[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 12:08:06.412575 12986 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.12.174.190:35713
I20260709 12:08:06.414556 12986 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 12:08:06.415966 12986 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:08:06.445832 12993 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:07.841624 12991 debug-util.cc:398] Leaking SignalData structure 0x7b080000f040 after lost signal to thread 12986
W20260709 12:08:08.203049 12986 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.760s	user 0.746s	sys 1.012s
W20260709 12:08:08.205600 12986 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.763s	user 0.747s	sys 1.013s
W20260709 12:08:06.446485 12992 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:08.209470 12995 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:08.211627 12986 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
W20260709 12:08:08.211570 12994 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1761 milliseconds
I20260709 12:08:08.213110 12986 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:08:08.213348 12986 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:08:08.213508 12986 hybrid_clock.cc:648] HybridClock initialized: now 1783598888213492 us; error 0 us; skew 500 ppm
I20260709 12:08:08.214386 12986 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:08:08.223556 12986 webserver.cc:533] Webserver started at http://127.12.174.190:35167/ using document root <none> and password file <none>
I20260709 12:08:08.224537 12986 fs_manager.cc:362] Metadata directory not provided
I20260709 12:08:08.224753 12986 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:08:08.225243 12986 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:08:08.233032 12986 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598886212958-12986-0/minicluster-data/master-0-root/instance:
uuid: "25527fcd02554e7f8fd5a6c77edc5a83"
format_stamp: "Formatted at 2026-07-09 12:08:08 on dist-test-slave-9q7n"
I20260709 12:08:08.244841 12986 fs_manager.cc:696] Time spent creating directory manager: real 0.011s	user 0.004s	sys 0.004s
I20260709 12:08:08.253048 13001 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:08.254710 12986 fs_manager.cc:730] Time spent opening block manager: real 0.007s	user 0.000s	sys 0.006s
I20260709 12:08:08.255177 12986 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598886212958-12986-0/minicluster-data/master-0-root
uuid: "25527fcd02554e7f8fd5a6c77edc5a83"
format_stamp: "Formatted at 2026-07-09 12:08:08 on dist-test-slave-9q7n"
I20260709 12:08:08.255578 12986 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598886212958-12986-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598886212958-12986-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598886212958-12986-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:08:08.331372 12986 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:08:08.333982 12986 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 12:08:08.334662 12986 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:08:08.597882 12986 rpc_server.cc:307] RPC server started. Bound to: 127.12.174.190:35713
I20260709 12:08:08.598192 13052 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.174.190:35713 every 8 connection(s)
I20260709 12:08:08.614411 13053 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:08.662328 13053 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 25527fcd02554e7f8fd5a6c77edc5a83: Bootstrap starting.
I20260709 12:08:08.675736 13053 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 25527fcd02554e7f8fd5a6c77edc5a83: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:08.680043 13053 log.cc:826] T 00000000000000000000000000000000 P 25527fcd02554e7f8fd5a6c77edc5a83: Log is configured to *not* fsync() on all Append() calls
I20260709 12:08:08.691314 13053 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 25527fcd02554e7f8fd5a6c77edc5a83: No bootstrap required, opened a new log
I20260709 12:08:08.730389 13053 raft_consensus.cc:359] T 00000000000000000000000000000000 P 25527fcd02554e7f8fd5a6c77edc5a83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25527fcd02554e7f8fd5a6c77edc5a83" member_type: VOTER }
I20260709 12:08:08.731191 13053 raft_consensus.cc:385] T 00000000000000000000000000000000 P 25527fcd02554e7f8fd5a6c77edc5a83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:08.731590 13053 raft_consensus.cc:740] T 00000000000000000000000000000000 P 25527fcd02554e7f8fd5a6c77edc5a83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25527fcd02554e7f8fd5a6c77edc5a83, State: Initialized, Role: FOLLOWER
I20260709 12:08:08.733078 13053 consensus_queue.cc:260] T 00000000000000000000000000000000 P 25527fcd02554e7f8fd5a6c77edc5a83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25527fcd02554e7f8fd5a6c77edc5a83" member_type: VOTER }
I20260709 12:08:08.733865 13053 raft_consensus.cc:399] T 00000000000000000000000000000000 P 25527fcd02554e7f8fd5a6c77edc5a83 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:08:08.734298 13053 raft_consensus.cc:493] T 00000000000000000000000000000000 P 25527fcd02554e7f8fd5a6c77edc5a83 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:08:08.734804 13053 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 25527fcd02554e7f8fd5a6c77edc5a83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:08.744807 13053 raft_consensus.cc:515] T 00000000000000000000000000000000 P 25527fcd02554e7f8fd5a6c77edc5a83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25527fcd02554e7f8fd5a6c77edc5a83" member_type: VOTER }
I20260709 12:08:08.746050 13053 leader_election.cc:304] T 00000000000000000000000000000000 P 25527fcd02554e7f8fd5a6c77edc5a83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 25527fcd02554e7f8fd5a6c77edc5a83; no voters: 
I20260709 12:08:08.751358 13053 leader_election.cc:290] T 00000000000000000000000000000000 P 25527fcd02554e7f8fd5a6c77edc5a83 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:08:08.752137 13056 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 25527fcd02554e7f8fd5a6c77edc5a83 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:08.758909 13056 raft_consensus.cc:697] T 00000000000000000000000000000000 P 25527fcd02554e7f8fd5a6c77edc5a83 [term 1 LEADER]: Becoming Leader. State: Replica: 25527fcd02554e7f8fd5a6c77edc5a83, State: Running, Role: LEADER
I20260709 12:08:08.760727 13056 consensus_queue.cc:237] T 00000000000000000000000000000000 P 25527fcd02554e7f8fd5a6c77edc5a83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25527fcd02554e7f8fd5a6c77edc5a83" member_type: VOTER }
I20260709 12:08:08.762696 13053 sys_catalog.cc:565] T 00000000000000000000000000000000 P 25527fcd02554e7f8fd5a6c77edc5a83 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:08:08.782502 13057 sys_catalog.cc:455] T 00000000000000000000000000000000 P 25527fcd02554e7f8fd5a6c77edc5a83 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "25527fcd02554e7f8fd5a6c77edc5a83" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25527fcd02554e7f8fd5a6c77edc5a83" member_type: VOTER } }
I20260709 12:08:08.783855 13057 sys_catalog.cc:458] T 00000000000000000000000000000000 P 25527fcd02554e7f8fd5a6c77edc5a83 [sys.catalog]: This master's current role is: LEADER
I20260709 12:08:08.780593 13058 sys_catalog.cc:455] T 00000000000000000000000000000000 P 25527fcd02554e7f8fd5a6c77edc5a83 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 25527fcd02554e7f8fd5a6c77edc5a83. Latest consensus state: current_term: 1 leader_uuid: "25527fcd02554e7f8fd5a6c77edc5a83" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25527fcd02554e7f8fd5a6c77edc5a83" member_type: VOTER } }
I20260709 12:08:08.785809 13058 sys_catalog.cc:458] T 00000000000000000000000000000000 P 25527fcd02554e7f8fd5a6c77edc5a83 [sys.catalog]: This master's current role is: LEADER
I20260709 12:08:08.794938 13063 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:08:08.822394 13063 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:08:08.860867 12986 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:08:08.866799 13063 catalog_manager.cc:1383] Generated new cluster ID: 309efbfd025d432780df7b72b2f3d3f3
I20260709 12:08:08.867282 13063 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:08:08.896903 13063 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:08:08.899340 13063 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:08:08.921307 13063 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 25527fcd02554e7f8fd5a6c77edc5a83: Generated new TSK 0
I20260709 12:08:08.922778 13063 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:08:08.994186 12986 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:08:09.012362 13075 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:09.016762 13076 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:09.030310 12986 server_base.cc:1061] running on GCE node
W20260709 12:08:09.031821 13078 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:09.033000 12986 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:08:09.033248 12986 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:08:09.033416 12986 hybrid_clock.cc:648] HybridClock initialized: now 1783598889033396 us; error 0 us; skew 500 ppm
I20260709 12:08:09.034062 12986 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:08:09.042948 12986 webserver.cc:533] Webserver started at http://127.12.174.129:33719/ using document root <none> and password file <none>
I20260709 12:08:09.043706 12986 fs_manager.cc:362] Metadata directory not provided
I20260709 12:08:09.043927 12986 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:08:09.044243 12986 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:08:09.045680 12986 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598886212958-12986-0/minicluster-data/ts-0-root/instance:
uuid: "ba142a6ed214425084a138399cc5f489"
format_stamp: "Formatted at 2026-07-09 12:08:09 on dist-test-slave-9q7n"
I20260709 12:08:09.055994 12986 fs_manager.cc:696] Time spent creating directory manager: real 0.010s	user 0.009s	sys 0.000s
I20260709 12:08:09.066490 13083 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:09.067767 12986 fs_manager.cc:730] Time spent opening block manager: real 0.009s	user 0.001s	sys 0.007s
I20260709 12:08:09.068148 12986 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598886212958-12986-0/minicluster-data/ts-0-root
uuid: "ba142a6ed214425084a138399cc5f489"
format_stamp: "Formatted at 2026-07-09 12:08:09 on dist-test-slave-9q7n"
I20260709 12:08:09.068491 12986 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598886212958-12986-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598886212958-12986-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598886212958-12986-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:08:09.124536 12986 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:08:09.127422 12986 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:08:09.135382 12986 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:08:09.144007 12986 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:08:09.144371 12986 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:09.144655 12986 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:08:09.144984 12986 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:09.458537 12986 rpc_server.cc:307] RPC server started. Bound to: 127.12.174.129:36937
I20260709 12:08:09.458880 13145 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.174.129:36937 every 8 connection(s)
I20260709 12:08:09.481151 12986 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:08:09.504040 13150 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:09.508391 13151 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:09.524714 13146 heartbeater.cc:344] Connected to a master server at 127.12.174.190:35713
I20260709 12:08:09.525781 13146 heartbeater.cc:461] Registering TS with master...
I20260709 12:08:09.527858 12986 server_base.cc:1061] running on GCE node
I20260709 12:08:09.527935 13146 heartbeater.cc:507] Master 127.12.174.190:35713 requested a full tablet report, sending...
W20260709 12:08:09.531325 13153 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:09.532522 12986 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:08:09.532776 12986 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:08:09.532966 12986 hybrid_clock.cc:648] HybridClock initialized: now 1783598889532943 us; error 0 us; skew 500 ppm
I20260709 12:08:09.532964 13018 ts_manager.cc:194] Registered new tserver with Master: ba142a6ed214425084a138399cc5f489 (127.12.174.129:36937)
I20260709 12:08:09.533854 12986 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:08:09.537506 12986 webserver.cc:533] Webserver started at http://127.12.174.130:34867/ using document root <none> and password file <none>
I20260709 12:08:09.538167 12986 fs_manager.cc:362] Metadata directory not provided
I20260709 12:08:09.538002 13018 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53506
I20260709 12:08:09.538429 12986 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:08:09.538771 12986 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:08:09.539945 12986 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598886212958-12986-0/minicluster-data/ts-1-root/instance:
uuid: "8f34a4731ec24146b05167572a79008f"
format_stamp: "Formatted at 2026-07-09 12:08:09 on dist-test-slave-9q7n"
I20260709 12:08:09.547294 12986 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.007s	sys 0.001s
I20260709 12:08:09.552836 13158 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:09.554199 12986 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.002s	sys 0.003s
I20260709 12:08:09.554641 12986 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598886212958-12986-0/minicluster-data/ts-1-root
uuid: "8f34a4731ec24146b05167572a79008f"
format_stamp: "Formatted at 2026-07-09 12:08:09 on dist-test-slave-9q7n"
I20260709 12:08:09.555087 12986 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598886212958-12986-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598886212958-12986-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598886212958-12986-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:08:09.603124 12986 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:08:09.606175 12986 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:08:09.613842 12986 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:08:09.622032 12986 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:08:09.622363 12986 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:09.622705 12986 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:08:09.622934 12986 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:09.934064 12986 rpc_server.cc:307] RPC server started. Bound to: 127.12.174.130:45431
I20260709 12:08:09.934509 13220 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.174.130:45431 every 8 connection(s)
I20260709 12:08:09.949671 12986 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:08:09.970574 13224 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:09.973310 13221 heartbeater.cc:344] Connected to a master server at 127.12.174.190:35713
I20260709 12:08:09.974102 13221 heartbeater.cc:461] Registering TS with master...
I20260709 12:08:09.976279 13221 heartbeater.cc:507] Master 127.12.174.190:35713 requested a full tablet report, sending...
I20260709 12:08:09.980383 13018 ts_manager.cc:194] Registered new tserver with Master: 8f34a4731ec24146b05167572a79008f (127.12.174.130:45431)
W20260709 12:08:09.982075 13225 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:09.983510 13018 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53518
W20260709 12:08:09.991727 13227 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:09.997650 12986 server_base.cc:1061] running on GCE node
I20260709 12:08:10.000104 12986 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:08:10.000444 12986 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:08:10.000778 12986 hybrid_clock.cc:648] HybridClock initialized: now 1783598890000751 us; error 0 us; skew 500 ppm
I20260709 12:08:10.001570 12986 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:08:10.005128 12986 webserver.cc:533] Webserver started at http://127.12.174.131:35071/ using document root <none> and password file <none>
I20260709 12:08:10.005861 12986 fs_manager.cc:362] Metadata directory not provided
I20260709 12:08:10.006134 12986 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:08:10.006474 12986 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:08:10.008033 12986 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598886212958-12986-0/minicluster-data/ts-2-root/instance:
uuid: "b2e22ffd8266454f91a45727bd098a92"
format_stamp: "Formatted at 2026-07-09 12:08:10 on dist-test-slave-9q7n"
I20260709 12:08:10.015686 12986 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.001s	sys 0.008s
I20260709 12:08:10.020634 13232 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:10.021762 12986 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 12:08:10.022156 12986 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598886212958-12986-0/minicluster-data/ts-2-root
uuid: "b2e22ffd8266454f91a45727bd098a92"
format_stamp: "Formatted at 2026-07-09 12:08:10 on dist-test-slave-9q7n"
I20260709 12:08:10.022540 12986 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598886212958-12986-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598886212958-12986-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598886212958-12986-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:08:10.039188 12986 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:08:10.040607 12986 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:08:10.043103 12986 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:08:10.047497 12986 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:08:10.047816 12986 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:10.048162 12986 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:08:10.048389 12986 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:10.327782 12986 rpc_server.cc:307] RPC server started. Bound to: 127.12.174.131:40191
I20260709 12:08:10.328497 13294 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.174.131:40191 every 8 connection(s)
I20260709 12:08:10.366037 13295 heartbeater.cc:344] Connected to a master server at 127.12.174.190:35713
I20260709 12:08:10.366556 13295 heartbeater.cc:461] Registering TS with master...
I20260709 12:08:10.367877 13295 heartbeater.cc:507] Master 127.12.174.190:35713 requested a full tablet report, sending...
I20260709 12:08:10.371440 13018 ts_manager.cc:194] Registered new tserver with Master: b2e22ffd8266454f91a45727bd098a92 (127.12.174.131:40191)
I20260709 12:08:10.372270 12986 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.02474105s
I20260709 12:08:10.373607 13018 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53528
I20260709 12:08:10.477806 13018 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53536:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:08:10.484453 13018 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:08:10.544281 13146 heartbeater.cc:499] Master 127.12.174.190:35713 was elected leader, sending a full tablet report...
I20260709 12:08:10.705164 13186 tablet_service.cc:1511] Processing CreateTablet for tablet d5f3329ccf5b4ebf87e0eb8dc143b5d9 (DEFAULT_TABLE table=test-workload [id=db91781bf5974cc587e45c2d8c7f666c]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:08:10.714061 13185 tablet_service.cc:1511] Processing CreateTablet for tablet 3ff6b11516e44942a67136b30bc48aa1 (DEFAULT_TABLE table=test-workload [id=db91781bf5974cc587e45c2d8c7f666c]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:08:10.714489 13184 tablet_service.cc:1511] Processing CreateTablet for tablet db4772bfddd848238ef081fec351b1c9 (DEFAULT_TABLE table=test-workload [id=db91781bf5974cc587e45c2d8c7f666c]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:08:10.719238 13183 tablet_service.cc:1511] Processing CreateTablet for tablet 6a73bb3cf9eb4b4484c76c5ef49859f0 (DEFAULT_TABLE table=test-workload [id=db91781bf5974cc587e45c2d8c7f666c]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:08:10.733098 13182 tablet_service.cc:1511] Processing CreateTablet for tablet cb766527c41242e0ab211622b1f0e268 (DEFAULT_TABLE table=test-workload [id=db91781bf5974cc587e45c2d8c7f666c]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:08:10.727496 13181 tablet_service.cc:1511] Processing CreateTablet for tablet 15a6902d3ade4230a51ed07fb1663a27 (DEFAULT_TABLE table=test-workload [id=db91781bf5974cc587e45c2d8c7f666c]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:08:10.747036 13111 tablet_service.cc:1511] Processing CreateTablet for tablet d5f3329ccf5b4ebf87e0eb8dc143b5d9 (DEFAULT_TABLE table=test-workload [id=db91781bf5974cc587e45c2d8c7f666c]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:08:10.758018 13186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5f3329ccf5b4ebf87e0eb8dc143b5d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:10.754047 13110 tablet_service.cc:1511] Processing CreateTablet for tablet 3ff6b11516e44942a67136b30bc48aa1 (DEFAULT_TABLE table=test-workload [id=db91781bf5974cc587e45c2d8c7f666c]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:08:10.756104 13106 tablet_service.cc:1511] Processing CreateTablet for tablet 15a6902d3ade4230a51ed07fb1663a27 (DEFAULT_TABLE table=test-workload [id=db91781bf5974cc587e45c2d8c7f666c]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:08:10.765089 13109 tablet_service.cc:1511] Processing CreateTablet for tablet db4772bfddd848238ef081fec351b1c9 (DEFAULT_TABLE table=test-workload [id=db91781bf5974cc587e45c2d8c7f666c]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:08:10.761451 13108 tablet_service.cc:1511] Processing CreateTablet for tablet 6a73bb3cf9eb4b4484c76c5ef49859f0 (DEFAULT_TABLE table=test-workload [id=db91781bf5974cc587e45c2d8c7f666c]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:08:10.769395 13180 tablet_service.cc:1511] Processing CreateTablet for tablet 848ce1d9265c4134bcef148a91744c7c (DEFAULT_TABLE table=test-workload [id=db91781bf5974cc587e45c2d8c7f666c]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:08:10.764739 13107 tablet_service.cc:1511] Processing CreateTablet for tablet cb766527c41242e0ab211622b1f0e268 (DEFAULT_TABLE table=test-workload [id=db91781bf5974cc587e45c2d8c7f666c]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:08:10.767894 13105 tablet_service.cc:1511] Processing CreateTablet for tablet 848ce1d9265c4134bcef148a91744c7c (DEFAULT_TABLE table=test-workload [id=db91781bf5974cc587e45c2d8c7f666c]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:08:10.769415 13110 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ff6b11516e44942a67136b30bc48aa1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:10.776295 13183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a73bb3cf9eb4b4484c76c5ef49859f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:10.780356 13181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15a6902d3ade4230a51ed07fb1663a27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:10.782985 13182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb766527c41242e0ab211622b1f0e268. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:10.785969 13105 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 848ce1d9265c4134bcef148a91744c7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:10.798102 13259 tablet_service.cc:1511] Processing CreateTablet for tablet 3ff6b11516e44942a67136b30bc48aa1 (DEFAULT_TABLE table=test-workload [id=db91781bf5974cc587e45c2d8c7f666c]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:08:10.801752 13107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb766527c41242e0ab211622b1f0e268. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:10.803541 13185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ff6b11516e44942a67136b30bc48aa1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:10.785219 13104 tablet_service.cc:1511] Processing CreateTablet for tablet 8211beafbf81439d8629834dbbb3a6b9 (DEFAULT_TABLE table=test-workload [id=db91781bf5974cc587e45c2d8c7f666c]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:08:10.805954 13259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ff6b11516e44942a67136b30bc48aa1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:10.809178 13108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a73bb3cf9eb4b4484c76c5ef49859f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:10.810840 13178 tablet_service.cc:1511] Processing CreateTablet for tablet ad2b770d07aa404ca5c89bdf309b08f9 (DEFAULT_TABLE table=test-workload [id=db91781bf5974cc587e45c2d8c7f666c]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:08:10.815208 13184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db4772bfddd848238ef081fec351b1c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:10.813331 13106 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15a6902d3ade4230a51ed07fb1663a27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:10.818996 13180 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 848ce1d9265c4134bcef148a91744c7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:10.828814 13104 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8211beafbf81439d8629834dbbb3a6b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:10.837503 13178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad2b770d07aa404ca5c89bdf309b08f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:10.821414 13179 tablet_service.cc:1511] Processing CreateTablet for tablet 8211beafbf81439d8629834dbbb3a6b9 (DEFAULT_TABLE table=test-workload [id=db91781bf5974cc587e45c2d8c7f666c]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:08:10.838454 13257 tablet_service.cc:1511] Processing CreateTablet for tablet 6a73bb3cf9eb4b4484c76c5ef49859f0 (DEFAULT_TABLE table=test-workload [id=db91781bf5974cc587e45c2d8c7f666c]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:08:10.829221 13260 tablet_service.cc:1511] Processing CreateTablet for tablet d5f3329ccf5b4ebf87e0eb8dc143b5d9 (DEFAULT_TABLE table=test-workload [id=db91781bf5974cc587e45c2d8c7f666c]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:08:10.851497 13109 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db4772bfddd848238ef081fec351b1c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:10.842895 13255 tablet_service.cc:1511] Processing CreateTablet for tablet 15a6902d3ade4230a51ed07fb1663a27 (DEFAULT_TABLE table=test-workload [id=db91781bf5974cc587e45c2d8c7f666c]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:08:10.838236 13103 tablet_service.cc:1511] Processing CreateTablet for tablet ad2b770d07aa404ca5c89bdf309b08f9 (DEFAULT_TABLE table=test-workload [id=db91781bf5974cc587e45c2d8c7f666c]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:08:10.845083 13254 tablet_service.cc:1511] Processing CreateTablet for tablet 848ce1d9265c4134bcef148a91744c7c (DEFAULT_TABLE table=test-workload [id=db91781bf5974cc587e45c2d8c7f666c]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:08:10.841192 13258 tablet_service.cc:1511] Processing CreateTablet for tablet db4772bfddd848238ef081fec351b1c9 (DEFAULT_TABLE table=test-workload [id=db91781bf5974cc587e45c2d8c7f666c]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:08:10.874526 13111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5f3329ccf5b4ebf87e0eb8dc143b5d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:10.845256 13256 tablet_service.cc:1511] Processing CreateTablet for tablet cb766527c41242e0ab211622b1f0e268 (DEFAULT_TABLE table=test-workload [id=db91781bf5974cc587e45c2d8c7f666c]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:08:10.907615 13252 tablet_service.cc:1511] Processing CreateTablet for tablet ad2b770d07aa404ca5c89bdf309b08f9 (DEFAULT_TABLE table=test-workload [id=db91781bf5974cc587e45c2d8c7f666c]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:08:10.919476 13179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8211beafbf81439d8629834dbbb3a6b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:10.922087 13103 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad2b770d07aa404ca5c89bdf309b08f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:10.874624 13253 tablet_service.cc:1511] Processing CreateTablet for tablet 8211beafbf81439d8629834dbbb3a6b9 (DEFAULT_TABLE table=test-workload [id=db91781bf5974cc587e45c2d8c7f666c]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:08:10.930169 13257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a73bb3cf9eb4b4484c76c5ef49859f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:10.939344 13258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db4772bfddd848238ef081fec351b1c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:10.942616 13253 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8211beafbf81439d8629834dbbb3a6b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:10.946411 13255 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15a6902d3ade4230a51ed07fb1663a27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:10.953972 13260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5f3329ccf5b4ebf87e0eb8dc143b5d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:10.957266 13254 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 848ce1d9265c4134bcef148a91744c7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:10.964005 13252 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad2b770d07aa404ca5c89bdf309b08f9. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:08:10.959200 13067 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:08:10.988312 13256 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb766527c41242e0ab211622b1f0e268. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:10.990172 13221 heartbeater.cc:499] Master 127.12.174.190:35713 was elected leader, sending a full tablet report...
I20260709 12:08:11.184372 13314 tablet_bootstrap.cc:492] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P b2e22ffd8266454f91a45727bd098a92: Bootstrap starting.
I20260709 12:08:11.185025 13315 tablet_bootstrap.cc:492] T 8211beafbf81439d8629834dbbb3a6b9 P ba142a6ed214425084a138399cc5f489: Bootstrap starting.
I20260709 12:08:11.213662 13316 tablet_bootstrap.cc:492] T d5f3329ccf5b4ebf87e0eb8dc143b5d9 P 8f34a4731ec24146b05167572a79008f: Bootstrap starting.
I20260709 12:08:11.321275 13315 tablet_bootstrap.cc:654] T 8211beafbf81439d8629834dbbb3a6b9 P ba142a6ed214425084a138399cc5f489: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:11.322732 13316 tablet_bootstrap.cc:654] T d5f3329ccf5b4ebf87e0eb8dc143b5d9 P 8f34a4731ec24146b05167572a79008f: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:11.331043 13314 tablet_bootstrap.cc:654] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P b2e22ffd8266454f91a45727bd098a92: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:11.342980 13316 tablet_bootstrap.cc:492] T d5f3329ccf5b4ebf87e0eb8dc143b5d9 P 8f34a4731ec24146b05167572a79008f: No bootstrap required, opened a new log
I20260709 12:08:11.343861 13316 ts_tablet_manager.cc:1403] T d5f3329ccf5b4ebf87e0eb8dc143b5d9 P 8f34a4731ec24146b05167572a79008f: Time spent bootstrapping tablet: real 0.150s	user 0.009s	sys 0.019s
I20260709 12:08:11.349232 13314 tablet_bootstrap.cc:492] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P b2e22ffd8266454f91a45727bd098a92: No bootstrap required, opened a new log
I20260709 12:08:11.350200 13314 ts_tablet_manager.cc:1403] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P b2e22ffd8266454f91a45727bd098a92: Time spent bootstrapping tablet: real 0.202s	user 0.016s	sys 0.018s
I20260709 12:08:11.350857 13315 tablet_bootstrap.cc:492] T 8211beafbf81439d8629834dbbb3a6b9 P ba142a6ed214425084a138399cc5f489: No bootstrap required, opened a new log
I20260709 12:08:11.351513 13315 ts_tablet_manager.cc:1403] T 8211beafbf81439d8629834dbbb3a6b9 P ba142a6ed214425084a138399cc5f489: Time spent bootstrapping tablet: real 0.188s	user 0.020s	sys 0.021s
I20260709 12:08:11.351503 13316 raft_consensus.cc:359] T d5f3329ccf5b4ebf87e0eb8dc143b5d9 P 8f34a4731ec24146b05167572a79008f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:11.352867 13316 raft_consensus.cc:385] T d5f3329ccf5b4ebf87e0eb8dc143b5d9 P 8f34a4731ec24146b05167572a79008f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:11.353560 13316 raft_consensus.cc:740] T d5f3329ccf5b4ebf87e0eb8dc143b5d9 P 8f34a4731ec24146b05167572a79008f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f34a4731ec24146b05167572a79008f, State: Initialized, Role: FOLLOWER
I20260709 12:08:11.355289 13316 consensus_queue.cc:260] T d5f3329ccf5b4ebf87e0eb8dc143b5d9 P 8f34a4731ec24146b05167572a79008f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:11.359279 13315 raft_consensus.cc:359] T 8211beafbf81439d8629834dbbb3a6b9 P ba142a6ed214425084a138399cc5f489 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:11.360730 13315 raft_consensus.cc:385] T 8211beafbf81439d8629834dbbb3a6b9 P ba142a6ed214425084a138399cc5f489 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:11.361270 13315 raft_consensus.cc:740] T 8211beafbf81439d8629834dbbb3a6b9 P ba142a6ed214425084a138399cc5f489 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba142a6ed214425084a138399cc5f489, State: Initialized, Role: FOLLOWER
I20260709 12:08:11.359287 13314 raft_consensus.cc:359] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P b2e22ffd8266454f91a45727bd098a92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:11.362880 13315 consensus_queue.cc:260] T 8211beafbf81439d8629834dbbb3a6b9 P ba142a6ed214425084a138399cc5f489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:11.363711 13314 raft_consensus.cc:385] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P b2e22ffd8266454f91a45727bd098a92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:11.364204 13314 raft_consensus.cc:740] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P b2e22ffd8266454f91a45727bd098a92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2e22ffd8266454f91a45727bd098a92, State: Initialized, Role: FOLLOWER
I20260709 12:08:11.365693 13314 consensus_queue.cc:260] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P b2e22ffd8266454f91a45727bd098a92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:11.371407 13316 ts_tablet_manager.cc:1434] T d5f3329ccf5b4ebf87e0eb8dc143b5d9 P 8f34a4731ec24146b05167572a79008f: Time spent starting tablet: real 0.027s	user 0.015s	sys 0.010s
I20260709 12:08:11.377664 13316 tablet_bootstrap.cc:492] T cb766527c41242e0ab211622b1f0e268 P 8f34a4731ec24146b05167572a79008f: Bootstrap starting.
I20260709 12:08:11.379158 13295 heartbeater.cc:499] Master 127.12.174.190:35713 was elected leader, sending a full tablet report...
I20260709 12:08:11.390812 13315 ts_tablet_manager.cc:1434] T 8211beafbf81439d8629834dbbb3a6b9 P ba142a6ed214425084a138399cc5f489: Time spent starting tablet: real 0.039s	user 0.018s	sys 0.005s
I20260709 12:08:11.392921 13315 tablet_bootstrap.cc:492] T d5f3329ccf5b4ebf87e0eb8dc143b5d9 P ba142a6ed214425084a138399cc5f489: Bootstrap starting.
I20260709 12:08:11.394912 13314 ts_tablet_manager.cc:1434] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P b2e22ffd8266454f91a45727bd098a92: Time spent starting tablet: real 0.044s	user 0.010s	sys 0.014s
I20260709 12:08:11.396449 13314 tablet_bootstrap.cc:492] T 8211beafbf81439d8629834dbbb3a6b9 P b2e22ffd8266454f91a45727bd098a92: Bootstrap starting.
I20260709 12:08:11.409647 13316 tablet_bootstrap.cc:654] T cb766527c41242e0ab211622b1f0e268 P 8f34a4731ec24146b05167572a79008f: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:11.410220 13315 tablet_bootstrap.cc:654] T d5f3329ccf5b4ebf87e0eb8dc143b5d9 P ba142a6ed214425084a138399cc5f489: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:11.418140 13320 raft_consensus.cc:493] T d5f3329ccf5b4ebf87e0eb8dc143b5d9 P 8f34a4731ec24146b05167572a79008f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:11.418918 13320 raft_consensus.cc:515] T d5f3329ccf5b4ebf87e0eb8dc143b5d9 P 8f34a4731ec24146b05167572a79008f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:11.424119 13314 tablet_bootstrap.cc:654] T 8211beafbf81439d8629834dbbb3a6b9 P b2e22ffd8266454f91a45727bd098a92: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:11.441387 13315 tablet_bootstrap.cc:492] T d5f3329ccf5b4ebf87e0eb8dc143b5d9 P ba142a6ed214425084a138399cc5f489: No bootstrap required, opened a new log
I20260709 12:08:11.442232 13315 ts_tablet_manager.cc:1403] T d5f3329ccf5b4ebf87e0eb8dc143b5d9 P ba142a6ed214425084a138399cc5f489: Time spent bootstrapping tablet: real 0.050s	user 0.010s	sys 0.027s
I20260709 12:08:11.437120 13320 leader_election.cc:290] T d5f3329ccf5b4ebf87e0eb8dc143b5d9 P 8f34a4731ec24146b05167572a79008f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ba142a6ed214425084a138399cc5f489 (127.12.174.129:36937), b2e22ffd8266454f91a45727bd098a92 (127.12.174.131:40191)
I20260709 12:08:11.448107 13315 raft_consensus.cc:359] T d5f3329ccf5b4ebf87e0eb8dc143b5d9 P ba142a6ed214425084a138399cc5f489 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:11.449260 13315 raft_consensus.cc:385] T d5f3329ccf5b4ebf87e0eb8dc143b5d9 P ba142a6ed214425084a138399cc5f489 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:11.449846 13315 raft_consensus.cc:740] T d5f3329ccf5b4ebf87e0eb8dc143b5d9 P ba142a6ed214425084a138399cc5f489 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba142a6ed214425084a138399cc5f489, State: Initialized, Role: FOLLOWER
I20260709 12:08:11.450973 13315 consensus_queue.cc:260] T d5f3329ccf5b4ebf87e0eb8dc143b5d9 P ba142a6ed214425084a138399cc5f489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:11.456538 13315 ts_tablet_manager.cc:1434] T d5f3329ccf5b4ebf87e0eb8dc143b5d9 P ba142a6ed214425084a138399cc5f489: Time spent starting tablet: real 0.014s	user 0.012s	sys 0.000s
I20260709 12:08:11.457473 13316 tablet_bootstrap.cc:492] T cb766527c41242e0ab211622b1f0e268 P 8f34a4731ec24146b05167572a79008f: No bootstrap required, opened a new log
I20260709 12:08:11.458209 13316 ts_tablet_manager.cc:1403] T cb766527c41242e0ab211622b1f0e268 P 8f34a4731ec24146b05167572a79008f: Time spent bootstrapping tablet: real 0.084s	user 0.013s	sys 0.021s
I20260709 12:08:11.459188 13315 tablet_bootstrap.cc:492] T ad2b770d07aa404ca5c89bdf309b08f9 P ba142a6ed214425084a138399cc5f489: Bootstrap starting.
W20260709 12:08:11.462517 13222 tablet.cc:2406] T d5f3329ccf5b4ebf87e0eb8dc143b5d9 P 8f34a4731ec24146b05167572a79008f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:08:11.465611 13314 tablet_bootstrap.cc:492] T 8211beafbf81439d8629834dbbb3a6b9 P b2e22ffd8266454f91a45727bd098a92: No bootstrap required, opened a new log
I20260709 12:08:11.468353 13314 ts_tablet_manager.cc:1403] T 8211beafbf81439d8629834dbbb3a6b9 P b2e22ffd8266454f91a45727bd098a92: Time spent bootstrapping tablet: real 0.072s	user 0.025s	sys 0.007s
I20260709 12:08:11.477957 13316 raft_consensus.cc:359] T cb766527c41242e0ab211622b1f0e268 P 8f34a4731ec24146b05167572a79008f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:11.479132 13316 raft_consensus.cc:385] T cb766527c41242e0ab211622b1f0e268 P 8f34a4731ec24146b05167572a79008f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:11.479652 13316 raft_consensus.cc:740] T cb766527c41242e0ab211622b1f0e268 P 8f34a4731ec24146b05167572a79008f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f34a4731ec24146b05167572a79008f, State: Initialized, Role: FOLLOWER
I20260709 12:08:11.482136 13314 raft_consensus.cc:359] T 8211beafbf81439d8629834dbbb3a6b9 P b2e22ffd8266454f91a45727bd098a92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:11.480791 13316 consensus_queue.cc:260] T cb766527c41242e0ab211622b1f0e268 P 8f34a4731ec24146b05167572a79008f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:11.483292 13314 raft_consensus.cc:385] T 8211beafbf81439d8629834dbbb3a6b9 P b2e22ffd8266454f91a45727bd098a92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:11.486095 13314 raft_consensus.cc:740] T 8211beafbf81439d8629834dbbb3a6b9 P b2e22ffd8266454f91a45727bd098a92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2e22ffd8266454f91a45727bd098a92, State: Initialized, Role: FOLLOWER
I20260709 12:08:11.488031 13316 ts_tablet_manager.cc:1434] T cb766527c41242e0ab211622b1f0e268 P 8f34a4731ec24146b05167572a79008f: Time spent starting tablet: real 0.029s	user 0.009s	sys 0.002s
I20260709 12:08:11.492384 13316 tablet_bootstrap.cc:492] T db4772bfddd848238ef081fec351b1c9 P 8f34a4731ec24146b05167572a79008f: Bootstrap starting.
I20260709 12:08:11.490231 13314 consensus_queue.cc:260] T 8211beafbf81439d8629834dbbb3a6b9 P b2e22ffd8266454f91a45727bd098a92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:11.495468 13314 ts_tablet_manager.cc:1434] T 8211beafbf81439d8629834dbbb3a6b9 P b2e22ffd8266454f91a45727bd098a92: Time spent starting tablet: real 0.027s	user 0.011s	sys 0.000s
I20260709 12:08:11.501757 13314 tablet_bootstrap.cc:492] T 3ff6b11516e44942a67136b30bc48aa1 P b2e22ffd8266454f91a45727bd098a92: Bootstrap starting.
I20260709 12:08:11.510211 13315 tablet_bootstrap.cc:654] T ad2b770d07aa404ca5c89bdf309b08f9 P ba142a6ed214425084a138399cc5f489: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:11.534070 13314 tablet_bootstrap.cc:654] T 3ff6b11516e44942a67136b30bc48aa1 P b2e22ffd8266454f91a45727bd098a92: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:11.538849 13316 tablet_bootstrap.cc:654] T db4772bfddd848238ef081fec351b1c9 P 8f34a4731ec24146b05167572a79008f: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:11.541975 13321 raft_consensus.cc:493] T 8211beafbf81439d8629834dbbb3a6b9 P ba142a6ed214425084a138399cc5f489 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:11.543010 13321 raft_consensus.cc:515] T 8211beafbf81439d8629834dbbb3a6b9 P ba142a6ed214425084a138399cc5f489 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:11.549389 13322 raft_consensus.cc:493] T 8211beafbf81439d8629834dbbb3a6b9 P b2e22ffd8266454f91a45727bd098a92 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:11.549129 13121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f3329ccf5b4ebf87e0eb8dc143b5d9" candidate_uuid: "8f34a4731ec24146b05167572a79008f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba142a6ed214425084a138399cc5f489" is_pre_election: true
I20260709 12:08:11.550321 13322 raft_consensus.cc:515] T 8211beafbf81439d8629834dbbb3a6b9 P b2e22ffd8266454f91a45727bd098a92 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:11.550714 13121 raft_consensus.cc:2468] T d5f3329ccf5b4ebf87e0eb8dc143b5d9 P ba142a6ed214425084a138399cc5f489 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f34a4731ec24146b05167572a79008f in term 0.
I20260709 12:08:11.558854 13162 leader_election.cc:304] T d5f3329ccf5b4ebf87e0eb8dc143b5d9 P 8f34a4731ec24146b05167572a79008f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f34a4731ec24146b05167572a79008f, ba142a6ed214425084a138399cc5f489; no voters: 
I20260709 12:08:11.561889 13320 raft_consensus.cc:2804] T d5f3329ccf5b4ebf87e0eb8dc143b5d9 P 8f34a4731ec24146b05167572a79008f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:11.562678 13320 raft_consensus.cc:493] T d5f3329ccf5b4ebf87e0eb8dc143b5d9 P 8f34a4731ec24146b05167572a79008f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:11.563760 13320 raft_consensus.cc:3060] T d5f3329ccf5b4ebf87e0eb8dc143b5d9 P 8f34a4731ec24146b05167572a79008f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:11.572734 13321 leader_election.cc:290] T 8211beafbf81439d8629834dbbb3a6b9 P ba142a6ed214425084a138399cc5f489 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f34a4731ec24146b05167572a79008f (127.12.174.130:45431), b2e22ffd8266454f91a45727bd098a92 (127.12.174.131:40191)
I20260709 12:08:11.568572 13322 leader_election.cc:290] T 8211beafbf81439d8629834dbbb3a6b9 P b2e22ffd8266454f91a45727bd098a92 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ba142a6ed214425084a138399cc5f489 (127.12.174.129:36937), 8f34a4731ec24146b05167572a79008f (127.12.174.130:45431)
I20260709 12:08:11.616670 13320 raft_consensus.cc:515] T d5f3329ccf5b4ebf87e0eb8dc143b5d9 P 8f34a4731ec24146b05167572a79008f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:11.638468 13121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f3329ccf5b4ebf87e0eb8dc143b5d9" candidate_uuid: "8f34a4731ec24146b05167572a79008f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba142a6ed214425084a138399cc5f489"
I20260709 12:08:11.641288 13121 raft_consensus.cc:3060] T d5f3329ccf5b4ebf87e0eb8dc143b5d9 P ba142a6ed214425084a138399cc5f489 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:11.646365 13320 leader_election.cc:290] T d5f3329ccf5b4ebf87e0eb8dc143b5d9 P 8f34a4731ec24146b05167572a79008f [CANDIDATE]: Term 1 election: Requested vote from peers ba142a6ed214425084a138399cc5f489 (127.12.174.129:36937), b2e22ffd8266454f91a45727bd098a92 (127.12.174.131:40191)
I20260709 12:08:11.649243 13315 tablet_bootstrap.cc:492] T ad2b770d07aa404ca5c89bdf309b08f9 P ba142a6ed214425084a138399cc5f489: No bootstrap required, opened a new log
I20260709 12:08:11.650085 13315 ts_tablet_manager.cc:1403] T ad2b770d07aa404ca5c89bdf309b08f9 P ba142a6ed214425084a138399cc5f489: Time spent bootstrapping tablet: real 0.191s	user 0.017s	sys 0.042s
I20260709 12:08:11.656489 13315 raft_consensus.cc:359] T ad2b770d07aa404ca5c89bdf309b08f9 P ba142a6ed214425084a138399cc5f489 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:11.661603 13315 raft_consensus.cc:385] T ad2b770d07aa404ca5c89bdf309b08f9 P ba142a6ed214425084a138399cc5f489 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:11.675196 13315 raft_consensus.cc:740] T ad2b770d07aa404ca5c89bdf309b08f9 P ba142a6ed214425084a138399cc5f489 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba142a6ed214425084a138399cc5f489, State: Initialized, Role: FOLLOWER
I20260709 12:08:11.681583 13320 raft_consensus.cc:493] T cb766527c41242e0ab211622b1f0e268 P 8f34a4731ec24146b05167572a79008f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:11.714454 13320 raft_consensus.cc:515] T cb766527c41242e0ab211622b1f0e268 P 8f34a4731ec24146b05167572a79008f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:11.721323 13269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f3329ccf5b4ebf87e0eb8dc143b5d9" candidate_uuid: "8f34a4731ec24146b05167572a79008f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2e22ffd8266454f91a45727bd098a92"
I20260709 12:08:11.721937 13320 leader_election.cc:290] T cb766527c41242e0ab211622b1f0e268 P 8f34a4731ec24146b05167572a79008f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ba142a6ed214425084a138399cc5f489 (127.12.174.129:36937), b2e22ffd8266454f91a45727bd098a92 (127.12.174.131:40191)
I20260709 12:08:11.717604 13315 consensus_queue.cc:260] T ad2b770d07aa404ca5c89bdf309b08f9 P ba142a6ed214425084a138399cc5f489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:11.701345 13270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f3329ccf5b4ebf87e0eb8dc143b5d9" candidate_uuid: "8f34a4731ec24146b05167572a79008f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2e22ffd8266454f91a45727bd098a92" is_pre_election: true
I20260709 12:08:11.728904 13120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb766527c41242e0ab211622b1f0e268" candidate_uuid: "8f34a4731ec24146b05167572a79008f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba142a6ed214425084a138399cc5f489" is_pre_election: true
I20260709 12:08:11.733407 13316 tablet_bootstrap.cc:492] T db4772bfddd848238ef081fec351b1c9 P 8f34a4731ec24146b05167572a79008f: No bootstrap required, opened a new log
W20260709 12:08:11.733287 13162 leader_election.cc:343] T cb766527c41242e0ab211622b1f0e268 P 8f34a4731ec24146b05167572a79008f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba142a6ed214425084a138399cc5f489 (127.12.174.129:36937): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:11.741853 13314 tablet_bootstrap.cc:492] T 3ff6b11516e44942a67136b30bc48aa1 P b2e22ffd8266454f91a45727bd098a92: No bootstrap required, opened a new log
I20260709 12:08:11.742115 13316 ts_tablet_manager.cc:1403] T db4772bfddd848238ef081fec351b1c9 P 8f34a4731ec24146b05167572a79008f: Time spent bootstrapping tablet: real 0.252s	user 0.020s	sys 0.016s
I20260709 12:08:11.742595 13314 ts_tablet_manager.cc:1403] T 3ff6b11516e44942a67136b30bc48aa1 P b2e22ffd8266454f91a45727bd098a92: Time spent bootstrapping tablet: real 0.241s	user 0.024s	sys 0.016s
I20260709 12:08:11.744412 13315 ts_tablet_manager.cc:1434] T ad2b770d07aa404ca5c89bdf309b08f9 P ba142a6ed214425084a138399cc5f489: Time spent starting tablet: real 0.094s	user 0.014s	sys 0.000s
I20260709 12:08:11.745414 13270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb766527c41242e0ab211622b1f0e268" candidate_uuid: "8f34a4731ec24146b05167572a79008f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2e22ffd8266454f91a45727bd098a92" is_pre_election: true
I20260709 12:08:11.753189 13268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8211beafbf81439d8629834dbbb3a6b9" candidate_uuid: "ba142a6ed214425084a138399cc5f489" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2e22ffd8266454f91a45727bd098a92" is_pre_election: true
W20260709 12:08:11.750808 13162 leader_election.cc:343] T d5f3329ccf5b4ebf87e0eb8dc143b5d9 P 8f34a4731ec24146b05167572a79008f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2e22ffd8266454f91a45727bd098a92 (127.12.174.131:40191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:11.756547 13315 tablet_bootstrap.cc:492] T 3ff6b11516e44942a67136b30bc48aa1 P ba142a6ed214425084a138399cc5f489: Bootstrap starting.
I20260709 12:08:11.760181 13268 raft_consensus.cc:2468] T 8211beafbf81439d8629834dbbb3a6b9 P b2e22ffd8266454f91a45727bd098a92 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba142a6ed214425084a138399cc5f489 in term 0.
W20260709 12:08:11.758479 13162 leader_election.cc:343] T d5f3329ccf5b4ebf87e0eb8dc143b5d9 P 8f34a4731ec24146b05167572a79008f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b2e22ffd8266454f91a45727bd098a92 (127.12.174.131:40191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:11.766275 13196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8211beafbf81439d8629834dbbb3a6b9" candidate_uuid: "ba142a6ed214425084a138399cc5f489" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f34a4731ec24146b05167572a79008f" is_pre_election: true
I20260709 12:08:11.769795 13121 raft_consensus.cc:2468] T d5f3329ccf5b4ebf87e0eb8dc143b5d9 P ba142a6ed214425084a138399cc5f489 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f34a4731ec24146b05167572a79008f in term 1.
W20260709 12:08:11.769155 13162 leader_election.cc:343] T cb766527c41242e0ab211622b1f0e268 P 8f34a4731ec24146b05167572a79008f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2e22ffd8266454f91a45727bd098a92 (127.12.174.131:40191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:11.768965 13314 raft_consensus.cc:359] T 3ff6b11516e44942a67136b30bc48aa1 P b2e22ffd8266454f91a45727bd098a92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:11.769726 13087 leader_election.cc:304] T 8211beafbf81439d8629834dbbb3a6b9 P ba142a6ed214425084a138399cc5f489 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2e22ffd8266454f91a45727bd098a92, ba142a6ed214425084a138399cc5f489; no voters: 
I20260709 12:08:11.773696 13314 raft_consensus.cc:385] T 3ff6b11516e44942a67136b30bc48aa1 P b2e22ffd8266454f91a45727bd098a92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:11.774894 13321 raft_consensus.cc:2804] T 8211beafbf81439d8629834dbbb3a6b9 P ba142a6ed214425084a138399cc5f489 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:11.774886 13314 raft_consensus.cc:740] T 3ff6b11516e44942a67136b30bc48aa1 P b2e22ffd8266454f91a45727bd098a92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2e22ffd8266454f91a45727bd098a92, State: Initialized, Role: FOLLOWER
W20260709 12:08:11.775229 13086 leader_election.cc:343] T 8211beafbf81439d8629834dbbb3a6b9 P ba142a6ed214425084a138399cc5f489 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8f34a4731ec24146b05167572a79008f (127.12.174.130:45431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:11.775990 13321 raft_consensus.cc:493] T 8211beafbf81439d8629834dbbb3a6b9 P ba142a6ed214425084a138399cc5f489 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:11.772161 13162 leader_election.cc:304] T cb766527c41242e0ab211622b1f0e268 P 8f34a4731ec24146b05167572a79008f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8f34a4731ec24146b05167572a79008f; no voters: b2e22ffd8266454f91a45727bd098a92, ba142a6ed214425084a138399cc5f489
I20260709 12:08:11.776829 13321 raft_consensus.cc:3060] T 8211beafbf81439d8629834dbbb3a6b9 P ba142a6ed214425084a138399cc5f489 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:11.770352 13316 raft_consensus.cc:359] T db4772bfddd848238ef081fec351b1c9 P 8f34a4731ec24146b05167572a79008f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:11.778010 13320 raft_consensus.cc:2749] T cb766527c41242e0ab211622b1f0e268 P 8f34a4731ec24146b05167572a79008f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:11.778223 13314 consensus_queue.cc:260] T 3ff6b11516e44942a67136b30bc48aa1 P b2e22ffd8266454f91a45727bd098a92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:11.785918 13162 leader_election.cc:304] T d5f3329ccf5b4ebf87e0eb8dc143b5d9 P 8f34a4731ec24146b05167572a79008f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8f34a4731ec24146b05167572a79008f, ba142a6ed214425084a138399cc5f489; no voters: b2e22ffd8266454f91a45727bd098a92
I20260709 12:08:11.781636 13316 raft_consensus.cc:385] T db4772bfddd848238ef081fec351b1c9 P 8f34a4731ec24146b05167572a79008f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:11.787685 13316 raft_consensus.cc:740] T db4772bfddd848238ef081fec351b1c9 P 8f34a4731ec24146b05167572a79008f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f34a4731ec24146b05167572a79008f, State: Initialized, Role: FOLLOWER
I20260709 12:08:11.789417 13320 raft_consensus.cc:2804] T d5f3329ccf5b4ebf87e0eb8dc143b5d9 P 8f34a4731ec24146b05167572a79008f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:11.788844 13316 consensus_queue.cc:260] T db4772bfddd848238ef081fec351b1c9 P 8f34a4731ec24146b05167572a79008f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:11.810374 13320 raft_consensus.cc:697] T d5f3329ccf5b4ebf87e0eb8dc143b5d9 P 8f34a4731ec24146b05167572a79008f [term 1 LEADER]: Becoming Leader. State: Replica: 8f34a4731ec24146b05167572a79008f, State: Running, Role: LEADER
I20260709 12:08:11.813833 13314 ts_tablet_manager.cc:1434] T 3ff6b11516e44942a67136b30bc48aa1 P b2e22ffd8266454f91a45727bd098a92: Time spent starting tablet: real 0.069s	user 0.007s	sys 0.008s
I20260709 12:08:11.813578 13121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8211beafbf81439d8629834dbbb3a6b9" candidate_uuid: "b2e22ffd8266454f91a45727bd098a92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba142a6ed214425084a138399cc5f489" is_pre_election: true
I20260709 12:08:11.816241 13320 consensus_queue.cc:237] T d5f3329ccf5b4ebf87e0eb8dc143b5d9 P 8f34a4731ec24146b05167572a79008f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:11.826422 13322 raft_consensus.cc:493] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P b2e22ffd8266454f91a45727bd098a92 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:11.826758 13340 raft_consensus.cc:493] T db4772bfddd848238ef081fec351b1c9 P 8f34a4731ec24146b05167572a79008f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:11.827170 13322 raft_consensus.cc:515] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P b2e22ffd8266454f91a45727bd098a92 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:11.821660 13315 tablet_bootstrap.cc:654] T 3ff6b11516e44942a67136b30bc48aa1 P ba142a6ed214425084a138399cc5f489: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:11.827709 13340 raft_consensus.cc:515] T db4772bfddd848238ef081fec351b1c9 P 8f34a4731ec24146b05167572a79008f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:11.838109 13322 leader_election.cc:290] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P b2e22ffd8266454f91a45727bd098a92 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ba142a6ed214425084a138399cc5f489 (127.12.174.129:36937), 8f34a4731ec24146b05167572a79008f (127.12.174.130:45431)
I20260709 12:08:11.833550 13314 tablet_bootstrap.cc:492] T 15a6902d3ade4230a51ed07fb1663a27 P b2e22ffd8266454f91a45727bd098a92: Bootstrap starting.
I20260709 12:08:11.838222 13120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a73bb3cf9eb4b4484c76c5ef49859f0" candidate_uuid: "b2e22ffd8266454f91a45727bd098a92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba142a6ed214425084a138399cc5f489" is_pre_election: true
W20260709 12:08:11.842192 13236 leader_election.cc:343] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P b2e22ffd8266454f91a45727bd098a92 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba142a6ed214425084a138399cc5f489 (127.12.174.129:36937): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:11.842643 13268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4772bfddd848238ef081fec351b1c9" candidate_uuid: "8f34a4731ec24146b05167572a79008f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2e22ffd8266454f91a45727bd098a92" is_pre_election: true
I20260709 12:08:11.843267 13119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4772bfddd848238ef081fec351b1c9" candidate_uuid: "8f34a4731ec24146b05167572a79008f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba142a6ed214425084a138399cc5f489" is_pre_election: true
W20260709 12:08:11.846001 13162 leader_election.cc:343] T db4772bfddd848238ef081fec351b1c9 P 8f34a4731ec24146b05167572a79008f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2e22ffd8266454f91a45727bd098a92 (127.12.174.131:40191): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:08:11.847985 13162 leader_election.cc:343] T db4772bfddd848238ef081fec351b1c9 P 8f34a4731ec24146b05167572a79008f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba142a6ed214425084a138399cc5f489 (127.12.174.129:36937): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:11.851168 13162 leader_election.cc:304] T db4772bfddd848238ef081fec351b1c9 P 8f34a4731ec24146b05167572a79008f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8f34a4731ec24146b05167572a79008f; no voters: b2e22ffd8266454f91a45727bd098a92, ba142a6ed214425084a138399cc5f489
I20260709 12:08:11.852427 13316 ts_tablet_manager.cc:1434] T db4772bfddd848238ef081fec351b1c9 P 8f34a4731ec24146b05167572a79008f: Time spent starting tablet: real 0.110s	user 0.007s	sys 0.011s
I20260709 12:08:11.854696 13316 tablet_bootstrap.cc:492] T 8211beafbf81439d8629834dbbb3a6b9 P 8f34a4731ec24146b05167572a79008f: Bootstrap starting.
I20260709 12:08:11.844306 13340 leader_election.cc:290] T db4772bfddd848238ef081fec351b1c9 P 8f34a4731ec24146b05167572a79008f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ba142a6ed214425084a138399cc5f489 (127.12.174.129:36937), b2e22ffd8266454f91a45727bd098a92 (127.12.174.131:40191)
I20260709 12:08:11.865983 13196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8211beafbf81439d8629834dbbb3a6b9" candidate_uuid: "b2e22ffd8266454f91a45727bd098a92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f34a4731ec24146b05167572a79008f" is_pre_election: true
I20260709 12:08:11.892863 13322 raft_consensus.cc:493] T 3ff6b11516e44942a67136b30bc48aa1 P b2e22ffd8266454f91a45727bd098a92 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:11.867846 13195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a73bb3cf9eb4b4484c76c5ef49859f0" candidate_uuid: "b2e22ffd8266454f91a45727bd098a92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f34a4731ec24146b05167572a79008f" is_pre_election: true
I20260709 12:08:11.896309 13322 raft_consensus.cc:515] T 3ff6b11516e44942a67136b30bc48aa1 P b2e22ffd8266454f91a45727bd098a92 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
W20260709 12:08:11.899986 13235 leader_election.cc:343] T 8211beafbf81439d8629834dbbb3a6b9 P b2e22ffd8266454f91a45727bd098a92 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8f34a4731ec24146b05167572a79008f (127.12.174.130:45431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:11.900391 13321 raft_consensus.cc:515] T 8211beafbf81439d8629834dbbb3a6b9 P ba142a6ed214425084a138399cc5f489 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:11.900899 13341 raft_consensus.cc:2749] T db4772bfddd848238ef081fec351b1c9 P 8f34a4731ec24146b05167572a79008f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:08:11.901279 13235 leader_election.cc:343] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P b2e22ffd8266454f91a45727bd098a92 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8f34a4731ec24146b05167572a79008f (127.12.174.130:45431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:11.901929 13235 leader_election.cc:304] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P b2e22ffd8266454f91a45727bd098a92 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2e22ffd8266454f91a45727bd098a92; no voters: 8f34a4731ec24146b05167572a79008f, ba142a6ed214425084a138399cc5f489
I20260709 12:08:11.905377 13119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff6b11516e44942a67136b30bc48aa1" candidate_uuid: "b2e22ffd8266454f91a45727bd098a92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba142a6ed214425084a138399cc5f489" is_pre_election: true
I20260709 12:08:11.902681 13121 raft_consensus.cc:2393] T 8211beafbf81439d8629834dbbb3a6b9 P ba142a6ed214425084a138399cc5f489 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2e22ffd8266454f91a45727bd098a92 in current term 1: Already voted for candidate ba142a6ed214425084a138399cc5f489 in this term.
I20260709 12:08:11.908121 13195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8211beafbf81439d8629834dbbb3a6b9" candidate_uuid: "ba142a6ed214425084a138399cc5f489" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f34a4731ec24146b05167572a79008f"
I20260709 12:08:11.910162 13315 tablet_bootstrap.cc:492] T 3ff6b11516e44942a67136b30bc48aa1 P ba142a6ed214425084a138399cc5f489: No bootstrap required, opened a new log
W20260709 12:08:11.910221 13086 leader_election.cc:343] T 8211beafbf81439d8629834dbbb3a6b9 P ba142a6ed214425084a138399cc5f489 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8f34a4731ec24146b05167572a79008f (127.12.174.130:45431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:11.911108 13322 leader_election.cc:290] T 3ff6b11516e44942a67136b30bc48aa1 P b2e22ffd8266454f91a45727bd098a92 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ba142a6ed214425084a138399cc5f489 (127.12.174.129:36937), 8f34a4731ec24146b05167572a79008f (127.12.174.130:45431)
I20260709 12:08:11.914220 13322 raft_consensus.cc:2749] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P b2e22ffd8266454f91a45727bd098a92 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:08:11.915345 13236 leader_election.cc:343] T 3ff6b11516e44942a67136b30bc48aa1 P b2e22ffd8266454f91a45727bd098a92 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba142a6ed214425084a138399cc5f489 (127.12.174.129:36937): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:11.923040 13268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8211beafbf81439d8629834dbbb3a6b9" candidate_uuid: "ba142a6ed214425084a138399cc5f489" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2e22ffd8266454f91a45727bd098a92"
I20260709 12:08:11.930665 13268 raft_consensus.cc:3060] T 8211beafbf81439d8629834dbbb3a6b9 P b2e22ffd8266454f91a45727bd098a92 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:11.931196 13236 leader_election.cc:304] T 8211beafbf81439d8629834dbbb3a6b9 P b2e22ffd8266454f91a45727bd098a92 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2e22ffd8266454f91a45727bd098a92; no voters: 8f34a4731ec24146b05167572a79008f, ba142a6ed214425084a138399cc5f489
I20260709 12:08:11.924862 13316 tablet_bootstrap.cc:654] T 8211beafbf81439d8629834dbbb3a6b9 P 8f34a4731ec24146b05167572a79008f: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:11.932266 13315 ts_tablet_manager.cc:1403] T 3ff6b11516e44942a67136b30bc48aa1 P ba142a6ed214425084a138399cc5f489: Time spent bootstrapping tablet: real 0.176s	user 0.032s	sys 0.028s
I20260709 12:08:11.933391 13314 tablet_bootstrap.cc:654] T 15a6902d3ade4230a51ed07fb1663a27 P b2e22ffd8266454f91a45727bd098a92: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:11.916757 13321 leader_election.cc:290] T 8211beafbf81439d8629834dbbb3a6b9 P ba142a6ed214425084a138399cc5f489 [CANDIDATE]: Term 1 election: Requested vote from peers 8f34a4731ec24146b05167572a79008f (127.12.174.130:45431), b2e22ffd8266454f91a45727bd098a92 (127.12.174.131:40191)
I20260709 12:08:11.937515 13195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff6b11516e44942a67136b30bc48aa1" candidate_uuid: "b2e22ffd8266454f91a45727bd098a92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f34a4731ec24146b05167572a79008f" is_pre_election: true
I20260709 12:08:11.935083 13016 catalog_manager.cc:5697] T d5f3329ccf5b4ebf87e0eb8dc143b5d9 P 8f34a4731ec24146b05167572a79008f reported cstate change: term changed from 0 to 1, leader changed from <none> to 8f34a4731ec24146b05167572a79008f (127.12.174.130). New cstate: current_term: 1 leader_uuid: "8f34a4731ec24146b05167572a79008f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } health_report { overall_health: UNKNOWN } } }
W20260709 12:08:11.946134 13235 leader_election.cc:343] T 3ff6b11516e44942a67136b30bc48aa1 P b2e22ffd8266454f91a45727bd098a92 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8f34a4731ec24146b05167572a79008f (127.12.174.130:45431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:11.946816 13235 leader_election.cc:304] T 3ff6b11516e44942a67136b30bc48aa1 P b2e22ffd8266454f91a45727bd098a92 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2e22ffd8266454f91a45727bd098a92; no voters: 8f34a4731ec24146b05167572a79008f, ba142a6ed214425084a138399cc5f489
I20260709 12:08:11.949205 13344 raft_consensus.cc:2749] T 3ff6b11516e44942a67136b30bc48aa1 P b2e22ffd8266454f91a45727bd098a92 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:11.954195 13315 raft_consensus.cc:359] T 3ff6b11516e44942a67136b30bc48aa1 P ba142a6ed214425084a138399cc5f489 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:11.955394 13315 raft_consensus.cc:385] T 3ff6b11516e44942a67136b30bc48aa1 P ba142a6ed214425084a138399cc5f489 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:11.958223 13315 raft_consensus.cc:740] T 3ff6b11516e44942a67136b30bc48aa1 P ba142a6ed214425084a138399cc5f489 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba142a6ed214425084a138399cc5f489, State: Initialized, Role: FOLLOWER
I20260709 12:08:11.959901 13315 consensus_queue.cc:260] T 3ff6b11516e44942a67136b30bc48aa1 P ba142a6ed214425084a138399cc5f489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:11.963308 13316 tablet_bootstrap.cc:492] T 8211beafbf81439d8629834dbbb3a6b9 P 8f34a4731ec24146b05167572a79008f: No bootstrap required, opened a new log
I20260709 12:08:11.964008 13316 ts_tablet_manager.cc:1403] T 8211beafbf81439d8629834dbbb3a6b9 P 8f34a4731ec24146b05167572a79008f: Time spent bootstrapping tablet: real 0.110s	user 0.017s	sys 0.011s
I20260709 12:08:11.965374 13314 tablet_bootstrap.cc:492] T 15a6902d3ade4230a51ed07fb1663a27 P b2e22ffd8266454f91a45727bd098a92: No bootstrap required, opened a new log
I20260709 12:08:11.963434 13315 ts_tablet_manager.cc:1434] T 3ff6b11516e44942a67136b30bc48aa1 P ba142a6ed214425084a138399cc5f489: Time spent starting tablet: real 0.031s	user 0.007s	sys 0.003s
I20260709 12:08:11.965937 13314 ts_tablet_manager.cc:1403] T 15a6902d3ade4230a51ed07fb1663a27 P b2e22ffd8266454f91a45727bd098a92: Time spent bootstrapping tablet: real 0.136s	user 0.013s	sys 0.022s
I20260709 12:08:11.968653 13315 tablet_bootstrap.cc:492] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P ba142a6ed214425084a138399cc5f489: Bootstrap starting.
I20260709 12:08:11.969678 13268 raft_consensus.cc:2468] T 8211beafbf81439d8629834dbbb3a6b9 P b2e22ffd8266454f91a45727bd098a92 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba142a6ed214425084a138399cc5f489 in term 1.
I20260709 12:08:11.970293 13322 raft_consensus.cc:2749] T 8211beafbf81439d8629834dbbb3a6b9 P b2e22ffd8266454f91a45727bd098a92 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:11.975382 13087 leader_election.cc:304] T 8211beafbf81439d8629834dbbb3a6b9 P ba142a6ed214425084a138399cc5f489 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b2e22ffd8266454f91a45727bd098a92, ba142a6ed214425084a138399cc5f489; no voters: 8f34a4731ec24146b05167572a79008f
I20260709 12:08:11.976980 13321 raft_consensus.cc:2804] T 8211beafbf81439d8629834dbbb3a6b9 P ba142a6ed214425084a138399cc5f489 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:11.978440 13316 raft_consensus.cc:359] T 8211beafbf81439d8629834dbbb3a6b9 P 8f34a4731ec24146b05167572a79008f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:11.982456 13316 raft_consensus.cc:385] T 8211beafbf81439d8629834dbbb3a6b9 P 8f34a4731ec24146b05167572a79008f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:11.983120 13316 raft_consensus.cc:740] T 8211beafbf81439d8629834dbbb3a6b9 P 8f34a4731ec24146b05167572a79008f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f34a4731ec24146b05167572a79008f, State: Initialized, Role: FOLLOWER
I20260709 12:08:11.984563 13316 consensus_queue.cc:260] T 8211beafbf81439d8629834dbbb3a6b9 P 8f34a4731ec24146b05167572a79008f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:11.975092 13314 raft_consensus.cc:359] T 15a6902d3ade4230a51ed07fb1663a27 P b2e22ffd8266454f91a45727bd098a92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:11.989881 13314 raft_consensus.cc:385] T 15a6902d3ade4230a51ed07fb1663a27 P b2e22ffd8266454f91a45727bd098a92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:11.990443 13314 raft_consensus.cc:740] T 15a6902d3ade4230a51ed07fb1663a27 P b2e22ffd8266454f91a45727bd098a92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2e22ffd8266454f91a45727bd098a92, State: Initialized, Role: FOLLOWER
I20260709 12:08:11.991741 13314 consensus_queue.cc:260] T 15a6902d3ade4230a51ed07fb1663a27 P b2e22ffd8266454f91a45727bd098a92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:11.994396 13316 ts_tablet_manager.cc:1434] T 8211beafbf81439d8629834dbbb3a6b9 P 8f34a4731ec24146b05167572a79008f: Time spent starting tablet: real 0.030s	user 0.005s	sys 0.006s
I20260709 12:08:11.995368 13321 raft_consensus.cc:697] T 8211beafbf81439d8629834dbbb3a6b9 P ba142a6ed214425084a138399cc5f489 [term 1 LEADER]: Becoming Leader. State: Replica: ba142a6ed214425084a138399cc5f489, State: Running, Role: LEADER
I20260709 12:08:11.997488 13316 tablet_bootstrap.cc:492] T 3ff6b11516e44942a67136b30bc48aa1 P 8f34a4731ec24146b05167572a79008f: Bootstrap starting.
I20260709 12:08:12.002693 13314 ts_tablet_manager.cc:1434] T 15a6902d3ade4230a51ed07fb1663a27 P b2e22ffd8266454f91a45727bd098a92: Time spent starting tablet: real 0.036s	user 0.005s	sys 0.009s
W20260709 12:08:12.003957 13067 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:08:12.005476 13315 tablet_bootstrap.cc:654] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P ba142a6ed214425084a138399cc5f489: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:12.014794 13314 tablet_bootstrap.cc:492] T ad2b770d07aa404ca5c89bdf309b08f9 P b2e22ffd8266454f91a45727bd098a92: Bootstrap starting.
I20260709 12:08:12.021719 13341 raft_consensus.cc:493] T 8211beafbf81439d8629834dbbb3a6b9 P 8f34a4731ec24146b05167572a79008f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:12.022562 13321 consensus_queue.cc:237] T 8211beafbf81439d8629834dbbb3a6b9 P ba142a6ed214425084a138399cc5f489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:12.022776 13341 raft_consensus.cc:515] T 8211beafbf81439d8629834dbbb3a6b9 P 8f34a4731ec24146b05167572a79008f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:12.027542 13341 leader_election.cc:290] T 8211beafbf81439d8629834dbbb3a6b9 P 8f34a4731ec24146b05167572a79008f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ba142a6ed214425084a138399cc5f489 (127.12.174.129:36937), b2e22ffd8266454f91a45727bd098a92 (127.12.174.131:40191)
I20260709 12:08:12.030972 13268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8211beafbf81439d8629834dbbb3a6b9" candidate_uuid: "8f34a4731ec24146b05167572a79008f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2e22ffd8266454f91a45727bd098a92" is_pre_election: true
I20260709 12:08:12.032279 13268 raft_consensus.cc:2393] T 8211beafbf81439d8629834dbbb3a6b9 P b2e22ffd8266454f91a45727bd098a92 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8f34a4731ec24146b05167572a79008f in current term 1: Already voted for candidate ba142a6ed214425084a138399cc5f489 in this term.
I20260709 12:08:12.028836 13121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8211beafbf81439d8629834dbbb3a6b9" candidate_uuid: "8f34a4731ec24146b05167572a79008f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba142a6ed214425084a138399cc5f489" is_pre_election: true
I20260709 12:08:12.036476 13162 leader_election.cc:304] T 8211beafbf81439d8629834dbbb3a6b9 P 8f34a4731ec24146b05167572a79008f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8f34a4731ec24146b05167572a79008f; no voters: b2e22ffd8266454f91a45727bd098a92, ba142a6ed214425084a138399cc5f489
I20260709 12:08:12.037650 13316 tablet_bootstrap.cc:654] T 3ff6b11516e44942a67136b30bc48aa1 P 8f34a4731ec24146b05167572a79008f: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:12.040150 13341 raft_consensus.cc:3060] T 8211beafbf81439d8629834dbbb3a6b9 P 8f34a4731ec24146b05167572a79008f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:12.057354 13314 tablet_bootstrap.cc:654] T ad2b770d07aa404ca5c89bdf309b08f9 P b2e22ffd8266454f91a45727bd098a92: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:12.065565 13341 raft_consensus.cc:2749] T 8211beafbf81439d8629834dbbb3a6b9 P 8f34a4731ec24146b05167572a79008f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:12.079059 13315 tablet_bootstrap.cc:492] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P ba142a6ed214425084a138399cc5f489: No bootstrap required, opened a new log
I20260709 12:08:12.079912 13315 ts_tablet_manager.cc:1403] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P ba142a6ed214425084a138399cc5f489: Time spent bootstrapping tablet: real 0.112s	user 0.017s	sys 0.022s
I20260709 12:08:12.094707 13315 raft_consensus.cc:359] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P ba142a6ed214425084a138399cc5f489 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:12.095817 13315 raft_consensus.cc:385] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P ba142a6ed214425084a138399cc5f489 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:12.096258 13315 raft_consensus.cc:740] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P ba142a6ed214425084a138399cc5f489 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba142a6ed214425084a138399cc5f489, State: Initialized, Role: FOLLOWER
I20260709 12:08:12.101122 13322 raft_consensus.cc:493] T 15a6902d3ade4230a51ed07fb1663a27 P b2e22ffd8266454f91a45727bd098a92 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:12.101877 13322 raft_consensus.cc:515] T 15a6902d3ade4230a51ed07fb1663a27 P b2e22ffd8266454f91a45727bd098a92 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:12.102731 13314 tablet_bootstrap.cc:492] T ad2b770d07aa404ca5c89bdf309b08f9 P b2e22ffd8266454f91a45727bd098a92: No bootstrap required, opened a new log
I20260709 12:08:12.103415 13314 ts_tablet_manager.cc:1403] T ad2b770d07aa404ca5c89bdf309b08f9 P b2e22ffd8266454f91a45727bd098a92: Time spent bootstrapping tablet: real 0.089s	user 0.025s	sys 0.012s
I20260709 12:08:12.102105 13018 catalog_manager.cc:5697] T 8211beafbf81439d8629834dbbb3a6b9 P ba142a6ed214425084a138399cc5f489 reported cstate change: term changed from 0 to 1, leader changed from <none> to ba142a6ed214425084a138399cc5f489 (127.12.174.129). New cstate: current_term: 1 leader_uuid: "ba142a6ed214425084a138399cc5f489" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:12.106604 13121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15a6902d3ade4230a51ed07fb1663a27" candidate_uuid: "b2e22ffd8266454f91a45727bd098a92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba142a6ed214425084a138399cc5f489" is_pre_election: true
I20260709 12:08:12.106853 13314 raft_consensus.cc:359] T ad2b770d07aa404ca5c89bdf309b08f9 P b2e22ffd8266454f91a45727bd098a92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:12.107674 13314 raft_consensus.cc:385] T ad2b770d07aa404ca5c89bdf309b08f9 P b2e22ffd8266454f91a45727bd098a92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:12.108006 13314 raft_consensus.cc:740] T ad2b770d07aa404ca5c89bdf309b08f9 P b2e22ffd8266454f91a45727bd098a92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2e22ffd8266454f91a45727bd098a92, State: Initialized, Role: FOLLOWER
W20260709 12:08:12.108817 13236 leader_election.cc:343] T 15a6902d3ade4230a51ed07fb1663a27 P b2e22ffd8266454f91a45727bd098a92 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba142a6ed214425084a138399cc5f489 (127.12.174.129:36937): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:12.108388 13315 consensus_queue.cc:260] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P ba142a6ed214425084a138399cc5f489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:12.109102 13314 consensus_queue.cc:260] T ad2b770d07aa404ca5c89bdf309b08f9 P b2e22ffd8266454f91a45727bd098a92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:12.112345 13315 ts_tablet_manager.cc:1434] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P ba142a6ed214425084a138399cc5f489: Time spent starting tablet: real 0.032s	user 0.005s	sys 0.011s
I20260709 12:08:12.112586 13195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15a6902d3ade4230a51ed07fb1663a27" candidate_uuid: "b2e22ffd8266454f91a45727bd098a92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f34a4731ec24146b05167572a79008f" is_pre_election: true
I20260709 12:08:12.113870 13315 tablet_bootstrap.cc:492] T 848ce1d9265c4134bcef148a91744c7c P ba142a6ed214425084a138399cc5f489: Bootstrap starting.
W20260709 12:08:12.114681 13235 leader_election.cc:343] T 15a6902d3ade4230a51ed07fb1663a27 P b2e22ffd8266454f91a45727bd098a92 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8f34a4731ec24146b05167572a79008f (127.12.174.130:45431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:12.113889 13322 leader_election.cc:290] T 15a6902d3ade4230a51ed07fb1663a27 P b2e22ffd8266454f91a45727bd098a92 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ba142a6ed214425084a138399cc5f489 (127.12.174.129:36937), 8f34a4731ec24146b05167572a79008f (127.12.174.130:45431)
I20260709 12:08:12.115365 13235 leader_election.cc:304] T 15a6902d3ade4230a51ed07fb1663a27 P b2e22ffd8266454f91a45727bd098a92 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2e22ffd8266454f91a45727bd098a92; no voters: 8f34a4731ec24146b05167572a79008f, ba142a6ed214425084a138399cc5f489
I20260709 12:08:12.117082 13322 raft_consensus.cc:2749] T 15a6902d3ade4230a51ed07fb1663a27 P b2e22ffd8266454f91a45727bd098a92 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:12.123118 13314 ts_tablet_manager.cc:1434] T ad2b770d07aa404ca5c89bdf309b08f9 P b2e22ffd8266454f91a45727bd098a92: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.001s
I20260709 12:08:12.127089 13314 tablet_bootstrap.cc:492] T cb766527c41242e0ab211622b1f0e268 P b2e22ffd8266454f91a45727bd098a92: Bootstrap starting.
I20260709 12:08:12.130432 13316 tablet_bootstrap.cc:492] T 3ff6b11516e44942a67136b30bc48aa1 P 8f34a4731ec24146b05167572a79008f: No bootstrap required, opened a new log
I20260709 12:08:12.143087 13316 ts_tablet_manager.cc:1403] T 3ff6b11516e44942a67136b30bc48aa1 P 8f34a4731ec24146b05167572a79008f: Time spent bootstrapping tablet: real 0.146s	user 0.011s	sys 0.026s
I20260709 12:08:12.148702 13315 tablet_bootstrap.cc:654] T 848ce1d9265c4134bcef148a91744c7c P ba142a6ed214425084a138399cc5f489: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:12.150666 13316 raft_consensus.cc:359] T 3ff6b11516e44942a67136b30bc48aa1 P 8f34a4731ec24146b05167572a79008f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:12.151835 13316 raft_consensus.cc:385] T 3ff6b11516e44942a67136b30bc48aa1 P 8f34a4731ec24146b05167572a79008f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:12.152294 13316 raft_consensus.cc:740] T 3ff6b11516e44942a67136b30bc48aa1 P 8f34a4731ec24146b05167572a79008f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f34a4731ec24146b05167572a79008f, State: Initialized, Role: FOLLOWER
I20260709 12:08:12.153352 13321 raft_consensus.cc:493] T ad2b770d07aa404ca5c89bdf309b08f9 P ba142a6ed214425084a138399cc5f489 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:12.153708 13316 consensus_queue.cc:260] T 3ff6b11516e44942a67136b30bc48aa1 P 8f34a4731ec24146b05167572a79008f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:12.154245 13321 raft_consensus.cc:515] T ad2b770d07aa404ca5c89bdf309b08f9 P ba142a6ed214425084a138399cc5f489 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:12.158311 13321 leader_election.cc:290] T ad2b770d07aa404ca5c89bdf309b08f9 P ba142a6ed214425084a138399cc5f489 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f34a4731ec24146b05167572a79008f (127.12.174.130:45431), b2e22ffd8266454f91a45727bd098a92 (127.12.174.131:40191)
I20260709 12:08:12.160166 13268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad2b770d07aa404ca5c89bdf309b08f9" candidate_uuid: "ba142a6ed214425084a138399cc5f489" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2e22ffd8266454f91a45727bd098a92" is_pre_election: true
I20260709 12:08:12.162292 13268 raft_consensus.cc:2468] T ad2b770d07aa404ca5c89bdf309b08f9 P b2e22ffd8266454f91a45727bd098a92 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba142a6ed214425084a138399cc5f489 in term 0.
I20260709 12:08:12.164155 13087 leader_election.cc:304] T ad2b770d07aa404ca5c89bdf309b08f9 P ba142a6ed214425084a138399cc5f489 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2e22ffd8266454f91a45727bd098a92, ba142a6ed214425084a138399cc5f489; no voters: 
I20260709 12:08:12.161198 13195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad2b770d07aa404ca5c89bdf309b08f9" candidate_uuid: "ba142a6ed214425084a138399cc5f489" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f34a4731ec24146b05167572a79008f" is_pre_election: true
W20260709 12:08:12.166465 13086 leader_election.cc:343] T ad2b770d07aa404ca5c89bdf309b08f9 P ba142a6ed214425084a138399cc5f489 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8f34a4731ec24146b05167572a79008f (127.12.174.130:45431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:12.166574 13321 raft_consensus.cc:2804] T ad2b770d07aa404ca5c89bdf309b08f9 P ba142a6ed214425084a138399cc5f489 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:12.167239 13321 raft_consensus.cc:493] T ad2b770d07aa404ca5c89bdf309b08f9 P ba142a6ed214425084a138399cc5f489 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:12.167727 13321 raft_consensus.cc:3060] T ad2b770d07aa404ca5c89bdf309b08f9 P ba142a6ed214425084a138399cc5f489 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:12.170639 13314 tablet_bootstrap.cc:654] T cb766527c41242e0ab211622b1f0e268 P b2e22ffd8266454f91a45727bd098a92: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:12.157903 13316 ts_tablet_manager.cc:1434] T 3ff6b11516e44942a67136b30bc48aa1 P 8f34a4731ec24146b05167572a79008f: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.006s
I20260709 12:08:12.172683 13316 tablet_bootstrap.cc:492] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P 8f34a4731ec24146b05167572a79008f: Bootstrap starting.
I20260709 12:08:12.181664 13348 raft_consensus.cc:493] T 3ff6b11516e44942a67136b30bc48aa1 P ba142a6ed214425084a138399cc5f489 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:12.182686 13348 raft_consensus.cc:515] T 3ff6b11516e44942a67136b30bc48aa1 P ba142a6ed214425084a138399cc5f489 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:12.190088 13268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff6b11516e44942a67136b30bc48aa1" candidate_uuid: "ba142a6ed214425084a138399cc5f489" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2e22ffd8266454f91a45727bd098a92" is_pre_election: true
I20260709 12:08:12.191123 13268 raft_consensus.cc:2468] T 3ff6b11516e44942a67136b30bc48aa1 P b2e22ffd8266454f91a45727bd098a92 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba142a6ed214425084a138399cc5f489 in term 0.
I20260709 12:08:12.196930 13087 leader_election.cc:304] T 3ff6b11516e44942a67136b30bc48aa1 P ba142a6ed214425084a138399cc5f489 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2e22ffd8266454f91a45727bd098a92, ba142a6ed214425084a138399cc5f489; no voters: 
I20260709 12:08:12.199863 13348 leader_election.cc:290] T 3ff6b11516e44942a67136b30bc48aa1 P ba142a6ed214425084a138399cc5f489 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f34a4731ec24146b05167572a79008f (127.12.174.130:45431), b2e22ffd8266454f91a45727bd098a92 (127.12.174.131:40191)
I20260709 12:08:12.201656 13348 raft_consensus.cc:2804] T 3ff6b11516e44942a67136b30bc48aa1 P ba142a6ed214425084a138399cc5f489 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:12.203953 13348 raft_consensus.cc:493] T 3ff6b11516e44942a67136b30bc48aa1 P ba142a6ed214425084a138399cc5f489 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:12.203744 13321 raft_consensus.cc:515] T ad2b770d07aa404ca5c89bdf309b08f9 P ba142a6ed214425084a138399cc5f489 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:12.204595 13348 raft_consensus.cc:3060] T 3ff6b11516e44942a67136b30bc48aa1 P ba142a6ed214425084a138399cc5f489 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:12.208948 13316 tablet_bootstrap.cc:654] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P 8f34a4731ec24146b05167572a79008f: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:12.210037 13195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff6b11516e44942a67136b30bc48aa1" candidate_uuid: "ba142a6ed214425084a138399cc5f489" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f34a4731ec24146b05167572a79008f" is_pre_election: true
I20260709 12:08:12.210969 13195 raft_consensus.cc:2468] T 3ff6b11516e44942a67136b30bc48aa1 P 8f34a4731ec24146b05167572a79008f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba142a6ed214425084a138399cc5f489 in term 0.
I20260709 12:08:12.214500 13315 tablet_bootstrap.cc:492] T 848ce1d9265c4134bcef148a91744c7c P ba142a6ed214425084a138399cc5f489: No bootstrap required, opened a new log
I20260709 12:08:12.217471 13195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad2b770d07aa404ca5c89bdf309b08f9" candidate_uuid: "ba142a6ed214425084a138399cc5f489" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f34a4731ec24146b05167572a79008f"
I20260709 12:08:12.219030 13315 ts_tablet_manager.cc:1403] T 848ce1d9265c4134bcef148a91744c7c P ba142a6ed214425084a138399cc5f489: Time spent bootstrapping tablet: real 0.106s	user 0.023s	sys 0.007s
W20260709 12:08:12.224701 13086 leader_election.cc:343] T ad2b770d07aa404ca5c89bdf309b08f9 P ba142a6ed214425084a138399cc5f489 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8f34a4731ec24146b05167572a79008f (127.12.174.130:45431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:12.219343 13321 leader_election.cc:290] T ad2b770d07aa404ca5c89bdf309b08f9 P ba142a6ed214425084a138399cc5f489 [CANDIDATE]: Term 1 election: Requested vote from peers 8f34a4731ec24146b05167572a79008f (127.12.174.130:45431), b2e22ffd8266454f91a45727bd098a92 (127.12.174.131:40191)
I20260709 12:08:12.232868 13315 raft_consensus.cc:359] T 848ce1d9265c4134bcef148a91744c7c P ba142a6ed214425084a138399cc5f489 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:12.236476 13315 raft_consensus.cc:385] T 848ce1d9265c4134bcef148a91744c7c P ba142a6ed214425084a138399cc5f489 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:12.239848 13315 raft_consensus.cc:740] T 848ce1d9265c4134bcef148a91744c7c P ba142a6ed214425084a138399cc5f489 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba142a6ed214425084a138399cc5f489, State: Initialized, Role: FOLLOWER
I20260709 12:08:12.238586 13321 raft_consensus.cc:493] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P ba142a6ed214425084a138399cc5f489 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:08:12.240621 13087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:40191, user_credentials={real_user=slave}} blocked reactor thread for 43775.5us
I20260709 12:08:12.241575 13321 raft_consensus.cc:515] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P ba142a6ed214425084a138399cc5f489 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:12.243650 13268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad2b770d07aa404ca5c89bdf309b08f9" candidate_uuid: "ba142a6ed214425084a138399cc5f489" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2e22ffd8266454f91a45727bd098a92"
I20260709 12:08:12.244446 13268 raft_consensus.cc:3060] T ad2b770d07aa404ca5c89bdf309b08f9 P b2e22ffd8266454f91a45727bd098a92 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:12.245030 13321 leader_election.cc:290] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P ba142a6ed214425084a138399cc5f489 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f34a4731ec24146b05167572a79008f (127.12.174.130:45431), b2e22ffd8266454f91a45727bd098a92 (127.12.174.131:40191)
I20260709 12:08:12.246807 13195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a73bb3cf9eb4b4484c76c5ef49859f0" candidate_uuid: "ba142a6ed214425084a138399cc5f489" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f34a4731ec24146b05167572a79008f" is_pre_election: true
I20260709 12:08:12.242332 13314 tablet_bootstrap.cc:492] T cb766527c41242e0ab211622b1f0e268 P b2e22ffd8266454f91a45727bd098a92: No bootstrap required, opened a new log
I20260709 12:08:12.251034 13316 tablet_bootstrap.cc:492] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P 8f34a4731ec24146b05167572a79008f: No bootstrap required, opened a new log
W20260709 12:08:12.251509 13086 leader_election.cc:343] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P ba142a6ed214425084a138399cc5f489 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8f34a4731ec24146b05167572a79008f (127.12.174.130:45431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:12.251763 13316 ts_tablet_manager.cc:1403] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P 8f34a4731ec24146b05167572a79008f: Time spent bootstrapping tablet: real 0.079s	user 0.014s	sys 0.014s
I20260709 12:08:12.251969 13348 raft_consensus.cc:515] T 3ff6b11516e44942a67136b30bc48aa1 P ba142a6ed214425084a138399cc5f489 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:12.253525 13314 ts_tablet_manager.cc:1403] T cb766527c41242e0ab211622b1f0e268 P b2e22ffd8266454f91a45727bd098a92: Time spent bootstrapping tablet: real 0.127s	user 0.021s	sys 0.037s
I20260709 12:08:12.255064 13270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a73bb3cf9eb4b4484c76c5ef49859f0" candidate_uuid: "ba142a6ed214425084a138399cc5f489" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2e22ffd8266454f91a45727bd098a92" is_pre_election: true
I20260709 12:08:12.256017 13270 raft_consensus.cc:2468] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P b2e22ffd8266454f91a45727bd098a92 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba142a6ed214425084a138399cc5f489 in term 0.
I20260709 12:08:12.258066 13195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff6b11516e44942a67136b30bc48aa1" candidate_uuid: "ba142a6ed214425084a138399cc5f489" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f34a4731ec24146b05167572a79008f"
I20260709 12:08:12.258355 13087 leader_election.cc:304] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P ba142a6ed214425084a138399cc5f489 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b2e22ffd8266454f91a45727bd098a92, ba142a6ed214425084a138399cc5f489; no voters: 8f34a4731ec24146b05167572a79008f
I20260709 12:08:12.258919 13195 raft_consensus.cc:3060] T 3ff6b11516e44942a67136b30bc48aa1 P 8f34a4731ec24146b05167572a79008f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:12.261008 13348 leader_election.cc:290] T 3ff6b11516e44942a67136b30bc48aa1 P ba142a6ed214425084a138399cc5f489 [CANDIDATE]: Term 1 election: Requested vote from peers 8f34a4731ec24146b05167572a79008f (127.12.174.130:45431), b2e22ffd8266454f91a45727bd098a92 (127.12.174.131:40191)
I20260709 12:08:12.257253 13315 consensus_queue.cc:260] T 848ce1d9265c4134bcef148a91744c7c P ba142a6ed214425084a138399cc5f489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:12.266633 13270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff6b11516e44942a67136b30bc48aa1" candidate_uuid: "ba142a6ed214425084a138399cc5f489" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2e22ffd8266454f91a45727bd098a92"
I20260709 12:08:12.267499 13270 raft_consensus.cc:3060] T 3ff6b11516e44942a67136b30bc48aa1 P b2e22ffd8266454f91a45727bd098a92 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:12.269891 13268 raft_consensus.cc:2468] T ad2b770d07aa404ca5c89bdf309b08f9 P b2e22ffd8266454f91a45727bd098a92 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba142a6ed214425084a138399cc5f489 in term 1.
I20260709 12:08:12.265821 13316 raft_consensus.cc:359] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P 8f34a4731ec24146b05167572a79008f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:12.272014 13316 raft_consensus.cc:385] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P 8f34a4731ec24146b05167572a79008f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:12.272567 13316 raft_consensus.cc:740] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P 8f34a4731ec24146b05167572a79008f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f34a4731ec24146b05167572a79008f, State: Initialized, Role: FOLLOWER
I20260709 12:08:12.273926 13316 consensus_queue.cc:260] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P 8f34a4731ec24146b05167572a79008f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:12.275417 13348 raft_consensus.cc:2804] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P ba142a6ed214425084a138399cc5f489 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:12.275992 13348 raft_consensus.cc:493] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P ba142a6ed214425084a138399cc5f489 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:12.274471 13087 leader_election.cc:304] T ad2b770d07aa404ca5c89bdf309b08f9 P ba142a6ed214425084a138399cc5f489 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b2e22ffd8266454f91a45727bd098a92, ba142a6ed214425084a138399cc5f489; no voters: 8f34a4731ec24146b05167572a79008f
I20260709 12:08:12.277244 13348 raft_consensus.cc:3060] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P ba142a6ed214425084a138399cc5f489 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:12.284612 13321 raft_consensus.cc:2804] T ad2b770d07aa404ca5c89bdf309b08f9 P ba142a6ed214425084a138399cc5f489 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:12.285380 13321 raft_consensus.cc:697] T ad2b770d07aa404ca5c89bdf309b08f9 P ba142a6ed214425084a138399cc5f489 [term 1 LEADER]: Becoming Leader. State: Replica: ba142a6ed214425084a138399cc5f489, State: Running, Role: LEADER
I20260709 12:08:12.286866 13321 consensus_queue.cc:237] T ad2b770d07aa404ca5c89bdf309b08f9 P ba142a6ed214425084a138399cc5f489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:12.278227 13314 raft_consensus.cc:359] T cb766527c41242e0ab211622b1f0e268 P b2e22ffd8266454f91a45727bd098a92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:12.278997 13315 ts_tablet_manager.cc:1434] T 848ce1d9265c4134bcef148a91744c7c P ba142a6ed214425084a138399cc5f489: Time spent starting tablet: real 0.054s	user 0.011s	sys 0.000s
I20260709 12:08:12.289534 13270 raft_consensus.cc:2468] T 3ff6b11516e44942a67136b30bc48aa1 P b2e22ffd8266454f91a45727bd098a92 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba142a6ed214425084a138399cc5f489 in term 1.
I20260709 12:08:12.290771 13315 tablet_bootstrap.cc:492] T db4772bfddd848238ef081fec351b1c9 P ba142a6ed214425084a138399cc5f489: Bootstrap starting.
I20260709 12:08:12.292876 13316 ts_tablet_manager.cc:1434] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P 8f34a4731ec24146b05167572a79008f: Time spent starting tablet: real 0.040s	user 0.004s	sys 0.008s
I20260709 12:08:12.294447 13316 tablet_bootstrap.cc:492] T 15a6902d3ade4230a51ed07fb1663a27 P 8f34a4731ec24146b05167572a79008f: Bootstrap starting.
I20260709 12:08:12.289655 13314 raft_consensus.cc:385] T cb766527c41242e0ab211622b1f0e268 P b2e22ffd8266454f91a45727bd098a92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:12.298071 13314 raft_consensus.cc:740] T cb766527c41242e0ab211622b1f0e268 P b2e22ffd8266454f91a45727bd098a92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2e22ffd8266454f91a45727bd098a92, State: Initialized, Role: FOLLOWER
I20260709 12:08:12.299122 13314 consensus_queue.cc:260] T cb766527c41242e0ab211622b1f0e268 P b2e22ffd8266454f91a45727bd098a92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:12.299399 13087 leader_election.cc:304] T 3ff6b11516e44942a67136b30bc48aa1 P ba142a6ed214425084a138399cc5f489 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2e22ffd8266454f91a45727bd098a92, ba142a6ed214425084a138399cc5f489; no voters: 
I20260709 12:08:12.301280 13358 raft_consensus.cc:2804] T 3ff6b11516e44942a67136b30bc48aa1 P ba142a6ed214425084a138399cc5f489 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:12.303081 13314 ts_tablet_manager.cc:1434] T cb766527c41242e0ab211622b1f0e268 P b2e22ffd8266454f91a45727bd098a92: Time spent starting tablet: real 0.049s	user 0.010s	sys 0.000s
I20260709 12:08:12.273828 13195 raft_consensus.cc:2468] T 3ff6b11516e44942a67136b30bc48aa1 P 8f34a4731ec24146b05167572a79008f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba142a6ed214425084a138399cc5f489 in term 1.
I20260709 12:08:12.310454 13316 tablet_bootstrap.cc:654] T 15a6902d3ade4230a51ed07fb1663a27 P 8f34a4731ec24146b05167572a79008f: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:12.314148 13314 tablet_bootstrap.cc:492] T 848ce1d9265c4134bcef148a91744c7c P b2e22ffd8266454f91a45727bd098a92: Bootstrap starting.
I20260709 12:08:12.318183 13341 raft_consensus.cc:493] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P 8f34a4731ec24146b05167572a79008f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:12.289096 13348 raft_consensus.cc:515] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P ba142a6ed214425084a138399cc5f489 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:12.318972 13341 raft_consensus.cc:515] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P 8f34a4731ec24146b05167572a79008f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
W20260709 12:08:12.321039 13162 consensus_peers.cc:597] T d5f3329ccf5b4ebf87e0eb8dc143b5d9 P 8f34a4731ec24146b05167572a79008f -> Peer b2e22ffd8266454f91a45727bd098a92 (127.12.174.131:40191): Couldn't send request to peer b2e22ffd8266454f91a45727bd098a92. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:08:12.322093 13341 leader_election.cc:290] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P 8f34a4731ec24146b05167572a79008f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ba142a6ed214425084a138399cc5f489 (127.12.174.129:36937), b2e22ffd8266454f91a45727bd098a92 (127.12.174.131:40191)
I20260709 12:08:12.324513 13270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a73bb3cf9eb4b4484c76c5ef49859f0" candidate_uuid: "8f34a4731ec24146b05167572a79008f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2e22ffd8266454f91a45727bd098a92" is_pre_election: true
I20260709 12:08:12.325486 13270 raft_consensus.cc:2468] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P b2e22ffd8266454f91a45727bd098a92 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f34a4731ec24146b05167572a79008f in term 0.
I20260709 12:08:12.325585 13121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a73bb3cf9eb4b4484c76c5ef49859f0" candidate_uuid: "8f34a4731ec24146b05167572a79008f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba142a6ed214425084a138399cc5f489" is_pre_election: true
I20260709 12:08:12.326795 13121 raft_consensus.cc:2393] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P ba142a6ed214425084a138399cc5f489 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8f34a4731ec24146b05167572a79008f in current term 1: Already voted for candidate ba142a6ed214425084a138399cc5f489 in this term.
I20260709 12:08:12.327121 13348 leader_election.cc:290] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P ba142a6ed214425084a138399cc5f489 [CANDIDATE]: Term 1 election: Requested vote from peers 8f34a4731ec24146b05167572a79008f (127.12.174.130:45431), b2e22ffd8266454f91a45727bd098a92 (127.12.174.131:40191)
I20260709 12:08:12.329452 13162 leader_election.cc:304] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P 8f34a4731ec24146b05167572a79008f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8f34a4731ec24146b05167572a79008f, b2e22ffd8266454f91a45727bd098a92; no voters: ba142a6ed214425084a138399cc5f489
I20260709 12:08:12.330006 13315 tablet_bootstrap.cc:654] T db4772bfddd848238ef081fec351b1c9 P ba142a6ed214425084a138399cc5f489: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:12.332077 13270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a73bb3cf9eb4b4484c76c5ef49859f0" candidate_uuid: "ba142a6ed214425084a138399cc5f489" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2e22ffd8266454f91a45727bd098a92"
I20260709 12:08:12.332918 13270 raft_consensus.cc:3060] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P b2e22ffd8266454f91a45727bd098a92 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:12.336262 13195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a73bb3cf9eb4b4484c76c5ef49859f0" candidate_uuid: "ba142a6ed214425084a138399cc5f489" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f34a4731ec24146b05167572a79008f"
I20260709 12:08:12.337127 13195 raft_consensus.cc:3060] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P 8f34a4731ec24146b05167572a79008f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:12.345651 13358 raft_consensus.cc:697] T 3ff6b11516e44942a67136b30bc48aa1 P ba142a6ed214425084a138399cc5f489 [term 1 LEADER]: Becoming Leader. State: Replica: ba142a6ed214425084a138399cc5f489, State: Running, Role: LEADER
I20260709 12:08:12.348037 13321 raft_consensus.cc:493] T 848ce1d9265c4134bcef148a91744c7c P ba142a6ed214425084a138399cc5f489 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:12.350122 13358 consensus_queue.cc:237] T 3ff6b11516e44942a67136b30bc48aa1 P ba142a6ed214425084a138399cc5f489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:12.349085 13321 raft_consensus.cc:515] T 848ce1d9265c4134bcef148a91744c7c P ba142a6ed214425084a138399cc5f489 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:12.358438 13322 raft_consensus.cc:493] T cb766527c41242e0ab211622b1f0e268 P b2e22ffd8266454f91a45727bd098a92 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:12.359227 13322 raft_consensus.cc:515] T cb766527c41242e0ab211622b1f0e268 P b2e22ffd8266454f91a45727bd098a92 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:12.359838 13196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848ce1d9265c4134bcef148a91744c7c" candidate_uuid: "ba142a6ed214425084a138399cc5f489" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f34a4731ec24146b05167572a79008f" is_pre_election: true
W20260709 12:08:12.362185 13086 leader_election.cc:343] T 848ce1d9265c4134bcef148a91744c7c P ba142a6ed214425084a138399cc5f489 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8f34a4731ec24146b05167572a79008f (127.12.174.130:45431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:12.363965 13121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb766527c41242e0ab211622b1f0e268" candidate_uuid: "b2e22ffd8266454f91a45727bd098a92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba142a6ed214425084a138399cc5f489" is_pre_election: true
I20260709 12:08:12.367897 13322 leader_election.cc:290] T cb766527c41242e0ab211622b1f0e268 P b2e22ffd8266454f91a45727bd098a92 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ba142a6ed214425084a138399cc5f489 (127.12.174.129:36937), 8f34a4731ec24146b05167572a79008f (127.12.174.130:45431)
I20260709 12:08:12.367830 13015 catalog_manager.cc:5697] T ad2b770d07aa404ca5c89bdf309b08f9 P ba142a6ed214425084a138399cc5f489 reported cstate change: term changed from 0 to 1, leader changed from <none> to ba142a6ed214425084a138399cc5f489 (127.12.174.129). New cstate: current_term: 1 leader_uuid: "ba142a6ed214425084a138399cc5f489" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:12.370488 13196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb766527c41242e0ab211622b1f0e268" candidate_uuid: "b2e22ffd8266454f91a45727bd098a92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f34a4731ec24146b05167572a79008f" is_pre_election: true
I20260709 12:08:12.371613 13196 raft_consensus.cc:2468] T cb766527c41242e0ab211622b1f0e268 P 8f34a4731ec24146b05167572a79008f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2e22ffd8266454f91a45727bd098a92 in term 0.
W20260709 12:08:12.373940 13236 leader_election.cc:343] T cb766527c41242e0ab211622b1f0e268 P b2e22ffd8266454f91a45727bd098a92 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba142a6ed214425084a138399cc5f489 (127.12.174.129:36937): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:12.374840 13235 leader_election.cc:304] T cb766527c41242e0ab211622b1f0e268 P b2e22ffd8266454f91a45727bd098a92 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8f34a4731ec24146b05167572a79008f, b2e22ffd8266454f91a45727bd098a92; no voters: ba142a6ed214425084a138399cc5f489
I20260709 12:08:12.376825 13322 raft_consensus.cc:2804] T cb766527c41242e0ab211622b1f0e268 P b2e22ffd8266454f91a45727bd098a92 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:12.377480 13322 raft_consensus.cc:493] T cb766527c41242e0ab211622b1f0e268 P b2e22ffd8266454f91a45727bd098a92 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:12.378104 13322 raft_consensus.cc:3060] T cb766527c41242e0ab211622b1f0e268 P b2e22ffd8266454f91a45727bd098a92 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:12.389456 13321 leader_election.cc:290] T 848ce1d9265c4134bcef148a91744c7c P ba142a6ed214425084a138399cc5f489 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f34a4731ec24146b05167572a79008f (127.12.174.130:45431), b2e22ffd8266454f91a45727bd098a92 (127.12.174.131:40191)
I20260709 12:08:12.390120 13314 tablet_bootstrap.cc:654] T 848ce1d9265c4134bcef148a91744c7c P b2e22ffd8266454f91a45727bd098a92: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:12.391609 13268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848ce1d9265c4134bcef148a91744c7c" candidate_uuid: "ba142a6ed214425084a138399cc5f489" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2e22ffd8266454f91a45727bd098a92" is_pre_election: true
I20260709 12:08:12.395150 13270 raft_consensus.cc:2468] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P b2e22ffd8266454f91a45727bd098a92 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba142a6ed214425084a138399cc5f489 in term 1.
W20260709 12:08:12.398659 13087 leader_election.cc:343] T 848ce1d9265c4134bcef148a91744c7c P ba142a6ed214425084a138399cc5f489 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2e22ffd8266454f91a45727bd098a92 (127.12.174.131:40191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:12.385692 13195 raft_consensus.cc:2468] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P 8f34a4731ec24146b05167572a79008f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba142a6ed214425084a138399cc5f489 in term 1.
I20260709 12:08:12.400270 13341 raft_consensus.cc:2764] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P 8f34a4731ec24146b05167572a79008f [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 12:08:12.399369 13087 leader_election.cc:304] T 848ce1d9265c4134bcef148a91744c7c P ba142a6ed214425084a138399cc5f489 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba142a6ed214425084a138399cc5f489; no voters: 8f34a4731ec24146b05167572a79008f, b2e22ffd8266454f91a45727bd098a92
I20260709 12:08:12.401481 13086 leader_election.cc:304] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P ba142a6ed214425084a138399cc5f489 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f34a4731ec24146b05167572a79008f, ba142a6ed214425084a138399cc5f489; no voters: 
I20260709 12:08:12.404209 13321 raft_consensus.cc:2804] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P ba142a6ed214425084a138399cc5f489 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:12.404954 13321 raft_consensus.cc:697] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P ba142a6ed214425084a138399cc5f489 [term 1 LEADER]: Becoming Leader. State: Replica: ba142a6ed214425084a138399cc5f489, State: Running, Role: LEADER
I20260709 12:08:12.406301 13316 tablet_bootstrap.cc:492] T 15a6902d3ade4230a51ed07fb1663a27 P 8f34a4731ec24146b05167572a79008f: No bootstrap required, opened a new log
I20260709 12:08:12.407120 13316 ts_tablet_manager.cc:1403] T 15a6902d3ade4230a51ed07fb1663a27 P 8f34a4731ec24146b05167572a79008f: Time spent bootstrapping tablet: real 0.113s	user 0.010s	sys 0.018s
I20260709 12:08:12.406397 13321 consensus_queue.cc:237] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P ba142a6ed214425084a138399cc5f489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:12.408473 13341 consensus_queue.cc:1048] T d5f3329ccf5b4ebf87e0eb8dc143b5d9 P 8f34a4731ec24146b05167572a79008f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:12.411058 13322 raft_consensus.cc:515] T cb766527c41242e0ab211622b1f0e268 P b2e22ffd8266454f91a45727bd098a92 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:12.413666 13360 raft_consensus.cc:2749] T 848ce1d9265c4134bcef148a91744c7c P ba142a6ed214425084a138399cc5f489 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:12.415800 13119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb766527c41242e0ab211622b1f0e268" candidate_uuid: "b2e22ffd8266454f91a45727bd098a92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba142a6ed214425084a138399cc5f489"
W20260709 12:08:12.417629 13236 leader_election.cc:343] T cb766527c41242e0ab211622b1f0e268 P b2e22ffd8266454f91a45727bd098a92 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ba142a6ed214425084a138399cc5f489 (127.12.174.129:36937): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:12.423467 13316 raft_consensus.cc:359] T 15a6902d3ade4230a51ed07fb1663a27 P 8f34a4731ec24146b05167572a79008f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:12.429942 13316 raft_consensus.cc:385] T 15a6902d3ade4230a51ed07fb1663a27 P 8f34a4731ec24146b05167572a79008f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:12.435012 13195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb766527c41242e0ab211622b1f0e268" candidate_uuid: "b2e22ffd8266454f91a45727bd098a92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f34a4731ec24146b05167572a79008f"
I20260709 12:08:12.435936 13195 raft_consensus.cc:3060] T cb766527c41242e0ab211622b1f0e268 P 8f34a4731ec24146b05167572a79008f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:12.439949 13315 tablet_bootstrap.cc:492] T db4772bfddd848238ef081fec351b1c9 P ba142a6ed214425084a138399cc5f489: No bootstrap required, opened a new log
I20260709 12:08:12.440730 13315 ts_tablet_manager.cc:1403] T db4772bfddd848238ef081fec351b1c9 P ba142a6ed214425084a138399cc5f489: Time spent bootstrapping tablet: real 0.150s	user 0.023s	sys 0.030s
I20260709 12:08:12.434178 13316 raft_consensus.cc:740] T 15a6902d3ade4230a51ed07fb1663a27 P 8f34a4731ec24146b05167572a79008f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f34a4731ec24146b05167572a79008f, State: Initialized, Role: FOLLOWER
I20260709 12:08:12.428890 13322 leader_election.cc:290] T cb766527c41242e0ab211622b1f0e268 P b2e22ffd8266454f91a45727bd098a92 [CANDIDATE]: Term 1 election: Requested vote from peers ba142a6ed214425084a138399cc5f489 (127.12.174.129:36937), 8f34a4731ec24146b05167572a79008f (127.12.174.130:45431)
I20260709 12:08:12.449815 13015 catalog_manager.cc:5697] T 3ff6b11516e44942a67136b30bc48aa1 P ba142a6ed214425084a138399cc5f489 reported cstate change: term changed from 0 to 1, leader changed from <none> to ba142a6ed214425084a138399cc5f489 (127.12.174.129). New cstate: current_term: 1 leader_uuid: "ba142a6ed214425084a138399cc5f489" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:12.448848 13316 consensus_queue.cc:260] T 15a6902d3ade4230a51ed07fb1663a27 P 8f34a4731ec24146b05167572a79008f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:12.456794 13314 tablet_bootstrap.cc:492] T 848ce1d9265c4134bcef148a91744c7c P b2e22ffd8266454f91a45727bd098a92: No bootstrap required, opened a new log
I20260709 12:08:12.457528 13314 ts_tablet_manager.cc:1403] T 848ce1d9265c4134bcef148a91744c7c P b2e22ffd8266454f91a45727bd098a92: Time spent bootstrapping tablet: real 0.144s	user 0.023s	sys 0.026s
I20260709 12:08:12.459053 13315 raft_consensus.cc:359] T db4772bfddd848238ef081fec351b1c9 P ba142a6ed214425084a138399cc5f489 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:12.460099 13315 raft_consensus.cc:385] T db4772bfddd848238ef081fec351b1c9 P ba142a6ed214425084a138399cc5f489 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:12.460525 13315 raft_consensus.cc:740] T db4772bfddd848238ef081fec351b1c9 P ba142a6ed214425084a138399cc5f489 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba142a6ed214425084a138399cc5f489, State: Initialized, Role: FOLLOWER
I20260709 12:08:12.477728 13195 raft_consensus.cc:2468] T cb766527c41242e0ab211622b1f0e268 P 8f34a4731ec24146b05167572a79008f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2e22ffd8266454f91a45727bd098a92 in term 1.
I20260709 12:08:12.478274 13314 raft_consensus.cc:359] T 848ce1d9265c4134bcef148a91744c7c P b2e22ffd8266454f91a45727bd098a92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:12.479108 13314 raft_consensus.cc:385] T 848ce1d9265c4134bcef148a91744c7c P b2e22ffd8266454f91a45727bd098a92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:12.479437 13314 raft_consensus.cc:740] T 848ce1d9265c4134bcef148a91744c7c P b2e22ffd8266454f91a45727bd098a92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2e22ffd8266454f91a45727bd098a92, State: Initialized, Role: FOLLOWER
I20260709 12:08:12.479566 13235 leader_election.cc:304] T cb766527c41242e0ab211622b1f0e268 P b2e22ffd8266454f91a45727bd098a92 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8f34a4731ec24146b05167572a79008f, b2e22ffd8266454f91a45727bd098a92; no voters: ba142a6ed214425084a138399cc5f489
I20260709 12:08:12.480468 13314 consensus_queue.cc:260] T 848ce1d9265c4134bcef148a91744c7c P b2e22ffd8266454f91a45727bd098a92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:12.482425 13321 consensus_queue.cc:1048] T 8211beafbf81439d8629834dbbb3a6b9 P ba142a6ed214425084a138399cc5f489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:12.485710 13344 raft_consensus.cc:2804] T cb766527c41242e0ab211622b1f0e268 P b2e22ffd8266454f91a45727bd098a92 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:12.485647 13315 consensus_queue.cc:260] T db4772bfddd848238ef081fec351b1c9 P ba142a6ed214425084a138399cc5f489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:12.488713 13316 ts_tablet_manager.cc:1434] T 15a6902d3ade4230a51ed07fb1663a27 P 8f34a4731ec24146b05167572a79008f: Time spent starting tablet: real 0.081s	user 0.006s	sys 0.009s
I20260709 12:08:12.490271 13316 tablet_bootstrap.cc:492] T ad2b770d07aa404ca5c89bdf309b08f9 P 8f34a4731ec24146b05167572a79008f: Bootstrap starting.
I20260709 12:08:12.492147 13315 ts_tablet_manager.cc:1434] T db4772bfddd848238ef081fec351b1c9 P ba142a6ed214425084a138399cc5f489: Time spent starting tablet: real 0.051s	user 0.009s	sys 0.008s
I20260709 12:08:12.484567 13314 ts_tablet_manager.cc:1434] T 848ce1d9265c4134bcef148a91744c7c P b2e22ffd8266454f91a45727bd098a92: Time spent starting tablet: real 0.027s	user 0.010s	sys 0.002s
I20260709 12:08:12.502322 13314 tablet_bootstrap.cc:492] T db4772bfddd848238ef081fec351b1c9 P b2e22ffd8266454f91a45727bd098a92: Bootstrap starting.
I20260709 12:08:12.504334 13322 raft_consensus.cc:493] T 848ce1d9265c4134bcef148a91744c7c P b2e22ffd8266454f91a45727bd098a92 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:12.500671 13315 tablet_bootstrap.cc:492] T cb766527c41242e0ab211622b1f0e268 P ba142a6ed214425084a138399cc5f489: Bootstrap starting.
I20260709 12:08:12.505036 13322 raft_consensus.cc:515] T 848ce1d9265c4134bcef148a91744c7c P b2e22ffd8266454f91a45727bd098a92 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:12.510401 13119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848ce1d9265c4134bcef148a91744c7c" candidate_uuid: "b2e22ffd8266454f91a45727bd098a92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba142a6ed214425084a138399cc5f489" is_pre_election: true
I20260709 12:08:12.511415 13119 raft_consensus.cc:2468] T 848ce1d9265c4134bcef148a91744c7c P ba142a6ed214425084a138399cc5f489 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2e22ffd8266454f91a45727bd098a92 in term 0.
I20260709 12:08:12.513504 13236 leader_election.cc:304] T 848ce1d9265c4134bcef148a91744c7c P b2e22ffd8266454f91a45727bd098a92 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2e22ffd8266454f91a45727bd098a92, ba142a6ed214425084a138399cc5f489; no voters: 
I20260709 12:08:12.532995 13344 raft_consensus.cc:697] T cb766527c41242e0ab211622b1f0e268 P b2e22ffd8266454f91a45727bd098a92 [term 1 LEADER]: Becoming Leader. State: Replica: b2e22ffd8266454f91a45727bd098a92, State: Running, Role: LEADER
I20260709 12:08:12.535429 13195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848ce1d9265c4134bcef148a91744c7c" candidate_uuid: "b2e22ffd8266454f91a45727bd098a92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f34a4731ec24146b05167572a79008f" is_pre_election: true
W20260709 12:08:12.538597 13235 leader_election.cc:343] T 848ce1d9265c4134bcef148a91744c7c P b2e22ffd8266454f91a45727bd098a92 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8f34a4731ec24146b05167572a79008f (127.12.174.130:45431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:12.539449 13322 leader_election.cc:290] T 848ce1d9265c4134bcef148a91744c7c P b2e22ffd8266454f91a45727bd098a92 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ba142a6ed214425084a138399cc5f489 (127.12.174.129:36937), 8f34a4731ec24146b05167572a79008f (127.12.174.130:45431)
I20260709 12:08:12.547730 13370 raft_consensus.cc:2804] T 848ce1d9265c4134bcef148a91744c7c P b2e22ffd8266454f91a45727bd098a92 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:12.548656 13370 raft_consensus.cc:493] T 848ce1d9265c4134bcef148a91744c7c P b2e22ffd8266454f91a45727bd098a92 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:12.537209 13344 consensus_queue.cc:237] T cb766527c41242e0ab211622b1f0e268 P b2e22ffd8266454f91a45727bd098a92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:12.550026 13370 raft_consensus.cc:3060] T 848ce1d9265c4134bcef148a91744c7c P b2e22ffd8266454f91a45727bd098a92 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:12.554843 13018 catalog_manager.cc:5697] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P ba142a6ed214425084a138399cc5f489 reported cstate change: term changed from 0 to 1, leader changed from <none> to ba142a6ed214425084a138399cc5f489 (127.12.174.129). New cstate: current_term: 1 leader_uuid: "ba142a6ed214425084a138399cc5f489" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:12.554250 13316 tablet_bootstrap.cc:654] T ad2b770d07aa404ca5c89bdf309b08f9 P 8f34a4731ec24146b05167572a79008f: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:12.560870 13315 tablet_bootstrap.cc:654] T cb766527c41242e0ab211622b1f0e268 P ba142a6ed214425084a138399cc5f489: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:12.567191 13314 tablet_bootstrap.cc:654] T db4772bfddd848238ef081fec351b1c9 P b2e22ffd8266454f91a45727bd098a92: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:12.585552 13370 raft_consensus.cc:515] T 848ce1d9265c4134bcef148a91744c7c P b2e22ffd8266454f91a45727bd098a92 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:12.591233 13370 leader_election.cc:290] T 848ce1d9265c4134bcef148a91744c7c P b2e22ffd8266454f91a45727bd098a92 [CANDIDATE]: Term 1 election: Requested vote from peers ba142a6ed214425084a138399cc5f489 (127.12.174.129:36937), 8f34a4731ec24146b05167572a79008f (127.12.174.130:45431)
I20260709 12:08:12.594343 13195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848ce1d9265c4134bcef148a91744c7c" candidate_uuid: "b2e22ffd8266454f91a45727bd098a92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f34a4731ec24146b05167572a79008f"
I20260709 12:08:12.599640 13121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848ce1d9265c4134bcef148a91744c7c" candidate_uuid: "b2e22ffd8266454f91a45727bd098a92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba142a6ed214425084a138399cc5f489"
I20260709 12:08:12.600629 13121 raft_consensus.cc:3060] T 848ce1d9265c4134bcef148a91744c7c P ba142a6ed214425084a138399cc5f489 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:08:12.601748 13235 leader_election.cc:343] T 848ce1d9265c4134bcef148a91744c7c P b2e22ffd8266454f91a45727bd098a92 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8f34a4731ec24146b05167572a79008f (127.12.174.130:45431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:12.622078 13121 raft_consensus.cc:2468] T 848ce1d9265c4134bcef148a91744c7c P ba142a6ed214425084a138399cc5f489 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2e22ffd8266454f91a45727bd098a92 in term 1.
I20260709 12:08:12.623908 13236 leader_election.cc:304] T 848ce1d9265c4134bcef148a91744c7c P b2e22ffd8266454f91a45727bd098a92 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b2e22ffd8266454f91a45727bd098a92, ba142a6ed214425084a138399cc5f489; no voters: 8f34a4731ec24146b05167572a79008f
I20260709 12:08:12.625803 13370 raft_consensus.cc:2804] T 848ce1d9265c4134bcef148a91744c7c P b2e22ffd8266454f91a45727bd098a92 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:12.618490 13017 catalog_manager.cc:5697] T cb766527c41242e0ab211622b1f0e268 P b2e22ffd8266454f91a45727bd098a92 reported cstate change: term changed from 0 to 1, leader changed from <none> to b2e22ffd8266454f91a45727bd098a92 (127.12.174.131). New cstate: current_term: 1 leader_uuid: "b2e22ffd8266454f91a45727bd098a92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:12.633683 13341 raft_consensus.cc:493] T 15a6902d3ade4230a51ed07fb1663a27 P 8f34a4731ec24146b05167572a79008f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:12.627328 13370 raft_consensus.cc:697] T 848ce1d9265c4134bcef148a91744c7c P b2e22ffd8266454f91a45727bd098a92 [term 1 LEADER]: Becoming Leader. State: Replica: b2e22ffd8266454f91a45727bd098a92, State: Running, Role: LEADER
I20260709 12:08:12.636356 13314 tablet_bootstrap.cc:492] T db4772bfddd848238ef081fec351b1c9 P b2e22ffd8266454f91a45727bd098a92: No bootstrap required, opened a new log
I20260709 12:08:12.636742 13314 ts_tablet_manager.cc:1403] T db4772bfddd848238ef081fec351b1c9 P b2e22ffd8266454f91a45727bd098a92: Time spent bootstrapping tablet: real 0.135s	user 0.016s	sys 0.007s
I20260709 12:08:12.634893 13341 raft_consensus.cc:515] T 15a6902d3ade4230a51ed07fb1663a27 P 8f34a4731ec24146b05167572a79008f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:12.638803 13321 consensus_queue.cc:1048] T 8211beafbf81439d8629834dbbb3a6b9 P ba142a6ed214425084a138399cc5f489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:12.640239 13341 leader_election.cc:290] T 15a6902d3ade4230a51ed07fb1663a27 P 8f34a4731ec24146b05167572a79008f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ba142a6ed214425084a138399cc5f489 (127.12.174.129:36937), b2e22ffd8266454f91a45727bd098a92 (127.12.174.131:40191)
I20260709 12:08:12.644174 13316 tablet_bootstrap.cc:492] T ad2b770d07aa404ca5c89bdf309b08f9 P 8f34a4731ec24146b05167572a79008f: No bootstrap required, opened a new log
I20260709 12:08:12.644750 13316 ts_tablet_manager.cc:1403] T ad2b770d07aa404ca5c89bdf309b08f9 P 8f34a4731ec24146b05167572a79008f: Time spent bootstrapping tablet: real 0.155s	user 0.031s	sys 0.025s
I20260709 12:08:12.648507 13315 tablet_bootstrap.cc:492] T cb766527c41242e0ab211622b1f0e268 P ba142a6ed214425084a138399cc5f489: No bootstrap required, opened a new log
I20260709 12:08:12.649020 13315 ts_tablet_manager.cc:1403] T cb766527c41242e0ab211622b1f0e268 P ba142a6ed214425084a138399cc5f489: Time spent bootstrapping tablet: real 0.156s	user 0.014s	sys 0.034s
I20260709 12:08:12.648780 13314 raft_consensus.cc:359] T db4772bfddd848238ef081fec351b1c9 P b2e22ffd8266454f91a45727bd098a92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:12.649596 13314 raft_consensus.cc:385] T db4772bfddd848238ef081fec351b1c9 P b2e22ffd8266454f91a45727bd098a92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:12.649546 13316 raft_consensus.cc:359] T ad2b770d07aa404ca5c89bdf309b08f9 P 8f34a4731ec24146b05167572a79008f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:12.650470 13316 raft_consensus.cc:385] T ad2b770d07aa404ca5c89bdf309b08f9 P 8f34a4731ec24146b05167572a79008f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:12.650794 13316 raft_consensus.cc:740] T ad2b770d07aa404ca5c89bdf309b08f9 P 8f34a4731ec24146b05167572a79008f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f34a4731ec24146b05167572a79008f, State: Initialized, Role: FOLLOWER
I20260709 12:08:12.650591 13370 consensus_queue.cc:237] T 848ce1d9265c4134bcef148a91744c7c P b2e22ffd8266454f91a45727bd098a92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:12.651659 13316 consensus_queue.cc:260] T ad2b770d07aa404ca5c89bdf309b08f9 P 8f34a4731ec24146b05167572a79008f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:12.650098 13314 raft_consensus.cc:740] T db4772bfddd848238ef081fec351b1c9 P b2e22ffd8266454f91a45727bd098a92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2e22ffd8266454f91a45727bd098a92, State: Initialized, Role: FOLLOWER
I20260709 12:08:12.653244 13314 consensus_queue.cc:260] T db4772bfddd848238ef081fec351b1c9 P b2e22ffd8266454f91a45727bd098a92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:12.655881 13314 ts_tablet_manager.cc:1434] T db4772bfddd848238ef081fec351b1c9 P b2e22ffd8266454f91a45727bd098a92: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.001s
I20260709 12:08:12.656934 13314 tablet_bootstrap.cc:492] T d5f3329ccf5b4ebf87e0eb8dc143b5d9 P b2e22ffd8266454f91a45727bd098a92: Bootstrap starting.
I20260709 12:08:12.666561 13316 ts_tablet_manager.cc:1434] T ad2b770d07aa404ca5c89bdf309b08f9 P 8f34a4731ec24146b05167572a79008f: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.005s
I20260709 12:08:12.666280 13315 raft_consensus.cc:359] T cb766527c41242e0ab211622b1f0e268 P ba142a6ed214425084a138399cc5f489 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:12.667035 13315 raft_consensus.cc:385] T cb766527c41242e0ab211622b1f0e268 P ba142a6ed214425084a138399cc5f489 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:12.667395 13315 raft_consensus.cc:740] T cb766527c41242e0ab211622b1f0e268 P ba142a6ed214425084a138399cc5f489 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba142a6ed214425084a138399cc5f489, State: Initialized, Role: FOLLOWER
I20260709 12:08:12.668303 13316 tablet_bootstrap.cc:492] T 848ce1d9265c4134bcef148a91744c7c P 8f34a4731ec24146b05167572a79008f: Bootstrap starting.
I20260709 12:08:12.669130 13270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15a6902d3ade4230a51ed07fb1663a27" candidate_uuid: "8f34a4731ec24146b05167572a79008f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2e22ffd8266454f91a45727bd098a92" is_pre_election: true
I20260709 12:08:12.670174 13270 raft_consensus.cc:2468] T 15a6902d3ade4230a51ed07fb1663a27 P b2e22ffd8266454f91a45727bd098a92 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f34a4731ec24146b05167572a79008f in term 0.
I20260709 12:08:12.672359 13162 leader_election.cc:304] T 15a6902d3ade4230a51ed07fb1663a27 P 8f34a4731ec24146b05167572a79008f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f34a4731ec24146b05167572a79008f, b2e22ffd8266454f91a45727bd098a92; no voters: 
I20260709 12:08:12.674383 13341 raft_consensus.cc:2804] T 15a6902d3ade4230a51ed07fb1663a27 P 8f34a4731ec24146b05167572a79008f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:12.674911 13341 raft_consensus.cc:493] T 15a6902d3ade4230a51ed07fb1663a27 P 8f34a4731ec24146b05167572a79008f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:12.675446 13341 raft_consensus.cc:3060] T 15a6902d3ade4230a51ed07fb1663a27 P 8f34a4731ec24146b05167572a79008f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:12.677162 13315 consensus_queue.cc:260] T cb766527c41242e0ab211622b1f0e268 P ba142a6ed214425084a138399cc5f489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:12.679914 13315 ts_tablet_manager.cc:1434] T cb766527c41242e0ab211622b1f0e268 P ba142a6ed214425084a138399cc5f489: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.002s
I20260709 12:08:12.680691 13315 tablet_bootstrap.cc:492] T 15a6902d3ade4230a51ed07fb1663a27 P ba142a6ed214425084a138399cc5f489: Bootstrap starting.
I20260709 12:08:12.677073 13121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15a6902d3ade4230a51ed07fb1663a27" candidate_uuid: "8f34a4731ec24146b05167572a79008f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba142a6ed214425084a138399cc5f489" is_pre_election: true
W20260709 12:08:12.690124 13162 leader_election.cc:343] T 15a6902d3ade4230a51ed07fb1663a27 P 8f34a4731ec24146b05167572a79008f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba142a6ed214425084a138399cc5f489 (127.12.174.129:36937): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:12.704631 13314 tablet_bootstrap.cc:654] T d5f3329ccf5b4ebf87e0eb8dc143b5d9 P b2e22ffd8266454f91a45727bd098a92: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:12.707927 13341 raft_consensus.cc:515] T 15a6902d3ade4230a51ed07fb1663a27 P 8f34a4731ec24146b05167572a79008f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:12.714030 13270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15a6902d3ade4230a51ed07fb1663a27" candidate_uuid: "8f34a4731ec24146b05167572a79008f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2e22ffd8266454f91a45727bd098a92"
I20260709 12:08:12.714980 13270 raft_consensus.cc:3060] T 15a6902d3ade4230a51ed07fb1663a27 P b2e22ffd8266454f91a45727bd098a92 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:12.715095 13121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15a6902d3ade4230a51ed07fb1663a27" candidate_uuid: "8f34a4731ec24146b05167572a79008f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba142a6ed214425084a138399cc5f489"
W20260709 12:08:12.717233 13162 leader_election.cc:343] T 15a6902d3ade4230a51ed07fb1663a27 P 8f34a4731ec24146b05167572a79008f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ba142a6ed214425084a138399cc5f489 (127.12.174.129:36937): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:12.711323 13341 leader_election.cc:290] T 15a6902d3ade4230a51ed07fb1663a27 P 8f34a4731ec24146b05167572a79008f [CANDIDATE]: Term 1 election: Requested vote from peers ba142a6ed214425084a138399cc5f489 (127.12.174.129:36937), b2e22ffd8266454f91a45727bd098a92 (127.12.174.131:40191)
I20260709 12:08:12.726541 13018 catalog_manager.cc:5697] T 848ce1d9265c4134bcef148a91744c7c P b2e22ffd8266454f91a45727bd098a92 reported cstate change: term changed from 0 to 1, leader changed from <none> to b2e22ffd8266454f91a45727bd098a92 (127.12.174.131). New cstate: current_term: 1 leader_uuid: "b2e22ffd8266454f91a45727bd098a92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:12.736440 13315 tablet_bootstrap.cc:654] T 15a6902d3ade4230a51ed07fb1663a27 P ba142a6ed214425084a138399cc5f489: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:12.732573 13270 raft_consensus.cc:2468] T 15a6902d3ade4230a51ed07fb1663a27 P b2e22ffd8266454f91a45727bd098a92 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f34a4731ec24146b05167572a79008f in term 1.
I20260709 12:08:12.747176 13162 leader_election.cc:304] T 15a6902d3ade4230a51ed07fb1663a27 P 8f34a4731ec24146b05167572a79008f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8f34a4731ec24146b05167572a79008f, b2e22ffd8266454f91a45727bd098a92; no voters: ba142a6ed214425084a138399cc5f489
I20260709 12:08:12.753989 13341 raft_consensus.cc:2804] T 15a6902d3ade4230a51ed07fb1663a27 P 8f34a4731ec24146b05167572a79008f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:12.754763 13341 raft_consensus.cc:697] T 15a6902d3ade4230a51ed07fb1663a27 P 8f34a4731ec24146b05167572a79008f [term 1 LEADER]: Becoming Leader. State: Replica: 8f34a4731ec24146b05167572a79008f, State: Running, Role: LEADER
I20260709 12:08:12.756108 13341 consensus_queue.cc:237] T 15a6902d3ade4230a51ed07fb1663a27 P 8f34a4731ec24146b05167572a79008f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:12.766554 13316 tablet_bootstrap.cc:654] T 848ce1d9265c4134bcef148a91744c7c P 8f34a4731ec24146b05167572a79008f: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:12.770558 13195 raft_consensus.cc:3060] T ad2b770d07aa404ca5c89bdf309b08f9 P 8f34a4731ec24146b05167572a79008f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:12.771790 13370 raft_consensus.cc:493] T db4772bfddd848238ef081fec351b1c9 P b2e22ffd8266454f91a45727bd098a92 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:12.772703 13370 raft_consensus.cc:515] T db4772bfddd848238ef081fec351b1c9 P b2e22ffd8266454f91a45727bd098a92 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:12.777714 13121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4772bfddd848238ef081fec351b1c9" candidate_uuid: "b2e22ffd8266454f91a45727bd098a92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba142a6ed214425084a138399cc5f489" is_pre_election: true
I20260709 12:08:12.778633 13121 raft_consensus.cc:2468] T db4772bfddd848238ef081fec351b1c9 P ba142a6ed214425084a138399cc5f489 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2e22ffd8266454f91a45727bd098a92 in term 0.
I20260709 12:08:12.779275 13314 tablet_bootstrap.cc:492] T d5f3329ccf5b4ebf87e0eb8dc143b5d9 P b2e22ffd8266454f91a45727bd098a92: No bootstrap required, opened a new log
I20260709 12:08:12.779767 13314 ts_tablet_manager.cc:1403] T d5f3329ccf5b4ebf87e0eb8dc143b5d9 P b2e22ffd8266454f91a45727bd098a92: Time spent bootstrapping tablet: real 0.123s	user 0.019s	sys 0.013s
I20260709 12:08:12.780182 13196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4772bfddd848238ef081fec351b1c9" candidate_uuid: "b2e22ffd8266454f91a45727bd098a92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f34a4731ec24146b05167572a79008f" is_pre_election: true
I20260709 12:08:12.781221 13196 raft_consensus.cc:2468] T db4772bfddd848238ef081fec351b1c9 P 8f34a4731ec24146b05167572a79008f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2e22ffd8266454f91a45727bd098a92 in term 0.
I20260709 12:08:12.783239 13370 leader_election.cc:290] T db4772bfddd848238ef081fec351b1c9 P b2e22ffd8266454f91a45727bd098a92 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ba142a6ed214425084a138399cc5f489 (127.12.174.129:36937), 8f34a4731ec24146b05167572a79008f (127.12.174.130:45431)
I20260709 12:08:12.784227 13235 leader_election.cc:304] T db4772bfddd848238ef081fec351b1c9 P b2e22ffd8266454f91a45727bd098a92 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f34a4731ec24146b05167572a79008f, b2e22ffd8266454f91a45727bd098a92; no voters: 
I20260709 12:08:12.786322 13315 tablet_bootstrap.cc:492] T 15a6902d3ade4230a51ed07fb1663a27 P ba142a6ed214425084a138399cc5f489: No bootstrap required, opened a new log
I20260709 12:08:12.786844 13315 ts_tablet_manager.cc:1403] T 15a6902d3ade4230a51ed07fb1663a27 P ba142a6ed214425084a138399cc5f489: Time spent bootstrapping tablet: real 0.106s	user 0.021s	sys 0.020s
I20260709 12:08:12.788081 13314 raft_consensus.cc:359] T d5f3329ccf5b4ebf87e0eb8dc143b5d9 P b2e22ffd8266454f91a45727bd098a92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:12.788928 13314 raft_consensus.cc:385] T d5f3329ccf5b4ebf87e0eb8dc143b5d9 P b2e22ffd8266454f91a45727bd098a92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:12.789227 13314 raft_consensus.cc:740] T d5f3329ccf5b4ebf87e0eb8dc143b5d9 P b2e22ffd8266454f91a45727bd098a92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2e22ffd8266454f91a45727bd098a92, State: Initialized, Role: FOLLOWER
I20260709 12:08:12.790174 13314 consensus_queue.cc:260] T d5f3329ccf5b4ebf87e0eb8dc143b5d9 P b2e22ffd8266454f91a45727bd098a92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:12.792080 13316 tablet_bootstrap.cc:492] T 848ce1d9265c4134bcef148a91744c7c P 8f34a4731ec24146b05167572a79008f: No bootstrap required, opened a new log
I20260709 12:08:12.792541 13314 ts_tablet_manager.cc:1434] T d5f3329ccf5b4ebf87e0eb8dc143b5d9 P b2e22ffd8266454f91a45727bd098a92: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 12:08:12.789134 13370 raft_consensus.cc:2804] T db4772bfddd848238ef081fec351b1c9 P b2e22ffd8266454f91a45727bd098a92 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:12.810901 13370 raft_consensus.cc:493] T db4772bfddd848238ef081fec351b1c9 P b2e22ffd8266454f91a45727bd098a92 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:12.811479 13370 raft_consensus.cc:3060] T db4772bfddd848238ef081fec351b1c9 P b2e22ffd8266454f91a45727bd098a92 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:12.795094 13017 catalog_manager.cc:5697] T 15a6902d3ade4230a51ed07fb1663a27 P 8f34a4731ec24146b05167572a79008f reported cstate change: term changed from 0 to 1, leader changed from <none> to 8f34a4731ec24146b05167572a79008f (127.12.174.130). New cstate: current_term: 1 leader_uuid: "8f34a4731ec24146b05167572a79008f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:12.812566 13270 raft_consensus.cc:3060] T d5f3329ccf5b4ebf87e0eb8dc143b5d9 P b2e22ffd8266454f91a45727bd098a92 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:12.811636 13348 consensus_queue.cc:1048] T ad2b770d07aa404ca5c89bdf309b08f9 P ba142a6ed214425084a138399cc5f489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:08:12.800949 13321 consensus_queue.cc:1048] T 3ff6b11516e44942a67136b30bc48aa1 P ba142a6ed214425084a138399cc5f489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260709 12:08:12.792627 13316 ts_tablet_manager.cc:1403] T 848ce1d9265c4134bcef148a91744c7c P 8f34a4731ec24146b05167572a79008f: Time spent bootstrapping tablet: real 0.125s	user 0.005s	sys 0.023s
I20260709 12:08:12.817356 13315 raft_consensus.cc:359] T 15a6902d3ade4230a51ed07fb1663a27 P ba142a6ed214425084a138399cc5f489 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:12.821560 13315 raft_consensus.cc:385] T 15a6902d3ade4230a51ed07fb1663a27 P ba142a6ed214425084a138399cc5f489 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:12.822221 13315 raft_consensus.cc:740] T 15a6902d3ade4230a51ed07fb1663a27 P ba142a6ed214425084a138399cc5f489 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba142a6ed214425084a138399cc5f489, State: Initialized, Role: FOLLOWER
I20260709 12:08:12.827448 13315 consensus_queue.cc:260] T 15a6902d3ade4230a51ed07fb1663a27 P ba142a6ed214425084a138399cc5f489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:12.835395 13315 ts_tablet_manager.cc:1434] T 15a6902d3ade4230a51ed07fb1663a27 P ba142a6ed214425084a138399cc5f489: Time spent starting tablet: real 0.048s	user 0.012s	sys 0.000s
I20260709 12:08:12.835074 13370 raft_consensus.cc:515] T db4772bfddd848238ef081fec351b1c9 P b2e22ffd8266454f91a45727bd098a92 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:12.844457 13316 raft_consensus.cc:359] T 848ce1d9265c4134bcef148a91744c7c P 8f34a4731ec24146b05167572a79008f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:12.845404 13316 raft_consensus.cc:385] T 848ce1d9265c4134bcef148a91744c7c P 8f34a4731ec24146b05167572a79008f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:12.845676 13316 raft_consensus.cc:740] T 848ce1d9265c4134bcef148a91744c7c P 8f34a4731ec24146b05167572a79008f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f34a4731ec24146b05167572a79008f, State: Initialized, Role: FOLLOWER
I20260709 12:08:12.846427 13316 consensus_queue.cc:260] T 848ce1d9265c4134bcef148a91744c7c P 8f34a4731ec24146b05167572a79008f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:12.857311 13121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4772bfddd848238ef081fec351b1c9" candidate_uuid: "b2e22ffd8266454f91a45727bd098a92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba142a6ed214425084a138399cc5f489"
I20260709 12:08:12.856175 13321 consensus_queue.cc:1048] T ad2b770d07aa404ca5c89bdf309b08f9 P ba142a6ed214425084a138399cc5f489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:08:12.858201 13121 raft_consensus.cc:3060] T db4772bfddd848238ef081fec351b1c9 P ba142a6ed214425084a138399cc5f489 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:12.859993 13316 ts_tablet_manager.cc:1434] T 848ce1d9265c4134bcef148a91744c7c P 8f34a4731ec24146b05167572a79008f: Time spent starting tablet: real 0.039s	user 0.004s	sys 0.004s
I20260709 12:08:12.860764 13370 leader_election.cc:290] T db4772bfddd848238ef081fec351b1c9 P b2e22ffd8266454f91a45727bd098a92 [CANDIDATE]: Term 1 election: Requested vote from peers ba142a6ed214425084a138399cc5f489 (127.12.174.129:36937), 8f34a4731ec24146b05167572a79008f (127.12.174.130:45431)
I20260709 12:08:12.873872 13195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4772bfddd848238ef081fec351b1c9" candidate_uuid: "b2e22ffd8266454f91a45727bd098a92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f34a4731ec24146b05167572a79008f"
I20260709 12:08:12.875051 13195 raft_consensus.cc:3060] T db4772bfddd848238ef081fec351b1c9 P 8f34a4731ec24146b05167572a79008f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:12.888804 13321 consensus_queue.cc:1048] T 3ff6b11516e44942a67136b30bc48aa1 P ba142a6ed214425084a138399cc5f489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:12.898931 13358 consensus_queue.cc:1048] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P ba142a6ed214425084a138399cc5f489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:12.904762 13121 raft_consensus.cc:2468] T db4772bfddd848238ef081fec351b1c9 P ba142a6ed214425084a138399cc5f489 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2e22ffd8266454f91a45727bd098a92 in term 1.
I20260709 12:08:12.919512 13236 leader_election.cc:304] T db4772bfddd848238ef081fec351b1c9 P b2e22ffd8266454f91a45727bd098a92 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2e22ffd8266454f91a45727bd098a92, ba142a6ed214425084a138399cc5f489; no voters: 
I20260709 12:08:12.921223 13370 raft_consensus.cc:2804] T db4772bfddd848238ef081fec351b1c9 P b2e22ffd8266454f91a45727bd098a92 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:12.923555 13370 raft_consensus.cc:697] T db4772bfddd848238ef081fec351b1c9 P b2e22ffd8266454f91a45727bd098a92 [term 1 LEADER]: Becoming Leader. State: Replica: b2e22ffd8266454f91a45727bd098a92, State: Running, Role: LEADER
I20260709 12:08:12.930838 13195 raft_consensus.cc:2468] T db4772bfddd848238ef081fec351b1c9 P 8f34a4731ec24146b05167572a79008f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2e22ffd8266454f91a45727bd098a92 in term 1.
I20260709 12:08:12.926419 13370 consensus_queue.cc:237] T db4772bfddd848238ef081fec351b1c9 P b2e22ffd8266454f91a45727bd098a92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:12.982564 13348 consensus_queue.cc:1048] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P ba142a6ed214425084a138399cc5f489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:12.994650 13018 catalog_manager.cc:5697] T db4772bfddd848238ef081fec351b1c9 P b2e22ffd8266454f91a45727bd098a92 reported cstate change: term changed from 0 to 1, leader changed from <none> to b2e22ffd8266454f91a45727bd098a92 (127.12.174.131). New cstate: current_term: 1 leader_uuid: "b2e22ffd8266454f91a45727bd098a92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:13.032298 13348 raft_consensus.cc:493] T cb766527c41242e0ab211622b1f0e268 P ba142a6ed214425084a138399cc5f489 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:13.033066 13348 raft_consensus.cc:515] T cb766527c41242e0ab211622b1f0e268 P ba142a6ed214425084a138399cc5f489 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:13.035933 13348 leader_election.cc:290] T cb766527c41242e0ab211622b1f0e268 P ba142a6ed214425084a138399cc5f489 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f34a4731ec24146b05167572a79008f (127.12.174.130:45431), b2e22ffd8266454f91a45727bd098a92 (127.12.174.131:40191)
I20260709 12:08:13.037179 13194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb766527c41242e0ab211622b1f0e268" candidate_uuid: "ba142a6ed214425084a138399cc5f489" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f34a4731ec24146b05167572a79008f" is_pre_election: true
I20260709 12:08:13.038426 13270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb766527c41242e0ab211622b1f0e268" candidate_uuid: "ba142a6ed214425084a138399cc5f489" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2e22ffd8266454f91a45727bd098a92" is_pre_election: true
I20260709 12:08:13.038856 13194 raft_consensus.cc:2393] T cb766527c41242e0ab211622b1f0e268 P 8f34a4731ec24146b05167572a79008f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba142a6ed214425084a138399cc5f489 in current term 1: Already voted for candidate b2e22ffd8266454f91a45727bd098a92 in this term.
I20260709 12:08:13.041838 13087 leader_election.cc:304] T cb766527c41242e0ab211622b1f0e268 P ba142a6ed214425084a138399cc5f489 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba142a6ed214425084a138399cc5f489; no voters: 8f34a4731ec24146b05167572a79008f, b2e22ffd8266454f91a45727bd098a92
I20260709 12:08:13.044202 13321 raft_consensus.cc:3060] T cb766527c41242e0ab211622b1f0e268 P ba142a6ed214425084a138399cc5f489 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:13.056277 13321 raft_consensus.cc:2749] T cb766527c41242e0ab211622b1f0e268 P ba142a6ed214425084a138399cc5f489 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:13.061913 13370 consensus_queue.cc:1048] T cb766527c41242e0ab211622b1f0e268 P b2e22ffd8266454f91a45727bd098a92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:13.080111 13370 consensus_queue.cc:1048] T cb766527c41242e0ab211622b1f0e268 P b2e22ffd8266454f91a45727bd098a92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:13.139269 13344 consensus_queue.cc:1048] T 848ce1d9265c4134bcef148a91744c7c P b2e22ffd8266454f91a45727bd098a92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:13.151455 13194 raft_consensus.cc:3060] T 848ce1d9265c4134bcef148a91744c7c P 8f34a4731ec24146b05167572a79008f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:13.160720 13393 consensus_queue.cc:1048] T 848ce1d9265c4134bcef148a91744c7c P b2e22ffd8266454f91a45727bd098a92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:13.222591 13321 raft_consensus.cc:493] T 15a6902d3ade4230a51ed07fb1663a27 P ba142a6ed214425084a138399cc5f489 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:13.223400 13321 raft_consensus.cc:515] T 15a6902d3ade4230a51ed07fb1663a27 P ba142a6ed214425084a138399cc5f489 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:13.227198 13321 leader_election.cc:290] T 15a6902d3ade4230a51ed07fb1663a27 P ba142a6ed214425084a138399cc5f489 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f34a4731ec24146b05167572a79008f (127.12.174.130:45431), b2e22ffd8266454f91a45727bd098a92 (127.12.174.131:40191)
I20260709 12:08:13.228475 13194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15a6902d3ade4230a51ed07fb1663a27" candidate_uuid: "ba142a6ed214425084a138399cc5f489" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f34a4731ec24146b05167572a79008f" is_pre_election: true
I20260709 12:08:13.228893 13270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15a6902d3ade4230a51ed07fb1663a27" candidate_uuid: "ba142a6ed214425084a138399cc5f489" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2e22ffd8266454f91a45727bd098a92" is_pre_election: true
I20260709 12:08:13.230016 13270 raft_consensus.cc:2393] T 15a6902d3ade4230a51ed07fb1663a27 P b2e22ffd8266454f91a45727bd098a92 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba142a6ed214425084a138399cc5f489 in current term 1: Already voted for candidate 8f34a4731ec24146b05167572a79008f in this term.
I20260709 12:08:13.231577 13087 leader_election.cc:304] T 15a6902d3ade4230a51ed07fb1663a27 P ba142a6ed214425084a138399cc5f489 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba142a6ed214425084a138399cc5f489; no voters: 8f34a4731ec24146b05167572a79008f, b2e22ffd8266454f91a45727bd098a92
I20260709 12:08:13.232789 13321 raft_consensus.cc:3060] T 15a6902d3ade4230a51ed07fb1663a27 P ba142a6ed214425084a138399cc5f489 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:13.243016 13321 raft_consensus.cc:2749] T 15a6902d3ade4230a51ed07fb1663a27 P ba142a6ed214425084a138399cc5f489 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:13.356159 13340 consensus_queue.cc:1048] T 15a6902d3ade4230a51ed07fb1663a27 P 8f34a4731ec24146b05167572a79008f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:13.368614 13340 consensus_queue.cc:1048] T 15a6902d3ade4230a51ed07fb1663a27 P 8f34a4731ec24146b05167572a79008f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:13.441835 13393 consensus_queue.cc:1048] T db4772bfddd848238ef081fec351b1c9 P b2e22ffd8266454f91a45727bd098a92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:13.460364 13393 consensus_queue.cc:1048] T db4772bfddd848238ef081fec351b1c9 P b2e22ffd8266454f91a45727bd098a92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:13.517282 13194 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d5f3329ccf5b4ebf87e0eb8dc143b5d9"
dest_uuid: "8f34a4731ec24146b05167572a79008f"
mode: GRACEFUL
new_leader_uuid: "ba142a6ed214425084a138399cc5f489"
 from {username='slave'} at 127.0.0.1:32838
I20260709 12:08:13.518151 13194 raft_consensus.cc:606] T d5f3329ccf5b4ebf87e0eb8dc143b5d9 P 8f34a4731ec24146b05167572a79008f [term 1 LEADER]: Received request to transfer leadership to TS ba142a6ed214425084a138399cc5f489
I20260709 12:08:13.543011 13270 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "db4772bfddd848238ef081fec351b1c9"
dest_uuid: "b2e22ffd8266454f91a45727bd098a92"
mode: GRACEFUL
new_leader_uuid: "ba142a6ed214425084a138399cc5f489"
 from {username='slave'} at 127.0.0.1:44804
I20260709 12:08:13.543805 13270 raft_consensus.cc:606] T db4772bfddd848238ef081fec351b1c9 P b2e22ffd8266454f91a45727bd098a92 [term 1 LEADER]: Received request to transfer leadership to TS ba142a6ed214425084a138399cc5f489
I20260709 12:08:13.549253 13398 raft_consensus.cc:993] T d5f3329ccf5b4ebf87e0eb8dc143b5d9 P 8f34a4731ec24146b05167572a79008f: : Instructing follower ba142a6ed214425084a138399cc5f489 to start an election
I20260709 12:08:13.549954 13340 raft_consensus.cc:1081] T d5f3329ccf5b4ebf87e0eb8dc143b5d9 P 8f34a4731ec24146b05167572a79008f [term 1 LEADER]: Signalling peer ba142a6ed214425084a138399cc5f489 to start an election
I20260709 12:08:13.552304 13121 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d5f3329ccf5b4ebf87e0eb8dc143b5d9"
dest_uuid: "ba142a6ed214425084a138399cc5f489"
 from {username='slave'} at 127.0.0.1:39318
I20260709 12:08:13.553222 13121 raft_consensus.cc:493] T d5f3329ccf5b4ebf87e0eb8dc143b5d9 P ba142a6ed214425084a138399cc5f489 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:13.553818 13121 raft_consensus.cc:3060] T d5f3329ccf5b4ebf87e0eb8dc143b5d9 P ba142a6ed214425084a138399cc5f489 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:13.556895 13270 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cb766527c41242e0ab211622b1f0e268"
dest_uuid: "b2e22ffd8266454f91a45727bd098a92"
mode: GRACEFUL
new_leader_uuid: "8f34a4731ec24146b05167572a79008f"
 from {username='slave'} at 127.0.0.1:44804
I20260709 12:08:13.557713 13270 raft_consensus.cc:606] T cb766527c41242e0ab211622b1f0e268 P b2e22ffd8266454f91a45727bd098a92 [term 1 LEADER]: Received request to transfer leadership to TS 8f34a4731ec24146b05167572a79008f
I20260709 12:08:13.564707 13121 raft_consensus.cc:515] T d5f3329ccf5b4ebf87e0eb8dc143b5d9 P ba142a6ed214425084a138399cc5f489 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:13.569494 13194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f3329ccf5b4ebf87e0eb8dc143b5d9" candidate_uuid: "ba142a6ed214425084a138399cc5f489" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8f34a4731ec24146b05167572a79008f"
I20260709 12:08:13.570442 13194 raft_consensus.cc:3055] T d5f3329ccf5b4ebf87e0eb8dc143b5d9 P 8f34a4731ec24146b05167572a79008f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:13.570957 13194 raft_consensus.cc:740] T d5f3329ccf5b4ebf87e0eb8dc143b5d9 P 8f34a4731ec24146b05167572a79008f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8f34a4731ec24146b05167572a79008f, State: Running, Role: LEADER
I20260709 12:08:13.571781 13270 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "848ce1d9265c4134bcef148a91744c7c"
dest_uuid: "b2e22ffd8266454f91a45727bd098a92"
mode: GRACEFUL
new_leader_uuid: "8f34a4731ec24146b05167572a79008f"
 from {username='slave'} at 127.0.0.1:44804
I20260709 12:08:13.572670 13121 leader_election.cc:290] T d5f3329ccf5b4ebf87e0eb8dc143b5d9 P ba142a6ed214425084a138399cc5f489 [CANDIDATE]: Term 2 election: Requested vote from peers 8f34a4731ec24146b05167572a79008f (127.12.174.130:45431), b2e22ffd8266454f91a45727bd098a92 (127.12.174.131:40191)
I20260709 12:08:13.572687 13270 raft_consensus.cc:606] T 848ce1d9265c4134bcef148a91744c7c P b2e22ffd8266454f91a45727bd098a92 [term 1 LEADER]: Received request to transfer leadership to TS 8f34a4731ec24146b05167572a79008f
I20260709 12:08:13.572309 13194 consensus_queue.cc:260] T d5f3329ccf5b4ebf87e0eb8dc143b5d9 P 8f34a4731ec24146b05167572a79008f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:13.574381 13267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f3329ccf5b4ebf87e0eb8dc143b5d9" candidate_uuid: "ba142a6ed214425084a138399cc5f489" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b2e22ffd8266454f91a45727bd098a92"
I20260709 12:08:13.575352 13267 raft_consensus.cc:3060] T d5f3329ccf5b4ebf87e0eb8dc143b5d9 P b2e22ffd8266454f91a45727bd098a92 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:13.576442 13194 raft_consensus.cc:3060] T d5f3329ccf5b4ebf87e0eb8dc143b5d9 P 8f34a4731ec24146b05167572a79008f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:13.578555 13370 raft_consensus.cc:993] T cb766527c41242e0ab211622b1f0e268 P b2e22ffd8266454f91a45727bd098a92: : Instructing follower 8f34a4731ec24146b05167572a79008f to start an election
I20260709 12:08:13.579286 13393 raft_consensus.cc:1081] T cb766527c41242e0ab211622b1f0e268 P b2e22ffd8266454f91a45727bd098a92 [term 1 LEADER]: Signalling peer 8f34a4731ec24146b05167572a79008f to start an election
I20260709 12:08:13.581918 13195 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cb766527c41242e0ab211622b1f0e268"
dest_uuid: "8f34a4731ec24146b05167572a79008f"
 from {username='slave'} at 127.0.0.1:51148
I20260709 12:08:13.582796 13195 raft_consensus.cc:493] T cb766527c41242e0ab211622b1f0e268 P 8f34a4731ec24146b05167572a79008f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:13.583359 13195 raft_consensus.cc:3060] T cb766527c41242e0ab211622b1f0e268 P 8f34a4731ec24146b05167572a79008f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:13.591661 13194 raft_consensus.cc:2468] T d5f3329ccf5b4ebf87e0eb8dc143b5d9 P 8f34a4731ec24146b05167572a79008f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba142a6ed214425084a138399cc5f489 in term 2.
I20260709 12:08:13.593587 13086 leader_election.cc:304] T d5f3329ccf5b4ebf87e0eb8dc143b5d9 P ba142a6ed214425084a138399cc5f489 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f34a4731ec24146b05167572a79008f, ba142a6ed214425084a138399cc5f489; no voters: 
I20260709 12:08:13.595064 13321 raft_consensus.cc:2804] T d5f3329ccf5b4ebf87e0eb8dc143b5d9 P ba142a6ed214425084a138399cc5f489 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:13.596139 13321 raft_consensus.cc:697] T d5f3329ccf5b4ebf87e0eb8dc143b5d9 P ba142a6ed214425084a138399cc5f489 [term 2 LEADER]: Becoming Leader. State: Replica: ba142a6ed214425084a138399cc5f489, State: Running, Role: LEADER
I20260709 12:08:13.597489 13321 consensus_queue.cc:237] T d5f3329ccf5b4ebf87e0eb8dc143b5d9 P ba142a6ed214425084a138399cc5f489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:13.599676 13394 raft_consensus.cc:993] T 848ce1d9265c4134bcef148a91744c7c P b2e22ffd8266454f91a45727bd098a92: : Instructing follower 8f34a4731ec24146b05167572a79008f to start an election
I20260709 12:08:13.600325 13394 raft_consensus.cc:1081] T 848ce1d9265c4134bcef148a91744c7c P b2e22ffd8266454f91a45727bd098a92 [term 1 LEADER]: Signalling peer 8f34a4731ec24146b05167572a79008f to start an election
I20260709 12:08:13.603432 13196 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "848ce1d9265c4134bcef148a91744c7c"
dest_uuid: "8f34a4731ec24146b05167572a79008f"
 from {username='slave'} at 127.0.0.1:51148
I20260709 12:08:13.604310 13196 raft_consensus.cc:493] T 848ce1d9265c4134bcef148a91744c7c P 8f34a4731ec24146b05167572a79008f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:13.604875 13196 raft_consensus.cc:3060] T 848ce1d9265c4134bcef148a91744c7c P 8f34a4731ec24146b05167572a79008f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:13.608170 13195 raft_consensus.cc:515] T cb766527c41242e0ab211622b1f0e268 P 8f34a4731ec24146b05167572a79008f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:13.611567 13267 raft_consensus.cc:2468] T d5f3329ccf5b4ebf87e0eb8dc143b5d9 P b2e22ffd8266454f91a45727bd098a92 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba142a6ed214425084a138399cc5f489 in term 2.
I20260709 12:08:13.613436 13195 leader_election.cc:290] T cb766527c41242e0ab211622b1f0e268 P 8f34a4731ec24146b05167572a79008f [CANDIDATE]: Term 2 election: Requested vote from peers ba142a6ed214425084a138399cc5f489 (127.12.174.129:36937), b2e22ffd8266454f91a45727bd098a92 (127.12.174.131:40191)
I20260709 12:08:13.614466 13270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb766527c41242e0ab211622b1f0e268" candidate_uuid: "8f34a4731ec24146b05167572a79008f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b2e22ffd8266454f91a45727bd098a92"
I20260709 12:08:13.615444 13270 raft_consensus.cc:3055] T cb766527c41242e0ab211622b1f0e268 P b2e22ffd8266454f91a45727bd098a92 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:13.615921 13270 raft_consensus.cc:740] T cb766527c41242e0ab211622b1f0e268 P b2e22ffd8266454f91a45727bd098a92 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b2e22ffd8266454f91a45727bd098a92, State: Running, Role: LEADER
I20260709 12:08:13.619366 13121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb766527c41242e0ab211622b1f0e268" candidate_uuid: "8f34a4731ec24146b05167572a79008f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ba142a6ed214425084a138399cc5f489"
I20260709 12:08:13.620240 13121 raft_consensus.cc:3060] T cb766527c41242e0ab211622b1f0e268 P ba142a6ed214425084a138399cc5f489 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:13.637876 13270 consensus_queue.cc:260] T cb766527c41242e0ab211622b1f0e268 P b2e22ffd8266454f91a45727bd098a92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:13.639474 13270 raft_consensus.cc:3060] T cb766527c41242e0ab211622b1f0e268 P b2e22ffd8266454f91a45727bd098a92 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:13.639844 13196 raft_consensus.cc:515] T 848ce1d9265c4134bcef148a91744c7c P 8f34a4731ec24146b05167572a79008f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:13.643448 13267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848ce1d9265c4134bcef148a91744c7c" candidate_uuid: "8f34a4731ec24146b05167572a79008f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b2e22ffd8266454f91a45727bd098a92"
I20260709 12:08:13.644058 13119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848ce1d9265c4134bcef148a91744c7c" candidate_uuid: "8f34a4731ec24146b05167572a79008f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ba142a6ed214425084a138399cc5f489"
I20260709 12:08:13.644806 13119 raft_consensus.cc:3060] T 848ce1d9265c4134bcef148a91744c7c P ba142a6ed214425084a138399cc5f489 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:13.646502 13017 catalog_manager.cc:5697] T d5f3329ccf5b4ebf87e0eb8dc143b5d9 P ba142a6ed214425084a138399cc5f489 reported cstate change: term changed from 1 to 2, leader changed from 8f34a4731ec24146b05167572a79008f (127.12.174.130) to ba142a6ed214425084a138399cc5f489 (127.12.174.129). New cstate: current_term: 2 leader_uuid: "ba142a6ed214425084a138399cc5f489" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:13.647711 13270 raft_consensus.cc:2468] T cb766527c41242e0ab211622b1f0e268 P b2e22ffd8266454f91a45727bd098a92 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f34a4731ec24146b05167572a79008f in term 2.
I20260709 12:08:13.649137 13162 leader_election.cc:304] T cb766527c41242e0ab211622b1f0e268 P 8f34a4731ec24146b05167572a79008f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f34a4731ec24146b05167572a79008f, b2e22ffd8266454f91a45727bd098a92; no voters: 
I20260709 12:08:13.650060 13340 raft_consensus.cc:2804] T cb766527c41242e0ab211622b1f0e268 P 8f34a4731ec24146b05167572a79008f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:13.650602 13340 raft_consensus.cc:697] T cb766527c41242e0ab211622b1f0e268 P 8f34a4731ec24146b05167572a79008f [term 2 LEADER]: Becoming Leader. State: Replica: 8f34a4731ec24146b05167572a79008f, State: Running, Role: LEADER
I20260709 12:08:13.652017 13340 consensus_queue.cc:237] T cb766527c41242e0ab211622b1f0e268 P 8f34a4731ec24146b05167572a79008f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:13.644150 13267 raft_consensus.cc:3055] T 848ce1d9265c4134bcef148a91744c7c P b2e22ffd8266454f91a45727bd098a92 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:13.656157 13267 raft_consensus.cc:740] T 848ce1d9265c4134bcef148a91744c7c P b2e22ffd8266454f91a45727bd098a92 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b2e22ffd8266454f91a45727bd098a92, State: Running, Role: LEADER
I20260709 12:08:13.657261 13119 raft_consensus.cc:2468] T 848ce1d9265c4134bcef148a91744c7c P ba142a6ed214425084a138399cc5f489 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f34a4731ec24146b05167572a79008f in term 2.
I20260709 12:08:13.657476 13267 consensus_queue.cc:260] T 848ce1d9265c4134bcef148a91744c7c P b2e22ffd8266454f91a45727bd098a92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:13.659514 13267 raft_consensus.cc:3060] T 848ce1d9265c4134bcef148a91744c7c P b2e22ffd8266454f91a45727bd098a92 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:13.661881 13119 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8211beafbf81439d8629834dbbb3a6b9"
dest_uuid: "ba142a6ed214425084a138399cc5f489"
mode: GRACEFUL
new_leader_uuid: "8f34a4731ec24146b05167572a79008f"
 from {username='slave'} at 127.0.0.1:48038
I20260709 12:08:13.662878 13119 raft_consensus.cc:606] T 8211beafbf81439d8629834dbbb3a6b9 P ba142a6ed214425084a138399cc5f489 [term 1 LEADER]: Received request to transfer leadership to TS 8f34a4731ec24146b05167572a79008f
I20260709 12:08:13.642225 13196 leader_election.cc:290] T 848ce1d9265c4134bcef148a91744c7c P 8f34a4731ec24146b05167572a79008f [CANDIDATE]: Term 2 election: Requested vote from peers ba142a6ed214425084a138399cc5f489 (127.12.174.129:36937), b2e22ffd8266454f91a45727bd098a92 (127.12.174.131:40191)
I20260709 12:08:13.665861 13121 raft_consensus.cc:2468] T cb766527c41242e0ab211622b1f0e268 P ba142a6ed214425084a138399cc5f489 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f34a4731ec24146b05167572a79008f in term 2.
I20260709 12:08:13.672499 13121 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ad2b770d07aa404ca5c89bdf309b08f9"
dest_uuid: "ba142a6ed214425084a138399cc5f489"
mode: GRACEFUL
new_leader_uuid: "b2e22ffd8266454f91a45727bd098a92"
 from {username='slave'} at 127.0.0.1:48038
I20260709 12:08:13.671383 13016 catalog_manager.cc:5697] T cb766527c41242e0ab211622b1f0e268 P 8f34a4731ec24146b05167572a79008f reported cstate change: term changed from 1 to 2, leader changed from b2e22ffd8266454f91a45727bd098a92 (127.12.174.131) to 8f34a4731ec24146b05167572a79008f (127.12.174.130). New cstate: current_term: 2 leader_uuid: "8f34a4731ec24146b05167572a79008f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:13.672454 13162 leader_election.cc:304] T 848ce1d9265c4134bcef148a91744c7c P 8f34a4731ec24146b05167572a79008f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f34a4731ec24146b05167572a79008f, ba142a6ed214425084a138399cc5f489; no voters: 
I20260709 12:08:13.673988 13121 raft_consensus.cc:606] T ad2b770d07aa404ca5c89bdf309b08f9 P ba142a6ed214425084a138399cc5f489 [term 1 LEADER]: Received request to transfer leadership to TS b2e22ffd8266454f91a45727bd098a92
I20260709 12:08:13.677181 13267 raft_consensus.cc:2468] T 848ce1d9265c4134bcef148a91744c7c P b2e22ffd8266454f91a45727bd098a92 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f34a4731ec24146b05167572a79008f in term 2.
I20260709 12:08:13.677949 13340 raft_consensus.cc:2804] T 848ce1d9265c4134bcef148a91744c7c P 8f34a4731ec24146b05167572a79008f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:13.678676 13340 raft_consensus.cc:697] T 848ce1d9265c4134bcef148a91744c7c P 8f34a4731ec24146b05167572a79008f [term 2 LEADER]: Becoming Leader. State: Replica: 8f34a4731ec24146b05167572a79008f, State: Running, Role: LEADER
I20260709 12:08:13.679811 13340 consensus_queue.cc:237] T 848ce1d9265c4134bcef148a91744c7c P 8f34a4731ec24146b05167572a79008f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:13.700932 13016 catalog_manager.cc:5697] T 848ce1d9265c4134bcef148a91744c7c P 8f34a4731ec24146b05167572a79008f reported cstate change: term changed from 1 to 2, leader changed from b2e22ffd8266454f91a45727bd098a92 (127.12.174.131) to 8f34a4731ec24146b05167572a79008f (127.12.174.130). New cstate: current_term: 2 leader_uuid: "8f34a4731ec24146b05167572a79008f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:14.003454 13358 raft_consensus.cc:993] T ad2b770d07aa404ca5c89bdf309b08f9 P ba142a6ed214425084a138399cc5f489: : Instructing follower b2e22ffd8266454f91a45727bd098a92 to start an election
I20260709 12:08:14.003928 13321 raft_consensus.cc:1081] T ad2b770d07aa404ca5c89bdf309b08f9 P ba142a6ed214425084a138399cc5f489 [term 1 LEADER]: Signalling peer b2e22ffd8266454f91a45727bd098a92 to start an election
I20260709 12:08:14.005684 13270 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ad2b770d07aa404ca5c89bdf309b08f9"
dest_uuid: "b2e22ffd8266454f91a45727bd098a92"
 from {username='slave'} at 127.0.0.1:56322
I20260709 12:08:14.006364 13270 raft_consensus.cc:493] T ad2b770d07aa404ca5c89bdf309b08f9 P b2e22ffd8266454f91a45727bd098a92 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:14.006717 13270 raft_consensus.cc:3060] T ad2b770d07aa404ca5c89bdf309b08f9 P b2e22ffd8266454f91a45727bd098a92 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:14.012341 13270 raft_consensus.cc:515] T ad2b770d07aa404ca5c89bdf309b08f9 P b2e22ffd8266454f91a45727bd098a92 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:14.014851 13270 leader_election.cc:290] T ad2b770d07aa404ca5c89bdf309b08f9 P b2e22ffd8266454f91a45727bd098a92 [CANDIDATE]: Term 2 election: Requested vote from peers ba142a6ed214425084a138399cc5f489 (127.12.174.129:36937), 8f34a4731ec24146b05167572a79008f (127.12.174.130:45431)
I20260709 12:08:14.015691 13121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad2b770d07aa404ca5c89bdf309b08f9" candidate_uuid: "b2e22ffd8266454f91a45727bd098a92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ba142a6ed214425084a138399cc5f489"
I20260709 12:08:14.015945 13196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad2b770d07aa404ca5c89bdf309b08f9" candidate_uuid: "b2e22ffd8266454f91a45727bd098a92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8f34a4731ec24146b05167572a79008f"
I20260709 12:08:14.016438 13121 raft_consensus.cc:3055] T ad2b770d07aa404ca5c89bdf309b08f9 P ba142a6ed214425084a138399cc5f489 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:14.016490 13196 raft_consensus.cc:3060] T ad2b770d07aa404ca5c89bdf309b08f9 P 8f34a4731ec24146b05167572a79008f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:14.017051 13121 raft_consensus.cc:740] T ad2b770d07aa404ca5c89bdf309b08f9 P ba142a6ed214425084a138399cc5f489 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ba142a6ed214425084a138399cc5f489, State: Running, Role: LEADER
I20260709 12:08:14.018050 13121 consensus_queue.cc:260] T ad2b770d07aa404ca5c89bdf309b08f9 P ba142a6ed214425084a138399cc5f489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:14.019389 13121 raft_consensus.cc:3060] T ad2b770d07aa404ca5c89bdf309b08f9 P ba142a6ed214425084a138399cc5f489 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:14.025359 13196 raft_consensus.cc:2468] T ad2b770d07aa404ca5c89bdf309b08f9 P 8f34a4731ec24146b05167572a79008f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2e22ffd8266454f91a45727bd098a92 in term 2.
I20260709 12:08:14.026937 13235 leader_election.cc:304] T ad2b770d07aa404ca5c89bdf309b08f9 P b2e22ffd8266454f91a45727bd098a92 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f34a4731ec24146b05167572a79008f, b2e22ffd8266454f91a45727bd098a92; no voters: 
I20260709 12:08:14.027159 13121 raft_consensus.cc:2468] T ad2b770d07aa404ca5c89bdf309b08f9 P ba142a6ed214425084a138399cc5f489 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2e22ffd8266454f91a45727bd098a92 in term 2.
I20260709 12:08:14.027712 13393 raft_consensus.cc:2804] T ad2b770d07aa404ca5c89bdf309b08f9 P b2e22ffd8266454f91a45727bd098a92 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:14.028184 13393 raft_consensus.cc:697] T ad2b770d07aa404ca5c89bdf309b08f9 P b2e22ffd8266454f91a45727bd098a92 [term 2 LEADER]: Becoming Leader. State: Replica: b2e22ffd8266454f91a45727bd098a92, State: Running, Role: LEADER
I20260709 12:08:14.029057 13393 consensus_queue.cc:237] T ad2b770d07aa404ca5c89bdf309b08f9 P b2e22ffd8266454f91a45727bd098a92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:14.030985 13196 raft_consensus.cc:1275] T d5f3329ccf5b4ebf87e0eb8dc143b5d9 P 8f34a4731ec24146b05167572a79008f [term 2 FOLLOWER]: Refusing update from remote peer ba142a6ed214425084a138399cc5f489: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:14.032491 13321 consensus_queue.cc:1048] T d5f3329ccf5b4ebf87e0eb8dc143b5d9 P ba142a6ed214425084a138399cc5f489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:14.038408 13016 catalog_manager.cc:5697] T ad2b770d07aa404ca5c89bdf309b08f9 P b2e22ffd8266454f91a45727bd098a92 reported cstate change: term changed from 1 to 2, leader changed from ba142a6ed214425084a138399cc5f489 (127.12.174.129) to b2e22ffd8266454f91a45727bd098a92 (127.12.174.131). New cstate: current_term: 2 leader_uuid: "b2e22ffd8266454f91a45727bd098a92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:14.043563 13393 raft_consensus.cc:993] T db4772bfddd848238ef081fec351b1c9 P b2e22ffd8266454f91a45727bd098a92: : Instructing follower ba142a6ed214425084a138399cc5f489 to start an election
I20260709 12:08:14.044108 13394 raft_consensus.cc:1081] T db4772bfddd848238ef081fec351b1c9 P b2e22ffd8266454f91a45727bd098a92 [term 1 LEADER]: Signalling peer ba142a6ed214425084a138399cc5f489 to start an election
I20260709 12:08:14.045140 13121 raft_consensus.cc:1275] T cb766527c41242e0ab211622b1f0e268 P ba142a6ed214425084a138399cc5f489 [term 2 FOLLOWER]: Refusing update from remote peer 8f34a4731ec24146b05167572a79008f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:14.048815 13340 consensus_queue.cc:1048] T cb766527c41242e0ab211622b1f0e268 P 8f34a4731ec24146b05167572a79008f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:08:14.056010 13119 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "db4772bfddd848238ef081fec351b1c9"
dest_uuid: "ba142a6ed214425084a138399cc5f489"
 from {username='slave'} at 127.0.0.1:39328
I20260709 12:08:14.056764 13119 raft_consensus.cc:493] T db4772bfddd848238ef081fec351b1c9 P ba142a6ed214425084a138399cc5f489 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:14.057181 13119 raft_consensus.cc:3060] T db4772bfddd848238ef081fec351b1c9 P ba142a6ed214425084a138399cc5f489 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:14.067982 13270 raft_consensus.cc:1275] T d5f3329ccf5b4ebf87e0eb8dc143b5d9 P b2e22ffd8266454f91a45727bd098a92 [term 2 FOLLOWER]: Refusing update from remote peer ba142a6ed214425084a138399cc5f489: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:14.068785 13119 raft_consensus.cc:515] T db4772bfddd848238ef081fec351b1c9 P ba142a6ed214425084a138399cc5f489 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:14.071025 13358 consensus_queue.cc:1048] T d5f3329ccf5b4ebf87e0eb8dc143b5d9 P ba142a6ed214425084a138399cc5f489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:08:14.071836 13119 leader_election.cc:290] T db4772bfddd848238ef081fec351b1c9 P ba142a6ed214425084a138399cc5f489 [CANDIDATE]: Term 2 election: Requested vote from peers 8f34a4731ec24146b05167572a79008f (127.12.174.130:45431), b2e22ffd8266454f91a45727bd098a92 (127.12.174.131:40191)
I20260709 12:08:14.072575 13196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4772bfddd848238ef081fec351b1c9" candidate_uuid: "ba142a6ed214425084a138399cc5f489" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8f34a4731ec24146b05167572a79008f"
I20260709 12:08:14.073228 13196 raft_consensus.cc:3060] T db4772bfddd848238ef081fec351b1c9 P 8f34a4731ec24146b05167572a79008f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:14.076597 13270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4772bfddd848238ef081fec351b1c9" candidate_uuid: "ba142a6ed214425084a138399cc5f489" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b2e22ffd8266454f91a45727bd098a92"
I20260709 12:08:14.077168 13270 raft_consensus.cc:3055] T db4772bfddd848238ef081fec351b1c9 P b2e22ffd8266454f91a45727bd098a92 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:14.077535 13270 raft_consensus.cc:740] T db4772bfddd848238ef081fec351b1c9 P b2e22ffd8266454f91a45727bd098a92 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b2e22ffd8266454f91a45727bd098a92, State: Running, Role: LEADER
I20260709 12:08:14.078599 13348 raft_consensus.cc:993] T 8211beafbf81439d8629834dbbb3a6b9 P ba142a6ed214425084a138399cc5f489: : Instructing follower 8f34a4731ec24146b05167572a79008f to start an election
I20260709 12:08:14.079167 13348 raft_consensus.cc:1081] T 8211beafbf81439d8629834dbbb3a6b9 P ba142a6ed214425084a138399cc5f489 [term 1 LEADER]: Signalling peer 8f34a4731ec24146b05167572a79008f to start an election
I20260709 12:08:14.078655 13270 consensus_queue.cc:260] T db4772bfddd848238ef081fec351b1c9 P b2e22ffd8266454f91a45727bd098a92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:14.080534 13270 raft_consensus.cc:3060] T db4772bfddd848238ef081fec351b1c9 P b2e22ffd8266454f91a45727bd098a92 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:14.081422 13195 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8211beafbf81439d8629834dbbb3a6b9"
dest_uuid: "8f34a4731ec24146b05167572a79008f"
 from {username='slave'} at 127.0.0.1:51132
I20260709 12:08:14.081924 13196 raft_consensus.cc:2468] T db4772bfddd848238ef081fec351b1c9 P 8f34a4731ec24146b05167572a79008f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba142a6ed214425084a138399cc5f489 in term 2.
I20260709 12:08:14.082067 13195 raft_consensus.cc:493] T 8211beafbf81439d8629834dbbb3a6b9 P 8f34a4731ec24146b05167572a79008f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:14.082460 13195 raft_consensus.cc:3060] T 8211beafbf81439d8629834dbbb3a6b9 P 8f34a4731ec24146b05167572a79008f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:14.085927 13086 leader_election.cc:304] T db4772bfddd848238ef081fec351b1c9 P ba142a6ed214425084a138399cc5f489 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f34a4731ec24146b05167572a79008f, ba142a6ed214425084a138399cc5f489; no voters: 
I20260709 12:08:14.086920 13358 raft_consensus.cc:2804] T db4772bfddd848238ef081fec351b1c9 P ba142a6ed214425084a138399cc5f489 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:14.087965 13358 raft_consensus.cc:697] T db4772bfddd848238ef081fec351b1c9 P ba142a6ed214425084a138399cc5f489 [term 2 LEADER]: Becoming Leader. State: Replica: ba142a6ed214425084a138399cc5f489, State: Running, Role: LEADER
I20260709 12:08:14.089449 13358 consensus_queue.cc:237] T db4772bfddd848238ef081fec351b1c9 P ba142a6ed214425084a138399cc5f489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:14.090907 13270 raft_consensus.cc:2468] T db4772bfddd848238ef081fec351b1c9 P b2e22ffd8266454f91a45727bd098a92 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba142a6ed214425084a138399cc5f489 in term 2.
I20260709 12:08:14.093092 13195 raft_consensus.cc:515] T 8211beafbf81439d8629834dbbb3a6b9 P 8f34a4731ec24146b05167572a79008f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:14.095649 13195 leader_election.cc:290] T 8211beafbf81439d8629834dbbb3a6b9 P 8f34a4731ec24146b05167572a79008f [CANDIDATE]: Term 2 election: Requested vote from peers ba142a6ed214425084a138399cc5f489 (127.12.174.129:36937), b2e22ffd8266454f91a45727bd098a92 (127.12.174.131:40191)
I20260709 12:08:14.097630 13270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8211beafbf81439d8629834dbbb3a6b9" candidate_uuid: "8f34a4731ec24146b05167572a79008f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b2e22ffd8266454f91a45727bd098a92"
I20260709 12:08:14.098404 13270 raft_consensus.cc:3060] T 8211beafbf81439d8629834dbbb3a6b9 P b2e22ffd8266454f91a45727bd098a92 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:14.102198 13268 raft_consensus.cc:1275] T cb766527c41242e0ab211622b1f0e268 P b2e22ffd8266454f91a45727bd098a92 [term 2 FOLLOWER]: Refusing update from remote peer 8f34a4731ec24146b05167572a79008f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:14.107306 13121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8211beafbf81439d8629834dbbb3a6b9" candidate_uuid: "8f34a4731ec24146b05167572a79008f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ba142a6ed214425084a138399cc5f489"
I20260709 12:08:14.107973 13121 raft_consensus.cc:3055] T 8211beafbf81439d8629834dbbb3a6b9 P ba142a6ed214425084a138399cc5f489 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:14.108345 13121 raft_consensus.cc:740] T 8211beafbf81439d8629834dbbb3a6b9 P ba142a6ed214425084a138399cc5f489 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ba142a6ed214425084a138399cc5f489, State: Running, Role: LEADER
I20260709 12:08:14.109169 13121 consensus_queue.cc:260] T 8211beafbf81439d8629834dbbb3a6b9 P ba142a6ed214425084a138399cc5f489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:14.110512 13121 raft_consensus.cc:3060] T 8211beafbf81439d8629834dbbb3a6b9 P ba142a6ed214425084a138399cc5f489 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:14.112820 13341 consensus_queue.cc:1048] T cb766527c41242e0ab211622b1f0e268 P 8f34a4731ec24146b05167572a79008f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:08:14.117878 13018 catalog_manager.cc:5697] T db4772bfddd848238ef081fec351b1c9 P ba142a6ed214425084a138399cc5f489 reported cstate change: term changed from 1 to 2, leader changed from b2e22ffd8266454f91a45727bd098a92 (127.12.174.131) to ba142a6ed214425084a138399cc5f489 (127.12.174.129). New cstate: current_term: 2 leader_uuid: "ba142a6ed214425084a138399cc5f489" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:14.120970 13121 raft_consensus.cc:2468] T 8211beafbf81439d8629834dbbb3a6b9 P ba142a6ed214425084a138399cc5f489 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f34a4731ec24146b05167572a79008f in term 2.
I20260709 12:08:14.123843 13162 leader_election.cc:304] T 8211beafbf81439d8629834dbbb3a6b9 P 8f34a4731ec24146b05167572a79008f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f34a4731ec24146b05167572a79008f, ba142a6ed214425084a138399cc5f489; no voters: 
I20260709 12:08:14.124799 13341 raft_consensus.cc:2804] T 8211beafbf81439d8629834dbbb3a6b9 P 8f34a4731ec24146b05167572a79008f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:14.125326 13341 raft_consensus.cc:697] T 8211beafbf81439d8629834dbbb3a6b9 P 8f34a4731ec24146b05167572a79008f [term 2 LEADER]: Becoming Leader. State: Replica: 8f34a4731ec24146b05167572a79008f, State: Running, Role: LEADER
I20260709 12:08:14.126209 13341 consensus_queue.cc:237] T 8211beafbf81439d8629834dbbb3a6b9 P 8f34a4731ec24146b05167572a79008f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:14.129211 13270 raft_consensus.cc:2468] T 8211beafbf81439d8629834dbbb3a6b9 P b2e22ffd8266454f91a45727bd098a92 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f34a4731ec24146b05167572a79008f in term 2.
I20260709 12:08:14.146023 13018 catalog_manager.cc:5697] T 8211beafbf81439d8629834dbbb3a6b9 P 8f34a4731ec24146b05167572a79008f reported cstate change: term changed from 1 to 2, leader changed from ba142a6ed214425084a138399cc5f489 (127.12.174.129) to 8f34a4731ec24146b05167572a79008f (127.12.174.130). New cstate: current_term: 2 leader_uuid: "8f34a4731ec24146b05167572a79008f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:14.228143 13270 raft_consensus.cc:1275] T 848ce1d9265c4134bcef148a91744c7c P b2e22ffd8266454f91a45727bd098a92 [term 2 FOLLOWER]: Refusing update from remote peer 8f34a4731ec24146b05167572a79008f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:14.229712 13341 consensus_queue.cc:1048] T 848ce1d9265c4134bcef148a91744c7c P 8f34a4731ec24146b05167572a79008f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:14.239166 13121 raft_consensus.cc:1275] T 848ce1d9265c4134bcef148a91744c7c P ba142a6ed214425084a138399cc5f489 [term 2 FOLLOWER]: Refusing update from remote peer 8f34a4731ec24146b05167572a79008f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:14.241118 13341 consensus_queue.cc:1048] T 848ce1d9265c4134bcef148a91744c7c P 8f34a4731ec24146b05167572a79008f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:14.476388 13195 raft_consensus.cc:1275] T ad2b770d07aa404ca5c89bdf309b08f9 P 8f34a4731ec24146b05167572a79008f [term 2 FOLLOWER]: Refusing update from remote peer b2e22ffd8266454f91a45727bd098a92: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:14.477662 13394 consensus_queue.cc:1048] T ad2b770d07aa404ca5c89bdf309b08f9 P b2e22ffd8266454f91a45727bd098a92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:14.486136 13121 raft_consensus.cc:1275] T ad2b770d07aa404ca5c89bdf309b08f9 P ba142a6ed214425084a138399cc5f489 [term 2 FOLLOWER]: Refusing update from remote peer b2e22ffd8266454f91a45727bd098a92: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:14.487833 13393 consensus_queue.cc:1048] T ad2b770d07aa404ca5c89bdf309b08f9 P b2e22ffd8266454f91a45727bd098a92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:14.553058 13195 raft_consensus.cc:1275] T db4772bfddd848238ef081fec351b1c9 P 8f34a4731ec24146b05167572a79008f [term 2 FOLLOWER]: Refusing update from remote peer ba142a6ed214425084a138399cc5f489: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:14.554306 13358 consensus_queue.cc:1048] T db4772bfddd848238ef081fec351b1c9 P ba142a6ed214425084a138399cc5f489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:14.562548 13270 raft_consensus.cc:1275] T db4772bfddd848238ef081fec351b1c9 P b2e22ffd8266454f91a45727bd098a92 [term 2 FOLLOWER]: Refusing update from remote peer ba142a6ed214425084a138399cc5f489: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:14.563970 13321 consensus_queue.cc:1048] T db4772bfddd848238ef081fec351b1c9 P ba142a6ed214425084a138399cc5f489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:14.666887 13270 raft_consensus.cc:1275] T 8211beafbf81439d8629834dbbb3a6b9 P b2e22ffd8266454f91a45727bd098a92 [term 2 FOLLOWER]: Refusing update from remote peer 8f34a4731ec24146b05167572a79008f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:14.667255 13121 raft_consensus.cc:1275] T 8211beafbf81439d8629834dbbb3a6b9 P ba142a6ed214425084a138399cc5f489 [term 2 FOLLOWER]: Refusing update from remote peer 8f34a4731ec24146b05167572a79008f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:14.668187 13398 consensus_queue.cc:1048] T 8211beafbf81439d8629834dbbb3a6b9 P 8f34a4731ec24146b05167572a79008f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:14.668826 13340 consensus_queue.cc:1048] T 8211beafbf81439d8629834dbbb3a6b9 P 8f34a4731ec24146b05167572a79008f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:16.716353 12986 auto_leader_rebalancer-test.cc:294] The leader distribution is 
I20260709 12:08:16.717352 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:16.742373 13195 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "15a6902d3ade4230a51ed07fb1663a27"
dest_uuid: "8f34a4731ec24146b05167572a79008f"
mode: GRACEFUL
new_leader_uuid: "b2e22ffd8266454f91a45727bd098a92"
 from {username='slave'} at 127.0.0.1:32840
I20260709 12:08:16.743429 13195 raft_consensus.cc:606] T 15a6902d3ade4230a51ed07fb1663a27 P 8f34a4731ec24146b05167572a79008f [term 1 LEADER]: Received request to transfer leadership to TS b2e22ffd8266454f91a45727bd098a92
I20260709 12:08:16.746397 13432 raft_consensus.cc:993] T 15a6902d3ade4230a51ed07fb1663a27 P 8f34a4731ec24146b05167572a79008f: : Instructing follower b2e22ffd8266454f91a45727bd098a92 to start an election
I20260709 12:08:16.747687 13341 raft_consensus.cc:1081] T 15a6902d3ade4230a51ed07fb1663a27 P 8f34a4731ec24146b05167572a79008f [term 1 LEADER]: Signalling peer b2e22ffd8266454f91a45727bd098a92 to start an election
I20260709 12:08:16.749995 13267 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "15a6902d3ade4230a51ed07fb1663a27"
dest_uuid: "b2e22ffd8266454f91a45727bd098a92"
 from {username='slave'} at 127.0.0.1:56306
I20260709 12:08:16.750582 13267 raft_consensus.cc:493] T 15a6902d3ade4230a51ed07fb1663a27 P b2e22ffd8266454f91a45727bd098a92 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:16.750937 13267 raft_consensus.cc:3060] T 15a6902d3ade4230a51ed07fb1663a27 P b2e22ffd8266454f91a45727bd098a92 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:16.759708 13267 raft_consensus.cc:515] T 15a6902d3ade4230a51ed07fb1663a27 P b2e22ffd8266454f91a45727bd098a92 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:16.760438 13121 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6a73bb3cf9eb4b4484c76c5ef49859f0"
dest_uuid: "ba142a6ed214425084a138399cc5f489"
mode: GRACEFUL
new_leader_uuid: "b2e22ffd8266454f91a45727bd098a92"
 from {username='slave'} at 127.0.0.1:48040
I20260709 12:08:16.761255 13121 raft_consensus.cc:606] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P ba142a6ed214425084a138399cc5f489 [term 1 LEADER]: Received request to transfer leadership to TS b2e22ffd8266454f91a45727bd098a92
I20260709 12:08:16.762866 13267 leader_election.cc:290] T 15a6902d3ade4230a51ed07fb1663a27 P b2e22ffd8266454f91a45727bd098a92 [CANDIDATE]: Term 2 election: Requested vote from peers ba142a6ed214425084a138399cc5f489 (127.12.174.129:36937), 8f34a4731ec24146b05167572a79008f (127.12.174.130:45431)
I20260709 12:08:16.763536 12986 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:08:16.763809 13121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15a6902d3ade4230a51ed07fb1663a27" candidate_uuid: "b2e22ffd8266454f91a45727bd098a92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ba142a6ed214425084a138399cc5f489"
I20260709 12:08:16.764137 13195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15a6902d3ade4230a51ed07fb1663a27" candidate_uuid: "b2e22ffd8266454f91a45727bd098a92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8f34a4731ec24146b05167572a79008f"
I20260709 12:08:16.764356 12986 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:16.764711 13121 raft_consensus.cc:3060] T 15a6902d3ade4230a51ed07fb1663a27 P ba142a6ed214425084a138399cc5f489 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:16.764693 13195 raft_consensus.cc:3055] T 15a6902d3ade4230a51ed07fb1663a27 P 8f34a4731ec24146b05167572a79008f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:16.765417 13195 raft_consensus.cc:740] T 15a6902d3ade4230a51ed07fb1663a27 P 8f34a4731ec24146b05167572a79008f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8f34a4731ec24146b05167572a79008f, State: Running, Role: LEADER
I20260709 12:08:16.766624 13195 consensus_queue.cc:260] T 15a6902d3ade4230a51ed07fb1663a27 P 8f34a4731ec24146b05167572a79008f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:16.768164 13195 raft_consensus.cc:3060] T 15a6902d3ade4230a51ed07fb1663a27 P 8f34a4731ec24146b05167572a79008f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:16.784484 13121 raft_consensus.cc:2468] T 15a6902d3ade4230a51ed07fb1663a27 P ba142a6ed214425084a138399cc5f489 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2e22ffd8266454f91a45727bd098a92 in term 2.
I20260709 12:08:16.784484 13195 raft_consensus.cc:2468] T 15a6902d3ade4230a51ed07fb1663a27 P 8f34a4731ec24146b05167572a79008f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2e22ffd8266454f91a45727bd098a92 in term 2.
I20260709 12:08:16.786423 13235 leader_election.cc:304] T 15a6902d3ade4230a51ed07fb1663a27 P b2e22ffd8266454f91a45727bd098a92 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f34a4731ec24146b05167572a79008f, b2e22ffd8266454f91a45727bd098a92; no voters: 
I20260709 12:08:16.787379 13393 raft_consensus.cc:2804] T 15a6902d3ade4230a51ed07fb1663a27 P b2e22ffd8266454f91a45727bd098a92 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:16.788578 13393 raft_consensus.cc:697] T 15a6902d3ade4230a51ed07fb1663a27 P b2e22ffd8266454f91a45727bd098a92 [term 2 LEADER]: Becoming Leader. State: Replica: b2e22ffd8266454f91a45727bd098a92, State: Running, Role: LEADER
I20260709 12:08:16.789630 13393 consensus_queue.cc:237] T 15a6902d3ade4230a51ed07fb1663a27 P b2e22ffd8266454f91a45727bd098a92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:16.800525 13016 catalog_manager.cc:5697] T 15a6902d3ade4230a51ed07fb1663a27 P b2e22ffd8266454f91a45727bd098a92 reported cstate change: term changed from 1 to 2, leader changed from 8f34a4731ec24146b05167572a79008f (127.12.174.130) to b2e22ffd8266454f91a45727bd098a92 (127.12.174.131). New cstate: current_term: 2 leader_uuid: "b2e22ffd8266454f91a45727bd098a92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:16.889674 13321 raft_consensus.cc:993] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P ba142a6ed214425084a138399cc5f489: : Instructing follower b2e22ffd8266454f91a45727bd098a92 to start an election
I20260709 12:08:16.890201 13321 raft_consensus.cc:1081] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P ba142a6ed214425084a138399cc5f489 [term 1 LEADER]: Signalling peer b2e22ffd8266454f91a45727bd098a92 to start an election
I20260709 12:08:16.892432 13267 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6a73bb3cf9eb4b4484c76c5ef49859f0"
dest_uuid: "b2e22ffd8266454f91a45727bd098a92"
 from {username='slave'} at 127.0.0.1:56322
I20260709 12:08:16.893127 13267 raft_consensus.cc:493] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P b2e22ffd8266454f91a45727bd098a92 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:16.893518 13267 raft_consensus.cc:3060] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P b2e22ffd8266454f91a45727bd098a92 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:16.901684 13267 raft_consensus.cc:515] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P b2e22ffd8266454f91a45727bd098a92 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:16.903615 13267 leader_election.cc:290] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P b2e22ffd8266454f91a45727bd098a92 [CANDIDATE]: Term 2 election: Requested vote from peers ba142a6ed214425084a138399cc5f489 (127.12.174.129:36937), 8f34a4731ec24146b05167572a79008f (127.12.174.130:45431)
I20260709 12:08:16.904534 13121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a73bb3cf9eb4b4484c76c5ef49859f0" candidate_uuid: "b2e22ffd8266454f91a45727bd098a92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ba142a6ed214425084a138399cc5f489"
I20260709 12:08:16.905107 13121 raft_consensus.cc:3055] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P ba142a6ed214425084a138399cc5f489 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:16.905333 13121 raft_consensus.cc:740] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P ba142a6ed214425084a138399cc5f489 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ba142a6ed214425084a138399cc5f489, State: Running, Role: LEADER
I20260709 12:08:16.906004 13121 consensus_queue.cc:260] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P ba142a6ed214425084a138399cc5f489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:16.906930 13121 raft_consensus.cc:3060] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P ba142a6ed214425084a138399cc5f489 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:16.910261 13195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a73bb3cf9eb4b4484c76c5ef49859f0" candidate_uuid: "b2e22ffd8266454f91a45727bd098a92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8f34a4731ec24146b05167572a79008f"
I20260709 12:08:16.910841 13195 raft_consensus.cc:3060] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P 8f34a4731ec24146b05167572a79008f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:16.911795 13121 raft_consensus.cc:2468] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P ba142a6ed214425084a138399cc5f489 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2e22ffd8266454f91a45727bd098a92 in term 2.
I20260709 12:08:16.913239 13236 leader_election.cc:304] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P b2e22ffd8266454f91a45727bd098a92 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2e22ffd8266454f91a45727bd098a92, ba142a6ed214425084a138399cc5f489; no voters: 
I20260709 12:08:16.914081 13393 raft_consensus.cc:2804] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P b2e22ffd8266454f91a45727bd098a92 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:16.914618 13393 raft_consensus.cc:697] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P b2e22ffd8266454f91a45727bd098a92 [term 2 LEADER]: Becoming Leader. State: Replica: b2e22ffd8266454f91a45727bd098a92, State: Running, Role: LEADER
I20260709 12:08:16.915545 13393 consensus_queue.cc:237] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P b2e22ffd8266454f91a45727bd098a92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:16.918367 13195 raft_consensus.cc:2468] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P 8f34a4731ec24146b05167572a79008f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2e22ffd8266454f91a45727bd098a92 in term 2.
I20260709 12:08:16.925108 13016 catalog_manager.cc:5697] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P b2e22ffd8266454f91a45727bd098a92 reported cstate change: term changed from 1 to 2, leader changed from ba142a6ed214425084a138399cc5f489 (127.12.174.129) to b2e22ffd8266454f91a45727bd098a92 (127.12.174.131). New cstate: current_term: 2 leader_uuid: "b2e22ffd8266454f91a45727bd098a92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:17.226444 13195 raft_consensus.cc:1275] T 15a6902d3ade4230a51ed07fb1663a27 P 8f34a4731ec24146b05167572a79008f [term 2 FOLLOWER]: Refusing update from remote peer b2e22ffd8266454f91a45727bd098a92: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:17.227741 13393 consensus_queue.cc:1048] T 15a6902d3ade4230a51ed07fb1663a27 P b2e22ffd8266454f91a45727bd098a92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:17.240497 13121 raft_consensus.cc:1275] T 15a6902d3ade4230a51ed07fb1663a27 P ba142a6ed214425084a138399cc5f489 [term 2 FOLLOWER]: Refusing update from remote peer b2e22ffd8266454f91a45727bd098a92: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:17.242323 13393 consensus_queue.cc:1048] T 15a6902d3ade4230a51ed07fb1663a27 P b2e22ffd8266454f91a45727bd098a92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:08:17.316160 13195 raft_consensus.cc:1275] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P 8f34a4731ec24146b05167572a79008f [term 2 FOLLOWER]: Refusing update from remote peer b2e22ffd8266454f91a45727bd098a92: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:17.317552 13446 consensus_queue.cc:1048] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P b2e22ffd8266454f91a45727bd098a92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:17.329646 13121 raft_consensus.cc:1275] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P ba142a6ed214425084a138399cc5f489 [term 2 FOLLOWER]: Refusing update from remote peer b2e22ffd8266454f91a45727bd098a92: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:17.331287 13435 consensus_queue.cc:1048] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P b2e22ffd8266454f91a45727bd098a92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:08:17.765699 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:17.770846 12986 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:17.771332 12986 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:18.722896 13453 raft_consensus.cc:493] T d5f3329ccf5b4ebf87e0eb8dc143b5d9 P 8f34a4731ec24146b05167572a79008f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ba142a6ed214425084a138399cc5f489)
I20260709 12:08:18.723462 13453 raft_consensus.cc:515] T d5f3329ccf5b4ebf87e0eb8dc143b5d9 P 8f34a4731ec24146b05167572a79008f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:18.727876 13119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f3329ccf5b4ebf87e0eb8dc143b5d9" candidate_uuid: "8f34a4731ec24146b05167572a79008f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ba142a6ed214425084a138399cc5f489" is_pre_election: true
I20260709 12:08:18.726353 13453 leader_election.cc:290] T d5f3329ccf5b4ebf87e0eb8dc143b5d9 P 8f34a4731ec24146b05167572a79008f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ba142a6ed214425084a138399cc5f489 (127.12.174.129:36937), b2e22ffd8266454f91a45727bd098a92 (127.12.174.131:40191)
I20260709 12:08:18.731225 13267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f3329ccf5b4ebf87e0eb8dc143b5d9" candidate_uuid: "8f34a4731ec24146b05167572a79008f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b2e22ffd8266454f91a45727bd098a92" is_pre_election: true
I20260709 12:08:18.735059 13162 leader_election.cc:304] T d5f3329ccf5b4ebf87e0eb8dc143b5d9 P 8f34a4731ec24146b05167572a79008f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8f34a4731ec24146b05167572a79008f; no voters: b2e22ffd8266454f91a45727bd098a92, ba142a6ed214425084a138399cc5f489
I20260709 12:08:18.736158 13453 raft_consensus.cc:2749] T d5f3329ccf5b4ebf87e0eb8dc143b5d9 P 8f34a4731ec24146b05167572a79008f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:08:18.738024 13453 raft_consensus.cc:493] T 15a6902d3ade4230a51ed07fb1663a27 P 8f34a4731ec24146b05167572a79008f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b2e22ffd8266454f91a45727bd098a92)
I20260709 12:08:18.738909 13453 raft_consensus.cc:515] T 15a6902d3ade4230a51ed07fb1663a27 P 8f34a4731ec24146b05167572a79008f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:18.741225 13453 leader_election.cc:290] T 15a6902d3ade4230a51ed07fb1663a27 P 8f34a4731ec24146b05167572a79008f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ba142a6ed214425084a138399cc5f489 (127.12.174.129:36937), b2e22ffd8266454f91a45727bd098a92 (127.12.174.131:40191)
I20260709 12:08:18.746322 13121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15a6902d3ade4230a51ed07fb1663a27" candidate_uuid: "8f34a4731ec24146b05167572a79008f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ba142a6ed214425084a138399cc5f489" is_pre_election: true
I20260709 12:08:18.747363 13267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15a6902d3ade4230a51ed07fb1663a27" candidate_uuid: "8f34a4731ec24146b05167572a79008f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b2e22ffd8266454f91a45727bd098a92" is_pre_election: true
I20260709 12:08:18.750061 13162 leader_election.cc:304] T 15a6902d3ade4230a51ed07fb1663a27 P 8f34a4731ec24146b05167572a79008f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8f34a4731ec24146b05167572a79008f; no voters: b2e22ffd8266454f91a45727bd098a92, ba142a6ed214425084a138399cc5f489
I20260709 12:08:18.752503 13453 raft_consensus.cc:2749] T 15a6902d3ade4230a51ed07fb1663a27 P 8f34a4731ec24146b05167572a79008f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:08:18.834671 13456 raft_consensus.cc:493] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P ba142a6ed214425084a138399cc5f489 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b2e22ffd8266454f91a45727bd098a92)
I20260709 12:08:18.835446 13456 raft_consensus.cc:515] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P ba142a6ed214425084a138399cc5f489 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:18.837447 13456 leader_election.cc:290] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P ba142a6ed214425084a138399cc5f489 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8f34a4731ec24146b05167572a79008f (127.12.174.130:45431), b2e22ffd8266454f91a45727bd098a92 (127.12.174.131:40191)
I20260709 12:08:18.838336 13193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a73bb3cf9eb4b4484c76c5ef49859f0" candidate_uuid: "ba142a6ed214425084a138399cc5f489" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8f34a4731ec24146b05167572a79008f" is_pre_election: true
I20260709 12:08:18.838615 13267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a73bb3cf9eb4b4484c76c5ef49859f0" candidate_uuid: "ba142a6ed214425084a138399cc5f489" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b2e22ffd8266454f91a45727bd098a92" is_pre_election: true
I20260709 12:08:18.840090 13086 leader_election.cc:304] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P ba142a6ed214425084a138399cc5f489 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba142a6ed214425084a138399cc5f489; no voters: 8f34a4731ec24146b05167572a79008f, b2e22ffd8266454f91a45727bd098a92
I20260709 12:08:18.840873 13456 raft_consensus.cc:2749] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P ba142a6ed214425084a138399cc5f489 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:08:19.689551 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:19.696117 12986 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:19.696580 12986 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:08:19.748454 13291 debug-util.cc:398] Leaking SignalData structure 0x7b0800166060 after lost signal to thread 12989
W20260709 12:08:19.749348 13291 debug-util.cc:398] Leaking SignalData structure 0x7b0800166740 after lost signal to thread 13052
W20260709 12:08:19.750274 13291 debug-util.cc:398] Leaking SignalData structure 0x7b08001e9600 after lost signal to thread 13145
W20260709 12:08:19.751056 13291 debug-util.cc:398] Leaking SignalData structure 0x7b08001e62e0 after lost signal to thread 13220
W20260709 12:08:19.751819 13291 debug-util.cc:398] Leaking SignalData structure 0x7b08001c4b60 after lost signal to thread 13294
I20260709 12:08:20.697602 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:20.703581 12986 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:20.704181 12986 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:21.705265 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:21.710355 12986 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:21.710807 12986 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:22.711993 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:22.716991 12986 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:22.717444 12986 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:23.718537 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:23.723508 12986 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:23.723954 12986 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:25.050376 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:25.055876 12986 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:25.056351 12986 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:08:25.170351 13291 debug-util.cc:398] Leaking SignalData structure 0x7b080019ac40 after lost signal to thread 12989
W20260709 12:08:25.171131 13291 debug-util.cc:398] Leaking SignalData structure 0x7b08001aa880 after lost signal to thread 13052
W20260709 12:08:25.171947 13291 debug-util.cc:398] Leaking SignalData structure 0x7b0800166120 after lost signal to thread 13145
W20260709 12:08:25.172689 13291 debug-util.cc:398] Leaking SignalData structure 0x7b08001f7700 after lost signal to thread 13220
W20260709 12:08:25.173403 13291 debug-util.cc:398] Leaking SignalData structure 0x7b08001e9840 after lost signal to thread 13294
I20260709 12:08:26.057335 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:26.063809 12986 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:26.064325 12986 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:27.065590 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:27.074440 12986 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:27.074909 12986 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:28.107650 12986 auto_leader_rebalancer-test.cc:313] The leader distribution is 
I20260709 12:08:28.112792 13121 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d5f3329ccf5b4ebf87e0eb8dc143b5d9"
dest_uuid: "ba142a6ed214425084a138399cc5f489"
mode: GRACEFUL
new_leader_uuid: "8f34a4731ec24146b05167572a79008f"
 from {username='slave'} at 127.0.0.1:48038
I20260709 12:08:28.113480 13121 raft_consensus.cc:606] T d5f3329ccf5b4ebf87e0eb8dc143b5d9 P ba142a6ed214425084a138399cc5f489 [term 2 LEADER]: Received request to transfer leadership to TS 8f34a4731ec24146b05167572a79008f
I20260709 12:08:28.119460 13121 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3ff6b11516e44942a67136b30bc48aa1"
dest_uuid: "ba142a6ed214425084a138399cc5f489"
mode: GRACEFUL
new_leader_uuid: "8f34a4731ec24146b05167572a79008f"
 from {username='slave'} at 127.0.0.1:48038
I20260709 12:08:28.119989 13121 raft_consensus.cc:606] T 3ff6b11516e44942a67136b30bc48aa1 P ba142a6ed214425084a138399cc5f489 [term 1 LEADER]: Received request to transfer leadership to TS 8f34a4731ec24146b05167572a79008f
I20260709 12:08:28.125145 13121 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "db4772bfddd848238ef081fec351b1c9"
dest_uuid: "ba142a6ed214425084a138399cc5f489"
mode: GRACEFUL
new_leader_uuid: "8f34a4731ec24146b05167572a79008f"
 from {username='slave'} at 127.0.0.1:48038
I20260709 12:08:28.125624 13121 raft_consensus.cc:606] T db4772bfddd848238ef081fec351b1c9 P ba142a6ed214425084a138399cc5f489 [term 2 LEADER]: Received request to transfer leadership to TS 8f34a4731ec24146b05167572a79008f
I20260709 12:08:28.131307 13269 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6a73bb3cf9eb4b4484c76c5ef49859f0"
dest_uuid: "b2e22ffd8266454f91a45727bd098a92"
mode: GRACEFUL
new_leader_uuid: "8f34a4731ec24146b05167572a79008f"
 from {username='slave'} at 127.0.0.1:44804
I20260709 12:08:28.132005 13269 raft_consensus.cc:606] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P b2e22ffd8266454f91a45727bd098a92 [term 2 LEADER]: Received request to transfer leadership to TS 8f34a4731ec24146b05167572a79008f
I20260709 12:08:28.140122 13269 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "15a6902d3ade4230a51ed07fb1663a27"
dest_uuid: "b2e22ffd8266454f91a45727bd098a92"
mode: GRACEFUL
new_leader_uuid: "8f34a4731ec24146b05167572a79008f"
 from {username='slave'} at 127.0.0.1:44804
I20260709 12:08:28.140674 13269 raft_consensus.cc:606] T 15a6902d3ade4230a51ed07fb1663a27 P b2e22ffd8266454f91a45727bd098a92 [term 2 LEADER]: Received request to transfer leadership to TS 8f34a4731ec24146b05167572a79008f
I20260709 12:08:28.246999 13465 raft_consensus.cc:993] T 15a6902d3ade4230a51ed07fb1663a27 P b2e22ffd8266454f91a45727bd098a92: : Instructing follower 8f34a4731ec24146b05167572a79008f to start an election
I20260709 12:08:28.247568 13477 raft_consensus.cc:1081] T 15a6902d3ade4230a51ed07fb1663a27 P b2e22ffd8266454f91a45727bd098a92 [term 2 LEADER]: Signalling peer 8f34a4731ec24146b05167572a79008f to start an election
I20260709 12:08:28.249300 13196 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "15a6902d3ade4230a51ed07fb1663a27"
dest_uuid: "8f34a4731ec24146b05167572a79008f"
 from {username='slave'} at 127.0.0.1:51148
I20260709 12:08:28.249864 13196 raft_consensus.cc:493] T 15a6902d3ade4230a51ed07fb1663a27 P 8f34a4731ec24146b05167572a79008f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:28.250217 13196 raft_consensus.cc:3060] T 15a6902d3ade4230a51ed07fb1663a27 P 8f34a4731ec24146b05167572a79008f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:28.258749 13196 raft_consensus.cc:515] T 15a6902d3ade4230a51ed07fb1663a27 P 8f34a4731ec24146b05167572a79008f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:28.261487 13196 leader_election.cc:290] T 15a6902d3ade4230a51ed07fb1663a27 P 8f34a4731ec24146b05167572a79008f [CANDIDATE]: Term 3 election: Requested vote from peers ba142a6ed214425084a138399cc5f489 (127.12.174.129:36937), b2e22ffd8266454f91a45727bd098a92 (127.12.174.131:40191)
I20260709 12:08:28.262497 13121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15a6902d3ade4230a51ed07fb1663a27" candidate_uuid: "8f34a4731ec24146b05167572a79008f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ba142a6ed214425084a138399cc5f489"
I20260709 12:08:28.262640 13269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15a6902d3ade4230a51ed07fb1663a27" candidate_uuid: "8f34a4731ec24146b05167572a79008f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b2e22ffd8266454f91a45727bd098a92"
I20260709 12:08:28.263302 13121 raft_consensus.cc:3060] T 15a6902d3ade4230a51ed07fb1663a27 P ba142a6ed214425084a138399cc5f489 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:28.263378 13269 raft_consensus.cc:3055] T 15a6902d3ade4230a51ed07fb1663a27 P b2e22ffd8266454f91a45727bd098a92 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:08:28.263732 13269 raft_consensus.cc:740] T 15a6902d3ade4230a51ed07fb1663a27 P b2e22ffd8266454f91a45727bd098a92 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b2e22ffd8266454f91a45727bd098a92, State: Running, Role: LEADER
I20260709 12:08:28.264511 13269 consensus_queue.cc:260] T 15a6902d3ade4230a51ed07fb1663a27 P b2e22ffd8266454f91a45727bd098a92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:28.265698 13269 raft_consensus.cc:3060] T 15a6902d3ade4230a51ed07fb1663a27 P b2e22ffd8266454f91a45727bd098a92 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:28.268805 13121 raft_consensus.cc:2468] T 15a6902d3ade4230a51ed07fb1663a27 P ba142a6ed214425084a138399cc5f489 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f34a4731ec24146b05167572a79008f in term 3.
I20260709 12:08:28.270139 13162 leader_election.cc:304] T 15a6902d3ade4230a51ed07fb1663a27 P 8f34a4731ec24146b05167572a79008f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f34a4731ec24146b05167572a79008f, ba142a6ed214425084a138399cc5f489; no voters: 
I20260709 12:08:28.270958 13476 raft_consensus.cc:2804] T 15a6902d3ade4230a51ed07fb1663a27 P 8f34a4731ec24146b05167572a79008f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:08:28.271636 13269 raft_consensus.cc:2468] T 15a6902d3ade4230a51ed07fb1663a27 P b2e22ffd8266454f91a45727bd098a92 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f34a4731ec24146b05167572a79008f in term 3.
I20260709 12:08:28.272224 13476 raft_consensus.cc:697] T 15a6902d3ade4230a51ed07fb1663a27 P 8f34a4731ec24146b05167572a79008f [term 3 LEADER]: Becoming Leader. State: Replica: 8f34a4731ec24146b05167572a79008f, State: Running, Role: LEADER
I20260709 12:08:28.273277 13476 consensus_queue.cc:237] T 15a6902d3ade4230a51ed07fb1663a27 P 8f34a4731ec24146b05167572a79008f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:28.285789 13016 catalog_manager.cc:5697] T 15a6902d3ade4230a51ed07fb1663a27 P 8f34a4731ec24146b05167572a79008f reported cstate change: term changed from 2 to 3, leader changed from b2e22ffd8266454f91a45727bd098a92 (127.12.174.131) to 8f34a4731ec24146b05167572a79008f (127.12.174.130). New cstate: current_term: 3 leader_uuid: "8f34a4731ec24146b05167572a79008f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:28.414750 13475 raft_consensus.cc:993] T d5f3329ccf5b4ebf87e0eb8dc143b5d9 P ba142a6ed214425084a138399cc5f489: : Instructing follower 8f34a4731ec24146b05167572a79008f to start an election
I20260709 12:08:28.415347 13475 raft_consensus.cc:1081] T d5f3329ccf5b4ebf87e0eb8dc143b5d9 P ba142a6ed214425084a138399cc5f489 [term 2 LEADER]: Signalling peer 8f34a4731ec24146b05167572a79008f to start an election
I20260709 12:08:28.417910 13196 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d5f3329ccf5b4ebf87e0eb8dc143b5d9"
dest_uuid: "8f34a4731ec24146b05167572a79008f"
 from {username='slave'} at 127.0.0.1:51132
I20260709 12:08:28.418648 13196 raft_consensus.cc:493] T d5f3329ccf5b4ebf87e0eb8dc143b5d9 P 8f34a4731ec24146b05167572a79008f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:28.419191 13196 raft_consensus.cc:3060] T d5f3329ccf5b4ebf87e0eb8dc143b5d9 P 8f34a4731ec24146b05167572a79008f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:28.428417 13196 raft_consensus.cc:515] T d5f3329ccf5b4ebf87e0eb8dc143b5d9 P 8f34a4731ec24146b05167572a79008f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:28.429540 13484 raft_consensus.cc:993] T 3ff6b11516e44942a67136b30bc48aa1 P ba142a6ed214425084a138399cc5f489: : Instructing follower 8f34a4731ec24146b05167572a79008f to start an election
I20260709 12:08:28.430133 13475 raft_consensus.cc:1081] T 3ff6b11516e44942a67136b30bc48aa1 P ba142a6ed214425084a138399cc5f489 [term 1 LEADER]: Signalling peer 8f34a4731ec24146b05167572a79008f to start an election
I20260709 12:08:28.430611 13196 leader_election.cc:290] T d5f3329ccf5b4ebf87e0eb8dc143b5d9 P 8f34a4731ec24146b05167572a79008f [CANDIDATE]: Term 3 election: Requested vote from peers ba142a6ed214425084a138399cc5f489 (127.12.174.129:36937), b2e22ffd8266454f91a45727bd098a92 (127.12.174.131:40191)
I20260709 12:08:28.431443 13121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f3329ccf5b4ebf87e0eb8dc143b5d9" candidate_uuid: "8f34a4731ec24146b05167572a79008f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ba142a6ed214425084a138399cc5f489"
I20260709 12:08:28.431675 13269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f3329ccf5b4ebf87e0eb8dc143b5d9" candidate_uuid: "8f34a4731ec24146b05167572a79008f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b2e22ffd8266454f91a45727bd098a92"
I20260709 12:08:28.431742 13196 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3ff6b11516e44942a67136b30bc48aa1"
dest_uuid: "8f34a4731ec24146b05167572a79008f"
 from {username='slave'} at 127.0.0.1:51132
I20260709 12:08:28.432129 13121 raft_consensus.cc:3055] T d5f3329ccf5b4ebf87e0eb8dc143b5d9 P ba142a6ed214425084a138399cc5f489 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:08:28.432449 13269 raft_consensus.cc:3060] T d5f3329ccf5b4ebf87e0eb8dc143b5d9 P b2e22ffd8266454f91a45727bd098a92 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:28.432502 13121 raft_consensus.cc:740] T d5f3329ccf5b4ebf87e0eb8dc143b5d9 P ba142a6ed214425084a138399cc5f489 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ba142a6ed214425084a138399cc5f489, State: Running, Role: LEADER
I20260709 12:08:28.432451 13196 raft_consensus.cc:493] T 3ff6b11516e44942a67136b30bc48aa1 P 8f34a4731ec24146b05167572a79008f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:28.433223 13196 raft_consensus.cc:3060] T 3ff6b11516e44942a67136b30bc48aa1 P 8f34a4731ec24146b05167572a79008f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:28.433647 13121 consensus_queue.cc:260] T d5f3329ccf5b4ebf87e0eb8dc143b5d9 P ba142a6ed214425084a138399cc5f489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:28.434976 13121 raft_consensus.cc:3060] T d5f3329ccf5b4ebf87e0eb8dc143b5d9 P ba142a6ed214425084a138399cc5f489 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:28.440930 13269 raft_consensus.cc:2468] T d5f3329ccf5b4ebf87e0eb8dc143b5d9 P b2e22ffd8266454f91a45727bd098a92 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f34a4731ec24146b05167572a79008f in term 3.
I20260709 12:08:28.441082 13121 raft_consensus.cc:2468] T d5f3329ccf5b4ebf87e0eb8dc143b5d9 P ba142a6ed214425084a138399cc5f489 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f34a4731ec24146b05167572a79008f in term 3.
I20260709 12:08:28.440948 13196 raft_consensus.cc:515] T 3ff6b11516e44942a67136b30bc48aa1 P 8f34a4731ec24146b05167572a79008f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:28.442377 13162 leader_election.cc:304] T d5f3329ccf5b4ebf87e0eb8dc143b5d9 P 8f34a4731ec24146b05167572a79008f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f34a4731ec24146b05167572a79008f, b2e22ffd8266454f91a45727bd098a92; no voters: 
I20260709 12:08:28.443235 13476 raft_consensus.cc:2804] T d5f3329ccf5b4ebf87e0eb8dc143b5d9 P 8f34a4731ec24146b05167572a79008f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:08:28.443524 13196 leader_election.cc:290] T 3ff6b11516e44942a67136b30bc48aa1 P 8f34a4731ec24146b05167572a79008f [CANDIDATE]: Term 2 election: Requested vote from peers ba142a6ed214425084a138399cc5f489 (127.12.174.129:36937), b2e22ffd8266454f91a45727bd098a92 (127.12.174.131:40191)
I20260709 12:08:28.443723 13476 raft_consensus.cc:697] T d5f3329ccf5b4ebf87e0eb8dc143b5d9 P 8f34a4731ec24146b05167572a79008f [term 3 LEADER]: Becoming Leader. State: Replica: 8f34a4731ec24146b05167572a79008f, State: Running, Role: LEADER
I20260709 12:08:28.444931 13121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff6b11516e44942a67136b30bc48aa1" candidate_uuid: "8f34a4731ec24146b05167572a79008f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ba142a6ed214425084a138399cc5f489"
I20260709 12:08:28.445456 13121 raft_consensus.cc:3055] T 3ff6b11516e44942a67136b30bc48aa1 P ba142a6ed214425084a138399cc5f489 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:28.445152 13476 consensus_queue.cc:237] T d5f3329ccf5b4ebf87e0eb8dc143b5d9 P 8f34a4731ec24146b05167572a79008f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:28.445681 13121 raft_consensus.cc:740] T 3ff6b11516e44942a67136b30bc48aa1 P ba142a6ed214425084a138399cc5f489 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ba142a6ed214425084a138399cc5f489, State: Running, Role: LEADER
I20260709 12:08:28.446416 13121 consensus_queue.cc:260] T 3ff6b11516e44942a67136b30bc48aa1 P ba142a6ed214425084a138399cc5f489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:28.447376 13121 raft_consensus.cc:3060] T 3ff6b11516e44942a67136b30bc48aa1 P ba142a6ed214425084a138399cc5f489 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:28.450269 13269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff6b11516e44942a67136b30bc48aa1" candidate_uuid: "8f34a4731ec24146b05167572a79008f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b2e22ffd8266454f91a45727bd098a92"
I20260709 12:08:28.451260 13269 raft_consensus.cc:3060] T 3ff6b11516e44942a67136b30bc48aa1 P b2e22ffd8266454f91a45727bd098a92 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:28.452867 13121 raft_consensus.cc:2468] T 3ff6b11516e44942a67136b30bc48aa1 P ba142a6ed214425084a138399cc5f489 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f34a4731ec24146b05167572a79008f in term 2.
I20260709 12:08:28.453992 13162 leader_election.cc:304] T 3ff6b11516e44942a67136b30bc48aa1 P 8f34a4731ec24146b05167572a79008f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f34a4731ec24146b05167572a79008f, ba142a6ed214425084a138399cc5f489; no voters: 
I20260709 12:08:28.454718 13476 raft_consensus.cc:2804] T 3ff6b11516e44942a67136b30bc48aa1 P 8f34a4731ec24146b05167572a79008f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:28.456440 13016 catalog_manager.cc:5697] T d5f3329ccf5b4ebf87e0eb8dc143b5d9 P 8f34a4731ec24146b05167572a79008f reported cstate change: term changed from 2 to 3, leader changed from ba142a6ed214425084a138399cc5f489 (127.12.174.129) to 8f34a4731ec24146b05167572a79008f (127.12.174.130). New cstate: current_term: 3 leader_uuid: "8f34a4731ec24146b05167572a79008f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:28.463490 13476 raft_consensus.cc:697] T 3ff6b11516e44942a67136b30bc48aa1 P 8f34a4731ec24146b05167572a79008f [term 2 LEADER]: Becoming Leader. State: Replica: 8f34a4731ec24146b05167572a79008f, State: Running, Role: LEADER
I20260709 12:08:28.464593 13269 raft_consensus.cc:2468] T 3ff6b11516e44942a67136b30bc48aa1 P b2e22ffd8266454f91a45727bd098a92 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f34a4731ec24146b05167572a79008f in term 2.
I20260709 12:08:28.465374 13476 consensus_queue.cc:237] T 3ff6b11516e44942a67136b30bc48aa1 P 8f34a4731ec24146b05167572a79008f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:28.477315 13016 catalog_manager.cc:5697] T 3ff6b11516e44942a67136b30bc48aa1 P 8f34a4731ec24146b05167572a79008f reported cstate change: term changed from 1 to 2, leader changed from ba142a6ed214425084a138399cc5f489 (127.12.174.129) to 8f34a4731ec24146b05167572a79008f (127.12.174.130). New cstate: current_term: 2 leader_uuid: "8f34a4731ec24146b05167572a79008f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:28.530874 13465 raft_consensus.cc:993] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P b2e22ffd8266454f91a45727bd098a92: : Instructing follower 8f34a4731ec24146b05167572a79008f to start an election
I20260709 12:08:28.531453 13477 raft_consensus.cc:1081] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P b2e22ffd8266454f91a45727bd098a92 [term 2 LEADER]: Signalling peer 8f34a4731ec24146b05167572a79008f to start an election
I20260709 12:08:28.533203 13196 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6a73bb3cf9eb4b4484c76c5ef49859f0"
dest_uuid: "8f34a4731ec24146b05167572a79008f"
 from {username='slave'} at 127.0.0.1:51148
I20260709 12:08:28.533830 13196 raft_consensus.cc:493] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P 8f34a4731ec24146b05167572a79008f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:28.534262 13196 raft_consensus.cc:3060] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P 8f34a4731ec24146b05167572a79008f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:28.543514 13196 raft_consensus.cc:515] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P 8f34a4731ec24146b05167572a79008f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:28.546253 13196 leader_election.cc:290] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P 8f34a4731ec24146b05167572a79008f [CANDIDATE]: Term 3 election: Requested vote from peers ba142a6ed214425084a138399cc5f489 (127.12.174.129:36937), b2e22ffd8266454f91a45727bd098a92 (127.12.174.131:40191)
I20260709 12:08:28.547037 13121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a73bb3cf9eb4b4484c76c5ef49859f0" candidate_uuid: "8f34a4731ec24146b05167572a79008f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ba142a6ed214425084a138399cc5f489"
I20260709 12:08:28.547751 13121 raft_consensus.cc:3060] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P ba142a6ed214425084a138399cc5f489 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:28.547369 13269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a73bb3cf9eb4b4484c76c5ef49859f0" candidate_uuid: "8f34a4731ec24146b05167572a79008f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b2e22ffd8266454f91a45727bd098a92"
I20260709 12:08:28.548311 13269 raft_consensus.cc:3055] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P b2e22ffd8266454f91a45727bd098a92 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:08:28.548702 13269 raft_consensus.cc:740] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P b2e22ffd8266454f91a45727bd098a92 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b2e22ffd8266454f91a45727bd098a92, State: Running, Role: LEADER
I20260709 12:08:28.549837 13269 consensus_queue.cc:260] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P b2e22ffd8266454f91a45727bd098a92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:28.551642 13269 raft_consensus.cc:3060] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P b2e22ffd8266454f91a45727bd098a92 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:28.553941 13121 raft_consensus.cc:2468] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P ba142a6ed214425084a138399cc5f489 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f34a4731ec24146b05167572a79008f in term 3.
I20260709 12:08:28.555070 13162 leader_election.cc:304] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P 8f34a4731ec24146b05167572a79008f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f34a4731ec24146b05167572a79008f, ba142a6ed214425084a138399cc5f489; no voters: 
I20260709 12:08:28.555908 13476 raft_consensus.cc:2804] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P 8f34a4731ec24146b05167572a79008f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:08:28.556468 13476 raft_consensus.cc:697] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P 8f34a4731ec24146b05167572a79008f [term 3 LEADER]: Becoming Leader. State: Replica: 8f34a4731ec24146b05167572a79008f, State: Running, Role: LEADER
I20260709 12:08:28.557705 13476 consensus_queue.cc:237] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P 8f34a4731ec24146b05167572a79008f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:28.561256 13269 raft_consensus.cc:2468] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P b2e22ffd8266454f91a45727bd098a92 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f34a4731ec24146b05167572a79008f in term 3.
I20260709 12:08:28.567561 13016 catalog_manager.cc:5697] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P 8f34a4731ec24146b05167572a79008f reported cstate change: term changed from 2 to 3, leader changed from b2e22ffd8266454f91a45727bd098a92 (127.12.174.131) to 8f34a4731ec24146b05167572a79008f (127.12.174.130). New cstate: current_term: 3 leader_uuid: "8f34a4731ec24146b05167572a79008f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:28.714010 13484 raft_consensus.cc:993] T db4772bfddd848238ef081fec351b1c9 P ba142a6ed214425084a138399cc5f489: : Instructing follower 8f34a4731ec24146b05167572a79008f to start an election
I20260709 12:08:28.714574 13475 raft_consensus.cc:1081] T db4772bfddd848238ef081fec351b1c9 P ba142a6ed214425084a138399cc5f489 [term 2 LEADER]: Signalling peer 8f34a4731ec24146b05167572a79008f to start an election
I20260709 12:08:28.716641 13196 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "db4772bfddd848238ef081fec351b1c9"
dest_uuid: "8f34a4731ec24146b05167572a79008f"
 from {username='slave'} at 127.0.0.1:51132
I20260709 12:08:28.717293 13196 raft_consensus.cc:493] T db4772bfddd848238ef081fec351b1c9 P 8f34a4731ec24146b05167572a79008f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:28.717689 13196 raft_consensus.cc:3060] T db4772bfddd848238ef081fec351b1c9 P 8f34a4731ec24146b05167572a79008f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:28.720901 13121 raft_consensus.cc:1275] T 15a6902d3ade4230a51ed07fb1663a27 P ba142a6ed214425084a138399cc5f489 [term 3 FOLLOWER]: Refusing update from remote peer 8f34a4731ec24146b05167572a79008f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:28.722201 13476 consensus_queue.cc:1048] T 15a6902d3ade4230a51ed07fb1663a27 P 8f34a4731ec24146b05167572a79008f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:28.728127 13196 raft_consensus.cc:515] T db4772bfddd848238ef081fec351b1c9 P 8f34a4731ec24146b05167572a79008f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:28.733212 13120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4772bfddd848238ef081fec351b1c9" candidate_uuid: "8f34a4731ec24146b05167572a79008f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ba142a6ed214425084a138399cc5f489"
I20260709 12:08:28.734205 13120 raft_consensus.cc:3055] T db4772bfddd848238ef081fec351b1c9 P ba142a6ed214425084a138399cc5f489 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:08:28.733191 13269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4772bfddd848238ef081fec351b1c9" candidate_uuid: "8f34a4731ec24146b05167572a79008f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b2e22ffd8266454f91a45727bd098a92"
I20260709 12:08:28.735648 13269 raft_consensus.cc:3060] T db4772bfddd848238ef081fec351b1c9 P b2e22ffd8266454f91a45727bd098a92 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:28.734680 13120 raft_consensus.cc:740] T db4772bfddd848238ef081fec351b1c9 P ba142a6ed214425084a138399cc5f489 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ba142a6ed214425084a138399cc5f489, State: Running, Role: LEADER
I20260709 12:08:28.737862 13120 consensus_queue.cc:260] T db4772bfddd848238ef081fec351b1c9 P ba142a6ed214425084a138399cc5f489 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:28.741560 13120 raft_consensus.cc:3060] T db4772bfddd848238ef081fec351b1c9 P ba142a6ed214425084a138399cc5f489 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:28.731729 13196 leader_election.cc:290] T db4772bfddd848238ef081fec351b1c9 P 8f34a4731ec24146b05167572a79008f [CANDIDATE]: Term 3 election: Requested vote from peers ba142a6ed214425084a138399cc5f489 (127.12.174.129:36937), b2e22ffd8266454f91a45727bd098a92 (127.12.174.131:40191)
I20260709 12:08:28.745622 13269 raft_consensus.cc:2468] T db4772bfddd848238ef081fec351b1c9 P b2e22ffd8266454f91a45727bd098a92 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f34a4731ec24146b05167572a79008f in term 3.
I20260709 12:08:28.750483 13162 leader_election.cc:304] T db4772bfddd848238ef081fec351b1c9 P 8f34a4731ec24146b05167572a79008f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f34a4731ec24146b05167572a79008f, b2e22ffd8266454f91a45727bd098a92; no voters: 
I20260709 12:08:28.751050 13268 raft_consensus.cc:1275] T 15a6902d3ade4230a51ed07fb1663a27 P b2e22ffd8266454f91a45727bd098a92 [term 3 FOLLOWER]: Refusing update from remote peer 8f34a4731ec24146b05167572a79008f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:28.752089 13478 raft_consensus.cc:2804] T db4772bfddd848238ef081fec351b1c9 P 8f34a4731ec24146b05167572a79008f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:08:28.753571 13478 raft_consensus.cc:697] T db4772bfddd848238ef081fec351b1c9 P 8f34a4731ec24146b05167572a79008f [term 3 LEADER]: Becoming Leader. State: Replica: 8f34a4731ec24146b05167572a79008f, State: Running, Role: LEADER
I20260709 12:08:28.754820 13486 consensus_queue.cc:1048] T 15a6902d3ade4230a51ed07fb1663a27 P 8f34a4731ec24146b05167572a79008f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:08:28.756496 13478 consensus_queue.cc:237] T db4772bfddd848238ef081fec351b1c9 P 8f34a4731ec24146b05167572a79008f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:28.764257 13120 raft_consensus.cc:2468] T db4772bfddd848238ef081fec351b1c9 P ba142a6ed214425084a138399cc5f489 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f34a4731ec24146b05167572a79008f in term 3.
I20260709 12:08:28.774197 13018 catalog_manager.cc:5697] T db4772bfddd848238ef081fec351b1c9 P 8f34a4731ec24146b05167572a79008f reported cstate change: term changed from 2 to 3, leader changed from ba142a6ed214425084a138399cc5f489 (127.12.174.129) to 8f34a4731ec24146b05167572a79008f (127.12.174.130). New cstate: current_term: 3 leader_uuid: "8f34a4731ec24146b05167572a79008f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:28.848109 13268 raft_consensus.cc:1275] T d5f3329ccf5b4ebf87e0eb8dc143b5d9 P b2e22ffd8266454f91a45727bd098a92 [term 3 FOLLOWER]: Refusing update from remote peer 8f34a4731ec24146b05167572a79008f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:28.849356 13476 consensus_queue.cc:1048] T d5f3329ccf5b4ebf87e0eb8dc143b5d9 P 8f34a4731ec24146b05167572a79008f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:28.858944 13120 raft_consensus.cc:1275] T d5f3329ccf5b4ebf87e0eb8dc143b5d9 P ba142a6ed214425084a138399cc5f489 [term 3 FOLLOWER]: Refusing update from remote peer 8f34a4731ec24146b05167572a79008f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:28.860790 13486 consensus_queue.cc:1048] T d5f3329ccf5b4ebf87e0eb8dc143b5d9 P 8f34a4731ec24146b05167572a79008f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:28.909185 13268 raft_consensus.cc:1275] T 3ff6b11516e44942a67136b30bc48aa1 P b2e22ffd8266454f91a45727bd098a92 [term 2 FOLLOWER]: Refusing update from remote peer 8f34a4731ec24146b05167572a79008f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:28.911123 13486 consensus_queue.cc:1048] T 3ff6b11516e44942a67136b30bc48aa1 P 8f34a4731ec24146b05167572a79008f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:08:28.923117 13120 raft_consensus.cc:1275] T 3ff6b11516e44942a67136b30bc48aa1 P ba142a6ed214425084a138399cc5f489 [term 2 FOLLOWER]: Refusing update from remote peer 8f34a4731ec24146b05167572a79008f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:28.925433 13476 consensus_queue.cc:1048] T 3ff6b11516e44942a67136b30bc48aa1 P 8f34a4731ec24146b05167572a79008f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:08:29.121817 13268 raft_consensus.cc:1275] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P b2e22ffd8266454f91a45727bd098a92 [term 3 FOLLOWER]: Refusing update from remote peer 8f34a4731ec24146b05167572a79008f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:29.123497 13476 consensus_queue.cc:1048] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P 8f34a4731ec24146b05167572a79008f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:29.137311 13120 raft_consensus.cc:1275] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P ba142a6ed214425084a138399cc5f489 [term 3 FOLLOWER]: Refusing update from remote peer 8f34a4731ec24146b05167572a79008f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:29.140967 13476 consensus_queue.cc:1048] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P 8f34a4731ec24146b05167572a79008f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:08:29.142908 13120 raft_consensus.cc:1275] T db4772bfddd848238ef081fec351b1c9 P ba142a6ed214425084a138399cc5f489 [term 3 FOLLOWER]: Refusing update from remote peer 8f34a4731ec24146b05167572a79008f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:29.144749 13476 consensus_queue.cc:1048] T db4772bfddd848238ef081fec351b1c9 P 8f34a4731ec24146b05167572a79008f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:08:29.162073 13268 raft_consensus.cc:1275] T db4772bfddd848238ef081fec351b1c9 P b2e22ffd8266454f91a45727bd098a92 [term 3 FOLLOWER]: Refusing update from remote peer 8f34a4731ec24146b05167572a79008f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:29.164166 13476 consensus_queue.cc:1048] T db4772bfddd848238ef081fec351b1c9 P 8f34a4731ec24146b05167572a79008f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:08:31.181995 12986 auto_leader_rebalancer-test.cc:328] The leader distribution is 
I20260709 12:08:31.182789 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:31.190987 13196 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6a73bb3cf9eb4b4484c76c5ef49859f0"
dest_uuid: "8f34a4731ec24146b05167572a79008f"
mode: GRACEFUL
new_leader_uuid: "ba142a6ed214425084a138399cc5f489"
 from {username='slave'} at 127.0.0.1:32840
I20260709 12:08:31.191643 13196 raft_consensus.cc:606] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P 8f34a4731ec24146b05167572a79008f [term 3 LEADER]: Received request to transfer leadership to TS ba142a6ed214425084a138399cc5f489
I20260709 12:08:31.194729 13196 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8211beafbf81439d8629834dbbb3a6b9"
dest_uuid: "8f34a4731ec24146b05167572a79008f"
mode: GRACEFUL
new_leader_uuid: "b2e22ffd8266454f91a45727bd098a92"
 from {username='slave'} at 127.0.0.1:32840
I20260709 12:08:31.195346 13196 raft_consensus.cc:606] T 8211beafbf81439d8629834dbbb3a6b9 P 8f34a4731ec24146b05167572a79008f [term 2 LEADER]: Received request to transfer leadership to TS b2e22ffd8266454f91a45727bd098a92
I20260709 12:08:31.197793 13196 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "848ce1d9265c4134bcef148a91744c7c"
dest_uuid: "8f34a4731ec24146b05167572a79008f"
mode: GRACEFUL
new_leader_uuid: "ba142a6ed214425084a138399cc5f489"
 from {username='slave'} at 127.0.0.1:32840
I20260709 12:08:31.198406 13196 raft_consensus.cc:606] T 848ce1d9265c4134bcef148a91744c7c P 8f34a4731ec24146b05167572a79008f [term 2 LEADER]: Received request to transfer leadership to TS ba142a6ed214425084a138399cc5f489
I20260709 12:08:31.200805 13196 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cb766527c41242e0ab211622b1f0e268"
dest_uuid: "8f34a4731ec24146b05167572a79008f"
mode: GRACEFUL
new_leader_uuid: "ba142a6ed214425084a138399cc5f489"
 from {username='slave'} at 127.0.0.1:32840
I20260709 12:08:31.201327 13196 raft_consensus.cc:606] T cb766527c41242e0ab211622b1f0e268 P 8f34a4731ec24146b05167572a79008f [term 2 LEADER]: Received request to transfer leadership to TS ba142a6ed214425084a138399cc5f489
I20260709 12:08:31.203684 13196 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "db4772bfddd848238ef081fec351b1c9"
dest_uuid: "8f34a4731ec24146b05167572a79008f"
mode: GRACEFUL
new_leader_uuid: "b2e22ffd8266454f91a45727bd098a92"
 from {username='slave'} at 127.0.0.1:32840
I20260709 12:08:31.204174 13196 raft_consensus.cc:606] T db4772bfddd848238ef081fec351b1c9 P 8f34a4731ec24146b05167572a79008f [term 3 LEADER]: Received request to transfer leadership to TS b2e22ffd8266454f91a45727bd098a92
I20260709 12:08:31.205250 12986 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:08:31.205770 12986 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:31.233855 13486 raft_consensus.cc:993] T cb766527c41242e0ab211622b1f0e268 P 8f34a4731ec24146b05167572a79008f: : Instructing follower ba142a6ed214425084a138399cc5f489 to start an election
I20260709 12:08:31.234321 13486 raft_consensus.cc:1081] T cb766527c41242e0ab211622b1f0e268 P 8f34a4731ec24146b05167572a79008f [term 2 LEADER]: Signalling peer ba142a6ed214425084a138399cc5f489 to start an election
I20260709 12:08:31.235989 13120 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cb766527c41242e0ab211622b1f0e268"
dest_uuid: "ba142a6ed214425084a138399cc5f489"
 from {username='slave'} at 127.0.0.1:39318
I20260709 12:08:31.236508 13120 raft_consensus.cc:493] T cb766527c41242e0ab211622b1f0e268 P ba142a6ed214425084a138399cc5f489 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:31.236838 13120 raft_consensus.cc:3060] T cb766527c41242e0ab211622b1f0e268 P ba142a6ed214425084a138399cc5f489 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:31.242383 13120 raft_consensus.cc:515] T cb766527c41242e0ab211622b1f0e268 P ba142a6ed214425084a138399cc5f489 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:31.245162 13120 leader_election.cc:290] T cb766527c41242e0ab211622b1f0e268 P ba142a6ed214425084a138399cc5f489 [CANDIDATE]: Term 3 election: Requested vote from peers 8f34a4731ec24146b05167572a79008f (127.12.174.130:45431), b2e22ffd8266454f91a45727bd098a92 (127.12.174.131:40191)
I20260709 12:08:31.245560 13486 raft_consensus.cc:993] T 8211beafbf81439d8629834dbbb3a6b9 P 8f34a4731ec24146b05167572a79008f: : Instructing follower b2e22ffd8266454f91a45727bd098a92 to start an election
I20260709 12:08:31.245981 13196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb766527c41242e0ab211622b1f0e268" candidate_uuid: "ba142a6ed214425084a138399cc5f489" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8f34a4731ec24146b05167572a79008f"
I20260709 12:08:31.246198 13486 raft_consensus.cc:1081] T 8211beafbf81439d8629834dbbb3a6b9 P 8f34a4731ec24146b05167572a79008f [term 2 LEADER]: Signalling peer b2e22ffd8266454f91a45727bd098a92 to start an election
I20260709 12:08:31.246615 13196 raft_consensus.cc:3055] T cb766527c41242e0ab211622b1f0e268 P 8f34a4731ec24146b05167572a79008f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:08:31.246946 13196 raft_consensus.cc:740] T cb766527c41242e0ab211622b1f0e268 P 8f34a4731ec24146b05167572a79008f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8f34a4731ec24146b05167572a79008f, State: Running, Role: LEADER
I20260709 12:08:31.247056 13269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb766527c41242e0ab211622b1f0e268" candidate_uuid: "ba142a6ed214425084a138399cc5f489" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b2e22ffd8266454f91a45727bd098a92"
I20260709 12:08:31.247632 13269 raft_consensus.cc:3060] T cb766527c41242e0ab211622b1f0e268 P b2e22ffd8266454f91a45727bd098a92 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:31.247676 13268 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8211beafbf81439d8629834dbbb3a6b9"
dest_uuid: "b2e22ffd8266454f91a45727bd098a92"
 from {username='slave'} at 127.0.0.1:56306
I20260709 12:08:31.248245 13268 raft_consensus.cc:493] T 8211beafbf81439d8629834dbbb3a6b9 P b2e22ffd8266454f91a45727bd098a92 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:31.247951 13196 consensus_queue.cc:260] T cb766527c41242e0ab211622b1f0e268 P 8f34a4731ec24146b05167572a79008f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:31.248555 13268 raft_consensus.cc:3060] T 8211beafbf81439d8629834dbbb3a6b9 P b2e22ffd8266454f91a45727bd098a92 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:31.249297 13196 raft_consensus.cc:3060] T cb766527c41242e0ab211622b1f0e268 P 8f34a4731ec24146b05167572a79008f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:31.254072 13268 raft_consensus.cc:515] T 8211beafbf81439d8629834dbbb3a6b9 P b2e22ffd8266454f91a45727bd098a92 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:31.255800 13269 raft_consensus.cc:2468] T cb766527c41242e0ab211622b1f0e268 P b2e22ffd8266454f91a45727bd098a92 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba142a6ed214425084a138399cc5f489 in term 3.
I20260709 12:08:31.256729 13268 leader_election.cc:290] T 8211beafbf81439d8629834dbbb3a6b9 P b2e22ffd8266454f91a45727bd098a92 [CANDIDATE]: Term 3 election: Requested vote from peers ba142a6ed214425084a138399cc5f489 (127.12.174.129:36937), 8f34a4731ec24146b05167572a79008f (127.12.174.130:45431)
I20260709 12:08:31.257388 13087 leader_election.cc:304] T cb766527c41242e0ab211622b1f0e268 P ba142a6ed214425084a138399cc5f489 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2e22ffd8266454f91a45727bd098a92, ba142a6ed214425084a138399cc5f489; no voters: 
I20260709 12:08:31.258021 13196 raft_consensus.cc:2468] T cb766527c41242e0ab211622b1f0e268 P 8f34a4731ec24146b05167572a79008f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba142a6ed214425084a138399cc5f489 in term 3.
I20260709 12:08:31.258016 13193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8211beafbf81439d8629834dbbb3a6b9" candidate_uuid: "b2e22ffd8266454f91a45727bd098a92" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8f34a4731ec24146b05167572a79008f"
I20260709 12:08:31.258852 13193 raft_consensus.cc:3055] T 8211beafbf81439d8629834dbbb3a6b9 P 8f34a4731ec24146b05167572a79008f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:08:31.259199 13193 raft_consensus.cc:740] T 8211beafbf81439d8629834dbbb3a6b9 P 8f34a4731ec24146b05167572a79008f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8f34a4731ec24146b05167572a79008f, State: Running, Role: LEADER
I20260709 12:08:31.257383 13120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8211beafbf81439d8629834dbbb3a6b9" candidate_uuid: "b2e22ffd8266454f91a45727bd098a92" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ba142a6ed214425084a138399cc5f489"
I20260709 12:08:31.259943 13120 raft_consensus.cc:3060] T 8211beafbf81439d8629834dbbb3a6b9 P ba142a6ed214425084a138399cc5f489 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:31.260069 13193 consensus_queue.cc:260] T 8211beafbf81439d8629834dbbb3a6b9 P 8f34a4731ec24146b05167572a79008f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:31.259302 13504 raft_consensus.cc:2804] T cb766527c41242e0ab211622b1f0e268 P ba142a6ed214425084a138399cc5f489 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:08:31.261512 13193 raft_consensus.cc:3060] T 8211beafbf81439d8629834dbbb3a6b9 P 8f34a4731ec24146b05167572a79008f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:31.268721 13120 raft_consensus.cc:2468] T 8211beafbf81439d8629834dbbb3a6b9 P ba142a6ed214425084a138399cc5f489 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2e22ffd8266454f91a45727bd098a92 in term 3.
I20260709 12:08:31.269217 13193 raft_consensus.cc:2468] T 8211beafbf81439d8629834dbbb3a6b9 P 8f34a4731ec24146b05167572a79008f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2e22ffd8266454f91a45727bd098a92 in term 3.
I20260709 12:08:31.270565 13236 leader_election.cc:304] T 8211beafbf81439d8629834dbbb3a6b9 P b2e22ffd8266454f91a45727bd098a92 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2e22ffd8266454f91a45727bd098a92, ba142a6ed214425084a138399cc5f489; no voters: 
I20260709 12:08:31.270694 13504 raft_consensus.cc:697] T cb766527c41242e0ab211622b1f0e268 P ba142a6ed214425084a138399cc5f489 [term 3 LEADER]: Becoming Leader. State: Replica: ba142a6ed214425084a138399cc5f489, State: Running, Role: LEADER
I20260709 12:08:31.271522 13477 raft_consensus.cc:2804] T 8211beafbf81439d8629834dbbb3a6b9 P b2e22ffd8266454f91a45727bd098a92 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:08:31.272235 13504 consensus_queue.cc:237] T cb766527c41242e0ab211622b1f0e268 P ba142a6ed214425084a138399cc5f489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:31.272745 13477 raft_consensus.cc:697] T 8211beafbf81439d8629834dbbb3a6b9 P b2e22ffd8266454f91a45727bd098a92 [term 3 LEADER]: Becoming Leader. State: Replica: b2e22ffd8266454f91a45727bd098a92, State: Running, Role: LEADER
I20260709 12:08:31.273856 13477 consensus_queue.cc:237] T 8211beafbf81439d8629834dbbb3a6b9 P b2e22ffd8266454f91a45727bd098a92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:31.282281 13018 catalog_manager.cc:5697] T cb766527c41242e0ab211622b1f0e268 P ba142a6ed214425084a138399cc5f489 reported cstate change: term changed from 2 to 3, leader changed from 8f34a4731ec24146b05167572a79008f (127.12.174.130) to ba142a6ed214425084a138399cc5f489 (127.12.174.129). New cstate: current_term: 3 leader_uuid: "ba142a6ed214425084a138399cc5f489" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:31.283037 13016 catalog_manager.cc:5697] T 8211beafbf81439d8629834dbbb3a6b9 P b2e22ffd8266454f91a45727bd098a92 reported cstate change: term changed from 2 to 3, leader changed from 8f34a4731ec24146b05167572a79008f (127.12.174.130) to b2e22ffd8266454f91a45727bd098a92 (127.12.174.131). New cstate: current_term: 3 leader_uuid: "b2e22ffd8266454f91a45727bd098a92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:31.404001 13486 raft_consensus.cc:993] T db4772bfddd848238ef081fec351b1c9 P 8f34a4731ec24146b05167572a79008f: : Instructing follower b2e22ffd8266454f91a45727bd098a92 to start an election
I20260709 12:08:31.404497 13476 raft_consensus.cc:1081] T db4772bfddd848238ef081fec351b1c9 P 8f34a4731ec24146b05167572a79008f [term 3 LEADER]: Signalling peer b2e22ffd8266454f91a45727bd098a92 to start an election
I20260709 12:08:31.406155 13268 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "db4772bfddd848238ef081fec351b1c9"
dest_uuid: "b2e22ffd8266454f91a45727bd098a92"
 from {username='slave'} at 127.0.0.1:56306
I20260709 12:08:31.406674 13268 raft_consensus.cc:493] T db4772bfddd848238ef081fec351b1c9 P b2e22ffd8266454f91a45727bd098a92 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:31.406970 13268 raft_consensus.cc:3060] T db4772bfddd848238ef081fec351b1c9 P b2e22ffd8266454f91a45727bd098a92 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:08:31.412770 13268 raft_consensus.cc:515] T db4772bfddd848238ef081fec351b1c9 P b2e22ffd8266454f91a45727bd098a92 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:31.414906 13268 leader_election.cc:290] T db4772bfddd848238ef081fec351b1c9 P b2e22ffd8266454f91a45727bd098a92 [CANDIDATE]: Term 4 election: Requested vote from peers ba142a6ed214425084a138399cc5f489 (127.12.174.129:36937), 8f34a4731ec24146b05167572a79008f (127.12.174.130:45431)
I20260709 12:08:31.415867 13120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4772bfddd848238ef081fec351b1c9" candidate_uuid: "b2e22ffd8266454f91a45727bd098a92" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "ba142a6ed214425084a138399cc5f489"
I20260709 12:08:31.416321 13193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4772bfddd848238ef081fec351b1c9" candidate_uuid: "b2e22ffd8266454f91a45727bd098a92" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "8f34a4731ec24146b05167572a79008f"
I20260709 12:08:31.416626 13120 raft_consensus.cc:3060] T db4772bfddd848238ef081fec351b1c9 P ba142a6ed214425084a138399cc5f489 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:08:31.416937 13193 raft_consensus.cc:3055] T db4772bfddd848238ef081fec351b1c9 P 8f34a4731ec24146b05167572a79008f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:08:31.417261 13193 raft_consensus.cc:740] T db4772bfddd848238ef081fec351b1c9 P 8f34a4731ec24146b05167572a79008f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8f34a4731ec24146b05167572a79008f, State: Running, Role: LEADER
I20260709 12:08:31.417968 13193 consensus_queue.cc:260] T db4772bfddd848238ef081fec351b1c9 P 8f34a4731ec24146b05167572a79008f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:31.418851 13193 raft_consensus.cc:3060] T db4772bfddd848238ef081fec351b1c9 P 8f34a4731ec24146b05167572a79008f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:08:31.423434 13120 raft_consensus.cc:2468] T db4772bfddd848238ef081fec351b1c9 P ba142a6ed214425084a138399cc5f489 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2e22ffd8266454f91a45727bd098a92 in term 4.
I20260709 12:08:31.424682 13121 raft_consensus.cc:1240] T db4772bfddd848238ef081fec351b1c9 P ba142a6ed214425084a138399cc5f489 [term 4 FOLLOWER]: Rejecting Update request from peer 8f34a4731ec24146b05167572a79008f for earlier term 3. Current term is 4. Ops: []
I20260709 12:08:31.425422 13236 leader_election.cc:304] T db4772bfddd848238ef081fec351b1c9 P b2e22ffd8266454f91a45727bd098a92 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2e22ffd8266454f91a45727bd098a92, ba142a6ed214425084a138399cc5f489; no voters: 
I20260709 12:08:31.426692 13477 raft_consensus.cc:2804] T db4772bfddd848238ef081fec351b1c9 P b2e22ffd8266454f91a45727bd098a92 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:08:31.427472 13477 raft_consensus.cc:697] T db4772bfddd848238ef081fec351b1c9 P b2e22ffd8266454f91a45727bd098a92 [term 4 LEADER]: Becoming Leader. State: Replica: b2e22ffd8266454f91a45727bd098a92, State: Running, Role: LEADER
I20260709 12:08:31.427652 13193 raft_consensus.cc:2468] T db4772bfddd848238ef081fec351b1c9 P 8f34a4731ec24146b05167572a79008f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2e22ffd8266454f91a45727bd098a92 in term 4.
I20260709 12:08:31.429260 13477 consensus_queue.cc:237] T db4772bfddd848238ef081fec351b1c9 P b2e22ffd8266454f91a45727bd098a92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:31.437497 13016 catalog_manager.cc:5697] T db4772bfddd848238ef081fec351b1c9 P b2e22ffd8266454f91a45727bd098a92 reported cstate change: term changed from 3 to 4, leader changed from 8f34a4731ec24146b05167572a79008f (127.12.174.130) to b2e22ffd8266454f91a45727bd098a92 (127.12.174.131). New cstate: current_term: 4 leader_uuid: "b2e22ffd8266454f91a45727bd098a92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:31.546763 13486 raft_consensus.cc:993] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P 8f34a4731ec24146b05167572a79008f: : Instructing follower ba142a6ed214425084a138399cc5f489 to start an election
I20260709 12:08:31.547313 13486 raft_consensus.cc:1081] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P 8f34a4731ec24146b05167572a79008f [term 3 LEADER]: Signalling peer ba142a6ed214425084a138399cc5f489 to start an election
I20260709 12:08:31.549221 13120 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6a73bb3cf9eb4b4484c76c5ef49859f0"
dest_uuid: "ba142a6ed214425084a138399cc5f489"
 from {username='slave'} at 127.0.0.1:39318
I20260709 12:08:31.549862 13120 raft_consensus.cc:493] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P ba142a6ed214425084a138399cc5f489 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:31.550225 13120 raft_consensus.cc:3060] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P ba142a6ed214425084a138399cc5f489 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:08:31.550987 13515 raft_consensus.cc:993] T 848ce1d9265c4134bcef148a91744c7c P 8f34a4731ec24146b05167572a79008f: : Instructing follower ba142a6ed214425084a138399cc5f489 to start an election
I20260709 12:08:31.551539 13486 raft_consensus.cc:1081] T 848ce1d9265c4134bcef148a91744c7c P 8f34a4731ec24146b05167572a79008f [term 2 LEADER]: Signalling peer ba142a6ed214425084a138399cc5f489 to start an election
I20260709 12:08:31.553122 13121 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "848ce1d9265c4134bcef148a91744c7c"
dest_uuid: "ba142a6ed214425084a138399cc5f489"
 from {username='slave'} at 127.0.0.1:39318
I20260709 12:08:31.553682 13121 raft_consensus.cc:493] T 848ce1d9265c4134bcef148a91744c7c P ba142a6ed214425084a138399cc5f489 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:31.554082 13121 raft_consensus.cc:3060] T 848ce1d9265c4134bcef148a91744c7c P ba142a6ed214425084a138399cc5f489 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:31.557241 13120 raft_consensus.cc:515] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P ba142a6ed214425084a138399cc5f489 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:31.559443 13120 leader_election.cc:290] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P ba142a6ed214425084a138399cc5f489 [CANDIDATE]: Term 4 election: Requested vote from peers 8f34a4731ec24146b05167572a79008f (127.12.174.130:45431), b2e22ffd8266454f91a45727bd098a92 (127.12.174.131:40191)
I20260709 12:08:31.560204 13193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a73bb3cf9eb4b4484c76c5ef49859f0" candidate_uuid: "ba142a6ed214425084a138399cc5f489" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "8f34a4731ec24146b05167572a79008f"
I20260709 12:08:31.560623 13268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a73bb3cf9eb4b4484c76c5ef49859f0" candidate_uuid: "ba142a6ed214425084a138399cc5f489" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "b2e22ffd8266454f91a45727bd098a92"
I20260709 12:08:31.560817 13193 raft_consensus.cc:3055] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P 8f34a4731ec24146b05167572a79008f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:08:31.561100 13121 raft_consensus.cc:515] T 848ce1d9265c4134bcef148a91744c7c P ba142a6ed214425084a138399cc5f489 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:31.561185 13268 raft_consensus.cc:3060] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P b2e22ffd8266454f91a45727bd098a92 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:08:31.561164 13193 raft_consensus.cc:740] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P 8f34a4731ec24146b05167572a79008f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8f34a4731ec24146b05167572a79008f, State: Running, Role: LEADER
I20260709 12:08:31.562299 13193 consensus_queue.cc:260] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P 8f34a4731ec24146b05167572a79008f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:31.563040 13121 leader_election.cc:290] T 848ce1d9265c4134bcef148a91744c7c P ba142a6ed214425084a138399cc5f489 [CANDIDATE]: Term 3 election: Requested vote from peers 8f34a4731ec24146b05167572a79008f (127.12.174.130:45431), b2e22ffd8266454f91a45727bd098a92 (127.12.174.131:40191)
I20260709 12:08:31.563596 13193 raft_consensus.cc:3060] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P 8f34a4731ec24146b05167572a79008f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:08:31.564205 13269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848ce1d9265c4134bcef148a91744c7c" candidate_uuid: "ba142a6ed214425084a138399cc5f489" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b2e22ffd8266454f91a45727bd098a92"
I20260709 12:08:31.564747 13269 raft_consensus.cc:3060] T 848ce1d9265c4134bcef148a91744c7c P b2e22ffd8266454f91a45727bd098a92 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:31.564667 13196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848ce1d9265c4134bcef148a91744c7c" candidate_uuid: "ba142a6ed214425084a138399cc5f489" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8f34a4731ec24146b05167572a79008f"
I20260709 12:08:31.565338 13196 raft_consensus.cc:3055] T 848ce1d9265c4134bcef148a91744c7c P 8f34a4731ec24146b05167572a79008f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:08:31.565871 13196 raft_consensus.cc:740] T 848ce1d9265c4134bcef148a91744c7c P 8f34a4731ec24146b05167572a79008f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8f34a4731ec24146b05167572a79008f, State: Running, Role: LEADER
I20260709 12:08:31.566857 13196 consensus_queue.cc:260] T 848ce1d9265c4134bcef148a91744c7c P 8f34a4731ec24146b05167572a79008f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:31.567967 13196 raft_consensus.cc:3060] T 848ce1d9265c4134bcef148a91744c7c P 8f34a4731ec24146b05167572a79008f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:31.568457 13268 raft_consensus.cc:2468] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P b2e22ffd8266454f91a45727bd098a92 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba142a6ed214425084a138399cc5f489 in term 4.
I20260709 12:08:31.569782 13087 leader_election.cc:304] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P ba142a6ed214425084a138399cc5f489 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2e22ffd8266454f91a45727bd098a92, ba142a6ed214425084a138399cc5f489; no voters: 
I20260709 12:08:31.570652 13504 raft_consensus.cc:2804] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P ba142a6ed214425084a138399cc5f489 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:08:31.571112 13504 raft_consensus.cc:697] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P ba142a6ed214425084a138399cc5f489 [term 4 LEADER]: Becoming Leader. State: Replica: ba142a6ed214425084a138399cc5f489, State: Running, Role: LEADER
I20260709 12:08:31.571882 13269 raft_consensus.cc:2468] T 848ce1d9265c4134bcef148a91744c7c P b2e22ffd8266454f91a45727bd098a92 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba142a6ed214425084a138399cc5f489 in term 3.
I20260709 12:08:31.571936 13504 consensus_queue.cc:237] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P ba142a6ed214425084a138399cc5f489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:31.573097 13193 raft_consensus.cc:2468] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P 8f34a4731ec24146b05167572a79008f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba142a6ed214425084a138399cc5f489 in term 4.
I20260709 12:08:31.576103 13087 leader_election.cc:304] T 848ce1d9265c4134bcef148a91744c7c P ba142a6ed214425084a138399cc5f489 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2e22ffd8266454f91a45727bd098a92, ba142a6ed214425084a138399cc5f489; no voters: 
I20260709 12:08:31.577008 13504 raft_consensus.cc:2804] T 848ce1d9265c4134bcef148a91744c7c P ba142a6ed214425084a138399cc5f489 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:08:31.577489 13504 raft_consensus.cc:697] T 848ce1d9265c4134bcef148a91744c7c P ba142a6ed214425084a138399cc5f489 [term 3 LEADER]: Becoming Leader. State: Replica: ba142a6ed214425084a138399cc5f489, State: Running, Role: LEADER
I20260709 12:08:31.577833 13196 raft_consensus.cc:2468] T 848ce1d9265c4134bcef148a91744c7c P 8f34a4731ec24146b05167572a79008f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba142a6ed214425084a138399cc5f489 in term 3.
I20260709 12:08:31.578392 13504 consensus_queue.cc:237] T 848ce1d9265c4134bcef148a91744c7c P ba142a6ed214425084a138399cc5f489 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } }
I20260709 12:08:31.580785 13016 catalog_manager.cc:5697] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P ba142a6ed214425084a138399cc5f489 reported cstate change: term changed from 3 to 4, leader changed from 8f34a4731ec24146b05167572a79008f (127.12.174.130) to ba142a6ed214425084a138399cc5f489 (127.12.174.129). New cstate: current_term: 4 leader_uuid: "ba142a6ed214425084a138399cc5f489" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:31.593554 13016 catalog_manager.cc:5697] T 848ce1d9265c4134bcef148a91744c7c P ba142a6ed214425084a138399cc5f489 reported cstate change: term changed from 2 to 3, leader changed from 8f34a4731ec24146b05167572a79008f (127.12.174.130) to ba142a6ed214425084a138399cc5f489 (127.12.174.129). New cstate: current_term: 3 leader_uuid: "ba142a6ed214425084a138399cc5f489" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:31.699538 13196 raft_consensus.cc:1275] T cb766527c41242e0ab211622b1f0e268 P 8f34a4731ec24146b05167572a79008f [term 3 FOLLOWER]: Refusing update from remote peer ba142a6ed214425084a138399cc5f489: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:31.700981 13504 consensus_queue.cc:1048] T cb766527c41242e0ab211622b1f0e268 P ba142a6ed214425084a138399cc5f489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:31.712363 13268 raft_consensus.cc:1275] T cb766527c41242e0ab211622b1f0e268 P b2e22ffd8266454f91a45727bd098a92 [term 3 FOLLOWER]: Refusing update from remote peer ba142a6ed214425084a138399cc5f489: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:31.714222 13520 consensus_queue.cc:1048] T cb766527c41242e0ab211622b1f0e268 P ba142a6ed214425084a138399cc5f489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:08:31.787606 13121 raft_consensus.cc:1275] T 8211beafbf81439d8629834dbbb3a6b9 P ba142a6ed214425084a138399cc5f489 [term 3 FOLLOWER]: Refusing update from remote peer b2e22ffd8266454f91a45727bd098a92: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:31.789427 13477 consensus_queue.cc:1048] T 8211beafbf81439d8629834dbbb3a6b9 P b2e22ffd8266454f91a45727bd098a92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:08:31.803364 13196 raft_consensus.cc:1275] T 8211beafbf81439d8629834dbbb3a6b9 P 8f34a4731ec24146b05167572a79008f [term 3 FOLLOWER]: Refusing update from remote peer b2e22ffd8266454f91a45727bd098a92: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:31.805377 13506 consensus_queue.cc:1048] T 8211beafbf81439d8629834dbbb3a6b9 P b2e22ffd8266454f91a45727bd098a92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:08:31.967657 13196 raft_consensus.cc:1275] T db4772bfddd848238ef081fec351b1c9 P 8f34a4731ec24146b05167572a79008f [term 4 FOLLOWER]: Refusing update from remote peer b2e22ffd8266454f91a45727bd098a92: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:08:31.967911 13121 raft_consensus.cc:1275] T db4772bfddd848238ef081fec351b1c9 P ba142a6ed214425084a138399cc5f489 [term 4 FOLLOWER]: Refusing update from remote peer b2e22ffd8266454f91a45727bd098a92: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:08:31.969600 13525 consensus_queue.cc:1048] T db4772bfddd848238ef081fec351b1c9 P b2e22ffd8266454f91a45727bd098a92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:08:31.970665 13506 consensus_queue.cc:1048] T db4772bfddd848238ef081fec351b1c9 P b2e22ffd8266454f91a45727bd098a92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba142a6ed214425084a138399cc5f489" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 36937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:08:32.025565 13196 raft_consensus.cc:1275] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P 8f34a4731ec24146b05167572a79008f [term 4 FOLLOWER]: Refusing update from remote peer ba142a6ed214425084a138399cc5f489: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:08:32.027927 13504 consensus_queue.cc:1048] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P ba142a6ed214425084a138399cc5f489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:08:32.030213 13268 raft_consensus.cc:1275] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P b2e22ffd8266454f91a45727bd098a92 [term 4 FOLLOWER]: Refusing update from remote peer ba142a6ed214425084a138399cc5f489: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:08:32.031841 13504 consensus_queue.cc:1048] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P ba142a6ed214425084a138399cc5f489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:08:32.041756 13268 raft_consensus.cc:1275] T 848ce1d9265c4134bcef148a91744c7c P b2e22ffd8266454f91a45727bd098a92 [term 3 FOLLOWER]: Refusing update from remote peer ba142a6ed214425084a138399cc5f489: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:32.043646 13504 consensus_queue.cc:1048] T 848ce1d9265c4134bcef148a91744c7c P ba142a6ed214425084a138399cc5f489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2e22ffd8266454f91a45727bd098a92" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:08:32.051313 13196 raft_consensus.cc:1275] T 848ce1d9265c4134bcef148a91744c7c P 8f34a4731ec24146b05167572a79008f [term 3 FOLLOWER]: Refusing update from remote peer ba142a6ed214425084a138399cc5f489: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:32.052888 13504 consensus_queue.cc:1048] T 848ce1d9265c4134bcef148a91744c7c P ba142a6ed214425084a138399cc5f489 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f34a4731ec24146b05167572a79008f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:32.207095 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:32.214371 12986 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:32.214943 12986 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:33.216235 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:33.222800 12986 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:33.223277 12986 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:34.224444 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:34.230330 12986 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:34.230783 12986 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:35.232007 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:35.238457 12986 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:35.239112 12986 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:36.240365 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:36.245680 12986 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:36.246116 12986 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:37.247575 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:37.254585 12986 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:37.255024 12986 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:38.256558 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:38.261801 12986 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:38.262261 12986 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:39.263420 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:39.268735 12986 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:39.269204 12986 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:40.270430 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:40.275430 12986 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:40.275905 12986 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:41.315565 12986 auto_leader_rebalancer-test.cc:340] The leader distribution is 
I20260709 12:08:41.316357 12986 tablet_server.cc:179] TabletServer@127.12.174.129:0 shutting down...
I20260709 12:08:41.348522 12986 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:08:41.349328 12986 tablet_replica.cc:333] T 848ce1d9265c4134bcef148a91744c7c P ba142a6ed214425084a138399cc5f489: stopping tablet replica
I20260709 12:08:41.350188 12986 raft_consensus.cc:2243] T 848ce1d9265c4134bcef148a91744c7c P ba142a6ed214425084a138399cc5f489 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:08:41.351222 12986 raft_consensus.cc:2272] T 848ce1d9265c4134bcef148a91744c7c P ba142a6ed214425084a138399cc5f489 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:41.353777 12986 tablet_replica.cc:333] T cb766527c41242e0ab211622b1f0e268 P ba142a6ed214425084a138399cc5f489: stopping tablet replica
I20260709 12:08:41.354439 12986 raft_consensus.cc:2243] T cb766527c41242e0ab211622b1f0e268 P ba142a6ed214425084a138399cc5f489 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:08:41.355383 12986 raft_consensus.cc:2272] T cb766527c41242e0ab211622b1f0e268 P ba142a6ed214425084a138399cc5f489 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:08:41.357049 13236 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:08:41.357479 12986 tablet_replica.cc:333] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P ba142a6ed214425084a138399cc5f489: stopping tablet replica
I20260709 12:08:41.358168 12986 raft_consensus.cc:2243] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P ba142a6ed214425084a138399cc5f489 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:08:41.359146 12986 raft_consensus.cc:2272] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P ba142a6ed214425084a138399cc5f489 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:08:41.360538 13236 consensus_peers.cc:597] T ad2b770d07aa404ca5c89bdf309b08f9 P b2e22ffd8266454f91a45727bd098a92 -> Peer ba142a6ed214425084a138399cc5f489 (127.12.174.129:36937): Couldn't send request to peer ba142a6ed214425084a138399cc5f489. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:08:41.361192 12986 tablet_replica.cc:333] T db4772bfddd848238ef081fec351b1c9 P ba142a6ed214425084a138399cc5f489: stopping tablet replica
I20260709 12:08:41.361778 12986 raft_consensus.cc:2243] T db4772bfddd848238ef081fec351b1c9 P ba142a6ed214425084a138399cc5f489 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:41.362404 12986 raft_consensus.cc:2272] T db4772bfddd848238ef081fec351b1c9 P ba142a6ed214425084a138399cc5f489 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:41.365245 12986 tablet_replica.cc:333] T ad2b770d07aa404ca5c89bdf309b08f9 P ba142a6ed214425084a138399cc5f489: stopping tablet replica
I20260709 12:08:41.365893 12986 raft_consensus.cc:2243] T ad2b770d07aa404ca5c89bdf309b08f9 P ba142a6ed214425084a138399cc5f489 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:41.366343 12986 raft_consensus.cc:2272] T ad2b770d07aa404ca5c89bdf309b08f9 P ba142a6ed214425084a138399cc5f489 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:41.368191 12986 tablet_replica.cc:333] T d5f3329ccf5b4ebf87e0eb8dc143b5d9 P ba142a6ed214425084a138399cc5f489: stopping tablet replica
I20260709 12:08:41.368680 12986 raft_consensus.cc:2243] T d5f3329ccf5b4ebf87e0eb8dc143b5d9 P ba142a6ed214425084a138399cc5f489 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:41.369098 12986 raft_consensus.cc:2272] T d5f3329ccf5b4ebf87e0eb8dc143b5d9 P ba142a6ed214425084a138399cc5f489 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:41.371097 12986 tablet_replica.cc:333] T 15a6902d3ade4230a51ed07fb1663a27 P ba142a6ed214425084a138399cc5f489: stopping tablet replica
I20260709 12:08:41.371563 12986 raft_consensus.cc:2243] T 15a6902d3ade4230a51ed07fb1663a27 P ba142a6ed214425084a138399cc5f489 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:41.371959 12986 raft_consensus.cc:2272] T 15a6902d3ade4230a51ed07fb1663a27 P ba142a6ed214425084a138399cc5f489 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:41.373840 12986 tablet_replica.cc:333] T 3ff6b11516e44942a67136b30bc48aa1 P ba142a6ed214425084a138399cc5f489: stopping tablet replica
I20260709 12:08:41.374339 12986 raft_consensus.cc:2243] T 3ff6b11516e44942a67136b30bc48aa1 P ba142a6ed214425084a138399cc5f489 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:41.374747 12986 raft_consensus.cc:2272] T 3ff6b11516e44942a67136b30bc48aa1 P ba142a6ed214425084a138399cc5f489 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:41.376593 12986 tablet_replica.cc:333] T 8211beafbf81439d8629834dbbb3a6b9 P ba142a6ed214425084a138399cc5f489: stopping tablet replica
I20260709 12:08:41.377156 12986 raft_consensus.cc:2243] T 8211beafbf81439d8629834dbbb3a6b9 P ba142a6ed214425084a138399cc5f489 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:41.377590 12986 raft_consensus.cc:2272] T 8211beafbf81439d8629834dbbb3a6b9 P ba142a6ed214425084a138399cc5f489 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:41.483628 12986 tablet_server.cc:196] TabletServer@127.12.174.129:0 shutdown complete.
W20260709 12:08:41.485339 13162 consensus_peers.cc:597] T 3ff6b11516e44942a67136b30bc48aa1 P 8f34a4731ec24146b05167572a79008f -> Peer ba142a6ed214425084a138399cc5f489 (127.12.174.129:36937): Couldn't send request to peer ba142a6ed214425084a138399cc5f489. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:36937: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:08:41.505630 12986 tablet_server.cc:179] TabletServer@127.12.174.130:0 shutting down...
I20260709 12:08:41.531236 12986 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:08:41.531898 12986 tablet_replica.cc:333] T 848ce1d9265c4134bcef148a91744c7c P 8f34a4731ec24146b05167572a79008f: stopping tablet replica
I20260709 12:08:41.532552 12986 raft_consensus.cc:2243] T 848ce1d9265c4134bcef148a91744c7c P 8f34a4731ec24146b05167572a79008f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:41.533071 12986 raft_consensus.cc:2272] T 848ce1d9265c4134bcef148a91744c7c P 8f34a4731ec24146b05167572a79008f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:41.535279 12986 tablet_replica.cc:333] T 15a6902d3ade4230a51ed07fb1663a27 P 8f34a4731ec24146b05167572a79008f: stopping tablet replica
I20260709 12:08:41.535843 12986 raft_consensus.cc:2243] T 15a6902d3ade4230a51ed07fb1663a27 P 8f34a4731ec24146b05167572a79008f [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:08:41.536707 12986 raft_consensus.cc:2272] T 15a6902d3ade4230a51ed07fb1663a27 P 8f34a4731ec24146b05167572a79008f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:41.538548 12986 tablet_replica.cc:333] T 3ff6b11516e44942a67136b30bc48aa1 P 8f34a4731ec24146b05167572a79008f: stopping tablet replica
I20260709 12:08:41.539053 12986 raft_consensus.cc:2243] T 3ff6b11516e44942a67136b30bc48aa1 P 8f34a4731ec24146b05167572a79008f [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:08:41.539933 12986 raft_consensus.cc:2272] T 3ff6b11516e44942a67136b30bc48aa1 P 8f34a4731ec24146b05167572a79008f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:41.541805 12986 tablet_replica.cc:333] T 8211beafbf81439d8629834dbbb3a6b9 P 8f34a4731ec24146b05167572a79008f: stopping tablet replica
I20260709 12:08:41.542340 12986 raft_consensus.cc:2243] T 8211beafbf81439d8629834dbbb3a6b9 P 8f34a4731ec24146b05167572a79008f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:41.542768 12986 raft_consensus.cc:2272] T 8211beafbf81439d8629834dbbb3a6b9 P 8f34a4731ec24146b05167572a79008f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:41.544662 12986 tablet_replica.cc:333] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P 8f34a4731ec24146b05167572a79008f: stopping tablet replica
I20260709 12:08:41.545193 12986 raft_consensus.cc:2243] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P 8f34a4731ec24146b05167572a79008f [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:41.545603 12986 raft_consensus.cc:2272] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P 8f34a4731ec24146b05167572a79008f [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:41.547354 12986 tablet_replica.cc:333] T cb766527c41242e0ab211622b1f0e268 P 8f34a4731ec24146b05167572a79008f: stopping tablet replica
I20260709 12:08:41.547874 12986 raft_consensus.cc:2243] T cb766527c41242e0ab211622b1f0e268 P 8f34a4731ec24146b05167572a79008f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:41.548296 12986 raft_consensus.cc:2272] T cb766527c41242e0ab211622b1f0e268 P 8f34a4731ec24146b05167572a79008f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:41.550149 12986 tablet_replica.cc:333] T ad2b770d07aa404ca5c89bdf309b08f9 P 8f34a4731ec24146b05167572a79008f: stopping tablet replica
I20260709 12:08:41.550632 12986 raft_consensus.cc:2243] T ad2b770d07aa404ca5c89bdf309b08f9 P 8f34a4731ec24146b05167572a79008f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:41.551069 12986 raft_consensus.cc:2272] T ad2b770d07aa404ca5c89bdf309b08f9 P 8f34a4731ec24146b05167572a79008f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:41.552853 12986 tablet_replica.cc:333] T db4772bfddd848238ef081fec351b1c9 P 8f34a4731ec24146b05167572a79008f: stopping tablet replica
I20260709 12:08:41.553332 12986 raft_consensus.cc:2243] T db4772bfddd848238ef081fec351b1c9 P 8f34a4731ec24146b05167572a79008f [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:41.553790 12986 raft_consensus.cc:2272] T db4772bfddd848238ef081fec351b1c9 P 8f34a4731ec24146b05167572a79008f [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:41.555459 12986 tablet_replica.cc:333] T d5f3329ccf5b4ebf87e0eb8dc143b5d9 P 8f34a4731ec24146b05167572a79008f: stopping tablet replica
I20260709 12:08:41.555902 12986 raft_consensus.cc:2243] T d5f3329ccf5b4ebf87e0eb8dc143b5d9 P 8f34a4731ec24146b05167572a79008f [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:08:41.556718 12986 raft_consensus.cc:2272] T d5f3329ccf5b4ebf87e0eb8dc143b5d9 P 8f34a4731ec24146b05167572a79008f [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:08:41.563019 13235 consensus_peers.cc:597] T 8211beafbf81439d8629834dbbb3a6b9 P b2e22ffd8266454f91a45727bd098a92 -> Peer 8f34a4731ec24146b05167572a79008f (127.12.174.130:45431): Couldn't send request to peer 8f34a4731ec24146b05167572a79008f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:08:41.587821 12986 tablet_server.cc:196] TabletServer@127.12.174.130:0 shutdown complete.
I20260709 12:08:41.608438 12986 tablet_server.cc:179] TabletServer@127.12.174.131:0 shutting down...
I20260709 12:08:41.631669 12986 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:08:41.632332 12986 tablet_replica.cc:333] T d5f3329ccf5b4ebf87e0eb8dc143b5d9 P b2e22ffd8266454f91a45727bd098a92: stopping tablet replica
I20260709 12:08:41.632979 12986 raft_consensus.cc:2243] T d5f3329ccf5b4ebf87e0eb8dc143b5d9 P b2e22ffd8266454f91a45727bd098a92 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:41.633493 12986 raft_consensus.cc:2272] T d5f3329ccf5b4ebf87e0eb8dc143b5d9 P b2e22ffd8266454f91a45727bd098a92 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:41.635535 12986 tablet_replica.cc:333] T 848ce1d9265c4134bcef148a91744c7c P b2e22ffd8266454f91a45727bd098a92: stopping tablet replica
I20260709 12:08:41.636080 12986 raft_consensus.cc:2243] T 848ce1d9265c4134bcef148a91744c7c P b2e22ffd8266454f91a45727bd098a92 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:41.636539 12986 raft_consensus.cc:2272] T 848ce1d9265c4134bcef148a91744c7c P b2e22ffd8266454f91a45727bd098a92 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:41.638374 12986 tablet_replica.cc:333] T db4772bfddd848238ef081fec351b1c9 P b2e22ffd8266454f91a45727bd098a92: stopping tablet replica
I20260709 12:08:41.638918 12986 raft_consensus.cc:2243] T db4772bfddd848238ef081fec351b1c9 P b2e22ffd8266454f91a45727bd098a92 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:08:41.639755 12986 raft_consensus.cc:2272] T db4772bfddd848238ef081fec351b1c9 P b2e22ffd8266454f91a45727bd098a92 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:41.641551 12986 tablet_replica.cc:333] T ad2b770d07aa404ca5c89bdf309b08f9 P b2e22ffd8266454f91a45727bd098a92: stopping tablet replica
I20260709 12:08:41.642133 12986 raft_consensus.cc:2243] T ad2b770d07aa404ca5c89bdf309b08f9 P b2e22ffd8266454f91a45727bd098a92 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:08:41.642984 12986 raft_consensus.cc:2272] T ad2b770d07aa404ca5c89bdf309b08f9 P b2e22ffd8266454f91a45727bd098a92 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:41.644809 12986 tablet_replica.cc:333] T 15a6902d3ade4230a51ed07fb1663a27 P b2e22ffd8266454f91a45727bd098a92: stopping tablet replica
I20260709 12:08:41.645509 12986 raft_consensus.cc:2243] T 15a6902d3ade4230a51ed07fb1663a27 P b2e22ffd8266454f91a45727bd098a92 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:41.645965 12986 raft_consensus.cc:2272] T 15a6902d3ade4230a51ed07fb1663a27 P b2e22ffd8266454f91a45727bd098a92 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:41.647745 12986 tablet_replica.cc:333] T 3ff6b11516e44942a67136b30bc48aa1 P b2e22ffd8266454f91a45727bd098a92: stopping tablet replica
I20260709 12:08:41.648257 12986 raft_consensus.cc:2243] T 3ff6b11516e44942a67136b30bc48aa1 P b2e22ffd8266454f91a45727bd098a92 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:41.648689 12986 raft_consensus.cc:2272] T 3ff6b11516e44942a67136b30bc48aa1 P b2e22ffd8266454f91a45727bd098a92 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:41.650482 12986 tablet_replica.cc:333] T 8211beafbf81439d8629834dbbb3a6b9 P b2e22ffd8266454f91a45727bd098a92: stopping tablet replica
I20260709 12:08:41.650965 12986 raft_consensus.cc:2243] T 8211beafbf81439d8629834dbbb3a6b9 P b2e22ffd8266454f91a45727bd098a92 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:08:41.651841 12986 raft_consensus.cc:2272] T 8211beafbf81439d8629834dbbb3a6b9 P b2e22ffd8266454f91a45727bd098a92 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:41.653594 12986 tablet_replica.cc:333] T cb766527c41242e0ab211622b1f0e268 P b2e22ffd8266454f91a45727bd098a92: stopping tablet replica
I20260709 12:08:41.654075 12986 raft_consensus.cc:2243] T cb766527c41242e0ab211622b1f0e268 P b2e22ffd8266454f91a45727bd098a92 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:41.654485 12986 raft_consensus.cc:2272] T cb766527c41242e0ab211622b1f0e268 P b2e22ffd8266454f91a45727bd098a92 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:41.656246 12986 tablet_replica.cc:333] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P b2e22ffd8266454f91a45727bd098a92: stopping tablet replica
I20260709 12:08:41.656694 12986 raft_consensus.cc:2243] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P b2e22ffd8266454f91a45727bd098a92 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:41.657112 12986 raft_consensus.cc:2272] T 6a73bb3cf9eb4b4484c76c5ef49859f0 P b2e22ffd8266454f91a45727bd098a92 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:41.710225 12986 tablet_server.cc:196] TabletServer@127.12.174.131:0 shutdown complete.
I20260709 12:08:41.730288 12986 master.cc:562] Master@127.12.174.190:35713 shutting down...
I20260709 12:08:41.946651 12986 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 25527fcd02554e7f8fd5a6c77edc5a83 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:08:41.947302 12986 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 25527fcd02554e7f8fd5a6c77edc5a83 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:41.947666 12986 tablet_replica.cc:333] T 00000000000000000000000000000000 P 25527fcd02554e7f8fd5a6c77edc5a83: stopping tablet replica
I20260709 12:08:41.967214 12986 master.cc:584] Master@127.12.174.190:35713 shutdown complete.
8f34a4731ec24146b05167572a79008f  4
b2e22ffd8266454f91a45727bd098a92  1
ba142a6ed214425084a138399cc5f489  4
8f34a4731ec24146b05167572a79008f  3
b2e22ffd8266454f91a45727bd098a92  3
ba142a6ed214425084a138399cc5f489  3
8f34a4731ec24146b05167572a79008f  8
b2e22ffd8266454f91a45727bd098a92  1
ba142a6ed214425084a138399cc5f489  0
8f34a4731ec24146b05167572a79008f  3
b2e22ffd8266454f91a45727bd098a92  3
ba142a6ed214425084a138399cc5f489  3
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (35605 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 12:08:42.010739 12986 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.12.174.190:44819
I20260709 12:08:42.011947 12986 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:08:42.017774 13545 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:42.017884 13546 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:42.024859 13548 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:42.025226 12986 server_base.cc:1061] running on GCE node
I20260709 12:08:42.026428 12986 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:08:42.026618 12986 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:08:42.026782 12986 hybrid_clock.cc:648] HybridClock initialized: now 1783598922026763 us; error 0 us; skew 500 ppm
I20260709 12:08:42.027340 12986 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:08:42.030411 12986 webserver.cc:533] Webserver started at http://127.12.174.190:32941/ using document root <none> and password file <none>
I20260709 12:08:42.030939 12986 fs_manager.cc:362] Metadata directory not provided
I20260709 12:08:42.031124 12986 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:08:42.031399 12986 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:08:42.032812 12986 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598886212958-12986-0/minicluster-data/master-0-root/instance:
uuid: "c540a9111b00450cb580b92db6199316"
format_stamp: "Formatted at 2026-07-09 12:08:42 on dist-test-slave-9q7n"
I20260709 12:08:42.037665 12986 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.001s
I20260709 12:08:42.041404 13553 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:42.042248 12986 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:08:42.042560 12986 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598886212958-12986-0/minicluster-data/master-0-root
uuid: "c540a9111b00450cb580b92db6199316"
format_stamp: "Formatted at 2026-07-09 12:08:42 on dist-test-slave-9q7n"
I20260709 12:08:42.042847 12986 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598886212958-12986-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598886212958-12986-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598886212958-12986-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:08:42.059805 12986 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:08:42.061184 12986 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:08:42.104143 12986 rpc_server.cc:307] RPC server started. Bound to: 127.12.174.190:44819
I20260709 12:08:42.104264 13605 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.174.190:44819 every 8 connection(s)
I20260709 12:08:42.108207 13606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:42.119387 13606 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c540a9111b00450cb580b92db6199316: Bootstrap starting.
I20260709 12:08:42.124580 13606 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c540a9111b00450cb580b92db6199316: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:42.129179 13606 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c540a9111b00450cb580b92db6199316: No bootstrap required, opened a new log
I20260709 12:08:42.131992 13606 raft_consensus.cc:359] T 00000000000000000000000000000000 P c540a9111b00450cb580b92db6199316 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c540a9111b00450cb580b92db6199316" member_type: VOTER }
I20260709 12:08:42.132486 13606 raft_consensus.cc:385] T 00000000000000000000000000000000 P c540a9111b00450cb580b92db6199316 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:42.132682 13606 raft_consensus.cc:740] T 00000000000000000000000000000000 P c540a9111b00450cb580b92db6199316 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c540a9111b00450cb580b92db6199316, State: Initialized, Role: FOLLOWER
I20260709 12:08:42.133414 13606 consensus_queue.cc:260] T 00000000000000000000000000000000 P c540a9111b00450cb580b92db6199316 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c540a9111b00450cb580b92db6199316" member_type: VOTER }
I20260709 12:08:42.133934 13606 raft_consensus.cc:399] T 00000000000000000000000000000000 P c540a9111b00450cb580b92db6199316 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:08:42.134145 13606 raft_consensus.cc:493] T 00000000000000000000000000000000 P c540a9111b00450cb580b92db6199316 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:08:42.134356 13606 raft_consensus.cc:3060] T 00000000000000000000000000000000 P c540a9111b00450cb580b92db6199316 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:42.139017 13606 raft_consensus.cc:515] T 00000000000000000000000000000000 P c540a9111b00450cb580b92db6199316 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c540a9111b00450cb580b92db6199316" member_type: VOTER }
I20260709 12:08:42.139571 13606 leader_election.cc:304] T 00000000000000000000000000000000 P c540a9111b00450cb580b92db6199316 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c540a9111b00450cb580b92db6199316; no voters: 
I20260709 12:08:42.140759 13606 leader_election.cc:290] T 00000000000000000000000000000000 P c540a9111b00450cb580b92db6199316 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:08:42.141239 13609 raft_consensus.cc:2804] T 00000000000000000000000000000000 P c540a9111b00450cb580b92db6199316 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:42.142613 13609 raft_consensus.cc:697] T 00000000000000000000000000000000 P c540a9111b00450cb580b92db6199316 [term 1 LEADER]: Becoming Leader. State: Replica: c540a9111b00450cb580b92db6199316, State: Running, Role: LEADER
I20260709 12:08:42.143392 13609 consensus_queue.cc:237] T 00000000000000000000000000000000 P c540a9111b00450cb580b92db6199316 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c540a9111b00450cb580b92db6199316" member_type: VOTER }
I20260709 12:08:42.144124 13606 sys_catalog.cc:565] T 00000000000000000000000000000000 P c540a9111b00450cb580b92db6199316 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:08:42.148599 13611 sys_catalog.cc:455] T 00000000000000000000000000000000 P c540a9111b00450cb580b92db6199316 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c540a9111b00450cb580b92db6199316. Latest consensus state: current_term: 1 leader_uuid: "c540a9111b00450cb580b92db6199316" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c540a9111b00450cb580b92db6199316" member_type: VOTER } }
I20260709 12:08:42.148509 13610 sys_catalog.cc:455] T 00000000000000000000000000000000 P c540a9111b00450cb580b92db6199316 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c540a9111b00450cb580b92db6199316" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c540a9111b00450cb580b92db6199316" member_type: VOTER } }
I20260709 12:08:42.149367 13611 sys_catalog.cc:458] T 00000000000000000000000000000000 P c540a9111b00450cb580b92db6199316 [sys.catalog]: This master's current role is: LEADER
I20260709 12:08:42.149441 13610 sys_catalog.cc:458] T 00000000000000000000000000000000 P c540a9111b00450cb580b92db6199316 [sys.catalog]: This master's current role is: LEADER
I20260709 12:08:42.152136 13617 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:08:42.158382 13617 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:08:42.164404 12986 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:08:42.168738 13617 catalog_manager.cc:1383] Generated new cluster ID: 2ce961c1fec644b782237920d4ae365e
I20260709 12:08:42.169003 13617 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:08:42.201472 13617 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:08:42.202781 13617 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:08:42.218186 13617 catalog_manager.cc:6070] T 00000000000000000000000000000000 P c540a9111b00450cb580b92db6199316: Generated new TSK 0
I20260709 12:08:42.218791 13617 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:08:42.232422 12986 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:08:42.239261 13627 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:42.240113 13628 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:42.241968 13630 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:42.243069 12986 server_base.cc:1061] running on GCE node
I20260709 12:08:42.244105 12986 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:08:42.244311 12986 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:08:42.244485 12986 hybrid_clock.cc:648] HybridClock initialized: now 1783598922244448 us; error 0 us; skew 500 ppm
I20260709 12:08:42.245019 12986 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:08:42.247800 12986 webserver.cc:533] Webserver started at http://127.12.174.129:33171/ using document root <none> and password file <none>
I20260709 12:08:42.248520 12986 fs_manager.cc:362] Metadata directory not provided
I20260709 12:08:42.248739 12986 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:08:42.249212 12986 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:08:42.250576 12986 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598886212958-12986-0/minicluster-data/ts-0-root/instance:
uuid: "d148369c73aa4cd59e17f9d5a0b6c181"
format_stamp: "Formatted at 2026-07-09 12:08:42 on dist-test-slave-9q7n"
I20260709 12:08:42.256208 12986 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.003s	sys 0.003s
I20260709 12:08:42.260123 13635 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:42.260902 12986 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:08:42.261232 12986 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598886212958-12986-0/minicluster-data/ts-0-root
uuid: "d148369c73aa4cd59e17f9d5a0b6c181"
format_stamp: "Formatted at 2026-07-09 12:08:42 on dist-test-slave-9q7n"
I20260709 12:08:42.261507 12986 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598886212958-12986-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598886212958-12986-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598886212958-12986-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:08:42.275106 12986 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:08:42.276469 12986 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:08:42.278113 12986 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:08:42.280666 12986 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:08:42.280900 12986 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:42.281157 12986 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:08:42.281333 12986 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:42.326071 12986 rpc_server.cc:307] RPC server started. Bound to: 127.12.174.129:37737
I20260709 12:08:42.326169 13697 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.174.129:37737 every 8 connection(s)
I20260709 12:08:42.331391 12986 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:08:42.341820 13703 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:42.341959 13702 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:42.350525 13705 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:42.351171 12986 server_base.cc:1061] running on GCE node
I20260709 12:08:42.352476 12986 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:08:42.352684 12986 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:08:42.352854 12986 hybrid_clock.cc:648] HybridClock initialized: now 1783598922352837 us; error 0 us; skew 500 ppm
I20260709 12:08:42.353375 12986 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:08:42.356479 12986 webserver.cc:533] Webserver started at http://127.12.174.130:41459/ using document root <none> and password file <none>
I20260709 12:08:42.357120 12986 fs_manager.cc:362] Metadata directory not provided
I20260709 12:08:42.357314 12986 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:08:42.357659 12986 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:08:42.357802 13698 heartbeater.cc:344] Connected to a master server at 127.12.174.190:44819
I20260709 12:08:42.358273 13698 heartbeater.cc:461] Registering TS with master...
I20260709 12:08:42.359215 13698 heartbeater.cc:507] Master 127.12.174.190:44819 requested a full tablet report, sending...
I20260709 12:08:42.359323 12986 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598886212958-12986-0/minicluster-data/ts-1-root/instance:
uuid: "056f6a42190a46df97a5104db44e9d64"
format_stamp: "Formatted at 2026-07-09 12:08:42 on dist-test-slave-9q7n"
I20260709 12:08:42.361611 13570 ts_manager.cc:194] Registered new tserver with Master: d148369c73aa4cd59e17f9d5a0b6c181 (127.12.174.129:37737)
I20260709 12:08:42.363624 13570 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51616
I20260709 12:08:42.364801 12986 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:08:42.368968 13710 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:42.369831 12986 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:08:42.370107 12986 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598886212958-12986-0/minicluster-data/ts-1-root
uuid: "056f6a42190a46df97a5104db44e9d64"
format_stamp: "Formatted at 2026-07-09 12:08:42 on dist-test-slave-9q7n"
I20260709 12:08:42.370365 12986 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598886212958-12986-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598886212958-12986-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598886212958-12986-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:08:42.382194 12986 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:08:42.383535 12986 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:08:42.385088 12986 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:08:42.387461 12986 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:08:42.387653 12986 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:42.387897 12986 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:08:42.388038 12986 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:42.435050 12986 rpc_server.cc:307] RPC server started. Bound to: 127.12.174.130:44237
I20260709 12:08:42.435256 13772 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.174.130:44237 every 8 connection(s)
I20260709 12:08:42.440322 12986 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:08:42.448199 13776 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:42.448899 13777 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:42.452407 13779 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:42.453693 12986 server_base.cc:1061] running on GCE node
I20260709 12:08:42.454742 12986 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:08:42.455016 12986 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:08:42.455204 13773 heartbeater.cc:344] Connected to a master server at 127.12.174.190:44819
I20260709 12:08:42.455240 12986 hybrid_clock.cc:648] HybridClock initialized: now 1783598922455217 us; error 0 us; skew 500 ppm
I20260709 12:08:42.455714 13773 heartbeater.cc:461] Registering TS with master...
I20260709 12:08:42.456060 12986 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:08:42.456525 13773 heartbeater.cc:507] Master 127.12.174.190:44819 requested a full tablet report, sending...
I20260709 12:08:42.458901 12986 webserver.cc:533] Webserver started at http://127.12.174.131:44573/ using document root <none> and password file <none>
I20260709 12:08:42.458922 13570 ts_manager.cc:194] Registered new tserver with Master: 056f6a42190a46df97a5104db44e9d64 (127.12.174.130:44237)
I20260709 12:08:42.459535 12986 fs_manager.cc:362] Metadata directory not provided
I20260709 12:08:42.459771 12986 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:08:42.460033 12986 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:08:42.460803 13570 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51630
I20260709 12:08:42.461323 12986 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598886212958-12986-0/minicluster-data/ts-2-root/instance:
uuid: "4018be520383439497fd4ee03342ed73"
format_stamp: "Formatted at 2026-07-09 12:08:42 on dist-test-slave-9q7n"
I20260709 12:08:42.466455 12986 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.002s
I20260709 12:08:42.469870 13784 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:42.470656 12986 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.002s
I20260709 12:08:42.470975 12986 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598886212958-12986-0/minicluster-data/ts-2-root
uuid: "4018be520383439497fd4ee03342ed73"
format_stamp: "Formatted at 2026-07-09 12:08:42 on dist-test-slave-9q7n"
I20260709 12:08:42.471274 12986 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598886212958-12986-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598886212958-12986-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598886212958-12986-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:08:42.493005 12986 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:08:42.494486 12986 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:08:42.496085 12986 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:08:42.498582 12986 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:08:42.498799 12986 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:42.499017 12986 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:08:42.499183 12986 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:42.542737 12986 rpc_server.cc:307] RPC server started. Bound to: 127.12.174.131:46793
I20260709 12:08:42.542872 13846 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.174.131:46793 every 8 connection(s)
I20260709 12:08:42.557317 13847 heartbeater.cc:344] Connected to a master server at 127.12.174.190:44819
I20260709 12:08:42.557703 13847 heartbeater.cc:461] Registering TS with master...
I20260709 12:08:42.558560 13847 heartbeater.cc:507] Master 127.12.174.190:44819 requested a full tablet report, sending...
I20260709 12:08:42.560559 13570 ts_manager.cc:194] Registered new tserver with Master: 4018be520383439497fd4ee03342ed73 (127.12.174.131:46793)
I20260709 12:08:42.560945 12986 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014740955s
I20260709 12:08:42.562057 13570 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51646
I20260709 12:08:42.587632 13570 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51658:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:08:42.591521 13570 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:08:42.678882 13811 tablet_service.cc:1511] Processing CreateTablet for tablet 1e31988a87d94a7d879cb9552131429d (DEFAULT_TABLE table=test-workload [id=c22cf81762a943368464a452e68b8164]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:08:42.679780 13812 tablet_service.cc:1511] Processing CreateTablet for tablet 10708055ab264a66aadf75fe80ae59f8 (DEFAULT_TABLE table=test-workload [id=c22cf81762a943368464a452e68b8164]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:08:42.680601 13811 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e31988a87d94a7d879cb9552131429d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:42.682202 13809 tablet_service.cc:1511] Processing CreateTablet for tablet 3ba6e60509e5462f984736f50675cd17 (DEFAULT_TABLE table=test-workload [id=c22cf81762a943368464a452e68b8164]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:08:42.682906 13808 tablet_service.cc:1511] Processing CreateTablet for tablet e27355722e7349aaa58d6ed2d707b81f (DEFAULT_TABLE table=test-workload [id=c22cf81762a943368464a452e68b8164]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:08:42.683692 13809 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ba6e60509e5462f984736f50675cd17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:42.685449 13808 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e27355722e7349aaa58d6ed2d707b81f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:42.686301 13807 tablet_service.cc:1511] Processing CreateTablet for tablet 041529b194374c228a48aaee162ec1d9 (DEFAULT_TABLE table=test-workload [id=c22cf81762a943368464a452e68b8164]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:08:42.686951 13810 tablet_service.cc:1511] Processing CreateTablet for tablet 6c145809834e41bea496b130cfda3cac (DEFAULT_TABLE table=test-workload [id=c22cf81762a943368464a452e68b8164]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:08:42.687661 13807 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 041529b194374c228a48aaee162ec1d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:42.688308 13810 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c145809834e41bea496b130cfda3cac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:42.690876 13812 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10708055ab264a66aadf75fe80ae59f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:42.696604 13806 tablet_service.cc:1511] Processing CreateTablet for tablet 089d82b1caf54ee3b23be8f48cb46605 (DEFAULT_TABLE table=test-workload [id=c22cf81762a943368464a452e68b8164]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:08:42.698211 13806 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 089d82b1caf54ee3b23be8f48cb46605. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:42.701133 13663 tablet_service.cc:1511] Processing CreateTablet for tablet 10708055ab264a66aadf75fe80ae59f8 (DEFAULT_TABLE table=test-workload [id=c22cf81762a943368464a452e68b8164]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:08:42.701985 13805 tablet_service.cc:1511] Processing CreateTablet for tablet 27d8fa0b057c4ff09029177a296ce950 (DEFAULT_TABLE table=test-workload [id=c22cf81762a943368464a452e68b8164]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:08:42.702677 13663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10708055ab264a66aadf75fe80ae59f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:42.702378 13662 tablet_service.cc:1511] Processing CreateTablet for tablet 1e31988a87d94a7d879cb9552131429d (DEFAULT_TABLE table=test-workload [id=c22cf81762a943368464a452e68b8164]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:08:42.703397 13805 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27d8fa0b057c4ff09029177a296ce950. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:42.703733 13662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e31988a87d94a7d879cb9552131429d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:42.707051 13661 tablet_service.cc:1511] Processing CreateTablet for tablet 6c145809834e41bea496b130cfda3cac (DEFAULT_TABLE table=test-workload [id=c22cf81762a943368464a452e68b8164]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:08:42.708537 13661 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c145809834e41bea496b130cfda3cac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:42.712543 13736 tablet_service.cc:1511] Processing CreateTablet for tablet 6c145809834e41bea496b130cfda3cac (DEFAULT_TABLE table=test-workload [id=c22cf81762a943368464a452e68b8164]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:08:42.713560 13738 tablet_service.cc:1511] Processing CreateTablet for tablet 10708055ab264a66aadf75fe80ae59f8 (DEFAULT_TABLE table=test-workload [id=c22cf81762a943368464a452e68b8164]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:08:42.714041 13736 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c145809834e41bea496b130cfda3cac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:42.714941 13738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10708055ab264a66aadf75fe80ae59f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:42.716440 13735 tablet_service.cc:1511] Processing CreateTablet for tablet 3ba6e60509e5462f984736f50675cd17 (DEFAULT_TABLE table=test-workload [id=c22cf81762a943368464a452e68b8164]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:08:42.718932 13737 tablet_service.cc:1511] Processing CreateTablet for tablet 1e31988a87d94a7d879cb9552131429d (DEFAULT_TABLE table=test-workload [id=c22cf81762a943368464a452e68b8164]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:08:42.719044 13734 tablet_service.cc:1511] Processing CreateTablet for tablet e27355722e7349aaa58d6ed2d707b81f (DEFAULT_TABLE table=test-workload [id=c22cf81762a943368464a452e68b8164]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:08:42.720988 13733 tablet_service.cc:1511] Processing CreateTablet for tablet 041529b194374c228a48aaee162ec1d9 (DEFAULT_TABLE table=test-workload [id=c22cf81762a943368464a452e68b8164]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:08:42.721557 13804 tablet_service.cc:1511] Processing CreateTablet for tablet 123f6eb9b1504a40a43955ccad371d4d (DEFAULT_TABLE table=test-workload [id=c22cf81762a943368464a452e68b8164]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:08:42.724071 13732 tablet_service.cc:1511] Processing CreateTablet for tablet 089d82b1caf54ee3b23be8f48cb46605 (DEFAULT_TABLE table=test-workload [id=c22cf81762a943368464a452e68b8164]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:08:42.724347 13803 tablet_service.cc:1511] Processing CreateTablet for tablet b3984e1dba884ec19c9eecad67e9487a (DEFAULT_TABLE table=test-workload [id=c22cf81762a943368464a452e68b8164]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:08:42.728499 13660 tablet_service.cc:1511] Processing CreateTablet for tablet 3ba6e60509e5462f984736f50675cd17 (DEFAULT_TABLE table=test-workload [id=c22cf81762a943368464a452e68b8164]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:08:42.729208 13656 tablet_service.cc:1511] Processing CreateTablet for tablet 27d8fa0b057c4ff09029177a296ce950 (DEFAULT_TABLE table=test-workload [id=c22cf81762a943368464a452e68b8164]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:08:42.730089 13735 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ba6e60509e5462f984736f50675cd17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:42.731418 13659 tablet_service.cc:1511] Processing CreateTablet for tablet e27355722e7349aaa58d6ed2d707b81f (DEFAULT_TABLE table=test-workload [id=c22cf81762a943368464a452e68b8164]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:08:42.729981 13660 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ba6e60509e5462f984736f50675cd17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:42.734148 13737 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e31988a87d94a7d879cb9552131429d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:42.735625 13658 tablet_service.cc:1511] Processing CreateTablet for tablet 041529b194374c228a48aaee162ec1d9 (DEFAULT_TABLE table=test-workload [id=c22cf81762a943368464a452e68b8164]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:08:42.736035 13734 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e27355722e7349aaa58d6ed2d707b81f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:42.736297 13657 tablet_service.cc:1511] Processing CreateTablet for tablet 089d82b1caf54ee3b23be8f48cb46605 (DEFAULT_TABLE table=test-workload [id=c22cf81762a943368464a452e68b8164]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:08:42.737085 13732 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 089d82b1caf54ee3b23be8f48cb46605. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:42.731441 13655 tablet_service.cc:1511] Processing CreateTablet for tablet 123f6eb9b1504a40a43955ccad371d4d (DEFAULT_TABLE table=test-workload [id=c22cf81762a943368464a452e68b8164]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:08:42.732671 13654 tablet_service.cc:1511] Processing CreateTablet for tablet b3984e1dba884ec19c9eecad67e9487a (DEFAULT_TABLE table=test-workload [id=c22cf81762a943368464a452e68b8164]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:08:42.739660 13803 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3984e1dba884ec19c9eecad67e9487a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:42.740609 13804 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 123f6eb9b1504a40a43955ccad371d4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:42.742740 13656 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27d8fa0b057c4ff09029177a296ce950. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:42.743316 13731 tablet_service.cc:1511] Processing CreateTablet for tablet 27d8fa0b057c4ff09029177a296ce950 (DEFAULT_TABLE table=test-workload [id=c22cf81762a943368464a452e68b8164]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:08:42.744773 13657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 089d82b1caf54ee3b23be8f48cb46605. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:42.745157 13733 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 041529b194374c228a48aaee162ec1d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:42.745422 13654 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3984e1dba884ec19c9eecad67e9487a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:42.746933 13659 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e27355722e7349aaa58d6ed2d707b81f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:42.747542 13730 tablet_service.cc:1511] Processing CreateTablet for tablet 123f6eb9b1504a40a43955ccad371d4d (DEFAULT_TABLE table=test-workload [id=c22cf81762a943368464a452e68b8164]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:08:42.748564 13655 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 123f6eb9b1504a40a43955ccad371d4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:42.749019 13731 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27d8fa0b057c4ff09029177a296ce950. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:42.751542 13658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 041529b194374c228a48aaee162ec1d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:42.752007 13730 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 123f6eb9b1504a40a43955ccad371d4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:42.756080 13729 tablet_service.cc:1511] Processing CreateTablet for tablet b3984e1dba884ec19c9eecad67e9487a (DEFAULT_TABLE table=test-workload [id=c22cf81762a943368464a452e68b8164]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:08:42.757489 13729 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3984e1dba884ec19c9eecad67e9487a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:42.851524 13863 tablet_bootstrap.cc:492] T 123f6eb9b1504a40a43955ccad371d4d P d148369c73aa4cd59e17f9d5a0b6c181: Bootstrap starting.
I20260709 12:08:42.861989 13862 tablet_bootstrap.cc:492] T e27355722e7349aaa58d6ed2d707b81f P 4018be520383439497fd4ee03342ed73: Bootstrap starting.
I20260709 12:08:42.880693 13864 tablet_bootstrap.cc:492] T 6c145809834e41bea496b130cfda3cac P 056f6a42190a46df97a5104db44e9d64: Bootstrap starting.
I20260709 12:08:42.902907 13862 tablet_bootstrap.cc:654] T e27355722e7349aaa58d6ed2d707b81f P 4018be520383439497fd4ee03342ed73: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:42.940042 13862 tablet_bootstrap.cc:492] T e27355722e7349aaa58d6ed2d707b81f P 4018be520383439497fd4ee03342ed73: No bootstrap required, opened a new log
I20260709 12:08:42.940673 13862 ts_tablet_manager.cc:1403] T e27355722e7349aaa58d6ed2d707b81f P 4018be520383439497fd4ee03342ed73: Time spent bootstrapping tablet: real 0.079s	user 0.019s	sys 0.004s
I20260709 12:08:42.943820 13862 raft_consensus.cc:359] T e27355722e7349aaa58d6ed2d707b81f P 4018be520383439497fd4ee03342ed73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } }
I20260709 12:08:42.944756 13862 raft_consensus.cc:385] T e27355722e7349aaa58d6ed2d707b81f P 4018be520383439497fd4ee03342ed73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:42.945113 13862 raft_consensus.cc:740] T e27355722e7349aaa58d6ed2d707b81f P 4018be520383439497fd4ee03342ed73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4018be520383439497fd4ee03342ed73, State: Initialized, Role: FOLLOWER
I20260709 12:08:42.945566 13864 tablet_bootstrap.cc:654] T 6c145809834e41bea496b130cfda3cac P 056f6a42190a46df97a5104db44e9d64: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:42.946508 13863 tablet_bootstrap.cc:654] T 123f6eb9b1504a40a43955ccad371d4d P d148369c73aa4cd59e17f9d5a0b6c181: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:42.946113 13862 consensus_queue.cc:260] T e27355722e7349aaa58d6ed2d707b81f P 4018be520383439497fd4ee03342ed73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } }
I20260709 12:08:42.949235 13847 heartbeater.cc:499] Master 127.12.174.190:44819 was elected leader, sending a full tablet report...
I20260709 12:08:42.949843 13862 ts_tablet_manager.cc:1434] T e27355722e7349aaa58d6ed2d707b81f P 4018be520383439497fd4ee03342ed73: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:08:42.950906 13862 tablet_bootstrap.cc:492] T 041529b194374c228a48aaee162ec1d9 P 4018be520383439497fd4ee03342ed73: Bootstrap starting.
I20260709 12:08:42.957816 13862 tablet_bootstrap.cc:654] T 041529b194374c228a48aaee162ec1d9 P 4018be520383439497fd4ee03342ed73: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:42.961246 13863 tablet_bootstrap.cc:492] T 123f6eb9b1504a40a43955ccad371d4d P d148369c73aa4cd59e17f9d5a0b6c181: No bootstrap required, opened a new log
I20260709 12:08:42.961890 13863 ts_tablet_manager.cc:1403] T 123f6eb9b1504a40a43955ccad371d4d P d148369c73aa4cd59e17f9d5a0b6c181: Time spent bootstrapping tablet: real 0.111s	user 0.011s	sys 0.003s
I20260709 12:08:42.967897 13863 raft_consensus.cc:359] T 123f6eb9b1504a40a43955ccad371d4d P d148369c73aa4cd59e17f9d5a0b6c181 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } }
I20260709 12:08:42.968755 13863 raft_consensus.cc:385] T 123f6eb9b1504a40a43955ccad371d4d P d148369c73aa4cd59e17f9d5a0b6c181 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:42.969127 13863 raft_consensus.cc:740] T 123f6eb9b1504a40a43955ccad371d4d P d148369c73aa4cd59e17f9d5a0b6c181 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d148369c73aa4cd59e17f9d5a0b6c181, State: Initialized, Role: FOLLOWER
I20260709 12:08:42.970479 13863 consensus_queue.cc:260] T 123f6eb9b1504a40a43955ccad371d4d P d148369c73aa4cd59e17f9d5a0b6c181 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } }
I20260709 12:08:42.974020 13698 heartbeater.cc:499] Master 127.12.174.190:44819 was elected leader, sending a full tablet report...
I20260709 12:08:42.975164 13864 tablet_bootstrap.cc:492] T 6c145809834e41bea496b130cfda3cac P 056f6a42190a46df97a5104db44e9d64: No bootstrap required, opened a new log
I20260709 12:08:42.975662 13864 ts_tablet_manager.cc:1403] T 6c145809834e41bea496b130cfda3cac P 056f6a42190a46df97a5104db44e9d64: Time spent bootstrapping tablet: real 0.097s	user 0.016s	sys 0.017s
I20260709 12:08:42.975117 13863 ts_tablet_manager.cc:1434] T 123f6eb9b1504a40a43955ccad371d4d P d148369c73aa4cd59e17f9d5a0b6c181: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.003s
I20260709 12:08:42.978224 13864 raft_consensus.cc:359] T 6c145809834e41bea496b130cfda3cac P 056f6a42190a46df97a5104db44e9d64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } }
I20260709 12:08:42.978981 13864 raft_consensus.cc:385] T 6c145809834e41bea496b130cfda3cac P 056f6a42190a46df97a5104db44e9d64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:42.979293 13864 raft_consensus.cc:740] T 6c145809834e41bea496b130cfda3cac P 056f6a42190a46df97a5104db44e9d64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 056f6a42190a46df97a5104db44e9d64, State: Initialized, Role: FOLLOWER
I20260709 12:08:42.980063 13864 consensus_queue.cc:260] T 6c145809834e41bea496b130cfda3cac P 056f6a42190a46df97a5104db44e9d64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } }
I20260709 12:08:42.985462 13863 tablet_bootstrap.cc:492] T 10708055ab264a66aadf75fe80ae59f8 P d148369c73aa4cd59e17f9d5a0b6c181: Bootstrap starting.
I20260709 12:08:42.993484 13863 tablet_bootstrap.cc:654] T 10708055ab264a66aadf75fe80ae59f8 P d148369c73aa4cd59e17f9d5a0b6c181: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:42.999931 13773 heartbeater.cc:499] Master 127.12.174.190:44819 was elected leader, sending a full tablet report...
I20260709 12:08:43.000579 13864 ts_tablet_manager.cc:1434] T 6c145809834e41bea496b130cfda3cac P 056f6a42190a46df97a5104db44e9d64: Time spent starting tablet: real 0.025s	user 0.009s	sys 0.015s
I20260709 12:08:43.001655 13864 tablet_bootstrap.cc:492] T 089d82b1caf54ee3b23be8f48cb46605 P 056f6a42190a46df97a5104db44e9d64: Bootstrap starting.
I20260709 12:08:43.002198 13863 tablet_bootstrap.cc:492] T 10708055ab264a66aadf75fe80ae59f8 P d148369c73aa4cd59e17f9d5a0b6c181: No bootstrap required, opened a new log
I20260709 12:08:43.002689 13863 ts_tablet_manager.cc:1403] T 10708055ab264a66aadf75fe80ae59f8 P d148369c73aa4cd59e17f9d5a0b6c181: Time spent bootstrapping tablet: real 0.017s	user 0.004s	sys 0.010s
I20260709 12:08:43.006258 13863 raft_consensus.cc:359] T 10708055ab264a66aadf75fe80ae59f8 P d148369c73aa4cd59e17f9d5a0b6c181 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } } peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } }
I20260709 12:08:43.007091 13863 raft_consensus.cc:385] T 10708055ab264a66aadf75fe80ae59f8 P d148369c73aa4cd59e17f9d5a0b6c181 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:43.007414 13863 raft_consensus.cc:740] T 10708055ab264a66aadf75fe80ae59f8 P d148369c73aa4cd59e17f9d5a0b6c181 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d148369c73aa4cd59e17f9d5a0b6c181, State: Initialized, Role: FOLLOWER
I20260709 12:08:43.007699 13862 tablet_bootstrap.cc:492] T 041529b194374c228a48aaee162ec1d9 P 4018be520383439497fd4ee03342ed73: No bootstrap required, opened a new log
I20260709 12:08:43.008157 13863 consensus_queue.cc:260] T 10708055ab264a66aadf75fe80ae59f8 P d148369c73aa4cd59e17f9d5a0b6c181 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } } peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } }
I20260709 12:08:43.008842 13864 tablet_bootstrap.cc:654] T 089d82b1caf54ee3b23be8f48cb46605 P 056f6a42190a46df97a5104db44e9d64: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:43.010670 13863 ts_tablet_manager.cc:1434] T 10708055ab264a66aadf75fe80ae59f8 P d148369c73aa4cd59e17f9d5a0b6c181: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:08:43.011840 13863 tablet_bootstrap.cc:492] T 1e31988a87d94a7d879cb9552131429d P d148369c73aa4cd59e17f9d5a0b6c181: Bootstrap starting.
I20260709 12:08:43.008203 13862 ts_tablet_manager.cc:1403] T 041529b194374c228a48aaee162ec1d9 P 4018be520383439497fd4ee03342ed73: Time spent bootstrapping tablet: real 0.058s	user 0.011s	sys 0.038s
I20260709 12:08:43.017081 13862 raft_consensus.cc:359] T 041529b194374c228a48aaee162ec1d9 P 4018be520383439497fd4ee03342ed73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } }
I20260709 12:08:43.018193 13862 raft_consensus.cc:385] T 041529b194374c228a48aaee162ec1d9 P 4018be520383439497fd4ee03342ed73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:43.018581 13862 raft_consensus.cc:740] T 041529b194374c228a48aaee162ec1d9 P 4018be520383439497fd4ee03342ed73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4018be520383439497fd4ee03342ed73, State: Initialized, Role: FOLLOWER
I20260709 12:08:43.019294 13863 tablet_bootstrap.cc:654] T 1e31988a87d94a7d879cb9552131429d P d148369c73aa4cd59e17f9d5a0b6c181: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:43.019676 13862 consensus_queue.cc:260] T 041529b194374c228a48aaee162ec1d9 P 4018be520383439497fd4ee03342ed73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } }
I20260709 12:08:43.021338 13864 tablet_bootstrap.cc:492] T 089d82b1caf54ee3b23be8f48cb46605 P 056f6a42190a46df97a5104db44e9d64: No bootstrap required, opened a new log
I20260709 12:08:43.021883 13864 ts_tablet_manager.cc:1403] T 089d82b1caf54ee3b23be8f48cb46605 P 056f6a42190a46df97a5104db44e9d64: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.010s
I20260709 12:08:43.026069 13862 ts_tablet_manager.cc:1434] T 041529b194374c228a48aaee162ec1d9 P 4018be520383439497fd4ee03342ed73: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.002s
I20260709 12:08:43.027222 13862 tablet_bootstrap.cc:492] T 27d8fa0b057c4ff09029177a296ce950 P 4018be520383439497fd4ee03342ed73: Bootstrap starting.
I20260709 12:08:43.026999 13864 raft_consensus.cc:359] T 089d82b1caf54ee3b23be8f48cb46605 P 056f6a42190a46df97a5104db44e9d64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } }
I20260709 12:08:43.027907 13864 raft_consensus.cc:385] T 089d82b1caf54ee3b23be8f48cb46605 P 056f6a42190a46df97a5104db44e9d64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:43.028246 13864 raft_consensus.cc:740] T 089d82b1caf54ee3b23be8f48cb46605 P 056f6a42190a46df97a5104db44e9d64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 056f6a42190a46df97a5104db44e9d64, State: Initialized, Role: FOLLOWER
I20260709 12:08:43.029067 13864 consensus_queue.cc:260] T 089d82b1caf54ee3b23be8f48cb46605 P 056f6a42190a46df97a5104db44e9d64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } }
I20260709 12:08:43.031872 13864 ts_tablet_manager.cc:1434] T 089d82b1caf54ee3b23be8f48cb46605 P 056f6a42190a46df97a5104db44e9d64: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:08:43.033061 13864 tablet_bootstrap.cc:492] T 123f6eb9b1504a40a43955ccad371d4d P 056f6a42190a46df97a5104db44e9d64: Bootstrap starting.
I20260709 12:08:43.034714 13862 tablet_bootstrap.cc:654] T 27d8fa0b057c4ff09029177a296ce950 P 4018be520383439497fd4ee03342ed73: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:43.040825 13864 tablet_bootstrap.cc:654] T 123f6eb9b1504a40a43955ccad371d4d P 056f6a42190a46df97a5104db44e9d64: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:43.044762 13863 tablet_bootstrap.cc:492] T 1e31988a87d94a7d879cb9552131429d P d148369c73aa4cd59e17f9d5a0b6c181: No bootstrap required, opened a new log
I20260709 12:08:43.045114 13862 tablet_bootstrap.cc:492] T 27d8fa0b057c4ff09029177a296ce950 P 4018be520383439497fd4ee03342ed73: No bootstrap required, opened a new log
I20260709 12:08:43.045418 13863 ts_tablet_manager.cc:1403] T 1e31988a87d94a7d879cb9552131429d P d148369c73aa4cd59e17f9d5a0b6c181: Time spent bootstrapping tablet: real 0.034s	user 0.013s	sys 0.020s
I20260709 12:08:43.045889 13862 ts_tablet_manager.cc:1403] T 27d8fa0b057c4ff09029177a296ce950 P 4018be520383439497fd4ee03342ed73: Time spent bootstrapping tablet: real 0.019s	user 0.011s	sys 0.005s
W20260709 12:08:43.047149 13848 tablet.cc:2406] T 041529b194374c228a48aaee162ec1d9 P 4018be520383439497fd4ee03342ed73: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:08:43.049814 13862 raft_consensus.cc:359] T 27d8fa0b057c4ff09029177a296ce950 P 4018be520383439497fd4ee03342ed73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } }
I20260709 12:08:43.050740 13862 raft_consensus.cc:385] T 27d8fa0b057c4ff09029177a296ce950 P 4018be520383439497fd4ee03342ed73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:43.050428 13863 raft_consensus.cc:359] T 1e31988a87d94a7d879cb9552131429d P d148369c73aa4cd59e17f9d5a0b6c181 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } }
I20260709 12:08:43.051100 13862 raft_consensus.cc:740] T 27d8fa0b057c4ff09029177a296ce950 P 4018be520383439497fd4ee03342ed73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4018be520383439497fd4ee03342ed73, State: Initialized, Role: FOLLOWER
I20260709 12:08:43.051388 13863 raft_consensus.cc:385] T 1e31988a87d94a7d879cb9552131429d P d148369c73aa4cd59e17f9d5a0b6c181 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:43.051801 13863 raft_consensus.cc:740] T 1e31988a87d94a7d879cb9552131429d P d148369c73aa4cd59e17f9d5a0b6c181 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d148369c73aa4cd59e17f9d5a0b6c181, State: Initialized, Role: FOLLOWER
I20260709 12:08:43.052191 13862 consensus_queue.cc:260] T 27d8fa0b057c4ff09029177a296ce950 P 4018be520383439497fd4ee03342ed73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } }
I20260709 12:08:43.052608 13863 consensus_queue.cc:260] T 1e31988a87d94a7d879cb9552131429d P d148369c73aa4cd59e17f9d5a0b6c181 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } }
I20260709 12:08:43.055236 13863 ts_tablet_manager.cc:1434] T 1e31988a87d94a7d879cb9552131429d P d148369c73aa4cd59e17f9d5a0b6c181: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.003s
I20260709 12:08:43.056672 13870 raft_consensus.cc:493] T 10708055ab264a66aadf75fe80ae59f8 P d148369c73aa4cd59e17f9d5a0b6c181 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:43.057171 13870 raft_consensus.cc:515] T 10708055ab264a66aadf75fe80ae59f8 P d148369c73aa4cd59e17f9d5a0b6c181 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } } peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } }
I20260709 12:08:43.058427 13862 ts_tablet_manager.cc:1434] T 27d8fa0b057c4ff09029177a296ce950 P 4018be520383439497fd4ee03342ed73: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.001s
I20260709 12:08:43.059686 13862 tablet_bootstrap.cc:492] T 1e31988a87d94a7d879cb9552131429d P 4018be520383439497fd4ee03342ed73: Bootstrap starting.
I20260709 12:08:43.067551 13864 tablet_bootstrap.cc:492] T 123f6eb9b1504a40a43955ccad371d4d P 056f6a42190a46df97a5104db44e9d64: No bootstrap required, opened a new log
I20260709 12:08:43.068248 13864 ts_tablet_manager.cc:1403] T 123f6eb9b1504a40a43955ccad371d4d P 056f6a42190a46df97a5104db44e9d64: Time spent bootstrapping tablet: real 0.035s	user 0.019s	sys 0.014s
I20260709 12:08:43.071027 13870 leader_election.cc:290] T 10708055ab264a66aadf75fe80ae59f8 P d148369c73aa4cd59e17f9d5a0b6c181 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4018be520383439497fd4ee03342ed73 (127.12.174.131:46793), 056f6a42190a46df97a5104db44e9d64 (127.12.174.130:44237)
I20260709 12:08:43.072734 13863 tablet_bootstrap.cc:492] T 6c145809834e41bea496b130cfda3cac P d148369c73aa4cd59e17f9d5a0b6c181: Bootstrap starting.
I20260709 12:08:43.067553 13862 tablet_bootstrap.cc:654] T 1e31988a87d94a7d879cb9552131429d P 4018be520383439497fd4ee03342ed73: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:43.071429 13864 raft_consensus.cc:359] T 123f6eb9b1504a40a43955ccad371d4d P 056f6a42190a46df97a5104db44e9d64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } }
I20260709 12:08:43.080053 13864 raft_consensus.cc:385] T 123f6eb9b1504a40a43955ccad371d4d P 056f6a42190a46df97a5104db44e9d64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:43.080430 13864 raft_consensus.cc:740] T 123f6eb9b1504a40a43955ccad371d4d P 056f6a42190a46df97a5104db44e9d64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 056f6a42190a46df97a5104db44e9d64, State: Initialized, Role: FOLLOWER
I20260709 12:08:43.081260 13864 consensus_queue.cc:260] T 123f6eb9b1504a40a43955ccad371d4d P 056f6a42190a46df97a5104db44e9d64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } }
I20260709 12:08:43.084160 13864 ts_tablet_manager.cc:1434] T 123f6eb9b1504a40a43955ccad371d4d P 056f6a42190a46df97a5104db44e9d64: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 12:08:43.085220 13864 tablet_bootstrap.cc:492] T 041529b194374c228a48aaee162ec1d9 P 056f6a42190a46df97a5104db44e9d64: Bootstrap starting.
I20260709 12:08:43.085498 13862 tablet_bootstrap.cc:492] T 1e31988a87d94a7d879cb9552131429d P 4018be520383439497fd4ee03342ed73: No bootstrap required, opened a new log
I20260709 12:08:43.086053 13862 ts_tablet_manager.cc:1403] T 1e31988a87d94a7d879cb9552131429d P 4018be520383439497fd4ee03342ed73: Time spent bootstrapping tablet: real 0.027s	user 0.007s	sys 0.008s
I20260709 12:08:43.088930 13862 raft_consensus.cc:359] T 1e31988a87d94a7d879cb9552131429d P 4018be520383439497fd4ee03342ed73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } }
I20260709 12:08:43.089665 13862 raft_consensus.cc:385] T 1e31988a87d94a7d879cb9552131429d P 4018be520383439497fd4ee03342ed73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:43.089980 13862 raft_consensus.cc:740] T 1e31988a87d94a7d879cb9552131429d P 4018be520383439497fd4ee03342ed73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4018be520383439497fd4ee03342ed73, State: Initialized, Role: FOLLOWER
I20260709 12:08:43.090746 13862 consensus_queue.cc:260] T 1e31988a87d94a7d879cb9552131429d P 4018be520383439497fd4ee03342ed73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } }
I20260709 12:08:43.092113 13864 tablet_bootstrap.cc:654] T 041529b194374c228a48aaee162ec1d9 P 056f6a42190a46df97a5104db44e9d64: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:43.098707 13862 ts_tablet_manager.cc:1434] T 1e31988a87d94a7d879cb9552131429d P 4018be520383439497fd4ee03342ed73: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:08:43.099023 13863 tablet_bootstrap.cc:654] T 6c145809834e41bea496b130cfda3cac P d148369c73aa4cd59e17f9d5a0b6c181: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:43.099676 13862 tablet_bootstrap.cc:492] T 10708055ab264a66aadf75fe80ae59f8 P 4018be520383439497fd4ee03342ed73: Bootstrap starting.
I20260709 12:08:43.108795 13862 tablet_bootstrap.cc:654] T 10708055ab264a66aadf75fe80ae59f8 P 4018be520383439497fd4ee03342ed73: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:43.109289 13748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10708055ab264a66aadf75fe80ae59f8" candidate_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "056f6a42190a46df97a5104db44e9d64" is_pre_election: true
I20260709 12:08:43.110107 13822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10708055ab264a66aadf75fe80ae59f8" candidate_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4018be520383439497fd4ee03342ed73" is_pre_election: true
W20260709 12:08:43.111155 13636 leader_election.cc:343] T 10708055ab264a66aadf75fe80ae59f8 P d148369c73aa4cd59e17f9d5a0b6c181 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 056f6a42190a46df97a5104db44e9d64 (127.12.174.130:44237): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:08:43.111784 13639 leader_election.cc:343] T 10708055ab264a66aadf75fe80ae59f8 P d148369c73aa4cd59e17f9d5a0b6c181 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4018be520383439497fd4ee03342ed73 (127.12.174.131:46793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:43.112354 13639 leader_election.cc:304] T 10708055ab264a66aadf75fe80ae59f8 P d148369c73aa4cd59e17f9d5a0b6c181 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d148369c73aa4cd59e17f9d5a0b6c181; no voters: 056f6a42190a46df97a5104db44e9d64, 4018be520383439497fd4ee03342ed73
I20260709 12:08:43.113361 13864 tablet_bootstrap.cc:492] T 041529b194374c228a48aaee162ec1d9 P 056f6a42190a46df97a5104db44e9d64: No bootstrap required, opened a new log
I20260709 12:08:43.113502 13870 raft_consensus.cc:2749] T 10708055ab264a66aadf75fe80ae59f8 P d148369c73aa4cd59e17f9d5a0b6c181 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:43.113906 13864 ts_tablet_manager.cc:1403] T 041529b194374c228a48aaee162ec1d9 P 056f6a42190a46df97a5104db44e9d64: Time spent bootstrapping tablet: real 0.029s	user 0.010s	sys 0.016s
I20260709 12:08:43.116822 13862 tablet_bootstrap.cc:492] T 10708055ab264a66aadf75fe80ae59f8 P 4018be520383439497fd4ee03342ed73: No bootstrap required, opened a new log
I20260709 12:08:43.117324 13862 ts_tablet_manager.cc:1403] T 10708055ab264a66aadf75fe80ae59f8 P 4018be520383439497fd4ee03342ed73: Time spent bootstrapping tablet: real 0.018s	user 0.004s	sys 0.010s
I20260709 12:08:43.117093 13864 raft_consensus.cc:359] T 041529b194374c228a48aaee162ec1d9 P 056f6a42190a46df97a5104db44e9d64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } }
I20260709 12:08:43.117791 13864 raft_consensus.cc:385] T 041529b194374c228a48aaee162ec1d9 P 056f6a42190a46df97a5104db44e9d64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:43.118039 13864 raft_consensus.cc:740] T 041529b194374c228a48aaee162ec1d9 P 056f6a42190a46df97a5104db44e9d64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 056f6a42190a46df97a5104db44e9d64, State: Initialized, Role: FOLLOWER
I20260709 12:08:43.118332 13863 tablet_bootstrap.cc:492] T 6c145809834e41bea496b130cfda3cac P d148369c73aa4cd59e17f9d5a0b6c181: No bootstrap required, opened a new log
I20260709 12:08:43.118829 13863 ts_tablet_manager.cc:1403] T 6c145809834e41bea496b130cfda3cac P d148369c73aa4cd59e17f9d5a0b6c181: Time spent bootstrapping tablet: real 0.046s	user 0.016s	sys 0.003s
I20260709 12:08:43.118742 13864 consensus_queue.cc:260] T 041529b194374c228a48aaee162ec1d9 P 056f6a42190a46df97a5104db44e9d64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } }
I20260709 12:08:43.120925 13864 ts_tablet_manager.cc:1434] T 041529b194374c228a48aaee162ec1d9 P 056f6a42190a46df97a5104db44e9d64: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:08:43.120527 13862 raft_consensus.cc:359] T 10708055ab264a66aadf75fe80ae59f8 P 4018be520383439497fd4ee03342ed73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } } peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } }
I20260709 12:08:43.121434 13862 raft_consensus.cc:385] T 10708055ab264a66aadf75fe80ae59f8 P 4018be520383439497fd4ee03342ed73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:43.121788 13862 raft_consensus.cc:740] T 10708055ab264a66aadf75fe80ae59f8 P 4018be520383439497fd4ee03342ed73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4018be520383439497fd4ee03342ed73, State: Initialized, Role: FOLLOWER
I20260709 12:08:43.121984 13864 tablet_bootstrap.cc:492] T 10708055ab264a66aadf75fe80ae59f8 P 056f6a42190a46df97a5104db44e9d64: Bootstrap starting.
I20260709 12:08:43.122083 13863 raft_consensus.cc:359] T 6c145809834e41bea496b130cfda3cac P d148369c73aa4cd59e17f9d5a0b6c181 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } }
I20260709 12:08:43.122874 13863 raft_consensus.cc:385] T 6c145809834e41bea496b130cfda3cac P d148369c73aa4cd59e17f9d5a0b6c181 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:43.123169 13863 raft_consensus.cc:740] T 6c145809834e41bea496b130cfda3cac P d148369c73aa4cd59e17f9d5a0b6c181 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d148369c73aa4cd59e17f9d5a0b6c181, State: Initialized, Role: FOLLOWER
I20260709 12:08:43.123906 13863 consensus_queue.cc:260] T 6c145809834e41bea496b130cfda3cac P d148369c73aa4cd59e17f9d5a0b6c181 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } }
I20260709 12:08:43.126190 13863 ts_tablet_manager.cc:1434] T 6c145809834e41bea496b130cfda3cac P d148369c73aa4cd59e17f9d5a0b6c181: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:08:43.126536 13862 consensus_queue.cc:260] T 10708055ab264a66aadf75fe80ae59f8 P 4018be520383439497fd4ee03342ed73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } } peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } }
I20260709 12:08:43.128168 13864 tablet_bootstrap.cc:654] T 10708055ab264a66aadf75fe80ae59f8 P 056f6a42190a46df97a5104db44e9d64: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:43.128791 13862 ts_tablet_manager.cc:1434] T 10708055ab264a66aadf75fe80ae59f8 P 4018be520383439497fd4ee03342ed73: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:08:43.129307 13871 raft_consensus.cc:493] T 089d82b1caf54ee3b23be8f48cb46605 P 056f6a42190a46df97a5104db44e9d64 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:43.129803 13862 tablet_bootstrap.cc:492] T 6c145809834e41bea496b130cfda3cac P 4018be520383439497fd4ee03342ed73: Bootstrap starting.
I20260709 12:08:43.129896 13871 raft_consensus.cc:515] T 089d82b1caf54ee3b23be8f48cb46605 P 056f6a42190a46df97a5104db44e9d64 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } }
I20260709 12:08:43.132776 13871 leader_election.cc:290] T 089d82b1caf54ee3b23be8f48cb46605 P 056f6a42190a46df97a5104db44e9d64 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d148369c73aa4cd59e17f9d5a0b6c181 (127.12.174.129:37737), 4018be520383439497fd4ee03342ed73 (127.12.174.131:46793)
I20260709 12:08:43.140962 13863 tablet_bootstrap.cc:492] T 089d82b1caf54ee3b23be8f48cb46605 P d148369c73aa4cd59e17f9d5a0b6c181: Bootstrap starting.
I20260709 12:08:43.150988 13862 tablet_bootstrap.cc:654] T 6c145809834e41bea496b130cfda3cac P 4018be520383439497fd4ee03342ed73: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:43.158335 13863 tablet_bootstrap.cc:654] T 089d82b1caf54ee3b23be8f48cb46605 P d148369c73aa4cd59e17f9d5a0b6c181: Neither blocks nor log segments found. Creating new log.
W20260709 12:08:43.158582 13619 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:08:43.161201 13864 tablet_bootstrap.cc:492] T 10708055ab264a66aadf75fe80ae59f8 P 056f6a42190a46df97a5104db44e9d64: No bootstrap required, opened a new log
I20260709 12:08:43.161809 13864 ts_tablet_manager.cc:1403] T 10708055ab264a66aadf75fe80ae59f8 P 056f6a42190a46df97a5104db44e9d64: Time spent bootstrapping tablet: real 0.040s	user 0.019s	sys 0.012s
I20260709 12:08:43.164880 13866 raft_consensus.cc:493] T 1e31988a87d94a7d879cb9552131429d P 4018be520383439497fd4ee03342ed73 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:43.164980 13871 raft_consensus.cc:493] T 6c145809834e41bea496b130cfda3cac P 056f6a42190a46df97a5104db44e9d64 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:43.165156 13864 raft_consensus.cc:359] T 10708055ab264a66aadf75fe80ae59f8 P 056f6a42190a46df97a5104db44e9d64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } } peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } }
I20260709 12:08:43.165444 13866 raft_consensus.cc:515] T 1e31988a87d94a7d879cb9552131429d P 4018be520383439497fd4ee03342ed73 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } }
I20260709 12:08:43.165518 13871 raft_consensus.cc:515] T 6c145809834e41bea496b130cfda3cac P 056f6a42190a46df97a5104db44e9d64 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } }
I20260709 12:08:43.166082 13864 raft_consensus.cc:385] T 10708055ab264a66aadf75fe80ae59f8 P 056f6a42190a46df97a5104db44e9d64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:43.166436 13864 raft_consensus.cc:740] T 10708055ab264a66aadf75fe80ae59f8 P 056f6a42190a46df97a5104db44e9d64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 056f6a42190a46df97a5104db44e9d64, State: Initialized, Role: FOLLOWER
I20260709 12:08:43.167387 13864 consensus_queue.cc:260] T 10708055ab264a66aadf75fe80ae59f8 P 056f6a42190a46df97a5104db44e9d64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } } peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } }
I20260709 12:08:43.167845 13871 leader_election.cc:290] T 6c145809834e41bea496b130cfda3cac P 056f6a42190a46df97a5104db44e9d64 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d148369c73aa4cd59e17f9d5a0b6c181 (127.12.174.129:37737), 4018be520383439497fd4ee03342ed73 (127.12.174.131:46793)
I20260709 12:08:43.173069 13864 ts_tablet_manager.cc:1434] T 10708055ab264a66aadf75fe80ae59f8 P 056f6a42190a46df97a5104db44e9d64: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.001s
I20260709 12:08:43.174723 13864 tablet_bootstrap.cc:492] T 27d8fa0b057c4ff09029177a296ce950 P 056f6a42190a46df97a5104db44e9d64: Bootstrap starting.
I20260709 12:08:43.179772 13866 leader_election.cc:290] T 1e31988a87d94a7d879cb9552131429d P 4018be520383439497fd4ee03342ed73 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d148369c73aa4cd59e17f9d5a0b6c181 (127.12.174.129:37737), 056f6a42190a46df97a5104db44e9d64 (127.12.174.130:44237)
I20260709 12:08:43.181576 13864 tablet_bootstrap.cc:654] T 27d8fa0b057c4ff09029177a296ce950 P 056f6a42190a46df97a5104db44e9d64: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:43.186751 13673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089d82b1caf54ee3b23be8f48cb46605" candidate_uuid: "056f6a42190a46df97a5104db44e9d64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" is_pre_election: true
I20260709 12:08:43.187376 13672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c145809834e41bea496b130cfda3cac" candidate_uuid: "056f6a42190a46df97a5104db44e9d64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" is_pre_election: true
I20260709 12:08:43.187958 13863 tablet_bootstrap.cc:492] T 089d82b1caf54ee3b23be8f48cb46605 P d148369c73aa4cd59e17f9d5a0b6c181: No bootstrap required, opened a new log
I20260709 12:08:43.188130 13672 raft_consensus.cc:2468] T 6c145809834e41bea496b130cfda3cac P d148369c73aa4cd59e17f9d5a0b6c181 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 056f6a42190a46df97a5104db44e9d64 in term 0.
I20260709 12:08:43.188506 13863 ts_tablet_manager.cc:1403] T 089d82b1caf54ee3b23be8f48cb46605 P d148369c73aa4cd59e17f9d5a0b6c181: Time spent bootstrapping tablet: real 0.055s	user 0.025s	sys 0.011s
W20260709 12:08:43.189541 13714 leader_election.cc:343] T 089d82b1caf54ee3b23be8f48cb46605 P 056f6a42190a46df97a5104db44e9d64 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d148369c73aa4cd59e17f9d5a0b6c181 (127.12.174.129:37737): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:43.190344 13714 leader_election.cc:304] T 6c145809834e41bea496b130cfda3cac P 056f6a42190a46df97a5104db44e9d64 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 056f6a42190a46df97a5104db44e9d64, d148369c73aa4cd59e17f9d5a0b6c181; no voters: 
I20260709 12:08:43.191550 13863 raft_consensus.cc:359] T 089d82b1caf54ee3b23be8f48cb46605 P d148369c73aa4cd59e17f9d5a0b6c181 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } }
I20260709 12:08:43.192260 13863 raft_consensus.cc:385] T 089d82b1caf54ee3b23be8f48cb46605 P d148369c73aa4cd59e17f9d5a0b6c181 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:43.192489 13863 raft_consensus.cc:740] T 089d82b1caf54ee3b23be8f48cb46605 P d148369c73aa4cd59e17f9d5a0b6c181 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d148369c73aa4cd59e17f9d5a0b6c181, State: Initialized, Role: FOLLOWER
I20260709 12:08:43.192999 13871 raft_consensus.cc:2804] T 6c145809834e41bea496b130cfda3cac P 056f6a42190a46df97a5104db44e9d64 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:43.193365 13871 raft_consensus.cc:493] T 6c145809834e41bea496b130cfda3cac P 056f6a42190a46df97a5104db44e9d64 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:43.193305 13863 consensus_queue.cc:260] T 089d82b1caf54ee3b23be8f48cb46605 P d148369c73aa4cd59e17f9d5a0b6c181 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } }
I20260709 12:08:43.193890 13871 raft_consensus.cc:3060] T 6c145809834e41bea496b130cfda3cac P 056f6a42190a46df97a5104db44e9d64 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:43.195955 13863 ts_tablet_manager.cc:1434] T 089d82b1caf54ee3b23be8f48cb46605 P d148369c73aa4cd59e17f9d5a0b6c181: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:08:43.196981 13863 tablet_bootstrap.cc:492] T 041529b194374c228a48aaee162ec1d9 P d148369c73aa4cd59e17f9d5a0b6c181: Bootstrap starting.
I20260709 12:08:43.203685 13863 tablet_bootstrap.cc:654] T 041529b194374c228a48aaee162ec1d9 P d148369c73aa4cd59e17f9d5a0b6c181: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:43.201694 13871 raft_consensus.cc:515] T 6c145809834e41bea496b130cfda3cac P 056f6a42190a46df97a5104db44e9d64 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } }
I20260709 12:08:43.207167 13871 leader_election.cc:290] T 6c145809834e41bea496b130cfda3cac P 056f6a42190a46df97a5104db44e9d64 [CANDIDATE]: Term 1 election: Requested vote from peers d148369c73aa4cd59e17f9d5a0b6c181 (127.12.174.129:37737), 4018be520383439497fd4ee03342ed73 (127.12.174.131:46793)
I20260709 12:08:43.204353 13862 tablet_bootstrap.cc:492] T 6c145809834e41bea496b130cfda3cac P 4018be520383439497fd4ee03342ed73: No bootstrap required, opened a new log
I20260709 12:08:43.208971 13672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c145809834e41bea496b130cfda3cac" candidate_uuid: "056f6a42190a46df97a5104db44e9d64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d148369c73aa4cd59e17f9d5a0b6c181"
I20260709 12:08:43.209723 13862 ts_tablet_manager.cc:1403] T 6c145809834e41bea496b130cfda3cac P 4018be520383439497fd4ee03342ed73: Time spent bootstrapping tablet: real 0.080s	user 0.018s	sys 0.017s
I20260709 12:08:43.209805 13672 raft_consensus.cc:3060] T 6c145809834e41bea496b130cfda3cac P d148369c73aa4cd59e17f9d5a0b6c181 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:43.210616 13864 tablet_bootstrap.cc:492] T 27d8fa0b057c4ff09029177a296ce950 P 056f6a42190a46df97a5104db44e9d64: No bootstrap required, opened a new log
I20260709 12:08:43.211191 13864 ts_tablet_manager.cc:1403] T 27d8fa0b057c4ff09029177a296ce950 P 056f6a42190a46df97a5104db44e9d64: Time spent bootstrapping tablet: real 0.037s	user 0.004s	sys 0.009s
I20260709 12:08:43.213187 13862 raft_consensus.cc:359] T 6c145809834e41bea496b130cfda3cac P 4018be520383439497fd4ee03342ed73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } }
I20260709 12:08:43.214062 13862 raft_consensus.cc:385] T 6c145809834e41bea496b130cfda3cac P 4018be520383439497fd4ee03342ed73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:43.214382 13862 raft_consensus.cc:740] T 6c145809834e41bea496b130cfda3cac P 4018be520383439497fd4ee03342ed73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4018be520383439497fd4ee03342ed73, State: Initialized, Role: FOLLOWER
I20260709 12:08:43.214811 13864 raft_consensus.cc:359] T 27d8fa0b057c4ff09029177a296ce950 P 056f6a42190a46df97a5104db44e9d64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } }
I20260709 12:08:43.215212 13862 consensus_queue.cc:260] T 6c145809834e41bea496b130cfda3cac P 4018be520383439497fd4ee03342ed73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } }
I20260709 12:08:43.215710 13864 raft_consensus.cc:385] T 27d8fa0b057c4ff09029177a296ce950 P 056f6a42190a46df97a5104db44e9d64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:43.216169 13864 raft_consensus.cc:740] T 27d8fa0b057c4ff09029177a296ce950 P 056f6a42190a46df97a5104db44e9d64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 056f6a42190a46df97a5104db44e9d64, State: Initialized, Role: FOLLOWER
I20260709 12:08:43.217067 13864 consensus_queue.cc:260] T 27d8fa0b057c4ff09029177a296ce950 P 056f6a42190a46df97a5104db44e9d64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } }
I20260709 12:08:43.217700 13862 ts_tablet_manager.cc:1434] T 6c145809834e41bea496b130cfda3cac P 4018be520383439497fd4ee03342ed73: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.000s
I20260709 12:08:43.218742 13672 raft_consensus.cc:2468] T 6c145809834e41bea496b130cfda3cac P d148369c73aa4cd59e17f9d5a0b6c181 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 056f6a42190a46df97a5104db44e9d64 in term 1.
I20260709 12:08:43.219566 13862 tablet_bootstrap.cc:492] T 123f6eb9b1504a40a43955ccad371d4d P 4018be520383439497fd4ee03342ed73: Bootstrap starting.
I20260709 12:08:43.220116 13714 leader_election.cc:304] T 6c145809834e41bea496b130cfda3cac P 056f6a42190a46df97a5104db44e9d64 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 056f6a42190a46df97a5104db44e9d64, d148369c73aa4cd59e17f9d5a0b6c181; no voters: 
I20260709 12:08:43.226639 13871 raft_consensus.cc:2804] T 6c145809834e41bea496b130cfda3cac P 056f6a42190a46df97a5104db44e9d64 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:43.227320 13871 raft_consensus.cc:697] T 6c145809834e41bea496b130cfda3cac P 056f6a42190a46df97a5104db44e9d64 [term 1 LEADER]: Becoming Leader. State: Replica: 056f6a42190a46df97a5104db44e9d64, State: Running, Role: LEADER
I20260709 12:08:43.227756 13862 tablet_bootstrap.cc:654] T 123f6eb9b1504a40a43955ccad371d4d P 4018be520383439497fd4ee03342ed73: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:43.227929 13866 raft_consensus.cc:493] T 27d8fa0b057c4ff09029177a296ce950 P 4018be520383439497fd4ee03342ed73 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:43.228286 13863 tablet_bootstrap.cc:492] T 041529b194374c228a48aaee162ec1d9 P d148369c73aa4cd59e17f9d5a0b6c181: No bootstrap required, opened a new log
I20260709 12:08:43.228901 13863 ts_tablet_manager.cc:1403] T 041529b194374c228a48aaee162ec1d9 P d148369c73aa4cd59e17f9d5a0b6c181: Time spent bootstrapping tablet: real 0.032s	user 0.007s	sys 0.003s
I20260709 12:08:43.228420 13866 raft_consensus.cc:515] T 27d8fa0b057c4ff09029177a296ce950 P 4018be520383439497fd4ee03342ed73 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } }
I20260709 12:08:43.230979 13866 leader_election.cc:290] T 27d8fa0b057c4ff09029177a296ce950 P 4018be520383439497fd4ee03342ed73 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d148369c73aa4cd59e17f9d5a0b6c181 (127.12.174.129:37737), 056f6a42190a46df97a5104db44e9d64 (127.12.174.130:44237)
I20260709 12:08:43.228464 13871 consensus_queue.cc:237] T 6c145809834e41bea496b130cfda3cac P 056f6a42190a46df97a5104db44e9d64 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } }
I20260709 12:08:43.235461 13863 raft_consensus.cc:359] T 041529b194374c228a48aaee162ec1d9 P d148369c73aa4cd59e17f9d5a0b6c181 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } }
I20260709 12:08:43.236249 13863 raft_consensus.cc:385] T 041529b194374c228a48aaee162ec1d9 P d148369c73aa4cd59e17f9d5a0b6c181 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:43.236570 13863 raft_consensus.cc:740] T 041529b194374c228a48aaee162ec1d9 P d148369c73aa4cd59e17f9d5a0b6c181 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d148369c73aa4cd59e17f9d5a0b6c181, State: Initialized, Role: FOLLOWER
I20260709 12:08:43.241720 13863 consensus_queue.cc:260] T 041529b194374c228a48aaee162ec1d9 P d148369c73aa4cd59e17f9d5a0b6c181 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } }
I20260709 12:08:43.243024 13864 ts_tablet_manager.cc:1434] T 27d8fa0b057c4ff09029177a296ce950 P 056f6a42190a46df97a5104db44e9d64: Time spent starting tablet: real 0.031s	user 0.001s	sys 0.006s
I20260709 12:08:43.245946 13863 ts_tablet_manager.cc:1434] T 041529b194374c228a48aaee162ec1d9 P d148369c73aa4cd59e17f9d5a0b6c181: Time spent starting tablet: real 0.017s	user 0.010s	sys 0.000s
I20260709 12:08:43.247124 13863 tablet_bootstrap.cc:492] T 27d8fa0b057c4ff09029177a296ce950 P d148369c73aa4cd59e17f9d5a0b6c181: Bootstrap starting.
I20260709 12:08:43.253324 13864 tablet_bootstrap.cc:492] T b3984e1dba884ec19c9eecad67e9487a P 056f6a42190a46df97a5104db44e9d64: Bootstrap starting.
I20260709 12:08:43.256780 13870 raft_consensus.cc:493] T 089d82b1caf54ee3b23be8f48cb46605 P d148369c73aa4cd59e17f9d5a0b6c181 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:43.257369 13870 raft_consensus.cc:515] T 089d82b1caf54ee3b23be8f48cb46605 P d148369c73aa4cd59e17f9d5a0b6c181 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } }
I20260709 12:08:43.260548 13870 leader_election.cc:290] T 089d82b1caf54ee3b23be8f48cb46605 P d148369c73aa4cd59e17f9d5a0b6c181 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 056f6a42190a46df97a5104db44e9d64 (127.12.174.130:44237), 4018be520383439497fd4ee03342ed73 (127.12.174.131:46793)
I20260709 12:08:43.261181 13870 raft_consensus.cc:493] T 123f6eb9b1504a40a43955ccad371d4d P d148369c73aa4cd59e17f9d5a0b6c181 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:43.260672 13892 raft_consensus.cc:493] T 27d8fa0b057c4ff09029177a296ce950 P 056f6a42190a46df97a5104db44e9d64 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:43.261722 13870 raft_consensus.cc:515] T 123f6eb9b1504a40a43955ccad371d4d P d148369c73aa4cd59e17f9d5a0b6c181 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } }
I20260709 12:08:43.262331 13892 raft_consensus.cc:515] T 27d8fa0b057c4ff09029177a296ce950 P 056f6a42190a46df97a5104db44e9d64 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } }
I20260709 12:08:43.267833 13870 leader_election.cc:290] T 123f6eb9b1504a40a43955ccad371d4d P d148369c73aa4cd59e17f9d5a0b6c181 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 056f6a42190a46df97a5104db44e9d64 (127.12.174.130:44237), 4018be520383439497fd4ee03342ed73 (127.12.174.131:46793)
I20260709 12:08:43.269512 13822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089d82b1caf54ee3b23be8f48cb46605" candidate_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4018be520383439497fd4ee03342ed73" is_pre_election: true
I20260709 12:08:43.270880 13892 leader_election.cc:290] T 27d8fa0b057c4ff09029177a296ce950 P 056f6a42190a46df97a5104db44e9d64 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d148369c73aa4cd59e17f9d5a0b6c181 (127.12.174.129:37737), 4018be520383439497fd4ee03342ed73 (127.12.174.131:46793)
I20260709 12:08:43.270877 13821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123f6eb9b1504a40a43955ccad371d4d" candidate_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4018be520383439497fd4ee03342ed73" is_pre_election: true
W20260709 12:08:43.271878 13639 leader_election.cc:343] T 089d82b1caf54ee3b23be8f48cb46605 P d148369c73aa4cd59e17f9d5a0b6c181 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4018be520383439497fd4ee03342ed73 (127.12.174.131:46793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:43.272310 13892 raft_consensus.cc:493] T 123f6eb9b1504a40a43955ccad371d4d P 056f6a42190a46df97a5104db44e9d64 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:08:43.273116 13639 leader_election.cc:343] T 123f6eb9b1504a40a43955ccad371d4d P d148369c73aa4cd59e17f9d5a0b6c181 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4018be520383439497fd4ee03342ed73 (127.12.174.131:46793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:43.272837 13892 raft_consensus.cc:515] T 123f6eb9b1504a40a43955ccad371d4d P 056f6a42190a46df97a5104db44e9d64 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } }
W20260709 12:08:43.274668 13714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37737, user_credentials={real_user=slave}} blocked reactor thread for 54671.6us
I20260709 12:08:43.275460 13892 leader_election.cc:290] T 123f6eb9b1504a40a43955ccad371d4d P 056f6a42190a46df97a5104db44e9d64 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d148369c73aa4cd59e17f9d5a0b6c181 (127.12.174.129:37737), 4018be520383439497fd4ee03342ed73 (127.12.174.131:46793)
I20260709 12:08:43.277660 13821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089d82b1caf54ee3b23be8f48cb46605" candidate_uuid: "056f6a42190a46df97a5104db44e9d64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4018be520383439497fd4ee03342ed73" is_pre_election: true
I20260709 12:08:43.278016 13822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c145809834e41bea496b130cfda3cac" candidate_uuid: "056f6a42190a46df97a5104db44e9d64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4018be520383439497fd4ee03342ed73" is_pre_election: true
I20260709 12:08:43.278782 13822 raft_consensus.cc:2468] T 6c145809834e41bea496b130cfda3cac P 4018be520383439497fd4ee03342ed73 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 056f6a42190a46df97a5104db44e9d64 in term 0.
I20260709 12:08:43.280259 13822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c145809834e41bea496b130cfda3cac" candidate_uuid: "056f6a42190a46df97a5104db44e9d64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4018be520383439497fd4ee03342ed73"
I20260709 12:08:43.280880 13822 raft_consensus.cc:3060] T 6c145809834e41bea496b130cfda3cac P 4018be520383439497fd4ee03342ed73 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:43.268015 13864 tablet_bootstrap.cc:654] T b3984e1dba884ec19c9eecad67e9487a P 056f6a42190a46df97a5104db44e9d64: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:43.283797 13672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d8fa0b057c4ff09029177a296ce950" candidate_uuid: "056f6a42190a46df97a5104db44e9d64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" is_pre_election: true
I20260709 12:08:43.285439 13672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123f6eb9b1504a40a43955ccad371d4d" candidate_uuid: "056f6a42190a46df97a5104db44e9d64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" is_pre_election: true
I20260709 12:08:43.286063 13672 raft_consensus.cc:2468] T 123f6eb9b1504a40a43955ccad371d4d P d148369c73aa4cd59e17f9d5a0b6c181 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 056f6a42190a46df97a5104db44e9d64 in term 0.
I20260709 12:08:43.286404 13863 tablet_bootstrap.cc:654] T 27d8fa0b057c4ff09029177a296ce950 P d148369c73aa4cd59e17f9d5a0b6c181: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:43.286628 13748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089d82b1caf54ee3b23be8f48cb46605" candidate_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "056f6a42190a46df97a5104db44e9d64" is_pre_election: true
I20260709 12:08:43.287333 13748 raft_consensus.cc:2468] T 089d82b1caf54ee3b23be8f48cb46605 P 056f6a42190a46df97a5104db44e9d64 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d148369c73aa4cd59e17f9d5a0b6c181 in term 0.
W20260709 12:08:43.287720 13714 leader_election.cc:343] T 27d8fa0b057c4ff09029177a296ce950 P 056f6a42190a46df97a5104db44e9d64 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d148369c73aa4cd59e17f9d5a0b6c181 (127.12.174.129:37737): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:43.288758 13714 leader_election.cc:304] T 123f6eb9b1504a40a43955ccad371d4d P 056f6a42190a46df97a5104db44e9d64 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 056f6a42190a46df97a5104db44e9d64, d148369c73aa4cd59e17f9d5a0b6c181; no voters: 
I20260709 12:08:43.289263 13748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123f6eb9b1504a40a43955ccad371d4d" candidate_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "056f6a42190a46df97a5104db44e9d64" is_pre_election: true
I20260709 12:08:43.289592 13892 raft_consensus.cc:2804] T 123f6eb9b1504a40a43955ccad371d4d P 056f6a42190a46df97a5104db44e9d64 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:43.290198 13748 raft_consensus.cc:2468] T 123f6eb9b1504a40a43955ccad371d4d P 056f6a42190a46df97a5104db44e9d64 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d148369c73aa4cd59e17f9d5a0b6c181 in term 0.
I20260709 12:08:43.290896 13892 raft_consensus.cc:493] T 123f6eb9b1504a40a43955ccad371d4d P 056f6a42190a46df97a5104db44e9d64 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:43.291291 13892 raft_consensus.cc:3060] T 123f6eb9b1504a40a43955ccad371d4d P 056f6a42190a46df97a5104db44e9d64 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:43.299719 13863 tablet_bootstrap.cc:492] T 27d8fa0b057c4ff09029177a296ce950 P d148369c73aa4cd59e17f9d5a0b6c181: No bootstrap required, opened a new log
I20260709 12:08:43.299780 13821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d8fa0b057c4ff09029177a296ce950" candidate_uuid: "056f6a42190a46df97a5104db44e9d64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4018be520383439497fd4ee03342ed73" is_pre_election: true
W20260709 12:08:43.302464 13714 leader_election.cc:343] T 089d82b1caf54ee3b23be8f48cb46605 P 056f6a42190a46df97a5104db44e9d64 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4018be520383439497fd4ee03342ed73 (127.12.174.131:46793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:43.302779 13821 raft_consensus.cc:2468] T 27d8fa0b057c4ff09029177a296ce950 P 4018be520383439497fd4ee03342ed73 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 056f6a42190a46df97a5104db44e9d64 in term 0.
I20260709 12:08:43.302939 13714 leader_election.cc:304] T 089d82b1caf54ee3b23be8f48cb46605 P 056f6a42190a46df97a5104db44e9d64 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 056f6a42190a46df97a5104db44e9d64; no voters: 4018be520383439497fd4ee03342ed73, d148369c73aa4cd59e17f9d5a0b6c181
I20260709 12:08:43.301685 13820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123f6eb9b1504a40a43955ccad371d4d" candidate_uuid: "056f6a42190a46df97a5104db44e9d64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4018be520383439497fd4ee03342ed73" is_pre_election: true
I20260709 12:08:43.302178 13864 tablet_bootstrap.cc:492] T b3984e1dba884ec19c9eecad67e9487a P 056f6a42190a46df97a5104db44e9d64: No bootstrap required, opened a new log
I20260709 12:08:43.303951 13892 raft_consensus.cc:515] T 123f6eb9b1504a40a43955ccad371d4d P 056f6a42190a46df97a5104db44e9d64 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } }
I20260709 12:08:43.304527 13864 ts_tablet_manager.cc:1403] T b3984e1dba884ec19c9eecad67e9487a P 056f6a42190a46df97a5104db44e9d64: Time spent bootstrapping tablet: real 0.051s	user 0.014s	sys 0.003s
I20260709 12:08:43.308779 13714 leader_election.cc:304] T 27d8fa0b057c4ff09029177a296ce950 P 056f6a42190a46df97a5104db44e9d64 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 056f6a42190a46df97a5104db44e9d64, 4018be520383439497fd4ee03342ed73; no voters: d148369c73aa4cd59e17f9d5a0b6c181
I20260709 12:08:43.309183 13863 ts_tablet_manager.cc:1403] T 27d8fa0b057c4ff09029177a296ce950 P d148369c73aa4cd59e17f9d5a0b6c181: Time spent bootstrapping tablet: real 0.062s	user 0.015s	sys 0.000s
W20260709 12:08:43.310227 13714 leader_election.cc:343] T 123f6eb9b1504a40a43955ccad371d4d P 056f6a42190a46df97a5104db44e9d64 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4018be520383439497fd4ee03342ed73 (127.12.174.131:46793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:43.310585 13822 raft_consensus.cc:2468] T 6c145809834e41bea496b130cfda3cac P 4018be520383439497fd4ee03342ed73 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 056f6a42190a46df97a5104db44e9d64 in term 1.
I20260709 12:08:43.310881 13864 raft_consensus.cc:359] T b3984e1dba884ec19c9eecad67e9487a P 056f6a42190a46df97a5104db44e9d64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } }
I20260709 12:08:43.311802 13636 leader_election.cc:304] T 089d82b1caf54ee3b23be8f48cb46605 P d148369c73aa4cd59e17f9d5a0b6c181 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 056f6a42190a46df97a5104db44e9d64, d148369c73aa4cd59e17f9d5a0b6c181; no voters: 4018be520383439497fd4ee03342ed73
I20260709 12:08:43.316062 13636 leader_election.cc:304] T 123f6eb9b1504a40a43955ccad371d4d P d148369c73aa4cd59e17f9d5a0b6c181 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 056f6a42190a46df97a5104db44e9d64, d148369c73aa4cd59e17f9d5a0b6c181; no voters: 4018be520383439497fd4ee03342ed73
I20260709 12:08:43.316444 13896 raft_consensus.cc:2749] T 089d82b1caf54ee3b23be8f48cb46605 P 056f6a42190a46df97a5104db44e9d64 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:43.316978 13897 raft_consensus.cc:2804] T 089d82b1caf54ee3b23be8f48cb46605 P d148369c73aa4cd59e17f9d5a0b6c181 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:43.317279 13896 raft_consensus.cc:2804] T 27d8fa0b057c4ff09029177a296ce950 P 056f6a42190a46df97a5104db44e9d64 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:43.317719 13896 raft_consensus.cc:493] T 27d8fa0b057c4ff09029177a296ce950 P 056f6a42190a46df97a5104db44e9d64 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:43.318079 13896 raft_consensus.cc:3060] T 27d8fa0b057c4ff09029177a296ce950 P 056f6a42190a46df97a5104db44e9d64 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:43.318377 13870 raft_consensus.cc:2804] T 123f6eb9b1504a40a43955ccad371d4d P d148369c73aa4cd59e17f9d5a0b6c181 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:43.318754 13870 raft_consensus.cc:493] T 123f6eb9b1504a40a43955ccad371d4d P d148369c73aa4cd59e17f9d5a0b6c181 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:43.319123 13870 raft_consensus.cc:3060] T 123f6eb9b1504a40a43955ccad371d4d P d148369c73aa4cd59e17f9d5a0b6c181 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:43.325603 13672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31988a87d94a7d879cb9552131429d" candidate_uuid: "4018be520383439497fd4ee03342ed73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" is_pre_election: true
I20260709 12:08:43.325991 13897 raft_consensus.cc:493] T 089d82b1caf54ee3b23be8f48cb46605 P d148369c73aa4cd59e17f9d5a0b6c181 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:43.326530 13897 raft_consensus.cc:3060] T 089d82b1caf54ee3b23be8f48cb46605 P d148369c73aa4cd59e17f9d5a0b6c181 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:43.327751 13673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d8fa0b057c4ff09029177a296ce950" candidate_uuid: "4018be520383439497fd4ee03342ed73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" is_pre_election: true
I20260709 12:08:43.326530 13672 raft_consensus.cc:2468] T 1e31988a87d94a7d879cb9552131429d P d148369c73aa4cd59e17f9d5a0b6c181 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4018be520383439497fd4ee03342ed73 in term 0.
I20260709 12:08:43.332832 13788 leader_election.cc:304] T 1e31988a87d94a7d879cb9552131429d P 4018be520383439497fd4ee03342ed73 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4018be520383439497fd4ee03342ed73, d148369c73aa4cd59e17f9d5a0b6c181; no voters: 
I20260709 12:08:43.333931 13866 raft_consensus.cc:2804] T 1e31988a87d94a7d879cb9552131429d P 4018be520383439497fd4ee03342ed73 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:43.334348 13866 raft_consensus.cc:493] T 1e31988a87d94a7d879cb9552131429d P 4018be520383439497fd4ee03342ed73 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:43.334733 13866 raft_consensus.cc:3060] T 1e31988a87d94a7d879cb9552131429d P 4018be520383439497fd4ee03342ed73 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:43.339282 13897 raft_consensus.cc:515] T 089d82b1caf54ee3b23be8f48cb46605 P d148369c73aa4cd59e17f9d5a0b6c181 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } }
I20260709 12:08:43.342458 13870 raft_consensus.cc:515] T 123f6eb9b1504a40a43955ccad371d4d P d148369c73aa4cd59e17f9d5a0b6c181 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } }
I20260709 12:08:43.343321 13864 raft_consensus.cc:385] T b3984e1dba884ec19c9eecad67e9487a P 056f6a42190a46df97a5104db44e9d64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:43.344450 13864 raft_consensus.cc:740] T b3984e1dba884ec19c9eecad67e9487a P 056f6a42190a46df97a5104db44e9d64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 056f6a42190a46df97a5104db44e9d64, State: Initialized, Role: FOLLOWER
I20260709 12:08:43.345432 13866 raft_consensus.cc:515] T 1e31988a87d94a7d879cb9552131429d P 4018be520383439497fd4ee03342ed73 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } }
I20260709 12:08:43.345929 13864 consensus_queue.cc:260] T b3984e1dba884ec19c9eecad67e9487a P 056f6a42190a46df97a5104db44e9d64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } }
I20260709 12:08:43.349241 13672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31988a87d94a7d879cb9552131429d" candidate_uuid: "4018be520383439497fd4ee03342ed73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d148369c73aa4cd59e17f9d5a0b6c181"
I20260709 12:08:43.314180 13863 raft_consensus.cc:359] T 27d8fa0b057c4ff09029177a296ce950 P d148369c73aa4cd59e17f9d5a0b6c181 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } }
I20260709 12:08:43.350023 13672 raft_consensus.cc:3060] T 1e31988a87d94a7d879cb9552131429d P d148369c73aa4cd59e17f9d5a0b6c181 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:43.350052 13863 raft_consensus.cc:385] T 27d8fa0b057c4ff09029177a296ce950 P d148369c73aa4cd59e17f9d5a0b6c181 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:43.351256 13863 raft_consensus.cc:740] T 27d8fa0b057c4ff09029177a296ce950 P d148369c73aa4cd59e17f9d5a0b6c181 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d148369c73aa4cd59e17f9d5a0b6c181, State: Initialized, Role: FOLLOWER
I20260709 12:08:43.353642 13820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123f6eb9b1504a40a43955ccad371d4d" candidate_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4018be520383439497fd4ee03342ed73"
I20260709 12:08:43.354265 13870 leader_election.cc:290] T 123f6eb9b1504a40a43955ccad371d4d P d148369c73aa4cd59e17f9d5a0b6c181 [CANDIDATE]: Term 1 election: Requested vote from peers 056f6a42190a46df97a5104db44e9d64 (127.12.174.130:44237), 4018be520383439497fd4ee03342ed73 (127.12.174.131:46793)
W20260709 12:08:43.355290 13639 leader_election.cc:343] T 123f6eb9b1504a40a43955ccad371d4d P d148369c73aa4cd59e17f9d5a0b6c181 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4018be520383439497fd4ee03342ed73 (127.12.174.131:46793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:43.356921 13864 ts_tablet_manager.cc:1434] T b3984e1dba884ec19c9eecad67e9487a P 056f6a42190a46df97a5104db44e9d64: Time spent starting tablet: real 0.052s	user 0.009s	sys 0.000s
I20260709 12:08:43.358332 13864 tablet_bootstrap.cc:492] T e27355722e7349aaa58d6ed2d707b81f P 056f6a42190a46df97a5104db44e9d64: Bootstrap starting.
I20260709 12:08:43.359483 13747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089d82b1caf54ee3b23be8f48cb46605" candidate_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "056f6a42190a46df97a5104db44e9d64"
I20260709 12:08:43.360272 13747 raft_consensus.cc:3060] T 089d82b1caf54ee3b23be8f48cb46605 P 056f6a42190a46df97a5104db44e9d64 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:43.359311 13897 leader_election.cc:290] T 089d82b1caf54ee3b23be8f48cb46605 P d148369c73aa4cd59e17f9d5a0b6c181 [CANDIDATE]: Term 1 election: Requested vote from peers 056f6a42190a46df97a5104db44e9d64 (127.12.174.130:44237), 4018be520383439497fd4ee03342ed73 (127.12.174.131:46793)
I20260709 12:08:43.360508 13820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089d82b1caf54ee3b23be8f48cb46605" candidate_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4018be520383439497fd4ee03342ed73"
I20260709 12:08:43.361191 13863 consensus_queue.cc:260] T 27d8fa0b057c4ff09029177a296ce950 P d148369c73aa4cd59e17f9d5a0b6c181 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } }
W20260709 12:08:43.362251 13639 leader_election.cc:343] T 089d82b1caf54ee3b23be8f48cb46605 P d148369c73aa4cd59e17f9d5a0b6c181 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4018be520383439497fd4ee03342ed73 (127.12.174.131:46793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:43.362371 13673 raft_consensus.cc:2468] T 27d8fa0b057c4ff09029177a296ce950 P d148369c73aa4cd59e17f9d5a0b6c181 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4018be520383439497fd4ee03342ed73 in term 0.
I20260709 12:08:43.359262 13748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123f6eb9b1504a40a43955ccad371d4d" candidate_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "056f6a42190a46df97a5104db44e9d64"
I20260709 12:08:43.365820 13748 raft_consensus.cc:2393] T 123f6eb9b1504a40a43955ccad371d4d P 056f6a42190a46df97a5104db44e9d64 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d148369c73aa4cd59e17f9d5a0b6c181 in current term 1: Already voted for candidate 056f6a42190a46df97a5104db44e9d64 in this term.
I20260709 12:08:43.366559 13863 ts_tablet_manager.cc:1434] T 27d8fa0b057c4ff09029177a296ce950 P d148369c73aa4cd59e17f9d5a0b6c181: Time spent starting tablet: real 0.057s	user 0.008s	sys 0.001s
I20260709 12:08:43.376745 13568 catalog_manager.cc:5697] T 6c145809834e41bea496b130cfda3cac P 056f6a42190a46df97a5104db44e9d64 reported cstate change: term changed from 0 to 1, leader changed from <none> to 056f6a42190a46df97a5104db44e9d64 (127.12.174.130). New cstate: current_term: 1 leader_uuid: "056f6a42190a46df97a5104db44e9d64" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:43.381225 13747 raft_consensus.cc:2468] T 089d82b1caf54ee3b23be8f48cb46605 P 056f6a42190a46df97a5104db44e9d64 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d148369c73aa4cd59e17f9d5a0b6c181 in term 1.
I20260709 12:08:43.367941 13892 leader_election.cc:290] T 123f6eb9b1504a40a43955ccad371d4d P 056f6a42190a46df97a5104db44e9d64 [CANDIDATE]: Term 1 election: Requested vote from peers d148369c73aa4cd59e17f9d5a0b6c181 (127.12.174.129:37737), 4018be520383439497fd4ee03342ed73 (127.12.174.131:46793)
I20260709 12:08:43.369838 13636 leader_election.cc:304] T 123f6eb9b1504a40a43955ccad371d4d P d148369c73aa4cd59e17f9d5a0b6c181 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d148369c73aa4cd59e17f9d5a0b6c181; no voters: 056f6a42190a46df97a5104db44e9d64, 4018be520383439497fd4ee03342ed73
I20260709 12:08:43.382946 13636 leader_election.cc:304] T 089d82b1caf54ee3b23be8f48cb46605 P d148369c73aa4cd59e17f9d5a0b6c181 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 056f6a42190a46df97a5104db44e9d64, d148369c73aa4cd59e17f9d5a0b6c181; no voters: 4018be520383439497fd4ee03342ed73
I20260709 12:08:43.370048 13673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123f6eb9b1504a40a43955ccad371d4d" candidate_uuid: "056f6a42190a46df97a5104db44e9d64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d148369c73aa4cd59e17f9d5a0b6c181"
I20260709 12:08:43.384433 13673 raft_consensus.cc:2393] T 123f6eb9b1504a40a43955ccad371d4d P d148369c73aa4cd59e17f9d5a0b6c181 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 056f6a42190a46df97a5104db44e9d64 in current term 1: Already voted for candidate d148369c73aa4cd59e17f9d5a0b6c181 in this term.
I20260709 12:08:43.386317 13870 raft_consensus.cc:2749] T 123f6eb9b1504a40a43955ccad371d4d P d148369c73aa4cd59e17f9d5a0b6c181 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:08:43.372268 13746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d8fa0b057c4ff09029177a296ce950" candidate_uuid: "4018be520383439497fd4ee03342ed73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "056f6a42190a46df97a5104db44e9d64" is_pre_election: true
I20260709 12:08:43.375295 13788 leader_election.cc:304] T 27d8fa0b057c4ff09029177a296ce950 P 4018be520383439497fd4ee03342ed73 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4018be520383439497fd4ee03342ed73, d148369c73aa4cd59e17f9d5a0b6c181; no voters: 
I20260709 12:08:43.387365 13870 raft_consensus.cc:2804] T 089d82b1caf54ee3b23be8f48cb46605 P d148369c73aa4cd59e17f9d5a0b6c181 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:43.387965 13870 raft_consensus.cc:697] T 089d82b1caf54ee3b23be8f48cb46605 P d148369c73aa4cd59e17f9d5a0b6c181 [term 1 LEADER]: Becoming Leader. State: Replica: d148369c73aa4cd59e17f9d5a0b6c181, State: Running, Role: LEADER
I20260709 12:08:43.388989 13870 consensus_queue.cc:237] T 089d82b1caf54ee3b23be8f48cb46605 P d148369c73aa4cd59e17f9d5a0b6c181 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } }
I20260709 12:08:43.371894 13748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31988a87d94a7d879cb9552131429d" candidate_uuid: "4018be520383439497fd4ee03342ed73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "056f6a42190a46df97a5104db44e9d64" is_pre_election: true
I20260709 12:08:43.389796 13672 raft_consensus.cc:2468] T 1e31988a87d94a7d879cb9552131429d P d148369c73aa4cd59e17f9d5a0b6c181 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4018be520383439497fd4ee03342ed73 in term 1.
I20260709 12:08:43.376740 13863 tablet_bootstrap.cc:492] T e27355722e7349aaa58d6ed2d707b81f P d148369c73aa4cd59e17f9d5a0b6c181: Bootstrap starting.
W20260709 12:08:43.394587 13785 leader_election.cc:343] T 1e31988a87d94a7d879cb9552131429d P 4018be520383439497fd4ee03342ed73 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 056f6a42190a46df97a5104db44e9d64 (127.12.174.130:44237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:43.395231 13862 tablet_bootstrap.cc:492] T 123f6eb9b1504a40a43955ccad371d4d P 4018be520383439497fd4ee03342ed73: No bootstrap required, opened a new log
I20260709 12:08:43.393056 13747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31988a87d94a7d879cb9552131429d" candidate_uuid: "4018be520383439497fd4ee03342ed73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "056f6a42190a46df97a5104db44e9d64"
I20260709 12:08:43.395733 13862 ts_tablet_manager.cc:1403] T 123f6eb9b1504a40a43955ccad371d4d P 4018be520383439497fd4ee03342ed73: Time spent bootstrapping tablet: real 0.176s	user 0.075s	sys 0.068s
W20260709 12:08:43.396663 13785 leader_election.cc:343] T 1e31988a87d94a7d879cb9552131429d P 4018be520383439497fd4ee03342ed73 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 056f6a42190a46df97a5104db44e9d64 (127.12.174.130:44237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:43.393390 13866 leader_election.cc:290] T 1e31988a87d94a7d879cb9552131429d P 4018be520383439497fd4ee03342ed73 [CANDIDATE]: Term 1 election: Requested vote from peers d148369c73aa4cd59e17f9d5a0b6c181 (127.12.174.129:37737), 056f6a42190a46df97a5104db44e9d64 (127.12.174.130:44237)
I20260709 12:08:43.399184 13866 raft_consensus.cc:2804] T 27d8fa0b057c4ff09029177a296ce950 P 4018be520383439497fd4ee03342ed73 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:43.399047 13862 raft_consensus.cc:359] T 123f6eb9b1504a40a43955ccad371d4d P 4018be520383439497fd4ee03342ed73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } }
I20260709 12:08:43.399585 13866 raft_consensus.cc:493] T 27d8fa0b057c4ff09029177a296ce950 P 4018be520383439497fd4ee03342ed73 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:43.399890 13862 raft_consensus.cc:385] T 123f6eb9b1504a40a43955ccad371d4d P 4018be520383439497fd4ee03342ed73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:43.399963 13866 raft_consensus.cc:3060] T 27d8fa0b057c4ff09029177a296ce950 P 4018be520383439497fd4ee03342ed73 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:43.400270 13862 raft_consensus.cc:740] T 123f6eb9b1504a40a43955ccad371d4d P 4018be520383439497fd4ee03342ed73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4018be520383439497fd4ee03342ed73, State: Initialized, Role: FOLLOWER
I20260709 12:08:43.401120 13862 consensus_queue.cc:260] T 123f6eb9b1504a40a43955ccad371d4d P 4018be520383439497fd4ee03342ed73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } }
I20260709 12:08:43.403357 13864 tablet_bootstrap.cc:654] T e27355722e7349aaa58d6ed2d707b81f P 056f6a42190a46df97a5104db44e9d64: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:43.403518 13862 ts_tablet_manager.cc:1434] T 123f6eb9b1504a40a43955ccad371d4d P 4018be520383439497fd4ee03342ed73: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.002s
I20260709 12:08:43.407706 13896 raft_consensus.cc:515] T 27d8fa0b057c4ff09029177a296ce950 P 056f6a42190a46df97a5104db44e9d64 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } }
I20260709 12:08:43.408233 13862 tablet_bootstrap.cc:492] T b3984e1dba884ec19c9eecad67e9487a P 4018be520383439497fd4ee03342ed73: Bootstrap starting.
I20260709 12:08:43.409051 13746 raft_consensus.cc:2393] T 27d8fa0b057c4ff09029177a296ce950 P 056f6a42190a46df97a5104db44e9d64 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4018be520383439497fd4ee03342ed73 in current term 1: Already voted for candidate 056f6a42190a46df97a5104db44e9d64 in this term.
I20260709 12:08:43.413239 13822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "123f6eb9b1504a40a43955ccad371d4d" candidate_uuid: "056f6a42190a46df97a5104db44e9d64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4018be520383439497fd4ee03342ed73"
I20260709 12:08:43.414024 13822 raft_consensus.cc:3060] T 123f6eb9b1504a40a43955ccad371d4d P 4018be520383439497fd4ee03342ed73 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:43.415036 13896 leader_election.cc:290] T 27d8fa0b057c4ff09029177a296ce950 P 056f6a42190a46df97a5104db44e9d64 [CANDIDATE]: Term 1 election: Requested vote from peers d148369c73aa4cd59e17f9d5a0b6c181 (127.12.174.129:37737), 4018be520383439497fd4ee03342ed73 (127.12.174.131:46793)
I20260709 12:08:43.415732 13862 tablet_bootstrap.cc:654] T b3984e1dba884ec19c9eecad67e9487a P 4018be520383439497fd4ee03342ed73: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:43.406912 13866 raft_consensus.cc:515] T 27d8fa0b057c4ff09029177a296ce950 P 4018be520383439497fd4ee03342ed73 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } }
I20260709 12:08:43.406798 13863 tablet_bootstrap.cc:654] T e27355722e7349aaa58d6ed2d707b81f P d148369c73aa4cd59e17f9d5a0b6c181: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:43.414024 13672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d8fa0b057c4ff09029177a296ce950" candidate_uuid: "056f6a42190a46df97a5104db44e9d64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d148369c73aa4cd59e17f9d5a0b6c181"
I20260709 12:08:43.418411 13672 raft_consensus.cc:3060] T 27d8fa0b057c4ff09029177a296ce950 P d148369c73aa4cd59e17f9d5a0b6c181 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:43.418891 13746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d8fa0b057c4ff09029177a296ce950" candidate_uuid: "4018be520383439497fd4ee03342ed73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "056f6a42190a46df97a5104db44e9d64"
I20260709 12:08:43.419757 13746 raft_consensus.cc:2393] T 27d8fa0b057c4ff09029177a296ce950 P 056f6a42190a46df97a5104db44e9d64 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4018be520383439497fd4ee03342ed73 in current term 1: Already voted for candidate 056f6a42190a46df97a5104db44e9d64 in this term.
I20260709 12:08:43.421298 13866 leader_election.cc:290] T 27d8fa0b057c4ff09029177a296ce950 P 4018be520383439497fd4ee03342ed73 [CANDIDATE]: Term 1 election: Requested vote from peers d148369c73aa4cd59e17f9d5a0b6c181 (127.12.174.129:37737), 056f6a42190a46df97a5104db44e9d64 (127.12.174.130:44237)
I20260709 12:08:43.422016 13866 raft_consensus.cc:493] T e27355722e7349aaa58d6ed2d707b81f P 4018be520383439497fd4ee03342ed73 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:43.422652 13866 raft_consensus.cc:515] T e27355722e7349aaa58d6ed2d707b81f P 4018be520383439497fd4ee03342ed73 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } }
I20260709 12:08:43.426339 13746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27355722e7349aaa58d6ed2d707b81f" candidate_uuid: "4018be520383439497fd4ee03342ed73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "056f6a42190a46df97a5104db44e9d64" is_pre_election: true
W20260709 12:08:43.428436 13785 leader_election.cc:343] T e27355722e7349aaa58d6ed2d707b81f P 4018be520383439497fd4ee03342ed73 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 056f6a42190a46df97a5104db44e9d64 (127.12.174.130:44237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:43.429064 13866 leader_election.cc:290] T e27355722e7349aaa58d6ed2d707b81f P 4018be520383439497fd4ee03342ed73 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d148369c73aa4cd59e17f9d5a0b6c181 (127.12.174.129:37737), 056f6a42190a46df97a5104db44e9d64 (127.12.174.130:44237)
I20260709 12:08:43.429312 13862 tablet_bootstrap.cc:492] T b3984e1dba884ec19c9eecad67e9487a P 4018be520383439497fd4ee03342ed73: No bootstrap required, opened a new log
I20260709 12:08:43.429781 13862 ts_tablet_manager.cc:1403] T b3984e1dba884ec19c9eecad67e9487a P 4018be520383439497fd4ee03342ed73: Time spent bootstrapping tablet: real 0.022s	user 0.008s	sys 0.004s
I20260709 12:08:43.430601 13864 tablet_bootstrap.cc:492] T e27355722e7349aaa58d6ed2d707b81f P 056f6a42190a46df97a5104db44e9d64: No bootstrap required, opened a new log
I20260709 12:08:43.431402 13864 ts_tablet_manager.cc:1403] T e27355722e7349aaa58d6ed2d707b81f P 056f6a42190a46df97a5104db44e9d64: Time spent bootstrapping tablet: real 0.073s	user 0.015s	sys 0.004s
I20260709 12:08:43.432843 13822 raft_consensus.cc:2468] T 123f6eb9b1504a40a43955ccad371d4d P 4018be520383439497fd4ee03342ed73 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 056f6a42190a46df97a5104db44e9d64 in term 1.
I20260709 12:08:43.433035 13862 raft_consensus.cc:359] T b3984e1dba884ec19c9eecad67e9487a P 4018be520383439497fd4ee03342ed73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } }
I20260709 12:08:43.433611 13863 tablet_bootstrap.cc:492] T e27355722e7349aaa58d6ed2d707b81f P d148369c73aa4cd59e17f9d5a0b6c181: No bootstrap required, opened a new log
I20260709 12:08:43.433825 13862 raft_consensus.cc:385] T b3984e1dba884ec19c9eecad67e9487a P 4018be520383439497fd4ee03342ed73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:43.434122 13863 ts_tablet_manager.cc:1403] T e27355722e7349aaa58d6ed2d707b81f P d148369c73aa4cd59e17f9d5a0b6c181: Time spent bootstrapping tablet: real 0.058s	user 0.012s	sys 0.004s
I20260709 12:08:43.434132 13862 raft_consensus.cc:740] T b3984e1dba884ec19c9eecad67e9487a P 4018be520383439497fd4ee03342ed73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4018be520383439497fd4ee03342ed73, State: Initialized, Role: FOLLOWER
I20260709 12:08:43.431330 13672 raft_consensus.cc:2468] T 27d8fa0b057c4ff09029177a296ce950 P d148369c73aa4cd59e17f9d5a0b6c181 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 056f6a42190a46df97a5104db44e9d64 in term 1.
I20260709 12:08:43.435220 13862 consensus_queue.cc:260] T b3984e1dba884ec19c9eecad67e9487a P 4018be520383439497fd4ee03342ed73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } }
I20260709 12:08:43.436019 13673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d8fa0b057c4ff09029177a296ce950" candidate_uuid: "4018be520383439497fd4ee03342ed73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d148369c73aa4cd59e17f9d5a0b6c181"
I20260709 12:08:43.436324 13714 leader_election.cc:304] T 27d8fa0b057c4ff09029177a296ce950 P 056f6a42190a46df97a5104db44e9d64 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 056f6a42190a46df97a5104db44e9d64, d148369c73aa4cd59e17f9d5a0b6c181; no voters: 
I20260709 12:08:43.436844 13673 raft_consensus.cc:2393] T 27d8fa0b057c4ff09029177a296ce950 P d148369c73aa4cd59e17f9d5a0b6c181 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4018be520383439497fd4ee03342ed73 in current term 1: Already voted for candidate 056f6a42190a46df97a5104db44e9d64 in this term.
I20260709 12:08:43.437232 13896 raft_consensus.cc:2804] T 27d8fa0b057c4ff09029177a296ce950 P 056f6a42190a46df97a5104db44e9d64 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:43.437325 13863 raft_consensus.cc:359] T e27355722e7349aaa58d6ed2d707b81f P d148369c73aa4cd59e17f9d5a0b6c181 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } }
I20260709 12:08:43.435242 13864 raft_consensus.cc:359] T e27355722e7349aaa58d6ed2d707b81f P 056f6a42190a46df97a5104db44e9d64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } }
I20260709 12:08:43.437951 13896 raft_consensus.cc:697] T 27d8fa0b057c4ff09029177a296ce950 P 056f6a42190a46df97a5104db44e9d64 [term 1 LEADER]: Becoming Leader. State: Replica: 056f6a42190a46df97a5104db44e9d64, State: Running, Role: LEADER
I20260709 12:08:43.438143 13863 raft_consensus.cc:385] T e27355722e7349aaa58d6ed2d707b81f P d148369c73aa4cd59e17f9d5a0b6c181 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:43.437463 13862 ts_tablet_manager.cc:1434] T b3984e1dba884ec19c9eecad67e9487a P 4018be520383439497fd4ee03342ed73: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:08:43.438512 13863 raft_consensus.cc:740] T e27355722e7349aaa58d6ed2d707b81f P d148369c73aa4cd59e17f9d5a0b6c181 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d148369c73aa4cd59e17f9d5a0b6c181, State: Initialized, Role: FOLLOWER
I20260709 12:08:43.438266 13864 raft_consensus.cc:385] T e27355722e7349aaa58d6ed2d707b81f P 056f6a42190a46df97a5104db44e9d64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:43.439339 13673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27355722e7349aaa58d6ed2d707b81f" candidate_uuid: "4018be520383439497fd4ee03342ed73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" is_pre_election: true
I20260709 12:08:43.439791 13864 raft_consensus.cc:740] T e27355722e7349aaa58d6ed2d707b81f P 056f6a42190a46df97a5104db44e9d64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 056f6a42190a46df97a5104db44e9d64, State: Initialized, Role: FOLLOWER
I20260709 12:08:43.439285 13863 consensus_queue.cc:260] T e27355722e7349aaa58d6ed2d707b81f P d148369c73aa4cd59e17f9d5a0b6c181 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } }
I20260709 12:08:43.440438 13673 raft_consensus.cc:2468] T e27355722e7349aaa58d6ed2d707b81f P d148369c73aa4cd59e17f9d5a0b6c181 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4018be520383439497fd4ee03342ed73 in term 0.
I20260709 12:08:43.440438 13896 consensus_queue.cc:237] T 27d8fa0b057c4ff09029177a296ce950 P 056f6a42190a46df97a5104db44e9d64 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } }
I20260709 12:08:43.440605 13864 consensus_queue.cc:260] T e27355722e7349aaa58d6ed2d707b81f P 056f6a42190a46df97a5104db44e9d64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } }
I20260709 12:08:43.441794 13863 ts_tablet_manager.cc:1434] T e27355722e7349aaa58d6ed2d707b81f P d148369c73aa4cd59e17f9d5a0b6c181: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:08:43.442391 13714 leader_election.cc:304] T 123f6eb9b1504a40a43955ccad371d4d P 056f6a42190a46df97a5104db44e9d64 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 056f6a42190a46df97a5104db44e9d64, 4018be520383439497fd4ee03342ed73; no voters: d148369c73aa4cd59e17f9d5a0b6c181
I20260709 12:08:43.442831 13863 tablet_bootstrap.cc:492] T b3984e1dba884ec19c9eecad67e9487a P d148369c73aa4cd59e17f9d5a0b6c181: Bootstrap starting.
I20260709 12:08:43.439304 13862 tablet_bootstrap.cc:492] T 3ba6e60509e5462f984736f50675cd17 P 4018be520383439497fd4ee03342ed73: Bootstrap starting.
I20260709 12:08:43.443866 13871 raft_consensus.cc:2804] T 123f6eb9b1504a40a43955ccad371d4d P 056f6a42190a46df97a5104db44e9d64 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:43.444386 13871 raft_consensus.cc:697] T 123f6eb9b1504a40a43955ccad371d4d P 056f6a42190a46df97a5104db44e9d64 [term 1 LEADER]: Becoming Leader. State: Replica: 056f6a42190a46df97a5104db44e9d64, State: Running, Role: LEADER
I20260709 12:08:43.445369 13871 consensus_queue.cc:237] T 123f6eb9b1504a40a43955ccad371d4d P 056f6a42190a46df97a5104db44e9d64 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } }
I20260709 12:08:43.442718 13864 ts_tablet_manager.cc:1434] T e27355722e7349aaa58d6ed2d707b81f P 056f6a42190a46df97a5104db44e9d64: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:08:43.448122 13788 leader_election.cc:304] T 1e31988a87d94a7d879cb9552131429d P 4018be520383439497fd4ee03342ed73 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4018be520383439497fd4ee03342ed73, d148369c73aa4cd59e17f9d5a0b6c181; no voters: 056f6a42190a46df97a5104db44e9d64
I20260709 12:08:43.448874 13864 tablet_bootstrap.cc:492] T 1e31988a87d94a7d879cb9552131429d P 056f6a42190a46df97a5104db44e9d64: Bootstrap starting.
I20260709 12:08:43.449980 13863 tablet_bootstrap.cc:654] T b3984e1dba884ec19c9eecad67e9487a P d148369c73aa4cd59e17f9d5a0b6c181: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:43.449685 13788 leader_election.cc:304] T 27d8fa0b057c4ff09029177a296ce950 P 4018be520383439497fd4ee03342ed73 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4018be520383439497fd4ee03342ed73; no voters: 056f6a42190a46df97a5104db44e9d64, d148369c73aa4cd59e17f9d5a0b6c181
I20260709 12:08:43.453313 13866 raft_consensus.cc:2749] T 27d8fa0b057c4ff09029177a296ce950 P 4018be520383439497fd4ee03342ed73 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:08:43.453943 13788 leader_election.cc:304] T e27355722e7349aaa58d6ed2d707b81f P 4018be520383439497fd4ee03342ed73 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4018be520383439497fd4ee03342ed73, d148369c73aa4cd59e17f9d5a0b6c181; no voters: 056f6a42190a46df97a5104db44e9d64
I20260709 12:08:43.454833 13866 raft_consensus.cc:2804] T e27355722e7349aaa58d6ed2d707b81f P 4018be520383439497fd4ee03342ed73 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:43.455120 13864 tablet_bootstrap.cc:654] T 1e31988a87d94a7d879cb9552131429d P 056f6a42190a46df97a5104db44e9d64: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:43.455202 13866 raft_consensus.cc:493] T e27355722e7349aaa58d6ed2d707b81f P 4018be520383439497fd4ee03342ed73 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:43.450119 13901 raft_consensus.cc:2804] T 1e31988a87d94a7d879cb9552131429d P 4018be520383439497fd4ee03342ed73 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:43.455610 13866 raft_consensus.cc:3060] T e27355722e7349aaa58d6ed2d707b81f P 4018be520383439497fd4ee03342ed73 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:43.455957 13570 catalog_manager.cc:5697] T 089d82b1caf54ee3b23be8f48cb46605 P d148369c73aa4cd59e17f9d5a0b6c181 reported cstate change: term changed from 0 to 1, leader changed from <none> to d148369c73aa4cd59e17f9d5a0b6c181 (127.12.174.129). New cstate: current_term: 1 leader_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:43.460282 13862 tablet_bootstrap.cc:654] T 3ba6e60509e5462f984736f50675cd17 P 4018be520383439497fd4ee03342ed73: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:43.462375 13822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d8fa0b057c4ff09029177a296ce950" candidate_uuid: "056f6a42190a46df97a5104db44e9d64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4018be520383439497fd4ee03342ed73"
I20260709 12:08:43.470825 13901 raft_consensus.cc:697] T 1e31988a87d94a7d879cb9552131429d P 4018be520383439497fd4ee03342ed73 [term 1 LEADER]: Becoming Leader. State: Replica: 4018be520383439497fd4ee03342ed73, State: Running, Role: LEADER
I20260709 12:08:43.471156 13908 raft_consensus.cc:493] T 041529b194374c228a48aaee162ec1d9 P 4018be520383439497fd4ee03342ed73 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:43.463426 13822 raft_consensus.cc:2393] T 27d8fa0b057c4ff09029177a296ce950 P 4018be520383439497fd4ee03342ed73 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 056f6a42190a46df97a5104db44e9d64 in current term 1: Already voted for candidate 4018be520383439497fd4ee03342ed73 in this term.
I20260709 12:08:43.472169 13901 consensus_queue.cc:237] T 1e31988a87d94a7d879cb9552131429d P 4018be520383439497fd4ee03342ed73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } }
I20260709 12:08:43.481635 13863 tablet_bootstrap.cc:492] T b3984e1dba884ec19c9eecad67e9487a P d148369c73aa4cd59e17f9d5a0b6c181: No bootstrap required, opened a new log
I20260709 12:08:43.482321 13863 ts_tablet_manager.cc:1403] T b3984e1dba884ec19c9eecad67e9487a P d148369c73aa4cd59e17f9d5a0b6c181: Time spent bootstrapping tablet: real 0.040s	user 0.005s	sys 0.011s
I20260709 12:08:43.469053 13866 raft_consensus.cc:515] T e27355722e7349aaa58d6ed2d707b81f P 4018be520383439497fd4ee03342ed73 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } }
I20260709 12:08:43.487191 13746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27355722e7349aaa58d6ed2d707b81f" candidate_uuid: "4018be520383439497fd4ee03342ed73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "056f6a42190a46df97a5104db44e9d64"
I20260709 12:08:43.471741 13908 raft_consensus.cc:515] T 041529b194374c228a48aaee162ec1d9 P 4018be520383439497fd4ee03342ed73 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } }
I20260709 12:08:43.488075 13746 raft_consensus.cc:3060] T e27355722e7349aaa58d6ed2d707b81f P 056f6a42190a46df97a5104db44e9d64 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:43.490185 13908 leader_election.cc:290] T 041529b194374c228a48aaee162ec1d9 P 4018be520383439497fd4ee03342ed73 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d148369c73aa4cd59e17f9d5a0b6c181 (127.12.174.129:37737), 056f6a42190a46df97a5104db44e9d64 (127.12.174.130:44237)
I20260709 12:08:43.491220 13864 tablet_bootstrap.cc:492] T 1e31988a87d94a7d879cb9552131429d P 056f6a42190a46df97a5104db44e9d64: No bootstrap required, opened a new log
I20260709 12:08:43.491751 13864 ts_tablet_manager.cc:1403] T 1e31988a87d94a7d879cb9552131429d P 056f6a42190a46df97a5104db44e9d64: Time spent bootstrapping tablet: real 0.043s	user 0.010s	sys 0.007s
I20260709 12:08:43.495136 13747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041529b194374c228a48aaee162ec1d9" candidate_uuid: "4018be520383439497fd4ee03342ed73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "056f6a42190a46df97a5104db44e9d64" is_pre_election: true
I20260709 12:08:43.495888 13747 raft_consensus.cc:2468] T 041529b194374c228a48aaee162ec1d9 P 056f6a42190a46df97a5104db44e9d64 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4018be520383439497fd4ee03342ed73 in term 0.
I20260709 12:08:43.497093 13672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27355722e7349aaa58d6ed2d707b81f" candidate_uuid: "4018be520383439497fd4ee03342ed73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d148369c73aa4cd59e17f9d5a0b6c181"
I20260709 12:08:43.497758 13672 raft_consensus.cc:3060] T e27355722e7349aaa58d6ed2d707b81f P d148369c73aa4cd59e17f9d5a0b6c181 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:43.498750 13864 raft_consensus.cc:359] T 1e31988a87d94a7d879cb9552131429d P 056f6a42190a46df97a5104db44e9d64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } }
I20260709 12:08:43.499459 13864 raft_consensus.cc:385] T 1e31988a87d94a7d879cb9552131429d P 056f6a42190a46df97a5104db44e9d64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:43.499724 13864 raft_consensus.cc:740] T 1e31988a87d94a7d879cb9552131429d P 056f6a42190a46df97a5104db44e9d64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 056f6a42190a46df97a5104db44e9d64, State: Initialized, Role: FOLLOWER
I20260709 12:08:43.499925 13746 raft_consensus.cc:2468] T e27355722e7349aaa58d6ed2d707b81f P 056f6a42190a46df97a5104db44e9d64 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4018be520383439497fd4ee03342ed73 in term 1.
I20260709 12:08:43.500501 13863 raft_consensus.cc:359] T b3984e1dba884ec19c9eecad67e9487a P d148369c73aa4cd59e17f9d5a0b6c181 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } }
I20260709 12:08:43.501204 13863 raft_consensus.cc:385] T b3984e1dba884ec19c9eecad67e9487a P d148369c73aa4cd59e17f9d5a0b6c181 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:43.501490 13863 raft_consensus.cc:740] T b3984e1dba884ec19c9eecad67e9487a P d148369c73aa4cd59e17f9d5a0b6c181 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d148369c73aa4cd59e17f9d5a0b6c181, State: Initialized, Role: FOLLOWER
I20260709 12:08:43.502441 13864 consensus_queue.cc:260] T 1e31988a87d94a7d879cb9552131429d P 056f6a42190a46df97a5104db44e9d64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } }
I20260709 12:08:43.504987 13864 ts_tablet_manager.cc:1434] T 1e31988a87d94a7d879cb9552131429d P 056f6a42190a46df97a5104db44e9d64: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 12:08:43.506007 13864 tablet_bootstrap.cc:492] T 3ba6e60509e5462f984736f50675cd17 P 056f6a42190a46df97a5104db44e9d64: Bootstrap starting.
I20260709 12:08:43.506518 13785 leader_election.cc:304] T 041529b194374c228a48aaee162ec1d9 P 4018be520383439497fd4ee03342ed73 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 056f6a42190a46df97a5104db44e9d64, 4018be520383439497fd4ee03342ed73; no voters: 
I20260709 12:08:43.507396 13908 raft_consensus.cc:2804] T 041529b194374c228a48aaee162ec1d9 P 4018be520383439497fd4ee03342ed73 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:43.507932 13908 raft_consensus.cc:493] T 041529b194374c228a48aaee162ec1d9 P 4018be520383439497fd4ee03342ed73 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:43.508569 13908 raft_consensus.cc:3060] T 041529b194374c228a48aaee162ec1d9 P 4018be520383439497fd4ee03342ed73 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:43.509555 13673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041529b194374c228a48aaee162ec1d9" candidate_uuid: "4018be520383439497fd4ee03342ed73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" is_pre_election: true
I20260709 12:08:43.510282 13673 raft_consensus.cc:2468] T 041529b194374c228a48aaee162ec1d9 P d148369c73aa4cd59e17f9d5a0b6c181 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4018be520383439497fd4ee03342ed73 in term 0.
I20260709 12:08:43.507859 13672 raft_consensus.cc:2468] T e27355722e7349aaa58d6ed2d707b81f P d148369c73aa4cd59e17f9d5a0b6c181 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4018be520383439497fd4ee03342ed73 in term 1.
I20260709 12:08:43.511276 13568 catalog_manager.cc:5697] T 27d8fa0b057c4ff09029177a296ce950 P 056f6a42190a46df97a5104db44e9d64 reported cstate change: term changed from 0 to 1, leader changed from <none> to 056f6a42190a46df97a5104db44e9d64 (127.12.174.130). New cstate: current_term: 1 leader_uuid: "056f6a42190a46df97a5104db44e9d64" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:43.512320 13864 tablet_bootstrap.cc:654] T 3ba6e60509e5462f984736f50675cd17 P 056f6a42190a46df97a5104db44e9d64: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:43.513036 13788 leader_election.cc:304] T e27355722e7349aaa58d6ed2d707b81f P 4018be520383439497fd4ee03342ed73 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4018be520383439497fd4ee03342ed73, d148369c73aa4cd59e17f9d5a0b6c181; no voters: 
I20260709 12:08:43.513332 13568 catalog_manager.cc:5697] T 123f6eb9b1504a40a43955ccad371d4d P 056f6a42190a46df97a5104db44e9d64 reported cstate change: term changed from 0 to 1, leader changed from <none> to 056f6a42190a46df97a5104db44e9d64 (127.12.174.130). New cstate: current_term: 1 leader_uuid: "056f6a42190a46df97a5104db44e9d64" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:43.516445 13862 tablet_bootstrap.cc:492] T 3ba6e60509e5462f984736f50675cd17 P 4018be520383439497fd4ee03342ed73: No bootstrap required, opened a new log
I20260709 12:08:43.515465 13866 leader_election.cc:290] T e27355722e7349aaa58d6ed2d707b81f P 4018be520383439497fd4ee03342ed73 [CANDIDATE]: Term 1 election: Requested vote from peers d148369c73aa4cd59e17f9d5a0b6c181 (127.12.174.129:37737), 056f6a42190a46df97a5104db44e9d64 (127.12.174.130:44237)
I20260709 12:08:43.514287 13916 raft_consensus.cc:2804] T e27355722e7349aaa58d6ed2d707b81f P 4018be520383439497fd4ee03342ed73 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:43.514047 13863 consensus_queue.cc:260] T b3984e1dba884ec19c9eecad67e9487a P d148369c73aa4cd59e17f9d5a0b6c181 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } }
I20260709 12:08:43.519922 13863 ts_tablet_manager.cc:1434] T b3984e1dba884ec19c9eecad67e9487a P d148369c73aa4cd59e17f9d5a0b6c181: Time spent starting tablet: real 0.037s	user 0.007s	sys 0.000s
I20260709 12:08:43.520957 13863 tablet_bootstrap.cc:492] T 3ba6e60509e5462f984736f50675cd17 P d148369c73aa4cd59e17f9d5a0b6c181: Bootstrap starting.
I20260709 12:08:43.523918 13916 raft_consensus.cc:697] T e27355722e7349aaa58d6ed2d707b81f P 4018be520383439497fd4ee03342ed73 [term 1 LEADER]: Becoming Leader. State: Replica: 4018be520383439497fd4ee03342ed73, State: Running, Role: LEADER
I20260709 12:08:43.524966 13916 consensus_queue.cc:237] T e27355722e7349aaa58d6ed2d707b81f P 4018be520383439497fd4ee03342ed73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } }
I20260709 12:08:43.517174 13862 ts_tablet_manager.cc:1403] T 3ba6e60509e5462f984736f50675cd17 P 4018be520383439497fd4ee03342ed73: Time spent bootstrapping tablet: real 0.078s	user 0.016s	sys 0.003s
I20260709 12:08:43.528543 13862 raft_consensus.cc:359] T 3ba6e60509e5462f984736f50675cd17 P 4018be520383439497fd4ee03342ed73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } }
I20260709 12:08:43.529501 13862 raft_consensus.cc:385] T 3ba6e60509e5462f984736f50675cd17 P 4018be520383439497fd4ee03342ed73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:43.529863 13862 raft_consensus.cc:740] T 3ba6e60509e5462f984736f50675cd17 P 4018be520383439497fd4ee03342ed73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4018be520383439497fd4ee03342ed73, State: Initialized, Role: FOLLOWER
I20260709 12:08:43.531286 13862 consensus_queue.cc:260] T 3ba6e60509e5462f984736f50675cd17 P 4018be520383439497fd4ee03342ed73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } }
I20260709 12:08:43.533468 13862 ts_tablet_manager.cc:1434] T 3ba6e60509e5462f984736f50675cd17 P 4018be520383439497fd4ee03342ed73: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:08:43.534004 13908 raft_consensus.cc:515] T 041529b194374c228a48aaee162ec1d9 P 4018be520383439497fd4ee03342ed73 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } }
I20260709 12:08:43.533322 13569 catalog_manager.cc:5697] T 1e31988a87d94a7d879cb9552131429d P 4018be520383439497fd4ee03342ed73 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4018be520383439497fd4ee03342ed73 (127.12.174.131). New cstate: current_term: 1 leader_uuid: "4018be520383439497fd4ee03342ed73" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:43.534523 13862 tablet_bootstrap.cc:492] T 089d82b1caf54ee3b23be8f48cb46605 P 4018be520383439497fd4ee03342ed73: Bootstrap starting.
I20260709 12:08:43.536751 13672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041529b194374c228a48aaee162ec1d9" candidate_uuid: "4018be520383439497fd4ee03342ed73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d148369c73aa4cd59e17f9d5a0b6c181"
I20260709 12:08:43.537127 13746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041529b194374c228a48aaee162ec1d9" candidate_uuid: "4018be520383439497fd4ee03342ed73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "056f6a42190a46df97a5104db44e9d64"
I20260709 12:08:43.537580 13672 raft_consensus.cc:3060] T 041529b194374c228a48aaee162ec1d9 P d148369c73aa4cd59e17f9d5a0b6c181 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:43.538384 13908 leader_election.cc:290] T 041529b194374c228a48aaee162ec1d9 P 4018be520383439497fd4ee03342ed73 [CANDIDATE]: Term 1 election: Requested vote from peers d148369c73aa4cd59e17f9d5a0b6c181 (127.12.174.129:37737), 056f6a42190a46df97a5104db44e9d64 (127.12.174.130:44237)
I20260709 12:08:43.537710 13746 raft_consensus.cc:3060] T 041529b194374c228a48aaee162ec1d9 P 056f6a42190a46df97a5104db44e9d64 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:43.538964 13863 tablet_bootstrap.cc:654] T 3ba6e60509e5462f984736f50675cd17 P d148369c73aa4cd59e17f9d5a0b6c181: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:43.546563 13746 raft_consensus.cc:2468] T 041529b194374c228a48aaee162ec1d9 P 056f6a42190a46df97a5104db44e9d64 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4018be520383439497fd4ee03342ed73 in term 1.
I20260709 12:08:43.546563 13672 raft_consensus.cc:2468] T 041529b194374c228a48aaee162ec1d9 P d148369c73aa4cd59e17f9d5a0b6c181 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4018be520383439497fd4ee03342ed73 in term 1.
I20260709 12:08:43.548132 13785 leader_election.cc:304] T 041529b194374c228a48aaee162ec1d9 P 4018be520383439497fd4ee03342ed73 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 056f6a42190a46df97a5104db44e9d64, 4018be520383439497fd4ee03342ed73; no voters: 
I20260709 12:08:43.549153 13862 tablet_bootstrap.cc:654] T 089d82b1caf54ee3b23be8f48cb46605 P 4018be520383439497fd4ee03342ed73: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:43.549650 13908 raft_consensus.cc:2804] T 041529b194374c228a48aaee162ec1d9 P 4018be520383439497fd4ee03342ed73 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:43.550189 13908 raft_consensus.cc:697] T 041529b194374c228a48aaee162ec1d9 P 4018be520383439497fd4ee03342ed73 [term 1 LEADER]: Becoming Leader. State: Replica: 4018be520383439497fd4ee03342ed73, State: Running, Role: LEADER
I20260709 12:08:43.550956 13908 consensus_queue.cc:237] T 041529b194374c228a48aaee162ec1d9 P 4018be520383439497fd4ee03342ed73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } }
I20260709 12:08:43.561406 13908 raft_consensus.cc:493] T 10708055ab264a66aadf75fe80ae59f8 P 4018be520383439497fd4ee03342ed73 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:43.561971 13908 raft_consensus.cc:515] T 10708055ab264a66aadf75fe80ae59f8 P 4018be520383439497fd4ee03342ed73 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } } peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } }
I20260709 12:08:43.565295 13863 tablet_bootstrap.cc:492] T 3ba6e60509e5462f984736f50675cd17 P d148369c73aa4cd59e17f9d5a0b6c181: No bootstrap required, opened a new log
I20260709 12:08:43.565433 13916 raft_consensus.cc:493] T b3984e1dba884ec19c9eecad67e9487a P 4018be520383439497fd4ee03342ed73 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:43.566072 13863 ts_tablet_manager.cc:1403] T 3ba6e60509e5462f984736f50675cd17 P d148369c73aa4cd59e17f9d5a0b6c181: Time spent bootstrapping tablet: real 0.045s	user 0.013s	sys 0.002s
I20260709 12:08:43.566000 13916 raft_consensus.cc:515] T b3984e1dba884ec19c9eecad67e9487a P 4018be520383439497fd4ee03342ed73 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } }
I20260709 12:08:43.566638 13746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10708055ab264a66aadf75fe80ae59f8" candidate_uuid: "4018be520383439497fd4ee03342ed73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "056f6a42190a46df97a5104db44e9d64" is_pre_election: true
I20260709 12:08:43.567297 13746 raft_consensus.cc:2468] T 10708055ab264a66aadf75fe80ae59f8 P 056f6a42190a46df97a5104db44e9d64 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4018be520383439497fd4ee03342ed73 in term 0.
I20260709 12:08:43.567461 13864 tablet_bootstrap.cc:492] T 3ba6e60509e5462f984736f50675cd17 P 056f6a42190a46df97a5104db44e9d64: No bootstrap required, opened a new log
I20260709 12:08:43.568387 13916 leader_election.cc:290] T b3984e1dba884ec19c9eecad67e9487a P 4018be520383439497fd4ee03342ed73 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d148369c73aa4cd59e17f9d5a0b6c181 (127.12.174.129:37737), 056f6a42190a46df97a5104db44e9d64 (127.12.174.130:44237)
I20260709 12:08:43.568526 13864 ts_tablet_manager.cc:1403] T 3ba6e60509e5462f984736f50675cd17 P 056f6a42190a46df97a5104db44e9d64: Time spent bootstrapping tablet: real 0.063s	user 0.013s	sys 0.002s
I20260709 12:08:43.569199 13673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3984e1dba884ec19c9eecad67e9487a" candidate_uuid: "4018be520383439497fd4ee03342ed73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" is_pre_election: true
I20260709 12:08:43.569367 13863 raft_consensus.cc:359] T 3ba6e60509e5462f984736f50675cd17 P d148369c73aa4cd59e17f9d5a0b6c181 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } }
I20260709 12:08:43.569864 13673 raft_consensus.cc:2468] T b3984e1dba884ec19c9eecad67e9487a P d148369c73aa4cd59e17f9d5a0b6c181 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4018be520383439497fd4ee03342ed73 in term 0.
I20260709 12:08:43.570233 13863 raft_consensus.cc:385] T 3ba6e60509e5462f984736f50675cd17 P d148369c73aa4cd59e17f9d5a0b6c181 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:43.570542 13863 raft_consensus.cc:740] T 3ba6e60509e5462f984736f50675cd17 P d148369c73aa4cd59e17f9d5a0b6c181 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d148369c73aa4cd59e17f9d5a0b6c181, State: Initialized, Role: FOLLOWER
I20260709 12:08:43.571086 13747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3984e1dba884ec19c9eecad67e9487a" candidate_uuid: "4018be520383439497fd4ee03342ed73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "056f6a42190a46df97a5104db44e9d64" is_pre_election: true
I20260709 12:08:43.571205 13788 leader_election.cc:304] T b3984e1dba884ec19c9eecad67e9487a P 4018be520383439497fd4ee03342ed73 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4018be520383439497fd4ee03342ed73, d148369c73aa4cd59e17f9d5a0b6c181; no voters: 
I20260709 12:08:43.571754 13864 raft_consensus.cc:359] T 3ba6e60509e5462f984736f50675cd17 P 056f6a42190a46df97a5104db44e9d64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } }
I20260709 12:08:43.571949 13747 raft_consensus.cc:2468] T b3984e1dba884ec19c9eecad67e9487a P 056f6a42190a46df97a5104db44e9d64 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4018be520383439497fd4ee03342ed73 in term 0.
I20260709 12:08:43.572181 13908 leader_election.cc:290] T 10708055ab264a66aadf75fe80ae59f8 P 4018be520383439497fd4ee03342ed73 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d148369c73aa4cd59e17f9d5a0b6c181 (127.12.174.129:37737), 056f6a42190a46df97a5104db44e9d64 (127.12.174.130:44237)
I20260709 12:08:43.572608 13864 raft_consensus.cc:385] T 3ba6e60509e5462f984736f50675cd17 P 056f6a42190a46df97a5104db44e9d64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:43.572932 13864 raft_consensus.cc:740] T 3ba6e60509e5462f984736f50675cd17 P 056f6a42190a46df97a5104db44e9d64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 056f6a42190a46df97a5104db44e9d64, State: Initialized, Role: FOLLOWER
I20260709 12:08:43.573071 13785 leader_election.cc:304] T 10708055ab264a66aadf75fe80ae59f8 P 4018be520383439497fd4ee03342ed73 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 056f6a42190a46df97a5104db44e9d64, 4018be520383439497fd4ee03342ed73; no voters: 
I20260709 12:08:43.571431 13863 consensus_queue.cc:260] T 3ba6e60509e5462f984736f50675cd17 P d148369c73aa4cd59e17f9d5a0b6c181 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } }
I20260709 12:08:43.573771 13864 consensus_queue.cc:260] T 3ba6e60509e5462f984736f50675cd17 P 056f6a42190a46df97a5104db44e9d64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } }
I20260709 12:08:43.574816 13917 raft_consensus.cc:2804] T 10708055ab264a66aadf75fe80ae59f8 P 4018be520383439497fd4ee03342ed73 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:43.575281 13917 raft_consensus.cc:493] T 10708055ab264a66aadf75fe80ae59f8 P 4018be520383439497fd4ee03342ed73 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:43.572749 13908 raft_consensus.cc:2804] T b3984e1dba884ec19c9eecad67e9487a P 4018be520383439497fd4ee03342ed73 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:43.575718 13917 raft_consensus.cc:3060] T 10708055ab264a66aadf75fe80ae59f8 P 4018be520383439497fd4ee03342ed73 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:43.577198 13862 tablet_bootstrap.cc:492] T 089d82b1caf54ee3b23be8f48cb46605 P 4018be520383439497fd4ee03342ed73: No bootstrap required, opened a new log
I20260709 12:08:43.577713 13862 ts_tablet_manager.cc:1403] T 089d82b1caf54ee3b23be8f48cb46605 P 4018be520383439497fd4ee03342ed73: Time spent bootstrapping tablet: real 0.043s	user 0.011s	sys 0.003s
I20260709 12:08:43.575884 13908 raft_consensus.cc:493] T b3984e1dba884ec19c9eecad67e9487a P 4018be520383439497fd4ee03342ed73 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:43.579062 13908 raft_consensus.cc:3060] T b3984e1dba884ec19c9eecad67e9487a P 4018be520383439497fd4ee03342ed73 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:43.583571 13863 ts_tablet_manager.cc:1434] T 3ba6e60509e5462f984736f50675cd17 P d148369c73aa4cd59e17f9d5a0b6c181: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 12:08:43.587112 13908 raft_consensus.cc:515] T b3984e1dba884ec19c9eecad67e9487a P 4018be520383439497fd4ee03342ed73 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } }
I20260709 12:08:43.588667 13864 ts_tablet_manager.cc:1434] T 3ba6e60509e5462f984736f50675cd17 P 056f6a42190a46df97a5104db44e9d64: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 12:08:43.590267 13673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3984e1dba884ec19c9eecad67e9487a" candidate_uuid: "4018be520383439497fd4ee03342ed73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d148369c73aa4cd59e17f9d5a0b6c181"
I20260709 12:08:43.590652 13747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3984e1dba884ec19c9eecad67e9487a" candidate_uuid: "4018be520383439497fd4ee03342ed73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "056f6a42190a46df97a5104db44e9d64"
I20260709 12:08:43.590894 13673 raft_consensus.cc:3060] T b3984e1dba884ec19c9eecad67e9487a P d148369c73aa4cd59e17f9d5a0b6c181 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:43.591282 13747 raft_consensus.cc:3060] T b3984e1dba884ec19c9eecad67e9487a P 056f6a42190a46df97a5104db44e9d64 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:43.590938 13862 raft_consensus.cc:359] T 089d82b1caf54ee3b23be8f48cb46605 P 4018be520383439497fd4ee03342ed73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } }
I20260709 12:08:43.591786 13862 raft_consensus.cc:385] T 089d82b1caf54ee3b23be8f48cb46605 P 4018be520383439497fd4ee03342ed73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:43.592085 13862 raft_consensus.cc:740] T 089d82b1caf54ee3b23be8f48cb46605 P 4018be520383439497fd4ee03342ed73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4018be520383439497fd4ee03342ed73, State: Initialized, Role: FOLLOWER
I20260709 12:08:43.590454 13569 catalog_manager.cc:5697] T e27355722e7349aaa58d6ed2d707b81f P 4018be520383439497fd4ee03342ed73 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4018be520383439497fd4ee03342ed73 (127.12.174.131). New cstate: current_term: 1 leader_uuid: "4018be520383439497fd4ee03342ed73" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:43.594681 13569 catalog_manager.cc:5697] T 041529b194374c228a48aaee162ec1d9 P 4018be520383439497fd4ee03342ed73 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4018be520383439497fd4ee03342ed73 (127.12.174.131). New cstate: current_term: 1 leader_uuid: "4018be520383439497fd4ee03342ed73" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:43.596335 13917 raft_consensus.cc:515] T 10708055ab264a66aadf75fe80ae59f8 P 4018be520383439497fd4ee03342ed73 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } } peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } }
I20260709 12:08:43.592971 13862 consensus_queue.cc:260] T 089d82b1caf54ee3b23be8f48cb46605 P 4018be520383439497fd4ee03342ed73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } }
I20260709 12:08:43.599200 13917 leader_election.cc:290] T 10708055ab264a66aadf75fe80ae59f8 P 4018be520383439497fd4ee03342ed73 [CANDIDATE]: Term 1 election: Requested vote from peers d148369c73aa4cd59e17f9d5a0b6c181 (127.12.174.129:37737), 056f6a42190a46df97a5104db44e9d64 (127.12.174.130:44237)
I20260709 12:08:43.575532 13672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10708055ab264a66aadf75fe80ae59f8" candidate_uuid: "4018be520383439497fd4ee03342ed73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" is_pre_election: true
I20260709 12:08:43.600340 13862 ts_tablet_manager.cc:1434] T 089d82b1caf54ee3b23be8f48cb46605 P 4018be520383439497fd4ee03342ed73: Time spent starting tablet: real 0.022s	user 0.004s	sys 0.002s
I20260709 12:08:43.600647 13672 raft_consensus.cc:2468] T 10708055ab264a66aadf75fe80ae59f8 P d148369c73aa4cd59e17f9d5a0b6c181 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4018be520383439497fd4ee03342ed73 in term 0.
I20260709 12:08:43.600890 13746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10708055ab264a66aadf75fe80ae59f8" candidate_uuid: "4018be520383439497fd4ee03342ed73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "056f6a42190a46df97a5104db44e9d64"
I20260709 12:08:43.601498 13746 raft_consensus.cc:3060] T 10708055ab264a66aadf75fe80ae59f8 P 056f6a42190a46df97a5104db44e9d64 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:43.598966 13747 raft_consensus.cc:2468] T b3984e1dba884ec19c9eecad67e9487a P 056f6a42190a46df97a5104db44e9d64 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4018be520383439497fd4ee03342ed73 in term 1.
I20260709 12:08:43.602571 13908 leader_election.cc:290] T b3984e1dba884ec19c9eecad67e9487a P 4018be520383439497fd4ee03342ed73 [CANDIDATE]: Term 1 election: Requested vote from peers d148369c73aa4cd59e17f9d5a0b6c181 (127.12.174.129:37737), 056f6a42190a46df97a5104db44e9d64 (127.12.174.130:44237)
I20260709 12:08:43.602972 13785 leader_election.cc:304] T b3984e1dba884ec19c9eecad67e9487a P 4018be520383439497fd4ee03342ed73 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 056f6a42190a46df97a5104db44e9d64, 4018be520383439497fd4ee03342ed73; no voters: 
I20260709 12:08:43.604112 13896 raft_consensus.cc:493] T 3ba6e60509e5462f984736f50675cd17 P 056f6a42190a46df97a5104db44e9d64 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:43.604503 13896 raft_consensus.cc:515] T 3ba6e60509e5462f984736f50675cd17 P 056f6a42190a46df97a5104db44e9d64 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } }
I20260709 12:08:43.605115 13672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10708055ab264a66aadf75fe80ae59f8" candidate_uuid: "4018be520383439497fd4ee03342ed73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d148369c73aa4cd59e17f9d5a0b6c181"
I20260709 12:08:43.605786 13672 raft_consensus.cc:3060] T 10708055ab264a66aadf75fe80ae59f8 P d148369c73aa4cd59e17f9d5a0b6c181 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:43.605309 13908 raft_consensus.cc:2804] T b3984e1dba884ec19c9eecad67e9487a P 4018be520383439497fd4ee03342ed73 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:43.606518 13908 raft_consensus.cc:697] T b3984e1dba884ec19c9eecad67e9487a P 4018be520383439497fd4ee03342ed73 [term 1 LEADER]: Becoming Leader. State: Replica: 4018be520383439497fd4ee03342ed73, State: Running, Role: LEADER
I20260709 12:08:43.606899 13896 leader_election.cc:290] T 3ba6e60509e5462f984736f50675cd17 P 056f6a42190a46df97a5104db44e9d64 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d148369c73aa4cd59e17f9d5a0b6c181 (127.12.174.129:37737), 4018be520383439497fd4ee03342ed73 (127.12.174.131:46793)
I20260709 12:08:43.607234 13673 raft_consensus.cc:2468] T b3984e1dba884ec19c9eecad67e9487a P d148369c73aa4cd59e17f9d5a0b6c181 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4018be520383439497fd4ee03342ed73 in term 1.
I20260709 12:08:43.608829 13822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba6e60509e5462f984736f50675cd17" candidate_uuid: "056f6a42190a46df97a5104db44e9d64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4018be520383439497fd4ee03342ed73" is_pre_election: true
I20260709 12:08:43.609018 13671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba6e60509e5462f984736f50675cd17" candidate_uuid: "056f6a42190a46df97a5104db44e9d64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" is_pre_election: true
I20260709 12:08:43.609519 13822 raft_consensus.cc:2468] T 3ba6e60509e5462f984736f50675cd17 P 4018be520383439497fd4ee03342ed73 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 056f6a42190a46df97a5104db44e9d64 in term 0.
I20260709 12:08:43.609760 13671 raft_consensus.cc:2468] T 3ba6e60509e5462f984736f50675cd17 P d148369c73aa4cd59e17f9d5a0b6c181 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 056f6a42190a46df97a5104db44e9d64 in term 0.
I20260709 12:08:43.608983 13908 consensus_queue.cc:237] T b3984e1dba884ec19c9eecad67e9487a P 4018be520383439497fd4ee03342ed73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } }
I20260709 12:08:43.611241 13714 leader_election.cc:304] T 3ba6e60509e5462f984736f50675cd17 P 056f6a42190a46df97a5104db44e9d64 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 056f6a42190a46df97a5104db44e9d64, 4018be520383439497fd4ee03342ed73; no voters: 
I20260709 12:08:43.611977 13896 raft_consensus.cc:2804] T 3ba6e60509e5462f984736f50675cd17 P 056f6a42190a46df97a5104db44e9d64 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:43.612334 13896 raft_consensus.cc:493] T 3ba6e60509e5462f984736f50675cd17 P 056f6a42190a46df97a5104db44e9d64 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:43.612677 13896 raft_consensus.cc:3060] T 3ba6e60509e5462f984736f50675cd17 P 056f6a42190a46df97a5104db44e9d64 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:43.615896 13746 raft_consensus.cc:2468] T 10708055ab264a66aadf75fe80ae59f8 P 056f6a42190a46df97a5104db44e9d64 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4018be520383439497fd4ee03342ed73 in term 1.
I20260709 12:08:43.618057 13785 leader_election.cc:304] T 10708055ab264a66aadf75fe80ae59f8 P 4018be520383439497fd4ee03342ed73 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 056f6a42190a46df97a5104db44e9d64, 4018be520383439497fd4ee03342ed73; no voters: 
I20260709 12:08:43.621763 13908 raft_consensus.cc:2804] T 10708055ab264a66aadf75fe80ae59f8 P 4018be520383439497fd4ee03342ed73 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:43.621964 13672 raft_consensus.cc:2468] T 10708055ab264a66aadf75fe80ae59f8 P d148369c73aa4cd59e17f9d5a0b6c181 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4018be520383439497fd4ee03342ed73 in term 1.
I20260709 12:08:43.622545 13908 raft_consensus.cc:697] T 10708055ab264a66aadf75fe80ae59f8 P 4018be520383439497fd4ee03342ed73 [term 1 LEADER]: Becoming Leader. State: Replica: 4018be520383439497fd4ee03342ed73, State: Running, Role: LEADER
I20260709 12:08:43.623464 13908 consensus_queue.cc:237] T 10708055ab264a66aadf75fe80ae59f8 P 4018be520383439497fd4ee03342ed73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } } peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } }
I20260709 12:08:43.627175 13570 catalog_manager.cc:5697] T b3984e1dba884ec19c9eecad67e9487a P 4018be520383439497fd4ee03342ed73 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4018be520383439497fd4ee03342ed73 (127.12.174.131). New cstate: current_term: 1 leader_uuid: "4018be520383439497fd4ee03342ed73" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:43.630434 13896 raft_consensus.cc:515] T 3ba6e60509e5462f984736f50675cd17 P 056f6a42190a46df97a5104db44e9d64 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } }
I20260709 12:08:43.635787 13896 leader_election.cc:290] T 3ba6e60509e5462f984736f50675cd17 P 056f6a42190a46df97a5104db44e9d64 [CANDIDATE]: Term 1 election: Requested vote from peers d148369c73aa4cd59e17f9d5a0b6c181 (127.12.174.129:37737), 4018be520383439497fd4ee03342ed73 (127.12.174.131:46793)
I20260709 12:08:43.636601 13672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba6e60509e5462f984736f50675cd17" candidate_uuid: "056f6a42190a46df97a5104db44e9d64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d148369c73aa4cd59e17f9d5a0b6c181"
I20260709 12:08:43.636878 13822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba6e60509e5462f984736f50675cd17" candidate_uuid: "056f6a42190a46df97a5104db44e9d64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4018be520383439497fd4ee03342ed73"
I20260709 12:08:43.637306 13672 raft_consensus.cc:3060] T 3ba6e60509e5462f984736f50675cd17 P d148369c73aa4cd59e17f9d5a0b6c181 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:43.637401 13822 raft_consensus.cc:3060] T 3ba6e60509e5462f984736f50675cd17 P 4018be520383439497fd4ee03342ed73 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:43.644678 13672 raft_consensus.cc:2468] T 3ba6e60509e5462f984736f50675cd17 P d148369c73aa4cd59e17f9d5a0b6c181 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 056f6a42190a46df97a5104db44e9d64 in term 1.
I20260709 12:08:43.645519 13822 raft_consensus.cc:2468] T 3ba6e60509e5462f984736f50675cd17 P 4018be520383439497fd4ee03342ed73 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 056f6a42190a46df97a5104db44e9d64 in term 1.
I20260709 12:08:43.645936 13714 leader_election.cc:304] T 3ba6e60509e5462f984736f50675cd17 P 056f6a42190a46df97a5104db44e9d64 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 056f6a42190a46df97a5104db44e9d64, d148369c73aa4cd59e17f9d5a0b6c181; no voters: 
I20260709 12:08:43.645516 13569 catalog_manager.cc:5697] T 10708055ab264a66aadf75fe80ae59f8 P 4018be520383439497fd4ee03342ed73 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4018be520383439497fd4ee03342ed73 (127.12.174.131). New cstate: current_term: 1 leader_uuid: "4018be520383439497fd4ee03342ed73" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:43.647641 13871 raft_consensus.cc:2804] T 3ba6e60509e5462f984736f50675cd17 P 056f6a42190a46df97a5104db44e9d64 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:43.648177 13871 raft_consensus.cc:697] T 3ba6e60509e5462f984736f50675cd17 P 056f6a42190a46df97a5104db44e9d64 [term 1 LEADER]: Becoming Leader. State: Replica: 056f6a42190a46df97a5104db44e9d64, State: Running, Role: LEADER
I20260709 12:08:43.649052 13871 consensus_queue.cc:237] T 3ba6e60509e5462f984736f50675cd17 P 056f6a42190a46df97a5104db44e9d64 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } }
I20260709 12:08:43.650302 13896 consensus_queue.cc:1048] T 6c145809834e41bea496b130cfda3cac P 056f6a42190a46df97a5104db44e9d64 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:43.658245 13570 catalog_manager.cc:5697] T 3ba6e60509e5462f984736f50675cd17 P 056f6a42190a46df97a5104db44e9d64 reported cstate change: term changed from 0 to 1, leader changed from <none> to 056f6a42190a46df97a5104db44e9d64 (127.12.174.130). New cstate: current_term: 1 leader_uuid: "056f6a42190a46df97a5104db44e9d64" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:43.667513 13892 consensus_queue.cc:1048] T 6c145809834e41bea496b130cfda3cac P 056f6a42190a46df97a5104db44e9d64 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:43.713179 13892 raft_consensus.cc:493] T 1e31988a87d94a7d879cb9552131429d P 056f6a42190a46df97a5104db44e9d64 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:43.713649 13892 raft_consensus.cc:515] T 1e31988a87d94a7d879cb9552131429d P 056f6a42190a46df97a5104db44e9d64 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } }
I20260709 12:08:43.715358 13892 leader_election.cc:290] T 1e31988a87d94a7d879cb9552131429d P 056f6a42190a46df97a5104db44e9d64 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d148369c73aa4cd59e17f9d5a0b6c181 (127.12.174.129:37737), 4018be520383439497fd4ee03342ed73 (127.12.174.131:46793)
I20260709 12:08:43.716290 13672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31988a87d94a7d879cb9552131429d" candidate_uuid: "056f6a42190a46df97a5104db44e9d64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" is_pre_election: true
I20260709 12:08:43.716534 13822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31988a87d94a7d879cb9552131429d" candidate_uuid: "056f6a42190a46df97a5104db44e9d64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4018be520383439497fd4ee03342ed73" is_pre_election: true
I20260709 12:08:43.717160 13672 raft_consensus.cc:2393] T 1e31988a87d94a7d879cb9552131429d P d148369c73aa4cd59e17f9d5a0b6c181 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 056f6a42190a46df97a5104db44e9d64 in current term 1: Already voted for candidate 4018be520383439497fd4ee03342ed73 in this term.
I20260709 12:08:43.718220 13714 leader_election.cc:304] T 1e31988a87d94a7d879cb9552131429d P 056f6a42190a46df97a5104db44e9d64 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 056f6a42190a46df97a5104db44e9d64; no voters: 4018be520383439497fd4ee03342ed73, d148369c73aa4cd59e17f9d5a0b6c181
I20260709 12:08:43.718874 13892 raft_consensus.cc:3060] T 1e31988a87d94a7d879cb9552131429d P 056f6a42190a46df97a5104db44e9d64 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:43.724025 13892 raft_consensus.cc:2749] T 1e31988a87d94a7d879cb9552131429d P 056f6a42190a46df97a5104db44e9d64 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:43.726516 13908 raft_consensus.cc:493] T 089d82b1caf54ee3b23be8f48cb46605 P 4018be520383439497fd4ee03342ed73 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:43.727068 13908 raft_consensus.cc:515] T 089d82b1caf54ee3b23be8f48cb46605 P 4018be520383439497fd4ee03342ed73 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } }
I20260709 12:08:43.729136 13908 leader_election.cc:290] T 089d82b1caf54ee3b23be8f48cb46605 P 4018be520383439497fd4ee03342ed73 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d148369c73aa4cd59e17f9d5a0b6c181 (127.12.174.129:37737), 056f6a42190a46df97a5104db44e9d64 (127.12.174.130:44237)
I20260709 12:08:43.729981 13672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089d82b1caf54ee3b23be8f48cb46605" candidate_uuid: "4018be520383439497fd4ee03342ed73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" is_pre_election: true
I20260709 12:08:43.730352 13746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089d82b1caf54ee3b23be8f48cb46605" candidate_uuid: "4018be520383439497fd4ee03342ed73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "056f6a42190a46df97a5104db44e9d64" is_pre_election: true
I20260709 12:08:43.731097 13746 raft_consensus.cc:2393] T 089d82b1caf54ee3b23be8f48cb46605 P 056f6a42190a46df97a5104db44e9d64 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4018be520383439497fd4ee03342ed73 in current term 1: Already voted for candidate d148369c73aa4cd59e17f9d5a0b6c181 in this term.
I20260709 12:08:43.731992 13785 leader_election.cc:304] T 089d82b1caf54ee3b23be8f48cb46605 P 4018be520383439497fd4ee03342ed73 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4018be520383439497fd4ee03342ed73; no voters: 056f6a42190a46df97a5104db44e9d64, d148369c73aa4cd59e17f9d5a0b6c181
I20260709 12:08:43.732656 13908 raft_consensus.cc:3060] T 089d82b1caf54ee3b23be8f48cb46605 P 4018be520383439497fd4ee03342ed73 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:43.738739 13908 raft_consensus.cc:2749] T 089d82b1caf54ee3b23be8f48cb46605 P 4018be520383439497fd4ee03342ed73 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:43.792853 13822 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "10708055ab264a66aadf75fe80ae59f8"
dest_uuid: "4018be520383439497fd4ee03342ed73"
mode: GRACEFUL
new_leader_uuid: "d148369c73aa4cd59e17f9d5a0b6c181"
 from {username='slave'} at 127.0.0.1:48036
I20260709 12:08:43.793435 13822 raft_consensus.cc:606] T 10708055ab264a66aadf75fe80ae59f8 P 4018be520383439497fd4ee03342ed73 [term 1 LEADER]: Received request to transfer leadership to TS d148369c73aa4cd59e17f9d5a0b6c181
I20260709 12:08:43.798835 13822 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1e31988a87d94a7d879cb9552131429d"
dest_uuid: "4018be520383439497fd4ee03342ed73"
mode: GRACEFUL
new_leader_uuid: "d148369c73aa4cd59e17f9d5a0b6c181"
 from {username='slave'} at 127.0.0.1:48036
I20260709 12:08:43.799353 13822 raft_consensus.cc:606] T 1e31988a87d94a7d879cb9552131429d P 4018be520383439497fd4ee03342ed73 [term 1 LEADER]: Received request to transfer leadership to TS d148369c73aa4cd59e17f9d5a0b6c181
I20260709 12:08:43.812408 13746 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6c145809834e41bea496b130cfda3cac"
dest_uuid: "056f6a42190a46df97a5104db44e9d64"
mode: GRACEFUL
new_leader_uuid: "d148369c73aa4cd59e17f9d5a0b6c181"
 from {username='slave'} at 127.0.0.1:53508
I20260709 12:08:43.812934 13746 raft_consensus.cc:606] T 6c145809834e41bea496b130cfda3cac P 056f6a42190a46df97a5104db44e9d64 [term 1 LEADER]: Received request to transfer leadership to TS d148369c73aa4cd59e17f9d5a0b6c181
I20260709 12:08:43.818466 13746 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3ba6e60509e5462f984736f50675cd17"
dest_uuid: "056f6a42190a46df97a5104db44e9d64"
mode: GRACEFUL
new_leader_uuid: "d148369c73aa4cd59e17f9d5a0b6c181"
 from {username='slave'} at 127.0.0.1:53508
I20260709 12:08:43.819020 13746 raft_consensus.cc:606] T 3ba6e60509e5462f984736f50675cd17 P 056f6a42190a46df97a5104db44e9d64 [term 1 LEADER]: Received request to transfer leadership to TS d148369c73aa4cd59e17f9d5a0b6c181
I20260709 12:08:43.825169 13822 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e27355722e7349aaa58d6ed2d707b81f"
dest_uuid: "4018be520383439497fd4ee03342ed73"
mode: GRACEFUL
new_leader_uuid: "d148369c73aa4cd59e17f9d5a0b6c181"
 from {username='slave'} at 127.0.0.1:48036
I20260709 12:08:43.825723 13822 raft_consensus.cc:606] T e27355722e7349aaa58d6ed2d707b81f P 4018be520383439497fd4ee03342ed73 [term 1 LEADER]: Received request to transfer leadership to TS d148369c73aa4cd59e17f9d5a0b6c181
I20260709 12:08:43.831025 13822 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "041529b194374c228a48aaee162ec1d9"
dest_uuid: "4018be520383439497fd4ee03342ed73"
mode: GRACEFUL
new_leader_uuid: "056f6a42190a46df97a5104db44e9d64"
 from {username='slave'} at 127.0.0.1:48036
I20260709 12:08:43.831543 13822 raft_consensus.cc:606] T 041529b194374c228a48aaee162ec1d9 P 4018be520383439497fd4ee03342ed73 [term 1 LEADER]: Received request to transfer leadership to TS 056f6a42190a46df97a5104db44e9d64
I20260709 12:08:43.846210 13672 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "089d82b1caf54ee3b23be8f48cb46605"
dest_uuid: "d148369c73aa4cd59e17f9d5a0b6c181"
mode: GRACEFUL
new_leader_uuid: "056f6a42190a46df97a5104db44e9d64"
 from {username='slave'} at 127.0.0.1:45770
I20260709 12:08:43.846869 13672 raft_consensus.cc:606] T 089d82b1caf54ee3b23be8f48cb46605 P d148369c73aa4cd59e17f9d5a0b6c181 [term 1 LEADER]: Received request to transfer leadership to TS 056f6a42190a46df97a5104db44e9d64
I20260709 12:08:43.892241 13908 consensus_queue.cc:1048] T 1e31988a87d94a7d879cb9552131429d P 4018be520383439497fd4ee03342ed73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:43.911890 13917 raft_consensus.cc:993] T 1e31988a87d94a7d879cb9552131429d P 4018be520383439497fd4ee03342ed73: : Instructing follower d148369c73aa4cd59e17f9d5a0b6c181 to start an election
I20260709 12:08:43.914104 13916 raft_consensus.cc:1081] T 1e31988a87d94a7d879cb9552131429d P 4018be520383439497fd4ee03342ed73 [term 1 LEADER]: Signalling peer d148369c73aa4cd59e17f9d5a0b6c181 to start an election
I20260709 12:08:43.919317 13671 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1e31988a87d94a7d879cb9552131429d"
dest_uuid: "d148369c73aa4cd59e17f9d5a0b6c181"
 from {username='slave'} at 127.0.0.1:45758
I20260709 12:08:43.920971 13671 raft_consensus.cc:493] T 1e31988a87d94a7d879cb9552131429d P d148369c73aa4cd59e17f9d5a0b6c181 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:43.921694 13671 raft_consensus.cc:3060] T 1e31988a87d94a7d879cb9552131429d P d148369c73aa4cd59e17f9d5a0b6c181 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:43.927561 13916 consensus_queue.cc:1048] T 1e31988a87d94a7d879cb9552131429d P 4018be520383439497fd4ee03342ed73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:43.936472 13671 raft_consensus.cc:515] T 1e31988a87d94a7d879cb9552131429d P d148369c73aa4cd59e17f9d5a0b6c181 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } }
I20260709 12:08:43.937767 13672 raft_consensus.cc:1240] T 1e31988a87d94a7d879cb9552131429d P d148369c73aa4cd59e17f9d5a0b6c181 [term 2 FOLLOWER]: Rejecting Update request from peer 4018be520383439497fd4ee03342ed73 for earlier term 1. Current term is 2. Ops: []
I20260709 12:08:43.939805 13671 leader_election.cc:290] T 1e31988a87d94a7d879cb9552131429d P d148369c73aa4cd59e17f9d5a0b6c181 [CANDIDATE]: Term 2 election: Requested vote from peers 056f6a42190a46df97a5104db44e9d64 (127.12.174.130:44237), 4018be520383439497fd4ee03342ed73 (127.12.174.131:46793)
I20260709 12:08:43.940075 13746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31988a87d94a7d879cb9552131429d" candidate_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "056f6a42190a46df97a5104db44e9d64"
I20260709 12:08:43.940867 13746 raft_consensus.cc:3060] T 1e31988a87d94a7d879cb9552131429d P 056f6a42190a46df97a5104db44e9d64 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:43.943583 13822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e31988a87d94a7d879cb9552131429d" candidate_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4018be520383439497fd4ee03342ed73"
I20260709 12:08:43.944243 13822 raft_consensus.cc:3055] T 1e31988a87d94a7d879cb9552131429d P 4018be520383439497fd4ee03342ed73 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:43.944281 13916 consensus_queue.cc:1059] T 1e31988a87d94a7d879cb9552131429d P 4018be520383439497fd4ee03342ed73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:43.944701 13822 raft_consensus.cc:740] T 1e31988a87d94a7d879cb9552131429d P 4018be520383439497fd4ee03342ed73 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4018be520383439497fd4ee03342ed73, State: Running, Role: LEADER
I20260709 12:08:43.946216 13822 consensus_queue.cc:260] T 1e31988a87d94a7d879cb9552131429d P 4018be520383439497fd4ee03342ed73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } }
I20260709 12:08:43.947610 13822 raft_consensus.cc:3060] T 1e31988a87d94a7d879cb9552131429d P 4018be520383439497fd4ee03342ed73 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:43.948948 13746 raft_consensus.cc:2468] T 1e31988a87d94a7d879cb9552131429d P 056f6a42190a46df97a5104db44e9d64 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d148369c73aa4cd59e17f9d5a0b6c181 in term 2.
I20260709 12:08:43.950291 13636 leader_election.cc:304] T 1e31988a87d94a7d879cb9552131429d P d148369c73aa4cd59e17f9d5a0b6c181 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 056f6a42190a46df97a5104db44e9d64, d148369c73aa4cd59e17f9d5a0b6c181; no voters: 
I20260709 12:08:43.951130 13870 raft_consensus.cc:2804] T 1e31988a87d94a7d879cb9552131429d P d148369c73aa4cd59e17f9d5a0b6c181 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:43.952311 13870 raft_consensus.cc:697] T 1e31988a87d94a7d879cb9552131429d P d148369c73aa4cd59e17f9d5a0b6c181 [term 2 LEADER]: Becoming Leader. State: Replica: d148369c73aa4cd59e17f9d5a0b6c181, State: Running, Role: LEADER
I20260709 12:08:43.958459 13822 raft_consensus.cc:2468] T 1e31988a87d94a7d879cb9552131429d P 4018be520383439497fd4ee03342ed73 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d148369c73aa4cd59e17f9d5a0b6c181 in term 2.
I20260709 12:08:43.955183 13870 consensus_queue.cc:237] T 1e31988a87d94a7d879cb9552131429d P d148369c73aa4cd59e17f9d5a0b6c181 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } }
W20260709 12:08:43.959052 13917 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 12:08:43.965173 13892 consensus_queue.cc:1048] T 123f6eb9b1504a40a43955ccad371d4d P 056f6a42190a46df97a5104db44e9d64 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:43.966681 13570 catalog_manager.cc:5697] T 1e31988a87d94a7d879cb9552131429d P d148369c73aa4cd59e17f9d5a0b6c181 reported cstate change: term changed from 1 to 2, leader changed from 4018be520383439497fd4ee03342ed73 (127.12.174.131) to d148369c73aa4cd59e17f9d5a0b6c181 (127.12.174.129). New cstate: current_term: 2 leader_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:43.969702 13871 consensus_queue.cc:1048] T 27d8fa0b057c4ff09029177a296ce950 P 056f6a42190a46df97a5104db44e9d64 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:43.970213 13870 consensus_queue.cc:1048] T 089d82b1caf54ee3b23be8f48cb46605 P d148369c73aa4cd59e17f9d5a0b6c181 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:43.982439 13871 consensus_queue.cc:1048] T 27d8fa0b057c4ff09029177a296ce950 P 056f6a42190a46df97a5104db44e9d64 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:43.984184 13871 consensus_queue.cc:1048] T 123f6eb9b1504a40a43955ccad371d4d P 056f6a42190a46df97a5104db44e9d64 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:44.003448 13917 consensus_queue.cc:1048] T 041529b194374c228a48aaee162ec1d9 P 4018be520383439497fd4ee03342ed73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:44.005311 13941 consensus_queue.cc:1048] T 089d82b1caf54ee3b23be8f48cb46605 P d148369c73aa4cd59e17f9d5a0b6c181 [LEADER]: Connected to new peer: Peer: permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:44.037299 13917 consensus_queue.cc:1048] T b3984e1dba884ec19c9eecad67e9487a P 4018be520383439497fd4ee03342ed73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:44.042054 13917 consensus_queue.cc:1048] T b3984e1dba884ec19c9eecad67e9487a P 4018be520383439497fd4ee03342ed73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:44.049882 13917 consensus_queue.cc:1048] T 041529b194374c228a48aaee162ec1d9 P 4018be520383439497fd4ee03342ed73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:44.055398 13870 raft_consensus.cc:993] T 089d82b1caf54ee3b23be8f48cb46605 P d148369c73aa4cd59e17f9d5a0b6c181: : Instructing follower 056f6a42190a46df97a5104db44e9d64 to start an election
I20260709 12:08:44.056082 13941 raft_consensus.cc:1081] T 089d82b1caf54ee3b23be8f48cb46605 P d148369c73aa4cd59e17f9d5a0b6c181 [term 1 LEADER]: Signalling peer 056f6a42190a46df97a5104db44e9d64 to start an election
I20260709 12:08:44.057868 13748 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "089d82b1caf54ee3b23be8f48cb46605"
dest_uuid: "056f6a42190a46df97a5104db44e9d64"
 from {username='slave'} at 127.0.0.1:53500
I20260709 12:08:44.058516 13748 raft_consensus.cc:493] T 089d82b1caf54ee3b23be8f48cb46605 P 056f6a42190a46df97a5104db44e9d64 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:44.058930 13748 raft_consensus.cc:3060] T 089d82b1caf54ee3b23be8f48cb46605 P 056f6a42190a46df97a5104db44e9d64 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:08:44.070669 13944 log.cc:927] Time spent T 123f6eb9b1504a40a43955ccad371d4d P d148369c73aa4cd59e17f9d5a0b6c181: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 12:08:44.073764 13917 consensus_queue.cc:1048] T 10708055ab264a66aadf75fe80ae59f8 P 4018be520383439497fd4ee03342ed73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:44.079454 13748 raft_consensus.cc:515] T 089d82b1caf54ee3b23be8f48cb46605 P 056f6a42190a46df97a5104db44e9d64 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } }
I20260709 12:08:44.088670 13748 leader_election.cc:290] T 089d82b1caf54ee3b23be8f48cb46605 P 056f6a42190a46df97a5104db44e9d64 [CANDIDATE]: Term 2 election: Requested vote from peers d148369c73aa4cd59e17f9d5a0b6c181 (127.12.174.129:37737), 4018be520383439497fd4ee03342ed73 (127.12.174.131:46793)
I20260709 12:08:44.113948 13821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089d82b1caf54ee3b23be8f48cb46605" candidate_uuid: "056f6a42190a46df97a5104db44e9d64" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4018be520383439497fd4ee03342ed73"
I20260709 12:08:44.114898 13821 raft_consensus.cc:3060] T 089d82b1caf54ee3b23be8f48cb46605 P 4018be520383439497fd4ee03342ed73 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:44.095021 13672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089d82b1caf54ee3b23be8f48cb46605" candidate_uuid: "056f6a42190a46df97a5104db44e9d64" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d148369c73aa4cd59e17f9d5a0b6c181"
I20260709 12:08:44.118396 13672 raft_consensus.cc:3055] T 089d82b1caf54ee3b23be8f48cb46605 P d148369c73aa4cd59e17f9d5a0b6c181 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:44.118842 13672 raft_consensus.cc:740] T 089d82b1caf54ee3b23be8f48cb46605 P d148369c73aa4cd59e17f9d5a0b6c181 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d148369c73aa4cd59e17f9d5a0b6c181, State: Running, Role: LEADER
I20260709 12:08:44.119920 13672 consensus_queue.cc:260] T 089d82b1caf54ee3b23be8f48cb46605 P d148369c73aa4cd59e17f9d5a0b6c181 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } }
I20260709 12:08:44.126076 13896 consensus_queue.cc:1048] T 3ba6e60509e5462f984736f50675cd17 P 056f6a42190a46df97a5104db44e9d64 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:44.132913 13916 consensus_queue.cc:1048] T 10708055ab264a66aadf75fe80ae59f8 P 4018be520383439497fd4ee03342ed73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:44.135756 13672 raft_consensus.cc:3060] T 089d82b1caf54ee3b23be8f48cb46605 P d148369c73aa4cd59e17f9d5a0b6c181 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:44.155543 13916 consensus_queue.cc:1048] T e27355722e7349aaa58d6ed2d707b81f P 4018be520383439497fd4ee03342ed73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:44.165786 13672 raft_consensus.cc:2468] T 089d82b1caf54ee3b23be8f48cb46605 P d148369c73aa4cd59e17f9d5a0b6c181 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 056f6a42190a46df97a5104db44e9d64 in term 2.
I20260709 12:08:44.167367 13714 leader_election.cc:304] T 089d82b1caf54ee3b23be8f48cb46605 P 056f6a42190a46df97a5104db44e9d64 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 056f6a42190a46df97a5104db44e9d64, d148369c73aa4cd59e17f9d5a0b6c181; no voters: 
I20260709 12:08:44.168375 13896 raft_consensus.cc:2804] T 089d82b1caf54ee3b23be8f48cb46605 P 056f6a42190a46df97a5104db44e9d64 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:44.168931 13896 raft_consensus.cc:697] T 089d82b1caf54ee3b23be8f48cb46605 P 056f6a42190a46df97a5104db44e9d64 [term 2 LEADER]: Becoming Leader. State: Replica: 056f6a42190a46df97a5104db44e9d64, State: Running, Role: LEADER
I20260709 12:08:44.169927 13896 consensus_queue.cc:237] T 089d82b1caf54ee3b23be8f48cb46605 P 056f6a42190a46df97a5104db44e9d64 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } }
I20260709 12:08:44.171749 13916 consensus_queue.cc:1048] T e27355722e7349aaa58d6ed2d707b81f P 4018be520383439497fd4ee03342ed73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:44.182464 13821 raft_consensus.cc:2468] T 089d82b1caf54ee3b23be8f48cb46605 P 4018be520383439497fd4ee03342ed73 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 056f6a42190a46df97a5104db44e9d64 in term 2.
I20260709 12:08:44.190661 13901 raft_consensus.cc:993] T 041529b194374c228a48aaee162ec1d9 P 4018be520383439497fd4ee03342ed73: : Instructing follower 056f6a42190a46df97a5104db44e9d64 to start an election
I20260709 12:08:44.191403 13908 raft_consensus.cc:1081] T 041529b194374c228a48aaee162ec1d9 P 4018be520383439497fd4ee03342ed73 [term 1 LEADER]: Signalling peer 056f6a42190a46df97a5104db44e9d64 to start an election
I20260709 12:08:44.193116 13892 raft_consensus.cc:993] T 3ba6e60509e5462f984736f50675cd17 P 056f6a42190a46df97a5104db44e9d64: : Instructing follower d148369c73aa4cd59e17f9d5a0b6c181 to start an election
I20260709 12:08:44.193586 13892 raft_consensus.cc:1081] T 3ba6e60509e5462f984736f50675cd17 P 056f6a42190a46df97a5104db44e9d64 [term 1 LEADER]: Signalling peer d148369c73aa4cd59e17f9d5a0b6c181 to start an election
I20260709 12:08:44.198374 13672 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3ba6e60509e5462f984736f50675cd17"
dest_uuid: "d148369c73aa4cd59e17f9d5a0b6c181"
 from {username='slave'} at 127.0.0.1:45742
I20260709 12:08:44.202484 13672 raft_consensus.cc:493] T 3ba6e60509e5462f984736f50675cd17 P d148369c73aa4cd59e17f9d5a0b6c181 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:44.202973 13672 raft_consensus.cc:3060] T 3ba6e60509e5462f984736f50675cd17 P d148369c73aa4cd59e17f9d5a0b6c181 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:44.204946 13746 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "041529b194374c228a48aaee162ec1d9"
dest_uuid: "056f6a42190a46df97a5104db44e9d64"
 from {username='slave'} at 127.0.0.1:53506
I20260709 12:08:44.205642 13746 raft_consensus.cc:493] T 041529b194374c228a48aaee162ec1d9 P 056f6a42190a46df97a5104db44e9d64 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:44.206085 13746 raft_consensus.cc:3060] T 041529b194374c228a48aaee162ec1d9 P 056f6a42190a46df97a5104db44e9d64 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:44.213580 13672 raft_consensus.cc:515] T 3ba6e60509e5462f984736f50675cd17 P d148369c73aa4cd59e17f9d5a0b6c181 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } }
I20260709 12:08:44.214911 13673 raft_consensus.cc:1240] T 3ba6e60509e5462f984736f50675cd17 P d148369c73aa4cd59e17f9d5a0b6c181 [term 2 FOLLOWER]: Rejecting Update request from peer 056f6a42190a46df97a5104db44e9d64 for earlier term 1. Current term is 2. Ops: []
I20260709 12:08:44.217593 13896 consensus_queue.cc:1059] T 3ba6e60509e5462f984736f50675cd17 P 056f6a42190a46df97a5104db44e9d64 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:44.218576 13896 raft_consensus.cc:3055] T 3ba6e60509e5462f984736f50675cd17 P 056f6a42190a46df97a5104db44e9d64 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:44.219007 13896 raft_consensus.cc:740] T 3ba6e60509e5462f984736f50675cd17 P 056f6a42190a46df97a5104db44e9d64 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 056f6a42190a46df97a5104db44e9d64, State: Running, Role: LEADER
I20260709 12:08:44.219802 13748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba6e60509e5462f984736f50675cd17" candidate_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "056f6a42190a46df97a5104db44e9d64"
I20260709 12:08:44.219944 13896 consensus_queue.cc:260] T 3ba6e60509e5462f984736f50675cd17 P 056f6a42190a46df97a5104db44e9d64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } }
I20260709 12:08:44.221065 13672 leader_election.cc:290] T 3ba6e60509e5462f984736f50675cd17 P d148369c73aa4cd59e17f9d5a0b6c181 [CANDIDATE]: Term 2 election: Requested vote from peers 056f6a42190a46df97a5104db44e9d64 (127.12.174.130:44237), 4018be520383439497fd4ee03342ed73 (127.12.174.131:46793)
I20260709 12:08:44.222009 13896 raft_consensus.cc:3060] T 3ba6e60509e5462f984736f50675cd17 P 056f6a42190a46df97a5104db44e9d64 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:44.222749 13820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba6e60509e5462f984736f50675cd17" candidate_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4018be520383439497fd4ee03342ed73"
I20260709 12:08:44.223397 13820 raft_consensus.cc:3060] T 3ba6e60509e5462f984736f50675cd17 P 4018be520383439497fd4ee03342ed73 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:44.193660 13901 raft_consensus.cc:993] T 10708055ab264a66aadf75fe80ae59f8 P 4018be520383439497fd4ee03342ed73: : Instructing follower d148369c73aa4cd59e17f9d5a0b6c181 to start an election
I20260709 12:08:44.225267 13901 raft_consensus.cc:1081] T 10708055ab264a66aadf75fe80ae59f8 P 4018be520383439497fd4ee03342ed73 [term 1 LEADER]: Signalling peer d148369c73aa4cd59e17f9d5a0b6c181 to start an election
I20260709 12:08:44.229423 13746 raft_consensus.cc:515] T 041529b194374c228a48aaee162ec1d9 P 056f6a42190a46df97a5104db44e9d64 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } }
I20260709 12:08:44.231230 13820 raft_consensus.cc:2468] T 3ba6e60509e5462f984736f50675cd17 P 4018be520383439497fd4ee03342ed73 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d148369c73aa4cd59e17f9d5a0b6c181 in term 2.
I20260709 12:08:44.232503 13639 leader_election.cc:304] T 3ba6e60509e5462f984736f50675cd17 P d148369c73aa4cd59e17f9d5a0b6c181 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4018be520383439497fd4ee03342ed73, d148369c73aa4cd59e17f9d5a0b6c181; no voters: 
I20260709 12:08:44.233485 13940 raft_consensus.cc:2804] T 3ba6e60509e5462f984736f50675cd17 P d148369c73aa4cd59e17f9d5a0b6c181 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:44.234109 13940 raft_consensus.cc:697] T 3ba6e60509e5462f984736f50675cd17 P d148369c73aa4cd59e17f9d5a0b6c181 [term 2 LEADER]: Becoming Leader. State: Replica: d148369c73aa4cd59e17f9d5a0b6c181, State: Running, Role: LEADER
I20260709 12:08:44.235112 13940 consensus_queue.cc:237] T 3ba6e60509e5462f984736f50675cd17 P d148369c73aa4cd59e17f9d5a0b6c181 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } }
I20260709 12:08:44.244652 13748 raft_consensus.cc:2468] T 3ba6e60509e5462f984736f50675cd17 P 056f6a42190a46df97a5104db44e9d64 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d148369c73aa4cd59e17f9d5a0b6c181 in term 2.
I20260709 12:08:44.252054 13669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041529b194374c228a48aaee162ec1d9" candidate_uuid: "056f6a42190a46df97a5104db44e9d64" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d148369c73aa4cd59e17f9d5a0b6c181"
I20260709 12:08:44.252832 13669 raft_consensus.cc:3060] T 041529b194374c228a48aaee162ec1d9 P d148369c73aa4cd59e17f9d5a0b6c181 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:44.255466 13570 catalog_manager.cc:5697] T 3ba6e60509e5462f984736f50675cd17 P d148369c73aa4cd59e17f9d5a0b6c181 reported cstate change: term changed from 1 to 2, leader changed from 056f6a42190a46df97a5104db44e9d64 (127.12.174.130) to d148369c73aa4cd59e17f9d5a0b6c181 (127.12.174.129). New cstate: current_term: 2 leader_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:44.257786 13746 leader_election.cc:290] T 041529b194374c228a48aaee162ec1d9 P 056f6a42190a46df97a5104db44e9d64 [CANDIDATE]: Term 2 election: Requested vote from peers d148369c73aa4cd59e17f9d5a0b6c181 (127.12.174.129:37737), 4018be520383439497fd4ee03342ed73 (127.12.174.131:46793)
I20260709 12:08:44.261291 13669 raft_consensus.cc:2468] T 041529b194374c228a48aaee162ec1d9 P d148369c73aa4cd59e17f9d5a0b6c181 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 056f6a42190a46df97a5104db44e9d64 in term 2.
W20260709 12:08:44.261363 13788 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37737, user_credentials={real_user=slave}} blocked reactor thread for 69985.9us
I20260709 12:08:44.262956 13714 leader_election.cc:304] T 041529b194374c228a48aaee162ec1d9 P 056f6a42190a46df97a5104db44e9d64 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 056f6a42190a46df97a5104db44e9d64, d148369c73aa4cd59e17f9d5a0b6c181; no voters: 
I20260709 12:08:44.263123 13670 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "10708055ab264a66aadf75fe80ae59f8"
dest_uuid: "d148369c73aa4cd59e17f9d5a0b6c181"
 from {username='slave'} at 127.0.0.1:45758
I20260709 12:08:44.263854 13896 raft_consensus.cc:2804] T 041529b194374c228a48aaee162ec1d9 P 056f6a42190a46df97a5104db44e9d64 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:44.265228 13820 raft_consensus.cc:1240] T 3ba6e60509e5462f984736f50675cd17 P 4018be520383439497fd4ee03342ed73 [term 2 FOLLOWER]: Rejecting Update request from peer 056f6a42190a46df97a5104db44e9d64 for earlier term 1. Current term is 2. Ops: []
I20260709 12:08:44.266538 13821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041529b194374c228a48aaee162ec1d9" candidate_uuid: "056f6a42190a46df97a5104db44e9d64" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4018be520383439497fd4ee03342ed73"
I20260709 12:08:44.267215 13821 raft_consensus.cc:3055] T 041529b194374c228a48aaee162ec1d9 P 4018be520383439497fd4ee03342ed73 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:44.263860 13670 raft_consensus.cc:493] T 10708055ab264a66aadf75fe80ae59f8 P d148369c73aa4cd59e17f9d5a0b6c181 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:44.267565 13821 raft_consensus.cc:740] T 041529b194374c228a48aaee162ec1d9 P 4018be520383439497fd4ee03342ed73 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4018be520383439497fd4ee03342ed73, State: Running, Role: LEADER
I20260709 12:08:44.268074 13670 raft_consensus.cc:3060] T 10708055ab264a66aadf75fe80ae59f8 P d148369c73aa4cd59e17f9d5a0b6c181 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:44.268718 13821 consensus_queue.cc:260] T 041529b194374c228a48aaee162ec1d9 P 4018be520383439497fd4ee03342ed73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } }
I20260709 12:08:44.270411 13821 raft_consensus.cc:3060] T 041529b194374c228a48aaee162ec1d9 P 4018be520383439497fd4ee03342ed73 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:44.267634 13896 raft_consensus.cc:697] T 041529b194374c228a48aaee162ec1d9 P 056f6a42190a46df97a5104db44e9d64 [term 2 LEADER]: Becoming Leader. State: Replica: 056f6a42190a46df97a5104db44e9d64, State: Running, Role: LEADER
I20260709 12:08:44.272270 13896 consensus_queue.cc:237] T 041529b194374c228a48aaee162ec1d9 P 056f6a42190a46df97a5104db44e9d64 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } }
I20260709 12:08:44.273399 13917 raft_consensus.cc:993] T e27355722e7349aaa58d6ed2d707b81f P 4018be520383439497fd4ee03342ed73: : Instructing follower d148369c73aa4cd59e17f9d5a0b6c181 to start an election
I20260709 12:08:44.273864 13917 raft_consensus.cc:1081] T e27355722e7349aaa58d6ed2d707b81f P 4018be520383439497fd4ee03342ed73 [term 1 LEADER]: Signalling peer d148369c73aa4cd59e17f9d5a0b6c181 to start an election
I20260709 12:08:44.277627 13871 raft_consensus.cc:993] T 6c145809834e41bea496b130cfda3cac P 056f6a42190a46df97a5104db44e9d64: : Instructing follower d148369c73aa4cd59e17f9d5a0b6c181 to start an election
I20260709 12:08:44.278154 13871 raft_consensus.cc:1081] T 6c145809834e41bea496b130cfda3cac P 056f6a42190a46df97a5104db44e9d64 [term 1 LEADER]: Signalling peer d148369c73aa4cd59e17f9d5a0b6c181 to start an election
I20260709 12:08:44.279156 13673 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e27355722e7349aaa58d6ed2d707b81f"
dest_uuid: "d148369c73aa4cd59e17f9d5a0b6c181"
 from {username='slave'} at 127.0.0.1:45758
I20260709 12:08:44.282294 13673 raft_consensus.cc:493] T e27355722e7349aaa58d6ed2d707b81f P d148369c73aa4cd59e17f9d5a0b6c181 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:44.282732 13673 raft_consensus.cc:3060] T e27355722e7349aaa58d6ed2d707b81f P d148369c73aa4cd59e17f9d5a0b6c181 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:44.282956 13670 raft_consensus.cc:515] T 10708055ab264a66aadf75fe80ae59f8 P d148369c73aa4cd59e17f9d5a0b6c181 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } } peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } }
I20260709 12:08:44.284349 13672 raft_consensus.cc:1240] T 10708055ab264a66aadf75fe80ae59f8 P d148369c73aa4cd59e17f9d5a0b6c181 [term 2 FOLLOWER]: Rejecting Update request from peer 4018be520383439497fd4ee03342ed73 for earlier term 1. Current term is 2. Ops: []
I20260709 12:08:44.287447 13954 consensus_queue.cc:1059] T 10708055ab264a66aadf75fe80ae59f8 P 4018be520383439497fd4ee03342ed73 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:44.287839 13670 leader_election.cc:290] T 10708055ab264a66aadf75fe80ae59f8 P d148369c73aa4cd59e17f9d5a0b6c181 [CANDIDATE]: Term 2 election: Requested vote from peers 4018be520383439497fd4ee03342ed73 (127.12.174.131:46793), 056f6a42190a46df97a5104db44e9d64 (127.12.174.130:44237)
I20260709 12:08:44.289839 13746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10708055ab264a66aadf75fe80ae59f8" candidate_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "056f6a42190a46df97a5104db44e9d64"
I20260709 12:08:44.290500 13746 raft_consensus.cc:3060] T 10708055ab264a66aadf75fe80ae59f8 P 056f6a42190a46df97a5104db44e9d64 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:44.293265 13822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10708055ab264a66aadf75fe80ae59f8" candidate_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4018be520383439497fd4ee03342ed73"
I20260709 12:08:44.294970 13673 raft_consensus.cc:515] T e27355722e7349aaa58d6ed2d707b81f P d148369c73aa4cd59e17f9d5a0b6c181 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } }
I20260709 12:08:44.289867 13916 raft_consensus.cc:3055] T 10708055ab264a66aadf75fe80ae59f8 P 4018be520383439497fd4ee03342ed73 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:44.298388 13821 raft_consensus.cc:2468] T 041529b194374c228a48aaee162ec1d9 P 4018be520383439497fd4ee03342ed73 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 056f6a42190a46df97a5104db44e9d64 in term 2.
I20260709 12:08:44.298868 13748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27355722e7349aaa58d6ed2d707b81f" candidate_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "056f6a42190a46df97a5104db44e9d64"
I20260709 12:08:44.299335 13673 leader_election.cc:290] T e27355722e7349aaa58d6ed2d707b81f P d148369c73aa4cd59e17f9d5a0b6c181 [CANDIDATE]: Term 2 election: Requested vote from peers 056f6a42190a46df97a5104db44e9d64 (127.12.174.130:44237), 4018be520383439497fd4ee03342ed73 (127.12.174.131:46793)
I20260709 12:08:44.299507 13748 raft_consensus.cc:3060] T e27355722e7349aaa58d6ed2d707b81f P 056f6a42190a46df97a5104db44e9d64 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:44.300638 13669 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6c145809834e41bea496b130cfda3cac"
dest_uuid: "d148369c73aa4cd59e17f9d5a0b6c181"
 from {username='slave'} at 127.0.0.1:45742
I20260709 12:08:44.300354 13568 catalog_manager.cc:5697] T 089d82b1caf54ee3b23be8f48cb46605 P 056f6a42190a46df97a5104db44e9d64 reported cstate change: term changed from 1 to 2, leader changed from d148369c73aa4cd59e17f9d5a0b6c181 (127.12.174.129) to 056f6a42190a46df97a5104db44e9d64 (127.12.174.130). New cstate: current_term: 2 leader_uuid: "056f6a42190a46df97a5104db44e9d64" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:44.301277 13669 raft_consensus.cc:493] T 6c145809834e41bea496b130cfda3cac P d148369c73aa4cd59e17f9d5a0b6c181 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:44.301717 13669 raft_consensus.cc:3060] T 6c145809834e41bea496b130cfda3cac P d148369c73aa4cd59e17f9d5a0b6c181 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:44.302611 13821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27355722e7349aaa58d6ed2d707b81f" candidate_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4018be520383439497fd4ee03342ed73"
I20260709 12:08:44.298324 13916 raft_consensus.cc:740] T 10708055ab264a66aadf75fe80ae59f8 P 4018be520383439497fd4ee03342ed73 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4018be520383439497fd4ee03342ed73, State: Running, Role: LEADER
I20260709 12:08:44.303498 13821 raft_consensus.cc:3055] T e27355722e7349aaa58d6ed2d707b81f P 4018be520383439497fd4ee03342ed73 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:44.304320 13821 raft_consensus.cc:740] T e27355722e7349aaa58d6ed2d707b81f P 4018be520383439497fd4ee03342ed73 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4018be520383439497fd4ee03342ed73, State: Running, Role: LEADER
I20260709 12:08:44.304116 13916 consensus_queue.cc:260] T 10708055ab264a66aadf75fe80ae59f8 P 4018be520383439497fd4ee03342ed73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } } peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } }
I20260709 12:08:44.305600 13916 raft_consensus.cc:3060] T 10708055ab264a66aadf75fe80ae59f8 P 4018be520383439497fd4ee03342ed73 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:44.305372 13821 consensus_queue.cc:260] T e27355722e7349aaa58d6ed2d707b81f P 4018be520383439497fd4ee03342ed73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } }
I20260709 12:08:44.307070 13821 raft_consensus.cc:3060] T e27355722e7349aaa58d6ed2d707b81f P 4018be520383439497fd4ee03342ed73 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:44.314851 13669 raft_consensus.cc:515] T 6c145809834e41bea496b130cfda3cac P d148369c73aa4cd59e17f9d5a0b6c181 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } }
I20260709 12:08:44.316682 13748 raft_consensus.cc:2468] T e27355722e7349aaa58d6ed2d707b81f P 056f6a42190a46df97a5104db44e9d64 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d148369c73aa4cd59e17f9d5a0b6c181 in term 2.
I20260709 12:08:44.318356 13636 leader_election.cc:304] T e27355722e7349aaa58d6ed2d707b81f P d148369c73aa4cd59e17f9d5a0b6c181 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 056f6a42190a46df97a5104db44e9d64, d148369c73aa4cd59e17f9d5a0b6c181; no voters: 
I20260709 12:08:44.319214 13940 raft_consensus.cc:2804] T e27355722e7349aaa58d6ed2d707b81f P d148369c73aa4cd59e17f9d5a0b6c181 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:44.319736 13940 raft_consensus.cc:697] T e27355722e7349aaa58d6ed2d707b81f P d148369c73aa4cd59e17f9d5a0b6c181 [term 2 LEADER]: Becoming Leader. State: Replica: d148369c73aa4cd59e17f9d5a0b6c181, State: Running, Role: LEADER
I20260709 12:08:44.320348 13821 raft_consensus.cc:2468] T e27355722e7349aaa58d6ed2d707b81f P 4018be520383439497fd4ee03342ed73 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d148369c73aa4cd59e17f9d5a0b6c181 in term 2.
I20260709 12:08:44.320593 13940 consensus_queue.cc:237] T e27355722e7349aaa58d6ed2d707b81f P d148369c73aa4cd59e17f9d5a0b6c181 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } }
I20260709 12:08:44.326074 13746 raft_consensus.cc:2468] T 10708055ab264a66aadf75fe80ae59f8 P 056f6a42190a46df97a5104db44e9d64 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d148369c73aa4cd59e17f9d5a0b6c181 in term 2.
I20260709 12:08:44.327473 13636 leader_election.cc:304] T 10708055ab264a66aadf75fe80ae59f8 P d148369c73aa4cd59e17f9d5a0b6c181 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 056f6a42190a46df97a5104db44e9d64, d148369c73aa4cd59e17f9d5a0b6c181; no voters: 
I20260709 12:08:44.328325 13940 raft_consensus.cc:2804] T 10708055ab264a66aadf75fe80ae59f8 P d148369c73aa4cd59e17f9d5a0b6c181 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:44.328651 13748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c145809834e41bea496b130cfda3cac" candidate_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "056f6a42190a46df97a5104db44e9d64"
I20260709 12:08:44.328862 13940 raft_consensus.cc:697] T 10708055ab264a66aadf75fe80ae59f8 P d148369c73aa4cd59e17f9d5a0b6c181 [term 2 LEADER]: Becoming Leader. State: Replica: d148369c73aa4cd59e17f9d5a0b6c181, State: Running, Role: LEADER
I20260709 12:08:44.329321 13748 raft_consensus.cc:3055] T 6c145809834e41bea496b130cfda3cac P 056f6a42190a46df97a5104db44e9d64 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:44.329653 13748 raft_consensus.cc:740] T 6c145809834e41bea496b130cfda3cac P 056f6a42190a46df97a5104db44e9d64 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 056f6a42190a46df97a5104db44e9d64, State: Running, Role: LEADER
I20260709 12:08:44.329815 13940 consensus_queue.cc:237] T 10708055ab264a66aadf75fe80ae59f8 P d148369c73aa4cd59e17f9d5a0b6c181 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } } peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } }
I20260709 12:08:44.330835 13748 consensus_queue.cc:260] T 6c145809834e41bea496b130cfda3cac P 056f6a42190a46df97a5104db44e9d64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } }
I20260709 12:08:44.331993 13748 raft_consensus.cc:3060] T 6c145809834e41bea496b130cfda3cac P 056f6a42190a46df97a5104db44e9d64 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:44.334570 13568 catalog_manager.cc:5697] T 041529b194374c228a48aaee162ec1d9 P 056f6a42190a46df97a5104db44e9d64 reported cstate change: term changed from 1 to 2, leader changed from 4018be520383439497fd4ee03342ed73 (127.12.174.131) to 056f6a42190a46df97a5104db44e9d64 (127.12.174.130). New cstate: current_term: 2 leader_uuid: "056f6a42190a46df97a5104db44e9d64" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:44.337090 13669 leader_election.cc:290] T 6c145809834e41bea496b130cfda3cac P d148369c73aa4cd59e17f9d5a0b6c181 [CANDIDATE]: Term 2 election: Requested vote from peers 056f6a42190a46df97a5104db44e9d64 (127.12.174.130:44237), 4018be520383439497fd4ee03342ed73 (127.12.174.131:46793)
I20260709 12:08:44.339643 13821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c145809834e41bea496b130cfda3cac" candidate_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4018be520383439497fd4ee03342ed73"
I20260709 12:08:44.340353 13821 raft_consensus.cc:3060] T 6c145809834e41bea496b130cfda3cac P 4018be520383439497fd4ee03342ed73 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:44.346011 13748 raft_consensus.cc:2468] T 6c145809834e41bea496b130cfda3cac P 056f6a42190a46df97a5104db44e9d64 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d148369c73aa4cd59e17f9d5a0b6c181 in term 2.
I20260709 12:08:44.347333 13636 leader_election.cc:304] T 6c145809834e41bea496b130cfda3cac P d148369c73aa4cd59e17f9d5a0b6c181 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 056f6a42190a46df97a5104db44e9d64, d148369c73aa4cd59e17f9d5a0b6c181; no voters: 
I20260709 12:08:44.348590 13940 raft_consensus.cc:2804] T 6c145809834e41bea496b130cfda3cac P d148369c73aa4cd59e17f9d5a0b6c181 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:44.349368 13940 raft_consensus.cc:697] T 6c145809834e41bea496b130cfda3cac P d148369c73aa4cd59e17f9d5a0b6c181 [term 2 LEADER]: Becoming Leader. State: Replica: d148369c73aa4cd59e17f9d5a0b6c181, State: Running, Role: LEADER
I20260709 12:08:44.350733 13940 consensus_queue.cc:237] T 6c145809834e41bea496b130cfda3cac P d148369c73aa4cd59e17f9d5a0b6c181 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } }
I20260709 12:08:44.351683 13821 raft_consensus.cc:2468] T 6c145809834e41bea496b130cfda3cac P 4018be520383439497fd4ee03342ed73 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d148369c73aa4cd59e17f9d5a0b6c181 in term 2.
I20260709 12:08:44.358441 13822 raft_consensus.cc:2468] T 10708055ab264a66aadf75fe80ae59f8 P 4018be520383439497fd4ee03342ed73 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d148369c73aa4cd59e17f9d5a0b6c181 in term 2.
I20260709 12:08:44.362416 13569 catalog_manager.cc:5697] T e27355722e7349aaa58d6ed2d707b81f P d148369c73aa4cd59e17f9d5a0b6c181 reported cstate change: term changed from 1 to 2, leader changed from 4018be520383439497fd4ee03342ed73 (127.12.174.131) to d148369c73aa4cd59e17f9d5a0b6c181 (127.12.174.129). New cstate: current_term: 2 leader_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:44.363833 13569 catalog_manager.cc:5697] T 10708055ab264a66aadf75fe80ae59f8 P d148369c73aa4cd59e17f9d5a0b6c181 reported cstate change: term changed from 1 to 2, leader changed from 4018be520383439497fd4ee03342ed73 (127.12.174.131) to d148369c73aa4cd59e17f9d5a0b6c181 (127.12.174.129). New cstate: current_term: 2 leader_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:44.377923 13569 catalog_manager.cc:5697] T 6c145809834e41bea496b130cfda3cac P d148369c73aa4cd59e17f9d5a0b6c181 reported cstate change: term changed from 1 to 2, leader changed from 056f6a42190a46df97a5104db44e9d64 (127.12.174.130) to d148369c73aa4cd59e17f9d5a0b6c181 (127.12.174.129). New cstate: current_term: 2 leader_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:44.390151 13822 raft_consensus.cc:1275] T 1e31988a87d94a7d879cb9552131429d P 4018be520383439497fd4ee03342ed73 [term 2 FOLLOWER]: Refusing update from remote peer d148369c73aa4cd59e17f9d5a0b6c181: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:44.391523 13940 consensus_queue.cc:1048] T 1e31988a87d94a7d879cb9552131429d P d148369c73aa4cd59e17f9d5a0b6c181 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:44.400305 13748 raft_consensus.cc:1275] T 1e31988a87d94a7d879cb9552131429d P 056f6a42190a46df97a5104db44e9d64 [term 2 FOLLOWER]: Refusing update from remote peer d148369c73aa4cd59e17f9d5a0b6c181: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:44.402263 13936 consensus_queue.cc:1048] T 1e31988a87d94a7d879cb9552131429d P d148369c73aa4cd59e17f9d5a0b6c181 [LEADER]: Connected to new peer: Peer: permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:08:44.639098 13748 raft_consensus.cc:1275] T 3ba6e60509e5462f984736f50675cd17 P 056f6a42190a46df97a5104db44e9d64 [term 2 FOLLOWER]: Refusing update from remote peer d148369c73aa4cd59e17f9d5a0b6c181: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:44.640683 13936 consensus_queue.cc:1048] T 3ba6e60509e5462f984736f50675cd17 P d148369c73aa4cd59e17f9d5a0b6c181 [LEADER]: Connected to new peer: Peer: permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:44.649925 13822 raft_consensus.cc:1275] T 3ba6e60509e5462f984736f50675cd17 P 4018be520383439497fd4ee03342ed73 [term 2 FOLLOWER]: Refusing update from remote peer d148369c73aa4cd59e17f9d5a0b6c181: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:44.651487 13936 consensus_queue.cc:1048] T 3ba6e60509e5462f984736f50675cd17 P d148369c73aa4cd59e17f9d5a0b6c181 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:44.683828 13669 raft_consensus.cc:1275] T 041529b194374c228a48aaee162ec1d9 P d148369c73aa4cd59e17f9d5a0b6c181 [term 2 FOLLOWER]: Refusing update from remote peer 056f6a42190a46df97a5104db44e9d64: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:44.685386 13896 consensus_queue.cc:1048] T 041529b194374c228a48aaee162ec1d9 P 056f6a42190a46df97a5104db44e9d64 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:44.694079 13822 raft_consensus.cc:1275] T 041529b194374c228a48aaee162ec1d9 P 4018be520383439497fd4ee03342ed73 [term 2 FOLLOWER]: Refusing update from remote peer 056f6a42190a46df97a5104db44e9d64: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:44.696267 13896 consensus_queue.cc:1048] T 041529b194374c228a48aaee162ec1d9 P 056f6a42190a46df97a5104db44e9d64 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:44.700301 13669 raft_consensus.cc:1275] T 089d82b1caf54ee3b23be8f48cb46605 P d148369c73aa4cd59e17f9d5a0b6c181 [term 2 FOLLOWER]: Refusing update from remote peer 056f6a42190a46df97a5104db44e9d64: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:44.702229 13896 consensus_queue.cc:1048] T 089d82b1caf54ee3b23be8f48cb46605 P 056f6a42190a46df97a5104db44e9d64 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:44.714708 13822 raft_consensus.cc:1275] T 089d82b1caf54ee3b23be8f48cb46605 P 4018be520383439497fd4ee03342ed73 [term 2 FOLLOWER]: Refusing update from remote peer 056f6a42190a46df97a5104db44e9d64: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:44.717082 13896 consensus_queue.cc:1048] T 089d82b1caf54ee3b23be8f48cb46605 P 056f6a42190a46df97a5104db44e9d64 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:44.749172 13822 raft_consensus.cc:1275] T e27355722e7349aaa58d6ed2d707b81f P 4018be520383439497fd4ee03342ed73 [term 2 FOLLOWER]: Refusing update from remote peer d148369c73aa4cd59e17f9d5a0b6c181: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:44.750758 13936 consensus_queue.cc:1048] T e27355722e7349aaa58d6ed2d707b81f P d148369c73aa4cd59e17f9d5a0b6c181 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:44.759235 13748 raft_consensus.cc:1275] T e27355722e7349aaa58d6ed2d707b81f P 056f6a42190a46df97a5104db44e9d64 [term 2 FOLLOWER]: Refusing update from remote peer d148369c73aa4cd59e17f9d5a0b6c181: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:44.760845 13936 consensus_queue.cc:1048] T e27355722e7349aaa58d6ed2d707b81f P d148369c73aa4cd59e17f9d5a0b6c181 [LEADER]: Connected to new peer: Peer: permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:44.767699 13748 raft_consensus.cc:1275] T 6c145809834e41bea496b130cfda3cac P 056f6a42190a46df97a5104db44e9d64 [term 2 FOLLOWER]: Refusing update from remote peer d148369c73aa4cd59e17f9d5a0b6c181: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:44.769111 13936 consensus_queue.cc:1048] T 6c145809834e41bea496b130cfda3cac P d148369c73aa4cd59e17f9d5a0b6c181 [LEADER]: Connected to new peer: Peer: permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:44.778434 13822 raft_consensus.cc:1275] T 6c145809834e41bea496b130cfda3cac P 4018be520383439497fd4ee03342ed73 [term 2 FOLLOWER]: Refusing update from remote peer d148369c73aa4cd59e17f9d5a0b6c181: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:44.780288 13870 consensus_queue.cc:1048] T 6c145809834e41bea496b130cfda3cac P d148369c73aa4cd59e17f9d5a0b6c181 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:44.823494 13822 raft_consensus.cc:1275] T 10708055ab264a66aadf75fe80ae59f8 P 4018be520383439497fd4ee03342ed73 [term 2 FOLLOWER]: Refusing update from remote peer d148369c73aa4cd59e17f9d5a0b6c181: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:44.824893 13870 consensus_queue.cc:1048] T 10708055ab264a66aadf75fe80ae59f8 P d148369c73aa4cd59e17f9d5a0b6c181 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:44.835033 13748 raft_consensus.cc:1275] T 10708055ab264a66aadf75fe80ae59f8 P 056f6a42190a46df97a5104db44e9d64 [term 2 FOLLOWER]: Refusing update from remote peer d148369c73aa4cd59e17f9d5a0b6c181: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:44.836400 13941 consensus_queue.cc:1048] T 10708055ab264a66aadf75fe80ae59f8 P d148369c73aa4cd59e17f9d5a0b6c181 [LEADER]: Connected to new peer: Peer: permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:46.897420 12986 auto_leader_rebalancer-test.cc:365] The leader distribution is 
I20260709 12:08:46.898758 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:46.918838 13669 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "10708055ab264a66aadf75fe80ae59f8"
dest_uuid: "d148369c73aa4cd59e17f9d5a0b6c181"
mode: GRACEFUL
new_leader_uuid: "4018be520383439497fd4ee03342ed73"
 from {username='slave'} at 127.0.0.1:45786
I20260709 12:08:46.919624 13669 raft_consensus.cc:606] T 10708055ab264a66aadf75fe80ae59f8 P d148369c73aa4cd59e17f9d5a0b6c181 [term 2 LEADER]: Received request to transfer leadership to TS 4018be520383439497fd4ee03342ed73
I20260709 12:08:46.922662 13669 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e27355722e7349aaa58d6ed2d707b81f"
dest_uuid: "d148369c73aa4cd59e17f9d5a0b6c181"
mode: GRACEFUL
new_leader_uuid: "4018be520383439497fd4ee03342ed73"
 from {username='slave'} at 127.0.0.1:45786
I20260709 12:08:46.923200 13669 raft_consensus.cc:606] T e27355722e7349aaa58d6ed2d707b81f P d148369c73aa4cd59e17f9d5a0b6c181 [term 2 LEADER]: Received request to transfer leadership to TS 4018be520383439497fd4ee03342ed73
I20260709 12:08:46.924362 12986 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:08:46.924881 12986 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:47.304593 13941 raft_consensus.cc:993] T e27355722e7349aaa58d6ed2d707b81f P d148369c73aa4cd59e17f9d5a0b6c181: : Instructing follower 4018be520383439497fd4ee03342ed73 to start an election
I20260709 12:08:47.305145 13962 raft_consensus.cc:1081] T e27355722e7349aaa58d6ed2d707b81f P d148369c73aa4cd59e17f9d5a0b6c181 [term 2 LEADER]: Signalling peer 4018be520383439497fd4ee03342ed73 to start an election
I20260709 12:08:47.307003 13822 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e27355722e7349aaa58d6ed2d707b81f"
dest_uuid: "4018be520383439497fd4ee03342ed73"
 from {username='slave'} at 127.0.0.1:48030
I20260709 12:08:47.307521 13822 raft_consensus.cc:493] T e27355722e7349aaa58d6ed2d707b81f P 4018be520383439497fd4ee03342ed73 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:47.307878 13822 raft_consensus.cc:3060] T e27355722e7349aaa58d6ed2d707b81f P 4018be520383439497fd4ee03342ed73 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:47.314457 13822 raft_consensus.cc:515] T e27355722e7349aaa58d6ed2d707b81f P 4018be520383439497fd4ee03342ed73 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } }
I20260709 12:08:47.316403 13822 leader_election.cc:290] T e27355722e7349aaa58d6ed2d707b81f P 4018be520383439497fd4ee03342ed73 [CANDIDATE]: Term 3 election: Requested vote from peers d148369c73aa4cd59e17f9d5a0b6c181 (127.12.174.129:37737), 056f6a42190a46df97a5104db44e9d64 (127.12.174.130:44237)
I20260709 12:08:47.317762 13748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27355722e7349aaa58d6ed2d707b81f" candidate_uuid: "4018be520383439497fd4ee03342ed73" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "056f6a42190a46df97a5104db44e9d64"
I20260709 12:08:47.317538 13669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27355722e7349aaa58d6ed2d707b81f" candidate_uuid: "4018be520383439497fd4ee03342ed73" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d148369c73aa4cd59e17f9d5a0b6c181"
I20260709 12:08:47.318645 13748 raft_consensus.cc:3060] T e27355722e7349aaa58d6ed2d707b81f P 056f6a42190a46df97a5104db44e9d64 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:47.318758 13669 raft_consensus.cc:3055] T e27355722e7349aaa58d6ed2d707b81f P d148369c73aa4cd59e17f9d5a0b6c181 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:08:47.319109 13669 raft_consensus.cc:740] T e27355722e7349aaa58d6ed2d707b81f P d148369c73aa4cd59e17f9d5a0b6c181 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d148369c73aa4cd59e17f9d5a0b6c181, State: Running, Role: LEADER
I20260709 12:08:47.319928 13669 consensus_queue.cc:260] T e27355722e7349aaa58d6ed2d707b81f P d148369c73aa4cd59e17f9d5a0b6c181 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } }
I20260709 12:08:47.321074 13669 raft_consensus.cc:3060] T e27355722e7349aaa58d6ed2d707b81f P d148369c73aa4cd59e17f9d5a0b6c181 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:47.324717 13748 raft_consensus.cc:2468] T e27355722e7349aaa58d6ed2d707b81f P 056f6a42190a46df97a5104db44e9d64 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4018be520383439497fd4ee03342ed73 in term 3.
I20260709 12:08:47.326083 13785 leader_election.cc:304] T e27355722e7349aaa58d6ed2d707b81f P 4018be520383439497fd4ee03342ed73 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 056f6a42190a46df97a5104db44e9d64, 4018be520383439497fd4ee03342ed73; no voters: 
I20260709 12:08:47.326923 13954 raft_consensus.cc:2804] T e27355722e7349aaa58d6ed2d707b81f P 4018be520383439497fd4ee03342ed73 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:08:47.327154 13669 raft_consensus.cc:2468] T e27355722e7349aaa58d6ed2d707b81f P d148369c73aa4cd59e17f9d5a0b6c181 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4018be520383439497fd4ee03342ed73 in term 3.
I20260709 12:08:47.328085 13954 raft_consensus.cc:697] T e27355722e7349aaa58d6ed2d707b81f P 4018be520383439497fd4ee03342ed73 [term 3 LEADER]: Becoming Leader. State: Replica: 4018be520383439497fd4ee03342ed73, State: Running, Role: LEADER
I20260709 12:08:47.329110 13954 consensus_queue.cc:237] T e27355722e7349aaa58d6ed2d707b81f P 4018be520383439497fd4ee03342ed73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } }
I20260709 12:08:47.337885 13570 catalog_manager.cc:5697] T e27355722e7349aaa58d6ed2d707b81f P 4018be520383439497fd4ee03342ed73 reported cstate change: term changed from 2 to 3, leader changed from d148369c73aa4cd59e17f9d5a0b6c181 (127.12.174.129) to 4018be520383439497fd4ee03342ed73 (127.12.174.131). New cstate: current_term: 3 leader_uuid: "4018be520383439497fd4ee03342ed73" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:47.384583 13941 raft_consensus.cc:993] T 10708055ab264a66aadf75fe80ae59f8 P d148369c73aa4cd59e17f9d5a0b6c181: : Instructing follower 4018be520383439497fd4ee03342ed73 to start an election
I20260709 12:08:47.385063 13941 raft_consensus.cc:1081] T 10708055ab264a66aadf75fe80ae59f8 P d148369c73aa4cd59e17f9d5a0b6c181 [term 2 LEADER]: Signalling peer 4018be520383439497fd4ee03342ed73 to start an election
I20260709 12:08:47.386618 13822 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "10708055ab264a66aadf75fe80ae59f8"
dest_uuid: "4018be520383439497fd4ee03342ed73"
 from {username='slave'} at 127.0.0.1:48030
I20260709 12:08:47.387055 13822 raft_consensus.cc:493] T 10708055ab264a66aadf75fe80ae59f8 P 4018be520383439497fd4ee03342ed73 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:47.387286 13822 raft_consensus.cc:3060] T 10708055ab264a66aadf75fe80ae59f8 P 4018be520383439497fd4ee03342ed73 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:47.392536 13822 raft_consensus.cc:515] T 10708055ab264a66aadf75fe80ae59f8 P 4018be520383439497fd4ee03342ed73 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } } peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } }
I20260709 12:08:47.394057 13822 leader_election.cc:290] T 10708055ab264a66aadf75fe80ae59f8 P 4018be520383439497fd4ee03342ed73 [CANDIDATE]: Term 3 election: Requested vote from peers d148369c73aa4cd59e17f9d5a0b6c181 (127.12.174.129:37737), 056f6a42190a46df97a5104db44e9d64 (127.12.174.130:44237)
I20260709 12:08:47.395146 13669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10708055ab264a66aadf75fe80ae59f8" candidate_uuid: "4018be520383439497fd4ee03342ed73" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d148369c73aa4cd59e17f9d5a0b6c181"
I20260709 12:08:47.395256 13748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10708055ab264a66aadf75fe80ae59f8" candidate_uuid: "4018be520383439497fd4ee03342ed73" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "056f6a42190a46df97a5104db44e9d64"
I20260709 12:08:47.396049 13669 raft_consensus.cc:3055] T 10708055ab264a66aadf75fe80ae59f8 P d148369c73aa4cd59e17f9d5a0b6c181 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:08:47.396128 13748 raft_consensus.cc:3060] T 10708055ab264a66aadf75fe80ae59f8 P 056f6a42190a46df97a5104db44e9d64 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:47.396458 13669 raft_consensus.cc:740] T 10708055ab264a66aadf75fe80ae59f8 P d148369c73aa4cd59e17f9d5a0b6c181 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d148369c73aa4cd59e17f9d5a0b6c181, State: Running, Role: LEADER
I20260709 12:08:47.397377 13669 consensus_queue.cc:260] T 10708055ab264a66aadf75fe80ae59f8 P d148369c73aa4cd59e17f9d5a0b6c181 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } } peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } }
I20260709 12:08:47.398699 13669 raft_consensus.cc:3060] T 10708055ab264a66aadf75fe80ae59f8 P d148369c73aa4cd59e17f9d5a0b6c181 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:47.403420 13748 raft_consensus.cc:2468] T 10708055ab264a66aadf75fe80ae59f8 P 056f6a42190a46df97a5104db44e9d64 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4018be520383439497fd4ee03342ed73 in term 3.
I20260709 12:08:47.404601 13785 leader_election.cc:304] T 10708055ab264a66aadf75fe80ae59f8 P 4018be520383439497fd4ee03342ed73 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 056f6a42190a46df97a5104db44e9d64, 4018be520383439497fd4ee03342ed73; no voters: 
I20260709 12:08:47.404845 13669 raft_consensus.cc:2468] T 10708055ab264a66aadf75fe80ae59f8 P d148369c73aa4cd59e17f9d5a0b6c181 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4018be520383439497fd4ee03342ed73 in term 3.
I20260709 12:08:47.405556 13954 raft_consensus.cc:2804] T 10708055ab264a66aadf75fe80ae59f8 P 4018be520383439497fd4ee03342ed73 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:08:47.406198 13954 raft_consensus.cc:697] T 10708055ab264a66aadf75fe80ae59f8 P 4018be520383439497fd4ee03342ed73 [term 3 LEADER]: Becoming Leader. State: Replica: 4018be520383439497fd4ee03342ed73, State: Running, Role: LEADER
I20260709 12:08:47.407456 13954 consensus_queue.cc:237] T 10708055ab264a66aadf75fe80ae59f8 P 4018be520383439497fd4ee03342ed73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } } peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } }
I20260709 12:08:47.417337 13568 catalog_manager.cc:5697] T 10708055ab264a66aadf75fe80ae59f8 P 4018be520383439497fd4ee03342ed73 reported cstate change: term changed from 2 to 3, leader changed from d148369c73aa4cd59e17f9d5a0b6c181 (127.12.174.129) to 4018be520383439497fd4ee03342ed73 (127.12.174.131). New cstate: current_term: 3 leader_uuid: "4018be520383439497fd4ee03342ed73" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:47.823944 13748 raft_consensus.cc:1275] T 10708055ab264a66aadf75fe80ae59f8 P 056f6a42190a46df97a5104db44e9d64 [term 3 FOLLOWER]: Refusing update from remote peer 4018be520383439497fd4ee03342ed73: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:47.825240 13954 consensus_queue.cc:1048] T 10708055ab264a66aadf75fe80ae59f8 P 4018be520383439497fd4ee03342ed73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:47.835445 13669 raft_consensus.cc:1275] T 10708055ab264a66aadf75fe80ae59f8 P d148369c73aa4cd59e17f9d5a0b6c181 [term 3 FOLLOWER]: Refusing update from remote peer 4018be520383439497fd4ee03342ed73: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:47.837333 13963 consensus_queue.cc:1048] T 10708055ab264a66aadf75fe80ae59f8 P 4018be520383439497fd4ee03342ed73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:08:47.850366 13746 raft_consensus.cc:1275] T e27355722e7349aaa58d6ed2d707b81f P 056f6a42190a46df97a5104db44e9d64 [term 3 FOLLOWER]: Refusing update from remote peer 4018be520383439497fd4ee03342ed73: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:47.852032 13963 consensus_queue.cc:1048] T e27355722e7349aaa58d6ed2d707b81f P 4018be520383439497fd4ee03342ed73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:47.873026 13669 raft_consensus.cc:1275] T e27355722e7349aaa58d6ed2d707b81f P d148369c73aa4cd59e17f9d5a0b6c181 [term 3 FOLLOWER]: Refusing update from remote peer 4018be520383439497fd4ee03342ed73: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:47.874873 13973 consensus_queue.cc:1048] T e27355722e7349aaa58d6ed2d707b81f P 4018be520383439497fd4ee03342ed73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:08:47.926378 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:47.932796 12986 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:47.933218 12986 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:48.934152 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:48.940994 12986 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:48.941443 12986 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:49.942668 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:49.950685 12986 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:49.951155 12986 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:50.952229 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:50.958993 12986 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:50.959438 12986 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:51.960438 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:51.967064 12986 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:51.967535 12986 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:52.968647 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:52.974970 12986 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:52.975430 12986 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:53.976408 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:53.981882 12986 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:53.982335 12986 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:55.214128 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:55.219862 12986 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:55.220352 12986 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:08:56.060227 13602 debug-util.cc:398] Leaking SignalData structure 0x7b0800051340 after lost signal to thread 12989
W20260709 12:08:56.061270 13602 debug-util.cc:398] Leaking SignalData structure 0x7b0800051a20 after lost signal to thread 13605
W20260709 12:08:56.062630 13602 debug-util.cc:398] Leaking SignalData structure 0x7b0800096e40 after lost signal to thread 13697
W20260709 12:08:56.063759 13602 debug-util.cc:398] Leaking SignalData structure 0x7b08001acb40 after lost signal to thread 13772
W20260709 12:08:56.064888 13602 debug-util.cc:398] Leaking SignalData structure 0x7b0800111700 after lost signal to thread 13846
I20260709 12:08:56.221372 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:56.227262 12986 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:56.227751 12986 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:57.269286 12986 auto_leader_rebalancer-test.cc:384] The leader distribution is 
I20260709 12:08:57.275158 13821 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "10708055ab264a66aadf75fe80ae59f8"
dest_uuid: "4018be520383439497fd4ee03342ed73"
mode: GRACEFUL
new_leader_uuid: "d148369c73aa4cd59e17f9d5a0b6c181"
 from {username='slave'} at 127.0.0.1:48036
I20260709 12:08:57.275940 13821 raft_consensus.cc:606] T 10708055ab264a66aadf75fe80ae59f8 P 4018be520383439497fd4ee03342ed73 [term 3 LEADER]: Received request to transfer leadership to TS d148369c73aa4cd59e17f9d5a0b6c181
I20260709 12:08:57.290647 13821 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e27355722e7349aaa58d6ed2d707b81f"
dest_uuid: "4018be520383439497fd4ee03342ed73"
mode: GRACEFUL
new_leader_uuid: "d148369c73aa4cd59e17f9d5a0b6c181"
 from {username='slave'} at 127.0.0.1:48036
I20260709 12:08:57.291175 13821 raft_consensus.cc:606] T e27355722e7349aaa58d6ed2d707b81f P 4018be520383439497fd4ee03342ed73 [term 3 LEADER]: Received request to transfer leadership to TS d148369c73aa4cd59e17f9d5a0b6c181
I20260709 12:08:57.296813 13746 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "041529b194374c228a48aaee162ec1d9"
dest_uuid: "056f6a42190a46df97a5104db44e9d64"
mode: GRACEFUL
new_leader_uuid: "d148369c73aa4cd59e17f9d5a0b6c181"
 from {username='slave'} at 127.0.0.1:53508
I20260709 12:08:57.297520 13746 raft_consensus.cc:606] T 041529b194374c228a48aaee162ec1d9 P 056f6a42190a46df97a5104db44e9d64 [term 2 LEADER]: Received request to transfer leadership to TS d148369c73aa4cd59e17f9d5a0b6c181
I20260709 12:08:57.304342 13746 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "089d82b1caf54ee3b23be8f48cb46605"
dest_uuid: "056f6a42190a46df97a5104db44e9d64"
mode: GRACEFUL
new_leader_uuid: "d148369c73aa4cd59e17f9d5a0b6c181"
 from {username='slave'} at 127.0.0.1:53508
I20260709 12:08:57.305073 13746 raft_consensus.cc:606] T 089d82b1caf54ee3b23be8f48cb46605 P 056f6a42190a46df97a5104db44e9d64 [term 2 LEADER]: Received request to transfer leadership to TS d148369c73aa4cd59e17f9d5a0b6c181
I20260709 12:08:57.310761 13746 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "27d8fa0b057c4ff09029177a296ce950"
dest_uuid: "056f6a42190a46df97a5104db44e9d64"
mode: GRACEFUL
new_leader_uuid: "d148369c73aa4cd59e17f9d5a0b6c181"
 from {username='slave'} at 127.0.0.1:53508
I20260709 12:08:57.311494 13746 raft_consensus.cc:606] T 27d8fa0b057c4ff09029177a296ce950 P 056f6a42190a46df97a5104db44e9d64 [term 1 LEADER]: Received request to transfer leadership to TS d148369c73aa4cd59e17f9d5a0b6c181
I20260709 12:08:57.436208 13991 raft_consensus.cc:993] T 10708055ab264a66aadf75fe80ae59f8 P 4018be520383439497fd4ee03342ed73: : Instructing follower d148369c73aa4cd59e17f9d5a0b6c181 to start an election
I20260709 12:08:57.436790 13995 raft_consensus.cc:1081] T 10708055ab264a66aadf75fe80ae59f8 P 4018be520383439497fd4ee03342ed73 [term 3 LEADER]: Signalling peer d148369c73aa4cd59e17f9d5a0b6c181 to start an election
I20260709 12:08:57.438583 13669 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "10708055ab264a66aadf75fe80ae59f8"
dest_uuid: "d148369c73aa4cd59e17f9d5a0b6c181"
 from {username='slave'} at 127.0.0.1:45758
I20260709 12:08:57.439121 13669 raft_consensus.cc:493] T 10708055ab264a66aadf75fe80ae59f8 P d148369c73aa4cd59e17f9d5a0b6c181 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:57.439488 13669 raft_consensus.cc:3060] T 10708055ab264a66aadf75fe80ae59f8 P d148369c73aa4cd59e17f9d5a0b6c181 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:08:57.446717 13669 raft_consensus.cc:515] T 10708055ab264a66aadf75fe80ae59f8 P d148369c73aa4cd59e17f9d5a0b6c181 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } } peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } }
I20260709 12:08:57.448604 13669 leader_election.cc:290] T 10708055ab264a66aadf75fe80ae59f8 P d148369c73aa4cd59e17f9d5a0b6c181 [CANDIDATE]: Term 4 election: Requested vote from peers 4018be520383439497fd4ee03342ed73 (127.12.174.131:46793), 056f6a42190a46df97a5104db44e9d64 (127.12.174.130:44237)
I20260709 12:08:57.449903 13821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10708055ab264a66aadf75fe80ae59f8" candidate_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "4018be520383439497fd4ee03342ed73"
I20260709 12:08:57.450232 13746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10708055ab264a66aadf75fe80ae59f8" candidate_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "056f6a42190a46df97a5104db44e9d64"
I20260709 12:08:57.450744 13821 raft_consensus.cc:3055] T 10708055ab264a66aadf75fe80ae59f8 P 4018be520383439497fd4ee03342ed73 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:08:57.450851 13746 raft_consensus.cc:3060] T 10708055ab264a66aadf75fe80ae59f8 P 056f6a42190a46df97a5104db44e9d64 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:08:57.451092 13821 raft_consensus.cc:740] T 10708055ab264a66aadf75fe80ae59f8 P 4018be520383439497fd4ee03342ed73 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4018be520383439497fd4ee03342ed73, State: Running, Role: LEADER
I20260709 12:08:57.452170 13821 consensus_queue.cc:260] T 10708055ab264a66aadf75fe80ae59f8 P 4018be520383439497fd4ee03342ed73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } } peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } }
I20260709 12:08:57.454052 13821 raft_consensus.cc:3060] T 10708055ab264a66aadf75fe80ae59f8 P 4018be520383439497fd4ee03342ed73 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:08:57.459343 13746 raft_consensus.cc:2468] T 10708055ab264a66aadf75fe80ae59f8 P 056f6a42190a46df97a5104db44e9d64 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d148369c73aa4cd59e17f9d5a0b6c181 in term 4.
I20260709 12:08:57.460920 13636 leader_election.cc:304] T 10708055ab264a66aadf75fe80ae59f8 P d148369c73aa4cd59e17f9d5a0b6c181 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 056f6a42190a46df97a5104db44e9d64, d148369c73aa4cd59e17f9d5a0b6c181; no voters: 
I20260709 12:08:57.461855 13978 raft_consensus.cc:2804] T 10708055ab264a66aadf75fe80ae59f8 P d148369c73aa4cd59e17f9d5a0b6c181 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:08:57.463101 13821 raft_consensus.cc:2468] T 10708055ab264a66aadf75fe80ae59f8 P 4018be520383439497fd4ee03342ed73 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d148369c73aa4cd59e17f9d5a0b6c181 in term 4.
I20260709 12:08:57.463095 13978 raft_consensus.cc:697] T 10708055ab264a66aadf75fe80ae59f8 P d148369c73aa4cd59e17f9d5a0b6c181 [term 4 LEADER]: Becoming Leader. State: Replica: d148369c73aa4cd59e17f9d5a0b6c181, State: Running, Role: LEADER
I20260709 12:08:57.464679 13978 consensus_queue.cc:237] T 10708055ab264a66aadf75fe80ae59f8 P d148369c73aa4cd59e17f9d5a0b6c181 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } } peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } }
I20260709 12:08:57.482529 13569 catalog_manager.cc:5697] T 10708055ab264a66aadf75fe80ae59f8 P d148369c73aa4cd59e17f9d5a0b6c181 reported cstate change: term changed from 3 to 4, leader changed from 4018be520383439497fd4ee03342ed73 (127.12.174.131) to d148369c73aa4cd59e17f9d5a0b6c181 (127.12.174.129). New cstate: current_term: 4 leader_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:57.580793 13986 raft_consensus.cc:993] T 089d82b1caf54ee3b23be8f48cb46605 P 056f6a42190a46df97a5104db44e9d64: : Instructing follower d148369c73aa4cd59e17f9d5a0b6c181 to start an election
I20260709 12:08:57.581588 13994 raft_consensus.cc:1081] T 089d82b1caf54ee3b23be8f48cb46605 P 056f6a42190a46df97a5104db44e9d64 [term 2 LEADER]: Signalling peer d148369c73aa4cd59e17f9d5a0b6c181 to start an election
I20260709 12:08:57.583649 13669 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "089d82b1caf54ee3b23be8f48cb46605"
dest_uuid: "d148369c73aa4cd59e17f9d5a0b6c181"
 from {username='slave'} at 127.0.0.1:45742
I20260709 12:08:57.584301 13669 raft_consensus.cc:493] T 089d82b1caf54ee3b23be8f48cb46605 P d148369c73aa4cd59e17f9d5a0b6c181 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:57.584682 13669 raft_consensus.cc:3060] T 089d82b1caf54ee3b23be8f48cb46605 P d148369c73aa4cd59e17f9d5a0b6c181 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:57.594816 13669 raft_consensus.cc:515] T 089d82b1caf54ee3b23be8f48cb46605 P d148369c73aa4cd59e17f9d5a0b6c181 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } }
I20260709 12:08:57.597084 13669 leader_election.cc:290] T 089d82b1caf54ee3b23be8f48cb46605 P d148369c73aa4cd59e17f9d5a0b6c181 [CANDIDATE]: Term 3 election: Requested vote from peers 056f6a42190a46df97a5104db44e9d64 (127.12.174.130:44237), 4018be520383439497fd4ee03342ed73 (127.12.174.131:46793)
I20260709 12:08:57.598174 13746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089d82b1caf54ee3b23be8f48cb46605" candidate_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "056f6a42190a46df97a5104db44e9d64"
I20260709 12:08:57.598722 13821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089d82b1caf54ee3b23be8f48cb46605" candidate_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4018be520383439497fd4ee03342ed73"
I20260709 12:08:57.598894 13746 raft_consensus.cc:3055] T 089d82b1caf54ee3b23be8f48cb46605 P 056f6a42190a46df97a5104db44e9d64 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:08:57.599668 13821 raft_consensus.cc:3060] T 089d82b1caf54ee3b23be8f48cb46605 P 4018be520383439497fd4ee03342ed73 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:57.599725 13746 raft_consensus.cc:740] T 089d82b1caf54ee3b23be8f48cb46605 P 056f6a42190a46df97a5104db44e9d64 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 056f6a42190a46df97a5104db44e9d64, State: Running, Role: LEADER
I20260709 12:08:57.601202 13746 consensus_queue.cc:260] T 089d82b1caf54ee3b23be8f48cb46605 P 056f6a42190a46df97a5104db44e9d64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } }
I20260709 12:08:57.603338 13746 raft_consensus.cc:3060] T 089d82b1caf54ee3b23be8f48cb46605 P 056f6a42190a46df97a5104db44e9d64 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:57.608039 13821 raft_consensus.cc:2468] T 089d82b1caf54ee3b23be8f48cb46605 P 4018be520383439497fd4ee03342ed73 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d148369c73aa4cd59e17f9d5a0b6c181 in term 3.
I20260709 12:08:57.610265 13639 leader_election.cc:304] T 089d82b1caf54ee3b23be8f48cb46605 P d148369c73aa4cd59e17f9d5a0b6c181 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4018be520383439497fd4ee03342ed73, d148369c73aa4cd59e17f9d5a0b6c181; no voters: 
I20260709 12:08:57.611644 13978 raft_consensus.cc:2804] T 089d82b1caf54ee3b23be8f48cb46605 P d148369c73aa4cd59e17f9d5a0b6c181 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:08:57.612392 13978 raft_consensus.cc:697] T 089d82b1caf54ee3b23be8f48cb46605 P d148369c73aa4cd59e17f9d5a0b6c181 [term 3 LEADER]: Becoming Leader. State: Replica: d148369c73aa4cd59e17f9d5a0b6c181, State: Running, Role: LEADER
I20260709 12:08:57.614264 13978 consensus_queue.cc:237] T 089d82b1caf54ee3b23be8f48cb46605 P d148369c73aa4cd59e17f9d5a0b6c181 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } }
I20260709 12:08:57.615947 13746 raft_consensus.cc:2468] T 089d82b1caf54ee3b23be8f48cb46605 P 056f6a42190a46df97a5104db44e9d64 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d148369c73aa4cd59e17f9d5a0b6c181 in term 3.
I20260709 12:08:57.625455 13569 catalog_manager.cc:5697] T 089d82b1caf54ee3b23be8f48cb46605 P d148369c73aa4cd59e17f9d5a0b6c181 reported cstate change: term changed from 2 to 3, leader changed from 056f6a42190a46df97a5104db44e9d64 (127.12.174.130) to d148369c73aa4cd59e17f9d5a0b6c181 (127.12.174.129). New cstate: current_term: 3 leader_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:57.649230 13986 raft_consensus.cc:993] T 27d8fa0b057c4ff09029177a296ce950 P 056f6a42190a46df97a5104db44e9d64: : Instructing follower d148369c73aa4cd59e17f9d5a0b6c181 to start an election
I20260709 12:08:57.649873 13994 raft_consensus.cc:1081] T 27d8fa0b057c4ff09029177a296ce950 P 056f6a42190a46df97a5104db44e9d64 [term 1 LEADER]: Signalling peer d148369c73aa4cd59e17f9d5a0b6c181 to start an election
I20260709 12:08:57.651822 13669 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "27d8fa0b057c4ff09029177a296ce950"
dest_uuid: "d148369c73aa4cd59e17f9d5a0b6c181"
 from {username='slave'} at 127.0.0.1:45742
I20260709 12:08:57.652438 13669 raft_consensus.cc:493] T 27d8fa0b057c4ff09029177a296ce950 P d148369c73aa4cd59e17f9d5a0b6c181 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:57.652812 13669 raft_consensus.cc:3060] T 27d8fa0b057c4ff09029177a296ce950 P d148369c73aa4cd59e17f9d5a0b6c181 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:57.656659 13986 raft_consensus.cc:993] T 041529b194374c228a48aaee162ec1d9 P 056f6a42190a46df97a5104db44e9d64: : Instructing follower d148369c73aa4cd59e17f9d5a0b6c181 to start an election
I20260709 12:08:57.657297 13986 raft_consensus.cc:1081] T 041529b194374c228a48aaee162ec1d9 P 056f6a42190a46df97a5104db44e9d64 [term 2 LEADER]: Signalling peer d148369c73aa4cd59e17f9d5a0b6c181 to start an election
I20260709 12:08:57.660622 13673 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "041529b194374c228a48aaee162ec1d9"
dest_uuid: "d148369c73aa4cd59e17f9d5a0b6c181"
 from {username='slave'} at 127.0.0.1:45742
I20260709 12:08:57.660629 13669 raft_consensus.cc:515] T 27d8fa0b057c4ff09029177a296ce950 P d148369c73aa4cd59e17f9d5a0b6c181 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } }
I20260709 12:08:57.661697 13673 raft_consensus.cc:493] T 041529b194374c228a48aaee162ec1d9 P d148369c73aa4cd59e17f9d5a0b6c181 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:57.663713 13669 leader_election.cc:290] T 27d8fa0b057c4ff09029177a296ce950 P d148369c73aa4cd59e17f9d5a0b6c181 [CANDIDATE]: Term 2 election: Requested vote from peers 056f6a42190a46df97a5104db44e9d64 (127.12.174.130:44237), 4018be520383439497fd4ee03342ed73 (127.12.174.131:46793)
I20260709 12:08:57.664230 13746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d8fa0b057c4ff09029177a296ce950" candidate_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "056f6a42190a46df97a5104db44e9d64"
I20260709 12:08:57.666035 13821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d8fa0b057c4ff09029177a296ce950" candidate_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4018be520383439497fd4ee03342ed73"
I20260709 12:08:57.662370 13673 raft_consensus.cc:3060] T 041529b194374c228a48aaee162ec1d9 P d148369c73aa4cd59e17f9d5a0b6c181 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:57.666654 13821 raft_consensus.cc:3060] T 27d8fa0b057c4ff09029177a296ce950 P 4018be520383439497fd4ee03342ed73 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:57.668678 13991 raft_consensus.cc:993] T e27355722e7349aaa58d6ed2d707b81f P 4018be520383439497fd4ee03342ed73: : Instructing follower d148369c73aa4cd59e17f9d5a0b6c181 to start an election
I20260709 12:08:57.669344 13991 raft_consensus.cc:1081] T e27355722e7349aaa58d6ed2d707b81f P 4018be520383439497fd4ee03342ed73 [term 3 LEADER]: Signalling peer d148369c73aa4cd59e17f9d5a0b6c181 to start an election
I20260709 12:08:57.669823 13746 raft_consensus.cc:3055] T 27d8fa0b057c4ff09029177a296ce950 P 056f6a42190a46df97a5104db44e9d64 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:57.670403 13746 raft_consensus.cc:740] T 27d8fa0b057c4ff09029177a296ce950 P 056f6a42190a46df97a5104db44e9d64 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 056f6a42190a46df97a5104db44e9d64, State: Running, Role: LEADER
I20260709 12:08:57.671949 13669 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e27355722e7349aaa58d6ed2d707b81f"
dest_uuid: "d148369c73aa4cd59e17f9d5a0b6c181"
 from {username='slave'} at 127.0.0.1:45758
I20260709 12:08:57.672598 13669 raft_consensus.cc:493] T e27355722e7349aaa58d6ed2d707b81f P d148369c73aa4cd59e17f9d5a0b6c181 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:57.672959 13669 raft_consensus.cc:3060] T e27355722e7349aaa58d6ed2d707b81f P d148369c73aa4cd59e17f9d5a0b6c181 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:08:57.676086 13746 consensus_queue.cc:260] T 27d8fa0b057c4ff09029177a296ce950 P 056f6a42190a46df97a5104db44e9d64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } }
I20260709 12:08:57.678282 13746 raft_consensus.cc:3060] T 27d8fa0b057c4ff09029177a296ce950 P 056f6a42190a46df97a5104db44e9d64 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:57.682090 13669 raft_consensus.cc:515] T e27355722e7349aaa58d6ed2d707b81f P d148369c73aa4cd59e17f9d5a0b6c181 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } }
I20260709 12:08:57.684888 13669 leader_election.cc:290] T e27355722e7349aaa58d6ed2d707b81f P d148369c73aa4cd59e17f9d5a0b6c181 [CANDIDATE]: Term 4 election: Requested vote from peers 056f6a42190a46df97a5104db44e9d64 (127.12.174.130:44237), 4018be520383439497fd4ee03342ed73 (127.12.174.131:46793)
I20260709 12:08:57.686610 13747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27355722e7349aaa58d6ed2d707b81f" candidate_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "056f6a42190a46df97a5104db44e9d64"
I20260709 12:08:57.687386 13821 raft_consensus.cc:2468] T 27d8fa0b057c4ff09029177a296ce950 P 4018be520383439497fd4ee03342ed73 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d148369c73aa4cd59e17f9d5a0b6c181 in term 2.
I20260709 12:08:57.687513 13747 raft_consensus.cc:3060] T e27355722e7349aaa58d6ed2d707b81f P 056f6a42190a46df97a5104db44e9d64 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:08:57.689621 13639 leader_election.cc:304] T 27d8fa0b057c4ff09029177a296ce950 P d148369c73aa4cd59e17f9d5a0b6c181 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4018be520383439497fd4ee03342ed73, d148369c73aa4cd59e17f9d5a0b6c181; no voters: 
I20260709 12:08:57.690711 13821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27355722e7349aaa58d6ed2d707b81f" candidate_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "4018be520383439497fd4ee03342ed73"
I20260709 12:08:57.691120 13978 raft_consensus.cc:2804] T 27d8fa0b057c4ff09029177a296ce950 P d148369c73aa4cd59e17f9d5a0b6c181 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:57.691593 13821 raft_consensus.cc:3055] T e27355722e7349aaa58d6ed2d707b81f P 4018be520383439497fd4ee03342ed73 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:08:57.691852 13673 raft_consensus.cc:515] T 041529b194374c228a48aaee162ec1d9 P d148369c73aa4cd59e17f9d5a0b6c181 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } }
I20260709 12:08:57.691996 13821 raft_consensus.cc:740] T e27355722e7349aaa58d6ed2d707b81f P 4018be520383439497fd4ee03342ed73 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4018be520383439497fd4ee03342ed73, State: Running, Role: LEADER
I20260709 12:08:57.691601 13978 raft_consensus.cc:697] T 27d8fa0b057c4ff09029177a296ce950 P d148369c73aa4cd59e17f9d5a0b6c181 [term 2 LEADER]: Becoming Leader. State: Replica: d148369c73aa4cd59e17f9d5a0b6c181, State: Running, Role: LEADER
I20260709 12:08:57.694775 13978 consensus_queue.cc:237] T 27d8fa0b057c4ff09029177a296ce950 P d148369c73aa4cd59e17f9d5a0b6c181 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } }
I20260709 12:08:57.696528 13673 leader_election.cc:290] T 041529b194374c228a48aaee162ec1d9 P d148369c73aa4cd59e17f9d5a0b6c181 [CANDIDATE]: Term 3 election: Requested vote from peers 056f6a42190a46df97a5104db44e9d64 (127.12.174.130:44237), 4018be520383439497fd4ee03342ed73 (127.12.174.131:46793)
I20260709 12:08:57.697446 13745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041529b194374c228a48aaee162ec1d9" candidate_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "056f6a42190a46df97a5104db44e9d64"
I20260709 12:08:57.698339 13745 raft_consensus.cc:3055] T 041529b194374c228a48aaee162ec1d9 P 056f6a42190a46df97a5104db44e9d64 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:08:57.698791 13745 raft_consensus.cc:740] T 041529b194374c228a48aaee162ec1d9 P 056f6a42190a46df97a5104db44e9d64 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 056f6a42190a46df97a5104db44e9d64, State: Running, Role: LEADER
I20260709 12:08:57.701270 13820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "041529b194374c228a48aaee162ec1d9" candidate_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4018be520383439497fd4ee03342ed73"
I20260709 12:08:57.702275 13820 raft_consensus.cc:3060] T 041529b194374c228a48aaee162ec1d9 P 4018be520383439497fd4ee03342ed73 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:57.694913 13821 consensus_queue.cc:260] T e27355722e7349aaa58d6ed2d707b81f P 4018be520383439497fd4ee03342ed73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } }
I20260709 12:08:57.710846 13821 raft_consensus.cc:3060] T e27355722e7349aaa58d6ed2d707b81f P 4018be520383439497fd4ee03342ed73 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:08:57.709569 13745 consensus_queue.cc:260] T 041529b194374c228a48aaee162ec1d9 P 056f6a42190a46df97a5104db44e9d64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } }
I20260709 12:08:57.713501 13745 raft_consensus.cc:3060] T 041529b194374c228a48aaee162ec1d9 P 056f6a42190a46df97a5104db44e9d64 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:57.718856 13747 raft_consensus.cc:2468] T e27355722e7349aaa58d6ed2d707b81f P 056f6a42190a46df97a5104db44e9d64 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d148369c73aa4cd59e17f9d5a0b6c181 in term 4.
I20260709 12:08:57.721153 13636 leader_election.cc:304] T e27355722e7349aaa58d6ed2d707b81f P d148369c73aa4cd59e17f9d5a0b6c181 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 056f6a42190a46df97a5104db44e9d64, d148369c73aa4cd59e17f9d5a0b6c181; no voters: 
I20260709 12:08:57.723227 13996 raft_consensus.cc:2804] T e27355722e7349aaa58d6ed2d707b81f P d148369c73aa4cd59e17f9d5a0b6c181 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:08:57.723471 13746 raft_consensus.cc:2468] T 27d8fa0b057c4ff09029177a296ce950 P 056f6a42190a46df97a5104db44e9d64 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d148369c73aa4cd59e17f9d5a0b6c181 in term 2.
I20260709 12:08:57.729825 13821 raft_consensus.cc:2468] T e27355722e7349aaa58d6ed2d707b81f P 4018be520383439497fd4ee03342ed73 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d148369c73aa4cd59e17f9d5a0b6c181 in term 4.
I20260709 12:08:57.745942 13996 raft_consensus.cc:697] T e27355722e7349aaa58d6ed2d707b81f P d148369c73aa4cd59e17f9d5a0b6c181 [term 4 LEADER]: Becoming Leader. State: Replica: d148369c73aa4cd59e17f9d5a0b6c181, State: Running, Role: LEADER
I20260709 12:08:57.747577 13996 consensus_queue.cc:237] T e27355722e7349aaa58d6ed2d707b81f P d148369c73aa4cd59e17f9d5a0b6c181 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } }
I20260709 12:08:57.749631 13820 raft_consensus.cc:2468] T 041529b194374c228a48aaee162ec1d9 P 4018be520383439497fd4ee03342ed73 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d148369c73aa4cd59e17f9d5a0b6c181 in term 3.
I20260709 12:08:57.755733 13745 raft_consensus.cc:2468] T 041529b194374c228a48aaee162ec1d9 P 056f6a42190a46df97a5104db44e9d64 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d148369c73aa4cd59e17f9d5a0b6c181 in term 3.
I20260709 12:08:57.756457 13639 leader_election.cc:304] T 041529b194374c228a48aaee162ec1d9 P d148369c73aa4cd59e17f9d5a0b6c181 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4018be520383439497fd4ee03342ed73, d148369c73aa4cd59e17f9d5a0b6c181; no voters: 
I20260709 12:08:57.759683 14004 raft_consensus.cc:2804] T 041529b194374c228a48aaee162ec1d9 P d148369c73aa4cd59e17f9d5a0b6c181 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:08:57.760558 14004 raft_consensus.cc:697] T 041529b194374c228a48aaee162ec1d9 P d148369c73aa4cd59e17f9d5a0b6c181 [term 3 LEADER]: Becoming Leader. State: Replica: d148369c73aa4cd59e17f9d5a0b6c181, State: Running, Role: LEADER
I20260709 12:08:57.759974 13569 catalog_manager.cc:5697] T 27d8fa0b057c4ff09029177a296ce950 P d148369c73aa4cd59e17f9d5a0b6c181 reported cstate change: term changed from 1 to 2, leader changed from 056f6a42190a46df97a5104db44e9d64 (127.12.174.130) to d148369c73aa4cd59e17f9d5a0b6c181 (127.12.174.129). New cstate: current_term: 2 leader_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:57.779767 14004 consensus_queue.cc:237] T 041529b194374c228a48aaee162ec1d9 P d148369c73aa4cd59e17f9d5a0b6c181 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } }
I20260709 12:08:57.793007 13569 catalog_manager.cc:5697] T e27355722e7349aaa58d6ed2d707b81f P d148369c73aa4cd59e17f9d5a0b6c181 reported cstate change: term changed from 3 to 4, leader changed from 4018be520383439497fd4ee03342ed73 (127.12.174.131) to d148369c73aa4cd59e17f9d5a0b6c181 (127.12.174.129). New cstate: current_term: 4 leader_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:57.795017 13569 catalog_manager.cc:5697] T 041529b194374c228a48aaee162ec1d9 P d148369c73aa4cd59e17f9d5a0b6c181 reported cstate change: term changed from 2 to 3, leader changed from 056f6a42190a46df97a5104db44e9d64 (127.12.174.130) to d148369c73aa4cd59e17f9d5a0b6c181 (127.12.174.129). New cstate: current_term: 3 leader_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:57.862389 13745 raft_consensus.cc:1275] T 10708055ab264a66aadf75fe80ae59f8 P 056f6a42190a46df97a5104db44e9d64 [term 4 FOLLOWER]: Refusing update from remote peer d148369c73aa4cd59e17f9d5a0b6c181: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:08:57.864073 14004 consensus_queue.cc:1048] T 10708055ab264a66aadf75fe80ae59f8 P d148369c73aa4cd59e17f9d5a0b6c181 [LEADER]: Connected to new peer: Peer: permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:08:57.884029 13821 raft_consensus.cc:1275] T 10708055ab264a66aadf75fe80ae59f8 P 4018be520383439497fd4ee03342ed73 [term 4 FOLLOWER]: Refusing update from remote peer d148369c73aa4cd59e17f9d5a0b6c181: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:08:57.886492 14005 consensus_queue.cc:1048] T 10708055ab264a66aadf75fe80ae59f8 P d148369c73aa4cd59e17f9d5a0b6c181 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:08:58.026659 13821 raft_consensus.cc:1275] T 089d82b1caf54ee3b23be8f48cb46605 P 4018be520383439497fd4ee03342ed73 [term 3 FOLLOWER]: Refusing update from remote peer d148369c73aa4cd59e17f9d5a0b6c181: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:58.028393 13996 consensus_queue.cc:1048] T 089d82b1caf54ee3b23be8f48cb46605 P d148369c73aa4cd59e17f9d5a0b6c181 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:58.047211 13745 raft_consensus.cc:1275] T 089d82b1caf54ee3b23be8f48cb46605 P 056f6a42190a46df97a5104db44e9d64 [term 3 FOLLOWER]: Refusing update from remote peer d148369c73aa4cd59e17f9d5a0b6c181: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:58.049523 13978 consensus_queue.cc:1048] T 089d82b1caf54ee3b23be8f48cb46605 P d148369c73aa4cd59e17f9d5a0b6c181 [LEADER]: Connected to new peer: Peer: permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:58.116855 13821 raft_consensus.cc:1275] T 27d8fa0b057c4ff09029177a296ce950 P 4018be520383439497fd4ee03342ed73 [term 2 FOLLOWER]: Refusing update from remote peer d148369c73aa4cd59e17f9d5a0b6c181: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:58.118669 13978 consensus_queue.cc:1048] T 27d8fa0b057c4ff09029177a296ce950 P d148369c73aa4cd59e17f9d5a0b6c181 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:58.133232 13745 raft_consensus.cc:1275] T 27d8fa0b057c4ff09029177a296ce950 P 056f6a42190a46df97a5104db44e9d64 [term 2 FOLLOWER]: Refusing update from remote peer d148369c73aa4cd59e17f9d5a0b6c181: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:58.136040 13978 consensus_queue.cc:1048] T 27d8fa0b057c4ff09029177a296ce950 P d148369c73aa4cd59e17f9d5a0b6c181 [LEADER]: Connected to new peer: Peer: permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:08:58.199910 13746 raft_consensus.cc:1275] T 041529b194374c228a48aaee162ec1d9 P 056f6a42190a46df97a5104db44e9d64 [term 3 FOLLOWER]: Refusing update from remote peer d148369c73aa4cd59e17f9d5a0b6c181: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:58.201323 13978 consensus_queue.cc:1048] T 041529b194374c228a48aaee162ec1d9 P d148369c73aa4cd59e17f9d5a0b6c181 [LEADER]: Connected to new peer: Peer: permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:58.211951 13746 raft_consensus.cc:1275] T e27355722e7349aaa58d6ed2d707b81f P 056f6a42190a46df97a5104db44e9d64 [term 4 FOLLOWER]: Refusing update from remote peer d148369c73aa4cd59e17f9d5a0b6c181: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:08:58.213614 14005 consensus_queue.cc:1048] T e27355722e7349aaa58d6ed2d707b81f P d148369c73aa4cd59e17f9d5a0b6c181 [LEADER]: Connected to new peer: Peer: permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:08:58.216638 13821 raft_consensus.cc:1275] T 041529b194374c228a48aaee162ec1d9 P 4018be520383439497fd4ee03342ed73 [term 3 FOLLOWER]: Refusing update from remote peer d148369c73aa4cd59e17f9d5a0b6c181: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:58.218758 14004 consensus_queue.cc:1048] T 041529b194374c228a48aaee162ec1d9 P d148369c73aa4cd59e17f9d5a0b6c181 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:58.240983 13820 raft_consensus.cc:1275] T e27355722e7349aaa58d6ed2d707b81f P 4018be520383439497fd4ee03342ed73 [term 4 FOLLOWER]: Refusing update from remote peer d148369c73aa4cd59e17f9d5a0b6c181: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:08:58.245769 13996 consensus_queue.cc:1048] T e27355722e7349aaa58d6ed2d707b81f P d148369c73aa4cd59e17f9d5a0b6c181 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:00.354496 12986 auto_leader_rebalancer-test.cc:399] The leader distribution is 
I20260709 12:09:00.355391 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:00.363353 13673 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "27d8fa0b057c4ff09029177a296ce950"
dest_uuid: "d148369c73aa4cd59e17f9d5a0b6c181"
mode: GRACEFUL
new_leader_uuid: "056f6a42190a46df97a5104db44e9d64"
 from {username='slave'} at 127.0.0.1:45786
I20260709 12:09:00.364030 13673 raft_consensus.cc:606] T 27d8fa0b057c4ff09029177a296ce950 P d148369c73aa4cd59e17f9d5a0b6c181 [term 2 LEADER]: Received request to transfer leadership to TS 056f6a42190a46df97a5104db44e9d64
I20260709 12:09:00.366709 13673 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3ba6e60509e5462f984736f50675cd17"
dest_uuid: "d148369c73aa4cd59e17f9d5a0b6c181"
mode: GRACEFUL
new_leader_uuid: "4018be520383439497fd4ee03342ed73"
 from {username='slave'} at 127.0.0.1:45786
I20260709 12:09:00.367199 13673 raft_consensus.cc:606] T 3ba6e60509e5462f984736f50675cd17 P d148369c73aa4cd59e17f9d5a0b6c181 [term 2 LEADER]: Received request to transfer leadership to TS 4018be520383439497fd4ee03342ed73
I20260709 12:09:00.369796 13673 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6c145809834e41bea496b130cfda3cac"
dest_uuid: "d148369c73aa4cd59e17f9d5a0b6c181"
mode: GRACEFUL
new_leader_uuid: "4018be520383439497fd4ee03342ed73"
 from {username='slave'} at 127.0.0.1:45786
I20260709 12:09:00.370369 13673 raft_consensus.cc:606] T 6c145809834e41bea496b130cfda3cac P d148369c73aa4cd59e17f9d5a0b6c181 [term 2 LEADER]: Received request to transfer leadership to TS 4018be520383439497fd4ee03342ed73
I20260709 12:09:00.372733 13673 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e27355722e7349aaa58d6ed2d707b81f"
dest_uuid: "d148369c73aa4cd59e17f9d5a0b6c181"
mode: GRACEFUL
new_leader_uuid: "056f6a42190a46df97a5104db44e9d64"
 from {username='slave'} at 127.0.0.1:45786
I20260709 12:09:00.373283 13673 raft_consensus.cc:606] T e27355722e7349aaa58d6ed2d707b81f P d148369c73aa4cd59e17f9d5a0b6c181 [term 4 LEADER]: Received request to transfer leadership to TS 056f6a42190a46df97a5104db44e9d64
I20260709 12:09:00.374352 12986 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:09:00.374882 12986 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:00.392604 14023 raft_consensus.cc:993] T 3ba6e60509e5462f984736f50675cd17 P d148369c73aa4cd59e17f9d5a0b6c181: : Instructing follower 4018be520383439497fd4ee03342ed73 to start an election
I20260709 12:09:00.393108 14004 raft_consensus.cc:1081] T 3ba6e60509e5462f984736f50675cd17 P d148369c73aa4cd59e17f9d5a0b6c181 [term 2 LEADER]: Signalling peer 4018be520383439497fd4ee03342ed73 to start an election
I20260709 12:09:00.394785 13821 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3ba6e60509e5462f984736f50675cd17"
dest_uuid: "4018be520383439497fd4ee03342ed73"
 from {username='slave'} at 127.0.0.1:48030
I20260709 12:09:00.395318 13821 raft_consensus.cc:493] T 3ba6e60509e5462f984736f50675cd17 P 4018be520383439497fd4ee03342ed73 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:00.395622 13821 raft_consensus.cc:3060] T 3ba6e60509e5462f984736f50675cd17 P 4018be520383439497fd4ee03342ed73 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:00.400740 13821 raft_consensus.cc:515] T 3ba6e60509e5462f984736f50675cd17 P 4018be520383439497fd4ee03342ed73 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } }
I20260709 12:09:00.403019 13821 leader_election.cc:290] T 3ba6e60509e5462f984736f50675cd17 P 4018be520383439497fd4ee03342ed73 [CANDIDATE]: Term 3 election: Requested vote from peers d148369c73aa4cd59e17f9d5a0b6c181 (127.12.174.129:37737), 056f6a42190a46df97a5104db44e9d64 (127.12.174.130:44237)
I20260709 12:09:00.404037 13673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba6e60509e5462f984736f50675cd17" candidate_uuid: "4018be520383439497fd4ee03342ed73" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d148369c73aa4cd59e17f9d5a0b6c181"
I20260709 12:09:00.404031 13746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba6e60509e5462f984736f50675cd17" candidate_uuid: "4018be520383439497fd4ee03342ed73" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "056f6a42190a46df97a5104db44e9d64"
I20260709 12:09:00.404779 13673 raft_consensus.cc:3055] T 3ba6e60509e5462f984736f50675cd17 P d148369c73aa4cd59e17f9d5a0b6c181 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:00.404807 13746 raft_consensus.cc:3060] T 3ba6e60509e5462f984736f50675cd17 P 056f6a42190a46df97a5104db44e9d64 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:00.405174 13673 raft_consensus.cc:740] T 3ba6e60509e5462f984736f50675cd17 P d148369c73aa4cd59e17f9d5a0b6c181 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d148369c73aa4cd59e17f9d5a0b6c181, State: Running, Role: LEADER
I20260709 12:09:00.405982 13673 consensus_queue.cc:260] T 3ba6e60509e5462f984736f50675cd17 P d148369c73aa4cd59e17f9d5a0b6c181 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } }
I20260709 12:09:00.407133 13673 raft_consensus.cc:3060] T 3ba6e60509e5462f984736f50675cd17 P d148369c73aa4cd59e17f9d5a0b6c181 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:00.410408 13746 raft_consensus.cc:2468] T 3ba6e60509e5462f984736f50675cd17 P 056f6a42190a46df97a5104db44e9d64 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4018be520383439497fd4ee03342ed73 in term 3.
I20260709 12:09:00.412056 13785 leader_election.cc:304] T 3ba6e60509e5462f984736f50675cd17 P 4018be520383439497fd4ee03342ed73 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 056f6a42190a46df97a5104db44e9d64, 4018be520383439497fd4ee03342ed73; no voters: 
I20260709 12:09:00.412930 13991 raft_consensus.cc:2804] T 3ba6e60509e5462f984736f50675cd17 P 4018be520383439497fd4ee03342ed73 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:00.413915 13673 raft_consensus.cc:2468] T 3ba6e60509e5462f984736f50675cd17 P d148369c73aa4cd59e17f9d5a0b6c181 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4018be520383439497fd4ee03342ed73 in term 3.
I20260709 12:09:00.414278 13991 raft_consensus.cc:697] T 3ba6e60509e5462f984736f50675cd17 P 4018be520383439497fd4ee03342ed73 [term 3 LEADER]: Becoming Leader. State: Replica: 4018be520383439497fd4ee03342ed73, State: Running, Role: LEADER
I20260709 12:09:00.415313 13991 consensus_queue.cc:237] T 3ba6e60509e5462f984736f50675cd17 P 4018be520383439497fd4ee03342ed73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } }
I20260709 12:09:00.421252 14023 raft_consensus.cc:993] T 27d8fa0b057c4ff09029177a296ce950 P d148369c73aa4cd59e17f9d5a0b6c181: : Instructing follower 056f6a42190a46df97a5104db44e9d64 to start an election
I20260709 12:09:00.421722 14004 raft_consensus.cc:1081] T 27d8fa0b057c4ff09029177a296ce950 P d148369c73aa4cd59e17f9d5a0b6c181 [term 2 LEADER]: Signalling peer 056f6a42190a46df97a5104db44e9d64 to start an election
I20260709 12:09:00.423262 13746 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "27d8fa0b057c4ff09029177a296ce950"
dest_uuid: "056f6a42190a46df97a5104db44e9d64"
 from {username='slave'} at 127.0.0.1:53500
I20260709 12:09:00.423758 13746 raft_consensus.cc:493] T 27d8fa0b057c4ff09029177a296ce950 P 056f6a42190a46df97a5104db44e9d64 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:00.423300 13568 catalog_manager.cc:5697] T 3ba6e60509e5462f984736f50675cd17 P 4018be520383439497fd4ee03342ed73 reported cstate change: term changed from 2 to 3, leader changed from d148369c73aa4cd59e17f9d5a0b6c181 (127.12.174.129) to 4018be520383439497fd4ee03342ed73 (127.12.174.131). New cstate: current_term: 3 leader_uuid: "4018be520383439497fd4ee03342ed73" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:00.424031 13746 raft_consensus.cc:3060] T 27d8fa0b057c4ff09029177a296ce950 P 056f6a42190a46df97a5104db44e9d64 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:00.431094 13746 raft_consensus.cc:515] T 27d8fa0b057c4ff09029177a296ce950 P 056f6a42190a46df97a5104db44e9d64 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } }
I20260709 12:09:00.434844 13673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d8fa0b057c4ff09029177a296ce950" candidate_uuid: "056f6a42190a46df97a5104db44e9d64" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d148369c73aa4cd59e17f9d5a0b6c181"
I20260709 12:09:00.435503 13673 raft_consensus.cc:3055] T 27d8fa0b057c4ff09029177a296ce950 P d148369c73aa4cd59e17f9d5a0b6c181 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:00.435822 13673 raft_consensus.cc:740] T 27d8fa0b057c4ff09029177a296ce950 P d148369c73aa4cd59e17f9d5a0b6c181 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d148369c73aa4cd59e17f9d5a0b6c181, State: Running, Role: LEADER
I20260709 12:09:00.436687 13673 consensus_queue.cc:260] T 27d8fa0b057c4ff09029177a296ce950 P d148369c73aa4cd59e17f9d5a0b6c181 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } }
I20260709 12:09:00.437525 13746 leader_election.cc:290] T 27d8fa0b057c4ff09029177a296ce950 P 056f6a42190a46df97a5104db44e9d64 [CANDIDATE]: Term 3 election: Requested vote from peers d148369c73aa4cd59e17f9d5a0b6c181 (127.12.174.129:37737), 4018be520383439497fd4ee03342ed73 (127.12.174.131:46793)
I20260709 12:09:00.437785 13673 raft_consensus.cc:3060] T 27d8fa0b057c4ff09029177a296ce950 P d148369c73aa4cd59e17f9d5a0b6c181 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:00.438516 13821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27d8fa0b057c4ff09029177a296ce950" candidate_uuid: "056f6a42190a46df97a5104db44e9d64" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4018be520383439497fd4ee03342ed73"
I20260709 12:09:00.439074 13821 raft_consensus.cc:3060] T 27d8fa0b057c4ff09029177a296ce950 P 4018be520383439497fd4ee03342ed73 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:00.446735 13821 raft_consensus.cc:2468] T 27d8fa0b057c4ff09029177a296ce950 P 4018be520383439497fd4ee03342ed73 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 056f6a42190a46df97a5104db44e9d64 in term 3.
I20260709 12:09:00.446914 13673 raft_consensus.cc:2468] T 27d8fa0b057c4ff09029177a296ce950 P d148369c73aa4cd59e17f9d5a0b6c181 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 056f6a42190a46df97a5104db44e9d64 in term 3.
I20260709 12:09:00.448221 13714 leader_election.cc:304] T 27d8fa0b057c4ff09029177a296ce950 P 056f6a42190a46df97a5104db44e9d64 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 056f6a42190a46df97a5104db44e9d64, 4018be520383439497fd4ee03342ed73; no voters: 
I20260709 12:09:00.449025 14021 raft_consensus.cc:2804] T 27d8fa0b057c4ff09029177a296ce950 P 056f6a42190a46df97a5104db44e9d64 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:00.450371 14021 raft_consensus.cc:697] T 27d8fa0b057c4ff09029177a296ce950 P 056f6a42190a46df97a5104db44e9d64 [term 3 LEADER]: Becoming Leader. State: Replica: 056f6a42190a46df97a5104db44e9d64, State: Running, Role: LEADER
I20260709 12:09:00.451208 14021 consensus_queue.cc:237] T 27d8fa0b057c4ff09029177a296ce950 P 056f6a42190a46df97a5104db44e9d64 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } }
I20260709 12:09:00.458402 13568 catalog_manager.cc:5697] T 27d8fa0b057c4ff09029177a296ce950 P 056f6a42190a46df97a5104db44e9d64 reported cstate change: term changed from 2 to 3, leader changed from d148369c73aa4cd59e17f9d5a0b6c181 (127.12.174.129) to 056f6a42190a46df97a5104db44e9d64 (127.12.174.130). New cstate: current_term: 3 leader_uuid: "056f6a42190a46df97a5104db44e9d64" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:00.525128 14023 raft_consensus.cc:993] T e27355722e7349aaa58d6ed2d707b81f P d148369c73aa4cd59e17f9d5a0b6c181: : Instructing follower 056f6a42190a46df97a5104db44e9d64 to start an election
I20260709 12:09:00.525784 14004 raft_consensus.cc:1081] T e27355722e7349aaa58d6ed2d707b81f P d148369c73aa4cd59e17f9d5a0b6c181 [term 4 LEADER]: Signalling peer 056f6a42190a46df97a5104db44e9d64 to start an election
I20260709 12:09:00.527371 13746 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e27355722e7349aaa58d6ed2d707b81f"
dest_uuid: "056f6a42190a46df97a5104db44e9d64"
 from {username='slave'} at 127.0.0.1:53500
I20260709 12:09:00.527843 13746 raft_consensus.cc:493] T e27355722e7349aaa58d6ed2d707b81f P 056f6a42190a46df97a5104db44e9d64 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:00.528117 13746 raft_consensus.cc:3060] T e27355722e7349aaa58d6ed2d707b81f P 056f6a42190a46df97a5104db44e9d64 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:09:00.533087 13746 raft_consensus.cc:515] T e27355722e7349aaa58d6ed2d707b81f P 056f6a42190a46df97a5104db44e9d64 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } }
I20260709 12:09:00.534912 13746 leader_election.cc:290] T e27355722e7349aaa58d6ed2d707b81f P 056f6a42190a46df97a5104db44e9d64 [CANDIDATE]: Term 5 election: Requested vote from peers d148369c73aa4cd59e17f9d5a0b6c181 (127.12.174.129:37737), 4018be520383439497fd4ee03342ed73 (127.12.174.131:46793)
I20260709 12:09:00.536022 13821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27355722e7349aaa58d6ed2d707b81f" candidate_uuid: "056f6a42190a46df97a5104db44e9d64" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "4018be520383439497fd4ee03342ed73"
I20260709 12:09:00.536175 13673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e27355722e7349aaa58d6ed2d707b81f" candidate_uuid: "056f6a42190a46df97a5104db44e9d64" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "d148369c73aa4cd59e17f9d5a0b6c181"
I20260709 12:09:00.536599 13821 raft_consensus.cc:3060] T e27355722e7349aaa58d6ed2d707b81f P 4018be520383439497fd4ee03342ed73 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:09:00.536672 13673 raft_consensus.cc:3055] T e27355722e7349aaa58d6ed2d707b81f P d148369c73aa4cd59e17f9d5a0b6c181 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:09:00.537082 13673 raft_consensus.cc:740] T e27355722e7349aaa58d6ed2d707b81f P d148369c73aa4cd59e17f9d5a0b6c181 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d148369c73aa4cd59e17f9d5a0b6c181, State: Running, Role: LEADER
I20260709 12:09:00.537914 13673 consensus_queue.cc:260] T e27355722e7349aaa58d6ed2d707b81f P d148369c73aa4cd59e17f9d5a0b6c181 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } }
I20260709 12:09:00.538950 13673 raft_consensus.cc:3060] T e27355722e7349aaa58d6ed2d707b81f P d148369c73aa4cd59e17f9d5a0b6c181 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:09:00.541869 13821 raft_consensus.cc:2468] T e27355722e7349aaa58d6ed2d707b81f P 4018be520383439497fd4ee03342ed73 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 056f6a42190a46df97a5104db44e9d64 in term 5.
I20260709 12:09:00.542904 13714 leader_election.cc:304] T e27355722e7349aaa58d6ed2d707b81f P 056f6a42190a46df97a5104db44e9d64 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 056f6a42190a46df97a5104db44e9d64, 4018be520383439497fd4ee03342ed73; no voters: 
I20260709 12:09:00.543553 14021 raft_consensus.cc:2804] T e27355722e7349aaa58d6ed2d707b81f P 056f6a42190a46df97a5104db44e9d64 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:09:00.543762 13673 raft_consensus.cc:2468] T e27355722e7349aaa58d6ed2d707b81f P d148369c73aa4cd59e17f9d5a0b6c181 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 056f6a42190a46df97a5104db44e9d64 in term 5.
I20260709 12:09:00.543962 14021 raft_consensus.cc:697] T e27355722e7349aaa58d6ed2d707b81f P 056f6a42190a46df97a5104db44e9d64 [term 5 LEADER]: Becoming Leader. State: Replica: 056f6a42190a46df97a5104db44e9d64, State: Running, Role: LEADER
I20260709 12:09:00.545002 14021 consensus_queue.cc:237] T e27355722e7349aaa58d6ed2d707b81f P 056f6a42190a46df97a5104db44e9d64 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } }
I20260709 12:09:00.552757 13568 catalog_manager.cc:5697] T e27355722e7349aaa58d6ed2d707b81f P 056f6a42190a46df97a5104db44e9d64 reported cstate change: term changed from 4 to 5, leader changed from d148369c73aa4cd59e17f9d5a0b6c181 (127.12.174.129) to 056f6a42190a46df97a5104db44e9d64 (127.12.174.130). New cstate: current_term: 5 leader_uuid: "056f6a42190a46df97a5104db44e9d64" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:00.704279 14023 raft_consensus.cc:993] T 6c145809834e41bea496b130cfda3cac P d148369c73aa4cd59e17f9d5a0b6c181: : Instructing follower 4018be520383439497fd4ee03342ed73 to start an election
I20260709 12:09:00.704742 14004 raft_consensus.cc:1081] T 6c145809834e41bea496b130cfda3cac P d148369c73aa4cd59e17f9d5a0b6c181 [term 2 LEADER]: Signalling peer 4018be520383439497fd4ee03342ed73 to start an election
I20260709 12:09:00.706342 13821 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6c145809834e41bea496b130cfda3cac"
dest_uuid: "4018be520383439497fd4ee03342ed73"
 from {username='slave'} at 127.0.0.1:48030
I20260709 12:09:00.706796 13821 raft_consensus.cc:493] T 6c145809834e41bea496b130cfda3cac P 4018be520383439497fd4ee03342ed73 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:00.707062 13821 raft_consensus.cc:3060] T 6c145809834e41bea496b130cfda3cac P 4018be520383439497fd4ee03342ed73 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:00.711968 13821 raft_consensus.cc:515] T 6c145809834e41bea496b130cfda3cac P 4018be520383439497fd4ee03342ed73 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } }
I20260709 12:09:00.713577 13821 leader_election.cc:290] T 6c145809834e41bea496b130cfda3cac P 4018be520383439497fd4ee03342ed73 [CANDIDATE]: Term 3 election: Requested vote from peers d148369c73aa4cd59e17f9d5a0b6c181 (127.12.174.129:37737), 056f6a42190a46df97a5104db44e9d64 (127.12.174.130:44237)
I20260709 12:09:00.714365 13673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c145809834e41bea496b130cfda3cac" candidate_uuid: "4018be520383439497fd4ee03342ed73" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d148369c73aa4cd59e17f9d5a0b6c181"
I20260709 12:09:00.714538 13746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c145809834e41bea496b130cfda3cac" candidate_uuid: "4018be520383439497fd4ee03342ed73" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "056f6a42190a46df97a5104db44e9d64"
I20260709 12:09:00.714941 13673 raft_consensus.cc:3055] T 6c145809834e41bea496b130cfda3cac P d148369c73aa4cd59e17f9d5a0b6c181 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:00.715088 13746 raft_consensus.cc:3060] T 6c145809834e41bea496b130cfda3cac P 056f6a42190a46df97a5104db44e9d64 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:00.715219 13673 raft_consensus.cc:740] T 6c145809834e41bea496b130cfda3cac P d148369c73aa4cd59e17f9d5a0b6c181 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d148369c73aa4cd59e17f9d5a0b6c181, State: Running, Role: LEADER
I20260709 12:09:00.715880 13673 consensus_queue.cc:260] T 6c145809834e41bea496b130cfda3cac P d148369c73aa4cd59e17f9d5a0b6c181 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } }
I20260709 12:09:00.716811 13673 raft_consensus.cc:3060] T 6c145809834e41bea496b130cfda3cac P d148369c73aa4cd59e17f9d5a0b6c181 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:00.720304 13746 raft_consensus.cc:2468] T 6c145809834e41bea496b130cfda3cac P 056f6a42190a46df97a5104db44e9d64 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4018be520383439497fd4ee03342ed73 in term 3.
I20260709 12:09:00.721417 13785 leader_election.cc:304] T 6c145809834e41bea496b130cfda3cac P 4018be520383439497fd4ee03342ed73 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 056f6a42190a46df97a5104db44e9d64, 4018be520383439497fd4ee03342ed73; no voters: 
I20260709 12:09:00.721530 13673 raft_consensus.cc:2468] T 6c145809834e41bea496b130cfda3cac P d148369c73aa4cd59e17f9d5a0b6c181 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4018be520383439497fd4ee03342ed73 in term 3.
I20260709 12:09:00.722337 13991 raft_consensus.cc:2804] T 6c145809834e41bea496b130cfda3cac P 4018be520383439497fd4ee03342ed73 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:00.722879 13991 raft_consensus.cc:697] T 6c145809834e41bea496b130cfda3cac P 4018be520383439497fd4ee03342ed73 [term 3 LEADER]: Becoming Leader. State: Replica: 4018be520383439497fd4ee03342ed73, State: Running, Role: LEADER
I20260709 12:09:00.723822 13991 consensus_queue.cc:237] T 6c145809834e41bea496b130cfda3cac P 4018be520383439497fd4ee03342ed73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } }
I20260709 12:09:00.731724 13568 catalog_manager.cc:5697] T 6c145809834e41bea496b130cfda3cac P 4018be520383439497fd4ee03342ed73 reported cstate change: term changed from 2 to 3, leader changed from d148369c73aa4cd59e17f9d5a0b6c181 (127.12.174.129) to 4018be520383439497fd4ee03342ed73 (127.12.174.131). New cstate: current_term: 3 leader_uuid: "4018be520383439497fd4ee03342ed73" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:00.983397 13673 raft_consensus.cc:1275] T 3ba6e60509e5462f984736f50675cd17 P d148369c73aa4cd59e17f9d5a0b6c181 [term 3 FOLLOWER]: Refusing update from remote peer 4018be520383439497fd4ee03342ed73: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:00.984650 13991 consensus_queue.cc:1048] T 3ba6e60509e5462f984736f50675cd17 P 4018be520383439497fd4ee03342ed73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:00.990690 13745 raft_consensus.cc:1275] T 3ba6e60509e5462f984736f50675cd17 P 056f6a42190a46df97a5104db44e9d64 [term 3 FOLLOWER]: Refusing update from remote peer 4018be520383439497fd4ee03342ed73: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:00.996182 13991 consensus_queue.cc:1048] T 3ba6e60509e5462f984736f50675cd17 P 4018be520383439497fd4ee03342ed73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:01.022190 13821 raft_consensus.cc:1275] T 27d8fa0b057c4ff09029177a296ce950 P 4018be520383439497fd4ee03342ed73 [term 3 FOLLOWER]: Refusing update from remote peer 056f6a42190a46df97a5104db44e9d64: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:01.023468 14021 consensus_queue.cc:1048] T 27d8fa0b057c4ff09029177a296ce950 P 056f6a42190a46df97a5104db44e9d64 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:01.033054 13673 raft_consensus.cc:1275] T 27d8fa0b057c4ff09029177a296ce950 P d148369c73aa4cd59e17f9d5a0b6c181 [term 3 FOLLOWER]: Refusing update from remote peer 056f6a42190a46df97a5104db44e9d64: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:01.035567 14030 consensus_queue.cc:1048] T 27d8fa0b057c4ff09029177a296ce950 P 056f6a42190a46df97a5104db44e9d64 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:01.071302 13673 raft_consensus.cc:1275] T e27355722e7349aaa58d6ed2d707b81f P d148369c73aa4cd59e17f9d5a0b6c181 [term 5 FOLLOWER]: Refusing update from remote peer 056f6a42190a46df97a5104db44e9d64: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:09:01.072644 14030 consensus_queue.cc:1048] T e27355722e7349aaa58d6ed2d707b81f P 056f6a42190a46df97a5104db44e9d64 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:01.081488 13821 raft_consensus.cc:1275] T e27355722e7349aaa58d6ed2d707b81f P 4018be520383439497fd4ee03342ed73 [term 5 FOLLOWER]: Refusing update from remote peer 056f6a42190a46df97a5104db44e9d64: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:09:01.083281 14030 consensus_queue.cc:1048] T e27355722e7349aaa58d6ed2d707b81f P 056f6a42190a46df97a5104db44e9d64 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4018be520383439497fd4ee03342ed73" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 46793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:01.241454 13745 raft_consensus.cc:1275] T 6c145809834e41bea496b130cfda3cac P 056f6a42190a46df97a5104db44e9d64 [term 3 FOLLOWER]: Refusing update from remote peer 4018be520383439497fd4ee03342ed73: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:01.242800 13991 consensus_queue.cc:1048] T 6c145809834e41bea496b130cfda3cac P 4018be520383439497fd4ee03342ed73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "056f6a42190a46df97a5104db44e9d64" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 44237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:01.247972 13673 raft_consensus.cc:1275] T 6c145809834e41bea496b130cfda3cac P d148369c73aa4cd59e17f9d5a0b6c181 [term 3 FOLLOWER]: Refusing update from remote peer 4018be520383439497fd4ee03342ed73: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:01.249439 13991 consensus_queue.cc:1048] T 6c145809834e41bea496b130cfda3cac P 4018be520383439497fd4ee03342ed73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d148369c73aa4cd59e17f9d5a0b6c181" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:01.376013 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:01.381847 12986 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:01.382287 12986 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:02.383244 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:02.389145 12986 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:02.389602 12986 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:03.390703 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:03.397092 12986 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:03.397635 12986 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:04.398623 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:04.404224 12986 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:04.404691 12986 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:05.405912 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:05.412680 12986 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:05.413141 12986 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:06.414099 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:06.421039 12986 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:06.421483 12986 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:07.422680 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:07.429876 12986 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:07.430413 12986 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:08.431552 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:08.436975 12986 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:08.437476 12986 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:09.438588 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:09.444298 12986 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:09.444788 12986 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:10.484719 12986 auto_leader_rebalancer-test.cc:410] The leader distribution is 
I20260709 12:09:10.485430 12986 tablet_server.cc:179] TabletServer@127.12.174.129:0 shutting down...
W20260709 12:09:10.517935 13714 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 2 similar messages]
I20260709 12:09:10.519847 12986 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:09:10.520934 12986 tablet_replica.cc:333] T 3ba6e60509e5462f984736f50675cd17 P d148369c73aa4cd59e17f9d5a0b6c181: stopping tablet replica
W20260709 12:09:10.522006 13714 consensus_peers.cc:597] T e27355722e7349aaa58d6ed2d707b81f P 056f6a42190a46df97a5104db44e9d64 -> Peer d148369c73aa4cd59e17f9d5a0b6c181 (127.12.174.129:37737): Couldn't send request to peer d148369c73aa4cd59e17f9d5a0b6c181. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:10.521970 12986 raft_consensus.cc:2243] T 3ba6e60509e5462f984736f50675cd17 P d148369c73aa4cd59e17f9d5a0b6c181 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:10.522892 12986 raft_consensus.cc:2272] T 3ba6e60509e5462f984736f50675cd17 P d148369c73aa4cd59e17f9d5a0b6c181 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:10.525525 12986 tablet_replica.cc:333] T e27355722e7349aaa58d6ed2d707b81f P d148369c73aa4cd59e17f9d5a0b6c181: stopping tablet replica
I20260709 12:09:10.526357 12986 raft_consensus.cc:2243] T e27355722e7349aaa58d6ed2d707b81f P d148369c73aa4cd59e17f9d5a0b6c181 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:10.526875 12986 raft_consensus.cc:2272] T e27355722e7349aaa58d6ed2d707b81f P d148369c73aa4cd59e17f9d5a0b6c181 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:10.529095 12986 tablet_replica.cc:333] T 6c145809834e41bea496b130cfda3cac P d148369c73aa4cd59e17f9d5a0b6c181: stopping tablet replica
I20260709 12:09:10.529695 12986 raft_consensus.cc:2243] T 6c145809834e41bea496b130cfda3cac P d148369c73aa4cd59e17f9d5a0b6c181 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:10.530251 12986 raft_consensus.cc:2272] T 6c145809834e41bea496b130cfda3cac P d148369c73aa4cd59e17f9d5a0b6c181 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:10.532404 12986 tablet_replica.cc:333] T 1e31988a87d94a7d879cb9552131429d P d148369c73aa4cd59e17f9d5a0b6c181: stopping tablet replica
I20260709 12:09:10.532974 12986 raft_consensus.cc:2243] T 1e31988a87d94a7d879cb9552131429d P d148369c73aa4cd59e17f9d5a0b6c181 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:09:10.533969 12986 raft_consensus.cc:2272] T 1e31988a87d94a7d879cb9552131429d P d148369c73aa4cd59e17f9d5a0b6c181 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:10.536144 12986 tablet_replica.cc:333] T 041529b194374c228a48aaee162ec1d9 P d148369c73aa4cd59e17f9d5a0b6c181: stopping tablet replica
I20260709 12:09:10.536747 12986 raft_consensus.cc:2243] T 041529b194374c228a48aaee162ec1d9 P d148369c73aa4cd59e17f9d5a0b6c181 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:09:10.537676 12986 raft_consensus.cc:2272] T 041529b194374c228a48aaee162ec1d9 P d148369c73aa4cd59e17f9d5a0b6c181 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:10.539999 12986 tablet_replica.cc:333] T 089d82b1caf54ee3b23be8f48cb46605 P d148369c73aa4cd59e17f9d5a0b6c181: stopping tablet replica
I20260709 12:09:10.540601 12986 raft_consensus.cc:2243] T 089d82b1caf54ee3b23be8f48cb46605 P d148369c73aa4cd59e17f9d5a0b6c181 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:09:10.541918 12986 raft_consensus.cc:2272] T 089d82b1caf54ee3b23be8f48cb46605 P d148369c73aa4cd59e17f9d5a0b6c181 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:09:10.544703 13788 consensus_peers.cc:597] T b3984e1dba884ec19c9eecad67e9487a P 4018be520383439497fd4ee03342ed73 -> Peer d148369c73aa4cd59e17f9d5a0b6c181 (127.12.174.129:37737): Couldn't send request to peer d148369c73aa4cd59e17f9d5a0b6c181. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:10.545248 12986 tablet_replica.cc:333] T 10708055ab264a66aadf75fe80ae59f8 P d148369c73aa4cd59e17f9d5a0b6c181: stopping tablet replica
I20260709 12:09:10.546077 12986 raft_consensus.cc:2243] T 10708055ab264a66aadf75fe80ae59f8 P d148369c73aa4cd59e17f9d5a0b6c181 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:09:10.547027 12986 raft_consensus.cc:2272] T 10708055ab264a66aadf75fe80ae59f8 P d148369c73aa4cd59e17f9d5a0b6c181 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:10.549499 12986 tablet_replica.cc:333] T b3984e1dba884ec19c9eecad67e9487a P d148369c73aa4cd59e17f9d5a0b6c181: stopping tablet replica
I20260709 12:09:10.550069 12986 raft_consensus.cc:2243] T b3984e1dba884ec19c9eecad67e9487a P d148369c73aa4cd59e17f9d5a0b6c181 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:10.550551 12986 raft_consensus.cc:2272] T b3984e1dba884ec19c9eecad67e9487a P d148369c73aa4cd59e17f9d5a0b6c181 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:10.552729 12986 tablet_replica.cc:333] T 27d8fa0b057c4ff09029177a296ce950 P d148369c73aa4cd59e17f9d5a0b6c181: stopping tablet replica
I20260709 12:09:10.553233 12986 raft_consensus.cc:2243] T 27d8fa0b057c4ff09029177a296ce950 P d148369c73aa4cd59e17f9d5a0b6c181 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:10.553678 12986 raft_consensus.cc:2272] T 27d8fa0b057c4ff09029177a296ce950 P d148369c73aa4cd59e17f9d5a0b6c181 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:10.555848 12986 tablet_replica.cc:333] T 123f6eb9b1504a40a43955ccad371d4d P d148369c73aa4cd59e17f9d5a0b6c181: stopping tablet replica
I20260709 12:09:10.556596 12986 raft_consensus.cc:2243] T 123f6eb9b1504a40a43955ccad371d4d P d148369c73aa4cd59e17f9d5a0b6c181 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:10.557158 12986 raft_consensus.cc:2272] T 123f6eb9b1504a40a43955ccad371d4d P d148369c73aa4cd59e17f9d5a0b6c181 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:10.590812 12986 tablet_server.cc:196] TabletServer@127.12.174.129:0 shutdown complete.
I20260709 12:09:10.616137 12986 tablet_server.cc:179] TabletServer@127.12.174.130:0 shutting down...
W20260709 12:09:10.644140 13714 consensus_peers.cc:597] T 27d8fa0b057c4ff09029177a296ce950 P 056f6a42190a46df97a5104db44e9d64 -> Peer d148369c73aa4cd59e17f9d5a0b6c181 (127.12.174.129:37737): Couldn't send request to peer d148369c73aa4cd59e17f9d5a0b6c181. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37737: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:10.646082 12986 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:09:10.646799 12986 tablet_replica.cc:333] T 3ba6e60509e5462f984736f50675cd17 P 056f6a42190a46df97a5104db44e9d64: stopping tablet replica
I20260709 12:09:10.647460 12986 raft_consensus.cc:2243] T 3ba6e60509e5462f984736f50675cd17 P 056f6a42190a46df97a5104db44e9d64 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:10.648025 12986 raft_consensus.cc:2272] T 3ba6e60509e5462f984736f50675cd17 P 056f6a42190a46df97a5104db44e9d64 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:10.650645 12986 tablet_replica.cc:333] T e27355722e7349aaa58d6ed2d707b81f P 056f6a42190a46df97a5104db44e9d64: stopping tablet replica
I20260709 12:09:10.651273 12986 raft_consensus.cc:2243] T e27355722e7349aaa58d6ed2d707b81f P 056f6a42190a46df97a5104db44e9d64 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:09:10.652171 12986 raft_consensus.cc:2272] T e27355722e7349aaa58d6ed2d707b81f P 056f6a42190a46df97a5104db44e9d64 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:10.654269 12986 tablet_replica.cc:333] T 089d82b1caf54ee3b23be8f48cb46605 P 056f6a42190a46df97a5104db44e9d64: stopping tablet replica
I20260709 12:09:10.654822 12986 raft_consensus.cc:2243] T 089d82b1caf54ee3b23be8f48cb46605 P 056f6a42190a46df97a5104db44e9d64 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:10.655434 12986 raft_consensus.cc:2272] T 089d82b1caf54ee3b23be8f48cb46605 P 056f6a42190a46df97a5104db44e9d64 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:10.657915 12986 tablet_replica.cc:333] T 041529b194374c228a48aaee162ec1d9 P 056f6a42190a46df97a5104db44e9d64: stopping tablet replica
I20260709 12:09:10.658690 12986 raft_consensus.cc:2243] T 041529b194374c228a48aaee162ec1d9 P 056f6a42190a46df97a5104db44e9d64 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:10.659179 12986 raft_consensus.cc:2272] T 041529b194374c228a48aaee162ec1d9 P 056f6a42190a46df97a5104db44e9d64 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:10.661242 12986 tablet_replica.cc:333] T b3984e1dba884ec19c9eecad67e9487a P 056f6a42190a46df97a5104db44e9d64: stopping tablet replica
I20260709 12:09:10.661825 12986 raft_consensus.cc:2243] T b3984e1dba884ec19c9eecad67e9487a P 056f6a42190a46df97a5104db44e9d64 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:10.662226 12986 raft_consensus.cc:2272] T b3984e1dba884ec19c9eecad67e9487a P 056f6a42190a46df97a5104db44e9d64 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:10.664291 12986 tablet_replica.cc:333] T 27d8fa0b057c4ff09029177a296ce950 P 056f6a42190a46df97a5104db44e9d64: stopping tablet replica
I20260709 12:09:10.664865 12986 raft_consensus.cc:2243] T 27d8fa0b057c4ff09029177a296ce950 P 056f6a42190a46df97a5104db44e9d64 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:09:10.665709 12986 raft_consensus.cc:2272] T 27d8fa0b057c4ff09029177a296ce950 P 056f6a42190a46df97a5104db44e9d64 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:10.667922 12986 tablet_replica.cc:333] T 123f6eb9b1504a40a43955ccad371d4d P 056f6a42190a46df97a5104db44e9d64: stopping tablet replica
I20260709 12:09:10.668406 12986 raft_consensus.cc:2243] T 123f6eb9b1504a40a43955ccad371d4d P 056f6a42190a46df97a5104db44e9d64 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:09:10.669154 12986 raft_consensus.cc:2272] T 123f6eb9b1504a40a43955ccad371d4d P 056f6a42190a46df97a5104db44e9d64 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:10.670984 12986 tablet_replica.cc:333] T 10708055ab264a66aadf75fe80ae59f8 P 056f6a42190a46df97a5104db44e9d64: stopping tablet replica
I20260709 12:09:10.671432 12986 raft_consensus.cc:2243] T 10708055ab264a66aadf75fe80ae59f8 P 056f6a42190a46df97a5104db44e9d64 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:10.671866 12986 raft_consensus.cc:2272] T 10708055ab264a66aadf75fe80ae59f8 P 056f6a42190a46df97a5104db44e9d64 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:10.673484 12986 tablet_replica.cc:333] T 1e31988a87d94a7d879cb9552131429d P 056f6a42190a46df97a5104db44e9d64: stopping tablet replica
I20260709 12:09:10.673974 12986 raft_consensus.cc:2243] T 1e31988a87d94a7d879cb9552131429d P 056f6a42190a46df97a5104db44e9d64 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:10.674401 12986 raft_consensus.cc:2272] T 1e31988a87d94a7d879cb9552131429d P 056f6a42190a46df97a5104db44e9d64 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:10.676120 12986 tablet_replica.cc:333] T 6c145809834e41bea496b130cfda3cac P 056f6a42190a46df97a5104db44e9d64: stopping tablet replica
I20260709 12:09:10.676548 12986 raft_consensus.cc:2243] T 6c145809834e41bea496b130cfda3cac P 056f6a42190a46df97a5104db44e9d64 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:10.676946 12986 raft_consensus.cc:2272] T 6c145809834e41bea496b130cfda3cac P 056f6a42190a46df97a5104db44e9d64 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:10.707077 12986 tablet_server.cc:196] TabletServer@127.12.174.130:0 shutdown complete.
W20260709 12:09:10.723747 13785 consensus_peers.cc:597] T 6c145809834e41bea496b130cfda3cac P 4018be520383439497fd4ee03342ed73 -> Peer 056f6a42190a46df97a5104db44e9d64 (127.12.174.130:44237): Couldn't send request to peer 056f6a42190a46df97a5104db44e9d64. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.130:44237: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:10.732981 12986 tablet_server.cc:179] TabletServer@127.12.174.131:0 shutting down...
W20260709 12:09:10.735237 13785 consensus_peers.cc:597] T 3ba6e60509e5462f984736f50675cd17 P 4018be520383439497fd4ee03342ed73 -> Peer 056f6a42190a46df97a5104db44e9d64 (127.12.174.130:44237): Couldn't send request to peer 056f6a42190a46df97a5104db44e9d64. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.130:44237: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:10.755321 12986 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:09:10.755986 12986 tablet_replica.cc:333] T 3ba6e60509e5462f984736f50675cd17 P 4018be520383439497fd4ee03342ed73: stopping tablet replica
I20260709 12:09:10.756623 12986 raft_consensus.cc:2243] T 3ba6e60509e5462f984736f50675cd17 P 4018be520383439497fd4ee03342ed73 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:09:10.757542 12986 raft_consensus.cc:2272] T 3ba6e60509e5462f984736f50675cd17 P 4018be520383439497fd4ee03342ed73 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:10.759620 12986 tablet_replica.cc:333] T 10708055ab264a66aadf75fe80ae59f8 P 4018be520383439497fd4ee03342ed73: stopping tablet replica
I20260709 12:09:10.760238 12986 raft_consensus.cc:2243] T 10708055ab264a66aadf75fe80ae59f8 P 4018be520383439497fd4ee03342ed73 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:10.760720 12986 raft_consensus.cc:2272] T 10708055ab264a66aadf75fe80ae59f8 P 4018be520383439497fd4ee03342ed73 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:10.762722 12986 tablet_replica.cc:333] T 6c145809834e41bea496b130cfda3cac P 4018be520383439497fd4ee03342ed73: stopping tablet replica
I20260709 12:09:10.763229 12986 raft_consensus.cc:2243] T 6c145809834e41bea496b130cfda3cac P 4018be520383439497fd4ee03342ed73 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:09:10.764034 12986 raft_consensus.cc:2272] T 6c145809834e41bea496b130cfda3cac P 4018be520383439497fd4ee03342ed73 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:10.765863 12986 tablet_replica.cc:333] T 1e31988a87d94a7d879cb9552131429d P 4018be520383439497fd4ee03342ed73: stopping tablet replica
I20260709 12:09:10.766367 12986 raft_consensus.cc:2243] T 1e31988a87d94a7d879cb9552131429d P 4018be520383439497fd4ee03342ed73 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:10.766831 12986 raft_consensus.cc:2272] T 1e31988a87d94a7d879cb9552131429d P 4018be520383439497fd4ee03342ed73 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:10.768473 12986 tablet_replica.cc:333] T b3984e1dba884ec19c9eecad67e9487a P 4018be520383439497fd4ee03342ed73: stopping tablet replica
I20260709 12:09:10.768970 12986 raft_consensus.cc:2243] T b3984e1dba884ec19c9eecad67e9487a P 4018be520383439497fd4ee03342ed73 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:09:10.769791 12986 raft_consensus.cc:2272] T b3984e1dba884ec19c9eecad67e9487a P 4018be520383439497fd4ee03342ed73 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:10.771517 12986 tablet_replica.cc:333] T 123f6eb9b1504a40a43955ccad371d4d P 4018be520383439497fd4ee03342ed73: stopping tablet replica
I20260709 12:09:10.771971 12986 raft_consensus.cc:2243] T 123f6eb9b1504a40a43955ccad371d4d P 4018be520383439497fd4ee03342ed73 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:10.772308 12986 raft_consensus.cc:2272] T 123f6eb9b1504a40a43955ccad371d4d P 4018be520383439497fd4ee03342ed73 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:10.773938 12986 tablet_replica.cc:333] T 27d8fa0b057c4ff09029177a296ce950 P 4018be520383439497fd4ee03342ed73: stopping tablet replica
I20260709 12:09:10.774402 12986 raft_consensus.cc:2243] T 27d8fa0b057c4ff09029177a296ce950 P 4018be520383439497fd4ee03342ed73 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:10.774776 12986 raft_consensus.cc:2272] T 27d8fa0b057c4ff09029177a296ce950 P 4018be520383439497fd4ee03342ed73 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:10.776479 12986 tablet_replica.cc:333] T 089d82b1caf54ee3b23be8f48cb46605 P 4018be520383439497fd4ee03342ed73: stopping tablet replica
I20260709 12:09:10.776937 12986 raft_consensus.cc:2243] T 089d82b1caf54ee3b23be8f48cb46605 P 4018be520383439497fd4ee03342ed73 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:10.777328 12986 raft_consensus.cc:2272] T 089d82b1caf54ee3b23be8f48cb46605 P 4018be520383439497fd4ee03342ed73 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:10.779091 12986 tablet_replica.cc:333] T 041529b194374c228a48aaee162ec1d9 P 4018be520383439497fd4ee03342ed73: stopping tablet replica
I20260709 12:09:10.779515 12986 raft_consensus.cc:2243] T 041529b194374c228a48aaee162ec1d9 P 4018be520383439497fd4ee03342ed73 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:10.779906 12986 raft_consensus.cc:2272] T 041529b194374c228a48aaee162ec1d9 P 4018be520383439497fd4ee03342ed73 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:10.781634 12986 tablet_replica.cc:333] T e27355722e7349aaa58d6ed2d707b81f P 4018be520383439497fd4ee03342ed73: stopping tablet replica
I20260709 12:09:10.782078 12986 raft_consensus.cc:2243] T e27355722e7349aaa58d6ed2d707b81f P 4018be520383439497fd4ee03342ed73 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:10.782475 12986 raft_consensus.cc:2272] T e27355722e7349aaa58d6ed2d707b81f P 4018be520383439497fd4ee03342ed73 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:10.814714 12986 tablet_server.cc:196] TabletServer@127.12.174.131:0 shutdown complete.
I20260709 12:09:10.838388 12986 master.cc:562] Master@127.12.174.190:44819 shutting down...
I20260709 12:09:10.862885 12986 raft_consensus.cc:2243] T 00000000000000000000000000000000 P c540a9111b00450cb580b92db6199316 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:09:10.863531 12986 raft_consensus.cc:2272] T 00000000000000000000000000000000 P c540a9111b00450cb580b92db6199316 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:10.863888 12986 tablet_replica.cc:333] T 00000000000000000000000000000000 P c540a9111b00450cb580b92db6199316: stopping tablet replica
I20260709 12:09:10.904182 12986 master.cc:584] Master@127.12.174.190:44819 shutdown complete.
056f6a42190a46df97a5104db44e9d64  4
4018be520383439497fd4ee03342ed73  1
d148369c73aa4cd59e17f9d5a0b6c181  5
056f6a42190a46df97a5104db44e9d64  4
4018be520383439497fd4ee03342ed73  3
d148369c73aa4cd59e17f9d5a0b6c181  3
056f6a42190a46df97a5104db44e9d64  1
4018be520383439497fd4ee03342ed73  1
d148369c73aa4cd59e17f9d5a0b6c181  8
056f6a42190a46df97a5104db44e9d64  3
4018be520383439497fd4ee03342ed73  3
d148369c73aa4cd59e17f9d5a0b6c181  4
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (28938 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 12:09:10.949092 12986 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.12.174.190:39655
I20260709 12:09:10.950445 12986 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:09:10.956914 14063 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:09:10.957329 14064 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:09:10.957370 14066 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:09:10.958648 12986 server_base.cc:1061] running on GCE node
I20260709 12:09:10.959529 12986 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:09:10.959713 12986 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:09:10.959829 12986 hybrid_clock.cc:648] HybridClock initialized: now 1783598950959818 us; error 0 us; skew 500 ppm
I20260709 12:09:10.960318 12986 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:09:10.962841 12986 webserver.cc:533] Webserver started at http://127.12.174.190:43421/ using document root <none> and password file <none>
I20260709 12:09:10.963315 12986 fs_manager.cc:362] Metadata directory not provided
I20260709 12:09:10.963475 12986 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:09:10.963707 12986 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:09:10.965098 12986 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598886212958-12986-0/minicluster-data/master-0-root/instance:
uuid: "d07070be2c074f4cb9ad35f1580c4ef7"
format_stamp: "Formatted at 2026-07-09 12:09:10 on dist-test-slave-9q7n"
I20260709 12:09:10.970220 12986 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.002s
I20260709 12:09:10.973896 14071 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:10.974718 12986 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.002s
I20260709 12:09:10.975054 12986 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598886212958-12986-0/minicluster-data/master-0-root
uuid: "d07070be2c074f4cb9ad35f1580c4ef7"
format_stamp: "Formatted at 2026-07-09 12:09:10 on dist-test-slave-9q7n"
I20260709 12:09:10.975378 12986 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598886212958-12986-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598886212958-12986-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598886212958-12986-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:09:11.000303 12986 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:09:11.001780 12986 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:09:11.044654 12986 rpc_server.cc:307] RPC server started. Bound to: 127.12.174.190:39655
I20260709 12:09:11.044776 14122 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.174.190:39655 every 8 connection(s)
I20260709 12:09:11.048960 14123 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:11.060719 14123 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d07070be2c074f4cb9ad35f1580c4ef7: Bootstrap starting.
I20260709 12:09:11.066110 14123 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d07070be2c074f4cb9ad35f1580c4ef7: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:11.070968 14123 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d07070be2c074f4cb9ad35f1580c4ef7: No bootstrap required, opened a new log
I20260709 12:09:11.073488 14123 raft_consensus.cc:359] T 00000000000000000000000000000000 P d07070be2c074f4cb9ad35f1580c4ef7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d07070be2c074f4cb9ad35f1580c4ef7" member_type: VOTER }
I20260709 12:09:11.074002 14123 raft_consensus.cc:385] T 00000000000000000000000000000000 P d07070be2c074f4cb9ad35f1580c4ef7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:11.074235 14123 raft_consensus.cc:740] T 00000000000000000000000000000000 P d07070be2c074f4cb9ad35f1580c4ef7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d07070be2c074f4cb9ad35f1580c4ef7, State: Initialized, Role: FOLLOWER
I20260709 12:09:11.074887 14123 consensus_queue.cc:260] T 00000000000000000000000000000000 P d07070be2c074f4cb9ad35f1580c4ef7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d07070be2c074f4cb9ad35f1580c4ef7" member_type: VOTER }
I20260709 12:09:11.075380 14123 raft_consensus.cc:399] T 00000000000000000000000000000000 P d07070be2c074f4cb9ad35f1580c4ef7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:09:11.075610 14123 raft_consensus.cc:493] T 00000000000000000000000000000000 P d07070be2c074f4cb9ad35f1580c4ef7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:09:11.075891 14123 raft_consensus.cc:3060] T 00000000000000000000000000000000 P d07070be2c074f4cb9ad35f1580c4ef7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:11.081298 14123 raft_consensus.cc:515] T 00000000000000000000000000000000 P d07070be2c074f4cb9ad35f1580c4ef7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d07070be2c074f4cb9ad35f1580c4ef7" member_type: VOTER }
I20260709 12:09:11.081967 14123 leader_election.cc:304] T 00000000000000000000000000000000 P d07070be2c074f4cb9ad35f1580c4ef7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d07070be2c074f4cb9ad35f1580c4ef7; no voters: 
I20260709 12:09:11.083648 14123 leader_election.cc:290] T 00000000000000000000000000000000 P d07070be2c074f4cb9ad35f1580c4ef7 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:09:11.083946 14126 raft_consensus.cc:2804] T 00000000000000000000000000000000 P d07070be2c074f4cb9ad35f1580c4ef7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:11.085399 14126 raft_consensus.cc:697] T 00000000000000000000000000000000 P d07070be2c074f4cb9ad35f1580c4ef7 [term 1 LEADER]: Becoming Leader. State: Replica: d07070be2c074f4cb9ad35f1580c4ef7, State: Running, Role: LEADER
I20260709 12:09:11.086207 14126 consensus_queue.cc:237] T 00000000000000000000000000000000 P d07070be2c074f4cb9ad35f1580c4ef7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d07070be2c074f4cb9ad35f1580c4ef7" member_type: VOTER }
I20260709 12:09:11.087076 14123 sys_catalog.cc:565] T 00000000000000000000000000000000 P d07070be2c074f4cb9ad35f1580c4ef7 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:09:11.091609 14128 sys_catalog.cc:455] T 00000000000000000000000000000000 P d07070be2c074f4cb9ad35f1580c4ef7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d07070be2c074f4cb9ad35f1580c4ef7. Latest consensus state: current_term: 1 leader_uuid: "d07070be2c074f4cb9ad35f1580c4ef7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d07070be2c074f4cb9ad35f1580c4ef7" member_type: VOTER } }
I20260709 12:09:11.091764 14127 sys_catalog.cc:455] T 00000000000000000000000000000000 P d07070be2c074f4cb9ad35f1580c4ef7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d07070be2c074f4cb9ad35f1580c4ef7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d07070be2c074f4cb9ad35f1580c4ef7" member_type: VOTER } }
I20260709 12:09:11.092366 14128 sys_catalog.cc:458] T 00000000000000000000000000000000 P d07070be2c074f4cb9ad35f1580c4ef7 [sys.catalog]: This master's current role is: LEADER
I20260709 12:09:11.092427 14127 sys_catalog.cc:458] T 00000000000000000000000000000000 P d07070be2c074f4cb9ad35f1580c4ef7 [sys.catalog]: This master's current role is: LEADER
I20260709 12:09:11.094743 14133 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:09:11.100167 14133 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:09:11.105316 12986 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:09:11.111022 14133 catalog_manager.cc:1383] Generated new cluster ID: f38044e247094b60b0015fcbd433a397
I20260709 12:09:11.111377 14133 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:09:11.130280 14133 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:09:11.131681 14133 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:09:11.146751 14133 catalog_manager.cc:6070] T 00000000000000000000000000000000 P d07070be2c074f4cb9ad35f1580c4ef7: Generated new TSK 0
I20260709 12:09:11.147420 14133 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:09:11.172456 12986 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:09:11.178967 14144 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:09:11.179904 14145 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:09:11.181582 14147 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:09:11.182111 12986 server_base.cc:1061] running on GCE node
I20260709 12:09:11.183063 12986 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:09:11.183280 12986 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:09:11.183444 12986 hybrid_clock.cc:648] HybridClock initialized: now 1783598951183426 us; error 0 us; skew 500 ppm
I20260709 12:09:11.184013 12986 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:09:11.186647 12986 webserver.cc:533] Webserver started at http://127.12.174.129:43311/ using document root <none> and password file <none>
I20260709 12:09:11.187171 12986 fs_manager.cc:362] Metadata directory not provided
I20260709 12:09:11.187381 12986 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:09:11.187661 12986 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:09:11.188949 12986 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598886212958-12986-0/minicluster-data/ts-0-root/instance:
uuid: "885067a0d31741bfb5c9935788e315bf"
format_stamp: "Formatted at 2026-07-09 12:09:11 on dist-test-slave-9q7n"
I20260709 12:09:11.193840 12986 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.004s
I20260709 12:09:11.197474 14152 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:11.198338 12986 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.003s
I20260709 12:09:11.198688 12986 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598886212958-12986-0/minicluster-data/ts-0-root
uuid: "885067a0d31741bfb5c9935788e315bf"
format_stamp: "Formatted at 2026-07-09 12:09:11 on dist-test-slave-9q7n"
I20260709 12:09:11.198962 12986 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598886212958-12986-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598886212958-12986-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598886212958-12986-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:09:11.228744 12986 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:09:11.230183 12986 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:09:11.231760 12986 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:09:11.234272 12986 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:09:11.234468 12986 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:11.234731 12986 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:09:11.234901 12986 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:11.281486 12986 rpc_server.cc:307] RPC server started. Bound to: 127.12.174.129:37187
I20260709 12:09:11.281589 14214 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.174.129:37187 every 8 connection(s)
I20260709 12:09:11.286695 12986 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:09:11.294668 14219 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:09:11.297148 14220 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:09:11.299692 12986 server_base.cc:1061] running on GCE node
W20260709 12:09:11.300288 14222 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:09:11.301662 12986 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:09:11.301944 12986 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:09:11.302114 12986 hybrid_clock.cc:648] HybridClock initialized: now 1783598951302096 us; error 0 us; skew 500 ppm
I20260709 12:09:11.302668 12986 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:09:11.304927 14215 heartbeater.cc:344] Connected to a master server at 127.12.174.190:39655
I20260709 12:09:11.305294 14215 heartbeater.cc:461] Registering TS with master...
I20260709 12:09:11.305850 12986 webserver.cc:533] Webserver started at http://127.12.174.130:45707/ using document root <none> and password file <none>
I20260709 12:09:11.306380 12986 fs_manager.cc:362] Metadata directory not provided
I20260709 12:09:11.306357 14215 heartbeater.cc:507] Master 127.12.174.190:39655 requested a full tablet report, sending...
I20260709 12:09:11.306721 12986 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:09:11.307036 12986 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:09:11.308532 12986 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598886212958-12986-0/minicluster-data/ts-1-root/instance:
uuid: "17aab1bbf5014936aa18cc21818b26ec"
format_stamp: "Formatted at 2026-07-09 12:09:11 on dist-test-slave-9q7n"
I20260709 12:09:11.309110 14088 ts_manager.cc:194] Registered new tserver with Master: 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187)
I20260709 12:09:11.311268 14088 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60410
I20260709 12:09:11.313838 12986 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.002s	sys 0.005s
I20260709 12:09:11.317978 14227 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:11.318799 12986 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.004s
I20260709 12:09:11.319092 12986 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598886212958-12986-0/minicluster-data/ts-1-root
uuid: "17aab1bbf5014936aa18cc21818b26ec"
format_stamp: "Formatted at 2026-07-09 12:09:11 on dist-test-slave-9q7n"
I20260709 12:09:11.319375 12986 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598886212958-12986-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598886212958-12986-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598886212958-12986-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:09:11.333108 12986 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:09:11.334544 12986 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:09:11.336090 12986 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:09:11.338591 12986 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:09:11.338796 12986 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:11.339046 12986 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:09:11.339207 12986 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:11.384742 12986 rpc_server.cc:307] RPC server started. Bound to: 127.12.174.130:36673
I20260709 12:09:11.384871 14289 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.174.130:36673 every 8 connection(s)
I20260709 12:09:11.389904 12986 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:09:11.398090 14293 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:09:11.400695 14294 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:09:11.402282 14296 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:09:11.403353 12986 server_base.cc:1061] running on GCE node
I20260709 12:09:11.404330 14290 heartbeater.cc:344] Connected to a master server at 127.12.174.190:39655
I20260709 12:09:11.404425 12986 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:09:11.404692 12986 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:09:11.404754 14290 heartbeater.cc:461] Registering TS with master...
I20260709 12:09:11.404878 12986 hybrid_clock.cc:648] HybridClock initialized: now 1783598951404859 us; error 0 us; skew 500 ppm
I20260709 12:09:11.405519 12986 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:09:11.405620 14290 heartbeater.cc:507] Master 127.12.174.190:39655 requested a full tablet report, sending...
I20260709 12:09:11.408129 14088 ts_manager.cc:194] Registered new tserver with Master: 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:11.408347 12986 webserver.cc:533] Webserver started at http://127.12.174.131:40481/ using document root <none> and password file <none>
I20260709 12:09:11.408931 12986 fs_manager.cc:362] Metadata directory not provided
I20260709 12:09:11.409117 12986 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:09:11.409386 12986 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:09:11.409883 14088 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60420
I20260709 12:09:11.410653 12986 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598886212958-12986-0/minicluster-data/ts-2-root/instance:
uuid: "65c9c1653b3346b39a0e118540e6080c"
format_stamp: "Formatted at 2026-07-09 12:09:11 on dist-test-slave-9q7n"
I20260709 12:09:11.415447 12986 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.004s
I20260709 12:09:11.419159 14301 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:11.420045 12986 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.002s
I20260709 12:09:11.420362 12986 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598886212958-12986-0/minicluster-data/ts-2-root
uuid: "65c9c1653b3346b39a0e118540e6080c"
format_stamp: "Formatted at 2026-07-09 12:09:11 on dist-test-slave-9q7n"
I20260709 12:09:11.420719 12986 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598886212958-12986-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598886212958-12986-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598886212958-12986-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:09:11.435297 12986 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:09:11.436666 12986 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:09:11.438365 12986 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:09:11.440797 12986 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:09:11.441016 12986 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:11.441284 12986 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:09:11.441438 12986 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:11.484656 12986 rpc_server.cc:307] RPC server started. Bound to: 127.12.174.131:45957
I20260709 12:09:11.484778 14363 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.174.131:45957 every 8 connection(s)
I20260709 12:09:11.499269 14364 heartbeater.cc:344] Connected to a master server at 127.12.174.190:39655
I20260709 12:09:11.499663 14364 heartbeater.cc:461] Registering TS with master...
I20260709 12:09:11.500487 14364 heartbeater.cc:507] Master 127.12.174.190:39655 requested a full tablet report, sending...
I20260709 12:09:11.502576 14088 ts_manager.cc:194] Registered new tserver with Master: 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:11.503083 12986 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015159105s
I20260709 12:09:11.504057 14088 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60436
I20260709 12:09:11.530915 14088 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60444:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:09:11.537914 14088 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:09:11.743408 14329 tablet_service.cc:1511] Processing CreateTablet for tablet cd9d6c9c152f47769123b7748d8c8262 (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:09:11.745055 14329 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd9d6c9c152f47769123b7748d8c8262. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:11.748319 14328 tablet_service.cc:1511] Processing CreateTablet for tablet 89bb37b32a7f408b9730abb56b9cfa05 (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:09:11.751024 14327 tablet_service.cc:1511] Processing CreateTablet for tablet ff1f0497acbe4a31944b5bac60c5482c (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:09:11.752893 14326 tablet_service.cc:1511] Processing CreateTablet for tablet 5879727b381a48b18b1949c96428b5d0 (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:09:11.753712 14325 tablet_service.cc:1511] Processing CreateTablet for tablet 7879f4a298eb4e69ac692911bd5ac5f8 (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:09:11.755101 14328 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89bb37b32a7f408b9730abb56b9cfa05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:11.756847 14253 tablet_service.cc:1511] Processing CreateTablet for tablet ff1f0497acbe4a31944b5bac60c5482c (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:09:11.757644 14255 tablet_service.cc:1511] Processing CreateTablet for tablet cd9d6c9c152f47769123b7748d8c8262 (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:09:11.758342 14253 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff1f0497acbe4a31944b5bac60c5482c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:11.759052 14255 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd9d6c9c152f47769123b7748d8c8262. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:11.761608 14324 tablet_service.cc:1511] Processing CreateTablet for tablet e9b3f8ef40054811944ba9bd9ed74eb3 (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:09:11.761835 14254 tablet_service.cc:1511] Processing CreateTablet for tablet 89bb37b32a7f408b9730abb56b9cfa05 (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:09:11.763231 14254 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89bb37b32a7f408b9730abb56b9cfa05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:11.758175 14325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7879f4a298eb4e69ac692911bd5ac5f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:11.767001 14252 tablet_service.cc:1511] Processing CreateTablet for tablet 5879727b381a48b18b1949c96428b5d0 (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:09:11.767432 14323 tablet_service.cc:1511] Processing CreateTablet for tablet 53f6ce2ae2d8465cb314a84096322886 (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:09:11.768502 14252 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5879727b381a48b18b1949c96428b5d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:11.768915 14323 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53f6ce2ae2d8465cb314a84096322886. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:11.770156 14327 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff1f0497acbe4a31944b5bac60c5482c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:11.770525 14251 tablet_service.cc:1511] Processing CreateTablet for tablet 7879f4a298eb4e69ac692911bd5ac5f8 (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:09:11.771072 14322 tablet_service.cc:1511] Processing CreateTablet for tablet ba1914a8ae9f4959971f147e578773fc (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:09:11.771943 14251 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7879f4a298eb4e69ac692911bd5ac5f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:11.772505 14322 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba1914a8ae9f4959971f147e578773fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:11.774909 14250 tablet_service.cc:1511] Processing CreateTablet for tablet e9b3f8ef40054811944ba9bd9ed74eb3 (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:09:11.775043 14321 tablet_service.cc:1511] Processing CreateTablet for tablet 0041f9f2b90844269c31eba4aeeab0a7 (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:09:11.776497 14321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0041f9f2b90844269c31eba4aeeab0a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:11.777868 14249 tablet_service.cc:1511] Processing CreateTablet for tablet 53f6ce2ae2d8465cb314a84096322886 (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:09:11.781323 14248 tablet_service.cc:1511] Processing CreateTablet for tablet ba1914a8ae9f4959971f147e578773fc (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:09:11.783821 14247 tablet_service.cc:1511] Processing CreateTablet for tablet 0041f9f2b90844269c31eba4aeeab0a7 (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:09:11.784549 14320 tablet_service.cc:1511] Processing CreateTablet for tablet 6de6b0d9885648e6b2f6822eb9f85021 (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:09:11.786547 14246 tablet_service.cc:1511] Processing CreateTablet for tablet 6de6b0d9885648e6b2f6822eb9f85021 (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:09:11.778339 14326 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5879727b381a48b18b1949c96428b5d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:11.788895 14324 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9b3f8ef40054811944ba9bd9ed74eb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:11.776420 14250 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9b3f8ef40054811944ba9bd9ed74eb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:11.790601 14249 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53f6ce2ae2d8465cb314a84096322886. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:11.791955 14248 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba1914a8ae9f4959971f147e578773fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:11.793318 14247 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0041f9f2b90844269c31eba4aeeab0a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:11.794727 14246 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6de6b0d9885648e6b2f6822eb9f85021. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:11.796048 14320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6de6b0d9885648e6b2f6822eb9f85021. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:11.863729 14180 tablet_service.cc:1511] Processing CreateTablet for tablet cd9d6c9c152f47769123b7748d8c8262 (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:09:11.865267 14180 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd9d6c9c152f47769123b7748d8c8262. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:11.879714 14179 tablet_service.cc:1511] Processing CreateTablet for tablet 89bb37b32a7f408b9730abb56b9cfa05 (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:09:11.881345 14179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89bb37b32a7f408b9730abb56b9cfa05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:11.891791 14178 tablet_service.cc:1511] Processing CreateTablet for tablet ff1f0497acbe4a31944b5bac60c5482c (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:09:11.893496 14178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff1f0497acbe4a31944b5bac60c5482c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:11.906903 14175 tablet_service.cc:1511] Processing CreateTablet for tablet e9b3f8ef40054811944ba9bd9ed74eb3 (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:09:11.908617 14177 tablet_service.cc:1511] Processing CreateTablet for tablet 5879727b381a48b18b1949c96428b5d0 (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:09:11.911113 14174 tablet_service.cc:1511] Processing CreateTablet for tablet 53f6ce2ae2d8465cb314a84096322886 (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:09:11.911465 14176 tablet_service.cc:1511] Processing CreateTablet for tablet 7879f4a298eb4e69ac692911bd5ac5f8 (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:09:11.913319 14171 tablet_service.cc:1511] Processing CreateTablet for tablet 6de6b0d9885648e6b2f6822eb9f85021 (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:09:11.915525 14172 tablet_service.cc:1511] Processing CreateTablet for tablet 0041f9f2b90844269c31eba4aeeab0a7 (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:09:11.908514 14175 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9b3f8ef40054811944ba9bd9ed74eb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:11.922963 14322 tablet_service.cc:1511] Processing CreateTablet for tablet afce5304599246a580d798fc0c843964 (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:09:11.925179 14322 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afce5304599246a580d798fc0c843964. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:11.925619 14173 tablet_service.cc:1511] Processing CreateTablet for tablet ba1914a8ae9f4959971f147e578773fc (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:09:11.918100 14177 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5879727b381a48b18b1949c96428b5d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:11.922976 14327 tablet_service.cc:1511] Processing CreateTablet for tablet bf9bea0d16e44efabb5cdd53e3828438 (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:09:11.929211 14327 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf9bea0d16e44efabb5cdd53e3828438. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:11.932513 14253 tablet_service.cc:1511] Processing CreateTablet for tablet bf9bea0d16e44efabb5cdd53e3828438 (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:09:11.933838 14329 tablet_service.cc:1511] Processing CreateTablet for tablet b4a0f56d071c4634842ea1584dfe40e6 (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:09:11.934948 14174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53f6ce2ae2d8465cb314a84096322886. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:11.935035 14321 tablet_service.cc:1511] Processing CreateTablet for tablet 60aca7b73a544dfc9a4bd6918b27d132 (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:09:11.935612 14323 tablet_service.cc:1511] Processing CreateTablet for tablet ec0fc0e91c904a0daeb3e29ee24a492d (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:09:11.937340 14173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba1914a8ae9f4959971f147e578773fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:11.938649 14324 tablet_service.cc:1511] Processing CreateTablet for tablet f548bfe8d3c540e487760b5966d0e7f8 (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:09:11.941033 14325 tablet_service.cc:1511] Processing CreateTablet for tablet 1eb6edfa93424aa68a4239fd27a62064 (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:09:11.944288 14176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7879f4a298eb4e69ac692911bd5ac5f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:11.945369 14172 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0041f9f2b90844269c31eba4aeeab0a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:11.946686 14171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6de6b0d9885648e6b2f6822eb9f85021. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:11.957711 14379 tablet_bootstrap.cc:492] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c: Bootstrap starting.
I20260709 12:09:11.957976 14253 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf9bea0d16e44efabb5cdd53e3828438. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:11.967381 14380 tablet_bootstrap.cc:492] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec: Bootstrap starting.
I20260709 12:09:11.967921 14321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60aca7b73a544dfc9a4bd6918b27d132. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:11.940613 14328 tablet_service.cc:1511] Processing CreateTablet for tablet ae82f0f3bcac4608987cd7c935c9799b (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:09:11.978796 14323 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec0fc0e91c904a0daeb3e29ee24a492d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:11.984911 14249 tablet_service.cc:1511] Processing CreateTablet for tablet afce5304599246a580d798fc0c843964 (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:09:11.986143 14325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1eb6edfa93424aa68a4239fd27a62064. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:11.989084 14324 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f548bfe8d3c540e487760b5966d0e7f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:11.986991 14255 tablet_service.cc:1511] Processing CreateTablet for tablet ae82f0f3bcac4608987cd7c935c9799b (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:09:11.997254 14251 tablet_service.cc:1511] Processing CreateTablet for tablet b4a0f56d071c4634842ea1584dfe40e6 (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:09:11.994114 14329 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4a0f56d071c4634842ea1584dfe40e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:12.015502 14328 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae82f0f3bcac4608987cd7c935c9799b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:12.016824 14247 tablet_service.cc:1511] Processing CreateTablet for tablet 60aca7b73a544dfc9a4bd6918b27d132 (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:09:12.018657 14248 tablet_service.cc:1511] Processing CreateTablet for tablet ec0fc0e91c904a0daeb3e29ee24a492d (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:09:12.020690 14255 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae82f0f3bcac4608987cd7c935c9799b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:12.025360 14249 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afce5304599246a580d798fc0c843964. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:12.026661 14175 tablet_service.cc:1511] Processing CreateTablet for tablet bf9bea0d16e44efabb5cdd53e3828438 (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:09:12.028230 14175 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf9bea0d16e44efabb5cdd53e3828438. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:11.993693 14320 tablet_service.cc:1511] Processing CreateTablet for tablet f52421be255e4fab824173d17981b5bb (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:09:12.031289 14320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f52421be255e4fab824173d17981b5bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:12.031090 14252 tablet_service.cc:1511] Processing CreateTablet for tablet f548bfe8d3c540e487760b5966d0e7f8 (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:09:12.032653 14252 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f548bfe8d3c540e487760b5966d0e7f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:12.034395 14248 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec0fc0e91c904a0daeb3e29ee24a492d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:12.036685 14247 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60aca7b73a544dfc9a4bd6918b27d132. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:12.044324 14178 tablet_service.cc:1511] Processing CreateTablet for tablet afce5304599246a580d798fc0c843964 (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:09:12.045966 14178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afce5304599246a580d798fc0c843964. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:12.046573 14326 tablet_service.cc:1511] Processing CreateTablet for tablet 53a4b57f88ee477d8c90d6b0f0cf2e57 (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:09:12.048000 14326 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53a4b57f88ee477d8c90d6b0f0cf2e57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:12.054558 14250 tablet_service.cc:1511] Processing CreateTablet for tablet f52421be255e4fab824173d17981b5bb (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:09:12.056001 14250 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f52421be255e4fab824173d17981b5bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:12.070459 14246 tablet_service.cc:1511] Processing CreateTablet for tablet 1eb6edfa93424aa68a4239fd27a62064 (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:09:12.071975 14246 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1eb6edfa93424aa68a4239fd27a62064. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:12.078779 14175 tablet_service.cc:1511] Processing CreateTablet for tablet ae82f0f3bcac4608987cd7c935c9799b (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:09:12.080314 14175 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae82f0f3bcac4608987cd7c935c9799b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:12.088218 14325 tablet_service.cc:1511] Processing CreateTablet for tablet 0d203245740a4821b7ebcc7669c8b2af (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:09:12.099951 14325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d203245740a4821b7ebcc7669c8b2af. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:09:12.100481 14136 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:09:12.102110 14321 tablet_service.cc:1511] Processing CreateTablet for tablet 8d9964631a6940e4b111e1b1dabb0aae (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:09:12.107093 14327 tablet_service.cc:1511] Processing CreateTablet for tablet fd6a20fc287b48fbb5cbf25078173b21 (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:09:12.107388 14177 tablet_service.cc:1511] Processing CreateTablet for tablet ec0fc0e91c904a0daeb3e29ee24a492d (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:09:12.108178 14174 tablet_service.cc:1511] Processing CreateTablet for tablet b4a0f56d071c4634842ea1584dfe40e6 (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:09:12.125164 14175 tablet_service.cc:1511] Processing CreateTablet for tablet f548bfe8d3c540e487760b5966d0e7f8 (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:09:12.126142 14327 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd6a20fc287b48fbb5cbf25078173b21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:12.126677 14174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4a0f56d071c4634842ea1584dfe40e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:12.128880 14175 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f548bfe8d3c540e487760b5966d0e7f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:12.129216 14254 tablet_service.cc:1511] Processing CreateTablet for tablet 0d203245740a4821b7ebcc7669c8b2af (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:09:12.130750 14254 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d203245740a4821b7ebcc7669c8b2af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:12.134405 14321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d9964631a6940e4b111e1b1dabb0aae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:12.135013 14247 tablet_service.cc:1511] Processing CreateTablet for tablet 8d9964631a6940e4b111e1b1dabb0aae (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:09:12.136452 14247 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d9964631a6940e4b111e1b1dabb0aae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:12.138895 14177 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec0fc0e91c904a0daeb3e29ee24a492d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:12.112234 14253 tablet_service.cc:1511] Processing CreateTablet for tablet 53a4b57f88ee477d8c90d6b0f0cf2e57 (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:09:12.151595 14253 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53a4b57f88ee477d8c90d6b0f0cf2e57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:12.154945 14251 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4a0f56d071c4634842ea1584dfe40e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:12.141933 14323 tablet_service.cc:1511] Processing CreateTablet for tablet f9f69e925a8f4da7ba2b318edae7b194 (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:09:12.156288 14323 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9f69e925a8f4da7ba2b318edae7b194. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:12.129805 14328 tablet_service.cc:1511] Processing CreateTablet for tablet b317dbf6b7fd4860be0fa436e8b54807 (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:09:12.154471 14171 tablet_service.cc:1511] Processing CreateTablet for tablet f52421be255e4fab824173d17981b5bb (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:09:12.141373 14252 tablet_service.cc:1511] Processing CreateTablet for tablet fd6a20fc287b48fbb5cbf25078173b21 (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:09:12.160688 14171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f52421be255e4fab824173d17981b5bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:12.161652 14379 tablet_bootstrap.cc:654] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:12.161435 14381 tablet_bootstrap.cc:492] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf: Bootstrap starting.
I20260709 12:09:12.166023 14180 tablet_service.cc:1511] Processing CreateTablet for tablet 53a4b57f88ee477d8c90d6b0f0cf2e57 (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:09:12.167543 14180 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53a4b57f88ee477d8c90d6b0f0cf2e57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:12.166052 14173 tablet_service.cc:1511] Processing CreateTablet for tablet 60aca7b73a544dfc9a4bd6918b27d132 (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:09:12.171411 14173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60aca7b73a544dfc9a4bd6918b27d132. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:12.173791 14380 tablet_bootstrap.cc:654] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:12.174906 14328 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b317dbf6b7fd4860be0fa436e8b54807. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:12.137535 14179 tablet_service.cc:1511] Processing CreateTablet for tablet 1eb6edfa93424aa68a4239fd27a62064 (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:09:12.178354 14179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1eb6edfa93424aa68a4239fd27a62064. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:12.182335 14176 tablet_service.cc:1511] Processing CreateTablet for tablet 0d203245740a4821b7ebcc7669c8b2af (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:09:12.184028 14176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d203245740a4821b7ebcc7669c8b2af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:12.188426 14178 tablet_service.cc:1511] Processing CreateTablet for tablet 8d9964631a6940e4b111e1b1dabb0aae (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:09:12.219120 14178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d9964631a6940e4b111e1b1dabb0aae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:12.178385 14252 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd6a20fc287b48fbb5cbf25078173b21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:12.237429 14248 tablet_service.cc:1511] Processing CreateTablet for tablet b317dbf6b7fd4860be0fa436e8b54807 (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:09:12.239223 14248 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b317dbf6b7fd4860be0fa436e8b54807. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:12.240559 14381 tablet_bootstrap.cc:654] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:12.263425 14324 tablet_service.cc:1511] Processing CreateTablet for tablet 57e5f03a80374104a130f5b0e70a0280 (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:09:12.264412 14325 tablet_service.cc:1511] Processing CreateTablet for tablet 88b5f4f19c2a4585b93b312cc1f3d17f (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:09:12.265142 14249 tablet_service.cc:1511] Processing CreateTablet for tablet f9f69e925a8f4da7ba2b318edae7b194 (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:09:12.286397 14249 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9f69e925a8f4da7ba2b318edae7b194. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:12.289286 14324 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57e5f03a80374104a130f5b0e70a0280. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:12.302254 14322 tablet_service.cc:1511] Processing CreateTablet for tablet 8efcd0417f0c412280654006e6389763 (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:09:12.308270 14175 tablet_service.cc:1511] Processing CreateTablet for tablet b317dbf6b7fd4860be0fa436e8b54807 (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:09:12.366473 14175 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b317dbf6b7fd4860be0fa436e8b54807. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:12.367393 14323 tablet_service.cc:1511] Processing CreateTablet for tablet 1dfd3f2bd71343f789aa5733a23d4b8d (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:09:12.310871 14325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88b5f4f19c2a4585b93b312cc1f3d17f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:12.314815 14215 heartbeater.cc:499] Master 127.12.174.190:39655 was elected leader, sending a full tablet report...
I20260709 12:09:12.319090 14328 tablet_service.cc:1511] Processing CreateTablet for tablet 90097151efa7426faeaea3ff87a7ea78 (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:09:12.323494 14379 tablet_bootstrap.cc:492] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c: No bootstrap required, opened a new log
I20260709 12:09:12.373294 14379 ts_tablet_manager.cc:1403] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c: Time spent bootstrapping tablet: real 0.416s	user 0.011s	sys 0.014s
I20260709 12:09:12.340844 14246 tablet_service.cc:1511] Processing CreateTablet for tablet 88b5f4f19c2a4585b93b312cc1f3d17f (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:09:12.374397 14246 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88b5f4f19c2a4585b93b312cc1f3d17f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:12.322218 14172 tablet_service.cc:1511] Processing CreateTablet for tablet fd6a20fc287b48fbb5cbf25078173b21 (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:09:12.342087 14321 tablet_service.cc:1511] Processing CreateTablet for tablet 55a08950f57748dea047f3190b2c0e95 (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:09:12.321398 14329 tablet_service.cc:1511] Processing CreateTablet for tablet f57e398f580944f0866ea5fab71be87f (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:09:12.333868 14380 tablet_bootstrap.cc:492] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec: No bootstrap required, opened a new log
I20260709 12:09:12.387735 14380 ts_tablet_manager.cc:1403] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec: Time spent bootstrapping tablet: real 0.421s	user 0.023s	sys 0.022s
I20260709 12:09:12.337571 14381 tablet_bootstrap.cc:492] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf: No bootstrap required, opened a new log
I20260709 12:09:12.344319 14247 tablet_service.cc:1511] Processing CreateTablet for tablet 8efcd0417f0c412280654006e6389763 (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:09:12.390228 14381 ts_tablet_manager.cc:1403] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf: Time spent bootstrapping tablet: real 0.230s	user 0.007s	sys 0.008s
I20260709 12:09:12.390770 14247 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8efcd0417f0c412280654006e6389763. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:12.347983 14180 tablet_service.cc:1511] Processing CreateTablet for tablet f9f69e925a8f4da7ba2b318edae7b194 (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:09:12.372828 14177 tablet_service.cc:1511] Processing CreateTablet for tablet 57e5f03a80374104a130f5b0e70a0280 (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:09:12.329638 14254 tablet_service.cc:1511] Processing CreateTablet for tablet 57e5f03a80374104a130f5b0e70a0280 (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:09:12.402751 14254 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57e5f03a80374104a130f5b0e70a0280. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:12.386268 14172 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd6a20fc287b48fbb5cbf25078173b21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:12.387082 14323 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1dfd3f2bd71343f789aa5733a23d4b8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:12.386698 14179 tablet_service.cc:1511] Processing CreateTablet for tablet 88b5f4f19c2a4585b93b312cc1f3d17f (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:09:12.405829 14179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88b5f4f19c2a4585b93b312cc1f3d17f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:12.405967 14329 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f57e398f580944f0866ea5fab71be87f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:12.407790 14322 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8efcd0417f0c412280654006e6389763. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:12.408026 14177 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57e5f03a80374104a130f5b0e70a0280. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:12.409945 14328 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90097151efa7426faeaea3ff87a7ea78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:12.412509 14290 heartbeater.cc:499] Master 127.12.174.190:39655 was elected leader, sending a full tablet report...
I20260709 12:09:12.412509 14321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55a08950f57748dea047f3190b2c0e95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:12.418503 14180 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9f69e925a8f4da7ba2b318edae7b194. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:12.428256 14174 tablet_service.cc:1511] Processing CreateTablet for tablet 8efcd0417f0c412280654006e6389763 (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:09:12.432392 14174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8efcd0417f0c412280654006e6389763. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:12.444000 14379 raft_consensus.cc:359] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:12.504668 14379 raft_consensus.cc:385] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:12.505023 14379 raft_consensus.cc:740] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Initialized, Role: FOLLOWER
I20260709 12:09:12.505847 14379 consensus_queue.cc:260] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:12.506744 14364 heartbeater.cc:499] Master 127.12.174.190:39655 was elected leader, sending a full tablet report...
I20260709 12:09:12.445259 14380 raft_consensus.cc:359] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:12.507295 14380 raft_consensus.cc:385] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:12.507622 14380 raft_consensus.cc:740] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Initialized, Role: FOLLOWER
I20260709 12:09:12.508395 14380 consensus_queue.cc:260] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:12.444077 14381 raft_consensus.cc:359] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } }
I20260709 12:09:12.509974 14381 raft_consensus.cc:385] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:12.510313 14381 raft_consensus.cc:740] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Initialized, Role: FOLLOWER
I20260709 12:09:12.511080 14381 consensus_queue.cc:260] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } }
W20260709 12:09:12.453956 14073 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 84896.9us
I20260709 12:09:12.461057 14250 tablet_service.cc:1511] Processing CreateTablet for tablet 90097151efa7426faeaea3ff87a7ea78 (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:09:12.514601 14250 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90097151efa7426faeaea3ff87a7ea78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:12.515810 14326 tablet_service.cc:1511] Processing CreateTablet for tablet 3832505489c04d04a69e256187061921 (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:09:12.471189 14249 tablet_service.cc:1511] Processing CreateTablet for tablet f57e398f580944f0866ea5fab71be87f (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:09:12.472213 14173 tablet_service.cc:1511] Processing CreateTablet for tablet f57e398f580944f0866ea5fab71be87f (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:09:12.473977 14255 tablet_service.cc:1511] Processing CreateTablet for tablet 55a08950f57748dea047f3190b2c0e95 (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:09:12.476332 14176 tablet_service.cc:1511] Processing CreateTablet for tablet 55a08950f57748dea047f3190b2c0e95 (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:09:12.480803 14178 tablet_service.cc:1511] Processing CreateTablet for tablet 1dfd3f2bd71343f789aa5733a23d4b8d (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:09:12.495043 14248 tablet_service.cc:1511] Processing CreateTablet for tablet 1dfd3f2bd71343f789aa5733a23d4b8d (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:09:12.497663 14179 tablet_service.cc:1511] Processing CreateTablet for tablet 5485933837894417a3f0f89d55af1296 (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:09:12.530642 14176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55a08950f57748dea047f3190b2c0e95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:12.531477 14178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1dfd3f2bd71343f789aa5733a23d4b8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:12.503543 14320 tablet_service.cc:1511] Processing CreateTablet for tablet 5485933837894417a3f0f89d55af1296 (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:09:12.462988 14171 tablet_service.cc:1511] Processing CreateTablet for tablet 90097151efa7426faeaea3ff87a7ea78 (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:09:12.534121 14171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90097151efa7426faeaea3ff87a7ea78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:12.534966 14173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f57e398f580944f0866ea5fab71be87f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:12.538240 14179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5485933837894417a3f0f89d55af1296. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:12.544436 14326 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3832505489c04d04a69e256187061921. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:12.545189 14320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5485933837894417a3f0f89d55af1296. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:12.520992 14177 tablet_service.cc:1511] Processing CreateTablet for tablet e9b8048bcdf74441aac2cd21ac7af4da (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:09:12.547379 14177 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9b8048bcdf74441aac2cd21ac7af4da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:12.512380 14254 tablet_service.cc:1511] Processing CreateTablet for tablet 3832505489c04d04a69e256187061921 (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:09:12.550410 14249 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f57e398f580944f0866ea5fab71be87f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:12.553791 14328 tablet_service.cc:1511] Processing CreateTablet for tablet 36091607df2f46059df62d677842a031 (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:09:12.555320 14328 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36091607df2f46059df62d677842a031. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:12.527205 14381 ts_tablet_manager.cc:1434] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf: Time spent starting tablet: real 0.137s	user 0.004s	sys 0.004s
I20260709 12:09:12.562247 14324 tablet_service.cc:1511] Processing CreateTablet for tablet afdbef67ffe54739bdccc3b631f66c89 (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:09:12.562842 14381 tablet_bootstrap.cc:492] T e9b3f8ef40054811944ba9bd9ed74eb3 P 885067a0d31741bfb5c9935788e315bf: Bootstrap starting.
I20260709 12:09:12.563686 14324 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afdbef67ffe54739bdccc3b631f66c89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:12.541455 14327 tablet_service.cc:1511] Processing CreateTablet for tablet e9b8048bcdf74441aac2cd21ac7af4da (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:09:12.567011 14327 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9b8048bcdf74441aac2cd21ac7af4da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:12.566936 14174 tablet_service.cc:1511] Processing CreateTablet for tablet 3832505489c04d04a69e256187061921 (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:09:12.568862 14174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3832505489c04d04a69e256187061921. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:12.574496 14248 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1dfd3f2bd71343f789aa5733a23d4b8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:12.579748 14255 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55a08950f57748dea047f3190b2c0e95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:12.582981 14379 ts_tablet_manager.cc:1434] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c: Time spent starting tablet: real 0.209s	user 0.014s	sys 0.005s
I20260709 12:09:12.583418 14247 tablet_service.cc:1511] Processing CreateTablet for tablet e9b8048bcdf74441aac2cd21ac7af4da (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:09:12.585209 14247 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9b8048bcdf74441aac2cd21ac7af4da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:12.586925 14321 tablet_service.cc:1511] Processing CreateTablet for tablet e85036847fc14bab8d6b10e9cbee3aca (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:09:12.588430 14321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e85036847fc14bab8d6b10e9cbee3aca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:12.589979 14381 tablet_bootstrap.cc:654] T e9b3f8ef40054811944ba9bd9ed74eb3 P 885067a0d31741bfb5c9935788e315bf: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:12.585117 14379 tablet_bootstrap.cc:492] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c: Bootstrap starting.
I20260709 12:09:12.604864 14253 tablet_service.cc:1511] Processing CreateTablet for tablet afdbef67ffe54739bdccc3b631f66c89 (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:09:12.610325 14254 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3832505489c04d04a69e256187061921. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:12.616469 14180 tablet_service.cc:1511] Processing CreateTablet for tablet afdbef67ffe54739bdccc3b631f66c89 (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:09:12.617976 14180 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afdbef67ffe54739bdccc3b631f66c89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:12.497460 14251 tablet_service.cc:1511] Processing CreateTablet for tablet 5485933837894417a3f0f89d55af1296 (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:09:12.631078 14380 ts_tablet_manager.cc:1434] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec: Time spent starting tablet: real 0.243s	user 0.012s	sys 0.005s
I20260709 12:09:12.639493 14248 tablet_service.cc:1511] Processing CreateTablet for tablet 36091607df2f46059df62d677842a031 (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:09:12.641006 14248 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36091607df2f46059df62d677842a031. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:12.642292 14253 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afdbef67ffe54739bdccc3b631f66c89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:12.653810 14251 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5485933837894417a3f0f89d55af1296. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:12.662108 14385 raft_consensus.cc:493] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:12.662675 14385 raft_consensus.cc:515] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:12.665406 14385 leader_election.cc:290] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:12.671298 14379 tablet_bootstrap.cc:654] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:12.695369 14252 tablet_service.cc:1511] Processing CreateTablet for tablet e85036847fc14bab8d6b10e9cbee3aca (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:09:12.696954 14252 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e85036847fc14bab8d6b10e9cbee3aca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:12.706554 14322 tablet_service.cc:1511] Processing CreateTablet for tablet e0c03baacf444c019b39ae64998e2686 (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:09:12.707875 14246 tablet_service.cc:1511] Processing CreateTablet for tablet e0c03baacf444c019b39ae64998e2686 (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:09:12.722054 14246 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0c03baacf444c019b39ae64998e2686. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:12.708307 14322 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0c03baacf444c019b39ae64998e2686. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:12.724583 14173 tablet_service.cc:1511] Processing CreateTablet for tablet e85036847fc14bab8d6b10e9cbee3aca (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:09:12.726104 14173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e85036847fc14bab8d6b10e9cbee3aca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:12.730163 14179 tablet_service.cc:1511] Processing CreateTablet for tablet 36091607df2f46059df62d677842a031 (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:09:12.731736 14179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36091607df2f46059df62d677842a031. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:12.732817 14381 tablet_bootstrap.cc:492] T e9b3f8ef40054811944ba9bd9ed74eb3 P 885067a0d31741bfb5c9935788e315bf: No bootstrap required, opened a new log
I20260709 12:09:12.733438 14381 ts_tablet_manager.cc:1403] T e9b3f8ef40054811944ba9bd9ed74eb3 P 885067a0d31741bfb5c9935788e315bf: Time spent bootstrapping tablet: real 0.171s	user 0.022s	sys 0.003s
I20260709 12:09:12.689375 14175 tablet_service.cc:1511] Processing CreateTablet for tablet f1a4a5f0a8324f479c5e1f499164bf42 (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:09:12.734977 14175 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1a4a5f0a8324f479c5e1f499164bf42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:12.709630 14326 tablet_service.cc:1511] Processing CreateTablet for tablet f1a4a5f0a8324f479c5e1f499164bf42 (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:09:12.712443 14380 tablet_bootstrap.cc:492] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec: Bootstrap starting.
I20260709 12:09:12.714517 14250 tablet_service.cc:1511] Processing CreateTablet for tablet f1a4a5f0a8324f479c5e1f499164bf42 (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:09:12.718382 14325 tablet_service.cc:1511] Processing CreateTablet for tablet 3c9d740fa53e42179ad8d244b4c179fd (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:09:12.746470 14326 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1a4a5f0a8324f479c5e1f499164bf42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:12.757063 14171 tablet_service.cc:1511] Processing CreateTablet for tablet 938efad339fd47e1b0b6d37fbc612db2 (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:09:12.763659 14177 tablet_service.cc:1511] Processing CreateTablet for tablet 3c9d740fa53e42179ad8d244b4c179fd (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:09:12.756971 14250 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1a4a5f0a8324f479c5e1f499164bf42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:12.797490 14386 raft_consensus.cc:493] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:12.798228 14386 raft_consensus.cc:515] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:12.797240 14174 tablet_service.cc:1511] Processing CreateTablet for tablet e0c03baacf444c019b39ae64998e2686 (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:09:12.773337 14381 raft_consensus.cc:359] T e9b3f8ef40054811944ba9bd9ed74eb3 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:12.801556 14386 leader_election.cc:290] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:12.804087 14381 raft_consensus.cc:385] T e9b3f8ef40054811944ba9bd9ed74eb3 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:12.814420 14381 raft_consensus.cc:740] T e9b3f8ef40054811944ba9bd9ed74eb3 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Initialized, Role: FOLLOWER
I20260709 12:09:12.805625 14323 tablet_service.cc:1511] Processing CreateTablet for tablet 938efad339fd47e1b0b6d37fbc612db2 (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:09:12.815259 14381 consensus_queue.cc:260] T e9b3f8ef40054811944ba9bd9ed74eb3 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:12.816082 14380 tablet_bootstrap.cc:654] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:12.809226 14379 tablet_bootstrap.cc:492] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c: No bootstrap required, opened a new log
I20260709 12:09:12.818243 14379 ts_tablet_manager.cc:1403] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c: Time spent bootstrapping tablet: real 0.233s	user 0.021s	sys 0.013s
I20260709 12:09:12.817554 14381 ts_tablet_manager.cc:1434] T e9b3f8ef40054811944ba9bd9ed74eb3 P 885067a0d31741bfb5c9935788e315bf: Time spent starting tablet: real 0.075s	user 0.005s	sys 0.002s
I20260709 12:09:12.809458 14320 tablet_service.cc:1511] Processing CreateTablet for tablet c022caf6920747708b0cfc607c962951 (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:09:12.801329 14249 tablet_service.cc:1511] Processing CreateTablet for tablet 938efad339fd47e1b0b6d37fbc612db2 (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:09:12.807916 14176 tablet_service.cc:1511] Processing CreateTablet for tablet c022caf6920747708b0cfc607c962951 (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:09:12.825103 14325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c9d740fa53e42179ad8d244b4c179fd. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:09:12.853909 14074 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 54789.9us
I20260709 12:09:12.855624 14329 tablet_service.cc:1511] Processing CreateTablet for tablet 35b39d0f3270452a8bd4f4b1800a837c (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:09:12.857064 14329 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35b39d0f3270452a8bd4f4b1800a837c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:12.859302 14178 tablet_service.cc:1511] Processing CreateTablet for tablet 2b1a5d42755443119571654ad5c5f2f3 (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:09:12.860500 14323 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 938efad339fd47e1b0b6d37fbc612db2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:12.859408 14180 tablet_service.cc:1511] Processing CreateTablet for tablet 35b39d0f3270452a8bd4f4b1800a837c (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:09:12.868299 14177 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c9d740fa53e42179ad8d244b4c179fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:12.874168 14381 tablet_bootstrap.cc:492] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf: Bootstrap starting.
I20260709 12:09:12.888171 14327 tablet_service.cc:1511] Processing CreateTablet for tablet 981a078d2d9d479abecc8b0b45771080 (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:09:12.880486 14249 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 938efad339fd47e1b0b6d37fbc612db2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:12.832363 14328 tablet_service.cc:1511] Processing CreateTablet for tablet 2b1a5d42755443119571654ad5c5f2f3 (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:09:12.896484 14324 tablet_service.cc:1511] Processing CreateTablet for tablet fb01374e8ef4493d909377b2b9179e39 (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:09:12.903405 14247 tablet_service.cc:1511] Processing CreateTablet for tablet c022caf6920747708b0cfc607c962951 (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:09:12.910353 14248 tablet_service.cc:1511] Processing CreateTablet for tablet 2b1a5d42755443119571654ad5c5f2f3 (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:09:12.911296 14255 tablet_service.cc:1511] Processing CreateTablet for tablet 3c9d740fa53e42179ad8d244b4c179fd (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:09:12.914956 14379 raft_consensus.cc:359] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:12.920145 14172 tablet_service.cc:1511] Processing CreateTablet for tablet 981a078d2d9d479abecc8b0b45771080 (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:09:12.884222 14320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c022caf6920747708b0cfc607c962951. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:12.945695 14253 tablet_service.cc:1511] Processing CreateTablet for tablet 35b39d0f3270452a8bd4f4b1800a837c (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:09:12.938187 14180 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35b39d0f3270452a8bd4f4b1800a837c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:12.955372 14176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c022caf6920747708b0cfc607c962951. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:12.955535 14387 raft_consensus.cc:493] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:12.956079 14387 raft_consensus.cc:515] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } }
I20260709 12:09:12.962345 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:12.962381 14255 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c9d740fa53e42179ad8d244b4c179fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:12.963321 14172 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 981a078d2d9d479abecc8b0b45771080. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:09:12.964365 14303 leader_election.cc:343] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:12.961303 14173 tablet_service.cc:1511] Processing CreateTablet for tablet fb01374e8ef4493d909377b2b9179e39 (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:09:12.925500 14379 raft_consensus.cc:385] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:12.966084 14247 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c022caf6920747708b0cfc607c962951. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:12.965945 14379 raft_consensus.cc:740] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Initialized, Role: FOLLOWER
I20260709 12:09:12.966331 14173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb01374e8ef4493d909377b2b9179e39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:12.968183 14379 consensus_queue.cc:260] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:12.991881 14254 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:51304 (request call id 33) took 1023 ms. Trace:
I20260709 12:09:12.992599 14254 rpcz_store.cc:276] 0709 12:09:11.968765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:12.510088 (+541323us) service_pool.cc:224] Handling call
0709 12:09:12.598926 (+ 88838us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:09:12.609872 (+ 10946us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:09:12.728049 (+118177us) tablet_metadata.cc:665] Metadata flushed
0709 12:09:12.947847 (+219798us) tablet_replica.cc:206] Creating consensus instance
0709 12:09:12.991765 (+ 43918us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:12.994403 14253 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35b39d0f3270452a8bd4f4b1800a837c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:12.995537 14254 tablet_service.cc:1511] Processing CreateTablet for tablet 981a078d2d9d479abecc8b0b45771080 (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:09:12.997325 14254 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 981a078d2d9d479abecc8b0b45771080. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:12.997927 14171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 938efad339fd47e1b0b6d37fbc612db2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:13.001235 14387 leader_election.cc:290] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:13.002882 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:09:13.005074 14304 leader_election.cc:343] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:13.005659 14304 leader_election.cc:304] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:09:13.007274 14389 raft_consensus.cc:2749] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:13.009838 14320 tablet_service.cc:1511] Processing CreateTablet for tablet e5c1eed5e91b4c908f1f9ebf315fbc6f (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:09:13.025664 14174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0c03baacf444c019b39ae64998e2686. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:13.026511 14178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b1a5d42755443119571654ad5c5f2f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:13.027245 14379 ts_tablet_manager.cc:1434] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c: Time spent starting tablet: real 0.206s	user 0.006s	sys 0.001s
I20260709 12:09:13.038864 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:09:13.040843 14229 leader_election.cc:343] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:13.046042 14251 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:51304 (request call id 32) took 1136 ms. Trace:
I20260709 12:09:13.046507 14251 rpcz_store.cc:276] 0709 12:09:11.909163 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:12.496532 (+587369us) service_pool.cc:224] Handling call
0709 12:09:12.642012 (+145480us) spinlock_profiling.cc:243] Waited 14 ms on lock 0x7b5800060c98. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2124016b71 00007f2124016a22 00007f212cf2f8d9 00007f212c089ee0 00007f212c16f831 00007f212c14cac3 00007f212c0fb400 00007f2125580af4 00007f2125580a82 00007f21255809b1
0709 12:09:12.642156 (+   144us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:09:12.642254 (+    98us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:09:12.879009 (+236755us) tablet_metadata.cc:665] Metadata flushed
0709 12:09:12.986961 (+107952us) tablet_replica.cc:206] Creating consensus instance
0709 12:09:13.045959 (+ 58998us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":32141696}
I20260709 12:09:13.049091 14251 tablet_service.cc:1511] Processing CreateTablet for tablet fb01374e8ef4493d909377b2b9179e39 (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:09:13.051928 14246 tablet_service.cc:1511] Processing CreateTablet for tablet e244b5af3ce244339f6fe0bd22a35eba (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:09:13.055085 14380 tablet_bootstrap.cc:492] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec: No bootstrap required, opened a new log
I20260709 12:09:13.062693 14380 ts_tablet_manager.cc:1403] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec: Time spent bootstrapping tablet: real 0.350s	user 0.016s	sys 0.034s
W20260709 12:09:13.064504 14216 tablet.cc:2406] T e9b3f8ef40054811944ba9bd9ed74eb3 P 885067a0d31741bfb5c9935788e315bf: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:09:13.043166 14327 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 981a078d2d9d479abecc8b0b45771080. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:13.066854 14380 raft_consensus.cc:359] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } }
I20260709 12:09:13.069393 14380 raft_consensus.cc:385] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:13.070508 14380 raft_consensus.cc:740] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Initialized, Role: FOLLOWER
I20260709 12:09:13.072418 14175 tablet_service.cc:1511] Processing CreateTablet for tablet e5c1eed5e91b4c908f1f9ebf315fbc6f (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:09:13.005560 14321 tablet_service.cc:1511] Processing CreateTablet for tablet e244b5af3ce244339f6fe0bd22a35eba (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:09:13.072893 14380 consensus_queue.cc:260] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } }
I20260709 12:09:13.057559 14381 tablet_bootstrap.cc:654] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:13.067950 14324 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb01374e8ef4493d909377b2b9179e39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:13.078141 14328 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b1a5d42755443119571654ad5c5f2f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:13.062778 14251 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb01374e8ef4493d909377b2b9179e39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:13.082144 14248 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b1a5d42755443119571654ad5c5f2f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:13.067358 14178 tablet_service.cc:1511] Processing CreateTablet for tablet e244b5af3ce244339f6fe0bd22a35eba (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:09:13.094475 14380 ts_tablet_manager.cc:1434] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec: Time spent starting tablet: real 0.031s	user 0.008s	sys 0.000s
I20260709 12:09:13.097999 14246 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e244b5af3ce244339f6fe0bd22a35eba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:13.099272 14380 tablet_bootstrap.cc:492] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec: Bootstrap starting.
I20260709 12:09:13.124336 14380 tablet_bootstrap.cc:654] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:13.126086 14175 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5c1eed5e91b4c908f1f9ebf315fbc6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:13.130118 14178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e244b5af3ce244339f6fe0bd22a35eba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:13.131508 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:13.133340 14321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e244b5af3ce244339f6fe0bd22a35eba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:13.151614 14320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5c1eed5e91b4c908f1f9ebf315fbc6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:13.151803 14180 tablet_service.cc:1511] Processing CreateTablet for tablet e1947202e59d4516a1b38a1583a3242d (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
W20260709 12:09:13.154109 14230 leader_election.cc:343] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:13.154656 14230 leader_election.cc:304] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:09:13.154847 14179 tablet_service.cc:1511] Processing CreateTablet for tablet f4739bc22bfe44fcba807da02d9351b6 (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:09:13.163089 14379 tablet_bootstrap.cc:492] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c: Bootstrap starting.
I20260709 12:09:13.167783 14323 tablet_service.cc:1511] Processing CreateTablet for tablet e1947202e59d4516a1b38a1583a3242d (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:09:13.169397 14323 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1947202e59d4516a1b38a1583a3242d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:13.169090 14326 tablet_service.cc:1511] Processing CreateTablet for tablet cbe93a4954a24795882e04fa537ddf4d (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:09:13.171159 14386 raft_consensus.cc:2749] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:13.182657 14180 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1947202e59d4516a1b38a1583a3242d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:13.208060 14250 tablet_service.cc:1511] Processing CreateTablet for tablet e1947202e59d4516a1b38a1583a3242d (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:09:13.214534 14179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4739bc22bfe44fcba807da02d9351b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:13.215058 14250 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1947202e59d4516a1b38a1583a3242d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:13.139430 14252 tablet_service.cc:1511] Processing CreateTablet for tablet e5c1eed5e91b4c908f1f9ebf315fbc6f (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:09:13.210772 14326 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbe93a4954a24795882e04fa537ddf4d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:09:13.226739 14136 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:09:13.241873 14252 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5c1eed5e91b4c908f1f9ebf315fbc6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:13.245455 14253 tablet_service.cc:1511] Processing CreateTablet for tablet cbe93a4954a24795882e04fa537ddf4d (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:09:13.246883 14253 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbe93a4954a24795882e04fa537ddf4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:13.251951 14255 tablet_service.cc:1511] Processing CreateTablet for tablet f4739bc22bfe44fcba807da02d9351b6 (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:09:13.253417 14255 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4739bc22bfe44fcba807da02d9351b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:13.254426 14177 tablet_service.cc:1511] Processing CreateTablet for tablet cbe93a4954a24795882e04fa537ddf4d (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:09:13.256108 14177 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbe93a4954a24795882e04fa537ddf4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:13.258239 14325 tablet_service.cc:1511] Processing CreateTablet for tablet 02513fb0dbdd4cbdb019d79f0f448d18 (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:09:13.259935 14325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02513fb0dbdd4cbdb019d79f0f448d18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:13.261106 14381 tablet_bootstrap.cc:492] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf: No bootstrap required, opened a new log
I20260709 12:09:13.267373 14387 raft_consensus.cc:493] T e9b3f8ef40054811944ba9bd9ed74eb3 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:13.268042 14387 raft_consensus.cc:515] T e9b3f8ef40054811944ba9bd9ed74eb3 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:13.285192 14387 leader_election.cc:290] T e9b3f8ef40054811944ba9bd9ed74eb3 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:13.286509 14322 tablet_service.cc:1511] Processing CreateTablet for tablet f4739bc22bfe44fcba807da02d9351b6 (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:09:13.287371 14178 tablet_service.cc:1511] Processing CreateTablet for tablet 02513fb0dbdd4cbdb019d79f0f448d18 (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:09:13.288055 14322 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4739bc22bfe44fcba807da02d9351b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:13.288735 14178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02513fb0dbdd4cbdb019d79f0f448d18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:13.273566 14381 ts_tablet_manager.cc:1403] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf: Time spent bootstrapping tablet: real 0.399s	user 0.014s	sys 0.031s
I20260709 12:09:13.293303 14381 raft_consensus.cc:359] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:13.303855 14386 raft_consensus.cc:493] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:13.304469 14386 raft_consensus.cc:515] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } }
I20260709 12:09:13.306320 14249 tablet_service.cc:1511] Processing CreateTablet for tablet 02513fb0dbdd4cbdb019d79f0f448d18 (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:09:13.306939 14386 leader_election.cc:290] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187)
I20260709 12:09:13.309891 14379 tablet_bootstrap.cc:654] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:13.308600 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:13.313715 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:13.314489 14190 raft_consensus.cc:2468] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 0.
W20260709 12:09:13.317427 14230 leader_election.cc:343] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:13.319821 14229 leader_election.cc:304] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:09:13.321314 14386 raft_consensus.cc:2804] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:13.321749 14386 raft_consensus.cc:493] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:13.322117 14386 raft_consensus.cc:3060] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:13.323122 14249 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02513fb0dbdd4cbdb019d79f0f448d18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:13.343138 14329 tablet_service.cc:1511] Processing CreateTablet for tablet fc8bff37f52742a3a3b8a39c45ade183 (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:09:13.343300 14324 tablet_service.cc:1511] Processing CreateTablet for tablet 15f7cecfe772454980c8ae9d1803fe98 (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:09:13.329346 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:13.330078 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:13.346261 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:13.336462 14174 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:59324 (request call id 38) took 1117 ms. Trace:
I20260709 12:09:13.344188 14389 raft_consensus.cc:493] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:13.347203 14389 raft_consensus.cc:515] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:13.344900 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:09:13.347774 14155 leader_election.cc:343] T e9b3f8ef40054811944ba9bd9ed74eb3 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:13.348480 14173 tablet_service.cc:1511] Processing CreateTablet for tablet 15f7cecfe772454980c8ae9d1803fe98 (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:09:13.349464 14324 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15f7cecfe772454980c8ae9d1803fe98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:13.351096 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:09:13.352022 14155 leader_election.cc:343] T e9b3f8ef40054811944ba9bd9ed74eb3 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:13.352349 14176 tablet_service.cc:1511] Processing CreateTablet for tablet bd5274ac33c2483681726f6b8eccdc6c (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:09:13.352603 14155 leader_election.cc:304] T e9b3f8ef40054811944ba9bd9ed74eb3 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:09:13.353405 14389 leader_election.cc:290] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:13.353583 14387 raft_consensus.cc:2749] T e9b3f8ef40054811944ba9bd9ed74eb3 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:13.299850 14172 tablet_service.cc:1511] Processing CreateTablet for tablet d82ca0c0e51a4e148b8d3e226ff7cebb (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:09:13.354305 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:13.355520 14247 tablet_service.cc:1511] Processing CreateTablet for tablet d82ca0c0e51a4e148b8d3e226ff7cebb (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
W20260709 12:09:13.355954 14304 leader_election.cc:343] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:13.356796 14303 leader_election.cc:343] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:13.357203 14155 leader_election.cc:343] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:13.357271 14303 leader_election.cc:304] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:09:13.358650 14389 raft_consensus.cc:2749] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:13.355935 14328 tablet_service.cc:1511] Processing CreateTablet for tablet d82ca0c0e51a4e148b8d3e226ff7cebb (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:09:13.327085 14251 tablet_service.cc:1511] Processing CreateTablet for tablet fc8bff37f52742a3a3b8a39c45ade183 (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:09:13.300606 14381 raft_consensus.cc:385] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:13.360790 14381 raft_consensus.cc:740] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Initialized, Role: FOLLOWER
I20260709 12:09:13.364437 14381 consensus_queue.cc:260] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:13.367332 14381 ts_tablet_manager.cc:1434] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf: Time spent starting tablet: real 0.077s	user 0.007s	sys 0.000s
I20260709 12:09:13.368765 14381 tablet_bootstrap.cc:492] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf: Bootstrap starting.
I20260709 12:09:13.356946 14247 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d82ca0c0e51a4e148b8d3e226ff7cebb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:13.375514 14380 tablet_bootstrap.cc:492] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec: No bootstrap required, opened a new log
I20260709 12:09:13.376191 14251 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc8bff37f52742a3a3b8a39c45ade183. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:13.376129 14380 ts_tablet_manager.cc:1403] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec: Time spent bootstrapping tablet: real 0.277s	user 0.019s	sys 0.003s
I20260709 12:09:13.379863 14380 raft_consensus.cc:359] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:13.380636 14380 raft_consensus.cc:385] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:13.381004 14380 raft_consensus.cc:740] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Initialized, Role: FOLLOWER
I20260709 12:09:13.311960 14171 tablet_service.cc:1511] Processing CreateTablet for tablet fc8bff37f52742a3a3b8a39c45ade183 (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:09:13.352063 14174 rpcz_store.cc:276] 0709 12:09:12.219233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:12.684976 (+465743us) service_pool.cc:224] Handling call
0709 12:09:12.838072 (+153096us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:09:12.846612 (+  8540us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:09:13.179795 (+333183us) tablet_metadata.cc:665] Metadata flushed
0709 12:09:13.325303 (+145508us) tablet_replica.cc:206] Creating consensus instance
0709 12:09:13.336363 (+ 11060us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1792}
I20260709 12:09:13.385218 14173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15f7cecfe772454980c8ae9d1803fe98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:13.386587 14176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd5274ac33c2483681726f6b8eccdc6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:13.386757 14174 tablet_service.cc:1511] Processing CreateTablet for tablet 7c8882b1b37d4e84a94a2e1e321a8755 (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:09:13.389077 14172 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d82ca0c0e51a4e148b8d3e226ff7cebb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:13.389982 14175 tablet_service.cc:1511] Processing CreateTablet for tablet 0a11d7ae457a408cac205ac501217c61 (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:09:13.361476 14248 tablet_service.cc:1511] Processing CreateTablet for tablet 15f7cecfe772454980c8ae9d1803fe98 (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:09:13.401957 14380 consensus_queue.cc:260] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:13.406450 14329 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc8bff37f52742a3a3b8a39c45ade183. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:13.420496 14328 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d82ca0c0e51a4e148b8d3e226ff7cebb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:13.420496 14171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc8bff37f52742a3a3b8a39c45ade183. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:13.421384 14174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c8882b1b37d4e84a94a2e1e321a8755. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:13.424137 14327 tablet_service.cc:1511] Processing CreateTablet for tablet 0a11d7ae457a408cac205ac501217c61 (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:09:13.425544 14327 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a11d7ae457a408cac205ac501217c61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:13.427327 14320 tablet_service.cc:1511] Processing CreateTablet for tablet bd5274ac33c2483681726f6b8eccdc6c (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:09:13.428356 14248 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15f7cecfe772454980c8ae9d1803fe98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:13.428118 14326 tablet_service.cc:1511] Processing CreateTablet for tablet 7c8882b1b37d4e84a94a2e1e321a8755 (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:09:13.428901 14254 tablet_service.cc:1511] Processing CreateTablet for tablet bd5274ac33c2483681726f6b8eccdc6c (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:09:13.409988 14386 raft_consensus.cc:515] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } }
I20260709 12:09:13.450172 14254 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd5274ac33c2483681726f6b8eccdc6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:13.450536 14379 tablet_bootstrap.cc:492] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c: No bootstrap required, opened a new log
I20260709 12:09:13.451114 14379 ts_tablet_manager.cc:1403] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c: Time spent bootstrapping tablet: real 0.288s	user 0.022s	sys 0.036s
I20260709 12:09:13.451277 14380 ts_tablet_manager.cc:1434] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec: Time spent starting tablet: real 0.074s	user 0.008s	sys 0.000s
I20260709 12:09:13.454372 14379 raft_consensus.cc:359] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:13.455173 14379 raft_consensus.cc:385] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:13.455492 14379 raft_consensus.cc:740] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Initialized, Role: FOLLOWER
I20260709 12:09:13.456419 14379 consensus_queue.cc:260] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:13.459652 14379 ts_tablet_manager.cc:1434] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:09:13.461476 14246 tablet_service.cc:1511] Processing CreateTablet for tablet 7c8882b1b37d4e84a94a2e1e321a8755 (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:09:13.462997 14175 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a11d7ae457a408cac205ac501217c61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:13.467113 14320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd5274ac33c2483681726f6b8eccdc6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:13.470741 14381 tablet_bootstrap.cc:654] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:13.471978 14379 tablet_bootstrap.cc:492] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c: Bootstrap starting.
I20260709 12:09:13.478300 14380 tablet_bootstrap.cc:492] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec: Bootstrap starting.
I20260709 12:09:13.505110 14326 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c8882b1b37d4e84a94a2e1e321a8755. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:13.479368 14387 raft_consensus.cc:493] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:13.506155 14387 raft_consensus.cc:515] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:13.506644 14246 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c8882b1b37d4e84a94a2e1e321a8755. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:13.508594 14387 leader_election.cc:290] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:13.486366 14265 raft_consensus.cc:2393] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 1: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:09:13.488965 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
W20260709 12:09:13.512104 14230 leader_election.cc:343] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:13.512581 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:13.513371 14339 raft_consensus.cc:2468] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 0.
I20260709 12:09:13.514932 14155 leader_election.cc:304] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:09:13.516033 14155 leader_election.cc:304] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:09:13.517165 14387 raft_consensus.cc:2804] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:13.517617 14387 raft_consensus.cc:493] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:13.518240 14387 raft_consensus.cc:3060] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:13.518517 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:13.519207 14265 raft_consensus.cc:2468] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 0.
I20260709 12:09:13.490062 14386 leader_election.cc:290] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187)
I20260709 12:09:13.492255 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:09:13.520697 14190 raft_consensus.cc:3060] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:13.499675 14253 tablet_service.cc:1511] Processing CreateTablet for tablet 0a11d7ae457a408cac205ac501217c61 (DEFAULT_TABLE table=test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:09:13.530565 14379 tablet_bootstrap.cc:654] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:13.543061 14380 tablet_bootstrap.cc:654] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:13.544744 14387 raft_consensus.cc:515] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:13.553349 14190 raft_consensus.cc:2468] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 1.
I20260709 12:09:13.556301 14253 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a11d7ae457a408cac205ac501217c61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:13.585634 14229 leader_election.cc:304] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:09:13.586973 14386 raft_consensus.cc:2804] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:13.587507 14386 raft_consensus.cc:697] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 1 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:09:13.588325 14386 consensus_queue.cc:237] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } }
I20260709 12:09:13.590631 14387 leader_election.cc:290] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:13.591418 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:09:13.592036 14265 raft_consensus.cc:3060] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:13.592867 14379 tablet_bootstrap.cc:492] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c: No bootstrap required, opened a new log
I20260709 12:09:13.593428 14379 ts_tablet_manager.cc:1403] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c: Time spent bootstrapping tablet: real 0.122s	user 0.019s	sys 0.015s
I20260709 12:09:13.595201 14408 raft_consensus.cc:2749] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:13.598277 14379 raft_consensus.cc:359] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:13.599155 14379 raft_consensus.cc:385] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:13.599545 14379 raft_consensus.cc:740] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Initialized, Role: FOLLOWER
I20260709 12:09:13.602532 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:09:13.606462 14265 raft_consensus.cc:2468] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 1.
I20260709 12:09:13.606828 14339 raft_consensus.cc:3060] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:13.607872 14155 leader_election.cc:304] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:09:13.608732 14387 raft_consensus.cc:2804] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:13.609186 14387 raft_consensus.cc:697] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 1 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:09:13.610076 14387 consensus_queue.cc:237] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:13.601440 14379 consensus_queue.cc:260] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:13.616641 14381 tablet_bootstrap.cc:492] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf: No bootstrap required, opened a new log
I20260709 12:09:13.617468 14381 ts_tablet_manager.cc:1403] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf: Time spent bootstrapping tablet: real 0.249s	user 0.014s	sys 0.009s
I20260709 12:09:13.616822 14380 tablet_bootstrap.cc:492] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec: No bootstrap required, opened a new log
I20260709 12:09:13.620788 14381 raft_consensus.cc:359] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:13.621629 14380 ts_tablet_manager.cc:1403] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec: Time spent bootstrapping tablet: real 0.144s	user 0.017s	sys 0.004s
I20260709 12:09:13.621846 14381 raft_consensus.cc:385] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:13.622426 14381 raft_consensus.cc:740] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Initialized, Role: FOLLOWER
I20260709 12:09:13.623320 14381 consensus_queue.cc:260] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:13.624145 14339 raft_consensus.cc:2468] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 1.
I20260709 12:09:13.625871 14381 ts_tablet_manager.cc:1434] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.002s
I20260709 12:09:13.626513 14379 ts_tablet_manager.cc:1434] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.002s
I20260709 12:09:13.627171 14381 tablet_bootstrap.cc:492] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf: Bootstrap starting.
I20260709 12:09:13.626374 14380 raft_consensus.cc:359] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:13.632124 14380 raft_consensus.cc:385] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:13.632457 14380 raft_consensus.cc:740] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Initialized, Role: FOLLOWER
I20260709 12:09:13.633301 14380 consensus_queue.cc:260] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:13.635020 14381 tablet_bootstrap.cc:654] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:13.636052 14380 ts_tablet_manager.cc:1434] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:09:13.637190 14380 tablet_bootstrap.cc:492] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec: Bootstrap starting.
I20260709 12:09:13.640583 14379 tablet_bootstrap.cc:492] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c: Bootstrap starting.
I20260709 12:09:13.643769 14380 tablet_bootstrap.cc:654] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:13.639396 14088 catalog_manager.cc:5697] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: term changed from 0 to 1, leader changed from <none> to 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130). New cstate: current_term: 1 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:13.655534 14379 tablet_bootstrap.cc:654] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:13.662068 14381 tablet_bootstrap.cc:492] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf: No bootstrap required, opened a new log
I20260709 12:09:13.662806 14381 ts_tablet_manager.cc:1403] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf: Time spent bootstrapping tablet: real 0.036s	user 0.016s	sys 0.016s
I20260709 12:09:13.664163 14087 catalog_manager.cc:5697] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf reported cstate change: term changed from 0 to 1, leader changed from <none> to 885067a0d31741bfb5c9935788e315bf (127.12.174.129). New cstate: current_term: 1 leader_uuid: "885067a0d31741bfb5c9935788e315bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:13.667225 14380 tablet_bootstrap.cc:492] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec: No bootstrap required, opened a new log
I20260709 12:09:13.668464 14380 ts_tablet_manager.cc:1403] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec: Time spent bootstrapping tablet: real 0.031s	user 0.018s	sys 0.003s
I20260709 12:09:13.668972 14381 raft_consensus.cc:359] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:13.670092 14381 raft_consensus.cc:385] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:13.670532 14381 raft_consensus.cc:740] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Initialized, Role: FOLLOWER
I20260709 12:09:13.671720 14379 tablet_bootstrap.cc:492] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c: No bootstrap required, opened a new log
I20260709 12:09:13.672669 14379 ts_tablet_manager.cc:1403] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c: Time spent bootstrapping tablet: real 0.032s	user 0.012s	sys 0.008s
I20260709 12:09:13.671837 14381 consensus_queue.cc:260] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:13.673820 14380 raft_consensus.cc:359] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:13.674842 14380 raft_consensus.cc:385] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:13.675266 14380 raft_consensus.cc:740] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Initialized, Role: FOLLOWER
I20260709 12:09:13.676412 14381 ts_tablet_manager.cc:1434] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf: Time spent starting tablet: real 0.013s	user 0.011s	sys 0.000s
I20260709 12:09:13.676734 14380 consensus_queue.cc:260] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:13.678035 14381 tablet_bootstrap.cc:492] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf: Bootstrap starting.
I20260709 12:09:13.679167 14379 raft_consensus.cc:359] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:13.680449 14379 raft_consensus.cc:385] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:13.681001 14380 ts_tablet_manager.cc:1434] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.003s
I20260709 12:09:13.681033 14379 raft_consensus.cc:740] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Initialized, Role: FOLLOWER
I20260709 12:09:13.682893 14380 tablet_bootstrap.cc:492] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec: Bootstrap starting.
I20260709 12:09:13.682735 14379 consensus_queue.cc:260] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:13.687047 14379 ts_tablet_manager.cc:1434] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c: Time spent starting tablet: real 0.014s	user 0.000s	sys 0.012s
I20260709 12:09:13.692868 14381 tablet_bootstrap.cc:654] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:13.694585 14379 tablet_bootstrap.cc:492] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c: Bootstrap starting.
I20260709 12:09:13.705165 14380 tablet_bootstrap.cc:654] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:13.714469 14379 tablet_bootstrap.cc:654] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:13.718376 14387 raft_consensus.cc:493] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:13.719148 14387 raft_consensus.cc:515] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:13.723816 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:13.725908 14386 raft_consensus.cc:493] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:13.723855 14381 tablet_bootstrap.cc:492] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf: No bootstrap required, opened a new log
I20260709 12:09:13.726783 14386 raft_consensus.cc:515] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:13.727507 14381 ts_tablet_manager.cc:1403] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf: Time spent bootstrapping tablet: real 0.050s	user 0.019s	sys 0.019s
I20260709 12:09:13.732471 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:09:13.734649 14230 leader_election.cc:343] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:13.734170 14381 raft_consensus.cc:359] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:09:13.725908 14155 leader_election.cc:343] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:13.738080 14386 leader_election.cc:290] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:13.738382 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:13.739408 14190 raft_consensus.cc:2468] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 0.
I20260709 12:09:13.740028 14387 leader_election.cc:290] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:13.735507 14381 raft_consensus.cc:385] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:13.742221 14381 raft_consensus.cc:740] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Initialized, Role: FOLLOWER
I20260709 12:09:13.743865 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:09:13.745786 14155 leader_election.cc:343] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:13.745998 14381 consensus_queue.cc:260] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:13.746354 14155 leader_election.cc:304] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:09:13.741613 14229 leader_election.cc:304] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:09:13.747481 14386 raft_consensus.cc:2804] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:13.747634 14387 raft_consensus.cc:2749] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:13.751799 14379 tablet_bootstrap.cc:492] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c: No bootstrap required, opened a new log
I20260709 12:09:13.753211 14379 ts_tablet_manager.cc:1403] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c: Time spent bootstrapping tablet: real 0.059s	user 0.015s	sys 0.024s
I20260709 12:09:13.752192 14386 raft_consensus.cc:493] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:13.755579 14386 raft_consensus.cc:3060] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:13.757539 14379 raft_consensus.cc:359] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } }
I20260709 12:09:13.758680 14379 raft_consensus.cc:385] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:13.759122 14379 raft_consensus.cc:740] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Initialized, Role: FOLLOWER
I20260709 12:09:13.760340 14379 consensus_queue.cc:260] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } }
I20260709 12:09:13.762470 14381 ts_tablet_manager.cc:1434] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf: Time spent starting tablet: real 0.034s	user 0.005s	sys 0.008s
I20260709 12:09:13.770354 14379 ts_tablet_manager.cc:1434] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c: Time spent starting tablet: real 0.017s	user 0.004s	sys 0.006s
I20260709 12:09:13.770627 14386 raft_consensus.cc:515] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:13.772035 14379 tablet_bootstrap.cc:492] T 7879f4a298eb4e69ac692911bd5ac5f8 P 65c9c1653b3346b39a0e118540e6080c: Bootstrap starting.
I20260709 12:09:13.776494 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:09:13.777483 14190 raft_consensus.cc:3060] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:13.780303 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
W20260709 12:09:13.782943 14230 leader_election.cc:343] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:13.784008 14386 leader_election.cc:290] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:13.785233 14379 tablet_bootstrap.cc:654] T 7879f4a298eb4e69ac692911bd5ac5f8 P 65c9c1653b3346b39a0e118540e6080c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:13.785892 14387 raft_consensus.cc:493] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:13.776504 14381 tablet_bootstrap.cc:492] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf: Bootstrap starting.
I20260709 12:09:13.786732 14387 raft_consensus.cc:515] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:13.789039 14387 leader_election.cc:290] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:13.792521 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:09:13.795204 14155 leader_election.cc:343] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:13.796769 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:13.797835 14339 raft_consensus.cc:2468] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 0.
I20260709 12:09:13.799587 14155 leader_election.cc:304] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:09:13.801409 14387 raft_consensus.cc:2804] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:13.801955 14387 raft_consensus.cc:493] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:13.802471 14387 raft_consensus.cc:3060] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:13.811300 14190 raft_consensus.cc:2468] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 1.
I20260709 12:09:13.813143 14229 leader_election.cc:304] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:09:13.814991 14386 raft_consensus.cc:2804] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:13.816011 14386 raft_consensus.cc:697] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 1 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:09:13.815716 14387 raft_consensus.cc:515] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:13.817440 14386 consensus_queue.cc:237] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:13.820241 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:09:13.822359 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:09:13.823176 14339 raft_consensus.cc:3060] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:13.823717 14380 tablet_bootstrap.cc:492] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec: No bootstrap required, opened a new log
I20260709 12:09:13.824419 14380 ts_tablet_manager.cc:1403] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec: Time spent bootstrapping tablet: real 0.142s	user 0.042s	sys 0.048s
I20260709 12:09:13.826920 14387 leader_election.cc:290] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:09:13.827931 14155 leader_election.cc:343] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:13.831054 14381 tablet_bootstrap.cc:654] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:13.831897 14380 raft_consensus.cc:359] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:13.833225 14380 raft_consensus.cc:385] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:13.833850 14380 raft_consensus.cc:740] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Initialized, Role: FOLLOWER
I20260709 12:09:13.839098 14339 raft_consensus.cc:2468] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 1.
I20260709 12:09:13.840170 14379 tablet_bootstrap.cc:492] T 7879f4a298eb4e69ac692911bd5ac5f8 P 65c9c1653b3346b39a0e118540e6080c: No bootstrap required, opened a new log
I20260709 12:09:13.840904 14379 ts_tablet_manager.cc:1403] T 7879f4a298eb4e69ac692911bd5ac5f8 P 65c9c1653b3346b39a0e118540e6080c: Time spent bootstrapping tablet: real 0.069s	user 0.013s	sys 0.028s
I20260709 12:09:13.841063 14155 leader_election.cc:304] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:09:13.835268 14380 consensus_queue.cc:260] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:13.843590 14387 raft_consensus.cc:2804] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:13.844575 14387 raft_consensus.cc:697] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 1 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:09:13.845943 14387 consensus_queue.cc:237] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:13.846403 14380 ts_tablet_manager.cc:1434] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec: Time spent starting tablet: real 0.022s	user 0.001s	sys 0.012s
I20260709 12:09:13.846550 14379 raft_consensus.cc:359] T 7879f4a298eb4e69ac692911bd5ac5f8 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:13.848399 14379 raft_consensus.cc:385] T 7879f4a298eb4e69ac692911bd5ac5f8 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:13.849114 14379 raft_consensus.cc:740] T 7879f4a298eb4e69ac692911bd5ac5f8 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Initialized, Role: FOLLOWER
I20260709 12:09:13.850279 14379 consensus_queue.cc:260] T 7879f4a298eb4e69ac692911bd5ac5f8 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:13.853255 14381 tablet_bootstrap.cc:492] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf: No bootstrap required, opened a new log
I20260709 12:09:13.854800 14381 ts_tablet_manager.cc:1403] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf: Time spent bootstrapping tablet: real 0.079s	user 0.006s	sys 0.018s
I20260709 12:09:13.860013 14381 raft_consensus.cc:359] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:13.861104 14381 raft_consensus.cc:385] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:13.861538 14381 raft_consensus.cc:740] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Initialized, Role: FOLLOWER
I20260709 12:09:13.862687 14381 consensus_queue.cc:260] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:13.862178 14087 catalog_manager.cc:5697] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: term changed from 0 to 1, leader changed from <none> to 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130). New cstate: current_term: 1 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:13.853986 14380 tablet_bootstrap.cc:492] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec: Bootstrap starting.
I20260709 12:09:13.870798 14379 ts_tablet_manager.cc:1434] T 7879f4a298eb4e69ac692911bd5ac5f8 P 65c9c1653b3346b39a0e118540e6080c: Time spent starting tablet: real 0.029s	user 0.012s	sys 0.003s
I20260709 12:09:13.877842 14380 tablet_bootstrap.cc:654] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:13.881352 14381 ts_tablet_manager.cc:1434] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.005s
I20260709 12:09:13.882989 14381 tablet_bootstrap.cc:492] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf: Bootstrap starting.
I20260709 12:09:13.885842 14379 tablet_bootstrap.cc:492] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c: Bootstrap starting.
I20260709 12:09:13.901608 14381 tablet_bootstrap.cc:654] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:13.902993 14379 tablet_bootstrap.cc:654] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:13.908056 14380 tablet_bootstrap.cc:492] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec: No bootstrap required, opened a new log
I20260709 12:09:13.908833 14380 ts_tablet_manager.cc:1403] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec: Time spent bootstrapping tablet: real 0.055s	user 0.006s	sys 0.014s
I20260709 12:09:13.910720 14379 tablet_bootstrap.cc:492] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c: No bootstrap required, opened a new log
I20260709 12:09:13.911479 14379 ts_tablet_manager.cc:1403] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c: Time spent bootstrapping tablet: real 0.026s	user 0.018s	sys 0.004s
I20260709 12:09:13.910537 14087 catalog_manager.cc:5697] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf reported cstate change: term changed from 0 to 1, leader changed from <none> to 885067a0d31741bfb5c9935788e315bf (127.12.174.129). New cstate: current_term: 1 leader_uuid: "885067a0d31741bfb5c9935788e315bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:13.914193 14380 raft_consensus.cc:359] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:13.915271 14380 raft_consensus.cc:385] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:13.915740 14380 raft_consensus.cc:740] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Initialized, Role: FOLLOWER
I20260709 12:09:13.916025 14379 raft_consensus.cc:359] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:13.916970 14379 raft_consensus.cc:385] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:13.917366 14379 raft_consensus.cc:740] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Initialized, Role: FOLLOWER
I20260709 12:09:13.917086 14380 consensus_queue.cc:260] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:13.920964 14380 ts_tablet_manager.cc:1434] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.007s
I20260709 12:09:13.923272 14380 tablet_bootstrap.cc:492] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec: Bootstrap starting.
I20260709 12:09:13.925657 14381 tablet_bootstrap.cc:492] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf: No bootstrap required, opened a new log
I20260709 12:09:13.925915 14386 raft_consensus.cc:493] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:13.926221 14381 ts_tablet_manager.cc:1403] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf: Time spent bootstrapping tablet: real 0.044s	user 0.022s	sys 0.010s
I20260709 12:09:13.926625 14386 raft_consensus.cc:515] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:13.930146 14381 raft_consensus.cc:359] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:13.930949 14381 raft_consensus.cc:385] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:13.931239 14381 raft_consensus.cc:740] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Initialized, Role: FOLLOWER
I20260709 12:09:13.931985 14381 consensus_queue.cc:260] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:13.933111 14386 leader_election.cc:290] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:13.934614 14386 raft_consensus.cc:493] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:13.935328 14386 raft_consensus.cc:515] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:13.935669 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:13.935673 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:13.937515 14339 raft_consensus.cc:2468] T 7879f4a298eb4e69ac692911bd5ac5f8 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 0.
I20260709 12:09:13.935636 14381 ts_tablet_manager.cc:1434] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:09:13.939429 14230 leader_election.cc:304] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:09:13.939915 14381 tablet_bootstrap.cc:492] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf: Bootstrap starting.
I20260709 12:09:13.942332 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:13.944689 14380 tablet_bootstrap.cc:654] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:13.944621 14386 leader_election.cc:290] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:13.922150 14379 consensus_queue.cc:260] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:13.945909 14389 raft_consensus.cc:493] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:13.946563 14389 raft_consensus.cc:515] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:13.947626 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:13.948508 14339 raft_consensus.cc:2468] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 0.
I20260709 12:09:13.949966 14381 tablet_bootstrap.cc:654] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:13.950186 14230 leader_election.cc:304] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
W20260709 12:09:13.951628 14229 leader_election.cc:343] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:13.951962 14406 raft_consensus.cc:2804] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:13.952589 14406 raft_consensus.cc:493] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:13.953119 14406 raft_consensus.cc:3060] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:13.953950 14387 raft_consensus.cc:493] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:13.954280 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:13.954619 14387 raft_consensus.cc:515] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:13.955461 14190 raft_consensus.cc:2393] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 1: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:09:13.959241 14387 leader_election.cc:290] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:13.962450 14389 leader_election.cc:290] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:13.962811 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:13.963351 14389 raft_consensus.cc:493] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:13.965834 14304 leader_election.cc:304] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
W20260709 12:09:13.972313 14229 leader_election.cc:343] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:13.972554 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:13.967195 14386 raft_consensus.cc:2804] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:13.975354 14386 raft_consensus.cc:493] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:13.976189 14386 raft_consensus.cc:3060] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:13.964129 14389 raft_consensus.cc:515] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } }
I20260709 12:09:13.986704 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:13.988056 14190 raft_consensus.cc:2393] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 1: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:09:13.986723 14379 ts_tablet_manager.cc:1434] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c: Time spent starting tablet: real 0.075s	user 0.008s	sys 0.000s
W20260709 12:09:13.990721 14155 leader_election.cc:343] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:13.996912 14379 tablet_bootstrap.cc:492] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c: Bootstrap starting.
I20260709 12:09:14.000391 14431 raft_consensus.cc:3060] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:13.985515 14389 leader_election.cc:290] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:14.005795 14381 tablet_bootstrap.cc:492] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf: No bootstrap required, opened a new log
I20260709 12:09:14.006489 14381 ts_tablet_manager.cc:1403] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf: Time spent bootstrapping tablet: real 0.067s	user 0.018s	sys 0.044s
I20260709 12:09:14.007594 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:09:14.009377 14155 leader_election.cc:343] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:14.010003 14155 leader_election.cc:304] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:09:14.010408 14381 raft_consensus.cc:359] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:14.010555 14406 raft_consensus.cc:515] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:14.011165 14387 raft_consensus.cc:2749] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:09:14.011667 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 46035.9us
I20260709 12:09:14.011162 14381 raft_consensus.cc:385] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:14.012663 14381 raft_consensus.cc:740] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Initialized, Role: FOLLOWER
I20260709 12:09:14.013556 14381 consensus_queue.cc:260] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:14.013900 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:14.016149 14380 tablet_bootstrap.cc:492] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec: No bootstrap required, opened a new log
I20260709 12:09:14.016678 14380 ts_tablet_manager.cc:1403] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec: Time spent bootstrapping tablet: real 0.094s	user 0.007s	sys 0.025s
I20260709 12:09:14.016441 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:09:14.017201 14339 raft_consensus.cc:3060] T 7879f4a298eb4e69ac692911bd5ac5f8 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:14.020550 14380 raft_consensus.cc:359] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:14.021356 14380 raft_consensus.cc:385] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:14.021476 14381 ts_tablet_manager.cc:1434] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 12:09:14.021908 14387 raft_consensus.cc:493] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:14.022652 14381 tablet_bootstrap.cc:492] T 6de6b0d9885648e6b2f6822eb9f85021 P 885067a0d31741bfb5c9935788e315bf: Bootstrap starting.
I20260709 12:09:14.022586 14387 raft_consensus.cc:515] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:14.027652 14386 raft_consensus.cc:515] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:14.030845 14387 leader_election.cc:290] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:14.031189 14380 raft_consensus.cc:740] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Initialized, Role: FOLLOWER
I20260709 12:09:14.034314 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:14.050063 14338 raft_consensus.cc:2468] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 0.
I20260709 12:09:14.050194 14380 consensus_queue.cc:260] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:14.029893 14406 leader_election.cc:290] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:14.039947 14304 leader_election.cc:304] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:09:14.052326 14155 leader_election.cc:304] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:09:14.042327 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:14.054711 14408 raft_consensus.cc:2804] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:14.055241 14408 raft_consensus.cc:493] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:14.055730 14408 raft_consensus.cc:3060] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:14.055943 14155 leader_election.cc:343] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:14.044145 14381 tablet_bootstrap.cc:654] T 6de6b0d9885648e6b2f6822eb9f85021 P 885067a0d31741bfb5c9935788e315bf: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:14.045032 14379 tablet_bootstrap.cc:654] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:14.044667 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:09:14.045759 14386 leader_election.cc:290] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:14.052990 14339 raft_consensus.cc:2468] T 7879f4a298eb4e69ac692911bd5ac5f8 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 1.
I20260709 12:09:14.059238 14230 leader_election.cc:304] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:09:14.055706 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:09:14.060837 14338 raft_consensus.cc:3060] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:14.046319 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:09:14.053989 14434 raft_consensus.cc:3060] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:14.063961 14229 leader_election.cc:343] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:14.064646 14386 raft_consensus.cc:2804] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:14.065856 14386 raft_consensus.cc:697] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 1 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:09:14.067381 14386 consensus_queue.cc:237] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:09:14.070724 14229 leader_election.cc:343] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:14.074450 14431 raft_consensus.cc:2749] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:14.077682 14408 raft_consensus.cc:515] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:14.081866 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
W20260709 12:09:14.083845 14155 leader_election.cc:343] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:14.085907 14408 leader_election.cc:290] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:14.086635 14406 raft_consensus.cc:493] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:14.087211 14406 raft_consensus.cc:515] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:14.091531 14406 leader_election.cc:290] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:14.093602 14380 ts_tablet_manager.cc:1434] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec: Time spent starting tablet: real 0.077s	user 0.021s	sys 0.021s
I20260709 12:09:14.095065 14380 tablet_bootstrap.cc:492] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec: Bootstrap starting.
I20260709 12:09:14.096979 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:14.097828 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:14.094769 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:09:14.099499 14431 raft_consensus.cc:493] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:14.100664 14339 raft_consensus.cc:3060] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:14.101390 14230 leader_election.cc:343] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:14.101083 14431 raft_consensus.cc:515] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:09:14.102979 14229 leader_election.cc:343] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:14.104758 14229 leader_election.cc:304] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:09:14.095734 14406 raft_consensus.cc:493] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:14.106689 14406 raft_consensus.cc:515] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:14.107504 14431 leader_election.cc:290] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:14.108716 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:14.111389 14435 raft_consensus.cc:2749] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:09:14.111721 14304 leader_election.cc:343] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:14.113358 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:14.115381 14408 consensus_queue.cc:1048] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:14.115586 14189 raft_consensus.cc:2468] T e9b3f8ef40054811944ba9bd9ed74eb3 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 0.
I20260709 12:09:14.120251 14338 raft_consensus.cc:2468] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 1.
I20260709 12:09:14.123168 14339 raft_consensus.cc:2468] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 1.
I20260709 12:09:14.122026 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:14.126619 14379 tablet_bootstrap.cc:492] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c: No bootstrap required, opened a new log
I20260709 12:09:14.126806 14335 raft_consensus.cc:2393] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 1: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:09:14.126318 14155 leader_election.cc:304] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:09:14.127164 14379 ts_tablet_manager.cc:1403] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c: Time spent bootstrapping tablet: real 0.131s	user 0.017s	sys 0.004s
I20260709 12:09:14.127822 14303 leader_election.cc:304] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:09:14.129421 14230 leader_election.cc:304] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:09:14.128454 14408 raft_consensus.cc:2804] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:14.131635 14435 raft_consensus.cc:2804] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:14.131816 14379 raft_consensus.cc:359] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:14.132371 14435 raft_consensus.cc:697] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 1 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:09:14.132725 14379 raft_consensus.cc:385] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:14.133185 14379 raft_consensus.cc:740] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Initialized, Role: FOLLOWER
I20260709 12:09:14.133530 14408 raft_consensus.cc:697] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 1 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:09:14.121773 14406 leader_election.cc:290] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:14.135845 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:14.136139 14408 consensus_queue.cc:237] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:14.133844 14435 consensus_queue.cc:237] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:14.137382 14431 raft_consensus.cc:2804] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:14.142503 14431 raft_consensus.cc:493] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:14.143071 14431 raft_consensus.cc:3060] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:14.145623 14380 tablet_bootstrap.cc:654] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:14.145231 14229 leader_election.cc:304] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:09:14.140615 14434 raft_consensus.cc:2749] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:14.148666 14379 consensus_queue.cc:260] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:14.152937 14379 ts_tablet_manager.cc:1434] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c: Time spent starting tablet: real 0.025s	user 0.004s	sys 0.003s
I20260709 12:09:14.154845 14379 tablet_bootstrap.cc:492] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c: Bootstrap starting.
I20260709 12:09:14.157827 14406 consensus_queue.cc:1048] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:09:14.157100 14386 raft_consensus.cc:3060] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:14.171145 14381 tablet_bootstrap.cc:492] T 6de6b0d9885648e6b2f6822eb9f85021 P 885067a0d31741bfb5c9935788e315bf: No bootstrap required, opened a new log
I20260709 12:09:14.171686 14381 ts_tablet_manager.cc:1403] T 6de6b0d9885648e6b2f6822eb9f85021 P 885067a0d31741bfb5c9935788e315bf: Time spent bootstrapping tablet: real 0.149s	user 0.024s	sys 0.005s
I20260709 12:09:14.175079 14381 raft_consensus.cc:359] T 6de6b0d9885648e6b2f6822eb9f85021 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:14.175771 14381 raft_consensus.cc:385] T 6de6b0d9885648e6b2f6822eb9f85021 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:14.176038 14381 raft_consensus.cc:740] T 6de6b0d9885648e6b2f6822eb9f85021 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Initialized, Role: FOLLOWER
I20260709 12:09:14.177125 14381 consensus_queue.cc:260] T 6de6b0d9885648e6b2f6822eb9f85021 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:14.179852 14381 ts_tablet_manager.cc:1434] T 6de6b0d9885648e6b2f6822eb9f85021 P 885067a0d31741bfb5c9935788e315bf: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:09:14.181022 14381 tablet_bootstrap.cc:492] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf: Bootstrap starting.
I20260709 12:09:14.182904 14406 consensus_queue.cc:1048] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:14.182915 14386 raft_consensus.cc:2749] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:14.191613 14379 tablet_bootstrap.cc:654] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:14.149942 14086 catalog_manager.cc:5697] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: term changed from 0 to 1, leader changed from <none> to 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130). New cstate: current_term: 1 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:14.202315 14381 tablet_bootstrap.cc:654] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:14.209086 14088 catalog_manager.cc:5697] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf reported cstate change: term changed from 0 to 1, leader changed from <none> to 885067a0d31741bfb5c9935788e315bf (127.12.174.129). New cstate: current_term: 1 leader_uuid: "885067a0d31741bfb5c9935788e315bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:14.214776 14434 raft_consensus.cc:493] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:14.215564 14434 raft_consensus.cc:515] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:14.217540 14408 consensus_queue.cc:1048] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:14.224802 14434 leader_election.cc:290] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:14.228252 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:14.224207 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:14.229048 14264 raft_consensus.cc:2468] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 0.
I20260709 12:09:14.229297 14190 raft_consensus.cc:2468] T 6de6b0d9885648e6b2f6822eb9f85021 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 0.
I20260709 12:09:14.230770 14304 leader_election.cc:304] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:09:14.232098 14434 raft_consensus.cc:2804] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:14.232661 14434 raft_consensus.cc:493] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:14.233208 14434 raft_consensus.cc:3060] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:14.239130 14431 raft_consensus.cc:515] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:14.247233 14387 raft_consensus.cc:493] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:14.248067 14387 raft_consensus.cc:515] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:14.252162 14379 tablet_bootstrap.cc:492] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c: No bootstrap required, opened a new log
I20260709 12:09:14.255877 14379 ts_tablet_manager.cc:1403] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c: Time spent bootstrapping tablet: real 0.101s	user 0.006s	sys 0.017s
I20260709 12:09:14.259105 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:14.266327 14436 consensus_queue.cc:1048] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:14.282047 14387 leader_election.cc:290] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:09:14.294320 14136 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:09:14.299053 14434 raft_consensus.cc:515] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:09:14.299921 14155 leader_election.cc:343] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:14.301909 14381 tablet_bootstrap.cc:492] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf: No bootstrap required, opened a new log
I20260709 12:09:14.302577 14381 ts_tablet_manager.cc:1403] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf: Time spent bootstrapping tablet: real 0.122s	user 0.014s	sys 0.005s
I20260709 12:09:14.303622 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:09:14.304020 14434 leader_election.cc:290] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:14.304852 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:09:14.306152 14189 raft_consensus.cc:3060] T 6de6b0d9885648e6b2f6822eb9f85021 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:14.309468 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:14.306530 14264 raft_consensus.cc:3060] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:14.324751 14155 leader_election.cc:343] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:14.326740 14155 leader_election.cc:304] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:09:14.328572 14449 consensus_queue.cc:1048] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.024s
I20260709 12:09:14.328328 14379 raft_consensus.cc:359] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:14.329661 14379 raft_consensus.cc:385] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:14.330633 14379 raft_consensus.cc:740] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Initialized, Role: FOLLOWER
I20260709 12:09:14.335563 14381 raft_consensus.cc:359] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:14.336382 14381 raft_consensus.cc:385] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:14.336668 14381 raft_consensus.cc:740] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Initialized, Role: FOLLOWER
I20260709 12:09:14.337652 14379 consensus_queue.cc:260] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:14.339612 14379 ts_tablet_manager.cc:1434] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c: Time spent starting tablet: real 0.083s	user 0.007s	sys 0.000s
I20260709 12:09:14.348068 14381 consensus_queue.cc:260] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:14.342939 14408 raft_consensus.cc:2749] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:14.362744 14379 tablet_bootstrap.cc:492] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c: Bootstrap starting.
I20260709 12:09:14.364327 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:09:14.365034 14188 raft_consensus.cc:3060] T e9b3f8ef40054811944ba9bd9ed74eb3 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:14.367626 14380 tablet_bootstrap.cc:492] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec: No bootstrap required, opened a new log
I20260709 12:09:14.368185 14380 ts_tablet_manager.cc:1403] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec: Time spent bootstrapping tablet: real 0.273s	user 0.025s	sys 0.005s
I20260709 12:09:14.371070 14380 raft_consensus.cc:359] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:14.371781 14380 raft_consensus.cc:385] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:14.372051 14380 raft_consensus.cc:740] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Initialized, Role: FOLLOWER
I20260709 12:09:14.372773 14380 consensus_queue.cc:260] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:14.383898 14189 raft_consensus.cc:2468] T 6de6b0d9885648e6b2f6822eb9f85021 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 1.
I20260709 12:09:14.384841 14431 leader_election.cc:290] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:14.385324 14436 consensus_queue.cc:1048] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:14.386366 14380 ts_tablet_manager.cc:1434] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.001s
I20260709 12:09:14.387429 14380 tablet_bootstrap.cc:492] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec: Bootstrap starting.
I20260709 12:09:14.390820 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:09:14.391676 14265 raft_consensus.cc:3060] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:14.391862 14303 leader_election.cc:304] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:09:14.394014 14431 raft_consensus.cc:2804] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:14.394788 14431 raft_consensus.cc:697] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:09:14.396730 14436 raft_consensus.cc:493] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:14.396235 14431 consensus_queue.cc:237] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:14.397593 14436 raft_consensus.cc:515] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:14.416682 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:14.417785 14190 raft_consensus.cc:2468] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 0.
I20260709 12:09:14.419603 14229 leader_election.cc:304] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:09:14.421078 14386 raft_consensus.cc:2804] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:14.421649 14386 raft_consensus.cc:493] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:14.422250 14386 raft_consensus.cc:3060] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:14.454842 14264 raft_consensus.cc:2468] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 1.
I20260709 12:09:14.479941 14381 ts_tablet_manager.cc:1434] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf: Time spent starting tablet: real 0.177s	user 0.029s	sys 0.025s
I20260709 12:09:14.481249 14381 tablet_bootstrap.cc:492] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf: Bootstrap starting.
I20260709 12:09:14.485631 14436 leader_election.cc:290] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:09:14.466966 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 131235us
I20260709 12:09:14.506776 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:14.507869 14335 raft_consensus.cc:2468] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 0.
I20260709 12:09:14.527287 14188 raft_consensus.cc:2468] T e9b3f8ef40054811944ba9bd9ed74eb3 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 1.
I20260709 12:09:14.529238 14303 leader_election.cc:304] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:09:14.530517 14431 raft_consensus.cc:2804] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:14.531198 14431 raft_consensus.cc:697] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:09:14.532574 14431 consensus_queue.cc:237] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:14.553238 14387 raft_consensus.cc:493] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:14.554137 14387 raft_consensus.cc:515] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:14.558509 14408 consensus_queue.cc:1048] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:14.562590 14379 tablet_bootstrap.cc:700] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c: Time spent opening tablet: real 0.125s	user 0.002s	sys 0.003s
I20260709 12:09:14.563827 14379 tablet_bootstrap.cc:654] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:14.564880 14265 raft_consensus.cc:2468] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 1.
I20260709 12:09:14.507314 14386 raft_consensus.cc:515] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:14.570602 14087 catalog_manager.cc:5697] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: term changed from 0 to 1, leader changed from <none> to 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130). New cstate: current_term: 1 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:14.572886 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:09:14.573582 14335 raft_consensus.cc:3060] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:14.592132 14380 tablet_bootstrap.cc:654] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:14.588846 14386 leader_election.cc:290] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:14.565649 14436 consensus_queue.cc:1048] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.029s
I20260709 12:09:14.606165 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:09:14.607141 14188 raft_consensus.cc:3060] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:14.608023 14381 tablet_bootstrap.cc:654] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:14.599346 14387 leader_election.cc:290] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:14.618290 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:14.626503 14457 consensus_queue.cc:1048] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:09:14.664661 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:14.679834 14335 raft_consensus.cc:2468] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 1.
I20260709 12:09:14.683657 14086 catalog_manager.cc:5697] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c reported cstate change: term changed from 0 to 1, leader changed from <none> to 65c9c1653b3346b39a0e118540e6080c (127.12.174.131). New cstate: current_term: 1 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:14.663551 14189 raft_consensus.cc:3060] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:14.696416 14380 tablet_bootstrap.cc:492] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec: No bootstrap required, opened a new log
I20260709 12:09:14.696952 14380 ts_tablet_manager.cc:1403] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec: Time spent bootstrapping tablet: real 0.310s	user 0.035s	sys 0.056s
W20260709 12:09:14.698508 14229 consensus_peers.cc:597] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:14.701278 14380 raft_consensus.cc:359] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:14.703135 14380 raft_consensus.cc:385] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:14.703445 14380 raft_consensus.cc:740] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Initialized, Role: FOLLOWER
I20260709 12:09:14.702152 14155 leader_election.cc:304] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
W20260709 12:09:14.706118 14155 consensus_peers.cc:597] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf -> Peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Couldn't send request to peer 17aab1bbf5014936aa18cc21818b26ec. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:14.705994 14380 consensus_queue.cc:260] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:14.708957 14380 ts_tablet_manager.cc:1434] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.002s
I20260709 12:09:14.711483 14379 tablet_bootstrap.cc:492] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c: No bootstrap required, opened a new log
I20260709 12:09:14.717653 14379 ts_tablet_manager.cc:1403] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c: Time spent bootstrapping tablet: real 0.357s	user 0.012s	sys 0.014s
I20260709 12:09:14.706162 14230 leader_election.cc:304] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:09:14.718310 14380 tablet_bootstrap.cc:492] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec: Bootstrap starting.
I20260709 12:09:14.722289 14379 raft_consensus.cc:359] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:14.723094 14379 raft_consensus.cc:385] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:14.723379 14379 raft_consensus.cc:740] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Initialized, Role: FOLLOWER
I20260709 12:09:14.724902 14386 raft_consensus.cc:2804] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:14.723969 14379 consensus_queue.cc:260] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:14.726292 14386 raft_consensus.cc:697] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 1 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:09:14.727516 14188 raft_consensus.cc:2468] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 1.
I20260709 12:09:14.727792 14386 consensus_queue.cc:237] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:14.729977 14379 ts_tablet_manager.cc:1434] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.003s
I20260709 12:09:14.730789 14379 tablet_bootstrap.cc:492] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c: Bootstrap starting.
I20260709 12:09:14.739042 14456 raft_consensus.cc:2749] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:14.748517 14381 tablet_bootstrap.cc:492] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf: No bootstrap required, opened a new log
I20260709 12:09:14.749127 14381 ts_tablet_manager.cc:1403] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf: Time spent bootstrapping tablet: real 0.268s	user 0.020s	sys 0.037s
I20260709 12:09:14.753204 14381 raft_consensus.cc:359] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:14.754729 14381 raft_consensus.cc:385] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:14.754937 14381 raft_consensus.cc:740] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Initialized, Role: FOLLOWER
I20260709 12:09:14.753753 14088 catalog_manager.cc:5697] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c reported cstate change: term changed from 0 to 1, leader changed from <none> to 65c9c1653b3346b39a0e118540e6080c (127.12.174.131). New cstate: current_term: 1 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:14.755775 14381 consensus_queue.cc:260] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:14.759510 14381 ts_tablet_manager.cc:1434] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.006s
I20260709 12:09:14.760588 14381 tablet_bootstrap.cc:492] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf: Bootstrap starting.
I20260709 12:09:14.761160 14386 consensus_queue.cc:1048] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:14.772447 14381 tablet_bootstrap.cc:654] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:14.774313 14380 tablet_bootstrap.cc:654] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:14.775575 14379 tablet_bootstrap.cc:654] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:14.781595 14436 consensus_queue.cc:1048] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:09:14.795125 14389 consensus_queue.cc:1048] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:14.826148 14449 raft_consensus.cc:493] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:14.823196 14086 catalog_manager.cc:5697] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: term changed from 0 to 1, leader changed from <none> to 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130). New cstate: current_term: 1 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:14.828395 14449 raft_consensus.cc:515] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:14.828104 14431 consensus_queue.cc:1048] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:09:14.833372 14381 tablet_bootstrap.cc:492] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf: No bootstrap required, opened a new log
I20260709 12:09:14.833895 14381 ts_tablet_manager.cc:1403] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf: Time spent bootstrapping tablet: real 0.074s	user 0.011s	sys 0.024s
I20260709 12:09:14.834275 14380 tablet_bootstrap.cc:492] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec: No bootstrap required, opened a new log
I20260709 12:09:14.834758 14380 ts_tablet_manager.cc:1403] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec: Time spent bootstrapping tablet: real 0.117s	user 0.024s	sys 0.025s
I20260709 12:09:14.846319 14380 raft_consensus.cc:359] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:14.847079 14380 raft_consensus.cc:385] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:14.850793 14380 raft_consensus.cc:740] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Initialized, Role: FOLLOWER
I20260709 12:09:14.848769 14379 tablet_bootstrap.cc:492] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c: No bootstrap required, opened a new log
I20260709 12:09:14.851735 14380 consensus_queue.cc:260] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:14.852202 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:14.852614 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:14.854108 14380 ts_tablet_manager.cc:1434] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec: Time spent starting tablet: real 0.019s	user 0.003s	sys 0.004s
I20260709 12:09:14.851349 14449 leader_election.cc:290] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:09:14.854343 14155 leader_election.cc:343] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:14.854984 14379 ts_tablet_manager.cc:1403] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c: Time spent bootstrapping tablet: real 0.124s	user 0.017s	sys 0.011s
I20260709 12:09:14.850098 14381 raft_consensus.cc:359] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:09:14.858381 14155 leader_election.cc:343] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:14.858999 14381 raft_consensus.cc:385] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:14.855167 14380 tablet_bootstrap.cc:492] T 60aca7b73a544dfc9a4bd6918b27d132 P 17aab1bbf5014936aa18cc21818b26ec: Bootstrap starting.
I20260709 12:09:14.862562 14379 raft_consensus.cc:359] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:14.863284 14379 raft_consensus.cc:385] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:14.863566 14379 raft_consensus.cc:740] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Initialized, Role: FOLLOWER
I20260709 12:09:14.859442 14155 leader_election.cc:304] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:09:14.864737 14379 consensus_queue.cc:260] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:14.869791 14380 tablet_bootstrap.cc:654] T 60aca7b73a544dfc9a4bd6918b27d132 P 17aab1bbf5014936aa18cc21818b26ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:14.870925 14379 ts_tablet_manager.cc:1434] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:09:14.871980 14379 tablet_bootstrap.cc:492] T bf9bea0d16e44efabb5cdd53e3828438 P 65c9c1653b3346b39a0e118540e6080c: Bootstrap starting.
I20260709 12:09:14.859462 14381 raft_consensus.cc:740] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Initialized, Role: FOLLOWER
I20260709 12:09:14.876133 14381 consensus_queue.cc:260] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:14.874675 14449 raft_consensus.cc:2749] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:14.887019 14379 tablet_bootstrap.cc:654] T bf9bea0d16e44efabb5cdd53e3828438 P 65c9c1653b3346b39a0e118540e6080c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:14.889997 14380 tablet_bootstrap.cc:492] T 60aca7b73a544dfc9a4bd6918b27d132 P 17aab1bbf5014936aa18cc21818b26ec: No bootstrap required, opened a new log
I20260709 12:09:14.890592 14380 ts_tablet_manager.cc:1403] T 60aca7b73a544dfc9a4bd6918b27d132 P 17aab1bbf5014936aa18cc21818b26ec: Time spent bootstrapping tablet: real 0.036s	user 0.018s	sys 0.010s
I20260709 12:09:14.899902 14381 ts_tablet_manager.cc:1434] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf: Time spent starting tablet: real 0.066s	user 0.007s	sys 0.001s
I20260709 12:09:14.901023 14381 tablet_bootstrap.cc:492] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf: Bootstrap starting.
I20260709 12:09:14.916646 14381 tablet_bootstrap.cc:654] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:14.921931 14380 raft_consensus.cc:359] T 60aca7b73a544dfc9a4bd6918b27d132 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:14.922703 14380 raft_consensus.cc:385] T 60aca7b73a544dfc9a4bd6918b27d132 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:14.922992 14380 raft_consensus.cc:740] T 60aca7b73a544dfc9a4bd6918b27d132 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Initialized, Role: FOLLOWER
I20260709 12:09:14.923893 14380 consensus_queue.cc:260] T 60aca7b73a544dfc9a4bd6918b27d132 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:14.926432 14380 ts_tablet_manager.cc:1434] T 60aca7b73a544dfc9a4bd6918b27d132 P 17aab1bbf5014936aa18cc21818b26ec: Time spent starting tablet: real 0.035s	user 0.007s	sys 0.000s
I20260709 12:09:14.927561 14380 tablet_bootstrap.cc:492] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec: Bootstrap starting.
I20260709 12:09:14.934013 14379 tablet_bootstrap.cc:492] T bf9bea0d16e44efabb5cdd53e3828438 P 65c9c1653b3346b39a0e118540e6080c: No bootstrap required, opened a new log
I20260709 12:09:14.934705 14379 ts_tablet_manager.cc:1403] T bf9bea0d16e44efabb5cdd53e3828438 P 65c9c1653b3346b39a0e118540e6080c: Time spent bootstrapping tablet: real 0.063s	user 0.009s	sys 0.022s
I20260709 12:09:14.937162 14380 tablet_bootstrap.cc:654] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:14.939191 14379 raft_consensus.cc:359] T bf9bea0d16e44efabb5cdd53e3828438 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:14.940004 14379 raft_consensus.cc:385] T bf9bea0d16e44efabb5cdd53e3828438 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:14.940337 14379 raft_consensus.cc:740] T bf9bea0d16e44efabb5cdd53e3828438 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Initialized, Role: FOLLOWER
I20260709 12:09:14.941201 14379 consensus_queue.cc:260] T bf9bea0d16e44efabb5cdd53e3828438 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:14.948086 14381 tablet_bootstrap.cc:492] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf: No bootstrap required, opened a new log
I20260709 12:09:14.948658 14381 ts_tablet_manager.cc:1403] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf: Time spent bootstrapping tablet: real 0.048s	user 0.011s	sys 0.007s
I20260709 12:09:14.950807 14379 ts_tablet_manager.cc:1434] T bf9bea0d16e44efabb5cdd53e3828438 P 65c9c1653b3346b39a0e118540e6080c: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 12:09:14.951900 14379 tablet_bootstrap.cc:492] T ec0fc0e91c904a0daeb3e29ee24a492d P 65c9c1653b3346b39a0e118540e6080c: Bootstrap starting.
I20260709 12:09:14.952365 14381 raft_consensus.cc:359] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:14.953074 14381 raft_consensus.cc:385] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:14.953370 14381 raft_consensus.cc:740] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Initialized, Role: FOLLOWER
I20260709 12:09:14.954324 14381 consensus_queue.cc:260] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:14.956790 14381 ts_tablet_manager.cc:1434] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 12:09:14.958257 14381 tablet_bootstrap.cc:492] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 885067a0d31741bfb5c9935788e315bf: Bootstrap starting.
I20260709 12:09:14.969928 14381 tablet_bootstrap.cc:654] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 885067a0d31741bfb5c9935788e315bf: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:14.972198 14380 tablet_bootstrap.cc:492] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec: No bootstrap required, opened a new log
I20260709 12:09:14.972723 14380 ts_tablet_manager.cc:1403] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec: Time spent bootstrapping tablet: real 0.045s	user 0.004s	sys 0.019s
I20260709 12:09:14.976150 14379 tablet_bootstrap.cc:654] T ec0fc0e91c904a0daeb3e29ee24a492d P 65c9c1653b3346b39a0e118540e6080c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:14.977250 14380 raft_consensus.cc:359] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:14.978026 14380 raft_consensus.cc:385] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:14.978323 14380 raft_consensus.cc:740] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Initialized, Role: FOLLOWER
I20260709 12:09:14.979236 14380 consensus_queue.cc:260] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:14.987386 14380 ts_tablet_manager.cc:1434] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.002s
I20260709 12:09:14.988263 14380 tablet_bootstrap.cc:492] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec: Bootstrap starting.
I20260709 12:09:14.989591 14381 tablet_bootstrap.cc:492] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 885067a0d31741bfb5c9935788e315bf: No bootstrap required, opened a new log
I20260709 12:09:14.990049 14379 tablet_bootstrap.cc:492] T ec0fc0e91c904a0daeb3e29ee24a492d P 65c9c1653b3346b39a0e118540e6080c: No bootstrap required, opened a new log
I20260709 12:09:14.990175 14381 ts_tablet_manager.cc:1403] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 885067a0d31741bfb5c9935788e315bf: Time spent bootstrapping tablet: real 0.032s	user 0.011s	sys 0.015s
I20260709 12:09:14.990537 14379 ts_tablet_manager.cc:1403] T ec0fc0e91c904a0daeb3e29ee24a492d P 65c9c1653b3346b39a0e118540e6080c: Time spent bootstrapping tablet: real 0.039s	user 0.006s	sys 0.016s
I20260709 12:09:14.996162 14381 raft_consensus.cc:359] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:14.996984 14381 raft_consensus.cc:385] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:14.997557 14380 tablet_bootstrap.cc:654] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:14.997311 14381 raft_consensus.cc:740] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Initialized, Role: FOLLOWER
I20260709 12:09:14.998625 14381 consensus_queue.cc:260] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:14.995688 14379 raft_consensus.cc:359] T ec0fc0e91c904a0daeb3e29ee24a492d P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:15.004977 14379 raft_consensus.cc:385] T ec0fc0e91c904a0daeb3e29ee24a492d P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:15.005205 14379 raft_consensus.cc:740] T ec0fc0e91c904a0daeb3e29ee24a492d P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Initialized, Role: FOLLOWER
I20260709 12:09:15.006045 14379 consensus_queue.cc:260] T ec0fc0e91c904a0daeb3e29ee24a492d P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:15.007272 14381 ts_tablet_manager.cc:1434] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 885067a0d31741bfb5c9935788e315bf: Time spent starting tablet: real 0.017s	user 0.001s	sys 0.007s
I20260709 12:09:15.008282 14381 tablet_bootstrap.cc:492] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf: Bootstrap starting.
I20260709 12:09:15.020184 14431 consensus_queue.cc:1048] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:15.027393 14381 tablet_bootstrap.cc:654] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:15.026016 14263 raft_consensus.cc:3060] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:15.029171 14379 ts_tablet_manager.cc:1434] T ec0fc0e91c904a0daeb3e29ee24a492d P 65c9c1653b3346b39a0e118540e6080c: Time spent starting tablet: real 0.038s	user 0.008s	sys 0.001s
I20260709 12:09:15.037199 14436 raft_consensus.cc:493] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:15.037935 14436 raft_consensus.cc:515] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:15.042114 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:15.042946 14189 raft_consensus.cc:2468] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 0.
I20260709 12:09:15.044703 14229 leader_election.cc:304] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:09:15.046459 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:15.048295 14380 tablet_bootstrap.cc:492] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec: No bootstrap required, opened a new log
W20260709 12:09:15.048441 14230 leader_election.cc:343] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:15.048815 14380 ts_tablet_manager.cc:1403] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec: Time spent bootstrapping tablet: real 0.061s	user 0.010s	sys 0.015s
I20260709 12:09:15.049038 14436 leader_election.cc:290] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:15.050423 14379 tablet_bootstrap.cc:492] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c: Bootstrap starting.
I20260709 12:09:15.051323 14461 raft_consensus.cc:2804] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:15.051792 14461 raft_consensus.cc:493] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:15.052227 14461 raft_consensus.cc:3060] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:15.053287 14380 raft_consensus.cc:359] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:15.054090 14380 raft_consensus.cc:385] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:15.054423 14380 raft_consensus.cc:740] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Initialized, Role: FOLLOWER
I20260709 12:09:15.054713 14456 raft_consensus.cc:493] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:15.055356 14380 consensus_queue.cc:260] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:15.055356 14456 raft_consensus.cc:515] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:15.058064 14380 ts_tablet_manager.cc:1434] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.004s
I20260709 12:09:15.059126 14380 tablet_bootstrap.cc:492] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec: Bootstrap starting.
I20260709 12:09:15.060038 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:15.061652 14431 raft_consensus.cc:493] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:15.065583 14431 raft_consensus.cc:515] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:15.068885 14456 leader_election.cc:290] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:15.069543 14431 leader_election.cc:290] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:15.074378 14381 tablet_bootstrap.cc:492] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf: No bootstrap required, opened a new log
I20260709 12:09:15.074873 14381 ts_tablet_manager.cc:1403] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf: Time spent bootstrapping tablet: real 0.067s	user 0.024s	sys 0.016s
I20260709 12:09:15.074975 14436 raft_consensus.cc:493] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:15.071549 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:09:15.078485 14303 leader_election.cc:343] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:15.076401 14436 raft_consensus.cc:515] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:15.078195 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:15.088469 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:15.088567 14461 raft_consensus.cc:515] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:15.089073 14155 leader_election.cc:304] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:09:15.089378 14188 raft_consensus.cc:2468] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 0.
I20260709 12:09:15.085974 14431 raft_consensus.cc:493] T ec0fc0e91c904a0daeb3e29ee24a492d P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:15.090852 14456 raft_consensus.cc:2749] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:15.092016 14229 leader_election.cc:304] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:09:15.093271 14386 raft_consensus.cc:2804] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:15.093729 14389 raft_consensus.cc:493] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:15.093786 14386 raft_consensus.cc:493] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:15.095294 14389 raft_consensus.cc:515] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:15.095297 14386 raft_consensus.cc:3060] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:15.098266 14381 raft_consensus.cc:359] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:15.098927 14380 tablet_bootstrap.cc:654] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:15.099134 14381 raft_consensus.cc:385] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:15.099538 14381 raft_consensus.cc:740] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Initialized, Role: FOLLOWER
I20260709 12:09:15.102412 14379 tablet_bootstrap.cc:654] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:15.103145 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:09:15.103972 14189 raft_consensus.cc:3060] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:15.105171 14389 leader_election.cc:290] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:15.094425 14431 raft_consensus.cc:515] T ec0fc0e91c904a0daeb3e29ee24a492d P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:15.106920 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:15.107309 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:15.107764 14264 raft_consensus.cc:2468] T 60aca7b73a544dfc9a4bd6918b27d132 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 0.
I20260709 12:09:15.108127 14339 raft_consensus.cc:2468] T bf9bea0d16e44efabb5cdd53e3828438 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 0.
I20260709 12:09:15.108691 14431 leader_election.cc:290] T ec0fc0e91c904a0daeb3e29ee24a492d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:15.109413 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:15.110507 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:15.110607 14304 leader_election.cc:304] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:09:15.110740 14386 raft_consensus.cc:515] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:15.115473 14381 consensus_queue.cc:260] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:15.122268 14436 leader_election.cc:290] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:15.122349 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:15.124320 14190 raft_consensus.cc:2468] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 0.
I20260709 12:09:15.125578 14381 ts_tablet_manager.cc:1434] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf: Time spent starting tablet: real 0.050s	user 0.009s	sys 0.001s
I20260709 12:09:15.118777 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:15.111320 14264 raft_consensus.cc:2468] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 0.
I20260709 12:09:15.129285 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:09:15.133183 14187 raft_consensus.cc:3060] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:15.131733 14389 raft_consensus.cc:2804] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:15.146345 14389 raft_consensus.cc:493] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:09:15.146637 14304 leader_election.cc:343] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:15.115302 14431 consensus_queue.cc:1048] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.034s
I20260709 12:09:15.150692 14381 tablet_bootstrap.cc:492] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf: Bootstrap starting.
I20260709 12:09:15.150722 14389 raft_consensus.cc:3060] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:15.152884 14304 leader_election.cc:304] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:09:15.153891 14303 leader_election.cc:304] T ec0fc0e91c904a0daeb3e29ee24a492d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:09:15.131603 14461 leader_election.cc:290] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:15.176817 14187 raft_consensus.cc:2468] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 1.
I20260709 12:09:15.184353 14431 raft_consensus.cc:2749] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:15.180727 14189 raft_consensus.cc:2468] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 1.
I20260709 12:09:15.189261 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:09:15.190547 14229 leader_election.cc:304] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:09:15.191742 14436 raft_consensus.cc:2804] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:15.192365 14436 raft_consensus.cc:697] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 1 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:09:15.185905 14434 raft_consensus.cc:2804] T ec0fc0e91c904a0daeb3e29ee24a492d P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:15.193656 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:09:15.193560 14436 consensus_queue.cc:237] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:15.194298 14434 raft_consensus.cc:493] T ec0fc0e91c904a0daeb3e29ee24a492d P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:15.194523 14335 raft_consensus.cc:3060] T bf9bea0d16e44efabb5cdd53e3828438 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:15.181783 14386 leader_election.cc:290] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:09:15.188621 14303 leader_election.cc:343] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:15.194854 14434 raft_consensus.cc:3060] T ec0fc0e91c904a0daeb3e29ee24a492d P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:15.206723 14229 leader_election.cc:304] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:09:15.208052 14386 raft_consensus.cc:2804] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:15.209523 14386 raft_consensus.cc:697] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 1 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:09:15.216007 14379 tablet_bootstrap.cc:492] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c: No bootstrap required, opened a new log
I20260709 12:09:15.216643 14379 ts_tablet_manager.cc:1403] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c: Time spent bootstrapping tablet: real 0.166s	user 0.024s	sys 0.024s
I20260709 12:09:15.220480 14434 raft_consensus.cc:515] T ec0fc0e91c904a0daeb3e29ee24a492d P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:15.221186 14379 raft_consensus.cc:359] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:09:15.223527 14230 leader_election.cc:343] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:15.232182 14189 raft_consensus.cc:3060] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:15.225622 14335 raft_consensus.cc:2468] T bf9bea0d16e44efabb5cdd53e3828438 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 1.
I20260709 12:09:15.234338 14379 raft_consensus.cc:385] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:15.235519 14379 raft_consensus.cc:740] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Initialized, Role: FOLLOWER
I20260709 12:09:15.233940 14449 raft_consensus.cc:493] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:15.213241 14386 consensus_queue.cc:237] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:15.239569 14461 consensus_queue.cc:1048] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:15.241166 14449 raft_consensus.cc:515] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:15.244125 14449 leader_election.cc:290] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:15.246119 14380 tablet_bootstrap.cc:492] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec: No bootstrap required, opened a new log
I20260709 12:09:15.246636 14380 ts_tablet_manager.cc:1403] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec: Time spent bootstrapping tablet: real 0.188s	user 0.024s	sys 0.040s
I20260709 12:09:15.247018 14379 consensus_queue.cc:260] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:15.246969 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:15.250655 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:15.258224 14379 ts_tablet_manager.cc:1434] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c: Time spent starting tablet: real 0.041s	user 0.004s	sys 0.004s
I20260709 12:09:15.257858 14406 consensus_queue.cc:1048] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:15.259397 14379 tablet_bootstrap.cc:492] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c: Bootstrap starting.
I20260709 12:09:15.261314 14389 raft_consensus.cc:515] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:15.278717 14380 raft_consensus.cc:359] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:15.280367 14380 raft_consensus.cc:385] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:15.280762 14380 raft_consensus.cc:740] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Initialized, Role: FOLLOWER
I20260709 12:09:15.302336 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:09:15.303316 14263 raft_consensus.cc:3060] T 60aca7b73a544dfc9a4bd6918b27d132 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:15.304533 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
W20260709 12:09:15.306685 14303 leader_election.cc:343] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:15.315636 14380 consensus_queue.cc:260] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:15.319766 14434 leader_election.cc:290] T ec0fc0e91c904a0daeb3e29ee24a492d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:09:15.323593 14155 leader_election.cc:343] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:15.310786 14389 leader_election.cc:290] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:15.330751 14086 catalog_manager.cc:5697] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: term changed from 0 to 1, leader changed from <none> to 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130). New cstate: current_term: 1 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:15.334259 14380 ts_tablet_manager.cc:1434] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec: Time spent starting tablet: real 0.087s	user 0.009s	sys 0.001s
I20260709 12:09:15.329017 14263 raft_consensus.cc:2468] T 60aca7b73a544dfc9a4bd6918b27d132 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 1.
I20260709 12:09:15.341575 14086 catalog_manager.cc:5697] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: term changed from 0 to 1, leader changed from <none> to 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130). New cstate: current_term: 1 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:15.344560 14380 tablet_bootstrap.cc:492] T 0d203245740a4821b7ebcc7669c8b2af P 17aab1bbf5014936aa18cc21818b26ec: Bootstrap starting.
W20260709 12:09:15.342070 14155 leader_election.cc:343] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:15.346256 14155 leader_election.cc:304] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:09:15.348899 14449 raft_consensus.cc:2749] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:15.354943 14381 tablet_bootstrap.cc:654] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:15.354772 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:09:15.355676 14188 raft_consensus.cc:3060] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:15.365667 14136 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:09:15.380309 14379 tablet_bootstrap.cc:654] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:15.382025 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:09:15.382738 14264 raft_consensus.cc:3060] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:15.391228 14304 leader_election.cc:304] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:09:15.393630 14389 raft_consensus.cc:2804] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:15.394438 14389 raft_consensus.cc:697] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:09:15.399135 14380 tablet_bootstrap.cc:654] T 0d203245740a4821b7ebcc7669c8b2af P 17aab1bbf5014936aa18cc21818b26ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:15.395884 14389 consensus_queue.cc:237] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:15.412601 14381 tablet_bootstrap.cc:492] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf: No bootstrap required, opened a new log
I20260709 12:09:15.413208 14381 ts_tablet_manager.cc:1403] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf: Time spent bootstrapping tablet: real 0.266s	user 0.024s	sys 0.007s
I20260709 12:09:15.433331 14188 raft_consensus.cc:2468] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 1.
I20260709 12:09:15.436292 14381 raft_consensus.cc:359] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:15.437086 14381 raft_consensus.cc:385] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:15.436894 14303 leader_election.cc:304] T ec0fc0e91c904a0daeb3e29ee24a492d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:09:15.437425 14381 raft_consensus.cc:740] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Initialized, Role: FOLLOWER
I20260709 12:09:15.438172 14389 raft_consensus.cc:2804] T ec0fc0e91c904a0daeb3e29ee24a492d P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:15.438316 14381 consensus_queue.cc:260] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:15.439122 14389 raft_consensus.cc:697] T ec0fc0e91c904a0daeb3e29ee24a492d P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:09:15.440833 14381 ts_tablet_manager.cc:1434] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf: Time spent starting tablet: real 0.027s	user 0.003s	sys 0.007s
I20260709 12:09:15.440374 14389 consensus_queue.cc:237] T ec0fc0e91c904a0daeb3e29ee24a492d P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:15.441934 14381 tablet_bootstrap.cc:492] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf: Bootstrap starting.
I20260709 12:09:15.430213 14264 raft_consensus.cc:2468] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 1.
I20260709 12:09:15.453879 14088 catalog_manager.cc:5697] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c reported cstate change: term changed from 0 to 1, leader changed from <none> to 65c9c1653b3346b39a0e118540e6080c (127.12.174.131). New cstate: current_term: 1 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:15.461526 14434 raft_consensus.cc:493] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:15.462399 14434 raft_consensus.cc:515] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:15.467414 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:15.468257 14188 raft_consensus.cc:2468] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 0.
I20260709 12:09:15.470146 14303 leader_election.cc:304] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:09:15.471122 14431 raft_consensus.cc:2804] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:15.471395 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:15.471657 14431 raft_consensus.cc:493] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:15.472172 14431 raft_consensus.cc:3060] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:15.473413 14304 leader_election.cc:343] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:15.474153 14434 leader_election.cc:290] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:15.480816 14431 raft_consensus.cc:515] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:15.488137 14380 tablet_bootstrap.cc:492] T 0d203245740a4821b7ebcc7669c8b2af P 17aab1bbf5014936aa18cc21818b26ec: No bootstrap required, opened a new log
I20260709 12:09:15.494264 14379 tablet_bootstrap.cc:492] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c: No bootstrap required, opened a new log
I20260709 12:09:15.496400 14380 ts_tablet_manager.cc:1403] T 0d203245740a4821b7ebcc7669c8b2af P 17aab1bbf5014936aa18cc21818b26ec: Time spent bootstrapping tablet: real 0.155s	user 0.017s	sys 0.020s
I20260709 12:09:15.496492 14379 ts_tablet_manager.cc:1403] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c: Time spent bootstrapping tablet: real 0.237s	user 0.021s	sys 0.031s
I20260709 12:09:15.499676 14380 raft_consensus.cc:359] T 0d203245740a4821b7ebcc7669c8b2af P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:15.500712 14380 raft_consensus.cc:385] T 0d203245740a4821b7ebcc7669c8b2af P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:15.501119 14380 raft_consensus.cc:740] T 0d203245740a4821b7ebcc7669c8b2af P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Initialized, Role: FOLLOWER
I20260709 12:09:15.501228 14381 tablet_bootstrap.cc:654] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:15.502140 14380 consensus_queue.cc:260] T 0d203245740a4821b7ebcc7669c8b2af P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:15.504640 14380 ts_tablet_manager.cc:1434] T 0d203245740a4821b7ebcc7669c8b2af P 17aab1bbf5014936aa18cc21818b26ec: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:09:15.500278 14379 raft_consensus.cc:359] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:15.505342 14379 raft_consensus.cc:385] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:15.505646 14379 raft_consensus.cc:740] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Initialized, Role: FOLLOWER
I20260709 12:09:15.506282 14380 tablet_bootstrap.cc:492] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec: Bootstrap starting.
I20260709 12:09:15.506470 14379 consensus_queue.cc:260] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:15.509264 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:09:15.509966 14188 raft_consensus.cc:3060] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:15.511067 14379 ts_tablet_manager.cc:1434] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:09:15.512218 14379 tablet_bootstrap.cc:492] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c: Bootstrap starting.
I20260709 12:09:15.510983 14431 leader_election.cc:290] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:15.518056 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
W20260709 12:09:15.520697 14304 leader_election.cc:343] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:15.527633 14379 tablet_bootstrap.cc:654] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:15.528360 14380 tablet_bootstrap.cc:654] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:15.528782 14088 catalog_manager.cc:5697] T ec0fc0e91c904a0daeb3e29ee24a492d P 65c9c1653b3346b39a0e118540e6080c reported cstate change: term changed from 0 to 1, leader changed from <none> to 65c9c1653b3346b39a0e118540e6080c (127.12.174.131). New cstate: current_term: 1 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:15.530642 14381 tablet_bootstrap.cc:492] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf: No bootstrap required, opened a new log
I20260709 12:09:15.531253 14381 ts_tablet_manager.cc:1403] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf: Time spent bootstrapping tablet: real 0.090s	user 0.012s	sys 0.006s
I20260709 12:09:15.532033 14188 raft_consensus.cc:2468] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 1.
I20260709 12:09:15.533875 14303 leader_election.cc:304] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:09:15.535104 14389 raft_consensus.cc:2804] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:15.535616 14389 raft_consensus.cc:697] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:09:15.536867 14389 consensus_queue.cc:237] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:15.539248 14381 raft_consensus.cc:359] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:15.540088 14381 raft_consensus.cc:385] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:15.540350 14381 raft_consensus.cc:740] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Initialized, Role: FOLLOWER
I20260709 12:09:15.546221 14381 consensus_queue.cc:260] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:15.556633 14381 ts_tablet_manager.cc:1434] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf: Time spent starting tablet: real 0.025s	user 0.002s	sys 0.009s
I20260709 12:09:15.558372 14381 tablet_bootstrap.cc:492] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf: Bootstrap starting.
I20260709 12:09:15.561926 14380 tablet_bootstrap.cc:492] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec: No bootstrap required, opened a new log
I20260709 12:09:15.562495 14380 ts_tablet_manager.cc:1403] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec: Time spent bootstrapping tablet: real 0.056s	user 0.014s	sys 0.020s
I20260709 12:09:15.564724 14088 catalog_manager.cc:5697] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c reported cstate change: term changed from 0 to 1, leader changed from <none> to 65c9c1653b3346b39a0e118540e6080c (127.12.174.131). New cstate: current_term: 1 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:15.568395 14381 tablet_bootstrap.cc:654] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:15.568264 14380 raft_consensus.cc:359] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:15.569028 14380 raft_consensus.cc:385] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:15.569330 14380 raft_consensus.cc:740] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Initialized, Role: FOLLOWER
I20260709 12:09:15.570075 14380 consensus_queue.cc:260] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:15.581108 14379 tablet_bootstrap.cc:492] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c: No bootstrap required, opened a new log
I20260709 12:09:15.581650 14379 ts_tablet_manager.cc:1403] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c: Time spent bootstrapping tablet: real 0.070s	user 0.013s	sys 0.017s
I20260709 12:09:15.590497 14380 ts_tablet_manager.cc:1434] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.000s
I20260709 12:09:15.590646 14379 raft_consensus.cc:359] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:15.591450 14379 raft_consensus.cc:385] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:15.591735 14379 raft_consensus.cc:740] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Initialized, Role: FOLLOWER
I20260709 12:09:15.593917 14379 consensus_queue.cc:260] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:15.600661 14380 tablet_bootstrap.cc:492] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec: Bootstrap starting.
I20260709 12:09:15.601362 14379 ts_tablet_manager.cc:1434] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.004s
I20260709 12:09:15.602602 14379 tablet_bootstrap.cc:492] T afce5304599246a580d798fc0c843964 P 65c9c1653b3346b39a0e118540e6080c: Bootstrap starting.
I20260709 12:09:15.607049 14338 raft_consensus.cc:3060] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:15.614634 14379 tablet_bootstrap.cc:654] T afce5304599246a580d798fc0c843964 P 65c9c1653b3346b39a0e118540e6080c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:15.632083 14491 consensus_queue.cc:1048] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:15.638561 14381 tablet_bootstrap.cc:492] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf: No bootstrap required, opened a new log
I20260709 12:09:15.638854 14386 consensus_queue.cc:1048] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:15.639593 14381 ts_tablet_manager.cc:1403] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf: Time spent bootstrapping tablet: real 0.081s	user 0.021s	sys 0.038s
I20260709 12:09:15.650611 14461 consensus_queue.cc:1048] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:15.668697 14381 raft_consensus.cc:359] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:15.669512 14381 raft_consensus.cc:385] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:15.669768 14381 raft_consensus.cc:740] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Initialized, Role: FOLLOWER
I20260709 12:09:15.670331 14381 consensus_queue.cc:260] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:15.672938 14449 raft_consensus.cc:493] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:15.673051 14381 ts_tablet_manager.cc:1434] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.000s
I20260709 12:09:15.674229 14381 tablet_bootstrap.cc:492] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf: Bootstrap starting.
I20260709 12:09:15.673462 14449 raft_consensus.cc:515] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:15.676069 14380 tablet_bootstrap.cc:654] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:15.682333 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:09:15.685174 14155 leader_election.cc:343] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:15.686736 14389 raft_consensus.cc:493] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:15.690407 14389 raft_consensus.cc:515] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:15.693665 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:15.694626 14338 raft_consensus.cc:2468] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 0.
I20260709 12:09:15.694985 14389 leader_election.cc:290] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:15.697851 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:15.687080 14449 leader_election.cc:290] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:15.699594 14155 leader_election.cc:304] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:09:15.701761 14386 raft_consensus.cc:493] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:15.702502 14386 raft_consensus.cc:515] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:15.704128 14491 raft_consensus.cc:493] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:15.705586 14491 raft_consensus.cc:515] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:15.711025 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:15.711431 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:15.713888 14379 tablet_bootstrap.cc:492] T afce5304599246a580d798fc0c843964 P 65c9c1653b3346b39a0e118540e6080c: No bootstrap required, opened a new log
I20260709 12:09:15.714433 14379 ts_tablet_manager.cc:1403] T afce5304599246a580d798fc0c843964 P 65c9c1653b3346b39a0e118540e6080c: Time spent bootstrapping tablet: real 0.112s	user 0.032s	sys 0.026s
W20260709 12:09:15.716821 14303 leader_election.cc:343] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:15.717090 14230 leader_election.cc:343] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:15.698766 14264 raft_consensus.cc:2468] T 0d203245740a4821b7ebcc7669c8b2af P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 0.
I20260709 12:09:15.704893 14449 raft_consensus.cc:2804] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:15.718221 14379 raft_consensus.cc:359] T afce5304599246a580d798fc0c843964 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:15.720399 14379 raft_consensus.cc:385] T afce5304599246a580d798fc0c843964 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:15.720724 14379 raft_consensus.cc:740] T afce5304599246a580d798fc0c843964 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Initialized, Role: FOLLOWER
I20260709 12:09:15.720048 14491 leader_election.cc:290] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:15.738516 14304 leader_election.cc:304] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:09:15.739279 14386 leader_election.cc:290] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:15.720319 14449 raft_consensus.cc:493] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:15.735117 14379 consensus_queue.cc:260] T afce5304599246a580d798fc0c843964 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:15.740319 14449 raft_consensus.cc:3060] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:15.740346 14389 raft_consensus.cc:2804] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:15.741118 14389 raft_consensus.cc:493] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:15.741631 14389 raft_consensus.cc:3060] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:15.746253 14379 ts_tablet_manager.cc:1434] T afce5304599246a580d798fc0c843964 P 65c9c1653b3346b39a0e118540e6080c: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.002s
I20260709 12:09:15.717705 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:15.748001 14379 tablet_bootstrap.cc:492] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c: Bootstrap starting.
W20260709 12:09:15.748903 14229 leader_election.cc:343] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:15.749228 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:15.749572 14229 leader_election.cc:304] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:09:15.750659 14190 raft_consensus.cc:2468] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 0.
I20260709 12:09:15.752718 14386 raft_consensus.cc:2749] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:15.758800 14229 leader_election.cc:304] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:09:15.760128 14461 raft_consensus.cc:2804] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:15.760664 14461 raft_consensus.cc:493] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:15.761226 14461 raft_consensus.cc:3060] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:15.767254 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:15.768185 14335 raft_consensus.cc:2468] T afce5304599246a580d798fc0c843964 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 0.
I20260709 12:09:15.770048 14456 raft_consensus.cc:493] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:15.770790 14456 raft_consensus.cc:515] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:15.773077 14381 tablet_bootstrap.cc:654] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:15.775408 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:09:15.778489 14155 leader_election.cc:343] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:15.779095 14456 leader_election.cc:290] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:15.793080 14491 consensus_queue.cc:1048] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:15.792474 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:15.796974 14380 tablet_bootstrap.cc:492] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec: No bootstrap required, opened a new log
W20260709 12:09:15.797257 14155 leader_election.cc:343] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:15.797533 14380 ts_tablet_manager.cc:1403] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec: Time spent bootstrapping tablet: real 0.197s	user 0.012s	sys 0.038s
I20260709 12:09:15.797933 14155 leader_election.cc:304] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:09:15.799708 14456 raft_consensus.cc:2749] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:15.801581 14380 raft_consensus.cc:359] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:15.802345 14380 raft_consensus.cc:385] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:15.802606 14380 raft_consensus.cc:740] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Initialized, Role: FOLLOWER
I20260709 12:09:15.803285 14380 consensus_queue.cc:260] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:15.809950 14516 raft_consensus.cc:493] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:15.810658 14516 raft_consensus.cc:515] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:15.813020 14436 raft_consensus.cc:493] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:15.813798 14436 raft_consensus.cc:515] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:15.816478 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:09:15.818513 14155 leader_election.cc:343] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:15.801594 14449 raft_consensus.cc:515] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:15.826960 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:15.827080 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:09:15.828406 14264 raft_consensus.cc:3060] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:15.829101 14389 raft_consensus.cc:515] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:15.831720 14379 tablet_bootstrap.cc:654] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:15.832834 14436 leader_election.cc:290] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:15.834481 14187 raft_consensus.cc:2393] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 1: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:09:15.834744 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:15.834872 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:09:15.835675 14339 raft_consensus.cc:2468] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 0.
I20260709 12:09:15.837694 14380 ts_tablet_manager.cc:1434] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec: Time spent starting tablet: real 0.040s	user 0.003s	sys 0.003s
I20260709 12:09:15.838186 14230 leader_election.cc:304] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:09:15.838441 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:09:15.839236 14263 raft_consensus.cc:3060] T 0d203245740a4821b7ebcc7669c8b2af P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:15.839326 14380 tablet_bootstrap.cc:492] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec: Bootstrap starting.
I20260709 12:09:15.835866 14389 leader_election.cc:290] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:09:15.849118 14303 leader_election.cc:343] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:15.852020 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:09:15.852721 14339 raft_consensus.cc:3060] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:15.861050 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:09:15.862679 14155 leader_election.cc:343] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:15.863229 14155 leader_election.cc:304] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:09:15.864116 14456 raft_consensus.cc:2749] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:15.849172 14449 leader_election.cc:290] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:15.866991 14461 raft_consensus.cc:515] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:15.870589 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:09:15.858552 14516 leader_election.cc:290] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:15.871326 14190 raft_consensus.cc:3060] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:15.875735 14263 raft_consensus.cc:2468] T 0d203245740a4821b7ebcc7669c8b2af P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 1.
I20260709 12:09:15.881768 14304 leader_election.cc:304] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:09:15.883997 14389 raft_consensus.cc:2804] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:15.884748 14389 raft_consensus.cc:697] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:09:15.880028 14339 raft_consensus.cc:2468] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 1.
I20260709 12:09:15.886090 14389 consensus_queue.cc:237] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:15.883049 14264 raft_consensus.cc:2468] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 1.
I20260709 12:09:15.887401 14155 leader_election.cc:304] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:09:15.890656 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:09:15.891497 14335 raft_consensus.cc:3060] T afce5304599246a580d798fc0c843964 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:15.890007 14461 leader_election.cc:290] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:15.897004 14436 raft_consensus.cc:2764] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 12:09:15.903088 14190 raft_consensus.cc:2468] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 1.
I20260709 12:09:15.905328 14449 raft_consensus.cc:2804] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:15.906177 14449 raft_consensus.cc:697] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 1 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
W20260709 12:09:15.907017 14303 consensus_peers.cc:597] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:15.908321 14229 leader_election.cc:304] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:09:15.910524 14436 raft_consensus.cc:2804] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:15.910754 14380 tablet_bootstrap.cc:654] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:15.912146 14436 raft_consensus.cc:697] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 1 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:09:15.913578 14379 tablet_bootstrap.cc:492] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c: No bootstrap required, opened a new log
I20260709 12:09:15.914260 14379 ts_tablet_manager.cc:1403] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c: Time spent bootstrapping tablet: real 0.167s	user 0.023s	sys 0.011s
I20260709 12:09:15.914652 14436 consensus_queue.cc:237] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:15.918423 14431 consensus_queue.cc:1048] T ec0fc0e91c904a0daeb3e29ee24a492d P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:15.920457 14381 tablet_bootstrap.cc:492] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf: No bootstrap required, opened a new log
I20260709 12:09:15.912873 14449 consensus_queue.cc:237] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:15.921049 14381 ts_tablet_manager.cc:1403] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf: Time spent bootstrapping tablet: real 0.247s	user 0.011s	sys 0.010s
I20260709 12:09:15.921859 14379 raft_consensus.cc:359] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:15.922580 14379 raft_consensus.cc:385] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:15.922884 14379 raft_consensus.cc:740] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Initialized, Role: FOLLOWER
I20260709 12:09:15.923606 14379 consensus_queue.cc:260] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:15.924496 14335 raft_consensus.cc:2468] T afce5304599246a580d798fc0c843964 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 1.
I20260709 12:09:15.933101 14381 raft_consensus.cc:359] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:15.936492 14381 raft_consensus.cc:385] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:15.937013 14381 raft_consensus.cc:740] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Initialized, Role: FOLLOWER
I20260709 12:09:15.940161 14379 ts_tablet_manager.cc:1434] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.003s
I20260709 12:09:15.941349 14379 tablet_bootstrap.cc:492] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c: Bootstrap starting.
I20260709 12:09:15.944983 14381 consensus_queue.cc:260] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:15.953101 14381 ts_tablet_manager.cc:1434] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.003s
I20260709 12:09:15.954329 14381 tablet_bootstrap.cc:492] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf: Bootstrap starting.
I20260709 12:09:15.958580 14086 catalog_manager.cc:5697] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c reported cstate change: term changed from 0 to 1, leader changed from <none> to 65c9c1653b3346b39a0e118540e6080c (127.12.174.131). New cstate: current_term: 1 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:15.960047 14087 catalog_manager.cc:5697] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: term changed from 0 to 1, leader changed from <none> to 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130). New cstate: current_term: 1 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:15.966384 14456 raft_consensus.cc:493] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:15.967150 14456 raft_consensus.cc:515] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:15.969226 14379 tablet_bootstrap.cc:654] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:15.973201 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:15.974449 14264 raft_consensus.cc:2393] T 60aca7b73a544dfc9a4bd6918b27d132 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 1: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:09:15.973240 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:15.978550 14155 leader_election.cc:304] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:09:15.980728 14516 raft_consensus.cc:3060] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:15.970484 14456 leader_election.cc:290] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:16.011973 14516 raft_consensus.cc:2749] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:16.012626 14389 consensus_queue.cc:1048] T ec0fc0e91c904a0daeb3e29ee24a492d P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:16.006901 14086 catalog_manager.cc:5697] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf reported cstate change: term changed from 0 to 1, leader changed from <none> to 885067a0d31741bfb5c9935788e315bf (127.12.174.129). New cstate: current_term: 1 leader_uuid: "885067a0d31741bfb5c9935788e315bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:16.016812 14389 consensus_queue.cc:1048] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:16.022078 14381 tablet_bootstrap.cc:654] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:16.023087 14380 tablet_bootstrap.cc:492] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec: No bootstrap required, opened a new log
I20260709 12:09:16.023648 14380 ts_tablet_manager.cc:1403] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec: Time spent bootstrapping tablet: real 0.185s	user 0.028s	sys 0.057s
I20260709 12:09:16.028383 14380 raft_consensus.cc:359] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:16.029222 14380 raft_consensus.cc:385] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:16.029611 14380 raft_consensus.cc:740] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Initialized, Role: FOLLOWER
I20260709 12:09:16.032922 14380 consensus_queue.cc:260] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:16.037918 14380 ts_tablet_manager.cc:1434] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec: Time spent starting tablet: real 0.014s	user 0.010s	sys 0.000s
I20260709 12:09:16.039885 14380 tablet_bootstrap.cc:492] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec: Bootstrap starting.
I20260709 12:09:16.055665 14380 tablet_bootstrap.cc:654] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:16.067035 14431 consensus_queue.cc:1048] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:16.070392 14265 raft_consensus.cc:3060] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:16.084728 14379 tablet_bootstrap.cc:492] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c: No bootstrap required, opened a new log
I20260709 12:09:16.085295 14379 ts_tablet_manager.cc:1403] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c: Time spent bootstrapping tablet: real 0.144s	user 0.006s	sys 0.019s
I20260709 12:09:16.089311 14379 raft_consensus.cc:359] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:16.090090 14379 raft_consensus.cc:385] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:16.090402 14379 raft_consensus.cc:740] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Initialized, Role: FOLLOWER
I20260709 12:09:16.091058 14379 consensus_queue.cc:260] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:16.091987 14434 consensus_queue.cc:1048] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:16.093279 14379 ts_tablet_manager.cc:1434] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.003s
I20260709 12:09:16.101375 14379 tablet_bootstrap.cc:492] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c: Bootstrap starting.
I20260709 12:09:16.106709 14380 tablet_bootstrap.cc:492] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec: No bootstrap required, opened a new log
I20260709 12:09:16.107529 14380 ts_tablet_manager.cc:1403] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec: Time spent bootstrapping tablet: real 0.068s	user 0.021s	sys 0.005s
I20260709 12:09:16.133667 14379 tablet_bootstrap.cc:654] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:16.153609 14381 tablet_bootstrap.cc:492] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf: No bootstrap required, opened a new log
I20260709 12:09:16.156107 14381 ts_tablet_manager.cc:1403] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf: Time spent bootstrapping tablet: real 0.202s	user 0.037s	sys 0.016s
I20260709 12:09:16.160410 14381 raft_consensus.cc:359] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:16.161199 14381 raft_consensus.cc:385] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:16.161518 14381 raft_consensus.cc:740] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Initialized, Role: FOLLOWER
I20260709 12:09:16.140731 14380 raft_consensus.cc:359] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:16.162109 14380 raft_consensus.cc:385] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:16.162444 14380 raft_consensus.cc:740] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Initialized, Role: FOLLOWER
I20260709 12:09:16.163264 14380 consensus_queue.cc:260] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:16.164501 14381 consensus_queue.cc:260] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:16.166280 14380 ts_tablet_manager.cc:1434] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec: Time spent starting tablet: real 0.058s	user 0.008s	sys 0.000s
I20260709 12:09:16.167106 14381 ts_tablet_manager.cc:1434] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 12:09:16.167421 14380 tablet_bootstrap.cc:492] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec: Bootstrap starting.
I20260709 12:09:16.168586 14381 tablet_bootstrap.cc:492] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf: Bootstrap starting.
I20260709 12:09:16.179137 14381 tablet_bootstrap.cc:654] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:16.182150 14436 raft_consensus.cc:493] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:16.183012 14436 raft_consensus.cc:515] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:16.188730 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:09:16.191468 14230 leader_election.cc:343] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:16.194070 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:09:16.196487 14229 leader_election.cc:343] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:16.197381 14229 leader_election.cc:304] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:09:16.197899 14436 leader_election.cc:290] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:16.198781 14461 raft_consensus.cc:2749] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:16.202695 14516 raft_consensus.cc:493] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:16.203244 14516 raft_consensus.cc:515] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:16.205505 14516 leader_election.cc:290] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:16.209646 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:16.212116 14381 tablet_bootstrap.cc:492] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf: No bootstrap required, opened a new log
I20260709 12:09:16.212579 14381 ts_tablet_manager.cc:1403] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf: Time spent bootstrapping tablet: real 0.044s	user 0.017s	sys 0.005s
I20260709 12:09:16.213330 14379 tablet_bootstrap.cc:492] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c: No bootstrap required, opened a new log
I20260709 12:09:16.216279 14379 ts_tablet_manager.cc:1403] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c: Time spent bootstrapping tablet: real 0.115s	user 0.039s	sys 0.042s
I20260709 12:09:16.216159 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:16.217751 14262 raft_consensus.cc:2393] T 0d203245740a4821b7ebcc7669c8b2af P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 1: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:09:16.219296 14381 raft_consensus.cc:359] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:16.219547 14155 leader_election.cc:304] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:09:16.220091 14381 raft_consensus.cc:385] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:16.220408 14381 raft_consensus.cc:740] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Initialized, Role: FOLLOWER
I20260709 12:09:16.221345 14516 raft_consensus.cc:3060] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:16.221149 14381 consensus_queue.cc:260] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:16.220916 14379 raft_consensus.cc:359] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:16.222141 14379 raft_consensus.cc:385] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:16.222491 14379 raft_consensus.cc:740] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Initialized, Role: FOLLOWER
I20260709 12:09:16.223346 14379 consensus_queue.cc:260] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:16.225286 14379 ts_tablet_manager.cc:1434] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 12:09:16.232462 14379 tablet_bootstrap.cc:492] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c: Bootstrap starting.
I20260709 12:09:16.233187 14381 ts_tablet_manager.cc:1434] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.000s
I20260709 12:09:16.240162 14381 tablet_bootstrap.cc:492] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf: Bootstrap starting.
I20260709 12:09:16.247789 14380 tablet_bootstrap.cc:654] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:16.248354 14516 raft_consensus.cc:2749] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:16.254683 14379 tablet_bootstrap.cc:654] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:16.258380 14380 tablet_bootstrap.cc:492] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec: No bootstrap required, opened a new log
I20260709 12:09:16.258955 14380 ts_tablet_manager.cc:1403] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec: Time spent bootstrapping tablet: real 0.092s	user 0.008s	sys 0.010s
I20260709 12:09:16.260946 14381 tablet_bootstrap.cc:654] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:16.262492 14379 tablet_bootstrap.cc:492] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c: No bootstrap required, opened a new log
I20260709 12:09:16.263025 14379 ts_tablet_manager.cc:1403] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c: Time spent bootstrapping tablet: real 0.031s	user 0.016s	sys 0.003s
I20260709 12:09:16.262691 14380 raft_consensus.cc:359] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:16.263368 14380 raft_consensus.cc:385] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:16.263659 14380 raft_consensus.cc:740] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Initialized, Role: FOLLOWER
I20260709 12:09:16.264470 14380 consensus_queue.cc:260] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:16.269588 14379 raft_consensus.cc:359] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:16.270392 14379 raft_consensus.cc:385] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:16.270668 14379 raft_consensus.cc:740] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Initialized, Role: FOLLOWER
I20260709 12:09:16.270716 14381 tablet_bootstrap.cc:492] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf: No bootstrap required, opened a new log
I20260709 12:09:16.271659 14379 consensus_queue.cc:260] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:16.273156 14381 ts_tablet_manager.cc:1403] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf: Time spent bootstrapping tablet: real 0.033s	user 0.010s	sys 0.008s
I20260709 12:09:16.272168 14380 ts_tablet_manager.cc:1434] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.002s
I20260709 12:09:16.274292 14380 tablet_bootstrap.cc:492] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec: Bootstrap starting.
I20260709 12:09:16.275030 14379 ts_tablet_manager.cc:1434] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.003s
I20260709 12:09:16.278489 14379 tablet_bootstrap.cc:492] T f52421be255e4fab824173d17981b5bb P 65c9c1653b3346b39a0e118540e6080c: Bootstrap starting.
I20260709 12:09:16.278252 14381 raft_consensus.cc:359] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:16.279129 14381 raft_consensus.cc:385] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:16.279433 14381 raft_consensus.cc:740] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Initialized, Role: FOLLOWER
I20260709 12:09:16.280143 14381 consensus_queue.cc:260] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:16.282611 14381 ts_tablet_manager.cc:1434] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:09:16.283756 14381 tablet_bootstrap.cc:492] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf: Bootstrap starting.
I20260709 12:09:16.292266 14379 tablet_bootstrap.cc:654] T f52421be255e4fab824173d17981b5bb P 65c9c1653b3346b39a0e118540e6080c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:16.293983 14381 tablet_bootstrap.cc:654] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:16.304498 14379 tablet_bootstrap.cc:492] T f52421be255e4fab824173d17981b5bb P 65c9c1653b3346b39a0e118540e6080c: No bootstrap required, opened a new log
I20260709 12:09:16.305123 14379 ts_tablet_manager.cc:1403] T f52421be255e4fab824173d17981b5bb P 65c9c1653b3346b39a0e118540e6080c: Time spent bootstrapping tablet: real 0.027s	user 0.006s	sys 0.014s
I20260709 12:09:16.309197 14380 tablet_bootstrap.cc:654] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:16.309202 14379 raft_consensus.cc:359] T f52421be255e4fab824173d17981b5bb P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:16.310073 14379 raft_consensus.cc:385] T f52421be255e4fab824173d17981b5bb P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:16.310392 14379 raft_consensus.cc:740] T f52421be255e4fab824173d17981b5bb P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Initialized, Role: FOLLOWER
I20260709 12:09:16.311919 14379 consensus_queue.cc:260] T f52421be255e4fab824173d17981b5bb P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:16.314462 14379 ts_tablet_manager.cc:1434] T f52421be255e4fab824173d17981b5bb P 65c9c1653b3346b39a0e118540e6080c: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.004s
I20260709 12:09:16.316061 14379 tablet_bootstrap.cc:492] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c: Bootstrap starting.
I20260709 12:09:16.324710 14434 raft_consensus.cc:493] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:16.325461 14434 raft_consensus.cc:515] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:16.325348 14379 tablet_bootstrap.cc:654] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:16.328320 14516 consensus_queue.cc:1048] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:16.331051 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:16.332230 14262 raft_consensus.cc:2468] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 0.
I20260709 12:09:16.331809 14434 leader_election.cc:290] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:16.334097 14304 leader_election.cc:304] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:09:16.334648 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:16.335291 14434 raft_consensus.cc:2804] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:16.335788 14434 raft_consensus.cc:493] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:16.336247 14434 raft_consensus.cc:3060] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:16.337018 14303 leader_election.cc:343] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:16.343758 14516 raft_consensus.cc:493] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:16.344506 14516 raft_consensus.cc:515] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:16.349892 14380 tablet_bootstrap.cc:492] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec: No bootstrap required, opened a new log
I20260709 12:09:16.350675 14380 ts_tablet_manager.cc:1403] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec: Time spent bootstrapping tablet: real 0.077s	user 0.011s	sys 0.010s
I20260709 12:09:16.351390 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:16.352972 14263 raft_consensus.cc:2468] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 0.
I20260709 12:09:16.354969 14516 leader_election.cc:290] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:16.360730 14389 raft_consensus.cc:493] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:16.361513 14389 raft_consensus.cc:515] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:16.364403 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:16.364905 14389 leader_election.cc:290] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:16.353245 14436 consensus_queue.cc:1048] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:16.365351 14335 raft_consensus.cc:2468] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 0.
I20260709 12:09:16.371265 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:16.372229 14263 raft_consensus.cc:2468] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 0.
I20260709 12:09:16.381611 14155 leader_election.cc:304] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:09:16.382768 14516 raft_consensus.cc:2804] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:16.383562 14516 raft_consensus.cc:493] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:16.384268 14516 raft_consensus.cc:3060] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:16.384884 14436 consensus_queue.cc:1048] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:16.386400 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:16.412868 14525 raft_consensus.cc:493] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:16.408143 14431 consensus_queue.cc:1048] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.024s
I20260709 12:09:16.430620 14304 leader_election.cc:304] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:09:16.453938 14380 raft_consensus.cc:359] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:16.454746 14380 raft_consensus.cc:385] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:16.455041 14380 raft_consensus.cc:740] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Initialized, Role: FOLLOWER
I20260709 12:09:16.441936 14525 raft_consensus.cc:515] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:16.455727 14380 consensus_queue.cc:260] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:16.448213 14431 raft_consensus.cc:493] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:09:16.452805 14136 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:09:16.461378 14525 leader_election.cc:290] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:16.465071 14380 ts_tablet_manager.cc:1434] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec: Time spent starting tablet: real 0.114s	user 0.023s	sys 0.018s
I20260709 12:09:16.470918 14380 tablet_bootstrap.cc:492] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec: Bootstrap starting.
I20260709 12:09:16.479254 14379 tablet_bootstrap.cc:492] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c: No bootstrap required, opened a new log
I20260709 12:09:16.479977 14379 ts_tablet_manager.cc:1403] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c: Time spent bootstrapping tablet: real 0.164s	user 0.012s	sys 0.016s
I20260709 12:09:16.488855 14543 raft_consensus.cc:493] T f52421be255e4fab824173d17981b5bb P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:16.488097 14516 raft_consensus.cc:515] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:16.471997 14389 raft_consensus.cc:2804] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:16.494155 14379 raft_consensus.cc:359] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:16.495229 14379 raft_consensus.cc:385] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:16.495544 14379 raft_consensus.cc:740] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Initialized, Role: FOLLOWER
I20260709 12:09:16.479610 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:16.465222 14431 raft_consensus.cc:515] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:16.500988 14436 raft_consensus.cc:493] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:16.501788 14436 raft_consensus.cc:515] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:16.501219 14190 raft_consensus.cc:2393] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 1: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:09:16.506834 14525 consensus_queue.cc:1048] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:16.507220 14436 leader_election.cc:290] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:16.509948 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:16.490360 14543 raft_consensus.cc:515] T f52421be255e4fab824173d17981b5bb P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:16.512850 14338 raft_consensus.cc:2468] T f52421be255e4fab824173d17981b5bb P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 0.
I20260709 12:09:16.497385 14389 raft_consensus.cc:493] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:16.561477 14516 leader_election.cc:290] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:09:16.565542 14155 leader_election.cc:343] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:16.570873 14230 leader_election.cc:304] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:09:16.574461 14406 raft_consensus.cc:2804] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:16.574939 14406 raft_consensus.cc:493] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:16.575451 14406 raft_consensus.cc:3060] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:16.620632 14406 raft_consensus.cc:515] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:16.577101 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:09:16.633718 14264 raft_consensus.cc:3060] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:16.634271 14406 leader_election.cc:290] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:16.534276 14389 raft_consensus.cc:3060] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:16.597055 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:16.636698 14262 raft_consensus.cc:2468] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 0.
I20260709 12:09:16.619555 14544 raft_consensus.cc:493] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:16.638264 14544 raft_consensus.cc:515] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:16.620312 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:16.640568 14190 raft_consensus.cc:2468] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 0.
I20260709 12:09:16.641820 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:09:16.642517 14187 raft_consensus.cc:3060] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:16.642589 14264 raft_consensus.cc:2468] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 1.
I20260709 12:09:16.644402 14155 leader_election.cc:304] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:09:16.645330 14456 raft_consensus.cc:2804] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:16.645929 14456 raft_consensus.cc:697] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 1 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:09:16.631623 14379 consensus_queue.cc:260] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:16.646898 14456 consensus_queue.cc:237] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:16.648088 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:16.648368 14379 ts_tablet_manager.cc:1434] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c: Time spent starting tablet: real 0.168s	user 0.018s	sys 0.021s
I20260709 12:09:16.576802 14431 leader_election.cc:290] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:16.654850 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
W20260709 12:09:16.654958 14155 leader_election.cc:343] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:16.655821 14155 leader_election.cc:304] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:09:16.646713 14544 leader_election.cc:290] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:16.657130 14381 tablet_bootstrap.cc:492] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf: No bootstrap required, opened a new log
I20260709 12:09:16.657685 14381 ts_tablet_manager.cc:1403] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf: Time spent bootstrapping tablet: real 0.374s	user 0.028s	sys 0.044s
I20260709 12:09:16.658818 14379 tablet_bootstrap.cc:492] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c: Bootstrap starting.
I20260709 12:09:16.670871 14381 raft_consensus.cc:359] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:16.671824 14381 raft_consensus.cc:385] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:16.672219 14381 raft_consensus.cc:740] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Initialized, Role: FOLLOWER
I20260709 12:09:16.673046 14381 consensus_queue.cc:260] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:16.670745 14449 raft_consensus.cc:2749] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:16.696802 14381 ts_tablet_manager.cc:1434] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf: Time spent starting tablet: real 0.039s	user 0.007s	sys 0.000s
I20260709 12:09:16.697659 14381 tablet_bootstrap.cc:492] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf: Bootstrap starting.
I20260709 12:09:16.697847 14379 tablet_bootstrap.cc:654] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:16.696400 14304 leader_election.cc:304] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:09:16.699731 14543 leader_election.cc:290] T f52421be255e4fab824173d17981b5bb P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:16.700361 14543 raft_consensus.cc:2804] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:16.700702 14543 raft_consensus.cc:493] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:16.701092 14543 raft_consensus.cc:3060] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:16.699120 14434 raft_consensus.cc:515] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:16.705782 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:16.706243 14434 leader_election.cc:290] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:16.708628 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:16.711231 14185 raft_consensus.cc:2468] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 0.
I20260709 12:09:16.707044 14525 raft_consensus.cc:493] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:16.696252 14551 consensus_queue.cc:1048] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.017s
I20260709 12:09:16.738533 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:09:16.740535 14335 raft_consensus.cc:3060] T f52421be255e4fab824173d17981b5bb P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:16.711838 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:16.831810 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:09:16.833170 14086 catalog_manager.cc:5697] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf reported cstate change: term changed from 0 to 1, leader changed from <none> to 885067a0d31741bfb5c9935788e315bf (127.12.174.129). New cstate: current_term: 1 leader_uuid: "885067a0d31741bfb5c9935788e315bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:16.842507 14187 raft_consensus.cc:2468] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 1.
I20260709 12:09:16.847981 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:16.849273 14264 raft_consensus.cc:2393] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 1: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:09:16.850895 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:16.853525 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:09:16.854806 14262 raft_consensus.cc:3060] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:16.855178 14303 leader_election.cc:304] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:09:16.721962 14525 raft_consensus.cc:515] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:16.863636 14434 raft_consensus.cc:2804] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:09:16.857372 14303 leader_election.cc:343] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:16.877709 14229 leader_election.cc:304] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:09:16.867376 14434 raft_consensus.cc:493] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:16.885438 14434 raft_consensus.cc:3060] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:16.904894 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 47761us
W20260709 12:09:16.906823 14303 leader_election.cc:343] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:16.908576 14381 tablet_bootstrap.cc:654] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:16.909332 14380 tablet_bootstrap.cc:654] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:16.896329 14525 leader_election.cc:290] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:09:16.917964 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 55253.9us
I20260709 12:09:16.931079 14557 raft_consensus.cc:2804] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:16.932641 14557 raft_consensus.cc:697] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 1 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:09:16.934322 14557 consensus_queue.cc:237] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:16.941491 14389 raft_consensus.cc:515] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:16.943279 14339 raft_consensus.cc:2393] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 1: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:09:16.945312 14389 leader_election.cc:290] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:16.947579 14335 raft_consensus.cc:2468] T f52421be255e4fab824173d17981b5bb P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 1.
I20260709 12:09:16.947788 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:09:16.960829 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:16.961280 14389 raft_consensus.cc:493] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:16.962080 14389 raft_consensus.cc:515] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:16.963352 14434 raft_consensus.cc:515] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:16.963733 14339 raft_consensus.cc:2468] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 0.
I20260709 12:09:16.965654 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:16.966440 14188 raft_consensus.cc:2468] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 0.
I20260709 12:09:16.967896 14303 leader_election.cc:304] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:09:16.960271 14262 raft_consensus.cc:2468] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 1.
I20260709 12:09:16.975479 14543 raft_consensus.cc:515] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:16.977990 14549 raft_consensus.cc:2804] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:16.980834 14155 leader_election.cc:304] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:09:16.981278 14549 raft_consensus.cc:493] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:16.981787 14549 raft_consensus.cc:3060] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:16.978610 14434 leader_election.cc:290] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:16.982697 14449 raft_consensus.cc:2804] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:16.983163 14449 raft_consensus.cc:493] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:16.983503 14449 raft_consensus.cc:3060] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:16.985615 14304 leader_election.cc:304] T f52421be255e4fab824173d17981b5bb P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:09:16.982720 14379 tablet_bootstrap.cc:492] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c: No bootstrap required, opened a new log
I20260709 12:09:16.989907 14379 ts_tablet_manager.cc:1403] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c: Time spent bootstrapping tablet: real 0.331s	user 0.031s	sys 0.031s
I20260709 12:09:16.990296 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:09:16.995412 14379 raft_consensus.cc:359] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:16.996205 14379 raft_consensus.cc:385] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:16.996455 14379 raft_consensus.cc:740] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Initialized, Role: FOLLOWER
I20260709 12:09:16.997103 14379 consensus_queue.cc:260] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:16.995623 14187 raft_consensus.cc:3060] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:16.999466 14389 leader_election.cc:290] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:17.001422 14543 leader_election.cc:290] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:17.011991 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
W20260709 12:09:17.012450 14304 leader_election.cc:343] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:17.014091 14303 leader_election.cc:343] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.015443 14380 tablet_bootstrap.cc:492] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec: No bootstrap required, opened a new log
I20260709 12:09:17.017030 14380 ts_tablet_manager.cc:1403] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec: Time spent bootstrapping tablet: real 0.546s	user 0.021s	sys 0.038s
I20260709 12:09:16.999047 14434 raft_consensus.cc:2749] T f52421be255e4fab824173d17981b5bb P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:17.021046 14380 raft_consensus.cc:359] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:17.017872 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:09:17.022223 14187 raft_consensus.cc:2468] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 1.
I20260709 12:09:17.022716 14263 raft_consensus.cc:2393] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 1: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:09:17.023464 14381 tablet_bootstrap.cc:492] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf: No bootstrap required, opened a new log
I20260709 12:09:17.023514 14380 raft_consensus.cc:385] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.023902 14380 raft_consensus.cc:740] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.024369 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:09:17.025267 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:09:17.025379 14380 consensus_queue.cc:260] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:17.026055 14265 raft_consensus.cc:3060] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:17.026356 14263 raft_consensus.cc:3060] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:17.027072 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:17.027096 14304 leader_election.cc:304] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:09:17.029351 14434 raft_consensus.cc:2804] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:17.030254 14304 leader_election.cc:304] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:09:17.031256 14551 raft_consensus.cc:2749] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:09:17.025223 14303 leader_election.cc:304] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
W20260709 12:09:17.032692 14304 leader_election.cc:343] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.034934 14381 ts_tablet_manager.cc:1403] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf: Time spent bootstrapping tablet: real 0.337s	user 0.048s	sys 0.024s
I20260709 12:09:17.036947 14544 raft_consensus.cc:2804] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:17.042613 14544 raft_consensus.cc:697] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:09:17.042865 14449 raft_consensus.cc:515] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:17.043830 14544 consensus_queue.cc:237] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:17.047524 14263 raft_consensus.cc:2468] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 1.
I20260709 12:09:17.047993 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:09:17.048229 14549 raft_consensus.cc:515] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:17.050122 14335 raft_consensus.cc:2393] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 1: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:09:17.052572 14381 raft_consensus.cc:359] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:17.053368 14381 raft_consensus.cc:385] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.053656 14381 raft_consensus.cc:740] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.057698 14381 consensus_queue.cc:260] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:17.059631 14381 ts_tablet_manager.cc:1434] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf: Time spent starting tablet: real 0.024s	user 0.003s	sys 0.003s
I20260709 12:09:17.060949 14380 ts_tablet_manager.cc:1434] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec: Time spent starting tablet: real 0.044s	user 0.005s	sys 0.005s
I20260709 12:09:17.063781 14380 tablet_bootstrap.cc:492] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec: Bootstrap starting.
I20260709 12:09:17.061132 14381 tablet_bootstrap.cc:492] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf: Bootstrap starting.
I20260709 12:09:17.036650 14434 raft_consensus.cc:697] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:09:17.045512 14449 leader_election.cc:290] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:17.062184 14379 ts_tablet_manager.cc:1434] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c: Time spent starting tablet: real 0.072s	user 0.009s	sys 0.000s
I20260709 12:09:17.065610 14379 tablet_bootstrap.cc:492] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c: Bootstrap starting.
I20260709 12:09:17.066545 14434 consensus_queue.cc:237] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:17.067435 14265 raft_consensus.cc:2468] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 1.
I20260709 12:09:17.070818 14304 leader_election.cc:304] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:09:17.071457 14549 leader_election.cc:290] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:17.072175 14549 raft_consensus.cc:2804] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:17.072454 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:09:17.103453 14379 tablet_bootstrap.cc:654] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.122928 14087 catalog_manager.cc:5697] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: term changed from 0 to 1, leader changed from <none> to 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130). New cstate: current_term: 1 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:17.091332 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:09:17.140163 14187 raft_consensus.cc:2393] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 1: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:09:17.072710 14549 raft_consensus.cc:697] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
W20260709 12:09:17.138486 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 67777.1us
I20260709 12:09:17.142226 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:17.159117 14380 tablet_bootstrap.cc:654] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec: Neither blocks nor log segments found. Creating new log.
W20260709 12:09:17.153808 14155 leader_election.cc:343] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.165016 14155 leader_election.cc:304] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:09:17.165902 14449 raft_consensus.cc:2749] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 12:09:17.166833 14155 leader_election.cc:343] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.162281 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
W20260709 12:09:17.172363 14304 leader_election.cc:343] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.173096 14304 leader_election.cc:304] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:09:17.175240 14434 raft_consensus.cc:2749] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:09:17.157855 14549 consensus_queue.cc:237] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:17.186789 14381 tablet_bootstrap.cc:654] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.192888 14379 tablet_bootstrap.cc:492] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c: No bootstrap required, opened a new log
I20260709 12:09:17.193459 14379 ts_tablet_manager.cc:1403] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c: Time spent bootstrapping tablet: real 0.128s	user 0.015s	sys 0.005s
I20260709 12:09:17.196821 14379 raft_consensus.cc:359] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:17.197352 14379 raft_consensus.cc:385] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.197579 14379 raft_consensus.cc:740] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.198266 14379 consensus_queue.cc:260] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:17.200603 14379 ts_tablet_manager.cc:1434] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:09:17.201122 14380 tablet_bootstrap.cc:492] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec: No bootstrap required, opened a new log
I20260709 12:09:17.201550 14380 ts_tablet_manager.cc:1403] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec: Time spent bootstrapping tablet: real 0.138s	user 0.007s	sys 0.007s
I20260709 12:09:17.201783 14379 tablet_bootstrap.cc:492] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c: Bootstrap starting.
I20260709 12:09:17.204512 14380 raft_consensus.cc:359] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:17.205029 14380 raft_consensus.cc:385] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.205246 14380 raft_consensus.cc:740] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.205807 14380 consensus_queue.cc:260] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:17.208459 14379 tablet_bootstrap.cc:654] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.209326 14086 catalog_manager.cc:5697] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c reported cstate change: term changed from 0 to 1, leader changed from <none> to 65c9c1653b3346b39a0e118540e6080c (127.12.174.131). New cstate: current_term: 1 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:17.210561 14380 ts_tablet_manager.cc:1434] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:09:17.213893 14381 tablet_bootstrap.cc:492] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf: No bootstrap required, opened a new log
I20260709 12:09:17.214352 14381 ts_tablet_manager.cc:1403] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf: Time spent bootstrapping tablet: real 0.154s	user 0.014s	sys 0.003s
I20260709 12:09:17.211928 14086 catalog_manager.cc:5697] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c reported cstate change: term changed from 0 to 1, leader changed from <none> to 65c9c1653b3346b39a0e118540e6080c (127.12.174.131). New cstate: current_term: 1 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:17.216099 14086 catalog_manager.cc:5697] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c reported cstate change: term changed from 0 to 1, leader changed from <none> to 65c9c1653b3346b39a0e118540e6080c (127.12.174.131). New cstate: current_term: 1 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:17.217839 14381 raft_consensus.cc:359] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:17.218380 14381 raft_consensus.cc:385] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.218587 14381 raft_consensus.cc:740] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.219187 14381 consensus_queue.cc:260] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:17.220844 14381 ts_tablet_manager.cc:1434] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:09:17.212013 14380 tablet_bootstrap.cc:492] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec: Bootstrap starting.
I20260709 12:09:17.225083 14381 tablet_bootstrap.cc:492] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf: Bootstrap starting.
I20260709 12:09:17.227883 14380 tablet_bootstrap.cc:654] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.233189 14381 tablet_bootstrap.cc:654] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.242009 14380 tablet_bootstrap.cc:492] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec: No bootstrap required, opened a new log
I20260709 12:09:17.242573 14380 ts_tablet_manager.cc:1403] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec: Time spent bootstrapping tablet: real 0.031s	user 0.010s	sys 0.009s
I20260709 12:09:17.242906 14434 raft_consensus.cc:493] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:17.243448 14434 raft_consensus.cc:515] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:17.245586 14434 leader_election.cc:290] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:17.245379 14380 raft_consensus.cc:359] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:17.246263 14380 raft_consensus.cc:385] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.246568 14380 raft_consensus.cc:740] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.247429 14380 consensus_queue.cc:260] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:17.250994 14380 ts_tablet_manager.cc:1434] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:09:17.251493 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:17.252682 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:17.253366 14380 tablet_bootstrap.cc:492] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec: Bootstrap starting.
I20260709 12:09:17.254679 14381 tablet_bootstrap.cc:492] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf: No bootstrap required, opened a new log
W20260709 12:09:17.254585 14304 leader_election.cc:343] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.255504 14381 ts_tablet_manager.cc:1403] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf: Time spent bootstrapping tablet: real 0.031s	user 0.021s	sys 0.004s
W20260709 12:09:17.257079 14303 leader_election.cc:343] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.257586 14303 leader_election.cc:304] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:09:17.258966 14389 raft_consensus.cc:2749] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:17.259076 14381 raft_consensus.cc:359] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:17.259829 14381 raft_consensus.cc:385] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.260108 14381 raft_consensus.cc:740] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.260313 14380 tablet_bootstrap.cc:654] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.260851 14381 consensus_queue.cc:260] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:17.264873 14381 ts_tablet_manager.cc:1434] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 12:09:17.265980 14381 tablet_bootstrap.cc:492] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf: Bootstrap starting.
I20260709 12:09:17.266368 14449 consensus_queue.cc:1048] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:17.271900 14379 tablet_bootstrap.cc:492] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c: No bootstrap required, opened a new log
I20260709 12:09:17.272683 14381 tablet_bootstrap.cc:654] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.272500 14379 ts_tablet_manager.cc:1403] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c: Time spent bootstrapping tablet: real 0.071s	user 0.019s	sys 0.015s
I20260709 12:09:17.273993 14389 raft_consensus.cc:493] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:17.274554 14389 raft_consensus.cc:515] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:17.276202 14379 raft_consensus.cc:359] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:17.276928 14379 raft_consensus.cc:385] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.277248 14379 raft_consensus.cc:740] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.278033 14389 leader_election.cc:290] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:17.278020 14379 consensus_queue.cc:260] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:17.279376 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:17.280880 14449 consensus_queue.cc:1048] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:17.281198 14379 ts_tablet_manager.cc:1434] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
W20260709 12:09:17.281083 14304 leader_election.cc:343] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.282747 14379 tablet_bootstrap.cc:492] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c: Bootstrap starting.
I20260709 12:09:17.286567 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:17.287531 14186 raft_consensus.cc:2468] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 0.
I20260709 12:09:17.289151 14303 leader_election.cc:304] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:09:17.290457 14389 raft_consensus.cc:2804] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:17.290885 14389 raft_consensus.cc:493] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:17.291092 14381 tablet_bootstrap.cc:492] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf: No bootstrap required, opened a new log
I20260709 12:09:17.291320 14389 raft_consensus.cc:3060] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:17.291635 14381 ts_tablet_manager.cc:1403] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf: Time spent bootstrapping tablet: real 0.026s	user 0.014s	sys 0.003s
I20260709 12:09:17.294589 14379 tablet_bootstrap.cc:654] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.294544 14381 raft_consensus.cc:359] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:17.295274 14381 raft_consensus.cc:385] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.295578 14381 raft_consensus.cc:740] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.296423 14381 consensus_queue.cc:260] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:17.299472 14381 ts_tablet_manager.cc:1434] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:09:17.300259 14389 raft_consensus.cc:515] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:17.300877 14381 tablet_bootstrap.cc:492] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf: Bootstrap starting.
I20260709 12:09:17.306663 14380 tablet_bootstrap.cc:492] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec: No bootstrap required, opened a new log
I20260709 12:09:17.309238 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:09:17.314121 14185 raft_consensus.cc:3060] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:17.314152 14380 ts_tablet_manager.cc:1403] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec: Time spent bootstrapping tablet: real 0.061s	user 0.011s	sys 0.007s
I20260709 12:09:17.319083 14380 raft_consensus.cc:359] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:17.319831 14380 raft_consensus.cc:385] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.320106 14380 raft_consensus.cc:740] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.320787 14380 consensus_queue.cc:260] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:17.322480 14185 raft_consensus.cc:2468] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 1.
I20260709 12:09:17.322752 14389 leader_election.cc:290] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:17.323554 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:09:17.323865 14303 leader_election.cc:304] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:09:17.324959 14389 raft_consensus.cc:2804] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:17.325449 14389 raft_consensus.cc:697] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:09:17.325989 14261 raft_consensus.cc:3060] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:17.326416 14381 tablet_bootstrap.cc:654] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.326311 14389 consensus_queue.cc:237] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:17.324636 14380 ts_tablet_manager.cc:1434] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:09:17.329298 14380 tablet_bootstrap.cc:492] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec: Bootstrap starting.
I20260709 12:09:17.337615 14261 raft_consensus.cc:2468] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 1.
I20260709 12:09:17.338081 14380 tablet_bootstrap.cc:654] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.341998 14379 tablet_bootstrap.cc:492] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c: No bootstrap required, opened a new log
I20260709 12:09:17.342588 14379 ts_tablet_manager.cc:1403] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c: Time spent bootstrapping tablet: real 0.060s	user 0.012s	sys 0.017s
I20260709 12:09:17.345461 14379 raft_consensus.cc:359] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:17.346464 14379 raft_consensus.cc:385] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.346838 14379 raft_consensus.cc:740] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.347663 14379 consensus_queue.cc:260] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:17.350108 14379 ts_tablet_manager.cc:1434] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.002s
I20260709 12:09:17.351389 14379 tablet_bootstrap.cc:492] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c: Bootstrap starting.
I20260709 12:09:17.353204 14380 tablet_bootstrap.cc:492] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec: No bootstrap required, opened a new log
I20260709 12:09:17.353839 14380 ts_tablet_manager.cc:1403] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec: Time spent bootstrapping tablet: real 0.025s	user 0.013s	sys 0.000s
I20260709 12:09:17.356894 14380 raft_consensus.cc:359] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:17.357599 14380 raft_consensus.cc:385] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.357913 14380 raft_consensus.cc:740] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.358561 14379 tablet_bootstrap.cc:654] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.358673 14380 consensus_queue.cc:260] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:17.360863 14380 ts_tablet_manager.cc:1434] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:09:17.362134 14380 tablet_bootstrap.cc:492] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec: Bootstrap starting.
I20260709 12:09:17.364123 14545 raft_consensus.cc:493] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:17.364677 14545 raft_consensus.cc:515] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:17.368557 14380 tablet_bootstrap.cc:654] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.367165 14545 leader_election.cc:290] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:17.369930 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:17.370379 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:17.370743 14261 raft_consensus.cc:2393] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 1: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:09:17.372227 14155 leader_election.cc:304] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:09:17.374071 14545 raft_consensus.cc:3060] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:17.376689 14379 tablet_bootstrap.cc:492] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c: No bootstrap required, opened a new log
I20260709 12:09:17.377336 14379 ts_tablet_manager.cc:1403] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c: Time spent bootstrapping tablet: real 0.026s	user 0.012s	sys 0.006s
I20260709 12:09:17.380167 14379 raft_consensus.cc:359] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:17.381088 14379 raft_consensus.cc:385] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.381428 14379 raft_consensus.cc:740] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.382259 14379 consensus_queue.cc:260] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:17.385914 14379 ts_tablet_manager.cc:1434] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:09:17.382719 14088 catalog_manager.cc:5697] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c reported cstate change: term changed from 0 to 1, leader changed from <none> to 65c9c1653b3346b39a0e118540e6080c (127.12.174.131). New cstate: current_term: 1 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:17.387071 14379 tablet_bootstrap.cc:492] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c: Bootstrap starting.
I20260709 12:09:17.390342 14545 raft_consensus.cc:2749] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:17.394747 14380 tablet_bootstrap.cc:492] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec: No bootstrap required, opened a new log
I20260709 12:09:17.395395 14380 ts_tablet_manager.cc:1403] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec: Time spent bootstrapping tablet: real 0.034s	user 0.009s	sys 0.004s
I20260709 12:09:17.395502 14381 tablet_bootstrap.cc:492] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf: No bootstrap required, opened a new log
I20260709 12:09:17.396077 14381 ts_tablet_manager.cc:1403] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf: Time spent bootstrapping tablet: real 0.095s	user 0.030s	sys 0.026s
I20260709 12:09:17.398819 14381 raft_consensus.cc:359] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:17.399570 14381 raft_consensus.cc:385] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.398527 14380 raft_consensus.cc:359] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:17.399857 14381 raft_consensus.cc:740] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.400413 14380 raft_consensus.cc:385] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.400774 14380 raft_consensus.cc:740] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.401036 14381 consensus_queue.cc:260] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:17.401516 14380 consensus_queue.cc:260] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:17.402400 14562 raft_consensus.cc:493] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:17.402931 14562 raft_consensus.cc:515] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:17.403976 14381 ts_tablet_manager.cc:1434] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 12:09:17.405408 14406 raft_consensus.cc:493] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:17.405923 14406 raft_consensus.cc:515] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:17.406527 14562 leader_election.cc:290] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:17.407413 14381 tablet_bootstrap.cc:492] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf: Bootstrap starting.
I20260709 12:09:17.407943 14406 leader_election.cc:290] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:17.413697 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:17.414053 14379 tablet_bootstrap.cc:654] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.413766 14380 ts_tablet_manager.cc:1434] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 12:09:17.415264 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:17.416374 14380 tablet_bootstrap.cc:492] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec: Bootstrap starting.
I20260709 12:09:17.417246 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:09:17.417567 14229 leader_election.cc:343] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.417977 14338 raft_consensus.cc:2468] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 0.
W20260709 12:09:17.418361 14229 leader_election.cc:343] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.419370 14230 leader_election.cc:304] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:09:17.420152 14562 consensus_queue.cc:1048] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:17.420583 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:17.421952 14406 raft_consensus.cc:2804] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:17.422348 14406 raft_consensus.cc:493] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:17.422706 14406 raft_consensus.cc:3060] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:17.422446 14230 leader_election.cc:343] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.427644 14230 leader_election.cc:304] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:09:17.428859 14381 tablet_bootstrap.cc:654] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.428818 14562 raft_consensus.cc:2749] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:17.437129 14545 raft_consensus.cc:493] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:17.437824 14545 raft_consensus.cc:515] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:17.442363 14545 leader_election.cc:290] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:17.443481 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:17.444185 14338 raft_consensus.cc:2468] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 0.
I20260709 12:09:17.445322 14155 leader_election.cc:304] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:09:17.446398 14557 consensus_queue.cc:1048] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:17.448307 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:17.448997 14261 raft_consensus.cc:2468] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 0.
I20260709 12:09:17.447417 14545 raft_consensus.cc:2804] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:17.461016 14380 tablet_bootstrap.cc:654] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.454104 14545 raft_consensus.cc:493] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:17.464905 14545 raft_consensus.cc:3060] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:17.473774 14381 tablet_bootstrap.cc:492] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf: No bootstrap required, opened a new log
I20260709 12:09:17.474443 14381 ts_tablet_manager.cc:1403] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf: Time spent bootstrapping tablet: real 0.067s	user 0.014s	sys 0.001s
I20260709 12:09:17.462316 14406 raft_consensus.cc:515] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:17.477222 14406 leader_election.cc:290] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:17.479287 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
W20260709 12:09:17.481140 14229 leader_election.cc:343] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.483632 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:09:17.484265 14338 raft_consensus.cc:3060] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:17.494103 14381 raft_consensus.cc:359] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:17.495486 14381 raft_consensus.cc:385] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.495869 14381 raft_consensus.cc:740] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.496752 14381 consensus_queue.cc:260] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:17.499814 14545 raft_consensus.cc:515] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:17.501022 14380 tablet_bootstrap.cc:492] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec: No bootstrap required, opened a new log
I20260709 12:09:17.501556 14380 ts_tablet_manager.cc:1403] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec: Time spent bootstrapping tablet: real 0.085s	user 0.012s	sys 0.003s
I20260709 12:09:17.502687 14545 leader_election.cc:290] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:17.503477 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:09:17.503942 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:09:17.504580 14335 raft_consensus.cc:3060] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:17.505445 14380 raft_consensus.cc:359] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:17.508687 14380 raft_consensus.cc:385] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.508996 14380 raft_consensus.cc:740] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.510895 14335 raft_consensus.cc:2468] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 1.
I20260709 12:09:17.504112 14261 raft_consensus.cc:3060] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:17.513599 14136 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:09:17.513904 14155 leader_election.cc:304] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:09:17.509711 14380 consensus_queue.cc:260] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:17.515031 14525 raft_consensus.cc:2804] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:17.515547 14525 raft_consensus.cc:697] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 1 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:09:17.516327 14380 ts_tablet_manager.cc:1434] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec: Time spent starting tablet: real 0.014s	user 0.002s	sys 0.002s
I20260709 12:09:17.516395 14525 consensus_queue.cc:237] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:17.518458 14380 tablet_bootstrap.cc:492] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec: Bootstrap starting.
I20260709 12:09:17.522004 14381 ts_tablet_manager.cc:1434] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf: Time spent starting tablet: real 0.047s	user 0.008s	sys 0.000s
I20260709 12:09:17.527235 14379 tablet_bootstrap.cc:492] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c: No bootstrap required, opened a new log
I20260709 12:09:17.535260 14379 ts_tablet_manager.cc:1403] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c: Time spent bootstrapping tablet: real 0.148s	user 0.026s	sys 0.009s
I20260709 12:09:17.526939 14338 raft_consensus.cc:2468] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 1.
I20260709 12:09:17.539942 14381 tablet_bootstrap.cc:492] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf: Bootstrap starting.
I20260709 12:09:17.541039 14230 leader_election.cc:304] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:09:17.542303 14406 raft_consensus.cc:2804] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:17.542567 14560 raft_consensus.cc:493] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:17.542212 14261 raft_consensus.cc:2468] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 1.
I20260709 12:09:17.546386 14406 raft_consensus.cc:697] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 1 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:09:17.543100 14560 raft_consensus.cc:515] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:17.547430 14406 consensus_queue.cc:237] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:17.549163 14560 leader_election.cc:290] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:17.551189 14379 raft_consensus.cc:359] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:17.552322 14379 raft_consensus.cc:385] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.555528 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:17.556326 14186 raft_consensus.cc:2468] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 0.
I20260709 12:09:17.552616 14379 raft_consensus.cc:740] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.563185 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:09:17.565165 14230 leader_election.cc:343] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.565806 14229 leader_election.cc:304] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:09:17.567001 14557 raft_consensus.cc:2804] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:17.567379 14557 raft_consensus.cc:493] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:17.567729 14557 raft_consensus.cc:3060] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:17.561820 14379 consensus_queue.cc:260] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:17.580567 14380 tablet_bootstrap.cc:654] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.575044 14086 catalog_manager.cc:5697] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf reported cstate change: term changed from 0 to 1, leader changed from <none> to 885067a0d31741bfb5c9935788e315bf (127.12.174.129). New cstate: current_term: 1 leader_uuid: "885067a0d31741bfb5c9935788e315bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:17.585162 14379 ts_tablet_manager.cc:1434] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c: Time spent starting tablet: real 0.042s	user 0.007s	sys 0.003s
I20260709 12:09:17.589777 14379 tablet_bootstrap.cc:492] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c: Bootstrap starting.
I20260709 12:09:17.596318 14088 catalog_manager.cc:5697] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: term changed from 0 to 1, leader changed from <none> to 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130). New cstate: current_term: 1 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:17.610352 14389 raft_consensus.cc:493] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:17.610837 14381 tablet_bootstrap.cc:654] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.610968 14389 raft_consensus.cc:515] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:17.613384 14389 leader_election.cc:290] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:17.615051 14389 consensus_queue.cc:1048] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:17.616921 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:17.623903 14557 raft_consensus.cc:515] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:17.625986 14379 tablet_bootstrap.cc:654] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.625003 14549 raft_consensus.cc:493] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:09:17.624032 14304 leader_election.cc:343] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.618458 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:17.626875 14549 raft_consensus.cc:515] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:17.629387 14381 tablet_bootstrap.cc:492] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf: No bootstrap required, opened a new log
I20260709 12:09:17.630103 14381 ts_tablet_manager.cc:1403] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf: Time spent bootstrapping tablet: real 0.090s	user 0.014s	sys 0.000s
I20260709 12:09:17.630725 14406 raft_consensus.cc:493] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:17.630156 14549 leader_election.cc:290] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:17.631449 14406 raft_consensus.cc:515] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:17.632719 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:17.634491 14380 tablet_bootstrap.cc:492] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec: No bootstrap required, opened a new log
I20260709 12:09:17.634856 14557 leader_election.cc:290] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:09:17.635061 14304 leader_election.cc:343] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.635596 14406 leader_election.cc:290] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:17.636369 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:17.635040 14380 ts_tablet_manager.cc:1403] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec: Time spent bootstrapping tablet: real 0.117s	user 0.011s	sys 0.021s
I20260709 12:09:17.636682 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:09:17.638754 14335 raft_consensus.cc:2393] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 1: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
W20260709 12:09:17.639770 14230 leader_election.cc:343] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.640347 14549 consensus_queue.cc:1048] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:17.641403 14380 raft_consensus.cc:359] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:17.643375 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:17.643785 14380 raft_consensus.cc:385] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.644137 14380 raft_consensus.cc:740] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.644199 14185 raft_consensus.cc:2468] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 0.
I20260709 12:09:17.644754 14380 consensus_queue.cc:260] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:17.641981 14381 raft_consensus.cc:359] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:17.646592 14381 raft_consensus.cc:385] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.647032 14381 raft_consensus.cc:740] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.647809 14381 consensus_queue.cc:260] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:17.648396 14380 ts_tablet_manager.cc:1434] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.001s
I20260709 12:09:17.649554 14380 tablet_bootstrap.cc:492] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec: Bootstrap starting.
I20260709 12:09:17.650153 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:09:17.650933 14186 raft_consensus.cc:3060] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:17.646600 14303 leader_election.cc:343] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.654616 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:17.655195 14381 ts_tablet_manager.cc:1434] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.000s
I20260709 12:09:17.655551 14187 raft_consensus.cc:2393] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 1: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:09:17.656443 14381 tablet_bootstrap.cc:492] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf: Bootstrap starting.
I20260709 12:09:17.657243 14229 leader_election.cc:304] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:09:17.658954 14557 raft_consensus.cc:3060] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:17.654603 14303 leader_election.cc:304] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:09:17.669274 14549 raft_consensus.cc:2749] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:17.669370 14186 raft_consensus.cc:2468] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 1.
I20260709 12:09:17.670886 14389 consensus_queue.cc:1048] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:17.671067 14229 leader_election.cc:304] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:09:17.673298 14560 raft_consensus.cc:2804] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:17.673878 14560 raft_consensus.cc:697] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 1 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:09:17.677899 14549 consensus_queue.cc:1048] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:17.679106 14380 tablet_bootstrap.cc:654] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.680694 14381 tablet_bootstrap.cc:654] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.688779 14303 leader_election.cc:304] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:09:17.690922 14389 raft_consensus.cc:2804] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:17.691395 14389 raft_consensus.cc:493] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:17.674782 14560 consensus_queue.cc:237] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:17.694057 14525 raft_consensus.cc:493] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:17.691982 14389 raft_consensus.cc:3060] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:17.694586 14525 raft_consensus.cc:515] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:17.698931 14525 leader_election.cc:290] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:17.700971 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:09:17.703146 14155 leader_election.cc:343] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.704077 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:09:17.705901 14155 leader_election.cc:343] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.706398 14155 leader_election.cc:304] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:09:17.707559 14525 raft_consensus.cc:2749] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:17.716862 14389 raft_consensus.cc:515] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:17.731560 14525 raft_consensus.cc:493] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:17.667143 14557 raft_consensus.cc:2749] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:17.734450 14525 raft_consensus.cc:515] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:17.735643 14389 leader_election.cc:290] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:17.736377 14379 tablet_bootstrap.cc:492] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c: No bootstrap required, opened a new log
I20260709 12:09:17.736932 14379 ts_tablet_manager.cc:1403] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c: Time spent bootstrapping tablet: real 0.149s	user 0.029s	sys 0.034s
I20260709 12:09:17.738693 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:17.740038 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:09:17.740093 14155 leader_election.cc:343] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.744077 14525 leader_election.cc:290] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:17.743666 14379 raft_consensus.cc:359] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:09:17.743788 14155 leader_election.cc:343] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.744618 14379 raft_consensus.cc:385] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.745033 14155 leader_election.cc:304] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:09:17.747257 14516 raft_consensus.cc:2749] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:17.747460 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:09:17.745021 14379 raft_consensus.cc:740] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.749478 14379 consensus_queue.cc:260] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:17.750538 14380 tablet_bootstrap.cc:492] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec: No bootstrap required, opened a new log
I20260709 12:09:17.751189 14380 ts_tablet_manager.cc:1403] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec: Time spent bootstrapping tablet: real 0.102s	user 0.006s	sys 0.010s
I20260709 12:09:17.752264 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:09:17.755352 14188 raft_consensus.cc:3060] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:17.755978 14379 ts_tablet_manager.cc:1434] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 12:09:17.757109 14379 tablet_bootstrap.cc:492] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c: Bootstrap starting.
W20260709 12:09:17.752673 14304 leader_election.cc:343] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.761766 14434 raft_consensus.cc:493] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:17.762042 14380 raft_consensus.cc:359] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:17.763063 14516 raft_consensus.cc:493] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:17.764592 14380 raft_consensus.cc:385] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.764578 14516 raft_consensus.cc:515] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:17.765606 14380 raft_consensus.cc:740] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.766812 14380 consensus_queue.cc:260] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:17.769779 14379 tablet_bootstrap.cc:654] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.771617 14380 ts_tablet_manager.cc:1434] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.001s
I20260709 12:09:17.762295 14434 raft_consensus.cc:515] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:17.768440 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:17.768891 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:17.774000 14188 raft_consensus.cc:2468] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 1.
I20260709 12:09:17.774345 14261 raft_consensus.cc:2393] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 1: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:09:17.775842 14155 leader_election.cc:304] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:09:17.767163 14516 leader_election.cc:290] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:17.777446 14516 raft_consensus.cc:3060] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:17.782250 14379 tablet_bootstrap.cc:492] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c: No bootstrap required, opened a new log
I20260709 12:09:17.782856 14379 ts_tablet_manager.cc:1403] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c: Time spent bootstrapping tablet: real 0.026s	user 0.012s	sys 0.006s
I20260709 12:09:17.784082 14434 leader_election.cc:290] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:17.787022 14516 raft_consensus.cc:2749] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:17.789130 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:17.789896 14261 raft_consensus.cc:2468] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 0.
I20260709 12:09:17.790230 14606 consensus_queue.cc:1048] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:17.787989 14379 raft_consensus.cc:359] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:17.788574 14380 tablet_bootstrap.cc:492] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec: Bootstrap starting.
I20260709 12:09:17.791567 14379 raft_consensus.cc:385] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.791884 14379 raft_consensus.cc:740] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.792681 14379 consensus_queue.cc:260] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:17.795296 14379 ts_tablet_manager.cc:1434] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c: Time spent starting tablet: real 0.012s	user 0.000s	sys 0.007s
I20260709 12:09:17.796491 14379 tablet_bootstrap.cc:492] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c: Bootstrap starting.
I20260709 12:09:17.797252 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:17.798308 14188 raft_consensus.cc:2468] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 0.
I20260709 12:09:17.801810 14380 tablet_bootstrap.cc:654] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.802531 14304 leader_election.cc:304] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:09:17.803033 14379 tablet_bootstrap.cc:654] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.808219 14606 raft_consensus.cc:2804] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:17.808684 14606 raft_consensus.cc:493] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:17.809093 14606 raft_consensus.cc:3060] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:17.815198 14380 tablet_bootstrap.cc:492] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec: No bootstrap required, opened a new log
I20260709 12:09:17.815778 14380 ts_tablet_manager.cc:1403] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec: Time spent bootstrapping tablet: real 0.028s	user 0.011s	sys 0.000s
I20260709 12:09:17.820045 14381 tablet_bootstrap.cc:492] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf: No bootstrap required, opened a new log
I20260709 12:09:17.820662 14381 ts_tablet_manager.cc:1403] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf: Time spent bootstrapping tablet: real 0.164s	user 0.013s	sys 0.021s
I20260709 12:09:17.822525 14303 leader_election.cc:304] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:09:17.825307 14379 tablet_bootstrap.cc:492] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c: No bootstrap required, opened a new log
I20260709 12:09:17.825882 14379 ts_tablet_manager.cc:1403] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c: Time spent bootstrapping tablet: real 0.030s	user 0.014s	sys 0.003s
I20260709 12:09:17.826407 14381 raft_consensus.cc:359] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:17.827239 14381 raft_consensus.cc:385] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.817145 14606 raft_consensus.cc:515] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:17.824710 14380 raft_consensus.cc:359] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:17.828832 14380 raft_consensus.cc:385] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.829129 14380 raft_consensus.cc:740] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.827561 14381 raft_consensus.cc:740] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.829473 14549 raft_consensus.cc:2804] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:17.830083 14549 raft_consensus.cc:697] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:09:17.830633 14606 leader_election.cc:290] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:17.830926 14549 consensus_queue.cc:237] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:17.832791 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:09:17.830835 14086 catalog_manager.cc:5697] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: term changed from 0 to 1, leader changed from <none> to 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130). New cstate: current_term: 1 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:17.834640 14381 consensus_queue.cc:260] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:17.836915 14381 ts_tablet_manager.cc:1434] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 12:09:17.840955 14380 consensus_queue.cc:260] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:17.841868 14379 raft_consensus.cc:359] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:17.842548 14379 raft_consensus.cc:385] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.842839 14379 raft_consensus.cc:740] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.845218 14381 tablet_bootstrap.cc:492] T 55a08950f57748dea047f3190b2c0e95 P 885067a0d31741bfb5c9935788e315bf: Bootstrap starting.
I20260709 12:09:17.849988 14607 raft_consensus.cc:493] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:17.850056 14380 ts_tablet_manager.cc:1434] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec: Time spent starting tablet: real 0.034s	user 0.009s	sys 0.000s
I20260709 12:09:17.850703 14607 raft_consensus.cc:515] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:17.852193 14380 tablet_bootstrap.cc:492] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec: Bootstrap starting.
I20260709 12:09:17.853045 14607 leader_election.cc:290] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:17.854089 14379 consensus_queue.cc:260] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:17.857369 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:09:17.858774 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:17.866954 14379 ts_tablet_manager.cc:1434] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c: Time spent starting tablet: real 0.041s	user 0.007s	sys 0.001s
I20260709 12:09:17.866973 14188 raft_consensus.cc:3060] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:17.868218 14379 tablet_bootstrap.cc:492] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c: Bootstrap starting.
I20260709 12:09:17.873322 14380 tablet_bootstrap.cc:654] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.878764 14379 tablet_bootstrap.cc:654] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.879271 14188 raft_consensus.cc:2468] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 1.
I20260709 12:09:17.880345 14607 consensus_queue.cc:1048] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:17.860523 14381 tablet_bootstrap.cc:654] T 55a08950f57748dea047f3190b2c0e95 P 885067a0d31741bfb5c9935788e315bf: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.833573 14262 raft_consensus.cc:3060] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:17.912566 14380 tablet_bootstrap.cc:492] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec: No bootstrap required, opened a new log
I20260709 12:09:17.912405 14607 consensus_queue.cc:1048] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:17.913185 14380 ts_tablet_manager.cc:1403] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec: Time spent bootstrapping tablet: real 0.061s	user 0.023s	sys 0.000s
I20260709 12:09:17.916914 14380 raft_consensus.cc:359] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:17.917276 14608 consensus_queue.cc:1048] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:17.917663 14380 raft_consensus.cc:385] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.918002 14380 raft_consensus.cc:740] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.918723 14380 consensus_queue.cc:260] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:17.920037 14303 leader_election.cc:304] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:09:17.921027 14607 raft_consensus.cc:2804] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:17.921550 14607 raft_consensus.cc:697] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:09:17.920336 14380 ts_tablet_manager.cc:1434] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.002s
I20260709 12:09:17.922173 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:17.922904 14188 raft_consensus.cc:2393] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 1: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:09:17.922457 14607 consensus_queue.cc:237] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:17.924048 14303 leader_election.cc:304] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:09:17.925362 14608 raft_consensus.cc:3060] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:17.940145 14608 raft_consensus.cc:2749] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:17.940899 14380 tablet_bootstrap.cc:492] T 36091607df2f46059df62d677842a031 P 17aab1bbf5014936aa18cc21818b26ec: Bootstrap starting.
I20260709 12:09:17.937697 14379 tablet_bootstrap.cc:492] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c: No bootstrap required, opened a new log
I20260709 12:09:17.942596 14379 ts_tablet_manager.cc:1403] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c: Time spent bootstrapping tablet: real 0.075s	user 0.010s	sys 0.017s
I20260709 12:09:17.945261 14560 consensus_queue.cc:1048] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:17.946681 14262 raft_consensus.cc:2468] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 1.
I20260709 12:09:17.945333 14379 raft_consensus.cc:359] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:17.949007 14379 raft_consensus.cc:385] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.949330 14379 raft_consensus.cc:740] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.952626 14379 consensus_queue.cc:260] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:17.956548 14379 ts_tablet_manager.cc:1434] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 12:09:17.964406 14381 tablet_bootstrap.cc:492] T 55a08950f57748dea047f3190b2c0e95 P 885067a0d31741bfb5c9935788e315bf: No bootstrap required, opened a new log
I20260709 12:09:17.964927 14381 ts_tablet_manager.cc:1403] T 55a08950f57748dea047f3190b2c0e95 P 885067a0d31741bfb5c9935788e315bf: Time spent bootstrapping tablet: real 0.120s	user 0.014s	sys 0.012s
I20260709 12:09:17.968832 14381 raft_consensus.cc:359] T 55a08950f57748dea047f3190b2c0e95 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:17.970016 14381 raft_consensus.cc:385] T 55a08950f57748dea047f3190b2c0e95 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.970340 14381 raft_consensus.cc:740] T 55a08950f57748dea047f3190b2c0e95 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.973114 14381 consensus_queue.cc:260] T 55a08950f57748dea047f3190b2c0e95 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:17.976256 14381 ts_tablet_manager.cc:1434] T 55a08950f57748dea047f3190b2c0e95 P 885067a0d31741bfb5c9935788e315bf: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.002s
I20260709 12:09:17.977588 14381 tablet_bootstrap.cc:492] T 1dfd3f2bd71343f789aa5733a23d4b8d P 885067a0d31741bfb5c9935788e315bf: Bootstrap starting.
I20260709 12:09:17.984369 14088 catalog_manager.cc:5697] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c reported cstate change: term changed from 0 to 1, leader changed from <none> to 65c9c1653b3346b39a0e118540e6080c (127.12.174.131). New cstate: current_term: 1 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:17.986264 14380 tablet_bootstrap.cc:654] T 36091607df2f46059df62d677842a031 P 17aab1bbf5014936aa18cc21818b26ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.986771 14379 tablet_bootstrap.cc:492] T f57e398f580944f0866ea5fab71be87f P 65c9c1653b3346b39a0e118540e6080c: Bootstrap starting.
I20260709 12:09:17.986246 14088 catalog_manager.cc:5697] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c reported cstate change: term changed from 0 to 1, leader changed from <none> to 65c9c1653b3346b39a0e118540e6080c (127.12.174.131). New cstate: current_term: 1 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:17.996471 14379 tablet_bootstrap.cc:654] T f57e398f580944f0866ea5fab71be87f P 65c9c1653b3346b39a0e118540e6080c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.998482 14608 raft_consensus.cc:493] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:17.999367 14608 raft_consensus.cc:515] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:18.005301 14608 leader_election.cc:290] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:18.002458 14560 raft_consensus.cc:493] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.008927 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:18.009924 14185 raft_consensus.cc:2468] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 0.
I20260709 12:09:18.013118 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:18.015030 14560 raft_consensus.cc:515] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:09:18.017225 14229 consensus_peers.cc:597] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:18.019500 14303 leader_election.cc:304] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:09:18.021528 14549 raft_consensus.cc:2804] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:18.022135 14549 raft_consensus.cc:493] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:18.022636 14549 raft_consensus.cc:3060] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:18.023144 14304 leader_election.cc:343] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.058285 14516 consensus_queue.cc:1048] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:18.065582 14381 tablet_bootstrap.cc:654] T 1dfd3f2bd71343f789aa5733a23d4b8d P 885067a0d31741bfb5c9935788e315bf: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.066692 14560 leader_election.cc:290] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:18.066891 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:18.068252 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:18.070463 14185 raft_consensus.cc:2468] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 0.
I20260709 12:09:18.071102 14380 tablet_bootstrap.cc:492] T 36091607df2f46059df62d677842a031 P 17aab1bbf5014936aa18cc21818b26ec: No bootstrap required, opened a new log
I20260709 12:09:18.071630 14380 ts_tablet_manager.cc:1403] T 36091607df2f46059df62d677842a031 P 17aab1bbf5014936aa18cc21818b26ec: Time spent bootstrapping tablet: real 0.148s	user 0.051s	sys 0.030s
I20260709 12:09:18.072530 14229 leader_election.cc:304] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
W20260709 12:09:18.073102 14230 leader_election.cc:343] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.073516 14560 raft_consensus.cc:2804] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:18.075098 14560 raft_consensus.cc:493] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:18.086522 14560 raft_consensus.cc:3060] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.089499 14516 consensus_queue.cc:1048] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:18.079191 14380 raft_consensus.cc:359] T 36091607df2f46059df62d677842a031 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:18.093961 14380 raft_consensus.cc:385] T 36091607df2f46059df62d677842a031 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.094343 14380 raft_consensus.cc:740] T 36091607df2f46059df62d677842a031 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.081091 14608 raft_consensus.cc:493] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.095441 14380 consensus_queue.cc:260] T 36091607df2f46059df62d677842a031 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:18.096050 14608 raft_consensus.cc:515] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:18.096629 14549 raft_consensus.cc:515] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:18.097973 14380 ts_tablet_manager.cc:1434] T 36091607df2f46059df62d677842a031 P 17aab1bbf5014936aa18cc21818b26ec: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.005s
I20260709 12:09:18.099596 14380 tablet_bootstrap.cc:492] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec: Bootstrap starting.
I20260709 12:09:18.100270 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:18.101792 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:09:18.102988 14186 raft_consensus.cc:3060] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:18.103529 14303 leader_election.cc:343] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.104581 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:09:18.106230 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:18.108675 14261 raft_consensus.cc:2468] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 0.
I20260709 12:09:18.105952 14607 raft_consensus.cc:493] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.103101 14608 leader_election.cc:290] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:18.111721 14607 raft_consensus.cc:515] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:18.115083 14379 tablet_bootstrap.cc:492] T f57e398f580944f0866ea5fab71be87f P 65c9c1653b3346b39a0e118540e6080c: No bootstrap required, opened a new log
I20260709 12:09:18.115728 14379 ts_tablet_manager.cc:1403] T f57e398f580944f0866ea5fab71be87f P 65c9c1653b3346b39a0e118540e6080c: Time spent bootstrapping tablet: real 0.129s	user 0.014s	sys 0.005s
I20260709 12:09:18.115947 14607 leader_election.cc:290] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:09:18.116843 14304 leader_election.cc:343] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.118436 14304 leader_election.cc:304] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:09:18.118837 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:18.121320 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:18.122292 14261 raft_consensus.cc:2468] T 36091607df2f46059df62d677842a031 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 0.
I20260709 12:09:18.120728 14381 tablet_bootstrap.cc:492] T 1dfd3f2bd71343f789aa5733a23d4b8d P 885067a0d31741bfb5c9935788e315bf: No bootstrap required, opened a new log
I20260709 12:09:18.124245 14381 ts_tablet_manager.cc:1403] T 1dfd3f2bd71343f789aa5733a23d4b8d P 885067a0d31741bfb5c9935788e315bf: Time spent bootstrapping tablet: real 0.147s	user 0.013s	sys 0.008s
W20260709 12:09:18.132627 14303 leader_election.cc:343] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.134661 14560 raft_consensus.cc:515] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:18.138895 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:09:18.139910 14185 raft_consensus.cc:3060] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.100250 14549 leader_election.cc:290] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:18.147068 14607 raft_consensus.cc:2804] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:18.156997 14607 raft_consensus.cc:493] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:18.158046 14304 leader_election.cc:304] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:09:18.158627 14607 raft_consensus.cc:3060] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.161259 14549 raft_consensus.cc:2804] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:18.163513 14549 raft_consensus.cc:493] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:18.164011 14549 raft_consensus.cc:3060] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.164777 14186 raft_consensus.cc:2468] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 1.
I20260709 12:09:18.166392 14303 leader_election.cc:304] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:09:18.167541 14608 raft_consensus.cc:2804] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:18.168210 14608 raft_consensus.cc:697] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:09:18.169420 14608 consensus_queue.cc:237] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:18.177211 14379 raft_consensus.cc:359] T f57e398f580944f0866ea5fab71be87f P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:18.178217 14379 raft_consensus.cc:385] T f57e398f580944f0866ea5fab71be87f P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.178496 14379 raft_consensus.cc:740] T f57e398f580944f0866ea5fab71be87f P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.179370 14379 consensus_queue.cc:260] T f57e398f580944f0866ea5fab71be87f P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:18.177209 14381 raft_consensus.cc:359] T 1dfd3f2bd71343f789aa5733a23d4b8d P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:18.181486 14379 ts_tablet_manager.cc:1434] T f57e398f580944f0866ea5fab71be87f P 65c9c1653b3346b39a0e118540e6080c: Time spent starting tablet: real 0.065s	user 0.013s	sys 0.008s
I20260709 12:09:18.181181 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:09:18.182090 14381 raft_consensus.cc:385] T 1dfd3f2bd71343f789aa5733a23d4b8d P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.182451 14381 raft_consensus.cc:740] T 1dfd3f2bd71343f789aa5733a23d4b8d P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.183423 14381 consensus_queue.cc:260] T 1dfd3f2bd71343f789aa5733a23d4b8d P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:18.185938 14381 ts_tablet_manager.cc:1434] T 1dfd3f2bd71343f789aa5733a23d4b8d P 885067a0d31741bfb5c9935788e315bf: Time spent starting tablet: real 0.061s	user 0.006s	sys 0.003s
I20260709 12:09:18.187184 14381 tablet_bootstrap.cc:492] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf: Bootstrap starting.
I20260709 12:09:18.187384 14380 tablet_bootstrap.cc:654] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.191274 14185 raft_consensus.cc:2468] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 1.
I20260709 12:09:18.192687 14229 leader_election.cc:304] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:09:18.193647 14406 raft_consensus.cc:2804] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:18.194375 14406 raft_consensus.cc:697] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 1 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:09:18.195673 14406 consensus_queue.cc:237] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:18.202099 14600 raft_consensus.cc:493] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.202913 14600 raft_consensus.cc:515] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:18.206962 14379 tablet_bootstrap.cc:492] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c: Bootstrap starting.
I20260709 12:09:18.208313 14562 raft_consensus.cc:493] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.209106 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:18.208994 14562 raft_consensus.cc:515] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:18.210018 14185 raft_consensus.cc:2468] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 0.
I20260709 12:09:18.174206 14560 leader_election.cc:290] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:18.218230 14600 leader_election.cc:290] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:18.232635 14229 leader_election.cc:304] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:09:18.236130 14600 raft_consensus.cc:2804] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:18.227509 14549 raft_consensus.cc:515] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:18.248896 14600 raft_consensus.cc:493] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:18.249432 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:18.254182 14185 raft_consensus.cc:2468] T 55a08950f57748dea047f3190b2c0e95 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 0.
I20260709 12:09:18.255570 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:18.256261 14338 raft_consensus.cc:2468] T f57e398f580944f0866ea5fab71be87f P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 0.
W20260709 12:09:18.256420 14230 leader_election.cc:343] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.259790 14229 leader_election.cc:304] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:09:18.252305 14562 leader_election.cc:290] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:18.263996 14381 tablet_bootstrap.cc:654] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.267663 14557 raft_consensus.cc:2804] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:18.268232 14557 raft_consensus.cc:493] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:18.267560 14088 catalog_manager.cc:5697] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c reported cstate change: term changed from 0 to 1, leader changed from <none> to 65c9c1653b3346b39a0e118540e6080c (127.12.174.131). New cstate: current_term: 1 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:18.252401 14600 raft_consensus.cc:3060] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.270262 14557 raft_consensus.cc:3060] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.274747 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:18.275491 14335 raft_consensus.cc:2468] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 0.
I20260709 12:09:18.283002 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
W20260709 12:09:18.284946 14303 leader_election.cc:343] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.296558 14560 consensus_queue.cc:1048] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:18.296325 14087 catalog_manager.cc:5697] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: term changed from 0 to 1, leader changed from <none> to 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130). New cstate: current_term: 1 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } }
W20260709 12:09:18.286736 14304 consensus_peers.cc:597] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c -> Peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Couldn't send request to peer 17aab1bbf5014936aa18cc21818b26ec. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:18.300753 14379 tablet_bootstrap.cc:654] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.304311 14380 tablet_bootstrap.cc:492] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec: No bootstrap required, opened a new log
I20260709 12:09:18.305625 14380 ts_tablet_manager.cc:1403] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec: Time spent bootstrapping tablet: real 0.206s	user 0.010s	sys 0.013s
I20260709 12:09:18.311107 14381 tablet_bootstrap.cc:492] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf: No bootstrap required, opened a new log
I20260709 12:09:18.311616 14381 ts_tablet_manager.cc:1403] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf: Time spent bootstrapping tablet: real 0.125s	user 0.011s	sys 0.015s
I20260709 12:09:18.312778 14549 leader_election.cc:290] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:18.315986 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:09:18.316819 14262 raft_consensus.cc:3060] T 36091607df2f46059df62d677842a031 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.335124 14607 raft_consensus.cc:515] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:18.339110 14607 leader_election.cc:290] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:18.341429 14600 raft_consensus.cc:515] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:18.342128 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:09:18.342850 14188 raft_consensus.cc:3060] T 1dfd3f2bd71343f789aa5733a23d4b8d P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.324764 14557 raft_consensus.cc:515] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:18.348371 14381 raft_consensus.cc:359] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:18.349215 14381 raft_consensus.cc:385] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.349551 14381 raft_consensus.cc:740] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.350382 14381 consensus_queue.cc:260] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:18.353088 14600 leader_election.cc:290] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:18.354720 14381 ts_tablet_manager.cc:1434] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf: Time spent starting tablet: real 0.043s	user 0.008s	sys 0.002s
I20260709 12:09:18.355433 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:09:18.356807 14261 raft_consensus.cc:3060] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.357792 14381 tablet_bootstrap.cc:492] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf: Bootstrap starting.
I20260709 12:09:18.359170 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:09:18.359975 14335 raft_consensus.cc:3060] T f57e398f580944f0866ea5fab71be87f P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.350562 14262 raft_consensus.cc:2468] T 36091607df2f46059df62d677842a031 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 1.
I20260709 12:09:18.351579 14380 raft_consensus.cc:359] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:18.362895 14380 raft_consensus.cc:385] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.363128 14380 raft_consensus.cc:740] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.365024 14557 leader_election.cc:290] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:18.376467 14261 raft_consensus.cc:2468] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 1.
I20260709 12:09:18.378185 14304 leader_election.cc:304] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:09:18.379360 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:09:18.380280 14185 raft_consensus.cc:3060] T 55a08950f57748dea047f3190b2c0e95 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.380614 14549 raft_consensus.cc:2804] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:18.382072 14549 raft_consensus.cc:697] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:09:18.383396 14549 consensus_queue.cc:237] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:18.384577 14335 raft_consensus.cc:2468] T f57e398f580944f0866ea5fab71be87f P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 1.
I20260709 12:09:18.387603 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:09:18.388536 14186 raft_consensus.cc:3060] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.389254 14304 leader_election.cc:304] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:09:18.378159 14380 consensus_queue.cc:260] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:18.394111 14607 raft_consensus.cc:2804] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:18.394785 14607 raft_consensus.cc:697] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:09:18.395045 14631 consensus_queue.cc:1048] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:18.396762 14607 consensus_queue.cc:237] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:18.404282 14381 tablet_bootstrap.cc:654] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.405354 14230 leader_election.cc:304] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:09:18.407907 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:09:18.408757 14335 raft_consensus.cc:3060] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.410857 14380 ts_tablet_manager.cc:1434] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec: Time spent starting tablet: real 0.105s	user 0.004s	sys 0.004s
I20260709 12:09:18.414450 14380 tablet_bootstrap.cc:492] T 3832505489c04d04a69e256187061921 P 17aab1bbf5014936aa18cc21818b26ec: Bootstrap starting.
I20260709 12:09:18.406711 14600 raft_consensus.cc:2804] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:18.415788 14600 raft_consensus.cc:697] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 1 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:09:18.417022 14600 consensus_queue.cc:237] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:18.411512 14186 raft_consensus.cc:2468] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 1.
I20260709 12:09:18.421044 14434 consensus_queue.cc:1048] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:18.427452 14188 raft_consensus.cc:2468] T 1dfd3f2bd71343f789aa5733a23d4b8d P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 1.
I20260709 12:09:18.432845 14335 raft_consensus.cc:2468] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 1.
I20260709 12:09:18.436028 14230 leader_election.cc:304] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:09:18.437530 14631 raft_consensus.cc:2804] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:18.438254 14631 raft_consensus.cc:697] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 1 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:09:18.440073 14381 tablet_bootstrap.cc:492] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf: No bootstrap required, opened a new log
I20260709 12:09:18.439469 14631 consensus_queue.cc:237] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:18.440593 14381 ts_tablet_manager.cc:1403] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf: Time spent bootstrapping tablet: real 0.083s	user 0.006s	sys 0.015s
I20260709 12:09:18.447654 14381 raft_consensus.cc:359] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:18.451035 14381 raft_consensus.cc:385] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.451714 14381 raft_consensus.cc:740] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.452529 14381 consensus_queue.cc:260] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:18.454949 14381 ts_tablet_manager.cc:1434] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.005s
I20260709 12:09:18.448400 14087 catalog_manager.cc:5697] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c reported cstate change: term changed from 0 to 1, leader changed from <none> to 65c9c1653b3346b39a0e118540e6080c (127.12.174.131). New cstate: current_term: 1 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:18.456082 14381 tablet_bootstrap.cc:492] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf: Bootstrap starting.
I20260709 12:09:18.458110 14607 consensus_queue.cc:1048] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:18.478569 14557 raft_consensus.cc:493] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.479245 14557 raft_consensus.cc:515] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:18.481760 14627 raft_consensus.cc:493] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.482430 14557 leader_election.cc:290] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:18.482424 14627 raft_consensus.cc:515] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:18.485854 14627 leader_election.cc:290] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:18.487892 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:18.489640 14188 raft_consensus.cc:3060] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.490201 14380 tablet_bootstrap.cc:654] T 3832505489c04d04a69e256187061921 P 17aab1bbf5014936aa18cc21818b26ec: Neither blocks nor log segments found. Creating new log.
W20260709 12:09:18.491725 14230 leader_election.cc:343] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.489709 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:18.493665 14261 raft_consensus.cc:2468] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 0.
I20260709 12:09:18.495596 14155 leader_election.cc:304] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:09:18.497185 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:18.497793 14627 raft_consensus.cc:2804] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:18.498382 14627 raft_consensus.cc:493] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:18.498878 14627 raft_consensus.cc:3060] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:18.501112 14155 leader_election.cc:343] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.501636 14434 consensus_queue.cc:1048] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:18.503187 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:18.513202 14088 catalog_manager.cc:5697] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c reported cstate change: term changed from 0 to 1, leader changed from <none> to 65c9c1653b3346b39a0e118540e6080c (127.12.174.131). New cstate: current_term: 1 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:18.529800 14087 catalog_manager.cc:5697] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: term changed from 0 to 1, leader changed from <none> to 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130). New cstate: current_term: 1 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:18.569173 14185 raft_consensus.cc:2468] T 55a08950f57748dea047f3190b2c0e95 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 1.
I20260709 12:09:18.580842 14607 consensus_queue.cc:1048] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:18.597203 14381 tablet_bootstrap.cc:654] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.597332 14379 tablet_bootstrap.cc:492] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c: No bootstrap required, opened a new log
I20260709 12:09:18.598644 14379 ts_tablet_manager.cc:1403] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c: Time spent bootstrapping tablet: real 0.392s	user 0.050s	sys 0.049s
W20260709 12:09:18.603091 14642 log.cc:927] Time spent T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:09:18.602867 14379 raft_consensus.cc:359] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:18.603753 14379 raft_consensus.cc:385] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.604110 14379 raft_consensus.cc:740] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.604955 14379 consensus_queue.cc:260] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:18.607002 14379 ts_tablet_manager.cc:1434] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 12:09:18.608059 14379 tablet_bootstrap.cc:492] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c: Bootstrap starting.
I20260709 12:09:18.633574 14380 tablet_bootstrap.cc:492] T 3832505489c04d04a69e256187061921 P 17aab1bbf5014936aa18cc21818b26ec: No bootstrap required, opened a new log
I20260709 12:09:18.635421 14380 ts_tablet_manager.cc:1403] T 3832505489c04d04a69e256187061921 P 17aab1bbf5014936aa18cc21818b26ec: Time spent bootstrapping tablet: real 0.221s	user 0.017s	sys 0.032s
I20260709 12:09:18.630151 14600 consensus_queue.cc:1048] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 12:09:18.674889 14380 raft_consensus.cc:359] T 3832505489c04d04a69e256187061921 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:18.675761 14380 raft_consensus.cc:385] T 3832505489c04d04a69e256187061921 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.676116 14380 raft_consensus.cc:740] T 3832505489c04d04a69e256187061921 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.681932 14379 tablet_bootstrap.cc:654] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.683450 14525 raft_consensus.cc:493] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:09:18.684602 14525 raft_consensus.cc:515] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:18.685510 14627 raft_consensus.cc:515] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:09:18.686506 14304 consensus_peers.cc:597] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c -> Peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Couldn't send request to peer 17aab1bbf5014936aa18cc21818b26ec. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:18.688416 14187 raft_consensus.cc:2393] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 1: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:09:18.689131 14627 leader_election.cc:290] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:18.690382 14525 leader_election.cc:290] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:09:18.691876 14136 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:09:18.691984 14229 leader_election.cc:304] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:09:18.692834 14557 raft_consensus.cc:3060] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.695699 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:09:18.697543 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:09:18.684885 14380 consensus_queue.cc:260] T 3832505489c04d04a69e256187061921 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:18.684499 14087 catalog_manager.cc:5697] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: term changed from 0 to 1, leader changed from <none> to 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130). New cstate: current_term: 1 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:18.702997 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:18.705286 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:18.708858 14380 ts_tablet_manager.cc:1434] T 3832505489c04d04a69e256187061921 P 17aab1bbf5014936aa18cc21818b26ec: Time spent starting tablet: real 0.073s	user 0.003s	sys 0.005s
W20260709 12:09:18.711575 14155 leader_election.cc:343] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.718478 14155 leader_election.cc:304] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:09:18.728554 14525 raft_consensus.cc:2749] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:18.722316 14338 raft_consensus.cc:3060] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.725804 14557 raft_consensus.cc:2749] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:18.752094 14380 tablet_bootstrap.cc:492] T 5485933837894417a3f0f89d55af1296 P 17aab1bbf5014936aa18cc21818b26ec: Bootstrap starting.
I20260709 12:09:18.765313 14262 raft_consensus.cc:2468] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 1.
I20260709 12:09:18.767868 14381 tablet_bootstrap.cc:492] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf: No bootstrap required, opened a new log
I20260709 12:09:18.768755 14381 ts_tablet_manager.cc:1403] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf: Time spent bootstrapping tablet: real 0.313s	user 0.015s	sys 0.017s
I20260709 12:09:18.771136 14379 tablet_bootstrap.cc:492] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c: No bootstrap required, opened a new log
I20260709 12:09:18.771770 14379 ts_tablet_manager.cc:1403] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c: Time spent bootstrapping tablet: real 0.164s	user 0.007s	sys 0.015s
I20260709 12:09:18.772125 14155 leader_election.cc:304] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:09:18.773442 14525 raft_consensus.cc:2804] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:18.774183 14525 raft_consensus.cc:697] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 1 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:09:18.775746 14525 consensus_queue.cc:237] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:18.780745 14379 raft_consensus.cc:359] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:18.781790 14379 raft_consensus.cc:385] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.782161 14379 raft_consensus.cc:740] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.783231 14380 tablet_bootstrap.cc:654] T 5485933837894417a3f0f89d55af1296 P 17aab1bbf5014936aa18cc21818b26ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.783156 14379 consensus_queue.cc:260] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:18.784775 14381 raft_consensus.cc:359] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:18.788359 14381 raft_consensus.cc:385] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.788762 14381 raft_consensus.cc:740] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.789657 14557 consensus_queue.cc:1048] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:18.789702 14381 consensus_queue.cc:260] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:18.793156 14379 ts_tablet_manager.cc:1434] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c: Time spent starting tablet: real 0.021s	user 0.001s	sys 0.006s
I20260709 12:09:18.794785 14379 tablet_bootstrap.cc:492] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c: Bootstrap starting.
I20260709 12:09:18.794823 14381 ts_tablet_manager.cc:1434] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf: Time spent starting tablet: real 0.025s	user 0.004s	sys 0.003s
I20260709 12:09:18.802949 14381 tablet_bootstrap.cc:492] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf: Bootstrap starting.
I20260709 12:09:18.820422 14607 consensus_queue.cc:1048] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:18.823419 14549 consensus_queue.cc:1048] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:18.830778 14087 catalog_manager.cc:5697] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf reported cstate change: term changed from 0 to 1, leader changed from <none> to 885067a0d31741bfb5c9935788e315bf (127.12.174.129). New cstate: current_term: 1 leader_uuid: "885067a0d31741bfb5c9935788e315bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:18.837872 14562 consensus_queue.cc:1048] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 12:09:18.855703 14380 tablet_bootstrap.cc:492] T 5485933837894417a3f0f89d55af1296 P 17aab1bbf5014936aa18cc21818b26ec: No bootstrap required, opened a new log
I20260709 12:09:18.857955 14380 ts_tablet_manager.cc:1403] T 5485933837894417a3f0f89d55af1296 P 17aab1bbf5014936aa18cc21818b26ec: Time spent bootstrapping tablet: real 0.146s	user 0.012s	sys 0.024s
I20260709 12:09:18.875007 14265 raft_consensus.cc:3060] T 3832505489c04d04a69e256187061921 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.887369 14549 consensus_queue.cc:1048] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:09:18.889720 14380 raft_consensus.cc:359] T 5485933837894417a3f0f89d55af1296 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:18.884500 14379 tablet_bootstrap.cc:654] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.891332 14381 tablet_bootstrap.cc:654] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.892155 14380 raft_consensus.cc:385] T 5485933837894417a3f0f89d55af1296 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.896891 14380 raft_consensus.cc:740] T 5485933837894417a3f0f89d55af1296 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.911862 14380 consensus_queue.cc:260] T 5485933837894417a3f0f89d55af1296 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:18.931339 14380 ts_tablet_manager.cc:1434] T 5485933837894417a3f0f89d55af1296 P 17aab1bbf5014936aa18cc21818b26ec: Time spent starting tablet: real 0.073s	user 0.010s	sys 0.002s
I20260709 12:09:18.937166 14525 raft_consensus.cc:493] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.951589 14525 raft_consensus.cc:515] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:18.954169 14648 raft_consensus.cc:493] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.954905 14648 raft_consensus.cc:515] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:18.960707 14648 leader_election.cc:290] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:18.961503 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:18.962114 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:09:18.964277 14155 leader_election.cc:343] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.969420 14525 leader_election.cc:290] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:18.971675 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:18.973526 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:09:18.983819 14155 leader_election.cc:343] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.984488 14155 leader_election.cc:304] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:09:18.988986 14263 raft_consensus.cc:2468] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 1.
I20260709 12:09:19.004232 14557 raft_consensus.cc:493] T 5485933837894417a3f0f89d55af1296 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.005059 14557 raft_consensus.cc:515] T 5485933837894417a3f0f89d55af1296 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:18.995540 14335 raft_consensus.cc:2468] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 1.
I20260709 12:09:19.009451 14557 leader_election.cc:290] T 5485933837894417a3f0f89d55af1296 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:19.005934 14380 tablet_bootstrap.cc:492] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec: Bootstrap starting.
I20260709 12:09:19.015273 14155 leader_election.cc:304] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:09:18.989205 14525 raft_consensus.cc:2749] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:09:19.027918 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 56120.3us
I20260709 12:09:19.022557 14648 raft_consensus.cc:2804] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:19.030596 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:19.049443 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:19.053459 14648 raft_consensus.cc:493] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:19.060163 14562 raft_consensus.cc:493] T 3832505489c04d04a69e256187061921 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:09:19.065198 14562 raft_consensus.cc:515] T 3832505489c04d04a69e256187061921 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:19.069782 14648 raft_consensus.cc:3060] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:09:19.102964 14658 log.cc:927] Time spent T 36091607df2f46059df62d677842a031 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.085s	user 0.001s	sys 0.003s
I20260709 12:09:19.113437 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:19.118017 14379 tablet_bootstrap.cc:492] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c: No bootstrap required, opened a new log
I20260709 12:09:19.084509 14557 consensus_queue.cc:1048] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.026s
I20260709 12:09:19.118039 14230 leader_election.cc:304] T 5485933837894417a3f0f89d55af1296 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:09:19.120317 14557 raft_consensus.cc:2749] T 5485933837894417a3f0f89d55af1296 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:19.118606 14379 ts_tablet_manager.cc:1403] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c: Time spent bootstrapping tablet: real 0.324s	user 0.011s	sys 0.018s
I20260709 12:09:19.127199 14562 leader_election.cc:290] T 3832505489c04d04a69e256187061921 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:19.142488 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:19.148590 14230 leader_election.cc:304] T 3832505489c04d04a69e256187061921 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:09:19.149756 14406 consensus_queue.cc:1048] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:19.134907 14557 consensus_queue.cc:1048] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.020s
I20260709 12:09:19.157992 14406 raft_consensus.cc:2749] T 3832505489c04d04a69e256187061921 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:19.160760 14380 tablet_bootstrap.cc:654] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.172147 14379 raft_consensus.cc:359] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:19.172966 14379 raft_consensus.cc:385] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.173250 14379 raft_consensus.cc:740] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.180006 14648 raft_consensus.cc:515] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:19.181562 14381 tablet_bootstrap.cc:492] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf: No bootstrap required, opened a new log
I20260709 12:09:19.184932 14381 ts_tablet_manager.cc:1403] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf: Time spent bootstrapping tablet: real 0.382s	user 0.044s	sys 0.034s
I20260709 12:09:19.184798 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:09:19.185670 14260 raft_consensus.cc:3060] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:09:19.187407 14303 consensus_peers.cc:597] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:19.188954 14381 raft_consensus.cc:359] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:19.192061 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:09:19.194123 14338 raft_consensus.cc:3060] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:19.193100 14648 leader_election.cc:290] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 2 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:19.201658 14434 raft_consensus.cc:493] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.209723 14434 raft_consensus.cc:515] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:19.211537 14381 raft_consensus.cc:385] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.214005 14381 raft_consensus.cc:740] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.214999 14434 leader_election.cc:290] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:19.215354 14381 consensus_queue.cc:260] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:19.218204 14381 ts_tablet_manager.cc:1434] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf: Time spent starting tablet: real 0.033s	user 0.003s	sys 0.005s
I20260709 12:09:19.219481 14381 tablet_bootstrap.cc:492] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf: Bootstrap starting.
I20260709 12:09:19.215286 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:19.220763 14338 raft_consensus.cc:2468] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 2.
I20260709 12:09:19.226069 14380 tablet_bootstrap.cc:492] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec: No bootstrap required, opened a new log
I20260709 12:09:19.224819 14379 consensus_queue.cc:260] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:19.236125 14380 ts_tablet_manager.cc:1403] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec: Time spent bootstrapping tablet: real 0.230s	user 0.020s	sys 0.013s
I20260709 12:09:19.237396 14379 ts_tablet_manager.cc:1434] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c: Time spent starting tablet: real 0.115s	user 0.005s	sys 0.002s
I20260709 12:09:19.239149 14379 tablet_bootstrap.cc:492] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c: Bootstrap starting.
I20260709 12:09:19.249701 14155 leader_election.cc:304] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:09:19.250700 14648 raft_consensus.cc:2804] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:19.251233 14648 raft_consensus.cc:697] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 2 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:09:19.252290 14648 consensus_queue.cc:237] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:19.233068 14262 raft_consensus.cc:3060] T 5485933837894417a3f0f89d55af1296 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.231873 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:19.259951 14261 raft_consensus.cc:2393] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 1: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:09:19.266492 14304 leader_election.cc:304] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:09:19.272616 14667 raft_consensus.cc:3060] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.288197 14260 raft_consensus.cc:2468] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 2.
I20260709 12:09:19.315945 14380 raft_consensus.cc:359] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:19.316732 14380 raft_consensus.cc:385] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.317107 14380 raft_consensus.cc:740] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.317934 14380 consensus_queue.cc:260] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:19.319154 14381 tablet_bootstrap.cc:654] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.320927 14380 ts_tablet_manager.cc:1434] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec: Time spent starting tablet: real 0.084s	user 0.003s	sys 0.004s
I20260709 12:09:19.326526 14086 catalog_manager.cc:5697] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf reported cstate change: term changed from 0 to 2, leader changed from <none> to 885067a0d31741bfb5c9935788e315bf (127.12.174.129). New cstate: current_term: 2 leader_uuid: "885067a0d31741bfb5c9935788e315bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:19.332151 14380 tablet_bootstrap.cc:492] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec: Bootstrap starting.
I20260709 12:09:19.341926 14525 consensus_queue.cc:1048] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:19.345438 14669 raft_consensus.cc:493] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.354067 14669 raft_consensus.cc:515] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:19.357527 14379 tablet_bootstrap.cc:654] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.360085 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:19.360996 14188 raft_consensus.cc:2468] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 0.
I20260709 12:09:19.364332 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:19.365233 14669 leader_election.cc:290] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:19.366364 14303 leader_election.cc:304] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
W20260709 12:09:19.367918 14304 leader_election.cc:343] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.369477 14434 raft_consensus.cc:2804] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:19.370132 14434 raft_consensus.cc:493] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:19.370661 14434 raft_consensus.cc:3060] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.389228 14667 raft_consensus.cc:2749] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:19.398077 14379 tablet_bootstrap.cc:492] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c: No bootstrap required, opened a new log
I20260709 12:09:19.397861 14434 raft_consensus.cc:515] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:19.400738 14525 consensus_queue.cc:1048] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:19.402360 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:09:19.403193 14188 raft_consensus.cc:3060] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.403370 14434 leader_election.cc:290] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:19.404917 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
W20260709 12:09:19.406443 14304 leader_election.cc:343] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.398702 14379 ts_tablet_manager.cc:1403] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c: Time spent bootstrapping tablet: real 0.160s	user 0.013s	sys 0.013s
I20260709 12:09:19.415189 14188 raft_consensus.cc:2468] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 1.
I20260709 12:09:19.416702 14303 leader_election.cc:304] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:09:19.427983 14667 raft_consensus.cc:2804] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:19.428845 14667 raft_consensus.cc:697] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:09:19.429836 14379 raft_consensus.cc:359] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:19.430595 14379 raft_consensus.cc:385] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.430858 14379 raft_consensus.cc:740] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.431584 14379 consensus_queue.cc:260] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:19.432914 14380 tablet_bootstrap.cc:654] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.434005 14379 ts_tablet_manager.cc:1434] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 12:09:19.435061 14379 tablet_bootstrap.cc:492] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c: Bootstrap starting.
I20260709 12:09:19.441295 14667 consensus_queue.cc:237] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:19.458720 14379 tablet_bootstrap.cc:654] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.484675 14381 tablet_bootstrap.cc:492] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf: No bootstrap required, opened a new log
I20260709 12:09:19.485158 14381 ts_tablet_manager.cc:1403] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf: Time spent bootstrapping tablet: real 0.266s	user 0.009s	sys 0.014s
I20260709 12:09:19.485373 14380 tablet_bootstrap.cc:492] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec: No bootstrap required, opened a new log
I20260709 12:09:19.485898 14380 ts_tablet_manager.cc:1403] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec: Time spent bootstrapping tablet: real 0.156s	user 0.011s	sys 0.016s
I20260709 12:09:19.489362 14381 raft_consensus.cc:359] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:19.490229 14381 raft_consensus.cc:385] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.490281 14380 raft_consensus.cc:359] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:19.490904 14380 raft_consensus.cc:385] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.491214 14380 raft_consensus.cc:740] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.490535 14381 raft_consensus.cc:740] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.491518 14087 catalog_manager.cc:5697] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c reported cstate change: term changed from 0 to 1, leader changed from <none> to 65c9c1653b3346b39a0e118540e6080c (127.12.174.131). New cstate: current_term: 1 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:19.493253 14379 tablet_bootstrap.cc:492] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c: No bootstrap required, opened a new log
I20260709 12:09:19.493755 14379 ts_tablet_manager.cc:1403] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c: Time spent bootstrapping tablet: real 0.059s	user 0.018s	sys 0.007s
I20260709 12:09:19.493584 14380 consensus_queue.cc:260] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:19.494788 14381 consensus_queue.cc:260] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:19.502995 14379 raft_consensus.cc:359] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:19.503931 14379 raft_consensus.cc:385] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.504254 14379 raft_consensus.cc:740] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.504974 14379 consensus_queue.cc:260] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:19.509634 14379 ts_tablet_manager.cc:1434] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 12:09:19.510941 14379 tablet_bootstrap.cc:492] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c: Bootstrap starting.
I20260709 12:09:19.512392 14381 ts_tablet_manager.cc:1434] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf: Time spent starting tablet: real 0.027s	user 0.001s	sys 0.007s
I20260709 12:09:19.513783 14381 tablet_bootstrap.cc:492] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf: Bootstrap starting.
I20260709 12:09:19.522569 14380 ts_tablet_manager.cc:1434] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.000s
I20260709 12:09:19.523985 14380 tablet_bootstrap.cc:492] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec: Bootstrap starting.
I20260709 12:09:19.533895 14380 tablet_bootstrap.cc:654] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.538132 14381 tablet_bootstrap.cc:654] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.547663 14379 tablet_bootstrap.cc:654] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.558077 14381 tablet_bootstrap.cc:492] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf: No bootstrap required, opened a new log
I20260709 12:09:19.559270 14381 ts_tablet_manager.cc:1403] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf: Time spent bootstrapping tablet: real 0.046s	user 0.023s	sys 0.001s
I20260709 12:09:19.570716 14381 raft_consensus.cc:359] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:19.571504 14381 raft_consensus.cc:385] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.573204 14560 raft_consensus.cc:493] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.573364 14381 raft_consensus.cc:740] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.573897 14560 raft_consensus.cc:515] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:19.574977 14381 consensus_queue.cc:260] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:19.577381 14381 ts_tablet_manager.cc:1434] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf: Time spent starting tablet: real 0.017s	user 0.004s	sys 0.003s
I20260709 12:09:19.577481 14379 tablet_bootstrap.cc:492] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c: No bootstrap required, opened a new log
I20260709 12:09:19.579567 14379 ts_tablet_manager.cc:1403] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c: Time spent bootstrapping tablet: real 0.067s	user 0.016s	sys 0.014s
I20260709 12:09:19.581632 14381 tablet_bootstrap.cc:492] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf: Bootstrap starting.
I20260709 12:09:19.583630 14379 raft_consensus.cc:359] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:19.584481 14379 raft_consensus.cc:385] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.584862 14379 raft_consensus.cc:740] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.584874 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:19.585901 14379 consensus_queue.cc:260] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:19.586249 14627 raft_consensus.cc:493] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.586925 14627 raft_consensus.cc:515] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:19.588033 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:19.589125 14188 raft_consensus.cc:2393] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 1: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:09:19.590983 14229 leader_election.cc:304] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:09:19.591516 14560 leader_election.cc:290] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:19.591310 14627 leader_election.cc:290] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:19.592621 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:09:19.595409 14155 leader_election.cc:343] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.593233 14380 tablet_bootstrap.cc:492] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec: No bootstrap required, opened a new log
I20260709 12:09:19.596664 14380 ts_tablet_manager.cc:1403] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec: Time spent bootstrapping tablet: real 0.073s	user 0.020s	sys 0.018s
I20260709 12:09:19.598788 14560 raft_consensus.cc:3060] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.599059 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:09:19.601063 14155 leader_election.cc:343] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.601541 14155 leader_election.cc:304] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:09:19.602759 14627 raft_consensus.cc:2749] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:19.603786 14379 ts_tablet_manager.cc:1434] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.000s
I20260709 12:09:19.605206 14379 tablet_bootstrap.cc:492] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c: Bootstrap starting.
I20260709 12:09:19.608109 14380 raft_consensus.cc:359] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:19.608945 14380 raft_consensus.cc:385] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.609299 14380 raft_consensus.cc:740] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.609486 14560 raft_consensus.cc:2749] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:19.610344 14380 consensus_queue.cc:260] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:19.613095 14380 ts_tablet_manager.cc:1434] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.004s
I20260709 12:09:19.615939 14379 tablet_bootstrap.cc:654] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.617285 14380 tablet_bootstrap.cc:492] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec: Bootstrap starting.
I20260709 12:09:19.615725 14381 tablet_bootstrap.cc:654] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.630867 14380 tablet_bootstrap.cc:654] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.639307 14647 raft_consensus.cc:493] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.640151 14647 raft_consensus.cc:515] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:19.645037 14381 tablet_bootstrap.cc:492] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf: No bootstrap required, opened a new log
I20260709 12:09:19.645684 14381 ts_tablet_manager.cc:1403] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf: Time spent bootstrapping tablet: real 0.064s	user 0.016s	sys 0.009s
I20260709 12:09:19.649556 14381 raft_consensus.cc:359] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:19.650455 14381 raft_consensus.cc:385] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.650771 14381 raft_consensus.cc:740] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.651505 14381 consensus_queue.cc:260] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:19.657665 14647 leader_election.cc:290] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:19.661420 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:19.673375 14337 raft_consensus.cc:2468] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 0.
I20260709 12:09:19.671813 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:19.674757 14155 leader_election.cc:304] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:09:19.658098 14381 ts_tablet_manager.cc:1434] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:09:19.676569 14627 raft_consensus.cc:2804] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:19.677246 14627 raft_consensus.cc:493] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:19.680717 14381 tablet_bootstrap.cc:492] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf: Bootstrap starting.
I20260709 12:09:19.684234 14265 raft_consensus.cc:1275] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:09:19.686976 14666 consensus_queue.cc:1048] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:19.693892 14627 raft_consensus.cc:3060] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.696343 14381 tablet_bootstrap.cc:654] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.674855 14262 raft_consensus.cc:2468] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 0.
I20260709 12:09:19.708732 14627 raft_consensus.cc:515] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:19.718334 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:09:19.719208 14265 raft_consensus.cc:3060] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.744874 14627 leader_election.cc:290] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:19.746371 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:09:19.747628 14335 raft_consensus.cc:3060] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.749071 14379 tablet_bootstrap.cc:492] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c: No bootstrap required, opened a new log
I20260709 12:09:19.749573 14379 ts_tablet_manager.cc:1403] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c: Time spent bootstrapping tablet: real 0.145s	user 0.051s	sys 0.071s
I20260709 12:09:19.742188 14560 raft_consensus.cc:493] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.763104 14434 raft_consensus.cc:493] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.763851 14434 raft_consensus.cc:515] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:19.772410 14335 raft_consensus.cc:2468] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 1.
I20260709 12:09:19.751780 14560 raft_consensus.cc:515] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:19.787039 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:09:19.790535 14229 leader_election.cc:343] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.793715 14379 raft_consensus.cc:359] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:19.795065 14379 raft_consensus.cc:385] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.795498 14379 raft_consensus.cc:740] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.796301 14379 consensus_queue.cc:260] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:19.797514 14380 tablet_bootstrap.cc:492] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec: No bootstrap required, opened a new log
I20260709 12:09:19.798015 14380 ts_tablet_manager.cc:1403] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec: Time spent bootstrapping tablet: real 0.181s	user 0.035s	sys 0.064s
I20260709 12:09:19.805214 14379 ts_tablet_manager.cc:1434] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c: Time spent starting tablet: real 0.055s	user 0.008s	sys 0.000s
I20260709 12:09:19.805533 14434 leader_election.cc:290] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:19.807418 14560 leader_election.cc:290] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:19.811668 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:19.812155 14379 tablet_bootstrap.cc:492] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c: Bootstrap starting.
W20260709 12:09:19.813284 14304 leader_election.cc:343] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.814666 14380 raft_consensus.cc:359] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:19.815361 14380 raft_consensus.cc:385] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.815653 14380 raft_consensus.cc:740] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.815441 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:19.816807 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:09:19.817451 14303 leader_election.cc:343] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.817911 14303 leader_election.cc:304] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:09:19.818466 14380 consensus_queue.cc:260] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:19.821076 14155 leader_election.cc:304] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:09:19.821156 14380 ts_tablet_manager.cc:1434] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec: Time spent starting tablet: real 0.023s	user 0.004s	sys 0.002s
W20260709 12:09:19.822944 14230 leader_election.cc:343] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.823621 14647 raft_consensus.cc:2804] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:19.824301 14647 raft_consensus.cc:697] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 1 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:09:19.825944 14667 raft_consensus.cc:2749] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:19.825536 14647 consensus_queue.cc:237] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:19.834398 14381 tablet_bootstrap.cc:492] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf: No bootstrap required, opened a new log
I20260709 12:09:19.834956 14381 ts_tablet_manager.cc:1403] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf: Time spent bootstrapping tablet: real 0.155s	user 0.038s	sys 0.052s
I20260709 12:09:19.829569 14334 raft_consensus.cc:1275] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:09:19.823341 14230 leader_election.cc:304] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:09:19.840332 14560 raft_consensus.cc:2749] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:19.850301 14434 raft_consensus.cc:493] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.850939 14434 raft_consensus.cc:515] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:19.851189 14381 raft_consensus.cc:359] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:19.851933 14381 raft_consensus.cc:385] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.852234 14381 raft_consensus.cc:740] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.852965 14381 consensus_queue.cc:260] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:19.853519 14434 leader_election.cc:290] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:09:19.854347 14136 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:09:19.855299 14381 ts_tablet_manager.cc:1434] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.003s
I20260709 12:09:19.855309 14525 consensus_queue.cc:1048] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:19.856492 14381 tablet_bootstrap.cc:492] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf: Bootstrap starting.
I20260709 12:09:19.857067 14380 tablet_bootstrap.cc:492] T 3c9d740fa53e42179ad8d244b4c179fd P 17aab1bbf5014936aa18cc21818b26ec: Bootstrap starting.
I20260709 12:09:19.862339 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:19.885057 14525 raft_consensus.cc:493] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.885991 14525 raft_consensus.cc:515] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:19.892444 14525 leader_election.cc:290] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:19.863619 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:19.861558 14265 raft_consensus.cc:2468] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 1.
W20260709 12:09:19.898111 14304 leader_election.cc:343] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.908624 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:19.909364 14335 raft_consensus.cc:2468] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 0.
I20260709 12:09:19.911194 14380 tablet_bootstrap.cc:654] T 3c9d740fa53e42179ad8d244b4c179fd P 17aab1bbf5014936aa18cc21818b26ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.912850 14155 leader_election.cc:304] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:09:19.918071 14379 tablet_bootstrap.cc:654] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c: Neither blocks nor log segments found. Creating new log.
W20260709 12:09:19.920195 14303 leader_election.cc:343] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.922444 14303 leader_election.cc:304] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:09:19.919144 14647 raft_consensus.cc:2804] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:19.925725 14647 raft_consensus.cc:493] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:19.935446 14434 raft_consensus.cc:2749] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:19.932732 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:19.933512 14627 raft_consensus.cc:493] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.939849 14627 raft_consensus.cc:515] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:19.940460 14086 catalog_manager.cc:5697] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf reported cstate change: term changed from 0 to 1, leader changed from <none> to 885067a0d31741bfb5c9935788e315bf (127.12.174.129). New cstate: current_term: 1 leader_uuid: "885067a0d31741bfb5c9935788e315bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } }
W20260709 12:09:19.944518 14155 leader_election.cc:343] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.950659 14627 leader_election.cc:290] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:19.950701 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:19.953234 14381 tablet_bootstrap.cc:654] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.934598 14647 raft_consensus.cc:3060] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:19.961558 14155 leader_election.cc:343] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.961691 14434 consensus_queue.cc:1048] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:19.968644 14380 tablet_bootstrap.cc:492] T 3c9d740fa53e42179ad8d244b4c179fd P 17aab1bbf5014936aa18cc21818b26ec: No bootstrap required, opened a new log
I20260709 12:09:19.969607 14380 ts_tablet_manager.cc:1403] T 3c9d740fa53e42179ad8d244b4c179fd P 17aab1bbf5014936aa18cc21818b26ec: Time spent bootstrapping tablet: real 0.119s	user 0.014s	sys 0.020s
I20260709 12:09:19.971048 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:19.974364 14379 tablet_bootstrap.cc:492] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c: No bootstrap required, opened a new log
I20260709 12:09:19.975021 14379 ts_tablet_manager.cc:1403] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c: Time spent bootstrapping tablet: real 0.163s	user 0.016s	sys 0.006s
W20260709 12:09:19.978690 14155 leader_election.cc:343] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.979255 14155 leader_election.cc:304] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:09:19.980433 14525 raft_consensus.cc:2749] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:19.981225 14380 raft_consensus.cc:359] T 3c9d740fa53e42179ad8d244b4c179fd P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:19.984339 14380 raft_consensus.cc:385] T 3c9d740fa53e42179ad8d244b4c179fd P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.984699 14380 raft_consensus.cc:740] T 3c9d740fa53e42179ad8d244b4c179fd P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.986039 14380 consensus_queue.cc:260] T 3c9d740fa53e42179ad8d244b4c179fd P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:19.987982 14380 ts_tablet_manager.cc:1434] T 3c9d740fa53e42179ad8d244b4c179fd P 17aab1bbf5014936aa18cc21818b26ec: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.000s
I20260709 12:09:19.995265 14379 raft_consensus.cc:359] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:20.001175 14379 raft_consensus.cc:385] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.001600 14379 raft_consensus.cc:740] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.997000 14647 raft_consensus.cc:515] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:20.004489 14647 leader_election.cc:290] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:20.002316 14379 consensus_queue.cc:260] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:20.005488 14189 raft_consensus.cc:3060] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.007918 14379 ts_tablet_manager.cc:1434] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.000s
I20260709 12:09:20.009622 14379 tablet_bootstrap.cc:492] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c: Bootstrap starting.
I20260709 12:09:20.012984 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:09:20.013674 14335 raft_consensus.cc:3060] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.014703 14380 tablet_bootstrap.cc:492] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec: Bootstrap starting.
I20260709 12:09:20.017784 14381 tablet_bootstrap.cc:492] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf: No bootstrap required, opened a new log
I20260709 12:09:20.018364 14381 ts_tablet_manager.cc:1403] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf: Time spent bootstrapping tablet: real 0.162s	user 0.014s	sys 0.016s
I20260709 12:09:20.023347 14335 raft_consensus.cc:2468] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 1.
I20260709 12:09:20.025571 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:09:20.026521 14265 raft_consensus.cc:3060] T 3c9d740fa53e42179ad8d244b4c179fd P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.030562 14155 leader_election.cc:304] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:09:19.998574 14694 consensus_queue.cc:1048] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.033s
I20260709 12:09:20.032716 14647 raft_consensus.cc:2804] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:20.033465 14647 raft_consensus.cc:697] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 1 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:09:20.034781 14647 consensus_queue.cc:237] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:20.046465 14265 raft_consensus.cc:2468] T 3c9d740fa53e42179ad8d244b4c179fd P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 1.
I20260709 12:09:20.055084 14381 raft_consensus.cc:359] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:20.055987 14381 raft_consensus.cc:385] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.063884 14379 tablet_bootstrap.cc:654] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.093380 14380 tablet_bootstrap.cc:654] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.110157 14379 tablet_bootstrap.cc:492] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c: No bootstrap required, opened a new log
I20260709 12:09:20.110800 14379 ts_tablet_manager.cc:1403] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c: Time spent bootstrapping tablet: real 0.101s	user 0.015s	sys 0.004s
I20260709 12:09:20.114573 14379 raft_consensus.cc:359] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:20.115399 14379 raft_consensus.cc:385] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.115756 14379 raft_consensus.cc:740] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.116539 14379 consensus_queue.cc:260] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:20.056303 14381 raft_consensus.cc:740] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.119222 14379 ts_tablet_manager.cc:1434] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:09:20.120841 14379 tablet_bootstrap.cc:492] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c: Bootstrap starting.
I20260709 12:09:20.128317 14381 consensus_queue.cc:260] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:20.129961 14379 tablet_bootstrap.cc:654] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.130503 14381 ts_tablet_manager.cc:1434] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf: Time spent starting tablet: real 0.112s	user 0.005s	sys 0.003s
I20260709 12:09:20.131470 14381 tablet_bootstrap.cc:492] T 981a078d2d9d479abecc8b0b45771080 P 885067a0d31741bfb5c9935788e315bf: Bootstrap starting.
I20260709 12:09:20.145268 14381 tablet_bootstrap.cc:654] T 981a078d2d9d479abecc8b0b45771080 P 885067a0d31741bfb5c9935788e315bf: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.152734 14379 tablet_bootstrap.cc:492] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c: No bootstrap required, opened a new log
I20260709 12:09:20.153352 14380 tablet_bootstrap.cc:492] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec: No bootstrap required, opened a new log
I20260709 12:09:20.153400 14379 ts_tablet_manager.cc:1403] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c: Time spent bootstrapping tablet: real 0.033s	user 0.013s	sys 0.017s
I20260709 12:09:20.153978 14380 ts_tablet_manager.cc:1403] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec: Time spent bootstrapping tablet: real 0.165s	user 0.014s	sys 0.009s
I20260709 12:09:20.156795 14380 raft_consensus.cc:359] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:20.157567 14380 raft_consensus.cc:385] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.157851 14380 raft_consensus.cc:740] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.158520 14380 consensus_queue.cc:260] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:20.160043 14086 catalog_manager.cc:5697] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf reported cstate change: term changed from 0 to 1, leader changed from <none> to 885067a0d31741bfb5c9935788e315bf (127.12.174.129). New cstate: current_term: 1 leader_uuid: "885067a0d31741bfb5c9935788e315bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:20.156636 14379 raft_consensus.cc:359] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:20.174850 14379 raft_consensus.cc:385] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.177910 14379 raft_consensus.cc:740] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.178722 14379 consensus_queue.cc:260] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:20.180455 14379 ts_tablet_manager.cc:1434] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c: Time spent starting tablet: real 0.026s	user 0.004s	sys 0.000s
I20260709 12:09:20.181453 14379 tablet_bootstrap.cc:492] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c: Bootstrap starting.
I20260709 12:09:20.176566 14380 ts_tablet_manager.cc:1434] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.000s
I20260709 12:09:20.182739 14380 tablet_bootstrap.cc:492] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec: Bootstrap starting.
I20260709 12:09:20.188720 14379 tablet_bootstrap.cc:654] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.193476 14380 tablet_bootstrap.cc:654] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.216652 14695 raft_consensus.cc:493] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.217303 14695 raft_consensus.cc:515] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:20.220300 14381 tablet_bootstrap.cc:492] T 981a078d2d9d479abecc8b0b45771080 P 885067a0d31741bfb5c9935788e315bf: No bootstrap required, opened a new log
I20260709 12:09:20.363059 14381 ts_tablet_manager.cc:1403] T 981a078d2d9d479abecc8b0b45771080 P 885067a0d31741bfb5c9935788e315bf: Time spent bootstrapping tablet: real 0.232s	user 0.050s	sys 0.074s
I20260709 12:09:20.271296 14557 raft_consensus.cc:493] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.366379 14557 raft_consensus.cc:515] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:20.366678 14381 raft_consensus.cc:359] T 981a078d2d9d479abecc8b0b45771080 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:20.371030 14381 raft_consensus.cc:385] T 981a078d2d9d479abecc8b0b45771080 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.220304 14695 leader_election.cc:290] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:20.371852 14381 raft_consensus.cc:740] T 981a078d2d9d479abecc8b0b45771080 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.374617 14381 consensus_queue.cc:260] T 981a078d2d9d479abecc8b0b45771080 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:20.377384 14381 ts_tablet_manager.cc:1434] T 981a078d2d9d479abecc8b0b45771080 P 885067a0d31741bfb5c9935788e315bf: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.001s
I20260709 12:09:20.377578 14525 consensus_queue.cc:1048] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:20.369273 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:20.222626 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:20.378650 14381 tablet_bootstrap.cc:492] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf: Bootstrap starting.
I20260709 12:09:20.379092 14265 raft_consensus.cc:2468] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 0.
I20260709 12:09:20.380219 14695 raft_consensus.cc:493] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.380728 14695 raft_consensus.cc:515] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:20.385977 14381 tablet_bootstrap.cc:654] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.386240 14380 tablet_bootstrap.cc:492] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec: No bootstrap required, opened a new log
I20260709 12:09:20.387913 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:20.388686 14188 raft_consensus.cc:2468] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 0.
I20260709 12:09:20.230201 14647 raft_consensus.cc:493] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.390183 14647 raft_consensus.cc:515] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:20.387938 14380 ts_tablet_manager.cc:1403] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec: Time spent bootstrapping tablet: real 0.205s	user 0.050s	sys 0.064s
I20260709 12:09:20.394797 14695 leader_election.cc:290] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:20.396342 14647 leader_election.cc:290] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:20.396219 14380 raft_consensus.cc:359] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:20.397611 14380 raft_consensus.cc:385] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.398059 14380 raft_consensus.cc:740] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.399175 14380 consensus_queue.cc:260] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:20.402122 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:20.403190 14666 raft_consensus.cc:493] T 981a078d2d9d479abecc8b0b45771080 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.403863 14666 raft_consensus.cc:515] T 981a078d2d9d479abecc8b0b45771080 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:20.406672 14380 ts_tablet_manager.cc:1434] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.003s
I20260709 12:09:20.407756 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:20.407827 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:20.407889 14380 tablet_bootstrap.cc:492] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec: Bootstrap starting.
I20260709 12:09:20.408456 14188 raft_consensus.cc:2468] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 0.
I20260709 12:09:20.409941 14666 leader_election.cc:290] T 981a078d2d9d479abecc8b0b45771080 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:09:20.410167 14155 leader_election.cc:343] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.414443 14229 leader_election.cc:304] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:09:20.415397 14560 raft_consensus.cc:2804] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:20.415992 14560 raft_consensus.cc:493] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:20.416512 14560 raft_consensus.cc:3060] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.416427 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:20.415431 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:09:20.420430 14303 leader_election.cc:343] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.421541 14303 leader_election.cc:304] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:09:20.421976 14380 tablet_bootstrap.cc:654] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.423092 14696 raft_consensus.cc:2804] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:20.423718 14696 raft_consensus.cc:493] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:20.424295 14696 raft_consensus.cc:3060] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:20.426462 14155 leader_election.cc:343] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.429782 14381 tablet_bootstrap.cc:492] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf: No bootstrap required, opened a new log
I20260709 12:09:20.430799 14155 leader_election.cc:304] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:09:20.431057 14381 ts_tablet_manager.cc:1403] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf: Time spent bootstrapping tablet: real 0.053s	user 0.012s	sys 0.003s
I20260709 12:09:20.433795 14666 raft_consensus.cc:2749] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:09:20.435400 14155 leader_election.cc:343] T 981a078d2d9d479abecc8b0b45771080 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.435289 14381 raft_consensus.cc:359] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:20.438748 14381 raft_consensus.cc:385] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:09:20.438894 14155 leader_election.cc:343] T 981a078d2d9d479abecc8b0b45771080 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.439190 14381 raft_consensus.cc:740] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.441357 14155 leader_election.cc:304] T 981a078d2d9d479abecc8b0b45771080 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:09:20.442099 14381 consensus_queue.cc:260] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:20.442446 14666 raft_consensus.cc:2749] T 981a078d2d9d479abecc8b0b45771080 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:20.444778 14381 ts_tablet_manager.cc:1434] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.003s
I20260709 12:09:20.446171 14381 tablet_bootstrap.cc:492] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf: Bootstrap starting.
I20260709 12:09:20.452119 14560 raft_consensus.cc:515] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:20.457201 14380 tablet_bootstrap.cc:492] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec: No bootstrap required, opened a new log
I20260709 12:09:20.433314 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:20.467150 14380 ts_tablet_manager.cc:1403] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec: Time spent bootstrapping tablet: real 0.060s	user 0.005s	sys 0.020s
I20260709 12:09:20.474736 14304 leader_election.cc:304] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:09:20.480767 14667 raft_consensus.cc:2804] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:20.481396 14667 raft_consensus.cc:493] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:20.481917 14667 raft_consensus.cc:3060] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.480862 14379 tablet_bootstrap.cc:492] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c: No bootstrap required, opened a new log
I20260709 12:09:20.488857 14379 ts_tablet_manager.cc:1403] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c: Time spent bootstrapping tablet: real 0.308s	user 0.012s	sys 0.004s
I20260709 12:09:20.459504 14647 consensus_queue.cc:1048] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.019s
I20260709 12:09:20.496347 14557 leader_election.cc:290] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:20.503211 14381 tablet_bootstrap.cc:654] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.504930 14560 leader_election.cc:290] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:20.507347 14265 raft_consensus.cc:2393] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 1: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:09:20.507462 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:09:20.508203 14188 raft_consensus.cc:3060] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.508781 14713 raft_consensus.cc:493] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.509492 14713 raft_consensus.cc:515] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:20.523111 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:20.524078 14189 raft_consensus.cc:2468] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 0.
I20260709 12:09:20.526198 14229 leader_election.cc:304] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:09:20.527436 14708 raft_consensus.cc:2804] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:20.527967 14708 raft_consensus.cc:493] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:20.528448 14708 raft_consensus.cc:3060] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.528795 14188 raft_consensus.cc:2468] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 1.
I20260709 12:09:20.532891 14696 raft_consensus.cc:515] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:20.528456 14667 raft_consensus.cc:515] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:20.534235 14229 leader_election.cc:304] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:09:20.537107 14665 raft_consensus.cc:2804] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:20.537936 14665 raft_consensus.cc:697] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 1 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:09:20.539302 14665 consensus_queue.cc:237] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:09:20.542366 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 74250.9us
I20260709 12:09:20.537544 14713 leader_election.cc:290] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:20.549220 14380 raft_consensus.cc:359] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:20.550028 14380 raft_consensus.cc:385] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.550324 14380 raft_consensus.cc:740] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.537439 14379 raft_consensus.cc:359] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:20.551622 14379 raft_consensus.cc:385] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.551869 14379 raft_consensus.cc:740] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.553153 14379 consensus_queue.cc:260] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:20.550905 14666 consensus_queue.cc:1048] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 12:09:20.557113 14380 consensus_queue.cc:260] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:20.560418 14379 ts_tablet_manager.cc:1434] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c: Time spent starting tablet: real 0.071s	user 0.000s	sys 0.007s
I20260709 12:09:20.567220 14667 leader_election.cc:290] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:20.568022 14696 leader_election.cc:290] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:20.568323 14708 raft_consensus.cc:515] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:20.577199 14708 leader_election.cc:290] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:20.579641 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:20.580677 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:09:20.583788 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:09:20.584684 14188 raft_consensus.cc:2393] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 1: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:09:20.585752 14379 tablet_bootstrap.cc:492] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c: Bootstrap starting.
I20260709 12:09:20.590094 14715 raft_consensus.cc:493] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.587522 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:09:20.587059 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:09:20.592881 14380 ts_tablet_manager.cc:1434] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec: Time spent starting tablet: real 0.124s	user 0.009s	sys 0.007s
I20260709 12:09:20.593782 14184 raft_consensus.cc:3060] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.594492 14339 raft_consensus.cc:3060] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.602732 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:09:20.604463 14380 tablet_bootstrap.cc:492] T 2b1a5d42755443119571654ad5c5f2f3 P 17aab1bbf5014936aa18cc21818b26ec: Bootstrap starting.
I20260709 12:09:20.590813 14715 raft_consensus.cc:515] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:20.599162 14338 raft_consensus.cc:2393] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 1: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:09:20.598644 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:20.608460 14557 raft_consensus.cc:493] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.631410 14088 catalog_manager.cc:5697] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: term changed from 0 to 1, leader changed from <none> to 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130). New cstate: current_term: 1 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } }
W20260709 12:09:20.633653 14303 leader_election.cc:343] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.632143 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:09:20.638772 14557 raft_consensus.cc:515] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:20.651310 14557 leader_election.cc:290] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:20.653184 14381 tablet_bootstrap.cc:492] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf: No bootstrap required, opened a new log
I20260709 12:09:20.654309 14381 ts_tablet_manager.cc:1403] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf: Time spent bootstrapping tablet: real 0.209s	user 0.015s	sys 0.024s
I20260709 12:09:20.670694 14715 leader_election.cc:290] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:20.672513 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:09:20.669516 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:20.647630 14261 raft_consensus.cc:3060] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:20.689579 14229 leader_election.cc:343] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.698786 14339 raft_consensus.cc:2468] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 1.
I20260709 12:09:20.702984 14381 raft_consensus.cc:359] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:20.703889 14381 raft_consensus.cc:385] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.704173 14381 raft_consensus.cc:740] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.710345 14525 consensus_queue.cc:1048] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:20.724011 14380 tablet_bootstrap.cc:654] T 2b1a5d42755443119571654ad5c5f2f3 P 17aab1bbf5014936aa18cc21818b26ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.734916 14381 consensus_queue.cc:260] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:20.740878 14230 leader_election.cc:304] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:09:20.741942 14406 raft_consensus.cc:2804] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:20.743220 14379 tablet_bootstrap.cc:654] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.742476 14406 raft_consensus.cc:697] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 1 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:09:20.747164 14304 leader_election.cc:304] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:09:20.746479 14406 consensus_queue.cc:237] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:20.750093 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:20.750970 14337 raft_consensus.cc:2468] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 0.
I20260709 12:09:20.737037 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:20.753239 14381 ts_tablet_manager.cc:1434] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf: Time spent starting tablet: real 0.099s	user 0.006s	sys 0.005s
I20260709 12:09:20.899046 14381 tablet_bootstrap.cc:492] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf: Bootstrap starting.
I20260709 12:09:20.795590 14723 raft_consensus.cc:2749] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:09:20.911670 14381 tablet_bootstrap.cc:654] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.810691 14627 raft_consensus.cc:493] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.914191 14627 raft_consensus.cc:515] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:20.922923 14627 leader_election.cc:290] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:20.896941 14184 raft_consensus.cc:2468] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 1.
I20260709 12:09:20.915271 14379 tablet_bootstrap.cc:492] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c: No bootstrap required, opened a new log
I20260709 12:09:20.928099 14379 ts_tablet_manager.cc:1403] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c: Time spent bootstrapping tablet: real 0.343s	user 0.036s	sys 0.004s
I20260709 12:09:20.925554 14380 tablet_bootstrap.cc:492] T 2b1a5d42755443119571654ad5c5f2f3 P 17aab1bbf5014936aa18cc21818b26ec: No bootstrap required, opened a new log
I20260709 12:09:20.933542 14380 ts_tablet_manager.cc:1403] T 2b1a5d42755443119571654ad5c5f2f3 P 17aab1bbf5014936aa18cc21818b26ec: Time spent bootstrapping tablet: real 0.335s	user 0.030s	sys 0.011s
I20260709 12:09:20.936786 14381 tablet_bootstrap.cc:492] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf: No bootstrap required, opened a new log
I20260709 12:09:20.937987 14230 leader_election.cc:304] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:09:20.938683 14381 ts_tablet_manager.cc:1403] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf: Time spent bootstrapping tablet: real 0.040s	user 0.008s	sys 0.004s
W20260709 12:09:20.939368 14303 leader_election.cc:343] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.941326 14713 raft_consensus.cc:2804] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:20.941727 14713 raft_consensus.cc:493] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:20.942140 14713 raft_consensus.cc:3060] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.949542 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:20.955910 14381 raft_consensus.cc:359] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:20.956804 14381 raft_consensus.cc:385] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.957207 14381 raft_consensus.cc:740] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.957796 14261 raft_consensus.cc:2468] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 1.
I20260709 12:09:20.958142 14381 consensus_queue.cc:260] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:20.960379 14381 ts_tablet_manager.cc:1434] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf: Time spent starting tablet: real 0.021s	user 0.004s	sys 0.003s
I20260709 12:09:20.961557 14381 tablet_bootstrap.cc:492] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf: Bootstrap starting.
I20260709 12:09:20.956501 14713 raft_consensus.cc:515] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:09:20.969038 14725 log.cc:927] Time spent T 3c9d740fa53e42179ad8d244b4c179fd P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.068s	user 0.000s	sys 0.004s
W20260709 12:09:20.973515 14727 log.cc:927] Time spent T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.075s	user 0.002s	sys 0.000s
I20260709 12:09:20.974823 14713 leader_election.cc:290] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:20.979056 14380 raft_consensus.cc:359] T 2b1a5d42755443119571654ad5c5f2f3 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:20.981264 14380 raft_consensus.cc:385] T 2b1a5d42755443119571654ad5c5f2f3 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.988792 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:09:20.989575 14333 raft_consensus.cc:3060] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.993297 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:09:20.997453 14381 tablet_bootstrap.cc:654] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.000257 14379 raft_consensus.cc:359] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:21.003849 14379 raft_consensus.cc:385] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.982611 14380 raft_consensus.cc:740] T 2b1a5d42755443119571654ad5c5f2f3 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.004390 14379 raft_consensus.cc:740] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.005070 14380 consensus_queue.cc:260] T 2b1a5d42755443119571654ad5c5f2f3 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:21.005273 14379 consensus_queue.cc:260] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:21.019673 14667 raft_consensus.cc:493] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.020282 14667 raft_consensus.cc:515] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:21.020681 14380 ts_tablet_manager.cc:1434] T 2b1a5d42755443119571654ad5c5f2f3 P 17aab1bbf5014936aa18cc21818b26ec: Time spent starting tablet: real 0.085s	user 0.006s	sys 0.000s
I20260709 12:09:21.021625 14380 tablet_bootstrap.cc:492] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec: Bootstrap starting.
I20260709 12:09:21.022573 14667 leader_election.cc:290] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:09:21.028215 14229 leader_election.cc:343] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.031013 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:21.035287 14184 raft_consensus.cc:2468] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 0.
I20260709 12:09:21.051281 14303 leader_election.cc:304] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:09:21.053385 14695 raft_consensus.cc:2804] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:21.053632 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:21.058370 14714 raft_consensus.cc:493] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.058625 14379 ts_tablet_manager.cc:1434] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c: Time spent starting tablet: real 0.127s	user 0.007s	sys 0.000s
I20260709 12:09:21.049494 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:21.059830 14379 tablet_bootstrap.cc:492] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c: Bootstrap starting.
I20260709 12:09:21.059770 14261 raft_consensus.cc:2468] T 2b1a5d42755443119571654ad5c5f2f3 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 0.
I20260709 12:09:21.018893 14333 raft_consensus.cc:2468] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 1.
I20260709 12:09:21.053706 14695 raft_consensus.cc:493] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:21.068785 14304 leader_election.cc:304] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:09:21.069607 14695 raft_consensus.cc:3060] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.071244 14434 raft_consensus.cc:2804] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:09:21.067713 14136 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:09:21.071760 14434 raft_consensus.cc:697] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:09:21.072933 14434 consensus_queue.cc:237] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:21.067273 14667 raft_consensus.cc:493] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.078787 14230 leader_election.cc:304] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:09:21.086766 14731 raft_consensus.cc:2804] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:21.087404 14731 raft_consensus.cc:697] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 1 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:09:21.088290 14731 consensus_queue.cc:237] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:21.059054 14714 raft_consensus.cc:515] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:21.098040 14264 raft_consensus.cc:2468] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 0.
I20260709 12:09:21.083222 14667 raft_consensus.cc:515] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:21.073992 14708 consensus_queue.cc:1048] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 12:09:21.103850 14560 consensus_queue.cc:1048] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:21.112138 14695 raft_consensus.cc:515] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:21.117929 14714 leader_election.cc:290] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:21.145186 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:21.145483 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:21.147944 14381 tablet_bootstrap.cc:492] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf: No bootstrap required, opened a new log
I20260709 12:09:21.196239 14381 ts_tablet_manager.cc:1403] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf: Time spent bootstrapping tablet: real 0.235s	user 0.013s	sys 0.026s
I20260709 12:09:21.147964 14087 catalog_manager.cc:5697] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: term changed from 0 to 1, leader changed from <none> to 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130). New cstate: current_term: 1 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:21.199193 14380 tablet_bootstrap.cc:654] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.203332 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:21.204316 14189 raft_consensus.cc:2468] T 981a078d2d9d479abecc8b0b45771080 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 0.
I20260709 12:09:21.206471 14303 leader_election.cc:304] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:09:21.208716 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:09:21.209398 14184 raft_consensus.cc:3060] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.192564 14667 leader_election.cc:290] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:21.216388 14379 tablet_bootstrap.cc:654] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.148552 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:21.218055 14336 raft_consensus.cc:2468] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 0.
I20260709 12:09:21.211611 14696 raft_consensus.cc:2804] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:21.219900 14696 raft_consensus.cc:493] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:21.221379 14696 raft_consensus.cc:3060] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.220000 14184 raft_consensus.cc:2468] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 1.
I20260709 12:09:21.224409 14381 raft_consensus.cc:359] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:21.225154 14381 raft_consensus.cc:385] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.225407 14381 raft_consensus.cc:740] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.230381 14303 leader_election.cc:304] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:09:21.232477 14230 leader_election.cc:304] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:09:21.201565 14186 raft_consensus.cc:2468] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 0.
I20260709 12:09:21.234963 14381 consensus_queue.cc:260] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:21.236060 14713 raft_consensus.cc:2804] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:21.240670 14713 raft_consensus.cc:493] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:21.242288 14713 raft_consensus.cc:3060] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.249460 14155 leader_election.cc:304] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:09:21.251129 14627 raft_consensus.cc:2749] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:21.259878 14381 ts_tablet_manager.cc:1434] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf: Time spent starting tablet: real 0.063s	user 0.003s	sys 0.004s
I20260709 12:09:21.284729 14304 leader_election.cc:304] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:09:21.279429 14085 catalog_manager.cc:5697] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c reported cstate change: term changed from 0 to 1, leader changed from <none> to 65c9c1653b3346b39a0e118540e6080c (127.12.174.131). New cstate: current_term: 1 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:21.290038 14695 leader_election.cc:290] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:21.302356 14724 raft_consensus.cc:2804] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:21.304091 14724 raft_consensus.cc:697] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:09:21.314142 14434 raft_consensus.cc:2804] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:21.314682 14434 raft_consensus.cc:493] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:21.315042 14434 raft_consensus.cc:3060] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.338336 14381 tablet_bootstrap.cc:492] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf: Bootstrap starting.
I20260709 12:09:21.305697 14724 consensus_queue.cc:237] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:21.308436 14731 consensus_queue.cc:1048] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.039s
I20260709 12:09:21.368582 14696 raft_consensus.cc:515] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:21.361402 14434 raft_consensus.cc:515] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:21.407035 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:09:21.408073 14264 raft_consensus.cc:3060] T 2b1a5d42755443119571654ad5c5f2f3 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.379068 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:21.409588 14434 leader_election.cc:290] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:21.458155 14379 tablet_bootstrap.cc:492] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c: No bootstrap required, opened a new log
I20260709 12:09:21.459136 14379 ts_tablet_manager.cc:1403] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c: Time spent bootstrapping tablet: real 0.400s	user 0.029s	sys 0.018s
I20260709 12:09:21.457454 14708 consensus_queue.cc:1048] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:09:21.464833 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
W20260709 12:09:21.467543 14304 leader_election.cc:343] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.468003 14380 tablet_bootstrap.cc:492] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec: No bootstrap required, opened a new log
I20260709 12:09:21.468479 14380 ts_tablet_manager.cc:1403] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec: Time spent bootstrapping tablet: real 0.447s	user 0.036s	sys 0.031s
I20260709 12:09:21.480273 14379 raft_consensus.cc:359] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:21.481238 14379 raft_consensus.cc:385] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.481544 14379 raft_consensus.cc:740] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.482354 14379 consensus_queue.cc:260] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:21.484730 14379 ts_tablet_manager.cc:1434] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.001s
I20260709 12:09:21.487747 14379 tablet_bootstrap.cc:492] T e244b5af3ce244339f6fe0bd22a35eba P 65c9c1653b3346b39a0e118540e6080c: Bootstrap starting.
I20260709 12:09:21.490178 14380 raft_consensus.cc:359] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:21.496963 14380 raft_consensus.cc:385] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.497416 14380 raft_consensus.cc:740] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.499681 14380 consensus_queue.cc:260] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:21.486858 14189 raft_consensus.cc:3060] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.528896 14088 catalog_manager.cc:5697] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: term changed from 0 to 1, leader changed from <none> to 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130). New cstate: current_term: 1 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:21.531780 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:09:21.537542 14380 ts_tablet_manager.cc:1434] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec: Time spent starting tablet: real 0.066s	user 0.007s	sys 0.003s
I20260709 12:09:21.548239 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:09:21.549264 14184 raft_consensus.cc:3060] T 981a078d2d9d479abecc8b0b45771080 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.518215 14627 raft_consensus.cc:493] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.535782 14713 raft_consensus.cc:515] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:21.573266 14380 tablet_bootstrap.cc:492] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec: Bootstrap starting.
I20260709 12:09:21.577591 14713 leader_election.cc:290] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:21.566457 14627 raft_consensus.cc:515] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:21.594211 14258 raft_consensus.cc:2393] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 1: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:09:21.624722 14627 leader_election.cc:290] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:21.626027 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:09:21.627463 14696 leader_election.cc:290] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:21.655086 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:09:21.656298 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:09:21.658402 14258 raft_consensus.cc:3060] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:21.662247 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 61245.3us
I20260709 12:09:21.651439 14379 tablet_bootstrap.cc:654] T e244b5af3ce244339f6fe0bd22a35eba P 65c9c1653b3346b39a0e118540e6080c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.666378 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:21.668188 14334 raft_consensus.cc:2393] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 1: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:09:21.670451 14339 raft_consensus.cc:2393] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 1: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:09:21.681661 14381 tablet_bootstrap.cc:654] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.701601 14380 tablet_bootstrap.cc:654] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec: Neither blocks nor log segments found. Creating new log.
W20260709 12:09:21.711023 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 86840.2us
I20260709 12:09:21.683800 14187 raft_consensus.cc:3060] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.689373 14264 raft_consensus.cc:2468] T 2b1a5d42755443119571654ad5c5f2f3 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 1.
W20260709 12:09:21.733861 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 88253.4us
I20260709 12:09:21.736861 14230 leader_election.cc:304] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:09:21.740101 14189 raft_consensus.cc:2468] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 1.
I20260709 12:09:21.702508 14258 raft_consensus.cc:2468] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 1.
I20260709 12:09:21.776429 14708 raft_consensus.cc:2749] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:09:21.777318 14185 raft_consensus.cc:3060] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.738658 14723 consensus_queue.cc:1048] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 12:09:21.720155 14721 raft_consensus.cc:493] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.780764 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:09:21.795481 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 56837.1us
I20260709 12:09:21.809693 14304 leader_election.cc:304] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:09:21.800885 14721 raft_consensus.cc:515] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:21.822443 14721 leader_election.cc:290] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:09:21.796367 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 57837.5us
I20260709 12:09:21.787496 14088 catalog_manager.cc:5697] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c reported cstate change: term changed from 0 to 1, leader changed from <none> to 65c9c1653b3346b39a0e118540e6080c (127.12.174.131). New cstate: current_term: 1 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:21.846808 14155 leader_election.cc:304] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:09:21.871515 14303 leader_election.cc:304] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:09:21.817031 14184 raft_consensus.cc:2468] T 981a078d2d9d479abecc8b0b45771080 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 1.
I20260709 12:09:21.887225 14434 raft_consensus.cc:2804] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:21.887770 14380 tablet_bootstrap.cc:492] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec: No bootstrap required, opened a new log
I20260709 12:09:21.887810 14434 raft_consensus.cc:697] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:09:21.888304 14380 ts_tablet_manager.cc:1403] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec: Time spent bootstrapping tablet: real 0.326s	user 0.014s	sys 0.015s
I20260709 12:09:21.888878 14434 consensus_queue.cc:237] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:21.851145 14723 raft_consensus.cc:2804] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:09:21.912825 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 66123.1us
I20260709 12:09:21.915678 14379 tablet_bootstrap.cc:492] T e244b5af3ce244339f6fe0bd22a35eba P 65c9c1653b3346b39a0e118540e6080c: No bootstrap required, opened a new log
I20260709 12:09:21.916338 14379 ts_tablet_manager.cc:1403] T e244b5af3ce244339f6fe0bd22a35eba P 65c9c1653b3346b39a0e118540e6080c: Time spent bootstrapping tablet: real 0.429s	user 0.019s	sys 0.008s
I20260709 12:09:21.904242 14525 raft_consensus.cc:2749] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:21.887483 14734 consensus_queue.cc:1048] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.029s
W20260709 12:09:21.922763 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 51347.8us
I20260709 12:09:21.911099 14723 raft_consensus.cc:697] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:09:21.926468 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:09:21.933442 14303 leader_election.cc:343] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.934607 14723 consensus_queue.cc:237] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:09:21.960222 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 75455.4us
I20260709 12:09:21.966848 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:21.967989 14381 tablet_bootstrap.cc:492] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf: No bootstrap required, opened a new log
I20260709 12:09:21.968585 14381 ts_tablet_manager.cc:1403] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf: Time spent bootstrapping tablet: real 0.644s	user 0.024s	sys 0.065s
I20260709 12:09:21.973001 14381 raft_consensus.cc:359] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:21.975643 14381 raft_consensus.cc:385] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.962576 14379 raft_consensus.cc:359] T e244b5af3ce244339f6fe0bd22a35eba P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:21.980813 14379 raft_consensus.cc:385] T e244b5af3ce244339f6fe0bd22a35eba P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.980671 14695 consensus_queue.cc:1048] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:21.981202 14379 raft_consensus.cc:740] T e244b5af3ce244339f6fe0bd22a35eba P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.981899 14381 raft_consensus.cc:740] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.982790 14381 consensus_queue.cc:260] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:21.983453 14667 consensus_queue.cc:1048] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:21.985299 14381 ts_tablet_manager.cc:1434] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.002s
I20260709 12:09:21.986440 14381 tablet_bootstrap.cc:492] T f4739bc22bfe44fcba807da02d9351b6 P 885067a0d31741bfb5c9935788e315bf: Bootstrap starting.
I20260709 12:09:21.987548 14379 consensus_queue.cc:260] T e244b5af3ce244339f6fe0bd22a35eba P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:21.990195 14379 ts_tablet_manager.cc:1434] T e244b5af3ce244339f6fe0bd22a35eba P 65c9c1653b3346b39a0e118540e6080c: Time spent starting tablet: real 0.073s	user 0.012s	sys 0.001s
I20260709 12:09:21.991320 14379 tablet_bootstrap.cc:492] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c: Bootstrap starting.
W20260709 12:09:21.977605 14304 leader_election.cc:343] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.994498 14304 leader_election.cc:304] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:09:21.997906 14738 raft_consensus.cc:2749] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:22.013532 14380 raft_consensus.cc:359] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:22.015440 14380 raft_consensus.cc:385] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.015770 14380 raft_consensus.cc:740] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.045956 14667 consensus_queue.cc:1048] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:22.046747 14627 raft_consensus.cc:493] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:22.046897 14380 consensus_queue.cc:260] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:22.047407 14627 raft_consensus.cc:515] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:22.062767 14627 leader_election.cc:290] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:22.066421 14379 tablet_bootstrap.cc:654] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c: Neither blocks nor log segments found. Creating new log.
W20260709 12:09:22.069589 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 162396us
I20260709 12:09:22.073107 14381 tablet_bootstrap.cc:654] T f4739bc22bfe44fcba807da02d9351b6 P 885067a0d31741bfb5c9935788e315bf: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.084817 14380 ts_tablet_manager.cc:1434] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec: Time spent starting tablet: real 0.196s	user 0.006s	sys 0.002s
I20260709 12:09:22.119287 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:22.120095 14339 raft_consensus.cc:2468] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 0.
I20260709 12:09:22.124259 14155 leader_election.cc:304] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:09:22.126850 14717 raft_consensus.cc:2804] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:22.127274 14717 raft_consensus.cc:493] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:22.125618 14380 tablet_bootstrap.cc:492] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec: Bootstrap starting.
I20260709 12:09:22.127606 14717 raft_consensus.cc:3060] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.138862 14380 tablet_bootstrap.cc:654] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec: Neither blocks nor log segments found. Creating new log.
W20260709 12:09:22.138952 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 284579us
I20260709 12:09:22.140028 14756 consensus_queue.cc:1048] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:22.144284 14379 tablet_bootstrap.cc:492] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c: No bootstrap required, opened a new log
I20260709 12:09:22.144881 14379 ts_tablet_manager.cc:1403] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c: Time spent bootstrapping tablet: real 0.154s	user 0.009s	sys 0.004s
I20260709 12:09:22.144781 14717 raft_consensus.cc:515] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:22.148239 14756 raft_consensus.cc:493] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:22.149029 14756 raft_consensus.cc:515] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:22.153707 14756 leader_election.cc:290] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:22.155511 14379 raft_consensus.cc:359] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:22.156302 14379 raft_consensus.cc:385] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.156627 14379 raft_consensus.cc:740] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.156719 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:09:22.157492 14339 raft_consensus.cc:3060] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.164795 14339 raft_consensus.cc:2468] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 1.
I20260709 12:09:22.165347 14717 leader_election.cc:290] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:22.166898 14379 consensus_queue.cc:260] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:22.171015 14379 ts_tablet_manager.cc:1434] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260709 12:09:22.172343 14379 tablet_bootstrap.cc:492] T 15f7cecfe772454980c8ae9d1803fe98 P 65c9c1653b3346b39a0e118540e6080c: Bootstrap starting.
I20260709 12:09:22.175230 14381 tablet_bootstrap.cc:492] T f4739bc22bfe44fcba807da02d9351b6 P 885067a0d31741bfb5c9935788e315bf: No bootstrap required, opened a new log
I20260709 12:09:22.175837 14381 ts_tablet_manager.cc:1403] T f4739bc22bfe44fcba807da02d9351b6 P 885067a0d31741bfb5c9935788e315bf: Time spent bootstrapping tablet: real 0.190s	user 0.012s	sys 0.000s
I20260709 12:09:22.176476 14155 leader_election.cc:304] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:09:22.177383 14525 raft_consensus.cc:2804] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:22.177922 14525 raft_consensus.cc:697] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 1 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:09:22.178710 14381 raft_consensus.cc:359] T f4739bc22bfe44fcba807da02d9351b6 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:22.179464 14381 raft_consensus.cc:385] T f4739bc22bfe44fcba807da02d9351b6 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.178764 14525 consensus_queue.cc:237] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:22.179741 14381 raft_consensus.cc:740] T f4739bc22bfe44fcba807da02d9351b6 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.180452 14381 consensus_queue.cc:260] T f4739bc22bfe44fcba807da02d9351b6 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:22.182439 14381 ts_tablet_manager.cc:1434] T f4739bc22bfe44fcba807da02d9351b6 P 885067a0d31741bfb5c9935788e315bf: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:09:22.183578 14381 tablet_bootstrap.cc:492] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf: Bootstrap starting.
I20260709 12:09:22.184917 14379 tablet_bootstrap.cc:654] T 15f7cecfe772454980c8ae9d1803fe98 P 65c9c1653b3346b39a0e118540e6080c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.198920 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:22.193691 14381 tablet_bootstrap.cc:654] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.204051 14759 raft_consensus.cc:493] T e244b5af3ce244339f6fe0bd22a35eba P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:09:22.224252 14136 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:09:22.224993 14380 tablet_bootstrap.cc:492] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec: No bootstrap required, opened a new log
I20260709 12:09:22.225592 14380 ts_tablet_manager.cc:1403] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec: Time spent bootstrapping tablet: real 0.100s	user 0.016s	sys 0.012s
I20260709 12:09:22.208022 14759 raft_consensus.cc:515] T e244b5af3ce244339f6fe0bd22a35eba P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:22.239347 14333 raft_consensus.cc:2468] T e244b5af3ce244339f6fe0bd22a35eba P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 0.
I20260709 12:09:22.260190 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:09:22.284716 14379 tablet_bootstrap.cc:492] T 15f7cecfe772454980c8ae9d1803fe98 P 65c9c1653b3346b39a0e118540e6080c: No bootstrap required, opened a new log
I20260709 12:09:22.292250 14379 ts_tablet_manager.cc:1403] T 15f7cecfe772454980c8ae9d1803fe98 P 65c9c1653b3346b39a0e118540e6080c: Time spent bootstrapping tablet: real 0.120s	user 0.011s	sys 0.009s
I20260709 12:09:22.299114 14759 leader_election.cc:290] T e244b5af3ce244339f6fe0bd22a35eba P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:22.300101 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:22.323104 14379 raft_consensus.cc:359] T 15f7cecfe772454980c8ae9d1803fe98 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:22.324813 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:22.330933 14265 raft_consensus.cc:2468] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 0.
I20260709 12:09:22.326210 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:22.332075 14185 raft_consensus.cc:2468] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 0.
I20260709 12:09:22.328745 14379 raft_consensus.cc:385] T 15f7cecfe772454980c8ae9d1803fe98 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.333328 14379 raft_consensus.cc:740] T 15f7cecfe772454980c8ae9d1803fe98 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.334167 14379 consensus_queue.cc:260] T 15f7cecfe772454980c8ae9d1803fe98 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:22.338542 14304 leader_election.cc:304] T e244b5af3ce244339f6fe0bd22a35eba P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:09:22.348088 14230 leader_election.cc:304] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:09:22.349608 14379 ts_tablet_manager.cc:1434] T 15f7cecfe772454980c8ae9d1803fe98 P 65c9c1653b3346b39a0e118540e6080c: Time spent starting tablet: real 0.057s	user 0.007s	sys 0.001s
I20260709 12:09:22.344383 14724 raft_consensus.cc:2804] T e244b5af3ce244339f6fe0bd22a35eba P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:22.358830 14379 tablet_bootstrap.cc:492] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c: Bootstrap starting.
I20260709 12:09:22.362661 14708 raft_consensus.cc:2804] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:22.363198 14708 raft_consensus.cc:493] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:22.363565 14708 raft_consensus.cc:3060] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.357587 14724 raft_consensus.cc:493] T e244b5af3ce244339f6fe0bd22a35eba P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:22.370122 14724 raft_consensus.cc:3060] T e244b5af3ce244339f6fe0bd22a35eba P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.388542 14738 consensus_queue.cc:1048] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:22.388808 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:22.389711 14190 raft_consensus.cc:2468] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 0.
I20260709 12:09:22.385298 14721 raft_consensus.cc:493] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:22.420042 14381 tablet_bootstrap.cc:492] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf: No bootstrap required, opened a new log
I20260709 12:09:22.420706 14381 ts_tablet_manager.cc:1403] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf: Time spent bootstrapping tablet: real 0.237s	user 0.013s	sys 0.013s
I20260709 12:09:22.395989 14721 raft_consensus.cc:515] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:09:22.433437 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 71418.9us
W20260709 12:09:22.439109 14155 leader_election.cc:343] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:22.440184 14155 leader_election.cc:343] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.446817 14380 raft_consensus.cc:359] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:22.472295 14380 raft_consensus.cc:385] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.472617 14380 raft_consensus.cc:740] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.474545 14381 raft_consensus.cc:359] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:22.475284 14381 raft_consensus.cc:385] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.475528 14381 raft_consensus.cc:740] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.476186 14381 consensus_queue.cc:260] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:22.470479 14759 consensus_queue.cc:1048] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 12:09:22.486641 14381 ts_tablet_manager.cc:1434] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf: Time spent starting tablet: real 0.066s	user 0.004s	sys 0.003s
I20260709 12:09:22.489992 14380 consensus_queue.cc:260] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:22.495711 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:09:22.499053 14782 log.cc:927] Time spent T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 12:09:22.496577 14721 leader_election.cc:290] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:22.500156 14381 tablet_bootstrap.cc:492] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf: Bootstrap starting.
I20260709 12:09:22.496522 14708 raft_consensus.cc:515] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:22.503899 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:09:22.506381 14380 ts_tablet_manager.cc:1434] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec: Time spent starting tablet: real 0.279s	user 0.039s	sys 0.023s
I20260709 12:09:22.519078 14380 tablet_bootstrap.cc:492] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec: Bootstrap starting.
I20260709 12:09:22.504137 14708 leader_election.cc:290] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:22.503942 14379 tablet_bootstrap.cc:654] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.504038 14724 raft_consensus.cc:515] T e244b5af3ce244339f6fe0bd22a35eba P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:22.524765 14339 raft_consensus.cc:2393] T e244b5af3ce244339f6fe0bd22a35eba P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 1: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:09:22.527842 14724 leader_election.cc:290] T e244b5af3ce244339f6fe0bd22a35eba P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:22.529042 14381 tablet_bootstrap.cc:654] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf: Neither blocks nor log segments found. Creating new log.
W20260709 12:09:22.531104 14303 leader_election.cc:343] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.531800 14783 raft_consensus.cc:493] T f4739bc22bfe44fcba807da02d9351b6 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:22.532269 14783 raft_consensus.cc:515] T f4739bc22bfe44fcba807da02d9351b6 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:22.535313 14380 tablet_bootstrap.cc:654] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec: Neither blocks nor log segments found. Creating new log.
W20260709 12:09:22.537729 14768 log.cc:927] Time spent T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.185s	user 0.005s	sys 0.004s
I20260709 12:09:22.538784 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:09:22.539584 14259 raft_consensus.cc:2393] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 1: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:09:22.537883 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:09:22.547232 14304 leader_election.cc:343] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.547686 14304 leader_election.cc:304] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:09:22.547274 14738 consensus_queue.cc:1048] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:22.548554 14667 raft_consensus.cc:2749] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:22.547850 14085 catalog_manager.cc:5697] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf reported cstate change: term changed from 0 to 1, leader changed from <none> to 885067a0d31741bfb5c9935788e315bf (127.12.174.129). New cstate: current_term: 1 leader_uuid: "885067a0d31741bfb5c9935788e315bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:22.555742 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:22.556185 14783 leader_election.cc:290] T f4739bc22bfe44fcba807da02d9351b6 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:22.557116 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:22.560458 14434 consensus_queue.cc:1048] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:22.562140 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:09:22.562767 14186 raft_consensus.cc:3060] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:22.563592 14155 leader_election.cc:343] T f4739bc22bfe44fcba807da02d9351b6 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:22.564298 14155 leader_election.cc:343] T f4739bc22bfe44fcba807da02d9351b6 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.564685 14155 leader_election.cc:304] T f4739bc22bfe44fcba807da02d9351b6 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:09:22.565991 14525 raft_consensus.cc:2749] T f4739bc22bfe44fcba807da02d9351b6 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:22.569839 14186 raft_consensus.cc:2468] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 1.
I20260709 12:09:22.574133 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:09:22.574994 14183 raft_consensus.cc:2393] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 1: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:09:22.578703 14229 leader_election.cc:304] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:09:22.590229 14303 leader_election.cc:304] T e244b5af3ce244339f6fe0bd22a35eba P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:09:22.622144 14759 raft_consensus.cc:493] T 15f7cecfe772454980c8ae9d1803fe98 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:22.622956 14759 raft_consensus.cc:515] T 15f7cecfe772454980c8ae9d1803fe98 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:22.625824 14738 raft_consensus.cc:2749] T e244b5af3ce244339f6fe0bd22a35eba P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:09:22.631400 14379 tablet_bootstrap.cc:492] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c: No bootstrap required, opened a new log
I20260709 12:09:22.631970 14379 ts_tablet_manager.cc:1403] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c: Time spent bootstrapping tablet: real 0.273s	user 0.025s	sys 0.001s
I20260709 12:09:22.616031 14752 raft_consensus.cc:2804] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:22.652259 14379 raft_consensus.cc:359] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:22.653035 14379 raft_consensus.cc:385] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.653309 14379 raft_consensus.cc:740] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.654019 14379 consensus_queue.cc:260] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:22.659319 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:09:22.661175 14304 leader_election.cc:343] T 15f7cecfe772454980c8ae9d1803fe98 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.652457 14759 leader_election.cc:290] T 15f7cecfe772454980c8ae9d1803fe98 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:22.666733 14381 tablet_bootstrap.cc:492] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf: No bootstrap required, opened a new log
I20260709 12:09:22.667260 14381 ts_tablet_manager.cc:1403] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf: Time spent bootstrapping tablet: real 0.167s	user 0.030s	sys 0.021s
I20260709 12:09:22.670575 14379 ts_tablet_manager.cc:1434] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c: Time spent starting tablet: real 0.038s	user 0.008s	sys 0.001s
I20260709 12:09:22.672495 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:22.676234 14381 raft_consensus.cc:359] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:22.658162 14752 raft_consensus.cc:697] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 1 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:09:22.684022 14381 raft_consensus.cc:385] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.684859 14381 raft_consensus.cc:740] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.686322 14381 consensus_queue.cc:260] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:09:22.682862 14155 consensus_peers.cc:597] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf -> Peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Couldn't send request to peer 17aab1bbf5014936aa18cc21818b26ec. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:22.685082 14752 consensus_queue.cc:237] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:22.682516 14380 tablet_bootstrap.cc:492] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec: No bootstrap required, opened a new log
I20260709 12:09:22.690076 14379 tablet_bootstrap.cc:492] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c: Bootstrap starting.
I20260709 12:09:22.690589 14380 ts_tablet_manager.cc:1403] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec: Time spent bootstrapping tablet: real 0.172s	user 0.046s	sys 0.030s
I20260709 12:09:22.693161 14381 ts_tablet_manager.cc:1434] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.002s
W20260709 12:09:22.692512 14303 leader_election.cc:343] T 15f7cecfe772454980c8ae9d1803fe98 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.695446 14303 leader_election.cc:304] T 15f7cecfe772454980c8ae9d1803fe98 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:09:22.696312 14381 tablet_bootstrap.cc:492] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf: Bootstrap starting.
I20260709 12:09:22.696834 14434 raft_consensus.cc:2749] T 15f7cecfe772454980c8ae9d1803fe98 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:22.725416 14380 raft_consensus.cc:359] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:22.726366 14380 raft_consensus.cc:385] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.726637 14380 raft_consensus.cc:740] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.729097 14380 consensus_queue.cc:260] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:22.731958 14380 ts_tablet_manager.cc:1434] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec: Time spent starting tablet: real 0.041s	user 0.008s	sys 0.000s
I20260709 12:09:22.733040 14380 tablet_bootstrap.cc:492] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec: Bootstrap starting.
I20260709 12:09:22.736742 14379 tablet_bootstrap.cc:654] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.749652 14525 consensus_queue.cc:1048] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 12:09:22.749701 14088 catalog_manager.cc:5697] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c reported cstate change: term changed from 0 to 1, leader changed from <none> to 65c9c1653b3346b39a0e118540e6080c (127.12.174.131). New cstate: current_term: 1 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:22.759086 14380 tablet_bootstrap.cc:654] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.758302 14088 catalog_manager.cc:5697] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c reported cstate change: term changed from 0 to 1, leader changed from <none> to 65c9c1653b3346b39a0e118540e6080c (127.12.174.131). New cstate: current_term: 1 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:22.762547 14381 tablet_bootstrap.cc:654] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.795730 14783 raft_consensus.cc:493] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:22.796504 14783 raft_consensus.cc:515] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:22.800637 14783 leader_election.cc:290] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:22.807056 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:22.808185 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:09:22.809544 14155 leader_election.cc:343] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:22.817509 14155 leader_election.cc:343] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.817989 14155 leader_election.cc:304] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:09:22.823342 14627 raft_consensus.cc:2749] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:22.829663 14380 tablet_bootstrap.cc:492] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec: No bootstrap required, opened a new log
I20260709 12:09:22.830399 14380 ts_tablet_manager.cc:1403] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec: Time spent bootstrapping tablet: real 0.098s	user 0.014s	sys 0.020s
I20260709 12:09:22.835035 14380 raft_consensus.cc:359] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:22.835690 14380 raft_consensus.cc:385] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.835969 14380 raft_consensus.cc:740] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.836716 14380 consensus_queue.cc:260] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:22.845387 14380 ts_tablet_manager.cc:1434] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.003s
I20260709 12:09:22.846470 14380 tablet_bootstrap.cc:492] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec: Bootstrap starting.
I20260709 12:09:22.860319 14379 tablet_bootstrap.cc:492] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c: No bootstrap required, opened a new log
I20260709 12:09:22.860872 14379 ts_tablet_manager.cc:1403] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c: Time spent bootstrapping tablet: real 0.173s	user 0.017s	sys 0.017s
I20260709 12:09:22.871861 14379 raft_consensus.cc:359] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:22.877918 14379 raft_consensus.cc:385] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.878228 14379 raft_consensus.cc:740] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.875101 14381 tablet_bootstrap.cc:492] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf: No bootstrap required, opened a new log
I20260709 12:09:22.879310 14381 ts_tablet_manager.cc:1403] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf: Time spent bootstrapping tablet: real 0.183s	user 0.016s	sys 0.019s
I20260709 12:09:22.872853 14087 catalog_manager.cc:5697] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: term changed from 0 to 1, leader changed from <none> to 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130). New cstate: current_term: 1 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:22.886868 14381 raft_consensus.cc:359] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:22.887600 14381 raft_consensus.cc:385] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.887866 14381 raft_consensus.cc:740] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.885032 14379 consensus_queue.cc:260] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:22.891458 14379 ts_tablet_manager.cc:1434] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c: Time spent starting tablet: real 0.030s	user 0.009s	sys 0.002s
I20260709 12:09:22.888540 14381 consensus_queue.cc:260] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:22.904897 14379 tablet_bootstrap.cc:492] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c: Bootstrap starting.
I20260709 12:09:22.890401 14380 tablet_bootstrap.cc:654] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.909593 14381 ts_tablet_manager.cc:1434] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.000s
I20260709 12:09:22.918984 14381 tablet_bootstrap.cc:492] T 02513fb0dbdd4cbdb019d79f0f448d18 P 885067a0d31741bfb5c9935788e315bf: Bootstrap starting.
I20260709 12:09:22.939054 14380 tablet_bootstrap.cc:492] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec: No bootstrap required, opened a new log
I20260709 12:09:22.939695 14380 ts_tablet_manager.cc:1403] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec: Time spent bootstrapping tablet: real 0.093s	user 0.010s	sys 0.007s
I20260709 12:09:22.941576 14381 tablet_bootstrap.cc:654] T 02513fb0dbdd4cbdb019d79f0f448d18 P 885067a0d31741bfb5c9935788e315bf: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.951792 14380 raft_consensus.cc:359] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:22.952693 14380 raft_consensus.cc:385] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.953018 14380 raft_consensus.cc:740] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.953982 14380 consensus_queue.cc:260] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:22.955366 14379 tablet_bootstrap.cc:654] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.956383 14380 ts_tablet_manager.cc:1434] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec: Time spent starting tablet: real 0.016s	user 0.009s	sys 0.000s
I20260709 12:09:22.957808 14380 tablet_bootstrap.cc:492] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec: Bootstrap starting.
I20260709 12:09:22.966032 14627 raft_consensus.cc:493] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:22.966580 14627 raft_consensus.cc:515] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:22.968638 14627 leader_election.cc:290] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:22.970758 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:22.971467 14259 raft_consensus.cc:2468] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 0.
I20260709 12:09:22.972559 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:22.973029 14379 tablet_bootstrap.cc:492] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c: No bootstrap required, opened a new log
I20260709 12:09:22.973134 14339 raft_consensus.cc:2468] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 0.
I20260709 12:09:22.973538 14379 ts_tablet_manager.cc:1403] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c: Time spent bootstrapping tablet: real 0.069s	user 0.011s	sys 0.008s
I20260709 12:09:22.974017 14381 tablet_bootstrap.cc:492] T 02513fb0dbdd4cbdb019d79f0f448d18 P 885067a0d31741bfb5c9935788e315bf: No bootstrap required, opened a new log
I20260709 12:09:22.974442 14381 ts_tablet_manager.cc:1403] T 02513fb0dbdd4cbdb019d79f0f448d18 P 885067a0d31741bfb5c9935788e315bf: Time spent bootstrapping tablet: real 0.056s	user 0.011s	sys 0.008s
I20260709 12:09:22.974534 14155 leader_election.cc:304] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:09:22.975365 14627 raft_consensus.cc:2804] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:22.975718 14627 raft_consensus.cc:493] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:22.976033 14627 raft_consensus.cc:3060] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.976941 14379 raft_consensus.cc:359] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:22.977046 14381 raft_consensus.cc:359] T 02513fb0dbdd4cbdb019d79f0f448d18 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:22.977761 14379 raft_consensus.cc:385] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.977836 14381 raft_consensus.cc:385] T 02513fb0dbdd4cbdb019d79f0f448d18 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.978088 14379 raft_consensus.cc:740] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.978174 14381 raft_consensus.cc:740] T 02513fb0dbdd4cbdb019d79f0f448d18 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.978811 14379 consensus_queue.cc:260] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:22.978945 14381 consensus_queue.cc:260] T 02513fb0dbdd4cbdb019d79f0f448d18 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:22.981003 14381 ts_tablet_manager.cc:1434] T 02513fb0dbdd4cbdb019d79f0f448d18 P 885067a0d31741bfb5c9935788e315bf: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:09:22.981185 14379 ts_tablet_manager.cc:1434] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:09:22.982033 14381 tablet_bootstrap.cc:492] T d82ca0c0e51a4e148b8d3e226ff7cebb P 885067a0d31741bfb5c9935788e315bf: Bootstrap starting.
I20260709 12:09:22.982540 14379 tablet_bootstrap.cc:492] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c: Bootstrap starting.
I20260709 12:09:22.993980 14381 tablet_bootstrap.cc:654] T d82ca0c0e51a4e148b8d3e226ff7cebb P 885067a0d31741bfb5c9935788e315bf: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.999612 14379 tablet_bootstrap.cc:654] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.014437 14627 raft_consensus.cc:515] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:23.017370 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:09:23.017699 14379 tablet_bootstrap.cc:492] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c: No bootstrap required, opened a new log
I20260709 12:09:23.018349 14379 ts_tablet_manager.cc:1403] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c: Time spent bootstrapping tablet: real 0.036s	user 0.002s	sys 0.019s
I20260709 12:09:23.019306 14259 raft_consensus.cc:3060] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.021965 14379 raft_consensus.cc:359] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:23.022709 14379 raft_consensus.cc:385] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.022972 14379 raft_consensus.cc:740] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.024158 14379 consensus_queue.cc:260] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:23.033711 14379 ts_tablet_manager.cc:1434] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 12:09:23.034843 14379 tablet_bootstrap.cc:492] T 0a11d7ae457a408cac205ac501217c61 P 65c9c1653b3346b39a0e118540e6080c: Bootstrap starting.
I20260709 12:09:23.041208 14379 tablet_bootstrap.cc:654] T 0a11d7ae457a408cac205ac501217c61 P 65c9c1653b3346b39a0e118540e6080c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.045552 14259 raft_consensus.cc:2468] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 1.
I20260709 12:09:23.046830 14155 leader_election.cc:304] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:09:23.048974 14525 raft_consensus.cc:2804] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:23.049463 14525 raft_consensus.cc:697] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 1 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:09:23.050309 14525 consensus_queue.cc:237] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:23.058153 14731 raft_consensus.cc:493] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.058666 14731 raft_consensus.cc:515] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:23.061772 14731 leader_election.cc:290] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:23.062121 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:23.063319 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:23.064913 14229 leader_election.cc:304] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:09:23.065929 14731 raft_consensus.cc:2749] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:23.072299 14380 tablet_bootstrap.cc:700] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec: Time spent opening tablet: real 0.101s	user 0.000s	sys 0.000s
I20260709 12:09:23.072947 14380 tablet_bootstrap.cc:654] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.077906 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:09:23.078521 14339 raft_consensus.cc:3060] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.089360 14339 raft_consensus.cc:2468] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 1.
I20260709 12:09:23.089800 14087 catalog_manager.cc:5697] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf reported cstate change: term changed from 0 to 1, leader changed from <none> to 885067a0d31741bfb5c9935788e315bf (127.12.174.129). New cstate: current_term: 1 leader_uuid: "885067a0d31741bfb5c9935788e315bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:23.090938 14627 leader_election.cc:290] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:23.094344 14434 raft_consensus.cc:493] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.094897 14434 raft_consensus.cc:515] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:23.096833 14434 leader_election.cc:290] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:23.099622 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:23.100340 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:09:23.102734 14304 leader_election.cc:343] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.100394 14187 raft_consensus.cc:2468] T 02513fb0dbdd4cbdb019d79f0f448d18 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 0.
I20260709 12:09:23.106662 14303 leader_election.cc:304] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:09:23.108017 14667 raft_consensus.cc:2804] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:23.108423 14667 raft_consensus.cc:493] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:23.109360 14667 raft_consensus.cc:3060] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.112164 14264 raft_consensus.cc:3060] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.118911 14731 raft_consensus.cc:493] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.119439 14731 raft_consensus.cc:515] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:23.123595 14731 leader_election.cc:290] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:23.125918 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:23.124491 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:23.126690 14334 raft_consensus.cc:2468] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 0.
I20260709 12:09:23.126983 14187 raft_consensus.cc:2468] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 0.
I20260709 12:09:23.129508 14229 leader_election.cc:304] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:09:23.133912 14708 raft_consensus.cc:2804] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:23.134446 14708 raft_consensus.cc:493] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:23.134953 14708 raft_consensus.cc:3060] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.145028 14381 tablet_bootstrap.cc:492] T d82ca0c0e51a4e148b8d3e226ff7cebb P 885067a0d31741bfb5c9935788e315bf: No bootstrap required, opened a new log
I20260709 12:09:23.145598 14381 ts_tablet_manager.cc:1403] T d82ca0c0e51a4e148b8d3e226ff7cebb P 885067a0d31741bfb5c9935788e315bf: Time spent bootstrapping tablet: real 0.164s	user 0.033s	sys 0.071s
I20260709 12:09:23.147221 14667 raft_consensus.cc:515] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:23.148754 14381 raft_consensus.cc:359] T d82ca0c0e51a4e148b8d3e226ff7cebb P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:23.149408 14381 raft_consensus.cc:385] T d82ca0c0e51a4e148b8d3e226ff7cebb P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.149689 14381 raft_consensus.cc:740] T d82ca0c0e51a4e148b8d3e226ff7cebb P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.149996 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:09:23.150595 14186 raft_consensus.cc:3060] T 02513fb0dbdd4cbdb019d79f0f448d18 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.150357 14381 consensus_queue.cc:260] T d82ca0c0e51a4e148b8d3e226ff7cebb P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:23.152437 14381 ts_tablet_manager.cc:1434] T d82ca0c0e51a4e148b8d3e226ff7cebb P 885067a0d31741bfb5c9935788e315bf: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:09:23.159593 14380 tablet_bootstrap.cc:492] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec: No bootstrap required, opened a new log
I20260709 12:09:23.160167 14381 tablet_bootstrap.cc:492] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf: Bootstrap starting.
I20260709 12:09:23.160136 14380 ts_tablet_manager.cc:1403] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec: Time spent bootstrapping tablet: real 0.203s	user 0.015s	sys 0.011s
I20260709 12:09:23.170384 14716 raft_consensus.cc:493] T d82ca0c0e51a4e148b8d3e226ff7cebb P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.170962 14716 raft_consensus.cc:515] T d82ca0c0e51a4e148b8d3e226ff7cebb P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:23.174603 14379 tablet_bootstrap.cc:492] T 0a11d7ae457a408cac205ac501217c61 P 65c9c1653b3346b39a0e118540e6080c: No bootstrap required, opened a new log
I20260709 12:09:23.175112 14379 ts_tablet_manager.cc:1403] T 0a11d7ae457a408cac205ac501217c61 P 65c9c1653b3346b39a0e118540e6080c: Time spent bootstrapping tablet: real 0.141s	user 0.016s	sys 0.060s
I20260709 12:09:23.177418 14434 raft_consensus.cc:493] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.177937 14434 raft_consensus.cc:515] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:23.181079 14434 leader_election.cc:290] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:23.183075 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:23.184695 14716 leader_election.cc:290] T d82ca0c0e51a4e148b8d3e226ff7cebb P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:09:23.186955 14304 leader_election.cc:343] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.190248 14763 raft_consensus.cc:493] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.190825 14763 raft_consensus.cc:515] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:23.191838 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:09:23.193660 14303 leader_election.cc:343] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.194136 14303 leader_election.cc:304] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:09:23.217612 14667 leader_election.cc:290] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:23.173918 14731 consensus_queue.cc:1048] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.017s
W20260709 12:09:23.238319 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 44706.6us
I20260709 12:09:23.232882 14759 raft_consensus.cc:2749] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:23.253415 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:23.274529 14380 raft_consensus.cc:359] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:23.275462 14380 raft_consensus.cc:385] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.275743 14380 raft_consensus.cc:740] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.278726 14380 consensus_queue.cc:260] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:23.280848 14379 raft_consensus.cc:359] T 0a11d7ae457a408cac205ac501217c61 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:23.281626 14379 raft_consensus.cc:385] T 0a11d7ae457a408cac205ac501217c61 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.281919 14379 raft_consensus.cc:740] T 0a11d7ae457a408cac205ac501217c61 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.282574 14379 consensus_queue.cc:260] T 0a11d7ae457a408cac205ac501217c61 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:23.284343 14763 leader_election.cc:290] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:23.284475 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:23.288280 14379 ts_tablet_manager.cc:1434] T 0a11d7ae457a408cac205ac501217c61 P 65c9c1653b3346b39a0e118540e6080c: Time spent starting tablet: real 0.113s	user 0.007s	sys 0.000s
I20260709 12:09:23.294780 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:23.295488 14708 raft_consensus.cc:515] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:23.297556 14708 leader_election.cc:290] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:23.298961 14381 tablet_bootstrap.cc:654] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.303045 14380 ts_tablet_manager.cc:1434] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec: Time spent starting tablet: real 0.141s	user 0.007s	sys 0.002s
W20260709 12:09:23.303663 14155 leader_election.cc:343] T d82ca0c0e51a4e148b8d3e226ff7cebb P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.306501 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
W20260709 12:09:23.312973 14229 leader_election.cc:343] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.299363 14379 tablet_bootstrap.cc:492] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c: Bootstrap starting.
I20260709 12:09:23.318217 14181 raft_consensus.cc:3060] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.304675 14186 raft_consensus.cc:2468] T 02513fb0dbdd4cbdb019d79f0f448d18 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 1.
W20260709 12:09:23.327384 14136 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:09:23.322336 14380 tablet_bootstrap.cc:492] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec: Bootstrap starting.
I20260709 12:09:23.330397 14303 leader_election.cc:304] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:09:23.335665 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:23.336413 14336 raft_consensus.cc:2468] T 15f7cecfe772454980c8ae9d1803fe98 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 0.
I20260709 12:09:23.337273 14759 raft_consensus.cc:2804] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:23.337868 14759 raft_consensus.cc:697] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:09:23.338804 14759 consensus_queue.cc:237] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:23.344182 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:09:23.343775 14812 consensus_queue.cc:1048] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
W20260709 12:09:23.366886 14155 leader_election.cc:343] T d82ca0c0e51a4e148b8d3e226ff7cebb P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.367334 14155 leader_election.cc:304] T d82ca0c0e51a4e148b8d3e226ff7cebb P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:09:23.361419 14181 raft_consensus.cc:2468] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 1.
I20260709 12:09:23.370746 14229 leader_election.cc:304] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:09:23.370990 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:09:23.372018 14627 raft_consensus.cc:2749] T d82ca0c0e51a4e148b8d3e226ff7cebb P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:23.379140 14752 raft_consensus.cc:2804] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:23.383195 14752 raft_consensus.cc:697] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 1 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:09:23.379436 14338 raft_consensus.cc:3060] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.390411 14381 tablet_bootstrap.cc:492] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf: No bootstrap required, opened a new log
I20260709 12:09:23.390944 14381 ts_tablet_manager.cc:1403] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf: Time spent bootstrapping tablet: real 0.238s	user 0.020s	sys 0.015s
I20260709 12:09:23.397612 14380 tablet_bootstrap.cc:654] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.402166 14381 raft_consensus.cc:359] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:23.402971 14381 raft_consensus.cc:385] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.403239 14381 raft_consensus.cc:740] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.403883 14381 consensus_queue.cc:260] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:23.403781 14752 consensus_queue.cc:237] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:23.405546 14381 ts_tablet_manager.cc:1434] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:09:23.406699 14381 tablet_bootstrap.cc:492] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf: Bootstrap starting.
I20260709 12:09:23.420003 14338 raft_consensus.cc:2468] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 1.
I20260709 12:09:23.420550 14379 tablet_bootstrap.cc:654] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.422945 14087 catalog_manager.cc:5697] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c reported cstate change: term changed from 0 to 1, leader changed from <none> to 65c9c1653b3346b39a0e118540e6080c (127.12.174.131). New cstate: current_term: 1 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:23.432441 14230 leader_election.cc:304] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
W20260709 12:09:23.437641 14304 leader_election.cc:343] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.437161 14738 raft_consensus.cc:493] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.440812 14738 raft_consensus.cc:515] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:23.434657 14756 raft_consensus.cc:2804] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:23.442107 14756 raft_consensus.cc:493] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:23.444310 14756 raft_consensus.cc:3060] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.446509 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:23.447161 14186 raft_consensus.cc:2468] T f4739bc22bfe44fcba807da02d9351b6 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 0.
I20260709 12:09:23.448798 14303 leader_election.cc:304] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:09:23.449949 14811 raft_consensus.cc:2804] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:23.450309 14381 tablet_bootstrap.cc:654] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.450565 14811 raft_consensus.cc:493] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:23.450941 14811 raft_consensus.cc:3060] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.446201 14738 leader_election.cc:290] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:23.473623 14752 raft_consensus.cc:493] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.472842 14756 raft_consensus.cc:515] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:23.485494 14756 leader_election.cc:290] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:23.493424 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:09:23.494118 14337 raft_consensus.cc:3060] T 15f7cecfe772454980c8ae9d1803fe98 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.495090 14379 tablet_bootstrap.cc:492] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c: No bootstrap required, opened a new log
I20260709 12:09:23.495756 14379 ts_tablet_manager.cc:1403] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c: Time spent bootstrapping tablet: real 0.197s	user 0.015s	sys 0.003s
I20260709 12:09:23.498564 14379 raft_consensus.cc:359] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:23.499536 14379 raft_consensus.cc:385] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.500098 14379 raft_consensus.cc:740] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.506888 14759 raft_consensus.cc:493] T 0a11d7ae457a408cac205ac501217c61 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.507637 14759 raft_consensus.cc:515] T 0a11d7ae457a408cac205ac501217c61 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:23.512614 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:23.512825 14759 leader_election.cc:290] T 0a11d7ae457a408cac205ac501217c61 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:09:23.516319 14303 leader_election.cc:343] T 0a11d7ae457a408cac205ac501217c61 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.517338 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:09:23.521401 14304 leader_election.cc:343] T 0a11d7ae457a408cac205ac501217c61 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.498301 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:09:23.488504 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:23.534304 14304 leader_election.cc:304] T 0a11d7ae457a408cac205ac501217c61 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:09:23.534395 14379 consensus_queue.cc:260] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:23.544046 14434 raft_consensus.cc:2749] T 0a11d7ae457a408cac205ac501217c61 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:23.545416 14379 ts_tablet_manager.cc:1434] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c: Time spent starting tablet: real 0.049s	user 0.007s	sys 0.002s
I20260709 12:09:23.553534 14379 tablet_bootstrap.cc:492] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c: Bootstrap starting.
I20260709 12:09:23.546664 14181 raft_consensus.cc:3060] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.492707 14752 raft_consensus.cc:515] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:23.556560 14087 catalog_manager.cc:5697] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: term changed from 0 to 1, leader changed from <none> to 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130). New cstate: current_term: 1 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:23.590404 14381 tablet_bootstrap.cc:492] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf: No bootstrap required, opened a new log
I20260709 12:09:23.590945 14381 ts_tablet_manager.cc:1403] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf: Time spent bootstrapping tablet: real 0.184s	user 0.032s	sys 0.012s
I20260709 12:09:23.601012 14752 leader_election.cc:290] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:23.603199 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:23.584681 14264 raft_consensus.cc:2468] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 0.
I20260709 12:09:23.613181 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:23.614058 14184 raft_consensus.cc:2468] T f4739bc22bfe44fcba807da02d9351b6 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 0.
I20260709 12:09:23.620137 14337 raft_consensus.cc:2468] T 15f7cecfe772454980c8ae9d1803fe98 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 1.
I20260709 12:09:23.597952 14525 consensus_queue.cc:1048] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.024s
I20260709 12:09:23.627703 14229 leader_election.cc:304] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:09:23.646740 14752 raft_consensus.cc:2804] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:23.647184 14752 raft_consensus.cc:493] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:23.647579 14752 raft_consensus.cc:3060] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.647369 14783 consensus_queue.cc:1048] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:23.652354 14381 raft_consensus.cc:359] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:23.654717 14381 raft_consensus.cc:385] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.655027 14381 raft_consensus.cc:740] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.655695 14381 consensus_queue.cc:260] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:23.666270 14379 tablet_bootstrap.cc:654] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.667585 14381 ts_tablet_manager.cc:1434] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf: Time spent starting tablet: real 0.076s	user 0.005s	sys 0.002s
I20260709 12:09:23.658448 14811 raft_consensus.cc:515] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:23.673056 14811 leader_election.cc:290] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:23.675186 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:09:23.675848 14182 raft_consensus.cc:3060] T f4739bc22bfe44fcba807da02d9351b6 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.679591 14339 raft_consensus.cc:2393] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 1: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:09:23.686197 14230 leader_election.cc:304] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:09:23.688446 14814 raft_consensus.cc:2804] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:23.688951 14814 raft_consensus.cc:697] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 1 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:09:23.692456 14181 raft_consensus.cc:2468] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 1.
I20260709 12:09:23.698606 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:09:23.699582 14814 consensus_queue.cc:237] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:23.705677 14381 tablet_bootstrap.cc:492] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf: Bootstrap starting.
I20260709 12:09:23.712122 14380 tablet_bootstrap.cc:492] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec: No bootstrap required, opened a new log
I20260709 12:09:23.712719 14380 ts_tablet_manager.cc:1403] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec: Time spent bootstrapping tablet: real 0.391s	user 0.029s	sys 0.012s
I20260709 12:09:23.767114 14380 raft_consensus.cc:359] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:23.767979 14380 raft_consensus.cc:385] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.768296 14380 raft_consensus.cc:740] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.748845 14752 raft_consensus.cc:515] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:23.778265 14259 raft_consensus.cc:2393] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 1: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:09:23.779902 14752 leader_election.cc:290] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:23.785454 14182 raft_consensus.cc:2468] T f4739bc22bfe44fcba807da02d9351b6 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 1.
I20260709 12:09:23.786916 14380 consensus_queue.cc:260] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:23.773186 14085 catalog_manager.cc:5697] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: term changed from 0 to 1, leader changed from <none> to 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130). New cstate: current_term: 1 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:23.790350 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:09:23.791715 14338 raft_consensus.cc:2393] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 1: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:09:23.796600 14380 ts_tablet_manager.cc:1434] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec: Time spent starting tablet: real 0.084s	user 0.007s	sys 0.002s
I20260709 12:09:23.797843 14380 tablet_bootstrap.cc:492] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec: Bootstrap starting.
I20260709 12:09:23.807897 14381 tablet_bootstrap.cc:654] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.809552 14380 tablet_bootstrap.cc:654] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.818831 14303 leader_election.cc:304] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:09:23.816414 14259 raft_consensus.cc:3060] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.822033 14811 raft_consensus.cc:2804] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:23.833308 14379 tablet_bootstrap.cc:492] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c: No bootstrap required, opened a new log
I20260709 12:09:23.833941 14379 ts_tablet_manager.cc:1403] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c: Time spent bootstrapping tablet: real 0.281s	user 0.020s	sys 0.022s
I20260709 12:09:23.846788 14379 raft_consensus.cc:359] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:23.847594 14379 raft_consensus.cc:385] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.847879 14379 raft_consensus.cc:740] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.848806 14667 raft_consensus.cc:493] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.848675 14379 consensus_queue.cc:260] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:23.849473 14667 raft_consensus.cc:515] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:23.851997 14379 ts_tablet_manager.cc:1434] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.002s
I20260709 12:09:23.852617 14667 leader_election.cc:290] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:23.853204 14379 tablet_bootstrap.cc:492] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c: Bootstrap starting.
I20260709 12:09:23.840458 14811 raft_consensus.cc:697] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:09:23.854859 14811 consensus_queue.cc:237] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:23.858106 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:09:23.860625 14304 leader_election.cc:343] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.859549 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:09:23.867651 14187 raft_consensus.cc:2393] T f4739bc22bfe44fcba807da02d9351b6 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 1: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:09:23.877724 14724 consensus_queue.cc:1048] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:23.889494 14229 leader_election.cc:304] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:09:23.891712 14731 raft_consensus.cc:2749] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:09:23.891858 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:23.903477 14381 tablet_bootstrap.cc:492] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf: No bootstrap required, opened a new log
I20260709 12:09:23.904084 14381 ts_tablet_manager.cc:1403] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf: Time spent bootstrapping tablet: real 0.225s	user 0.016s	sys 0.003s
W20260709 12:09:23.907716 14303 leader_election.cc:343] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.908411 14303 leader_election.cc:304] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:09:23.910230 14738 raft_consensus.cc:2749] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:23.916124 14379 tablet_bootstrap.cc:654] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.915644 14825 consensus_queue.cc:1048] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:23.917929 14752 raft_consensus.cc:493] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.919143 14752 raft_consensus.cc:515] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:23.928495 14752 leader_election.cc:290] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:23.929564 14381 raft_consensus.cc:359] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:23.929682 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:23.930408 14381 raft_consensus.cc:385] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.930738 14381 raft_consensus.cc:740] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.931382 14381 consensus_queue.cc:260] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:23.934257 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:23.940665 14229 leader_election.cc:304] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:09:23.943080 14381 ts_tablet_manager.cc:1434] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf: Time spent starting tablet: real 0.039s	user 0.009s	sys 0.000s
I20260709 12:09:23.946751 14380 tablet_bootstrap.cc:492] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec: No bootstrap required, opened a new log
I20260709 12:09:23.947299 14380 ts_tablet_manager.cc:1403] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec: Time spent bootstrapping tablet: real 0.150s	user 0.013s	sys 0.008s
I20260709 12:09:23.952557 14381 tablet_bootstrap.cc:492] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf: Bootstrap starting.
I20260709 12:09:23.949311 14708 raft_consensus.cc:2749] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:23.974069 14813 consensus_queue.cc:1048] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:23.983302 14087 catalog_manager.cc:5697] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c reported cstate change: term changed from 0 to 1, leader changed from <none> to 65c9c1653b3346b39a0e118540e6080c (127.12.174.131). New cstate: current_term: 1 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:23.982077 14380 raft_consensus.cc:359] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:23.987025 14380 raft_consensus.cc:385] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.987360 14380 raft_consensus.cc:740] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.995793 14380 consensus_queue.cc:260] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:24.003526 14380 ts_tablet_manager.cc:1434] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec: Time spent starting tablet: real 0.056s	user 0.009s	sys 0.002s
I20260709 12:09:24.005529 14380 tablet_bootstrap.cc:492] T fc8bff37f52742a3a3b8a39c45ade183 P 17aab1bbf5014936aa18cc21818b26ec: Bootstrap starting.
I20260709 12:09:24.008323 14381 tablet_bootstrap.cc:654] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.012960 14379 tablet_bootstrap.cc:492] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c: No bootstrap required, opened a new log
I20260709 12:09:24.014330 14379 ts_tablet_manager.cc:1403] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c: Time spent bootstrapping tablet: real 0.161s	user 0.011s	sys 0.015s
I20260709 12:09:24.018839 14716 raft_consensus.cc:493] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.019585 14716 raft_consensus.cc:515] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:24.026306 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:24.026557 14813 consensus_queue.cc:1048] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:24.027380 14716 leader_election.cc:290] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:09:24.028330 14155 leader_election.cc:343] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.029287 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:24.029929 14339 raft_consensus.cc:2468] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 0.
I20260709 12:09:24.035207 14379 raft_consensus.cc:359] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:24.035983 14379 raft_consensus.cc:385] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.036288 14379 raft_consensus.cc:740] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.036895 14155 leader_election.cc:304] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:09:24.037118 14379 consensus_queue.cc:260] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:24.040355 14379 ts_tablet_manager.cc:1434] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.002s
I20260709 12:09:24.050511 14826 raft_consensus.cc:2804] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:24.051115 14826 raft_consensus.cc:493] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:24.051608 14826 raft_consensus.cc:3060] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.121304 14627 raft_consensus.cc:493] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.122645 14380 tablet_bootstrap.cc:654] T fc8bff37f52742a3a3b8a39c45ade183 P 17aab1bbf5014936aa18cc21818b26ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.122169 14627 raft_consensus.cc:515] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:24.129966 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:24.131175 14338 raft_consensus.cc:2468] T 0a11d7ae457a408cac205ac501217c61 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 0.
I20260709 12:09:24.133563 14155 leader_election.cc:304] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:09:24.134541 14831 raft_consensus.cc:2804] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:24.135079 14831 raft_consensus.cc:493] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:24.135565 14831 raft_consensus.cc:3060] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.125438 14627 leader_election.cc:290] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:24.148147 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:24.161988 14826 raft_consensus.cc:515] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:24.169297 14708 consensus_queue.cc:1048] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:09:24.172487 14155 leader_election.cc:343] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.172171 14831 raft_consensus.cc:515] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:24.184378 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
W20260709 12:09:24.186632 14155 leader_election.cc:343] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.186925 14826 leader_election.cc:290] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:24.188649 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:09:24.189513 14337 raft_consensus.cc:3060] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.200687 14381 tablet_bootstrap.cc:492] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf: No bootstrap required, opened a new log
I20260709 12:09:24.201400 14381 ts_tablet_manager.cc:1403] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf: Time spent bootstrapping tablet: real 0.249s	user 0.048s	sys 0.056s
I20260709 12:09:24.206574 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
W20260709 12:09:24.208484 14155 leader_election.cc:343] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.208815 14831 leader_election.cc:290] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:24.210669 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:09:24.212924 14334 raft_consensus.cc:3060] T 0a11d7ae457a408cac205ac501217c61 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.216270 14381 raft_consensus.cc:359] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:24.217144 14381 raft_consensus.cc:385] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.217458 14381 raft_consensus.cc:740] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.218150 14381 consensus_queue.cc:260] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:24.219676 14381 ts_tablet_manager.cc:1434] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 12:09:24.223680 14752 consensus_queue.cc:1048] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:24.242355 14380 tablet_bootstrap.cc:492] T fc8bff37f52742a3a3b8a39c45ade183 P 17aab1bbf5014936aa18cc21818b26ec: No bootstrap required, opened a new log
I20260709 12:09:24.242909 14380 ts_tablet_manager.cc:1403] T fc8bff37f52742a3a3b8a39c45ade183 P 17aab1bbf5014936aa18cc21818b26ec: Time spent bootstrapping tablet: real 0.238s	user 0.012s	sys 0.011s
I20260709 12:09:24.246703 14334 raft_consensus.cc:2468] T 0a11d7ae457a408cac205ac501217c61 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 1.
I20260709 12:09:24.256507 14155 leader_election.cc:304] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:09:24.258070 14831 raft_consensus.cc:2804] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:24.246767 14380 raft_consensus.cc:359] T fc8bff37f52742a3a3b8a39c45ade183 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:24.261230 14380 raft_consensus.cc:385] T fc8bff37f52742a3a3b8a39c45ade183 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.261302 14811 raft_consensus.cc:493] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.262893 14811 raft_consensus.cc:515] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:24.267931 14811 leader_election.cc:290] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:24.270347 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:24.260531 14337 raft_consensus.cc:2468] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 1.
I20260709 12:09:24.258821 14831 raft_consensus.cc:697] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 1 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:09:24.274227 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:24.274437 14155 leader_election.cc:304] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:09:24.275127 14185 raft_consensus.cc:2468] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 0.
I20260709 12:09:24.274667 14831 consensus_queue.cc:237] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:24.278518 14303 leader_election.cc:304] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:09:24.279495 14738 raft_consensus.cc:2804] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:24.280062 14738 raft_consensus.cc:493] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:24.280474 14627 raft_consensus.cc:2804] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:24.280575 14738 raft_consensus.cc:3060] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:24.279675 14304 leader_election.cc:343] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.281677 14724 consensus_queue.cc:1048] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:24.282598 14627 raft_consensus.cc:697] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 1 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:09:24.284024 14627 consensus_queue.cc:237] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:24.261642 14380 raft_consensus.cc:740] T fc8bff37f52742a3a3b8a39c45ade183 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.287175 14380 consensus_queue.cc:260] T fc8bff37f52742a3a3b8a39c45ade183 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:24.299165 14380 ts_tablet_manager.cc:1434] T fc8bff37f52742a3a3b8a39c45ade183 P 17aab1bbf5014936aa18cc21818b26ec: Time spent starting tablet: real 0.056s	user 0.009s	sys 0.000s
I20260709 12:09:24.300416 14380 tablet_bootstrap.cc:492] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec: Bootstrap starting.
I20260709 12:09:24.356642 14738 raft_consensus.cc:515] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:24.366302 14085 catalog_manager.cc:5697] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf reported cstate change: term changed from 0 to 1, leader changed from <none> to 885067a0d31741bfb5c9935788e315bf (127.12.174.129). New cstate: current_term: 1 leader_uuid: "885067a0d31741bfb5c9935788e315bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:24.371237 14085 catalog_manager.cc:5697] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf reported cstate change: term changed from 0 to 1, leader changed from <none> to 885067a0d31741bfb5c9935788e315bf (127.12.174.129). New cstate: current_term: 1 leader_uuid: "885067a0d31741bfb5c9935788e315bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:24.375699 14825 consensus_queue.cc:1048] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:24.378113 14738 leader_election.cc:290] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:24.381551 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:09:24.388042 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:09:24.389626 14184 raft_consensus.cc:3060] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.391003 14380 tablet_bootstrap.cc:654] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec: Neither blocks nor log segments found. Creating new log.
W20260709 12:09:24.399482 14304 leader_election.cc:343] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.402379 14752 raft_consensus.cc:493] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.402916 14752 raft_consensus.cc:515] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:09:24.404452 14136 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:09:24.405521 14752 leader_election.cc:290] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:24.411288 14184 raft_consensus.cc:2468] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 1.
I20260709 12:09:24.414561 14303 leader_election.cc:304] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:09:24.415521 14738 raft_consensus.cc:2804] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:24.416421 14811 raft_consensus.cc:493] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.417090 14811 raft_consensus.cc:515] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:24.419304 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:24.420009 14339 raft_consensus.cc:2468] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 0.
I20260709 12:09:24.420197 14811 leader_election.cc:290] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:24.420671 14738 raft_consensus.cc:697] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:09:24.421571 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:24.422075 14738 consensus_queue.cc:237] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:24.422508 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:24.423511 14181 raft_consensus.cc:2468] T d82ca0c0e51a4e148b8d3e226ff7cebb P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 0.
I20260709 12:09:24.423583 14184 raft_consensus.cc:2468] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 0.
I20260709 12:09:24.426301 14303 leader_election.cc:304] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:09:24.427690 14724 raft_consensus.cc:2804] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:24.428285 14724 raft_consensus.cc:493] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:24.428565 14229 leader_election.cc:304] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:09:24.428887 14724 raft_consensus.cc:3060] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.431993 14752 raft_consensus.cc:2804] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:24.433835 14752 raft_consensus.cc:493] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:24.434412 14752 raft_consensus.cc:3060] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.444334 14724 raft_consensus.cc:515] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:24.446904 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:09:24.449644 14304 leader_election.cc:343] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.455323 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:09:24.456034 14184 raft_consensus.cc:3060] T d82ca0c0e51a4e148b8d3e226ff7cebb P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.456097 14724 leader_election.cc:290] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:24.467131 14184 raft_consensus.cc:2468] T d82ca0c0e51a4e148b8d3e226ff7cebb P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 1.
I20260709 12:09:24.476441 14303 leader_election.cc:304] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:09:24.478051 14811 raft_consensus.cc:2804] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:24.478873 14811 raft_consensus.cc:697] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:09:24.480306 14811 consensus_queue.cc:237] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:24.498140 14380 tablet_bootstrap.cc:492] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec: No bootstrap required, opened a new log
I20260709 12:09:24.498715 14380 ts_tablet_manager.cc:1403] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec: Time spent bootstrapping tablet: real 0.199s	user 0.030s	sys 0.034s
I20260709 12:09:24.502933 14380 raft_consensus.cc:359] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:24.503757 14380 raft_consensus.cc:385] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.504002 14752 raft_consensus.cc:515] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:24.504444 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:09:24.516623 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:09:24.517441 14182 raft_consensus.cc:3060] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.521354 14088 catalog_manager.cc:5697] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c reported cstate change: term changed from 0 to 1, leader changed from <none> to 65c9c1653b3346b39a0e118540e6080c (127.12.174.131). New cstate: current_term: 1 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:24.504022 14380 raft_consensus.cc:740] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.526055 14380 consensus_queue.cc:260] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:24.526990 14264 raft_consensus.cc:3060] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.527928 14380 ts_tablet_manager.cc:1434] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec: Time spent starting tablet: real 0.029s	user 0.004s	sys 0.002s
I20260709 12:09:24.529044 14380 tablet_bootstrap.cc:492] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec: Bootstrap starting.
I20260709 12:09:24.534873 14752 leader_election.cc:290] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:24.535126 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:09:24.535722 14339 raft_consensus.cc:3060] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.535917 14182 raft_consensus.cc:2468] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 1.
I20260709 12:09:24.537319 14229 leader_election.cc:304] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:09:24.538144 14813 raft_consensus.cc:2804] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:24.538784 14813 raft_consensus.cc:697] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 1 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:09:24.540120 14813 consensus_queue.cc:237] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:24.542356 14756 raft_consensus.cc:493] T fc8bff37f52742a3a3b8a39c45ade183 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.543038 14756 raft_consensus.cc:515] T fc8bff37f52742a3a3b8a39c45ade183 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:24.544227 14339 raft_consensus.cc:2468] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 1.
I20260709 12:09:24.545900 14380 tablet_bootstrap.cc:654] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.547150 14756 leader_election.cc:290] T fc8bff37f52742a3a3b8a39c45ade183 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:24.547658 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:24.548952 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:24.549762 14339 raft_consensus.cc:2393] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 1: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:09:24.551199 14229 leader_election.cc:304] T fc8bff37f52742a3a3b8a39c45ade183 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:09:24.552273 14731 raft_consensus.cc:3060] T fc8bff37f52742a3a3b8a39c45ade183 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.558660 14264 raft_consensus.cc:2468] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 1.
I20260709 12:09:24.573498 14088 catalog_manager.cc:5697] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c reported cstate change: term changed from 0 to 1, leader changed from <none> to 65c9c1653b3346b39a0e118540e6080c (127.12.174.131). New cstate: current_term: 1 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:24.589032 14380 tablet_bootstrap.cc:492] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec: No bootstrap required, opened a new log
I20260709 12:09:24.588819 14731 raft_consensus.cc:2749] T fc8bff37f52742a3a3b8a39c45ade183 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:24.589574 14380 ts_tablet_manager.cc:1403] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec: Time spent bootstrapping tablet: real 0.061s	user 0.025s	sys 0.021s
I20260709 12:09:24.594576 14380 raft_consensus.cc:359] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:24.596161 14380 raft_consensus.cc:385] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.596444 14380 raft_consensus.cc:740] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.597266 14380 consensus_queue.cc:260] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:24.599890 14380 ts_tablet_manager.cc:1434] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:09:24.601008 14380 tablet_bootstrap.cc:492] T 7c8882b1b37d4e84a94a2e1e321a8755 P 17aab1bbf5014936aa18cc21818b26ec: Bootstrap starting.
I20260709 12:09:24.610432 14087 catalog_manager.cc:5697] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: term changed from 0 to 1, leader changed from <none> to 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130). New cstate: current_term: 1 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:24.612881 14380 tablet_bootstrap.cc:654] T 7c8882b1b37d4e84a94a2e1e321a8755 P 17aab1bbf5014936aa18cc21818b26ec: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.624095 14380 tablet_bootstrap.cc:492] T 7c8882b1b37d4e84a94a2e1e321a8755 P 17aab1bbf5014936aa18cc21818b26ec: No bootstrap required, opened a new log
I20260709 12:09:24.624621 14380 ts_tablet_manager.cc:1403] T 7c8882b1b37d4e84a94a2e1e321a8755 P 17aab1bbf5014936aa18cc21818b26ec: Time spent bootstrapping tablet: real 0.024s	user 0.012s	sys 0.003s
I20260709 12:09:24.628356 14380 raft_consensus.cc:359] T 7c8882b1b37d4e84a94a2e1e321a8755 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:24.629101 14380 raft_consensus.cc:385] T 7c8882b1b37d4e84a94a2e1e321a8755 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.629357 14380 raft_consensus.cc:740] T 7c8882b1b37d4e84a94a2e1e321a8755 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.630024 14380 consensus_queue.cc:260] T 7c8882b1b37d4e84a94a2e1e321a8755 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:24.632081 14380 ts_tablet_manager.cc:1434] T 7c8882b1b37d4e84a94a2e1e321a8755 P 17aab1bbf5014936aa18cc21818b26ec: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.005s
I20260709 12:09:24.753197 14826 consensus_queue.cc:1048] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:24.754724 14752 raft_consensus.cc:493] T 7c8882b1b37d4e84a94a2e1e321a8755 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.755446 14752 raft_consensus.cc:515] T 7c8882b1b37d4e84a94a2e1e321a8755 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:24.759527 14752 leader_election.cc:290] T 7c8882b1b37d4e84a94a2e1e321a8755 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:24.760782 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:24.762607 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:24.763995 14184 raft_consensus.cc:2393] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 1: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:09:24.766067 14229 leader_election.cc:304] T 7c8882b1b37d4e84a94a2e1e321a8755 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:09:24.768299 14752 raft_consensus.cc:3060] T 7c8882b1b37d4e84a94a2e1e321a8755 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.769197 14826 consensus_queue.cc:1048] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:24.790598 14752 raft_consensus.cc:2749] T 7c8882b1b37d4e84a94a2e1e321a8755 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:24.793644 14264 raft_consensus.cc:3060] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.801190 14826 consensus_queue.cc:1048] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:24.804873 14826 consensus_queue.cc:1048] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:24.900135 14811 consensus_queue.cc:1048] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:24.916152 14667 consensus_queue.cc:1048] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:24.919708 14667 consensus_queue.cc:1048] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:24.939644 14738 consensus_queue.cc:1048] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:25.020429 14731 consensus_queue.cc:1048] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:25.043668 14813 consensus_queue.cc:1048] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:25.852770 12986 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:09:25.891657 14866 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:09:25.891774 14867 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:09:25.891707 14869 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:09:25.893865 12986 server_base.cc:1061] running on GCE node
I20260709 12:09:25.896811 12986 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:09:25.897074 12986 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:09:25.897254 12986 hybrid_clock.cc:648] HybridClock initialized: now 1783598965897239 us; error 0 us; skew 500 ppm
I20260709 12:09:25.897855 12986 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:09:25.901338 12986 webserver.cc:533] Webserver started at http://127.12.174.132:34715/ using document root <none> and password file <none>
I20260709 12:09:25.901923 12986 fs_manager.cc:362] Metadata directory not provided
I20260709 12:09:25.902112 12986 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:09:25.902398 12986 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:09:25.903646 12986 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598886212958-12986-0/minicluster-data/ts-3-root/instance:
uuid: "73d01e9b1a9d49358da4985b21d681db"
format_stamp: "Formatted at 2026-07-09 12:09:25 on dist-test-slave-9q7n"
I20260709 12:09:25.908913 12986 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.001s
I20260709 12:09:25.913318 14874 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:25.915022 12986 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 12:09:25.915478 12986 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598886212958-12986-0/minicluster-data/ts-3-root
uuid: "73d01e9b1a9d49358da4985b21d681db"
format_stamp: "Formatted at 2026-07-09 12:09:25 on dist-test-slave-9q7n"
I20260709 12:09:25.915802 12986 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598886212958-12986-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598886212958-12986-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598886212958-12986-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:09:25.936861 12986 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:09:25.939571 12986 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:09:25.941452 12986 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:09:25.944558 12986 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:09:25.944847 12986 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:25.945142 12986 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:09:25.945356 12986 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:26.025435 12986 rpc_server.cc:307] RPC server started. Bound to: 127.12.174.132:37341
I20260709 12:09:26.025532 14936 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.174.132:37341 every 8 connection(s)
I20260709 12:09:26.031774 12986 auto_leader_rebalancer-test.cc:439] add a tserver: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:09:26.047744 14937 heartbeater.cc:344] Connected to a master server at 127.12.174.190:39655
I20260709 12:09:26.048192 14937 heartbeater.cc:461] Registering TS with master...
I20260709 12:09:26.048969 14937 heartbeater.cc:507] Master 127.12.174.190:39655 requested a full tablet report, sending...
I20260709 12:09:26.051235 14088 ts_manager.cc:194] Registered new tserver with Master: 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:09:26.053098 14088 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44116
I20260709 12:09:26.581239 14337 consensus_queue.cc:237] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } }
I20260709 12:09:26.589782 14262 raft_consensus.cc:1275] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:26.592499 14738 consensus_queue.cc:1048] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:26.593321 14182 raft_consensus.cc:1275] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:26.597177 14667 consensus_queue.cc:1048] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:26.605497 14738 raft_consensus.cc:2955] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } } }
I20260709 12:09:26.608291 14262 raft_consensus.cc:2955] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } } }
I20260709 12:09:26.611271 14182 raft_consensus.cc:2955] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } } }
I20260709 12:09:26.620560 14338 consensus_queue.cc:237] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } }
W20260709 12:09:26.625406 14303 consensus_peers.cc:597] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c -> Peer 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341): Couldn't send request to peer 73d01e9b1a9d49358da4985b21d681db. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 53a4b57f88ee477d8c90d6b0f0cf2e57. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:26.631283 14088 catalog_manager.cc:5697] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: config changed from index -1 to 2, NON_VOTER 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) added. New cstate: current_term: 1 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } } }
W20260709 12:09:26.652480 14303 consensus_peers.cc:597] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c -> Peer 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341): Couldn't send request to peer 73d01e9b1a9d49358da4985b21d681db. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2b1a5d42755443119571654ad5c5f2f3. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:26.654255 14182 raft_consensus.cc:1275] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:26.655504 14262 raft_consensus.cc:1275] T 2b1a5d42755443119571654ad5c5f2f3 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:26.656757 14738 consensus_queue.cc:1048] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:26.657549 14667 consensus_queue.cc:1048] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:26.671618 14944 raft_consensus.cc:2955] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } } }
I20260709 12:09:26.673804 14184 raft_consensus.cc:2955] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } } }
I20260709 12:09:26.679275 14262 raft_consensus.cc:2955] T 2b1a5d42755443119571654ad5c5f2f3 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } } }
I20260709 12:09:26.718299 14085 catalog_manager.cc:5697] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c reported cstate change: config changed from index -1 to 2, NON_VOTER 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) added. New cstate: current_term: 1 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:26.798188 14263 consensus_queue.cc:237] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } }
I20260709 12:09:26.806608 14337 raft_consensus.cc:1275] T e244b5af3ce244339f6fe0bd22a35eba P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:26.808004 14184 raft_consensus.cc:1275] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:26.808234 14813 consensus_queue.cc:1048] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:26.811474 14813 consensus_queue.cc:1048] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:09:26.822788 14229 consensus_peers.cc:597] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec -> Peer 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341): Couldn't send request to peer 73d01e9b1a9d49358da4985b21d681db. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e244b5af3ce244339f6fe0bd22a35eba. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:26.828246 14752 raft_consensus.cc:2955] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } } }
I20260709 12:09:26.836169 14182 raft_consensus.cc:2955] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } } }
I20260709 12:09:26.836149 14337 raft_consensus.cc:2955] T e244b5af3ce244339f6fe0bd22a35eba P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } } }
I20260709 12:09:26.875169 14087 catalog_manager.cc:5697] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf reported cstate change: config changed from index -1 to 2, NON_VOTER 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) added. New cstate: current_term: 1 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } } }
I20260709 12:09:26.905050 14339 consensus_queue.cc:237] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } }
W20260709 12:09:26.920334 14303 consensus_peers.cc:597] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c -> Peer 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341): Couldn't send request to peer 73d01e9b1a9d49358da4985b21d681db. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 981a078d2d9d479abecc8b0b45771080. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:26.922360 14263 raft_consensus.cc:1275] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:26.922840 14181 raft_consensus.cc:1275] T 981a078d2d9d479abecc8b0b45771080 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:26.923945 14944 consensus_queue.cc:1048] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:26.924912 14941 consensus_queue.cc:1048] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:27.009212 14738 raft_consensus.cc:2955] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } } }
I20260709 12:09:27.013298 14181 raft_consensus.cc:2955] T 981a078d2d9d479abecc8b0b45771080 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } } }
I20260709 12:09:27.056695 14937 heartbeater.cc:499] Master 127.12.174.190:39655 was elected leader, sending a full tablet report...
I20260709 12:09:27.087641 14085 catalog_manager.cc:5697] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c reported cstate change: config changed from index -1 to 2, NON_VOTER 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) added. New cstate: current_term: 1 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:27.151684 14263 raft_consensus.cc:2955] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } } }
I20260709 12:09:27.178860 14971 ts_tablet_manager.cc:933] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db: Initiating tablet copy from peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:27.191426 14971 tablet_copy_client.cc:323] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db: tablet copy: Beginning tablet copy session from remote peer at address 127.12.174.131:45957
I20260709 12:09:27.227113 14973 ts_tablet_manager.cc:933] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db: Initiating tablet copy from peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:27.249583 14349 tablet_copy_service.cc:140] P 65c9c1653b3346b39a0e118540e6080c: Received BeginTabletCopySession request for tablet 2b1a5d42755443119571654ad5c5f2f3 from peer 73d01e9b1a9d49358da4985b21d681db ({username='slave'} at 127.0.0.1:55492)
I20260709 12:09:27.250367 14973 tablet_copy_client.cc:323] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db: tablet copy: Beginning tablet copy session from remote peer at address 127.12.174.131:45957
I20260709 12:09:27.250392 14349 tablet_copy_service.cc:161] P 65c9c1653b3346b39a0e118540e6080c: Beginning new tablet copy session on tablet 2b1a5d42755443119571654ad5c5f2f3 from peer 73d01e9b1a9d49358da4985b21d681db at {username='slave'} at 127.0.0.1:55492: session id = 73d01e9b1a9d49358da4985b21d681db-2b1a5d42755443119571654ad5c5f2f3
I20260709 12:09:27.253094 14348 tablet_copy_service.cc:140] P 65c9c1653b3346b39a0e118540e6080c: Received BeginTabletCopySession request for tablet 53a4b57f88ee477d8c90d6b0f0cf2e57 from peer 73d01e9b1a9d49358da4985b21d681db ({username='slave'} at 127.0.0.1:55492)
I20260709 12:09:27.253686 14348 tablet_copy_service.cc:161] P 65c9c1653b3346b39a0e118540e6080c: Beginning new tablet copy session on tablet 53a4b57f88ee477d8c90d6b0f0cf2e57 from peer 73d01e9b1a9d49358da4985b21d681db at {username='slave'} at 127.0.0.1:55492: session id = 73d01e9b1a9d49358da4985b21d681db-53a4b57f88ee477d8c90d6b0f0cf2e57
I20260709 12:09:27.258591 14349 tablet_copy_source_session.cc:215] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:27.260989 14348 tablet_copy_source_session.cc:215] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:27.263319 14971 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b1a5d42755443119571654ad5c5f2f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:27.264935 14973 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53a4b57f88ee477d8c90d6b0f0cf2e57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:27.282174 14971 tablet_copy_client.cc:806] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:27.283073 14971 tablet_copy_client.cc:670] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:27.285677 14973 tablet_copy_client.cc:806] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:27.286612 14973 tablet_copy_client.cc:670] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:27.295877 14971 tablet_copy_client.cc:538] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:27.301786 14973 tablet_copy_client.cc:538] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:27.307886 14971 tablet_bootstrap.cc:492] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db: Bootstrap starting.
I20260709 12:09:27.312160 14973 tablet_bootstrap.cc:492] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db: Bootstrap starting.
I20260709 12:09:27.334590 14973 tablet_bootstrap.cc:492] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:27.335709 14973 tablet_bootstrap.cc:492] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db: Bootstrap complete.
I20260709 12:09:27.336329 14973 ts_tablet_manager.cc:1403] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db: Time spent bootstrapping tablet: real 0.024s	user 0.020s	sys 0.003s
I20260709 12:09:27.339424 14973 raft_consensus.cc:359] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } }
I20260709 12:09:27.340310 14973 raft_consensus.cc:740] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Initialized, Role: LEARNER
I20260709 12:09:27.341495 14973 consensus_queue.cc:260] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } }
I20260709 12:09:27.347110 14971 tablet_bootstrap.cc:492] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:27.347268 14973 ts_tablet_manager.cc:1434] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.003s
I20260709 12:09:27.349581 14348 tablet_copy_service.cc:342] P 65c9c1653b3346b39a0e118540e6080c: Request end of tablet copy session 73d01e9b1a9d49358da4985b21d681db-53a4b57f88ee477d8c90d6b0f0cf2e57 received from {username='slave'} at 127.0.0.1:55492
I20260709 12:09:27.350220 14348 tablet_copy_service.cc:434] P 65c9c1653b3346b39a0e118540e6080c: ending tablet copy session 73d01e9b1a9d49358da4985b21d681db-53a4b57f88ee477d8c90d6b0f0cf2e57 on tablet 53a4b57f88ee477d8c90d6b0f0cf2e57 with peer 73d01e9b1a9d49358da4985b21d681db
I20260709 12:09:27.352335 14971 tablet_bootstrap.cc:492] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db: Bootstrap complete.
I20260709 12:09:27.354739 14971 ts_tablet_manager.cc:1403] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db: Time spent bootstrapping tablet: real 0.047s	user 0.029s	sys 0.010s
I20260709 12:09:27.361114 14971 raft_consensus.cc:359] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } }
I20260709 12:09:27.362466 14971 raft_consensus.cc:740] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Initialized, Role: LEARNER
I20260709 12:09:27.363204 14971 consensus_queue.cc:260] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } }
I20260709 12:09:27.364809 14973 ts_tablet_manager.cc:933] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db: Initiating tablet copy from peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:27.365502 14971 ts_tablet_manager.cc:1434] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db: Time spent starting tablet: real 0.010s	user 0.002s	sys 0.002s
I20260709 12:09:27.368173 14348 tablet_copy_service.cc:342] P 65c9c1653b3346b39a0e118540e6080c: Request end of tablet copy session 73d01e9b1a9d49358da4985b21d681db-2b1a5d42755443119571654ad5c5f2f3 received from {username='slave'} at 127.0.0.1:55492
I20260709 12:09:27.368432 14973 tablet_copy_client.cc:323] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db: tablet copy: Beginning tablet copy session from remote peer at address 127.12.174.130:36673
I20260709 12:09:27.368986 14348 tablet_copy_service.cc:434] P 65c9c1653b3346b39a0e118540e6080c: ending tablet copy session 73d01e9b1a9d49358da4985b21d681db-2b1a5d42755443119571654ad5c5f2f3 on tablet 2b1a5d42755443119571654ad5c5f2f3 with peer 73d01e9b1a9d49358da4985b21d681db
I20260709 12:09:27.387097 14275 tablet_copy_service.cc:140] P 17aab1bbf5014936aa18cc21818b26ec: Received BeginTabletCopySession request for tablet e244b5af3ce244339f6fe0bd22a35eba from peer 73d01e9b1a9d49358da4985b21d681db ({username='slave'} at 127.0.0.1:53050)
I20260709 12:09:27.387703 14275 tablet_copy_service.cc:161] P 17aab1bbf5014936aa18cc21818b26ec: Beginning new tablet copy session on tablet e244b5af3ce244339f6fe0bd22a35eba from peer 73d01e9b1a9d49358da4985b21d681db at {username='slave'} at 127.0.0.1:53050: session id = 73d01e9b1a9d49358da4985b21d681db-e244b5af3ce244339f6fe0bd22a35eba
I20260709 12:09:27.400981 14275 tablet_copy_source_session.cc:215] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:27.404492 14973 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e244b5af3ce244339f6fe0bd22a35eba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:27.418601 14971 ts_tablet_manager.cc:933] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db: Initiating tablet copy from peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:27.422729 14971 tablet_copy_client.cc:323] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db: tablet copy: Beginning tablet copy session from remote peer at address 127.12.174.131:45957
I20260709 12:09:27.424181 14348 tablet_copy_service.cc:140] P 65c9c1653b3346b39a0e118540e6080c: Received BeginTabletCopySession request for tablet 981a078d2d9d479abecc8b0b45771080 from peer 73d01e9b1a9d49358da4985b21d681db ({username='slave'} at 127.0.0.1:55492)
I20260709 12:09:27.424611 14348 tablet_copy_service.cc:161] P 65c9c1653b3346b39a0e118540e6080c: Beginning new tablet copy session on tablet 981a078d2d9d479abecc8b0b45771080 from peer 73d01e9b1a9d49358da4985b21d681db at {username='slave'} at 127.0.0.1:55492: session id = 73d01e9b1a9d49358da4985b21d681db-981a078d2d9d479abecc8b0b45771080
I20260709 12:09:27.425518 14973 tablet_copy_client.cc:806] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:27.426600 14973 tablet_copy_client.cc:670] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:27.430929 14973 tablet_copy_client.cc:538] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:27.432168 14348 tablet_copy_source_session.cc:215] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:27.435956 14971 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 981a078d2d9d479abecc8b0b45771080. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:27.443239 14973 tablet_bootstrap.cc:492] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db: Bootstrap starting.
I20260709 12:09:27.459190 14971 tablet_copy_client.cc:806] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:27.459892 14971 tablet_copy_client.cc:670] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:27.465628 14971 tablet_copy_client.cc:538] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:27.476763 14971 tablet_bootstrap.cc:492] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db: Bootstrap starting.
I20260709 12:09:27.485061 14973 tablet_bootstrap.cc:492] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:27.494457 14973 tablet_bootstrap.cc:492] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db: Bootstrap complete.
I20260709 12:09:27.495225 14973 ts_tablet_manager.cc:1403] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db: Time spent bootstrapping tablet: real 0.052s	user 0.020s	sys 0.017s
I20260709 12:09:27.500568 14973 raft_consensus.cc:359] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } }
I20260709 12:09:27.502857 14973 raft_consensus.cc:740] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Initialized, Role: LEARNER
I20260709 12:09:27.503695 14973 consensus_queue.cc:260] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } }
I20260709 12:09:27.506403 14973 ts_tablet_manager.cc:1434] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:09:27.508324 14275 tablet_copy_service.cc:342] P 17aab1bbf5014936aa18cc21818b26ec: Request end of tablet copy session 73d01e9b1a9d49358da4985b21d681db-e244b5af3ce244339f6fe0bd22a35eba received from {username='slave'} at 127.0.0.1:53050
I20260709 12:09:27.508797 14275 tablet_copy_service.cc:434] P 17aab1bbf5014936aa18cc21818b26ec: ending tablet copy session 73d01e9b1a9d49358da4985b21d681db-e244b5af3ce244339f6fe0bd22a35eba on tablet e244b5af3ce244339f6fe0bd22a35eba with peer 73d01e9b1a9d49358da4985b21d681db
I20260709 12:09:27.519047 14971 tablet_bootstrap.cc:492] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:27.520004 14971 tablet_bootstrap.cc:492] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db: Bootstrap complete.
I20260709 12:09:27.520592 14971 ts_tablet_manager.cc:1403] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db: Time spent bootstrapping tablet: real 0.044s	user 0.012s	sys 0.016s
I20260709 12:09:27.523669 14971 raft_consensus.cc:359] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } }
I20260709 12:09:27.525468 14971 raft_consensus.cc:740] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Initialized, Role: LEARNER
I20260709 12:09:27.526157 14971 consensus_queue.cc:260] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } }
I20260709 12:09:27.528503 14971 ts_tablet_manager.cc:1434] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:09:27.530378 14348 tablet_copy_service.cc:342] P 65c9c1653b3346b39a0e118540e6080c: Request end of tablet copy session 73d01e9b1a9d49358da4985b21d681db-981a078d2d9d479abecc8b0b45771080 received from {username='slave'} at 127.0.0.1:55492
I20260709 12:09:27.530800 14348 tablet_copy_service.cc:434] P 65c9c1653b3346b39a0e118540e6080c: ending tablet copy session 73d01e9b1a9d49358da4985b21d681db-981a078d2d9d479abecc8b0b45771080 on tablet 981a078d2d9d479abecc8b0b45771080 with peer 73d01e9b1a9d49358da4985b21d681db
I20260709 12:09:27.573037 14912 raft_consensus.cc:1217] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:27.656024 14912 raft_consensus.cc:1217] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:27.823141 14912 raft_consensus.cc:1217] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:27.994107 14912 raft_consensus.cc:1217] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:28.051524 14944 raft_consensus.cc:1064] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c: attempting to promote NON_VOTER 73d01e9b1a9d49358da4985b21d681db to VOTER
I20260709 12:09:28.087734 14944 consensus_queue.cc:237] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:09:28.149989 14912 raft_consensus.cc:1275] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 1 LEARNER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:28.150861 14262 raft_consensus.cc:1275] T 2b1a5d42755443119571654ad5c5f2f3 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:28.151789 14181 raft_consensus.cc:1275] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:28.153067 14944 consensus_queue.cc:1048] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:28.154320 14988 consensus_queue.cc:1048] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:28.155658 14989 consensus_queue.cc:1048] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:28.181452 14941 raft_consensus.cc:2955] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:28.183496 14912 raft_consensus.cc:2955] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:28.189457 14263 raft_consensus.cc:2955] T 2b1a5d42755443119571654ad5c5f2f3 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:28.202008 14085 catalog_manager.cc:5697] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: config changed from index 2 to 3, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:28.216217 14181 raft_consensus.cc:2955] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:28.309657 14944 raft_consensus.cc:1064] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c: attempting to promote NON_VOTER 73d01e9b1a9d49358da4985b21d681db to VOTER
I20260709 12:09:28.309413 14337 consensus_queue.cc:237] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:09:28.338950 14944 consensus_queue.cc:237] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:09:28.345038 14912 raft_consensus.cc:1275] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:28.351246 14738 consensus_queue.cc:1048] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:28.354161 14187 raft_consensus.cc:1275] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:28.361557 14738 consensus_queue.cc:1048] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:28.372375 14941 raft_consensus.cc:2955] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:28.376524 14912 raft_consensus.cc:2955] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:28.399983 14074 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2b1a5d42755443119571654ad5c5f2f3 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:28.410542 14088 catalog_manager.cc:5697] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c reported cstate change: config changed from index 3 to 4, VOTER 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130) evicted. New cstate: current_term: 1 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:28.420428 14991 raft_consensus.cc:1064] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec: attempting to promote NON_VOTER 73d01e9b1a9d49358da4985b21d681db to VOTER
I20260709 12:09:28.423523 14991 consensus_queue.cc:237] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:09:28.426122 14246 tablet_service.cc:1558] Processing DeleteTablet for tablet 2b1a5d42755443119571654ad5c5f2f3 with delete_type TABLET_DATA_TOMBSTONED (TS 17aab1bbf5014936aa18cc21818b26ec not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:51304
I20260709 12:09:28.459604 14337 raft_consensus.cc:1275] T e244b5af3ce244339f6fe0bd22a35eba P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:28.459604 14911 raft_consensus.cc:1275] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 1 LEARNER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:28.462347 14752 consensus_queue.cc:1048] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:28.462682 14738 consensus_queue.cc:1048] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:28.463493 14911 raft_consensus.cc:1275] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 1 LEARNER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:28.465001 15003 tablet_replica.cc:333] T 2b1a5d42755443119571654ad5c5f2f3 P 17aab1bbf5014936aa18cc21818b26ec: stopping tablet replica
I20260709 12:09:28.466316 15003 raft_consensus.cc:2243] T 2b1a5d42755443119571654ad5c5f2f3 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:28.467204 15003 raft_consensus.cc:2272] T 2b1a5d42755443119571654ad5c5f2f3 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:28.484074 14752 consensus_queue.cc:1048] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:28.486264 15003 ts_tablet_manager.cc:1916] T 2b1a5d42755443119571654ad5c5f2f3 P 17aab1bbf5014936aa18cc21818b26ec: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:28.490561 14262 raft_consensus.cc:1275] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:28.505589 14944 consensus_queue.cc:1048] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:28.511793 14944 raft_consensus.cc:1064] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c: attempting to promote NON_VOTER 73d01e9b1a9d49358da4985b21d681db to VOTER
I20260709 12:09:28.498067 14181 raft_consensus.cc:1275] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:28.517707 14181 raft_consensus.cc:2955] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:28.525174 14187 raft_consensus.cc:1275] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:28.519470 14944 consensus_queue.cc:237] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:09:28.652980 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 117466us
I20260709 12:09:28.683602 14263 raft_consensus.cc:1275] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:28.683754 14752 raft_consensus.cc:2955] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:28.700373 14990 consensus_queue.cc:1048] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:28.716471 14738 consensus_queue.cc:1048] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:28.721781 15003 ts_tablet_manager.cc:1929] T 2b1a5d42755443119571654ad5c5f2f3 P 17aab1bbf5014936aa18cc21818b26ec: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:28.722477 15003 log.cc:1199] T 2b1a5d42755443119571654ad5c5f2f3 P 17aab1bbf5014936aa18cc21818b26ec: Deleting WAL directory at /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598886212958-12986-0/minicluster-data/ts-1-root/wals/2b1a5d42755443119571654ad5c5f2f3
I20260709 12:09:28.724328 14074 catalog_manager.cc:5028] TS 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): tablet 2b1a5d42755443119571654ad5c5f2f3 (table test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]) successfully deleted
I20260709 12:09:28.738773 14911 raft_consensus.cc:2955] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:28.740325 14086 catalog_manager.cc:5697] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: config changed from index 2 to 3, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:28.749274 14912 raft_consensus.cc:1275] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 1 LEARNER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:28.751410 14337 raft_consensus.cc:2955] T e244b5af3ce244339f6fe0bd22a35eba P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:28.759541 14184 raft_consensus.cc:1275] T 981a078d2d9d479abecc8b0b45771080 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:28.838340 14181 raft_consensus.cc:2955] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
W20260709 12:09:28.851488 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 45363.4us
I20260709 12:09:28.854177 14738 consensus_queue.cc:1048] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 12:09:28.886170 14987 consensus_queue.cc:1048] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:28.886919 14986 raft_consensus.cc:2955] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:28.919752 14264 raft_consensus.cc:2955] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:28.924353 14944 consensus_queue.cc:1048] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:28.952947 14189 raft_consensus.cc:2955] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:28.955322 14912 raft_consensus.cc:2955] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:28.986392 14088 catalog_manager.cc:5697] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 885067a0d31741bfb5c9935788e315bf reported cstate change: config changed from index 2 to 3, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
W20260709 12:09:29.037864 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 53171.4us
I20260709 12:09:29.048803 14986 raft_consensus.cc:2955] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:29.063346 14182 raft_consensus.cc:2955] T 981a078d2d9d479abecc8b0b45771080 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
W20260709 12:09:29.093037 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 166517us
I20260709 12:09:29.099787 14912 raft_consensus.cc:2955] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:29.107618 14334 consensus_queue.cc:237] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:09:29.117067 14911 raft_consensus.cc:1275] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:29.125902 14987 consensus_queue.cc:1048] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:29.126989 14088 catalog_manager.cc:5697] T 981a078d2d9d479abecc8b0b45771080 P 885067a0d31741bfb5c9935788e315bf reported cstate change: config changed from index 2 to 3, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:29.135138 14738 raft_consensus.cc:2955] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 885067a0d31741bfb5c9935788e315bf (127.12.174.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:29.147423 14263 raft_consensus.cc:1275] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:29.146919 14912 raft_consensus.cc:2955] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 885067a0d31741bfb5c9935788e315bf (127.12.174.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:29.149209 14074 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 53a4b57f88ee477d8c90d6b0f0cf2e57 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:29.177528 14262 raft_consensus.cc:2955] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:29.206436 14986 consensus_queue.cc:1048] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:29.211735 14263 raft_consensus.cc:2955] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 885067a0d31741bfb5c9935788e315bf (127.12.174.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:29.223764 14088 catalog_manager.cc:5697] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: config changed from index 3 to 4, VOTER 885067a0d31741bfb5c9935788e315bf (127.12.174.129) evicted. New cstate: current_term: 1 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:29.225088 14337 consensus_queue.cc:237] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:09:29.238247 14912 raft_consensus.cc:1275] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:29.239714 14738 consensus_queue.cc:1048] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:29.239748 14265 consensus_queue.cc:237] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:09:29.247454 14738 raft_consensus.cc:2955] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 885067a0d31741bfb5c9935788e315bf (127.12.174.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:29.251761 14912 raft_consensus.cc:2955] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 885067a0d31741bfb5c9935788e315bf (127.12.174.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:29.254531 14911 raft_consensus.cc:1275] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:29.255043 14181 raft_consensus.cc:1275] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:29.257107 15009 consensus_queue.cc:1048] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:29.258059 14990 consensus_queue.cc:1048] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:29.259441 14074 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 981a078d2d9d479abecc8b0b45771080 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:29.265252 14176 tablet_service.cc:1558] Processing DeleteTablet for tablet 53a4b57f88ee477d8c90d6b0f0cf2e57 with delete_type TABLET_DATA_TOMBSTONED (TS 885067a0d31741bfb5c9935788e315bf not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:59324
W20260709 12:09:29.271396 14074 catalog_manager.cc:5220] ChangeConfig:REMOVE_PEER RPC for tablet 981a078d2d9d479abecc8b0b45771080 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957) due to CAS failure; no further retry: Illegal state: Request specified cas_config_opid_index of 3 but the committed config has opid_index of 4
I20260709 12:09:29.272079 14752 raft_consensus.cc:2955] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 65c9c1653b3346b39a0e118540e6080c (127.12.174.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:29.278503 14087 catalog_manager.cc:5697] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c reported cstate change: config changed from index 3 to 4, VOTER 885067a0d31741bfb5c9935788e315bf (127.12.174.129) evicted. New cstate: current_term: 1 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:29.284178 14189 raft_consensus.cc:2955] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 65c9c1653b3346b39a0e118540e6080c (127.12.174.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:29.301689 14912 raft_consensus.cc:2955] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 65c9c1653b3346b39a0e118540e6080c (127.12.174.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:29.309876 14171 tablet_service.cc:1558] Processing DeleteTablet for tablet 981a078d2d9d479abecc8b0b45771080 with delete_type TABLET_DATA_TOMBSTONED (TS 885067a0d31741bfb5c9935788e315bf not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:59324
I20260709 12:09:29.322096 14074 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e244b5af3ce244339f6fe0bd22a35eba with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:29.330932 15017 tablet_replica.cc:333] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 885067a0d31741bfb5c9935788e315bf: stopping tablet replica
I20260709 12:09:29.332309 14087 catalog_manager.cc:5697] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: config changed from index 3 to 4, VOTER 65c9c1653b3346b39a0e118540e6080c (127.12.174.131) evicted. New cstate: current_term: 1 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:29.309747 14262 raft_consensus.cc:1275] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:29.341208 14738 consensus_queue.cc:1048] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:29.349059 14328 tablet_service.cc:1558] Processing DeleteTablet for tablet e244b5af3ce244339f6fe0bd22a35eba with delete_type TABLET_DATA_TOMBSTONED (TS 65c9c1653b3346b39a0e118540e6080c not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55416
I20260709 12:09:29.353391 15018 tablet_replica.cc:333] T e244b5af3ce244339f6fe0bd22a35eba P 65c9c1653b3346b39a0e118540e6080c: stopping tablet replica
I20260709 12:09:29.390998 14263 raft_consensus.cc:2955] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 885067a0d31741bfb5c9935788e315bf (127.12.174.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:29.436456 15017 raft_consensus.cc:2243] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:29.438145 15017 raft_consensus.cc:2272] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:29.443060 15017 ts_tablet_manager.cc:1916] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 885067a0d31741bfb5c9935788e315bf: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:29.461995 15017 ts_tablet_manager.cc:1929] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 885067a0d31741bfb5c9935788e315bf: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:29.462571 15017 log.cc:1199] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 885067a0d31741bfb5c9935788e315bf: Deleting WAL directory at /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598886212958-12986-0/minicluster-data/ts-0-root/wals/53a4b57f88ee477d8c90d6b0f0cf2e57
I20260709 12:09:29.465474 15017 tablet_replica.cc:333] T 981a078d2d9d479abecc8b0b45771080 P 885067a0d31741bfb5c9935788e315bf: stopping tablet replica
I20260709 12:09:29.466532 14073 catalog_manager.cc:5028] TS 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): tablet 53a4b57f88ee477d8c90d6b0f0cf2e57 (table test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]) successfully deleted
I20260709 12:09:29.468590 15017 raft_consensus.cc:2243] T 981a078d2d9d479abecc8b0b45771080 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:29.469547 15017 raft_consensus.cc:2272] T 981a078d2d9d479abecc8b0b45771080 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:29.473515 15017 ts_tablet_manager.cc:1916] T 981a078d2d9d479abecc8b0b45771080 P 885067a0d31741bfb5c9935788e315bf: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:29.479578 15018 raft_consensus.cc:2243] T e244b5af3ce244339f6fe0bd22a35eba P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:29.480405 15018 raft_consensus.cc:2272] T e244b5af3ce244339f6fe0bd22a35eba P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:29.485517 15018 ts_tablet_manager.cc:1916] T e244b5af3ce244339f6fe0bd22a35eba P 65c9c1653b3346b39a0e118540e6080c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:29.498891 15017 ts_tablet_manager.cc:1929] T 981a078d2d9d479abecc8b0b45771080 P 885067a0d31741bfb5c9935788e315bf: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:29.499495 15017 log.cc:1199] T 981a078d2d9d479abecc8b0b45771080 P 885067a0d31741bfb5c9935788e315bf: Deleting WAL directory at /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598886212958-12986-0/minicluster-data/ts-0-root/wals/981a078d2d9d479abecc8b0b45771080
I20260709 12:09:29.500861 14073 catalog_manager.cc:5028] TS 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): tablet 981a078d2d9d479abecc8b0b45771080 (table test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]) successfully deleted
I20260709 12:09:29.505057 15018 ts_tablet_manager.cc:1929] T e244b5af3ce244339f6fe0bd22a35eba P 65c9c1653b3346b39a0e118540e6080c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:29.505614 15018 log.cc:1199] T e244b5af3ce244339f6fe0bd22a35eba P 65c9c1653b3346b39a0e118540e6080c: Deleting WAL directory at /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598886212958-12986-0/minicluster-data/ts-2-root/wals/e244b5af3ce244339f6fe0bd22a35eba
I20260709 12:09:29.507372 14074 catalog_manager.cc:5028] TS 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957): tablet e244b5af3ce244339f6fe0bd22a35eba (table test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]) successfully deleted
I20260709 12:09:30.427582 14336 consensus_queue.cc:237] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } }
I20260709 12:09:30.434484 14265 raft_consensus.cc:1275] T 60aca7b73a544dfc9a4bd6918b27d132 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:30.434542 14182 raft_consensus.cc:1275] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:09:30.434705 14303 consensus_peers.cc:597] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c -> Peer 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341): Couldn't send request to peer 73d01e9b1a9d49358da4985b21d681db. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 60aca7b73a544dfc9a4bd6918b27d132. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:30.435910 14987 consensus_queue.cc:1048] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:30.436712 14986 consensus_queue.cc:1048] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:30.444231 14987 raft_consensus.cc:2955] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } } }
I20260709 12:09:30.446105 14182 raft_consensus.cc:2955] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } } }
I20260709 12:09:30.455353 14265 raft_consensus.cc:2955] T 60aca7b73a544dfc9a4bd6918b27d132 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } } }
I20260709 12:09:30.461683 14263 consensus_queue.cc:237] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } }
I20260709 12:09:30.466058 14087 catalog_manager.cc:5697] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c reported cstate change: config changed from index -1 to 2, NON_VOTER 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) added. New cstate: current_term: 1 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:30.481709 14336 raft_consensus.cc:1275] T 15f7cecfe772454980c8ae9d1803fe98 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:09:30.485302 14229 consensus_peers.cc:597] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec -> Peer 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341): Couldn't send request to peer 73d01e9b1a9d49358da4985b21d681db. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 15f7cecfe772454980c8ae9d1803fe98. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:30.486250 14752 consensus_queue.cc:1048] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:30.494639 14182 raft_consensus.cc:1275] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:30.496155 14990 consensus_queue.cc:1048] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:30.544353 14990 raft_consensus.cc:2955] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } } }
W20260709 12:09:30.603554 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 72959.5us
W20260709 12:09:30.826239 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 223373us
I20260709 12:09:30.862792 14336 consensus_queue.cc:237] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } }
I20260709 12:09:30.907478 14333 raft_consensus.cc:2955] T 15f7cecfe772454980c8ae9d1803fe98 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } } }
I20260709 12:09:30.924808 14189 raft_consensus.cc:2955] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } } }
I20260709 12:09:30.952025 14181 raft_consensus.cc:1275] T d82ca0c0e51a4e148b8d3e226ff7cebb P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:30.953873 15041 consensus_queue.cc:1048] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:30.973397 14987 raft_consensus.cc:2955] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } } }
I20260709 12:09:30.975785 14181 raft_consensus.cc:2955] T d82ca0c0e51a4e148b8d3e226ff7cebb P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } } }
W20260709 12:09:30.978004 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 56406.2us
I20260709 12:09:31.014545 14263 raft_consensus.cc:1275] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:31.028512 14332 consensus_queue.cc:237] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } }
W20260709 12:09:31.042841 14303 consensus_peers.cc:597] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c -> Peer 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341): Couldn't send request to peer 73d01e9b1a9d49358da4985b21d681db. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d82ca0c0e51a4e148b8d3e226ff7cebb. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:31.056900 14087 catalog_manager.cc:5697] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf reported cstate change: config changed from index -1 to 2, NON_VOTER 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) added. New cstate: current_term: 1 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } } }
I20260709 12:09:31.077239 14189 raft_consensus.cc:1275] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:09:31.077306 14303 consensus_peers.cc:597] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c -> Peer 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341): Couldn't send request to peer 73d01e9b1a9d49358da4985b21d681db. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7c8882b1b37d4e84a94a2e1e321a8755. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:31.078457 14986 consensus_queue.cc:1048] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:31.079375 15042 consensus_queue.cc:1048] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:31.094889 15052 ts_tablet_manager.cc:933] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db: Initiating tablet copy from peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:31.106110 14088 catalog_manager.cc:5697] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c reported cstate change: config changed from index -1 to 2, NON_VOTER 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) added. New cstate: current_term: 1 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:31.109851 14259 raft_consensus.cc:1275] T 7c8882b1b37d4e84a94a2e1e321a8755 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:31.118667 15041 consensus_queue.cc:1048] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:31.139298 15053 ts_tablet_manager.cc:933] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db: Initiating tablet copy from peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:31.152210 15026 raft_consensus.cc:2955] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } } }
I20260709 12:09:31.166064 15053 tablet_copy_client.cc:323] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db: tablet copy: Beginning tablet copy session from remote peer at address 127.12.174.130:36673
I20260709 12:09:31.165256 14259 raft_consensus.cc:2955] T 7c8882b1b37d4e84a94a2e1e321a8755 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } } }
I20260709 12:09:31.170280 14275 tablet_copy_service.cc:140] P 17aab1bbf5014936aa18cc21818b26ec: Received BeginTabletCopySession request for tablet 15f7cecfe772454980c8ae9d1803fe98 from peer 73d01e9b1a9d49358da4985b21d681db ({username='slave'} at 127.0.0.1:53050)
I20260709 12:09:31.170900 14275 tablet_copy_service.cc:161] P 17aab1bbf5014936aa18cc21818b26ec: Beginning new tablet copy session on tablet 15f7cecfe772454980c8ae9d1803fe98 from peer 73d01e9b1a9d49358da4985b21d681db at {username='slave'} at 127.0.0.1:53050: session id = 73d01e9b1a9d49358da4985b21d681db-15f7cecfe772454980c8ae9d1803fe98
I20260709 12:09:31.172600 14260 raft_consensus.cc:2955] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } } }
I20260709 12:09:31.199765 15052 tablet_copy_client.cc:323] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db: tablet copy: Beginning tablet copy session from remote peer at address 127.12.174.131:45957
I20260709 12:09:31.203662 14348 tablet_copy_service.cc:140] P 65c9c1653b3346b39a0e118540e6080c: Received BeginTabletCopySession request for tablet 60aca7b73a544dfc9a4bd6918b27d132 from peer 73d01e9b1a9d49358da4985b21d681db ({username='slave'} at 127.0.0.1:55492)
I20260709 12:09:31.204331 14348 tablet_copy_service.cc:161] P 65c9c1653b3346b39a0e118540e6080c: Beginning new tablet copy session on tablet 60aca7b73a544dfc9a4bd6918b27d132 from peer 73d01e9b1a9d49358da4985b21d681db at {username='slave'} at 127.0.0.1:55492: session id = 73d01e9b1a9d49358da4985b21d681db-60aca7b73a544dfc9a4bd6918b27d132
I20260709 12:09:31.207508 14275 tablet_copy_source_session.cc:215] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:31.207016 14088 catalog_manager.cc:5697] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c reported cstate change: config changed from index -1 to 2, NON_VOTER 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) added. New cstate: current_term: 1 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:31.203881 14185 raft_consensus.cc:2955] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } } }
I20260709 12:09:31.218400 14348 tablet_copy_source_session.cc:215] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:31.222221 15053 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15f7cecfe772454980c8ae9d1803fe98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:31.229512 15052 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60aca7b73a544dfc9a4bd6918b27d132. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:31.249475 15053 tablet_copy_client.cc:806] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:31.250296 15053 tablet_copy_client.cc:670] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:31.255944 15053 tablet_copy_client.cc:538] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:31.263120 15052 tablet_copy_client.cc:806] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:31.263827 15052 tablet_copy_client.cc:670] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:31.266932 15053 tablet_bootstrap.cc:492] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db: Bootstrap starting.
I20260709 12:09:31.269331 15052 tablet_copy_client.cc:538] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:31.285882 15052 tablet_bootstrap.cc:492] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db: Bootstrap starting.
I20260709 12:09:31.304360 15053 tablet_bootstrap.cc:492] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:31.305859 15053 tablet_bootstrap.cc:492] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db: Bootstrap complete.
I20260709 12:09:31.306852 15053 ts_tablet_manager.cc:1403] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db: Time spent bootstrapping tablet: real 0.040s	user 0.018s	sys 0.020s
I20260709 12:09:31.316289 15053 raft_consensus.cc:359] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } }
I20260709 12:09:31.317704 15053 raft_consensus.cc:740] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Initialized, Role: LEARNER
I20260709 12:09:31.318845 15053 consensus_queue.cc:260] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } }
I20260709 12:09:31.331979 15052 tablet_bootstrap.cc:492] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:31.335675 15052 tablet_bootstrap.cc:492] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db: Bootstrap complete.
I20260709 12:09:31.336714 15052 ts_tablet_manager.cc:1403] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db: Time spent bootstrapping tablet: real 0.051s	user 0.029s	sys 0.013s
I20260709 12:09:31.347219 15053 ts_tablet_manager.cc:1434] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db: Time spent starting tablet: real 0.038s	user 0.003s	sys 0.015s
I20260709 12:09:31.350549 14275 tablet_copy_service.cc:342] P 17aab1bbf5014936aa18cc21818b26ec: Request end of tablet copy session 73d01e9b1a9d49358da4985b21d681db-15f7cecfe772454980c8ae9d1803fe98 received from {username='slave'} at 127.0.0.1:53050
I20260709 12:09:31.354635 14275 tablet_copy_service.cc:434] P 17aab1bbf5014936aa18cc21818b26ec: ending tablet copy session 73d01e9b1a9d49358da4985b21d681db-15f7cecfe772454980c8ae9d1803fe98 on tablet 15f7cecfe772454980c8ae9d1803fe98 with peer 73d01e9b1a9d49358da4985b21d681db
I20260709 12:09:31.353147 15052 raft_consensus.cc:359] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } }
I20260709 12:09:31.356436 15052 raft_consensus.cc:740] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Initialized, Role: LEARNER
I20260709 12:09:31.357530 15052 consensus_queue.cc:260] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } }
I20260709 12:09:31.362229 15052 ts_tablet_manager.cc:1434] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db: Time spent starting tablet: real 0.025s	user 0.011s	sys 0.003s
I20260709 12:09:31.364986 14348 tablet_copy_service.cc:342] P 65c9c1653b3346b39a0e118540e6080c: Request end of tablet copy session 73d01e9b1a9d49358da4985b21d681db-60aca7b73a544dfc9a4bd6918b27d132 received from {username='slave'} at 127.0.0.1:55492
I20260709 12:09:31.365653 14348 tablet_copy_service.cc:434] P 65c9c1653b3346b39a0e118540e6080c: ending tablet copy session 73d01e9b1a9d49358da4985b21d681db-60aca7b73a544dfc9a4bd6918b27d132 on tablet 60aca7b73a544dfc9a4bd6918b27d132 with peer 73d01e9b1a9d49358da4985b21d681db
I20260709 12:09:31.499380 14910 raft_consensus.cc:1217] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:31.535666 15052 ts_tablet_manager.cc:933] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db: Initiating tablet copy from peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:31.538816 14910 raft_consensus.cc:1217] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:31.548882 15052 tablet_copy_client.cc:323] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db: tablet copy: Beginning tablet copy session from remote peer at address 127.12.174.131:45957
I20260709 12:09:31.551568 14348 tablet_copy_service.cc:140] P 65c9c1653b3346b39a0e118540e6080c: Received BeginTabletCopySession request for tablet d82ca0c0e51a4e148b8d3e226ff7cebb from peer 73d01e9b1a9d49358da4985b21d681db ({username='slave'} at 127.0.0.1:55492)
I20260709 12:09:31.552258 14348 tablet_copy_service.cc:161] P 65c9c1653b3346b39a0e118540e6080c: Beginning new tablet copy session on tablet d82ca0c0e51a4e148b8d3e226ff7cebb from peer 73d01e9b1a9d49358da4985b21d681db at {username='slave'} at 127.0.0.1:55492: session id = 73d01e9b1a9d49358da4985b21d681db-d82ca0c0e51a4e148b8d3e226ff7cebb
I20260709 12:09:31.554383 15053 ts_tablet_manager.cc:933] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db: Initiating tablet copy from peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:31.561952 15053 tablet_copy_client.cc:323] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db: tablet copy: Beginning tablet copy session from remote peer at address 127.12.174.131:45957
I20260709 12:09:31.564181 14349 tablet_copy_service.cc:140] P 65c9c1653b3346b39a0e118540e6080c: Received BeginTabletCopySession request for tablet 7c8882b1b37d4e84a94a2e1e321a8755 from peer 73d01e9b1a9d49358da4985b21d681db ({username='slave'} at 127.0.0.1:55492)
I20260709 12:09:31.564788 14349 tablet_copy_service.cc:161] P 65c9c1653b3346b39a0e118540e6080c: Beginning new tablet copy session on tablet 7c8882b1b37d4e84a94a2e1e321a8755 from peer 73d01e9b1a9d49358da4985b21d681db at {username='slave'} at 127.0.0.1:55492: session id = 73d01e9b1a9d49358da4985b21d681db-7c8882b1b37d4e84a94a2e1e321a8755
I20260709 12:09:31.565263 14348 tablet_copy_source_session.cc:215] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:31.569794 15052 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d82ca0c0e51a4e148b8d3e226ff7cebb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:31.574043 14349 tablet_copy_source_session.cc:215] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:31.577538 15053 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c8882b1b37d4e84a94a2e1e321a8755. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:31.586154 15052 tablet_copy_client.cc:806] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:31.586810 15052 tablet_copy_client.cc:670] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:31.595911 15052 tablet_copy_client.cc:538] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:31.608913 15053 tablet_copy_client.cc:806] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:31.609593 15053 tablet_copy_client.cc:670] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:31.614459 15052 tablet_bootstrap.cc:492] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db: Bootstrap starting.
I20260709 12:09:31.618755 15053 tablet_copy_client.cc:538] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:31.629942 15053 tablet_bootstrap.cc:492] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db: Bootstrap starting.
I20260709 12:09:31.638955 15052 tablet_bootstrap.cc:492] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:31.640035 15052 tablet_bootstrap.cc:492] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db: Bootstrap complete.
I20260709 12:09:31.640823 15052 ts_tablet_manager.cc:1403] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db: Time spent bootstrapping tablet: real 0.027s	user 0.020s	sys 0.002s
I20260709 12:09:31.644516 15052 raft_consensus.cc:359] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } }
I20260709 12:09:31.645543 15052 raft_consensus.cc:740] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Initialized, Role: LEARNER
I20260709 12:09:31.646397 15052 consensus_queue.cc:260] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } }
I20260709 12:09:31.658874 15052 ts_tablet_manager.cc:1434] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db: Time spent starting tablet: real 0.018s	user 0.009s	sys 0.002s
I20260709 12:09:31.661244 14349 tablet_copy_service.cc:342] P 65c9c1653b3346b39a0e118540e6080c: Request end of tablet copy session 73d01e9b1a9d49358da4985b21d681db-d82ca0c0e51a4e148b8d3e226ff7cebb received from {username='slave'} at 127.0.0.1:55492
I20260709 12:09:31.661759 14349 tablet_copy_service.cc:434] P 65c9c1653b3346b39a0e118540e6080c: ending tablet copy session 73d01e9b1a9d49358da4985b21d681db-d82ca0c0e51a4e148b8d3e226ff7cebb on tablet d82ca0c0e51a4e148b8d3e226ff7cebb with peer 73d01e9b1a9d49358da4985b21d681db
I20260709 12:09:31.679373 15053 tablet_bootstrap.cc:492] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:31.680464 15053 tablet_bootstrap.cc:492] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db: Bootstrap complete.
I20260709 12:09:31.681298 15053 ts_tablet_manager.cc:1403] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db: Time spent bootstrapping tablet: real 0.052s	user 0.041s	sys 0.001s
I20260709 12:09:31.684495 15053 raft_consensus.cc:359] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } }
I20260709 12:09:31.685176 15053 raft_consensus.cc:740] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Initialized, Role: LEARNER
I20260709 12:09:31.685724 15053 consensus_queue.cc:260] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } }
I20260709 12:09:31.688025 15053 ts_tablet_manager.cc:1434] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:09:31.689988 14349 tablet_copy_service.cc:342] P 65c9c1653b3346b39a0e118540e6080c: Request end of tablet copy session 73d01e9b1a9d49358da4985b21d681db-7c8882b1b37d4e84a94a2e1e321a8755 received from {username='slave'} at 127.0.0.1:55492
I20260709 12:09:31.690452 14349 tablet_copy_service.cc:434] P 65c9c1653b3346b39a0e118540e6080c: ending tablet copy session 73d01e9b1a9d49358da4985b21d681db-7c8882b1b37d4e84a94a2e1e321a8755 on tablet 7c8882b1b37d4e84a94a2e1e321a8755 with peer 73d01e9b1a9d49358da4985b21d681db
W20260709 12:09:31.704437 12991 debug-util.cc:398] Leaking SignalData structure 0x7b080000f880 after lost signal to thread 14230
W20260709 12:09:31.908972 14360 debug-util.cc:398] Leaking SignalData structure 0x7b08001677e0 after lost signal to thread 12989
W20260709 12:09:31.910245 14360 debug-util.cc:398] Leaking SignalData structure 0x7b0800167ec0 after lost signal to thread 14122
W20260709 12:09:31.911589 14360 debug-util.cc:398] Leaking SignalData structure 0x7b08002441e0 after lost signal to thread 14214
W20260709 12:09:31.912807 14360 debug-util.cc:398] Leaking SignalData structure 0x7b08002fb880 after lost signal to thread 14289
W20260709 12:09:31.914002 14360 debug-util.cc:398] Leaking SignalData structure 0x7b0800299640 after lost signal to thread 14363
W20260709 12:09:31.915294 14360 debug-util.cc:398] Leaking SignalData structure 0x7b080028ce00 after lost signal to thread 14936
I20260709 12:09:31.996206 14910 raft_consensus.cc:1217] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:32.013336 14910 raft_consensus.cc:1217] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:32.085749 14986 raft_consensus.cc:1064] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c: attempting to promote NON_VOTER 73d01e9b1a9d49358da4985b21d681db to VOTER
I20260709 12:09:32.088764 14986 consensus_queue.cc:237] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:09:32.109519 14910 raft_consensus.cc:1275] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [term 1 LEARNER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:32.111599 15041 consensus_queue.cc:1048] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:32.114699 14259 raft_consensus.cc:1275] T 60aca7b73a544dfc9a4bd6918b27d132 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:32.119369 15041 consensus_queue.cc:1048] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:32.133167 14182 raft_consensus.cc:1275] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:32.134516 14259 raft_consensus.cc:2955] T 60aca7b73a544dfc9a4bd6918b27d132 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:32.137620 14986 consensus_queue.cc:1048] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:32.142176 15038 raft_consensus.cc:1064] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec: attempting to promote NON_VOTER 73d01e9b1a9d49358da4985b21d681db to VOTER
I20260709 12:09:32.150125 15038 consensus_queue.cc:237] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:09:32.133020 15041 raft_consensus.cc:2955] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:32.167716 14910 raft_consensus.cc:2955] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:32.182871 14189 raft_consensus.cc:2955] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:32.190593 14088 catalog_manager.cc:5697] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: config changed from index 2 to 3, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:32.223796 14336 raft_consensus.cc:1275] T 15f7cecfe772454980c8ae9d1803fe98 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:32.225508 14990 consensus_queue.cc:1048] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:32.235354 14910 raft_consensus.cc:1275] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 1 LEARNER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:32.237143 14990 consensus_queue.cc:1048] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:32.240444 14189 raft_consensus.cc:1275] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:32.242827 14990 consensus_queue.cc:1048] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:32.266839 15038 raft_consensus.cc:2955] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:32.273845 14912 raft_consensus.cc:2955] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:32.278014 14189 raft_consensus.cc:2955] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:32.293632 14336 raft_consensus.cc:2955] T 15f7cecfe772454980c8ae9d1803fe98 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:32.336377 14086 catalog_manager.cc:5697] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: config changed from index 2 to 3, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:32.367944 14260 consensus_queue.cc:237] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:09:32.374207 14912 raft_consensus.cc:1275] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:32.374756 14189 raft_consensus.cc:1275] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:32.377596 15073 consensus_queue.cc:1048] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:32.378422 14990 consensus_queue.cc:1048] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:32.388010 15038 raft_consensus.cc:2955] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 65c9c1653b3346b39a0e118540e6080c (127.12.174.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:32.395505 14189 raft_consensus.cc:2955] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 65c9c1653b3346b39a0e118540e6080c (127.12.174.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:32.403033 14074 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 15f7cecfe772454980c8ae9d1803fe98 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:32.416275 14086 catalog_manager.cc:5697] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: config changed from index 3 to 4, VOTER 65c9c1653b3346b39a0e118540e6080c (127.12.174.131) evicted. New cstate: current_term: 1 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:32.415999 14912 raft_consensus.cc:2955] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 65c9c1653b3346b39a0e118540e6080c (127.12.174.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:32.440155 15068 raft_consensus.cc:1064] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c: attempting to promote NON_VOTER 73d01e9b1a9d49358da4985b21d681db to VOTER
I20260709 12:09:32.443102 15068 consensus_queue.cc:237] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:09:32.468127 14328 tablet_service.cc:1558] Processing DeleteTablet for tablet 15f7cecfe772454980c8ae9d1803fe98 with delete_type TABLET_DATA_TOMBSTONED (TS 65c9c1653b3346b39a0e118540e6080c not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55416
I20260709 12:09:32.474332 15026 raft_consensus.cc:1064] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c: attempting to promote NON_VOTER 73d01e9b1a9d49358da4985b21d681db to VOTER
I20260709 12:09:32.477017 15026 consensus_queue.cc:237] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:09:32.496945 14911 raft_consensus.cc:1275] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 1 LEARNER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:32.499058 14986 consensus_queue.cc:1048] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:32.510051 14260 raft_consensus.cc:1275] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:32.512576 15042 consensus_queue.cc:1048] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:32.524421 14185 raft_consensus.cc:1275] T d82ca0c0e51a4e148b8d3e226ff7cebb P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:32.530472 14986 consensus_queue.cc:1048] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:32.541594 15081 tablet_replica.cc:333] T 15f7cecfe772454980c8ae9d1803fe98 P 65c9c1653b3346b39a0e118540e6080c: stopping tablet replica
I20260709 12:09:32.549541 15081 raft_consensus.cc:2243] T 15f7cecfe772454980c8ae9d1803fe98 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:32.557655 14912 raft_consensus.cc:1275] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 1 LEARNER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:32.559296 15068 consensus_queue.cc:1048] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:32.560099 14260 raft_consensus.cc:1275] T 7c8882b1b37d4e84a94a2e1e321a8755 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:32.560496 14189 raft_consensus.cc:1275] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:32.561775 14986 consensus_queue.cc:1048] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:32.563493 14986 consensus_queue.cc:1048] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:32.565867 15081 raft_consensus.cc:2272] T 15f7cecfe772454980c8ae9d1803fe98 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:09:32.610366 15080 log.cc:927] Time spent T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.055s	user 0.000s	sys 0.002s
I20260709 12:09:32.616897 15081 ts_tablet_manager.cc:1916] T 15f7cecfe772454980c8ae9d1803fe98 P 65c9c1653b3346b39a0e118540e6080c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:32.676599 14332 consensus_queue.cc:237] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:09:32.680202 14185 raft_consensus.cc:2955] T d82ca0c0e51a4e148b8d3e226ff7cebb P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:32.676627 15042 raft_consensus.cc:2955] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:32.697121 14910 raft_consensus.cc:1275] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
W20260709 12:09:32.698180 15084 log.cc:927] Time spent T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
W20260709 12:09:32.703998 15086 log.cc:927] Time spent T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.059s	user 0.002s	sys 0.000s
I20260709 12:09:32.703784 14263 raft_consensus.cc:2955] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:32.704028 14085 catalog_manager.cc:5697] T d82ca0c0e51a4e148b8d3e226ff7cebb P 885067a0d31741bfb5c9935788e315bf reported cstate change: config changed from index 2 to 3, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
W20260709 12:09:32.708178 15088 log.cc:927] Time spent T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.062s	user 0.000s	sys 0.003s
W20260709 12:09:32.710134 15089 log.cc:927] Time spent T 7c8882b1b37d4e84a94a2e1e321a8755 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.066s	user 0.005s	sys 0.000s
I20260709 12:09:32.726585 15068 consensus_queue.cc:1048] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:32.735633 15026 raft_consensus.cc:2955] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:32.764614 15081 ts_tablet_manager.cc:1929] T 15f7cecfe772454980c8ae9d1803fe98 P 65c9c1653b3346b39a0e118540e6080c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:32.765358 15081 log.cc:1199] T 15f7cecfe772454980c8ae9d1803fe98 P 65c9c1653b3346b39a0e118540e6080c: Deleting WAL directory at /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598886212958-12986-0/minicluster-data/ts-2-root/wals/15f7cecfe772454980c8ae9d1803fe98
I20260709 12:09:32.767565 14074 catalog_manager.cc:5028] TS 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957): tablet 15f7cecfe772454980c8ae9d1803fe98 (table test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]) successfully deleted
W20260709 12:09:32.782953 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 51672.7us
I20260709 12:09:32.787959 14189 raft_consensus.cc:1275] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:32.791491 14986 consensus_queue.cc:1048] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:32.790740 14910 raft_consensus.cc:2955] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:32.794126 14189 raft_consensus.cc:2955] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:32.794247 14911 raft_consensus.cc:2955] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:32.820914 14260 raft_consensus.cc:2955] T 7c8882b1b37d4e84a94a2e1e321a8755 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:32.841813 14333 consensus_queue.cc:237] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:09:32.853102 15041 raft_consensus.cc:2955] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:32.859333 14912 raft_consensus.cc:2955] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:32.861233 14185 raft_consensus.cc:2955] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:32.878917 14087 catalog_manager.cc:5697] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: config changed from index 3 to 4, VOTER 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130) evicted. New cstate: current_term: 1 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:32.906070 14263 raft_consensus.cc:1275] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:32.909137 14986 consensus_queue.cc:1048] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:32.912590 14085 catalog_manager.cc:5697] T 7c8882b1b37d4e84a94a2e1e321a8755 P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: config changed from index 2 to 3, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:32.926752 14986 raft_consensus.cc:2955] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 885067a0d31741bfb5c9935788e315bf (127.12.174.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:32.928112 14911 raft_consensus.cc:1275] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:32.929520 14260 raft_consensus.cc:2955] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 885067a0d31741bfb5c9935788e315bf (127.12.174.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:32.942195 14246 tablet_service.cc:1558] Processing DeleteTablet for tablet 60aca7b73a544dfc9a4bd6918b27d132 with delete_type TABLET_DATA_TOMBSTONED (TS 17aab1bbf5014936aa18cc21818b26ec not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:51304
I20260709 12:09:32.943207 15042 consensus_queue.cc:1048] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:32.961391 14333 consensus_queue.cc:237] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:09:32.958631 14911 raft_consensus.cc:2955] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 885067a0d31741bfb5c9935788e315bf (127.12.174.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:32.968568 14074 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d82ca0c0e51a4e148b8d3e226ff7cebb with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:32.971517 14086 catalog_manager.cc:5697] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: config changed from index 3 to 4, VOTER 885067a0d31741bfb5c9935788e315bf (127.12.174.129) evicted. New cstate: current_term: 1 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:32.981149 14189 raft_consensus.cc:1275] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:32.985037 15091 tablet_replica.cc:333] T 60aca7b73a544dfc9a4bd6918b27d132 P 17aab1bbf5014936aa18cc21818b26ec: stopping tablet replica
I20260709 12:09:32.985247 15068 consensus_queue.cc:1048] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:32.987011 15091 raft_consensus.cc:2243] T 60aca7b73a544dfc9a4bd6918b27d132 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:32.991878 14912 raft_consensus.cc:1275] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:32.997516 14074 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 60aca7b73a544dfc9a4bd6918b27d132 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:33.011899 15091 raft_consensus.cc:2272] T 60aca7b73a544dfc9a4bd6918b27d132 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:33.018031 14176 tablet_service.cc:1558] Processing DeleteTablet for tablet d82ca0c0e51a4e148b8d3e226ff7cebb with delete_type TABLET_DATA_TOMBSTONED (TS 885067a0d31741bfb5c9935788e315bf not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:59324
I20260709 12:09:33.025063 15042 consensus_queue.cc:1048] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:33.046393 15041 raft_consensus.cc:2955] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:33.057390 14187 raft_consensus.cc:2955] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:33.073988 14074 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7c8882b1b37d4e84a94a2e1e321a8755 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:33.075656 14911 raft_consensus.cc:2955] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:33.092025 14085 catalog_manager.cc:5697] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c reported cstate change: config changed from index 3 to 4, VOTER 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130) evicted. New cstate: current_term: 1 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:33.107556 14246 tablet_service.cc:1558] Processing DeleteTablet for tablet 7c8882b1b37d4e84a94a2e1e321a8755 with delete_type TABLET_DATA_TOMBSTONED (TS 17aab1bbf5014936aa18cc21818b26ec not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:51304
I20260709 12:09:33.111881 15091 ts_tablet_manager.cc:1916] T 60aca7b73a544dfc9a4bd6918b27d132 P 17aab1bbf5014936aa18cc21818b26ec: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:33.114259 15093 tablet_replica.cc:333] T d82ca0c0e51a4e148b8d3e226ff7cebb P 885067a0d31741bfb5c9935788e315bf: stopping tablet replica
I20260709 12:09:33.132768 15093 raft_consensus.cc:2243] T d82ca0c0e51a4e148b8d3e226ff7cebb P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:33.141534 15093 raft_consensus.cc:2272] T d82ca0c0e51a4e148b8d3e226ff7cebb P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:33.147008 15093 ts_tablet_manager.cc:1916] T d82ca0c0e51a4e148b8d3e226ff7cebb P 885067a0d31741bfb5c9935788e315bf: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:33.147428 15091 ts_tablet_manager.cc:1929] T 60aca7b73a544dfc9a4bd6918b27d132 P 17aab1bbf5014936aa18cc21818b26ec: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:33.148599 15091 log.cc:1199] T 60aca7b73a544dfc9a4bd6918b27d132 P 17aab1bbf5014936aa18cc21818b26ec: Deleting WAL directory at /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598886212958-12986-0/minicluster-data/ts-1-root/wals/60aca7b73a544dfc9a4bd6918b27d132
I20260709 12:09:33.151098 14074 catalog_manager.cc:5028] TS 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): tablet 60aca7b73a544dfc9a4bd6918b27d132 (table test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]) successfully deleted
I20260709 12:09:33.151217 15091 tablet_replica.cc:333] T 7c8882b1b37d4e84a94a2e1e321a8755 P 17aab1bbf5014936aa18cc21818b26ec: stopping tablet replica
I20260709 12:09:33.153466 15091 raft_consensus.cc:2243] T 7c8882b1b37d4e84a94a2e1e321a8755 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:33.155339 15091 raft_consensus.cc:2272] T 7c8882b1b37d4e84a94a2e1e321a8755 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:33.162233 15091 ts_tablet_manager.cc:1916] T 7c8882b1b37d4e84a94a2e1e321a8755 P 17aab1bbf5014936aa18cc21818b26ec: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:33.188881 15091 ts_tablet_manager.cc:1929] T 7c8882b1b37d4e84a94a2e1e321a8755 P 17aab1bbf5014936aa18cc21818b26ec: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:33.189424 15091 log.cc:1199] T 7c8882b1b37d4e84a94a2e1e321a8755 P 17aab1bbf5014936aa18cc21818b26ec: Deleting WAL directory at /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598886212958-12986-0/minicluster-data/ts-1-root/wals/7c8882b1b37d4e84a94a2e1e321a8755
I20260709 12:09:33.191429 14074 catalog_manager.cc:5028] TS 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): tablet 7c8882b1b37d4e84a94a2e1e321a8755 (table test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]) successfully deleted
I20260709 12:09:33.199796 15093 ts_tablet_manager.cc:1929] T d82ca0c0e51a4e148b8d3e226ff7cebb P 885067a0d31741bfb5c9935788e315bf: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:33.200429 15093 log.cc:1199] T d82ca0c0e51a4e148b8d3e226ff7cebb P 885067a0d31741bfb5c9935788e315bf: Deleting WAL directory at /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598886212958-12986-0/minicluster-data/ts-0-root/wals/d82ca0c0e51a4e148b8d3e226ff7cebb
I20260709 12:09:33.203150 14073 catalog_manager.cc:5028] TS 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): tablet d82ca0c0e51a4e148b8d3e226ff7cebb (table test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]) successfully deleted
W20260709 12:09:34.313813 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 109826us
W20260709 12:09:34.448482 14231 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.786s	user 0.003s	sys 0.021s
W20260709 12:09:34.448877 14231 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.786s	user 0.003s	sys 0.021s
W20260709 12:09:34.534719 14229 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.921s	user 0.005s	sys 0.012s
W20260709 12:09:34.535128 14229 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.922s	user 0.005s	sys 0.012s
I20260709 12:09:34.539708 15094 raft_consensus.cc:493] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:09:34.540294 15094 raft_consensus.cc:515] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:34.542405 15094 leader_election.cc:290] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:34.543740 15102 raft_consensus.cc:493] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:09:34.545531 15102 raft_consensus.cc:515] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:09:34.553964 15102 leader_election.cc:290] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:09:34.572187 15095 raft_consensus.cc:493] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:09:34.573208 15095 raft_consensus.cc:515] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:34.584663 15095 leader_election.cc:290] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:34.590211 15101 raft_consensus.cc:493] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:09:34.590865 15101 raft_consensus.cc:515] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:34.593370 15101 leader_election.cc:290] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:09:34.609144 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 286814us
I20260709 12:09:34.611428 15097 raft_consensus.cc:493] T bf9bea0d16e44efabb5cdd53e3828438 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:09:34.612018 15097 raft_consensus.cc:515] T bf9bea0d16e44efabb5cdd53e3828438 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:34.631912 15100 raft_consensus.cc:493] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:09:34.632597 15100 raft_consensus.cc:515] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:09:34.634370 14230 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.894s	user 0.005s	sys 0.007s
W20260709 12:09:34.634740 14230 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.894s	user 0.005s	sys 0.007s
I20260709 12:09:34.635561 15100 leader_election.cc:290] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:34.642055 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:34.617274 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:34.641346 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:34.614305 15097 leader_election.cc:290] T bf9bea0d16e44efabb5cdd53e3828438 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:34.647399 15041 raft_consensus.cc:493] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:09:34.647883 15041 raft_consensus.cc:515] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:34.649245 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:34.649668 15041 leader_election.cc:290] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:34.650144 15041 raft_consensus.cc:493] T afce5304599246a580d798fc0c843964 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:09:34.650563 15041 raft_consensus.cc:515] T afce5304599246a580d798fc0c843964 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:34.652308 15041 leader_election.cc:290] T afce5304599246a580d798fc0c843964 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:34.657882 15095 raft_consensus.cc:493] T 36091607df2f46059df62d677842a031 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:09:34.658375 15095 raft_consensus.cc:515] T 36091607df2f46059df62d677842a031 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:34.660475 15095 leader_election.cc:290] T 36091607df2f46059df62d677842a031 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:34.664373 15096 raft_consensus.cc:493] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
W20260709 12:09:34.665715 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 46217.7us
I20260709 12:09:34.675642 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:34.674700 15102 raft_consensus.cc:493] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:09:34.664937 15096 raft_consensus.cc:515] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:09:34.677695 15102 raft_consensus.cc:515] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:34.680946 15101 raft_consensus.cc:493] T 02513fb0dbdd4cbdb019d79f0f448d18 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:09:34.681556 15101 raft_consensus.cc:515] T 02513fb0dbdd4cbdb019d79f0f448d18 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:34.683615 15101 leader_election.cc:290] T 02513fb0dbdd4cbdb019d79f0f448d18 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:34.685700 15096 leader_election.cc:290] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:09:34.686017 15101 raft_consensus.cc:493] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:09:34.687331 15102 leader_election.cc:290] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:34.702139 15101 raft_consensus.cc:515] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:34.704241 15104 raft_consensus.cc:493] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:09:34.704826 15104 raft_consensus.cc:515] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:34.706393 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:09:34.711513 14263 consensus_queue.cc:237] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } }
I20260709 12:09:34.715142 15104 leader_election.cc:290] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:34.718252 15100 raft_consensus.cc:493] T f4739bc22bfe44fcba807da02d9351b6 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:09:34.718772 15100 raft_consensus.cc:515] T f4739bc22bfe44fcba807da02d9351b6 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:34.720765 15100 leader_election.cc:290] T f4739bc22bfe44fcba807da02d9351b6 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:34.727984 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:34.717965 15101 leader_election.cc:290] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:34.731046 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:34.734552 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:34.763206 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:34.752895 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:34.772782 15108 raft_consensus.cc:493] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:09:34.772482 15101 raft_consensus.cc:493] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:09:34.782140 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:34.772540 15109 raft_consensus.cc:493] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:09:34.783210 15101 raft_consensus.cc:515] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:34.786005 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:34.788278 15101 leader_election.cc:290] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:34.734617 15041 raft_consensus.cc:493] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:09:34.788962 15041 raft_consensus.cc:515] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:34.783707 15109 raft_consensus.cc:515] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:34.796865 15109 leader_election.cc:290] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:34.779428 15108 raft_consensus.cc:515] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } }
I20260709 12:09:34.800225 15100 raft_consensus.cc:493] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:09:34.802088 14155 leader_election.cc:304] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:09:34.803077 15106 raft_consensus.cc:493] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:09:34.802965 15104 raft_consensus.cc:493] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:09:34.805356 14155 leader_election.cc:304] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:09:34.805606 15041 leader_election.cc:290] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:34.803660 15106 raft_consensus.cc:515] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:34.804320 15102 raft_consensus.cc:493] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:09:34.803999 15104 raft_consensus.cc:515] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:34.811981 15106 leader_election.cc:290] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:34.806177 15101 raft_consensus.cc:493] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:09:34.812563 15106 raft_consensus.cc:2749] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:34.812487 15104 leader_election.cc:290] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:34.808969 15102 raft_consensus.cc:515] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:34.809842 15100 raft_consensus.cc:515] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } }
I20260709 12:09:34.813925 15105 raft_consensus.cc:2749] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:34.813256 15106 raft_consensus.cc:493] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:09:34.815553 15101 raft_consensus.cc:515] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:34.817005 15102 leader_election.cc:290] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:34.818637 15100 leader_election.cc:290] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:34.823488 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:34.823904 15108 leader_election.cc:290] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:34.817703 15101 leader_election.cc:290] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:34.825657 15107 raft_consensus.cc:493] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:09:34.826237 15107 raft_consensus.cc:515] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:34.829869 15096 raft_consensus.cc:493] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:09:34.824465 15106 raft_consensus.cc:515] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:34.829871 15107 leader_election.cc:290] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:34.830492 15096 raft_consensus.cc:515] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:34.833580 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:34.834095 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:34.835002 15096 leader_election.cc:290] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:34.837891 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:34.838621 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:34.839792 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:34.839849 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:34.841064 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:34.841537 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:34.841615 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:34.842391 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:34.843008 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:34.844388 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:34.846887 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:34.847012 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:34.847648 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:34.848881 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:34.849573 14185 raft_consensus.cc:2468] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 1.
I20260709 12:09:34.850718 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:34.851191 14189 raft_consensus.cc:2468] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 1.
W20260709 12:09:34.851728 14229 consensus_peers.cc:597] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec -> Peer 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341): Couldn't send request to peer 73d01e9b1a9d49358da4985b21d681db. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7879f4a298eb4e69ac692911bd5ac5f8. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:34.852602 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:34.854028 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:34.860939 14256 raft_consensus.cc:2468] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 1.
I20260709 12:09:34.863112 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:34.863715 14333 raft_consensus.cc:1275] T 7879f4a298eb4e69ac692911bd5ac5f8 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:34.864027 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:34.854552 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:34.867089 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:34.867714 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:34.868170 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:34.869185 14155 leader_election.cc:304] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:09:34.871017 14155 leader_election.cc:304] T 02513fb0dbdd4cbdb019d79f0f448d18 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:09:34.872162 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:34.874884 15111 raft_consensus.cc:493] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:09:34.878983 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:34.882058 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:34.880194 15102 raft_consensus.cc:2749] T 02513fb0dbdd4cbdb019d79f0f448d18 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:34.869997 15100 raft_consensus.cc:2749] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:34.884723 15106 leader_election.cc:290] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:34.875471 15111 raft_consensus.cc:515] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:34.885785 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:34.887079 14185 raft_consensus.cc:2468] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 1.
I20260709 12:09:34.885885 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:34.882634 14155 leader_election.cc:304] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:09:34.894357 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:34.896644 14155 leader_election.cc:304] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:09:34.902266 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:34.903589 15101 raft_consensus.cc:2749] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:34.904793 15101 raft_consensus.cc:2749] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:34.905048 14155 leader_election.cc:304] T f4739bc22bfe44fcba807da02d9351b6 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:09:34.907100 15106 raft_consensus.cc:2749] T f4739bc22bfe44fcba807da02d9351b6 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:34.908238 14155 leader_election.cc:304] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:09:34.909080 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:34.911715 14189 raft_consensus.cc:2468] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 1.
I20260709 12:09:34.911837 15106 raft_consensus.cc:2749] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:34.908192 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:34.913257 14155 leader_election.cc:304] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:09:34.914114 15106 raft_consensus.cc:2749] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:34.915577 14155 leader_election.cc:304] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:09:34.916132 15111 leader_election.cc:290] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:34.916414 15106 raft_consensus.cc:2749] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:34.921774 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:34.923218 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:34.925123 14155 leader_election.cc:304] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:09:34.925860 15111 raft_consensus.cc:2749] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:34.926252 14155 leader_election.cc:304] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:09:34.927830 15106 raft_consensus.cc:2749] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:34.927529 14155 leader_election.cc:304] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:09:34.929301 15111 raft_consensus.cc:2804] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:34.929767 15111 raft_consensus.cc:493] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:09:34.930167 15111 raft_consensus.cc:3060] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:34.934496 15113 raft_consensus.cc:493] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:09:34.935266 15113 raft_consensus.cc:515] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:34.936008 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:34.938248 15113 leader_election.cc:290] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:34.938902 14155 leader_election.cc:304] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:09:34.939705 15113 raft_consensus.cc:2749] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:34.938902 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:34.942412 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:34.943040 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:34.945137 15111 raft_consensus.cc:515] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:09:34.946194 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 64961.2us
I20260709 12:09:34.946403 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:34.948657 14182 raft_consensus.cc:1275] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:34.955746 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:34.953142 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:34.958714 15111 leader_election.cc:290] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 2 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:34.956602 14230 leader_election.cc:304] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:09:34.961354 15116 raft_consensus.cc:2749] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:34.963073 15116 consensus_queue.cc:1048] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:34.964336 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:09:34.964337 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:09:34.966588 14303 leader_election.cc:304] T bf9bea0d16e44efabb5cdd53e3828438 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:09:34.968348 14303 leader_election.cc:304] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:09:34.968492 15042 raft_consensus.cc:2804] T bf9bea0d16e44efabb5cdd53e3828438 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:34.968870 15042 raft_consensus.cc:493] T bf9bea0d16e44efabb5cdd53e3828438 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:09:34.969226 15042 raft_consensus.cc:3060] T bf9bea0d16e44efabb5cdd53e3828438 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:34.969991 14303 leader_election.cc:304] T afce5304599246a580d798fc0c843964 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:09:34.971089 14303 leader_election.cc:304] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:09:34.973315 15117 raft_consensus.cc:2804] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:34.973697 15117 raft_consensus.cc:493] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:09:34.974071 15117 raft_consensus.cc:3060] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:34.974694 15041 raft_consensus.cc:2749] T afce5304599246a580d798fc0c843964 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:34.974995 14155 leader_election.cc:304] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:09:34.975440 15041 raft_consensus.cc:2804] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:34.975835 15041 raft_consensus.cc:493] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:09:34.976176 15041 raft_consensus.cc:3060] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:34.976699 15113 raft_consensus.cc:2749] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:34.979255 14155 leader_election.cc:304] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:09:34.983305 15113 raft_consensus.cc:2749] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:34.995278 14229 leader_election.cc:304] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:09:34.997061 15103 raft_consensus.cc:2749] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:34.997514 14154 leader_election.cc:304] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:09:35.001175 14229 leader_election.cc:304] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:09:34.997617 15042 raft_consensus.cc:515] T bf9bea0d16e44efabb5cdd53e3828438 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:35.003916 15115 raft_consensus.cc:2749] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:35.003767 15041 raft_consensus.cc:515] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:35.006029 15041 leader_election.cc:290] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 2 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:35.006362 14303 leader_election.cc:304] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:09:35.007375 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:09:35.007766 14303 leader_election.cc:304] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:09:35.009879 15108 raft_consensus.cc:2749] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:35.010151 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:09:35.010655 15097 raft_consensus.cc:2804] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:35.011049 15097 raft_consensus.cc:493] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:09:35.011408 15097 raft_consensus.cc:3060] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:35.013564 15042 leader_election.cc:290] T bf9bea0d16e44efabb5cdd53e3828438 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 2 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:35.019959 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:09:35.020670 15117 raft_consensus.cc:515] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:35.026917 15117 leader_election.cc:290] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 2 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:35.027575 15103 raft_consensus.cc:2955] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } } }
I20260709 12:09:35.031620 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:09:35.035382 14332 raft_consensus.cc:2955] T 7879f4a298eb4e69ac692911bd5ac5f8 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } } }
I20260709 12:09:35.023408 14303 leader_election.cc:304] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:09:35.038540 15117 raft_consensus.cc:2749] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:09:35.023653 15107 raft_consensus.cc:2749] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:35.040395 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:09:35.021606 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:09:35.042114 14303 leader_election.cc:304] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:09:35.042925 15117 raft_consensus.cc:2749] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:09:35.042850 14304 leader_election.cc:304] T bf9bea0d16e44efabb5cdd53e3828438 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:09:35.044618 15117 raft_consensus.cc:2749] T bf9bea0d16e44efabb5cdd53e3828438 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:09:35.051854 14229 leader_election.cc:304] T 36091607df2f46059df62d677842a031 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:09:35.053133 15095 raft_consensus.cc:2749] T 36091607df2f46059df62d677842a031 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:35.057178 14229 leader_election.cc:304] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:09:35.058167 15096 raft_consensus.cc:2749] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:35.059798 14229 leader_election.cc:304] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:09:35.060626 15096 consensus_queue.cc:1048] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 12:09:35.068910 15096 raft_consensus.cc:2749] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:35.072901 15097 raft_consensus.cc:515] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } }
I20260709 12:09:35.084360 14336 raft_consensus.cc:1240] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:35.087088 14085 catalog_manager.cc:5697] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: config changed from index -1 to 2, NON_VOTER 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) added. New cstate: current_term: 1 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:35.091538 15096 consensus_queue.cc:1059] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:35.092677 15103 raft_consensus.cc:3055] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:35.093084 15103 raft_consensus.cc:740] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:09:35.093954 15103 consensus_queue.cc:260] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } }
I20260709 12:09:35.095579 15103 raft_consensus.cc:3060] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:35.102663 15116 raft_consensus.cc:493] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:09:35.103327 15116 raft_consensus.cc:515] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:35.104048 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:09:35.106247 15116 leader_election.cc:290] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:35.108511 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:35.114909 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:09:35.117203 14155 leader_election.cc:304] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:09:35.117997 15111 raft_consensus.cc:2749] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:09:35.123957 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:09:35.124488 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:35.127718 14184 raft_consensus.cc:2955] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } } }
I20260709 12:09:35.133849 15097 leader_election.cc:290] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 2 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:35.133628 14263 raft_consensus.cc:2468] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 2.
I20260709 12:09:35.139443 14304 leader_election.cc:304] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:09:35.142354 15108 raft_consensus.cc:2804] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:35.143057 15108 raft_consensus.cc:697] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 2 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:09:35.144523 15108 consensus_queue.cc:237] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } }
I20260709 12:09:35.152282 14229 leader_election.cc:304] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:09:35.154537 15116 raft_consensus.cc:2749] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:35.167109 14333 raft_consensus.cc:1240] T bf9bea0d16e44efabb5cdd53e3828438 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:35.167157 14332 raft_consensus.cc:1240] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:35.171696 15116 consensus_queue.cc:1059] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:09:35.175765 15094 consensus_queue.cc:1059] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:09:35.202978 15107 raft_consensus.cc:3055] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:35.203665 15107 raft_consensus.cc:740] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:09:35.213433 14187 consensus_queue.cc:237] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } }
I20260709 12:09:35.205201 15107 consensus_queue.cc:260] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:35.217288 15094 raft_consensus.cc:3055] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:35.219269 15094 raft_consensus.cc:740] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:09:35.220654 15094 consensus_queue.cc:260] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:35.222702 15094 raft_consensus.cc:3060] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:35.232379 15107 raft_consensus.cc:3060] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:35.253866 14332 raft_consensus.cc:1240] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:35.272425 14332 raft_consensus.cc:1275] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:35.275576 15100 consensus_queue.cc:1048] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:09:35.292305 14263 raft_consensus.cc:1275] T fc8bff37f52742a3a3b8a39c45ade183 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:09:35.298538 14154 consensus_peers.cc:597] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf -> Peer 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341): Couldn't send request to peer 73d01e9b1a9d49358da4985b21d681db. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fc8bff37f52742a3a3b8a39c45ade183. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:35.304173 15100 consensus_queue.cc:1048] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:35.303186 15031 consensus_queue.cc:1059] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 12:09:35.312176 15087 raft_consensus.cc:3055] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:35.312741 15087 raft_consensus.cc:740] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:09:35.314508 15087 consensus_queue.cc:260] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:35.353952 15087 raft_consensus.cc:3060] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:35.361497 15100 raft_consensus.cc:2955] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } } }
I20260709 12:09:35.363324 14332 raft_consensus.cc:2955] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } } }
I20260709 12:09:35.370528 14263 raft_consensus.cc:2955] T fc8bff37f52742a3a3b8a39c45ade183 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } } }
I20260709 12:09:35.393198 15132 ts_tablet_manager.cc:933] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db: Initiating tablet copy from peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:35.410995 14182 raft_consensus.cc:1240] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:35.413691 15127 consensus_queue.cc:1059] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:35.414851 15127 raft_consensus.cc:3055] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:35.415333 15127 raft_consensus.cc:740] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:09:35.417132 14088 catalog_manager.cc:5697] T fc8bff37f52742a3a3b8a39c45ade183 P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: config changed from index -1 to 2, NON_VOTER 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) added. New cstate: current_term: 1 leader_uuid: "885067a0d31741bfb5c9935788e315bf" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } } }
I20260709 12:09:35.419272 14086 catalog_manager.cc:5697] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c reported cstate change: term changed from 1 to 2, leader changed from 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130) to 65c9c1653b3346b39a0e118540e6080c (127.12.174.131). New cstate: current_term: 2 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:35.420890 15127 consensus_queue.cc:260] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:35.423044 15127 raft_consensus.cc:3060] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:35.429502 15132 tablet_copy_client.cc:323] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db: tablet copy: Beginning tablet copy session from remote peer at address 127.12.174.130:36673
I20260709 12:09:35.431548 14275 tablet_copy_service.cc:140] P 17aab1bbf5014936aa18cc21818b26ec: Received BeginTabletCopySession request for tablet 7879f4a298eb4e69ac692911bd5ac5f8 from peer 73d01e9b1a9d49358da4985b21d681db ({username='slave'} at 127.0.0.1:53050)
I20260709 12:09:35.432156 14275 tablet_copy_service.cc:161] P 17aab1bbf5014936aa18cc21818b26ec: Beginning new tablet copy session on tablet 7879f4a298eb4e69ac692911bd5ac5f8 from peer 73d01e9b1a9d49358da4985b21d681db at {username='slave'} at 127.0.0.1:53050: session id = 73d01e9b1a9d49358da4985b21d681db-7879f4a298eb4e69ac692911bd5ac5f8
I20260709 12:09:35.442957 14275 tablet_copy_source_session.cc:215] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 12:09:35.444757 14286 debug-util.cc:398] Leaking SignalData structure 0x7b0800164740 after lost signal to thread 12989
W20260709 12:09:35.445945 14286 debug-util.cc:398] Leaking SignalData structure 0x7b0800164e20 after lost signal to thread 14122
W20260709 12:09:35.447072 14286 debug-util.cc:398] Leaking SignalData structure 0x7b0800315aa0 after lost signal to thread 14214
W20260709 12:09:35.447973 14286 debug-util.cc:398] Leaking SignalData structure 0x7b08002e45c0 after lost signal to thread 14289
W20260709 12:09:35.449015 14286 debug-util.cc:398] Leaking SignalData structure 0x7b0800239720 after lost signal to thread 14363
W20260709 12:09:35.455087 14286 debug-util.cc:398] Leaking SignalData structure 0x7b08002fc2a0 after lost signal to thread 14936
I20260709 12:09:35.462904 15132 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7879f4a298eb4e69ac692911bd5ac5f8. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:09:35.463008 14136 auto_rebalancer.cc:629] Failed to schedule move for tablet cbe93a4954a24795882e04fa537ddf4d: Illegal state: Replica 17aab1bbf5014936aa18cc21818b26ec is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 2 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } }
I20260709 12:09:35.476713 14258 consensus_queue.cc:237] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } }
I20260709 12:09:35.511843 15132 tablet_copy_client.cc:806] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:35.514071 15132 tablet_copy_client.cc:670] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:35.525625 15132 tablet_copy_client.cc:538] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:35.549185 14182 raft_consensus.cc:3060] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:35.562086 14181 raft_consensus.cc:1275] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:09:35.564917 14229 consensus_peers.cc:597] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec -> Peer 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341): Couldn't send request to peer 73d01e9b1a9d49358da4985b21d681db. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: afce5304599246a580d798fc0c843964. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:35.566546 15031 consensus_queue.cc:1048] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:35.566872 14333 raft_consensus.cc:1275] T afce5304599246a580d798fc0c843964 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:35.567651 14182 raft_consensus.cc:1275] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:35.569974 15108 consensus_queue.cc:1048] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:35.571739 15107 consensus_queue.cc:1048] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:35.581305 15132 tablet_bootstrap.cc:492] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db: Bootstrap starting.
I20260709 12:09:35.660357 15087 raft_consensus.cc:2955] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } } }
I20260709 12:09:35.672420 14333 raft_consensus.cc:2955] T afce5304599246a580d798fc0c843964 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } } }
I20260709 12:09:35.724678 14187 raft_consensus.cc:2955] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } } }
I20260709 12:09:35.749119 14086 catalog_manager.cc:5697] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: config changed from index -1 to 2, NON_VOTER 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) added. New cstate: current_term: 1 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:35.765210 14263 raft_consensus.cc:1275] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:35.768258 14986 consensus_queue.cc:1048] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:35.791091 15141 ts_tablet_manager.cc:933] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db: Initiating tablet copy from peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187)
I20260709 12:09:35.814680 15141 tablet_copy_client.cc:323] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db: tablet copy: Beginning tablet copy session from remote peer at address 127.12.174.129:37187
I20260709 12:09:35.874434 15132 tablet_bootstrap.cc:492] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:35.882349 15132 tablet_bootstrap.cc:492] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db: Bootstrap complete.
I20260709 12:09:35.883423 15132 ts_tablet_manager.cc:1403] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db: Time spent bootstrapping tablet: real 0.302s	user 0.024s	sys 0.030s
I20260709 12:09:35.930841 15132 raft_consensus.cc:359] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } }
I20260709 12:09:35.932056 15132 raft_consensus.cc:740] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Initialized, Role: LEARNER
I20260709 12:09:35.946359 15132 consensus_queue.cc:260] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } }
I20260709 12:09:35.958806 15132 ts_tablet_manager.cc:1434] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db: Time spent starting tablet: real 0.075s	user 0.007s	sys 0.008s
I20260709 12:09:35.960984 14275 tablet_copy_service.cc:342] P 17aab1bbf5014936aa18cc21818b26ec: Request end of tablet copy session 73d01e9b1a9d49358da4985b21d681db-7879f4a298eb4e69ac692911bd5ac5f8 received from {username='slave'} at 127.0.0.1:53050
I20260709 12:09:35.961622 14275 tablet_copy_service.cc:434] P 17aab1bbf5014936aa18cc21818b26ec: ending tablet copy session 73d01e9b1a9d49358da4985b21d681db-7879f4a298eb4e69ac692911bd5ac5f8 on tablet 7879f4a298eb4e69ac692911bd5ac5f8 with peer 73d01e9b1a9d49358da4985b21d681db
I20260709 12:09:36.014241 14200 tablet_copy_service.cc:140] P 885067a0d31741bfb5c9935788e315bf: Received BeginTabletCopySession request for tablet fc8bff37f52742a3a3b8a39c45ade183 from peer 73d01e9b1a9d49358da4985b21d681db ({username='slave'} at 127.0.0.1:56652)
I20260709 12:09:36.015036 14200 tablet_copy_service.cc:161] P 885067a0d31741bfb5c9935788e315bf: Beginning new tablet copy session on tablet fc8bff37f52742a3a3b8a39c45ade183 from peer 73d01e9b1a9d49358da4985b21d681db at {username='slave'} at 127.0.0.1:56652: session id = 73d01e9b1a9d49358da4985b21d681db-fc8bff37f52742a3a3b8a39c45ade183
I20260709 12:09:36.029322 14200 tablet_copy_source_session.cc:215] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:36.037624 15141 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc8bff37f52742a3a3b8a39c45ade183. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:36.087837 15141 tablet_copy_client.cc:806] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:36.088577 15141 tablet_copy_client.cc:670] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:36.093528 15141 tablet_copy_client.cc:538] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:36.128626 15141 tablet_bootstrap.cc:492] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db: Bootstrap starting.
I20260709 12:09:36.131678 15132 ts_tablet_manager.cc:933] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db: Initiating tablet copy from peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:09:36.234854 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 158022us
I20260709 12:09:36.261929 15132 tablet_copy_client.cc:323] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db: tablet copy: Beginning tablet copy session from remote peer at address 127.12.174.130:36673
I20260709 12:09:36.264182 14275 tablet_copy_service.cc:140] P 17aab1bbf5014936aa18cc21818b26ec: Received BeginTabletCopySession request for tablet afce5304599246a580d798fc0c843964 from peer 73d01e9b1a9d49358da4985b21d681db ({username='slave'} at 127.0.0.1:53050)
I20260709 12:09:36.264997 14275 tablet_copy_service.cc:161] P 17aab1bbf5014936aa18cc21818b26ec: Beginning new tablet copy session on tablet afce5304599246a580d798fc0c843964 from peer 73d01e9b1a9d49358da4985b21d681db at {username='slave'} at 127.0.0.1:53050: session id = 73d01e9b1a9d49358da4985b21d681db-afce5304599246a580d798fc0c843964
I20260709 12:09:36.283018 14275 tablet_copy_source_session.cc:215] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:36.299629 15141 tablet_bootstrap.cc:492] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:36.300725 15141 tablet_bootstrap.cc:492] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db: Bootstrap complete.
I20260709 12:09:36.302042 15141 ts_tablet_manager.cc:1403] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db: Time spent bootstrapping tablet: real 0.174s	user 0.031s	sys 0.008s
I20260709 12:09:36.304505 15132 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afce5304599246a580d798fc0c843964. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:36.319515 15141 raft_consensus.cc:359] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } }
I20260709 12:09:36.320484 15141 raft_consensus.cc:740] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Initialized, Role: LEARNER
I20260709 12:09:36.331569 15132 tablet_copy_client.cc:806] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:36.332365 15132 tablet_copy_client.cc:670] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:36.336462 15132 tablet_copy_client.cc:538] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:36.337715 15141 consensus_queue.cc:260] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } }
I20260709 12:09:36.344580 15141 ts_tablet_manager.cc:1434] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db: Time spent starting tablet: real 0.042s	user 0.006s	sys 0.001s
I20260709 12:09:36.350200 14911 raft_consensus.cc:1217] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:36.352617 14200 tablet_copy_service.cc:342] P 885067a0d31741bfb5c9935788e315bf: Request end of tablet copy session 73d01e9b1a9d49358da4985b21d681db-fc8bff37f52742a3a3b8a39c45ade183 received from {username='slave'} at 127.0.0.1:56652
I20260709 12:09:36.353138 14200 tablet_copy_service.cc:434] P 885067a0d31741bfb5c9935788e315bf: ending tablet copy session 73d01e9b1a9d49358da4985b21d681db-fc8bff37f52742a3a3b8a39c45ade183 on tablet fc8bff37f52742a3a3b8a39c45ade183 with peer 73d01e9b1a9d49358da4985b21d681db
I20260709 12:09:36.362107 15132 tablet_bootstrap.cc:492] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db: Bootstrap starting.
I20260709 12:09:36.430186 15132 tablet_bootstrap.cc:492] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:36.431246 15132 tablet_bootstrap.cc:492] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db: Bootstrap complete.
I20260709 12:09:36.432070 15132 ts_tablet_manager.cc:1403] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db: Time spent bootstrapping tablet: real 0.070s	user 0.023s	sys 0.006s
I20260709 12:09:36.435413 15132 raft_consensus.cc:359] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } }
I20260709 12:09:36.436381 15132 raft_consensus.cc:740] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Initialized, Role: LEARNER
I20260709 12:09:36.437119 15132 consensus_queue.cc:260] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } }
I20260709 12:09:36.444720 15132 ts_tablet_manager.cc:1434] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:09:36.447713 14275 tablet_copy_service.cc:342] P 17aab1bbf5014936aa18cc21818b26ec: Request end of tablet copy session 73d01e9b1a9d49358da4985b21d681db-afce5304599246a580d798fc0c843964 received from {username='slave'} at 127.0.0.1:53050
I20260709 12:09:36.448204 14275 tablet_copy_service.cc:434] P 17aab1bbf5014936aa18cc21818b26ec: ending tablet copy session 73d01e9b1a9d49358da4985b21d681db-afce5304599246a580d798fc0c843964 on tablet afce5304599246a580d798fc0c843964 with peer 73d01e9b1a9d49358da4985b21d681db
I20260709 12:09:36.590281 15127 raft_consensus.cc:493] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:36.590879 15127 raft_consensus.cc:515] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:36.593083 15127 leader_election.cc:290] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:36.598598 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:36.600787 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:36.601559 14181 raft_consensus.cc:2468] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 2.
I20260709 12:09:36.603492 14303 leader_election.cc:304] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:09:36.604746 15108 raft_consensus.cc:2804] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:36.605141 15108 raft_consensus.cc:493] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:36.605481 15108 raft_consensus.cc:3060] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:36.630651 15108 raft_consensus.cc:515] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:36.638778 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:09:36.639437 14181 raft_consensus.cc:3060] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:36.655171 15106 raft_consensus.cc:493] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:09:36.655993 15106 raft_consensus.cc:515] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:36.660095 15100 raft_consensus.cc:493] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:09:36.660904 15100 raft_consensus.cc:515] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:36.665622 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:36.666359 14263 raft_consensus.cc:2468] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 2.
I20260709 12:09:36.666445 15100 leader_election.cc:290] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:36.668335 14155 leader_election.cc:304] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:09:36.668479 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:36.669216 14333 raft_consensus.cc:2393] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 2: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:09:36.670271 15149 raft_consensus.cc:2804] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:36.670909 15149 raft_consensus.cc:493] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:09:36.671449 15149 raft_consensus.cc:3060] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:36.701282 15106 leader_election.cc:290] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:36.705137 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:36.705900 14263 raft_consensus.cc:2468] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 2.
I20260709 12:09:36.706631 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:36.707540 14338 raft_consensus.cc:2393] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 2: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:09:36.732463 14912 raft_consensus.cc:1217] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:36.742617 14155 leader_election.cc:304] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:09:36.744354 15100 raft_consensus.cc:2804] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:36.744938 15100 raft_consensus.cc:493] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:09:36.745450 15100 raft_consensus.cc:3060] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:36.755373 14912 raft_consensus.cc:1217] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:36.774024 15106 raft_consensus.cc:493] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:09:36.774865 15106 raft_consensus.cc:515] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:36.779557 15096 raft_consensus.cc:493] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:09:36.780279 15096 raft_consensus.cc:515] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:36.786082 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:36.786841 14258 raft_consensus.cc:2468] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 2.
I20260709 12:09:36.788968 15096 leader_election.cc:290] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:36.793316 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:36.802336 15108 leader_election.cc:290] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:36.808802 14155 leader_election.cc:304] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:09:36.809896 15154 raft_consensus.cc:2804] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:36.810333 15154 raft_consensus.cc:493] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:09:36.810693 15154 raft_consensus.cc:3060] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:36.810837 15106 leader_election.cc:290] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:36.813591 14181 raft_consensus.cc:2468] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 3.
I20260709 12:09:36.818073 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:09:36.818787 14258 raft_consensus.cc:3060] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:09:36.826033 15154 raft_consensus.cc:515] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:36.829663 15154 leader_election.cc:290] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 2 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:36.841974 14258 raft_consensus.cc:2468] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 3.
I20260709 12:09:36.854769 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:36.855751 14333 raft_consensus.cc:2393] T bf9bea0d16e44efabb5cdd53e3828438 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 2: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:09:36.861631 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:36.862715 14333 raft_consensus.cc:2368] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 2. Current term is 3.
I20260709 12:09:36.864748 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:09:36.865571 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:09:36.866406 14333 raft_consensus.cc:2393] T bf9bea0d16e44efabb5cdd53e3828438 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 2: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:09:36.867762 15098 raft_consensus.cc:493] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:36.868397 15098 raft_consensus.cc:515] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:36.882314 14230 leader_election.cc:400] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 2 pre-election: Vote denied by peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957) with higher term. Message: Invalid argument: T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 2. Current term is 3.
I20260709 12:09:36.882711 14230 leader_election.cc:403] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:09:36.886269 15031 raft_consensus.cc:2749] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957) with higher term. Message: Invalid argument: T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 2. Current term is 3.
I20260709 12:09:36.904812 14258 raft_consensus.cc:2468] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 2.
I20260709 12:09:36.902746 15098 leader_election.cc:290] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:36.914638 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:36.913942 15149 raft_consensus.cc:515] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:36.893193 14303 leader_election.cc:304] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:09:36.926054 15127 raft_consensus.cc:2804] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:36.945179 15100 raft_consensus.cc:515] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:36.948611 15149 leader_election.cc:290] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 2 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:36.955914 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:36.957595 14260 raft_consensus.cc:2468] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 2.
I20260709 12:09:36.967934 14184 raft_consensus.cc:2468] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 2.
I20260709 12:09:36.987687 14303 leader_election.cc:304] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:09:36.989212 15041 raft_consensus.cc:2804] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:36.989605 15041 raft_consensus.cc:493] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:36.990003 15041 raft_consensus.cc:3060] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:36.977238 15127 raft_consensus.cc:697] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 3 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:09:36.998798 15041 raft_consensus.cc:515] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:37.006013 15100 leader_election.cc:290] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 2 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:37.008800 15127 consensus_queue.cc:237] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:37.030819 15031 raft_consensus.cc:1064] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec: attempting to promote NON_VOTER 73d01e9b1a9d49358da4985b21d681db to VOTER
I20260709 12:09:37.033591 15031 consensus_queue.cc:237] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:09:37.042872 15041 leader_election.cc:290] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:37.046480 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:09:37.047187 14260 raft_consensus.cc:3060] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:37.042518 15098 raft_consensus.cc:493] T bf9bea0d16e44efabb5cdd53e3828438 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:37.065810 15098 raft_consensus.cc:515] T bf9bea0d16e44efabb5cdd53e3828438 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:37.059312 14260 raft_consensus.cc:2468] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 3.
I20260709 12:09:37.080879 14304 leader_election.cc:304] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:09:37.082183 15127 raft_consensus.cc:2804] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:37.082928 15127 raft_consensus.cc:697] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 3 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:09:37.083272 14085 catalog_manager.cc:5697] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:37.085348 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:37.086124 14260 raft_consensus.cc:2468] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 2.
W20260709 12:09:37.086671 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 84468.4us
I20260709 12:09:37.069150 15098 leader_election.cc:290] T bf9bea0d16e44efabb5cdd53e3828438 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:37.088869 15127 consensus_queue.cc:237] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:37.094888 14304 leader_election.cc:304] T bf9bea0d16e44efabb5cdd53e3828438 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:09:37.096318 15157 raft_consensus.cc:2804] T bf9bea0d16e44efabb5cdd53e3828438 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:37.098073 15157 raft_consensus.cc:493] T bf9bea0d16e44efabb5cdd53e3828438 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:37.098578 15157 raft_consensus.cc:3060] T bf9bea0d16e44efabb5cdd53e3828438 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:37.116888 15157 raft_consensus.cc:515] T bf9bea0d16e44efabb5cdd53e3828438 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:37.120379 15157 leader_election.cc:290] T bf9bea0d16e44efabb5cdd53e3828438 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:37.087404 14155 leader_election.cc:304] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
W20260709 12:09:37.150929 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 63464.4us
I20260709 12:09:37.159884 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:09:37.162580 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:37.163671 14185 raft_consensus.cc:2468] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 2.
I20260709 12:09:37.172525 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:09:37.173692 14263 raft_consensus.cc:2368] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 2. Current term is 3.
I20260709 12:09:37.173707 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:09:37.161589 14181 raft_consensus.cc:3060] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:37.191480 14911 raft_consensus.cc:1275] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 1 LEARNER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:37.199359 14260 raft_consensus.cc:2468] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 2.
I20260709 12:09:37.202656 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:09:37.203045 14189 raft_consensus.cc:1275] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:37.206043 14182 raft_consensus.cc:3060] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:37.208490 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:09:37.236071 14182 raft_consensus.cc:2468] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 3.
I20260709 12:09:37.246125 14262 raft_consensus.cc:3060] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:37.248739 15153 raft_consensus.cc:2764] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Leader election decision vote started in defunct term 2: won
I20260709 12:09:37.261787 14262 raft_consensus.cc:2468] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 3.
I20260709 12:09:37.264810 14181 raft_consensus.cc:2468] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 3.
I20260709 12:09:37.267390 15154 raft_consensus.cc:1064] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf: attempting to promote NON_VOTER 73d01e9b1a9d49358da4985b21d681db to VOTER
I20260709 12:09:37.268316 14338 raft_consensus.cc:1275] T 7879f4a298eb4e69ac692911bd5ac5f8 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:37.276309 15154 consensus_queue.cc:237] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:09:37.279975 14155 leader_election.cc:400] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 2 election: Vote denied by peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673) with higher term. Message: Invalid argument: T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 2. Current term is 3.
I20260709 12:09:37.295356 14155 leader_election.cc:403] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
W20260709 12:09:37.290782 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 59759.3us
I20260709 12:09:37.291461 14304 leader_election.cc:304] T bf9bea0d16e44efabb5cdd53e3828438 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:09:37.292583 15159 raft_consensus.cc:493] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:37.299914 15159 raft_consensus.cc:515] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:37.301131 15173 raft_consensus.cc:2804] T bf9bea0d16e44efabb5cdd53e3828438 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:37.302186 15173 raft_consensus.cc:697] T bf9bea0d16e44efabb5cdd53e3828438 P 65c9c1653b3346b39a0e118540e6080c [term 3 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:09:37.302683 15159 leader_election.cc:290] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:09:37.290246 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 64082.3us
I20260709 12:09:37.303519 15173 consensus_queue.cc:237] T bf9bea0d16e44efabb5cdd53e3828438 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:37.309966 15171 consensus_queue.cc:1048] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 12:09:37.314087 15106 raft_consensus.cc:2749] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673) with higher term. Message: Invalid argument: T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 2. Current term is 3.
I20260709 12:09:37.315968 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:09:37.316954 14338 raft_consensus.cc:2393] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 2: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:09:37.324009 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:37.324781 14260 raft_consensus.cc:2468] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 2.
I20260709 12:09:37.325815 15087 consensus_queue.cc:1048] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:37.326840 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:09:37.331843 14911 raft_consensus.cc:1275] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 1 LEARNER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:37.336023 15031 consensus_queue.cc:1048] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:37.340325 15164 consensus_queue.cc:1048] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:37.343258 14155 leader_election.cc:304] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:09:37.344508 15154 raft_consensus.cc:2804] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:37.345249 15154 raft_consensus.cc:697] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 2 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:09:37.346808 15154 consensus_queue.cc:237] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:37.368027 14304 leader_election.cc:304] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:09:37.413954 15127 raft_consensus.cc:2804] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:37.414556 15127 raft_consensus.cc:493] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:37.415083 15127 raft_consensus.cc:3060] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:37.424199 14263 raft_consensus.cc:1275] T fc8bff37f52742a3a3b8a39c45ade183 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:37.428894 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:37.450728 15171 raft_consensus.cc:1064] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec: attempting to promote NON_VOTER 73d01e9b1a9d49358da4985b21d681db to VOTER
I20260709 12:09:37.472813 15171 consensus_queue.cc:237] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:09:37.489789 15161 consensus_queue.cc:1048] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:37.490283 14182 raft_consensus.cc:1275] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:09:37.494499 14332 raft_consensus.cc:1275] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:37.494637 14088 catalog_manager.cc:5697] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf reported cstate change: term changed from 1 to 2, leader changed from 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130) to 885067a0d31741bfb5c9935788e315bf (127.12.174.129). New cstate: current_term: 2 leader_uuid: "885067a0d31741bfb5c9935788e315bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:37.516609 15165 consensus_queue.cc:1048] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:09:37.526387 15127 raft_consensus.cc:515] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:37.529042 15127 leader_election.cc:290] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:37.532199 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:09:37.532958 14262 raft_consensus.cc:3060] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:37.543596 14262 raft_consensus.cc:2468] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 3.
I20260709 12:09:37.548465 15172 consensus_queue.cc:1048] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 12:09:37.553658 14264 raft_consensus.cc:1275] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:09:37.572628 14187 raft_consensus.cc:1275] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:09:37.573755 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
W20260709 12:09:37.575999 15182 log.cc:927] Time spent T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 12:09:37.583313 15107 raft_consensus.cc:2955] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:37.587226 14912 raft_consensus.cc:1275] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 1 LEARNER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:37.587718 14911 raft_consensus.cc:2955] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:37.598388 14304 leader_election.cc:304] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:09:37.602905 14187 raft_consensus.cc:1275] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:37.603843 15173 consensus_queue.cc:1048] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:37.609338 15169 raft_consensus.cc:2804] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:37.611822 15169 raft_consensus.cc:697] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 3 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:09:37.614625 15119 consensus_queue.cc:1048] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 12:09:37.611696 14332 raft_consensus.cc:1275] T afce5304599246a580d798fc0c843964 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:37.615408 15169 consensus_queue.cc:237] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:37.623067 14265 raft_consensus.cc:1275] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:09:37.634797 15096 consensus_queue.cc:1048] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 12:09:37.629305 15172 consensus_queue.cc:1048] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 12:09:37.686944 15031 consensus_queue.cc:1048] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:37.688462 15094 consensus_queue.cc:1048] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:37.691190 15164 raft_consensus.cc:2955] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:37.654028 14181 raft_consensus.cc:2955] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:37.703025 14337 raft_consensus.cc:2955] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:37.747185 14263 raft_consensus.cc:1240] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 2. Current term is 3. Ops: []
W20260709 12:09:37.796418 15184 log.cc:927] Time spent T fc8bff37f52742a3a3b8a39c45ade183 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 12:09:37.954917 14912 raft_consensus.cc:2955] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:37.978295 14088 catalog_manager.cc:5697] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c reported cstate change: term changed from 1 to 3, leader changed from 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130) to 65c9c1653b3346b39a0e118540e6080c (127.12.174.131). New cstate: current_term: 3 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } }
W20260709 12:09:37.984869 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 82515.2us
I20260709 12:09:37.986179 14088 catalog_manager.cc:5697] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c reported cstate change: term changed from 2 to 3, leader changed from 885067a0d31741bfb5c9935788e315bf (127.12.174.129) to 65c9c1653b3346b39a0e118540e6080c (127.12.174.131). New cstate: current_term: 3 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:37.987250 15164 consensus_queue.cc:1059] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 12:09:38.030131 14088 catalog_manager.cc:5697] T bf9bea0d16e44efabb5cdd53e3828438 P 65c9c1653b3346b39a0e118540e6080c reported cstate change: term changed from 1 to 3, leader changed from 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130) to 65c9c1653b3346b39a0e118540e6080c (127.12.174.131). New cstate: current_term: 3 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:38.034080 14265 raft_consensus.cc:1275] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:09:38.122941 14085 catalog_manager.cc:5697] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: config changed from index 2 to 3, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
W20260709 12:09:38.148686 15193 log.cc:927] Time spent T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.144s	user 0.004s	sys 0.000s
I20260709 12:09:38.152073 14337 raft_consensus.cc:2955] T 7879f4a298eb4e69ac692911bd5ac5f8 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:38.157009 15161 raft_consensus.cc:3055] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:38.157708 15161 raft_consensus.cc:740] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:09:38.162683 15161 consensus_queue.cc:260] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:38.197671 14263 raft_consensus.cc:2955] T fc8bff37f52742a3a3b8a39c45ade183 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:38.203472 15161 raft_consensus.cc:3060] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:38.381377 14181 raft_consensus.cc:1275] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:09:38.436391 15094 raft_consensus.cc:2955] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:38.420660 15173 consensus_queue.cc:1048] T bf9bea0d16e44efabb5cdd53e3828438 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 12:09:38.505319 14264 raft_consensus.cc:1275] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:09:38.514371 14189 raft_consensus.cc:1275] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:09:38.514822 14189 pending_rounds.cc:85] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf: Aborting all ops after (but not including) 1
I20260709 12:09:38.516552 14910 raft_consensus.cc:2955] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:38.527323 14337 raft_consensus.cc:2955] T afce5304599246a580d798fc0c843964 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:38.535902 15169 consensus_queue.cc:1048] T bf9bea0d16e44efabb5cdd53e3828438 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:38.542701 14189 pending_rounds.cc:107] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:09:38.543927 14189 raft_consensus.cc:2889] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:09:38.557430 15205 consensus_queue.cc:1048] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:38.564597 15173 consensus_queue.cc:1048] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:09:38.607622 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 87331.1us
I20260709 12:09:38.621083 14188 raft_consensus.cc:2955] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:38.672240 14085 catalog_manager.cc:5697] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: config changed from index 2 to 3, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "885067a0d31741bfb5c9935788e315bf" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:38.678874 14085 catalog_manager.cc:5697] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: config changed from index 2 to 3, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:38.799223 14263 consensus_queue.cc:237] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:09:38.854209 14910 raft_consensus.cc:1275] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:38.855854 15192 consensus_queue.cc:1048] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:38.869818 15227 raft_consensus.cc:2955] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 65c9c1653b3346b39a0e118540e6080c (127.12.174.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:38.873375 14181 consensus_queue.cc:237] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:09:38.888266 14339 raft_consensus.cc:1275] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:38.897142 14910 raft_consensus.cc:2955] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 65c9c1653b3346b39a0e118540e6080c (127.12.174.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:38.897434 14074 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7879f4a298eb4e69ac692911bd5ac5f8 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:38.900238 15154 consensus_queue.cc:1048] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:38.917888 14181 raft_consensus.cc:1275] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:38.924590 14912 raft_consensus.cc:1275] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:38.952483 14258 consensus_queue.cc:237] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:09:38.954564 15192 consensus_queue.cc:1048] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:38.957418 14086 catalog_manager.cc:5697] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: config changed from index 3 to 4, VOTER 65c9c1653b3346b39a0e118540e6080c (127.12.174.131) evicted. New cstate: current_term: 1 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:38.964018 14912 raft_consensus.cc:1275] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:38.966476 15227 consensus_queue.cc:1048] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:38.969440 15154 consensus_queue.cc:1048] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:38.982628 14181 raft_consensus.cc:1275] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:38.990286 14328 tablet_service.cc:1558] Processing DeleteTablet for tablet 7879f4a298eb4e69ac692911bd5ac5f8 with delete_type TABLET_DATA_TOMBSTONED (TS 65c9c1653b3346b39a0e118540e6080c not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55416
I20260709 12:09:38.994113 14189 raft_consensus.cc:2955] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 65c9c1653b3346b39a0e118540e6080c (127.12.174.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:38.996666 15165 raft_consensus.cc:2955] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:39.001402 14337 raft_consensus.cc:2955] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:39.004802 15227 consensus_queue.cc:1048] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:39.011018 15094 raft_consensus.cc:2955] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 65c9c1653b3346b39a0e118540e6080c (127.12.174.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:39.035956 14073 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet fc8bff37f52742a3a3b8a39c45ade183 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:39.039830 14087 catalog_manager.cc:5697] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf reported cstate change: config changed from index 3 to 4, VOTER 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130) evicted. New cstate: current_term: 1 leader_uuid: "885067a0d31741bfb5c9935788e315bf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:39.044162 14910 raft_consensus.cc:2955] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:39.058178 14912 raft_consensus.cc:2955] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 65c9c1653b3346b39a0e118540e6080c (127.12.174.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:39.062175 14246 tablet_service.cc:1558] Processing DeleteTablet for tablet fc8bff37f52742a3a3b8a39c45ade183 with delete_type TABLET_DATA_TOMBSTONED (TS 17aab1bbf5014936aa18cc21818b26ec not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:51304
I20260709 12:09:39.068889 14074 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet afce5304599246a580d798fc0c843964 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:39.074465 15233 tablet_replica.cc:333] T 7879f4a298eb4e69ac692911bd5ac5f8 P 65c9c1653b3346b39a0e118540e6080c: stopping tablet replica
I20260709 12:09:39.111001 15233 raft_consensus.cc:2243] T 7879f4a298eb4e69ac692911bd5ac5f8 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:39.111563 14086 catalog_manager.cc:5697] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: config changed from index 3 to 4, VOTER 65c9c1653b3346b39a0e118540e6080c (127.12.174.131) evicted. New cstate: current_term: 1 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:39.115013 15233 raft_consensus.cc:2272] T 7879f4a298eb4e69ac692911bd5ac5f8 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:39.117435 15234 tablet_replica.cc:333] T fc8bff37f52742a3a3b8a39c45ade183 P 17aab1bbf5014936aa18cc21818b26ec: stopping tablet replica
I20260709 12:09:39.126446 14328 tablet_service.cc:1558] Processing DeleteTablet for tablet afce5304599246a580d798fc0c843964 with delete_type TABLET_DATA_TOMBSTONED (TS 65c9c1653b3346b39a0e118540e6080c not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55416
I20260709 12:09:39.138561 14189 raft_consensus.cc:2955] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 65c9c1653b3346b39a0e118540e6080c (127.12.174.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:39.142911 15233 ts_tablet_manager.cc:1916] T 7879f4a298eb4e69ac692911bd5ac5f8 P 65c9c1653b3346b39a0e118540e6080c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:39.154628 15234 raft_consensus.cc:2243] T fc8bff37f52742a3a3b8a39c45ade183 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:39.155827 15234 raft_consensus.cc:2272] T fc8bff37f52742a3a3b8a39c45ade183 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:39.165643 15234 ts_tablet_manager.cc:1916] T fc8bff37f52742a3a3b8a39c45ade183 P 17aab1bbf5014936aa18cc21818b26ec: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:39.192042 15233 ts_tablet_manager.cc:1929] T 7879f4a298eb4e69ac692911bd5ac5f8 P 65c9c1653b3346b39a0e118540e6080c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:39.192801 15233 log.cc:1199] T 7879f4a298eb4e69ac692911bd5ac5f8 P 65c9c1653b3346b39a0e118540e6080c: Deleting WAL directory at /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598886212958-12986-0/minicluster-data/ts-2-root/wals/7879f4a298eb4e69ac692911bd5ac5f8
I20260709 12:09:39.194772 14074 catalog_manager.cc:5028] TS 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957): tablet 7879f4a298eb4e69ac692911bd5ac5f8 (table test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]) successfully deleted
I20260709 12:09:39.197280 15233 tablet_replica.cc:333] T afce5304599246a580d798fc0c843964 P 65c9c1653b3346b39a0e118540e6080c: stopping tablet replica
I20260709 12:09:39.198587 15233 raft_consensus.cc:2243] T afce5304599246a580d798fc0c843964 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:39.199510 15233 raft_consensus.cc:2272] T afce5304599246a580d798fc0c843964 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:39.203614 15233 ts_tablet_manager.cc:1916] T afce5304599246a580d798fc0c843964 P 65c9c1653b3346b39a0e118540e6080c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:39.212755 15234 ts_tablet_manager.cc:1929] T fc8bff37f52742a3a3b8a39c45ade183 P 17aab1bbf5014936aa18cc21818b26ec: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:39.213615 15234 log.cc:1199] T fc8bff37f52742a3a3b8a39c45ade183 P 17aab1bbf5014936aa18cc21818b26ec: Deleting WAL directory at /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598886212958-12986-0/minicluster-data/ts-1-root/wals/fc8bff37f52742a3a3b8a39c45ade183
I20260709 12:09:39.229400 15233 ts_tablet_manager.cc:1929] T afce5304599246a580d798fc0c843964 P 65c9c1653b3346b39a0e118540e6080c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:39.230695 15233 log.cc:1199] T afce5304599246a580d798fc0c843964 P 65c9c1653b3346b39a0e118540e6080c: Deleting WAL directory at /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598886212958-12986-0/minicluster-data/ts-2-root/wals/afce5304599246a580d798fc0c843964
I20260709 12:09:39.232465 14074 catalog_manager.cc:5028] TS 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957): tablet afce5304599246a580d798fc0c843964 (table test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]) successfully deleted
I20260709 12:09:39.239032 14074 catalog_manager.cc:5028] TS 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): tablet fc8bff37f52742a3a3b8a39c45ade183 (table test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]) successfully deleted
I20260709 12:09:40.282902 14258 consensus_queue.cc:237] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } }
W20260709 12:09:40.308837 14229 consensus_peers.cc:597] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec -> Peer 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341): Couldn't send request to peer 73d01e9b1a9d49358da4985b21d681db. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 55a08950f57748dea047f3190b2c0e95. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:40.316471 14336 raft_consensus.cc:1275] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:40.323027 14189 raft_consensus.cc:1275] T 55a08950f57748dea047f3190b2c0e95 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:40.324738 15236 consensus_queue.cc:1048] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:40.328310 15094 consensus_queue.cc:1048] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:40.363015 15227 raft_consensus.cc:2955] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } } }
I20260709 12:09:40.385376 14181 raft_consensus.cc:2955] T 55a08950f57748dea047f3190b2c0e95 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } } }
I20260709 12:09:40.401898 14337 raft_consensus.cc:2955] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } } }
I20260709 12:09:40.420734 14189 consensus_queue.cc:237] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } }
I20260709 12:09:40.438984 14088 catalog_manager.cc:5697] T 55a08950f57748dea047f3190b2c0e95 P 885067a0d31741bfb5c9935788e315bf reported cstate change: config changed from index -1 to 2, NON_VOTER 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) added. New cstate: current_term: 1 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } } }
I20260709 12:09:40.445283 14339 raft_consensus.cc:1275] T 0a11d7ae457a408cac205ac501217c61 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:40.446973 15235 consensus_queue.cc:1048] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:09:40.460005 14154 consensus_peers.cc:597] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf -> Peer 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341): Couldn't send request to peer 73d01e9b1a9d49358da4985b21d681db. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0a11d7ae457a408cac205ac501217c61. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:40.461587 14258 raft_consensus.cc:1275] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:40.463074 15235 consensus_queue.cc:1048] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:40.519577 15154 raft_consensus.cc:2955] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } } }
I20260709 12:09:40.632404 14086 catalog_manager.cc:5697] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf reported cstate change: config changed from index -1 to 2, NON_VOTER 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) added. New cstate: current_term: 1 leader_uuid: "885067a0d31741bfb5c9935788e315bf" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:40.648010 14263 raft_consensus.cc:2955] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } } }
I20260709 12:09:40.682992 14337 raft_consensus.cc:2955] T 0a11d7ae457a408cac205ac501217c61 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } } }
I20260709 12:09:40.637610 14339 consensus_queue.cc:237] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } }
W20260709 12:09:40.744491 14303 consensus_peers.cc:597] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c -> Peer 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341): Couldn't send request to peer 73d01e9b1a9d49358da4985b21d681db. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3832505489c04d04a69e256187061921. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:40.748133 14263 raft_consensus.cc:1275] T 3832505489c04d04a69e256187061921 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:40.750337 14188 raft_consensus.cc:1275] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:40.750272 15206 consensus_queue.cc:1048] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:40.753232 15206 consensus_queue.cc:1048] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:40.774088 15239 raft_consensus.cc:2955] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } } }
I20260709 12:09:40.788923 14188 raft_consensus.cc:2955] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } } }
I20260709 12:09:40.805182 14086 catalog_manager.cc:5697] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c reported cstate change: config changed from index -1 to 2, NON_VOTER 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) added. New cstate: current_term: 1 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:40.808310 14339 consensus_queue.cc:237] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } }
W20260709 12:09:40.828094 14303 consensus_peers.cc:597] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c -> Peer 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341): Couldn't send request to peer 73d01e9b1a9d49358da4985b21d681db. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e9b3f8ef40054811944ba9bd9ed74eb3. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:40.828819 14188 raft_consensus.cc:1275] T e9b3f8ef40054811944ba9bd9ed74eb3 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:40.830232 14265 raft_consensus.cc:1275] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:40.831555 15206 consensus_queue.cc:1048] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:40.808004 14263 raft_consensus.cc:2955] T 3832505489c04d04a69e256187061921 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } } }
I20260709 12:09:40.835986 15253 consensus_queue.cc:1048] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:40.836078 15257 ts_tablet_manager.cc:933] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db: Initiating tablet copy from peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:40.860494 15257 tablet_copy_client.cc:323] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db: tablet copy: Beginning tablet copy session from remote peer at address 127.12.174.130:36673
I20260709 12:09:40.863390 14275 tablet_copy_service.cc:140] P 17aab1bbf5014936aa18cc21818b26ec: Received BeginTabletCopySession request for tablet 55a08950f57748dea047f3190b2c0e95 from peer 73d01e9b1a9d49358da4985b21d681db ({username='slave'} at 127.0.0.1:53050)
I20260709 12:09:40.864101 14275 tablet_copy_service.cc:161] P 17aab1bbf5014936aa18cc21818b26ec: Beginning new tablet copy session on tablet 55a08950f57748dea047f3190b2c0e95 from peer 73d01e9b1a9d49358da4985b21d681db at {username='slave'} at 127.0.0.1:53050: session id = 73d01e9b1a9d49358da4985b21d681db-55a08950f57748dea047f3190b2c0e95
I20260709 12:09:40.876919 15253 raft_consensus.cc:2955] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } } }
I20260709 12:09:40.900996 14263 raft_consensus.cc:2955] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } } }
I20260709 12:09:40.908051 14181 raft_consensus.cc:2955] T e9b3f8ef40054811944ba9bd9ed74eb3 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } } }
I20260709 12:09:40.905652 14275 tablet_copy_source_session.cc:215] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:40.921352 14086 catalog_manager.cc:5697] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: config changed from index -1 to 2, NON_VOTER 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) added. New cstate: current_term: 1 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } } }
I20260709 12:09:40.922974 15262 ts_tablet_manager.cc:933] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db: Initiating tablet copy from peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187)
I20260709 12:09:40.937278 15257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55a08950f57748dea047f3190b2c0e95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:41.002409 15262 tablet_copy_client.cc:323] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db: tablet copy: Beginning tablet copy session from remote peer at address 127.12.174.129:37187
I20260709 12:09:41.004732 14200 tablet_copy_service.cc:140] P 885067a0d31741bfb5c9935788e315bf: Received BeginTabletCopySession request for tablet 0a11d7ae457a408cac205ac501217c61 from peer 73d01e9b1a9d49358da4985b21d681db ({username='slave'} at 127.0.0.1:56652)
I20260709 12:09:41.005321 14200 tablet_copy_service.cc:161] P 885067a0d31741bfb5c9935788e315bf: Beginning new tablet copy session on tablet 0a11d7ae457a408cac205ac501217c61 from peer 73d01e9b1a9d49358da4985b21d681db at {username='slave'} at 127.0.0.1:56652: session id = 73d01e9b1a9d49358da4985b21d681db-0a11d7ae457a408cac205ac501217c61
I20260709 12:09:41.014591 14200 tablet_copy_source_session.cc:215] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:41.019579 15262 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a11d7ae457a408cac205ac501217c61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:41.020840 15257 tablet_copy_client.cc:806] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:41.021509 15257 tablet_copy_client.cc:670] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:41.026062 15257 tablet_copy_client.cc:538] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:41.036352 15257 tablet_bootstrap.cc:492] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db: Bootstrap starting.
I20260709 12:09:41.049853 15262 tablet_copy_client.cc:806] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:41.050561 15262 tablet_copy_client.cc:670] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:41.059144 15262 tablet_copy_client.cc:538] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:41.072976 15262 tablet_bootstrap.cc:492] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db: Bootstrap starting.
I20260709 12:09:41.105036 15257 tablet_bootstrap.cc:492] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:41.106070 15257 tablet_bootstrap.cc:492] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db: Bootstrap complete.
I20260709 12:09:41.107003 15257 ts_tablet_manager.cc:1403] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db: Time spent bootstrapping tablet: real 0.071s	user 0.017s	sys 0.010s
I20260709 12:09:41.110416 15257 raft_consensus.cc:359] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } }
I20260709 12:09:41.111349 15257 raft_consensus.cc:740] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Initialized, Role: LEARNER
I20260709 12:09:41.112068 15257 consensus_queue.cc:260] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } }
I20260709 12:09:41.140208 15257 ts_tablet_manager.cc:1434] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db: Time spent starting tablet: real 0.033s	user 0.014s	sys 0.016s
I20260709 12:09:41.142249 14275 tablet_copy_service.cc:342] P 17aab1bbf5014936aa18cc21818b26ec: Request end of tablet copy session 73d01e9b1a9d49358da4985b21d681db-55a08950f57748dea047f3190b2c0e95 received from {username='slave'} at 127.0.0.1:53050
I20260709 12:09:41.142757 14275 tablet_copy_service.cc:434] P 17aab1bbf5014936aa18cc21818b26ec: ending tablet copy session 73d01e9b1a9d49358da4985b21d681db-55a08950f57748dea047f3190b2c0e95 on tablet 55a08950f57748dea047f3190b2c0e95 with peer 73d01e9b1a9d49358da4985b21d681db
I20260709 12:09:41.150162 15262 tablet_bootstrap.cc:492] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:41.151321 15262 tablet_bootstrap.cc:492] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db: Bootstrap complete.
I20260709 12:09:41.152254 15262 ts_tablet_manager.cc:1403] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db: Time spent bootstrapping tablet: real 0.080s	user 0.038s	sys 0.009s
I20260709 12:09:41.155480 15262 raft_consensus.cc:359] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } }
I20260709 12:09:41.156388 15262 raft_consensus.cc:740] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Initialized, Role: LEARNER
I20260709 12:09:41.157091 15262 consensus_queue.cc:260] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } }
I20260709 12:09:41.160445 15262 ts_tablet_manager.cc:1434] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:09:41.162735 14200 tablet_copy_service.cc:342] P 885067a0d31741bfb5c9935788e315bf: Request end of tablet copy session 73d01e9b1a9d49358da4985b21d681db-0a11d7ae457a408cac205ac501217c61 received from {username='slave'} at 127.0.0.1:56652
I20260709 12:09:41.163226 14200 tablet_copy_service.cc:434] P 885067a0d31741bfb5c9935788e315bf: ending tablet copy session 73d01e9b1a9d49358da4985b21d681db-0a11d7ae457a408cac205ac501217c61 on tablet 0a11d7ae457a408cac205ac501217c61 with peer 73d01e9b1a9d49358da4985b21d681db
I20260709 12:09:41.322984 15262 ts_tablet_manager.cc:933] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db: Initiating tablet copy from peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:41.369560 15257 ts_tablet_manager.cc:933] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db: Initiating tablet copy from peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:41.388883 15257 tablet_copy_client.cc:323] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db: tablet copy: Beginning tablet copy session from remote peer at address 127.12.174.131:45957
I20260709 12:09:41.391080 14349 tablet_copy_service.cc:140] P 65c9c1653b3346b39a0e118540e6080c: Received BeginTabletCopySession request for tablet 3832505489c04d04a69e256187061921 from peer 73d01e9b1a9d49358da4985b21d681db ({username='slave'} at 127.0.0.1:55492)
I20260709 12:09:41.391733 14349 tablet_copy_service.cc:161] P 65c9c1653b3346b39a0e118540e6080c: Beginning new tablet copy session on tablet 3832505489c04d04a69e256187061921 from peer 73d01e9b1a9d49358da4985b21d681db at {username='slave'} at 127.0.0.1:55492: session id = 73d01e9b1a9d49358da4985b21d681db-3832505489c04d04a69e256187061921
I20260709 12:09:41.402745 14349 tablet_copy_source_session.cc:215] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:41.407413 15257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3832505489c04d04a69e256187061921. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:41.429494 14910 raft_consensus.cc:1217] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:41.440764 15257 tablet_copy_client.cc:806] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:41.441491 15257 tablet_copy_client.cc:670] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:41.443529 15262 tablet_copy_client.cc:323] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db: tablet copy: Beginning tablet copy session from remote peer at address 127.12.174.131:45957
I20260709 12:09:41.453522 15257 tablet_copy_client.cc:538] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:41.453998 14348 tablet_copy_service.cc:140] P 65c9c1653b3346b39a0e118540e6080c: Received BeginTabletCopySession request for tablet e9b3f8ef40054811944ba9bd9ed74eb3 from peer 73d01e9b1a9d49358da4985b21d681db ({username='slave'} at 127.0.0.1:55492)
I20260709 12:09:41.454620 14348 tablet_copy_service.cc:161] P 65c9c1653b3346b39a0e118540e6080c: Beginning new tablet copy session on tablet e9b3f8ef40054811944ba9bd9ed74eb3 from peer 73d01e9b1a9d49358da4985b21d681db at {username='slave'} at 127.0.0.1:55492: session id = 73d01e9b1a9d49358da4985b21d681db-e9b3f8ef40054811944ba9bd9ed74eb3
I20260709 12:09:41.459795 14910 raft_consensus.cc:1217] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:41.481778 14348 tablet_copy_source_session.cc:215] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:41.486688 15262 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9b3f8ef40054811944ba9bd9ed74eb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:41.525417 15257 tablet_bootstrap.cc:492] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db: Bootstrap starting.
I20260709 12:09:41.528671 15262 tablet_copy_client.cc:806] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:41.529348 15262 tablet_copy_client.cc:670] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:41.533406 15262 tablet_copy_client.cc:538] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:41.547345 15262 tablet_bootstrap.cc:492] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db: Bootstrap starting.
W20260709 12:09:41.549486 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 48823.5us
I20260709 12:09:41.599891 15262 tablet_bootstrap.cc:492] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:41.600840 15262 tablet_bootstrap.cc:492] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db: Bootstrap complete.
I20260709 12:09:41.601572 15262 ts_tablet_manager.cc:1403] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db: Time spent bootstrapping tablet: real 0.055s	user 0.021s	sys 0.020s
I20260709 12:09:41.604756 15262 raft_consensus.cc:359] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } }
I20260709 12:09:41.605707 15262 raft_consensus.cc:740] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Initialized, Role: LEARNER
I20260709 12:09:41.617645 15262 consensus_queue.cc:260] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } }
I20260709 12:09:41.620846 15262 ts_tablet_manager.cc:1434] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.003s
I20260709 12:09:41.622792 14348 tablet_copy_service.cc:342] P 65c9c1653b3346b39a0e118540e6080c: Request end of tablet copy session 73d01e9b1a9d49358da4985b21d681db-e9b3f8ef40054811944ba9bd9ed74eb3 received from {username='slave'} at 127.0.0.1:55492
I20260709 12:09:41.623260 14348 tablet_copy_service.cc:434] P 65c9c1653b3346b39a0e118540e6080c: ending tablet copy session 73d01e9b1a9d49358da4985b21d681db-e9b3f8ef40054811944ba9bd9ed74eb3 on tablet e9b3f8ef40054811944ba9bd9ed74eb3 with peer 73d01e9b1a9d49358da4985b21d681db
I20260709 12:09:41.656193 15257 tablet_bootstrap.cc:492] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:41.657236 15257 tablet_bootstrap.cc:492] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db: Bootstrap complete.
I20260709 12:09:41.658067 15257 ts_tablet_manager.cc:1403] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db: Time spent bootstrapping tablet: real 0.133s	user 0.026s	sys 0.002s
I20260709 12:09:41.661240 15257 raft_consensus.cc:359] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } }
I20260709 12:09:41.662211 15257 raft_consensus.cc:740] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Initialized, Role: LEARNER
I20260709 12:09:41.662907 15257 consensus_queue.cc:260] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } }
I20260709 12:09:41.667954 15257 ts_tablet_manager.cc:1434] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.001s
I20260709 12:09:41.669801 14348 tablet_copy_service.cc:342] P 65c9c1653b3346b39a0e118540e6080c: Request end of tablet copy session 73d01e9b1a9d49358da4985b21d681db-3832505489c04d04a69e256187061921 received from {username='slave'} at 127.0.0.1:55492
I20260709 12:09:41.670234 14348 tablet_copy_service.cc:434] P 65c9c1653b3346b39a0e118540e6080c: ending tablet copy session 73d01e9b1a9d49358da4985b21d681db-3832505489c04d04a69e256187061921 on tablet 3832505489c04d04a69e256187061921 with peer 73d01e9b1a9d49358da4985b21d681db
I20260709 12:09:41.839862 14910 raft_consensus.cc:1217] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:41.855274 14910 raft_consensus.cc:1217] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:41.931348 15235 raft_consensus.cc:1064] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf: attempting to promote NON_VOTER 73d01e9b1a9d49358da4985b21d681db to VOTER
I20260709 12:09:41.937625 15235 consensus_queue.cc:237] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:09:41.939018 15094 raft_consensus.cc:1064] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec: attempting to promote NON_VOTER 73d01e9b1a9d49358da4985b21d681db to VOTER
I20260709 12:09:41.941886 15094 consensus_queue.cc:237] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:09:41.997756 14339 raft_consensus.cc:1275] T 0a11d7ae457a408cac205ac501217c61 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:42.000946 14263 raft_consensus.cc:1275] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:42.002233 15201 consensus_queue.cc:1048] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:42.013374 15201 consensus_queue.cc:1048] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:42.041380 14910 raft_consensus.cc:1275] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 1 LEARNER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:42.057628 14910 raft_consensus.cc:1275] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 1 LEARNER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:42.059455 15243 consensus_queue.cc:1048] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:42.070822 14189 raft_consensus.cc:1275] T 55a08950f57748dea047f3190b2c0e95 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:42.071424 14339 raft_consensus.cc:1275] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:42.073414 15243 consensus_queue.cc:1048] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:42.108879 15235 consensus_queue.cc:1048] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:42.110252 15154 raft_consensus.cc:2955] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:42.125346 14265 raft_consensus.cc:2955] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:42.134687 15270 consensus_queue.cc:1048] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:42.141958 15094 raft_consensus.cc:2955] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:42.153877 14339 raft_consensus.cc:2955] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:42.210562 14086 catalog_manager.cc:5697] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c reported cstate change: config changed from index 2 to 3, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:42.234357 14910 raft_consensus.cc:2955] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:42.268745 14339 raft_consensus.cc:2955] T 0a11d7ae457a408cac205ac501217c61 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
W20260709 12:09:42.266817 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 58228us
W20260709 12:09:42.278085 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 68638.7us
I20260709 12:09:42.295039 14088 catalog_manager.cc:5697] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: config changed from index 2 to 3, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "885067a0d31741bfb5c9935788e315bf" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:42.318163 14910 raft_consensus.cc:2955] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
W20260709 12:09:42.444214 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 44115.4us
W20260709 12:09:42.450927 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 67952.2us
I20260709 12:09:42.458549 15286 raft_consensus.cc:1064] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c: attempting to promote NON_VOTER 73d01e9b1a9d49358da4985b21d681db to VOTER
I20260709 12:09:42.462184 15286 consensus_queue.cc:237] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:09:42.472754 15239 raft_consensus.cc:1064] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c: attempting to promote NON_VOTER 73d01e9b1a9d49358da4985b21d681db to VOTER
I20260709 12:09:42.477003 15239 consensus_queue.cc:237] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:09:42.495983 14256 raft_consensus.cc:1275] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:42.500095 15238 consensus_queue.cc:1048] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:42.505503 14910 raft_consensus.cc:1275] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 1 LEARNER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:42.508925 14181 raft_consensus.cc:2955] T 55a08950f57748dea047f3190b2c0e95 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:42.524874 14189 raft_consensus.cc:1275] T e9b3f8ef40054811944ba9bd9ed74eb3 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:42.534417 15238 consensus_queue.cc:1048] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:42.543063 15237 consensus_queue.cc:1048] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 12:09:42.599968 14263 consensus_queue.cc:237] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:09:42.609953 14911 raft_consensus.cc:1275] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 1 LEARNER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:42.619204 15253 consensus_queue.cc:1048] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:42.654477 14263 raft_consensus.cc:1275] T 3832505489c04d04a69e256187061921 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:42.657780 14911 raft_consensus.cc:1275] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:42.660534 14339 raft_consensus.cc:1275] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:42.663524 15094 consensus_queue.cc:1048] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:42.663944 14183 raft_consensus.cc:1275] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:42.674273 15267 consensus_queue.cc:1048] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:42.679597 15239 raft_consensus.cc:2955] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:42.688731 15208 consensus_queue.cc:1048] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:42.687641 15243 raft_consensus.cc:2955] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 885067a0d31741bfb5c9935788e315bf (127.12.174.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:42.692107 15237 consensus_queue.cc:1048] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:42.693127 14336 raft_consensus.cc:2955] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 885067a0d31741bfb5c9935788e315bf (127.12.174.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:42.758643 14189 raft_consensus.cc:2955] T e9b3f8ef40054811944ba9bd9ed74eb3 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:42.685114 14256 raft_consensus.cc:2955] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:42.803702 14912 raft_consensus.cc:2955] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:42.809063 15237 raft_consensus.cc:2955] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:42.815582 14265 raft_consensus.cc:2955] T 3832505489c04d04a69e256187061921 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:42.846174 14189 consensus_queue.cc:237] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:09:42.851953 14085 catalog_manager.cc:5697] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: config changed from index 2 to 3, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:42.854074 14912 raft_consensus.cc:1275] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:42.861245 14184 raft_consensus.cc:2955] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:42.870404 15154 consensus_queue.cc:1048] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:09:42.903914 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 155762us
I20260709 12:09:42.920998 15154 raft_consensus.cc:2955] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 65c9c1653b3346b39a0e118540e6080c (127.12.174.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:42.927525 14912 raft_consensus.cc:2955] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 65c9c1653b3346b39a0e118540e6080c (127.12.174.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:42.944725 14256 raft_consensus.cc:1275] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:42.962133 14073 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0a11d7ae457a408cac205ac501217c61 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:42.963195 14074 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 55a08950f57748dea047f3190b2c0e95 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:42.966513 14911 raft_consensus.cc:2955] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 885067a0d31741bfb5c9935788e315bf (127.12.174.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:42.990274 14911 raft_consensus.cc:2955] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:43.021870 14086 catalog_manager.cc:5697] T 3832505489c04d04a69e256187061921 P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: config changed from index 2 to 3, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:43.024025 14086 catalog_manager.cc:5697] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: config changed from index 3 to 4, VOTER 885067a0d31741bfb5c9935788e315bf (127.12.174.129) evicted. New cstate: current_term: 1 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:09:43.041416 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 74566.3us
I20260709 12:09:43.042482 15154 consensus_queue.cc:1048] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:43.078169 14256 raft_consensus.cc:2955] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 65c9c1653b3346b39a0e118540e6080c (127.12.174.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:43.087339 14176 tablet_service.cc:1558] Processing DeleteTablet for tablet 55a08950f57748dea047f3190b2c0e95 with delete_type TABLET_DATA_TOMBSTONED (TS 885067a0d31741bfb5c9935788e315bf not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:59324
I20260709 12:09:43.087919 14087 catalog_manager.cc:5697] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: config changed from index 3 to 4, VOTER 65c9c1653b3346b39a0e118540e6080c (127.12.174.131) evicted. New cstate: current_term: 1 leader_uuid: "885067a0d31741bfb5c9935788e315bf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:43.138995 15308 tablet_replica.cc:333] T 55a08950f57748dea047f3190b2c0e95 P 885067a0d31741bfb5c9935788e315bf: stopping tablet replica
I20260709 12:09:43.145223 15308 raft_consensus.cc:2243] T 55a08950f57748dea047f3190b2c0e95 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:43.146574 15308 raft_consensus.cc:2272] T 55a08950f57748dea047f3190b2c0e95 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:43.149484 14328 tablet_service.cc:1558] Processing DeleteTablet for tablet 0a11d7ae457a408cac205ac501217c61 with delete_type TABLET_DATA_TOMBSTONED (TS 65c9c1653b3346b39a0e118540e6080c not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55416
I20260709 12:09:43.161445 14339 consensus_queue.cc:237] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:09:43.167445 14336 consensus_queue.cc:237] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:09:43.178573 15309 tablet_replica.cc:333] T 0a11d7ae457a408cac205ac501217c61 P 65c9c1653b3346b39a0e118540e6080c: stopping tablet replica
I20260709 12:09:43.180339 15309 raft_consensus.cc:2243] T 0a11d7ae457a408cac205ac501217c61 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:43.188319 15308 ts_tablet_manager.cc:1916] T 55a08950f57748dea047f3190b2c0e95 P 885067a0d31741bfb5c9935788e315bf: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:43.198359 15309 raft_consensus.cc:2272] T 0a11d7ae457a408cac205ac501217c61 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:43.203730 14911 raft_consensus.cc:1275] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:43.207415 15309 ts_tablet_manager.cc:1916] T 0a11d7ae457a408cac205ac501217c61 P 65c9c1653b3346b39a0e118540e6080c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:43.209803 15239 consensus_queue.cc:1048] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:43.230793 15238 raft_consensus.cc:2955] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 885067a0d31741bfb5c9935788e315bf (127.12.174.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:43.243364 14183 raft_consensus.cc:1275] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:43.246217 14912 raft_consensus.cc:1275] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:43.249766 15208 consensus_queue.cc:1048] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:43.252357 15208 consensus_queue.cc:1048] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:43.270849 15308 ts_tablet_manager.cc:1929] T 55a08950f57748dea047f3190b2c0e95 P 885067a0d31741bfb5c9935788e315bf: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:43.269904 15208 raft_consensus.cc:2955] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:43.271548 15308 log.cc:1199] T 55a08950f57748dea047f3190b2c0e95 P 885067a0d31741bfb5c9935788e315bf: Deleting WAL directory at /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598886212958-12986-0/minicluster-data/ts-0-root/wals/55a08950f57748dea047f3190b2c0e95
I20260709 12:09:43.274052 14073 catalog_manager.cc:5028] TS 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): tablet 55a08950f57748dea047f3190b2c0e95 (table test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]) successfully deleted
I20260709 12:09:43.276274 14912 raft_consensus.cc:2955] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:43.280472 14181 raft_consensus.cc:2955] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:43.286485 14260 raft_consensus.cc:1275] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:43.234336 14911 raft_consensus.cc:2955] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 885067a0d31741bfb5c9935788e315bf (127.12.174.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:43.303200 14074 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e9b3f8ef40054811944ba9bd9ed74eb3 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:43.318771 15272 consensus_queue.cc:1048] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:43.324342 14087 catalog_manager.cc:5697] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf reported cstate change: config changed from index 3 to 4, VOTER 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130) evicted. New cstate: current_term: 1 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:43.358024 14074 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3832505489c04d04a69e256187061921 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:43.374601 14246 tablet_service.cc:1558] Processing DeleteTablet for tablet 3832505489c04d04a69e256187061921 with delete_type TABLET_DATA_TOMBSTONED (TS 17aab1bbf5014936aa18cc21818b26ec not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:51304
I20260709 12:09:43.382807 14086 catalog_manager.cc:5697] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: config changed from index 3 to 4, VOTER 885067a0d31741bfb5c9935788e315bf (127.12.174.129) evicted. New cstate: current_term: 1 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:43.391841 15309 ts_tablet_manager.cc:1929] T 0a11d7ae457a408cac205ac501217c61 P 65c9c1653b3346b39a0e118540e6080c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:43.392627 15309 log.cc:1199] T 0a11d7ae457a408cac205ac501217c61 P 65c9c1653b3346b39a0e118540e6080c: Deleting WAL directory at /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598886212958-12986-0/minicluster-data/ts-2-root/wals/0a11d7ae457a408cac205ac501217c61
I20260709 12:09:43.403479 14074 catalog_manager.cc:5028] TS 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957): tablet 0a11d7ae457a408cac205ac501217c61 (table test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]) successfully deleted
I20260709 12:09:43.420236 14176 tablet_service.cc:1558] Processing DeleteTablet for tablet e9b3f8ef40054811944ba9bd9ed74eb3 with delete_type TABLET_DATA_TOMBSTONED (TS 885067a0d31741bfb5c9935788e315bf not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:59324
I20260709 12:09:43.423085 15308 tablet_replica.cc:333] T e9b3f8ef40054811944ba9bd9ed74eb3 P 885067a0d31741bfb5c9935788e315bf: stopping tablet replica
I20260709 12:09:43.424867 15308 raft_consensus.cc:2243] T e9b3f8ef40054811944ba9bd9ed74eb3 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:43.426106 15308 raft_consensus.cc:2272] T e9b3f8ef40054811944ba9bd9ed74eb3 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:43.432353 15308 ts_tablet_manager.cc:1916] T e9b3f8ef40054811944ba9bd9ed74eb3 P 885067a0d31741bfb5c9935788e315bf: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:43.452664 14263 raft_consensus.cc:2955] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 885067a0d31741bfb5c9935788e315bf (127.12.174.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:43.453315 15312 tablet_replica.cc:333] T 3832505489c04d04a69e256187061921 P 17aab1bbf5014936aa18cc21818b26ec: stopping tablet replica
I20260709 12:09:43.466694 15312 raft_consensus.cc:2243] T 3832505489c04d04a69e256187061921 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:43.467558 15312 raft_consensus.cc:2272] T 3832505489c04d04a69e256187061921 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:43.479857 15312 ts_tablet_manager.cc:1916] T 3832505489c04d04a69e256187061921 P 17aab1bbf5014936aa18cc21818b26ec: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:43.504453 15312 ts_tablet_manager.cc:1929] T 3832505489c04d04a69e256187061921 P 17aab1bbf5014936aa18cc21818b26ec: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:43.504972 15312 log.cc:1199] T 3832505489c04d04a69e256187061921 P 17aab1bbf5014936aa18cc21818b26ec: Deleting WAL directory at /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598886212958-12986-0/minicluster-data/ts-1-root/wals/3832505489c04d04a69e256187061921
I20260709 12:09:43.505278 15308 ts_tablet_manager.cc:1929] T e9b3f8ef40054811944ba9bd9ed74eb3 P 885067a0d31741bfb5c9935788e315bf: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:43.506107 15308 log.cc:1199] T e9b3f8ef40054811944ba9bd9ed74eb3 P 885067a0d31741bfb5c9935788e315bf: Deleting WAL directory at /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598886212958-12986-0/minicluster-data/ts-0-root/wals/e9b3f8ef40054811944ba9bd9ed74eb3
I20260709 12:09:43.507386 14074 catalog_manager.cc:5028] TS 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): tablet 3832505489c04d04a69e256187061921 (table test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]) successfully deleted
I20260709 12:09:43.515658 14073 catalog_manager.cc:5028] TS 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): tablet e9b3f8ef40054811944ba9bd9ed74eb3 (table test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]) successfully deleted
I20260709 12:09:44.603776 14339 consensus_queue.cc:237] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } }
I20260709 12:09:44.616834 14181 raft_consensus.cc:1275] T 02513fb0dbdd4cbdb019d79f0f448d18 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:09:44.617125 14303 consensus_peers.cc:597] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c -> Peer 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341): Couldn't send request to peer 73d01e9b1a9d49358da4985b21d681db. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 02513fb0dbdd4cbdb019d79f0f448d18. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:44.618754 14260 raft_consensus.cc:1275] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:44.622212 15272 consensus_queue.cc:1048] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:44.628659 15239 consensus_queue.cc:1048] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:44.653378 15239 raft_consensus.cc:2955] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } } }
I20260709 12:09:44.655958 14260 raft_consensus.cc:2955] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } } }
I20260709 12:09:44.660337 14181 raft_consensus.cc:2955] T 02513fb0dbdd4cbdb019d79f0f448d18 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } } }
I20260709 12:09:44.699139 14263 consensus_queue.cc:237] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } }
I20260709 12:09:44.703337 14087 catalog_manager.cc:5697] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: config changed from index -1 to 2, NON_VOTER 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) added. New cstate: current_term: 1 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } } }
I20260709 12:09:44.726598 14339 raft_consensus.cc:1275] T f57e398f580944f0866ea5fab71be87f P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:09:44.732895 14229 consensus_peers.cc:597] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec -> Peer 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341): Couldn't send request to peer 73d01e9b1a9d49358da4985b21d681db. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f57e398f580944f0866ea5fab71be87f. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:44.734649 15313 consensus_queue.cc:1048] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:44.746521 14190 raft_consensus.cc:1275] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:44.749467 15313 consensus_queue.cc:1048] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:44.763396 15301 raft_consensus.cc:2955] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } } }
I20260709 12:09:44.772337 14190 raft_consensus.cc:2955] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } } }
I20260709 12:09:44.783370 14339 raft_consensus.cc:2955] T f57e398f580944f0866ea5fab71be87f P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } } }
I20260709 12:09:44.849110 14333 consensus_queue.cc:237] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } }
I20260709 12:09:44.860215 14088 catalog_manager.cc:5697] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: config changed from index -1 to 2, NON_VOTER 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) added. New cstate: current_term: 1 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:44.919759 14260 raft_consensus.cc:1275] T 5485933837894417a3f0f89d55af1296 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:44.921406 15239 consensus_queue.cc:1048] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:44.931041 14183 raft_consensus.cc:1275] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:44.932144 15239 raft_consensus.cc:2955] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } } }
I20260709 12:09:44.938549 14263 raft_consensus.cc:2955] T 5485933837894417a3f0f89d55af1296 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } } }
I20260709 12:09:44.955142 15310 consensus_queue.cc:1048] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 12:09:44.957942 14333 consensus_queue.cc:237] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } }
W20260709 12:09:44.954337 14303 consensus_peers.cc:597] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c -> Peer 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341): Couldn't send request to peer 73d01e9b1a9d49358da4985b21d681db. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5485933837894417a3f0f89d55af1296. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:44.969918 14183 raft_consensus.cc:2955] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } } }
I20260709 12:09:44.968614 14088 catalog_manager.cc:5697] T 5485933837894417a3f0f89d55af1296 P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: config changed from index -1 to 2, NON_VOTER 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) added. New cstate: current_term: 1 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } } }
W20260709 12:09:44.986095 14303 consensus_peers.cc:597] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c -> Peer 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341): Couldn't send request to peer 73d01e9b1a9d49358da4985b21d681db. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 36091607df2f46059df62d677842a031. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:44.989092 14183 raft_consensus.cc:1275] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:44.991129 15310 consensus_queue.cc:1048] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:44.992362 14263 raft_consensus.cc:1275] T 36091607df2f46059df62d677842a031 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:44.997000 15310 consensus_queue.cc:1048] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:45.011211 15314 raft_consensus.cc:2955] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } } }
I20260709 12:09:45.013509 14260 raft_consensus.cc:2955] T 36091607df2f46059df62d677842a031 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } } }
I20260709 12:09:45.023540 14183 raft_consensus.cc:2955] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } } }
I20260709 12:09:45.039050 14086 catalog_manager.cc:5697] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c reported cstate change: config changed from index -1 to 2, NON_VOTER 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) added. New cstate: current_term: 1 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:45.148667 15334 ts_tablet_manager.cc:933] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db: Initiating tablet copy from peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:45.160849 15334 tablet_copy_client.cc:323] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db: tablet copy: Beginning tablet copy session from remote peer at address 127.12.174.131:45957
I20260709 12:09:45.163271 14348 tablet_copy_service.cc:140] P 65c9c1653b3346b39a0e118540e6080c: Received BeginTabletCopySession request for tablet 02513fb0dbdd4cbdb019d79f0f448d18 from peer 73d01e9b1a9d49358da4985b21d681db ({username='slave'} at 127.0.0.1:55492)
I20260709 12:09:45.163883 14348 tablet_copy_service.cc:161] P 65c9c1653b3346b39a0e118540e6080c: Beginning new tablet copy session on tablet 02513fb0dbdd4cbdb019d79f0f448d18 from peer 73d01e9b1a9d49358da4985b21d681db at {username='slave'} at 127.0.0.1:55492: session id = 73d01e9b1a9d49358da4985b21d681db-02513fb0dbdd4cbdb019d79f0f448d18
I20260709 12:09:45.177516 14348 tablet_copy_source_session.cc:215] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:45.181802 15334 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02513fb0dbdd4cbdb019d79f0f448d18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:45.214902 15334 tablet_copy_client.cc:806] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:45.215646 15334 tablet_copy_client.cc:670] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:45.226051 15334 tablet_copy_client.cc:538] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:45.240903 15334 tablet_bootstrap.cc:492] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db: Bootstrap starting.
I20260709 12:09:45.254217 15336 ts_tablet_manager.cc:933] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db: Initiating tablet copy from peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:45.290242 15334 tablet_bootstrap.cc:492] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:45.291293 15334 tablet_bootstrap.cc:492] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db: Bootstrap complete.
I20260709 12:09:45.292059 15334 ts_tablet_manager.cc:1403] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db: Time spent bootstrapping tablet: real 0.051s	user 0.024s	sys 0.015s
I20260709 12:09:45.295322 15334 raft_consensus.cc:359] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } }
I20260709 12:09:45.296214 15334 raft_consensus.cc:740] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Initialized, Role: LEARNER
I20260709 12:09:45.296918 15334 consensus_queue.cc:260] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } }
I20260709 12:09:45.320133 15334 ts_tablet_manager.cc:1434] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db: Time spent starting tablet: real 0.028s	user 0.021s	sys 0.008s
I20260709 12:09:45.323767 14348 tablet_copy_service.cc:342] P 65c9c1653b3346b39a0e118540e6080c: Request end of tablet copy session 73d01e9b1a9d49358da4985b21d681db-02513fb0dbdd4cbdb019d79f0f448d18 received from {username='slave'} at 127.0.0.1:55492
I20260709 12:09:45.324275 14348 tablet_copy_service.cc:434] P 65c9c1653b3346b39a0e118540e6080c: ending tablet copy session 73d01e9b1a9d49358da4985b21d681db-02513fb0dbdd4cbdb019d79f0f448d18 on tablet 02513fb0dbdd4cbdb019d79f0f448d18 with peer 73d01e9b1a9d49358da4985b21d681db
I20260709 12:09:45.336932 15336 tablet_copy_client.cc:323] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db: tablet copy: Beginning tablet copy session from remote peer at address 127.12.174.130:36673
I20260709 12:09:45.340497 14275 tablet_copy_service.cc:140] P 17aab1bbf5014936aa18cc21818b26ec: Received BeginTabletCopySession request for tablet f57e398f580944f0866ea5fab71be87f from peer 73d01e9b1a9d49358da4985b21d681db ({username='slave'} at 127.0.0.1:53050)
I20260709 12:09:45.341130 14275 tablet_copy_service.cc:161] P 17aab1bbf5014936aa18cc21818b26ec: Beginning new tablet copy session on tablet f57e398f580944f0866ea5fab71be87f from peer 73d01e9b1a9d49358da4985b21d681db at {username='slave'} at 127.0.0.1:53050: session id = 73d01e9b1a9d49358da4985b21d681db-f57e398f580944f0866ea5fab71be87f
I20260709 12:09:45.349866 14275 tablet_copy_source_session.cc:215] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:45.354604 15336 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f57e398f580944f0866ea5fab71be87f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:45.379967 15336 tablet_copy_client.cc:806] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:45.380669 15336 tablet_copy_client.cc:670] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:45.386103 15336 tablet_copy_client.cc:538] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:45.394963 15334 ts_tablet_manager.cc:933] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db: Initiating tablet copy from peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:45.407353 15334 tablet_copy_client.cc:323] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db: tablet copy: Beginning tablet copy session from remote peer at address 127.12.174.131:45957
I20260709 12:09:45.409240 14348 tablet_copy_service.cc:140] P 65c9c1653b3346b39a0e118540e6080c: Received BeginTabletCopySession request for tablet 36091607df2f46059df62d677842a031 from peer 73d01e9b1a9d49358da4985b21d681db ({username='slave'} at 127.0.0.1:55492)
I20260709 12:09:45.409941 14348 tablet_copy_service.cc:161] P 65c9c1653b3346b39a0e118540e6080c: Beginning new tablet copy session on tablet 36091607df2f46059df62d677842a031 from peer 73d01e9b1a9d49358da4985b21d681db at {username='slave'} at 127.0.0.1:55492: session id = 73d01e9b1a9d49358da4985b21d681db-36091607df2f46059df62d677842a031
I20260709 12:09:45.421682 15336 tablet_bootstrap.cc:492] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db: Bootstrap starting.
I20260709 12:09:45.422585 15341 ts_tablet_manager.cc:933] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db: Initiating tablet copy from peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:45.423386 14348 tablet_copy_source_session.cc:215] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:45.427508 15334 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36091607df2f46059df62d677842a031. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:45.469205 15336 tablet_bootstrap.cc:492] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:45.470353 15336 tablet_bootstrap.cc:492] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db: Bootstrap complete.
I20260709 12:09:45.471530 15336 ts_tablet_manager.cc:1403] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db: Time spent bootstrapping tablet: real 0.050s	user 0.020s	sys 0.012s
I20260709 12:09:45.474730 15336 raft_consensus.cc:359] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } }
I20260709 12:09:45.475921 15336 raft_consensus.cc:740] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Initialized, Role: LEARNER
I20260709 12:09:45.476837 15336 consensus_queue.cc:260] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } }
I20260709 12:09:45.479681 15336 ts_tablet_manager.cc:1434] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:09:45.482546 14275 tablet_copy_service.cc:342] P 17aab1bbf5014936aa18cc21818b26ec: Request end of tablet copy session 73d01e9b1a9d49358da4985b21d681db-f57e398f580944f0866ea5fab71be87f received from {username='slave'} at 127.0.0.1:53050
I20260709 12:09:45.482998 14275 tablet_copy_service.cc:434] P 17aab1bbf5014936aa18cc21818b26ec: ending tablet copy session 73d01e9b1a9d49358da4985b21d681db-f57e398f580944f0866ea5fab71be87f on tablet f57e398f580944f0866ea5fab71be87f with peer 73d01e9b1a9d49358da4985b21d681db
I20260709 12:09:45.536077 15334 tablet_copy_client.cc:806] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:45.536845 15334 tablet_copy_client.cc:670] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:45.537817 15341 tablet_copy_client.cc:323] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db: tablet copy: Beginning tablet copy session from remote peer at address 127.12.174.131:45957
I20260709 12:09:45.540069 14349 tablet_copy_service.cc:140] P 65c9c1653b3346b39a0e118540e6080c: Received BeginTabletCopySession request for tablet 5485933837894417a3f0f89d55af1296 from peer 73d01e9b1a9d49358da4985b21d681db ({username='slave'} at 127.0.0.1:55492)
I20260709 12:09:45.540607 14349 tablet_copy_service.cc:161] P 65c9c1653b3346b39a0e118540e6080c: Beginning new tablet copy session on tablet 5485933837894417a3f0f89d55af1296 from peer 73d01e9b1a9d49358da4985b21d681db at {username='slave'} at 127.0.0.1:55492: session id = 73d01e9b1a9d49358da4985b21d681db-5485933837894417a3f0f89d55af1296
I20260709 12:09:45.542328 15334 tablet_copy_client.cc:538] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:45.549461 14349 tablet_copy_source_session.cc:215] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:45.555696 15334 tablet_bootstrap.cc:492] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db: Bootstrap starting.
I20260709 12:09:45.556527 15341 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5485933837894417a3f0f89d55af1296. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:45.578598 15341 tablet_copy_client.cc:806] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:45.579269 15341 tablet_copy_client.cc:670] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:45.583580 15341 tablet_copy_client.cc:538] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:45.596082 15341 tablet_bootstrap.cc:492] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db: Bootstrap starting.
I20260709 12:09:45.603624 14911 raft_consensus.cc:1217] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:45.624969 15341 tablet_bootstrap.cc:492] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:45.625968 15341 tablet_bootstrap.cc:492] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db: Bootstrap complete.
I20260709 12:09:45.626763 15341 ts_tablet_manager.cc:1403] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db: Time spent bootstrapping tablet: real 0.031s	user 0.016s	sys 0.008s
I20260709 12:09:45.629992 15341 raft_consensus.cc:359] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } }
I20260709 12:09:45.630878 15341 raft_consensus.cc:740] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Initialized, Role: LEARNER
I20260709 12:09:45.631858 15334 tablet_bootstrap.cc:492] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:45.631582 15341 consensus_queue.cc:260] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } }
I20260709 12:09:45.632858 15334 tablet_bootstrap.cc:492] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db: Bootstrap complete.
I20260709 12:09:45.633582 15341 ts_tablet_manager.cc:1434] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 12:09:45.633606 15334 ts_tablet_manager.cc:1403] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db: Time spent bootstrapping tablet: real 0.078s	user 0.024s	sys 0.000s
I20260709 12:09:45.637090 15334 raft_consensus.cc:359] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } }
I20260709 12:09:45.638319 15334 raft_consensus.cc:740] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Initialized, Role: LEARNER
I20260709 12:09:45.638468 14349 tablet_copy_service.cc:342] P 65c9c1653b3346b39a0e118540e6080c: Request end of tablet copy session 73d01e9b1a9d49358da4985b21d681db-5485933837894417a3f0f89d55af1296 received from {username='slave'} at 127.0.0.1:55492
I20260709 12:09:45.639009 14349 tablet_copy_service.cc:434] P 65c9c1653b3346b39a0e118540e6080c: ending tablet copy session 73d01e9b1a9d49358da4985b21d681db-5485933837894417a3f0f89d55af1296 on tablet 5485933837894417a3f0f89d55af1296 with peer 73d01e9b1a9d49358da4985b21d681db
I20260709 12:09:45.640399 15334 consensus_queue.cc:260] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } }
I20260709 12:09:45.654520 15334 ts_tablet_manager.cc:1434] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 12:09:45.657775 14349 tablet_copy_service.cc:342] P 65c9c1653b3346b39a0e118540e6080c: Request end of tablet copy session 73d01e9b1a9d49358da4985b21d681db-36091607df2f46059df62d677842a031 received from {username='slave'} at 127.0.0.1:55492
I20260709 12:09:45.658273 14349 tablet_copy_service.cc:434] P 65c9c1653b3346b39a0e118540e6080c: ending tablet copy session 73d01e9b1a9d49358da4985b21d681db-36091607df2f46059df62d677842a031 on tablet 36091607df2f46059df62d677842a031 with peer 73d01e9b1a9d49358da4985b21d681db
I20260709 12:09:45.677503 14911 raft_consensus.cc:1217] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:45.788594 14911 raft_consensus.cc:1217] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:45.830075 14911 raft_consensus.cc:1217] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:46.210346 15272 raft_consensus.cc:1064] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c: attempting to promote NON_VOTER 73d01e9b1a9d49358da4985b21d681db to VOTER
I20260709 12:09:46.213835 15272 consensus_queue.cc:237] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:09:46.223865 14263 raft_consensus.cc:1275] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:46.223865 14912 raft_consensus.cc:1275] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 1 LEARNER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:46.225677 14181 raft_consensus.cc:1275] T 02513fb0dbdd4cbdb019d79f0f448d18 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:46.225474 15272 consensus_queue.cc:1048] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:46.227046 15310 consensus_queue.cc:1048] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:46.227881 15239 consensus_queue.cc:1048] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:46.239255 15310 raft_consensus.cc:1064] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c: attempting to promote NON_VOTER 73d01e9b1a9d49358da4985b21d681db to VOTER
I20260709 12:09:46.242057 15310 consensus_queue.cc:237] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:09:46.258409 14911 raft_consensus.cc:1275] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 1 LEARNER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:46.259838 14260 raft_consensus.cc:1275] T 36091607df2f46059df62d677842a031 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:46.260089 14188 raft_consensus.cc:1275] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:46.261583 15310 consensus_queue.cc:1048] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:46.262631 15344 consensus_queue.cc:1048] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:46.263715 15272 consensus_queue.cc:1048] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:46.278306 15310 raft_consensus.cc:2955] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:46.282452 14259 raft_consensus.cc:2955] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:46.292623 15239 raft_consensus.cc:2955] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:46.301630 14183 raft_consensus.cc:2955] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:46.316375 15301 raft_consensus.cc:1064] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec: attempting to promote NON_VOTER 73d01e9b1a9d49358da4985b21d681db to VOTER
I20260709 12:09:46.319778 15301 consensus_queue.cc:237] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:09:46.313067 14912 raft_consensus.cc:2955] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:46.337965 14086 catalog_manager.cc:5697] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf reported cstate change: config changed from index 2 to 3, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
W20260709 12:09:46.363830 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 68097.8us
I20260709 12:09:46.363317 14183 raft_consensus.cc:2955] T 02513fb0dbdd4cbdb019d79f0f448d18 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:46.366367 14087 catalog_manager.cc:5697] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c reported cstate change: config changed from index 2 to 3, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:46.375036 14339 raft_consensus.cc:1275] T f57e398f580944f0866ea5fab71be87f P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:46.377089 14259 raft_consensus.cc:2955] T 36091607df2f46059df62d677842a031 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:46.393190 15363 consensus_queue.cc:1048] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:46.408774 15272 raft_consensus.cc:1064] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c: attempting to promote NON_VOTER 73d01e9b1a9d49358da4985b21d681db to VOTER
I20260709 12:09:46.410930 14911 raft_consensus.cc:2955] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:46.411818 15272 consensus_queue.cc:237] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:09:46.414245 14912 raft_consensus.cc:1275] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [term 1 LEARNER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:46.415230 14183 raft_consensus.cc:1275] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:46.421276 15361 consensus_queue.cc:1048] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:46.424736 15364 consensus_queue.cc:1048] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:46.442571 14259 raft_consensus.cc:1275] T 5485933837894417a3f0f89d55af1296 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:46.445660 15363 raft_consensus.cc:2955] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:46.447435 14912 raft_consensus.cc:1275] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 1 LEARNER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:46.445597 15272 consensus_queue.cc:1048] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 12:09:46.448886 14183 raft_consensus.cc:1275] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:46.452194 15344 consensus_queue.cc:1048] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:46.454588 15358 consensus_queue.cc:1048] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:46.469791 14183 raft_consensus.cc:2955] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:46.452773 14912 raft_consensus.cc:2955] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:46.517998 15272 raft_consensus.cc:2955] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:46.524108 14259 raft_consensus.cc:2955] T 5485933837894417a3f0f89d55af1296 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:46.530278 14912 raft_consensus.cc:2955] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:46.543634 14339 raft_consensus.cc:2955] T f57e398f580944f0866ea5fab71be87f P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:46.551640 14188 raft_consensus.cc:2955] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:46.562929 14333 consensus_queue.cc:237] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:09:46.569794 14260 raft_consensus.cc:1275] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:46.573292 15358 consensus_queue.cc:1048] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.007s
I20260709 12:09:46.572750 14911 raft_consensus.cc:1275] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:46.571736 14085 catalog_manager.cc:5697] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf reported cstate change: config changed from index 2 to 3, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:46.632843 15310 consensus_queue.cc:1048] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:46.646987 15359 raft_consensus.cc:2955] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 885067a0d31741bfb5c9935788e315bf (127.12.174.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:46.648620 14088 catalog_manager.cc:5697] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c reported cstate change: config changed from index 2 to 3, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:46.654449 14260 raft_consensus.cc:2955] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 885067a0d31741bfb5c9935788e315bf (127.12.174.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:46.655120 14911 raft_consensus.cc:2955] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 885067a0d31741bfb5c9935788e315bf (127.12.174.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:46.666643 14074 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 02513fb0dbdd4cbdb019d79f0f448d18 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:46.672997 14339 consensus_queue.cc:237] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:09:46.676218 14333 consensus_queue.cc:237] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:09:46.696233 14912 raft_consensus.cc:1275] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:46.698344 14188 raft_consensus.cc:1275] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:46.704056 14912 raft_consensus.cc:1275] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:46.706182 14188 raft_consensus.cc:1275] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:46.713061 14088 catalog_manager.cc:5697] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: config changed from index 3 to 4, VOTER 885067a0d31741bfb5c9935788e315bf (127.12.174.129) evicted. New cstate: current_term: 1 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:46.715926 15239 consensus_queue.cc:1048] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:46.715866 15359 consensus_queue.cc:1048] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.008s
I20260709 12:09:46.724133 15239 consensus_queue.cc:1048] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:46.726393 15239 consensus_queue.cc:1048] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:46.726099 14260 consensus_queue.cc:237] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:09:46.732571 14176 tablet_service.cc:1558] Processing DeleteTablet for tablet 02513fb0dbdd4cbdb019d79f0f448d18 with delete_type TABLET_DATA_TOMBSTONED (TS 885067a0d31741bfb5c9935788e315bf not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:59324
I20260709 12:09:46.738291 14912 raft_consensus.cc:1275] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:46.739108 15344 raft_consensus.cc:2955] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:46.743240 14183 raft_consensus.cc:1275] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:46.748235 15363 consensus_queue.cc:1048] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 12:09:46.751977 15374 consensus_queue.cc:1048] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:46.754549 14183 raft_consensus.cc:2955] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:46.754576 15272 raft_consensus.cc:2955] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:46.758083 14912 raft_consensus.cc:2955] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:46.766397 14074 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5485933837894417a3f0f89d55af1296 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:46.770080 14074 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 36091607df2f46059df62d677842a031 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:46.774775 14088 catalog_manager.cc:5697] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: config changed from index 3 to 4, VOTER 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130) evicted. New cstate: current_term: 1 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:46.776191 14181 raft_consensus.cc:2955] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:46.779501 15374 raft_consensus.cc:2955] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 65c9c1653b3346b39a0e118540e6080c (127.12.174.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:46.782327 15378 tablet_replica.cc:333] T 02513fb0dbdd4cbdb019d79f0f448d18 P 885067a0d31741bfb5c9935788e315bf: stopping tablet replica
I20260709 12:09:46.786142 14246 tablet_service.cc:1558] Processing DeleteTablet for tablet 36091607df2f46059df62d677842a031 with delete_type TABLET_DATA_TOMBSTONED (TS 17aab1bbf5014936aa18cc21818b26ec not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:51304
I20260709 12:09:46.781867 14910 raft_consensus.cc:2955] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 65c9c1653b3346b39a0e118540e6080c (127.12.174.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:46.788890 15378 raft_consensus.cc:2243] T 02513fb0dbdd4cbdb019d79f0f448d18 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:46.789767 15378 raft_consensus.cc:2272] T 02513fb0dbdd4cbdb019d79f0f448d18 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:46.801800 14074 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f57e398f580944f0866ea5fab71be87f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:46.806145 14183 raft_consensus.cc:2955] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 65c9c1653b3346b39a0e118540e6080c (127.12.174.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:46.818984 14088 catalog_manager.cc:5697] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf reported cstate change: config changed from index 3 to 4, VOTER 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130) evicted. New cstate: current_term: 1 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:46.823840 15379 tablet_replica.cc:333] T 36091607df2f46059df62d677842a031 P 17aab1bbf5014936aa18cc21818b26ec: stopping tablet replica
I20260709 12:09:46.824664 14085 catalog_manager.cc:5697] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: config changed from index 3 to 4, VOTER 65c9c1653b3346b39a0e118540e6080c (127.12.174.131) evicted. New cstate: current_term: 1 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:46.827101 15378 ts_tablet_manager.cc:1916] T 02513fb0dbdd4cbdb019d79f0f448d18 P 885067a0d31741bfb5c9935788e315bf: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:46.837248 14246 tablet_service.cc:1558] Processing DeleteTablet for tablet 5485933837894417a3f0f89d55af1296 with delete_type TABLET_DATA_TOMBSTONED (TS 17aab1bbf5014936aa18cc21818b26ec not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:51304
I20260709 12:09:46.840298 14328 tablet_service.cc:1558] Processing DeleteTablet for tablet f57e398f580944f0866ea5fab71be87f with delete_type TABLET_DATA_TOMBSTONED (TS 65c9c1653b3346b39a0e118540e6080c not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55416
I20260709 12:09:46.841862 15379 raft_consensus.cc:2243] T 36091607df2f46059df62d677842a031 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:46.855454 15380 tablet_replica.cc:333] T f57e398f580944f0866ea5fab71be87f P 65c9c1653b3346b39a0e118540e6080c: stopping tablet replica
I20260709 12:09:46.853988 15379 raft_consensus.cc:2272] T 36091607df2f46059df62d677842a031 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:46.868722 14910 raft_consensus.cc:2955] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:46.870402 15380 raft_consensus.cc:2243] T f57e398f580944f0866ea5fab71be87f P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:46.871832 15380 raft_consensus.cc:2272] T f57e398f580944f0866ea5fab71be87f P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:46.868762 15379 ts_tablet_manager.cc:1916] T 36091607df2f46059df62d677842a031 P 17aab1bbf5014936aa18cc21818b26ec: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:46.881785 15378 ts_tablet_manager.cc:1929] T 02513fb0dbdd4cbdb019d79f0f448d18 P 885067a0d31741bfb5c9935788e315bf: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:46.883656 15378 log.cc:1199] T 02513fb0dbdd4cbdb019d79f0f448d18 P 885067a0d31741bfb5c9935788e315bf: Deleting WAL directory at /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598886212958-12986-0/minicluster-data/ts-0-root/wals/02513fb0dbdd4cbdb019d79f0f448d18
I20260709 12:09:46.883040 15380 ts_tablet_manager.cc:1916] T f57e398f580944f0866ea5fab71be87f P 65c9c1653b3346b39a0e118540e6080c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:46.890734 14073 catalog_manager.cc:5028] TS 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): tablet 02513fb0dbdd4cbdb019d79f0f448d18 (table test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]) successfully deleted
I20260709 12:09:46.903129 15379 ts_tablet_manager.cc:1929] T 36091607df2f46059df62d677842a031 P 17aab1bbf5014936aa18cc21818b26ec: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:46.903825 15379 log.cc:1199] T 36091607df2f46059df62d677842a031 P 17aab1bbf5014936aa18cc21818b26ec: Deleting WAL directory at /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598886212958-12986-0/minicluster-data/ts-1-root/wals/36091607df2f46059df62d677842a031
I20260709 12:09:46.907429 14074 catalog_manager.cc:5028] TS 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): tablet 36091607df2f46059df62d677842a031 (table test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]) successfully deleted
I20260709 12:09:46.909166 15379 tablet_replica.cc:333] T 5485933837894417a3f0f89d55af1296 P 17aab1bbf5014936aa18cc21818b26ec: stopping tablet replica
I20260709 12:09:46.910934 15380 ts_tablet_manager.cc:1929] T f57e398f580944f0866ea5fab71be87f P 65c9c1653b3346b39a0e118540e6080c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:46.911324 15379 raft_consensus.cc:2243] T 5485933837894417a3f0f89d55af1296 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:46.911563 15380 log.cc:1199] T f57e398f580944f0866ea5fab71be87f P 65c9c1653b3346b39a0e118540e6080c: Deleting WAL directory at /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598886212958-12986-0/minicluster-data/ts-2-root/wals/f57e398f580944f0866ea5fab71be87f
I20260709 12:09:46.912464 15379 raft_consensus.cc:2272] T 5485933837894417a3f0f89d55af1296 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:46.913573 14074 catalog_manager.cc:5028] TS 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957): tablet f57e398f580944f0866ea5fab71be87f (table test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]) successfully deleted
I20260709 12:09:46.916366 15379 ts_tablet_manager.cc:1916] T 5485933837894417a3f0f89d55af1296 P 17aab1bbf5014936aa18cc21818b26ec: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:46.931442 15379 ts_tablet_manager.cc:1929] T 5485933837894417a3f0f89d55af1296 P 17aab1bbf5014936aa18cc21818b26ec: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:46.931957 15379 log.cc:1199] T 5485933837894417a3f0f89d55af1296 P 17aab1bbf5014936aa18cc21818b26ec: Deleting WAL directory at /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598886212958-12986-0/minicluster-data/ts-1-root/wals/5485933837894417a3f0f89d55af1296
I20260709 12:09:46.933985 14074 catalog_manager.cc:5028] TS 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): tablet 5485933837894417a3f0f89d55af1296 (table test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]) successfully deleted
I20260709 12:09:47.409439 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:47.490051 14256 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7"
dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
mode: GRACEFUL
new_leader_uuid: "885067a0d31741bfb5c9935788e315bf"
 from {username='slave'} at 127.0.0.1:42676
I20260709 12:09:47.491089 14256 raft_consensus.cc:606] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 1 LEADER]: Received request to transfer leadership to TS 885067a0d31741bfb5c9935788e315bf
I20260709 12:09:47.494308 14256 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c"
dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
mode: GRACEFUL
new_leader_uuid: "885067a0d31741bfb5c9935788e315bf"
 from {username='slave'} at 127.0.0.1:42676
I20260709 12:09:47.494855 14256 raft_consensus.cc:606] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 1 LEADER]: Received request to transfer leadership to TS 885067a0d31741bfb5c9935788e315bf
I20260709 12:09:47.509238 14339 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b"
dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
mode: GRACEFUL
new_leader_uuid: "17aab1bbf5014936aa18cc21818b26ec"
 from {username='slave'} at 127.0.0.1:50896
I20260709 12:09:47.509881 14339 raft_consensus.cc:606] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 3 LEADER]: Received request to transfer leadership to TS 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:09:47.512472 14339 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686"
dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
mode: GRACEFUL
new_leader_uuid: "885067a0d31741bfb5c9935788e315bf"
 from {username='slave'} at 127.0.0.1:50896
I20260709 12:09:47.512959 14339 raft_consensus.cc:606] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Received request to transfer leadership to TS 885067a0d31741bfb5c9935788e315bf
I20260709 12:09:47.515276 14339 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d"
dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
mode: GRACEFUL
new_leader_uuid: "17aab1bbf5014936aa18cc21818b26ec"
 from {username='slave'} at 127.0.0.1:50896
I20260709 12:09:47.515799 14339 raft_consensus.cc:606] T ec0fc0e91c904a0daeb3e29ee24a492d P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Received request to transfer leadership to TS 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:09:47.516819 12986 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:09:47.518291 12986 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:47.519281 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:47.608117 15272 raft_consensus.cc:993] T ec0fc0e91c904a0daeb3e29ee24a492d P 65c9c1653b3346b39a0e118540e6080c: : Instructing follower 17aab1bbf5014936aa18cc21818b26ec to start an election
I20260709 12:09:47.609102 15356 raft_consensus.cc:1081] T ec0fc0e91c904a0daeb3e29ee24a492d P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Signalling peer 17aab1bbf5014936aa18cc21818b26ec to start an election
I20260709 12:09:47.610740 14256 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d"
dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
 from {username='slave'} at 127.0.0.1:41764
I20260709 12:09:47.611253 14256 raft_consensus.cc:493] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:47.611534 14256 raft_consensus.cc:3060] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:47.620118 14256 raft_consensus.cc:515] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:47.622223 14256 leader_election.cc:290] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 2 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:47.623406 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:09:47.623698 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:09:47.624138 14339 raft_consensus.cc:3055] T ec0fc0e91c904a0daeb3e29ee24a492d P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:47.624366 14181 raft_consensus.cc:3060] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:47.624478 14339 raft_consensus.cc:740] T ec0fc0e91c904a0daeb3e29ee24a492d P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:09:47.625392 14339 consensus_queue.cc:260] T ec0fc0e91c904a0daeb3e29ee24a492d P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:47.626684 14339 raft_consensus.cc:3060] T ec0fc0e91c904a0daeb3e29ee24a492d P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:47.630955 14181 raft_consensus.cc:2468] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 2.
I20260709 12:09:47.632390 14229 leader_election.cc:304] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:09:47.633201 15374 raft_consensus.cc:2804] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:47.633292 14339 raft_consensus.cc:2468] T ec0fc0e91c904a0daeb3e29ee24a492d P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 2.
I20260709 12:09:47.633638 15374 raft_consensus.cc:697] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 2 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:09:47.634754 15374 consensus_queue.cc:237] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:47.649647 15356 raft_consensus.cc:993] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c: : Instructing follower 885067a0d31741bfb5c9935788e315bf to start an election
I20260709 12:09:47.650403 15344 raft_consensus.cc:1081] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Signalling peer 885067a0d31741bfb5c9935788e315bf to start an election
I20260709 12:09:47.652710 14181 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686"
dest_uuid: "885067a0d31741bfb5c9935788e315bf"
 from {username='slave'} at 127.0.0.1:56044
I20260709 12:09:47.653347 14181 raft_consensus.cc:493] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:47.653792 14181 raft_consensus.cc:3060] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:47.653759 14087 catalog_manager.cc:5697] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: term changed from 1 to 2, leader changed from 65c9c1653b3346b39a0e118540e6080c (127.12.174.131) to 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130). New cstate: current_term: 2 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:47.661672 14181 raft_consensus.cc:515] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:47.664569 14181 leader_election.cc:290] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 2 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:47.666126 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:09:47.666347 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:09:47.666834 14339 raft_consensus.cc:3055] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:47.667033 14260 raft_consensus.cc:3060] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:47.667222 14339 raft_consensus.cc:740] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:09:47.668718 14339 consensus_queue.cc:260] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:47.669948 14339 raft_consensus.cc:3060] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:47.678376 14339 raft_consensus.cc:2468] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 2.
I20260709 12:09:47.679788 14155 leader_election.cc:304] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:09:47.680891 15328 raft_consensus.cc:2804] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:47.681401 15328 raft_consensus.cc:697] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 2 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:09:47.682350 15374 raft_consensus.cc:993] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec: : Instructing follower 885067a0d31741bfb5c9935788e315bf to start an election
I20260709 12:09:47.682914 15374 raft_consensus.cc:1081] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 1 LEADER]: Signalling peer 885067a0d31741bfb5c9935788e315bf to start an election
I20260709 12:09:47.682664 15328 consensus_queue.cc:237] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:47.684991 14181 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c"
dest_uuid: "885067a0d31741bfb5c9935788e315bf"
 from {username='slave'} at 127.0.0.1:56046
I20260709 12:09:47.685616 14181 raft_consensus.cc:493] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:47.686117 14181 raft_consensus.cc:3060] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:47.697140 14181 raft_consensus.cc:515] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:47.698086 14260 raft_consensus.cc:2468] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 2.
I20260709 12:09:47.703701 14181 leader_election.cc:290] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 2 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:47.706732 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:09:47.707442 14333 raft_consensus.cc:3060] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:47.708863 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:09:47.709559 14260 raft_consensus.cc:3055] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:47.712857 14260 raft_consensus.cc:740] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:09:47.714329 14260 consensus_queue.cc:260] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:47.715696 14260 raft_consensus.cc:3060] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:47.721974 14333 raft_consensus.cc:2468] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 2.
I20260709 12:09:47.723088 14155 leader_election.cc:304] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:09:47.726495 14260 raft_consensus.cc:2468] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 2.
I20260709 12:09:47.726770 15390 raft_consensus.cc:2804] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:47.727442 15390 raft_consensus.cc:697] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 2 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:09:47.728510 15390 consensus_queue.cc:237] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:47.753429 14087 catalog_manager.cc:5697] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf reported cstate change: term changed from 1 to 2, leader changed from 65c9c1653b3346b39a0e118540e6080c (127.12.174.131) to 885067a0d31741bfb5c9935788e315bf (127.12.174.129). New cstate: current_term: 2 leader_uuid: "885067a0d31741bfb5c9935788e315bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:47.754729 14087 catalog_manager.cc:5697] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf reported cstate change: term changed from 1 to 2, leader changed from 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130) to 885067a0d31741bfb5c9935788e315bf (127.12.174.129). New cstate: current_term: 2 leader_uuid: "885067a0d31741bfb5c9935788e315bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:47.871196 15356 raft_consensus.cc:993] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c: : Instructing follower 17aab1bbf5014936aa18cc21818b26ec to start an election
I20260709 12:09:47.871712 15344 raft_consensus.cc:1081] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 3 LEADER]: Signalling peer 17aab1bbf5014936aa18cc21818b26ec to start an election
I20260709 12:09:47.873400 14260 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b"
dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
 from {username='slave'} at 127.0.0.1:41764
I20260709 12:09:47.874060 14260 raft_consensus.cc:493] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:47.876358 14260 raft_consensus.cc:3060] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:47.884598 14260 raft_consensus.cc:515] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:47.887014 14260 leader_election.cc:290] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 4 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:47.887820 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:09:47.888657 14183 raft_consensus.cc:3060] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:47.894452 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:09:47.895149 14333 raft_consensus.cc:3055] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:09:47.895510 14333 raft_consensus.cc:740] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:09:47.896339 14333 consensus_queue.cc:260] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:47.897711 14333 raft_consensus.cc:3060] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:47.898216 14183 raft_consensus.cc:2468] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 4.
I20260709 12:09:47.901217 14229 leader_election.cc:304] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:09:47.902081 15374 raft_consensus.cc:2804] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:09:47.902609 15374 raft_consensus.cc:697] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 4 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:09:47.903566 15374 consensus_queue.cc:237] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:47.907307 14333 raft_consensus.cc:2468] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 4.
I20260709 12:09:47.950826 15393 raft_consensus.cc:993] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec: : Instructing follower 885067a0d31741bfb5c9935788e315bf to start an election
I20260709 12:09:47.951354 15393 raft_consensus.cc:1081] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 1 LEADER]: Signalling peer 885067a0d31741bfb5c9935788e315bf to start an election
I20260709 12:09:47.954452 14181 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7"
dest_uuid: "885067a0d31741bfb5c9935788e315bf"
 from {username='slave'} at 127.0.0.1:56046
I20260709 12:09:47.955065 14181 raft_consensus.cc:493] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:47.955443 14181 raft_consensus.cc:3060] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:47.962061 14260 consensus_queue.cc:237] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } }
I20260709 12:09:47.966609 14181 raft_consensus.cc:515] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:47.973238 14085 catalog_manager.cc:5697] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: term changed from 3 to 4, leader changed from 65c9c1653b3346b39a0e118540e6080c (127.12.174.131) to 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130). New cstate: current_term: 4 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:47.975097 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:09:47.975772 14333 raft_consensus.cc:3060] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:47.973213 14181 leader_election.cc:290] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 2 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:47.980549 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:09:47.981206 14256 raft_consensus.cc:3055] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:47.981527 14256 raft_consensus.cc:740] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:09:47.982487 14256 consensus_queue.cc:260] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:47.983788 14256 raft_consensus.cc:3060] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:47.985077 14333 raft_consensus.cc:2468] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 2.
I20260709 12:09:47.986631 14155 leader_election.cc:304] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:09:47.987684 15390 raft_consensus.cc:2804] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:47.988248 15390 raft_consensus.cc:697] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 2 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:09:47.989343 15390 consensus_queue.cc:237] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:47.993614 14256 raft_consensus.cc:2468] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 2.
I20260709 12:09:47.995504 14333 raft_consensus.cc:1275] T f52421be255e4fab824173d17981b5bb P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:47.997414 15393 consensus_queue.cc:1048] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:47.999336 14181 raft_consensus.cc:1275] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:09:48.002025 14229 consensus_peers.cc:597] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec -> Peer 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341): Couldn't send request to peer 73d01e9b1a9d49358da4985b21d681db. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f52421be255e4fab824173d17981b5bb. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:48.002794 15393 consensus_queue.cc:1048] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:48.008148 15374 raft_consensus.cc:2955] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } } }
I20260709 12:09:48.009981 14085 catalog_manager.cc:5697] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf reported cstate change: term changed from 1 to 2, leader changed from 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130) to 885067a0d31741bfb5c9935788e315bf (127.12.174.129). New cstate: current_term: 2 leader_uuid: "885067a0d31741bfb5c9935788e315bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:48.015799 14333 raft_consensus.cc:2955] T f52421be255e4fab824173d17981b5bb P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } } }
I20260709 12:09:48.029632 14336 consensus_queue.cc:237] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } }
I20260709 12:09:48.037228 14181 raft_consensus.cc:2955] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } } }
I20260709 12:09:48.042654 14087 catalog_manager.cc:5697] T f52421be255e4fab824173d17981b5bb P 65c9c1653b3346b39a0e118540e6080c reported cstate change: config changed from index -1 to 2, NON_VOTER 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) added. New cstate: current_term: 1 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } } }
I20260709 12:09:48.058396 14260 raft_consensus.cc:1275] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:48.058424 14333 raft_consensus.cc:1275] T ec0fc0e91c904a0daeb3e29ee24a492d P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:09:48.060339 14303 consensus_peers.cc:597] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c -> Peer 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341): Couldn't send request to peer 73d01e9b1a9d49358da4985b21d681db. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6de6b0d9885648e6b2f6822eb9f85021. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:48.060909 15361 consensus_queue.cc:1048] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:48.062636 15356 consensus_queue.cc:1048] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:48.065709 14181 raft_consensus.cc:1275] T 6de6b0d9885648e6b2f6822eb9f85021 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:48.067683 15356 consensus_queue.cc:1048] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:48.103825 15344 raft_consensus.cc:2955] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } } }
I20260709 12:09:48.118412 14183 raft_consensus.cc:1275] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:48.120535 15363 consensus_queue.cc:1048] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:48.127956 14260 raft_consensus.cc:2955] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } } }
I20260709 12:09:48.155194 14260 consensus_queue.cc:237] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } }
I20260709 12:09:48.161837 14181 raft_consensus.cc:2955] T 6de6b0d9885648e6b2f6822eb9f85021 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } } }
W20260709 12:09:48.166193 14229 consensus_peers.cc:597] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec -> Peer 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341): Couldn't send request to peer 73d01e9b1a9d49358da4985b21d681db. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ec0fc0e91c904a0daeb3e29ee24a492d. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:48.167982 14333 raft_consensus.cc:1275] T ec0fc0e91c904a0daeb3e29ee24a492d P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:09:48.169348 15363 consensus_queue.cc:1048] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:48.177781 14190 raft_consensus.cc:1275] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:09:48.177376 14087 catalog_manager.cc:5697] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: config changed from index -1 to 2, NON_VOTER 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) added. New cstate: current_term: 1 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } } }
I20260709 12:09:48.179713 15363 consensus_queue.cc:1048] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:48.194689 15361 raft_consensus.cc:2955] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } } }
I20260709 12:09:48.199739 14190 raft_consensus.cc:2955] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } } }
I20260709 12:09:48.200453 14333 raft_consensus.cc:2955] T ec0fc0e91c904a0daeb3e29ee24a492d P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } } }
I20260709 12:09:48.216205 14336 consensus_queue.cc:237] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } }
I20260709 12:09:48.218274 14260 raft_consensus.cc:1275] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:48.220973 15377 consensus_queue.cc:1048] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:48.217154 14085 catalog_manager.cc:5697] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: config changed from index -1 to 3, NON_VOTER 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) added. New cstate: current_term: 2 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:48.248718 14256 raft_consensus.cc:1275] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:48.250417 15344 consensus_queue.cc:1048] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:48.251868 14183 raft_consensus.cc:1275] T 1dfd3f2bd71343f789aa5733a23d4b8d P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:09:48.254205 14303 consensus_peers.cc:597] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c -> Peer 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341): Couldn't send request to peer 73d01e9b1a9d49358da4985b21d681db. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1dfd3f2bd71343f789aa5733a23d4b8d. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:48.254361 14336 raft_consensus.cc:1275] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:48.256210 15406 consensus_queue.cc:1048] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:48.259872 15390 consensus_queue.cc:1048] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:48.278918 14263 raft_consensus.cc:1275] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:48.287681 15328 consensus_queue.cc:1048] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:48.290628 14256 raft_consensus.cc:2955] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } } }
I20260709 12:09:48.291115 15344 raft_consensus.cc:2955] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } } }
W20260709 12:09:48.358007 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 56289.9us
I20260709 12:09:48.366745 14181 raft_consensus.cc:2955] T 1dfd3f2bd71343f789aa5733a23d4b8d P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } } }
I20260709 12:09:48.367707 14336 raft_consensus.cc:1275] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:48.387864 15414 consensus_queue.cc:1048] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:48.388330 14085 catalog_manager.cc:5697] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c reported cstate change: config changed from index -1 to 2, NON_VOTER 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) added. New cstate: current_term: 1 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:48.414458 14183 raft_consensus.cc:1275] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:09:48.418156 14339 raft_consensus.cc:1275] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:09:48.418808 15374 consensus_queue.cc:1048] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:48.420112 15361 consensus_queue.cc:1048] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:48.519956 14260 raft_consensus.cc:1275] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:48.522755 15414 consensus_queue.cc:1048] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:48.547253 14339 raft_consensus.cc:1275] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:48.549464 15414 consensus_queue.cc:1048] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:48.568589 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:48.581523 15422 ts_tablet_manager.cc:933] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db: Initiating tablet copy from peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:48.590555 15422 tablet_copy_client.cc:323] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db: tablet copy: Beginning tablet copy session from remote peer at address 127.12.174.130:36673
I20260709 12:09:48.592845 14275 tablet_copy_service.cc:140] P 17aab1bbf5014936aa18cc21818b26ec: Received BeginTabletCopySession request for tablet f52421be255e4fab824173d17981b5bb from peer 73d01e9b1a9d49358da4985b21d681db ({username='slave'} at 127.0.0.1:53050)
I20260709 12:09:48.593393 14275 tablet_copy_service.cc:161] P 17aab1bbf5014936aa18cc21818b26ec: Beginning new tablet copy session on tablet f52421be255e4fab824173d17981b5bb from peer 73d01e9b1a9d49358da4985b21d681db at {username='slave'} at 127.0.0.1:53050: session id = 73d01e9b1a9d49358da4985b21d681db-f52421be255e4fab824173d17981b5bb
I20260709 12:09:48.612532 14275 tablet_copy_source_session.cc:215] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:48.616983 15422 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f52421be255e4fab824173d17981b5bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:48.618727 15424 ts_tablet_manager.cc:933] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db: Initiating tablet copy from peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:48.666770 14339 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78"
dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
mode: GRACEFUL
new_leader_uuid: "17aab1bbf5014936aa18cc21818b26ec"
 from {username='slave'} at 127.0.0.1:50896
I20260709 12:09:48.667725 14339 raft_consensus.cc:606] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Received request to transfer leadership to TS 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:09:48.671463 14256 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c"
dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
mode: GRACEFUL
new_leader_uuid: "885067a0d31741bfb5c9935788e315bf"
 from {username='slave'} at 127.0.0.1:42676
I20260709 12:09:48.672096 14256 raft_consensus.cc:606] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 1 LEADER]: Received request to transfer leadership to TS 885067a0d31741bfb5c9935788e315bf
I20260709 12:09:48.675765 14339 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438"
dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
mode: GRACEFUL
new_leader_uuid: "17aab1bbf5014936aa18cc21818b26ec"
 from {username='slave'} at 127.0.0.1:50896
I20260709 12:09:48.676492 14339 raft_consensus.cc:606] T bf9bea0d16e44efabb5cdd53e3828438 P 65c9c1653b3346b39a0e118540e6080c [term 3 LEADER]: Received request to transfer leadership to TS 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:09:48.680205 14339 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb"
dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
mode: GRACEFUL
new_leader_uuid: "73d01e9b1a9d49358da4985b21d681db"
 from {username='slave'} at 127.0.0.1:50896
I20260709 12:09:48.680935 14339 raft_consensus.cc:606] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Received request to transfer leadership to TS 73d01e9b1a9d49358da4985b21d681db
I20260709 12:09:48.684271 15424 tablet_copy_client.cc:323] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db: tablet copy: Beginning tablet copy session from remote peer at address 127.12.174.131:45957
I20260709 12:09:48.687189 14349 tablet_copy_service.cc:140] P 65c9c1653b3346b39a0e118540e6080c: Received BeginTabletCopySession request for tablet 6de6b0d9885648e6b2f6822eb9f85021 from peer 73d01e9b1a9d49358da4985b21d681db ({username='slave'} at 127.0.0.1:55492)
I20260709 12:09:48.687917 14349 tablet_copy_service.cc:161] P 65c9c1653b3346b39a0e118540e6080c: Beginning new tablet copy session on tablet 6de6b0d9885648e6b2f6822eb9f85021 from peer 73d01e9b1a9d49358da4985b21d681db at {username='slave'} at 127.0.0.1:55492: session id = 73d01e9b1a9d49358da4985b21d681db-6de6b0d9885648e6b2f6822eb9f85021
I20260709 12:09:48.694890 15422 tablet_copy_client.cc:806] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:48.695676 15422 tablet_copy_client.cc:670] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:48.713222 15429 ts_tablet_manager.cc:933] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db: Initiating tablet copy from peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:48.714406 15422 tablet_copy_client.cc:538] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:48.716629 15428 ts_tablet_manager.cc:933] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db: Initiating tablet copy from peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:48.730894 15428 tablet_copy_client.cc:323] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db: tablet copy: Beginning tablet copy session from remote peer at address 127.12.174.131:45957
I20260709 12:09:48.733908 14348 tablet_copy_service.cc:140] P 65c9c1653b3346b39a0e118540e6080c: Received BeginTabletCopySession request for tablet 1dfd3f2bd71343f789aa5733a23d4b8d from peer 73d01e9b1a9d49358da4985b21d681db ({username='slave'} at 127.0.0.1:55492)
I20260709 12:09:48.734565 14348 tablet_copy_service.cc:161] P 65c9c1653b3346b39a0e118540e6080c: Beginning new tablet copy session on tablet 1dfd3f2bd71343f789aa5733a23d4b8d from peer 73d01e9b1a9d49358da4985b21d681db at {username='slave'} at 127.0.0.1:55492: session id = 73d01e9b1a9d49358da4985b21d681db-1dfd3f2bd71343f789aa5733a23d4b8d
I20260709 12:09:48.747659 15429 tablet_copy_client.cc:323] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db: tablet copy: Beginning tablet copy session from remote peer at address 127.12.174.130:36673
I20260709 12:09:48.749778 14275 tablet_copy_service.cc:140] P 17aab1bbf5014936aa18cc21818b26ec: Received BeginTabletCopySession request for tablet ec0fc0e91c904a0daeb3e29ee24a492d from peer 73d01e9b1a9d49358da4985b21d681db ({username='slave'} at 127.0.0.1:53050)
I20260709 12:09:48.750366 14275 tablet_copy_service.cc:161] P 17aab1bbf5014936aa18cc21818b26ec: Beginning new tablet copy session on tablet ec0fc0e91c904a0daeb3e29ee24a492d from peer 73d01e9b1a9d49358da4985b21d681db at {username='slave'} at 127.0.0.1:53050: session id = 73d01e9b1a9d49358da4985b21d681db-ec0fc0e91c904a0daeb3e29ee24a492d
I20260709 12:09:48.756671 14348 tablet_copy_source_session.cc:215] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:48.759106 14275 tablet_copy_source_session.cc:215] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:48.759873 14349 tablet_copy_source_session.cc:215] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:48.766188 15429 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec0fc0e91c904a0daeb3e29ee24a492d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:48.772857 15428 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1dfd3f2bd71343f789aa5733a23d4b8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:48.781862 15417 raft_consensus.cc:993] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec: : Instructing follower 885067a0d31741bfb5c9935788e315bf to start an election
I20260709 12:09:48.782454 15363 raft_consensus.cc:1081] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 1 LEADER]: Signalling peer 885067a0d31741bfb5c9935788e315bf to start an election
I20260709 12:09:48.784302 14181 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c"
dest_uuid: "885067a0d31741bfb5c9935788e315bf"
 from {username='slave'} at 127.0.0.1:56046
I20260709 12:09:48.784925 14181 raft_consensus.cc:493] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:48.785300 14181 raft_consensus.cc:3060] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:48.790277 15424 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6de6b0d9885648e6b2f6822eb9f85021. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:48.796785 14181 raft_consensus.cc:515] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:48.800974 15405 raft_consensus.cc:993] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c: : Instructing follower 73d01e9b1a9d49358da4985b21d681db to start an election
I20260709 12:09:48.801556 15356 raft_consensus.cc:1081] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Signalling peer 73d01e9b1a9d49358da4985b21d681db to start an election
I20260709 12:09:48.803597 14912 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb"
dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
 from {username='slave'} at 127.0.0.1:53194
I20260709 12:09:48.803992 15429 tablet_copy_client.cc:806] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:48.804277 14912 raft_consensus.cc:493] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:48.804625 15429 tablet_copy_client.cc:670] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:48.804665 14912 raft_consensus.cc:3060] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:48.808912 15429 tablet_copy_client.cc:538] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:48.807127 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:09:48.812230 14339 raft_consensus.cc:3060] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:48.812033 14912 raft_consensus.cc:515] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:09:48.815864 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:09:48.815981 14912 leader_election.cc:290] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 2 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:48.816537 14256 raft_consensus.cc:3060] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:48.818358 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:09:48.818699 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:09:48.819020 14338 raft_consensus.cc:3055] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:48.819248 14260 raft_consensus.cc:3055] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:48.819348 14338 raft_consensus.cc:740] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:09:48.819602 14260 raft_consensus.cc:740] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:09:48.820487 14260 consensus_queue.cc:260] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:48.821156 15429 tablet_bootstrap.cc:492] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db: Bootstrap starting.
I20260709 12:09:48.821676 14260 raft_consensus.cc:3060] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:48.822312 14338 consensus_queue.cc:260] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:09:48.823678 14338 raft_consensus.cc:3060] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:48.836380 14256 raft_consensus.cc:2468] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 2.
I20260709 12:09:48.856118 14339 raft_consensus.cc:2468] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 2.
I20260709 12:09:48.858008 14155 leader_election.cc:304] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:09:48.858383 14877 leader_election.cc:304] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:09:48.859033 15414 raft_consensus.cc:2804] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:48.859575 15414 raft_consensus.cc:697] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 2 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:09:48.860489 15414 consensus_queue.cc:237] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:48.841687 15422 tablet_bootstrap.cc:492] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db: Bootstrap starting.
I20260709 12:09:48.844939 14338 raft_consensus.cc:2468] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 2.
I20260709 12:09:48.849311 15344 raft_consensus.cc:993] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c: : Instructing follower 17aab1bbf5014936aa18cc21818b26ec to start an election
I20260709 12:09:48.884532 15344 raft_consensus.cc:1081] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Signalling peer 17aab1bbf5014936aa18cc21818b26ec to start an election
I20260709 12:09:48.900962 15433 raft_consensus.cc:2804] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:48.851477 14181 leader_election.cc:290] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 2 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:48.923018 14183 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d"
dest_uuid: "885067a0d31741bfb5c9935788e315bf"
mode: GRACEFUL
new_leader_uuid: "17aab1bbf5014936aa18cc21818b26ec"
 from {username='slave'} at 127.0.0.1:52548
I20260709 12:09:48.923730 14183 raft_consensus.cc:606] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 1 LEADER]: Received request to transfer leadership to TS 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:09:48.932176 14259 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f"
dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
mode: GRACEFUL
new_leader_uuid: "73d01e9b1a9d49358da4985b21d681db"
 from {username='slave'} at 127.0.0.1:42676
I20260709 12:09:48.932821 14259 raft_consensus.cc:606] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 1 LEADER]: Received request to transfer leadership to TS 73d01e9b1a9d49358da4985b21d681db
I20260709 12:09:48.935470 12986 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:09:48.937031 15272 raft_consensus.cc:993] T bf9bea0d16e44efabb5cdd53e3828438 P 65c9c1653b3346b39a0e118540e6080c: : Instructing follower 17aab1bbf5014936aa18cc21818b26ec to start an election
I20260709 12:09:48.937505 12986 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:48.938581 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:48.937515 15272 raft_consensus.cc:1081] T bf9bea0d16e44efabb5cdd53e3828438 P 65c9c1653b3346b39a0e118540e6080c [term 3 LEADER]: Signalling peer 17aab1bbf5014936aa18cc21818b26ec to start an election
I20260709 12:09:48.944631 14263 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438"
dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
 from {username='slave'} at 127.0.0.1:41764
I20260709 12:09:48.945257 14263 raft_consensus.cc:493] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:48.945657 14263 raft_consensus.cc:3060] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:48.932786 15433 raft_consensus.cc:697] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 2 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:09:48.947943 15433 consensus_queue.cc:237] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:09:48.956679 14087 catalog_manager.cc:5697] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf reported cstate change: term changed from 1 to 2, leader changed from 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130) to 885067a0d31741bfb5c9935788e315bf (127.12.174.129). New cstate: current_term: 2 leader_uuid: "885067a0d31741bfb5c9935788e315bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:48.854447 14260 raft_consensus.cc:2468] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 2.
I20260709 12:09:48.965539 14256 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78"
dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
 from {username='slave'} at 127.0.0.1:41764
I20260709 12:09:48.966238 14256 raft_consensus.cc:493] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:48.966600 14256 raft_consensus.cc:3060] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:48.973563 15428 tablet_copy_client.cc:806] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:48.974498 15428 tablet_copy_client.cc:670] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:48.979717 15428 tablet_copy_client.cc:538] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:48.980712 14256 raft_consensus.cc:515] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:48.991917 14263 raft_consensus.cc:515] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:48.996806 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:09:48.997541 14338 raft_consensus.cc:3055] T bf9bea0d16e44efabb5cdd53e3828438 P 65c9c1653b3346b39a0e118540e6080c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:09:48.998332 14338 raft_consensus.cc:740] T bf9bea0d16e44efabb5cdd53e3828438 P 65c9c1653b3346b39a0e118540e6080c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:09:48.999296 14338 consensus_queue.cc:260] T bf9bea0d16e44efabb5cdd53e3828438 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:49.000744 14338 raft_consensus.cc:3060] T bf9bea0d16e44efabb5cdd53e3828438 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:49.002048 14263 leader_election.cc:290] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 4 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:49.005249 14256 leader_election.cc:290] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 2 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:49.017300 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:09:49.022423 14336 raft_consensus.cc:3055] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:49.022835 14336 raft_consensus.cc:740] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:09:49.023591 14336 consensus_queue.cc:260] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:49.024896 14336 raft_consensus.cc:3060] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:49.026820 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:09:49.027464 14181 raft_consensus.cc:3060] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:49.030441 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:09:49.031134 14183 raft_consensus.cc:3060] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:49.040488 14338 raft_consensus.cc:2468] T bf9bea0d16e44efabb5cdd53e3828438 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 4.
I20260709 12:09:49.049619 15424 tablet_copy_client.cc:806] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:49.054468 15424 tablet_copy_client.cc:670] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:48.996275 15429 tablet_bootstrap.cc:492] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:49.056064 14230 leader_election.cc:304] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:09:49.057242 15374 raft_consensus.cc:2804] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:09:49.060498 15374 raft_consensus.cc:697] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 4 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:09:49.072216 14085 catalog_manager.cc:5697] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 1 to 2, leader changed from 65c9c1653b3346b39a0e118540e6080c (127.12.174.131) to 73d01e9b1a9d49358da4985b21d681db (127.12.174.132). New cstate: current_term: 2 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:49.077237 15374 consensus_queue.cc:237] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:49.051857 14183 raft_consensus.cc:2468] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 2.
I20260709 12:09:49.046660 14181 raft_consensus.cc:2468] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 4.
I20260709 12:09:49.082320 15429 tablet_bootstrap.cc:492] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db: Bootstrap complete.
I20260709 12:09:49.083240 15429 ts_tablet_manager.cc:1403] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db: Time spent bootstrapping tablet: real 0.262s	user 0.050s	sys 0.020s
I20260709 12:09:49.051921 14336 raft_consensus.cc:2468] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 2.
I20260709 12:09:49.087767 14230 leader_election.cc:304] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:09:49.088856 15417 raft_consensus.cc:2804] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:49.091596 15424 tablet_copy_client.cc:538] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:49.108230 15424 tablet_bootstrap.cc:492] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db: Bootstrap starting.
I20260709 12:09:49.140090 15328 raft_consensus.cc:993] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf: : Instructing follower 17aab1bbf5014936aa18cc21818b26ec to start an election
I20260709 12:09:49.143710 15328 raft_consensus.cc:1081] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 1 LEADER]: Signalling peer 17aab1bbf5014936aa18cc21818b26ec to start an election
I20260709 12:09:49.144615 15417 raft_consensus.cc:697] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 2 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:09:49.150856 14263 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d"
dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
 from {username='slave'} at 127.0.0.1:41768
I20260709 12:09:49.149618 15417 consensus_queue.cc:237] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:49.150281 14085 catalog_manager.cc:5697] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: term changed from 3 to 4, leader changed from 65c9c1653b3346b39a0e118540e6080c (127.12.174.131) to 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130). New cstate: current_term: 4 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:49.155547 14263 raft_consensus.cc:493] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:49.162230 14263 raft_consensus.cc:3060] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:49.167549 15429 raft_consensus.cc:359] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } }
I20260709 12:09:49.172183 15429 raft_consensus.cc:740] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Initialized, Role: LEARNER
I20260709 12:09:49.192313 15429 consensus_queue.cc:260] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } }
I20260709 12:09:49.213405 15429 ts_tablet_manager.cc:1434] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db: Time spent starting tablet: real 0.130s	user 0.008s	sys 0.001s
I20260709 12:09:49.169950 15422 tablet_bootstrap.cc:492] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:49.216361 15422 tablet_bootstrap.cc:492] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db: Bootstrap complete.
I20260709 12:09:49.165244 15428 tablet_bootstrap.cc:492] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db: Bootstrap starting.
I20260709 12:09:49.228277 14275 tablet_copy_service.cc:342] P 17aab1bbf5014936aa18cc21818b26ec: Request end of tablet copy session 73d01e9b1a9d49358da4985b21d681db-ec0fc0e91c904a0daeb3e29ee24a492d received from {username='slave'} at 127.0.0.1:53050
I20260709 12:09:49.228927 14275 tablet_copy_service.cc:434] P 17aab1bbf5014936aa18cc21818b26ec: ending tablet copy session 73d01e9b1a9d49358da4985b21d681db-ec0fc0e91c904a0daeb3e29ee24a492d on tablet ec0fc0e91c904a0daeb3e29ee24a492d with peer 73d01e9b1a9d49358da4985b21d681db
I20260709 12:09:49.234483 15422 ts_tablet_manager.cc:1403] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db: Time spent bootstrapping tablet: real 0.393s	user 0.023s	sys 0.003s
I20260709 12:09:49.242970 14263 raft_consensus.cc:515] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:49.253700 14256 raft_consensus.cc:1275] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:49.255304 15328 consensus_queue.cc:1048] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:49.261643 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:09:49.262351 14338 raft_consensus.cc:3060] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:49.273643 14338 raft_consensus.cc:2468] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 2.
I20260709 12:09:49.276928 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:09:49.277712 14190 raft_consensus.cc:3055] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:49.278080 14190 raft_consensus.cc:740] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:09:49.277196 14088 catalog_manager.cc:5697] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: term changed from 1 to 2, leader changed from 65c9c1653b3346b39a0e118540e6080c (127.12.174.131) to 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130). New cstate: current_term: 2 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:49.278961 14190 consensus_queue.cc:260] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:49.279897 14190 raft_consensus.cc:3060] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:49.258086 14263 leader_election.cc:290] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 2 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:49.313017 15422 raft_consensus.cc:359] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } }
I20260709 12:09:49.328161 15422 raft_consensus.cc:740] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Initialized, Role: LEARNER
I20260709 12:09:49.328956 15422 consensus_queue.cc:260] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } }
I20260709 12:09:49.330595 14333 raft_consensus.cc:1240] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:49.334437 14190 raft_consensus.cc:2468] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 2.
I20260709 12:09:49.339260 15417 raft_consensus.cc:993] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec: : Instructing follower 73d01e9b1a9d49358da4985b21d681db to start an election
I20260709 12:09:49.339803 15417 raft_consensus.cc:1081] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 1 LEADER]: Signalling peer 73d01e9b1a9d49358da4985b21d681db to start an election
I20260709 12:09:49.335736 14230 leader_election.cc:304] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:09:49.347647 15363 raft_consensus.cc:2804] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:49.350263 14333 raft_consensus.cc:1275] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:49.352777 15433 consensus_queue.cc:1048] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:09:49.379920 14912 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f"
dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
 from {username='slave'} at 127.0.0.1:53200
I20260709 12:09:49.380604 14912 raft_consensus.cc:493] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:49.380986 14912 raft_consensus.cc:3060] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:49.381909 15363 raft_consensus.cc:697] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 2 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:09:49.402763 14338 raft_consensus.cc:1275] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:49.403653 14912 raft_consensus.cc:515] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:09:49.408538 15424 tablet_bootstrap.cc:492] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:49.411059 15424 tablet_bootstrap.cc:492] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db: Bootstrap complete.
I20260709 12:09:49.411829 15424 ts_tablet_manager.cc:1403] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db: Time spent bootstrapping tablet: real 0.304s	user 0.039s	sys 0.009s
I20260709 12:09:49.413686 14912 leader_election.cc:290] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 2 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:49.417609 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:09:49.418249 14190 raft_consensus.cc:3060] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:49.420920 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:09:49.421559 14256 raft_consensus.cc:3055] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:49.421885 14256 raft_consensus.cc:740] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:09:49.415689 15422 ts_tablet_manager.cc:1434] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db: Time spent starting tablet: real 0.180s	user 0.005s	sys 0.005s
I20260709 12:09:49.422705 14256 consensus_queue.cc:260] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:09:49.423259 14911 raft_consensus.cc:1217] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 12:09:49.423946 14256 raft_consensus.cc:3060] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:49.428699 15363 consensus_queue.cc:237] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:49.430701 14911 raft_consensus.cc:1217] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:49.416740 15328 consensus_queue.cc:1048] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 12:09:49.463300 15428 tablet_bootstrap.cc:492] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:49.464511 15428 tablet_bootstrap.cc:492] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db: Bootstrap complete.
I20260709 12:09:49.465667 15428 ts_tablet_manager.cc:1403] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db: Time spent bootstrapping tablet: real 0.301s	user 0.033s	sys 0.008s
I20260709 12:09:49.467443 15424 raft_consensus.cc:359] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } }
I20260709 12:09:49.468636 15424 raft_consensus.cc:740] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Initialized, Role: LEARNER
I20260709 12:09:49.455446 14190 raft_consensus.cc:2468] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 2.
I20260709 12:09:49.468923 15428 raft_consensus.cc:359] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } }
I20260709 12:09:49.475806 15428 raft_consensus.cc:740] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Initialized, Role: LEARNER
I20260709 12:09:49.476580 15428 consensus_queue.cc:260] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } }
I20260709 12:09:49.484822 15428 ts_tablet_manager.cc:1434] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.001s
I20260709 12:09:49.487046 14348 tablet_copy_service.cc:342] P 65c9c1653b3346b39a0e118540e6080c: Request end of tablet copy session 73d01e9b1a9d49358da4985b21d681db-1dfd3f2bd71343f789aa5733a23d4b8d received from {username='slave'} at 127.0.0.1:55492
I20260709 12:09:49.487531 14348 tablet_copy_service.cc:434] P 65c9c1653b3346b39a0e118540e6080c: ending tablet copy session 73d01e9b1a9d49358da4985b21d681db-1dfd3f2bd71343f789aa5733a23d4b8d on tablet 1dfd3f2bd71343f789aa5733a23d4b8d with peer 73d01e9b1a9d49358da4985b21d681db
I20260709 12:09:49.490175 14876 leader_election.cc:304] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:09:49.514794 14336 raft_consensus.cc:1275] T bf9bea0d16e44efabb5cdd53e3828438 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:09:49.516909 15442 consensus_queue.cc:1048] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:49.539656 15463 raft_consensus.cc:2804] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:49.543165 15463 raft_consensus.cc:697] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [term 2 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:09:49.544133 14256 raft_consensus.cc:2468] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 2.
I20260709 12:09:49.544291 15463 consensus_queue.cc:237] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:09:49.469328 15424 consensus_queue.cc:260] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } }
I20260709 12:09:49.551855 14181 raft_consensus.cc:1275] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:09:49.555365 15424 ts_tablet_manager.cc:1434] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db: Time spent starting tablet: real 0.143s	user 0.008s	sys 0.000s
I20260709 12:09:49.559798 14348 tablet_copy_service.cc:342] P 65c9c1653b3346b39a0e118540e6080c: Request end of tablet copy session 73d01e9b1a9d49358da4985b21d681db-6de6b0d9885648e6b2f6822eb9f85021 received from {username='slave'} at 127.0.0.1:55492
I20260709 12:09:49.559118 15442 consensus_queue.cc:1048] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:49.560313 14348 tablet_copy_service.cc:434] P 65c9c1653b3346b39a0e118540e6080c: ending tablet copy session 73d01e9b1a9d49358da4985b21d681db-6de6b0d9885648e6b2f6822eb9f85021 on tablet 6de6b0d9885648e6b2f6822eb9f85021 with peer 73d01e9b1a9d49358da4985b21d681db
I20260709 12:09:49.557286 14088 catalog_manager.cc:5697] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: term changed from 1 to 2, leader changed from 885067a0d31741bfb5c9935788e315bf (127.12.174.129) to 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130). New cstate: current_term: 2 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:49.582403 14260 raft_consensus.cc:1275] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:49.584159 14275 tablet_copy_service.cc:342] P 17aab1bbf5014936aa18cc21818b26ec: Request end of tablet copy session 73d01e9b1a9d49358da4985b21d681db-f52421be255e4fab824173d17981b5bb received from {username='slave'} at 127.0.0.1:53050
I20260709 12:09:49.584664 14275 tablet_copy_service.cc:434] P 17aab1bbf5014936aa18cc21818b26ec: ending tablet copy session 73d01e9b1a9d49358da4985b21d681db-f52421be255e4fab824173d17981b5bb on tablet f52421be255e4fab824173d17981b5bb with peer 73d01e9b1a9d49358da4985b21d681db
I20260709 12:09:49.585729 15463 consensus_queue.cc:1048] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:09:49.602901 14087 catalog_manager.cc:5697] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 1 to 2, leader changed from 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130) to 73d01e9b1a9d49358da4985b21d681db (127.12.174.132). New cstate: current_term: 2 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:49.707647 14181 raft_consensus.cc:1275] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:49.713303 15374 consensus_queue.cc:1048] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:49.727645 14912 raft_consensus.cc:1217] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:49.749687 14336 raft_consensus.cc:1275] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:49.751703 15374 consensus_queue.cc:1048] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:49.897447 14190 raft_consensus.cc:1275] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:49.899576 15417 consensus_queue.cc:1048] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:49.908715 14336 raft_consensus.cc:1275] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:49.910957 15417 consensus_queue.cc:1048] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:49.913617 15417 raft_consensus.cc:1064] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec: attempting to promote NON_VOTER 73d01e9b1a9d49358da4985b21d681db to VOTER
I20260709 12:09:49.915688 15417 consensus_queue.cc:237] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:09:49.936385 15442 raft_consensus.cc:1064] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec: attempting to promote NON_VOTER 73d01e9b1a9d49358da4985b21d681db to VOTER
I20260709 12:09:49.939009 15442 consensus_queue.cc:237] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:09:49.958731 14912 raft_consensus.cc:1275] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 2 LEARNER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:09:49.962216 15449 consensus_queue.cc:1048] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:49.967844 14333 raft_consensus.cc:1275] T ec0fc0e91c904a0daeb3e29ee24a492d P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:09:49.970502 15476 consensus_queue.cc:1048] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:49.981889 14181 raft_consensus.cc:1275] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:49.983611 15433 consensus_queue.cc:1048] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:49.985430 14190 raft_consensus.cc:1275] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:09:49.991065 14256 raft_consensus.cc:1275] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:49.992424 15433 consensus_queue.cc:1048] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:49.997174 15363 consensus_queue.cc:1048] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:50.025691 14338 raft_consensus.cc:1275] T f52421be255e4fab824173d17981b5bb P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:50.027340 15363 consensus_queue.cc:1048] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:50.029428 14910 raft_consensus.cc:1275] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 1 LEARNER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:50.031992 14910 raft_consensus.cc:1217] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:50.033880 15475 consensus_queue.cc:1048] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:50.037232 14183 raft_consensus.cc:1275] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:50.058087 15417 consensus_queue.cc:1048] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.013s
I20260709 12:09:50.107388 15363 raft_consensus.cc:2955] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:50.122320 14333 raft_consensus.cc:2955] T ec0fc0e91c904a0daeb3e29ee24a492d P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:50.132887 15344 raft_consensus.cc:1064] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c: attempting to promote NON_VOTER 73d01e9b1a9d49358da4985b21d681db to VOTER
I20260709 12:09:50.133225 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:50.135687 15344 consensus_queue.cc:237] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:09:50.163089 15442 raft_consensus.cc:2955] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:50.163369 14184 raft_consensus.cc:2955] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:50.210172 14188 raft_consensus.cc:2955] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
W20260709 12:09:50.262897 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 102895us
I20260709 12:09:50.262354 14910 raft_consensus.cc:2955] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:50.252961 14086 catalog_manager.cc:5697] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf reported cstate change: config changed from index 3 to 4, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:50.266038 14333 raft_consensus.cc:2955] T f52421be255e4fab824173d17981b5bb P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:50.265066 14912 raft_consensus.cc:2955] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:50.268375 14256 raft_consensus.cc:1275] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 12:09:50.283535 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 83939.1us
I20260709 12:09:50.284456 15356 consensus_queue.cc:1048] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:50.288228 14188 raft_consensus.cc:1275] T 1dfd3f2bd71343f789aa5733a23d4b8d P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:50.292855 14911 raft_consensus.cc:1275] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 1 LEARNER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:50.293655 14087 catalog_manager.cc:5697] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: config changed from index 2 to 3, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:50.314239 15487 consensus_queue.cc:1048] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:50.327214 15486 consensus_queue.cc:1048] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:50.348388 15487 raft_consensus.cc:2955] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:50.357270 14259 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98"
dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
mode: GRACEFUL
new_leader_uuid: "73d01e9b1a9d49358da4985b21d681db"
 from {username='slave'} at 127.0.0.1:42676
I20260709 12:09:50.358096 14259 raft_consensus.cc:606] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 1 LEADER]: Received request to transfer leadership to TS 73d01e9b1a9d49358da4985b21d681db
I20260709 12:09:50.360117 14190 raft_consensus.cc:2955] T 1dfd3f2bd71343f789aa5733a23d4b8d P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:50.372519 14336 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3832505489c04d04a69e256187061921"
dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
mode: GRACEFUL
new_leader_uuid: "73d01e9b1a9d49358da4985b21d681db"
 from {username='slave'} at 127.0.0.1:50896
I20260709 12:09:50.373235 14336 raft_consensus.cc:606] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Received request to transfer leadership to TS 73d01e9b1a9d49358da4985b21d681db
I20260709 12:09:50.380317 14184 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae"
dest_uuid: "885067a0d31741bfb5c9935788e315bf"
mode: GRACEFUL
new_leader_uuid: "17aab1bbf5014936aa18cc21818b26ec"
 from {username='slave'} at 127.0.0.1:52548
I20260709 12:09:50.380959 14184 raft_consensus.cc:606] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 1 LEADER]: Received request to transfer leadership to TS 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:09:50.384864 14259 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "afce5304599246a580d798fc0c843964"
dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
mode: GRACEFUL
new_leader_uuid: "73d01e9b1a9d49358da4985b21d681db"
 from {username='slave'} at 127.0.0.1:42676
I20260709 12:09:50.385562 14259 raft_consensus.cc:606] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 1 LEADER]: Received request to transfer leadership to TS 73d01e9b1a9d49358da4985b21d681db
I20260709 12:09:50.391127 14259 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d"
dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
mode: GRACEFUL
new_leader_uuid: "885067a0d31741bfb5c9935788e315bf"
 from {username='slave'} at 127.0.0.1:42676
I20260709 12:09:50.391710 14259 raft_consensus.cc:606] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 2 LEADER]: Received request to transfer leadership to TS 885067a0d31741bfb5c9935788e315bf
I20260709 12:09:50.396530 14333 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39"
dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
mode: GRACEFUL
new_leader_uuid: "17aab1bbf5014936aa18cc21818b26ec"
 from {username='slave'} at 127.0.0.1:50896
I20260709 12:09:50.397161 14333 raft_consensus.cc:606] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Received request to transfer leadership to TS 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:09:50.400193 12986 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:09:50.415247 14259 consensus_queue.cc:237] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:09:50.419834 12986 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:50.426887 14912 raft_consensus.cc:1275] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:50.446897 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:50.467200 15476 consensus_queue.cc:1048] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:50.458621 14088 catalog_manager.cc:5697] T 1dfd3f2bd71343f789aa5733a23d4b8d P 885067a0d31741bfb5c9935788e315bf reported cstate change: config changed from index 2 to 3, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:50.455390 14256 consensus_queue.cc:237] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:09:50.434113 14190 raft_consensus.cc:1275] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:50.488142 14910 raft_consensus.cc:1275] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:50.489324 14184 raft_consensus.cc:1275] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:50.448668 14259 raft_consensus.cc:2955] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:50.506207 14912 raft_consensus.cc:2955] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:50.489137 15476 consensus_queue.cc:1048] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 12:09:50.523839 15406 raft_consensus.cc:1064] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c: attempting to promote NON_VOTER 73d01e9b1a9d49358da4985b21d681db to VOTER
I20260709 12:09:50.564173 15406 consensus_queue.cc:237] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:09:50.566443 15374 consensus_queue.cc:1048] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:50.574646 15449 raft_consensus.cc:993] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec: : Instructing follower 885067a0d31741bfb5c9935788e315bf to start an election
I20260709 12:09:50.575285 15449 raft_consensus.cc:1081] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 2 LEADER]: Signalling peer 885067a0d31741bfb5c9935788e315bf to start an election
I20260709 12:09:50.580240 14184 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d"
dest_uuid: "885067a0d31741bfb5c9935788e315bf"
 from {username='slave'} at 127.0.0.1:56046
I20260709 12:09:50.580832 14184 raft_consensus.cc:493] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:50.581225 14184 raft_consensus.cc:3060] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:50.589231 14184 raft_consensus.cc:515] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:50.597368 14259 raft_consensus.cc:1275] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:50.598913 15487 consensus_queue.cc:1048] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:50.599165 14184 leader_election.cc:290] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 3 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:50.603334 14338 consensus_queue.cc:237] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:09:50.610350 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:09:50.611090 14339 raft_consensus.cc:3060] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:50.614130 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:09:50.614748 14263 raft_consensus.cc:3055] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:50.615052 14263 raft_consensus.cc:740] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:09:50.615814 14263 consensus_queue.cc:260] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:50.616947 14263 raft_consensus.cc:3060] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:50.620325 14339 raft_consensus.cc:2468] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 3.
I20260709 12:09:50.622392 15417 consensus_queue.cc:1048] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:50.626421 15363 raft_consensus.cc:2955] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 65c9c1653b3346b39a0e118540e6080c (127.12.174.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:50.631878 15475 raft_consensus.cc:2955] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 65c9c1653b3346b39a0e118540e6080c (127.12.174.131) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:50.635454 15449 raft_consensus.cc:993] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec: : Instructing follower 73d01e9b1a9d49358da4985b21d681db to start an election
I20260709 12:09:50.635991 15449 raft_consensus.cc:1081] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 1 LEADER]: Signalling peer 73d01e9b1a9d49358da4985b21d681db to start an election
I20260709 12:09:50.639369 14260 raft_consensus.cc:1275] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:50.642935 15406 consensus_queue.cc:1048] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:50.653079 14263 raft_consensus.cc:2468] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 3.
I20260709 12:09:50.652678 15487 raft_consensus.cc:2955] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 885067a0d31741bfb5c9935788e315bf (127.12.174.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:50.656172 14074 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ec0fc0e91c904a0daeb3e29ee24a492d with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:50.658226 14910 raft_consensus.cc:1275] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 1 LEARNER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:50.664579 14184 raft_consensus.cc:1275] T 6de6b0d9885648e6b2f6822eb9f85021 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:50.652663 14155 leader_election.cc:304] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:09:50.672148 15494 raft_consensus.cc:993] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c: : Instructing follower 73d01e9b1a9d49358da4985b21d681db to start an election
I20260709 12:09:50.672672 15494 raft_consensus.cc:1081] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Signalling peer 73d01e9b1a9d49358da4985b21d681db to start an election
I20260709 12:09:50.667348 14910 raft_consensus.cc:2955] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 65c9c1653b3346b39a0e118540e6080c (127.12.174.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:50.674907 14256 raft_consensus.cc:2955] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 885067a0d31741bfb5c9935788e315bf (127.12.174.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:50.680820 14911 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98"
dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
 from {username='slave'} at 127.0.0.1:53200
I20260709 12:09:50.681456 14911 raft_consensus.cc:493] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:50.681821 14911 raft_consensus.cc:3060] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:50.681896 15406 consensus_queue.cc:1048] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:50.684026 14074 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f52421be255e4fab824173d17981b5bb with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:50.685329 14909 raft_consensus.cc:1275] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:50.687180 14184 raft_consensus.cc:2955] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 65c9c1653b3346b39a0e118540e6080c (127.12.174.131) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:50.687969 14909 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3832505489c04d04a69e256187061921"
dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
 from {username='slave'} at 127.0.0.1:53194
I20260709 12:09:50.688573 14909 raft_consensus.cc:493] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:50.688961 14909 raft_consensus.cc:3060] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:50.691013 15493 consensus_queue.cc:1048] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:50.694378 14911 raft_consensus.cc:515] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:09:50.694887 15493 raft_consensus.cc:993] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c: : Instructing follower 17aab1bbf5014936aa18cc21818b26ec to start an election
I20260709 12:09:50.704075 15493 raft_consensus.cc:1081] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Signalling peer 17aab1bbf5014936aa18cc21818b26ec to start an election
I20260709 12:09:50.697520 14909 raft_consensus.cc:515] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:09:50.706135 14909 leader_election.cc:290] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 2 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:50.671942 15390 raft_consensus.cc:2804] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:50.701970 15356 consensus_queue.cc:1048] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:50.708351 14256 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39"
dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
 from {username='slave'} at 127.0.0.1:41764
I20260709 12:09:50.709055 14256 raft_consensus.cc:493] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:50.715432 14183 raft_consensus.cc:2955] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 65c9c1653b3346b39a0e118540e6080c (127.12.174.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:50.719394 14911 leader_election.cc:290] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 2 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:50.708979 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:09:50.721153 14339 raft_consensus.cc:3055] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:50.721436 14339 raft_consensus.cc:740] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:09:50.722162 14339 consensus_queue.cc:260] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:09:50.723390 14339 raft_consensus.cc:3060] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:50.725916 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:09:50.726593 14263 raft_consensus.cc:3055] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:50.726890 14263 raft_consensus.cc:740] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:09:50.727211 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:09:50.727821 14263 consensus_queue.cc:260] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:09:50.729135 14263 raft_consensus.cc:3060] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:50.731192 14088 catalog_manager.cc:5697] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: config changed from index 4 to 5, VOTER 65c9c1653b3346b39a0e118540e6080c (127.12.174.131) evicted. New cstate: current_term: 2 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:50.734018 14256 raft_consensus.cc:3060] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:50.709429 15390 raft_consensus.cc:697] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 3 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:09:50.727787 14181 raft_consensus.cc:3060] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:50.745155 14263 raft_consensus.cc:2468] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 2.
I20260709 12:09:50.751472 14339 raft_consensus.cc:2468] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 2.
I20260709 12:09:50.755661 14181 raft_consensus.cc:2468] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 2.
I20260709 12:09:50.759975 14256 raft_consensus.cc:515] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:50.762601 14877 leader_election.cc:304] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:09:50.763693 14877 leader_election.cc:304] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:09:50.765046 14074 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1dfd3f2bd71343f789aa5733a23d4b8d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:50.772632 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:09:50.773458 14184 raft_consensus.cc:3060] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:50.778680 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:09:50.779323 14339 raft_consensus.cc:3055] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:50.779668 14339 raft_consensus.cc:740] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:09:50.740196 15390 consensus_queue.cc:237] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:50.777552 14256 leader_election.cc:290] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 2 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:50.786077 14339 consensus_queue.cc:260] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:50.779248 15458 raft_consensus.cc:2804] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:50.791793 14909 raft_consensus.cc:2955] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 885067a0d31741bfb5c9935788e315bf (127.12.174.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:50.796294 14087 catalog_manager.cc:5697] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db reported cstate change: config changed from index 3 to 4, VOTER 65c9c1653b3346b39a0e118540e6080c (127.12.174.131) evicted. New cstate: current_term: 1 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:50.793838 14184 raft_consensus.cc:2468] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 2.
I20260709 12:09:50.793429 14908 raft_consensus.cc:2955] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:50.811100 15493 raft_consensus.cc:2955] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:50.841146 14339 raft_consensus.cc:3060] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:50.869657 14911 raft_consensus.cc:2955] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 65c9c1653b3346b39a0e118540e6080c (127.12.174.131) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:50.875633 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:09:50.876317 14190 raft_consensus.cc:3060] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:50.879606 14339 raft_consensus.cc:2468] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 2.
I20260709 12:09:50.881599 14328 tablet_service.cc:1558] Processing DeleteTablet for tablet ec0fc0e91c904a0daeb3e29ee24a492d with delete_type TABLET_DATA_TOMBSTONED (TS 65c9c1653b3346b39a0e118540e6080c not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:55416
W20260709 12:09:50.878156 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 114549us
I20260709 12:09:50.858265 15458 raft_consensus.cc:697] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 2 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:09:50.877806 15509 raft_consensus.cc:2804] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:09:50.961774 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 95506us
I20260709 12:09:50.962361 15374 raft_consensus.cc:993] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec: : Instructing follower 73d01e9b1a9d49358da4985b21d681db to start an election
I20260709 12:09:50.962270 14190 raft_consensus.cc:2468] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 2.
I20260709 12:09:50.962911 15374 raft_consensus.cc:1081] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 1 LEADER]: Signalling peer 73d01e9b1a9d49358da4985b21d681db to start an election
I20260709 12:09:50.963773 15458 consensus_queue.cc:237] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:09:50.971186 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 74776.3us
I20260709 12:09:50.974934 14230 leader_election.cc:304] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:09:50.975462 15414 raft_consensus.cc:993] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf: : Instructing follower 17aab1bbf5014936aa18cc21818b26ec to start an election
I20260709 12:09:50.976022 15414 raft_consensus.cc:1081] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 1 LEADER]: Signalling peer 17aab1bbf5014936aa18cc21818b26ec to start an election
I20260709 12:09:50.986532 15475 raft_consensus.cc:2804] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:50.987174 15475 raft_consensus.cc:697] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 2 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:09:50.987466 15511 tablet_replica.cc:333] T ec0fc0e91c904a0daeb3e29ee24a492d P 65c9c1653b3346b39a0e118540e6080c: stopping tablet replica
I20260709 12:09:50.988402 14085 catalog_manager.cc:5697] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c reported cstate change: config changed from index 3 to 4, VOTER 885067a0d31741bfb5c9935788e315bf (127.12.174.129) evicted. New cstate: current_term: 1 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:50.991628 15475 consensus_queue.cc:237] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:50.992440 14088 catalog_manager.cc:5697] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf reported cstate change: term changed from 2 to 3, leader changed from 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130) to 885067a0d31741bfb5c9935788e315bf (127.12.174.129). New cstate: current_term: 3 leader_uuid: "885067a0d31741bfb5c9935788e315bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:50.995365 14263 raft_consensus.cc:2955] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:51.014075 14328 tablet_service.cc:1558] Processing DeleteTablet for tablet f52421be255e4fab824173d17981b5bb with delete_type TABLET_DATA_TOMBSTONED (TS 65c9c1653b3346b39a0e118540e6080c not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55416
I20260709 12:09:51.018577 15509 raft_consensus.cc:697] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 2 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:09:51.019747 15509 consensus_queue.cc:237] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:09:51.029049 14176 tablet_service.cc:1558] Processing DeleteTablet for tablet 1dfd3f2bd71343f789aa5733a23d4b8d with delete_type TABLET_DATA_TOMBSTONED (TS 885067a0d31741bfb5c9935788e315bf not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:59324
I20260709 12:09:51.042021 14183 raft_consensus.cc:2955] T 6de6b0d9885648e6b2f6822eb9f85021 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
W20260709 12:09:51.041987 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 54776.9us
I20260709 12:09:51.033470 14088 catalog_manager.cc:5697] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c reported cstate change: config changed from index 2 to 3, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:51.051460 15511 raft_consensus.cc:2243] T ec0fc0e91c904a0daeb3e29ee24a492d P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:51.053323 14256 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae"
dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
 from {username='slave'} at 127.0.0.1:41768
I20260709 12:09:51.053934 14256 raft_consensus.cc:493] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:51.054318 14256 raft_consensus.cc:3060] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:51.054510 15515 tablet_replica.cc:333] T 1dfd3f2bd71343f789aa5733a23d4b8d P 885067a0d31741bfb5c9935788e315bf: stopping tablet replica
I20260709 12:09:51.056725 15515 raft_consensus.cc:2243] T 1dfd3f2bd71343f789aa5733a23d4b8d P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:51.057597 15515 raft_consensus.cc:2272] T 1dfd3f2bd71343f789aa5733a23d4b8d P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:51.062537 15511 raft_consensus.cc:2272] T ec0fc0e91c904a0daeb3e29ee24a492d P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:51.068539 15511 ts_tablet_manager.cc:1916] T ec0fc0e91c904a0daeb3e29ee24a492d P 65c9c1653b3346b39a0e118540e6080c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:51.072611 14085 catalog_manager.cc:5697] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 1 to 2, leader changed from 65c9c1653b3346b39a0e118540e6080c (127.12.174.131) to 73d01e9b1a9d49358da4985b21d681db (127.12.174.132). New cstate: current_term: 2 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:51.076454 14338 consensus_queue.cc:237] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:09:51.078706 14911 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "afce5304599246a580d798fc0c843964"
dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
 from {username='slave'} at 127.0.0.1:53200
I20260709 12:09:51.087939 14911 raft_consensus.cc:493] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:51.088331 14911 raft_consensus.cc:3060] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:51.083230 14256 raft_consensus.cc:515] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:51.098031 15515 ts_tablet_manager.cc:1916] T 1dfd3f2bd71343f789aa5733a23d4b8d P 885067a0d31741bfb5c9935788e315bf: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:51.100170 14909 raft_consensus.cc:1275] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:51.104555 15486 consensus_queue.cc:1048] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:51.101287 14256 leader_election.cc:290] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 2 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:51.117005 15493 raft_consensus.cc:2955] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 885067a0d31741bfb5c9935788e315bf (127.12.174.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:51.126905 14088 catalog_manager.cc:5697] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 1 to 2, leader changed from 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130) to 73d01e9b1a9d49358da4985b21d681db (127.12.174.132). New cstate: current_term: 2 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:51.126334 14909 raft_consensus.cc:2955] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 885067a0d31741bfb5c9935788e315bf (127.12.174.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:51.132959 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:09:51.133572 14339 raft_consensus.cc:3060] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:51.153317 14263 raft_consensus.cc:1275] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:51.158289 15515 ts_tablet_manager.cc:1929] T 1dfd3f2bd71343f789aa5733a23d4b8d P 885067a0d31741bfb5c9935788e315bf: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:51.159099 15515 log.cc:1199] T 1dfd3f2bd71343f789aa5733a23d4b8d P 885067a0d31741bfb5c9935788e315bf: Deleting WAL directory at /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598886212958-12986-0/minicluster-data/ts-0-root/wals/1dfd3f2bd71343f789aa5733a23d4b8d
I20260709 12:09:51.162276 14073 catalog_manager.cc:5028] TS 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): tablet 1dfd3f2bd71343f789aa5733a23d4b8d (table test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]) successfully deleted
I20260709 12:09:51.162320 14339 raft_consensus.cc:2468] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 2.
I20260709 12:09:51.155406 14911 raft_consensus.cc:515] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:09:51.170760 15487 consensus_queue.cc:1048] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:51.175467 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:09:51.176110 14183 raft_consensus.cc:3060] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:51.176829 14230 leader_election.cc:304] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:09:51.177798 15475 raft_consensus.cc:2804] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:51.178444 15475 raft_consensus.cc:697] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 2 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:09:51.179762 15475 consensus_queue.cc:237] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:51.183784 14183 raft_consensus.cc:2468] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 2.
I20260709 12:09:51.184235 15511 ts_tablet_manager.cc:1929] T ec0fc0e91c904a0daeb3e29ee24a492d P 65c9c1653b3346b39a0e118540e6080c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 12:09:51.186031 15511 log.cc:1199] T ec0fc0e91c904a0daeb3e29ee24a492d P 65c9c1653b3346b39a0e118540e6080c: Deleting WAL directory at /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598886212958-12986-0/minicluster-data/ts-2-root/wals/ec0fc0e91c904a0daeb3e29ee24a492d
I20260709 12:09:51.186452 14074 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6de6b0d9885648e6b2f6822eb9f85021 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:51.184564 14333 raft_consensus.cc:1275] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:51.185089 14876 leader_election.cc:304] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:09:51.188233 15458 raft_consensus.cc:2804] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:51.188887 15458 raft_consensus.cc:697] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 2 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:09:51.189699 15390 consensus_queue.cc:1048] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:51.190196 15458 consensus_queue.cc:237] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:09:51.193547 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:09:51.195960 14183 raft_consensus.cc:3055] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:51.196280 14183 raft_consensus.cc:740] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:09:51.196777 15511 tablet_replica.cc:333] T f52421be255e4fab824173d17981b5bb P 65c9c1653b3346b39a0e118540e6080c: stopping tablet replica
I20260709 12:09:51.195880 14088 catalog_manager.cc:5697] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c reported cstate change: config changed from index 3 to 4, VOTER 885067a0d31741bfb5c9935788e315bf (127.12.174.129) evicted. New cstate: current_term: 1 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:51.201813 15511 raft_consensus.cc:2243] T f52421be255e4fab824173d17981b5bb P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:51.197170 14183 consensus_queue.cc:260] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:51.207818 14183 raft_consensus.cc:3060] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:51.208400 14259 raft_consensus.cc:2955] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 885067a0d31741bfb5c9935788e315bf (127.12.174.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:51.216228 14183 raft_consensus.cc:2468] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 2.
I20260709 12:09:51.223284 14074 catalog_manager.cc:5028] TS 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957): tablet ec0fc0e91c904a0daeb3e29ee24a492d (table test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]) successfully deleted
I20260709 12:09:51.228675 14176 tablet_service.cc:1558] Processing DeleteTablet for tablet 6de6b0d9885648e6b2f6822eb9f85021 with delete_type TABLET_DATA_TOMBSTONED (TS 885067a0d31741bfb5c9935788e315bf not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:59324
I20260709 12:09:51.230201 15515 tablet_replica.cc:333] T 6de6b0d9885648e6b2f6822eb9f85021 P 885067a0d31741bfb5c9935788e315bf: stopping tablet replica
I20260709 12:09:51.231907 15515 raft_consensus.cc:2243] T 6de6b0d9885648e6b2f6822eb9f85021 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:51.232993 15515 raft_consensus.cc:2272] T 6de6b0d9885648e6b2f6822eb9f85021 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:51.244803 14088 catalog_manager.cc:5697] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: term changed from 1 to 2, leader changed from 885067a0d31741bfb5c9935788e315bf (127.12.174.129) to 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130). New cstate: current_term: 2 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:51.246934 14088 catalog_manager.cc:5697] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: term changed from 1 to 2, leader changed from 65c9c1653b3346b39a0e118540e6080c (127.12.174.131) to 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130). New cstate: current_term: 2 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:51.248924 15515 ts_tablet_manager.cc:1916] T 6de6b0d9885648e6b2f6822eb9f85021 P 885067a0d31741bfb5c9935788e315bf: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:51.252945 14911 leader_election.cc:290] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 2 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:51.254498 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:09:51.255148 14265 raft_consensus.cc:3055] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:51.255446 14265 raft_consensus.cc:740] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:09:51.256371 14265 consensus_queue.cc:260] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:09:51.257498 14265 raft_consensus.cc:3060] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:51.213330 15511 raft_consensus.cc:2272] T f52421be255e4fab824173d17981b5bb P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:51.273213 14183 raft_consensus.cc:1240] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:51.281546 14265 raft_consensus.cc:2468] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 2.
I20260709 12:09:51.293385 14088 catalog_manager.cc:5697] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 1 to 2, leader changed from 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130) to 73d01e9b1a9d49358da4985b21d681db (127.12.174.132). New cstate: current_term: 2 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:51.286773 15511 ts_tablet_manager.cc:1916] T f52421be255e4fab824173d17981b5bb P 65c9c1653b3346b39a0e118540e6080c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:51.312351 15515 ts_tablet_manager.cc:1929] T 6de6b0d9885648e6b2f6822eb9f85021 P 885067a0d31741bfb5c9935788e315bf: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:51.312919 15515 log.cc:1199] T 6de6b0d9885648e6b2f6822eb9f85021 P 885067a0d31741bfb5c9935788e315bf: Deleting WAL directory at /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598886212958-12986-0/minicluster-data/ts-0-root/wals/6de6b0d9885648e6b2f6822eb9f85021
I20260709 12:09:51.314678 14073 catalog_manager.cc:5028] TS 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): tablet 6de6b0d9885648e6b2f6822eb9f85021 (table test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]) successfully deleted
I20260709 12:09:51.317034 14265 raft_consensus.cc:1275] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:51.318629 15495 consensus_queue.cc:1048] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:51.355727 15511 ts_tablet_manager.cc:1929] T f52421be255e4fab824173d17981b5bb P 65c9c1653b3346b39a0e118540e6080c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:51.356371 15511 log.cc:1199] T f52421be255e4fab824173d17981b5bb P 65c9c1653b3346b39a0e118540e6080c: Deleting WAL directory at /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598886212958-12986-0/minicluster-data/ts-2-root/wals/f52421be255e4fab824173d17981b5bb
I20260709 12:09:51.358129 14074 catalog_manager.cc:5028] TS 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957): tablet f52421be255e4fab824173d17981b5bb (table test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]) successfully deleted
I20260709 12:09:51.441488 14183 raft_consensus.cc:1275] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:51.442830 15458 consensus_queue.cc:1048] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:09:51.457243 14181 raft_consensus.cc:1275] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:51.458910 15509 consensus_queue.cc:1048] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:09:51.462762 14339 raft_consensus.cc:1275] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:51.466140 15475 consensus_queue.cc:1048] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:51.482885 14265 raft_consensus.cc:1275] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:51.484599 15509 consensus_queue.cc:1048] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:51.497767 14338 raft_consensus.cc:1275] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:51.500242 14190 raft_consensus.cc:1275] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:51.501485 15458 consensus_queue.cc:1048] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:51.502517 15449 consensus_queue.cc:1048] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:51.647468 14181 raft_consensus.cc:1275] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:51.648495 15449 consensus_queue.cc:1048] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:51.651932 14190 raft_consensus.cc:1275] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:51.653081 15458 consensus_queue.cc:1048] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:51.659456 14338 raft_consensus.cc:1275] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:51.660607 15442 consensus_queue.cc:1048] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:51.677452 14265 raft_consensus.cc:1275] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:51.679526 15458 consensus_queue.cc:1048] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:51.803292 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:51.899493 14338 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "36091607df2f46059df62d677842a031"
dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
mode: GRACEFUL
new_leader_uuid: "885067a0d31741bfb5c9935788e315bf"
 from {username='slave'} at 127.0.0.1:50896
I20260709 12:09:51.900844 14338 raft_consensus.cc:606] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Received request to transfer leadership to TS 885067a0d31741bfb5c9935788e315bf
I20260709 12:09:51.909453 14338 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5485933837894417a3f0f89d55af1296"
dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
mode: GRACEFUL
new_leader_uuid: "73d01e9b1a9d49358da4985b21d681db"
 from {username='slave'} at 127.0.0.1:50896
I20260709 12:09:51.910548 14338 raft_consensus.cc:606] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Received request to transfer leadership to TS 73d01e9b1a9d49358da4985b21d681db
I20260709 12:09:51.923545 14190 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89"
dest_uuid: "885067a0d31741bfb5c9935788e315bf"
mode: GRACEFUL
new_leader_uuid: "17aab1bbf5014936aa18cc21818b26ec"
 from {username='slave'} at 127.0.0.1:52548
I20260709 12:09:51.924630 14190 raft_consensus.cc:606] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 1 LEADER]: Received request to transfer leadership to TS 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:09:51.933445 14333 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807"
dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
mode: GRACEFUL
new_leader_uuid: "17aab1bbf5014936aa18cc21818b26ec"
 from {username='slave'} at 127.0.0.1:50896
I20260709 12:09:51.934607 14333 raft_consensus.cc:606] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Received request to transfer leadership to TS 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:09:51.940021 14259 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba"
dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
mode: GRACEFUL
new_leader_uuid: "73d01e9b1a9d49358da4985b21d681db"
 from {username='slave'} at 127.0.0.1:42676
I20260709 12:09:51.940826 14259 raft_consensus.cc:606] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 1 LEADER]: Received request to transfer leadership to TS 73d01e9b1a9d49358da4985b21d681db
I20260709 12:09:51.944598 14259 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f52421be255e4fab824173d17981b5bb"
dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
mode: GRACEFUL
new_leader_uuid: "73d01e9b1a9d49358da4985b21d681db"
 from {username='slave'} at 127.0.0.1:42676
I20260709 12:09:51.945119 14259 raft_consensus.cc:606] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 1 LEADER]: Received request to transfer leadership to TS 73d01e9b1a9d49358da4985b21d681db
I20260709 12:09:51.946292 12986 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:09:51.948081 12986 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:51.948755 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:51.993917 15328 raft_consensus.cc:993] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf: : Instructing follower 17aab1bbf5014936aa18cc21818b26ec to start an election
I20260709 12:09:51.994562 15535 raft_consensus.cc:1081] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 1 LEADER]: Signalling peer 17aab1bbf5014936aa18cc21818b26ec to start an election
I20260709 12:09:51.996570 14265 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89"
dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
 from {username='slave'} at 127.0.0.1:41768
I20260709 12:09:51.997063 14265 raft_consensus.cc:493] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:51.997339 14265 raft_consensus.cc:3060] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:52.002671 14265 raft_consensus.cc:515] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:52.004477 14265 leader_election.cc:290] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 2 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:52.005323 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:09:52.005980 14190 raft_consensus.cc:3055] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:52.006326 14190 raft_consensus.cc:740] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:09:52.007140 14190 consensus_queue.cc:260] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:52.005846 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:09:52.008253 14338 raft_consensus.cc:3060] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:52.008385 14190 raft_consensus.cc:3060] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:52.010751 15493 raft_consensus.cc:993] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c: : Instructing follower 17aab1bbf5014936aa18cc21818b26ec to start an election
I20260709 12:09:52.011310 15494 raft_consensus.cc:1081] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Signalling peer 17aab1bbf5014936aa18cc21818b26ec to start an election
I20260709 12:09:52.013033 14259 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807"
dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
 from {username='slave'} at 127.0.0.1:41764
I20260709 12:09:52.013593 14259 raft_consensus.cc:493] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:52.013965 14259 raft_consensus.cc:3060] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:52.015066 14190 raft_consensus.cc:2468] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 2.
I20260709 12:09:52.016069 14338 raft_consensus.cc:2468] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 2.
I20260709 12:09:52.018052 14230 leader_election.cc:304] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:09:52.018981 15512 raft_consensus.cc:2804] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:52.019462 15512 raft_consensus.cc:697] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 2 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:09:52.020315 15512 consensus_queue.cc:237] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:52.025879 14259 raft_consensus.cc:515] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:52.028123 14259 leader_election.cc:290] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 2 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:52.031757 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:09:52.032404 14333 raft_consensus.cc:3055] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:52.032708 14333 raft_consensus.cc:740] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:09:52.034206 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:09:52.034822 14190 raft_consensus.cc:3060] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:52.033507 14333 consensus_queue.cc:260] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:52.035801 14333 raft_consensus.cc:3060] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:52.042960 14190 raft_consensus.cc:2468] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 2.
I20260709 12:09:52.044313 14229 leader_election.cc:304] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:09:52.045404 15512 raft_consensus.cc:2804] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:52.046344 15512 raft_consensus.cc:697] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 2 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:09:52.047261 14333 raft_consensus.cc:2468] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 2.
I20260709 12:09:52.047219 15512 consensus_queue.cc:237] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:52.053668 14085 catalog_manager.cc:5697] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: term changed from 1 to 2, leader changed from 885067a0d31741bfb5c9935788e315bf (127.12.174.129) to 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130). New cstate: current_term: 2 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:52.081602 14087 catalog_manager.cc:5697] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: term changed from 1 to 2, leader changed from 65c9c1653b3346b39a0e118540e6080c (127.12.174.131) to 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130). New cstate: current_term: 2 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:52.134382 15442 raft_consensus.cc:993] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec: : Instructing follower 73d01e9b1a9d49358da4985b21d681db to start an election
I20260709 12:09:52.134873 15512 raft_consensus.cc:1081] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 1 LEADER]: Signalling peer 73d01e9b1a9d49358da4985b21d681db to start an election
I20260709 12:09:52.136370 14909 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba"
dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
 from {username='slave'} at 127.0.0.1:53200
I20260709 12:09:52.136869 14909 raft_consensus.cc:493] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:52.137178 14909 raft_consensus.cc:3060] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:52.144300 14909 raft_consensus.cc:515] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:09:52.146111 14909 leader_election.cc:290] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 2 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:52.146828 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:09:52.147244 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:09:52.147461 14190 raft_consensus.cc:3060] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:52.147751 14265 raft_consensus.cc:3055] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:52.148007 14265 raft_consensus.cc:740] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:09:52.148619 14265 consensus_queue.cc:260] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:09:52.149659 14265 raft_consensus.cc:3060] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:52.154548 14190 raft_consensus.cc:2468] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 2.
I20260709 12:09:52.155822 14265 raft_consensus.cc:2468] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 2.
I20260709 12:09:52.155905 14876 leader_election.cc:304] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:09:52.158481 15509 raft_consensus.cc:2804] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:52.158999 15509 raft_consensus.cc:697] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 2 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:09:52.159854 15509 consensus_queue.cc:237] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:09:52.173243 14087 catalog_manager.cc:5697] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 1 to 2, leader changed from 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130) to 73d01e9b1a9d49358da4985b21d681db (127.12.174.132). New cstate: current_term: 2 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:52.238961 15406 raft_consensus.cc:993] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c: : Instructing follower 73d01e9b1a9d49358da4985b21d681db to start an election
I20260709 12:09:52.239554 15406 raft_consensus.cc:1081] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Signalling peer 73d01e9b1a9d49358da4985b21d681db to start an election
I20260709 12:09:52.241482 14909 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5485933837894417a3f0f89d55af1296"
dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
 from {username='slave'} at 127.0.0.1:53194
I20260709 12:09:52.242110 14909 raft_consensus.cc:493] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:52.242501 14909 raft_consensus.cc:3060] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:52.247984 14909 raft_consensus.cc:515] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:09:52.249981 14909 leader_election.cc:290] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 2 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:52.250780 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:09:52.251041 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:09:52.251724 14338 raft_consensus.cc:3055] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:52.252115 14338 raft_consensus.cc:740] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:09:52.253042 14338 consensus_queue.cc:260] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:09:52.254634 14338 raft_consensus.cc:3060] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:52.256963 14190 raft_consensus.cc:3060] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:52.263986 14338 raft_consensus.cc:2468] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 2.
I20260709 12:09:52.265018 14877 leader_election.cc:304] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:09:52.265761 15509 raft_consensus.cc:2804] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:52.266201 15509 raft_consensus.cc:697] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 2 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:09:52.267084 15509 consensus_queue.cc:237] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:09:52.269057 14190 raft_consensus.cc:2468] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 2.
I20260709 12:09:52.277621 14087 catalog_manager.cc:5697] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 1 to 2, leader changed from 65c9c1653b3346b39a0e118540e6080c (127.12.174.131) to 73d01e9b1a9d49358da4985b21d681db (127.12.174.132). New cstate: current_term: 2 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:52.353765 14190 consensus_queue.cc:237] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } }
I20260709 12:09:52.360677 14338 raft_consensus.cc:1275] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:52.361281 14265 raft_consensus.cc:1275] T 3c9d740fa53e42179ad8d244b4c179fd P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:52.362172 15535 consensus_queue.cc:1048] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:09:52.361918 14154 consensus_peers.cc:597] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf -> Peer 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341): Couldn't send request to peer 73d01e9b1a9d49358da4985b21d681db. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3c9d740fa53e42179ad8d244b4c179fd. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:52.363270 15328 consensus_queue.cc:1048] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:52.374979 15328 raft_consensus.cc:2955] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } } }
I20260709 12:09:52.378628 14265 raft_consensus.cc:2955] T 3c9d740fa53e42179ad8d244b4c179fd P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } } }
I20260709 12:09:52.389144 14338 raft_consensus.cc:2955] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } } }
I20260709 12:09:52.405763 14265 consensus_queue.cc:237] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } }
I20260709 12:09:52.408689 14087 catalog_manager.cc:5697] T 3c9d740fa53e42179ad8d244b4c179fd P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: config changed from index -1 to 2, NON_VOTER 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) added. New cstate: current_term: 1 leader_uuid: "885067a0d31741bfb5c9935788e315bf" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } } }
I20260709 12:09:52.411995 15512 raft_consensus.cc:993] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec: : Instructing follower 73d01e9b1a9d49358da4985b21d681db to start an election
I20260709 12:09:52.413939 15512 raft_consensus.cc:1081] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 1 LEADER]: Signalling peer 73d01e9b1a9d49358da4985b21d681db to start an election
I20260709 12:09:52.414803 15494 raft_consensus.cc:993] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c: : Instructing follower 885067a0d31741bfb5c9935788e315bf to start an election
I20260709 12:09:52.415343 15494 raft_consensus.cc:1081] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Signalling peer 885067a0d31741bfb5c9935788e315bf to start an election
I20260709 12:09:52.416787 14909 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f52421be255e4fab824173d17981b5bb"
dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
 from {username='slave'} at 127.0.0.1:53200
I20260709 12:09:52.416935 14183 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "36091607df2f46059df62d677842a031"
dest_uuid: "885067a0d31741bfb5c9935788e315bf"
 from {username='slave'} at 127.0.0.1:56044
I20260709 12:09:52.417557 14183 raft_consensus.cc:493] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:52.417665 14909 raft_consensus.cc:493] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:52.418146 14909 raft_consensus.cc:3060] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:52.417984 14183 raft_consensus.cc:3060] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:52.433058 14338 raft_consensus.cc:1275] T bf9bea0d16e44efabb5cdd53e3828438 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:09:52.434849 15442 consensus_queue.cc:1048] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:52.436323 14190 raft_consensus.cc:1275] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 12:09:52.438282 14229 consensus_peers.cc:597] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec -> Peer 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341): Couldn't send request to peer 73d01e9b1a9d49358da4985b21d681db. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bf9bea0d16e44efabb5cdd53e3828438. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:52.439304 15512 consensus_queue.cc:1048] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:52.434712 14909 raft_consensus.cc:515] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:09:52.441360 14183 raft_consensus.cc:515] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:09:52.448083 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:09:52.448755 14181 raft_consensus.cc:3060] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:52.450414 14183 leader_election.cc:290] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 2 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:09:52.451321 14908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:09:52.451993 14908 raft_consensus.cc:3060] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:52.461324 15442 raft_consensus.cc:2955] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 4 LEADER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } } }
I20260709 12:09:52.461549 14190 raft_consensus.cc:2955] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } } }
I20260709 12:09:52.466128 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:09:52.474069 14339 raft_consensus.cc:3055] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:52.474436 14339 raft_consensus.cc:740] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:09:52.475353 14339 consensus_queue.cc:260] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:09:52.476739 14339 raft_consensus.cc:3060] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:52.477113 14184 raft_consensus.cc:1275] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:52.477766 14338 raft_consensus.cc:2955] T bf9bea0d16e44efabb5cdd53e3828438 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } } }
I20260709 12:09:52.479699 15512 consensus_queue.cc:1048] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:52.487999 14181 raft_consensus.cc:2468] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 2.
I20260709 12:09:52.489300 14876 leader_election.cc:304] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:09:52.490243 15509 raft_consensus.cc:2804] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:52.490756 15509 raft_consensus.cc:697] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 2 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:09:52.491637 15509 consensus_queue.cc:237] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:09:52.515316 14338 consensus_queue.cc:237] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } }
I20260709 12:09:52.519331 14088 catalog_manager.cc:5697] T bf9bea0d16e44efabb5cdd53e3828438 P 65c9c1653b3346b39a0e118540e6080c reported cstate change: config changed from index -1 to 4, NON_VOTER 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) added. New cstate: current_term: 4 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } } }
I20260709 12:09:52.523206 14908 raft_consensus.cc:2468] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 2.
I20260709 12:09:52.526031 14339 raft_consensus.cc:2468] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 2.
W20260709 12:09:52.549337 14303 consensus_peers.cc:597] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c -> Peer 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341): Couldn't send request to peer 73d01e9b1a9d49358da4985b21d681db. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0d203245740a4821b7ebcc7669c8b2af. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:52.560005 14155 leader_election.cc:304] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:09:52.552947 14265 raft_consensus.cc:1275] T 0d203245740a4821b7ebcc7669c8b2af P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:52.566175 14339 raft_consensus.cc:1275] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:52.553898 14909 leader_election.cc:290] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 2 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:52.567129 14087 catalog_manager.cc:5697] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 1 to 2, leader changed from 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130) to 73d01e9b1a9d49358da4985b21d681db (127.12.174.132). New cstate: current_term: 2 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:52.568639 15494 consensus_queue.cc:1048] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:52.572407 14190 raft_consensus.cc:1275] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:52.573448 15512 consensus_queue.cc:1048] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:52.580574 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:09:52.581279 14259 raft_consensus.cc:3055] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:52.581707 15328 raft_consensus.cc:2804] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:52.582327 15328 raft_consensus.cc:697] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 2 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:09:52.583148 15328 consensus_queue.cc:237] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:09:52.585767 15493 consensus_queue.cc:1048] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:52.587193 14259 raft_consensus.cc:740] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:09:52.589113 14259 consensus_queue.cc:260] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:09:52.590521 14259 raft_consensus.cc:3060] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:52.605450 14183 raft_consensus.cc:1275] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:52.611225 15442 consensus_queue.cc:1048] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:52.621999 14265 raft_consensus.cc:1275] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:52.624096 15508 consensus_queue.cc:1048] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:09:52.629863 14333 raft_consensus.cc:1275] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:52.639196 15493 raft_consensus.cc:2955] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } } }
I20260709 12:09:52.647039 14259 raft_consensus.cc:2468] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 2.
I20260709 12:09:52.656481 14189 raft_consensus.cc:2955] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } } }
I20260709 12:09:52.727417 14088 catalog_manager.cc:5697] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf reported cstate change: term changed from 1 to 2, leader changed from 65c9c1653b3346b39a0e118540e6080c (127.12.174.131) to 885067a0d31741bfb5c9935788e315bf (127.12.174.129). New cstate: current_term: 2 leader_uuid: "885067a0d31741bfb5c9935788e315bf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:52.746083 14190 raft_consensus.cc:1275] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:52.747941 15509 consensus_queue.cc:1048] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:09:52.755899 14184 raft_consensus.cc:1275] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 12:09:52.763705 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 126264us
I20260709 12:09:52.763976 15509 consensus_queue.cc:1048] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:52.767899 15442 consensus_queue.cc:1048] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:52.768772 14265 raft_consensus.cc:2955] T 0d203245740a4821b7ebcc7669c8b2af P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } } }
I20260709 12:09:52.812144 15566 ts_tablet_manager.cc:933] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db: Initiating tablet copy from peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187)
I20260709 12:09:52.815299 14333 consensus_queue.cc:237] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } }
I20260709 12:09:52.821811 15566 tablet_copy_client.cc:323] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db: tablet copy: Beginning tablet copy session from remote peer at address 127.12.174.129:37187
I20260709 12:09:52.828476 14200 tablet_copy_service.cc:140] P 885067a0d31741bfb5c9935788e315bf: Received BeginTabletCopySession request for tablet 3c9d740fa53e42179ad8d244b4c179fd from peer 73d01e9b1a9d49358da4985b21d681db ({username='slave'} at 127.0.0.1:56652)
I20260709 12:09:52.829384 14200 tablet_copy_service.cc:161] P 885067a0d31741bfb5c9935788e315bf: Beginning new tablet copy session on tablet 3c9d740fa53e42179ad8d244b4c179fd from peer 73d01e9b1a9d49358da4985b21d681db at {username='slave'} at 127.0.0.1:56652: session id = 73d01e9b1a9d49358da4985b21d681db-3c9d740fa53e42179ad8d244b4c179fd
I20260709 12:09:52.843298 14338 raft_consensus.cc:1275] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:52.828207 14087 catalog_manager.cc:5697] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c reported cstate change: config changed from index -1 to 2, NON_VOTER 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) added. New cstate: current_term: 1 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:09:52.875131 14303 consensus_peers.cc:597] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c -> Peer 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341): Couldn't send request to peer 73d01e9b1a9d49358da4985b21d681db. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f4739bc22bfe44fcba807da02d9351b6. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:52.894436 14183 raft_consensus.cc:1275] T f4739bc22bfe44fcba807da02d9351b6 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:52.901357 15494 consensus_queue.cc:1048] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:52.902630 14183 raft_consensus.cc:1275] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:52.910837 15509 consensus_queue.cc:1048] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:52.912035 15565 consensus_queue.cc:1048] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:09:52.916096 14200 tablet_copy_source_session.cc:215] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:52.948716 15576 ts_tablet_manager.cc:933] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db: Initiating tablet copy from peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:52.932914 15570 raft_consensus.cc:2955] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } } }
I20260709 12:09:52.963474 14260 raft_consensus.cc:1275] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:52.963778 14190 raft_consensus.cc:2955] T f4739bc22bfe44fcba807da02d9351b6 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } } }
I20260709 12:09:53.002784 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:09:53.127092 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 55149us
I20260709 12:09:53.158977 15571 ts_tablet_manager.cc:933] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db: Initiating tablet copy from peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:09:53.222185 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 54258.9us
W20260709 12:09:53.293308 15573 log.cc:927] Time spent T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
W20260709 12:09:53.294956 15575 log.cc:927] Time spent T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 12:09:53.298190 15566 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c9d740fa53e42179ad8d244b4c179fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:53.303031 14265 raft_consensus.cc:1275] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:53.274857 15576 tablet_copy_client.cc:323] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db: tablet copy: Beginning tablet copy session from remote peer at address 127.12.174.130:36673
W20260709 12:09:53.309284 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 181292us
I20260709 12:09:53.315125 15571 tablet_copy_client.cc:323] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db: tablet copy: Beginning tablet copy session from remote peer at address 127.12.174.131:45957
I20260709 12:09:53.357757 14189 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d"
dest_uuid: "885067a0d31741bfb5c9935788e315bf"
mode: GRACEFUL
new_leader_uuid: "65c9c1653b3346b39a0e118540e6080c"
 from {username='slave'} at 127.0.0.1:52548
I20260709 12:09:53.358464 14189 raft_consensus.cc:606] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 3 LEADER]: Received request to transfer leadership to TS 65c9c1653b3346b39a0e118540e6080c
I20260709 12:09:53.363987 14333 raft_consensus.cc:1275] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 12:09:53.383014 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 393803us
I20260709 12:09:53.408099 14338 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca"
dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
mode: GRACEFUL
new_leader_uuid: "17aab1bbf5014936aa18cc21818b26ec"
 from {username='slave'} at 127.0.0.1:50896
I20260709 12:09:53.408924 14338 raft_consensus.cc:606] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Received request to transfer leadership to TS 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:09:53.415171 12986 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:09:53.417420 12986 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:53.429908 15591 consensus_queue.cc:1048] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
W20260709 12:09:53.447793 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 314487us
I20260709 12:09:53.456183 14907 raft_consensus.cc:1275] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 12:09:53.463477 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 49278.1us
W20260709 12:09:53.464819 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 136533us
I20260709 12:09:53.472220 14275 tablet_copy_service.cc:140] P 17aab1bbf5014936aa18cc21818b26ec: Received BeginTabletCopySession request for tablet bf9bea0d16e44efabb5cdd53e3828438 from peer 73d01e9b1a9d49358da4985b21d681db ({username='slave'} at 127.0.0.1:53050)
I20260709 12:09:53.472894 14275 tablet_copy_service.cc:161] P 17aab1bbf5014936aa18cc21818b26ec: Beginning new tablet copy session on tablet bf9bea0d16e44efabb5cdd53e3828438 from peer 73d01e9b1a9d49358da4985b21d681db at {username='slave'} at 127.0.0.1:53050: session id = 73d01e9b1a9d49358da4985b21d681db-bf9bea0d16e44efabb5cdd53e3828438
I20260709 12:09:53.473053 14348 tablet_copy_service.cc:140] P 65c9c1653b3346b39a0e118540e6080c: Received BeginTabletCopySession request for tablet 0d203245740a4821b7ebcc7669c8b2af from peer 73d01e9b1a9d49358da4985b21d681db ({username='slave'} at 127.0.0.1:55492)
I20260709 12:09:53.473676 14348 tablet_copy_service.cc:161] P 65c9c1653b3346b39a0e118540e6080c: Beginning new tablet copy session on tablet 0d203245740a4821b7ebcc7669c8b2af from peer 73d01e9b1a9d49358da4985b21d681db at {username='slave'} at 127.0.0.1:55492: session id = 73d01e9b1a9d49358da4985b21d681db-0d203245740a4821b7ebcc7669c8b2af
I20260709 12:09:53.492744 15607 consensus_queue.cc:1048] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:53.505512 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:53.516321 15604 consensus_queue.cc:1048] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:09:53.526635 14275 tablet_copy_source_session.cc:215] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:53.534773 15566 tablet_copy_client.cc:806] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:53.535075 14348 tablet_copy_source_session.cc:215] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:53.535586 15566 tablet_copy_client.cc:670] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:53.546135 15592 consensus_queue.cc:1048] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:09:53.550632 14265 raft_consensus.cc:2955] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } } }
I20260709 12:09:53.551997 15576 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf9bea0d16e44efabb5cdd53e3828438. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:53.652653 15612 ts_tablet_manager.cc:933] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db: Initiating tablet copy from peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:53.658732 14088 catalog_manager.cc:5697] T f4739bc22bfe44fcba807da02d9351b6 P 885067a0d31741bfb5c9935788e315bf reported cstate change: config changed from index -1 to 2, NON_VOTER 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) added. New cstate: current_term: 1 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } } }
I20260709 12:09:53.674192 15571 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d203245740a4821b7ebcc7669c8b2af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:53.707000 15566 tablet_copy_client.cc:538] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 12:09:53.767462 15614 log.cc:927] Time spent T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260709 12:09:53.888969 15596 raft_consensus.cc:993] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c: : Instructing follower 17aab1bbf5014936aa18cc21818b26ec to start an election
I20260709 12:09:53.889705 15596 raft_consensus.cc:1081] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Signalling peer 17aab1bbf5014936aa18cc21818b26ec to start an election
I20260709 12:09:53.897353 14264 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca"
dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
 from {username='slave'} at 127.0.0.1:41764
I20260709 12:09:53.898054 14264 raft_consensus.cc:493] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:53.898407 14264 raft_consensus.cc:3060] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:53.909300 15584 raft_consensus.cc:993] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf: : Instructing follower 65c9c1653b3346b39a0e118540e6080c to start an election
I20260709 12:09:53.910969 15566 tablet_bootstrap.cc:492] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db: Bootstrap starting.
I20260709 12:09:53.916796 15591 raft_consensus.cc:1081] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 3 LEADER]: Signalling peer 65c9c1653b3346b39a0e118540e6080c to start an election
I20260709 12:09:53.915162 14264 raft_consensus.cc:515] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:53.940366 14264 leader_election.cc:290] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 2 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:53.951956 15612 tablet_copy_client.cc:323] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db: tablet copy: Beginning tablet copy session from remote peer at address 127.12.174.131:45957
I20260709 12:09:53.959152 14348 tablet_copy_service.cc:140] P 65c9c1653b3346b39a0e118540e6080c: Received BeginTabletCopySession request for tablet f4739bc22bfe44fcba807da02d9351b6 from peer 73d01e9b1a9d49358da4985b21d681db ({username='slave'} at 127.0.0.1:55492)
I20260709 12:09:53.959802 14348 tablet_copy_service.cc:161] P 65c9c1653b3346b39a0e118540e6080c: Beginning new tablet copy session on tablet f4739bc22bfe44fcba807da02d9351b6 from peer 73d01e9b1a9d49358da4985b21d681db at {username='slave'} at 127.0.0.1:55492: session id = 73d01e9b1a9d49358da4985b21d681db-f4739bc22bfe44fcba807da02d9351b6
I20260709 12:09:53.974766 15571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:53194 (request call id 451) took 1036 ms. Trace:
I20260709 12:09:53.975510 15571 rpcz_store.cc:276] 0709 12:09:52.937884 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:52.938093 (+   209us) service_pool.cc:224] Handling call
0709 12:09:53.190231 (+252138us) ts_tablet_manager.cc:934] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db: Initiating tablet copy from peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
0709 12:09:53.672006 (+481775us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:09:53.959729 (+287723us) tablet_metadata.cc:665] Metadata flushed
0709 12:09:53.959901 (+   172us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:09:53.973569 (+ 13668us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:09:53.974067 (+   498us) tablet_replica.cc:206] Creating consensus instance
0709 12:09:53.974575 (+   508us) ts_tablet_manager.cc:989] Replica registered.
0709 12:09:53.974669 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":15518,"tablet-copy.queue_time_us":163011,"thread_start_us":73985,"threads_started":2}
I20260709 12:09:53.978718 15571 tablet_copy_client.cc:806] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:53.979480 15571 tablet_copy_client.cc:670] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:53.980919 15576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:53200 (request call id 247) took 1088 ms. Trace:
I20260709 12:09:53.981551 15576 rpcz_store.cc:276] 0709 12:09:52.892425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:52.904990 (+ 12565us) service_pool.cc:224] Handling call
0709 12:09:52.950919 (+ 45929us) ts_tablet_manager.cc:934] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db: Initiating tablet copy from peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
0709 12:09:53.550643 (+599724us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:09:53.935179 (+384536us) tablet_metadata.cc:665] Metadata flushed
0709 12:09:53.939642 (+  4463us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:09:53.979792 (+ 40150us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:09:53.980246 (+   454us) tablet_replica.cc:206] Creating consensus instance
0709 12:09:53.980690 (+   444us) ts_tablet_manager.cc:989] Replica registered.
0709 12:09:53.980803 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":81377,"tablet-copy.queue_time_us":43110,"thread_start_us":295653,"threads_started":2}
I20260709 12:09:53.985337 15576 tablet_copy_client.cc:806] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:53.996508 15576 tablet_copy_client.cc:670] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:53.997129 15571 tablet_copy_client.cc:538] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 12:09:53.995404 14154 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 109493us
I20260709 12:09:54.023074 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:09:54.023753 14333 raft_consensus.cc:3055] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:54.024072 14333 raft_consensus.cc:740] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:09:54.024853 14333 consensus_queue.cc:260] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:54.027496 14333 raft_consensus.cc:3060] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:54.031697 14348 tablet_copy_source_session.cc:215] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:54.036934 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:09:54.039954 14339 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d"
dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
 from {username='slave'} at 127.0.0.1:50858
I20260709 12:09:54.040577 14339 raft_consensus.cc:493] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:54.040961 14339 raft_consensus.cc:3060] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:54.037674 14188 raft_consensus.cc:3060] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:09:54.114451 15621 log.cc:927] Time spent T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.250s	user 0.000s	sys 0.006s
W20260709 12:09:54.119735 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 70688.4us
I20260709 12:09:54.125972 14333 raft_consensus.cc:2468] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 2.
I20260709 12:09:54.128875 14339 raft_consensus.cc:515] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:54.133173 14188 raft_consensus.cc:2468] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 2.
W20260709 12:09:54.133227 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 80958us
W20260709 12:09:54.126716 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 65145.6us
I20260709 12:09:54.150206 14339 leader_election.cc:290] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 4 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:09:54.155128 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 125837us
I20260709 12:09:54.164588 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:09:54.165337 14187 raft_consensus.cc:3055] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:09:54.165702 14187 raft_consensus.cc:740] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
W20260709 12:09:54.127241 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 105064us
I20260709 12:09:54.180089 14187 consensus_queue.cc:260] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:54.225613 14187 raft_consensus.cc:3060] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:54.258493 15576 tablet_copy_client.cc:538] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:54.273136 15612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4739bc22bfe44fcba807da02d9351b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:54.281910 15476 raft_consensus.cc:493] T 0d203245740a4821b7ebcc7669c8b2af P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:09:54.282806 15476 raft_consensus.cc:515] T 0d203245740a4821b7ebcc7669c8b2af P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } }
I20260709 12:09:54.287161 15476 leader_election.cc:290] T 0d203245740a4821b7ebcc7669c8b2af P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:54.294273 15571 tablet_bootstrap.cc:492] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db: Bootstrap starting.
I20260709 12:09:54.302243 14230 leader_election.cc:304] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:09:54.308974 15594 raft_consensus.cc:2804] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:54.310050 15594 raft_consensus.cc:697] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 2 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:09:54.306653 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:09:54.312099 14265 raft_consensus.cc:3060] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:09:54.303800 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 122458us
I20260709 12:09:54.315174 15594 consensus_queue.cc:237] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:54.337088 14265 raft_consensus.cc:2468] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 4.
I20260709 12:09:54.399263 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:54.415613 14187 raft_consensus.cc:2468] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 4.
I20260709 12:09:54.427012 14303 leader_election.cc:304] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:09:54.457053 15634 raft_consensus.cc:2804] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:09:54.457634 15634 raft_consensus.cc:697] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 4 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:09:54.458618 15634 consensus_queue.cc:237] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:54.524557 15566 tablet_bootstrap.cc:492] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:54.525818 15566 tablet_bootstrap.cc:492] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db: Bootstrap complete.
I20260709 12:09:54.610258 15566 ts_tablet_manager.cc:1403] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db: Time spent bootstrapping tablet: real 0.700s	user 0.047s	sys 0.042s
I20260709 12:09:54.627820 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:09:54.647012 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 158603us
I20260709 12:09:54.708297 15647 raft_consensus.cc:493] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
W20260709 12:09:54.719277 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 70812.3us
I20260709 12:09:54.708941 15647 raft_consensus.cc:515] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:09:54.758111 15647 leader_election.cc:290] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:09:54.787137 14230 leader_election.cc:304] T 0d203245740a4821b7ebcc7669c8b2af P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:09:54.895421 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
W20260709 12:09:54.899701 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 112734us
I20260709 12:09:54.914489 15639 raft_consensus.cc:2749] T 0d203245740a4821b7ebcc7669c8b2af P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:09:54.938848 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 107318us
I20260709 12:09:54.941066 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:54.957029 15576 tablet_bootstrap.cc:492] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db: Bootstrap starting.
I20260709 12:09:54.969934 14230 leader_election.cc:304] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:09:54.971323 14336 raft_consensus.cc:1275] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:54.914930 15566 raft_consensus.cc:359] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } }
I20260709 12:09:55.017974 15328 raft_consensus.cc:493] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:09:55.018576 15328 raft_consensus.cc:515] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:09:54.851648 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:55.025386 15512 consensus_queue.cc:1048] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:55.031308 15328 leader_election.cc:290] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:09:55.032225 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 59793.9us
I20260709 12:09:54.976060 15652 raft_consensus.cc:2749] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:54.978488 15612 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:53194 (request call id 458) took 1466 ms. Trace:
I20260709 12:09:55.012514 15566 raft_consensus.cc:740] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Initialized, Role: LEARNER
I20260709 12:09:55.048629 14907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:09:55.051833 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:55.061422 14182 raft_consensus.cc:1275] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 12:09:55.024624 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 45680.9us
I20260709 12:09:55.069289 15571 tablet_bootstrap.cc:492] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:55.036291 15612 rpcz_store.cc:276] 0709 12:09:53.504581 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:53.505225 (+   644us) service_pool.cc:224] Handling call
0709 12:09:53.653166 (+147941us) ts_tablet_manager.cc:934] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db: Initiating tablet copy from peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
0709 12:09:53.904363 (+251197us) spinlock_profiling.cc:243] Waited 3.08 ms on lock 0x7b4400022b4c. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2123f74c85 00007f2123f756a2 00007f2126ce71db 00007f2126ce2aaf 00007f21240310ac 00007f212ce8b9a9 00007f212404d69b 00007f212404acaa 00007f212404abd2 00007f212c0af131
0709 12:09:54.256293 (+351930us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:09:54.607202 (+350909us) tablet_metadata.cc:665] Metadata flushed
0709 12:09:54.610968 (+  3766us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:09:54.889212 (+278244us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:09:54.922850 (+ 33638us) tablet_replica.cc:206] Creating consensus instance
0709 12:09:54.946559 (+ 23709us) ts_tablet_manager.cc:989] Replica registered.
0709 12:09:54.971250 (+ 24691us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":16002,"spinlock_wait_cycles":7081728,"tablet-copy.queue_time_us":111920,"thread_start_us":278981,"threads_started":2}
I20260709 12:09:55.074366 15612 tablet_copy_client.cc:806] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:55.074705 14155 leader_election.cc:304] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:09:55.070925 15566 consensus_queue.cc:260] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } }
I20260709 12:09:55.080471 15566 ts_tablet_manager.cc:1434] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db: Time spent starting tablet: real 0.435s	user 0.008s	sys 0.002s
I20260709 12:09:55.074985 15612 tablet_copy_client.cc:670] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:55.076072 15571 tablet_bootstrap.cc:492] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db: Bootstrap complete.
I20260709 12:09:55.090147 15609 raft_consensus.cc:2749] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:55.095934 15406 raft_consensus.cc:493] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:09:55.107956 15406 raft_consensus.cc:515] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:55.111394 15406 leader_election.cc:290] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:55.105312 14181 raft_consensus.cc:1275] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:55.114310 15571 ts_tablet_manager.cc:1403] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db: Time spent bootstrapping tablet: real 0.849s	user 0.040s	sys 0.021s
I20260709 12:09:55.084718 15494 consensus_queue.cc:1048] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 12:09:55.130254 14085 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60410 (request call id 244) took 1079 ms. Trace:
I20260709 12:09:55.130735 14085 rpcz_store.cc:276] 0709 12:09:54.116815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:54.127094 (+ 10279us) service_pool.cc:224] Handling call
0709 12:09:55.130150 (+1003056us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":361314,"reported_tablets":2}
I20260709 12:09:55.138655 14087 catalog_manager.cc:5697] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: term changed from 1 to 2, leader changed from 65c9c1653b3346b39a0e118540e6080c (127.12.174.131) to 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130). New cstate: current_term: 2 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:55.143769 15600 consensus_queue.cc:1048] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:55.148166 14200 tablet_copy_service.cc:342] P 885067a0d31741bfb5c9935788e315bf: Request end of tablet copy session 73d01e9b1a9d49358da4985b21d681db-3c9d740fa53e42179ad8d244b4c179fd received from {username='slave'} at 127.0.0.1:56652
I20260709 12:09:55.148712 14200 tablet_copy_service.cc:434] P 885067a0d31741bfb5c9935788e315bf: ending tablet copy session 73d01e9b1a9d49358da4985b21d681db-3c9d740fa53e42179ad8d244b4c179fd on tablet 3c9d740fa53e42179ad8d244b4c179fd with peer 73d01e9b1a9d49358da4985b21d681db
I20260709 12:09:55.148877 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:55.157871 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:55.179666 15571 raft_consensus.cc:359] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } }
I20260709 12:09:55.180627 15571 raft_consensus.cc:740] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Initialized, Role: LEARNER
I20260709 12:09:55.181351 15571 consensus_queue.cc:260] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } }
I20260709 12:09:55.183063 14259 raft_consensus.cc:1275] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:09:55.218132 14304 leader_election.cc:304] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:09:55.219460 15612 tablet_copy_client.cc:538] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:55.218716 15571 ts_tablet_manager.cc:1434] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db: Time spent starting tablet: real 0.104s	user 0.009s	sys 0.001s
I20260709 12:09:55.230232 15634 raft_consensus.cc:2749] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:09:55.237978 15632 consensus_queue.cc:1048] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 12:09:55.258183 14348 tablet_copy_service.cc:342] P 65c9c1653b3346b39a0e118540e6080c: Request end of tablet copy session 73d01e9b1a9d49358da4985b21d681db-0d203245740a4821b7ebcc7669c8b2af received from {username='slave'} at 127.0.0.1:55492
I20260709 12:09:55.258724 14348 tablet_copy_service.cc:434] P 65c9c1653b3346b39a0e118540e6080c: ending tablet copy session 73d01e9b1a9d49358da4985b21d681db-0d203245740a4821b7ebcc7669c8b2af on tablet 0d203245740a4821b7ebcc7669c8b2af with peer 73d01e9b1a9d49358da4985b21d681db
I20260709 12:09:55.299922 15612 tablet_bootstrap.cc:492] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db: Bootstrap starting.
I20260709 12:09:55.365850 15576 tablet_bootstrap.cc:492] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:55.367820 14908 raft_consensus.cc:1217] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:55.368932 15576 tablet_bootstrap.cc:492] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db: Bootstrap complete.
I20260709 12:09:55.374219 15576 ts_tablet_manager.cc:1403] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db: Time spent bootstrapping tablet: real 0.418s	user 0.050s	sys 0.062s
I20260709 12:09:55.384586 14181 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "36091607df2f46059df62d677842a031"
dest_uuid: "885067a0d31741bfb5c9935788e315bf"
mode: GRACEFUL
new_leader_uuid: "65c9c1653b3346b39a0e118540e6080c"
 from {username='slave'} at 127.0.0.1:52548
I20260709 12:09:55.385327 14181 raft_consensus.cc:606] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 2 LEADER]: Received request to transfer leadership to TS 65c9c1653b3346b39a0e118540e6080c
I20260709 12:09:55.385069 15576 raft_consensus.cc:359] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [term 4 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } }
I20260709 12:09:55.391000 15576 raft_consensus.cc:740] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [term 4 LEARNER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Initialized, Role: LEARNER
I20260709 12:09:55.392096 15576 consensus_queue.cc:260] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } }
I20260709 12:09:55.396669 14332 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6"
dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
mode: GRACEFUL
new_leader_uuid: "17aab1bbf5014936aa18cc21818b26ec"
 from {username='slave'} at 127.0.0.1:50896
I20260709 12:09:55.397351 14332 raft_consensus.cc:606] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Received request to transfer leadership to TS 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:09:55.398754 12986 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:09:55.400772 12986 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:55.401631 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:55.399400 15576 ts_tablet_manager.cc:1434] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.006s
I20260709 12:09:55.423763 14275 tablet_copy_service.cc:342] P 17aab1bbf5014936aa18cc21818b26ec: Request end of tablet copy session 73d01e9b1a9d49358da4985b21d681db-bf9bea0d16e44efabb5cdd53e3828438 received from {username='slave'} at 127.0.0.1:53050
I20260709 12:09:55.424468 14275 tablet_copy_service.cc:434] P 17aab1bbf5014936aa18cc21818b26ec: ending tablet copy session 73d01e9b1a9d49358da4985b21d681db-bf9bea0d16e44efabb5cdd53e3828438 on tablet bf9bea0d16e44efabb5cdd53e3828438 with peer 73d01e9b1a9d49358da4985b21d681db
I20260709 12:09:55.432430 14085 catalog_manager.cc:5697] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c reported cstate change: term changed from 3 to 4, leader changed from 885067a0d31741bfb5c9935788e315bf (127.12.174.129) to 65c9c1653b3346b39a0e118540e6080c (127.12.174.131). New cstate: current_term: 4 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:55.489027 15642 raft_consensus.cc:993] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c: : Instructing follower 17aab1bbf5014936aa18cc21818b26ec to start an election
I20260709 12:09:55.489550 15642 raft_consensus.cc:1081] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Signalling peer 17aab1bbf5014936aa18cc21818b26ec to start an election
I20260709 12:09:55.503701 14264 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6"
dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
 from {username='slave'} at 127.0.0.1:41764
I20260709 12:09:55.504251 14264 raft_consensus.cc:493] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:55.504606 14264 raft_consensus.cc:3060] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:55.522156 14910 raft_consensus.cc:1217] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:55.523910 14264 raft_consensus.cc:515] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } }
I20260709 12:09:55.532546 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:09:55.533098 14339 raft_consensus.cc:3055] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:55.505071 15612 tablet_bootstrap.cc:492] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:55.533334 14339 raft_consensus.cc:740] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:09:55.536573 14339 consensus_queue.cc:260] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } }
I20260709 12:09:55.537954 14339 raft_consensus.cc:3060] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:55.541640 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:09:55.542296 14181 raft_consensus.cc:3060] T f4739bc22bfe44fcba807da02d9351b6 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:55.533864 14264 leader_election.cc:290] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 2 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:55.549363 14339 raft_consensus.cc:2468] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 2.
I20260709 12:09:55.556778 14230 leader_election.cc:304] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:09:55.556376 14181 raft_consensus.cc:2468] T f4739bc22bfe44fcba807da02d9351b6 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 2.
I20260709 12:09:55.559685 15649 raft_consensus.cc:2804] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:55.575997 15649 raft_consensus.cc:697] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 2 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:09:55.586653 15649 consensus_queue.cc:237] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } }
I20260709 12:09:55.640290 14907 raft_consensus.cc:1217] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [term 4 LEARNER]: Deduplicated request from leader. Original: 4.3->[4.4-4.4]   Dedup: 4.4->[]
I20260709 12:09:55.633919 15612 tablet_bootstrap.cc:492] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db: Bootstrap complete.
I20260709 12:09:55.651265 15612 ts_tablet_manager.cc:1403] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db: Time spent bootstrapping tablet: real 0.352s	user 0.025s	sys 0.030s
I20260709 12:09:55.663538 15612 raft_consensus.cc:359] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } }
I20260709 12:09:55.665660 15612 raft_consensus.cc:740] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Initialized, Role: LEARNER
I20260709 12:09:55.666494 15612 consensus_queue.cc:260] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } }
I20260709 12:09:55.676467 14087 catalog_manager.cc:5697] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: term changed from 1 to 2, leader changed from 65c9c1653b3346b39a0e118540e6080c (127.12.174.131) to 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130). New cstate: current_term: 2 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:55.677157 15612 ts_tablet_manager.cc:1434] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db: Time spent starting tablet: real 0.025s	user 0.004s	sys 0.004s
I20260709 12:09:55.690634 14348 tablet_copy_service.cc:342] P 65c9c1653b3346b39a0e118540e6080c: Request end of tablet copy session 73d01e9b1a9d49358da4985b21d681db-f4739bc22bfe44fcba807da02d9351b6 received from {username='slave'} at 127.0.0.1:55492
I20260709 12:09:55.691166 14348 tablet_copy_service.cc:434] P 65c9c1653b3346b39a0e118540e6080c: ending tablet copy session 73d01e9b1a9d49358da4985b21d681db-f4739bc22bfe44fcba807da02d9351b6 on tablet f4739bc22bfe44fcba807da02d9351b6 with peer 73d01e9b1a9d49358da4985b21d681db
I20260709 12:09:55.781131 15591 raft_consensus.cc:993] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf: : Instructing follower 65c9c1653b3346b39a0e118540e6080c to start an election
I20260709 12:09:55.781752 15673 raft_consensus.cc:1081] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 2 LEADER]: Signalling peer 65c9c1653b3346b39a0e118540e6080c to start an election
I20260709 12:09:55.783864 14339 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "36091607df2f46059df62d677842a031"
dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
 from {username='slave'} at 127.0.0.1:50858
I20260709 12:09:55.784359 14339 raft_consensus.cc:493] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:55.784638 14339 raft_consensus.cc:3060] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:55.791858 14339 raft_consensus.cc:515] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:09:55.794783 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:09:55.795368 14339 leader_election.cc:290] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:09:55.797120 14907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:09:55.797809 14907 raft_consensus.cc:3060] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:55.795544 14181 raft_consensus.cc:3055] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:55.802438 14181 raft_consensus.cc:740] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:09:55.803568 14181 consensus_queue.cc:260] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:09:55.806932 14181 raft_consensus.cc:3060] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:55.819715 14907 raft_consensus.cc:2468] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 3.
I20260709 12:09:55.821027 14303 leader_election.cc:304] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:09:55.823246 15561 raft_consensus.cc:2804] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:55.823854 15561 raft_consensus.cc:697] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 3 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:09:55.824764 15561 consensus_queue.cc:237] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:09:55.858975 14085 catalog_manager.cc:5697] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c reported cstate change: term changed from 2 to 3, leader changed from 885067a0d31741bfb5c9935788e315bf (127.12.174.129) to 65c9c1653b3346b39a0e118540e6080c (127.12.174.131). New cstate: current_term: 3 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:55.866375 15494 raft_consensus.cc:1064] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c: attempting to promote NON_VOTER 73d01e9b1a9d49358da4985b21d681db to VOTER
I20260709 12:09:55.866746 14181 raft_consensus.cc:2468] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 3.
I20260709 12:09:55.869555 15494 consensus_queue.cc:237] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:09:55.892711 14264 raft_consensus.cc:1275] T 0d203245740a4821b7ebcc7669c8b2af P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:55.894716 14907 raft_consensus.cc:1275] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 1 LEARNER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:55.896170 15561 consensus_queue.cc:1048] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:55.900772 14181 raft_consensus.cc:1275] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:55.902534 15645 consensus_queue.cc:1048] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:55.906462 15645 consensus_queue.cc:1048] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:55.924647 15561 raft_consensus.cc:2955] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:55.928635 14182 raft_consensus.cc:2955] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:55.945792 14907 raft_consensus.cc:2955] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:55.948518 14258 raft_consensus.cc:2955] T 0d203245740a4821b7ebcc7669c8b2af P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:55.948928 14085 catalog_manager.cc:5697] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c reported cstate change: config changed from index 2 to 3, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:55.964167 14339 consensus_queue.cc:237] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:09:55.987263 14908 raft_consensus.cc:1275] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:55.992448 14187 raft_consensus.cc:1275] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:55.994608 15494 consensus_queue.cc:1048] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:55.999469 15494 consensus_queue.cc:1048] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:56.003238 15561 raft_consensus.cc:2955] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:56.013163 15673 raft_consensus.cc:1064] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf: attempting to promote NON_VOTER 73d01e9b1a9d49358da4985b21d681db to VOTER
I20260709 12:09:56.013375 14187 raft_consensus.cc:2955] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:56.021317 14908 raft_consensus.cc:2955] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:56.021232 14074 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0d203245740a4821b7ebcc7669c8b2af with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:56.040371 14085 catalog_manager.cc:5697] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c reported cstate change: config changed from index 3 to 4, VOTER 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130) evicted. New cstate: current_term: 1 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:56.016973 15673 consensus_queue.cc:237] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:09:56.056785 14246 tablet_service.cc:1558] Processing DeleteTablet for tablet 0d203245740a4821b7ebcc7669c8b2af with delete_type TABLET_DATA_TOMBSTONED (TS 17aab1bbf5014936aa18cc21818b26ec not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:51304
I20260709 12:09:56.062045 14910 raft_consensus.cc:3060] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 1 LEARNER]: Advancing to term 2
I20260709 12:09:56.062393 15680 tablet_replica.cc:333] T 0d203245740a4821b7ebcc7669c8b2af P 17aab1bbf5014936aa18cc21818b26ec: stopping tablet replica
I20260709 12:09:56.063899 15680 raft_consensus.cc:2243] T 0d203245740a4821b7ebcc7669c8b2af P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:56.064705 15680 raft_consensus.cc:2272] T 0d203245740a4821b7ebcc7669c8b2af P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:56.072542 15680 ts_tablet_manager.cc:1916] T 0d203245740a4821b7ebcc7669c8b2af P 17aab1bbf5014936aa18cc21818b26ec: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:56.081419 14910 raft_consensus.cc:1275] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 2 LEARNER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:09:56.085196 15639 consensus_queue.cc:1048] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:56.090960 14333 raft_consensus.cc:1275] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:56.092864 15674 consensus_queue.cc:1048] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:56.108286 14908 raft_consensus.cc:1275] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [term 1 LEARNER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:56.111141 14259 raft_consensus.cc:1275] T 3c9d740fa53e42179ad8d244b4c179fd P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:56.110878 15597 consensus_queue.cc:1048] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:56.119771 15680 ts_tablet_manager.cc:1929] T 0d203245740a4821b7ebcc7669c8b2af P 17aab1bbf5014936aa18cc21818b26ec: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:56.120409 15680 log.cc:1199] T 0d203245740a4821b7ebcc7669c8b2af P 17aab1bbf5014936aa18cc21818b26ec: Deleting WAL directory at /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598886212958-12986-0/minicluster-data/ts-1-root/wals/0d203245740a4821b7ebcc7669c8b2af
I20260709 12:09:56.124761 15597 consensus_queue.cc:1048] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:09:56.125866 14074 catalog_manager.cc:5028] TS 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): tablet 0d203245740a4821b7ebcc7669c8b2af (table test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]) successfully deleted
I20260709 12:09:56.155943 15674 raft_consensus.cc:2955] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:56.163416 14333 raft_consensus.cc:2955] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:56.185421 14259 raft_consensus.cc:2955] T 3c9d740fa53e42179ad8d244b4c179fd P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:56.196024 14912 raft_consensus.cc:2955] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:56.208222 14332 raft_consensus.cc:1275] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:09:56.210326 14182 raft_consensus.cc:1275] T f4739bc22bfe44fcba807da02d9351b6 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:09:56.210934 15639 consensus_queue.cc:1048] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:56.212531 15600 consensus_queue.cc:1048] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:56.212587 14085 catalog_manager.cc:5697] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf reported cstate change: config changed from index 2 to 3, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "885067a0d31741bfb5c9935788e315bf" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:56.257392 14185 raft_consensus.cc:1275] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:09:56.259369 15634 consensus_queue.cc:1048] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:09:56.273705 15650 raft_consensus.cc:1064] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec: attempting to promote NON_VOTER 73d01e9b1a9d49358da4985b21d681db to VOTER
I20260709 12:09:56.289036 15649 raft_consensus.cc:1064] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec: attempting to promote NON_VOTER 73d01e9b1a9d49358da4985b21d681db to VOTER
W20260709 12:09:56.289597 15649 raft_consensus.cc:1068] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec: Unable to promote non-voter 73d01e9b1a9d49358da4985b21d681db: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:09:56.300598 14181 consensus_queue.cc:237] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:09:56.291031 15650 consensus_queue.cc:237] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 2, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:09:56.326908 14910 raft_consensus.cc:1275] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:56.328936 15597 consensus_queue.cc:1048] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:56.341449 15597 raft_consensus.cc:2955] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:56.346705 14912 raft_consensus.cc:2955] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:56.347978 14908 raft_consensus.cc:1275] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:09:56.349665 15646 consensus_queue.cc:1048] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:09:56.372054 14336 raft_consensus.cc:1275] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:56.372164 14073 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3c9d740fa53e42179ad8d244b4c179fd with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:56.394572 14085 catalog_manager.cc:5697] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf reported cstate change: config changed from index 3 to 4, VOTER 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130) evicted. New cstate: current_term: 1 leader_uuid: "885067a0d31741bfb5c9935788e315bf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:56.458449 14339 raft_consensus.cc:1275] T bf9bea0d16e44efabb5cdd53e3828438 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:09:56.462965 14910 raft_consensus.cc:1275] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [term 4 LEARNER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:09:56.481807 14185 raft_consensus.cc:1275] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:09:56.488504 15673 consensus_queue.cc:1048] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:56.510623 14333 raft_consensus.cc:2955] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:56.520771 15650 raft_consensus.cc:1064] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec: attempting to promote NON_VOTER 73d01e9b1a9d49358da4985b21d681db to VOTER
I20260709 12:09:56.521451 15639 consensus_queue.cc:1048] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:09:56.524061 15650 consensus_queue.cc:237] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 2, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:09:56.526737 15640 consensus_queue.cc:1048] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:09:56.555833 14339 raft_consensus.cc:1275] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:09:56.557997 14910 raft_consensus.cc:1275] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 2 LEARNER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:09:56.558180 15639 consensus_queue.cc:1048] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:56.586315 15600 consensus_queue.cc:1048] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:56.596081 15639 consensus_queue.cc:1048] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:56.598917 15600 raft_consensus.cc:2955] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:56.619377 14184 raft_consensus.cc:1275] T f4739bc22bfe44fcba807da02d9351b6 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:09:56.621179 14339 raft_consensus.cc:2955] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:56.630846 15650 consensus_queue.cc:1048] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:56.601190 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:56.635109 14910 raft_consensus.cc:2955] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:56.635087 15650 raft_consensus.cc:2955] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 4 LEADER]: Committing config change with OpId 4.5: config changed from index 4 to 5, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
W20260709 12:09:57.439568 14155 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.008s	sys 0.002s
W20260709 12:09:57.439978 14155 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.576s	user 0.008s	sys 0.002s
W20260709 12:09:57.446341 14156 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.635s	user 0.000s	sys 0.013s
W20260709 12:09:57.446897 14156 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.636s	user 0.000s	sys 0.013s
W20260709 12:09:57.481031 14154 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.718s	user 0.005s	sys 0.000s
W20260709 12:09:57.481616 14154 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.718s	user 0.005s	sys 0.000s
W20260709 12:09:57.640352 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 990942us
W20260709 12:09:58.112284 14154 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.628s	user 0.003s	sys 0.000s
W20260709 12:09:57.701962 14211 debug-util.cc:398] Leaking SignalData structure 0x7b08000e9620 after lost signal to thread 12989
W20260709 12:09:58.141688 14154 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.658s	user 0.004s	sys 0.000s
W20260709 12:09:58.143478 14211 debug-util.cc:398] Leaking SignalData structure 0x7b08000849a0 after lost signal to thread 14122
I20260709 12:09:58.026947 15494 raft_consensus.cc:493] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:09:57.950307 15580 raft_consensus.cc:493] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:09:58.061439 15646 raft_consensus.cc:493] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:09:57.996821 15710 raft_consensus.cc:493] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:09:58.334888 15710 raft_consensus.cc:515] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:09:57.860893 15709 raft_consensus.cc:493] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:09:58.003520 15711 raft_consensus.cc:493] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:09:58.338722 15711 raft_consensus.cc:515] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:58.051225 15712 raft_consensus.cc:493] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:09:58.342756 15712 raft_consensus.cc:515] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:58.058475 15713 raft_consensus.cc:493] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:09:58.346889 15713 raft_consensus.cc:515] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:09:58.065239 15714 raft_consensus.cc:493] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:09:58.057953 15715 raft_consensus.cc:493] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:09:58.057226 15716 raft_consensus.cc:493] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:09:58.063809 15718 raft_consensus.cc:493] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:09:58.062870 15717 raft_consensus.cc:493] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:09:58.368089 15712 leader_election.cc:290] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:58.028628 15706 raft_consensus.cc:493] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:09:58.262267 15673 raft_consensus.cc:493] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:09:58.264312 15649 raft_consensus.cc:493] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:09:58.308743 15674 raft_consensus.cc:493] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:09:58.370517 15646 raft_consensus.cc:515] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:58.377985 15674 raft_consensus.cc:515] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:58.312698 15645 raft_consensus.cc:493] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:09:58.370527 15710 leader_election.cc:290] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:58.329993 15701 raft_consensus.cc:493] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:09:58.331626 15708 raft_consensus.cc:493] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:09:58.319775 15494 raft_consensus.cc:515] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:58.320078 15580 raft_consensus.cc:515] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:58.356978 15713 leader_election.cc:290] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:58.358314 15709 raft_consensus.cc:515] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:58.323005 15722 raft_consensus.cc:493] T f4739bc22bfe44fcba807da02d9351b6 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:09:58.368997 15712 raft_consensus.cc:493] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:09:58.368477 15717 raft_consensus.cc:515] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:09:58.370254 15600 raft_consensus.cc:493] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:09:58.360378 15714 raft_consensus.cc:515] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:09:58.361003 15716 raft_consensus.cc:515] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:09:58.326313 15719 raft_consensus.cc:493] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:09:58.368309 15718 raft_consensus.cc:515] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:09:58.380484 15673 raft_consensus.cc:515] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:58.383867 15713 raft_consensus.cc:493] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:09:58.384073 15649 raft_consensus.cc:515] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:58.378435 15706 raft_consensus.cc:515] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:09:58.384770 15591 raft_consensus.cc:493] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:09:58.388973 15721 raft_consensus.cc:493] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:09:58.389930 15674 leader_election.cc:290] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:58.390483 15715 raft_consensus.cc:515] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:58.393280 15713 raft_consensus.cc:515] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:09:58.393679 15722 raft_consensus.cc:515] T f4739bc22bfe44fcba807da02d9351b6 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } }
I20260709 12:09:58.395572 15580 leader_election.cc:290] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:58.380576 15645 raft_consensus.cc:515] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:58.395952 15701 raft_consensus.cc:515] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:09:58.404992 15494 leader_election.cc:290] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:58.405349 15649 leader_election.cc:290] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:58.406186 15712 raft_consensus.cc:515] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:58.408085 15600 raft_consensus.cc:515] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:58.408679 15713 leader_election.cc:290] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:58.405349 15715 leader_election.cc:290] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:58.408102 15711 leader_election.cc:290] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:58.410981 15712 leader_election.cc:290] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:58.412268 15598 raft_consensus.cc:493] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:09:58.406327 15494 raft_consensus.cc:493] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:09:58.418712 15645 leader_election.cc:290] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:58.403213 15709 leader_election.cc:290] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:58.411005 15600 leader_election.cc:290] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:58.412602 15646 leader_election.cc:290] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:58.406802 15674 raft_consensus.cc:493] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:09:58.400892 15708 raft_consensus.cc:515] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:58.433521 15714 leader_election.cc:290] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:58.433653 15708 leader_election.cc:290] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:58.419855 15591 raft_consensus.cc:515] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:58.415208 15719 raft_consensus.cc:515] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:09:58.415694 15580 raft_consensus.cc:493] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:09:58.435102 15598 raft_consensus.cc:515] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:09:58.429718 15709 raft_consensus.cc:493] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:09:58.453402 15717 leader_election.cc:290] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:58.454802 15701 leader_election.cc:290] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:09:58.455861 15709 raft_consensus.cc:515] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:58.449687 15580 raft_consensus.cc:515] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:09:58.459998 15494 raft_consensus.cc:515] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:09:58.477258 15598 leader_election.cc:290] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:58.442237 15721 raft_consensus.cc:515] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:58.467015 15722 leader_election.cc:290] T f4739bc22bfe44fcba807da02d9351b6 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:58.510493 15580 leader_election.cc:290] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:09:58.511168 14336 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.878s	user 0.010s	sys 0.026s
I20260709 12:09:58.511360 15719 leader_election.cc:290] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:09:58.512538 15591 leader_election.cc:290] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:58.514052 15709 leader_election.cc:290] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:58.514945 15706 leader_election.cc:290] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:09:58.490592 15705 raft_consensus.cc:493] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:09:58.465173 15716 leader_election.cc:290] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:58.467092 15673 leader_election.cc:290] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:09:58.531031 14336 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.899s	user 0.010s	sys 0.026s
I20260709 12:09:58.532773 14336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50856 (request call id 1357) took 1986 ms. Trace:
I20260709 12:09:58.534242 15640 raft_consensus.cc:493] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:09:58.533205 14336 rpcz_store.cc:276] 0709 12:09:56.546518 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:56.546684 (+   166us) service_pool.cc:224] Handling call
0709 12:09:56.630744 (+ 84060us) spinlock_profiling.cc:243] Waited 1.22 ms on lock 0x7b5800065d98. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2124016b71 00007f2124016eee 000000000036eb39 00007f212c08a1e0 00007f212c1530c4 00007f212c153131 00007f212c114fc0 00007f212c0ff929 00007f212c0ff3d2 00007f2125676bd4
0709 12:09:56.630918 (+   174us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:09:56.631347 (+   429us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:09:56.631373 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:09:56.632300 (+   927us) log.cc:844] Serialized 572 byte log entry
0709 12:09:58.531937 (+1899637us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:09:58.532148 (+   211us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:58.532307 (+   159us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:09:58.532387 (+    80us) raft_consensus.cc:1685] finished
0709 12:09:58.532397 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:58.532651 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2845312,"thread_start_us":1899019,"threads_started":1,"wal-append.queue_time_us":44737,"wal-append.run_cpu_time_us":1968,"wal-append.run_wall_time_us":1002320}
I20260709 12:09:58.519292 15725 raft_consensus.cc:493] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:09:58.516875 15649 raft_consensus.cc:493] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:09:58.525134 15705 raft_consensus.cc:515] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:58.535349 15640 raft_consensus.cc:515] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:58.511265 15639 raft_consensus.cc:493] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:09:58.522146 15674 raft_consensus.cc:515] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:09:58.544561 15494 leader_election.cc:290] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:09:58.545552 15718 leader_election.cc:290] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:58.540087 15649 raft_consensus.cc:515] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:58.550618 15580 raft_consensus.cc:493] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
W20260709 12:09:58.535852 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 194014us
I20260709 12:09:58.541656 15600 raft_consensus.cc:493] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:09:58.556167 15721 leader_election.cc:290] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:58.553264 15580 raft_consensus.cc:515] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:09:58.556526 15674 leader_election.cc:290] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:09:58.557186 15600 raft_consensus.cc:515] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:09:58.557540 15728 raft_consensus.cc:493] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:09:58.561583 15716 raft_consensus.cc:493] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:09:58.562636 15716 raft_consensus.cc:515] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:09:58.565436 15716 leader_election.cc:290] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:58.567617 15705 leader_election.cc:290] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:58.568145 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:09:58.548218 15639 raft_consensus.cc:515] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:09:58.558054 15718 raft_consensus.cc:493] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:09:58.572393 15580 leader_election.cc:290] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:09:58.572641 15718 raft_consensus.cc:515] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:09:58.559108 15728 raft_consensus.cc:515] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:58.577083 15719 raft_consensus.cc:493] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:09:58.583775 15600 leader_election.cc:290] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:09:58.584345 15701 raft_consensus.cc:493] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:09:58.583575 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:09:58.578650 15719 raft_consensus.cc:515] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:09:58.569336 15674 raft_consensus.cc:493] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:09:58.587792 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:09:58.587832 14907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:09:58.585197 15701 raft_consensus.cc:515] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:09:58.577703 15721 raft_consensus.cc:493] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:09:58.598368 15597 raft_consensus.cc:493] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:09:58.598712 15721 raft_consensus.cc:515] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:58.599184 15597 raft_consensus.cc:515] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:09:58.601300 15674 raft_consensus.cc:515] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } }
I20260709 12:09:58.602144 14907 raft_consensus.cc:2468] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 1.
I20260709 12:09:58.603924 15721 leader_election.cc:290] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:58.606056 15649 leader_election.cc:290] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:58.601538 15597 leader_election.cc:290] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:09:58.608487 15639 leader_election.cc:290] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:09:58.610471 14189 raft_consensus.cc:2955] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:58.612694 15719 leader_election.cc:290] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:09:58.575464 15729 raft_consensus.cc:493] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:09:58.620354 15715 raft_consensus.cc:493] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:09:58.621299 15715 raft_consensus.cc:515] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:58.623878 15715 leader_election.cc:290] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:58.627108 15715 raft_consensus.cc:493] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:09:58.631147 15701 leader_election.cc:290] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:09:58.631577 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:58.632679 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:58.604171 15674 leader_election.cc:290] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:58.560089 15725 raft_consensus.cc:515] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:58.664242 15640 leader_election.cc:290] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:58.651131 15730 raft_consensus.cc:493] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:09:58.679335 15736 raft_consensus.cc:493] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:09:58.679917 14183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56046 (request call id 1490) took 2081 ms. Trace:
I20260709 12:09:58.663792 15715 raft_consensus.cc:515] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:58.683403 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:58.685019 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:58.676630 15728 leader_election.cc:290] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:58.680389 14183 rpcz_store.cc:276] 0709 12:09:56.598453 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:58.678640 (+2080187us) service_pool.cc:224] Handling call
0709 12:09:58.679101 (+   461us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:58.679353 (+   252us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:09:58.679377 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:09:58.679454 (+    77us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:09:58.679517 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:58.679575 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:58.679710 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:58.687487 15717 raft_consensus.cc:493] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:09:58.690408 15734 raft_consensus.cc:493] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:09:58.670694 15718 leader_election.cc:290] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:58.691136 15734 raft_consensus.cc:515] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:09:58.692901 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:09:58.691725 15598 raft_consensus.cc:493] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:09:58.696511 15598 raft_consensus.cc:515] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:09:58.685725 14188 raft_consensus.cc:2468] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 1.
I20260709 12:09:58.693696 14910 raft_consensus.cc:2468] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 2.
I20260709 12:09:58.702859 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:58.703811 14190 raft_consensus.cc:2468] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 1.
I20260709 12:09:58.685051 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:58.683439 15715 leader_election.cc:290] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:58.704936 14908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:09:58.709131 15738 raft_consensus.cc:493] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:09:58.691039 15717 raft_consensus.cc:515] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:09:58.689385 15733 raft_consensus.cc:493] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:09:58.680317 15736 raft_consensus.cc:515] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:09:58.711498 14211 debug-util.cc:398] Leaking SignalData structure 0x7b0800169340 after lost signal to thread 14214
I20260709 12:09:58.709689 15650 raft_consensus.cc:493] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:09:58.713868 14908 raft_consensus.cc:2468] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 1.
I20260709 12:09:58.722568 15739 raft_consensus.cc:493] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:09:58.715072 14910 raft_consensus.cc:2955] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:58.721035 15650 raft_consensus.cc:515] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:58.723078 14086 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60420 (request call id 250) took 2184 ms. Trace:
I20260709 12:09:58.732118 15650 leader_election.cc:290] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:09:58.729264 14211 debug-util.cc:398] Leaking SignalData structure 0x7b0800305700 after lost signal to thread 14215
I20260709 12:09:58.726347 14086 rpcz_store.cc:276] 0709 12:09:56.538299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:56.538464 (+   165us) service_pool.cc:224] Handling call
0709 12:09:58.722750 (+2184286us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":108611,"reported_tablets":1}
I20260709 12:09:58.737635 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:58.698233 14181 raft_consensus.cc:2955] T f4739bc22bfe44fcba807da02d9351b6 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:58.710222 15735 raft_consensus.cc:493] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:09:58.748143 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:58.748736 14190 raft_consensus.cc:2468] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 4.
I20260709 12:09:58.717720 15730 raft_consensus.cc:515] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:58.732096 15725 leader_election.cc:290] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:58.755539 15723 raft_consensus.cc:493] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:09:58.756140 14085 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60410 (request call id 250) took 2367 ms. Trace:
I20260709 12:09:58.750439 15731 raft_consensus.cc:493] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:09:58.751618 14259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41768 (request call id 1124) took 2117 ms. Trace:
I20260709 12:09:58.751520 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:58.754145 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:58.758491 14246 tablet_service.cc:1558] Processing DeleteTablet for tablet 3c9d740fa53e42179ad8d244b4c179fd with delete_type TABLET_DATA_TOMBSTONED (TS 17aab1bbf5014936aa18cc21818b26ec not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:51304
I20260709 12:09:58.675125 15729 raft_consensus.cc:515] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:58.759800 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:58.757419 14259 rpcz_store.cc:276] 0709 12:09:58.480758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:58.750412 (+269654us) service_pool.cc:224] Handling call
0709 12:09:58.750840 (+   428us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:09:58.751126 (+   286us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:09:58.751157 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:09:58.751221 (+    64us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:09:58.751253 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:09:58.751311 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:09:58.751420 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:09:58.732381 15738 raft_consensus.cc:515] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:58.744946 15715 raft_consensus.cc:493] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:09:58.723610 15739 raft_consensus.cc:515] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:58.765774 15561 raft_consensus.cc:493] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:09:58.762243 14183 raft_consensus.cc:2468] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 2.
I20260709 12:09:58.745707 15732 raft_consensus.cc:493] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:09:58.750289 15726 raft_consensus.cc:493] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:09:58.771808 15734 leader_election.cc:290] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:58.765964 14907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:09:58.772948 14876 leader_election.cc:304] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:09:58.772495 14908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:09:58.774811 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:09:58.776538 15740 raft_consensus.cc:493] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:09:58.775043 15640 raft_consensus.cc:493] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:09:58.778137 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:58.786298 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:58.754267 15701 raft_consensus.cc:493] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:09:58.788677 15741 raft_consensus.cc:493] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:09:58.793095 15746 raft_consensus.cc:493] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:09:58.756377 15723 raft_consensus.cc:515] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:09:58.803846 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 91182.9us
I20260709 12:09:58.777525 15640 raft_consensus.cc:515] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:58.801941 15715 raft_consensus.cc:515] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:09:58.756587 14085 rpcz_store.cc:276] 0709 12:09:56.389009 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:56.389164 (+   155us) service_pool.cc:224] Handling call
0709 12:09:58.755935 (+2366771us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:09:56.398188 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:09:56.398915 (+   727us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:09:56.398946 (+    31us) write_op.cc:435] Acquired schema lock
0709 12:09:56.398963 (+    17us) tablet.cc:662] Decoding operations
0709 12:09:56.448819 (+ 49856us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:09:56.449083 (+   264us) write_op.cc:641] Partition lock acquired for write op
0709 12:09:56.449216 (+   133us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:09:56.450042 (+   826us) tablet.cc:701] Row locks acquired
0709 12:09:56.450150 (+   108us) write_op.cc:260] PREPARE: finished
0709 12:09:56.450693 (+   543us) write_op.cc:270] Start()
0709 12:09:56.451280 (+   587us) write_op.cc:276] Timestamp: P: 1783598996450553 usec, L: 0
0709 12:09:56.451332 (+    52us) op_driver.cc:348] REPLICATION: starting
0709 12:09:56.455688 (+  4356us) log.cc:844] Serialized 539 byte log entry
0709 12:09:56.465042 (+  9354us) spinlock_profiling.cc:243] Waited 3.31 ms on lock 0x7b18001611a0. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f212cf16ab1 00007f212cf23281 00007f212ab7241d 00007f212ab7471a 00007f212ab746a8 00007f212ab74628 00007f212ab745e3 00007f212ab737fc 00007f212cfa62f6 00007f212cfa0aa8 00007f2127147310
0709 12:09:56.465092 (+    50us) op_driver.cc:464] REPLICATION: finished
0709 12:09:56.469964 (+  4872us) write_op.cc:301] APPLY: starting
0709 12:09:56.470054 (+    90us) tablet.cc:1367] starting BulkCheckPresence
0709 12:09:56.470158 (+   104us) tablet.cc:1370] finished BulkCheckPresence
0709 12:09:56.470178 (+    20us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:09:56.470425 (+   247us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:09:56.470574 (+   149us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:09:56.470619 (+    45us) write_op.cc:312] APPLY: finished
0709 12:09:56.470814 (+   195us) log.cc:844] Serialized 23 byte log entry
0709 12:09:56.470994 (+   180us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:09:56.471076 (+    82us) write_op.cc:454] Released schema lock
0709 12:09:56.471115 (+    39us) write_op.cc:341] FINISH: Updating metrics
0709 12:09:56.541372 (+ 70257us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:09:56.541424 (+    52us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":30771,"reported_tablets":2,"spinlock_wait_cycles":675712,"child_traces":[["op",{"apply.queue_time_us":4608,"apply.run_cpu_time_us":1453,"apply.run_wall_time_us":1454,"num_ops":1,"prepare.queue_time_us":116,"prepare.run_cpu_time_us":21323,"prepare.run_wall_time_us":143096,"replication_time_us":8155,"spinlock_wait_cycles":8293120}]]}
I20260709 12:09:58.814419 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:58.822908 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:58.813869 15734 raft_consensus.cc:2804] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:58.822193 14154 leader_election.cc:304] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:09:58.811762 15736 leader_election.cc:290] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:58.816118 15743 raft_consensus.cc:493] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:09:58.816224 15701 raft_consensus.cc:515] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:58.800324 15731 raft_consensus.cc:515] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:09:58.832214 15742 raft_consensus.cc:493] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:09:58.778481 15735 raft_consensus.cc:515] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:58.777393 15740 raft_consensus.cc:515] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:09:58.833958 14154 leader_election.cc:304] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:09:58.820052 15639 raft_consensus.cc:493] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:09:58.789590 15741 raft_consensus.cc:515] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:09:58.818244 15650 raft_consensus.cc:493] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:09:58.821638 15600 raft_consensus.cc:493] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:09:58.824932 15734 raft_consensus.cc:493] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:09:58.840392 14183 raft_consensus.cc:2468] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 1.
I20260709 12:09:58.810119 15561 raft_consensus.cc:515] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:09:58.842466 15737 log.cc:927] Time spent T f4739bc22bfe44fcba807da02d9351b6 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
I20260709 12:09:58.836555 15728 raft_consensus.cc:2804] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:58.814997 15726 raft_consensus.cc:515] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:58.838917 15725 raft_consensus.cc:2804] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:58.855062 15715 leader_election.cc:290] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:09:58.773304 15733 raft_consensus.cc:515] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:58.853991 15600 raft_consensus.cc:515] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:58.813159 15732 raft_consensus.cc:515] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:58.843662 15734 raft_consensus.cc:3060] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:58.828071 15746 raft_consensus.cc:515] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:58.876096 15738 leader_election.cc:290] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:58.877429 15739 leader_election.cc:290] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:58.864509 15725 raft_consensus.cc:493] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:09:58.840242 15598 leader_election.cc:290] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:58.859752 15728 raft_consensus.cc:493] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:09:58.863544 15640 leader_election.cc:290] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:58.846486 15742 raft_consensus.cc:515] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:09:58.908155 14907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:09:58.864087 15639 raft_consensus.cc:515] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:09:58.919294 15745 tablet_replica.cc:333] T 3c9d740fa53e42179ad8d244b4c179fd P 17aab1bbf5014936aa18cc21818b26ec: stopping tablet replica
I20260709 12:09:58.919947 14907 raft_consensus.cc:2468] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 1.
I20260709 12:09:58.921125 15745 raft_consensus.cc:2243] T 3c9d740fa53e42179ad8d244b4c179fd P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:58.921880 15702 raft_consensus.cc:493] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:09:58.922046 15715 raft_consensus.cc:493] T bf9bea0d16e44efabb5cdd53e3828438 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:09:58.897135 15725 raft_consensus.cc:3060] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:58.922854 15715 raft_consensus.cc:515] T bf9bea0d16e44efabb5cdd53e3828438 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:09:58.907200 15728 raft_consensus.cc:3060] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:58.884039 15747 raft_consensus.cc:493] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:09:58.939637 15733 leader_election.cc:290] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:58.936889 14876 leader_election.cc:304] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:09:58.944865 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:58.924285 15640 raft_consensus.cc:493] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:09:58.957103 15744 raft_consensus.cc:493] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
W20260709 12:09:58.957542 14211 debug-util.cc:398] Leaking SignalData structure 0x7b08001f3580 after lost signal to thread 14289
I20260709 12:09:58.928608 15723 leader_election.cc:290] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:58.959955 15733 raft_consensus.cc:493] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:09:58.960541 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:58.961217 15639 leader_election.cc:290] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:09:58.961983 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:58.909344 15650 raft_consensus.cc:515] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:09:58.952258 15714 raft_consensus.cc:2804] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:58.949838 15729 leader_election.cc:290] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:09:58.963385 14211 debug-util.cc:398] Leaking SignalData structure 0x7b0800322300 after lost signal to thread 14290
I20260709 12:09:58.922752 15702 raft_consensus.cc:515] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:58.973997 15714 raft_consensus.cc:493] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:09:58.979380 15714 raft_consensus.cc:3060] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:58.979620 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:58.896783 15743 raft_consensus.cc:515] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:09:58.955147 15730 leader_election.cc:290] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:58.984477 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:09:59.007897 15639 raft_consensus.cc:670] T 3c9d740fa53e42179ad8d244b4c179fd P 17aab1bbf5014936aa18cc21818b26ec: failed to trigger leader election: Illegal state: RaftConsensus is not running: State = Stopping
I20260709 12:09:58.999713 15735 leader_election.cc:290] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:58.980542 15674 raft_consensus.cc:493] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:09:58.992332 15494 raft_consensus.cc:493] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:09:58.998608 15749 raft_consensus.cc:493] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:09:58.997912 15748 raft_consensus.cc:493] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:09:59.006954 14183 raft_consensus.cc:2468] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 2.
I20260709 12:09:58.969715 15721 raft_consensus.cc:493] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:09:59.017032 14303 leader_election.cc:304] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:09:59.023159 15494 raft_consensus.cc:515] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:59.027559 14303 leader_election.cc:304] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:09:58.979851 15747 raft_consensus.cc:515] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:59.021869 15600 leader_election.cc:290] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:59.021694 15736 raft_consensus.cc:493] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:09:59.016098 15640 raft_consensus.cc:515] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:09:59.049445 15494 leader_election.cc:290] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:59.002245 15744 raft_consensus.cc:515] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:09:59.043495 14211 debug-util.cc:398] Leaking SignalData structure 0x7b0800290e00 after lost signal to thread 14363
I20260709 12:09:59.030037 15712 raft_consensus.cc:2804] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:59.040148 15701 leader_election.cc:290] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:59.055953 14303 leader_election.cc:304] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:09:59.049582 15745 raft_consensus.cc:2272] T 3c9d740fa53e42179ad8d244b4c179fd P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:59.064139 15494 raft_consensus.cc:493] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:09:59.030107 15649 raft_consensus.cc:493] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:09:59.066259 14258 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95"
dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
mode: GRACEFUL
new_leader_uuid: "73d01e9b1a9d49358da4985b21d681db"
 from {username='slave'} at 127.0.0.1:42676
I20260709 12:09:59.064600 14303 leader_election.cc:304] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:09:59.068107 15561 leader_election.cc:290] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:59.024871 15733 raft_consensus.cc:515] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:59.051368 15752 raft_consensus.cc:493] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:09:59.061295 15742 leader_election.cc:290] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:09:59.078395 15746 leader_election.cc:290] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:59.062618 15712 raft_consensus.cc:493] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:09:59.078806 15726 leader_election.cc:290] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:59.045089 15674 raft_consensus.cc:515] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:59.048959 15711 raft_consensus.cc:493] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:09:59.071473 14258 raft_consensus.cc:606] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 1 LEADER]: Received request to transfer leadership to TS 73d01e9b1a9d49358da4985b21d681db
W20260709 12:09:59.055629 14211 debug-util.cc:398] Leaking SignalData structure 0x7b08002afe00 after lost signal to thread 14364
I20260709 12:09:59.079247 15754 raft_consensus.cc:493] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:09:59.085979 15751 raft_consensus.cc:493] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:09:59.051815 15600 raft_consensus.cc:493] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:09:59.080670 15748 raft_consensus.cc:515] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:09:59.078452 15702 leader_election.cc:290] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:59.044329 15731 leader_election.cc:290] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:09:59.111752 15494 raft_consensus.cc:515] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:59.074602 15645 raft_consensus.cc:2804] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:09:59.139816 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 75304.7us
I20260709 12:09:59.054296 15639 raft_consensus.cc:493] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:09:59.052831 15749 raft_consensus.cc:515] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:09:59.064533 15735 raft_consensus.cc:2804] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:09:59.053032 15721 raft_consensus.cc:515] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:59.132272 15712 raft_consensus.cc:3060] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:59.088858 15752 raft_consensus.cc:515] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:09:59.073684 15736 raft_consensus.cc:515] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:59.133522 15758 raft_consensus.cc:493] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:09:59.175277 15758 raft_consensus.cc:515] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } }
I20260709 12:09:59.143828 15649 raft_consensus.cc:515] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:59.177845 15758 leader_election.cc:290] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187)
I20260709 12:09:59.179365 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:59.180759 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:59.181376 14339 raft_consensus.cc:2468] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 2.
W20260709 12:09:59.182431 14211 debug-util.cc:398] Leaking SignalData structure 0x7b0800308b60 after lost signal to thread 14936
W20260709 12:09:59.182834 14211 debug-util.cc:398] Leaking SignalData structure 0x7b080033a9a0 after lost signal to thread 14937
I20260709 12:09:59.183634 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:59.184616 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:59.184924 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:59.159224 15645 raft_consensus.cc:493] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:09:59.186156 15645 raft_consensus.cc:3060] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:59.161680 15711 raft_consensus.cc:515] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:09:59.164252 15600 raft_consensus.cc:515] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:59.165335 15494 leader_election.cc:290] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:59.169529 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:59.170832 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:59.171825 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:59.153237 15754 raft_consensus.cc:515] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:59.172776 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:59.172921 15735 raft_consensus.cc:493] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:09:59.152280 15726 raft_consensus.cc:2749] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:59.216907 14332 raft_consensus.cc:2468] T bf9bea0d16e44efabb5cdd53e3828438 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 4.
I20260709 12:09:59.171705 15674 leader_election.cc:290] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:59.172654 15650 leader_election.cc:290] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:09:59.227375 14303 leader_election.cc:304] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:09:59.174935 15752 leader_election.cc:290] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:09:59.230979 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:59.246313 14330 raft_consensus.cc:2468] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 1.
I20260709 12:09:59.223600 15735 raft_consensus.cc:3060] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:09:59.234814 15640 leader_election.cc:290] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:09:59.255115 15753 log.cc:927] Time spent T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.236s	user 0.001s	sys 0.000s
I20260709 12:09:59.238178 15711 leader_election.cc:290] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:09:59.234968 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:59.256803 15747 leader_election.cc:290] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:59.236433 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:59.257627 15736 leader_election.cc:290] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:59.257686 14258 raft_consensus.cc:2468] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 1.
I20260709 12:09:59.237279 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:59.259814 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:59.238270 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:59.225728 15639 raft_consensus.cc:515] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:09:59.239275 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:59.241814 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:59.242050 15743 leader_election.cc:290] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:09:59.162441 15751 raft_consensus.cc:515] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:59.264029 14260 raft_consensus.cc:2468] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 1.
I20260709 12:09:59.265045 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:59.264432 14259 raft_consensus.cc:2468] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 1.
I20260709 12:09:59.269011 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:59.270429 14260 raft_consensus.cc:2468] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 1.
I20260709 12:09:59.270953 14265 raft_consensus.cc:2468] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 1.
I20260709 12:09:59.271320 15639 leader_election.cc:290] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:09:59.223075 15715 leader_election.cc:290] T bf9bea0d16e44efabb5cdd53e3828438 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:09:59.274221 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 76403.5us
I20260709 12:09:59.274559 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:59.265872 15740 leader_election.cc:290] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:09:59.270720 15751 leader_election.cc:290] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:59.283846 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:59.284673 14258 raft_consensus.cc:2468] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 1.
I20260709 12:09:59.297250 14877 leader_election.cc:304] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:09:59.229583 15745 ts_tablet_manager.cc:1916] T 3c9d740fa53e42179ad8d244b4c179fd P 17aab1bbf5014936aa18cc21818b26ec: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:59.252561 15733 leader_election.cc:290] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:59.303550 14877 leader_election.cc:304] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:09:59.306257 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:59.309131 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:59.309727 15718 raft_consensus.cc:2749] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:59.310117 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:59.311820 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:59.312446 14189 raft_consensus.cc:2468] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 1.
I20260709 12:09:59.310580 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:59.315702 15741 leader_election.cc:290] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:09:59.318023 15721 leader_election.cc:290] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:59.264000 15726 raft_consensus.cc:2804] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:59.321969 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:59.322423 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:59.323165 14262 raft_consensus.cc:2468] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 1.
I20260709 12:09:59.326296 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:59.320560 15726 raft_consensus.cc:493] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:09:59.327595 15726 raft_consensus.cc:3060] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:59.323674 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:59.330749 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:59.328029 15732 leader_election.cc:290] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:59.331332 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:59.331768 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:59.332432 14334 raft_consensus.cc:2468] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 2.
I20260709 12:09:59.333285 15718 raft_consensus.cc:2749] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:09:59.334227 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:59.263813 15754 leader_election.cc:290] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:59.330503 14258 raft_consensus.cc:2468] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 2.
I20260709 12:09:59.336294 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:59.336227 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:59.339810 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:59.340459 14189 raft_consensus.cc:2468] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 2.
I20260709 12:09:59.269670 15744 leader_election.cc:290] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:59.337927 14182 raft_consensus.cc:2468] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 2.
I20260709 12:09:59.344133 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:59.345229 15728 raft_consensus.cc:515] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:09:59.345822 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:59.346433 14186 raft_consensus.cc:1240] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:59.348263 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:59.354609 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:59.355032 14332 raft_consensus.cc:2410] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for term 3 because replica has last-logged OpId of term: 2 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
I20260709 12:09:59.355966 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:59.349393 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:59.350888 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:59.357172 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:59.349545 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:59.351224 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:59.350217 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:59.349045 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:59.355866 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:59.350172 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:59.347568 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:59.349210 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:59.359423 14181 raft_consensus.cc:2468] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 1.
I20260709 12:09:59.358763 14184 raft_consensus.cc:2468] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 1.
I20260709 12:09:59.358987 14338 raft_consensus.cc:2468] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 1.
I20260709 12:09:59.352329 14229 leader_election.cc:304] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:09:59.362013 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:59.362140 14907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:09:59.362105 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:09:59.363410 14334 raft_consensus.cc:2468] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 1.
I20260709 12:09:59.362807 14335 raft_consensus.cc:2468] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 2.
I20260709 12:09:59.362363 15735 raft_consensus.cc:515] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:59.317471 15725 raft_consensus.cc:515] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:09:59.368288 15725 leader_election.cc:290] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 3 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:09:59.324556 15712 raft_consensus.cc:515] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:59.372815 15712 leader_election.cc:290] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 2 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:59.376130 15645 raft_consensus.cc:515] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:59.377619 14330 raft_consensus.cc:2393] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 3: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:09:59.382841 14088 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44116 (request call id 148) took 2793 ms. Trace:
I20260709 12:09:59.364017 15749 leader_election.cc:290] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:09:59.383234 14088 rpcz_store.cc:276] 0709 12:09:56.589101 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:56.589253 (+   152us) service_pool.cc:224] Handling call
0709 12:09:59.382638 (+2793385us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2017203,"reported_tablets":3}
I20260709 12:09:59.383708 15754 raft_consensus.cc:2804] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:59.385083 15754 raft_consensus.cc:493] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:09:59.385522 15754 raft_consensus.cc:3060] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:59.383705 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:59.389758 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:59.390166 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:09:59.390906 15735 leader_election.cc:290] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:59.391148 15649 leader_election.cc:290] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:59.394340 14087 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60436 (request call id 282) took 2744 ms. Trace:
I20260709 12:09:59.394953 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:59.395548 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:59.395709 14332 raft_consensus.cc:2468] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 2.
I20260709 12:09:59.396471 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:59.396975 15717 leader_election.cc:290] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:59.397876 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:59.398135 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:59.398259 14877 leader_election.cc:304] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:09:59.398769 14335 raft_consensus.cc:2468] T bf9bea0d16e44efabb5cdd53e3828438 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 4.
I20260709 12:09:59.399614 15714 raft_consensus.cc:515] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:09:59.401088 14907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:09:59.405584 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:59.405824 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:59.406106 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:59.406746 14264 raft_consensus.cc:2468] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 2.
I20260709 12:09:59.407121 14334 raft_consensus.cc:1240] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:59.408089 15718 raft_consensus.cc:2804] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:59.408535 15718 raft_consensus.cc:493] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:09:59.407138 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:09:59.410226 14186 raft_consensus.cc:3060] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:59.394807 14087 rpcz_store.cc:276] 0709 12:09:56.649541 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:56.649710 (+   169us) service_pool.cc:224] Handling call
0709 12:09:59.394123 (+2744413us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1745447,"reported_tablets":1}
I20260709 12:09:59.408447 14332 raft_consensus.cc:1240] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 4. Current term is 5. Ops: []
I20260709 12:09:59.408967 15718 raft_consensus.cc:3060] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:59.347530 15728 leader_election.cc:290] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 2 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:09:59.413125 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:59.427033 14334 raft_consensus.cc:2393] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 5: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:09:59.416043 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:59.426910 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:59.427693 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:59.418272 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:59.428737 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:59.429502 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:09:59.430195 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:59.431332 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:59.420181 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:59.420766 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:09:59.433954 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:59.421275 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:59.422084 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:59.422454 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:09:59.423272 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:59.435875 14331 raft_consensus.cc:2468] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 1.
I20260709 12:09:59.394892 15734 raft_consensus.cc:515] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:09:59.437619 14910 raft_consensus.cc:1240] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:59.423764 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:59.424002 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:59.418284 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:59.440071 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:59.413235 14907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:09:59.440336 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:59.403563 15726 raft_consensus.cc:515] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:59.440384 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:59.441552 14330 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d"
dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
mode: GRACEFUL
new_leader_uuid: "17aab1bbf5014936aa18cc21818b26ec"
 from {username='slave'} at 127.0.0.1:50896
I20260709 12:09:59.410327 14877 leader_election.cc:304] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:09:59.431422 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:59.442262 14330 raft_consensus.cc:606] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 3 LEADER]: Received request to transfer leadership to TS 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:09:59.448299 15717 raft_consensus.cc:2749] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:09:59.427380 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:09:59.410274 15645 leader_election.cc:290] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:59.438604 14303 leader_election.cc:304] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:09:59.448549 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:59.470223 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:59.471390 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:59.471742 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:59.473889 15714 leader_election.cc:290] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 2 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:59.457297 14334 raft_consensus.cc:1240] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 2. Current term is 3. Ops: []
I20260709 12:09:59.475539 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:09:59.476233 14910 raft_consensus.cc:2468] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 2.
I20260709 12:09:59.476334 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:59.475577 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:09:59.465256 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 59588.4us
I20260709 12:09:59.479322 14877 leader_election.cc:304] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:09:59.480727 14877 leader_election.cc:304] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:09:59.465690 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:09:59.481928 14189 raft_consensus.cc:2393] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db in current term 2: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:09:59.437477 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:59.469388 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:59.478386 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:59.483814 14265 raft_consensus.cc:2468] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 1.
I20260709 12:09:59.460100 14337 raft_consensus.cc:1240] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 2. Current term is 3. Ops: []
I20260709 12:09:59.484073 14877 leader_election.cc:304] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:09:59.486028 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:59.488466 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:09:59.487844 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 49347.1us
I20260709 12:09:59.492273 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:59.468421 15600 leader_election.cc:290] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:59.494590 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:59.495543 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:09:59.463411 15734 leader_election.cc:290] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 2 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:59.499583 14877 leader_election.cc:304] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:09:59.502163 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:59.453418 15726 leader_election.cc:290] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:59.498349 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:59.487438 15714 raft_consensus.cc:2749] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:09:59.489400 15717 raft_consensus.cc:2804] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:59.490233 15735 raft_consensus.cc:2804] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:59.517946 15735 raft_consensus.cc:493] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:09:59.518405 15735 raft_consensus.cc:3060] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:59.518733 15717 raft_consensus.cc:493] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:09:59.519212 15717 raft_consensus.cc:3060] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:09:59.492939 15755 log.cc:927] Time spent T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.426s	user 0.002s	sys 0.010s
I20260709 12:09:59.500453 14181 raft_consensus.cc:2468] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 4.
I20260709 12:09:59.507572 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:59.508306 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:09:59.501247 15716 raft_consensus.cc:2804] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:59.509171 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:09:59.526883 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:09:59.527622 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:59.509846 15598 raft_consensus.cc:2804] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:59.528496 15598 raft_consensus.cc:493] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:09:59.528976 15598 raft_consensus.cc:3060] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:59.531594 15754 raft_consensus.cc:515] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:09:59.502669 14877 leader_election.cc:304] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:09:59.511503 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:09:59.523484 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:59.549585 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:59.523993 15716 raft_consensus.cc:493] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:09:59.550254 15714 raft_consensus.cc:2749] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:09:59.550436 15716 raft_consensus.cc:3060] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:59.550805 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:59.526041 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:59.532464 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:09:59.532794 14907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:09:59.510430 14155 leader_election.cc:304] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
W20260709 12:09:59.555763 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 45512.4us
I20260709 12:09:59.534111 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:59.529085 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:09:59.539213 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:59.538460 15749 consensus_queue.cc:1059] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:09:59.547999 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 45499.8us
I20260709 12:09:59.548877 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:59.549624 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:59.557814 14877 leader_election.cc:304] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:09:59.559056 15749 raft_consensus.cc:3055] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:59.559396 15749 raft_consensus.cc:740] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:09:59.553813 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:59.559875 15730 raft_consensus.cc:2804] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:59.554180 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:59.563220 15730 raft_consensus.cc:493] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:09:59.563683 15730 raft_consensus.cc:3060] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:59.559988 15714 raft_consensus.cc:2804] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:59.553484 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:59.561966 15748 leader_election.cc:290] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:09:59.562191 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:09:59.566275 14877 leader_election.cc:304] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:09:59.564440 14155 leader_election.cc:304] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:09:59.556500 14186 raft_consensus.cc:2468] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 2.
I20260709 12:09:59.573401 14182 raft_consensus.cc:1240] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:59.573523 14155 leader_election.cc:304] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:09:59.574331 15704 raft_consensus.cc:2749] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:09:59.575065 15704 raft_consensus.cc:2804] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:59.575425 15704 raft_consensus.cc:493] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:09:59.575778 15704 raft_consensus.cc:3060] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:59.576799 14155 leader_election.cc:304] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:09:59.577862 14155 leader_election.cc:304] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:09:59.564301 15714 raft_consensus.cc:493] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:09:59.568478 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:59.570063 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:59.579873 14876 leader_election.cc:304] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:09:59.582005 15734 raft_consensus.cc:2804] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:59.580929 14155 leader_election.cc:304] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:09:59.570508 15754 leader_election.cc:290] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 2 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:09:59.578951 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:09:59.578945 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:59.578805 15597 raft_consensus.cc:2804] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:59.591274 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:09:59.591653 15597 raft_consensus.cc:493] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:09:59.582576 15734 raft_consensus.cc:697] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 2 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:09:59.591998 15756 raft_consensus.cc:2804] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:59.592126 15597 raft_consensus.cc:3060] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:59.592458 15756 raft_consensus.cc:493] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:09:59.592947 15756 raft_consensus.cc:3060] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:59.585394 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:59.586912 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:59.588771 14155 leader_election.cc:304] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:09:59.571274 15749 consensus_queue.cc:260] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:09:59.590888 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:59.595849 14877 leader_election.cc:304] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:09:59.549173 14087 catalog_manager.cc:5697] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: config changed from index 2 to 4, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:59.598050 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:09:59.599345 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:09:59.599787 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:09:59.580006 15714 raft_consensus.cc:3060] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:59.599233 15720 raft_consensus.cc:2804] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:59.582973 15708 raft_consensus.cc:2804] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:59.591256 15674 raft_consensus.cc:2749] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:59.579928 15718 raft_consensus.cc:515] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:09:59.604559 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:59.602648 15720 raft_consensus.cc:493] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:09:59.606336 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:09:59.600167 14087 catalog_manager.cc:5697] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: config changed from index 4 to 5, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New cstate: current_term: 4 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:59.601368 14155 leader_election.cc:304] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:09:59.609084 14188 raft_consensus.cc:3060] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:59.614086 14907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:09:59.615307 14303 leader_election.cc:304] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:09:59.618116 14907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:09:59.621534 15748 raft_consensus.cc:2804] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:59.622041 15748 raft_consensus.cc:493] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:09:59.622411 15748 raft_consensus.cc:3060] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:59.623865 14303 leader_election.cc:304] T bf9bea0d16e44efabb5cdd53e3828438 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:09:59.624845 15726 raft_consensus.cc:2749] T bf9bea0d16e44efabb5cdd53e3828438 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:09:59.627781 14303 leader_election.cc:304] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:09:59.628629 15726 raft_consensus.cc:2804] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:59.629024 15726 raft_consensus.cc:493] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:09:59.629387 15726 raft_consensus.cc:3060] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:59.631160 15748 raft_consensus.cc:515] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:59.635537 15748 leader_election.cc:290] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 2 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:59.636350 15764 raft_consensus.cc:2749] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:09:59.642549 14303 leader_election.cc:304] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:09:59.620105 15756 raft_consensus.cc:515] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:09:59.644786 14264 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca"
dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
mode: GRACEFUL
new_leader_uuid: "885067a0d31741bfb5c9935788e315bf"
 from {username='slave'} at 127.0.0.1:42676
I20260709 12:09:59.647157 15718 leader_election.cc:290] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 2 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:59.647897 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:59.661764 14264 raft_consensus.cc:606] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 2 LEADER]: Received request to transfer leadership to TS 885067a0d31741bfb5c9935788e315bf
I20260709 12:09:59.653898 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:59.662361 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:59.660650 14908 raft_consensus.cc:1240] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 1. Current term is 2. Ops: []
W20260709 12:09:59.656363 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 60586.8us
I20260709 12:09:59.663147 14262 raft_consensus.cc:2468] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 1.
I20260709 12:09:59.659829 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:59.662755 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:59.660917 14155 leader_election.cc:304] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:09:59.604477 15708 raft_consensus.cc:493] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:09:59.655133 14337 raft_consensus.cc:2955] T bf9bea0d16e44efabb5cdd53e3828438 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:09:59.667316 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:59.672134 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:59.670933 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:09:59.642589 15726 raft_consensus.cc:515] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:59.671366 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:59.679050 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:59.679898 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:09:59.644966 15720 raft_consensus.cc:3060] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:59.680264 14303 leader_election.cc:304] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:09:59.675383 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:59.683750 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:59.684032 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:59.679839 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:59.651896 15728 raft_consensus.cc:2804] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:59.710691 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:09:59.710780 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:09:59.592965 15734 consensus_queue.cc:237] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:09:59.718194 14303 leader_election.cc:304] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:09:59.676290 15749 raft_consensus.cc:3060] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:59.718924 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:59.682008 15708 raft_consensus.cc:3060] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:59.722234 14303 leader_election.cc:304] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:09:59.722635 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:59.722721 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:59.687291 15748 raft_consensus.cc:2804] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:59.649497 15716 raft_consensus.cc:515] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:09:59.728078 14154 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 94833.9us
I20260709 12:09:59.713363 15725 raft_consensus.cc:2749] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:09:59.718447 15645 raft_consensus.cc:2749] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:09:59.742862 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:59.743528 14260 raft_consensus.cc:2468] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 1.
I20260709 12:09:59.719628 15728 raft_consensus.cc:493] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:09:59.748770 15730 raft_consensus.cc:515] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:59.728826 15712 raft_consensus.cc:2804] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:59.731763 15723 raft_consensus.cc:2804] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:59.727921 15748 raft_consensus.cc:493] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:09:59.756270 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:09:59.756191 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:09:59.757802 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:09:59.758737 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:59.763667 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:09:59.751839 15728 raft_consensus.cc:3060] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:59.766296 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:59.753090 15712 raft_consensus.cc:493] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:09:59.764539 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:09:59.755524 15723 raft_consensus.cc:493] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:09:59.770197 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:59.795363 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:59.786816 14188 raft_consensus.cc:2468] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 2.
I20260709 12:09:59.779633 14303 leader_election.cc:304] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:09:59.759318 15748 raft_consensus.cc:3060] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:59.803370 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:59.804068 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:09:59.787791 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:09:59.806764 14303 leader_election.cc:304] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:09:59.809819 15494 raft_consensus.cc:2749] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:09:59.815006 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 84529.7us
I20260709 12:09:59.819360 14303 leader_election.cc:304] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:09:59.825205 14304 leader_election.cc:304] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:09:59.825522 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:59.825795 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:59.826849 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:59.827080 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:59.783769 15712 raft_consensus.cc:3060] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:59.830380 15756 leader_election.cc:290] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 2 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:59.775377 15598 raft_consensus.cc:515] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:09:59.770574 15716 leader_election.cc:290] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 2 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:09:59.831902 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 70590.2us
I20260709 12:09:59.832685 15494 raft_consensus.cc:2804] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:59.833036 15598 leader_election.cc:290] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 2 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:59.769677 15597 raft_consensus.cc:515] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:59.834864 15735 raft_consensus.cc:515] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:09:59.791044 15730 leader_election.cc:290] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 3 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:59.770573 15726 leader_election.cc:290] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:59.837205 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:09:59.837903 15751 raft_consensus.cc:2804] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:59.838596 15751 raft_consensus.cc:697] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 2 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:09:59.839747 15751 consensus_queue.cc:237] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:59.840773 15745 ts_tablet_manager.cc:1929] T 3c9d740fa53e42179ad8d244b4c179fd P 17aab1bbf5014936aa18cc21818b26ec: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:59.841405 15745 log.cc:1199] T 3c9d740fa53e42179ad8d244b4c179fd P 17aab1bbf5014936aa18cc21818b26ec: Deleting WAL directory at /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598886212958-12986-0/minicluster-data/ts-1-root/wals/3c9d740fa53e42179ad8d244b4c179fd
I20260709 12:09:59.785270 15723 raft_consensus.cc:3060] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:59.833073 15494 raft_consensus.cc:493] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:09:59.844318 15494 raft_consensus.cc:3060] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:59.833271 14304 leader_election.cc:304] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:09:59.842581 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:59.848371 14877 leader_election.cc:304] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:09:59.832162 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:59.851225 14182 raft_consensus.cc:1240] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:59.854537 14182 raft_consensus.cc:1240] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 2. Current term is 3. Ops: []
I20260709 12:09:59.825263 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:59.837136 15735 leader_election.cc:290] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 2 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:09:59.864363 14304 leader_election.cc:304] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:09:59.811136 15645 raft_consensus.cc:2749] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:59.867120 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:09:59.835417 15597 leader_election.cc:290] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 2 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:09:59.863911 15561 raft_consensus.cc:2804] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:59.870162 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:09:59.873694 14304 leader_election.cc:304] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:09:59.876726 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:09:59.877071 14304 leader_election.cc:304] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:09:59.878940 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:09:59.886626 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:09:59.887173 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:09:59.862212 15716 raft_consensus.cc:2749] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:09:59.823858 15750 consensus_queue.cc:1059] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.061s
I20260709 12:09:59.882438 14230 leader_election.cc:304] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:09:59.869843 15561 raft_consensus.cc:493] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:09:59.869812 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:09:59.895308 14304 leader_election.cc:304] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:09:59.893923 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:09:59.894089 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:09:59.891269 15735 raft_consensus.cc:2749] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:59.885444 15711 raft_consensus.cc:2749] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:59.886262 15715 raft_consensus.cc:2804] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:09:59.924506 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 188590us
I20260709 12:09:59.891456 15745 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51304 (request call id 75) took 1121 ms. Trace:
I20260709 12:09:59.937633 14230 leader_election.cc:304] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:09:59.939390 15712 raft_consensus.cc:515] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:59.927376 15649 raft_consensus.cc:2749] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:59.920070 15561 raft_consensus.cc:3060] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:59.885957 15704 raft_consensus.cc:515] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:59.886448 15728 raft_consensus.cc:515] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:09:59.956517 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:09:59.943058 14909 raft_consensus.cc:1240] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 1. Current term is 2. Ops: []
W20260709 12:09:59.951336 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 238721us
W20260709 12:09:59.946918 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 51677.3us
I20260709 12:09:59.931532 15715 raft_consensus.cc:493] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:09:59.933301 15746 raft_consensus.cc:2804] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:09:59.994760 15776 consensus_queue.cc:1059] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:59.998014 14186 raft_consensus.cc:1240] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 1. Current term is 2. Ops: []
W20260709 12:09:59.996493 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 56664.2us
I20260709 12:09:59.999804 14304 leader_election.cc:304] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:09:59.945642 15649 raft_consensus.cc:2749] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:09:59.971895 15715 raft_consensus.cc:3060] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:59.941699 15712 leader_election.cc:290] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 2 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:09:59.950870 15717 raft_consensus.cc:515] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:10:00.009387 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 100548us
I20260709 12:09:59.972087 15746 raft_consensus.cc:493] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:10:00.012841 15649 raft_consensus.cc:3055] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:00.015863 15750 raft_consensus.cc:2749] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:00.019421 15746 raft_consensus.cc:3060] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:00.051748 14877 leader_election.cc:304] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:00.054889 14877 leader_election.cc:304] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:00.056412 14877 leader_election.cc:304] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:00.032384 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:10:00.065934 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 66219.2us
I20260709 12:10:00.067389 14304 leader_election.cc:304] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:00.047037 14908 raft_consensus.cc:1240] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:00.069412 14304 leader_election.cc:304] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:00.043788 15649 raft_consensus.cc:740] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:09:59.935628 15745 rpcz_store.cc:276] 0709 12:09:58.756479 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:09:58.756702 (+   223us) service_pool.cc:224] Handling call
0709 12:09:58.840801 (+ 84099us) ts_tablet_manager.cc:1151] Deleting tablet 3c9d740fa53e42179ad8d244b4c179fd
0709 12:09:58.860518 (+ 19717us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 12:09:59.454931 (+594413us) tablet_metadata.cc:665] Metadata flushed
0709 12:09:59.840603 (+385672us) tablet_metadata.cc:665] Metadata flushed
0709 12:09:59.877830 (+ 37227us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":69909,"thread_start_us":54058,"threads_started":1}
I20260709 12:10:00.030591 15712 consensus_queue.cc:1059] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 12:10:00.065932 15756 raft_consensus.cc:2749] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:00.065979 15716 raft_consensus.cc:2749] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:00.085083 14230 leader_election.cc:304] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:00.063863 15768 raft_consensus.cc:2749] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:00.076259 15750 raft_consensus.cc:2804] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:00.084141 15739 raft_consensus.cc:2749] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:00.075842 15730 raft_consensus.cc:493] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:00.092114 14304 leader_election.cc:304] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:00.077167 15714 raft_consensus.cc:515] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:00.090113 15750 raft_consensus.cc:493] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:10:00.097803 14304 leader_election.cc:304] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:00.102195 15711 raft_consensus.cc:2749] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:10:00.103124 15771 log.cc:927] Time spent T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:10:00.114678 14304 leader_election.cc:304] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:00.119951 14304 leader_election.cc:304] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:00.124680 15561 raft_consensus.cc:515] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:00.125672 15744 raft_consensus.cc:2749] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:00.135862 14912 raft_consensus.cc:1240] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:00.127480 14304 leader_election.cc:304] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:00.098438 15704 leader_election.cc:290] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 2 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:10:00.139775 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 139974us
I20260709 12:10:00.110200 15784 consensus_queue.cc:1059] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:00.128448 15711 raft_consensus.cc:2804] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:00.151836 15711 raft_consensus.cc:493] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:10:00.152334 15711 raft_consensus.cc:3060] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:00.143499 15645 raft_consensus.cc:993] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c: : Instructing follower 17aab1bbf5014936aa18cc21818b26ec to start an election
I20260709 12:10:00.111343 15750 raft_consensus.cc:3060] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:00.127749 15743 raft_consensus.cc:2749] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:00.095818 15730 raft_consensus.cc:515] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:00.117583 15754 raft_consensus.cc:2749] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:00.177213 15714 leader_election.cc:290] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 2 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:00.181164 14909 raft_consensus.cc:1240] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 1. Current term is 2. Ops: []
W20260709 12:10:00.134601 15772 log.cc:927] Time spent T bf9bea0d16e44efabb5cdd53e3828438 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 12:10:00.148598 14155 leader_election.cc:304] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:00.127900 15728 leader_election.cc:290] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 2 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:00.150173 14304 leader_election.cc:304] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:00.187817 14304 leader_election.cc:304] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:00.189143 14304 leader_election.cc:304] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:00.163986 15561 leader_election.cc:290] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 2 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:00.164417 15735 raft_consensus.cc:1081] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 3 LEADER]: Signalling peer 17aab1bbf5014936aa18cc21818b26ec to start an election
I20260709 12:10:00.169648 15777 raft_consensus.cc:3055] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Stepping down as leader of term 1
W20260709 12:10:00.194983 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 178225us
I20260709 12:10:00.197525 14304 leader_election.cc:304] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:00.154526 15717 leader_election.cc:290] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 2 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:00.191913 15743 raft_consensus.cc:2749] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:00.203524 15774 raft_consensus.cc:493] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:10:00.192106 15727 raft_consensus.cc:2749] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:00.204265 15774 raft_consensus.cc:515] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:00.157425 15751 raft_consensus.cc:2749] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:00.205868 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
W20260709 12:10:00.207463 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 58988us
W20260709 12:10:00.208809 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 121666us
I20260709 12:10:00.209376 14155 leader_election.cc:304] T f4739bc22bfe44fcba807da02d9351b6 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:00.212122 14155 leader_election.cc:304] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:00.214016 14304 leader_election.cc:304] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:00.120507 15649 consensus_queue.cc:260] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:00.215205 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:00.192629 15600 raft_consensus.cc:493] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:10:00.214970 14155 leader_election.cc:304] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:00.223788 14155 leader_election.cc:304] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:00.226694 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:00.205840 15740 raft_consensus.cc:2749] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:00.162845 15723 raft_consensus.cc:515] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:00.196362 15777 raft_consensus.cc:740] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:00.231609 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:00.212623 15728 raft_consensus.cc:2749] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:00.258913 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:00.260015 15600 raft_consensus.cc:515] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:00.264019 15600 leader_election.cc:290] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:00.267457 14877 leader_election.cc:304] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:00.268929 15768 raft_consensus.cc:2749] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:00.238879 15732 raft_consensus.cc:2804] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:00.218604 15778 raft_consensus.cc:3060] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:00.239766 15726 raft_consensus.cc:3055] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:00.241058 15730 leader_election.cc:290] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:00.241842 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:00.244503 15776 raft_consensus.cc:3055] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:00.245441 15781 raft_consensus.cc:993] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec: : Instructing follower 885067a0d31741bfb5c9935788e315bf to start an election
I20260709 12:10:00.229590 15779 raft_consensus.cc:2749] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:00.218755 15733 raft_consensus.cc:2749] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:00.246312 15674 raft_consensus.cc:2749] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:00.246992 15748 raft_consensus.cc:515] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:00.248521 14189 raft_consensus.cc:1275] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:00.248678 14155 leader_election.cc:304] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:00.222599 15561 consensus_queue.cc:1059] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 12:10:00.289634 14155 leader_election.cc:304] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:00.290068 15674 raft_consensus.cc:2749] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:00.290343 14912 raft_consensus.cc:1240] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 1. Current term is 2. Ops: []
W20260709 12:10:00.282081 15720 consensus_meta.cc:287] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.565s	user 0.007s	sys 0.006s
I20260709 12:10:00.254303 14304 leader_election.cc:304] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:00.294597 15561 raft_consensus.cc:3055] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:00.295164 15561 raft_consensus.cc:740] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:00.295369 14304 leader_election.cc:304] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:00.295846 15789 consensus_queue.cc:1048] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:00.296700 14304 leader_election.cc:304] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:00.297837 15645 consensus_queue.cc:1059] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:00.298869 15740 raft_consensus.cc:2749] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:00.280671 15732 raft_consensus.cc:493] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:10:00.298362 14304 leader_election.cc:304] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:00.257330 15494 raft_consensus.cc:515] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:00.215363 15597 raft_consensus.cc:2749] T f4739bc22bfe44fcba807da02d9351b6 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:00.278689 14906 raft_consensus.cc:1240] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:00.279942 15726 raft_consensus.cc:740] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:00.282783 15776 raft_consensus.cc:740] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:10:00.286356 14877 leader_election.cc:304] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
W20260709 12:10:00.290712 15749 consensus_meta.cc:287] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.565s	user 0.010s	sys 0.003s
I20260709 12:10:00.292394 15674 raft_consensus.cc:3060] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:00.253845 15649 raft_consensus.cc:3060] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:00.348541 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:00.349043 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:00.304416 15751 raft_consensus.cc:2749] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:00.348546 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:00.306536 14339 raft_consensus.cc:1240] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:00.279763 15777 consensus_queue.cc:260] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:00.351574 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:00.289667 15600 raft_consensus.cc:1081] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 2 LEADER]: Signalling peer 885067a0d31741bfb5c9935788e315bf to start an election
I20260709 12:10:00.352008 15777 raft_consensus.cc:3060] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:00.282172 15715 raft_consensus.cc:515] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:00.356117 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:00.332105 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:00.337003 14336 raft_consensus.cc:1240] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:00.333077 15789 raft_consensus.cc:2749] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:00.337632 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:00.338155 15748 leader_election.cc:290] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:00.338340 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
W20260709 12:10:00.339243 15708 consensus_meta.cc:287] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.607s	user 0.013s	sys 0.000s
I20260709 12:10:00.339995 15776 consensus_queue.cc:260] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:00.306214 15732 raft_consensus.cc:3060] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:00.342551 15774 leader_election.cc:290] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:00.343806 15746 raft_consensus.cc:515] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:00.343967 15726 consensus_queue.cc:260] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:00.307371 15744 consensus_queue.cc:1059] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 12:10:00.345469 14258 raft_consensus.cc:1240] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:00.334748 15723 leader_election.cc:290] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 2 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:00.343825 15494 leader_election.cc:290] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 2 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:00.355937 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:00.299337 15645 raft_consensus.cc:2749] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:00.332774 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:00.358655 14304 leader_election.cc:304] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:00.306804 15735 raft_consensus.cc:3055] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:00.332638 15561 consensus_queue.cc:260] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:00.346596 15739 raft_consensus.cc:2749] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:00.353235 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:00.375329 14256 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d"
dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
 from {username='slave'} at 127.0.0.1:41764
I20260709 12:10:00.427248 14256 raft_consensus.cc:493] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:00.427655 14256 raft_consensus.cc:3060] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:00.379451 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:00.381143 14332 raft_consensus.cc:1240] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 2. Current term is 3. Ops: []
W20260709 12:10:00.381138 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 296103us
I20260709 12:10:00.405269 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:00.406347 15776 raft_consensus.cc:3060] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:00.400077 15735 raft_consensus.cc:740] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:00.413578 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:00.416258 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:00.417034 15744 raft_consensus.cc:3055] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:00.418057 15733 raft_consensus.cc:2749] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:00.419041 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
W20260709 12:10:00.418174 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 59630.6us
I20260709 12:10:00.415781 14087 catalog_manager.cc:5697] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 1 to 2, leader changed from 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130) to 73d01e9b1a9d49358da4985b21d681db (127.12.174.132). New cstate: current_term: 2 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:00.363372 15720 raft_consensus.cc:515] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:00.430956 14230 leader_election.cc:304] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:00.449908 14230 leader_election.cc:304] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:00.448313 15561 raft_consensus.cc:3060] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:00.451020 14230 leader_election.cc:304] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:00.440152 14155 leader_election.cc:304] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:00.443212 14304 leader_election.cc:304] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:00.451640 15774 raft_consensus.cc:2749] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:00.452525 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:00.452934 15645 raft_consensus.cc:2749] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:00.453785 15720 leader_election.cc:290] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 3 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:00.446578 15735 consensus_queue.cc:260] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:00.454430 15600 raft_consensus.cc:2749] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:00.454751 15735 raft_consensus.cc:3060] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:00.455576 14188 raft_consensus.cc:1240] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:00.461545 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:00.372305 15708 raft_consensus.cc:515] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:00.471820 14230 leader_election.cc:304] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:00.464120 15720 raft_consensus.cc:2749] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:00.478145 15728 consensus_queue.cc:1059] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:00.479245 15728 raft_consensus.cc:3055] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:00.484580 14304 leader_election.cc:304] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:00.485499 15494 raft_consensus.cc:2749] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:00.486063 14304 leader_election.cc:304] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:00.391032 15751 consensus_queue.cc:1059] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.074s
I20260709 12:10:00.386436 15779 consensus_queue.cc:1059] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.089s
I20260709 12:10:00.479585 15728 raft_consensus.cc:740] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:10:00.441390 15744 raft_consensus.cc:740] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:00.442898 15715 leader_election.cc:290] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:00.496060 14263 raft_consensus.cc:3055] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:00.496990 14304 leader_election.cc:304] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:00.501101 15494 raft_consensus.cc:2749] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:00.502657 14304 leader_election.cc:304] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:00.499558 14263 raft_consensus.cc:740] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:10:00.479661 15774 raft_consensus.cc:2749] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:00.505326 14304 leader_election.cc:304] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:00.418960 15770 consensus_queue.cc:1059] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.070s
I20260709 12:10:00.514271 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:00.493938 15645 raft_consensus.cc:2749] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:00.490875 15786 raft_consensus.cc:2749] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:00.517884 15728 consensus_queue.cc:260] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:00.519832 15728 raft_consensus.cc:3060] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:00.498512 15597 raft_consensus.cc:3055] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:00.528414 15597 raft_consensus.cc:740] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:10:00.529661 15711 raft_consensus.cc:515] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:00.531339 14331 raft_consensus.cc:1240] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:00.533167 15711 leader_election.cc:290] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 2 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:00.524051 15723 raft_consensus.cc:2749] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:00.509865 15743 raft_consensus.cc:2749] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:10:00.544435 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 51414.3us
W20260709 12:10:00.553714 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 337976us
I20260709 12:10:00.554603 14229 leader_election.cc:304] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:00.536887 15781 consensus_queue.cc:1059] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:00.553807 15744 consensus_queue.cc:260] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:00.559223 15600 raft_consensus.cc:2804] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:00.562144 15600 raft_consensus.cc:493] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:00.562701 15600 raft_consensus.cc:3060] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:00.563452 15708 leader_election.cc:290] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 3 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:00.566941 15750 raft_consensus.cc:515] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:00.569038 14338 raft_consensus.cc:1240] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:00.574084 14230 leader_election.cc:304] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:00.556216 14263 consensus_queue.cc:260] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:00.544723 15778 raft_consensus.cc:2749] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:00.576951 14230 leader_election.cc:304] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:00.579402 14230 leader_election.cc:304] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:00.580684 14230 leader_election.cc:304] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:00.581532 14263 raft_consensus.cc:3060] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:00.586225 15754 consensus_queue.cc:1059] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 12:10:00.587563 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:00.589098 15784 raft_consensus.cc:2749] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:00.590071 15784 raft_consensus.cc:2749] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:00.590595 15674 raft_consensus.cc:2749] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:00.590898 15784 raft_consensus.cc:2749] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:00.600744 14229 leader_election.cc:304] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:00.605651 14304 leader_election.cc:304] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:00.606863 14230 leader_election.cc:304] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:00.608139 14230 leader_election.cc:304] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:00.581652 15791 raft_consensus.cc:2749] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:00.616525 14336 raft_consensus.cc:1240] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:00.649438 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:00.655965 15792 raft_consensus.cc:2749] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:00.656752 15792 raft_consensus.cc:2749] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:00.664079 15597 consensus_queue.cc:260] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:00.618037 15750 leader_election.cc:290] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 2 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:00.670625 15597 raft_consensus.cc:3060] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:00.675549 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:00.620487 15743 raft_consensus.cc:2749] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:00.681972 14256 raft_consensus.cc:515] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:00.693075 14256 leader_election.cc:290] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 4 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:00.671757 15795 raft_consensus.cc:2749] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:10:00.702481 15793 log.cc:927] Time spent T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.131s	user 0.001s	sys 0.000s
W20260709 12:10:00.689872 14155 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.174.130:36673 timed out after 1.791s (SENT) [suppressed 4 similar messages]
I20260709 12:10:00.716169 14229 leader_election.cc:304] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:00.717442 14229 leader_election.cc:304] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:00.718568 14229 leader_election.cc:304] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:00.722409 15795 consensus_queue.cc:1059] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 12:10:00.728448 15600 raft_consensus.cc:515] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:00.730885 15600 leader_election.cc:290] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:10:00.740051 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 131999us
I20260709 12:10:00.741137 14230 leader_election.cc:304] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:00.709482 15773 consensus_queue.cc:1059] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 12:10:00.748800 14263 raft_consensus.cc:1275] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:00.719229 15791 consensus_queue.cc:1059] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 12:10:00.756203 14229 leader_election.cc:304] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:00.748258 15797 raft_consensus.cc:2749] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:10:00.767462 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 77629.5us
W20260709 12:10:00.769794 14155 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:00.755342 15600 raft_consensus.cc:2749] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:00.772096 15721 raft_consensus.cc:2749] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:00.772229 15600 raft_consensus.cc:3055] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:00.772909 15600 raft_consensus.cc:740] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:10:00.772761 15718 consensus_queue.cc:1048] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:00.773923 15600 consensus_queue.cc:260] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:00.775178 15600 raft_consensus.cc:3060] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:00.758705 15754 raft_consensus.cc:2749] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:00.776028 15791 raft_consensus.cc:3055] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:00.776440 15791 raft_consensus.cc:740] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:10:00.776875 15732 raft_consensus.cc:515] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:00.777302 15791 consensus_queue.cc:260] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:00.778745 15791 raft_consensus.cc:3060] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:10:00.779075 14305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:00.779058 15732 leader_election.cc:290] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 2 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:00.781828 14330 raft_consensus.cc:1240] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:00.785223 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:10:00.785534 14230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:00.793207 14337 raft_consensus.cc:1240] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:00.793516 14260 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6"
dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
mode: GRACEFUL
new_leader_uuid: "885067a0d31741bfb5c9935788e315bf"
 from {username='slave'} at 127.0.0.1:42676
I20260709 12:10:00.794122 14260 raft_consensus.cc:606] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 2 LEADER]: Received request to transfer leadership to TS 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:00.794224 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:00.794839 14339 raft_consensus.cc:3055] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:00.795441 14339 raft_consensus.cc:740] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:00.786922 14331 raft_consensus.cc:1240] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:00.796561 14339 consensus_queue.cc:260] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:00.787531 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:00.788455 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:00.799986 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:00.801396 15800 consensus_queue.cc:1059] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:00.788285 14338 raft_consensus.cc:1240] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:00.803830 15773 raft_consensus.cc:3055] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:00.804312 15773 raft_consensus.cc:740] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:10:00.805203 15773 consensus_queue.cc:260] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:00.806571 15773 raft_consensus.cc:3060] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:00.807428 14262 raft_consensus.cc:1275] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:00.807606 12986 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:10:00.810052 15781 raft_consensus.cc:3055] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:00.810454 15781 raft_consensus.cc:740] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:10:00.811465 15704 consensus_queue.cc:1059] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:10:00.811904 15781 consensus_queue.cc:260] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:00.812420 15704 consensus_queue.cc:1059] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:10:00.810851 15778 consensus_queue.cc:1059] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:00.813161 15781 raft_consensus.cc:3060] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:00.813297 15728 raft_consensus.cc:3055] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:00.813889 15728 raft_consensus.cc:740] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:10:00.815080 15728 consensus_queue.cc:260] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:00.816165 15728 raft_consensus.cc:3060] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:00.793841 14333 raft_consensus.cc:1240] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:00.817921 15778 raft_consensus.cc:3055] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:00.818313 15778 raft_consensus.cc:740] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:10:00.818461 15774 raft_consensus.cc:3055] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:00.818835 15774 raft_consensus.cc:740] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:10:00.819216 15778 consensus_queue.cc:260] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:00.819657 15774 consensus_queue.cc:260] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:00.820890 15778 raft_consensus.cc:3060] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:00.821676 15774 raft_consensus.cc:3060] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:00.823493 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:00.784674 14074 catalog_manager.cc:5028] TS 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): tablet 3c9d740fa53e42179ad8d244b4c179fd (table test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]) successfully deleted
W20260709 12:10:00.828768 14074 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 44245.4us
I20260709 12:10:00.829222 15744 raft_consensus.cc:3060] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:10:00.830753 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 68347.2us
I20260709 12:10:00.833114 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:00.833177 14303 leader_election.cc:304] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:00.834165 12986 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:10:00.841262 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:00.842500 14183 raft_consensus.cc:1275] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:10:00.845295 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 89153.4us
I20260709 12:10:00.846091 14229 leader_election.cc:304] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:00.848160 14229 leader_election.cc:304] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:00.849150 14229 leader_election.cc:304] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:00.849943 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:00.855263 15798 raft_consensus.cc:2749] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:00.855561 14229 leader_election.cc:304] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:00.829901 15802 consensus_queue.cc:1059] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 12:10:00.858105 15802 raft_consensus.cc:3055] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:00.858453 15802 raft_consensus.cc:740] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:10:00.810266 15776 consensus_queue.cc:1059] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 12:10:00.860726 14229 leader_election.cc:304] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:00.864251 14229 leader_election.cc:304] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:00.865712 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:00.846964 15788 raft_consensus.cc:3055] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:00.837119 15723 raft_consensus.cc:2749] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:00.881578 14339 raft_consensus.cc:3060] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:00.852072 15784 raft_consensus.cc:2749] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:00.852388 15721 raft_consensus.cc:2749] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:00.846959 15773 raft_consensus.cc:2749] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:00.899637 15796 raft_consensus.cc:3055] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:00.900496 15746 leader_election.cc:290] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:00.867734 15798 raft_consensus.cc:2749] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:00.908727 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:00.909929 14260 raft_consensus.cc:1240] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:00.924614 14262 raft_consensus.cc:3060] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:00.874488 15725 raft_consensus.cc:3055] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:00.848083 15732 consensus_queue.cc:1048] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.051s
I20260709 12:10:00.861677 15802 consensus_queue.cc:260] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:00.862996 15708 consensus_queue.cc:1059] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.053s
I20260709 12:10:00.916208 14333 raft_consensus.cc:1240] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:00.865721 15786 raft_consensus.cc:2749] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:00.877636 15726 raft_consensus.cc:3060] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:10:00.915078 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 50902.2us
I20260709 12:10:00.927716 14303 leader_election.cc:304] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:00.912539 15788 raft_consensus.cc:740] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:10:00.925522 15796 raft_consensus.cc:740] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:10:00.925683 15797 raft_consensus.cc:2749] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:00.939277 15802 raft_consensus.cc:3060] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:00.927874 15770 raft_consensus.cc:493] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:10:00.990978 15770 raft_consensus.cc:515] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:00.989492 15796 consensus_queue.cc:260] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:00.950438 15766 raft_consensus.cc:3055] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:00.994033 15766 raft_consensus.cc:740] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:10:00.951718 15754 raft_consensus.cc:3055] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:00.936036 15645 consensus_queue.cc:1048] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 12:10:00.957419 14229 leader_election.cc:304] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:00.930009 15600 consensus_queue.cc:1059] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 12:10:00.930187 15725 raft_consensus.cc:740] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:10:00.994719 15796 raft_consensus.cc:3060] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:00.965950 15746 raft_consensus.cc:2749] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:01.001410 15600 raft_consensus.cc:3055] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:01.003763 15600 raft_consensus.cc:740] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:10:00.997002 15754 raft_consensus.cc:740] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:10:01.004954 15600 consensus_queue.cc:260] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:01.005987 15754 consensus_queue.cc:260] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:01.006771 15600 raft_consensus.cc:3060] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:01.007596 15754 raft_consensus.cc:3060] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:01.010421 15797 raft_consensus.cc:2749] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:10:01.003373 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 46054.5us
I20260709 12:10:00.979235 14339 raft_consensus.cc:2468] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 4.
W20260709 12:10:00.982720 14155 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:00.998898 15766 consensus_queue.cc:260] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:01.025645 15766 raft_consensus.cc:3060] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:00.961292 15704 consensus_queue.cc:1059] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
W20260709 12:10:01.019163 14154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:01.031412 14229 leader_election.cc:304] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:01.032908 14262 raft_consensus.cc:2468] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 3.
I20260709 12:10:01.030786 14230 leader_election.cc:304] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:10:01.035230 14304 leader_election.cc:304] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:10:01.036954 14155 leader_election.cc:304] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:01.037943 15783 raft_consensus.cc:2749] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:01.040083 14155 leader_election.cc:304] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:01.041805 15597 raft_consensus.cc:2749] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:01.043399 14909 raft_consensus.cc:1240] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 2 LEADER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:01.044576 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:01.045758 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:01.046928 14256 raft_consensus.cc:1240] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:01.050625 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:01.051398 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:01.049363 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:01.049288 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:01.069193 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:01.070758 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:01.071960 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:01.073160 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:01.077433 14155 leader_election.cc:304] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:01.066118 14262 raft_consensus.cc:2468] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 3.
I20260709 12:10:01.058442 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:01.036475 15797 raft_consensus.cc:2749] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:01.082506 15788 consensus_queue.cc:260] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:01.090649 15720 raft_consensus.cc:2749] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:01.049932 15645 raft_consensus.cc:2804] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:01.052832 15792 raft_consensus.cc:2804] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:01.100221 15792 raft_consensus.cc:697] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 4 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:10:01.101565 15792 consensus_queue.cc:237] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:01.096235 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:01.113425 14155 leader_election.cc:304] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:01.113701 14262 raft_consensus.cc:2468] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 3.
I20260709 12:10:01.115795 14259 raft_consensus.cc:1240] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:01.119096 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:01.117327 14155 leader_election.cc:304] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:01.120898 15494 consensus_queue.cc:1059] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:10:01.119652 15807 log.cc:927] Time spent T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 12:10:01.132894 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:01.134871 14155 leader_election.cc:304] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:01.136142 14155 leader_election.cc:304] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:01.135239 14190 raft_consensus.cc:1240] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:01.119365 15730 raft_consensus.cc:2749] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:01.141906 14187 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca"
dest_uuid: "885067a0d31741bfb5c9935788e315bf"
 from {username='slave'} at 127.0.0.1:56046
I20260709 12:10:01.142460 14187 raft_consensus.cc:493] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:01.142804 14187 raft_consensus.cc:3060] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:01.126991 15770 leader_election.cc:290] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:01.145946 15704 raft_consensus.cc:2749] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:01.132828 15743 raft_consensus.cc:3055] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:01.146656 15743 raft_consensus.cc:740] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:01.147835 15743 consensus_queue.cc:260] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:01.149646 15743 raft_consensus.cc:3060] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:01.119114 15645 raft_consensus.cc:697] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 3 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:01.153631 14264 raft_consensus.cc:2468] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 2.
I20260709 12:10:01.158409 15645 consensus_queue.cc:237] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:01.161907 14186 raft_consensus.cc:1240] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:01.130375 15783 raft_consensus.cc:2749] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:01.164731 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:01.170287 14190 raft_consensus.cc:3060] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:01.175233 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:01.166719 14187 raft_consensus.cc:515] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:01.176733 14155 leader_election.cc:304] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:01.182969 15725 consensus_queue.cc:260] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:01.184767 15725 raft_consensus.cc:3060] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:01.174362 14261 consensus_queue.cc:237] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:01.153458 15720 raft_consensus.cc:2749] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:01.189539 14185 raft_consensus.cc:2468] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 3.
W20260709 12:10:01.192674 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:01.177830 14187 leader_election.cc:290] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 4 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:01.199124 14229 leader_election.cc:304] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:01.161605 15759 raft_consensus.cc:493] T bf9bea0d16e44efabb5cdd53e3828438 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:10:01.203078 14183 raft_consensus.cc:1240] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:01.203620 14155 leader_election.cc:304] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:01.212092 14229 leader_election.cc:304] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:01.217335 15778 raft_consensus.cc:2804] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:01.218658 15778 raft_consensus.cc:697] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 3 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:10:01.196689 15597 raft_consensus.cc:2749] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:01.225042 14155 leader_election.cc:304] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
W20260709 12:10:01.228304 14230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:01.226830 15774 raft_consensus.cc:2749] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:01.231699 15795 raft_consensus.cc:993] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec: : Instructing follower 885067a0d31741bfb5c9935788e315bf to start an election
W20260709 12:10:01.228844 14074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 117012us
I20260709 12:10:01.232283 15795 raft_consensus.cc:1081] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 2 LEADER]: Signalling peer 885067a0d31741bfb5c9935788e315bf to start an election
I20260709 12:10:01.238175 14155 leader_election.cc:304] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:01.205097 15786 raft_consensus.cc:2749] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:01.256774 15789 raft_consensus.cc:493] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:01.243214 14260 raft_consensus.cc:2468] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 3.
I20260709 12:10:01.265345 15788 raft_consensus.cc:3060] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:10:01.265920 14228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:01.270058 14229 leader_election.cc:304] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:01.249770 15704 raft_consensus.cc:2804] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:01.273231 15704 raft_consensus.cc:493] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:10:01.273603 15704 raft_consensus.cc:3060] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:01.275295 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:01.276081 14339 raft_consensus.cc:2393] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 3: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:10:01.277482 14190 raft_consensus.cc:2468] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 4.
I20260709 12:10:01.277808 15766 raft_consensus.cc:2804] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:01.284734 14184 raft_consensus.cc:2468] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 2.
I20260709 12:10:01.220808 15778 consensus_queue.cc:237] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:01.208643 15759 raft_consensus.cc:515] T bf9bea0d16e44efabb5cdd53e3828438 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:01.292323 15759 leader_election.cc:290] T bf9bea0d16e44efabb5cdd53e3828438 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:01.297181 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:01.277508 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:01.285082 15784 raft_consensus.cc:2749] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:01.304584 14155 leader_election.cc:304] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:01.304930 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:01.305567 14260 raft_consensus.cc:3060] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:01.305608 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:01.288829 15766 raft_consensus.cc:697] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 2 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:10:01.308368 14190 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6"
dest_uuid: "885067a0d31741bfb5c9935788e315bf"
 from {username='slave'} at 127.0.0.1:56046
I20260709 12:10:01.308756 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:01.311797 14303 leader_election.cc:304] T bf9bea0d16e44efabb5cdd53e3828438 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:01.315049 14260 raft_consensus.cc:2468] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 4.
I20260709 12:10:01.318147 14265 raft_consensus.cc:2468] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 3.
W20260709 12:10:01.323029 14074 catalog_manager.cc:4755] TS 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): ChangeConfig:REMOVE_PEER RPC failed for tablet f4739bc22bfe44fcba807da02d9351b6: Remote error: Service unavailable: leader transfer in progress
I20260709 12:10:01.335336 14155 leader_election.cc:304] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:01.260265 15789 raft_consensus.cc:515] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:01.332419 14190 raft_consensus.cc:493] T f4739bc22bfe44fcba807da02d9351b6 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:01.318171 15730 raft_consensus.cc:2804] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:01.338019 14190 raft_consensus.cc:3060] T f4739bc22bfe44fcba807da02d9351b6 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:01.306376 14330 raft_consensus.cc:3060] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:01.336494 15738 raft_consensus.cc:2749] T bf9bea0d16e44efabb5cdd53e3828438 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:01.340553 15720 raft_consensus.cc:2804] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:10:01.381647 14155 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:01.343060 15730 raft_consensus.cc:697] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 3 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:10:01.388950 14190 raft_consensus.cc:515] T f4739bc22bfe44fcba807da02d9351b6 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:01.376572 15598 raft_consensus.cc:493] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:10:01.403764 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:01.404654 14260 raft_consensus.cc:3055] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:01.405134 14260 raft_consensus.cc:740] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:10:01.406548 15730 consensus_queue.cc:237] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:01.410100 15789 leader_election.cc:290] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:01.387095 15720 raft_consensus.cc:697] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 4 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:10:01.411244 15720 consensus_queue.cc:237] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:01.404910 15726 raft_consensus.cc:493] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:01.414384 15726 raft_consensus.cc:515] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:01.416445 15726 leader_election.cc:290] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:01.420006 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:01.420768 14906 raft_consensus.cc:2468] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 2.
I20260709 12:10:01.422684 14339 raft_consensus.cc:1240] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:01.413480 15598 raft_consensus.cc:515] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:01.422964 14335 raft_consensus.cc:1240] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:01.423933 14303 leader_election.cc:304] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:10:01.426025 14260 consensus_queue.cc:260] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:01.396195 15766 consensus_queue.cc:237] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:01.434260 15754 consensus_queue.cc:1059] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:01.435467 15754 consensus_queue.cc:1059] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:10:01.436443 15754 raft_consensus.cc:3055] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:01.436771 15754 raft_consensus.cc:740] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:10:01.437044 14190 leader_election.cc:290] T f4739bc22bfe44fcba807da02d9351b6 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 3 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:01.437896 15796 raft_consensus.cc:3055] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:01.438299 15796 raft_consensus.cc:740] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:10:01.439247 15796 consensus_queue.cc:260] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:01.440433 15796 raft_consensus.cc:3060] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:01.448621 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:01.449368 14335 raft_consensus.cc:3060] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:01.445068 14303 leader_election.cc:304] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:10:01.459060 14190 raft_consensus.cc:1240] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:01.477430 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:01.478165 14185 raft_consensus.cc:2468] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 2.
I20260709 12:10:01.454687 15726 raft_consensus.cc:2804] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:01.452576 15789 raft_consensus.cc:493] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:10:01.471726 14088 catalog_manager.cc:5697] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf reported cstate change: term changed from 1 to 2, leader changed from 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130) to 65c9c1653b3346b39a0e118540e6080c (127.12.174.131). New cstate: current_term: 2 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } }
I20260709 12:10:01.485307 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:10:01.493176 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:01.496112 15598 leader_election.cc:290] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:01.470384 15746 raft_consensus.cc:2804] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:01.499367 14155 leader_election.cc:304] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:01.478606 15814 raft_consensus.cc:493] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:10:01.497372 15746 raft_consensus.cc:697] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 2 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:01.535964 15704 raft_consensus.cc:515] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:01.536823 14909 raft_consensus.cc:1275] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:01.540283 14186 raft_consensus.cc:1275] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:01.541693 15784 consensus_queue.cc:1048] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:01.505780 15783 raft_consensus.cc:2804] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:01.544723 14335 raft_consensus.cc:2468] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 3.
I20260709 12:10:01.545439 15783 raft_consensus.cc:697] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 3 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:10:01.546376 15783 consensus_queue.cc:237] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:01.482719 15726 raft_consensus.cc:493] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:01.548125 14228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:01.437621 15754 consensus_queue.cc:260] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:01.565057 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:01.566092 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:01.566953 14183 raft_consensus.cc:2393] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db in current term 3: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:10:01.569059 14186 raft_consensus.cc:2468] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 2.
I20260709 12:10:01.570277 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:01.564318 15726 raft_consensus.cc:3060] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:01.626770 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 47083.8us
I20260709 12:10:01.631153 14876 leader_election.cc:304] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:01.570299 15784 consensus_queue.cc:1048] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.062s
I20260709 12:10:01.571355 15797 consensus_queue.cc:1059] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.064s
I20260709 12:10:01.501645 15789 raft_consensus.cc:515] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:01.649099 15494 raft_consensus.cc:493] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:01.650518 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:01.659896 14335 raft_consensus.cc:2393] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 3: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:10:01.659611 15494 raft_consensus.cc:515] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:01.663307 15494 leader_election.cc:290] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:01.564723 15814 raft_consensus.cc:515] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:01.544938 15746 consensus_queue.cc:237] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:10:01.666677 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:01.651882 15704 leader_election.cc:290] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 3 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:01.670964 15721 raft_consensus.cc:493] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:10:01.674513 15721 raft_consensus.cc:515] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:01.675333 15814 leader_election.cc:290] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:01.676689 15721 leader_election.cc:290] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:01.667853 14906 raft_consensus.cc:3060] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:01.679369 15734 raft_consensus.cc:493] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:01.679924 15734 raft_consensus.cc:515] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:01.680760 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:01.682166 15734 leader_election.cc:290] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:01.682675 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:01.684409 14229 leader_election.cc:304] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:01.686179 14258 raft_consensus.cc:2468] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 3.
I20260709 12:10:01.643944 15750 raft_consensus.cc:493] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
W20260709 12:10:01.710108 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 48916.4us
I20260709 12:10:01.713338 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:01.714107 14912 raft_consensus.cc:2468] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 2.
I20260709 12:10:01.715972 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:01.716642 14258 raft_consensus.cc:2468] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 3.
I20260709 12:10:01.714149 14186 raft_consensus.cc:1275] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:01.652663 14330 raft_consensus.cc:2468] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 4.
I20260709 12:10:01.720485 14303 leader_election.cc:304] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:10:01.684271 15803 raft_consensus.cc:2804] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:01.724083 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:01.706662 15721 raft_consensus.cc:2749] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:01.722903 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:01.724761 14265 raft_consensus.cc:2468] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 1.
I20260709 12:10:01.726143 14335 raft_consensus.cc:2468] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 2.
W20260709 12:10:01.725832 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 94790.7us
I20260709 12:10:01.727535 14186 raft_consensus.cc:1275] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:01.712108 15750 raft_consensus.cc:515] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:01.728559 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:01.729225 14261 raft_consensus.cc:2468] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 2.
I20260709 12:10:01.730404 15750 leader_election.cc:290] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:01.724280 15803 raft_consensus.cc:493] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:01.731949 15803 raft_consensus.cc:3060] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:01.737093 15721 consensus_queue.cc:1048] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:01.722828 15738 consensus_queue.cc:1048] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.017s
I20260709 12:10:01.746400 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:01.748733 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:01.761160 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:01.762293 14265 raft_consensus.cc:2393] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 2: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:10:01.726652 15645 raft_consensus.cc:2804] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:01.790081 14304 leader_election.cc:304] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
W20260709 12:10:01.797351 14229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:01.785668 15645 raft_consensus.cc:493] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:01.800222 15828 raft_consensus.cc:3060] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:01.813588 15645 raft_consensus.cc:3060] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:01.842882 14330 raft_consensus.cc:1275] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:10:01.846192 15825 log.cc:927] Time spent T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 12:10:01.802444 15795 raft_consensus.cc:2955] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 4 LEADER]: Committing config change with OpId 4.6: config changed from index 5 to 6, VOTER 65c9c1653b3346b39a0e118540e6080c (127.12.174.131) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:10:01.851002 14906 raft_consensus.cc:2468] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 3.
I20260709 12:10:01.877368 14261 raft_consensus.cc:1275] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:01.880074 15802 consensus_queue.cc:1048] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:01.891736 14260 raft_consensus.cc:3060] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:01.889117 15726 raft_consensus.cc:515] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:01.895190 14339 raft_consensus.cc:2393] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db in current term 3: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:10:01.901854 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:01.902550 14183 raft_consensus.cc:3060] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:01.905167 15743 consensus_queue.cc:1048] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:01.905887 15723 raft_consensus.cc:493] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:01.916401 15723 raft_consensus.cc:515] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:01.914951 14154 leader_election.cc:304] T f4739bc22bfe44fcba807da02d9351b6 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:01.905527 15754 raft_consensus.cc:3060] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:01.918618 15723 leader_election.cc:290] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:01.919904 14260 raft_consensus.cc:2468] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 3.
I20260709 12:10:01.923110 15828 raft_consensus.cc:2749] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:01.923574 15728 raft_consensus.cc:2804] T f4739bc22bfe44fcba807da02d9351b6 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:01.924088 15728 raft_consensus.cc:697] T f4739bc22bfe44fcba807da02d9351b6 P 885067a0d31741bfb5c9935788e315bf [term 3 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:10:01.924075 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:01.927562 15728 consensus_queue.cc:237] T f4739bc22bfe44fcba807da02d9351b6 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:01.929719 15803 raft_consensus.cc:515] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:01.925827 14260 raft_consensus.cc:2468] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 3.
I20260709 12:10:01.932451 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:01.934295 14304 leader_election.cc:304] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:10:01.938277 15726 leader_election.cc:290] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:01.939268 15803 leader_election.cc:290] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 3 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:01.940373 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:10:01.942319 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:01.944080 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:01.949545 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:01.956869 14074 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet bf9bea0d16e44efabb5cdd53e3828438 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:10:01.958118 14335 raft_consensus.cc:1275] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:01.930649 15789 leader_election.cc:290] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:01.960978 14909 raft_consensus.cc:2955] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, VOTER 65c9c1653b3346b39a0e118540e6080c (127.12.174.131) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:10:01.966148 15708 raft_consensus.cc:493] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:01.971704 14265 raft_consensus.cc:1275] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:01.968755 15783 raft_consensus.cc:493] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:01.973022 14264 raft_consensus.cc:1275] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:01.972056 14184 raft_consensus.cc:2955] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, VOTER 65c9c1653b3346b39a0e118540e6080c (127.12.174.131) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:10:01.985328 14877 leader_election.cc:304] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:01.992410 15803 raft_consensus.cc:2804] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:01.992870 15803 raft_consensus.cc:493] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:10:01.993248 15803 raft_consensus.cc:3060] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:01.994895 14877 leader_election.cc:304] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:10:01.968060 14183 raft_consensus.cc:2468] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 3.
W20260709 12:10:02.010998 15839 log.cc:927] Time spent T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
W20260709 12:10:02.012828 15835 log.cc:927] Time spent T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.115s	user 0.001s	sys 0.000s
W20260709 12:10:02.017647 15833 log.cc:927] Time spent T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.121s	user 0.004s	sys 0.000s
I20260709 12:10:02.021049 15783 raft_consensus.cc:515] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:02.024475 15783 leader_election.cc:290] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:02.026145 14906 raft_consensus.cc:2393] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 3: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
I20260709 12:10:01.996238 15708 raft_consensus.cc:515] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:02.019609 15645 raft_consensus.cc:515] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:01.981881 15759 raft_consensus.cc:493] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:02.030213 15759 raft_consensus.cc:515] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:01.986207 15746 raft_consensus.cc:2804] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:02.034584 15746 raft_consensus.cc:493] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:02.035145 15746 raft_consensus.cc:3060] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:02.037196 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 53678.7us
I20260709 12:10:02.039719 14155 leader_election.cc:304] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:02.040122 15725 consensus_queue.cc:1048] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:02.051275 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:02.052429 14265 raft_consensus.cc:2393] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db in current term 3: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:10:02.059002 14877 leader_election.cc:304] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
W20260709 12:10:02.059315 14074 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet f4739bc22bfe44fcba807da02d9351b6 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 17aab1bbf5014936aa18cc21818b26ec is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
W20260709 12:10:02.064715 14074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 67117.8us
I20260709 12:10:02.075143 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:02.072348 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:02.084282 14333 raft_consensus.cc:2393] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db in current term 3: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:10:02.083932 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:02.088794 14257 raft_consensus.cc:2468] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 1.
I20260709 12:10:02.090387 14304 leader_election.cc:304] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:10:02.044386 15789 raft_consensus.cc:2804] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:02.060068 15720 raft_consensus.cc:2804] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:02.097540 14303 leader_election.cc:304] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:02.062515 15827 raft_consensus.cc:2749] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:02.168464 15723 raft_consensus.cc:493] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:02.097256 15789 raft_consensus.cc:493] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:02.187332 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 88581us
I20260709 12:10:02.198647 14877 leader_election.cc:304] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:02.182680 14085 catalog_manager.cc:5697] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: term changed from 3 to 4, leader changed from 65c9c1653b3346b39a0e118540e6080c (127.12.174.131) to 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130). New cstate: current_term: 4 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:02.183046 14087 catalog_manager.cc:5697] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: config changed from index 5 to 6, VOTER 65c9c1653b3346b39a0e118540e6080c (127.12.174.131) evicted. New cstate: current_term: 4 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:10:02.181317 15795 raft_consensus.cc:493] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:02.188328 15816 raft_consensus.cc:2804] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:02.182029 15708 leader_election.cc:290] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:02.190507 15759 leader_election.cc:290] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:02.190001 15754 raft_consensus.cc:493] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:10:02.187651 15734 raft_consensus.cc:493] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:02.187175 15600 raft_consensus.cc:493] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:10:02.199317 15789 raft_consensus.cc:3060] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:02.221338 14155 leader_election.cc:304] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:02.203184 15720 raft_consensus.cc:697] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 3 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:10:02.217164 15738 raft_consensus.cc:2804] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:02.245755 14265 raft_consensus.cc:1275] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:02.181918 15723 raft_consensus.cc:515] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:02.248085 14333 raft_consensus.cc:1275] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:02.217468 15816 raft_consensus.cc:493] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:02.215730 15827 raft_consensus.cc:2749] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:02.229995 15759 raft_consensus.cc:493] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:02.253087 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:02.245527 15600 raft_consensus.cc:515] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:02.250613 15645 leader_election.cc:290] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:02.234031 15754 raft_consensus.cc:515] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:02.239212 15734 raft_consensus.cc:515] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:02.223207 15795 raft_consensus.cc:515] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:02.252419 15788 consensus_queue.cc:1048] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 12:10:02.278988 15720 consensus_queue.cc:237] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:02.394562 15837 raft_consensus.cc:493] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:02.257051 15738 raft_consensus.cc:697] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 3 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:02.233557 15598 raft_consensus.cc:493] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:02.379536 15789 raft_consensus.cc:515] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:02.411811 15598 raft_consensus.cc:515] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:02.363561 14339 raft_consensus.cc:3060] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:02.366820 15721 raft_consensus.cc:493] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:10:02.368170 15674 consensus_queue.cc:1048] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:10:02.371070 15750 raft_consensus.cc:493] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:02.395941 15743 raft_consensus.cc:493] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:02.252969 15708 consensus_queue.cc:1048] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.119s
I20260709 12:10:02.258435 15816 raft_consensus.cc:3060] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:02.372917 15784 raft_consensus.cc:493] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:02.244927 15778 raft_consensus.cc:2749] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:02.374662 15723 leader_election.cc:290] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:02.375025 15759 raft_consensus.cc:515] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:02.257414 14335 raft_consensus.cc:1275] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:10:02.250847 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 153401us
I20260709 12:10:02.251016 14332 raft_consensus.cc:1275] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:02.368160 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:02.448400 14338 raft_consensus.cc:2468] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 2.
I20260709 12:10:02.448748 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:10:02.449393 14906 raft_consensus.cc:3060] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:02.252807 14264 raft_consensus.cc:1275] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:02.448387 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:02.451375 14909 raft_consensus.cc:2468] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 2.
I20260709 12:10:02.451812 15845 raft_consensus.cc:493] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:02.452481 15845 raft_consensus.cc:515] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:02.455242 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:02.455978 14182 raft_consensus.cc:2468] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 2.
I20260709 12:10:02.460244 15598 leader_election.cc:290] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:02.462967 15789 leader_election.cc:290] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 3 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:02.463058 14906 raft_consensus.cc:2468] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 3.
I20260709 12:10:02.464208 15600 leader_election.cc:290] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:02.466876 15754 leader_election.cc:290] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:02.468776 15600 raft_consensus.cc:493] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:02.469038 14339 raft_consensus.cc:1275] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:02.469481 15600 raft_consensus.cc:515] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:02.472620 15600 leader_election.cc:290] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:02.472745 15814 raft_consensus.cc:493] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:02.427636 15645 raft_consensus.cc:493] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:02.473434 15814 raft_consensus.cc:515] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:02.426596 15750 raft_consensus.cc:515] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:02.477031 15750 leader_election.cc:290] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:02.477239 15814 leader_election.cc:290] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:02.484661 15734 leader_election.cc:290] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:02.429538 15721 raft_consensus.cc:515] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:02.411496 15738 consensus_queue.cc:237] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:02.507776 14260 raft_consensus.cc:2468] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 1.
W20260709 12:10:02.255085 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 56568.9us
I20260709 12:10:02.257854 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:02.390991 15732 raft_consensus.cc:493] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:02.400054 14258 raft_consensus.cc:1275] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:02.402956 14334 raft_consensus.cc:1275] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:10:02.406692 15791 raft_consensus.cc:493] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:10:02.407173 15746 raft_consensus.cc:515] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:02.408216 15795 leader_election.cc:290] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:02.409577 15837 raft_consensus.cc:515] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:02.415254 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:02.532040 14184 raft_consensus.cc:2468] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 5.
I20260709 12:10:02.256640 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:02.429306 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:02.360065 15803 raft_consensus.cc:515] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:02.522034 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:02.533111 14333 raft_consensus.cc:2468] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 3.
I20260709 12:10:02.522728 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:02.538336 14334 raft_consensus.cc:2468] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 2.
I20260709 12:10:02.524358 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:02.539186 14258 raft_consensus.cc:3060] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:10:02.526535 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:02.537473 14263 raft_consensus.cc:2468] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 2.
I20260709 12:10:02.527294 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:02.542692 14338 raft_consensus.cc:2468] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 2.
I20260709 12:10:02.508728 14265 raft_consensus.cc:2468] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 2.
I20260709 12:10:02.506027 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:02.544396 14190 raft_consensus.cc:2468] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 2.
I20260709 12:10:02.533849 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:02.534066 14189 raft_consensus.cc:2468] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 3.
I20260709 12:10:02.525032 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:02.545768 14185 raft_consensus.cc:2468] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 2.
I20260709 12:10:02.546175 14339 raft_consensus.cc:3060] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:02.546687 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:02.540735 14264 raft_consensus.cc:2468] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 1.
I20260709 12:10:02.539535 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:02.533475 14229 leader_election.cc:304] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:02.549723 14262 raft_consensus.cc:3060] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:02.552798 14229 leader_election.cc:304] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:02.528899 15750 raft_consensus.cc:493] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:02.554674 14264 raft_consensus.cc:3060] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:02.559496 14229 leader_election.cc:304] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:02.561774 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:02.563046 14229 leader_election.cc:304] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:02.474193 15645 raft_consensus.cc:515] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:02.431469 15597 consensus_queue.cc:1048] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.109s
I20260709 12:10:02.567288 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:02.576040 14265 raft_consensus.cc:2468] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 3.
I20260709 12:10:02.555527 14339 raft_consensus.cc:2468] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 3.
I20260709 12:10:02.565985 14262 raft_consensus.cc:2468] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 3.
I20260709 12:10:02.569643 14258 raft_consensus.cc:2468] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 3.
I20260709 12:10:02.439143 15743 raft_consensus.cc:515] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:02.572036 14264 raft_consensus.cc:1275] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:02.551224 15721 leader_election.cc:290] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:02.552481 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:02.531169 15732 raft_consensus.cc:515] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:02.537089 15791 raft_consensus.cc:515] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:02.502204 15784 raft_consensus.cc:515] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:02.585198 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:02.564759 15795 raft_consensus.cc:2804] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:02.564611 15754 raft_consensus.cc:2804] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:02.570595 15802 raft_consensus.cc:2804] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:02.595489 14264 raft_consensus.cc:2468] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 1.
I20260709 12:10:02.594564 14259 raft_consensus.cc:2468] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 5.
I20260709 12:10:02.598781 14877 leader_election.cc:304] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:10:02.564529 15750 raft_consensus.cc:515] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:02.604859 14263 raft_consensus.cc:2468] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 1.
I20260709 12:10:02.593321 15721 raft_consensus.cc:2804] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:02.607182 14258 raft_consensus.cc:1275] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:10:02.610622 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:02.611253 14258 raft_consensus.cc:2468] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 1.
I20260709 12:10:02.593576 14906 raft_consensus.cc:2468] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 2.
I20260709 12:10:02.605762 14877 leader_election.cc:304] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:10:02.607566 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:02.596817 15802 raft_consensus.cc:493] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:10:02.594213 15795 raft_consensus.cc:493] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:10:02.615669 14338 raft_consensus.cc:2468] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 2.
I20260709 12:10:02.602016 15754 raft_consensus.cc:493] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:02.600116 15720 raft_consensus.cc:493] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:02.612676 15814 raft_consensus.cc:493] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:10:02.623596 15857 raft_consensus.cc:493] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:02.623729 15814 raft_consensus.cc:515] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:02.625528 15803 leader_election.cc:290] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 3 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:02.626726 15814 leader_election.cc:290] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:02.627745 15746 leader_election.cc:290] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 4 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:02.620142 14155 leader_election.cc:304] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:02.622571 15720 raft_consensus.cc:515] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:02.630550 15750 leader_election.cc:290] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:02.624177 15743 leader_election.cc:290] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:02.631289 15645 leader_election.cc:290] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:02.631862 15788 consensus_queue.cc:1048] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.013s
I20260709 12:10:02.606287 15854 raft_consensus.cc:493] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:02.634835 14877 leader_election.cc:304] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:10:02.620642 14229 leader_election.cc:304] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:10:02.633723 14155 leader_election.cc:304] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:02.609436 15721 raft_consensus.cc:493] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:10:02.646234 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:02.675428 14155 leader_election.cc:304] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:02.647424 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:02.656654 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:02.614938 15598 raft_consensus.cc:2804] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:02.617656 15726 raft_consensus.cc:493] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:02.617762 15802 raft_consensus.cc:3060] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:02.615216 15600 raft_consensus.cc:493] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:10:02.637872 15720 leader_election.cc:290] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:02.623829 15837 leader_election.cc:290] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:10:02.700477 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 63807.6us
W20260709 12:10:02.694492 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 55767.1us
I20260709 12:10:02.633394 15795 raft_consensus.cc:3060] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:02.675429 15728 raft_consensus.cc:2804] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:02.633121 15754 raft_consensus.cc:3060] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:02.705417 14262 raft_consensus.cc:2468] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 1.
I20260709 12:10:02.636129 15778 raft_consensus.cc:2804] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:02.717176 15778 raft_consensus.cc:493] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:02.701893 15726 raft_consensus.cc:515] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:02.709405 14304 leader_election.cc:304] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:10:02.677098 15774 raft_consensus.cc:2804] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:02.677996 15721 raft_consensus.cc:3060] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:02.719254 14265 raft_consensus.cc:2468] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 3.
I20260709 12:10:02.719169 14877 leader_election.cc:304] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:10:02.676146 15859 raft_consensus.cc:2804] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:02.723795 15859 raft_consensus.cc:493] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:02.703150 15847 raft_consensus.cc:2804] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:02.724376 15859 raft_consensus.cc:3060] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:02.708223 15720 raft_consensus.cc:2804] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:10:02.719910 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 44575.6us
I20260709 12:10:02.634604 15674 consensus_queue.cc:1048] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.084s
I20260709 12:10:02.725912 14877 leader_election.cc:304] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:10:02.717767 15778 raft_consensus.cc:3060] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:02.677202 15814 consensus_queue.cc:1048] T f4739bc22bfe44fcba807da02d9351b6 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.080s
W20260709 12:10:02.718675 15769 log.cc:927] Time spent T 00000000000000000000000000000000 P d07070be2c074f4cb9ad35f1580c4ef7: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
W20260709 12:10:02.730557 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 151802us
I20260709 12:10:02.719969 15774 raft_consensus.cc:493] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:02.743440 15853 log.cc:927] Time spent T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 12:10:02.745550 15791 leader_election.cc:290] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:02.746027 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:02.748246 14909 raft_consensus.cc:1275] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:10:02.692018 15766 consensus_queue.cc:1048] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 12:10:02.752506 15732 leader_election.cc:290] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:02.758186 15847 raft_consensus.cc:697] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 3 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:10:02.677598 15854 raft_consensus.cc:515] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:02.702193 15826 consensus_queue.cc:1048] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.044s
I20260709 12:10:02.718232 15728 raft_consensus.cc:493] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:02.637764 15816 raft_consensus.cc:515] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:02.721191 14304 leader_election.cc:304] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:10:02.705204 15600 raft_consensus.cc:515] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:02.624303 15857 raft_consensus.cc:515] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:02.731379 15718 raft_consensus.cc:2804] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:02.732033 15720 raft_consensus.cc:493] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:02.816547 15600 leader_election.cc:290] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:02.816883 15720 raft_consensus.cc:3060] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:02.776077 14182 raft_consensus.cc:2468] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 2.
I20260709 12:10:02.773747 15774 raft_consensus.cc:3060] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:02.822005 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 100903us
I20260709 12:10:02.823040 14304 leader_election.cc:304] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:10:02.823917 14304 leader_election.cc:304] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:10:02.773641 15837 raft_consensus.cc:2804] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:02.776531 15759 leader_election.cc:290] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:02.812137 14338 raft_consensus.cc:2468] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 2.
I20260709 12:10:02.811651 15718 raft_consensus.cc:493] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:02.815441 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:02.801088 15708 consensus_queue.cc:1048] T f4739bc22bfe44fcba807da02d9351b6 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 12:10:02.825541 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:02.859494 14263 raft_consensus.cc:2393] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 5: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:10:02.826097 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:02.860211 14339 raft_consensus.cc:2393] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 2: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:10:02.831183 15738 raft_consensus.cc:2804] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:02.832168 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:02.832629 15726 leader_election.cc:290] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:02.835675 14229 leader_election.cc:304] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:02.808665 15728 raft_consensus.cc:3060] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:02.839419 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:02.824186 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:02.874027 14260 raft_consensus.cc:2468] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 2.
I20260709 12:10:02.874909 14335 raft_consensus.cc:2468] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 5.
I20260709 12:10:02.857568 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:02.785955 15852 consensus_queue.cc:1048] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.078s
I20260709 12:10:02.877041 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:02.866389 14182 raft_consensus.cc:2393] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db in current term 3: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:10:02.878005 14331 raft_consensus.cc:2468] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 2.
I20260709 12:10:02.869449 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:02.879567 14332 raft_consensus.cc:2393] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 3: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:10:02.880403 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:02.879109 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:02.876068 14336 raft_consensus.cc:2468] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 5.
I20260709 12:10:02.885489 14333 raft_consensus.cc:2393] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 2: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:10:02.855963 15718 raft_consensus.cc:3060] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:02.854733 15744 raft_consensus.cc:2804] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:02.880970 15791 raft_consensus.cc:2804] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:02.836560 15865 raft_consensus.cc:493] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:02.902144 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:02.836560 15732 consensus_queue.cc:1048] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.052s
I20260709 12:10:02.937541 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:02.907361 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:02.908022 14304 leader_election.cc:304] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:10:02.845099 15802 raft_consensus.cc:515] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:02.914005 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:02.916572 14265 raft_consensus.cc:3060] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:02.903771 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:02.946831 14262 raft_consensus.cc:2468] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 2.
I20260709 12:10:02.891491 15738 raft_consensus.cc:697] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 3 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:02.881376 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:02.891146 15770 raft_consensus.cc:493] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:02.927423 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:02.951550 14258 raft_consensus.cc:2468] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 2.
I20260709 12:10:02.928632 15854 leader_election.cc:290] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:02.865779 15862 raft_consensus.cc:2804] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:02.935060 15816 leader_election.cc:290] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:02.902354 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:02.984674 14264 raft_consensus.cc:2468] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 2.
I20260709 12:10:02.910745 15791 raft_consensus.cc:493] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:10:02.992321 15791 raft_consensus.cc:3060] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:02.914752 15863 raft_consensus.cc:493] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:02.936820 15865 raft_consensus.cc:515] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:02.949121 14337 raft_consensus.cc:2393] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 2: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:10:02.868480 15766 consensus_queue.cc:1048] T f4739bc22bfe44fcba807da02d9351b6 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.077s
I20260709 12:10:02.958801 14331 raft_consensus.cc:2393] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 2: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:10:02.957144 15862 raft_consensus.cc:493] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:02.956717 15828 raft_consensus.cc:2804] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:02.969310 14304 leader_election.cc:304] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:10:03.004208 14304 leader_election.cc:304] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:10:02.953831 15860 raft_consensus.cc:493] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:02.957065 15770 raft_consensus.cc:515] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:03.005172 14304 leader_election.cc:304] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:10:02.972443 15802 leader_election.cc:290] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:02.973912 15598 raft_consensus.cc:493] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:02.974181 15738 consensus_queue.cc:237] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:03.011478 15770 leader_election.cc:290] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:10:03.005376 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 237084us
I20260709 12:10:03.015230 15865 leader_election.cc:290] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:03.006604 15862 raft_consensus.cc:3060] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:03.018734 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:03.019459 14260 raft_consensus.cc:2468] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 3.
I20260709 12:10:02.980376 15795 raft_consensus.cc:515] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:02.911624 15744 raft_consensus.cc:493] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:02.989255 14265 raft_consensus.cc:2468] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 4.
I20260709 12:10:03.032148 15744 raft_consensus.cc:3060] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:03.032686 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:03.033618 15854 raft_consensus.cc:2804] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:03.033972 14331 raft_consensus.cc:2393] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 3: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:10:03.034226 15854 raft_consensus.cc:493] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:03.034801 15854 raft_consensus.cc:3060] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:03.035163 15784 leader_election.cc:290] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:03.038477 14258 raft_consensus.cc:1240] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:03.009430 15863 raft_consensus.cc:515] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:03.010941 15598 raft_consensus.cc:3060] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:03.009588 15845 leader_election.cc:290] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:03.006366 15828 raft_consensus.cc:493] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:03.029680 14155 leader_election.cc:304] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:03.020457 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:03.041297 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:03.032837 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:03.048628 14304 leader_election.cc:304] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:10:03.028414 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:03.011116 15844 raft_consensus.cc:2804] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:03.053864 14260 raft_consensus.cc:2468] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 2.
I20260709 12:10:02.946617 15847 consensus_queue.cc:237] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:03.020957 15816 raft_consensus.cc:2804] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:10:03.074278 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 283737us
I20260709 12:10:03.054046 14265 raft_consensus.cc:3060] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:10:03.076619 14258 raft_consensus.cc:2468] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 1.
I20260709 12:10:03.086478 14304 leader_election.cc:304] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:10:03.086133 14335 raft_consensus.cc:2468] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 2.
I20260709 12:10:03.091876 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:03.095378 15732 raft_consensus.cc:2804] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:03.096253 15732 raft_consensus.cc:697] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 4 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:03.108983 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:03.104416 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:03.119817 14155 leader_election.cc:304] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:03.121562 14155 leader_election.cc:304] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:03.084656 15844 raft_consensus.cc:493] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:03.135811 15844 raft_consensus.cc:3060] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:03.057665 15828 raft_consensus.cc:3060] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:03.025107 15754 raft_consensus.cc:515] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:03.020361 15859 raft_consensus.cc:515] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:03.090411 15816 raft_consensus.cc:493] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:03.011384 15860 raft_consensus.cc:515] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:03.133656 15778 raft_consensus.cc:515] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:03.261241 14908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:10:03.077356 15770 raft_consensus.cc:493] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:03.082855 15865 raft_consensus.cc:2804] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:03.198160 15788 consensus_queue.cc:1059] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:10:03.398594 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 312203us
W20260709 12:10:03.416978 15721 consensus_meta.cc:287] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.682s	user 0.011s	sys 0.012s
I20260709 12:10:03.145457 15725 raft_consensus.cc:2804] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:03.136389 15732 consensus_queue.cc:237] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:10:03.398537 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 257602us
W20260709 12:10:03.415298 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 269352us
I20260709 12:10:03.432869 15868 raft_consensus.cc:493] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:03.434235 14909 raft_consensus.cc:2393] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 3: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
I20260709 12:10:03.400481 14265 raft_consensus.cc:2468] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 3.
I20260709 12:10:03.413522 15849 raft_consensus.cc:2804] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:03.416550 15816 raft_consensus.cc:3060] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:03.443149 14256 raft_consensus.cc:2468] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 3.
W20260709 12:10:03.447153 14154 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.000s	sys 0.053s
W20260709 12:10:03.502300 14154 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.591s	user 0.001s	sys 0.053s
I20260709 12:10:03.433606 15850 raft_consensus.cc:2804] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:10:03.447093 15837 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.577s	user 0.021s	sys 0.031s
I20260709 12:10:03.436236 15865 raft_consensus.cc:493] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:03.436533 15792 raft_consensus.cc:493] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
W20260709 12:10:03.451555 14330 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.634s	user 0.037s	sys 0.036s
I20260709 12:10:03.436260 14908 raft_consensus.cc:3060] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:03.437539 15769 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.660s	user 0.011s	sys 0.026s
I20260709 12:10:03.436249 15770 raft_consensus.cc:515] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:03.446290 15725 raft_consensus.cc:493] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:10:03.508275 14906 raft_consensus.cc:1275] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:10:03.504700 15850 raft_consensus.cc:493] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:03.508608 15837 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.638s	user 0.022s	sys 0.031s
I20260709 12:10:03.498435 15857 leader_election.cc:290] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:03.456936 15795 leader_election.cc:290] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 2 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:03.500257 15849 raft_consensus.cc:493] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:03.555274 15849 raft_consensus.cc:3060] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:03.547734 15862 consensus_meta.cc:287] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.531s	user 0.005s	sys 0.020s
W20260709 12:10:03.512409 14330 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.695s	user 0.037s	sys 0.036s
W20260709 12:10:03.512779 15774 consensus_meta.cc:287] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.680s	user 0.011s	sys 0.004s
W20260709 12:10:03.516678 15718 consensus_meta.cc:287] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db: Time spent flushing consensus metadata: real 0.602s	user 0.009s	sys 0.005s
I20260709 12:10:03.507805 15597 raft_consensus.cc:3055] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:03.446591 15721 raft_consensus.cc:515] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:10:03.515837 15769 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.738s	user 0.012s	sys 0.027s
I20260709 12:10:03.510149 15865 raft_consensus.cc:3060] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:03.502785 15868 raft_consensus.cc:515] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:03.576345 15718 raft_consensus.cc:515] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:03.549659 15725 raft_consensus.cc:3060] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:10:03.583833 14259 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.632s	user 0.005s	sys 0.022s
I20260709 12:10:03.549355 15850 raft_consensus.cc:3060] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:03.553333 15837 raft_consensus.cc:697] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 3 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
W20260709 12:10:03.584241 14259 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.632s	user 0.005s	sys 0.022s
I20260709 12:10:03.516254 15792 raft_consensus.cc:515] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:03.554497 15826 raft_consensus.cc:493] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
W20260709 12:10:03.602674 14876 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.768s	user 0.009s	sys 0.018s
W20260709 12:10:03.621223 14876 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.787s	user 0.009s	sys 0.018s
I20260709 12:10:03.572677 15597 raft_consensus.cc:740] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
W20260709 12:10:03.621598 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 786974us
I20260709 12:10:03.622979 14912 raft_consensus.cc:2393] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 3: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
I20260709 12:10:03.609165 15863 leader_election.cc:290] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:03.573814 15774 raft_consensus.cc:515] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:03.563925 15862 raft_consensus.cc:515] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:03.618659 15750 raft_consensus.cc:493] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:03.629432 15726 raft_consensus.cc:493] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:03.641186 15855 raft_consensus.cc:2804] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:03.642223 15830 raft_consensus.cc:493] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
W20260709 12:10:03.630275 15871 log.cc:927] Time spent T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:10:03.649143 15726 raft_consensus.cc:515] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:03.657877 15718 leader_election.cc:290] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 3 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:10:03.652204 15728 consensus_meta.cc:287] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.755s	user 0.015s	sys 0.008s
I20260709 12:10:03.623580 15826 raft_consensus.cc:515] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:10:03.693485 14339 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.803s	user 0.002s	sys 0.038s
W20260709 12:10:03.698540 14339 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.809s	user 0.002s	sys 0.038s
W20260709 12:10:03.702677 14262 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.720s	user 0.013s	sys 0.028s
W20260709 12:10:03.715123 14262 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.733s	user 0.014s	sys 0.029s
W20260709 12:10:03.714250 14336 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.801s	user 0.007s	sys 0.035s
W20260709 12:10:03.709723 14334 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.767s	user 0.016s	sys 0.039s
W20260709 12:10:03.716281 14336 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.803s	user 0.007s	sys 0.035s
W20260709 12:10:03.716373 14334 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.774s	user 0.017s	sys 0.039s
W20260709 12:10:03.716512 14155 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.578s	user 0.014s	sys 0.045s
I20260709 12:10:03.717938 15792 leader_election.cc:290] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:10:03.718273 14155 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.580s	user 0.014s	sys 0.045s
I20260709 12:10:03.686184 15778 leader_election.cc:290] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 4 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:10:03.720479 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 581848us
W20260709 12:10:03.719328 14333 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.769s	user 0.018s	sys 0.026s
W20260709 12:10:03.726444 14333 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.776s	user 0.018s	sys 0.026s
I20260709 12:10:03.652601 15750 raft_consensus.cc:515] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:03.729043 14155 leader_election.cc:304] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:03.691347 15728 raft_consensus.cc:515] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:03.691617 15830 raft_consensus.cc:515] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:10:03.729905 15738 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.589s	user 0.045s	sys 0.093s
I20260709 12:10:03.656767 15597 consensus_queue.cc:260] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:03.764354 15865 raft_consensus.cc:515] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:10:03.764884 15720 consensus_meta.cc:287] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.947s	user 0.015s	sys 0.001s
I20260709 12:10:03.759116 15778 raft_consensus.cc:2804] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:10:03.769785 15738 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.634s	user 0.046s	sys 0.093s
W20260709 12:10:03.810688 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 307221us
I20260709 12:10:03.760833 15770 leader_election.cc:290] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:03.761579 15860 leader_election.cc:290] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:10:03.809278 15744 consensus_meta.cc:287] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.776s	user 0.011s	sys 0.004s
I20260709 12:10:03.763227 14908 raft_consensus.cc:2468] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 3.
I20260709 12:10:03.855298 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:03.715348 15837 consensus_queue.cc:237] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:03.862597 14257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41768 (request call id 1200) took 1256 ms. Trace:
I20260709 12:10:03.776996 15814 raft_consensus.cc:493] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:03.814680 15721 leader_election.cc:290] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 2 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:10:03.869598 14156 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.601s	user 0.015s	sys 0.049s
W20260709 12:10:03.884410 14156 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.725s	user 0.016s	sys 0.049s
I20260709 12:10:03.866822 14304 leader_election.cc:304] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:10:03.809096 15852 raft_consensus.cc:493] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:03.904212 15892 raft_consensus.cc:493] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:03.914623 15852 raft_consensus.cc:515] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:10:03.870034 15877 log.cc:927] Time spent T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 12:10:03.876809 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:03.827390 15778 raft_consensus.cc:493] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:03.865267 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:03.859804 15597 raft_consensus.cc:3060] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:03.898336 15898 raft_consensus.cc:493] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:03.863718 15770 raft_consensus.cc:493] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:03.869038 15726 leader_election.cc:290] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:03.832924 15720 raft_consensus.cc:515] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:10:03.869087 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 52530us
I20260709 12:10:03.914692 15892 raft_consensus.cc:515] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:03.919649 14256 raft_consensus.cc:3060] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:03.926302 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 59594.8us
I20260709 12:10:03.934887 14304 leader_election.cc:304] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:10:03.874747 15744 raft_consensus.cc:515] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:03.878875 15868 leader_election.cc:290] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:03.913528 15759 raft_consensus.cc:493] T bf9bea0d16e44efabb5cdd53e3828438 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:10:03.993167 14336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50856 (request call id 1438) took 1118 ms. Trace:
I20260709 12:10:03.919201 15774 leader_election.cc:290] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:03.927551 15778 raft_consensus.cc:3060] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:03.997645 14336 rpcz_store.cc:276] 0709 12:10:02.874529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:02.883576 (+  9047us) service_pool.cc:224] Handling call
0709 12:10:02.883906 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:02.884146 (+   240us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:10:03.717767 (+833621us) log.cc:844] Serialized 14 byte log entry
0709 12:10:03.935795 (+218028us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:03.992790 (+ 56995us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:03.992853 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:03.992933 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:03.993092 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30370,"prepare.queue_time_us":975930,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":2995,"thread_start_us":991227,"threads_started":2}
I20260709 12:10:04.005956 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:04.006633 14336 raft_consensus.cc:3060] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:03.994066 15803 raft_consensus.cc:493] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:04.015949 14332 raft_consensus.cc:2368] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 2. Current term is 3.
I20260709 12:10:04.016110 14259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41768 (request call id 1211) took 1132 ms. Trace:
I20260709 12:10:03.916584 15814 raft_consensus.cc:515] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:04.027359 15766 raft_consensus.cc:493] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:04.028175 15766 raft_consensus.cc:515] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:04.021497 14259 rpcz_store.cc:276] 0709 12:10:02.883980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:02.884302 (+   322us) service_pool.cc:224] Handling call
0709 12:10:02.884625 (+   323us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:02.886673 (+  2048us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:02.886709 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:02.899543 (+ 12834us) log.cc:844] Serialized 26 byte log entry
0709 12:10:03.589316 (+689773us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:03.589362 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:03.590410 (+  1048us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:04.015852 (+425442us) raft_consensus.cc:1685] finished
0709 12:10:04.015874 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:04.016042 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1635,"raft.queue_time_us":1766,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":6191,"thread_start_us":637337,"threads_started":1,"wal-append.queue_time_us":814223}
I20260709 12:10:04.031031 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:04.034308 15728 leader_election.cc:290] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 3 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:04.003123 15743 raft_consensus.cc:2804] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:04.039292 15814 leader_election.cc:290] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:04.039698 15744 leader_election.cc:290] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:03.930557 15874 raft_consensus.cc:493] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:04.034564 15865 leader_election.cc:290] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:03.930814 15770 raft_consensus.cc:515] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:04.048455 14256 raft_consensus.cc:2468] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 4.
I20260709 12:10:04.021701 15868 raft_consensus.cc:493] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:04.019642 15750 leader_election.cc:290] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:04.053452 15743 raft_consensus.cc:697] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 3 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
W20260709 12:10:04.053882 15882 log.cc:927] Time spent T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
I20260709 12:10:04.055333 14336 raft_consensus.cc:2468] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 4.
I20260709 12:10:04.025928 15845 raft_consensus.cc:2804] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:04.059206 15728 raft_consensus.cc:493] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:10:04.070098 15743 consensus_queue.cc:237] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:04.070482 15728 raft_consensus.cc:515] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:04.072173 14333 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50858 (request call id 1243) took 1188 ms. Trace:
I20260709 12:10:04.072605 14333 rpcz_store.cc:276] 0709 12:10:02.883535 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:02.890980 (+  7445us) service_pool.cc:224] Handling call
0709 12:10:02.891344 (+   364us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:02.898517 (+  7173us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:02.898550 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:02.926494 (+ 27944us) log.cc:844] Serialized 26 byte log entry
0709 12:10:03.726948 (+800454us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:03.726998 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:03.727081 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:04.071886 (+344805us) raft_consensus.cc:1685] finished
0709 12:10:04.071909 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:04.072075 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12102,"raft.queue_time_us":114,"raft.run_cpu_time_us":228,"raft.run_wall_time_us":16982,"thread_start_us":776196,"threads_started":1,"wal-append.queue_time_us":1128116}
I20260709 12:10:04.074445 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:10:04.063066 15598 consensus_meta.cc:287] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db: Time spent flushing consensus metadata: real 0.986s	user 0.014s	sys 0.000s
I20260709 12:10:04.067291 15845 raft_consensus.cc:493] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:10:04.073704 15728 leader_election.cc:290] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:04.066810 15868 raft_consensus.cc:515] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:04.078826 15598 raft_consensus.cc:515] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:04.082315 15598 leader_election.cc:290] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 3 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:04.074656 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:04.073953 15792 raft_consensus.cc:493] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:04.084049 15792 raft_consensus.cc:515] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } }
W20260709 12:10:04.084827 15844 consensus_meta.cc:287] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.948s	user 0.003s	sys 0.009s
W20260709 12:10:04.087561 15828 consensus_meta.cc:287] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.888s	user 0.007s	sys 0.006s
I20260709 12:10:04.011351 15898 raft_consensus.cc:515] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:03.995689 15759 raft_consensus.cc:515] T bf9bea0d16e44efabb5cdd53e3828438 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:04.042944 15874 raft_consensus.cc:515] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:04.078179 15845 raft_consensus.cc:3060] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:04.026625 15803 raft_consensus.cc:515] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:04.057801 15860 raft_consensus.cc:493] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:04.051565 15826 leader_election.cc:290] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:04.088207 15828 raft_consensus.cc:515] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:04.104243 15890 raft_consensus.cc:493] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:04.088738 15792 leader_election.cc:290] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187)
W20260709 12:10:04.101074 15791 consensus_meta.cc:287] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 1.103s	user 0.009s	sys 0.006s
I20260709 12:10:04.085436 15844 raft_consensus.cc:515] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:04.139740 15792 raft_consensus.cc:493] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:10:04.140574 15792 raft_consensus.cc:515] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:04.141155 15754 leader_election.cc:290] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:04.141978 15890 raft_consensus.cc:515] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:04.142964 15791 raft_consensus.cc:515] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:04.149545 15792 leader_election.cc:290] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:04.157222 15868 leader_election.cc:290] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:04.157821 15754 raft_consensus.cc:493] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:04.158628 15754 raft_consensus.cc:515] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:04.160861 15828 leader_election.cc:290] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 6 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:04.161453 15721 raft_consensus.cc:493] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:04.162271 15721 raft_consensus.cc:515] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:04.121842 15725 raft_consensus.cc:515] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:04.122838 15770 leader_election.cc:290] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:04.163757 15754 leader_election.cc:290] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:03.876508 14257 rpcz_store.cc:276] 0709 12:10:02.605871 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:02.607374 (+  1503us) service_pool.cc:224] Handling call
0709 12:10:02.622092 (+ 14718us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:02.629013 (+  6921us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:02.629071 (+    58us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:02.629814 (+   743us) log.cc:844] Serialized 26 byte log entry
0709 12:10:02.773450 (+143636us) spinlock_profiling.cc:243] Waited 3.37 ms on lock 0x7b18003aa080. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f212cf16ab1 00007f212cf23281 00007f2124030e07 00007f212ce8b9a9 00007f212404d69b 00007f212404b93f 00007f212404dc02 00007f2126cd520b 00007f2126cdad23 00007f2126cdb0d1 00007f21270f6a0f
0709 12:10:03.050158 (+276708us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:03.078849 (+ 28691us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:03.097561 (+ 18712us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:03.733024 (+635463us) raft_consensus.cc:1685] finished
0709 12:10:03.733052 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:03.858569 (+125517us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6332,"raft.queue_time_us":7117,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":96,"spinlock_wait_cycles":7754624,"thread_start_us":229893,"threads_started":1,"wal-append.queue_time_us":822764}
I20260709 12:10:04.181172 14908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:10:04.154414 15766 leader_election.cc:290] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:04.114599 15860 raft_consensus.cc:515] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:04.188834 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:04.157287 15791 leader_election.cc:290] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 2 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:04.176779 15846 raft_consensus.cc:493] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:10:04.164093 15852 leader_election.cc:290] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:04.168514 15844 leader_election.cc:290] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:04.200533 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:04.210398 14339 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50858 (request call id 1242) took 1327 ms. Trace:
W20260709 12:10:04.212833 15873 log.cc:927] Time spent T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.240s	user 0.000s	sys 0.001s
I20260709 12:10:04.210983 14339 rpcz_store.cc:276] 0709 12:10:02.883178 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:02.885464 (+  2286us) service_pool.cc:224] Handling call
0709 12:10:02.885808 (+   344us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:02.888995 (+  3187us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:02.889030 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:02.889564 (+   534us) log.cc:844] Serialized 26 byte log entry
0709 12:10:03.698981 (+809417us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:03.699030 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:03.699110 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:04.210062 (+510952us) raft_consensus.cc:1685] finished
0709 12:10:04.210088 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:04.210313 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2762,"raft.queue_time_us":4096,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":158,"thread_start_us":808864,"threads_started":1,"wal-append.queue_time_us":1173327}
I20260709 12:10:04.187409 15720 leader_election.cc:290] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 3 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:04.191852 15859 leader_election.cc:290] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 3 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:04.220626 14258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41764 (request call id 1842) took 1199 ms. Trace:
I20260709 12:10:04.223802 14258 rpcz_store.cc:276] 0709 12:10:03.021710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:03.104014 (+ 82304us) service_pool.cc:224] Handling call
0709 12:10:03.106266 (+  2252us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:03.106816 (+   550us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:03.106845 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:03.107331 (+   486us) log.cc:844] Serialized 26 byte log entry
0709 12:10:03.880506 (+773175us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:10:03.880552 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:03.880631 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:04.220326 (+339695us) raft_consensus.cc:1685] finished
0709 12:10:04.220352 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:04.220549 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":89,"raft.run_cpu_time_us":203,"raft.run_wall_time_us":25145,"thread_start_us":454365,"threads_started":1,"wal-append.queue_time_us":1002409}
W20260709 12:10:04.227028 14303 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.771s	user 0.018s	sys 0.059s
W20260709 12:10:04.227429 14303 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.772s	user 0.018s	sys 0.059s
I20260709 12:10:04.220818 14330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50858 (request call id 1231) took 1961 ms. Trace:
W20260709 12:10:04.227741 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 772119us
I20260709 12:10:04.216935 14908 raft_consensus.cc:2393] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 3: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
I20260709 12:10:04.238922 15725 leader_election.cc:290] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 2 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:04.240276 14908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
W20260709 12:10:04.241168 15816 consensus_meta.cc:287] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.729s	user 0.011s	sys 0.002s
I20260709 12:10:04.198609 15830 leader_election.cc:290] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:04.235699 15892 leader_election.cc:290] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:04.273027 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:04.242880 15890 leader_election.cc:290] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:04.287884 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:04.286085 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:04.273943 14909 raft_consensus.cc:2468] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 3.
I20260709 12:10:04.287086 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:04.290345 14189 raft_consensus.cc:2468] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 5.
I20260709 12:10:04.291555 14186 raft_consensus.cc:1275] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:04.203279 15846 raft_consensus.cc:515] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:04.241699 15816 raft_consensus.cc:515] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:04.285056 15844 raft_consensus.cc:493] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:04.296422 15854 consensus_meta.cc:287] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 1.261s	user 0.011s	sys 0.005s
I20260709 12:10:04.304778 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:04.310698 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:04.311069 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:04.311589 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:04.311949 15860 leader_election.cc:290] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:04.313513 15874 leader_election.cc:290] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:04.383976 14183 raft_consensus.cc:2468] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 2.
W20260709 12:10:04.314606 15885 log.cc:927] Time spent T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.398s	user 0.002s	sys 0.002s
I20260709 12:10:04.316068 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:04.316809 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:04.317190 14264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41768 (request call id 1214) took 1321 ms. Trace:
W20260709 12:10:04.299328 15881 log.cc:927] Time spent T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.117s	user 0.001s	sys 0.001s
I20260709 12:10:04.318523 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:04.294521 15869 raft_consensus.cc:493] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:10:04.382325 14086 catalog_manager.cc:5697] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf reported cstate change: term changed from 2 to 3, leader changed from 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130) to 885067a0d31741bfb5c9935788e315bf (127.12.174.129). New cstate: current_term: 3 leader_uuid: "885067a0d31741bfb5c9935788e315bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:04.318903 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:04.315933 14181 raft_consensus.cc:1275] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:10:04.228916 14330 rpcz_store.cc:276] 0709 12:10:02.259249 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:02.395383 (+136134us) service_pool.cc:224] Handling call
0709 12:10:02.439895 (+ 44512us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:02.767221 (+327326us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:02.771663 (+  4442us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:02.817193 (+ 45530us) log.cc:844] Serialized 26 byte log entry
0709 12:10:03.577476 (+760283us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:03.585170 (+  7694us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:04.215084 (+629914us) spinlock_profiling.cc:243] Waited 88.2 ms on lock 0x7b5400146754. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:10:04.215171 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:04.215275 (+   104us) raft_consensus.cc:1685] finished
0709 12:10:04.215294 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:04.220701 (+  5407us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9640,"raft.queue_time_us":58778,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":158,"spinlock_wait_cycles":202756864,"thread_start_us":895725,"threads_started":2,"wal-append.queue_time_us":912694}
I20260709 12:10:04.320438 15855 raft_consensus.cc:493] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:10:04.321003 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:04.321445 15759 leader_election.cc:290] T bf9bea0d16e44efabb5cdd53e3828438 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:04.322026 15898 leader_election.cc:290] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:04.402951 15778 raft_consensus.cc:515] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:04.405095 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:04.407084 14185 raft_consensus.cc:2393] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 3: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:10:04.322739 14332 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50856 (request call id 1439) took 1447 ms. Trace:
I20260709 12:10:04.326382 15721 leader_election.cc:290] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:04.299907 15803 leader_election.cc:290] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:10:04.332846 15849 consensus_meta.cc:287] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.777s	user 0.014s	sys 0.000s
I20260709 12:10:04.335445 15846 leader_election.cc:290] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:04.336521 15854 raft_consensus.cc:515] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:04.339365 15597 raft_consensus.cc:493] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:04.460124 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:04.460990 14185 raft_consensus.cc:2468] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 2.
I20260709 12:10:04.462651 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:04.340976 14263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:51304 (request call id 84) took 1360 ms. Trace:
W20260709 12:10:04.348974 15850 consensus_meta.cc:287] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.738s	user 0.010s	sys 0.004s
I20260709 12:10:04.351606 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:04.464690 14229 leader_election.cc:304] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:04.465126 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:04.343641 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:04.466094 14259 raft_consensus.cc:3060] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:10:04.354310 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:04.355885 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:04.350790 15892 raft_consensus.cc:493] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:10:04.469398 15778 leader_election.cc:290] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 3 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:04.469811 14337 raft_consensus.cc:2393] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 3: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:10:04.406368 15855 raft_consensus.cc:3060] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:04.391167 15869 raft_consensus.cc:515] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:04.364254 14907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:04.365290 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:04.365885 15862 leader_election.cc:290] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:04.371595 14085 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60420 (request call id 252) took 2411 ms. Trace:
I20260709 12:10:04.304215 15844 raft_consensus.cc:515] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:04.329035 15845 raft_consensus.cc:515] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:04.374251 14087 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44116 (request call id 153) took 2284 ms. Trace:
I20260709 12:10:04.374949 15802 raft_consensus.cc:493] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:10:04.375517 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:04.376009 14328 tablet_service.cc:1558] Processing DeleteTablet for tablet bf9bea0d16e44efabb5cdd53e3828438 with delete_type TABLET_DATA_TOMBSTONED (TS 65c9c1653b3346b39a0e118540e6080c not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:55416
I20260709 12:10:04.379237 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:04.387604 14190 raft_consensus.cc:2410] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:10:04.387327 14264 rpcz_store.cc:276] 0709 12:10:02.996214 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:02.997183 (+   969us) service_pool.cc:224] Handling call
0709 12:10:03.556287 (+559104us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:03.556725 (+   438us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:03.556763 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:03.570789 (+ 14026us) log.cc:844] Serialized 26 byte log entry
0709 12:10:03.811578 (+240789us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:03.811633 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:03.811717 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:04.088199 (+276482us) raft_consensus.cc:1685] finished
0709 12:10:04.088222 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:04.316864 (+228642us) spinlock_profiling.cc:243] Waited 559 ms on lock 0x7b54002fc950. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713a8ad 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:10:04.317118 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3022,"raft.run_cpu_time_us":201,"raft.run_wall_time_us":13511,"spinlock_wait_cycles":1284777728,"thread_start_us":202088,"threads_started":1,"wal-append.queue_time_us":412993}
I20260709 12:10:04.391955 14086 catalog_manager.cc:5697] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf reported cstate change: term changed from 2 to 3, leader changed from 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130) to 885067a0d31741bfb5c9935788e315bf (127.12.174.129). New cstate: current_term: 3 leader_uuid: "885067a0d31741bfb5c9935788e315bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:04.490980 14086 catalog_manager.cc:5697] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf reported cstate change: term changed from 2 to 3, leader changed from 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130) to 885067a0d31741bfb5c9935788e315bf (127.12.174.129). New cstate: current_term: 3 leader_uuid: "885067a0d31741bfb5c9935788e315bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:04.470378 15791 raft_consensus.cc:2804] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:04.492801 14086 catalog_manager.cc:5697] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf reported cstate change: term changed from 1 to 2, leader changed from 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130) to 885067a0d31741bfb5c9935788e315bf (127.12.174.129). New cstate: current_term: 2 leader_uuid: "885067a0d31741bfb5c9935788e315bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } }
W20260709 12:10:04.487561 14304 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.004s	sys 0.025s
W20260709 12:10:04.497872 14304 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.562s	user 0.004s	sys 0.025s
W20260709 12:10:04.498171 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 563337us
I20260709 12:10:04.501152 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:04.503168 15862 raft_consensus.cc:493] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:10:04.504382 14334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50858 (request call id 1244) took 1588 ms. Trace:
W20260709 12:10:04.503639 14302 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.557s	user 0.036s	sys 0.032s
I20260709 12:10:04.505395 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
W20260709 12:10:04.505906 14302 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.560s	user 0.036s	sys 0.033s
I20260709 12:10:04.506618 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:04.439723 15774 raft_consensus.cc:493] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:04.401048 14189 raft_consensus.cc:3060] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:04.400985 15860 raft_consensus.cc:493] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:10:04.439637 14188 raft_consensus.cc:2468] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 2.
I20260709 12:10:04.340354 14908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:04.497402 15791 raft_consensus.cc:493] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:04.467121 14256 raft_consensus.cc:3060] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:10:04.513286 15774 raft_consensus.cc:515] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:04.513938 15791 raft_consensus.cc:3060] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:04.463328 14263 rpcz_store.cc:276] 0709 12:10:02.980163 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:02.980328 (+   165us) service_pool.cc:224] Handling call
0709 12:10:04.340603 (+1360275us) spinlock_profiling.cc:243] Waited 609 ms on lock 0x7b5400072954. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f2127141735 00007f21271399fa 00007f212c1014c9 00007f212567dc54 00007f212567dbe2 00007f212567db11 00007f212567da8c 00007f212567cd42 00007f212547648c 00007f21254758c6
0709 12:10:04.340858 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1400106368}
I20260709 12:10:04.393018 15863 raft_consensus.cc:493] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:04.468494 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:04.458356 15890 raft_consensus.cc:493] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:04.340667 15816 leader_election.cc:290] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:04.477973 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:04.526645 14187 raft_consensus.cc:2468] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 2.
I20260709 12:10:04.465713 14183 raft_consensus.cc:3060] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:04.527068 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:04.527763 14265 raft_consensus.cc:3060] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:04.498179 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
W20260709 12:10:04.529155 14074 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet f4739bc22bfe44fcba807da02d9351b6 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 17aab1bbf5014936aa18cc21818b26ec is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 leader_uuid: "885067a0d31741bfb5c9935788e315bf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
W20260709 12:10:04.479809 14153 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.024s	sys 0.041s
I20260709 12:10:04.409255 14332 rpcz_store.cc:276] 0709 12:10:02.874799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:02.880153 (+  5354us) service_pool.cc:224] Handling call
0709 12:10:04.322483 (+1442330us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b54000b7a54. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:10:04.322639 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2609834880}
I20260709 12:10:04.553694 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:04.554389 14332 raft_consensus.cc:3060] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:04.482472 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:04.554406 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:04.482415 14262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41768 (request call id 1213) took 1502 ms. Trace:
I20260709 12:10:04.555335 14181 raft_consensus.cc:2368] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 2. Current term is 3.
I20260709 12:10:04.441865 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:04.461567 15721 raft_consensus.cc:493] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:04.557626 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:04.558327 14264 raft_consensus.cc:3060] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:04.556053 14153 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.614s	user 0.024s	sys 0.041s
I20260709 12:10:04.467988 15754 raft_consensus.cc:493] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
W20260709 12:10:04.482144 14337 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50856 (request call id 1442) took 1438 ms (client timeout 1881 ms). Trace:
I20260709 12:10:04.489581 14087 rpcz_store.cc:276] 0709 12:10:02.090314 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:02.090581 (+   267us) service_pool.cc:224] Handling call
0709 12:10:04.374178 (+2283597us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:02.691168 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:02.807199 (+116031us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:02.808291 (+  1092us) write_op.cc:435] Acquired schema lock
0709 12:10:02.808312 (+    21us) tablet.cc:662] Decoding operations
0709 12:10:02.868518 (+ 60206us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:02.870933 (+  2415us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:02.870975 (+    42us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:10:02.876851 (+  5876us) tablet.cc:701] Row locks acquired
0709 12:10:02.876869 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:10:02.877114 (+   245us) write_op.cc:270] Start()
0709 12:10:02.877295 (+   181us) write_op.cc:276] Timestamp: P: 1783599002877041 usec, L: 0
0709 12:10:02.877319 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:10:02.878324 (+  1005us) log.cc:844] Serialized 539 byte log entry
0709 12:10:03.927417 (+1049093us) op_driver.cc:464] REPLICATION: finished
0709 12:10:04.001937 (+ 74520us) write_op.cc:301] APPLY: starting
0709 12:10:04.013368 (+ 11431us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:04.025490 (+ 12122us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:04.041537 (+ 16047us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:04.041855 (+   318us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:04.042111 (+   256us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:10:04.042184 (+    73us) write_op.cc:312] APPLY: finished
0709 12:10:04.042443 (+   259us) log.cc:844] Serialized 23 byte log entry
0709 12:10:04.042699 (+   256us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:04.042819 (+   120us) write_op.cc:454] Released schema lock
0709 12:10:04.042879 (+    60us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:04.043399 (+   520us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:04.043446 (+    47us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":410838,"reported_tablets":1,"spinlock_wait_cycles":528128,"child_traces":[["op",{"apply.queue_time_us":2386,"apply.run_cpu_time_us":2630,"apply.run_wall_time_us":41387,"num_ops":1,"prepare.queue_time_us":415418,"prepare.run_cpu_time_us":4626,"prepare.run_wall_time_us":202968,"replication_time_us":1035339}]]}
I20260709 12:10:04.506628 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:04.466054 15849 raft_consensus.cc:515] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:04.385388 14186 raft_consensus.cc:2468] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 2.
I20260709 12:10:04.504776 14334 rpcz_store.cc:276] 0709 12:10:02.916084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:02.941156 (+ 25072us) service_pool.cc:224] Handling call
0709 12:10:02.941523 (+   367us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:02.941922 (+   399us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:02.941952 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:02.942518 (+   566us) log.cc:844] Serialized 26 byte log entry
0709 12:10:03.717111 (+774593us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:10:03.717156 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:03.717235 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:04.313668 (+596433us) spinlock_profiling.cc:243] Waited 7.75 ms on lock 0x7b4400022b4c. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2123f74c85 00007f2123f756a2 00007f2126ce71db 00007f2126ce2aaf 00007f2126cd686e 00007f2126cd5bb6 00007f2126cd57d8 00007f2126cdf221 00007f2126cdf1d9 00007f2126cdf169
0709 12:10:04.497061 (+183393us) raft_consensus.cc:1685] finished
0709 12:10:04.497085 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:04.504306 (+  7221us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6462,"raft.run_cpu_time_us":203,"raft.run_wall_time_us":4069,"spinlock_wait_cycles":17831296,"thread_start_us":774131,"threads_started":1,"wal-append.queue_time_us":871611}
I20260709 12:10:04.467844 15597 raft_consensus.cc:515] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:04.496382 14086 catalog_manager.cc:5697] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf reported cstate change: term changed from 2 to 3, leader changed from 885067a0d31741bfb5c9935788e315bf (127.12.174.129) to 65c9c1653b3346b39a0e118540e6080c (127.12.174.131). New cstate: current_term: 3 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } }
I20260709 12:10:04.511790 14261 raft_consensus.cc:2393] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db in current term 3: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:10:04.523608 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:04.469456 15850 raft_consensus.cc:515] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:04.469811 15892 raft_consensus.cc:515] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:04.501286 15802 raft_consensus.cc:515] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:04.503844 15862 raft_consensus.cc:515] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:04.540529 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
W20260709 12:10:04.580070 14337 rpcz_store.cc:269] 0709 12:10:03.043784 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:03.052122 (+  8338us) service_pool.cc:224] Handling call
0709 12:10:04.481908 (+1429786us) spinlock_profiling.cc:243] Waited 1.36 s on lock 0x7b5400145854. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:10:04.482084 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3127418752}
I20260709 12:10:04.525255 14229 leader_election.cc:304] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:04.598294 14264 raft_consensus.cc:2468] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 3.
W20260709 12:10:04.548828 14155 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.615s	user 0.011s	sys 0.033s
W20260709 12:10:04.614964 14155 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.681s	user 0.012s	sys 0.033s
W20260709 12:10:04.615375 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 681575us
I20260709 12:10:04.616621 14155 leader_election.cc:304] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:04.555549 14262 rpcz_store.cc:276] 0709 12:10:02.980155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:02.980337 (+   182us) service_pool.cc:224] Handling call
0709 12:10:02.980949 (+   612us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:02.981345 (+   396us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:02.981377 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:02.981872 (+   495us) log.cc:844] Serialized 26 byte log entry
0709 12:10:03.715567 (+733695us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:03.715614 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:03.715695 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:04.482185 (+766490us) raft_consensus.cc:1685] finished
0709 12:10:04.482211 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:04.482358 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1013,"raft.run_cpu_time_us":249,"raft.run_wall_time_us":6563,"spinlock_wait_cycles":449280,"thread_start_us":733198,"threads_started":1,"wal-append.queue_time_us":1141750}
W20260709 12:10:04.549190 14876 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.825s	user 0.023s	sys 0.028s
I20260709 12:10:04.483481 14085 rpcz_store.cc:276] 0709 12:10:01.960539 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:01.960670 (+   131us) service_pool.cc:224] Handling call
0709 12:10:02.061539 (+100869us) spinlock_profiling.cc:243] Waited 95.2 ms on lock 0x7b54002e3454. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a5090 00007f2127143f3a 00007f212cef9e9c 00007f212cff804e 00007f212b4b92a4 00007f212b4b9232 00007f212b4b9161 00007f212b4b90dc 00007f212b4b8392 00007f212547648c 00007f21254758c6
0709 12:10:02.098527 (+ 36988us) spinlock_profiling.cc:243] Waited 1.8 ms on lock 0x7b5400030890. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2124017640 00007f212ceee846 00007f212cff890e 00007f212b4b92a4 00007f212b4b9232 00007f212b4b9161 00007f212b4b90dc 00007f212b4b8392 00007f212547648c 00007f21254758c6
0709 12:10:04.371505 (+2272978us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:02.433123 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:02.433787 (+   664us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:02.433827 (+    40us) write_op.cc:435] Acquired schema lock
0709 12:10:02.433846 (+    19us) tablet.cc:662] Decoding operations
0709 12:10:02.434228 (+   382us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:02.434303 (+    75us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:02.434331 (+    28us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:10:02.434521 (+   190us) tablet.cc:701] Row locks acquired
0709 12:10:02.434537 (+    16us) write_op.cc:260] PREPARE: finished
0709 12:10:02.434697 (+   160us) write_op.cc:270] Start()
0709 12:10:02.434816 (+   119us) write_op.cc:276] Timestamp: P: 1783599002434650 usec, L: 0
0709 12:10:02.434839 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 12:10:02.604289 (+169450us) log.cc:844] Serialized 544 byte log entry
0709 12:10:03.680937 (+1076648us) op_driver.cc:464] REPLICATION: finished
0709 12:10:03.907747 (+226810us) write_op.cc:301] APPLY: starting
0709 12:10:03.907860 (+   113us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:03.907976 (+   116us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:03.908153 (+   177us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:03.908526 (+   373us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:03.908739 (+   213us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:10:03.908790 (+    51us) write_op.cc:312] APPLY: finished
0709 12:10:03.909023 (+   233us) log.cc:844] Serialized 23 byte log entry
0709 12:10:03.909227 (+   204us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:03.909305 (+    78us) write_op.cc:454] Released schema lock
0709 12:10:03.909348 (+    43us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:03.909792 (+   444us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:03.909826 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":74032,"reported_tablets":4,"spinlock_wait_cycles":223211264,"child_traces":[["op",{"apply.queue_time_us":226503,"apply.run_cpu_time_us":2041,"apply.run_wall_time_us":2042,"num_ops":1,"prepare.queue_time_us":216402,"prepare.run_cpu_time_us":3582,"prepare.run_wall_time_us":180512,"replication_time_us":1245884,"thread_start_us":410603,"threads_started":2}]]}
I20260709 12:10:04.556545 14182 raft_consensus.cc:2468] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 2.
I20260709 12:10:04.565933 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:04.619272 14263 raft_consensus.cc:2393] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 6: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
W20260709 12:10:04.617924 14876 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.894s	user 0.023s	sys 0.028s
I20260709 12:10:04.619115 14189 raft_consensus.cc:2468] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 3.
I20260709 12:10:04.620863 14155 leader_election.cc:304] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:04.596807 14256 raft_consensus.cc:2468] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 3.
I20260709 12:10:04.573845 15888 raft_consensus.cc:493] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:10:04.574379 15904 raft_consensus.cc:493] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:04.617234 15754 raft_consensus.cc:515] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:04.581025 14190 raft_consensus.cc:2368] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 2. Current term is 3.
I20260709 12:10:04.530081 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:04.523445 15860 raft_consensus.cc:515] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:04.624807 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:04.624720 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:04.624763 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:04.596066 14183 raft_consensus.cc:2468] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 3.
W20260709 12:10:04.579332 15732 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.652s	user 0.002s	sys 0.023s
I20260709 12:10:04.571776 14265 raft_consensus.cc:2468] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 3.
W20260709 12:10:04.546234 14331 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.966s	user 0.016s	sys 0.013s
I20260709 12:10:04.556603 15774 leader_election.cc:290] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:04.632267 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:04.580307 15721 raft_consensus.cc:515] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:04.628968 15904 raft_consensus.cc:515] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:04.627383 14188 raft_consensus.cc:3060] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:04.626958 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:04.621081 14086 catalog_manager.cc:5697] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf reported cstate change: term changed from 2 to 4, leader changed from 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130) to 885067a0d31741bfb5c9935788e315bf (127.12.174.129). New cstate: current_term: 4 leader_uuid: "885067a0d31741bfb5c9935788e315bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } }
W20260709 12:10:04.702214 15914 log.cc:927] Time spent T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 12:10:04.562219 15738 raft_consensus.cc:493] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:10:04.550818 15600 raft_consensus.cc:493] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:04.712121 14184 raft_consensus.cc:2468] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 2.
I20260709 12:10:04.715121 15902 raft_consensus.cc:2804] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:04.628208 15901 raft_consensus.cc:493] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:04.542088 15890 raft_consensus.cc:515] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:04.530066 15863 raft_consensus.cc:515] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:04.716548 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:04.607017 15905 raft_consensus.cc:493] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:10:04.628538 15888 raft_consensus.cc:515] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:04.943508 14262 raft_consensus.cc:3060] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:04.944267 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:04.945055 15721 leader_election.cc:290] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:04.945971 15888 leader_election.cc:290] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:04.946707 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:04.947305 15890 leader_election.cc:290] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:04.827585 15907 raft_consensus.cc:493] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:10:04.948174 15738 raft_consensus.cc:515] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:04.948287 15907 raft_consensus.cc:515] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:04.907752 15844 leader_election.cc:290] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:04.716673 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:04.952028 15905 raft_consensus.cc:515] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:10:04.830585 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 126848us
I20260709 12:10:04.954457 15905 leader_election.cc:290] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:04.831511 15850 leader_election.cc:290] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:04.833223 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:04.956063 15600 raft_consensus.cc:515] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:04.786830 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
W20260709 12:10:04.951678 15732 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.026s	user 0.005s	sys 0.042s
I20260709 12:10:04.957597 14336 raft_consensus.cc:2393] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 2: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:10:04.957839 14338 raft_consensus.cc:1240] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 4 LEADER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 3. Current term is 4. Ops: []
W20260709 12:10:04.828469 15913 log.cc:927] Time spent T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
W20260709 12:10:04.907858 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 200042us
I20260709 12:10:04.883728 15869 leader_election.cc:290] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:04.831938 15846 raft_consensus.cc:493] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:04.961073 15846 raft_consensus.cc:515] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:04.830322 15802 leader_election.cc:290] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:04.811949 14330 raft_consensus.cc:2393] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 2: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:10:04.810163 15778 raft_consensus.cc:2749] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:04.963506 15846 leader_election.cc:290] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:04.810801 15854 leader_election.cc:290] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:04.963434 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:04.711766 15868 raft_consensus.cc:2804] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:04.949847 15901 raft_consensus.cc:515] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:10:04.949684 14331 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.372s	user 0.023s	sys 0.016s
I20260709 12:10:04.865495 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:04.830966 15597 leader_election.cc:290] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:04.844415 14259 raft_consensus.cc:2468] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 3.
I20260709 12:10:04.752053 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:04.883538 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:04.969422 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:04.969725 15816 raft_consensus.cc:493] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
W20260709 12:10:04.751623 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 131081us
I20260709 12:10:04.972074 15792 raft_consensus.cc:493] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:10:05.009289 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:05.007722 14304 leader_election.cc:304] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:10:04.982087 14262 raft_consensus.cc:2468] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 3.
I20260709 12:10:04.952662 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:04.971630 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:04.958544 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:05.005426 14185 raft_consensus.cc:2468] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 5.
I20260709 12:10:05.025054 14336 raft_consensus.cc:2393] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db in current term 3: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
W20260709 12:10:04.971292 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 219046us
W20260709 12:10:04.750109 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 117433us
I20260709 12:10:04.976191 14188 raft_consensus.cc:2468] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 6.
I20260709 12:10:04.965333 14086 catalog_manager.cc:5697] T f4739bc22bfe44fcba807da02d9351b6 P 885067a0d31741bfb5c9935788e315bf reported cstate change: term changed from 2 to 3, leader changed from 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130) to 885067a0d31741bfb5c9935788e315bf (127.12.174.129). New cstate: current_term: 3 leader_uuid: "885067a0d31741bfb5c9935788e315bf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:04.945675 15721 raft_consensus.cc:493] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:04.950506 15907 leader_election.cc:290] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:04.750609 14335 raft_consensus.cc:2393] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db in current term 3: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:10:04.950793 15738 leader_election.cc:290] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:04.958624 15600 leader_election.cc:290] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:04.970386 15860 leader_election.cc:290] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:04.968513 15904 leader_election.cc:290] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:04.977612 15902 raft_consensus.cc:697] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 4 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:10:05.035115 15792 raft_consensus.cc:515] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:04.982012 15845 leader_election.cc:290] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 4 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:04.981647 15868 raft_consensus.cc:493] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:05.044209 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:05.069191 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:05.044991 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:05.048799 14182 raft_consensus.cc:2468] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 2.
I20260709 12:10:05.049219 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:05.049948 14337 raft_consensus.cc:2393] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 6: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
W20260709 12:10:05.051760 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 526531us
I20260709 12:10:05.053795 14181 raft_consensus.cc:2368] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 2. Current term is 3.
I20260709 12:10:05.053756 14877 leader_election.cc:304] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:10:05.066709 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:05.072850 14877 leader_election.cc:304] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:10:05.049751 15849 leader_election.cc:290] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 4 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:05.073877 14182 raft_consensus.cc:1240] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:05.022686 15816 raft_consensus.cc:515] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:05.072099 14876 leader_election.cc:304] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:05.084774 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:10:05.085513 14332 consensus_meta.cc:287] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.527s	user 0.010s	sys 0.001s
I20260709 12:10:05.086073 14332 raft_consensus.cc:2468] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 3.
I20260709 12:10:05.056039 15862 leader_election.cc:290] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:05.087528 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:05.059036 15600 raft_consensus.cc:493] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:05.063550 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:05.040964 15854 raft_consensus.cc:2804] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:05.059638 14304 leader_election.cc:304] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:10:05.065177 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:05.075302 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:05.076435 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:04.985859 15905 raft_consensus.cc:493] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:05.079226 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:05.061544 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:05.045850 15721 raft_consensus.cc:515] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:05.088943 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:05.549922 14339 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50856 (request call id 1446) took 1027 ms. Trace:
I20260709 12:10:05.526124 14338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50858 (request call id 1247) took 2548 ms. Trace:
I20260709 12:10:05.499233 15863 leader_election.cc:290] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:05.513926 14333 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50856 (request call id 1445) took 1005 ms. Trace:
I20260709 12:10:05.552063 14259 raft_consensus.cc:3060] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:05.536880 14877 leader_election.cc:304] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:10:05.550678 14339 rpcz_store.cc:276] 0709 12:10:04.522509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:04.617588 (+ 95079us) service_pool.cc:224] Handling call
0709 12:10:04.617947 (+   359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:04.944335 (+326388us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:04.944372 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:04.944415 (+    43us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:10:04.944464 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:05.549595 (+605131us) spinlock_profiling.cc:243] Waited 326 ms on lock 0x7b54000fd2d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:10:05.549649 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:05.549848 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":750130048}
I20260709 12:10:05.552949 15820 raft_consensus.cc:2804] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:05.553642 15820 raft_consensus.cc:697] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 3 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:10:05.553752 15600 raft_consensus.cc:515] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:05.554693 15820 consensus_queue.cc:237] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:05.417097 15902 consensus_queue.cc:237] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:05.556493 15600 leader_election.cc:290] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:10:05.556772 15791 consensus_meta.cc:287] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 1.042s	user 0.013s	sys 0.004s
W20260709 12:10:05.473438 15889 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.505s	user 0.001s	sys 0.007s
I20260709 12:10:05.557897 15816 leader_election.cc:290] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:10:05.371459 15783 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.020s	sys 0.021s
I20260709 12:10:05.503425 14229 leader_election.cc:304] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 73d01e9b1a9d49358da4985b21d681db
W20260709 12:10:05.614492 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 111196us
W20260709 12:10:05.549000 15855 consensus_meta.cc:287] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 1.062s	user 0.012s	sys 0.000s
I20260709 12:10:05.550918 14185 raft_consensus.cc:2393] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 4: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:10:05.094161 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:05.616905 14263 raft_consensus.cc:2468] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 3.
I20260709 12:10:05.551499 14182 raft_consensus.cc:2468] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 1.
I20260709 12:10:05.109964 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:05.552120 14333 rpcz_store.cc:276] 0709 12:10:04.508916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:04.509043 (+   127us) service_pool.cc:224] Handling call
0709 12:10:04.579840 (+ 70797us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:04.949320 (+369480us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:04.949354 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:04.949397 (+    43us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:04.949437 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:05.513585 (+564148us) spinlock_profiling.cc:243] Waited 369 ms on lock 0x7b540023ad54. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:10:05.513657 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:05.513846 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":849204480}
I20260709 12:10:05.071026 15868 raft_consensus.cc:3060] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:05.440207 14181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56046 (request call id 1592) took 1110 ms. Trace:
I20260709 12:10:05.615899 15924 raft_consensus.cc:2804] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:05.620332 14181 rpcz_store.cc:276] 0709 12:10:04.329333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:04.865689 (+536356us) service_pool.cc:224] Handling call
0709 12:10:05.439943 (+574254us) spinlock_profiling.cc:243] Waited 42 ms on lock 0x7b54003a2fd4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:10:05.440127 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":96520448}
I20260709 12:10:05.572216 15854 raft_consensus.cc:697] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 3 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:05.090875 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:05.139062 14876 leader_election.cc:304] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:05.119555 15910 raft_consensus.cc:2804] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:05.194777 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:05.074276 15892 leader_election.cc:290] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:05.120188 15846 raft_consensus.cc:2749] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:05.117362 15869 raft_consensus.cc:2804] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:10:05.193625 15917 log.cc:927] Time spent T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.310s	user 0.001s	sys 0.000s
W20260709 12:10:05.379796 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 417997us
I20260709 12:10:05.614004 15791 raft_consensus.cc:515] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:10:05.163892 15911 log.cc:927] Time spent T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.217s	user 0.000s	sys 0.000s
I20260709 12:10:05.191814 15754 leader_election.cc:290] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:05.562943 14259 raft_consensus.cc:2468] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 3.
W20260709 12:10:05.193217 15916 log.cc:927] Time spent T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.181s	user 0.000s	sys 0.000s
W20260709 12:10:05.194244 15918 log.cc:927] Time spent T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.142s	user 0.000s	sys 0.000s
I20260709 12:10:05.164304 15847 consensus_queue.cc:1059] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.400s
W20260709 12:10:05.556928 14303 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.006s	sys 0.005s
I20260709 12:10:05.202777 14907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:05.552284 14338 rpcz_store.cc:276] 0709 12:10:02.977713 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:03.125529 (+147816us) service_pool.cc:224] Handling call
0709 12:10:03.125954 (+   425us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:04.958288 (+1832334us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:05.525708 (+567420us) spinlock_profiling.cc:243] Waited 1.83 s on lock 0x7b5400146254. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:10:05.525998 (+   290us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4212496256}
I20260709 12:10:05.559442 14265 raft_consensus.cc:2393] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 3: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
I20260709 12:10:05.565553 14258 raft_consensus.cc:1275] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:10:05.565624 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:10:05.565101 15721 leader_election.cc:290] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:10:05.409706 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 357888us
I20260709 12:10:05.568181 14260 raft_consensus.cc:2468] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 2.
I20260709 12:10:05.527716 15876 raft_consensus.cc:493] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:05.573076 14184 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56044 (request call id 1839) took 1253 ms (client timeout 1615 ms). Trace:
W20260709 12:10:05.610446 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 550860us
I20260709 12:10:05.610874 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:05.513168 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:05.380300 15802 raft_consensus.cc:493] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:10:05.678938 15791 leader_election.cc:290] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:05.618693 14264 raft_consensus.cc:3060] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:05.371565 15860 raft_consensus.cc:493] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:10:05.571769 15732 raft_consensus.cc:493] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:05.444949 15792 leader_election.cc:290] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:10:05.192620 15909 log.cc:927] Time spent T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.278s	user 0.000s	sys 0.001s
W20260709 12:10:05.613699 15783 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.784s	user 0.020s	sys 0.032s
I20260709 12:10:05.622049 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:05.622259 14229 leader_election.cc:400] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 2 pre-election: Vote denied by peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187) with higher term. Message: Invalid argument: T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 2. Current term is 3.
I20260709 12:10:05.680301 15837 raft_consensus.cc:3055] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:05.625727 14256 raft_consensus.cc:1275] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 12:10:05.624648 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 485707us
I20260709 12:10:05.676096 15721 raft_consensus.cc:493] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:10:05.632861 14335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55492 (request call id 128) took 1081 ms. Trace:
I20260709 12:10:05.441762 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:05.636991 15924 raft_consensus.cc:697] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 3 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:05.628775 15920 raft_consensus.cc:493] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:10:05.638827 15901 leader_election.cc:290] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:05.572014 15905 raft_consensus.cc:515] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:10:05.649798 14303 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.621s	user 0.006s	sys 0.005s
I20260709 12:10:05.674742 14304 leader_election.cc:304] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:10:05.674778 14910 raft_consensus.cc:2468] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 3.
I20260709 12:10:05.548345 15921 raft_consensus.cc:493] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:05.701913 15837 raft_consensus.cc:740] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:10:05.680364 14155 leader_election.cc:304] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:05.678158 15854 consensus_queue.cc:237] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:10:05.671113 14184 rpcz_store.cc:269] 0709 12:10:04.316950 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:04.318245 (+  1295us) service_pool.cc:224] Handling call
0709 12:10:05.569939 (+1251694us) spinlock_profiling.cc:243] Waited 322 ms on lock 0x7b540019c3d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:10:05.570076 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":740485376}
I20260709 12:10:05.641625 15910 raft_consensus.cc:697] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 3 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:10:05.679631 15869 raft_consensus.cc:697] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 3 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:10:05.663132 15754 raft_consensus.cc:493] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:05.625178 15856 raft_consensus.cc:2749] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:05.697866 14264 raft_consensus.cc:2468] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 4.
I20260709 12:10:05.616971 15600 raft_consensus.cc:2804] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:05.729617 14331 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50858 (request call id 1246) took 2788 ms. Trace:
I20260709 12:10:05.729681 15901 raft_consensus.cc:2749] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:05.686700 15802 raft_consensus.cc:515] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:05.703294 14335 rpcz_store.cc:276] 0709 12:10:04.551491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:04.554114 (+  2623us) service_pool.cc:224] Handling call
0709 12:10:05.632674 (+1078560us) spinlock_profiling.cc:243] Waited 81.9 ms on lock 0x7b5400019d54. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:10:05.632796 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":188444544}
I20260709 12:10:05.714116 15920 raft_consensus.cc:515] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:05.731664 15869 consensus_queue.cc:237] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:05.697000 14229 leader_election.cc:403] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:05.711264 15721 raft_consensus.cc:515] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:05.622912 15855 raft_consensus.cc:515] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:05.717356 14154 leader_election.cc:304] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
W20260709 12:10:05.768469 14154 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 51226.2us
I20260709 12:10:05.715524 14304 leader_election.cc:304] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:10:05.693588 15860 raft_consensus.cc:515] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:10:05.774271 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 158822us
I20260709 12:10:05.775069 14229 leader_election.cc:304] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:05.720690 14261 raft_consensus.cc:1240] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:05.680111 15876 raft_consensus.cc:515] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:05.775978 15791 raft_consensus.cc:493] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:10:05.777915 15876 leader_election.cc:290] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:10:05.728334 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 48051.6us
I20260709 12:10:05.694883 15732 raft_consensus.cc:515] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:05.732211 15802 leader_election.cc:290] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:05.778913 15802 raft_consensus.cc:2804] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:05.779302 15802 raft_consensus.cc:493] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:05.779661 15802 raft_consensus.cc:3060] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:05.732465 15920 leader_election.cc:290] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:05.723660 15904 raft_consensus.cc:2804] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:05.782716 15904 raft_consensus.cc:697] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 3 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:05.783661 15904 consensus_queue.cc:237] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:05.784385 15855 leader_election.cc:290] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 4 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:05.776614 15791 raft_consensus.cc:515] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:10:05.714195 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 685471us
I20260709 12:10:05.785010 14183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56652 (request call id 166) took 1433 ms. Trace:
I20260709 12:10:05.725927 15921 raft_consensus.cc:515] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:05.785393 14183 rpcz_store.cc:276] 0709 12:10:04.351661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:04.979558 (+627897us) service_pool.cc:224] Handling call
0709 12:10:05.570146 (+590588us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:05.570328 (+   182us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:05.570355 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:05.570397 (+    42us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:05.570426 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:05.570478 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:05.784827 (+214349us) spinlock_profiling.cc:243] Waited 589 ms on lock 0x7b540019c3d0. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713a8ad 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:10:05.784947 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1353905408}
I20260709 12:10:05.729619 15600 raft_consensus.cc:493] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:05.738013 15924 consensus_queue.cc:237] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:05.741937 15905 leader_election.cc:290] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:05.744761 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:05.745968 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:05.746518 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:05.747102 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:05.747602 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:05.748082 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:05.748661 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:05.751006 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:05.744858 15919 tablet_replica.cc:333] T bf9bea0d16e44efabb5cdd53e3828438 P 65c9c1653b3346b39a0e118540e6080c: stopping tablet replica
I20260709 12:10:05.757445 14230 leader_election.cc:304] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:05.756242 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:05.735749 15754 raft_consensus.cc:515] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:05.754006 15645 raft_consensus.cc:493] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:10:05.746160 15837 consensus_queue.cc:260] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:05.762184 15910 consensus_queue.cc:237] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:10:05.770188 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 54749.7us
I20260709 12:10:05.771703 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
W20260709 12:10:05.765249 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 56037.4us
I20260709 12:10:05.730229 14331 rpcz_store.cc:276] 0709 12:10:02.941521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:03.034899 (+ 93378us) service_pool.cc:224] Handling call
0709 12:10:03.035424 (+   525us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:03.050027 (+ 14603us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:03.053144 (+  3117us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:03.502136 (+448992us) log.cc:844] Serialized 26 byte log entry
0709 12:10:04.093568 (+591432us) spinlock_profiling.cc:243] Waited 4.08 ms on lock 0x7b4400022b4c. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2123f74c85 00007f2123f756a2 00007f2126ce71db 00007f2126ce2aaf 00007f21240310ac 00007f212ce8b9a9 00007f212404d69b 00007f212404b93f 00007f212404dc02 00007f2126cd520b
0709 12:10:05.032840 (+939272us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:05.047374 (+ 14534us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:05.054594 (+  7220us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:05.714263 (+659669us) raft_consensus.cc:1685] finished
0709 12:10:05.715577 (+  1314us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:05.729533 (+ 13956us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10110,"raft.run_cpu_time_us":202,"raft.run_wall_time_us":7238,"spinlock_wait_cycles":9392512,"thread_start_us":1432484,"threads_started":1,"wal-append.queue_time_us":1022300}
I20260709 12:10:05.773442 15932 raft_consensus.cc:493] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:05.774003 15770 raft_consensus.cc:2804] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:05.948655 15932 raft_consensus.cc:515] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:05.950917 14332 raft_consensus.cc:2468] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 2.
I20260709 12:10:05.951399 14304 leader_election.cc:304] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:10:05.951891 14335 raft_consensus.cc:2468] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 1.
W20260709 12:10:05.952718 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 195365us
I20260709 12:10:05.952948 14338 raft_consensus.cc:2468] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 5.
I20260709 12:10:05.953557 14337 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50856 (request call id 1459) took 1246 ms. Trace:
I20260709 12:10:05.899748 14187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56046 (request call id 1580) took 1574 ms. Trace:
W20260709 12:10:05.954463 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 179481us
I20260709 12:10:05.954597 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:05.953714 14338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50856 (request call id 1451) took 1339 ms. Trace:
I20260709 12:10:05.956422 14338 rpcz_store.cc:276] 0709 12:10:04.614778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:05.670602 (+1055824us) service_pool.cc:224] Handling call
0709 12:10:05.953658 (+283056us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:05.957171 14230 leader_election.cc:304] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:05.956107 14229 leader_election.cc:400] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 2 election: Vote denied by peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187) with higher term. Message: Invalid argument: T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 2. Current term is 3.
I20260709 12:10:05.961450 14229 leader_election.cc:403] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:10:05.963297 14334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50856 (request call id 1458) took 1256 ms. Trace:
I20260709 12:10:05.963774 14334 rpcz_store.cc:276] 0709 12:10:04.706717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:05.657636 (+950919us) service_pool.cc:224] Handling call
0709 12:10:05.963222 (+305586us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:05.964797 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:05.965834 14339 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50856 (request call id 1452) took 1350 ms. Trace:
I20260709 12:10:05.966264 14339 rpcz_store.cc:276] 0709 12:10:04.615018 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:05.609768 (+994750us) service_pool.cc:224] Handling call
0709 12:10:05.740280 (+130512us) spinlock_profiling.cc:243] Waited 999 us on lock 0x7b5800065d98. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2124016b71 00007f2124016a22 00007f212cf2f8d9 00007f212c089ee0 00007f212c1530ab 00007f212c153131 00007f212c1010a0 00007f212c100984 00007f212567b6d4 00007f212567b662
0709 12:10:05.965775 (+225495us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2297600}
I20260709 12:10:05.967334 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:05.950963 14336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55492 (request call id 133) took 1372 ms. Trace:
I20260709 12:10:05.968662 14336 rpcz_store.cc:276] 0709 12:10:04.578375 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:05.083093 (+504718us) service_pool.cc:224] Handling call
0709 12:10:05.950874 (+867781us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:05.953996 14337 rpcz_store.cc:276] 0709 12:10:04.706966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:05.077890 (+370924us) service_pool.cc:224] Handling call
0709 12:10:05.694625 (+616735us) spinlock_profiling.cc:243] Waited 4.64 ms on lock 0x7b5800065d98. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2124016b71 00007f2124016a22 00007f212cf2f8d9 00007f212c089ee0 00007f212c1530ab 00007f212c153131 00007f212c1010a0 00007f212c100984 00007f212567b6d4 00007f212567b662
0709 12:10:05.953494 (+258869us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10668288}
I20260709 12:10:05.971899 14333 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50856 (request call id 1456) took 1266 ms. Trace:
W20260709 12:10:05.972213 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 186749us
I20260709 12:10:05.972404 14333 rpcz_store.cc:276] 0709 12:10:04.705968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:05.621334 (+915366us) service_pool.cc:224] Handling call
0709 12:10:05.971828 (+350494us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:05.973496 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:05.974153 14333 raft_consensus.cc:3060] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:05.954872 14187 rpcz_store.cc:276] 0709 12:10:04.325193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:04.952274 (+627081us) service_pool.cc:224] Handling call
0709 12:10:05.899427 (+947153us) spinlock_profiling.cc:243] Waited 845 ms on lock 0x7b540038c7d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:10:05.899658 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1943350784}
I20260709 12:10:05.976257 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:05.977581 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:05.978281 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:05.775975 15738 raft_consensus.cc:2804] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:05.775921 15792 raft_consensus.cc:3060] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:10:05.787067 15921 leader_election.cc:290] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:05.983633 14304 leader_election.cc:304] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:10:05.985133 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:05.955627 15600 raft_consensus.cc:3060] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:05.952720 15770 raft_consensus.cc:493] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:05.955475 15920 raft_consensus.cc:2749] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:06.001096 14304 leader_election.cc:304] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:10:05.995283 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:05.955696 15901 raft_consensus.cc:493] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:05.981976 15721 leader_election.cc:290] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:05.807094 15868 raft_consensus.cc:515] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:06.000231 14332 raft_consensus.cc:2468] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 5.
I20260709 12:10:05.978750 15902 raft_consensus.cc:493] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:05.982703 15738 raft_consensus.cc:493] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:06.008250 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 47124.6us
I20260709 12:10:06.009639 14259 raft_consensus.cc:2468] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 3.
I20260709 12:10:06.017982 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:06.021412 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:10:05.998307 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:06.032750 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:05.990998 15837 raft_consensus.cc:3060] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:06.079706 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:06.120728 14337 raft_consensus.cc:3060] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:05.971225 15645 raft_consensus.cc:515] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:06.121428 14258 raft_consensus.cc:2468] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 1.
W20260709 12:10:06.120764 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 149779us
I20260709 12:10:06.122460 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:06.123118 14258 raft_consensus.cc:3060] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:06.123186 14877 leader_election.cc:304] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:05.994005 15907 raft_consensus.cc:2804] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:06.038749 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:06.125038 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:05.981482 15889 consensus_queue.cc:1048] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.054s
W20260709 12:10:06.126575 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 122949us
I20260709 12:10:05.999351 14330 raft_consensus.cc:2393] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 4: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:10:06.130828 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:10:06.037333 14303 connection.cc:256] RPC call timeout handler was delayed by -1.5065175849999832s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1553s for a response
I20260709 12:10:06.132035 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
W20260709 12:10:06.132253 14303 connection.cc:256] RPC call timeout handler was delayed by -1.3535175849999632s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1723s for a response
W20260709 12:10:06.132660 14303 connection.cc:256] RPC call timeout handler was delayed by -1.3499175849999574s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17270000000000002s for a response
I20260709 12:10:06.134415 14230 leader_election.cc:304] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
W20260709 12:10:06.127187 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 171204us
I20260709 12:10:06.135505 14230 leader_election.cc:304] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:10:06.135593 14229 leader_election.cc:304] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:06.140549 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:06.002907 15770 raft_consensus.cc:3060] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:05.998034 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:06.142350 14332 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af"
dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
mode: GRACEFUL
new_leader_uuid: "73d01e9b1a9d49358da4985b21d681db"
 from {username='slave'} at 127.0.0.1:50896
I20260709 12:10:06.143450 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:06.034024 15759 raft_consensus.cc:2804] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:06.001408 15860 leader_election.cc:290] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:06.079613 15921 raft_consensus.cc:3060] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:06.145977 14332 raft_consensus.cc:606] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Received request to transfer leadership to TS 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:06.077783 15846 raft_consensus.cc:493] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:06.129174 15738 raft_consensus.cc:3060] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:06.082583 15732 leader_election.cc:290] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:10:06.161764 14303 connection.cc:256] RPC call timeout handler was delayed by -1.174417584999901s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1922s for a response
I20260709 12:10:06.147450 14912 raft_consensus.cc:1275] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:10:06.148239 14262 raft_consensus.cc:1240] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:06.078573 15933 raft_consensus.cc:2749] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:06.078868 15718 raft_consensus.cc:493] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:06.151569 14332 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:50896 (request call id 14) took 1526 ms. Trace:
I20260709 12:10:06.211807 14332 rpcz_store.cc:276] 0709 12:10:04.625587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:06.142198 (+1516611us) service_pool.cc:224] Handling call
0709 12:10:06.151496 (+  9298us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:06.033975 15932 leader_election.cc:290] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:06.142565 15875 raft_consensus.cc:2749] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:06.146404 14334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50856 (request call id 1453) took 1531 ms. Trace:
I20260709 12:10:06.226413 14334 rpcz_store.cc:276] 0709 12:10:04.630778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:06.144139 (+1513361us) service_pool.cc:224] Handling call
0709 12:10:06.144479 (+   340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:06.144693 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:06.144726 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:06.144771 (+    45us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:10:06.144803 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:06.144852 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:06.146340 (+  1488us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:06.227816 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:06.081773 15854 consensus_queue.cc:1048] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.076s
I20260709 12:10:06.138607 14907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:06.213218 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:10:06.251359 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 115899us
I20260709 12:10:06.139569 14906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59144 (request call id 147) took 1775 ms. Trace:
I20260709 12:10:06.142998 15907 raft_consensus.cc:697] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 3 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:06.220324 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:06.078019 15901 raft_consensus.cc:515] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:06.235636 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:06.240772 14258 raft_consensus.cc:2468] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 4.
I20260709 12:10:06.242720 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:06.249215 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:06.139544 15888 raft_consensus.cc:493] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:10:06.250620 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:06.154877 14338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 135) took 1449 ms. Trace:
I20260709 12:10:06.252132 14332 raft_consensus.cc:2468] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 3.
I20260709 12:10:06.251271 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:06.297982 14183 raft_consensus.cc:2393] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 3: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:10:06.300148 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:06.257525 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:06.250981 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:06.254180 14877 leader_election.cc:304] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:06.217856 14908 raft_consensus.cc:1275] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:10:06.259896 14304 leader_election.cc:304] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
W20260709 12:10:06.261199 14074 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet f4739bc22bfe44fcba807da02d9351b6 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 17aab1bbf5014936aa18cc21818b26ec is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 leader_uuid: "885067a0d31741bfb5c9935788e315bf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
W20260709 12:10:06.311379 14074 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 50286.4us
W20260709 12:10:06.266841 14230 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.174.131:45957 timed out after 2.238s (SENT) [suppressed 9 similar messages]
I20260709 12:10:06.145478 15844 raft_consensus.cc:2804] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:06.270778 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:06.270977 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:06.121184 15902 raft_consensus.cc:515] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } }
I20260709 12:10:06.319156 14332 raft_consensus.cc:1240] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:06.150497 15759 raft_consensus.cc:493] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:06.285392 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:06.161708 14330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50856 (request call id 1448) took 1552 ms. Trace:
I20260709 12:10:06.296890 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:06.331434 14187 raft_consensus.cc:3060] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:06.302541 14338 rpcz_store.cc:276] 0709 12:10:04.705555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:06.153932 (+1448377us) service_pool.cc:224] Handling call
0709 12:10:06.154291 (+   359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:06.154516 (+   225us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:06.154545 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:06.154591 (+    46us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:06.154621 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:06.154679 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:06.154812 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:06.174374 15860 raft_consensus.cc:2804] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:06.259267 15932 raft_consensus.cc:2749] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:06.303349 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:10:06.303450 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 49385.8us
I20260709 12:10:06.298856 14188 raft_consensus.cc:2468] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 2.
I20260709 12:10:06.304167 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:06.304847 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:06.345477 14877 leader_election.cc:304] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:06.346179 14183 raft_consensus.cc:2393] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 3: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:10:06.262149 15942 raft_consensus.cc:2804] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:06.305800 14337 raft_consensus.cc:2468] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 3.
I20260709 12:10:06.238121 15732 raft_consensus.cc:493] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:06.212266 15791 leader_election.cc:290] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:06.174542 15846 raft_consensus.cc:515] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:06.219547 15718 raft_consensus.cc:515] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:06.330390 15937 raft_consensus.cc:2804] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:06.329881 15759 raft_consensus.cc:3060] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:06.296877 15869 consensus_queue.cc:1059] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.088s
I20260709 12:10:06.401125 15754 leader_election.cc:290] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:06.382925 15942 raft_consensus.cc:493] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:06.411016 15942 raft_consensus.cc:3060] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:06.411872 15939 log.cc:927] Time spent T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.152s	user 0.001s	sys 0.000s
W20260709 12:10:06.414086 15935 log.cc:927] Time spent T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.333s	user 0.001s	sys 0.000s
I20260709 12:10:06.414331 15868 leader_election.cc:290] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:10:06.418581 15940 log.cc:927] Time spent T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.198s	user 0.000s	sys 0.000s
I20260709 12:10:06.343133 15860 raft_consensus.cc:493] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
W20260709 12:10:06.420012 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 284497us
W20260709 12:10:06.430397 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 85059.3us
I20260709 12:10:06.452620 15907 consensus_queue.cc:237] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:10:06.453898 14303 connection.cc:256] RPC call timeout handler was delayed by -1.0835175849999814s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20230000000000004s for a response
I20260709 12:10:06.452057 14229 leader_election.cc:304] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:06.435500 14333 raft_consensus.cc:2468] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 3.
I20260709 12:10:06.421030 14334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50856 (request call id 1460) took 1713 ms. Trace:
I20260709 12:10:06.457034 14334 rpcz_store.cc:276] 0709 12:10:04.707205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:06.310865 (+1603660us) service_pool.cc:224] Handling call
0709 12:10:06.420490 (+109625us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:06.420691 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:06.420716 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:06.420759 (+    43us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:06.420787 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:06.420843 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:06.420967 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:06.318806 15888 raft_consensus.cc:515] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:06.384817 15875 raft_consensus.cc:2749] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:10:06.467623 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 251172us
I20260709 12:10:06.459445 14229 leader_election.cc:304] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:06.396970 14187 raft_consensus.cc:2468] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 3.
W20260709 12:10:06.470197 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 203404us
W20260709 12:10:06.461843 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 202040us
I20260709 12:10:06.329689 14330 rpcz_store.cc:276] 0709 12:10:04.602681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:05.611690 (+1009009us) service_pool.cc:224] Handling call
0709 12:10:06.154724 (+543034us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:06.474076 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 78100.8us
I20260709 12:10:06.479753 14155 leader_election.cc:304] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:06.397394 15732 raft_consensus.cc:515] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:06.393663 15937 raft_consensus.cc:493] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:10:06.421335 15816 raft_consensus.cc:493] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:10:06.458536 15860 raft_consensus.cc:3060] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:06.498037 14336 raft_consensus.cc:2468] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 2.
I20260709 12:10:06.498675 14877 leader_election.cc:304] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:06.500150 14155 leader_election.cc:304] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:06.506805 14155 leader_election.cc:304] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:06.468750 15868 raft_consensus.cc:2749] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:06.510179 15674 raft_consensus.cc:2749] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:06.476857 15932 raft_consensus.cc:2749] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:06.481523 15844 raft_consensus.cc:697] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 4 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:06.516222 14229 leader_election.cc:304] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:06.520260 14229 leader_election.cc:304] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:06.513443 15718 leader_election.cc:290] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:06.502420 15937 raft_consensus.cc:3060] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:06.495661 15902 leader_election.cc:290] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:10:06.529834 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 55811us
I20260709 12:10:06.521517 14229 leader_election.cc:304] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:06.502697 15863 raft_consensus.cc:2749] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:10:06.510769 15934 log.cc:927] Time spent T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.336s	user 0.000s	sys 0.000s
I20260709 12:10:06.503997 15845 raft_consensus.cc:2804] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:06.505751 15901 leader_election.cc:290] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:06.530691 14304 leader_election.cc:304] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:10:06.508051 15816 raft_consensus.cc:515] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:06.259112 14906 rpcz_store.cc:276] 0709 12:10:04.350600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:04.350760 (+   160us) service_pool.cc:224] Handling call
0709 12:10:04.355462 (+  4702us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:04.356083 (+   621us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:04.356136 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:04.356898 (+   762us) log.cc:844] Serialized 26 byte log entry
0709 12:10:04.740212 (+383314us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:04.748430 (+  8218us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:04.811728 (+ 63298us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:05.794558 (+982830us) spinlock_profiling.cc:243] Waited 11.5 ms on lock 0x7b2400318e18. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2123ed49c4 00007f2123ed2acb 00007f212408ddc9 00007f212408da55 00007f212408cfb0 00007f2126d03488 00007f2126d03be8 00007f2126cdb398 00007f2126cd676a 00007f2126cd5bb6
0709 12:10:05.981787 (+187229us) raft_consensus.cc:1685] finished
0709 12:10:05.981808 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:06.121833 (+140025us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4380,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":155,"spinlock_wait_cycles":26535168,"thread_start_us":322373,"threads_started":1,"wal-append.queue_time_us":624747}
I20260709 12:10:06.519061 15920 raft_consensus.cc:493] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:10:06.538460 14229 leader_election.cc:304] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:06.555842 14229 leader_election.cc:400] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 2 election: Vote denied by peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187) with higher term. Message: Invalid argument: T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 2. Current term is 3.
I20260709 12:10:06.556351 14229 leader_election.cc:403] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:10:06.517571 15889 raft_consensus.cc:493] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:06.560606 14229 leader_election.cc:304] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:06.520179 15875 raft_consensus.cc:2804] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:06.538493 15674 raft_consensus.cc:2804] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:06.523641 15933 raft_consensus.cc:2749] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:06.497956 15943 raft_consensus.cc:493] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
W20260709 12:10:06.626542 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 66051.2us
I20260709 12:10:06.641551 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:06.642771 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:06.643144 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:06.643599 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:06.644308 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:06.645385 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:06.645650 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:06.646735 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:06.562376 15932 raft_consensus.cc:2804] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:06.536536 15791 raft_consensus.cc:2804] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:06.648059 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:06.648605 15932 raft_consensus.cc:493] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
W20260709 12:10:06.636466 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 122524us
I20260709 12:10:06.651644 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:06.651865 14190 raft_consensus.cc:2410] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:10:06.650734 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:06.654093 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:06.656697 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:06.541678 15845 raft_consensus.cc:493] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:10:06.659648 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:06.660380 14185 raft_consensus.cc:2468] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 1.
I20260709 12:10:06.562772 15743 raft_consensus.cc:2804] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:06.541467 15946 raft_consensus.cc:2749] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:06.562561 15868 raft_consensus.cc:2749] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187) with higher term. Message: Invalid argument: T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 2. Current term is 3.
I20260709 12:10:06.665421 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:06.673004 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:06.668788 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:06.670279 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:10:06.677366 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 160860us
I20260709 12:10:06.627136 15875 raft_consensus.cc:493] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:06.623533 15846 leader_election.cc:290] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:06.553412 15949 raft_consensus.cc:493] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:06.667169 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:06.674361 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:06.673763 14184 raft_consensus.cc:2468] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 1.
I20260709 12:10:06.649178 15932 raft_consensus.cc:3060] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:06.541100 15961 raft_consensus.cc:493] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
W20260709 12:10:06.671937 15921 consensus_meta.cc:287] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.511s	user 0.009s	sys 0.003s
I20260709 12:10:06.558625 15718 consensus_queue.cc:1059] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.115s
I20260709 12:10:06.553293 15920 raft_consensus.cc:515] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:06.622697 15889 raft_consensus.cc:515] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:06.689353 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:06.921682 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:06.803673 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:06.649788 15754 raft_consensus.cc:493] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:06.900339 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:06.926103 14259 raft_consensus.cc:2468] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 1.
I20260709 12:10:06.638096 15674 raft_consensus.cc:697] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 5 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:10:06.560782 15645 leader_election.cc:290] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:10:06.898492 15837 consensus_meta.cc:287] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db: Time spent flushing consensus metadata: real 0.768s	user 0.010s	sys 0.005s
W20260709 12:10:06.774256 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 79025us
I20260709 12:10:06.924945 15732 leader_election.cc:290] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:06.663086 15845 raft_consensus.cc:3060] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:06.636132 15945 raft_consensus.cc:2749] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:06.772629 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:06.979420 15645 consensus_queue.cc:1048] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:10:06.979887 15969 log.cc:927] Time spent T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:10:06.978147 14303 leader_election.cc:304] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:06.981474 15645 raft_consensus.cc:2749] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:06.981805 14303 leader_election.cc:304] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:06.982986 15645 raft_consensus.cc:2749] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:10:06.985085 15759 consensus_meta.cc:287] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.527s	user 0.006s	sys 0.002s
I20260709 12:10:06.985631 15759 raft_consensus.cc:515] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:06.986752 14303 leader_election.cc:304] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:10:06.986554 15860 raft_consensus.cc:515] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:06.987818 15759 leader_election.cc:290] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:06.988176 14303 leader_election.cc:304] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:06.988315 15645 raft_consensus.cc:2804] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:10:06.988894 15802 consensus_meta.cc:287] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 1.209s	user 0.004s	sys 0.009s
I20260709 12:10:06.989277 15802 raft_consensus.cc:515] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:06.990222 15978 raft_consensus.cc:2804] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:06.990727 15978 raft_consensus.cc:493] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:06.991134 15978 raft_consensus.cc:3060] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:06.878540 15743 raft_consensus.cc:697] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 4 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:06.992980 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:10:06.896754 15938 log.cc:927] Time spent T 00000000000000000000000000000000 P d07070be2c074f4cb9ad35f1580c4ef7: Append to log took a long time: real 0.599s	user 0.001s	sys 0.000s
W20260709 12:10:06.950120 15792 consensus_meta.cc:287] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.947s	user 0.002s	sys 0.009s
I20260709 12:10:06.922295 15875 raft_consensus.cc:3060] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:07.015911 15792 raft_consensus.cc:2749] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187) with higher term. Message: Invalid argument: T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 2. Current term is 3.
I20260709 12:10:06.951041 14907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:10:06.955827 14908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:07.020144 14908 raft_consensus.cc:2468] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 3.
W20260709 12:10:06.953280 15942 consensus_meta.cc:287] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.542s	user 0.008s	sys 0.001s
I20260709 12:10:06.993959 14263 raft_consensus.cc:1240] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:06.662707 15854 consensus_queue.cc:1048] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.310s
I20260709 12:10:06.990387 14257 raft_consensus.cc:1240] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:06.953183 15674 consensus_queue.cc:237] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:06.996481 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:06.996073 15645 raft_consensus.cc:697] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 6 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:06.996104 15860 leader_election.cc:290] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:06.993243 15743 consensus_queue.cc:237] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:06.950654 15846 raft_consensus.cc:3055] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:06.938532 15754 raft_consensus.cc:515] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:07.034540 15645 consensus_queue.cc:237] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:07.036262 15754 leader_election.cc:290] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:06.995898 15802 leader_election.cc:290] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:06.929716 15921 raft_consensus.cc:2749] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187) with higher term. Message: Invalid argument: T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 2. Current term is 3.
W20260709 12:10:07.036013 15770 consensus_meta.cc:287] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.882s	user 0.009s	sys 0.002s
I20260709 12:10:06.717679 15791 raft_consensus.cc:697] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 2 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:10:07.037868 14260 raft_consensus.cc:2468] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 3.
I20260709 12:10:06.728971 15844 consensus_queue.cc:237] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:07.003051 15978 raft_consensus.cc:515] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:10:07.003695 15738 consensus_meta.cc:287] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.789s	user 0.008s	sys 0.001s
I20260709 12:10:07.003526 15932 raft_consensus.cc:515] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:06.997370 15937 raft_consensus.cc:515] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:06.929963 15949 raft_consensus.cc:515] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:07.034449 15846 raft_consensus.cc:740] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:10:07.005630 15845 raft_consensus.cc:515] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:07.037271 15770 raft_consensus.cc:515] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:07.062609 14338 raft_consensus.cc:1240] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:07.012020 14229 leader_election.cc:304] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
W20260709 12:10:07.015262 15600 consensus_meta.cc:287] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.982s	user 0.012s	sys 0.000s
I20260709 12:10:07.029911 15920 leader_election.cc:290] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:07.025233 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:07.039611 15847 raft_consensus.cc:493] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:07.040252 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:06.659922 15943 raft_consensus.cc:515] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:07.046296 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:07.119520 14259 raft_consensus.cc:2393] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 3: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:10:07.051152 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:07.051582 14258 raft_consensus.cc:2468] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 3.
I20260709 12:10:07.004988 14303 leader_election.cc:304] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
W20260709 12:10:07.121249 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 116355us
I20260709 12:10:07.123900 14303 leader_election.cc:304] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
W20260709 12:10:07.067886 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 55952.6us
I20260709 12:10:06.965922 15961 raft_consensus.cc:515] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:07.094219 15968 raft_consensus.cc:493] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
W20260709 12:10:07.095593 14332 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.573s	user 0.000s	sys 0.009s
I20260709 12:10:07.097774 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:07.039753 15791 consensus_queue.cc:237] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:06.941267 15888 leader_election.cc:290] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:06.833176 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:07.109642 14189 raft_consensus.cc:2468] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 1.
I20260709 12:10:07.126019 14229 leader_election.cc:304] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
W20260709 12:10:07.205802 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 79877.6us
I20260709 12:10:07.207715 14229 leader_election.cc:304] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:10:07.051987 15889 leader_election.cc:290] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:07.193255 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:07.226173 14259 raft_consensus.cc:2468] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 3.
W20260709 12:10:07.194231 14332 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.603s	user 0.001s	sys 0.009s
W20260709 12:10:07.195415 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 71575.5us
I20260709 12:10:07.043550 15942 raft_consensus.cc:515] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:07.227546 14303 leader_election.cc:304] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:07.216975 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:07.218568 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:07.228785 14186 raft_consensus.cc:3060] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:07.220120 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:07.222707 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:07.230361 14303 leader_election.cc:304] T bf9bea0d16e44efabb5cdd53e3828438 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:07.231105 14190 raft_consensus.cc:2468] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 3.
I20260709 12:10:07.225092 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:07.232111 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:07.232520 14264 raft_consensus.cc:2368] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 2. Current term is 3.
I20260709 12:10:07.089365 15802 raft_consensus.cc:2749] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:07.233016 14259 raft_consensus.cc:2468] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 3.
I20260709 12:10:07.227506 14332 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50858 (request call id 1274) took 1533 ms. Trace:
I20260709 12:10:07.053596 15738 raft_consensus.cc:515] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:07.256481 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:07.258299 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:07.236404 14333 raft_consensus.cc:1275] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:10:07.224649 14229 leader_election.cc:304] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:07.260493 14262 raft_consensus.cc:2368] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 5. Current term is 6.
I20260709 12:10:07.119942 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:07.192785 15920 raft_consensus.cc:493] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:07.199146 15904 raft_consensus.cc:2749] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:07.261220 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:07.122759 14257 raft_consensus.cc:3060] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:07.200752 15645 raft_consensus.cc:2749] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:07.225217 15754 raft_consensus.cc:2804] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:07.108767 15600 raft_consensus.cc:515] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:07.263960 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:07.252822 15956 raft_consensus.cc:2749] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:07.228510 15959 raft_consensus.cc:493] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:10:07.290012 14339 raft_consensus.cc:2393] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 4: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:10:07.292238 14186 raft_consensus.cc:2468] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 3.
I20260709 12:10:07.262776 14229 leader_election.cc:304] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:07.252488 15889 raft_consensus.cc:2749] T bf9bea0d16e44efabb5cdd53e3828438 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:07.262559 15933 raft_consensus.cc:2749] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:07.192893 15847 raft_consensus.cc:515] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:07.294238 14259 raft_consensus.cc:2393] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 3: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:10:07.357089 14259 raft_consensus.cc:1240] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:07.313834 15837 consensus_queue.cc:1048] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
W20260709 12:10:07.365911 15979 log.cc:927] Time spent T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 12:10:07.366530 15932 leader_election.cc:290] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 2 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:10:07.306277 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 43576.8us
I20260709 12:10:07.301929 15860 raft_consensus.cc:2804] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:07.307468 15845 leader_election.cc:290] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 2 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:07.226507 15968 raft_consensus.cc:515] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:07.293618 15754 raft_consensus.cc:493] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:07.308976 15943 leader_election.cc:290] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:07.311403 15600 leader_election.cc:290] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:07.311898 14265 raft_consensus.cc:1240] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:07.353287 15942 leader_election.cc:290] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:07.294986 15920 raft_consensus.cc:515] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:07.351608 15847 leader_election.cc:290] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:10:07.367835 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 106259us
I20260709 12:10:07.369477 14229 leader_election.cc:304] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:07.305554 14303 leader_election.cc:304] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:07.308079 15770 leader_election.cc:290] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 4 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:07.367699 15949 leader_election.cc:290] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:07.381326 15754 raft_consensus.cc:3060] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:07.383592 15847 raft_consensus.cc:493] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:10:07.383934 15875 raft_consensus.cc:515] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:07.384140 15847 raft_consensus.cc:515] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:07.374480 15860 raft_consensus.cc:493] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:07.386171 15860 raft_consensus.cc:3060] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:10:07.386438 15941 log.cc:927] Time spent T f4739bc22bfe44fcba807da02d9351b6 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 1.089s	user 0.007s	sys 0.003s
I20260709 12:10:07.388796 15847 leader_election.cc:290] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:07.368474 15959 raft_consensus.cc:515] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:07.376695 14335 raft_consensus.cc:1240] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 4 LEADER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:07.393649 14229 leader_election.cc:304] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:07.395462 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:07.402220 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:10:07.403517 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 98063us
I20260709 12:10:07.406360 14303 leader_election.cc:304] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:07.410362 14229 leader_election.cc:304] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:07.411352 15845 consensus_queue.cc:1048] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:07.411782 15933 raft_consensus.cc:2804] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:07.412367 15933 raft_consensus.cc:493] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:07.412833 15933 raft_consensus.cc:3060] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:07.408000 15956 raft_consensus.cc:2749] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:07.419953 14229 leader_election.cc:304] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:07.412935 15754 raft_consensus.cc:515] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:07.405005 15791 raft_consensus.cc:2749] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:07.398464 15600 raft_consensus.cc:2749] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:07.433765 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:07.409142 15732 raft_consensus.cc:2749] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:07.414651 15943 consensus_queue.cc:1048] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 12:10:07.444736 14257 raft_consensus.cc:2468] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 4.
I20260709 12:10:07.438427 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:10:07.449769 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:07.448199 15875 leader_election.cc:290] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 4 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:07.437988 15937 leader_election.cc:290] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 2 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:07.481041 14334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50858 (request call id 1280) took 1233 ms. Trace:
I20260709 12:10:07.439589 15802 raft_consensus.cc:2749] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:07.482776 14334 rpcz_store.cc:276] 0709 12:10:06.247947 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:06.467817 (+219870us) service_pool.cc:224] Handling call
0709 12:10:06.468161 (+   344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:06.552877 (+ 84716us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:10:06.846889 (+294012us) log.cc:844] Serialized 14 byte log entry
0709 12:10:07.044074 (+197185us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:07.044135 (+    61us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:07.044177 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:07.480740 (+436563us) spinlock_profiling.cc:243] Waited 84.4 ms on lock 0x7b54000fbed4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:10:07.480793 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:07.480962 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1044,"prepare.queue_time_us":165102,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":8035,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":5931,"spinlock_wait_cycles":194191616,"thread_start_us":489950,"threads_started":2,"wal-append.queue_time_us":387879}
I20260709 12:10:07.448949 15921 raft_consensus.cc:2749] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:07.531253 15968 leader_election.cc:290] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:07.536316 15959 leader_election.cc:290] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:07.550532 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:07.551317 14334 raft_consensus.cc:2468] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 1.
I20260709 12:10:07.554090 14877 leader_election.cc:304] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:10:07.554926 15968 raft_consensus.cc:2804] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:07.555444 15968 raft_consensus.cc:493] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:10:07.555948 15968 raft_consensus.cc:3060] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:07.557247 15961 leader_election.cc:290] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:07.566419 15860 raft_consensus.cc:515] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:07.575863 15816 leader_election.cc:290] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:07.576395 15860 leader_election.cc:290] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 2 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:07.590469 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:07.591425 14263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41764 (request call id 1871) took 1566 ms. Trace:
I20260709 12:10:07.591804 14263 rpcz_store.cc:276] 0709 12:10:06.024809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:06.025027 (+   218us) service_pool.cc:224] Handling call
0709 12:10:06.025393 (+   366us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:07.022107 (+996714us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:07.591200 (+569093us) spinlock_profiling.cc:243] Waited 968 ms on lock 0x7b54001b30d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:10:07.591367 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2227063168}
I20260709 12:10:07.591902 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:07.593129 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:07.593824 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:07.595342 14877 leader_election.cc:304] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:07.595785 15827 consensus_queue.cc:1059] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:07.600171 14877 leader_election.cc:304] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:07.595301 14258 raft_consensus.cc:2393] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db in current term 4: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:10:07.601315 14263 raft_consensus.cc:1275] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:07.602752 14263 raft_consensus.cc:1240] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:07.581423 15933 raft_consensus.cc:515] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:07.605008 14263 raft_consensus.cc:1275] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:10:07.607369 14877 leader_election.cc:304] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:07.605518 15718 raft_consensus.cc:2749] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:07.614187 15986 raft_consensus.cc:3060] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:07.612416 15933 leader_election.cc:290] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 4 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:10:07.616034 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 246076us
I20260709 12:10:07.605613 15869 raft_consensus.cc:2749] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:07.673261 15600 raft_consensus.cc:493] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:07.674022 15600 raft_consensus.cc:515] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:07.674410 14263 raft_consensus.cc:1275] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:10:07.675323 14263 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886"
dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
mode: GRACEFUL
new_leader_uuid: "885067a0d31741bfb5c9935788e315bf"
 from {username='slave'} at 127.0.0.1:42676
I20260709 12:10:07.675848 14263 raft_consensus.cc:606] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Received request to transfer leadership to TS 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:07.676174 14263 raft_consensus.cc:614] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:07.678777 14263 raft_consensus.cc:1240] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:07.626472 15820 raft_consensus.cc:3055] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:07.626653 15942 raft_consensus.cc:493] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:07.680202 14908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:07.679746 15600 leader_election.cc:290] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:07.688555 14264 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0"
dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
mode: GRACEFUL
new_leader_uuid: "885067a0d31741bfb5c9935788e315bf"
 from {username='slave'} at 127.0.0.1:42676
I20260709 12:10:07.689975 14264 raft_consensus.cc:606] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Received request to transfer leadership to TS 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:07.691836 14264 raft_consensus.cc:614] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:07.679488 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:10:07.696149 14338 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755"
dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
mode: GRACEFUL
new_leader_uuid: "885067a0d31741bfb5c9935788e315bf"
 from {username='slave'} at 127.0.0.1:50896
I20260709 12:10:07.700294 14338 raft_consensus.cc:606] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Received request to transfer leadership to TS 885067a0d31741bfb5c9935788e315bf
W20260709 12:10:07.697118 14074 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet f4739bc22bfe44fcba807da02d9351b6 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 17aab1bbf5014936aa18cc21818b26ec is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 leader_uuid: "885067a0d31741bfb5c9935788e315bf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:10:07.699008 15968 raft_consensus.cc:515] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:07.681540 15820 raft_consensus.cc:740] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:10:07.704641 15820 consensus_queue.cc:260] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:07.705909 15820 raft_consensus.cc:3060] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:07.707996 15968 leader_election.cc:290] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 2 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:07.685535 15942 raft_consensus.cc:515] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:07.716004 15942 leader_election.cc:290] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:07.713855 14338 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262"
dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
mode: GRACEFUL
new_leader_uuid: "17aab1bbf5014936aa18cc21818b26ec"
 from {username='slave'} at 127.0.0.1:50896
I20260709 12:10:07.718202 14338 raft_consensus.cc:606] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 2 LEADER]: Received request to transfer leadership to TS 17aab1bbf5014936aa18cc21818b26ec
W20260709 12:10:07.720702 14876 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:07.722889 12986 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:10:07.723426 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
W20260709 12:10:07.725135 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 117872us
I20260709 12:10:07.725867 14336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50856 (request call id 1465) took 1539 ms. Trace:
I20260709 12:10:07.726231 14336 rpcz_store.cc:276] 0709 12:10:06.186288 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:06.237694 (+ 51406us) service_pool.cc:224] Handling call
0709 12:10:07.725650 (+1487956us) spinlock_profiling.cc:243] Waited 149 ms on lock 0x7b5400145d54. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:10:07.725804 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":343640448}
I20260709 12:10:07.726691 15875 consensus_queue.cc:1048] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:07.728154 14335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50858 (request call id 1269) took 2051 ms. Trace:
I20260709 12:10:07.728518 14335 rpcz_store.cc:276] 0709 12:10:05.677111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:06.318146 (+641035us) service_pool.cc:224] Handling call
0709 12:10:06.318562 (+   416us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:07.391507 (+1072945us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:07.727917 (+336410us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b54002a6554. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:10:07.728096 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2433019520}
I20260709 12:10:07.729628 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:07.730234 14338 raft_consensus.cc:3060] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:07.255235 14332 rpcz_store.cc:276] 0709 12:10:05.694130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:06.320148 (+626018us) service_pool.cc:224] Handling call
0709 12:10:06.320479 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:06.320714 (+   235us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:10:06.522042 (+201328us) log.cc:844] Serialized 14 byte log entry
0709 12:10:07.227184 (+705142us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:07.227233 (+    49us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:07.227276 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:07.227338 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:07.227451 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":313636,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":2471,"raft.queue_time_us":6153,"raft.run_cpu_time_us":196,"raft.run_wall_time_us":19128,"thread_start_us":865886,"threads_started":2,"wal-append.queue_time_us":676777}
I20260709 12:10:07.734272 15986 raft_consensus.cc:2749] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:10:07.724218 14904 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53194 (request call id 590) took 1727 ms (client timeout 1930 ms). Trace:
I20260709 12:10:07.736490 14264 raft_consensus.cc:1240] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 1. Current term is 2. Ops: []
W20260709 12:10:07.734805 14904 rpcz_store.cc:269] 0709 12:10:05.996455 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:05.996617 (+   162us) service_pool.cc:224] Handling call
0709 12:10:07.723314 (+1726697us) spinlock_profiling.cc:243] Waited 5.33 ms on lock 0x7b5800096698. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2124016b71 00007f2124016eee 000000000036eb39 00007f212c08a1e0 00007f212c1530c4 00007f212c153131 00007f212c1010a0 00007f212c100984 00007f212567b6d4 00007f212567b662
0709 12:10:07.724135 (+   821us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12258560}
I20260709 12:10:07.742779 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:10:07.743067 14263 raft_consensus.cc:1240] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:07.744204 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:07.762583 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:07.765945 14336 raft_consensus.cc:1275] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:10:07.767608 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:07.769157 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:07.767951 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:07.768484 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:07.770870 14335 raft_consensus.cc:2468] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 3.
I20260709 12:10:07.771869 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:07.772600 14335 raft_consensus.cc:2393] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 2: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:10:07.771790 14338 raft_consensus.cc:2468] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 2.
I20260709 12:10:07.774099 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:07.770859 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
W20260709 12:10:07.775628 14230 leader_election.cc:336] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957): Timed out: RequestConsensusVote RPC to 127.12.174.131:45957 timed out after 1.500s (SENT)
I20260709 12:10:07.778537 14230 leader_election.cc:304] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:07.779386 15802 raft_consensus.cc:2749] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:10:07.780313 15982 log.cc:927] Time spent T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.514s	user 0.004s	sys 0.000s
I20260709 12:10:07.765321 15942 raft_consensus.cc:493] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:07.782121 15942 raft_consensus.cc:515] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:07.784319 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:07.775475 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:07.776934 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:07.768362 15986 raft_consensus.cc:493] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:07.784904 14336 raft_consensus.cc:2468] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 1.
I20260709 12:10:07.786476 14877 leader_election.cc:304] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:10:07.781427 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:07.789075 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:07.789472 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:07.789630 14336 raft_consensus.cc:3060] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:07.788427 15968 consensus_queue.cc:1048] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 12:10:07.790697 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:07.793056 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:07.786279 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:07.786589 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:07.787346 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:07.795555 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:07.795852 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:07.802587 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:07.803107 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:07.797628 14336 raft_consensus.cc:2468] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 6.
I20260709 12:10:07.799690 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:07.805315 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:07.807363 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:07.808413 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:07.808779 15844 raft_consensus.cc:493] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:07.809450 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:07.809276 15844 raft_consensus.cc:515] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:07.810158 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:07.810976 14256 raft_consensus.cc:2393] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 3: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:10:07.812788 14256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41768 (request call id 1231) took 1141 ms. Trace:
I20260709 12:10:07.793912 15986 raft_consensus.cc:515] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:07.813154 14256 rpcz_store.cc:276] 0709 12:10:06.671789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:07.809911 (+1138122us) service_pool.cc:224] Handling call
0709 12:10:07.812723 (+  2812us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:07.816045 14230 leader_election.cc:304] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:07.805944 14261 raft_consensus.cc:3060] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:07.794754 15977 raft_consensus.cc:2804] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:07.819959 14230 leader_election.cc:304] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:07.821280 14230 leader_election.cc:304] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:07.822536 14230 leader_election.cc:304] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:07.825399 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:07.825901 14256 raft_consensus.cc:1240] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:10:07.827064 14230 leader_election.cc:304] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:07.831321 14230 leader_election.cc:304] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:07.833148 14256 raft_consensus.cc:1275] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:10:07.833722 14263 raft_consensus.cc:1240] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:07.820142 15932 raft_consensus.cc:2804] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:07.837081 14256 raft_consensus.cc:1275] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:07.819335 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:07.821784 15802 raft_consensus.cc:2749] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:07.840425 15802 raft_consensus.cc:2749] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:07.829427 15600 raft_consensus.cc:2804] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:07.841395 15600 raft_consensus.cc:493] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:10:07.841864 15600 raft_consensus.cc:3060] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:07.842458 15961 raft_consensus.cc:493] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:07.842962 15961 raft_consensus.cc:515] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:07.831220 15933 raft_consensus.cc:2749] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:07.845057 15961 leader_election.cc:290] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:07.848357 15816 consensus_queue.cc:1059] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:10:07.849227 15944 raft_consensus.cc:3055] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:07.849567 15944 raft_consensus.cc:740] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:07.850476 15944 consensus_queue.cc:260] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:07.851104 15986 leader_election.cc:290] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:07.851624 15944 raft_consensus.cc:3060] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:07.825152 15977 raft_consensus.cc:697] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 2 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:10:07.852756 15977 consensus_queue.cc:237] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:07.855010 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:07.855698 14264 raft_consensus.cc:2468] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 4.
I20260709 12:10:07.838841 14263 raft_consensus.cc:1275] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:10:07.865694 14263 raft_consensus.cc:1275] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:10:07.868901 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:07.865130 15600 raft_consensus.cc:515] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:07.874713 15942 leader_election.cc:290] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:07.876786 14265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53050 (request call id 191) took 2262 ms. Trace:
I20260709 12:10:07.854242 15932 raft_consensus.cc:493] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:10:07.878440 15932 raft_consensus.cc:3060] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:07.877187 14265 rpcz_store.cc:276] 0709 12:10:05.614511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:05.672901 (+ 58390us) service_pool.cc:224] Handling call
0709 12:10:05.673165 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:07.381468 (+1708303us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:07.876514 (+495046us) spinlock_profiling.cc:243] Waited 1.64 s on lock 0x7b54001c1e54. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:10:07.876697 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3768348416}
I20260709 12:10:07.889906 14265 raft_consensus.cc:1275] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:10:07.899112 14261 raft_consensus.cc:2468] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 2.
W20260709 12:10:07.906510 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 75554.3us
I20260709 12:10:07.908133 14230 leader_election.cc:304] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:07.909725 15600 leader_election.cc:290] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 4 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:07.913378 14230 leader_election.cc:304] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:07.914649 14230 leader_election.cc:304] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:07.915416 15791 raft_consensus.cc:2749] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:07.916162 15791 raft_consensus.cc:2749] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:07.916646 14906 raft_consensus.cc:2468] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 4.
I20260709 12:10:07.917336 14230 leader_election.cc:304] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:07.913247 15942 raft_consensus.cc:2804] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:07.918187 15791 raft_consensus.cc:2749] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:07.918866 15942 raft_consensus.cc:493] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:10:07.919301 15942 raft_consensus.cc:3060] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:07.920607 14230 leader_election.cc:304] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:10:07.921710 14230 leader_election.cc:304] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:07.922837 15791 raft_consensus.cc:2804] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:07.929929 15968 consensus_queue.cc:1048] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:07.930708 15960 consensus_queue.cc:1059] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:07.932482 15645 consensus_queue.cc:1059] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:07.935490 15645 consensus_queue.cc:1059] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:07.936977 15754 leader_election.cc:290] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 4 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:07.902751 15721 raft_consensus.cc:2749] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:07.939469 14335 raft_consensus.cc:1240] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:07.941517 15986 consensus_queue.cc:1059] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:07.942236 15827 consensus_queue.cc:1059] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:07.943728 15827 raft_consensus.cc:3055] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:07.935494 15759 raft_consensus.cc:3055] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:07.944841 15759 raft_consensus.cc:740] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:07.946266 15759 consensus_queue.cc:260] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:07.947974 15759 raft_consensus.cc:3060] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:07.944286 15827 raft_consensus.cc:740] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:10:07.949220 15844 leader_election.cc:290] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:07.951779 15978 leader_election.cc:290] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:07.953329 14189 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56652 (request call id 187) took 1288 ms. Trace:
I20260709 12:10:07.953154 15827 consensus_queue.cc:260] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:07.954350 14262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41768 (request call id 1227) took 1289 ms. Trace:
W20260709 12:10:07.944453 15985 log.cc:927] Time spent T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.631s	user 0.004s	sys 0.004s
I20260709 12:10:07.957708 14337 raft_consensus.cc:1240] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:07.964776 14189 rpcz_store.cc:276] 0709 12:10:06.664624 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:06.665135 (+   511us) service_pool.cc:224] Handling call
0709 12:10:07.953157 (+1288022us) spinlock_profiling.cc:243] Waited 436 ms on lock 0x7b540035b454. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:10:07.953267 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1003057024}
I20260709 12:10:07.965600 14262 rpcz_store.cc:276] 0709 12:10:06.666600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:06.666902 (+   302us) service_pool.cc:224] Handling call
0709 12:10:07.954109 (+1287207us) spinlock_profiling.cc:243] Waited 338 ms on lock 0x7b54002017d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:10:07.954250 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":777498880}
I20260709 12:10:07.957252 15928 raft_consensus.cc:493] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:10:07.967077 15850 raft_consensus.cc:993] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c: : Instructing follower 17aab1bbf5014936aa18cc21818b26ec to start an election
I20260709 12:10:07.968014 15855 raft_consensus.cc:1081] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 2 LEADER]: Signalling peer 17aab1bbf5014936aa18cc21818b26ec to start an election
I20260709 12:10:07.958243 15944 consensus_queue.cc:1059] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:07.973928 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:07.974804 15600 raft_consensus.cc:2749] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:10:07.975035 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 53397.9us
W20260709 12:10:07.957594 14339 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50856 (request call id 1463) took 2926 ms (client timeout 2896 ms). Trace:
I20260709 12:10:07.975965 14230 leader_election.cc:304] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
W20260709 12:10:07.975893 14339 rpcz_store.cc:269] 0709 12:10:05.031442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:06.032379 (+1000937us) service_pool.cc:224] Handling call
0709 12:10:07.957339 (+1924960us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b540029f754. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:10:07.957495 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2654114048}
W20260709 12:10:07.961798 15984 log.cc:927] Time spent T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.658s	user 0.004s	sys 0.000s
I20260709 12:10:07.967365 15928 raft_consensus.cc:515] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:07.971594 14876 leader_election.cc:304] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:07.989604 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
W20260709 12:10:07.959930 14331 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50858 (request call id 1265) took 2294 ms (client timeout 1934 ms). Trace:
I20260709 12:10:07.980679 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:07.980963 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:07.981562 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:08.000721 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:07.974408 15947 raft_consensus.cc:493] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:07.977546 15791 raft_consensus.cc:697] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 6 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:10:08.008113 14304 leader_election.cc:304] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:10:07.987994 15754 raft_consensus.cc:2749] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:07.988828 15986 raft_consensus.cc:493] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:08.019323 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:08.024544 14304 leader_election.cc:304] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:10:08.000072 15910 raft_consensus.cc:2804] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:08.032310 14265 raft_consensus.cc:1240] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:08.035370 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:08.027330 14263 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262"
dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
 from {username='slave'} at 127.0.0.1:41764
I20260709 12:10:08.048866 14263 raft_consensus.cc:493] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:08.049615 14263 raft_consensus.cc:3060] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:08.037403 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:08.054091 14336 raft_consensus.cc:1240] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:08.050535 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:07.999801 15970 consensus_queue.cc:1048] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.048s
I20260709 12:10:08.006848 15978 consensus_queue.cc:1059] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.044s
I20260709 12:10:08.077783 15927 raft_consensus.cc:493] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:08.095170 15927 raft_consensus.cc:515] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:08.096869 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:08.023113 15844 raft_consensus.cc:2804] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:08.047266 15910 raft_consensus.cc:493] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:08.098127 15844 raft_consensus.cc:493] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:08.058907 15888 consensus_queue.cc:1048] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.049s
I20260709 12:10:08.098766 15844 raft_consensus.cc:3060] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:08.102233 15904 raft_consensus.cc:3055] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:08.102696 15904 raft_consensus.cc:740] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
W20260709 12:10:08.103937 15980 log.cc:927] Time spent T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.753s	user 0.001s	sys 0.006s
I20260709 12:10:08.103737 15904 consensus_queue.cc:260] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:08.049819 15862 raft_consensus.cc:2804] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:08.060205 14904 raft_consensus.cc:1240] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:08.021245 15932 raft_consensus.cc:515] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:10:08.088593 15936 log.cc:927] Time spent T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 1.786s	user 0.008s	sys 0.000s
I20260709 12:10:08.112223 15928 leader_election.cc:290] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:08.020718 15855 consensus_queue.cc:1048] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.084s
I20260709 12:10:08.097750 14905 raft_consensus.cc:1240] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:10:08.116969 14333 raft_consensus.cc:1240] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:08.118139 14876 leader_election.cc:304] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:08.011818 15961 consensus_queue.cc:1048] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.067s
I20260709 12:10:08.019313 15947 raft_consensus.cc:515] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:08.026398 15645 consensus_queue.cc:1048] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.083s
I20260709 12:10:08.098224 15910 raft_consensus.cc:3060] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:08.120194 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
W20260709 12:10:07.991294 14331 rpcz_store.cc:269] 0709 12:10:05.665529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:05.980658 (+315129us) service_pool.cc:224] Handling call
0709 12:10:07.959662 (+1979004us) spinlock_profiling.cc:243] Waited 1.4 s on lock 0x7b5400145854. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:10:07.959841 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3208875264}
I20260709 12:10:08.096771 15937 raft_consensus.cc:3055] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:10:08.131500 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 209291us
I20260709 12:10:08.139153 14876 leader_election.cc:304] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:08.139607 14263 raft_consensus.cc:515] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } }
I20260709 12:10:08.140796 14876 leader_election.cc:304] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:08.141656 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:10:08.138943 15937 raft_consensus.cc:740] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:10:08.094041 15912 raft_consensus.cc:493] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:08.085705 15783 raft_consensus.cc:493] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:08.026131 15986 raft_consensus.cc:515] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:08.090677 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:08.141449 15816 raft_consensus.cc:493] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:10:08.121789 15932 leader_election.cc:290] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:08.163450 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:08.179026 14333 raft_consensus.cc:3055] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:08.179710 14333 raft_consensus.cc:740] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:08.142408 15977 raft_consensus.cc:2749] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:08.130369 15862 raft_consensus.cc:697] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 2 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:08.146145 15876 raft_consensus.cc:2804] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:08.204380 14259 raft_consensus.cc:1240] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:10:08.182168 14333 consensus_queue.cc:260] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } }
I20260709 12:10:08.212363 14333 raft_consensus.cc:3060] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:08.131381 15933 consensus_queue.cc:1059] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.059s
I20260709 12:10:08.170056 15968 raft_consensus.cc:2749] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:08.160741 15904 raft_consensus.cc:3060] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:08.143208 15937 consensus_queue.cc:260] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:08.200762 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:08.200387 15947 leader_election.cc:290] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:08.156725 15912 raft_consensus.cc:515] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:10:08.266765 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 48156us
I20260709 12:10:08.170514 15791 consensus_queue.cc:237] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:08.169260 15783 raft_consensus.cc:515] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:10:08.278065 14305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:08.268837 15876 raft_consensus.cc:493] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
W20260709 12:10:08.281621 14155 connection.cc:256] RPC call timeout handler was delayed by -1.0018908570000349s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1523s for a response
I20260709 12:10:08.216801 15816 raft_consensus.cc:515] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:08.262663 15927 leader_election.cc:290] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:08.256985 15970 consensus_queue.cc:1059] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 12:10:08.289665 14184 raft_consensus.cc:2468] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 1.
I20260709 12:10:08.294332 14333 raft_consensus.cc:2468] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 3.
I20260709 12:10:08.299358 14155 leader_election.cc:304] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:08.300273 15953 raft_consensus.cc:2749] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:08.301079 14155 leader_election.cc:304] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:08.295892 14904 raft_consensus.cc:2393] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 2: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
I20260709 12:10:08.285429 15876 raft_consensus.cc:3060] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:08.272243 15942 raft_consensus.cc:515] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:08.281069 15907 consensus_queue.cc:1059] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 12:10:08.297698 15927 raft_consensus.cc:493] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:08.301817 15947 raft_consensus.cc:493] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:08.309963 14155 leader_election.cc:304] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:08.310902 15953 raft_consensus.cc:2749] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:08.322991 14155 leader_election.cc:304] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
W20260709 12:10:08.317893 16005 log.cc:927] Time spent T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
W20260709 12:10:08.328437 16007 log.cc:927] Time spent T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 12:10:08.328769 15783 leader_election.cc:290] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:10:08.329174 16009 log.cc:927] Time spent T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 12:10:08.330035 15912 leader_election.cc:290] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:08.334589 15816 leader_election.cc:290] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:08.335343 15953 raft_consensus.cc:2749] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:08.308817 15862 consensus_queue.cc:237] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:08.338199 15986 leader_election.cc:290] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:08.326208 16015 raft_consensus.cc:2749] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:08.341984 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:08.344429 15844 raft_consensus.cc:515] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:08.324669 15927 raft_consensus.cc:515] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:10:08.359102 14878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:08.378793 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 55901.8us
I20260709 12:10:08.383353 14261 raft_consensus.cc:2468] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 4.
I20260709 12:10:08.386124 14877 leader_election.cc:304] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
W20260709 12:10:08.388046 14302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:08.388764 14155 leader_election.cc:304] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:08.390354 14155 leader_election.cc:304] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:08.327360 15947 raft_consensus.cc:515] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:08.390522 15953 raft_consensus.cc:2749] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:08.346571 15876 raft_consensus.cc:515] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:08.420873 15920 leader_election.cc:290] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:08.421576 15912 raft_consensus.cc:2804] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:08.422051 15912 raft_consensus.cc:493] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:08.422418 15912 raft_consensus.cc:3060] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:08.423220 14332 raft_consensus.cc:1240] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:08.425211 14909 raft_consensus.cc:1240] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:10:08.425416 15919 raft_consensus.cc:2243] T bf9bea0d16e44efabb5cdd53e3828438 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:10:08.427269 14229 leader_election.cc:304] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:08.426307 15919 raft_consensus.cc:2272] T bf9bea0d16e44efabb5cdd53e3828438 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:10:08.414402 15820 raft_consensus.cc:2804] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:08.442345 14155 leader_election.cc:304] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:08.434175 15920 raft_consensus.cc:2804] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:08.445132 14155 leader_election.cc:304] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:08.447690 14155 leader_election.cc:400] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 2 election: Vote denied by peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673) with higher term. Message: Invalid argument: T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 2. Current term is 3.
I20260709 12:10:08.447971 14155 leader_election.cc:403] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:10:08.455681 14155 leader_election.cc:304] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:08.456581 15942 leader_election.cc:290] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 2 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:10:08.459573 14260 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41764 (request call id 1874) took 2260 ms (client timeout 2888 ms). Trace:
I20260709 12:10:08.460884 15783 raft_consensus.cc:2749] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673) with higher term. Message: Invalid argument: T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 2. Current term is 3.
I20260709 12:10:08.441747 15820 raft_consensus.cc:493] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:08.460024 14260 rpcz_store.cc:269] 0709 12:10:06.187615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:06.219986 (+ 32371us) service_pool.cc:224] Handling call
0709 12:10:08.448200 (+2228214us) spinlock_profiling.cc:243] Waited 745 ms on lock 0x7b5400031e54. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:10:08.448339 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1713173248}
I20260709 12:10:08.465828 14304 leader_election.cc:304] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:08.461920 15783 raft_consensus.cc:2804] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:08.445501 16025 raft_consensus.cc:2749] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:08.469811 15947 leader_election.cc:290] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:08.471287 14263 leader_election.cc:290] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187)
I20260709 12:10:08.467903 15820 raft_consensus.cc:3060] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:08.458069 16015 raft_consensus.cc:2804] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:08.476815 16015 raft_consensus.cc:493] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:08.477205 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:08.444038 15953 consensus_queue.cc:1059] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 12:10:08.476846 15738 leader_election.cc:290] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 4 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:08.471886 15783 raft_consensus.cc:493] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:08.480933 15942 raft_consensus.cc:493] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:08.481312 15783 raft_consensus.cc:3060] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:08.481529 15942 raft_consensus.cc:515] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:08.443267 15910 raft_consensus.cc:515] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:08.484926 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:08.490432 14333 raft_consensus.cc:2393] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 4: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:10:08.491448 15919 ts_tablet_manager.cc:1916] T bf9bea0d16e44efabb5cdd53e3828438 P 65c9c1653b3346b39a0e118540e6080c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:10:08.463155 15920 raft_consensus.cc:697] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 4 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:10:08.477234 16015 raft_consensus.cc:3060] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:08.494199 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:08.498571 15876 leader_election.cc:290] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 2 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:08.500341 14331 raft_consensus.cc:1240] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:10:08.479882 15953 raft_consensus.cc:3055] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:08.503908 15827 raft_consensus.cc:3060] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:08.504087 15953 raft_consensus.cc:740] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:10:08.501246 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:08.502305 15912 raft_consensus.cc:515] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:08.474852 15951 raft_consensus.cc:2764] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:10:08.506366 14903 raft_consensus.cc:1240] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:08.503707 15927 leader_election.cc:290] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:08.492601 15920 consensus_queue.cc:237] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:08.512712 15942 leader_election.cc:290] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:08.505416 15953 consensus_queue.cc:260] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:08.515602 15953 raft_consensus.cc:3060] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:08.522706 15888 raft_consensus.cc:3055] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:08.522383 15783 raft_consensus.cc:515] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:08.523309 15888 raft_consensus.cc:740] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:08.660022 15888 consensus_queue.cc:260] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:10:08.576006 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 120262us
I20260709 12:10:08.593879 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:08.581348 14229 leader_election.cc:304] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:08.599043 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:08.607826 14186 raft_consensus.cc:3055] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:08.593279 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:08.612452 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:08.613114 14337 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 139) took 2877 ms. Trace:
I20260709 12:10:08.672245 14337 rpcz_store.cc:276] 0709 12:10:05.735738 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:06.456869 (+721131us) service_pool.cc:224] Handling call
0709 12:10:07.957490 (+1500621us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:07.965310 (+  7820us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:08.612549 (+647239us) spinlock_profiling.cc:243] Waited 1.5 s on lock 0x7b540029f750. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713a8ad 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:10:08.612861 (+   312us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3450265472}
I20260709 12:10:08.617199 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:08.619632 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:08.622264 14876 leader_election.cc:304] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:08.622752 12986 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:10:08.624264 14905 raft_consensus.cc:1240] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 2 LEADER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:08.631702 14263 raft_consensus.cc:1240] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:08.633199 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:08.624223 14085 catalog_manager.cc:5697] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 1 to 3, leader changed from 65c9c1653b3346b39a0e118540e6080c (127.12.174.131) to 73d01e9b1a9d49358da4985b21d681db (127.12.174.132). New cstate: current_term: 3 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:08.634091 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:10:08.635160 14086 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60410 (request call id 254) took 6089 ms. Trace:
I20260709 12:10:08.636091 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:08.636782 14303 leader_election.cc:304] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:08.638098 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:08.647616 14908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:08.649322 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:10:08.650972 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:10:08.663018 14155 leader_election.cc:304] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:08.526857 15910 leader_election.cc:290] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 2 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:08.533787 15912 leader_election.cc:290] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 2 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:08.532992 15924 raft_consensus.cc:3055] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:10:08.576004 14154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:08.534250 15937 raft_consensus.cc:3060] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:08.538342 16004 raft_consensus.cc:3055] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:08.538854 16015 raft_consensus.cc:515] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:10:08.538525 16016 log.cc:927] Time spent T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.211s	user 0.003s	sys 0.000s
W20260709 12:10:08.531785 16019 log.cc:927] Time spent T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.196s	user 0.000s	sys 0.003s
I20260709 12:10:08.709165 15944 raft_consensus.cc:3055] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:08.780268 15944 raft_consensus.cc:740] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
W20260709 12:10:08.540618 16030 log.cc:927] Time spent T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
I20260709 12:10:08.784325 15860 raft_consensus.cc:493] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:10:08.784611 16004 raft_consensus.cc:740] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:10:08.785671 15924 raft_consensus.cc:740] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:08.694883 14184 raft_consensus.cc:2468] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 4.
I20260709 12:10:08.696280 15844 leader_election.cc:290] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:08.778883 15846 consensus_queue.cc:260] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:08.785374 15860 raft_consensus.cc:515] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:08.670271 14186 raft_consensus.cc:740] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:10:08.710682 14334 raft_consensus.cc:1275] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:08.714850 14188 raft_consensus.cc:3060] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:08.759019 14230 leader_election.cc:304] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:10:08.797868 14189 raft_consensus.cc:3060] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:08.797304 15803 raft_consensus.cc:2804] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:08.807782 15953 raft_consensus.cc:2749] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:08.814523 15855 raft_consensus.cc:2749] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:08.786283 16004 consensus_queue.cc:260] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:08.810884 15803 raft_consensus.cc:493] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:08.817344 14186 consensus_queue.cc:260] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:08.829602 14186 raft_consensus.cc:3060] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:10:08.832305 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 73596.4us
I20260709 12:10:08.831946 15846 raft_consensus.cc:3060] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:08.833755 15942 raft_consensus.cc:2804] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:08.836658 15942 raft_consensus.cc:697] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 3 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:10:08.829845 15888 raft_consensus.cc:3060] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:08.844058 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 222352us
I20260709 12:10:08.825233 15803 raft_consensus.cc:3060] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:10:08.849617 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 213206us
I20260709 12:10:08.828207 15860 leader_election.cc:290] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:08.853264 15721 raft_consensus.cc:493] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:10:08.825798 15783 leader_election.cc:290] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 4 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:08.857595 14085 catalog_manager.cc:5697] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 2 to 3, leader changed from 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130) to 73d01e9b1a9d49358da4985b21d681db (127.12.174.132). New cstate: current_term: 3 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:08.860467 15920 raft_consensus.cc:2804] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:08.879040 14338 raft_consensus.cc:2468] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 2.
W20260709 12:10:08.886209 14302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:08.887933 14338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50856 (request call id 1485) took 1085 ms. Trace:
I20260709 12:10:08.886471 15959 consensus_queue.cc:1048] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.098s
I20260709 12:10:08.888464 14338 rpcz_store.cc:276] 0709 12:10:07.794311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:07.795005 (+   694us) service_pool.cc:224] Handling call
0709 12:10:08.593387 (+798382us) spinlock_profiling.cc:243] Waited 1.06 ms on lock 0x7b5800065d98. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2124016b71 00007f2124016a22 00007f212cf2f8d9 00007f212c089ee0 00007f212c1530ab 00007f212c153131 00007f212c1010a0 00007f212c100984 00007f212567b6d4 00007f212567b662
0709 12:10:08.879745 (+286358us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2427648}
W20260709 12:10:08.910331 14230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:08.821914 14184 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6"
dest_uuid: "885067a0d31741bfb5c9935788e315bf"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:59324
W20260709 12:10:08.912424 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 331538us
W20260709 12:10:08.889994 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 227252us
I20260709 12:10:08.915387 14188 raft_consensus.cc:2468] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 2.
I20260709 12:10:08.909528 16004 raft_consensus.cc:3060] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:08.917234 14184 raft_consensus.cc:606] T f4739bc22bfe44fcba807da02d9351b6 P 885067a0d31741bfb5c9935788e315bf [term 3 LEADER]: Received request to transfer leadership
I20260709 12:10:08.903589 16023 consensus_queue.cc:1059] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 12:10:08.905843 15855 raft_consensus.cc:493] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:10:08.925248 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:08.935815 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:08.925274 15844 consensus_queue.cc:1059] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:08.926024 15855 raft_consensus.cc:515] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:08.899581 15920 raft_consensus.cc:697] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 3 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:10:08.896965 15721 raft_consensus.cc:515] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:08.929944 16032 consensus_queue.cc:1059] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:08.930871 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:08.932551 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:08.903283 15876 raft_consensus.cc:493] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:08.922597 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 45682.4us
I20260709 12:10:08.855427 15942 consensus_queue.cc:237] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } }
I20260709 12:10:08.929828 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:08.949326 14186 raft_consensus.cc:1275] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:08.950960 15868 raft_consensus.cc:493] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:08.951506 15876 raft_consensus.cc:515] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:08.951749 15868 raft_consensus.cc:515] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:08.952656 15721 leader_election.cc:290] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:08.911904 15820 raft_consensus.cc:515] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:08.954566 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:08.956133 14189 raft_consensus.cc:2468] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 2.
I20260709 12:10:08.962826 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:08.967816 15856 raft_consensus.cc:3055] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:08.969503 14155 leader_election.cc:304] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:08.970129 14182 raft_consensus.cc:3060] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:08.972966 14230 leader_election.cc:304] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:08.973696 15920 consensus_queue.cc:237] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:08.968400 15856 raft_consensus.cc:740] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:10:08.976518 15856 consensus_queue.cc:260] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:08.983238 14190 raft_consensus.cc:2393] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 2: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:10:08.960543 15868 leader_election.cc:290] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:08.983063 14257 raft_consensus.cc:2393] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 3: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:10:08.983327 15947 raft_consensus.cc:2749] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:09.000034 15802 raft_consensus.cc:3060] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:09.000451 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:10:09.004920 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:09.005945 14910 raft_consensus.cc:2468] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 3.
I20260709 12:10:09.008441 15875 raft_consensus.cc:493] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:09.009145 15875 raft_consensus.cc:515] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:09.011050 14303 leader_election.cc:304] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:09.011294 15850 consensus_queue.cc:1059] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:09.012637 15850 raft_consensus.cc:2749] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:09.017402 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:09.020622 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:08.992125 15876 leader_election.cc:290] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:09.021592 14183 raft_consensus.cc:2468] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 3.
I20260709 12:10:09.012732 14303 leader_election.cc:304] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
W20260709 12:10:09.025979 14304 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:09.026544 14304 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:08.776928 14086 rpcz_store.cc:276] 0709 12:10:02.545274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:02.545438 (+   164us) service_pool.cc:224] Handling call
0709 12:10:02.834143 (+288705us) spinlock_profiling.cc:243] Waited 5.01 ms on lock 0x7b54002e3454. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a5090 00007f2127143f3a 00007f212cef9e9c 00007f212cff804e 00007f212b4b92a4 00007f212b4b9232 00007f212b4b9161 00007f212b4b90dc 00007f212b4b8392 00007f212547648c 00007f21254758c6
0709 12:10:08.634817 (+5800674us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:05.615036 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:05.686661 (+ 71625us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:05.686700 (+    39us) write_op.cc:435] Acquired schema lock
0709 12:10:05.686716 (+    16us) tablet.cc:662] Decoding operations
0709 12:10:05.726686 (+ 39970us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:05.726778 (+    92us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:05.726813 (+    35us) tablet.cc:685] Acquiring locks for 7 operations
0709 12:10:05.734133 (+  7320us) tablet.cc:701] Row locks acquired
0709 12:10:05.734156 (+    23us) write_op.cc:260] PREPARE: finished
0709 12:10:05.734309 (+   153us) write_op.cc:270] Start()
0709 12:10:05.734443 (+   134us) write_op.cc:276] Timestamp: P: 1783599005734267 usec, L: 0
0709 12:10:05.734467 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:10:05.736412 (+  1945us) log.cc:844] Serialized 2950 byte log entry
0709 12:10:06.895819 (+1159407us) spinlock_profiling.cc:243] Waited 5.17 ms on lock 0x7b4400022b4c. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2123f74c85 00007f2123f756a2 00007f2126ce71db 00007f2126ce2aaf 00007f2126cd686e 00007f2126cd5bb6 00007f2126cd57d8 00007f2126cdf221 00007f2126cdf1d9 00007f2126cdf169
0709 12:10:07.362337 (+466518us) op_driver.cc:464] REPLICATION: finished
0709 12:10:07.473566 (+111229us) write_op.cc:301] APPLY: starting
0709 12:10:07.473682 (+   116us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:07.473926 (+   244us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:07.473950 (+    24us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:07.524428 (+ 50478us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:07.524839 (+   411us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=7
0709 12:10:07.524920 (+    81us) write_op.cc:312] APPLY: finished
0709 12:10:07.525410 (+   490us) log.cc:844] Serialized 59 byte log entry
0709 12:10:07.526851 (+  1441us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:07.527037 (+   186us) write_op.cc:454] Released schema lock
0709 12:10:07.527125 (+    88us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:07.532645 (+  5520us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:07.532707 (+    62us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":5644,"reported_tablets":10,"spinlock_wait_cycles":11512576,"child_traces":[["op",{"apply.queue_time_us":110900,"apply.run_cpu_time_us":4310,"apply.run_wall_time_us":54056,"num_ops":7,"prepare.queue_time_us":513774,"prepare.run_cpu_time_us":16252,"prepare.run_wall_time_us":230535,"raft.queue_time_us":345282,"raft.run_cpu_time_us":18403,"raft.run_wall_time_us":66636,"replication_time_us":1627685,"spinlock_wait_cycles":11887488,"thread_start_us":671810,"threads_started":4,"wal-append.queue_time_us":419933,"wal-append.run_cpu_time_us":35829,"wal-append.run_wall_time_us":2350665}]]}
I20260709 12:10:09.033198 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:09.036267 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:09.037384 14185 raft_consensus.cc:1275] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:09.037715 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:09.038581 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:09.039208 14184 raft_consensus.cc:3055] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:09.037271 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:09.040158 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:09.040823 14181 raft_consensus.cc:3060] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:09.044296 15855 leader_election.cc:290] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:09.045205 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:09.045981 14905 raft_consensus.cc:2468] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 3.
I20260709 12:10:09.046283 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:09.047049 14188 raft_consensus.cc:2468] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 6.
I20260709 12:10:09.047569 15951 raft_consensus.cc:3055] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:09.047950 15951 raft_consensus.cc:740] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:09.048986 15951 consensus_queue.cc:260] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:10:09.049495 14910 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53200 (request call id 323) took 2388 ms (client timeout 1893 ms). Trace:
W20260709 12:10:09.057556 14910 rpcz_store.cc:269] 0709 12:10:06.660645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:06.661248 (+   603us) service_pool.cc:224] Handling call
0709 12:10:07.742618 (+1081370us) spinlock_profiling.cc:243] Waited 27.3 ms on lock 0x7b5800096698. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2124016b71 00007f2124016a22 00007f212cf2f8d9 00007f212c089ee0 00007f212c1530ab 00007f212c153131 00007f212c1010a0 00007f212c100984 00007f212567b6d4 00007f212567b662
0709 12:10:09.049260 (+1306642us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b54005e0e54. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:10:09.049412 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2739176576}
I20260709 12:10:09.058151 15951 raft_consensus.cc:3060] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:09.050397 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
W20260709 12:10:09.050825 15827 consensus_meta.cc:287] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db: Time spent flushing consensus metadata: real 0.546s	user 0.011s	sys 0.014s
I20260709 12:10:09.051241 15856 raft_consensus.cc:3060] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:09.055826 15849 raft_consensus.cc:3055] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:09.060746 15849 raft_consensus.cc:740] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:10:09.051988 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:09.052500 14876 leader_election.cc:304] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:09.062206 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
W20260709 12:10:09.062992 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 57577.3us
I20260709 12:10:09.063315 14262 raft_consensus.cc:3060] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:09.063818 14876 leader_election.cc:304] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:08.963420 15944 consensus_queue.cc:260] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:09.053390 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:09.039567 14184 raft_consensus.cc:740] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:10:09.066071 14261 raft_consensus.cc:2468] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 3.
I20260709 12:10:09.053956 16015 leader_election.cc:290] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 4 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:09.054589 15924 consensus_queue.cc:260] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:09.066699 14265 raft_consensus.cc:1240] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 4 LEADER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:10:09.068646 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:09.055927 14181 raft_consensus.cc:2468] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 3.
I20260709 12:10:09.056924 15875 leader_election.cc:290] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:09.066641 14184 consensus_queue.cc:260] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:09.069022 14877 leader_election.cc:304] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:10:09.062191 15849 consensus_queue.cc:260] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:09.068382 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
W20260709 12:10:09.070552 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 126166us
I20260709 12:10:09.062201 14183 raft_consensus.cc:2468] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 3.
W20260709 12:10:09.114670 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 45866.5us
I20260709 12:10:09.075246 14182 raft_consensus.cc:2468] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 2.
I20260709 12:10:09.076655 15944 raft_consensus.cc:3060] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:09.115178 14258 raft_consensus.cc:2468] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 3.
W20260709 12:10:09.081020 14304 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:09.081360 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 68740.2us
I20260709 12:10:09.083086 15738 raft_consensus.cc:2749] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:09.055408 15820 leader_election.cc:290] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 5 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:09.085160 14905 raft_consensus.cc:1275] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:10:09.087810 14229 leader_election.cc:304] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:09.069151 15924 raft_consensus.cc:3060] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:09.117166 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:09.117350 14184 raft_consensus.cc:3060] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:09.117637 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:09.117395 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
W20260709 12:10:09.078032 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 105217us
I20260709 12:10:09.120601 14262 raft_consensus.cc:2468] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 5.
I20260709 12:10:09.125566 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:09.125557 14186 raft_consensus.cc:3060] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:09.127689 14303 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:09.128309 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:09.128929 14260 raft_consensus.cc:3060] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:09.136425 14304 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:09.138324 14187 raft_consensus.cc:3060] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:09.142300 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:09.118397 15846 raft_consensus.cc:2804] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:09.148669 14877 leader_election.cc:304] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:10:09.129618 16023 raft_consensus.cc:2804] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:09.152820 16023 raft_consensus.cc:697] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [term 2 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:10:09.153997 16023 consensus_queue.cc:237] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:10:09.154785 14156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:09.154698 14230 leader_election.cc:304] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:10:09.157773 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:09.163414 15849 raft_consensus.cc:3060] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:09.165680 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:09.159487 14910 raft_consensus.cc:2468] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 3.
W20260709 12:10:09.170154 14230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:09.148128 15846 raft_consensus.cc:493] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:09.158028 15860 raft_consensus.cc:2749] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:09.134720 15827 consensus_queue.cc:1048] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 12:10:09.178143 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:09.169421 15910 raft_consensus.cc:2804] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:09.180207 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:10:09.180284 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 92612.3us
I20260709 12:10:09.184722 14229 leader_election.cc:304] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:10:09.182821 15600 raft_consensus.cc:493] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:09.185803 14334 raft_consensus.cc:1275] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:10:09.186255 15600 raft_consensus.cc:515] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:09.177963 15754 raft_consensus.cc:2804] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:09.188062 15948 raft_consensus.cc:2804] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:09.188231 15754 raft_consensus.cc:697] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 2 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:10:09.188519 15948 raft_consensus.cc:493] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:09.188930 15948 raft_consensus.cc:3060] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:09.189445 15754 consensus_queue.cc:237] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:09.191416 15721 raft_consensus.cc:2804] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:09.191879 15721 raft_consensus.cc:493] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:09.192234 15721 raft_consensus.cc:3060] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:09.196779 15910 raft_consensus.cc:697] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 2 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:10:09.198024 15910 consensus_queue.cc:237] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:09.173390 15846 raft_consensus.cc:3060] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:09.199261 14185 raft_consensus.cc:3060] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:09.201335 14188 raft_consensus.cc:1240] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:10:09.206476 14190 pending_rounds.cc:85] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf: Aborting all ops after (but not including) 2
I20260709 12:10:09.206941 14190 pending_rounds.cc:107] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 12:10:09.207226 14190 raft_consensus.cc:2889] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:09.210106 14331 raft_consensus.cc:1275] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 12:10:09.210618 14331 pending_rounds.cc:85] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c: Aborting all ops after (but not including) 4
I20260709 12:10:09.210896 14331 pending_rounds.cc:107] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 12:10:09.211153 14331 raft_consensus.cc:2889] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:09.215857 15600 leader_election.cc:290] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:09.219661 15868 consensus_queue.cc:1048] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:09.230909 15803 raft_consensus.cc:515] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:09.232586 15802 raft_consensus.cc:2749] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:09.238790 14155 leader_election.cc:304] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:09.243881 14260 raft_consensus.cc:2468] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 5.
I20260709 12:10:09.245188 14186 raft_consensus.cc:2468] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 4.
I20260709 12:10:09.249188 14877 leader_election.cc:304] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:10:09.267469 15600 raft_consensus.cc:493] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
W20260709 12:10:09.269558 14305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:09.245975 16015 raft_consensus.cc:2749] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:09.245491 15875 raft_consensus.cc:493] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:09.282461 14186 raft_consensus.cc:1240] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 2. Current term is 3. Ops: [2.2-2.2]
W20260709 12:10:09.283432 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 64687.4us
I20260709 12:10:09.284085 14184 raft_consensus.cc:1275] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 5. (term mismatch)
I20260709 12:10:09.284499 14184 pending_rounds.cc:85] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf: Aborting all ops after (but not including) 4
I20260709 12:10:09.284735 14184 pending_rounds.cc:107] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf: Aborting uncommitted NO_OP operation due to leader change: 5.5
I20260709 12:10:09.284940 14184 raft_consensus.cc:2889] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:09.270574 15856 raft_consensus.cc:2804] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:09.296453 14155 leader_election.cc:304] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:09.298398 14186 raft_consensus.cc:1275] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:10:09.255241 15948 raft_consensus.cc:515] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:09.300755 15600 raft_consensus.cc:515] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:09.281112 15875 raft_consensus.cc:515] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:09.313156 15600 leader_election.cc:290] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:10:09.318804 14302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:09.318293 15947 raft_consensus.cc:2749] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:09.326030 14187 raft_consensus.cc:2468] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 5.
I20260709 12:10:09.326377 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:09.329245 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:09.306836 15856 raft_consensus.cc:697] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 5 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:10:09.341471 15856 consensus_queue.cc:237] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:09.342868 15803 leader_election.cc:290] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 2 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:09.312970 15875 leader_election.cc:290] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:09.345513 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:09.346077 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:09.346323 14183 raft_consensus.cc:1240] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:09.346709 14260 raft_consensus.cc:3060] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:09.333535 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:09.336380 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:09.347501 14185 raft_consensus.cc:2468] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 3.
I20260709 12:10:09.347505 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:09.339228 15948 leader_election.cc:290] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 4 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:09.306530 15846 raft_consensus.cc:515] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:10:09.351585 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 66230.9us
I20260709 12:10:09.354116 16015 consensus_queue.cc:1059] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:09.355477 15783 raft_consensus.cc:3055] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:09.355670 16015 raft_consensus.cc:993] T f4739bc22bfe44fcba807da02d9351b6 P 885067a0d31741bfb5c9935788e315bf: : Instructing follower 17aab1bbf5014936aa18cc21818b26ec to start an election
I20260709 12:10:09.355880 15783 raft_consensus.cc:740] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:10:09.356562 14304 leader_election.cc:304] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:10:09.349197 14264 raft_consensus.cc:2468] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 3.
I20260709 12:10:09.360385 14155 leader_election.cc:304] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:09.370364 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:09.372816 15947 raft_consensus.cc:1081] T f4739bc22bfe44fcba807da02d9351b6 P 885067a0d31741bfb5c9935788e315bf [term 3 LEADER]: Signalling peer 17aab1bbf5014936aa18cc21818b26ec to start an election
I20260709 12:10:09.373678 14187 raft_consensus.cc:1240] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:09.374127 15953 raft_consensus.cc:2764] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader election decision vote started in defunct term 4: won
I20260709 12:10:09.375252 14187 raft_consensus.cc:1240] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:09.376367 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:09.367898 15850 raft_consensus.cc:2804] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:09.369474 14260 raft_consensus.cc:2468] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 4.
I20260709 12:10:09.370993 15846 leader_election.cc:290] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 4 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:09.356943 15783 consensus_queue.cc:260] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:09.393111 15783 raft_consensus.cc:3060] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:09.400841 14187 raft_consensus.cc:1240] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:09.408140 15942 raft_consensus.cc:493] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:10:09.389096 15850 raft_consensus.cc:697] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 5 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:09.409439 15942 raft_consensus.cc:515] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:09.411381 15850 consensus_queue.cc:237] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:09.420250 14155 leader_election.cc:304] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:09.420073 14186 raft_consensus.cc:1240] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 3. Current term is 4. Ops: []
W20260709 12:10:09.431527 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 74152.8us
I20260709 12:10:09.438858 14184 raft_consensus.cc:1275] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:10:09.445274 15754 consensus_queue.cc:1048] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:09.449980 14182 raft_consensus.cc:1275] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:09.450443 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:09.465196 14877 leader_election.cc:304] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:09.468842 14877 leader_election.cc:304] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:10:09.470142 14186 raft_consensus.cc:1240] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:09.471521 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:09.472571 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:09.472733 14260 raft_consensus.cc:2468] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 3.
I20260709 12:10:09.473958 14182 raft_consensus.cc:2468] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 6.
I20260709 12:10:09.485649 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:09.485916 14264 raft_consensus.cc:1275] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:09.475281 16004 consensus_queue.cc:1048] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 12:10:09.487901 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:09.482632 15948 raft_consensus.cc:2804] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:09.492905 15919 ts_tablet_manager.cc:1929] T bf9bea0d16e44efabb5cdd53e3828438 P 65c9c1653b3346b39a0e118540e6080c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 4.5
I20260709 12:10:09.458856 15953 raft_consensus.cc:2804] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:10:09.506807 14154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:09.493760 15919 log.cc:1199] T bf9bea0d16e44efabb5cdd53e3828438 P 65c9c1653b3346b39a0e118540e6080c: Deleting WAL directory at /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598886212958-12986-0/minicluster-data/ts-2-root/wals/bf9bea0d16e44efabb5cdd53e3828438
I20260709 12:10:09.483268 15846 raft_consensus.cc:2804] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:09.511685 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:09.489585 15948 raft_consensus.cc:697] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 4 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:10:09.512588 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:09.513064 14182 raft_consensus.cc:2468] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 3.
I20260709 12:10:09.482190 15721 raft_consensus.cc:515] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:09.516345 14186 raft_consensus.cc:2468] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 2.
I20260709 12:10:09.518834 14182 raft_consensus.cc:3055] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:09.519241 14182 raft_consensus.cc:740] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:10:09.519352 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:09.521041 14260 raft_consensus.cc:2393] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db in current term 4: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:10:09.523293 14338 raft_consensus.cc:2468] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 3.
I20260709 12:10:09.521544 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:09.513690 15846 raft_consensus.cc:493] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:09.529031 15846 raft_consensus.cc:3060] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:09.522043 15953 raft_consensus.cc:697] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 3 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:10:09.529157 15948 consensus_queue.cc:237] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:09.531054 15953 consensus_queue.cc:237] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:09.521185 15721 leader_election.cc:290] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 4 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:09.529644 15947 consensus_queue.cc:1059] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 12:10:09.534559 15942 leader_election.cc:290] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:09.534933 15947 raft_consensus.cc:3055] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:09.535320 15947 raft_consensus.cc:740] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:10:09.536484 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:09.536298 15947 consensus_queue.cc:260] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:09.537410 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:09.537838 15947 raft_consensus.cc:3060] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:09.538051 16049 log.cc:927] Time spent T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.139s	user 0.001s	sys 0.000s
I20260709 12:10:09.538805 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:09.539821 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:09.540352 14186 raft_consensus.cc:1275] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:09.540625 14190 raft_consensus.cc:2393] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 4: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
W20260709 12:10:09.540822 14156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:09.516906 15783 consensus_queue.cc:1048] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.017s
I20260709 12:10:09.532969 14182 consensus_queue.cc:260] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:09.543062 14182 raft_consensus.cc:3060] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:09.544380 14185 raft_consensus.cc:1240] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:09.537729 14181 raft_consensus.cc:1240] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:09.554744 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:09.529031 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:09.561349 14182 raft_consensus.cc:1275] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:09.566996 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:09.567077 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:09.568272 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:09.578541 14877 leader_election.cc:304] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:09.579164 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:09.579850 14182 raft_consensus.cc:3060] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:10:09.584098 14303 leader_election.cc:304] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:09.585160 15855 consensus_queue.cc:1048] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:09.587328 15855 consensus_queue.cc:1059] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:09.588343 16056 raft_consensus.cc:2749] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:09.569108 14181 raft_consensus.cc:2376] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 2. Re-sending same reply.
I20260709 12:10:09.596511 14182 raft_consensus.cc:2468] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 4.
I20260709 12:10:09.599968 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:10:09.601037 15600 raft_consensus.cc:493] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:10:09.601686 15600 raft_consensus.cc:515] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:09.602025 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:09.604462 15600 leader_election.cc:290] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:09.604588 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:09.606923 14155 leader_election.cc:304] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:09.608767 15849 raft_consensus.cc:2749] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:09.607133 15844 raft_consensus.cc:493] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:10:09.595685 14186 raft_consensus.cc:3060] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:09.612157 14156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:09.608897 14155 leader_election.cc:400] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 election: Vote denied by peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673) with higher term. Message: Invalid argument: T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 5. Current term is 6.
I20260709 12:10:09.599335 15910 raft_consensus.cc:2749] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:09.575520 15944 consensus_queue.cc:1059] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 12:10:09.633447 15944 raft_consensus.cc:3055] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:09.633882 15944 raft_consensus.cc:740] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:09.627322 15919 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55416 (request call id 82) took 5248 ms. Trace:
I20260709 12:10:09.628518 14337 raft_consensus.cc:1275] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:09.611726 15920 raft_consensus.cc:493] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:10:09.629274 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:09.640918 14331 raft_consensus.cc:2468] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 3.
I20260709 12:10:09.630151 14189 raft_consensus.cc:1275] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:10:09.641852 15844 raft_consensus.cc:515] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:09.634622 14333 raft_consensus.cc:1275] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:09.630870 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:09.634469 14230 leader_election.cc:304] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
W20260709 12:10:09.645336 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 61415.2us
I20260709 12:10:09.646241 15600 raft_consensus.cc:2804] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:09.647102 15600 raft_consensus.cc:493] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:09.647467 15600 raft_consensus.cc:3060] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:09.641608 14229 leader_election.cc:304] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:09.654038 15951 consensus_queue.cc:1048] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:09.656814 15754 raft_consensus.cc:2804] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:09.657348 15754 raft_consensus.cc:493] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:09.657873 15754 raft_consensus.cc:3060] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:09.656430 15920 raft_consensus.cc:515] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:09.658062 14903 raft_consensus.cc:2393] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 4: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
I20260709 12:10:09.658799 14304 leader_election.cc:304] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
W20260709 12:10:09.659448 14230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:09.661907 14303 leader_election.cc:304] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:09.661381 14332 raft_consensus.cc:2468] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 2.
I20260709 12:10:09.656370 15844 leader_election.cc:290] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:09.669590 14188 raft_consensus.cc:1275] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:10:09.674014 15944 consensus_queue.cc:260] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:09.688606 14229 leader_election.cc:304] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:09.691963 15802 consensus_queue.cc:1048] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:09.689574 15844 raft_consensus.cc:2749] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:09.693822 14230 leader_election.cc:304] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:10:09.695219 14229 leader_election.cc:304] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:09.702076 14186 raft_consensus.cc:2468] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 3.
I20260709 12:10:09.704771 15951 consensus_queue.cc:1048] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:09.705632 14303 leader_election.cc:304] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:10:09.696846 15855 consensus_queue.cc:1059] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 12:10:09.717772 14303 leader_election.cc:304] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:10:09.652755 15846 raft_consensus.cc:515] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:09.696920 15924 raft_consensus.cc:2804] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:09.698352 15944 raft_consensus.cc:3060] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:09.715369 15951 raft_consensus.cc:3055] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:09.750622 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:09.693718 15802 consensus_queue.cc:1048] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.047s
I20260709 12:10:09.730201 15868 raft_consensus.cc:493] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:09.752117 14877 leader_election.cc:304] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:09.733960 15844 raft_consensus.cc:2804] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:09.743155 15924 raft_consensus.cc:493] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:10:09.735931 15860 raft_consensus.cc:2804] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:09.746479 15855 raft_consensus.cc:2804] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:09.722893 15942 raft_consensus.cc:2749] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:09.746666 15951 raft_consensus.cc:740] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:09.763805 15924 raft_consensus.cc:3060] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:09.776721 14303 leader_election.cc:304] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:09.763813 15964 raft_consensus.cc:2749] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:09.764052 15860 raft_consensus.cc:493] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:10:09.769275 15855 raft_consensus.cc:493] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:10:09.638391 15919 rpcz_store.cc:276] 0709 12:10:04.374878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:04.375236 (+   358us) service_pool.cc:224] Handling call
0709 12:10:05.118066 (+742830us) ts_tablet_manager.cc:1151] Deleting tablet bf9bea0d16e44efabb5cdd53e3828438
0709 12:10:05.164752 (+ 46686us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 12:10:05.744476 (+579724us) spinlock_profiling.cc:243] Waited 12.2 ms on lock 0x7b5800065d98. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2124016b71 00007f212401730e 00007f212cf588c9 00007f212c089e51 00007f212c150dd0 00007f212c151293 00007f212c1822d0 00007f212c16883d 00007f212c1687e9 00007f212c168779
0709 12:10:09.058071 (+3313595us) tablet_metadata.cc:665] Metadata flushed
0709 12:10:09.387721 (+329650us) tablet_metadata.cc:665] Metadata flushed
0709 12:10:09.622347 (+234626us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2475682,"spinlock_wait_cycles":28140416,"tablet-delete.queue_time_us":566594,"thread_start_us":191082,"threads_started":1}
I20260709 12:10:09.784401 14260 raft_consensus.cc:2393] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 4: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:10:09.772100 16004 raft_consensus.cc:2749] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:09.782161 15860 raft_consensus.cc:3060] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:09.768651 15868 raft_consensus.cc:515] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:10:09.795264 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 100197us
I20260709 12:10:09.797128 15888 raft_consensus.cc:2804] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:09.797628 15888 raft_consensus.cc:493] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:10:09.798081 15888 raft_consensus.cc:3060] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:09.783205 15855 raft_consensus.cc:3060] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:09.805218 14229 leader_election.cc:304] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:09.812800 15868 leader_election.cc:290] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:09.824306 14229 leader_election.cc:304] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:09.826856 14155 leader_election.cc:304] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:10:09.828248 15947 raft_consensus.cc:2804] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:09.828886 15947 raft_consensus.cc:697] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 3 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:10:09.830004 15947 consensus_queue.cc:237] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:09.831238 15802 raft_consensus.cc:2749] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:09.845716 14155 leader_election.cc:304] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:09.838358 16004 raft_consensus.cc:2749] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:09.837550 14229 leader_election.cc:304] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:09.855710 15849 raft_consensus.cc:2749] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:09.856315 15942 raft_consensus.cc:2804] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:09.856804 15942 raft_consensus.cc:493] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:09.839146 15920 leader_election.cc:290] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:09.883255 15942 raft_consensus.cc:3060] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:09.897585 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 60142.7us
I20260709 12:10:09.899266 14186 raft_consensus.cc:1275] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:09.818863 15951 consensus_queue.cc:260] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:09.908850 14188 raft_consensus.cc:1275] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:09.909070 14229 leader_election.cc:304] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:09.916105 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:09.916988 14183 raft_consensus.cc:3060] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:09.919183 16070 log.cc:927] Time spent T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.152s	user 0.002s	sys 0.000s
I20260709 12:10:09.919829 15754 raft_consensus.cc:515] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:09.920300 14074 catalog_manager.cc:5028] TS 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957): tablet bf9bea0d16e44efabb5cdd53e3828438 (table test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]) successfully deleted
I20260709 12:10:09.927260 16076 raft_consensus.cc:2749] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:09.928505 15802 raft_consensus.cc:493] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:09.929031 15802 raft_consensus.cc:515] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:09.931303 15802 leader_election.cc:290] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:09.932727 15754 leader_election.cc:290] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 4 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:10:09.934288 14073 catalog_manager.cc:4755] TS 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): ChangeConfig:REMOVE_PEER RPC failed for tablet f4739bc22bfe44fcba807da02d9351b6: Remote error: Service unavailable: leader transfer in progress
I20260709 12:10:09.941294 15600 raft_consensus.cc:515] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:10:09.954999 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 171386us
W20260709 12:10:09.954105 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 181608us
I20260709 12:10:09.960157 14229 leader_election.cc:304] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:09.955977 15600 leader_election.cc:290] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 4 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:10:09.973278 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 75349.7us
I20260709 12:10:09.959223 16081 raft_consensus.cc:493] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:09.975577 16081 raft_consensus.cc:515] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:09.976891 15860 raft_consensus.cc:515] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:09.978189 16081 leader_election.cc:290] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:09.960115 15844 raft_consensus.cc:493] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:10:09.977349 14155 leader_election.cc:304] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:09.979247 15844 raft_consensus.cc:3060] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:09.981585 14303 leader_election.cc:304] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:09.983234 15849 raft_consensus.cc:2749] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:09.984836 14155 leader_election.cc:304] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:09.984617 15942 raft_consensus.cc:515] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:09.987892 14183 raft_consensus.cc:2468] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 4.
I20260709 12:10:09.989486 14337 raft_consensus.cc:1275] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:09.992481 14876 leader_election.cc:304] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:10.001703 16081 consensus_queue.cc:1048] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 12:10:10.004550 16090 raft_consensus.cc:2749] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:10.005530 16094 raft_consensus.cc:2804] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:09.985773 15754 raft_consensus.cc:2804] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:09.935221 16080 consensus_queue.cc:1048] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.072s
I20260709 12:10:09.958959 15856 consensus_queue.cc:1048] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 12:10:10.003015 15849 raft_consensus.cc:2749] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:10.013540 14183 raft_consensus.cc:3060] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:10:10.008540 16094 raft_consensus.cc:697] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 4 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:10:10.013027 15910 raft_consensus.cc:493] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:10.009968 15754 raft_consensus.cc:493] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:09.999600 15944 consensus_queue.cc:1059] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 12:10:10.044287 16094 consensus_queue.cc:237] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:10.031739 14188 raft_consensus.cc:1275] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:10.031831 15942 leader_election.cc:290] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 7 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:10.031728 15924 raft_consensus.cc:515] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:10.044646 15910 raft_consensus.cc:515] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:10.026522 15820 consensus_queue.cc:1048] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 12:10:10.035977 15888 raft_consensus.cc:515] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:10.026629 16090 consensus_queue.cc:1048] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 12:10:10.025301 14331 raft_consensus.cc:3055] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:10.044862 15754 raft_consensus.cc:3060] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:10.055747 14331 raft_consensus.cc:740] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:10.056846 14331 consensus_queue.cc:260] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:10.058017 14331 raft_consensus.cc:3060] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:10.058990 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:10.060505 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:10.061200 14190 raft_consensus.cc:2376] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 3. Re-sending same reply.
I20260709 12:10:10.063313 15888 leader_election.cc:290] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 2 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:10.063660 14903 raft_consensus.cc:1240] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 2 LEADER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:10.045855 14229 leader_election.cc:304] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:10.066375 14186 raft_consensus.cc:1240] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 1. Current term is 2. Ops: []
W20260709 12:10:10.066890 14303 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:10.072038 14910 raft_consensus.cc:1240] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:10.055167 15910 leader_election.cc:290] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:10.044240 15953 consensus_queue.cc:1059] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.036s
I20260709 12:10:10.071785 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:10.080641 15953 raft_consensus.cc:3055] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:10.081043 15953 raft_consensus.cc:740] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:10:10.081595 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:10.051103 15961 consensus_queue.cc:1048] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:10.029817 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:10.083985 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:10.085271 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:10.073643 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:10.078626 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:10.086197 14265 raft_consensus.cc:3060] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:10.055172 15924 leader_election.cc:290] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 4 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:10.074286 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:10:10.076077 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:10.087744 14186 raft_consensus.cc:2468] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 2.
I20260709 12:10:10.088769 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:10.047650 15860 leader_election.cc:290] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:10.093657 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:10.045542 15944 raft_consensus.cc:3055] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:10.095181 14188 raft_consensus.cc:2468] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 2.
I20260709 12:10:10.048095 15846 leader_election.cc:290] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 4 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:10.096899 14303 leader_election.cc:304] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:10.098695 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:10.099685 16096 consensus_queue.cc:1059] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
W20260709 12:10:10.100205 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 89980.4us
I20260709 12:10:10.101810 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:10:10.102128 15961 raft_consensus.cc:2749] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:10.103050 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:10.103682 16096 raft_consensus.cc:3055] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:10.104056 16096 raft_consensus.cc:740] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:10.104137 16083 consensus_queue.cc:1048] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:10.104568 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:10.096232 15959 consensus_queue.cc:1048] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 12:10:10.102983 15600 consensus_queue.cc:1048] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 12:10:10.105118 16096 consensus_queue.cc:260] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:10.108489 15953 consensus_queue.cc:260] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:10.109324 16096 raft_consensus.cc:3060] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:10.111707 14303 leader_election.cc:304] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:10:10.102344 14229 leader_election.cc:304] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:10.112144 14910 raft_consensus.cc:2393] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 2: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
I20260709 12:10:10.040630 15855 raft_consensus.cc:515] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:10.124123 14334 raft_consensus.cc:2393] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 3: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:10:10.172082 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:10.173527 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:10.159936 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:10.162837 14265 raft_consensus.cc:2468] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 4.
I20260709 12:10:10.169659 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:10.177229 14085 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44116 (request call id 154) took 5096 ms. Trace:
I20260709 12:10:10.179453 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:10.203141 14338 raft_consensus.cc:2468] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 4.
I20260709 12:10:10.203539 14339 raft_consensus.cc:3060] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:10.134361 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:10.139266 14264 raft_consensus.cc:1240] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:10.160420 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:10.182073 14229 leader_election.cc:304] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
W20260709 12:10:10.196022 14302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:10.097091 15944 raft_consensus.cc:740] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
W20260709 12:10:10.163755 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 52143us
I20260709 12:10:10.092841 15942 raft_consensus.cc:2804] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:10.120752 14876 leader_election.cc:304] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:10.200405 14332 raft_consensus.cc:2468] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 3.
W20260709 12:10:10.217960 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 97307.9us
I20260709 12:10:10.219024 16094 raft_consensus.cc:2804] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:10.219482 16094 raft_consensus.cc:493] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:10.219826 16094 raft_consensus.cc:3060] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:10.221163 14186 raft_consensus.cc:2468] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 2.
I20260709 12:10:10.208892 14258 raft_consensus.cc:2468] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 2.
I20260709 12:10:10.117304 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:10.207773 14336 raft_consensus.cc:2468] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 3.
I20260709 12:10:10.138499 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:10.207120 14230 leader_election.cc:304] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:10:10.230346 15600 raft_consensus.cc:2804] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:10.230762 15600 raft_consensus.cc:493] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:10:10.231122 15600 raft_consensus.cc:3060] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:10.117681 16076 raft_consensus.cc:3060] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:10.213546 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:10.168895 15951 raft_consensus.cc:3060] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:10.139418 15953 raft_consensus.cc:3060] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:10.213121 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:10.249086 14263 raft_consensus.cc:3060] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:10.205670 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:10.227100 14264 raft_consensus.cc:1275] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:10.181655 14088 catalog_manager.cc:5697] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c reported cstate change: term changed from 1 to 2, leader changed from 885067a0d31741bfb5c9935788e315bf (127.12.174.129) to 65c9c1653b3346b39a0e118540e6080c (127.12.174.131). New cstate: current_term: 2 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:10.173946 14331 raft_consensus.cc:1275] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:10.234010 14304 leader_election.cc:304] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
W20260709 12:10:10.228140 15948 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.694s	user 0.019s	sys 0.035s
I20260709 12:10:10.098069 15924 consensus_queue.cc:1048] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.126s
I20260709 12:10:10.096819 15844 raft_consensus.cc:515] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:10.225085 15920 raft_consensus.cc:2749] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:10.207135 15888 raft_consensus.cc:2804] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:10.237128 14338 raft_consensus.cc:3060] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:10.177143 15754 raft_consensus.cc:515] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:10:10.266444 15948 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.733s	user 0.019s	sys 0.036s
I20260709 12:10:10.267901 15754 leader_election.cc:290] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 4 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:10.202893 14085 rpcz_store.cc:276] 0709 12:10:05.080759 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:05.080907 (+   148us) service_pool.cc:224] Handling call
0709 12:10:10.177148 (+5096241us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:09.333398 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:09.334129 (+   731us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:09.334200 (+    71us) write_op.cc:435] Acquired schema lock
0709 12:10:09.334223 (+    23us) tablet.cc:662] Decoding operations
0709 12:10:09.334772 (+   549us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:09.334904 (+   132us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:09.334934 (+    30us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:10:09.335555 (+   621us) tablet.cc:701] Row locks acquired
0709 12:10:09.335611 (+    56us) write_op.cc:260] PREPARE: finished
0709 12:10:09.335813 (+   202us) write_op.cc:270] Start()
0709 12:10:09.335969 (+   156us) write_op.cc:276] Timestamp: P: 1783599009335748 usec, L: 0
0709 12:10:09.336001 (+    32us) op_driver.cc:348] REPLICATION: starting
0709 12:10:09.336729 (+   728us) log.cc:844] Serialized 925 byte log entry
0709 12:10:09.546583 (+209854us) spinlock_profiling.cc:243] Waited 24.4 ms on lock 0x7b4400022b4c. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2123f74c85 00007f2123f756a2 00007f2126ce71db 00007f2126ce2aaf 00007f21240310ac 00007f212ce8b9a9 00007f212404d69b 00007f212404b93f 00007f212404dc02 00007f2126cd520b
0709 12:10:09.790565 (+243982us) op_driver.cc:464] REPLICATION: finished
0709 12:10:09.934643 (+144078us) write_op.cc:301] APPLY: starting
0709 12:10:09.934751 (+   108us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:09.934923 (+   172us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:09.934970 (+    47us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:10.004883 (+ 69913us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:10.005159 (+   276us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:10:10.005229 (+    70us) write_op.cc:312] APPLY: finished
0709 12:10:10.005564 (+   335us) log.cc:844] Serialized 29 byte log entry
0709 12:10:10.005812 (+   248us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:10.005922 (+   110us) write_op.cc:454] Released schema lock
0709 12:10:10.006018 (+    96us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:10.022951 (+ 16933us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:10.025593 (+  2642us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":881347,"reported_tablets":4,"child_traces":[["op",{"apply.queue_time_us":142006,"apply.run_cpu_time_us":3020,"apply.run_wall_time_us":76132,"num_ops":2,"prepare.queue_time_us":298599,"prepare.run_cpu_time_us":25145,"prepare.run_wall_time_us":317541,"raft.queue_time_us":93395,"raft.run_cpu_time_us":15373,"raft.run_wall_time_us":113444,"replication_time_us":444232,"spinlock_wait_cycles":56216960,"thread_start_us":639259,"threads_started":4,"wal-append.queue_time_us":330845}]]}
I20260709 12:10:10.252560 14258 raft_consensus.cc:1275] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:10:10.231200 14260 raft_consensus.cc:1240] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:10.228824 15942 raft_consensus.cc:697] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 4 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:10:10.272948 15942 consensus_queue.cc:237] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:10.276448 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
W20260709 12:10:10.278612 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 119067us
I20260709 12:10:10.279791 14229 leader_election.cc:304] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:10.281172 14338 raft_consensus.cc:2468] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 4.
I20260709 12:10:10.282594 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:10.283597 14338 raft_consensus.cc:2393] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 2: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:10:10.287195 14188 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6"
dest_uuid: "885067a0d31741bfb5c9935788e315bf"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:59324
I20260709 12:10:10.288371 14155 leader_election.cc:304] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:10.247098 16080 raft_consensus.cc:493] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:10.294064 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:10.292351 14188 raft_consensus.cc:606] T f4739bc22bfe44fcba807da02d9351b6 P 885067a0d31741bfb5c9935788e315bf [term 3 LEADER]: Received request to transfer leadership
I20260709 12:10:10.293282 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:10.298800 14333 raft_consensus.cc:1240] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 5. Current term is 7. Ops: []
W20260709 12:10:10.305938 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 88791.9us
I20260709 12:10:10.278000 16081 raft_consensus.cc:2804] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:10.306737 15600 raft_consensus.cc:515] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:10.305603 14230 leader_election.cc:304] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:10:10.308194 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:10.310012 14230 leader_election.cc:304] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:10:10.337956 14303 leader_election.cc:304] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:10.259083 15803 consensus_queue.cc:1048] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.046s
W20260709 12:10:10.289249 16056 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 12:10:10.342187 14229 leader_election.cc:304] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:10.306883 15754 raft_consensus.cc:2804] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:10.362272 14229 leader_election.cc:304] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:10.369419 15600 leader_election.cc:290] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:10.312929 16081 raft_consensus.cc:493] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:10.373126 14184 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6"
dest_uuid: "885067a0d31741bfb5c9935788e315bf"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:59324
I20260709 12:10:10.375875 14184 raft_consensus.cc:606] T f4739bc22bfe44fcba807da02d9351b6 P 885067a0d31741bfb5c9935788e315bf [term 3 LEADER]: Received request to transfer leadership
I20260709 12:10:10.311774 15888 raft_consensus.cc:697] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 3 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:10.341761 15942 raft_consensus.cc:2804] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:10.378809 14335 raft_consensus.cc:1240] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:10.347530 15920 raft_consensus.cc:2804] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:10.382911 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:10.307184 15944 consensus_queue.cc:260] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:10.387954 16092 raft_consensus.cc:2749] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:10.369333 15860 raft_consensus.cc:2804] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:10.302827 16080 raft_consensus.cc:515] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:10:10.383608 16106 log.cc:927] Time spent T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 12:10:10.376930 16081 raft_consensus.cc:3060] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:10.416827 14305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:10.418253 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 55941.7us
I20260709 12:10:10.368587 15820 consensus_queue.cc:1048] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 12:10:10.384658 15802 raft_consensus.cc:2764] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader election decision vote started in defunct term 3: won
I20260709 12:10:10.438269 14337 raft_consensus.cc:3060] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:10.385365 15942 raft_consensus.cc:493] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:10.389020 15754 raft_consensus.cc:697] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 2 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:10:10.434902 15860 raft_consensus.cc:697] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 4 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
W20260709 12:10:10.445984 16098 log.cc:927] Time spent T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
W20260709 12:10:10.518018 14154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:10.523103 16100 log.cc:927] Time spent T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
W20260709 12:10:10.446895 16104 consensus_queue.cc:1175] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "17aab1bbf5014936aa18cc21818b26ec" responder_term: 3 status { last_received { term: 3 index: 2 } last_committed_idx: 2 last_received_current_leader { term: 3 index: 2 } }
I20260709 12:10:10.425276 15920 raft_consensus.cc:697] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 4 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:10:10.523960 16093 raft_consensus.cc:2749] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:10.378140 15961 consensus_queue.cc:1059] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.054s
I20260709 12:10:10.526377 15888 consensus_queue.cc:237] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:10.381278 16087 consensus_queue.cc:1059] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.210s
I20260709 12:10:10.446400 15862 consensus_queue.cc:1048] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.135s
I20260709 12:10:10.434516 15944 raft_consensus.cc:3060] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:10.786075 16092 raft_consensus.cc:493] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:10.787559 15850 raft_consensus.cc:493] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:10.699075 16108 log.cc:927] Time spent T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
W20260709 12:10:10.873716 14339 consensus_meta.cc:287] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.646s	user 0.007s	sys 0.033s
I20260709 12:10:10.874224 14339 raft_consensus.cc:2468] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 3.
I20260709 12:10:10.448558 15942 raft_consensus.cc:3060] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:10.534718 15855 leader_election.cc:290] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:10.807147 14184 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6"
dest_uuid: "885067a0d31741bfb5c9935788e315bf"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:59324
W20260709 12:10:10.809839 14305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:10.810966 14337 raft_consensus.cc:2468] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 5.
W20260709 12:10:10.811688 14263 consensus_meta.cc:287] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.553s	user 0.013s	sys 0.010s
W20260709 12:10:10.813647 16076 consensus_meta.cc:287] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.565s	user 0.016s	sys 0.001s
I20260709 12:10:10.867970 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:10.812537 15802 raft_consensus.cc:493] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:10.829679 16094 consensus_meta.cc:287] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db: Time spent flushing consensus metadata: real 0.609s	user 0.010s	sys 0.008s
I20260709 12:10:10.883210 14263 raft_consensus.cc:2468] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 4.
I20260709 12:10:10.882578 14184 raft_consensus.cc:606] T f4739bc22bfe44fcba807da02d9351b6 P 885067a0d31741bfb5c9935788e315bf [term 3 LEADER]: Received request to transfer leadership
W20260709 12:10:10.907143 14303 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.012s	sys 0.011s
W20260709 12:10:10.907572 14303 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.541s	user 0.012s	sys 0.011s
W20260709 12:10:10.910421 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 476360us
I20260709 12:10:10.911329 14229 leader_election.cc:304] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:10.912251 15600 raft_consensus.cc:2749] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:10:10.915282 14187 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.007s	sys 0.030s
W20260709 12:10:10.915743 14187 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.539s	user 0.007s	sys 0.030s
I20260709 12:10:10.952250 14182 raft_consensus.cc:1275] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:10.954349 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:10.958648 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:10.960004 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:10.892762 16076 raft_consensus.cc:2749] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:10.966813 15600 raft_consensus.cc:493] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:10.968410 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:10.974418 14184 raft_consensus.cc:2468] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 3.
I20260709 12:10:10.970995 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:10:10.972086 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 665471us
I20260709 12:10:10.876044 16092 raft_consensus.cc:515] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:10.972646 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:10.968936 14339 raft_consensus.cc:1240] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 2 LEADER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:10.900465 15844 leader_election.cc:290] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 7 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:10.984344 14190 raft_consensus.cc:1275] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:10.985430 15600 raft_consensus.cc:515] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:10.899309 15802 raft_consensus.cc:515] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:10.993444 14303 leader_election.cc:304] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
W20260709 12:10:10.967442 16098 log.cc:927] Time spent T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:10:10.996263 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:11.000344 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:10.905445 16015 raft_consensus.cc:493] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:10:11.007562 15600 leader_election.cc:290] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:11.008026 15802 leader_election.cc:290] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:10.886452 15850 raft_consensus.cc:515] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:10:11.012778 16107 log.cc:927] Time spent T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.194s	user 0.000s	sys 0.001s
W20260709 12:10:11.013238 16101 log.cc:927] Time spent T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.254s	user 0.000s	sys 0.009s
I20260709 12:10:10.899940 16094 raft_consensus.cc:515] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:11.006762 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:10.998557 15910 raft_consensus.cc:493] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:13.690349 15910 raft_consensus.cc:515] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:13.692880 15910 leader_election.cc:290] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:10:11.026654 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 50043.5us
I20260709 12:10:11.136041 16114 raft_consensus.cc:493] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:11.651175 16125 log.cc:927] Time spent T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.429s	user 0.001s	sys 0.000s
I20260709 12:10:11.698083 16127 raft_consensus.cc:493] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:10:14.894158 16114 raft_consensus.cc:515] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:14.894627 16127 raft_consensus.cc:515] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:10:12.322256 16126 log.cc:927] Time spent T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.162s	user 0.001s	sys 0.000s
I20260709 12:10:12.691648 14188 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56046 (request call id 1671) took 1722 ms. Trace:
W20260709 12:10:13.606228 16115 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.964s	user 0.023s	sys 0.023s
W20260709 12:10:13.770665 14876 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.945s	user 0.015s	sys 0.029s
W20260709 12:10:13.786891 14264 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.806s	user 0.026s	sys 0.039s
W20260709 12:10:14.899174 14264 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 3.925s	user 0.027s	sys 0.039s
W20260709 12:10:14.898906 16115 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 3.257s	user 0.024s	sys 0.023s
I20260709 12:10:14.898636 14188 rpcz_store.cc:276] 0709 12:10:10.969646 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:10.979174 (+  9528us) service_pool.cc:224] Handling call
0709 12:10:12.691515 (+1712341us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:14.900058 14264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41764 (request call id 1939) took 4359 ms. Trace:
I20260709 12:10:13.856689 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
W20260709 12:10:13.690496 14190 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56046 (request call id 1660) took 2732 ms (client timeout 3279 ms). Trace:
I20260709 12:10:14.900429 14264 rpcz_store.cc:276] 0709 12:10:10.540433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:10.671207 (+130774us) service_pool.cc:224] Handling call
0709 12:10:10.794681 (+123474us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:10.809299 (+ 14618us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:10:10.970149 (+160850us) log.cc:844] Serialized 14 byte log entry
0709 12:10:14.899622 (+3929473us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:14.899687 (+    65us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:14.899745 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:14.899820 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:14.899959 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":316377,"prepare.run_cpu_time_us":88,"prepare.run_wall_time_us":1275,"thread_start_us":4086058,"threads_started":2,"wal-append.queue_time_us":234472}
I20260709 12:10:13.868232 16139 raft_consensus.cc:493] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:13.871325 14154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:14.825568 16144 raft_consensus.cc:493] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:11.039968 15920 consensus_queue.cc:237] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:15.104923 16172 raft_consensus.cc:493] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:15.106557 16172 raft_consensus.cc:515] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:11.022616 15754 consensus_queue.cc:237] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:11.055612 15844 raft_consensus.cc:3055] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:11.207070 15850 leader_election.cc:290] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:11.014726 15860 consensus_queue.cc:237] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:11.057897 15862 raft_consensus.cc:2749] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:10:11.815212 15888 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.704s	user 0.010s	sys 0.004s
W20260709 12:10:12.480862 15944 consensus_meta.cc:287] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 1.605s	user 0.003s	sys 0.011s
W20260709 12:10:11.094640 15951 consensus_meta.cc:287] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.837s	user 0.011s	sys 0.007s
W20260709 12:10:11.057307 15953 consensus_meta.cc:287] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.804s	user 0.014s	sys 0.010s
I20260709 12:10:11.047765 16015 raft_consensus.cc:515] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:15.284709 16015 leader_election.cc:290] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:10:11.094818 16081 consensus_meta.cc:287] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.552s	user 0.008s	sys 0.008s
I20260709 12:10:14.911289 14303 leader_election.cc:304] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
W20260709 12:10:12.478390 16091 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.125s	user 0.001s	sys 0.006s
W20260709 12:10:15.294142 16091 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 4.086s	user 0.001s	sys 0.008s
I20260709 12:10:11.208321 16094 leader_election.cc:290] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 4 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:10:11.094381 16096 consensus_meta.cc:287] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.984s	user 0.007s	sys 0.014s
I20260709 12:10:14.842847 16143 raft_consensus.cc:493] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
W20260709 12:10:14.849460 14339 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 3.792s	user 0.028s	sys 0.043s
W20260709 12:10:15.297570 14339 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 4.240s	user 0.029s	sys 0.043s
I20260709 12:10:15.297160 16143 raft_consensus.cc:515] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:14.866910 16145 raft_consensus.cc:493] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:14.872519 16099 log.cc:927] Time spent T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 4.525s	user 0.024s	sys 0.037s
I20260709 12:10:14.885851 14182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56046 (request call id 1662) took 3919 ms. Trace:
I20260709 12:10:15.308547 14182 rpcz_store.cc:276] 0709 12:10:10.958425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:14.876632 (+3918207us) service_pool.cc:224] Handling call
0709 12:10:14.877097 (+   465us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:14.877326 (+   229us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:14.877354 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:14.877400 (+    46us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:10:14.877454 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:14.877509 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:14.877654 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:15.311239 14182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56046 (request call id 1666) took 4351 ms. Trace:
I20260709 12:10:15.311685 14182 rpcz_store.cc:276] 0709 12:10:10.959439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.310183 (+4350744us) service_pool.cc:224] Handling call
0709 12:10:15.310586 (+   403us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:15.310807 (+   221us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:15.310836 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:15.310885 (+    49us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:15.310946 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:15.311004 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:15.311154 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:14.891171 14185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 1905) took 4830 ms. Trace:
I20260709 12:10:15.314105 14185 rpcz_store.cc:276] 0709 12:10:10.061171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:10.061312 (+   141us) service_pool.cc:224] Handling call
0709 12:10:10.061642 (+   330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:10.062054 (+   412us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:10.062080 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:10.062634 (+   554us) log.cc:844] Serialized 26 byte log entry
0709 12:10:10.191706 (+129072us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:10.218072 (+ 26366us) log.cc:844] Serialized 14 byte log entry
0709 12:10:10.223409 (+  5337us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:10.223502 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:14.890798 (+4667296us) raft_consensus.cc:1685] finished
0709 12:10:14.890830 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:14.891049 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":24761,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"raft.queue_time_us":2216,"raft.run_cpu_time_us":198,"raft.run_wall_time_us":199,"thread_start_us":128696,"threads_started":1,"wal-append.queue_time_us":192094,"wal-append.run_cpu_time_us":18580,"wal-append.run_wall_time_us":1810175}
I20260709 12:10:14.897533 16114 leader_election.cc:290] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:14.892234 16149 raft_consensus.cc:493] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:15.317590 16149 raft_consensus.cc:515] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:15.320612 16149 leader_election.cc:290] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:10:14.898874 14876 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 4.073s	user 0.015s	sys 0.030s
I20260709 12:10:15.322429 16091 raft_consensus.cc:493] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:15.323036 16091 raft_consensus.cc:515] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:10:14.903644 14189 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56046 (request call id 1664) took 3944 ms (client timeout 2082 ms). Trace:
W20260709 12:10:15.324748 14189 rpcz_store.cc:269] 0709 12:10:10.958924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:10.976783 (+ 17859us) service_pool.cc:224] Handling call
0709 12:10:14.903543 (+3926760us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:15.325452 16091 leader_election.cc:290] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:15.326747 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:10:14.901919 14190 rpcz_store.cc:269] 0709 12:10:10.957838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:10.989518 (+ 31680us) service_pool.cc:224] Handling call
0709 12:10:13.690385 (+2700867us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:15.330612 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:14.906052 14331 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50856 (request call id 1537) took 4700 ms. Trace:
I20260709 12:10:15.331552 14331 rpcz_store.cc:276] 0709 12:10:10.205272 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:14.888509 (+4683237us) service_pool.cc:224] Handling call
0709 12:10:14.888942 (+   433us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:14.889218 (+   276us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:10:14.898495 (+  9277us) log.cc:844] Serialized 14 byte log entry
0709 12:10:14.905544 (+  7049us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:14.905619 (+    75us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:14.905686 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:14.905798 (+   112us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:14.905967 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":4153,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":50,"raft.queue_time_us":21411,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":100,"thread_start_us":14873,"threads_started":2,"wal-append.queue_time_us":26868}
I20260709 12:10:14.908708 16144 raft_consensus.cc:515] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:15.336045 16144 leader_election.cc:290] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:14.901443 16127 leader_election.cc:290] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:14.902463 16139 raft_consensus.cc:515] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:15.338343 15827 raft_consensus.cc:493] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:15.338577 16139 leader_election.cc:290] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:10:14.911151 16113 log.cc:927] Time spent T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 3.803s	user 0.021s	sys 0.017s
I20260709 12:10:14.916621 16154 raft_consensus.cc:493] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:15.339030 15827 raft_consensus.cc:515] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:15.339906 16094 raft_consensus.cc:493] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:10:15.339715 16154 raft_consensus.cc:515] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:15.340456 16094 raft_consensus.cc:515] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:15.342262 16154 leader_election.cc:290] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:14.922259 14181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56652 (request call id 235) took 4703 ms. Trace:
I20260709 12:10:15.343014 14181 rpcz_store.cc:276] 0709 12:10:10.219194 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:10.264896 (+ 45702us) service_pool.cc:224] Handling call
0709 12:10:10.265319 (+   423us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:10.269371 (+  4052us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:10.269402 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:10.270434 (+  1032us) log.cc:844] Serialized 26 byte log entry
0709 12:10:10.378745 (+108311us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:10.378784 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:10.378856 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:14.921955 (+4543099us) raft_consensus.cc:1685] finished
0709 12:10:14.921978 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:14.922174 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3023,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":127,"thread_start_us":91312,"threads_started":1,"wal-append.queue_time_us":586846,"wal-append.run_cpu_time_us":2641,"wal-append.run_wall_time_us":1125914}
I20260709 12:10:15.344957 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:15.345644 14181 raft_consensus.cc:2468] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 2.
I20260709 12:10:15.346724 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:15.347864 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:14.927145 15738 raft_consensus.cc:493] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:10:15.348759 15738 raft_consensus.cc:515] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:15.349640 15827 leader_election.cc:290] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:15.350255 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:15.326773 14189 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56046 (request call id 1669) took 4357 ms. Trace:
I20260709 12:10:15.351709 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:14.927851 16155 raft_consensus.cc:493] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:15.353435 16155 raft_consensus.cc:515] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:14.932257 14335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50856 (request call id 1525) took 4931 ms. Trace:
I20260709 12:10:15.355098 16094 leader_election.cc:290] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:15.354939 14335 rpcz_store.cc:276] 0709 12:10:10.000833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:10.003419 (+  2586us) service_pool.cc:224] Handling call
0709 12:10:10.106686 (+103267us) spinlock_profiling.cc:243] Waited 3.78 ms on lock 0x7b5800065d98. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2124016b71 00007f2124016a22 00007f212cf2f8d9 00007f212c089ee0 00007f212c1530ab 00007f212c153131 00007f212c114fc0 00007f212c0ff929 00007f212c0ff3d2 00007f2125676bd4
0709 12:10:10.378526 (+271840us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:10.385467 (+  6941us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:14.931913 (+4546446us) spinlock_profiling.cc:243] Waited 272 ms on lock 0x7b54000fd7d0. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713a8ad 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:10:14.932122 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":633395200}
I20260709 12:10:15.353714 14331 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50858 (request call id 1303) took 4998 ms. Trace:
I20260709 12:10:15.356803 14335 raft_consensus.cc:1240] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:15.356532 14331 rpcz_store.cc:276] 0709 12:10:10.355527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.352639 (+4997112us) service_pool.cc:224] Handling call
0709 12:10:15.352997 (+   358us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:15.353255 (+   258us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:15.353295 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:15.353351 (+    56us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:15.353405 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:15.353480 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:15.353635 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:14.940212 16156 raft_consensus.cc:493] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:14.941645 16157 raft_consensus.cc:493] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:10:15.358063 16156 raft_consensus.cc:515] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:15.358268 16157 raft_consensus.cc:515] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:14.945034 16158 raft_consensus.cc:493] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:14.951701 16092 leader_election.cc:290] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:10:14.958472 14184 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56046 (request call id 1670) took 3989 ms (client timeout 1775 ms). Trace:
I20260709 12:10:15.359949 16158 raft_consensus.cc:515] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:10:15.360291 14184 rpcz_store.cc:269] 0709 12:10:10.969352 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:10.975205 (+  5853us) service_pool.cc:224] Handling call
0709 12:10:14.958314 (+3983109us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:14.947079 16153 raft_consensus.cc:493] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:15.362304 16153 raft_consensus.cc:515] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:14.949196 16148 raft_consensus.cc:493] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:15.363438 16148 raft_consensus.cc:515] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:15.364698 16153 leader_election.cc:290] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:14.988950 16104 raft_consensus.cc:493] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:15.366510 16104 raft_consensus.cc:515] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:10:14.990348 14875 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 3.857s	user 0.000s	sys 0.055s
I20260709 12:10:15.006807 14333 raft_consensus.cc:1240] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:15.368005 14187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56652 (request call id 234) took 5242 ms. Trace:
I20260709 12:10:15.368552 14333 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50858 (request call id 1302) took 5062 ms. Trace:
I20260709 12:10:15.369365 14181 raft_consensus.cc:2393] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db in current term 4: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
W20260709 12:10:15.012012 14304 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 4.212s	user 0.054s	sys 0.101s
I20260709 12:10:15.021131 16160 raft_consensus.cc:493] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:15.034277 16090 raft_consensus.cc:493] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:15.370081 16160 raft_consensus.cc:515] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } }
I20260709 12:10:15.370177 16090 raft_consensus.cc:515] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:15.351364 14189 rpcz_store.cc:276] 0709 12:10:10.969050 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.325649 (+4356599us) service_pool.cc:224] Handling call
0709 12:10:15.326150 (+   501us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:15.326406 (+   256us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:15.326434 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:15.326484 (+    50us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:15.326523 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:15.326579 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:15.326695 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:15.035557 16110 raft_consensus.cc:493] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:15.372169 16110 raft_consensus.cc:515] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:15.373699 14876 leader_election.cc:304] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:15.374521 16110 leader_election.cc:290] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:15.045497 16161 raft_consensus.cc:493] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:15.052798 15600 raft_consensus.cc:493] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:15.053272 16147 raft_consensus.cc:493] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:15.375298 16161 raft_consensus.cc:515] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:15.375908 16147 raft_consensus.cc:515] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:15.376327 16078 consensus_queue.cc:1048] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:10:15.047521 14337 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50856 (request call id 1540) took 4666 ms (client timeout 2741 ms). Trace:
W20260709 12:10:15.377873 14337 rpcz_store.cc:269] 0709 12:10:10.380602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:10.382575 (+  1973us) service_pool.cc:224] Handling call
0709 12:10:15.047213 (+4664638us) spinlock_profiling.cc:243] Waited 47.6 ms on lock 0x7b54002a6f54. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:10:15.047375 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":109454208}
I20260709 12:10:15.066859 16163 raft_consensus.cc:493] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:15.052222 16083 raft_consensus.cc:493] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:15.378873 16163 raft_consensus.cc:515] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:10:15.062583 14229 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 4.088s	user 0.035s	sys 0.035s
I20260709 12:10:15.084038 16168 raft_consensus.cc:493] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:15.308496 14330 raft_consensus.cc:2468] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 2.
I20260709 12:10:15.380388 14185 raft_consensus.cc:1275] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:15.093820 16169 raft_consensus.cc:493] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:15.381014 16169 raft_consensus.cc:515] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:15.382874 15924 raft_consensus.cc:493] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:15.095312 16170 raft_consensus.cc:493] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:15.383383 15924 raft_consensus.cc:515] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:10:15.070137 14302 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 4.271s	user 0.006s	sys 0.056s
I20260709 12:10:15.383859 16170 raft_consensus.cc:515] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:15.077162 15937 raft_consensus.cc:493] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:10:15.384804 15937 raft_consensus.cc:515] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:15.386225 16170 leader_election.cc:290] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:15.096655 16171 raft_consensus.cc:493] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:15.386937 15937 leader_election.cc:290] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:15.096788 14332 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 190) took 5027 ms. Trace:
I20260709 12:10:15.387018 16171 raft_consensus.cc:515] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:10:15.097364 14155 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 4.286s	user 0.048s	sys 0.060s
I20260709 12:10:15.108461 16173 raft_consensus.cc:493] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:15.114684 16174 raft_consensus.cc:493] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:15.116453 16175 raft_consensus.cc:493] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:15.118119 14262 raft_consensus.cc:1275] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:10:15.132486 16087 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 4.222s	user 0.017s	sys 0.035s
I20260709 12:10:15.133486 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:15.397356 14339 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50856 (request call id 1536) took 5192 ms. Trace:
I20260709 12:10:15.137465 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:15.198945 14328 tablet_service.cc:1558] Processing DeleteTablet for tablet bf9bea0d16e44efabb5cdd53e3828438 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 5 (current committed config index is 6)) from {username='slave'} at 127.0.0.1:55416
I20260709 12:10:15.194904 16076 raft_consensus.cc:493] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
W20260709 12:10:15.207371 14088 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60436 (request call id 283) took 12757 ms (client timeout 15000 ms). Trace:
I20260709 12:10:15.198750 14087 catalog_manager.cc:5697] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: term changed from 2 to 4, leader changed from 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130) to 65c9c1653b3346b39a0e118540e6080c (127.12.174.131). New cstate: current_term: 4 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } }
I20260709 12:10:15.219499 16165 raft_consensus.cc:493] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:15.239706 16177 raft_consensus.cc:493] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:15.231833 15844 raft_consensus.cc:740] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:15.261675 16183 raft_consensus.cc:493] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:15.263587 14338 raft_consensus.cc:2410] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 12:10:15.262292 15888 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 4.167s	user 0.014s	sys 0.004s
I20260709 12:10:15.278501 16180 raft_consensus.cc:493] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:15.288556 16081 raft_consensus.cc:515] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:11.131119 16080 leader_election.cc:290] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:15.294678 15951 raft_consensus.cc:2749] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:15.519304 16171 leader_election.cc:290] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:14.866163 16146 raft_consensus.cc:493] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
W20260709 12:10:15.294839 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 383617us
I20260709 12:10:15.307608 14336 raft_consensus.cc:2468] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 4.
I20260709 12:10:15.362654 16158 leader_election.cc:290] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:15.520257 16146 raft_consensus.cc:515] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:15.522251 16081 leader_election.cc:290] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:15.357720 14335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50858 (request call id 1304) took 4985 ms. Trace:
I20260709 12:10:15.368966 14333 rpcz_store.cc:276] 0709 12:10:10.306203 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.006182 (+4699979us) service_pool.cc:224] Handling call
0709 12:10:15.006572 (+   390us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:15.368263 (+361691us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:15.368479 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:15.016865 14186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56046 (request call id 1661) took 4058 ms. Trace:
I20260709 12:10:15.370718 14190 raft_consensus.cc:3060] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:10:15.372551 16160 leader_election.cc:290] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:15.377410 16127 raft_consensus.cc:2804] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:15.378239 16147 leader_election.cc:290] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:15.073273 14183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 1897) took 5014 ms. Trace:
I20260709 12:10:15.380025 16168 raft_consensus.cc:515] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:15.527786 16168 leader_election.cc:290] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:15.389004 15924 leader_election.cc:290] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:15.112051 16172 leader_election.cc:290] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:15.086727 16164 raft_consensus.cc:493] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
W20260709 12:10:12.367949 15942 consensus_meta.cc:287] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 1.461s	user 0.012s	sys 0.000s
I20260709 12:10:15.387624 14332 rpcz_store.cc:276] 0709 12:10:10.068990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:10.218228 (+149238us) service_pool.cc:224] Handling call
0709 12:10:10.218601 (+   373us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:10.225923 (+  7322us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:10.225955 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:10.232737 (+  6782us) log.cc:844] Serialized 26 byte log entry
0709 12:10:15.096031 (+4863294us) spinlock_profiling.cc:243] Waited 1.07 ms on lock 0x7b18002485c0. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f212cf16ab1 00007f212cf23281 00007f2126ce34bc 00007f212403148b 00007f212ce8b9a9 00007f212404d69b 00007f212404b93f 00007f212404dc02 00007f2126cd520b 00007f2126cdad23 00007f2126cdb0d1
0709 12:10:15.096248 (+   217us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:15.096287 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:15.096369 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:15.096425 (+    56us) raft_consensus.cc:1685] finished
0709 12:10:15.096437 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:15.096705 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29484,"raft.queue_time_us":18811,"raft.run_cpu_time_us":225,"raft.run_wall_time_us":13667,"spinlock_wait_cycles":2460544,"thread_start_us":45584,"threads_started":1,"wal-append.queue_time_us":186418,"wal-append.run_cpu_time_us":12152,"wal-append.run_wall_time_us":1673878}
I20260709 12:10:15.544673 14182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56046 (request call id 1667) took 4576 ms. Trace:
I20260709 12:10:15.545120 14182 rpcz_store.cc:276] 0709 12:10:10.968416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.312803 (+4344387us) service_pool.cc:224] Handling call
0709 12:10:15.313358 (+   555us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:15.380729 (+ 67371us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:15.391848 (+ 11119us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:15.397683 (+  5835us) log.cc:844] Serialized 52 byte log entry
0709 12:10:15.511120 (+113437us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:10:15.511170 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:15.511257 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:15.544421 (+ 33164us) raft_consensus.cc:1685] finished
0709 12:10:15.544443 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:15.544602 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3265,"raft.queue_time_us":80262,"raft.run_cpu_time_us":210,"raft.run_wall_time_us":37869,"thread_start_us":36313,"threads_started":1,"wal-append.queue_time_us":85110}
I20260709 12:10:15.375376 15600 raft_consensus.cc:515] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:15.368377 14187 rpcz_store.cc:276] 0709 12:10:10.126029 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:10.214103 (+ 88074us) service_pool.cc:224] Handling call
0709 12:10:10.214460 (+   357us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:10.214709 (+   249us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:10.214754 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:10.299697 (+ 84943us) spinlock_profiling.cc:243] Waited 1.08 ms on lock 0x7b2c0006d948. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2125a34a11 00007f2125a44372 00007f2127176a01 00007f212713b43a 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2
0709 12:10:10.305217 (+  5520us) log.cc:844] Serialized 26 byte log entry
0709 12:10:10.923038 (+617821us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:10.923082 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:10.923155 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:14.908016 (+3984861us) spinlock_profiling.cc:243] Waited 7.2 ms on lock 0x7b4400022b4c. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2123f74c85 00007f2123f756a2 00007f2126ce71db 00007f2126ce2aaf 00007f2126cd686e 00007f2126cd5bb6 00007f2126cd57d8 00007f2126cdf221 00007f2126cdf1d9 00007f2126cdf169
0709 12:10:15.367740 (+459724us) raft_consensus.cc:1685] finished
0709 12:10:15.367766 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:15.367931 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19054592,"thread_start_us":546186,"threads_started":1,"wal-append.queue_time_us":703829}
I20260709 12:10:15.393399 14185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56046 (request call id 1668) took 4424 ms. Trace:
I20260709 12:10:15.548411 14185 rpcz_store.cc:276] 0709 12:10:10.968777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.316325 (+4347548us) service_pool.cc:224] Handling call
0709 12:10:15.316724 (+   399us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:15.380774 (+ 64050us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:15.393144 (+ 12370us) spinlock_profiling.cc:243] Waited 62 ms on lock 0x7b5400289bd4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:10:15.393332 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":142701312}
I20260709 12:10:15.360641 16156 leader_election.cc:290] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:10:15.396073 14875 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 4.263s	user 0.000s	sys 0.055s
W20260709 12:10:15.308141 14230 connection.cc:256] RPC call timeout handler was delayed by -3.1545700239998951s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2082s for a response
W20260709 12:10:15.550861 14230 connection.cc:256] RPC call timeout handler was delayed by -2.5591255370002273s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1676s for a response
W20260709 12:10:15.551206 14230 connection.cc:256] RPC call timeout handler was delayed by -2.2404705230001127s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2741s for a response
W20260709 12:10:15.551476 14230 connection.cc:256] RPC call timeout handler was delayed by -2.0623255370001061s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22280000000000003s for a response
W20260709 12:10:15.553589 14230 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.174.131:45957 timed out after 1.676s (SENT) [suppressed 17 similar messages]
I20260709 12:10:15.135097 16166 raft_consensus.cc:493] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:15.555651 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:15.393270 16104 leader_election.cc:290] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:15.398451 16157 leader_election.cc:290] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:10:15.399291 14302 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 4.600s	user 0.006s	sys 0.057s
W20260709 12:10:15.439906 14229 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 4.466s	user 0.036s	sys 0.035s
I20260709 12:10:15.440708 14256 raft_consensus.cc:2393] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db in current term 4: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
W20260709 12:10:15.425144 14155 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 4.614s	user 0.049s	sys 0.060s
W20260709 12:10:15.442399 14304 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 4.642s	user 0.055s	sys 0.101s
W20260709 12:10:15.566715 14155 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:15.438321 14257 raft_consensus.cc:2410] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:10:15.383443 16169 leader_election.cc:290] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:15.445950 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:15.439641 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:15.379246 16083 raft_consensus.cc:515] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:15.370307 15738 leader_election.cc:290] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:15.443455 14087 catalog_manager.cc:5697] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: term changed from 1 to 3, leader changed from 65c9c1653b3346b39a0e118540e6080c (127.12.174.131) to 73d01e9b1a9d49358da4985b21d681db (127.12.174.132). New cstate: current_term: 3 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
W20260709 12:10:15.399114 16087 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 4.490s	user 0.018s	sys 0.035s
I20260709 12:10:15.360085 14331 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50856 (request call id 1539) took 4979 ms. Trace:
W20260709 12:10:15.457088 14338 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50858 (request call id 1300) took 5199 ms (client timeout 2194 ms). Trace:
W20260709 12:10:15.386950 14330 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50858 (request call id 1294) took 5337 ms (client timeout 1964 ms). Trace:
I20260709 12:10:15.527825 16161 leader_election.cc:290] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:10:15.573342 14155 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:15.397359 15920 raft_consensus.cc:493] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:15.439875 15937 consensus_queue.cc:1048] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 12:10:15.389520 16173 raft_consensus.cc:515] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:10:15.440423 14088 rpcz_store.cc:269] 0709 12:10:02.449585 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:02.449749 (+   164us) service_pool.cc:224] Handling call
0709 12:10:02.832328 (+382579us) spinlock_profiling.cc:243] Waited 163 ms on lock 0x7b54002e3454. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a5090 00007f2127143f3a 00007f212cef9e9c 00007f212cff804e 00007f212b4b92a4 00007f212b4b9232 00007f212b4b9161 00007f212b4b90dc 00007f212b4b8392 00007f212547648c 00007f21254758c6
0709 12:10:15.206816 (+12374488us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:10.883806 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:11.083789 (+199983us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:11.087349 (+  3560us) write_op.cc:435] Acquired schema lock
0709 12:10:11.090778 (+  3429us) tablet.cc:662] Decoding operations
0709 12:10:11.132119 (+ 41341us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:11.135896 (+  3777us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:11.135949 (+    53us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:10:11.160121 (+ 24172us) tablet.cc:701] Row locks acquired
0709 12:10:11.163950 (+  3829us) write_op.cc:260] PREPARE: finished
0709 12:10:11.183832 (+ 19882us) write_op.cc:270] Start()
0709 12:10:11.194000 (+ 10168us) write_op.cc:276] Timestamp: P: 1783599011183727 usec, L: 0
0709 12:10:11.194893 (+   893us) op_driver.cc:348] REPLICATION: starting
0709 12:10:11.299432 (+104539us) log.cc:844] Serialized 544 byte log entry
0709 12:10:14.900331 (+3600899us) op_driver.cc:464] REPLICATION: finished
0709 12:10:14.980116 (+ 79785us) write_op.cc:301] APPLY: starting
0709 12:10:14.980220 (+   104us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:14.980336 (+   116us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:14.980677 (+   341us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:14.980963 (+   286us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:14.981140 (+   177us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:10:14.981203 (+    63us) write_op.cc:312] APPLY: finished
0709 12:10:14.981605 (+   402us) log.cc:844] Serialized 23 byte log entry
0709 12:10:15.038822 (+ 57217us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:15.039042 (+   220us) write_op.cc:454] Released schema lock
0709 12:10:15.039087 (+    45us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:15.039524 (+   437us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:15.039552 (+    28us) write_op.cc:454] Released schema lock
0709 12:10:15.120107 (+ 80555us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b54002e3454. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713832a 00007f21270bdf14 00007f21270bdec3 00007f21270bde38 00007f21270bddf3 00007f21270bd0dc 00007f21270e6e16 00007f21270cecbb 00007f21270b939d 00007f21270bcd75
Metrics: {"mutex_wait_us":24858,"reported_tablets":7,"spinlock_wait_cycles":374104448,"child_traces":[["op",{"apply.queue_time_us":79440,"apply.run_cpu_time_us":13245,"apply.run_wall_time_us":59412,"num_ops":1,"prepare.queue_time_us":564266,"prepare.run_cpu_time_us":53972,"prepare.run_wall_time_us":4016236,"raft.queue_time_us":172050,"raft.run_cpu_time_us":19819,"raft.run_wall_time_us":1314851,"replication_time_us":3705260,"spinlock_wait_cycles":2517537536,"thread_start_us":3904592,"threads_started":5,"wal-append.queue_time_us":2388890,"wal-append.run_cpu_time_us":4469,"wal-append.run_wall_time_us":1174402}]]}
I20260709 12:10:15.390121 16145 raft_consensus.cc:515] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:15.459908 16076 raft_consensus.cc:515] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:15.441896 16175 raft_consensus.cc:515] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:15.440042 16174 raft_consensus.cc:515] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:15.598874 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:15.490032 15844 consensus_queue.cc:260] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:15.494593 16090 leader_election.cc:290] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:15.471570 16183 raft_consensus.cc:515] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:10:15.512476 16189 log.cc:927] Time spent T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 12:10:15.473493 16180 raft_consensus.cc:515] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:15.456049 16177 raft_consensus.cc:515] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:15.572685 15888 raft_consensus.cc:493] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:15.506211 16143 leader_election.cc:290] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:15.518158 16163 leader_election.cc:290] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:15.448383 16165 raft_consensus.cc:515] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:15.618980 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:15.521479 14303 leader_election.cc:304] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
W20260709 12:10:15.639675 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 118295us
I20260709 12:10:15.640635 14303 leader_election.cc:304] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:14.980124 16159 raft_consensus.cc:493] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:15.523658 14335 rpcz_store.cc:276] 0709 12:10:10.372174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.356188 (+4984014us) service_pool.cc:224] Handling call
0709 12:10:15.356589 (+   401us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:15.357419 (+   830us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:15.357651 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:15.593075 15924 raft_consensus.cc:493] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:15.583621 16104 raft_consensus.cc:493] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:10:15.528905 16164 raft_consensus.cc:515] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:15.534040 16146 leader_election.cc:290] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:15.534344 16148 leader_election.cc:290] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:15.525425 14183 rpcz_store.cc:276] 0709 12:10:10.058805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:10.085185 (+ 26380us) service_pool.cc:224] Handling call
0709 12:10:10.096079 (+ 10894us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:10.099566 (+  3487us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:10.099606 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:10.100197 (+   591us) log.cc:844] Serialized 26 byte log entry
0709 12:10:10.162884 (+ 62687us) spinlock_profiling.cc:243] Waited 7.9 ms on lock 0x7b18003a17a0. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f212cf16ab1 00007f212cf23281 00007f2124030e07 00007f212ce8b9a9 00007f212404d69b 00007f212404b93f 00007f212404dc02 00007f2126cd520b 00007f2126cdad23 00007f2126cdb0d1 00007f21270f6a0f
0709 12:10:10.258647 (+ 95763us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:10:10.258704 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:10.258790 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:15.072892 (+4814102us) spinlock_profiling.cc:243] Waited 8.07 ms on lock 0x7b2c00130778. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21253eb291 00007f21254060ca 00007f21271344ad 00007f212713bf8e 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2
0709 12:10:15.073006 (+   114us) raft_consensus.cc:1685] finished
0709 12:10:15.073035 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:15.073194 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1229,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":157,"spinlock_wait_cycles":36737536,"thread_start_us":95508,"threads_started":1,"wal-append.queue_time_us":284703,"wal-append.run_cpu_time_us":15813,"wal-append.run_wall_time_us":1677150}
I20260709 12:10:15.540791 16155 leader_election.cc:290] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:15.541813 14190 raft_consensus.cc:2468] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 4.
I20260709 12:10:15.544400 15942 raft_consensus.cc:515] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:15.391072 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:10:15.549932 14154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:15.554538 16078 raft_consensus.cc:493] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:15.554070 15875 raft_consensus.cc:493] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
W20260709 12:10:15.559461 14336 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50858 (request call id 1301) took 5271 ms (client timeout 1619 ms). Trace:
I20260709 12:10:15.565284 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:15.701558 14910 raft_consensus.cc:2468] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 3.
I20260709 12:10:15.570348 14188 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56046 (request call id 1665) took 4611 ms. Trace:
I20260709 12:10:15.561127 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:15.580358 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:15.475735 14334 raft_consensus.cc:2368] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 2. Current term is 3.
I20260709 12:10:15.573227 14877 leader_election.cc:304] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
W20260709 12:10:15.705255 14304 connection.cc:256] RPC call timeout handler was delayed by -3.5710271460000058s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2073s for a response
I20260709 12:10:15.580041 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
W20260709 12:10:15.582820 14338 rpcz_store.cc:269] 0709 12:10:10.257430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:10.292983 (+ 35553us) service_pool.cc:224] Handling call
0709 12:10:15.456804 (+5163821us) spinlock_profiling.cc:243] Waited 4.97 s on lock 0x7b54000b7a54. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:10:15.456996 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11423447808}
I20260709 12:10:15.584861 15600 leader_election.cc:290] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:15.596129 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:15.597319 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:15.598129 15738 raft_consensus.cc:493] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:15.606678 14258 raft_consensus.cc:2468] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 4.
I20260709 12:10:15.567874 16172 raft_consensus.cc:493] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:15.584142 14087 catalog_manager.cc:5697] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:10:15.556331 16166 raft_consensus.cc:515] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:15.441098 14339 rpcz_store.cc:276] 0709 12:10:10.204966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:11.020821 (+815855us) service_pool.cc:224] Handling call
0709 12:10:11.039518 (+ 18697us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:11.039828 (+   310us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:10:15.307686 (+4267858us) log.cc:844] Serialized 14 byte log entry
0709 12:10:15.397003 (+ 89317us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:15.397057 (+    54us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:15.397110 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:15.397177 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:15.397287 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1268481,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":72,"raft.queue_time_us":2642,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":16966,"thread_start_us":4329352,"threads_started":2}
I20260709 12:10:15.582576 16110 raft_consensus.cc:493] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:15.573642 16170 raft_consensus.cc:493] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:15.638396 14181 raft_consensus.cc:2468] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 4.
I20260709 12:10:15.523850 14186 rpcz_store.cc:276] 0709 12:10:10.958150 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.015657 (+4057507us) service_pool.cc:224] Handling call
0709 12:10:15.016149 (+   492us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:15.016396 (+   247us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:15.016425 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:15.016473 (+    48us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:10:15.016516 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:15.016573 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:15.016724 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:15.643334 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:15.529505 16127 raft_consensus.cc:493] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:15.572484 16185 raft_consensus.cc:493] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:15.662166 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
W20260709 12:10:15.589102 14330 rpcz_store.cc:269] 0709 12:10:10.049234 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:10.110615 (+ 61381us) service_pool.cc:224] Handling call
0709 12:10:15.386709 (+5276094us) spinlock_profiling.cc:243] Waited 5.07 s on lock 0x7b54002819d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:10:15.386849 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11658710912}
I20260709 12:10:15.681403 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:15.573851 14256 raft_consensus.cc:1240] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 6 LEADER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:15.596199 15920 raft_consensus.cc:515] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:15.661598 15888 raft_consensus.cc:515] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:15.777521 16163 raft_consensus.cc:493] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:15.773173 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:15.793695 14910 raft_consensus.cc:2368] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 3. Current term is 4.
I20260709 12:10:15.685086 16171 consensus_queue.cc:1059] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 12:10:15.683342 15924 raft_consensus.cc:515] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:10:15.696359 14073 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet f4739bc22bfe44fcba807da02d9351b6 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187) due to error UNKNOWN_ERROR; will retry: Invalid argument: Cannot remove peer 885067a0d31741bfb5c9935788e315bf from the config because it is the leader. Force another leader to be elected to remove this peer. Consensus state: current_term: 3 leader_uuid: "885067a0d31741bfb5c9935788e315bf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:10:15.774081 16148 raft_consensus.cc:493] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:15.697360 14265 raft_consensus.cc:2368] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for earlier term 3. Current term is 4.
I20260709 12:10:15.697937 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:15.693526 14264 raft_consensus.cc:2468] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 1.
I20260709 12:10:15.476166 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:15.685463 14184 raft_consensus.cc:1275] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:10:15.793342 16163 raft_consensus.cc:515] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:15.690382 16167 raft_consensus.cc:3060] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:15.776822 14155 connection.cc:256] RPC call timeout handler was delayed by -4.0954781529999309s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16190000000000002s for a response
I20260709 12:10:15.792917 14260 raft_consensus.cc:2410] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 12:10:15.794466 14073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 98225.2us
I20260709 12:10:15.776486 14074 catalog_manager.cc:5028] TS 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957): tablet bf9bea0d16e44efabb5cdd53e3828438 (table test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]) successfully deleted
I20260709 12:10:15.687083 16081 raft_consensus.cc:2804] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:15.686839 16104 raft_consensus.cc:515] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } }
W20260709 12:10:15.873171 14074 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 96700.4us
I20260709 12:10:15.773753 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
W20260709 12:10:15.828586 14155 connection.cc:256] RPC call timeout handler was delayed by -4.0954781529999309s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16190000000000002s for a response
I20260709 12:10:15.888367 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:15.777307 14908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:15.894299 14339 raft_consensus.cc:2393] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db in current term 4: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
W20260709 12:10:15.700671 14336 rpcz_store.cc:269] 0709 12:10:10.288495 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:10.292613 (+  4118us) service_pool.cc:224] Handling call
0709 12:10:15.559317 (+5266704us) spinlock_profiling.cc:243] Waited 4.96 s on lock 0x7b54000b8954. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:10:15.559398 (+    81us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11407699200}
W20260709 12:10:15.893486 14155 connection.cc:256] RPC call timeout handler was delayed by -3.950578152999924s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17800000000000002s for a response
W20260709 12:10:15.705421 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 132314us
I20260709 12:10:15.874820 14912 raft_consensus.cc:2410] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260709 12:10:15.895411 14155 connection.cc:256] RPC call timeout handler was delayed by -3.784978153000111s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19640000000000002s for a response
W20260709 12:10:15.892948 14304 connection.cc:256] RPC call timeout handler was delayed by -3.40058636699996s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1884s for a response
W20260709 12:10:15.896072 14155 connection.cc:256] RPC call timeout handler was delayed by -3.7786781530001008s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19710000000000003s for a response
I20260709 12:10:15.799539 14154 leader_election.cc:304] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
W20260709 12:10:15.897715 14154 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 98257.1us
W20260709 12:10:15.756843 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 67750.7us
I20260709 12:10:15.899437 14154 leader_election.cc:400] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 3 pre-election: Vote denied by peer 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341) with higher term. Message: Invalid argument: T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 3. Current term is 4.
I20260709 12:10:15.899788 14154 leader_election.cc:403] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:15.795058 14335 raft_consensus.cc:2468] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 4.
W20260709 12:10:15.898944 14155 connection.cc:256] RPC call timeout handler was delayed by -3.7786781530001008s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19710000000000003s for a response
W20260709 12:10:15.902307 14155 connection.cc:256] RPC call timeout handler was delayed by -3.7687781530000848s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19820000000000002s for a response
W20260709 12:10:15.902690 14155 connection.cc:256] RPC call timeout handler was delayed by -3.6184781530000691s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2149s for a response
I20260709 12:10:15.900125 14087 catalog_manager.cc:5697] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: term changed from 1 to 2, leader changed from 885067a0d31741bfb5c9935788e315bf (127.12.174.129) to 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130). New cstate: current_term: 2 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:15.691159 16160 raft_consensus.cc:493] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:10:15.688510 16157 raft_consensus.cc:493] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:15.582507 14331 rpcz_store.cc:276] 0709 12:10:10.380274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.358988 (+4978714us) service_pool.cc:224] Handling call
0709 12:10:15.359459 (+   471us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:15.359696 (+   237us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:15.359724 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:15.359776 (+    52us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:15.359814 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:15.359887 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:15.360012 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:15.702562 14188 rpcz_store.cc:276] 0709 12:10:10.959197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:14.900419 (+3941222us) service_pool.cc:224] Handling call
0709 12:10:14.900805 (+   386us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:15.425909 (+525104us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:15.425962 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:15.444365 (+ 18403us) log.cc:844] Serialized 26 byte log entry
0709 12:10:15.486503 (+ 42138us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:15.515439 (+ 28936us) log.cc:844] Serialized 14 byte log entry
0709 12:10:15.515690 (+   251us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:15.561330 (+ 45640us) spinlock_profiling.cc:243] Waited 438 ms on lock 0x7b540028b4d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:10:15.561377 (+    47us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:15.561421 (+    44us) raft_consensus.cc:1685] finished
0709 12:10:15.570123 (+  8702us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:15.570272 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":86400,"prepare.queue_time_us":120382,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":52,"raft.queue_time_us":86749,"raft.run_cpu_time_us":273,"raft.run_wall_time_us":7216,"spinlock_wait_cycles":1008067968,"thread_start_us":31854,"threads_started":2,"wal-append.queue_time_us":73428}
I20260709 12:10:15.904858 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:15.828327 16127 raft_consensus.cc:3060] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:15.922423 14155 connection.cc:256] RPC call timeout handler was delayed by -3.5779781530000037s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2194s for a response
I20260709 12:10:15.956053 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:15.928256 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:15.936087 14337 raft_consensus.cc:3060] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:15.936992 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:10:15.882072 14933 debug-util.cc:398] Leaking SignalData structure 0x7b08002dc060 after lost signal to thread 12989
I20260709 12:10:15.697852 15942 leader_election.cc:290] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 4 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:10:15.950192 14265 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41764 (request call id 1940) took 5303 ms (client timeout 1884 ms). Trace:
W20260709 12:10:15.956434 14155 connection.cc:256] RPC call timeout handler was delayed by -3.5779781530000037s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2194s for a response
I20260709 12:10:15.787345 15937 raft_consensus.cc:3060] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:15.792452 16083 leader_election.cc:290] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:15.953979 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:15.954248 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:15.776927 16156 raft_consensus.cc:493] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:15.958509 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:15.794312 16110 raft_consensus.cc:515] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:15.777696 16143 raft_consensus.cc:493] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:15.874502 16147 raft_consensus.cc:3055] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:15.693372 16096 raft_consensus.cc:493] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:10:15.961179 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:15.776757 16158 raft_consensus.cc:493] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:15.962098 14155 connection.cc:256] RPC call timeout handler was delayed by -3.0802781530001084s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2747s for a response
I20260709 12:10:15.963313 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:15.774001 16161 raft_consensus.cc:493] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:15.961869 14265 rpcz_store.cc:269] 0709 12:10:10.623892 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:10.812203 (+188311us) service_pool.cc:224] Handling call
0709 12:10:15.926480 (+5114277us) spinlock_profiling.cc:243] Waited 4.81 s on lock 0x7b54002c0954. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:10:15.926666 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11068429056}
I20260709 12:10:15.965044 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:15.881912 16076 leader_election.cc:290] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:15.967787 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:15.786774 16146 raft_consensus.cc:493] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
W20260709 12:10:15.968730 14154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:15.922821 16149 raft_consensus.cc:2749] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341) with higher term. Message: Invalid argument: T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 3. Current term is 4.
I20260709 12:10:15.972818 14190 raft_consensus.cc:2468] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 1.
I20260709 12:10:15.923331 16139 raft_consensus.cc:2804] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:15.793949 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:15.887797 16081 raft_consensus.cc:697] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 2 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:15.971037 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:15.756747 15944 raft_consensus.cc:493] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:16.057327 15944 raft_consensus.cc:515] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:16.058586 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:16.059432 14265 raft_consensus.cc:2393] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 4: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:10:16.060556 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:16.061074 15944 leader_election.cc:290] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:16.061976 16092 raft_consensus.cc:493] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:16.062126 16087 raft_consensus.cc:493] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:10:15.980244 14338 raft_consensus.cc:2468] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 2.
I20260709 12:10:16.063323 15924 leader_election.cc:290] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:16.063141 16087 raft_consensus.cc:515] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:15.966290 16157 raft_consensus.cc:515] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:16.064244 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:15.713181 16155 raft_consensus.cc:493] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:10:16.050709 16139 raft_consensus.cc:493] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:15.942414 16112 raft_consensus.cc:3055] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:15.882360 16185 raft_consensus.cc:515] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:16.067415 16112 raft_consensus.cc:740] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
W20260709 12:10:16.035907 16113 log.cc:927] Time spent T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:10:16.044461 16163 leader_election.cc:290] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:16.050951 16161 raft_consensus.cc:515] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:16.072566 16185 leader_election.cc:290] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:15.992038 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:15.992659 16174 leader_election.cc:290] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:15.992841 15844 raft_consensus.cc:3060] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:15.993119 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:15.993920 14907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:15.905881 15738 raft_consensus.cc:515] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:15.995113 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:16.000289 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:16.001097 14877 leader_election.cc:304] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 885067a0d31741bfb5c9935788e315bf
W20260709 12:10:16.083433 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 82430.6us
I20260709 12:10:16.048355 16164 leader_election.cc:290] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:16.003078 14337 raft_consensus.cc:2468] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 4.
I20260709 12:10:15.874173 16170 raft_consensus.cc:515] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:16.082727 16157 leader_election.cc:290] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:10:16.005076 14334 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50858 (request call id 1298) took 5779 ms (client timeout 1971 ms). Trace:
W20260709 12:10:16.130124 14334 rpcz_store.cc:269] 0709 12:10:10.226105 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:10.290889 (+ 64784us) service_pool.cc:224] Handling call
0709 12:10:16.004749 (+5713860us) spinlock_profiling.cc:243] Waited 5.18 s on lock 0x7b54000fc8d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:10:16.004904 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11914770304}
I20260709 12:10:16.131547 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:16.132853 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:16.004849 16166 leader_election.cc:290] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:15.901188 16172 raft_consensus.cc:515] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:15.992614 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:16.063071 16092 raft_consensus.cc:515] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:16.006299 16104 leader_election.cc:290] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:16.049430 16146 raft_consensus.cc:515] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:15.685411 16159 raft_consensus.cc:515] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:16.020794 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:16.020989 14335 raft_consensus.cc:2410] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:10:16.022419 14876 leader_election.cc:304] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:10:15.711925 15875 raft_consensus.cc:515] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:15.889271 16148 raft_consensus.cc:515] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:16.020741 14336 raft_consensus.cc:2468] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 4.
I20260709 12:10:16.033043 14908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:16.033933 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:16.159294 14262 raft_consensus.cc:2410] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:10:16.159508 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:16.034969 14260 raft_consensus.cc:2468] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 4.
I20260709 12:10:16.160295 14187 raft_consensus.cc:3060] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:16.161168 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:16.133759 16130 raft_consensus.cc:2804] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:16.161962 14260 raft_consensus.cc:2468] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 2.
I20260709 12:10:16.162999 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:16.036360 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:15.997344 16173 leader_election.cc:290] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:16.025480 14189 raft_consensus.cc:2468] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 4.
I20260709 12:10:16.050258 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:15.981607 15827 raft_consensus.cc:493] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:16.055555 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:16.055025 16081 consensus_queue.cc:237] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:16.056504 14330 raft_consensus.cc:2393] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 7: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:10:16.057835 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:16.172287 15738 leader_election.cc:290] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:16.172665 14912 raft_consensus.cc:2468] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 4.
I20260709 12:10:16.173774 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:16.175108 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:16.065538 16155 raft_consensus.cc:515] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:16.178190 16155 leader_election.cc:290] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:16.178287 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:16.066870 16139 raft_consensus.cc:3060] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:16.179031 14335 raft_consensus.cc:2468] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 4.
I20260709 12:10:16.180049 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:16.180621 14335 raft_consensus.cc:2376] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 3. Re-sending same reply.
I20260709 12:10:16.181946 14334 raft_consensus.cc:2468] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 4.
I20260709 12:10:16.181545 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:16.183677 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:16.184317 16180 leader_election.cc:290] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:16.184867 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:15.980435 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:15.770059 14183 consensus_queue.cc:237] T f4739bc22bfe44fcba807da02d9351b6 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 4, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: false } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:16.186375 14264 raft_consensus.cc:2393] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 3: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
W20260709 12:10:16.066308 14303 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:15.991185 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
W20260709 12:10:16.068655 14229 connection.cc:256] RPC call timeout handler was delayed by -3.650748546999921s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15560000000000002s for a response
I20260709 12:10:16.061141 14265 raft_consensus.cc:3060] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:16.067129 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:10:16.191740 14229 connection.cc:256] RPC call timeout handler was delayed by -3.6399485469999036s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15680000000000002s for a response
I20260709 12:10:16.047307 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:16.034130 16158 raft_consensus.cc:515] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:16.046782 16090 raft_consensus.cc:493] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:10:16.019362 16143 raft_consensus.cc:515] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:15.966521 16160 raft_consensus.cc:515] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:16.152747 16110 leader_election.cc:290] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:16.076444 16087 leader_election.cc:290] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:16.025419 15951 raft_consensus.cc:493] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:10:16.045934 15862 raft_consensus.cc:493] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:16.217727 15738 raft_consensus.cc:493] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:16.010035 16156 raft_consensus.cc:515] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:16.003129 16145 leader_election.cc:290] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:16.085940 14877 leader_election.cc:304] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:16.117177 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:16.223208 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:16.223839 14185 raft_consensus.cc:2468] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 4.
I20260709 12:10:16.224709 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:16.224617 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:16.073423 16076 raft_consensus.cc:493] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:16.074740 16183 leader_election.cc:290] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:16.111374 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:10:16.077556 14933 debug-util.cc:398] Leaking SignalData structure 0x7b08002dc740 after lost signal to thread 14122
W20260709 12:10:16.137238 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 143331us
I20260709 12:10:16.137288 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:16.137502 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:16.205211 16173 raft_consensus.cc:493] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:16.053097 16096 raft_consensus.cc:515] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:10:16.147189 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 113538us
I20260709 12:10:16.142326 14909 raft_consensus.cc:2468] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 3.
I20260709 12:10:16.010066 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:16.089305 16175 leader_election.cc:290] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:16.166069 14908 raft_consensus.cc:2393] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 4: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
I20260709 12:10:16.160306 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:16.192778 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
W20260709 12:10:16.192157 14229 connection.cc:256] RPC call timeout handler was delayed by -3.4536485469998297s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1775s for a response
W20260709 12:10:16.264325 14229 connection.cc:256] RPC call timeout handler was delayed by -3.3267485469998519s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1916s for a response
W20260709 12:10:16.264737 14229 connection.cc:256] RPC call timeout handler was delayed by -3.1773485469998377s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2082s for a response
I20260709 12:10:16.205492 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:10:16.265084 14229 connection.cc:256] RPC call timeout handler was delayed by -3.0243485469998177s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22519999999999998s for a response
I20260709 12:10:16.193463 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:16.134917 16165 leader_election.cc:290] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:16.204716 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:16.265573 14336 raft_consensus.cc:2368] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 3. Current term is 4.
I20260709 12:10:16.014645 16147 raft_consensus.cc:740] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:10:16.211977 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:16.212853 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:16.214002 14905 raft_consensus.cc:2468] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 4.
I20260709 12:10:16.216881 16155 raft_consensus.cc:493] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:16.163942 16130 raft_consensus.cc:493] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:10:16.225317 14185 raft_consensus.cc:2468] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 3.
I20260709 12:10:16.272075 14261 raft_consensus.cc:2393] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 2: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:10:16.272410 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:16.273237 14185 raft_consensus.cc:2410] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:10:16.068400 15942 raft_consensus.cc:493] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:10:16.237097 14187 raft_consensus.cc:2468] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 3.
I20260709 12:10:16.274443 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:16.274873 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:15.711719 16078 raft_consensus.cc:515] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:16.240720 14337 raft_consensus.cc:2468] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 4.
I20260709 12:10:16.242830 14181 raft_consensus.cc:2393] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 4: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:10:16.171485 15827 raft_consensus.cc:515] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:16.243855 14154 leader_election.cc:304] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
W20260709 12:10:16.244468 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 222129us
I20260709 12:10:16.218513 15738 raft_consensus.cc:515] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:16.210805 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:16.249017 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:16.240695 14259 raft_consensus.cc:2468] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 3.
I20260709 12:10:16.219627 15888 leader_election.cc:290] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:16.263670 14186 raft_consensus.cc:2468] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 3.
W20260709 12:10:16.264459 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 178755us
W20260709 12:10:16.265573 14229 connection.cc:256] RPC call timeout handler was delayed by -2.8686485470000207s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2425s for a response
W20260709 12:10:16.294842 14229 connection.cc:256] RPC call timeout handler was delayed by -2.7534485469998344s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2553s for a response
I20260709 12:10:16.215898 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:16.268762 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:16.270890 14264 raft_consensus.cc:2393] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 7: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:10:16.266927 14907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:16.271982 16023 raft_consensus.cc:2804] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:16.207226 16090 raft_consensus.cc:515] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:16.279997 14265 raft_consensus.cc:2410] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:10:16.283537 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:16.287137 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:16.244344 16076 raft_consensus.cc:515] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:16.304553 14912 raft_consensus.cc:2468] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 1.
I20260709 12:10:16.288651 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:16.219197 15951 raft_consensus.cc:515] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:16.249284 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:16.292052 14876 leader_election.cc:304] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
W20260709 12:10:16.295215 14229 connection.cc:256] RPC call timeout handler was delayed by -2.5842485470000156s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2741s for a response
I20260709 12:10:16.277195 14155 leader_election.cc:304] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 73d01e9b1a9d49358da4985b21d681db
W20260709 12:10:16.296748 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:16.314841 14229 connection.cc:256] RPC call timeout handler was delayed by -2.1000485469999148s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3279s for a response
I20260709 12:10:16.221385 16127 raft_consensus.cc:515] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:10:16.296931 14154 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 53182.1us
W20260709 12:10:16.315698 14154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:16.278482 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:16.298453 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:16.274930 16130 raft_consensus.cc:3060] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:16.301419 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:10:16.306463 16199 log.cc:927] Time spent T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 12:10:16.319823 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:16.298252 14911 raft_consensus.cc:2468] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 2.
I20260709 12:10:16.297878 14304 leader_election.cc:304] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:10:16.308348 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:16.320907 14265 raft_consensus.cc:2368] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for earlier term 3. Current term is 4.
I20260709 12:10:16.309648 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:16.316017 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:16.316049 14182 raft_consensus.cc:1240] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:10:16.318804 14229 leader_election.cc:304] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:16.307214 16147 consensus_queue.cc:260] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:16.243654 15862 raft_consensus.cc:515] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:16.321838 14258 raft_consensus.cc:2468] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 4.
I20260709 12:10:16.322801 14257 raft_consensus.cc:2468] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 4.
W20260709 12:10:16.323874 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 46747.5us
W20260709 12:10:16.304859 14933 debug-util.cc:398] Leaking SignalData structure 0x7b08003b63e0 after lost signal to thread 14214
I20260709 12:10:16.270200 16173 raft_consensus.cc:515] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:16.300787 16023 raft_consensus.cc:493] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:16.324406 14189 raft_consensus.cc:1275] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 12:10:16.348394 14189 pending_rounds.cc:85] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf: Aborting all ops after (but not including) 2
I20260709 12:10:16.348726 14189 pending_rounds.cc:107] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:10:16.349035 14189 raft_consensus.cc:2889] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:16.298928 14906 raft_consensus.cc:2468] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 4.
I20260709 12:10:16.328464 15920 leader_election.cc:290] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:16.330788 14903 raft_consensus.cc:2393] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 3: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
I20260709 12:10:16.331228 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:16.332710 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:16.320299 14877 leader_election.cc:304] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:10:16.365849 14262 raft_consensus.cc:2468] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 5.
I20260709 12:10:16.296298 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:16.324717 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:16.317277 16206 raft_consensus.cc:2804] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:16.300072 16165 raft_consensus.cc:2804] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:16.338465 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:16.372627 14335 raft_consensus.cc:2468] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 3.
I20260709 12:10:16.342695 14155 leader_election.cc:304] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:16.286823 15942 raft_consensus.cc:515] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:16.291602 16183 consensus_queue.cc:1059] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 12:10:16.287557 16155 raft_consensus.cc:515] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:16.324476 16154 raft_consensus.cc:2804] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:16.350136 16023 raft_consensus.cc:3060] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:16.358083 16148 leader_election.cc:290] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:16.297449 16161 leader_election.cc:290] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:10:16.366004 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 45789.2us
I20260709 12:10:16.366161 14338 raft_consensus.cc:2468] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 4.
I20260709 12:10:16.334730 14229 leader_election.cc:304] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:16.337426 15888 raft_consensus.cc:2804] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:16.341233 16166 raft_consensus.cc:2749] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:16.375504 14265 raft_consensus.cc:1240] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:16.401302 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:10:16.379601 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 45422.3us
I20260709 12:10:16.350211 16147 raft_consensus.cc:3060] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:16.402014 14335 raft_consensus.cc:2468] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 2.
I20260709 12:10:16.374868 16167 raft_consensus.cc:2749] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:16.384419 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:16.382225 16210 raft_consensus.cc:2804] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:16.406616 14334 raft_consensus.cc:2410] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:10:16.407006 16210 raft_consensus.cc:493] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:16.407418 16210 raft_consensus.cc:3060] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:16.407833 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:16.408531 14334 raft_consensus.cc:2468] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 1.
I20260709 12:10:16.409677 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:16.361897 16207 raft_consensus.cc:2804] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:16.396955 14263 raft_consensus.cc:1240] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:16.386808 14155 leader_election.cc:304] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:16.412154 15827 leader_election.cc:290] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:16.412964 14155 leader_election.cc:400] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 2 pre-election: Vote denied by peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957) with higher term. Message: Invalid argument: T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 2. Current term is 3.
I20260709 12:10:16.412788 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:16.413254 14155 leader_election.cc:403] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:16.378121 14331 raft_consensus.cc:2468] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 3.
I20260709 12:10:16.413908 16173 leader_election.cc:290] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:16.414072 14263 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6"
dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
 from {username='slave'} at 127.0.0.1:41768
I20260709 12:10:16.414377 16148 raft_consensus.cc:2804] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:16.372421 16165 raft_consensus.cc:493] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:16.414786 16076 leader_election.cc:290] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:16.416245 15862 leader_election.cc:290] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:10:16.395624 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 61006.7us
I20260709 12:10:16.414072 14155 leader_election.cc:304] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:16.370489 16206 raft_consensus.cc:493] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:16.414784 14263 raft_consensus.cc:493] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:16.420854 14263 raft_consensus.cc:3060] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:16.383251 16172 leader_election.cc:290] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:16.423697 14229 leader_election.cc:304] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:16.385916 16154 raft_consensus.cc:493] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:16.390331 16204 raft_consensus.cc:2804] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:16.414980 16165 raft_consensus.cc:3060] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:16.425323 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
W20260709 12:10:16.401700 14933 debug-util.cc:398] Leaking SignalData structure 0x7b080034bd20 after lost signal to thread 14289
I20260709 12:10:16.411811 16207 raft_consensus.cc:697] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 4 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:10:16.413936 16159 leader_election.cc:290] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:16.415073 16183 raft_consensus.cc:2749] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957) with higher term. Message: Invalid argument: T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 2. Current term is 3.
I20260709 12:10:16.403944 15920 raft_consensus.cc:2749] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:16.397486 16143 leader_election.cc:290] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:16.400930 15888 raft_consensus.cc:493] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:16.432245 14335 raft_consensus.cc:2376] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 5. Re-sending same reply.
I20260709 12:10:16.439072 14229 leader_election.cc:304] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:16.458892 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:16.451138 16078 leader_election.cc:290] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:16.405772 16146 leader_election.cc:290] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:16.423760 16206 raft_consensus.cc:3060] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:16.414783 16148 raft_consensus.cc:493] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:16.421169 16161 raft_consensus.cc:2749] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:16.405396 15875 leader_election.cc:290] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:16.418500 16092 leader_election.cc:290] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:16.440156 16096 leader_election.cc:290] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:10:16.436251 14933 debug-util.cc:398] Leaking SignalData structure 0x7b08003260e0 after lost signal to thread 14290
I20260709 12:10:16.468008 16155 leader_election.cc:290] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:16.495764 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:16.470093 15888 raft_consensus.cc:3060] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:16.426697 16154 raft_consensus.cc:3060] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:16.470978 14259 raft_consensus.cc:1240] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:16.472607 14264 raft_consensus.cc:1240] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:16.431351 16158 leader_election.cc:290] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:16.453366 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:16.504930 14187 raft_consensus.cc:3060] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:16.428532 16076 consensus_queue.cc:1048] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.053s
I20260709 12:10:16.473690 14229 leader_election.cc:304] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:16.477432 14263 raft_consensus.cc:515] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:16.431596 16180 raft_consensus.cc:2749] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:16.482231 16173 raft_consensus.cc:2749] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:16.514424 14229 leader_election.cc:304] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:16.515637 14229 leader_election.cc:304] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:16.436439 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:16.507031 14264 raft_consensus.cc:1240] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:16.508044 14256 raft_consensus.cc:1240] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 3. Current term is 5. Ops: []
I20260709 12:10:16.508491 14259 raft_consensus.cc:1240] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 4 LEADER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:16.490275 16148 raft_consensus.cc:3060] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:16.538100 14263 leader_election.cc:290] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:16.539047 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:16.542304 14259 raft_consensus.cc:1240] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:16.540642 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:16.543581 14877 leader_election.cc:304] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:10:16.545114 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:16.549351 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:16.551669 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:16.552913 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:16.553117 14187 raft_consensus.cc:2468] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 3.
I20260709 12:10:16.490541 16187 consensus_queue.cc:1048] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.051s
I20260709 12:10:16.520017 16083 raft_consensus.cc:2749] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:16.561805 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:16.564589 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:16.535862 16164 raft_consensus.cc:2804] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:16.567644 14336 raft_consensus.cc:3060] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:16.567922 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:16.568634 14187 raft_consensus.cc:3055] T f4739bc22bfe44fcba807da02d9351b6 P 885067a0d31741bfb5c9935788e315bf [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:16.568997 14187 raft_consensus.cc:740] T f4739bc22bfe44fcba807da02d9351b6 P 885067a0d31741bfb5c9935788e315bf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
W20260709 12:10:16.565122 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 129357us
I20260709 12:10:16.536707 15920 raft_consensus.cc:2804] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:16.519593 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:10:16.570729 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 89213.1us
I20260709 12:10:16.565958 14229 leader_election.cc:304] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:16.570938 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:10:16.567091 14933 debug-util.cc:398] Leaking SignalData structure 0x7b08002a0e00 after lost signal to thread 14363
W20260709 12:10:16.585435 14155 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:16.579221 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:16.580251 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:16.569970 14187 consensus_queue.cc:260] T f4739bc22bfe44fcba807da02d9351b6 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: false } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:16.562386 15951 leader_election.cc:290] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:16.576988 14229 leader_election.cc:304] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:10:16.565569 16094 raft_consensus.cc:2804] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:16.587668 14263 raft_consensus.cc:2410] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:10:16.589298 14336 raft_consensus.cc:2468] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 4.
I20260709 12:10:16.564095 14907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:16.474779 16207 consensus_queue.cc:237] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:16.594883 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:16.601774 14264 raft_consensus.cc:2410] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
W20260709 12:10:16.591248 14154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:16.591523 14155 leader_election.cc:304] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:16.572773 16164 raft_consensus.cc:493] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:16.573946 15920 raft_consensus.cc:493] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:16.595690 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:16.580184 16169 raft_consensus.cc:2749] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:10:16.586665 14933 debug-util.cc:398] Leaking SignalData structure 0x7b08003cabe0 after lost signal to thread 14364
I20260709 12:10:16.604573 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:16.608569 14263 raft_consensus.cc:2468] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 2.
I20260709 12:10:16.609871 14155 leader_election.cc:304] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:16.592794 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:16.593065 16094 raft_consensus.cc:493] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:10:16.597059 15942 leader_election.cc:290] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:16.615005 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:16.610224 15920 raft_consensus.cc:3060] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:16.620977 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:16.603029 16175 raft_consensus.cc:2804] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:16.614305 14155 leader_election.cc:304] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:16.606204 16164 raft_consensus.cc:3060] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:16.623996 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:16.625654 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:16.612670 16146 raft_consensus.cc:2749] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:16.631593 14229 leader_election.cc:304] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
W20260709 12:10:16.622301 15937 consensus_meta.cc:287] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db: Time spent flushing consensus metadata: real 0.643s	user 0.007s	sys 0.009s
I20260709 12:10:16.620839 16143 raft_consensus.cc:2804] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:16.636312 14155 leader_election.cc:304] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:16.596779 16204 raft_consensus.cc:697] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 4 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:10:16.653069 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:16.655414 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:16.656270 14336 raft_consensus.cc:2468] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 2.
I20260709 12:10:16.627929 16094 raft_consensus.cc:3060] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:16.642174 14184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56046 (request call id 1672) took 5652 ms. Trace:
W20260709 12:10:16.644737 14933 debug-util.cc:398] Leaking SignalData structure 0x7b0800376280 after lost signal to thread 14936
I20260709 12:10:16.645886 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:16.662000 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:16.650231 14155 leader_election.cc:304] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:16.638230 16226 raft_consensus.cc:2749] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:16.640125 16139 raft_consensus.cc:515] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:16.657830 14264 raft_consensus.cc:2393] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 4: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:10:16.659310 14184 rpcz_store.cc:276] 0709 12:10:10.989542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.361091 (+4371549us) service_pool.cc:224] Handling call
0709 12:10:15.361460 (+   369us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:15.872506 (+511046us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:16.641834 (+769328us) spinlock_profiling.cc:243] Waited 240 ms on lock 0x7b54004628d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:10:16.642057 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":551940864}
I20260709 12:10:16.647773 14905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59144 (request call id 173) took 1094 ms. Trace:
I20260709 12:10:16.643878 15888 raft_consensus.cc:515] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:16.634047 16175 raft_consensus.cc:493] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:16.651829 16146 raft_consensus.cc:2749] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:16.667711 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:16.669133 14332 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 194) took 1096 ms. Trace:
I20260709 12:10:16.666682 14876 leader_election.cc:304] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:16.669535 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:16.651218 16143 raft_consensus.cc:493] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:16.671821 14336 raft_consensus.cc:1275] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:10:16.675630 14336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50858 (request call id 1305) took 1077 ms. Trace:
I20260709 12:10:16.651456 15937 raft_consensus.cc:2749] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:16.674187 14332 rpcz_store.cc:276] 0709 12:10:15.567758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.569365 (+  1607us) service_pool.cc:224] Handling call
0709 12:10:15.569714 (+   349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:16.191771 (+622057us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:16.191803 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:16.191843 (+    40us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:16.191875 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:16.664251 (+472376us) spinlock_profiling.cc:243] Waited 621 ms on lock 0x7b54002800d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:10:16.664304 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:16.664443 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1427395968}
I20260709 12:10:16.675895 14265 raft_consensus.cc:1240] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:10:16.675980 14336 rpcz_store.cc:276] 0709 12:10:15.598141 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:16.670192 (+1072051us) service_pool.cc:224] Handling call
0709 12:10:16.670544 (+   352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:16.675342 (+  4798us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:16.675562 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:16.679035 14336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50858 (request call id 1307) took 1069 ms. Trace:
I20260709 12:10:16.679488 14336 rpcz_store.cc:276] 0709 12:10:15.609925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:16.678280 (+1068355us) service_pool.cc:224] Handling call
0709 12:10:16.678547 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:16.678727 (+   180us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:16.678753 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:16.678796 (+    43us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:10:16.678829 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:16.678881 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:16.678981 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:16.681185 14336 raft_consensus.cc:1240] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:16.681911 14336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50858 (request call id 1308) took 1061 ms. Trace:
I20260709 12:10:16.682320 14336 rpcz_store.cc:276] 0709 12:10:15.620824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:16.680622 (+1059798us) service_pool.cc:224] Handling call
0709 12:10:16.680964 (+   342us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:16.681644 (+   680us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:16.681850 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:16.688787 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:16.689815 14334 raft_consensus.cc:2393] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db in current term 5: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:10:16.673800 16175 raft_consensus.cc:3060] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:16.695376 14332 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50858 (request call id 1306) took 1097 ms. Trace:
I20260709 12:10:16.677258 16143 raft_consensus.cc:3060] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:16.696072 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:10:16.700654 14910 raft_consensus.cc:3060] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:16.697902 14332 rpcz_store.cc:276] 0709 12:10:15.598443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:16.677796 (+1079353us) service_pool.cc:224] Handling call
0709 12:10:16.678128 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:16.688285 (+ 10157us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:16.688316 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:16.688363 (+    47us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:10:16.695109 (+  6746us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:16.695178 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:16.695314 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:16.676621 16091 raft_consensus.cc:2804] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:16.706831 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:16.670078 16222 raft_consensus.cc:2804] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:16.691547 14257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41764 (request call id 1945) took 1114 ms. Trace:
I20260709 12:10:16.668949 14905 rpcz_store.cc:276] 0709 12:10:15.552860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.555321 (+  2461us) service_pool.cc:224] Handling call
0709 12:10:16.647539 (+1092218us) spinlock_profiling.cc:243] Waited 651 ms on lock 0x7b5400757e54. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:10:16.647671 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1496292736}
W20260709 12:10:16.702649 16217 log.cc:927] Time spent T 00000000000000000000000000000000 P d07070be2c074f4cb9ad35f1580c4ef7: Append to log took a long time: real 0.105s	user 0.003s	sys 0.000s
I20260709 12:10:16.704300 14332 raft_consensus.cc:1275] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:16.688288 15942 consensus_queue.cc:1048] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 12:10:16.686703 16166 raft_consensus.cc:2749] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:16.709120 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:16.698581 14330 raft_consensus.cc:2410] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 12:10:16.707175 15844 consensus_meta.cc:287] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.629s	user 0.011s	sys 0.002s
I20260709 12:10:16.710227 15888 leader_election.cc:290] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:16.727413 14339 raft_consensus.cc:2468] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 4.
I20260709 12:10:16.714959 16222 raft_consensus.cc:493] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:16.721107 16091 raft_consensus.cc:697] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [term 3 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:10:16.714754 14257 rpcz_store.cc:276] 0709 12:10:15.574607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:16.378289 (+803682us) service_pool.cc:224] Handling call
0709 12:10:16.403161 (+ 24872us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:16.415613 (+ 12452us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:16.415646 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:16.416303 (+   657us) log.cc:844] Serialized 26 byte log entry
0709 12:10:16.557024 (+140721us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:16.557074 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:16.557154 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:16.673289 (+116135us) raft_consensus.cc:1685] finished
0709 12:10:16.673310 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:16.688875 (+ 15565us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5392,"raft.run_cpu_time_us":192,"raft.run_wall_time_us":12325,"thread_start_us":129889,"threads_started":1,"wal-append.queue_time_us":177284}
I20260709 12:10:16.751549 16091 consensus_queue.cc:237] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:16.752856 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:16.729346 16222 raft_consensus.cc:3060] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:16.725924 16226 consensus_queue.cc:1059] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 12:10:16.757332 16226 raft_consensus.cc:3055] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:16.714313 16210 raft_consensus.cc:515] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:16.758705 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:10:16.754338 16230 log.cc:927] Time spent T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:10:16.759776 16210 leader_election.cc:290] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 5 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:10:16.710243 16220 log.cc:927] Time spent T f4739bc22bfe44fcba807da02d9351b6 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.117s	user 0.000s	sys 0.001s
I20260709 12:10:16.738417 16139 leader_election.cc:290] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 4 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:16.743073 16127 leader_election.cc:290] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 3 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:16.746345 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:16.786371 14258 raft_consensus.cc:2393] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 4: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:10:16.747885 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:10:16.749809 14185 raft_consensus.cc:3055] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:16.789700 14185 raft_consensus.cc:740] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:10:16.790633 14334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55492 (request call id 200) took 1106 ms. Trace:
I20260709 12:10:16.791136 14334 rpcz_store.cc:276] 0709 12:10:15.684654 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:16.409365 (+724711us) service_pool.cc:224] Handling call
0709 12:10:16.790391 (+381026us) spinlock_profiling.cc:243] Waited 279 ms on lock 0x7b54000b8e54. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:10:16.790559 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":641874816}
I20260709 12:10:16.792672 14334 raft_consensus.cc:1240] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:16.790678 14185 consensus_queue.cc:260] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:16.793427 14185 raft_consensus.cc:3060] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:16.757769 16226 raft_consensus.cc:740] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:10:16.719791 14264 raft_consensus.cc:2468] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 1.
W20260709 12:10:16.775197 14230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:16.723121 16204 consensus_queue.cc:237] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:16.799938 14334 raft_consensus.cc:1240] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 3. Current term is 4. Ops: []
W20260709 12:10:16.716461 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 46195.3us
I20260709 12:10:16.821303 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:16.832295 16148 raft_consensus.cc:515] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:16.810302 14230 leader_election.cc:304] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:16.835275 14230 leader_election.cc:304] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:16.840842 14185 raft_consensus.cc:1275] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 12:10:16.841710 14185 pending_rounds.cc:85] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf: Aborting all ops after (but not including) 1
I20260709 12:10:16.843078 14185 pending_rounds.cc:107] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 12:10:16.844903 14185 raft_consensus.cc:2889] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:10:16.844898 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 45738us
I20260709 12:10:16.846343 14877 leader_election.cc:304] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:16.849231 16127 raft_consensus.cc:2749] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:16.849388 16226 consensus_queue.cc:260] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:16.850070 16185 raft_consensus.cc:2804] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:16.849923 16112 consensus_queue.cc:260] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:16.850524 16149 consensus_queue.cc:1059] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:10:16.851044 16112 raft_consensus.cc:3060] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:16.850111 16158 consensus_queue.cc:1059] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:16.844048 15942 raft_consensus.cc:2764] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:10:16.854192 14230 leader_election.cc:304] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db
W20260709 12:10:16.856832 14154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:16.852350 16158 raft_consensus.cc:3055] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:16.875025 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:16.877568 14877 leader_election.cc:304] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
W20260709 12:10:16.879033 14333 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55492 (request call id 195) took 1311 ms (client timeout 1728 ms). Trace:
W20260709 12:10:16.897382 14333 rpcz_store.cc:269] 0709 12:10:15.568085 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.580107 (+ 12022us) service_pool.cc:224] Handling call
0709 12:10:16.878777 (+1298670us) spinlock_profiling.cc:243] Waited 585 ms on lock 0x7b540029f254. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:10:16.878947 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1345441152}
I20260709 12:10:16.879416 14265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41768 (request call id 1268) took 1100 ms. Trace:
W20260709 12:10:16.879957 14303 connection.cc:256] RPC call timeout handler was delayed by -4.0674754240001221s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19610000000000002s for a response
W20260709 12:10:16.899416 14303 connection.cc:256] RPC call timeout handler was delayed by -3.9666754239999591s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2073s for a response
I20260709 12:10:16.898712 14265 rpcz_store.cc:276] 0709 12:10:15.779187 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:16.428126 (+648939us) service_pool.cc:224] Handling call
0709 12:10:16.675627 (+247501us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:16.677615 (+  1988us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:16.879219 (+201604us) spinlock_profiling.cc:243] Waited 223 ms on lock 0x7b5400212350. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713a8ad 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:10:16.879350 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":512979840}
I20260709 12:10:16.880242 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:16.902371 14334 raft_consensus.cc:3060] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:16.881114 16083 raft_consensus.cc:2804] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:16.882772 16143 raft_consensus.cc:515] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:16.908188 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:16.880293 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:16.903734 14910 raft_consensus.cc:2468] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 5.
I20260709 12:10:16.832859 16175 raft_consensus.cc:515] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:16.906826 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:16.907538 16078 raft_consensus.cc:2804] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:16.907786 14303 leader_election.cc:304] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:16.918020 14877 leader_election.cc:304] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:16.865063 16185 raft_consensus.cc:697] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 3 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:10:16.928288 14303 leader_election.cc:304] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:16.918977 14264 raft_consensus.cc:1240] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:16.921360 14155 leader_election.cc:304] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:16.921948 14338 raft_consensus.cc:1240] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:10:16.922120 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:16.930832 14303 leader_election.cc:304] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:10:16.884063 16158 raft_consensus.cc:740] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:10:16.901440 16139 consensus_queue.cc:1059] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 12:10:16.915652 16083 raft_consensus.cc:493] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:16.934597 16155 raft_consensus.cc:2804] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:16.919899 14905 raft_consensus.cc:1240] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 3. Current term is 5. Ops: []
I20260709 12:10:16.935148 15888 raft_consensus.cc:2749] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:16.931790 16114 raft_consensus.cc:3060] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:16.919620 16078 raft_consensus.cc:493] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:16.936662 16185 consensus_queue.cc:237] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:16.938473 16143 leader_election.cc:290] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 3 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:16.939357 16154 raft_consensus.cc:515] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:16.939899 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:16.947978 16155 raft_consensus.cc:493] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:16.942293 14336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 202) took 1202 ms. Trace:
I20260709 12:10:16.918375 16226 raft_consensus.cc:3060] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:16.945240 14259 raft_consensus.cc:2393] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db in current term 5: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:10:16.944387 14155 leader_election.cc:400] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 3 pre-election: Vote denied by peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957) with higher term. Message: Invalid argument: T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 3. Current term is 4.
I20260709 12:10:16.951879 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:16.932245 15844 raft_consensus.cc:2749] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:10:16.948943 16147 consensus_meta.cc:287] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.543s	user 0.009s	sys 0.008s
I20260709 12:10:16.944839 16149 raft_consensus.cc:3060] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:16.947728 16083 raft_consensus.cc:3060] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:16.956722 16078 raft_consensus.cc:3060] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:16.972302 16023 consensus_meta.cc:287] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db: Time spent flushing consensus metadata: real 0.571s	user 0.022s	sys 0.000s
I20260709 12:10:16.972810 16023 raft_consensus.cc:515] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:16.973467 16158 consensus_queue.cc:260] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:16.974540 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:16.975080 16158 raft_consensus.cc:3060] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:16.975543 14908 raft_consensus.cc:1240] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:16.975778 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:16.976960 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:16.919364 16233 consensus_queue.cc:1059] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.041s
W20260709 12:10:16.978824 16130 consensus_meta.cc:287] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db: Time spent flushing consensus metadata: real 0.628s	user 0.011s	sys 0.008s
I20260709 12:10:16.979326 16130 raft_consensus.cc:515] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:16.979682 14154 leader_election.cc:304] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:10:16.981945 16139 raft_consensus.cc:2804] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:16.982398 16139 raft_consensus.cc:493] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:10:16.982865 16139 raft_consensus.cc:3060] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:16.981986 14909 raft_consensus.cc:1240] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:16.965674 16155 raft_consensus.cc:3060] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:16.966867 14155 leader_election.cc:304] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:16.987404 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:16.990779 16206 raft_consensus.cc:515] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:16.993192 16148 leader_election.cc:290] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 3 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:16.996510 14262 raft_consensus.cc:2410] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 12:10:16.982436 16165 consensus_meta.cc:287] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.526s	user 0.000s	sys 0.019s
I20260709 12:10:16.966491 14264 raft_consensus.cc:2376] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 4. Re-sending same reply.
I20260709 12:10:16.940975 14303 leader_election.cc:304] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:16.971066 14190 raft_consensus.cc:2468] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 2.
I20260709 12:10:16.979261 16233 raft_consensus.cc:3055] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:10:17.003575 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 62718.6us
I20260709 12:10:17.004294 14303 leader_election.cc:304] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:16.986115 16154 leader_election.cc:290] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 2 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:16.964802 14336 rpcz_store.cc:276] 0709 12:10:15.740463 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:16.689882 (+949419us) service_pool.cc:224] Handling call
0709 12:10:16.690405 (+   523us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:16.691412 (+  1007us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:16.691467 (+    55us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:16.697197 (+  5730us) log.cc:844] Serialized 26 byte log entry
0709 12:10:16.843555 (+146358us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:16.903562 (+ 60007us) log.cc:844] Serialized 14 byte log entry
0709 12:10:16.903862 (+   300us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:16.903937 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:16.941935 (+ 37998us) raft_consensus.cc:1685] finished
0709 12:10:16.941959 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:16.942208 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":81992,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":1990,"raft.queue_time_us":595,"raft.run_cpu_time_us":246,"raft.run_wall_time_us":3475,"thread_start_us":167652,"threads_started":2,"wal-append.queue_time_us":208443}
I20260709 12:10:16.993505 16206 leader_election.cc:290] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 4 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:17.010349 14303 leader_election.cc:304] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:16.997676 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:16.982579 15920 raft_consensus.cc:515] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:16.995959 16163 raft_consensus.cc:2749] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:17.013180 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:17.001541 16143 consensus_queue.cc:1048] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 12:10:17.015904 15944 raft_consensus.cc:3060] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:17.025050 14262 raft_consensus.cc:2393] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 7: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:10:17.003592 16233 raft_consensus.cc:740] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:10:17.036093 14256 raft_consensus.cc:2393] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 5: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:10:17.017151 16143 consensus_queue.cc:1059] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.010s
I20260709 12:10:17.005079 16232 consensus_queue.cc:1059] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 12:10:17.013816 15844 raft_consensus.cc:2749] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:17.017680 15951 raft_consensus.cc:2804] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:17.003263 16165 raft_consensus.cc:515] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:17.046286 16156 leader_election.cc:290] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:10:17.125980 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 115714us
W20260709 12:10:17.053084 14302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:17.050086 16130 leader_election.cc:290] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 2 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:17.128552 15944 raft_consensus.cc:2749] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:17.024627 16170 leader_election.cc:290] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:17.128787 14264 raft_consensus.cc:1275] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:10:17.089327 14334 raft_consensus.cc:2468] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 5.
I20260709 12:10:17.051633 16139 raft_consensus.cc:515] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:17.158245 14304 leader_election.cc:400] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 election: Vote denied by peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673) with higher term. Message: Invalid argument: T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for earlier term 3. Current term is 4.
I20260709 12:10:17.132757 14303 leader_election.cc:304] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:17.133945 16155 raft_consensus.cc:515] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:17.136135 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:17.080120 14262 raft_consensus.cc:1240] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 3. Current term is 5. Ops: []
I20260709 12:10:17.053210 16078 raft_consensus.cc:515] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:17.159368 14877 leader_election.cc:304] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:10:17.200263 16080 raft_consensus.cc:2804] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:17.200804 16080 raft_consensus.cc:697] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 5 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:10:17.133477 16114 raft_consensus.cc:2749] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:17.201718 16080 consensus_queue.cc:237] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:17.202528 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:17.204612 14337 raft_consensus.cc:1275] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:17.206844 15875 consensus_queue.cc:1048] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:17.161576 16156 consensus_queue.cc:1059] T f4739bc22bfe44fcba807da02d9351b6 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 12:10:17.206859 16139 leader_election.cc:290] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:17.209960 16165 leader_election.cc:290] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:17.159574 14303 leader_election.cc:304] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:17.211728 16155 leader_election.cc:290] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:17.212467 15944 raft_consensus.cc:2749] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:10:17.212297 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 52815.4us
I20260709 12:10:17.161720 15844 raft_consensus.cc:2749] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:17.213640 14303 leader_election.cc:304] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:17.125545 16083 raft_consensus.cc:515] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:17.214732 14303 leader_election.cc:304] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:10:17.215461 15944 raft_consensus.cc:2749] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:17.215938 14303 leader_election.cc:304] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:17.196867 16112 raft_consensus.cc:493] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:17.069710 16164 raft_consensus.cc:515] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:17.071539 16160 leader_election.cc:290] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:17.216871 16112 raft_consensus.cc:515] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:17.218923 16164 leader_election.cc:290] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 4 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:17.129093 16094 raft_consensus.cc:515] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:17.219954 14265 raft_consensus.cc:2368] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 3. Current term is 4.
I20260709 12:10:17.161396 15920 leader_election.cc:290] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:17.220561 15924 raft_consensus.cc:3060] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:10:17.175760 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:17.212888 14336 raft_consensus.cc:2368] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db for earlier term 4. Current term is 5.
I20260709 12:10:17.222962 16094 leader_election.cc:290] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 5 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:17.224651 14877 leader_election.cc:400] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 4 election: Vote denied by peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957) with higher term. Message: Invalid argument: T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db for earlier term 4. Current term is 5.
I20260709 12:10:17.224992 14877 leader_election.cc:403] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:10:17.225943 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:17.229995 16094 raft_consensus.cc:3060] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:17.219988 16112 leader_election.cc:290] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:10:17.220778 16235 log.cc:927] Time spent T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
I20260709 12:10:17.216277 15944 raft_consensus.cc:2804] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:17.212375 16231 raft_consensus.cc:3055] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:17.236529 16231 raft_consensus.cc:740] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:10:17.216514 16083 leader_election.cc:290] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 4 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:17.238461 16231 consensus_queue.cc:260] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:17.241797 16231 raft_consensus.cc:3060] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:17.243424 15738 leader_election.cc:290] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:17.244004 16177 leader_election.cc:290] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:17.247300 16149 raft_consensus.cc:2749] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:17.242478 15944 raft_consensus.cc:697] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 3 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:17.252597 15944 consensus_queue.cc:237] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:17.160735 14304 leader_election.cc:403] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
W20260709 12:10:18.437849 14119 debug-util.cc:398] Leaking SignalData structure 0x7b08002fd4c0 after lost signal to thread 12986
W20260709 12:10:20.317606 14119 debug-util.cc:398] Leaking SignalData structure 0x7b0800091c20 after lost signal to thread 12989
I20260709 12:10:17.194684 16175 leader_election.cc:290] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:17.104060 16222 raft_consensus.cc:515] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:10:20.939252 16080 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 3.734s	user 0.049s	sys 0.066s
W20260709 12:10:20.940004 16080 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 3.735s	user 0.050s	sys 0.066s
W20260709 12:10:17.640910 16244 log.cc:927] Time spent T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.626s	user 0.001s	sys 0.000s
I20260709 12:10:20.943643 16023 leader_election.cc:290] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 5 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:10:17.704501 16248 log.cc:927] Time spent T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 12:10:19.416395 16226 consensus_meta.cc:287] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 2.446s	user 0.016s	sys 0.018s
W20260709 12:10:19.416565 16203 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
W20260709 12:10:19.422307 14154 connection.cc:256] RPC call timeout handler was delayed by -2.179407448999882s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21070000000000003s for a response
W20260709 12:10:20.948262 14154 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.174.132:37341 timed out after 2.107s (SENT) [suppressed 12 similar messages]
W20260709 12:10:19.426942 14156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:17.158812 15951 raft_consensus.cc:493] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:20.950246 14156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:20.122152 14302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:20.222424 14305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:20.318087 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 3.16303e+06us
W20260709 12:10:20.318991 14155 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 3.303s	user 0.037s	sys 0.072s
W20260709 12:10:20.958168 14155 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 3.943s	user 0.038s	sys 0.072s
W20260709 12:10:20.958695 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 3.94322e+06us
I20260709 12:10:20.959805 14155 leader_election.cc:304] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:20.358835 16164 raft_consensus.cc:493] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:20.961288 16164 raft_consensus.cc:515] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:20.963984 16164 leader_election.cc:290] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:20.362265 16147 raft_consensus.cc:493] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:20.964999 16147 raft_consensus.cc:515] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:10:20.366439 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 3.12468e+06us
I20260709 12:10:20.969645 16180 raft_consensus.cc:493] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:20.970342 16224 raft_consensus.cc:493] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:20.970636 16180 raft_consensus.cc:515] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:10:20.368842 16231 consensus_meta.cc:287] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 3.122s	user 0.013s	sys 0.024s
I20260709 12:10:20.971144 16224 raft_consensus.cc:515] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:20.741901 14331 raft_consensus.cc:2393] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 4: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
W20260709 12:10:20.373153 16094 consensus_meta.cc:287] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db: Time spent flushing consensus metadata: real 3.142s	user 0.024s	sys 0.030s
I20260709 12:10:20.972252 16231 raft_consensus.cc:493] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:20.762137 14876 connection.cc:256] RPC call timeout handler was delayed by -1.7686325259999194s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.23870000000000002s for a response
W20260709 12:10:20.972504 14331 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50858 (request call id 1325) took 4522 ms (client timeout 1956 ms). Trace:
I20260709 12:10:20.973090 16231 raft_consensus.cc:515] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:10:20.972884 14876 connection.cc:256] RPC call timeout handler was delayed by -1.7628127870000299s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17700000000000002s for a response
W20260709 12:10:20.974236 14876 connection.cc:256] RPC call timeout handler was delayed by -1.7383646140001474s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1806s for a response
W20260709 12:10:20.974603 14876 connection.cc:256] RPC call timeout handler was delayed by -1.3898213400000259s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2175s for a response
I20260709 12:10:20.976179 16231 leader_election.cc:290] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:20.976926 16231 raft_consensus.cc:493] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
W20260709 12:10:20.789945 15924 consensus_meta.cc:287] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 3.569s	user 0.025s	sys 0.016s
I20260709 12:10:20.978116 15924 raft_consensus.cc:2749] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:20.792402 14187 raft_consensus.cc:3060] T f4739bc22bfe44fcba807da02d9351b6 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:10:20.796521 14909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59144 (request call id 184) took 4657 ms. Trace:
I20260709 12:10:20.804234 16145 raft_consensus.cc:3055] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:20.810751 16127 raft_consensus.cc:493] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:20.815557 16130 raft_consensus.cc:493] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
W20260709 12:10:20.830081 16185 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 3.611s	user 0.028s	sys 0.057s
W20260709 12:10:20.856884 14912 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53200 (request call id 345) took 4800 ms (client timeout 2171 ms). Trace:
I20260709 12:10:20.869994 15827 raft_consensus.cc:493] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
W20260709 12:10:20.882009 14190 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56652 (request call id 267) took 4413 ms (client timeout 2387 ms). Trace:
I20260709 12:10:17.196106 14189 raft_consensus.cc:1240] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:20.979005 16224 leader_election.cc:290] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:20.907099 16175 raft_consensus.cc:493] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:20.908924 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:10:20.911058 14903 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59144 (request call id 174) took 5357 ms (client timeout 2107 ms). Trace:
W20260709 12:10:20.981983 16185 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 3.763s	user 0.028s	sys 0.062s
I20260709 12:10:20.913390 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:20.981403 14909 rpcz_store.cc:276] 0709 12:10:16.138686 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:16.322522 (+183836us) service_pool.cc:224] Handling call
0709 12:10:16.322898 (+   376us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:16.983534 (+660636us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:20.795821 (+3812287us) spinlock_profiling.cc:243] Waited 659 ms on lock 0x7b54007481d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:10:20.796269 (+   448us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1515320192}
W20260709 12:10:20.916976 14186 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56044 (request call id 1918) took 5015 ms (client timeout 1884 ms). Trace:
I20260709 12:10:20.919188 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:20.920317 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:10:20.925398 14265 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41768 (request call id 1298) took 4017 ms (client timeout 1780 ms). Trace:
I20260709 12:10:20.925552 14259 raft_consensus.cc:1240] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:20.929193 16233 consensus_queue.cc:260] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:10:20.932884 14339 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50858 (request call id 1313) took 5158 ms (client timeout 1891 ms). Trace:
I20260709 12:10:20.950119 15951 raft_consensus.cc:3060] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:19.862447 14337 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.650s	user 0.005s	sys 0.027s
I20260709 12:10:20.971429 15738 raft_consensus.cc:493] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:20.776944 16078 leader_election.cc:290] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 3 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:21.026026 16172 raft_consensus.cc:493] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
W20260709 12:10:20.998871 14186 rpcz_store.cc:269] 0709 12:10:15.901552 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:16.020502 (+118950us) service_pool.cc:224] Handling call
0709 12:10:20.916574 (+4896072us) spinlock_profiling.cc:243] Waited 53.3 ms on lock 0x7b54003b2754. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:10:20.916759 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":122551552}
I20260709 12:10:20.906175 16083 raft_consensus.cc:493] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:21.027233 16172 raft_consensus.cc:515] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:21.027863 16083 raft_consensus.cc:515] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:20.979079 15924 raft_consensus.cc:493] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:20.957661 14304 leader_election.cc:304] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:10:20.982471 16130 raft_consensus.cc:515] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:10:21.035877 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 76296.9us
I20260709 12:10:21.037185 14155 leader_election.cc:304] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
W20260709 12:10:20.981026 14912 rpcz_store.cc:269] 0709 12:10:16.055811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:16.176082 (+120271us) service_pool.cc:224] Handling call
0709 12:10:20.850535 (+4674453us) spinlock_profiling.cc:243] Waited 40.4 ms on lock 0x7b54005e01d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:10:20.856379 (+  5844us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":92905728}
W20260709 12:10:20.973452 14331 rpcz_store.cc:269] 0709 12:10:16.449828 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:16.613774 (+163946us) service_pool.cc:224] Handling call
0709 12:10:17.135914 (+522140us) spinlock_profiling.cc:243] Waited 2.55 ms on lock 0x7b5800065d98. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2124016e9c 00007f2124016a5b 00007f212cf2f8d9 00007f212c089ee0 00007f212c1530ab 00007f212c153131 00007f212c1010a0 00007f212c100984 00007f212567b6d4 00007f212567b662
0709 12:10:20.972396 (+3836482us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5860224}
I20260709 12:10:20.972776 16094 raft_consensus.cc:2749] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957) with higher term. Message: Invalid argument: T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db for earlier term 4. Current term is 5.
I20260709 12:10:20.974100 16169 raft_consensus.cc:493] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:20.911970 16219 log.cc:927] Time spent T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 4.299s	user 0.011s	sys 0.026s
I20260709 12:10:20.979554 16145 raft_consensus.cc:740] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
W20260709 12:10:20.981256 14190 rpcz_store.cc:269] 0709 12:10:16.468053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:16.482497 (+ 14444us) service_pool.cc:224] Handling call
0709 12:10:20.881417 (+4398920us) spinlock_profiling.cc:243] Waited 474 ms on lock 0x7b54003b2c54. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:10:20.881689 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1091007360}
W20260709 12:10:20.999897 14265 rpcz_store.cc:269] 0709 12:10:16.907922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:16.933076 (+ 25154us) service_pool.cc:224] Handling call
0709 12:10:20.924897 (+3991821us) spinlock_profiling.cc:243] Waited 257 ms on lock 0x7b54002012d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:10:20.925149 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":590829824}
W20260709 12:10:21.001060 14339 rpcz_store.cc:269] 0709 12:10:15.774609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.927907 (+153298us) service_pool.cc:224] Handling call
0709 12:10:20.932375 (+5004468us) spinlock_profiling.cc:243] Waited 770 ms on lock 0x7b540047de54. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:10:20.932575 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1771980160}
I20260709 12:10:21.017724 14261 raft_consensus.cc:2468] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 2.
I20260709 12:10:21.043949 16169 raft_consensus.cc:515] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:21.048441 16145 consensus_queue.cc:260] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:20.990295 16127 raft_consensus.cc:515] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:21.018579 16175 raft_consensus.cc:515] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:21.050555 16169 leader_election.cc:290] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:21.021422 14263 raft_consensus.cc:2468] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 3.
W20260709 12:10:21.051097 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:21.051620 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:21.051867 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:21.052439 16127 leader_election.cc:290] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:21.022049 16147 leader_election.cc:290] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:10:21.022348 14337 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 3.810s	user 0.008s	sys 0.027s
I20260709 12:10:21.053251 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:20.990867 16203 raft_consensus.cc:493] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
W20260709 12:10:21.024346 14229 connection.cc:256] RPC call timeout handler was delayed by -3.0691620259999581s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2171s for a response
I20260709 12:10:21.020759 16233 raft_consensus.cc:3060] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:21.028491 14264 raft_consensus.cc:2393] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 5: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:10:21.017760 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:20.938335 16222 leader_election.cc:290] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:21.050093 16145 raft_consensus.cc:3060] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:10:20.994976 14903 rpcz_store.cc:269] 0709 12:10:15.553200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.556501 (+  3301us) service_pool.cc:224] Handling call
0709 12:10:20.910484 (+5353983us) spinlock_profiling.cc:243] Waited 626 ms on lock 0x7b54007d50d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:10:20.910829 (+   345us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1438874880}
I20260709 12:10:21.018431 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:20.998736 16164 raft_consensus.cc:493] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:21.056427 16265 consensus_queue.cc:1048] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:21.057212 16164 raft_consensus.cc:515] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:21.058666 16265 raft_consensus.cc:2804] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:21.059137 16265 raft_consensus.cc:493] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:21.034288 16180 leader_election.cc:290] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:21.029073 15738 raft_consensus.cc:515] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:21.034396 16172 leader_election.cc:290] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:21.038398 16130 leader_election.cc:290] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:21.105702 15738 leader_election.cc:290] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:10:21.070528 14154 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 122267us
I20260709 12:10:20.983665 15844 raft_consensus.cc:2749] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673) with higher term. Message: Invalid argument: T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for earlier term 3. Current term is 4.
I20260709 12:10:21.109050 16264 consensus_queue.cc:1059] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:21.110666 16264 raft_consensus.cc:3055] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:21.111215 16264 raft_consensus.cc:740] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:10:21.113225 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:21.113101 16264 consensus_queue.cc:260] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:10:21.039608 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 82128.6us
I20260709 12:10:21.035745 14184 raft_consensus.cc:1240] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:21.040416 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
W20260709 12:10:21.044406 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 74636.2us
I20260709 12:10:21.120512 14183 raft_consensus.cc:3060] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:21.048825 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:21.123317 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:21.124109 14261 raft_consensus.cc:3060] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:21.124544 14304 leader_election.cc:304] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
W20260709 12:10:21.054522 14229 connection.cc:256] RPC call timeout handler was delayed by -2.6327681999998731s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2074s for a response
W20260709 12:10:21.125998 14229 connection.cc:256] RPC call timeout handler was delayed by -2.6057681999998294s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21040000000000003s for a response
W20260709 12:10:21.126411 14229 connection.cc:256] RPC call timeout handler was delayed by -2.5454681999999593s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2171s for a response
W20260709 12:10:21.126919 14229 connection.cc:256] RPC call timeout handler was delayed by -2.1917681999998422s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2564s for a response
W20260709 12:10:21.127326 14229 connection.cc:256] RPC call timeout handler was delayed by -2.1215681999999561s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2642s for a response
W20260709 12:10:21.127601 14229 connection.cc:256] RPC call timeout handler was delayed by -2.0431224530000236s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2642s for a response
I20260709 12:10:21.025154 16076 raft_consensus.cc:493] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:10:20.983696 15827 raft_consensus.cc:515] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:21.083781 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:20.977689 16231 raft_consensus.cc:515] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:21.135012 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:21.051785 16175 leader_election.cc:290] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:21.071990 16083 leader_election.cc:290] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:21.084870 16222 raft_consensus.cc:2749] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:21.137319 14189 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56046 (request call id 1681) took 5090 ms. Trace:
I20260709 12:10:21.139005 15738 raft_consensus.cc:2804] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:21.139707 15738 raft_consensus.cc:493] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:21.140102 15738 raft_consensus.cc:3060] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:21.059881 14182 raft_consensus.cc:1275] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:10:21.059856 16224 raft_consensus.cc:493] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:21.060496 16203 raft_consensus.cc:515] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:21.170565 16076 raft_consensus.cc:515] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:21.030159 15924 raft_consensus.cc:515] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:21.174345 14263 raft_consensus.cc:3060] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:20.994700 14257 raft_consensus.cc:2468] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 3.
I20260709 12:10:21.175053 15827 leader_election.cc:290] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:21.174592 15951 raft_consensus.cc:515] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:21.011037 16226 raft_consensus.cc:2749] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:21.061676 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:21.055826 14337 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 220) took 3844 ms. Trace:
W20260709 12:10:21.051942 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:21.059849 16090 leader_election.cc:290] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:21.059834 16164 leader_election.cc:290] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:21.010516 16262 raft_consensus.cc:493] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:21.072137 14181 raft_consensus.cc:1275] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:21.075129 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
W20260709 12:10:21.098985 14330 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 3.846s	user 0.015s	sys 0.036s
I20260709 12:10:21.100782 16265 raft_consensus.cc:3060] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:21.084517 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 47797.1us
I20260709 12:10:21.128618 14188 raft_consensus.cc:1240] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:21.078305 14187 raft_consensus.cc:2410] T f4739bc22bfe44fcba807da02d9351b6 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
W20260709 12:10:21.033413 14230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:21.138075 14189 rpcz_store.cc:276] 0709 12:10:16.047096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:16.350240 (+303144us) service_pool.cc:224] Handling call
0709 12:10:16.357345 (+  7105us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:21.024046 (+4666701us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:21.136874 (+112828us) spinlock_profiling.cc:243] Waited 813 ms on lock 0x7b540028e6d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:10:21.137124 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1870321536}
I20260709 12:10:21.142002 16224 raft_consensus.cc:515] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:21.382393 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
W20260709 12:10:21.385872 14302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:21.378715 14183 raft_consensus.cc:2468] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 3.
I20260709 12:10:21.222237 14339 raft_consensus.cc:2393] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db in current term 3: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
W20260709 12:10:21.421767 14305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:21.419847 14261 raft_consensus.cc:2468] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 5.
W20260709 12:10:21.422098 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 299652us
I20260709 12:10:21.426091 14186 raft_consensus.cc:2393] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db in current term 4: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
W20260709 12:10:21.424841 14187 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56046 (request call id 1694) took 4874 ms (client timeout 2642 ms). Trace:
I20260709 12:10:21.428267 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:21.429934 16146 raft_consensus.cc:493] T f4739bc22bfe44fcba807da02d9351b6 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:21.432164 14877 connection.cc:256] RPC call timeout handler was delayed by -2.86817253900017s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1854s for a response
W20260709 12:10:21.434662 14877 connection.cc:256] RPC call timeout handler was delayed by -2.8213273360001949s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16890000000000002s for a response
I20260709 12:10:21.434430 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
W20260709 12:10:21.435087 14877 connection.cc:256] RPC call timeout handler was delayed by -2.5114047590000155s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17700000000000002s for a response
W20260709 12:10:21.435600 14877 connection.cc:256] RPC call timeout handler was delayed by -2.4790047590001905s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1806s for a response
W20260709 12:10:21.436290 14877 connection.cc:256] RPC call timeout handler was delayed by -2.4778682700000445s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1559s for a response
I20260709 12:10:21.379596 16143 raft_consensus.cc:493] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:21.222677 15951 leader_election.cc:290] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:21.176486 16264 raft_consensus.cc:3060] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:10:21.427799 14187 rpcz_store.cc:269] 0709 12:10:16.550666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:16.566670 (+ 16004us) service_pool.cc:224] Handling call
0709 12:10:20.790822 (+4224152us) spinlock_profiling.cc:243] Waited 623 ms on lock 0x7b58000b66d0. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f21270970aa 00007f2127119447 00007f2127131fe7 00007f21271337de 00007f212713f27c 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c
0709 12:10:21.424756 (+633934us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1432246656}
W20260709 12:10:21.437083 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 312748us
I20260709 12:10:21.379834 16160 raft_consensus.cc:493] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:21.442291 14188 raft_consensus.cc:2393] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db in current term 5: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:10:21.444598 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:21.447749 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:21.451328 14181 raft_consensus.cc:2393] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db in current term 4: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:10:21.452198 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:21.442869 15924 leader_election.cc:290] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:21.456127 14334 raft_consensus.cc:1275] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:10:21.451825 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
W20260709 12:10:21.458372 14119 debug-util.cc:398] Leaking SignalData structure 0x7b0800036880 after lost signal to thread 14122
W20260709 12:10:21.459144 14119 debug-util.cc:398] Leaking SignalData structure 0x7b0800036960 after lost signal to thread 14136
I20260709 12:10:21.453692 14186 raft_consensus.cc:2376] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 3. Re-sending same reply.
I20260709 12:10:21.465587 16231 leader_election.cc:290] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:21.466831 14183 raft_consensus.cc:2393] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db in current term 4: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
W20260709 12:10:21.466777 14119 debug-util.cc:398] Leaking SignalData structure 0x7b080009a840 after lost signal to thread 14214
W20260709 12:10:21.467581 14119 debug-util.cc:398] Leaking SignalData structure 0x7b0800322980 after lost signal to thread 14215
I20260709 12:10:21.468627 14877 leader_election.cc:304] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:21.470611 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:10:21.473780 14119 debug-util.cc:398] Leaking SignalData structure 0x7b0800330840 after lost signal to thread 14289
W20260709 12:10:21.474200 14119 debug-util.cc:398] Leaking SignalData structure 0x7b08002f2560 after lost signal to thread 14290
I20260709 12:10:21.417112 14337 rpcz_store.cc:276] 0709 12:10:17.210127 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:17.210293 (+   166us) service_pool.cc:224] Handling call
0709 12:10:17.210642 (+   349us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:17.210998 (+   356us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:17.211032 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:17.211608 (+   576us) log.cc:844] Serialized 26 byte log entry
0709 12:10:21.053572 (+3841964us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:21.053629 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:21.053724 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:21.053815 (+    91us) raft_consensus.cc:1685] finished
0709 12:10:21.053825 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:21.053960 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1262,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":105,"thread_start_us":3841486,"threads_started":1,"wal-append.queue_time_us":454648,"wal-append.run_cpu_time_us":2080,"wal-append.run_wall_time_us":1144214}
I20260709 12:10:21.466135 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:21.476012 14335 raft_consensus.cc:3055] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:21.465955 16146 raft_consensus.cc:515] T f4739bc22bfe44fcba807da02d9351b6 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: false } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:21.478670 15937 raft_consensus.cc:2804] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:21.479101 15937 raft_consensus.cc:493] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:21.479533 15937 raft_consensus.cc:3060] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:21.461678 16076 leader_election.cc:290] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:21.477197 14335 raft_consensus.cc:740] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
W20260709 12:10:21.483048 14119 debug-util.cc:398] Leaking SignalData structure 0x7b08001f2ba0 after lost signal to thread 14363
I20260709 12:10:21.483551 14181 raft_consensus.cc:2410] T f4739bc22bfe44fcba807da02d9351b6 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db for term 6 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:10:21.462798 16203 leader_election.cc:290] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:21.464596 16226 raft_consensus.cc:493] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:21.490157 14119 debug-util.cc:398] Leaking SignalData structure 0x7b080037f300 after lost signal to thread 14936
W20260709 12:10:21.490549 14119 debug-util.cc:398] Leaking SignalData structure 0x7b080037f2c0 after lost signal to thread 14937
I20260709 12:10:21.485682 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:21.493198 14187 raft_consensus.cc:2393] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db in current term 5: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
W20260709 12:10:21.482707 14330 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 4.230s	user 0.023s	sys 0.051s
I20260709 12:10:21.496891 14260 raft_consensus.cc:1240] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:21.497907 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:21.498824 14336 raft_consensus.cc:2468] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 4.
W20260709 12:10:21.500169 14256 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41768 (request call id 1287) took 4940 ms (client timeout 1841 ms). Trace:
W20260709 12:10:21.500653 14256 rpcz_store.cc:269] 0709 12:10:16.559519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:16.667420 (+107901us) service_pool.cc:224] Handling call
0709 12:10:21.491916 (+4824496us) spinlock_profiling.cc:243] Waited 360 ms on lock 0x7b54002fc954. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:10:21.499956 (+  8040us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":829046144}
I20260709 12:10:21.501315 16146 leader_election.cc:290] T f4739bc22bfe44fcba807da02d9351b6 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:21.460377 16143 raft_consensus.cc:515] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:21.458381 16262 raft_consensus.cc:515] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:10:21.512243 14119 debug-util.cc:398] Leaking SignalData structure 0x7b080035c1c0 after lost signal to thread 16197
I20260709 12:10:21.514494 14258 raft_consensus.cc:2468] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 5.
W20260709 12:10:21.515733 14119 debug-util.cc:398] Leaking SignalData structure 0x7b08003a2560 after lost signal to thread 16200
I20260709 12:10:21.519536 14085 catalog_manager.cc:5697] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:21.522452 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:10:21.491938 15738 raft_consensus.cc:515] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:21.523582 14903 raft_consensus.cc:2368] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 2. Current term is 3.
I20260709 12:10:21.525032 15738 leader_election.cc:290] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 6 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:21.525547 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:10:21.506330 14335 consensus_queue.cc:260] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:21.526288 14909 raft_consensus.cc:3060] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:21.526489 14155 leader_election.cc:304] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:21.524924 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:10:21.526698 16224 leader_election.cc:290] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:21.522524 14907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:10:21.530011 16224 raft_consensus.cc:2749] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:21.531447 14335 raft_consensus.cc:3060] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:21.534340 14260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41764 (request call id 1942) took 5960 ms. Trace:
I20260709 12:10:21.534837 14260 rpcz_store.cc:276] 0709 12:10:15.573837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:19.743686 (+4169849us) service_pool.cc:224] Handling call
0709 12:10:21.496479 (+1752793us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:21.497508 (+  1029us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:21.534082 (+ 36574us) spinlock_profiling.cc:243] Waited 1.75 s on lock 0x7b54002fc950. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713a8ad 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:10:21.534243 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4023683968}
W20260709 12:10:21.535431 14119 debug-util.cc:398] Leaking SignalData structure 0x7b080039ffc0 after lost signal to thread 16228
I20260709 12:10:21.530110 14907 raft_consensus.cc:2393] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 5: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
W20260709 12:10:21.538777 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 90069.3us
I20260709 12:10:21.544939 14907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:21.549041 14330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 208) took 5322 ms. Trace:
I20260709 12:10:21.551180 15951 consensus_queue.cc:1059] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:21.552668 16090 raft_consensus.cc:3055] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:21.553094 16090 raft_consensus.cc:740] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:21.554204 16090 consensus_queue.cc:260] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:21.464660 16160 raft_consensus.cc:515] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:21.564649 14155 leader_election.cc:304] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:10:21.565099 16090 raft_consensus.cc:3060] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:21.566478 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:21.568631 14907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:21.570329 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:10:21.527281 14908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:21.572216 14908 raft_consensus.cc:2410] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:10:21.574687 16224 raft_consensus.cc:2804] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:21.577162 16222 raft_consensus.cc:493] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:21.577991 16222 raft_consensus.cc:515] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:10:21.580396 16145 consensus_meta.cc:287] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.524s	user 0.005s	sys 0.004s
I20260709 12:10:21.576303 16224 raft_consensus.cc:493] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:21.581590 16222 leader_election.cc:290] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:21.583745 16143 leader_election.cc:290] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:21.584133 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:21.586355 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:21.585382 14304 leader_election.cc:304] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:10:21.589596 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:21.591656 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:10:21.574676 14087 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60420 (request call id 253) took 12578 ms (client timeout 15000 ms). Trace:
I20260709 12:10:21.589493 16226 raft_consensus.cc:515] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:21.592911 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:21.594075 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:21.594702 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:21.595594 16114 consensus_queue.cc:1059] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:21.574695 16262 leader_election.cc:290] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:21.598125 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:21.598280 16257 consensus_queue.cc:1059] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:21.597189 16215 consensus_queue.cc:1048] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 12:10:21.598960 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:10:21.603767 14156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:21.625267 14156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:21.625916 14156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:21.622895 14908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:21.630127 16257 raft_consensus.cc:3055] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:21.630055 16259 consensus_queue.cc:1048] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 12:10:21.630635 16257 raft_consensus.cc:740] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:10:21.549703 14330 rpcz_store.cc:276] 0709 12:10:16.226364 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:16.746697 (+520333us) service_pool.cc:224] Handling call
0709 12:10:16.842422 (+ 95725us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:16.865818 (+ 23396us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:10:17.252022 (+386204us) spinlock_profiling.cc:243] Waited 1.73 ms on lock 0x7b1800248920. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f212cf16ab1 00007f212cf23281 00007f2126ce34bc 00007f212403148b 00007f212ce8b9a9 00007f212404d69b 00007f212404b93f 00007f212404b455 00007f212ab333c7 00007f21271459a7 00007f21271550bf
0709 12:10:17.252245 (+   223us) log.cc:844] Serialized 14 byte log entry
0709 12:10:21.548342 (+4296097us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:21.548463 (+   121us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:21.548531 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:21.548650 (+   119us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:21.548916 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7324,"prepare.queue_time_us":72010,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":55,"spinlock_wait_cycles":3988736,"thread_start_us":4316102,"threads_started":2,"wal-append.queue_time_us":533244,"wal-append.run_cpu_time_us":1321,"wal-append.run_wall_time_us":1001328}
I20260709 12:10:21.631738 16257 consensus_queue.cc:260] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:21.633090 16257 raft_consensus.cc:3060] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:21.634174 14189 raft_consensus.cc:2410] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:10:21.629527 15738 raft_consensus.cc:2804] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:21.635685 15738 raft_consensus.cc:493] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:10:21.636214 15738 raft_consensus.cc:3060] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:21.637516 14154 leader_election.cc:400] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 2 election: Vote denied by peer 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341) with higher term. Message: Invalid argument: T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 2. Current term is 3.
I20260709 12:10:21.637884 14154 leader_election.cc:403] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:10:21.613303 16224 raft_consensus.cc:3060] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:21.612368 14263 raft_consensus.cc:2468] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 2.
I20260709 12:10:21.527300 14085 catalog_manager.cc:5697] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 1 to 4, leader changed from 65c9c1653b3346b39a0e118540e6080c (127.12.174.131) to 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130). New cstate: current_term: 4 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
W20260709 12:10:21.643829 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 101505us
W20260709 12:10:21.645900 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 206297us
W20260709 12:10:21.647260 14230 connection.cc:256] RPC call timeout handler was delayed by -3.5110434229998191s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16060000000000002s for a response
W20260709 12:10:21.647783 14230 connection.cc:256] RPC call timeout handler was delayed by -3.4021434229998704s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17270000000000002s for a response
I20260709 12:10:21.613880 14335 raft_consensus.cc:1275] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 12:10:21.616940 14334 raft_consensus.cc:2368] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 2. Current term is 3.
I20260709 12:10:21.618906 14181 raft_consensus.cc:1240] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:21.623585 14187 raft_consensus.cc:2468] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 5.
I20260709 12:10:21.653098 14335 pending_rounds.cc:85] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c: Aborting all ops after (but not including) 4
W20260709 12:10:21.649112 14230 connection.cc:256] RPC call timeout handler was delayed by -3.374527192999949s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22660000000000002s for a response
I20260709 12:10:21.656420 14183 raft_consensus.cc:2468] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 4.
W20260709 12:10:21.656770 14230 connection.cc:256] RPC call timeout handler was delayed by -3.371229853999921s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22200000000000003s for a response
I20260709 12:10:21.635314 16226 leader_election.cc:290] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:10:21.657157 14230 connection.cc:256] RPC call timeout handler was delayed by -3.3291960560000007s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2171s for a response
I20260709 12:10:21.660101 14185 raft_consensus.cc:1240] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 2. Current term is 3. Ops: []
W20260709 12:10:21.664741 14230 connection.cc:256] RPC call timeout handler was delayed by -3.2778960559999177s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22280000000000003s for a response
I20260709 12:10:21.660118 14304 leader_election.cc:304] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:10:21.624712 14903 raft_consensus.cc:2468] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 5.
I20260709 12:10:21.642401 16091 raft_consensus.cc:3055] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:21.615180 15937 raft_consensus.cc:515] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:21.657389 14335 pending_rounds.cc:107] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 12:10:21.677393 14335 raft_consensus.cc:2889] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:10:21.665135 14230 connection.cc:256] RPC call timeout handler was delayed by -3.2757606870000018s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22120000000000004s for a response
I20260709 12:10:21.648490 14085 catalog_manager.cc:5697] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 1 to 2, leader changed from 65c9c1653b3346b39a0e118540e6080c (127.12.174.131) to 73d01e9b1a9d49358da4985b21d681db (127.12.174.132). New cstate: current_term: 2 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:21.674682 14877 leader_election.cc:304] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
W20260709 12:10:21.690654 14230 connection.cc:256] RPC call timeout handler was delayed by -3.2203487049998785s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1946s for a response
W20260709 12:10:21.691061 14230 connection.cc:256] RPC call timeout handler was delayed by -3.206843422999782s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19440000000000002s for a response
W20260709 12:10:21.691397 14230 connection.cc:256] RPC call timeout handler was delayed by -3.1600434229999337s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1996s for a response
W20260709 12:10:21.691717 14230 connection.cc:256] RPC call timeout handler was delayed by -3.1294434229998842s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20299999999999999s for a response
W20260709 12:10:21.691996 14230 connection.cc:256] RPC call timeout handler was delayed by -3.0628434229997765s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21040000000000003s for a response
W20260709 12:10:21.692289 14230 connection.cc:256] RPC call timeout handler was delayed by -3.0025434229999064s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2171s for a response
I20260709 12:10:21.676704 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:21.661442 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
W20260709 12:10:21.703639 14230 connection.cc:256] RPC call timeout handler was delayed by -2.9314434229997914s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.225s for a response
I20260709 12:10:21.662326 16145 raft_consensus.cc:2749] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341) with higher term. Message: Invalid argument: T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 2. Current term is 3.
I20260709 12:10:21.708120 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:21.715404 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:21.717971 14334 raft_consensus.cc:2393] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 5: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:10:21.676844 16091 raft_consensus.cc:740] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:10:21.705117 16262 raft_consensus.cc:2804] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:21.667773 16226 raft_consensus.cc:493] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:10:21.707628 16076 raft_consensus.cc:493] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:21.730870 14085 catalog_manager.cc:5697] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 1 to 3, leader changed from 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130) to 73d01e9b1a9d49358da4985b21d681db (127.12.174.132). New cstate: current_term: 3 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:21.677004 16160 leader_election.cc:290] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:21.714578 14330 raft_consensus.cc:1240] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:21.732744 14154 leader_election.cc:304] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:21.719843 16114 raft_consensus.cc:2749] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:10:21.742395 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 80448.3us
I20260709 12:10:21.729180 16164 raft_consensus.cc:493] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:21.727216 16262 raft_consensus.cc:493] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:21.755103 14183 raft_consensus.cc:1240] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:21.733430 14907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
W20260709 12:10:21.616994 14087 rpcz_store.cc:269] 0709 12:10:08.996661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:08.997112 (+   451us) service_pool.cc:224] Handling call
0709 12:10:21.574415 (+12577303us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:16.210411 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:16.330534 (+120123us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:16.330575 (+    41us) write_op.cc:435] Acquired schema lock
0709 12:10:16.330596 (+    21us) tablet.cc:662] Decoding operations
0709 12:10:16.331589 (+   993us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:16.331694 (+   105us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:16.331726 (+    32us) tablet.cc:685] Acquiring locks for 4 operations
0709 12:10:16.332261 (+   535us) tablet.cc:701] Row locks acquired
0709 12:10:16.332282 (+    21us) write_op.cc:260] PREPARE: finished
0709 12:10:16.332489 (+   207us) write_op.cc:270] Start()
0709 12:10:16.332609 (+   120us) write_op.cc:276] Timestamp: P: 1783599016332424 usec, L: 0
0709 12:10:16.332628 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 12:10:16.378175 (+ 45547us) log.cc:844] Serialized 1708 byte log entry
0709 12:10:16.676629 (+298454us) spinlock_profiling.cc:243] Waited 3.33 ms on lock 0x7b4400022b4c. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2123f74c85 00007f2123f756a2 00007f2126ce71db 00007f2126ce2aaf 00007f2126cd686e 00007f2126cd5bb6 00007f2126cd57d8 00007f2126cdf221 00007f2126cdf1d9 00007f2126cdf169
0709 12:10:16.845919 (+169290us) op_driver.cc:464] REPLICATION: finished
0709 12:10:17.003091 (+157172us) write_op.cc:301] APPLY: starting
0709 12:10:17.011082 (+  7991us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:17.011265 (+   183us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:17.011286 (+    21us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:17.104555 (+ 93269us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:17.104788 (+   233us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 12:10:17.104842 (+    54us) write_op.cc:312] APPLY: finished
0709 12:10:17.224296 (+119454us) log.cc:844] Serialized 41 byte log entry
0709 12:10:17.224628 (+   332us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:17.224771 (+   143us) write_op.cc:454] Released schema lock
0709 12:10:17.224852 (+    81us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:17.225315 (+   463us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:17.225360 (+    45us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":20251,"reported_tablets":16,"child_traces":[["op",{"apply.queue_time_us":150129,"apply.run_cpu_time_us":5718,"apply.run_wall_time_us":226450,"num_ops":4,"prepare.queue_time_us":177665,"prepare.run_cpu_time_us":36175,"prepare.run_wall_time_us":298059,"raft.queue_time_us":103474,"raft.run_cpu_time_us":27990,"raft.run_wall_time_us":71197,"replication_time_us":513125,"spinlock_wait_cycles":7658240,"thread_start_us":400376,"threads_started":4,"wal-append.queue_time_us":197172,"wal-append.run_cpu_time_us":108033,"wal-append.run_wall_time_us":4238393}]]}
I20260709 12:10:21.746345 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:21.748697 16164 raft_consensus.cc:515] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:21.778654 14908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:10:21.755134 16262 raft_consensus.cc:3060] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:21.742605 16226 raft_consensus.cc:515] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:10:21.797879 14230 connection.cc:256] RPC call timeout handler was delayed by -2.8161960560000807s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2741s for a response
W20260709 12:10:21.799599 14230 connection.cc:256] RPC call timeout handler was delayed by -2.6488434229997893s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2564s for a response
W20260709 12:10:21.800062 14230 connection.cc:256] RPC call timeout handler was delayed by -2.6293271929998809s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3094s for a response
W20260709 12:10:21.800442 14230 connection.cc:256] RPC call timeout handler was delayed by -2.6254434229999788s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.259s for a response
W20260709 12:10:21.800796 14230 connection.cc:256] RPC call timeout handler was delayed by -2.5786434229999031s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2642s for a response
W20260709 12:10:21.801177 14230 connection.cc:256] RPC call timeout handler was delayed by -2.1809270950000155s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1957s for a response
I20260709 12:10:21.771257 16076 raft_consensus.cc:515] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:10:21.838167 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:21.839280 14304 leader_election.cc:304] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
W20260709 12:10:21.840492 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 45668.4us
W20260709 12:10:21.840890 14154 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 121942us
W20260709 12:10:21.841640 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 46896.4us
I20260709 12:10:21.847350 15951 raft_consensus.cc:2804] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:21.847896 15951 raft_consensus.cc:493] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:10:21.848294 15951 raft_consensus.cc:3060] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:21.848491 14304 leader_election.cc:304] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:10:21.848927 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:21.849035 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
W20260709 12:10:21.850030 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 44403.3us
I20260709 12:10:21.771695 16143 raft_consensus.cc:493] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:10:21.806991 14085 catalog_manager.cc:5697] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:21.748890 16091 consensus_queue.cc:260] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:10:21.855768 14154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:21.859756 14908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:21.844314 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:21.853300 16145 raft_consensus.cc:2749] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:21.849715 16277 raft_consensus.cc:493] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:21.866106 14229 leader_election.cc:304] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:21.868077 14909 raft_consensus.cc:2468] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 5.
I20260709 12:10:21.869959 14912 raft_consensus.cc:1240] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:21.870045 14877 leader_election.cc:304] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:21.871061 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:21.875061 16076 leader_election.cc:290] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:21.875563 16263 consensus_queue.cc:1059] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:21.877542 16277 raft_consensus.cc:515] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:21.881809 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:21.882575 14257 raft_consensus.cc:2468] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 4.
W20260709 12:10:21.883757 14302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:21.882138 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:21.860589 16114 consensus_queue.cc:1059] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 12:10:21.866860 16112 raft_consensus.cc:2804] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:21.888334 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:21.888140 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:21.892333 14260 raft_consensus.cc:2468] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 4.
W20260709 12:10:21.896970 16273 log.cc:927] Time spent T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 12:10:21.902542 16164 leader_election.cc:290] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:21.887916 15827 raft_consensus.cc:2749] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:21.905143 14229 leader_election.cc:304] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
W20260709 12:10:21.907940 14155 connection.cc:256] RPC call timeout handler was delayed by -3.7496702739999819s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1554s for a response
W20260709 12:10:21.908419 14155 connection.cc:256] RPC call timeout handler was delayed by -3.7460702739999761s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15580000000000002s for a response
W20260709 12:10:21.908725 14155 connection.cc:256] RPC call timeout handler was delayed by -3.6677702740000768s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1645s for a response
W20260709 12:10:21.909272 14155 connection.cc:256] RPC call timeout handler was delayed by -3.491370274000019s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1841s for a response
W20260709 12:10:21.909582 14155 connection.cc:256] RPC call timeout handler was delayed by -3.481470274000003s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18520000000000003s for a response
W20260709 12:10:21.909873 14155 connection.cc:256] RPC call timeout handler was delayed by -3.4211702739999055s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19190000000000002s for a response
W20260709 12:10:21.910130 14155 connection.cc:256] RPC call timeout handler was delayed by -3.387870274000079s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1956s for a response
W20260709 12:10:21.910426 14155 connection.cc:256] RPC call timeout handler was delayed by -3.3518702740000208s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1996s for a response
W20260709 12:10:21.910686 14155 connection.cc:256] RPC call timeout handler was delayed by -3.2039410979998593s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16190000000000002s for a response
W20260709 12:10:21.910938 14155 connection.cc:256] RPC call timeout handler was delayed by -3.0590410979998524s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17800000000000002s for a response
W20260709 12:10:21.911190 14155 connection.cc:256] RPC call timeout handler was delayed by -2.8871410980000292s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19710000000000003s for a response
W20260709 12:10:21.911432 14155 connection.cc:256] RPC call timeout handler was delayed by -2.8772410980000132s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19820000000000002s for a response
W20260709 12:10:21.911672 14155 connection.cc:256] RPC call timeout handler was delayed by -2.7269410979999975s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2149s for a response
W20260709 12:10:21.911916 14155 connection.cc:256] RPC call timeout handler was delayed by -2.686441097999932s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2194s for a response
W20260709 12:10:21.912168 14155 connection.cc:256] RPC call timeout handler was delayed by -2.1887410980000368s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2747s for a response
W20260709 12:10:21.912431 14155 connection.cc:256] RPC call timeout handler was delayed by -1.2692702740000641s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.431s for a response
I20260709 12:10:21.912837 16266 raft_consensus.cc:3055] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:21.913327 16266 raft_consensus.cc:740] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:21.914392 16203 raft_consensus.cc:493] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:21.914335 16266 consensus_queue.cc:260] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:21.914983 16203 raft_consensus.cc:515] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:21.915787 16266 raft_consensus.cc:3060] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:21.913335 16264 raft_consensus.cc:493] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:10:21.917272 16203 leader_election.cc:290] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:21.917459 16264 raft_consensus.cc:515] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:21.919198 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:21.919700 16264 leader_election.cc:290] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:21.920097 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:21.920245 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:21.920749 14181 raft_consensus.cc:3060] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:21.921290 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:21.927574 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:21.884646 15937 leader_election.cc:290] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 2 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:10:21.936174 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 66203.3us
I20260709 12:10:21.922106 14261 raft_consensus.cc:3060] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:21.922493 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:21.923336 16091 raft_consensus.cc:3060] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:21.892402 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:21.918947 15738 raft_consensus.cc:515] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:21.913038 14155 leader_election.cc:304] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:21.933569 14181 raft_consensus.cc:2468] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 4.
I20260709 12:10:21.863696 15844 consensus_queue.cc:1059] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.065s
I20260709 12:10:21.865680 16143 raft_consensus.cc:515] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:21.939400 14187 raft_consensus.cc:2468] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 6.
I20260709 12:10:21.942238 14263 raft_consensus.cc:2468] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 4.
I20260709 12:10:21.939081 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:21.892720 14085 catalog_manager.cc:5697] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:10:21.944350 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:21.943746 14188 raft_consensus.cc:2468] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 2.
I20260709 12:10:21.895339 16076 raft_consensus.cc:2749] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:21.949549 14183 raft_consensus.cc:2468] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 3.
W20260709 12:10:21.946332 14156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:21.947928 14186 raft_consensus.cc:3060] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:21.947893 14903 raft_consensus.cc:2393] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 5: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
I20260709 12:10:21.952616 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:21.953379 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:10:21.955319 14184 raft_consensus.cc:1240] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:21.955817 14877 leader_election.cc:304] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:10:21.936441 16112 raft_consensus.cc:697] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 5 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:21.963804 16112 consensus_queue.cc:237] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:21.946674 16164 raft_consensus.cc:2749] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:21.952781 14085 catalog_manager.cc:5697] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 1 to 2, leader changed from 885067a0d31741bfb5c9935788e315bf (127.12.174.129) to 73d01e9b1a9d49358da4985b21d681db (127.12.174.132). New cstate: current_term: 2 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:21.912175 16224 raft_consensus.cc:515] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:21.970702 14261 raft_consensus.cc:2468] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 6.
I20260709 12:10:21.961506 14230 leader_election.cc:304] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:21.949563 16160 raft_consensus.cc:2804] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:21.962512 15844 consensus_queue.cc:1243] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer 17aab1bbf5014936aa18cc21818b26ec log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:10:21.948629 16277 leader_election.cc:290] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:21.977438 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:21.980839 14904 raft_consensus.cc:2368] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 4. Current term is 5.
I20260709 12:10:21.981091 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:21.982780 14181 raft_consensus.cc:2393] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 5: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:10:21.988778 14908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:21.993094 16076 consensus_queue.cc:1059] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:21.994194 14230 leader_election.cc:304] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:21.995220 16280 raft_consensus.cc:2804] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:21.995643 16280 raft_consensus.cc:493] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:21.995747 14230 leader_election.cc:304] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:21.996160 16280 raft_consensus.cc:3060] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:21.980717 16279 raft_consensus.cc:2804] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:21.998199 16279 raft_consensus.cc:493] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:21.998571 16279 raft_consensus.cc:3060] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:22.000238 14182 raft_consensus.cc:2468] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 2.
I20260709 12:10:21.991293 14189 raft_consensus.cc:2468] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 4.
I20260709 12:10:21.997447 14230 leader_election.cc:304] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db
W20260709 12:10:22.003652 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 45509.4us
I20260709 12:10:22.003829 14229 leader_election.cc:304] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:21.994196 16076 raft_consensus.cc:3055] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:22.005158 16164 raft_consensus.cc:2804] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:22.005559 16164 raft_consensus.cc:493] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:22.005920 16164 raft_consensus.cc:3060] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:22.006100 16143 leader_election.cc:290] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:22.006968 16114 raft_consensus.cc:2804] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:22.007544 16114 raft_consensus.cc:697] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 2 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:10:22.008432 15951 raft_consensus.cc:515] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:22.011127 15951 leader_election.cc:290] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 4 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:21.981072 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:22.012109 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:22.013418 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:22.013657 16226 leader_election.cc:290] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:22.014109 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:22.014802 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:22.015285 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:22.015930 14190 raft_consensus.cc:2468] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 4.
I20260709 12:10:22.019022 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:22.023054 14155 leader_election.cc:304] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:22.024636 14155 leader_election.cc:304] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:22.026081 16226 raft_consensus.cc:3060] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:22.026821 16160 raft_consensus.cc:493] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:22.027328 16160 raft_consensus.cc:3060] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:22.027529 16224 leader_election.cc:290] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 4 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:22.028232 16224 raft_consensus.cc:2749] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:22.030215 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:22.033514 16285 raft_consensus.cc:3055] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:22.033994 16285 raft_consensus.cc:740] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:22.035015 16285 consensus_queue.cc:260] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:22.036615 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:22.036931 16285 raft_consensus.cc:3060] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:22.034884 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:22.041591 14908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:10:22.044106 14257 raft_consensus.cc:2410] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db for term 6 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:10:22.041617 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:10:22.004693 14085 catalog_manager.cc:5697] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 1 to 3, leader changed from 65c9c1653b3346b39a0e118540e6080c (127.12.174.131) to 73d01e9b1a9d49358da4985b21d681db (127.12.174.132). New cstate: current_term: 3 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:22.054723 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:22.055442 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:22.047781 16076 raft_consensus.cc:740] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:10:22.008491 16114 consensus_queue.cc:237] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:22.062923 16076 consensus_queue.cc:260] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:22.064291 16076 raft_consensus.cc:3060] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:22.072551 14155 leader_election.cc:304] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:22.072870 14085 catalog_manager.cc:5697] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 1 to 2, leader changed from 65c9c1653b3346b39a0e118540e6080c (127.12.174.131) to 73d01e9b1a9d49358da4985b21d681db (127.12.174.132). New cstate: current_term: 2 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:10:22.081782 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 84446.6us
W20260709 12:10:22.087435 14154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:22.079918 16265 consensus_meta.cc:287] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.633s	user 0.013s	sys 0.000s
W20260709 12:10:22.091693 14302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:22.092368 14230 leader_election.cc:304] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:22.092890 14154 leader_election.cc:304] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:22.086131 14085 catalog_manager.cc:5697] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:10:22.097895 14303 connection.cc:256] RPC call timeout handler was delayed by -4.168017872000064s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15580000000000002s for a response
W20260709 12:10:22.098352 14303 connection.cc:256] RPC call timeout handler was delayed by -3.8746178720000444s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1884s for a response
W20260709 12:10:22.098573 14303 connection.cc:256] RPC call timeout handler was delayed by -3.5839178720000291s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2207s for a response
I20260709 12:10:22.081782 16292 raft_consensus.cc:2804] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:22.107081 14908 raft_consensus.cc:2468] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 5.
I20260709 12:10:22.110008 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:22.110731 14182 raft_consensus.cc:3060] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:22.110261 14156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:22.090407 15924 raft_consensus.cc:493] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:22.113054 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:22.113775 14189 raft_consensus.cc:2468] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 4.
I20260709 12:10:22.116568 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:22.099917 16143 raft_consensus.cc:2749] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:22.118444 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:22.100060 16090 raft_consensus.cc:493] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:22.120239 15924 raft_consensus.cc:515] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:22.122342 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:22.132692 14188 raft_consensus.cc:2393] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 3: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
I20260709 12:10:22.083117 16279 raft_consensus.cc:515] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:22.101394 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:10:22.112638 16233 raft_consensus.cc:2804] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:22.099148 16207 consensus_queue.cc:1048] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 12:10:22.126173 14155 leader_election.cc:304] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
W20260709 12:10:22.127378 14305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:22.129552 14187 raft_consensus.cc:2468] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 4.
I20260709 12:10:22.118708 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:22.100370 16292 raft_consensus.cc:493] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:22.159770 14261 raft_consensus.cc:1240] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:22.099869 16265 raft_consensus.cc:515] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:10:22.160741 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:22.163961 14904 raft_consensus.cc:2393] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 3: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
I20260709 12:10:22.148260 14334 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080"
dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
mode: GRACEFUL
new_leader_uuid: "17aab1bbf5014936aa18cc21818b26ec"
 from {username='slave'} at 127.0.0.1:50896
W20260709 12:10:22.170149 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 59720.3us
I20260709 12:10:22.171032 14155 leader_election.cc:304] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:22.171847 16226 raft_consensus.cc:2749] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:22.156989 16292 raft_consensus.cc:3060] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:22.178051 14190 raft_consensus.cc:1240] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:22.179350 16279 leader_election.cc:290] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 4 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:22.180152 16279 raft_consensus.cc:2804] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:22.180677 16279 raft_consensus.cc:493] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:22.181123 16279 raft_consensus.cc:3060] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:22.138779 16280 raft_consensus.cc:515] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:22.185267 16280 leader_election.cc:290] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 4 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:22.154650 16203 raft_consensus.cc:2749] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:22.169224 16164 raft_consensus.cc:515] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:22.157186 16233 raft_consensus.cc:697] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 5 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:10:22.187130 16233 consensus_queue.cc:237] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:22.188055 16164 leader_election.cc:290] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:22.185186 16076 raft_consensus.cc:2764] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader election decision vote started in defunct term 5: won
I20260709 12:10:22.188190 16262 raft_consensus.cc:515] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:10:22.189543 16257 consensus_meta.cc:287] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db: Time spent flushing consensus metadata: real 0.556s	user 0.015s	sys 0.000s
I20260709 12:10:22.155496 15738 leader_election.cc:290] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:22.190570 16262 leader_election.cc:290] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 4 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:22.191275 14911 raft_consensus.cc:2468] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 5.
I20260709 12:10:22.195067 14334 raft_consensus.cc:606] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 5 LEADER]: Received request to transfer leadership to TS 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:10:22.195757 14186 raft_consensus.cc:2468] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 5.
I20260709 12:10:22.196905 14912 raft_consensus.cc:2468] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 5.
I20260709 12:10:22.198307 14182 raft_consensus.cc:2468] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 5.
I20260709 12:10:22.199990 14183 raft_consensus.cc:1240] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 4. Current term is 5. Ops: []
W20260709 12:10:22.201773 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 120950us
W20260709 12:10:22.205878 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 123166us
I20260709 12:10:22.155958 16090 raft_consensus.cc:515] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:22.207566 14155 leader_election.cc:304] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:22.208227 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:22.208822 16090 leader_election.cc:290] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:22.204038 16226 raft_consensus.cc:3060] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:22.214393 16265 leader_election.cc:290] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:22.214906 16160 raft_consensus.cc:515] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:22.219357 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:10:22.223459 14878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:22.226505 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 61902.7us
I20260709 12:10:22.226909 14334 raft_consensus.cc:1240] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 3 LEADER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:22.227473 14303 leader_election.cc:304] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:22.228618 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:22.229434 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:22.230238 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:22.230356 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:22.231122 14336 raft_consensus.cc:1240] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 6. Current term is 7. Ops: []
W20260709 12:10:22.219462 14156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:22.231333 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:22.229522 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:10:22.232081 14156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:22.232050 14334 raft_consensus.cc:1275] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 12:10:22.234006 14334 pending_rounds.cc:85] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c: Aborting all ops after (but not including) 1
I20260709 12:10:22.234383 14334 pending_rounds.cc:107] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 12:10:22.235267 14334 raft_consensus.cc:2889] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:22.237934 16266 raft_consensus.cc:2749] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:22.240568 16160 leader_election.cc:290] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 3 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:22.233919 15924 leader_election.cc:290] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:22.232290 14303 leader_election.cc:304] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:22.248019 14877 leader_election.cc:304] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:22.257783 14877 leader_election.cc:304] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
W20260709 12:10:22.261924 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 258180us
I20260709 12:10:22.260933 16257 raft_consensus.cc:3060] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:22.264143 16224 raft_consensus.cc:2749] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:22.273666 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:22.274169 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:22.275058 14338 raft_consensus.cc:1275] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:10:22.274920 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:22.275588 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:22.276305 14333 raft_consensus.cc:2393] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 5: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
I20260709 12:10:22.276556 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:22.277135 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:22.277413 14330 raft_consensus.cc:2410] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 12:10:22.277890 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 68361us
I20260709 12:10:22.269543 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:22.278784 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:22.279438 14339 raft_consensus.cc:2468] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 4.
I20260709 12:10:22.275013 14335 raft_consensus.cc:2393] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 3: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:10:22.278093 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:22.276129 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:22.283146 14229 leader_election.cc:400] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 4 election: Vote denied by peer 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341) with higher term. Message: Invalid argument: T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 4. Current term is 5.
I20260709 12:10:22.281584 14155 leader_election.cc:304] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:22.284461 14337 raft_consensus.cc:3060] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:22.282114 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 49937.5us
I20260709 12:10:22.240736 16279 raft_consensus.cc:515] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:22.283762 16298 consensus_queue.cc:1059] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
W20260709 12:10:22.283216 16294 log.cc:927] Time spent T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.177s	user 0.001s	sys 0.000s
I20260709 12:10:22.286836 16298 raft_consensus.cc:3055] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:22.287209 16298 raft_consensus.cc:740] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:10:22.287772 16279 leader_election.cc:290] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 2 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:22.265340 16266 raft_consensus.cc:2749] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:22.284571 14229 leader_election.cc:403] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:10:22.292367 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:22.293097 14263 raft_consensus.cc:3060] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:22.294219 14303 leader_election.cc:304] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:22.294754 14877 leader_election.cc:304] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:22.296924 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:22.297655 14335 raft_consensus.cc:2468] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 4.
I20260709 12:10:22.298511 15924 raft_consensus.cc:3060] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:22.300913 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:22.301575 14260 raft_consensus.cc:3060] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:22.295571 16296 raft_consensus.cc:2749] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:22.301726 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:22.306063 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:22.306908 14264 raft_consensus.cc:2393] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 4: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:10:22.304244 14155 leader_election.cc:304] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:22.307804 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:22.308522 14265 raft_consensus.cc:3060] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:22.310738 14303 leader_election.cc:304] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:22.264665 16292 raft_consensus.cc:515] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:22.314188 16266 raft_consensus.cc:2749] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:22.288143 16298 consensus_queue.cc:260] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:22.332433 14229 leader_election.cc:304] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:10:22.333091 14333 raft_consensus.cc:2468] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 5.
I20260709 12:10:22.293835 16224 raft_consensus.cc:2749] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:22.337893 16207 raft_consensus.cc:2804] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:22.338497 16207 raft_consensus.cc:493] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:22.338863 16207 raft_consensus.cc:3060] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:22.337939 16279 raft_consensus.cc:2804] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:22.339874 16279 raft_consensus.cc:493] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:22.340394 16279 raft_consensus.cc:3060] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:22.313644 16292 leader_election.cc:290] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 4 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:22.335131 16302 raft_consensus.cc:2749] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341) with higher term. Message: Invalid argument: T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 4. Current term is 5.
I20260709 12:10:22.344080 14260 raft_consensus.cc:2468] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 4.
I20260709 12:10:22.345420 14303 leader_election.cc:304] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:10:22.348050 14337 raft_consensus.cc:2468] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 5.
I20260709 12:10:22.350417 14263 raft_consensus.cc:2468] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 3.
I20260709 12:10:22.351604 16295 raft_consensus.cc:2804] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:22.352308 16295 raft_consensus.cc:697] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 5 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
W20260709 12:10:22.352862 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 263360us
I20260709 12:10:22.353615 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:22.353834 14230 leader_election.cc:304] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:22.354302 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:22.357017 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:22.357853 16302 raft_consensus.cc:2804] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:22.358244 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:22.358510 16302 raft_consensus.cc:697] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 4 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:10:22.359555 16302 consensus_queue.cc:237] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:22.360620 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:22.361904 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:10:22.360033 14185 raft_consensus.cc:1240] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:22.361837 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:22.354346 14904 raft_consensus.cc:2468] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 3.
I20260709 12:10:22.365603 14912 raft_consensus.cc:1240] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 1. Current term is 2. Ops: []
W20260709 12:10:22.367695 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 63574.1us
I20260709 12:10:22.368630 14155 leader_election.cc:304] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:22.368867 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:22.369586 14188 raft_consensus.cc:3060] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:22.370805 14155 leader_election.cc:304] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:22.343704 16233 raft_consensus.cc:2749] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:22.374799 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:22.376230 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:22.353384 16295 consensus_queue.cc:237] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:22.382319 16292 consensus_queue.cc:1048] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:22.357882 14183 raft_consensus.cc:2393] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 3: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:10:22.384606 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:10:22.386677 14230 leader_election.cc:304] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:22.386880 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:22.388816 14185 raft_consensus.cc:1275] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:22.390357 14181 raft_consensus.cc:3060] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:22.392985 14156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:22.396068 14188 raft_consensus.cc:2468] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 5.
I20260709 12:10:22.349447 14304 leader_election.cc:304] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:10:22.397971 14265 raft_consensus.cc:2468] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 5.
I20260709 12:10:22.398383 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:10:22.399427 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 53664.7us
I20260709 12:10:22.397979 16203 raft_consensus.cc:3060] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:22.402092 16160 raft_consensus.cc:2749] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:10:22.402520 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 55650us
I20260709 12:10:22.403131 14182 raft_consensus.cc:2393] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 5: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:10:22.403232 14304 leader_election.cc:304] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:10:22.404196 16285 raft_consensus.cc:2804] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:22.404103 16233 consensus_queue.cc:1048] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:22.405014 16265 raft_consensus.cc:2804] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:22.405406 16265 raft_consensus.cc:493] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:22.405776 16265 raft_consensus.cc:3060] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:22.406148 14155 leader_election.cc:400] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 3 pre-election: Vote denied by peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673) with higher term. Message: Invalid argument: T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 3. Current term is 4.
I20260709 12:10:22.406495 14155 leader_election.cc:403] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:22.407106 14304 leader_election.cc:304] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:10:22.404673 16285 raft_consensus.cc:493] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:22.407828 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:22.416472 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:22.416712 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:10:22.416700 14155 leader_election.cc:304] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:22.418007 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:22.421454 14304 leader_election.cc:304] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:10:22.400290 16292 raft_consensus.cc:2749] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:22.434582 16160 raft_consensus.cc:2749] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:22.435707 16090 raft_consensus.cc:2804] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:22.434778 14912 raft_consensus.cc:2393] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 2: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
I20260709 12:10:22.436326 16090 raft_consensus.cc:697] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 6 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:22.436857 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:22.434578 14182 raft_consensus.cc:3060] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:22.437776 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:22.437348 16090 consensus_queue.cc:237] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:22.438463 14333 raft_consensus.cc:2468] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 3.
I20260709 12:10:22.439033 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:22.441699 14333 raft_consensus.cc:1240] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:22.442965 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:22.444506 14155 leader_election.cc:304] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:22.433509 14186 raft_consensus.cc:3060] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:22.445693 16160 raft_consensus.cc:2749] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:22.446177 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:10:22.447584 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:22.445472 14182 raft_consensus.cc:2468] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 3.
I20260709 12:10:22.447489 16266 raft_consensus.cc:2804] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:22.454138 16266 raft_consensus.cc:493] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:22.454617 16266 raft_consensus.cc:3060] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:22.454908 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:22.447883 14183 raft_consensus.cc:2468] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 3.
I20260709 12:10:22.460292 16279 raft_consensus.cc:515] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:22.414598 16298 raft_consensus.cc:3060] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:22.433058 16285 raft_consensus.cc:3060] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:22.463047 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 76513us
I20260709 12:10:22.464749 14230 leader_election.cc:304] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:22.466253 14335 raft_consensus.cc:2468] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 1.
I20260709 12:10:22.468137 16265 raft_consensus.cc:515] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:22.468916 16207 raft_consensus.cc:515] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:22.471951 16207 leader_election.cc:290] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 6 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:22.474378 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:22.474567 16207 consensus_queue.cc:1048] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:22.475137 14183 raft_consensus.cc:3060] T f4739bc22bfe44fcba807da02d9351b6 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:22.478726 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:22.479579 14334 raft_consensus.cc:2468] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 4.
I20260709 12:10:22.481047 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:22.481350 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:22.481767 14338 raft_consensus.cc:3060] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:22.482127 14331 raft_consensus.cc:2368] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 4. Current term is 5.
W20260709 12:10:22.482577 14228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:22.480856 14302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:22.484196 14304 leader_election.cc:304] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:10:22.485209 14304 leader_election.cc:304] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:10:22.487048 16265 leader_election.cc:290] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:22.489127 15924 raft_consensus.cc:2749] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:22.493269 14181 raft_consensus.cc:2468] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 6.
I20260709 12:10:22.494719 14338 raft_consensus.cc:2468] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 6.
I20260709 12:10:22.496975 14155 leader_election.cc:400] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 2 election: Vote denied by peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957) with higher term. Message: Invalid argument: T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 2. Current term is 3.
I20260709 12:10:22.493916 14304 leader_election.cc:304] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:10:22.501586 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:22.502259 14263 raft_consensus.cc:3060] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:22.420835 16233 raft_consensus.cc:2749] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673) with higher term. Message: Invalid argument: T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 3. Current term is 4.
I20260709 12:10:22.514369 14186 raft_consensus.cc:2468] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 4.
I20260709 12:10:22.518672 14183 raft_consensus.cc:2410] T f4739bc22bfe44fcba807da02d9351b6 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db for term 6 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:10:22.519712 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:22.450929 16226 raft_consensus.cc:2749] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:10:22.522646 14302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:22.499917 16164 consensus_queue.cc:1059] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 12:10:22.528101 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:22.530623 14259 raft_consensus.cc:3060] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:22.531996 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 86261.2us
I20260709 12:10:22.501040 16286 raft_consensus.cc:2804] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:22.541359 14155 leader_election.cc:304] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:22.508663 16265 raft_consensus.cc:2804] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:22.547170 14230 leader_election.cc:304] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:22.510685 15738 raft_consensus.cc:2804] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:22.511372 16292 raft_consensus.cc:2749] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:22.548959 14877 leader_election.cc:304] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:22.555158 14263 raft_consensus.cc:2468] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 6.
W20260709 12:10:22.558405 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 148428us
I20260709 12:10:22.556093 14877 leader_election.cc:304] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:22.562275 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:22.540355 16164 consensus_queue.cc:1243] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer 65c9c1653b3346b39a0e118540e6080c log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:10:22.562738 14877 leader_election.cc:304] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:22.565577 14263 raft_consensus.cc:1240] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 4. Current term is 6. Ops: []
I20260709 12:10:22.549836 16203 raft_consensus.cc:2749] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:22.553350 16233 raft_consensus.cc:2749] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:22.568082 14155 leader_election.cc:304] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:22.559407 15827 raft_consensus.cc:2749] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:22.560540 16286 raft_consensus.cc:697] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 4 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:22.564070 16296 raft_consensus.cc:2749] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:22.579542 14256 raft_consensus.cc:1275] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:10:22.580233 14155 leader_election.cc:304] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
W20260709 12:10:22.581761 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 73059.3us
I20260709 12:10:22.563674 16302 raft_consensus.cc:2749] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:22.584575 16224 consensus_queue.cc:1059] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:22.584939 16210 consensus_queue.cc:1059] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 12:10:22.585585 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:22.563190 15738 raft_consensus.cc:697] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 5 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:22.595033 14303 leader_election.cc:304] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:22.569214 16215 raft_consensus.cc:2749] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:22.612177 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:22.612686 14303 leader_election.cc:304] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:22.599759 16143 raft_consensus.cc:2804] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:22.613282 14265 raft_consensus.cc:2410] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:10:22.613384 16143 raft_consensus.cc:493] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:10:22.614390 14303 leader_election.cc:304] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:22.565786 16265 raft_consensus.cc:697] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 3 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:22.578148 16160 raft_consensus.cc:2764] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:10:22.596873 14155 leader_election.cc:304] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:22.577174 14257 raft_consensus.cc:3055] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:22.615278 16262 raft_consensus.cc:2749] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:22.618767 14155 leader_election.cc:400] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 4 election: Vote denied by peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957) with higher term. Message: Invalid argument: T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 4. Current term is 5.
I20260709 12:10:22.619603 14155 leader_election.cc:403] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:10:22.624235 15924 raft_consensus.cc:2749] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:22.617777 14257 raft_consensus.cc:740] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:10:22.625779 16288 consensus_queue.cc:1048] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 12:10:22.626431 16265 consensus_queue.cc:237] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:22.627345 16210 raft_consensus.cc:3055] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:22.627795 16210 raft_consensus.cc:740] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:10:22.628243 16257 raft_consensus.cc:2749] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:22.630268 16145 raft_consensus.cc:2804] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:22.630811 16145 raft_consensus.cc:493] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:22.630568 14257 consensus_queue.cc:260] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:22.631202 16145 raft_consensus.cc:3060] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:22.632010 14257 raft_consensus.cc:3060] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:22.625084 15924 consensus_queue.cc:1059] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:22.625808 14303 leader_election.cc:304] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:22.637004 14877 leader_election.cc:304] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:22.640710 14256 raft_consensus.cc:1240] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 1. Current term is 3. Ops: []
I20260709 12:10:22.629127 16210 consensus_queue.cc:260] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:22.606547 16279 leader_election.cc:290] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:22.618269 16090 raft_consensus.cc:2749] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:22.616298 16143 raft_consensus.cc:3060] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:22.648169 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:22.648407 14264 raft_consensus.cc:1240] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:22.648599 16210 raft_consensus.cc:3060] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:22.649065 14230 leader_election.cc:304] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:22.649174 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:22.650282 15924 raft_consensus.cc:3055] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:22.649869 15738 consensus_queue.cc:237] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:22.651250 16160 raft_consensus.cc:3060] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:22.651726 14305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:22.652221 16222 raft_consensus.cc:3055] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:22.660517 16112 raft_consensus.cc:2749] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:22.618778 16266 raft_consensus.cc:515] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:22.666718 14303 leader_election.cc:304] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:22.673369 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:22.660732 15924 raft_consensus.cc:740] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:22.674602 15924 consensus_queue.cc:260] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:22.675896 15924 raft_consensus.cc:3060] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:22.670899 16164 raft_consensus.cc:2749] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:22.664741 16222 raft_consensus.cc:740] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:10:22.680233 16222 consensus_queue.cc:260] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:22.665963 16262 consensus_queue.cc:1059] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 12:10:22.682119 16262 raft_consensus.cc:3055] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:22.682776 16262 raft_consensus.cc:740] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:22.658969 16297 raft_consensus.cc:2804] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:22.691241 14263 raft_consensus.cc:1275] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:10:22.693598 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 48492us
I20260709 12:10:22.695041 14230 leader_election.cc:304] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:22.671075 16224 raft_consensus.cc:493] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:22.696099 16224 raft_consensus.cc:515] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:22.698311 16224 leader_election.cc:290] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:22.687009 16286 consensus_queue.cc:237] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:22.699643 14230 leader_election.cc:304] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:22.700649 16279 raft_consensus.cc:2749] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:22.701067 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:22.701488 16164 raft_consensus.cc:2749] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:22.702646 14331 raft_consensus.cc:2468] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 7.
I20260709 12:10:22.683691 16262 consensus_queue.cc:260] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:22.703963 16262 raft_consensus.cc:3060] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:22.704589 14155 leader_election.cc:304] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:22.705902 16224 raft_consensus.cc:2804] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:22.706341 16224 raft_consensus.cc:493] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:22.706768 16224 raft_consensus.cc:3060] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:22.703269 16164 consensus_queue.cc:1048] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 12:10:22.710214 14337 raft_consensus.cc:2393] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 5: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:10:22.711548 16266 leader_election.cc:290] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:22.681631 16222 raft_consensus.cc:3060] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:22.715772 16302 consensus_queue.cc:1048] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:10:22.718238 14230 leader_election.cc:304] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:22.719726 14259 raft_consensus.cc:2468] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 5.
I20260709 12:10:22.722718 16226 raft_consensus.cc:493] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:10:22.728214 16226 raft_consensus.cc:515] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } }
I20260709 12:10:22.727187 16295 raft_consensus.cc:2749] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:22.733045 16285 raft_consensus.cc:515] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:22.734266 14339 raft_consensus.cc:1240] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:22.736073 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:22.737634 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:22.738184 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:22.730520 16226 leader_election.cc:290] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:22.739099 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:22.739964 14256 raft_consensus.cc:2393] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 6: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:10:22.717404 16145 raft_consensus.cc:515] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:10:22.741314 14156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:22.742157 14264 raft_consensus.cc:1240] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:22.742836 16145 leader_election.cc:290] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:22.740818 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:22.762421 14256 raft_consensus.cc:2393] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 4: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:10:22.763337 16285 leader_election.cc:290] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:22.743324 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:22.763576 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:22.764876 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:22.765007 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:22.739506 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:22.726887 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
W20260709 12:10:22.749984 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:22.739145 14261 raft_consensus.cc:2468] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 4.
W20260709 12:10:22.738478 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 71846.5us
I20260709 12:10:22.766238 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:22.768270 14303 leader_election.cc:304] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:22.766263 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:22.751971 14260 raft_consensus.cc:2468] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 5.
I20260709 12:10:22.755641 14304 leader_election.cc:304] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:10:22.756379 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:22.770648 14263 raft_consensus.cc:2368] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 4. Current term is 5.
I20260709 12:10:22.770798 14258 raft_consensus.cc:2393] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 6: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
W20260709 12:10:22.771289 14154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:22.758133 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:22.757453 14333 raft_consensus.cc:1240] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 4 LEADER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:22.760298 14904 raft_consensus.cc:1275] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:22.760736 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:22.755389 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:22.773191 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:22.777632 14263 raft_consensus.cc:2468] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 7.
I20260709 12:10:22.780285 16145 consensus_queue.cc:1059] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:22.780665 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:22.781289 16145 raft_consensus.cc:3055] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:22.743974 16298 raft_consensus.cc:2749] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:22.783114 14258 raft_consensus.cc:1240] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:22.781673 16145 raft_consensus.cc:740] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:10:22.784596 16160 raft_consensus.cc:2749] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957) with higher term. Message: Invalid argument: T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 4. Current term is 5.
I20260709 12:10:22.784626 16145 consensus_queue.cc:260] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:22.771813 16286 raft_consensus.cc:2749] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:22.786561 16145 raft_consensus.cc:3060] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:22.787029 14303 leader_election.cc:304] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:10:22.787810 16279 consensus_queue.cc:1048] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:10:22.788386 14303 leader_election.cc:304] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:22.790635 16226 consensus_queue.cc:1059] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:10:22.790791 16160 consensus_queue.cc:1048] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:22.791756 16226 consensus_queue.cc:1243] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer 65c9c1653b3346b39a0e118540e6080c log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:10:22.792287 16226 raft_consensus.cc:3055] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:22.792603 16226 raft_consensus.cc:740] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:10:22.793685 16226 consensus_queue.cc:260] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:22.795140 16226 raft_consensus.cc:3060] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:22.772822 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:22.799010 14265 raft_consensus.cc:1275] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:22.724818 16297 raft_consensus.cc:697] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 6 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:10:22.802662 14256 raft_consensus.cc:3060] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:22.804575 14229 leader_election.cc:304] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:22.807341 14260 raft_consensus.cc:1240] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 3. Current term is 4. Ops: [3.2-3.2]
W20260709 12:10:22.807488 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 89402.9us
I20260709 12:10:22.808578 14230 leader_election.cc:304] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
W20260709 12:10:22.815048 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:22.816413 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
W20260709 12:10:22.817278 14156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:22.810791 14303 leader_election.cc:304] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:22.817508 14229 leader_election.cc:304] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:22.820353 16280 raft_consensus.cc:2749] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:22.796664 14330 raft_consensus.cc:3060] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:22.833338 16143 raft_consensus.cc:515] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:22.838585 14257 raft_consensus.cc:1275] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:10:22.839092 14257 pending_rounds.cc:85] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec: Aborting all ops after (but not including) 1
I20260709 12:10:22.839346 14257 pending_rounds.cc:107] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:10:22.839617 14257 raft_consensus.cc:2889] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:22.841243 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:22.841952 14334 raft_consensus.cc:3060] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:22.842927 14330 raft_consensus.cc:2468] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 5.
I20260709 12:10:22.776446 16285 raft_consensus.cc:2804] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:22.845072 16286 raft_consensus.cc:2764] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
W20260709 12:10:22.846019 16076 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
I20260709 12:10:22.845058 14256 raft_consensus.cc:2468] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 5.
I20260709 12:10:22.818322 16279 raft_consensus.cc:2749] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:22.811193 16288 raft_consensus.cc:2749] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:22.862288 14155 leader_election.cc:304] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
W20260709 12:10:22.865875 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 48450.3us
W20260709 12:10:22.871606 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 63098.8us
I20260709 12:10:22.866822 14229 leader_election.cc:304] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
W20260709 12:10:22.875281 14155 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:22.884840 14262 raft_consensus.cc:1275] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:22.887761 14334 raft_consensus.cc:2468] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 2.
I20260709 12:10:22.888767 14304 leader_election.cc:304] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:10:22.889240 14155 leader_election.cc:304] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:22.870072 16145 raft_consensus.cc:2804] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:22.866110 16262 raft_consensus.cc:2749] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:22.870112 16302 raft_consensus.cc:2749] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:22.866699 16143 leader_election.cc:290] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 2 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:22.864972 16285 raft_consensus.cc:697] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 5 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:22.910929 14229 leader_election.cc:304] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
W20260709 12:10:23.027807 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 117932us
I20260709 12:10:22.902149 16266 raft_consensus.cc:2804] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:23.022250 14230 leader_election.cc:304] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:23.017860 16145 raft_consensus.cc:697] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 5 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
W20260709 12:10:23.034862 16321 log.cc:927] Time spent T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260709 12:10:23.035275 16145 consensus_queue.cc:237] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:22.910219 16279 raft_consensus.cc:2804] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:22.895550 16226 raft_consensus.cc:2804] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:22.889423 16278 consensus_queue.cc:1048] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.134s
I20260709 12:10:22.896021 16090 consensus_queue.cc:1048] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.128s
I20260709 12:10:23.028601 14229 leader_election.cc:304] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:23.055533 14229 leader_election.cc:304] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
W20260709 12:10:23.025969 16311 log.cc:927] Time spent T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.109s	user 0.000s	sys 0.001s
I20260709 12:10:23.043120 16076 raft_consensus.cc:2804] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:23.065857 16266 raft_consensus.cc:697] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 5 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:23.067303 16266 consensus_queue.cc:237] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:23.069046 16285 consensus_queue.cc:237] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:23.071452 16262 raft_consensus.cc:993] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c: : Instructing follower 17aab1bbf5014936aa18cc21818b26ec to start an election
I20260709 12:10:23.072019 16262 raft_consensus.cc:1081] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 5 LEADER]: Signalling peer 17aab1bbf5014936aa18cc21818b26ec to start an election
I20260709 12:10:23.063859 15924 raft_consensus.cc:493] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:23.074193 15924 raft_consensus.cc:515] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:10:23.074373 14302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:23.093312 14156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:23.060045 16164 raft_consensus.cc:2804] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:23.055213 16302 raft_consensus.cc:2749] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:10:23.099560 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 47776.9us
I20260709 12:10:23.058296 16298 raft_consensus.cc:2804] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:23.057633 16226 raft_consensus.cc:697] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 2 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:10:23.060981 16076 raft_consensus.cc:493] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:23.108027 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 177119us
W20260709 12:10:23.114197 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 49333.9us
I20260709 12:10:23.115175 14229 leader_election.cc:304] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:23.098268 16164 raft_consensus.cc:493] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:23.119347 16164 raft_consensus.cc:3060] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:23.106215 14256 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080"
dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
 from {username='slave'} at 127.0.0.1:41764
I20260709 12:10:23.122421 14256 raft_consensus.cc:493] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:23.122856 14256 raft_consensus.cc:3060] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:23.114683 14230 leader_election.cc:304] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:23.127738 14303 leader_election.cc:304] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:10:23.142467 14256 raft_consensus.cc:515] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:23.104349 16298 raft_consensus.cc:493] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:23.151031 14186 raft_consensus.cc:1240] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:23.104400 15924 leader_election.cc:290] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:23.114399 16076 raft_consensus.cc:3060] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:23.109292 16279 raft_consensus.cc:697] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 4 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:10:23.160068 14262 raft_consensus.cc:1240] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:23.050951 16297 consensus_queue.cc:237] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:23.165899 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:23.106331 16286 consensus_queue.cc:1059] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.049s
I20260709 12:10:23.179397 14181 raft_consensus.cc:1275] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:10:23.151039 16288 raft_consensus.cc:2804] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:23.158623 16298 raft_consensus.cc:3060] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:23.177572 14183 raft_consensus.cc:2468] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 5.
I20260709 12:10:23.182613 14912 raft_consensus.cc:1240] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:23.165465 14256 leader_election.cc:290] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:23.186261 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
W20260709 12:10:23.183535 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 68454.2us
I20260709 12:10:23.186892 14182 raft_consensus.cc:3060] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:23.189198 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:23.190025 14186 raft_consensus.cc:2368] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for earlier term 3. Current term is 4.
I20260709 12:10:23.190481 14229 leader_election.cc:304] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:23.199133 14259 raft_consensus.cc:1275] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:23.199900 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:23.200888 14188 raft_consensus.cc:2410] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:10:23.156347 16224 raft_consensus.cc:515] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:23.205442 14182 raft_consensus.cc:2468] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 5.
I20260709 12:10:23.189536 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:23.210657 14257 raft_consensus.cc:2393] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 3: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:10:23.185556 16226 consensus_queue.cc:237] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:23.212152 16331 raft_consensus.cc:2764] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:10:23.212328 16224 leader_election.cc:290] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 8 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:23.202819 16292 raft_consensus.cc:2804] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:23.204483 15937 consensus_queue.cc:1059] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 12:10:23.214252 16292 raft_consensus.cc:493] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:23.214811 16292 raft_consensus.cc:3060] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:23.215039 15937 raft_consensus.cc:3055] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:23.215654 15937 raft_consensus.cc:740] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:10:23.185154 16288 raft_consensus.cc:493] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:10:23.220063 14188 raft_consensus.cc:1275] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:10:23.221314 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:23.221947 14334 raft_consensus.cc:3060] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:23.191201 16329 raft_consensus.cc:2749] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:23.225219 14912 raft_consensus.cc:1275] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:10:23.226136 14185 raft_consensus.cc:1275] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:10:23.236367 14229 leader_election.cc:304] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
W20260709 12:10:23.238296 14156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:23.239107 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:10:23.239562 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 130354us
I20260709 12:10:23.240049 14181 raft_consensus.cc:2393] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 3: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:10:23.223167 16288 raft_consensus.cc:3060] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:23.247260 14229 leader_election.cc:304] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:23.256243 14334 raft_consensus.cc:2468] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 8.
I20260709 12:10:23.260510 14155 leader_election.cc:304] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:23.226807 14904 raft_consensus.cc:1275] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:10:23.217124 15937 consensus_queue.cc:260] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:23.274029 16324 raft_consensus.cc:493] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:23.274688 14334 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6"
dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
mode: GRACEFUL
new_leader_uuid: "17aab1bbf5014936aa18cc21818b26ec"
 from {username='slave'} at 127.0.0.1:50896
I20260709 12:10:23.240604 16285 raft_consensus.cc:493] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:23.276247 14334 raft_consensus.cc:606] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Received request to transfer leadership to TS 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:10:23.274588 14303 leader_election.cc:304] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:23.277400 14334 raft_consensus.cc:614] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:23.278378 14303 leader_election.cc:304] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:23.279268 14230 leader_election.cc:304] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:23.268132 16222 raft_consensus.cc:2804] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:23.288440 14303 leader_election.cc:304] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:23.269150 16329 raft_consensus.cc:2804] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:23.284317 16338 raft_consensus.cc:2804] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:23.307291 16336 raft_consensus.cc:2804] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:23.307840 16336 raft_consensus.cc:493] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:23.308187 16336 raft_consensus.cc:3060] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:23.240944 16279 consensus_queue.cc:237] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:23.289026 16265 raft_consensus.cc:2749] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:10:23.304328 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 57137.5us
I20260709 12:10:23.318809 14229 leader_election.cc:304] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
W20260709 12:10:23.321857 16334 log.cc:927] Time spent T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.052s	user 0.000s	sys 0.002s
I20260709 12:10:23.325199 16330 consensus_queue.cc:1048] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.053s
I20260709 12:10:23.297822 16286 raft_consensus.cc:493] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:23.333896 14156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:23.341004 16328 log.cc:927] Time spent T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 12:10:23.286083 16285 raft_consensus.cc:515] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:23.293551 16266 raft_consensus.cc:2749] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:23.300927 16222 raft_consensus.cc:697] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 8 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:10:23.347780 14264 raft_consensus.cc:1240] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:23.274658 16324 raft_consensus.cc:515] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:10:23.321476 14304 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:23.386125 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:23.324965 16298 raft_consensus.cc:515] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:10:23.351248 14154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:23.398382 14181 raft_consensus.cc:1275] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:23.403616 14186 raft_consensus.cc:1275] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:10:23.388373 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 69659.2us
I20260709 12:10:23.379644 16329 raft_consensus.cc:697] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 5 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:10:23.382102 15937 raft_consensus.cc:3060] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:23.417465 14263 raft_consensus.cc:1240] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 2. Current term is 3. Ops: []
W20260709 12:10:23.417824 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 120187us
I20260709 12:10:23.419088 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:23.420001 14186 raft_consensus.cc:2393] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 5: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:10:23.391515 16338 raft_consensus.cc:697] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 3 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:10:23.402695 16076 raft_consensus.cc:515] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:23.411738 14904 raft_consensus.cc:1240] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:23.357491 16090 consensus_queue.cc:1048] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 12:10:23.380215 16286 raft_consensus.cc:515] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:10:23.440806 14155 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:23.465608 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:23.453070 14229 leader_election.cc:304] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:23.456645 14184 raft_consensus.cc:1240] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 5 LEADER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 4. Current term is 5. Ops: [4.2-4.2]
W20260709 12:10:23.449247 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 64888.2us
I20260709 12:10:23.470768 14186 raft_consensus.cc:2368] T f4739bc22bfe44fcba807da02d9351b6 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 5. Current term is 6.
W20260709 12:10:23.471794 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 192588us
I20260709 12:10:23.390183 16112 consensus_queue.cc:1048] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.051s
I20260709 12:10:23.408504 16266 consensus_queue.cc:1048] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 12:10:23.478118 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:23.480003 14264 raft_consensus.cc:3060] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:23.490207 14155 leader_election.cc:304] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:23.479956 16259 raft_consensus.cc:493] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:23.437916 16295 consensus_queue.cc:1059] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.049s
I20260709 12:10:23.479417 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:10:23.484153 16331 raft_consensus.cc:2749] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:10:23.518985 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 115027us
I20260709 12:10:23.521939 14186 raft_consensus.cc:1240] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 2 LEADER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 1. Current term is 2. Ops: []
W20260709 12:10:23.534938 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 63766.6us
I20260709 12:10:23.512115 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:23.545521 14230 leader_election.cc:304] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:10:23.547960 14155 leader_election.cc:304] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:23.479645 16164 raft_consensus.cc:515] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:23.557772 16226 raft_consensus.cc:2749] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:10:23.531844 16323 log.cc:927] Time spent T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:10:23.531514 16145 raft_consensus.cc:493] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:23.534667 16280 raft_consensus.cc:493] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:23.519665 16342 raft_consensus.cc:2749] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:23.587479 14186 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca"
dest_uuid: "885067a0d31741bfb5c9935788e315bf"
mode: GRACEFUL
new_leader_uuid: "17aab1bbf5014936aa18cc21818b26ec"
 from {username='slave'} at 127.0.0.1:52548
I20260709 12:10:23.594060 14186 raft_consensus.cc:606] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Received request to transfer leadership to TS 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:10:23.594471 14186 raft_consensus.cc:614] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:23.589566 16226 raft_consensus.cc:2749] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:23.509454 16222 consensus_queue.cc:237] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:23.577895 16337 raft_consensus.cc:2804] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:23.532111 16259 raft_consensus.cc:515] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:23.606308 16286 leader_election.cc:290] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:23.593715 16266 raft_consensus.cc:3055] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:10:23.608819 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 203668us
I20260709 12:10:23.606626 16345 raft_consensus.cc:2764] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader election decision vote started in defunct term 5: won
I20260709 12:10:23.595973 16280 raft_consensus.cc:515] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:23.597312 16090 consensus_queue.cc:1059] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 12:10:23.558115 16352 consensus_queue.cc:1048] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.108s
I20260709 12:10:23.579706 16331 consensus_queue.cc:1059] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 12:10:23.559659 16329 consensus_queue.cc:237] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:23.592374 16145 raft_consensus.cc:515] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:23.600181 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: true dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:10:23.755870 16076 leader_election.cc:290] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 8 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:23.762750 16145 leader_election.cc:290] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:23.570729 16338 consensus_queue.cc:237] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:23.696015 16324 leader_election.cc:290] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:23.757602 16349 raft_consensus.cc:3055] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:23.758540 14303 leader_election.cc:400] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 election: Vote denied by peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187) with higher term. Message: Invalid argument: T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for earlier term 3. Current term is 4.
I20260709 12:10:23.650928 14264 raft_consensus.cc:2468] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 8.
W20260709 12:10:23.759343 16346 log.cc:927] Time spent T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.147s	user 0.000s	sys 0.002s
I20260709 12:10:23.784126 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:23.651593 14265 raft_consensus.cc:1275] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 12:10:23.767522 14156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:23.639856 14190 raft_consensus.cc:1275] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:23.772363 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:23.766207 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:23.786029 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
W20260709 12:10:23.708334 16343 log.cc:927] Time spent T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 12:10:23.761065 14904 raft_consensus.cc:3060] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:23.796931 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:23.623519 16337 raft_consensus.cc:697] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 4 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
W20260709 12:10:23.646842 16347 log.cc:927] Time spent T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.138s	user 0.000s	sys 0.001s
I20260709 12:10:23.810374 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:23.647264 16164 leader_election.cc:290] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:10:23.809521 14156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:23.824846 14338 raft_consensus.cc:3060] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:23.643640 16332 log.cc:927] Time spent T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.399s	user 0.005s	sys 0.000s
I20260709 12:10:23.755847 16266 raft_consensus.cc:740] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
W20260709 12:10:23.826762 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 278875us
I20260709 12:10:23.784122 16349 raft_consensus.cc:740] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
W20260709 12:10:23.838266 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 80206.7us
I20260709 12:10:23.836269 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:23.844372 14155 leader_election.cc:304] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:23.845911 14155 leader_election.cc:304] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:23.653558 16292 raft_consensus.cc:515] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:23.854362 14303 leader_election.cc:304] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:10:23.864336 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: true dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:23.865477 14333 raft_consensus.cc:3055] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:23.865891 14333 raft_consensus.cc:740] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:23.868201 14155 leader_election.cc:304] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:23.827226 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:23.866972 14333 consensus_queue.cc:260] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:23.903220 14333 raft_consensus.cc:3060] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:23.851946 16224 raft_consensus.cc:2749] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:23.910689 14155 leader_election.cc:304] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:23.913609 14335 raft_consensus.cc:2468] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 2.
I20260709 12:10:23.912303 14155 leader_election.cc:304] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:23.916288 14155 leader_election.cc:304] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:23.917495 14155 leader_election.cc:304] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
W20260709 12:10:23.912441 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 75113.2us
I20260709 12:10:23.919019 14230 leader_election.cc:304] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:23.921344 16224 raft_consensus.cc:2764] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:10:23.926433 16358 consensus_queue.cc:1048] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:23.927412 16349 consensus_queue.cc:260] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:23.929018 16349 raft_consensus.cc:3060] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:23.848675 16324 consensus_queue.cc:1059] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.058s
I20260709 12:10:23.932051 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:23.831642 16355 consensus_queue.cc:1048] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.087s
I20260709 12:10:23.933580 14335 raft_consensus.cc:3060] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:23.935550 14230 leader_election.cc:304] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:23.936908 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:23.937608 14185 raft_consensus.cc:2468] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 4.
I20260709 12:10:23.938879 16359 raft_consensus.cc:493] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:23.934247 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:23.940261 14184 raft_consensus.cc:2468] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 7.
I20260709 12:10:23.939637 16359 raft_consensus.cc:515] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:23.919734 16143 raft_consensus.cc:2749] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:23.948669 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:23.952507 14185 raft_consensus.cc:1240] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:23.957983 15827 raft_consensus.cc:493] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:23.958550 16280 leader_election.cc:290] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:10:23.960577 14302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:23.918082 16233 raft_consensus.cc:2749] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:23.961930 16302 raft_consensus.cc:2804] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:23.962692 16302 raft_consensus.cc:697] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 2 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:10:23.964030 16302 consensus_queue.cc:237] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:23.914791 16222 raft_consensus.cc:2749] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:23.964843 16368 raft_consensus.cc:2804] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:23.968761 14335 raft_consensus.cc:2468] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 5.
I20260709 12:10:23.930878 16226 raft_consensus.cc:2749] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:23.971808 14338 raft_consensus.cc:2468] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 4.
I20260709 12:10:23.974290 14333 raft_consensus.cc:2468] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 6.
W20260709 12:10:23.968377 16288 consensus_meta.cc:287] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.699s	user 0.002s	sys 0.011s
I20260709 12:10:23.987110 16365 consensus_queue.cc:1048] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.095s
I20260709 12:10:23.959422 16337 consensus_queue.cc:237] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:10:23.990463 16333 log.cc:927] Time spent T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.750s	user 0.002s	sys 0.012s
I20260709 12:10:23.990511 14185 raft_consensus.cc:1275] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:23.951215 16342 raft_consensus.cc:2749] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:23.982888 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:23.994576 14230 leader_election.cc:304] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:10:23.958777 15827 raft_consensus.cc:515] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:23.998528 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:24.000514 14338 raft_consensus.cc:3060] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:24.004323 14229 leader_election.cc:400] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 election: Vote denied by peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187) with higher term. Message: Invalid argument: T f4739bc22bfe44fcba807da02d9351b6 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 5. Current term is 6.
I20260709 12:10:24.011831 14184 raft_consensus.cc:1275] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 12:10:24.012701 14184 pending_rounds.cc:85] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf: Aborting all ops after (but not including) 2
I20260709 12:10:24.013036 14184 pending_rounds.cc:107] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:10:23.985378 16368 raft_consensus.cc:697] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 5 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:24.015688 14184 raft_consensus.cc:2889] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:24.016361 16368 consensus_queue.cc:237] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:24.024869 16349 raft_consensus.cc:2804] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:24.027205 15827 leader_election.cc:290] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:24.028126 16259 leader_election.cc:290] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:10:24.029697 15937 consensus_meta.cc:287] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db: Time spent flushing consensus metadata: real 0.608s	user 0.008s	sys 0.005s
W20260709 12:10:24.041311 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 123897us
I20260709 12:10:24.049485 14338 raft_consensus.cc:2468] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 8.
I20260709 12:10:24.054721 14338 raft_consensus.cc:1240] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:24.058370 16359 leader_election.cc:290] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:23.997905 16288 raft_consensus.cc:515] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:24.047592 16335 consensus_queue.cc:1059] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 12:10:24.064626 16288 leader_election.cc:290] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 4 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:24.004396 16279 consensus_queue.cc:1059] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.063s
I20260709 12:10:24.067610 16279 consensus_queue.cc:1243] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer 885067a0d31741bfb5c9935788e315bf log is divergent from this leader: its last log entry 5.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:10:24.050179 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:24.075299 14903 raft_consensus.cc:2468] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 3.
I20260709 12:10:24.077117 14154 leader_election.cc:304] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:24.078047 16226 raft_consensus.cc:2804] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:24.049978 16371 raft_consensus.cc:2749] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:24.080298 14155 leader_election.cc:304] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
W20260709 12:10:24.083240 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 158567us
W20260709 12:10:24.114439 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 119947us
I20260709 12:10:24.116027 14230 leader_election.cc:304] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:10:24.119483 14155 leader_election.cc:400] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 4 election: Vote denied by peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673) with higher term. Message: Invalid argument: T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 4. Current term is 5.
I20260709 12:10:24.120535 14155 leader_election.cc:304] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:24.123737 14155 leader_election.cc:304] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:24.128823 14262 raft_consensus.cc:1275] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:24.048909 16222 raft_consensus.cc:493] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:24.078496 16226 raft_consensus.cc:493] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:24.127517 16233 raft_consensus.cc:2749] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:24.156755 14265 raft_consensus.cc:1275] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:10:24.161276 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:24.161936 14265 raft_consensus.cc:2376] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 5. Re-sending same reply.
I20260709 12:10:24.129920 16143 raft_consensus.cc:2749] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:24.131850 16342 raft_consensus.cc:2804] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:24.140558 16226 raft_consensus.cc:3060] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:24.136814 16335 consensus_queue.cc:1243] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer 885067a0d31741bfb5c9935788e315bf log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:10:24.162602 14303 leader_election.cc:304] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:24.173521 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:24.163131 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:24.162845 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:24.184619 14189 raft_consensus.cc:2468] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 4.
I20260709 12:10:24.176687 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:24.178467 14262 raft_consensus.cc:3055] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:24.140092 16349 raft_consensus.cc:697] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 5 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:10:24.185940 14259 raft_consensus.cc:2393] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 6: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
I20260709 12:10:24.185680 14262 raft_consensus.cc:740] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:10:24.187461 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:24.155638 16224 consensus_queue.cc:1048] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 12:10:24.139995 16222 raft_consensus.cc:515] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:24.174979 16295 consensus_queue.cc:1048] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.032s
W20260709 12:10:24.189498 16336 consensus_meta.cc:287] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.881s	user 0.013s	sys 0.003s
I20260709 12:10:24.198693 16383 raft_consensus.cc:3060] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:24.211386 16380 log.cc:927] Time spent T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:10:24.200469 14262 consensus_queue.cc:260] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:24.214591 14262 raft_consensus.cc:3060] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:24.200794 16374 raft_consensus.cc:2749] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:10:24.194298 16373 log.cc:927] Time spent T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.150s	user 0.002s	sys 0.000s
I20260709 12:10:24.197719 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:24.228209 14261 raft_consensus.cc:2468] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 5.
I20260709 12:10:24.210139 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:24.239642 16286 consensus_queue.cc:1048] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:24.240435 16324 consensus_queue.cc:1048] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:24.241760 15937 consensus_queue.cc:1048] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:24.227092 16342 raft_consensus.cc:697] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 6 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:10:24.255733 16342 consensus_queue.cc:237] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:24.207686 16336 raft_consensus.cc:515] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:24.259110 16285 leader_election.cc:290] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:24.262257 16374 raft_consensus.cc:493] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:24.264372 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:10:24.209591 16386 log.cc:927] Time spent T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 12:10:24.263099 16374 raft_consensus.cc:515] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:24.274463 14189 raft_consensus.cc:2468] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 3.
I20260709 12:10:24.204250 14904 raft_consensus.cc:2468] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 6.
I20260709 12:10:24.278827 14188 raft_consensus.cc:1275] T f4739bc22bfe44fcba807da02d9351b6 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260709 12:10:24.285552 14188 pending_rounds.cc:85] T f4739bc22bfe44fcba807da02d9351b6 P 885067a0d31741bfb5c9935788e315bf: Aborting all ops after (but not including) 5
I20260709 12:10:24.285669 14908 raft_consensus.cc:1240] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 5. Current term is 6. Ops: [3.5-5.6]
I20260709 12:10:24.208489 16222 leader_election.cc:290] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:24.270906 14877 leader_election.cc:304] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:10:24.268445 16224 raft_consensus.cc:493] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:24.270620 16336 leader_election.cc:290] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:24.285985 14188 pending_rounds.cc:107] T f4739bc22bfe44fcba807da02d9351b6 P 885067a0d31741bfb5c9935788e315bf: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 3.6
I20260709 12:10:24.295099 16224 raft_consensus.cc:515] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:24.307828 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:24.308723 14333 raft_consensus.cc:2468] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 3.
I20260709 12:10:24.309806 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:24.311329 14333 raft_consensus.cc:2468] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 5.
I20260709 12:10:24.311769 14188 raft_consensus.cc:2917] T f4739bc22bfe44fcba807da02d9351b6 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Aborting config change with OpId 3.6: Aborted: Op aborted by new leader
I20260709 12:10:24.313195 14188 raft_consensus.cc:2889] T f4739bc22bfe44fcba807da02d9351b6 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:24.274720 16374 leader_election.cc:290] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:10:24.274753 14073 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet f4739bc22bfe44fcba807da02d9351b6 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 885067a0d31741bfb5c9935788e315bf is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } } pending_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: false } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
W20260709 12:10:24.322389 14073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 48225.9us
W20260709 12:10:24.313359 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 74212.3us
I20260709 12:10:24.319785 15827 raft_consensus.cc:2804] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:24.325117 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:24.326027 14333 raft_consensus.cc:2468] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 3.
I20260709 12:10:24.327116 14333 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da"
dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
mode: GRACEFUL
new_leader_uuid: "17aab1bbf5014936aa18cc21818b26ec"
 from {username='slave'} at 127.0.0.1:50896
I20260709 12:10:24.327863 14333 raft_consensus.cc:606] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 5 LEADER]: Received request to transfer leadership to TS 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:10:24.324071 14303 leader_election.cc:304] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:10:24.332289 14333 raft_consensus.cc:1240] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 12:10:24.324553 15827 raft_consensus.cc:493] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:24.350188 15827 raft_consensus.cc:3060] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:24.350895 16224 leader_election.cc:290] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:24.361181 14085 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44116 (request call id 155) took 8983 ms. Trace:
I20260709 12:10:24.367054 14333 raft_consensus.cc:1240] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:10:24.295423 16349 consensus_queue.cc:237] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:24.375293 14303 leader_election.cc:304] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:24.377264 14339 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 250) took 1216 ms. Trace:
I20260709 12:10:24.361747 14085 rpcz_store.cc:276] 0709 12:10:15.378155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.379848 (+  1693us) service_pool.cc:224] Handling call
0709 12:10:24.361066 (+8981218us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:22.348875 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:22.487380 (+138505us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:22.487441 (+    61us) write_op.cc:435] Acquired schema lock
0709 12:10:22.487458 (+    17us) tablet.cc:662] Decoding operations
0709 12:10:22.488702 (+  1244us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:22.488807 (+   105us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:22.488839 (+    32us) tablet.cc:685] Acquiring locks for 10 operations
0709 12:10:22.508428 (+ 19589us) tablet.cc:701] Row locks acquired
0709 12:10:22.531974 (+ 23546us) write_op.cc:260] PREPARE: finished
0709 12:10:22.558229 (+ 26255us) write_op.cc:270] Start()
0709 12:10:22.577617 (+ 19388us) write_op.cc:276] Timestamp: P: 1783599022547288 usec, L: 0
0709 12:10:22.579922 (+  2305us) op_driver.cc:348] REPLICATION: starting
0709 12:10:22.661722 (+ 81800us) log.cc:844] Serialized 4014 byte log entry
0709 12:10:23.265446 (+603724us) op_driver.cc:464] REPLICATION: finished
0709 12:10:23.741403 (+475957us) write_op.cc:301] APPLY: starting
0709 12:10:23.741554 (+   151us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:23.742083 (+   529us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:23.742331 (+   248us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:23.943604 (+201273us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:23.943938 (+   334us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=10
0709 12:10:23.943982 (+    44us) write_op.cc:312] APPLY: finished
0709 12:10:23.944384 (+   402us) log.cc:844] Serialized 77 byte log entry
0709 12:10:23.944609 (+   225us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:23.944764 (+   155us) write_op.cc:454] Released schema lock
0709 12:10:23.944835 (+    71us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:23.945320 (+   485us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:23.945364 (+    44us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":43283,"reported_tablets":13,"child_traces":[["op",{"apply.queue_time_us":470968,"apply.run_cpu_time_us":6288,"apply.run_wall_time_us":203910,"num_ops":10,"prepare.queue_time_us":131844,"prepare.run_cpu_time_us":19954,"prepare.run_wall_time_us":467536,"raft.queue_time_us":134567,"raft.run_cpu_time_us":32463,"raft.run_wall_time_us":252004,"replication_time_us":652613,"thread_start_us":450226,"threads_started":4,"wal-append.queue_time_us":210061}]]}
I20260709 12:10:24.385366 14262 raft_consensus.cc:1275] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 2. (term mismatch)
I20260709 12:10:24.386221 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:24.386961 14911 raft_consensus.cc:2468] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 3.
I20260709 12:10:24.385758 14262 pending_rounds.cc:85] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec: Aborting all ops after (but not including) 1
I20260709 12:10:24.376890 16262 raft_consensus.cc:2804] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:24.374328 16285 raft_consensus.cc:493] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:10:24.407038 14333 raft_consensus.cc:1275] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:10:24.389520 16387 log.cc:927] Time spent T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
W20260709 12:10:24.395023 14905 consensus_meta.cc:287] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db: Time spent flushing consensus metadata: real 0.835s	user 0.009s	sys 0.008s
I20260709 12:10:24.333366 16226 raft_consensus.cc:515] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:24.398316 14154 leader_election.cc:304] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:24.375576 16224 raft_consensus.cc:493] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:24.408380 16262 raft_consensus.cc:493] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:24.412546 16224 raft_consensus.cc:515] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:24.415736 16224 leader_election.cc:290] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:24.415462 15827 raft_consensus.cc:515] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:24.386058 14188 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:56648 (request call id 3) took 9165 ms. Trace:
I20260709 12:10:24.406490 14262 pending_rounds.cc:107] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec: Aborting uncommitted NO_OP operation due to leader change: 4.2
I20260709 12:10:24.417510 16224 raft_consensus.cc:493] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:24.416965 16374 raft_consensus.cc:2804] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:24.410220 16285 raft_consensus.cc:515] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:24.422519 16374 raft_consensus.cc:493] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:24.423091 16374 raft_consensus.cc:3060] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:24.424372 15738 raft_consensus.cc:3055] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:24.424938 15738 raft_consensus.cc:740] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:24.426357 15738 consensus_queue.cc:260] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:24.428310 14262 raft_consensus.cc:2889] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:24.425282 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:10:24.408392 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 137577us
I20260709 12:10:24.430670 16262 raft_consensus.cc:3060] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:24.435793 16224 raft_consensus.cc:515] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:10:24.438195 16076 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
I20260709 12:10:24.416885 14188 rpcz_store.cc:276] 0709 12:10:15.214534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.699628 (+485094us) service_pool.cc:224] Handling call
0709 12:10:16.422856 (+723228us) spinlock_profiling.cc:243] Waited 9.37 ms on lock 0x7b4c004177c0. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2125407a20 00007f2125418a29 00007f21253de644 00007f2125405f2d 00007f2125405b93 00007f21270941af 00007f2127093f3e 00007f2127119888 00007f212713675c 00007f212713776a 00007f212713691b
0709 12:10:16.438075 (+ 15219us) log.cc:844] Serialized 572 byte log entry
0709 12:10:16.738665 (+300590us) spinlock_profiling.cc:243] Waited 8.02 ms on lock 0x7b54000da5a0. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f21270b4142 00007f2127094eaa 00007f212709bd53 00007f212709bcd9 00007f212709bc69 00007f212709bc31 00007f212709adfd 0000000000388634 0000000000388479 00007f212404e475
0709 12:10:16.769872 (+ 31207us) spinlock_profiling.cc:243] Waited 10.8 ms on lock 0x7b54000da5a0. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f21270b4142 00007f2127094eaa 00007f212709bd53 00007f212709bcd9 00007f212709bc69 00007f212709bc31 00007f212709adfd 0000000000388634 0000000000388479 00007f212404e475
0709 12:10:17.208835 (+438963us) spinlock_profiling.cc:243] Waited 1.34 ms on lock 0x7b1800294220. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f212cf16ab1 00007f212cf23281 00007f212401c2a6 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f21270bbb26 00007f21270b549a 00007f21270b4714
0709 12:10:17.209262 (+   427us) spinlock_profiling.cc:243] Waited 4.36 ms on lock 0x7b54000da5a0. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f21270bbb26 00007f21270b549a 00007f21270b4714 00007f2127094eaa 00007f212709bd53 00007f212709bcd9 00007f212709bc69 00007f212709bc31 00007f212709adfd 0000000000388634
0709 12:10:24.352181 (+7142919us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13410,"raft.queue_time_us":35406,"raft.run_cpu_time_us":9170,"raft.run_wall_time_us":1094316,"spinlock_wait_cycles":77904256,"thread_start_us":72673,"threads_started":1,"wal-append.queue_time_us":130783,"wal-append.run_cpu_time_us":37884,"wal-append.run_wall_time_us":4332230}
W20260709 12:10:24.454879 14136 auto_rebalancer.cc:893] Removing replace marker failed: Op aborted by new leader
W20260709 12:10:24.461218 14136 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for f4739bc22bfe44fcba807da02d9351b6 already in progress
W20260709 12:10:24.461680 14136 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for f4739bc22bfe44fcba807da02d9351b6 already in progress
W20260709 12:10:24.462236 16361 log.cc:927] Time spent T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.493s	user 0.000s	sys 0.004s
I20260709 12:10:24.468617 16226 leader_election.cc:290] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 4 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:24.470296 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:10:24.471029 14911 raft_consensus.cc:3060] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:24.411396 14905 raft_consensus.cc:2468] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 5.
I20260709 12:10:24.474320 14905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53200 (request call id 366) took 1062 ms. Trace:
I20260709 12:10:24.475178 16224 leader_election.cc:290] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:24.471096 14338 raft_consensus.cc:1275] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 2. (index mismatch)
I20260709 12:10:24.474984 14905 rpcz_store.cc:276] 0709 12:10:23.411833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:23.416565 (+  4732us) service_pool.cc:224] Handling call
0709 12:10:24.474181 (+1057616us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:24.476300 14302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:24.470199 14336 raft_consensus.cc:1275] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:24.478897 14338 raft_consensus.cc:1275] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:10:24.481518 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 49920.7us
I20260709 12:10:24.490893 14336 raft_consensus.cc:1275] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:10:24.494227 16285 leader_election.cc:290] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:24.494927 14229 leader_election.cc:304] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:24.500582 16392 raft_consensus.cc:493] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:24.501489 16392 raft_consensus.cc:515] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:24.507509 14911 raft_consensus.cc:2468] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 4.
I20260709 12:10:24.509510 14154 leader_election.cc:304] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:24.509258 16076 raft_consensus.cc:2804] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:24.512250 16076 raft_consensus.cc:697] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 5 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:10:24.512928 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:24.513597 16076 consensus_queue.cc:237] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:24.511440 16224 raft_consensus.cc:2804] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:24.515321 16224 raft_consensus.cc:697] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 4 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:10:24.516752 16224 consensus_queue.cc:237] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:24.519845 16145 raft_consensus.cc:493] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:24.519601 16374 raft_consensus.cc:515] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:24.520597 16145 raft_consensus.cc:515] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:24.522375 15827 leader_election.cc:290] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 6 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:24.513674 14334 raft_consensus.cc:2376] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 8. Re-sending same reply.
I20260709 12:10:24.504388 16383 raft_consensus.cc:2749] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:24.527909 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:24.534432 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:24.534791 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:24.532717 16371 raft_consensus.cc:493] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:24.536280 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:24.536084 16371 raft_consensus.cc:515] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:24.536935 14258 raft_consensus.cc:2468] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 3.
I20260709 12:10:24.538157 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:24.538515 14259 raft_consensus.cc:3055] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:24.538915 14259 raft_consensus.cc:740] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:10:24.539717 14259 consensus_queue.cc:260] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:24.540822 14259 raft_consensus.cc:3060] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:24.541285 16392 leader_election.cc:290] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:24.532687 16222 raft_consensus.cc:493] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:24.537364 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:24.537011 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:24.543988 14338 raft_consensus.cc:2468] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 4.
I20260709 12:10:24.535614 14263 raft_consensus.cc:2468] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 4.
I20260709 12:10:24.542924 14336 raft_consensus.cc:2468] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 3.
I20260709 12:10:24.548574 14334 raft_consensus.cc:1275] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:10:24.546959 16233 consensus_queue.cc:1048] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 12:10:24.535212 16226 consensus_queue.cc:1048] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 12:10:24.542403 16222 raft_consensus.cc:515] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:24.553334 16145 leader_election.cc:290] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:24.556020 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:24.556768 14911 raft_consensus.cc:2468] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 4.
I20260709 12:10:24.558887 14154 leader_election.cc:304] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
W20260709 12:10:24.573834 14230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:24.558589 16222 leader_election.cc:290] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:24.523695 16399 consensus_queue.cc:1048] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.087s
I20260709 12:10:24.599030 14261 raft_consensus.cc:1275] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:10:24.597158 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:24.608564 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:24.609761 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:24.610291 14338 raft_consensus.cc:3060] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:24.611104 14259 raft_consensus.cc:1275] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:24.612782 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:24.598537 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:10:24.616050 14877 leader_election.cc:304] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:10:24.616186 14911 raft_consensus.cc:3060] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:24.622614 16279 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 12:10:24.628782 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:24.629587 14335 raft_consensus.cc:2468] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 5.
I20260709 12:10:24.630106 14911 raft_consensus.cc:2468] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 4.
I20260709 12:10:24.632467 14338 raft_consensus.cc:2468] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 4.
I20260709 12:10:24.564163 16145 raft_consensus.cc:2804] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:24.631340 14154 leader_election.cc:304] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:24.565145 16374 leader_election.cc:290] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 4 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:24.639891 16226 raft_consensus.cc:493] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:24.643400 16226 raft_consensus.cc:515] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:24.630559 16339 raft_consensus.cc:2764] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:10:24.638409 16222 raft_consensus.cc:2804] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:24.647313 16222 raft_consensus.cc:697] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 4 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:10:24.648311 16222 consensus_queue.cc:237] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:24.650329 16371 leader_election.cc:290] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:24.635036 16145 raft_consensus.cc:493] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:24.654832 16145 raft_consensus.cc:3060] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:24.381775 14339 rpcz_store.cc:276] 0709 12:10:23.144968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:23.145123 (+   155us) service_pool.cc:224] Handling call
0709 12:10:24.262477 (+1117354us) spinlock_profiling.cc:243] Waited 3.25 ms on lock 0x7b5800065d98. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2124016b71 00007f2124016a22 00007f212cf2f8d9 00007f212c089ee0 00007f212c1530ab 00007f212c153131 00007f212c114fc0 00007f212c0ff929 00007f212c0ff3d2 00007f2125676bd4
0709 12:10:24.262728 (+   251us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:24.262967 (+   239us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:10:24.263269 (+   302us) log.cc:844] Serialized 14 byte log entry
0709 12:10:24.360858 (+ 97589us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:24.360910 (+    52us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:24.360953 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:24.361027 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:24.361174 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":42109,"prepare.queue_time_us":308,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":35,"raft.queue_time_us":29328,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":1531,"spinlock_wait_cycles":7465216,"thread_start_us":67728,"threads_started":1}
I20260709 12:10:24.669138 16262 raft_consensus.cc:515] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:10:24.672994 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:24.683678 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:24.684564 14182 raft_consensus.cc:3060] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:24.686661 14184 raft_consensus.cc:1275] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:24.679435 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:24.698325 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:24.698675 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:24.697022 14185 raft_consensus.cc:3060] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:24.699014 14261 raft_consensus.cc:3060] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:24.696432 14182 raft_consensus.cc:2468] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 8.
I20260709 12:10:24.677115 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:24.703716 14189 raft_consensus.cc:2393] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 3: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:10:24.704886 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:24.705138 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:24.705776 14190 raft_consensus.cc:2468] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 5.
I20260709 12:10:24.706543 14182 raft_consensus.cc:1275] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:10:24.707139 14186 raft_consensus.cc:1240] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 2 LEADER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:24.707068 14181 raft_consensus.cc:1275] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:24.710137 14155 leader_election.cc:304] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:24.711598 14261 raft_consensus.cc:2468] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 6.
I20260709 12:10:24.669411 16298 leader_election.cc:290] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:24.714445 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:24.786667 16226 leader_election.cc:290] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:24.788798 14189 raft_consensus.cc:1275] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:10:24.798030 16292 leader_election.cc:290] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:24.803284 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:24.804040 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:24.802688 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:24.820669 14338 raft_consensus.cc:2468] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 3.
I20260709 12:10:24.821030 14337 raft_consensus.cc:2468] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 4.
I20260709 12:10:24.820688 14335 raft_consensus.cc:3060] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:24.822373 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:24.809593 14184 raft_consensus.cc:1275] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:10:24.677152 14905 raft_consensus.cc:1240] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 4. Current term is 6. Ops: []
I20260709 12:10:24.714656 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
W20260709 12:10:24.816325 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 106295us
I20260709 12:10:24.828836 14183 raft_consensus.cc:2393] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 5: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
W20260709 12:10:24.810554 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 103204us
I20260709 12:10:24.828856 14229 leader_election.cc:304] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:24.832369 14229 leader_election.cc:304] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:24.809726 14185 raft_consensus.cc:2468] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 5.
I20260709 12:10:24.696844 16399 raft_consensus.cc:493] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:24.829200 14155 leader_election.cc:304] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:24.816932 16374 raft_consensus.cc:2749] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:24.834076 16298 consensus_queue.cc:1048] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 12:10:24.772979 16326 raft_consensus.cc:493] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:24.843668 14335 raft_consensus.cc:2468] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 4.
I20260709 12:10:24.697602 16355 consensus_queue.cc:1048] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.147s
I20260709 12:10:24.847019 16145 raft_consensus.cc:515] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:24.708813 16349 raft_consensus.cc:493] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:24.850184 16349 raft_consensus.cc:515] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:24.714191 16302 raft_consensus.cc:493] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:24.783818 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:24.856958 14155 leader_election.cc:304] T f4739bc22bfe44fcba807da02d9351b6 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:24.748248 14903 raft_consensus.cc:2468] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 5.
I20260709 12:10:24.855399 16279 raft_consensus.cc:2804] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:24.865510 14331 raft_consensus.cc:2393] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 4: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:10:24.853613 16349 leader_election.cc:290] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:24.869761 16226 consensus_queue.cc:1048] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:24.869999 14155 leader_election.cc:304] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:24.872936 14155 leader_election.cc:304] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:24.858970 16222 raft_consensus.cc:2749] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:24.877447 14230 leader_election.cc:304] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:24.875834 14155 leader_election.cc:304] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:24.864388 16385 raft_consensus.cc:2804] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:24.865103 16355 raft_consensus.cc:493] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:24.864233 16374 raft_consensus.cc:2749] T f4739bc22bfe44fcba807da02d9351b6 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:24.903789 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:24.881603 16224 raft_consensus.cc:2804] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:24.886993 16279 raft_consensus.cc:697] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 8 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
W20260709 12:10:24.922495 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 532874us
I20260709 12:10:24.923568 14303 leader_election.cc:304] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
W20260709 12:10:24.927657 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 94591.1us
I20260709 12:10:24.899806 16392 raft_consensus.cc:2804] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:24.902678 14331 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50856 (request call id 1592) took 1113 ms. Trace:
I20260709 12:10:24.900949 16385 raft_consensus.cc:493] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:24.903777 16143 consensus_queue.cc:1048] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 12:10:24.865705 16302 raft_consensus.cc:515] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:24.853901 16399 raft_consensus.cc:515] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:24.899479 16233 consensus_queue.cc:1048] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 12:10:24.915966 16224 raft_consensus.cc:493] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:24.917018 16355 raft_consensus.cc:515] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:24.841346 16326 raft_consensus.cc:515] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:24.927867 16374 raft_consensus.cc:493] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:24.945691 16324 raft_consensus.cc:493] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:24.966035 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:10:24.941345 14302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:24.952912 14338 raft_consensus.cc:1275] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
W20260709 12:10:24.976037 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 52591.1us
I20260709 12:10:24.971240 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:24.980327 14262 raft_consensus.cc:1240] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:24.925812 16365 raft_consensus.cc:2764] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:10:24.889942 16349 consensus_queue.cc:1059] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.047s
I20260709 12:10:24.986289 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:24.933308 16392 raft_consensus.cc:493] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:24.999949 14263 raft_consensus.cc:1275] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:25.000741 14877 leader_election.cc:304] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:10:25.004951 14912 raft_consensus.cc:1275] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:24.975160 16224 raft_consensus.cc:3060] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:24.963053 14257 raft_consensus.cc:1275] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:24.958163 16342 raft_consensus.cc:2749] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:24.941623 16145 leader_election.cc:290] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:24.946336 16295 raft_consensus.cc:493] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:24.937978 16222 raft_consensus.cc:493] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:24.929903 16368 consensus_queue.cc:1059] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.071s
I20260709 12:10:25.015344 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:24.965238 16374 raft_consensus.cc:515] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:25.047435 16374 leader_election.cc:290] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:24.984599 16364 raft_consensus.cc:493] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:24.983902 16112 raft_consensus.cc:2749] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:25.006069 16392 raft_consensus.cc:3060] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:24.939576 16385 raft_consensus.cc:3060] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:25.060552 16408 log.cc:927] Time spent T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
I20260709 12:10:24.932494 14331 rpcz_store.cc:276] 0709 12:10:23.772763 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:23.777722 (+  4959us) service_pool.cc:224] Handling call
0709 12:10:24.783620 (+1005898us) spinlock_profiling.cc:243] Waited 14.8 ms on lock 0x7b5800065d98. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2124016b71 00007f2124016a22 00007f212cf2f8d9 00007f212c089ee0 00007f212c1530ab 00007f212c153131 00007f212c1010a0 00007f212c100984 00007f212567b6d4 00007f212567b662
0709 12:10:24.886217 (+102597us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":34124544}
I20260709 12:10:25.041045 16222 raft_consensus.cc:515] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:25.042390 16295 raft_consensus.cc:515] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:25.026059 16375 raft_consensus.cc:2804] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:25.055965 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:25.055820 14155 leader_election.cc:304] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:10:25.051644 16364 raft_consensus.cc:515] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:24.999598 16265 consensus_queue.cc:1048] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.045s
I20260709 12:10:25.038895 16262 leader_election.cc:290] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:25.079746 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:25.080531 14336 raft_consensus.cc:3060] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:24.984808 16324 raft_consensus.cc:515] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:10:25.063866 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 186504us
I20260709 12:10:25.058139 14332 raft_consensus.cc:2468] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 3.
I20260709 12:10:25.067782 14261 raft_consensus.cc:1275] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:10:25.011261 16285 consensus_queue.cc:1059] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.050s
I20260709 12:10:24.943028 16279 consensus_queue.cc:237] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:25.087334 14335 raft_consensus.cc:1275] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:10:25.086196 14332 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50856 (request call id 1594) took 1312 ms. Trace:
I20260709 12:10:25.061208 16383 raft_consensus.cc:493] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:25.090487 14332 rpcz_store.cc:276] 0709 12:10:23.773333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:23.781569 (+  8236us) service_pool.cc:224] Handling call
0709 12:10:24.903589 (+1122020us) spinlock_profiling.cc:243] Waited 5.21 ms on lock 0x7b5800065d98. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2124016b71 00007f2124016a22 00007f212cf2f8d9 00007f212c089ee0 00007f212c1530ab 00007f212c153131 00007f212c1010a0 00007f212c100984 00007f212567b6d4 00007f212567b662
0709 12:10:25.086129 (+182540us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11987712}
I20260709 12:10:25.085641 14155 leader_election.cc:304] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:10:25.113862 14303 leader_election.cc:304] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:10:25.115325 14230 leader_election.cc:304] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:25.152742 14303 leader_election.cc:304] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
W20260709 12:10:25.156822 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 71284.6us
I20260709 12:10:25.082697 16375 raft_consensus.cc:697] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 6 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:10:25.159202 14155 leader_election.cc:304] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:25.100939 16145 raft_consensus.cc:2804] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:25.102900 16226 raft_consensus.cc:2749] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:25.166885 16358 raft_consensus.cc:2749] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:25.168913 14331 raft_consensus.cc:1275] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:25.170917 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:25.110723 16383 raft_consensus.cc:515] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:25.175266 16383 leader_election.cc:290] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:25.100199 16374 consensus_queue.cc:1048] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.076s
I20260709 12:10:25.110265 16143 raft_consensus.cc:493] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:25.178428 14185 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6"
dest_uuid: "885067a0d31741bfb5c9935788e315bf"
mode: GRACEFUL
new_leader_uuid: "17aab1bbf5014936aa18cc21818b26ec"
 from {username='slave'} at 127.0.0.1:52548
I20260709 12:10:25.179101 14185 raft_consensus.cc:606] T f4739bc22bfe44fcba807da02d9351b6 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Received request to transfer leadership to TS 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:10:25.179457 14185 raft_consensus.cc:614] T f4739bc22bfe44fcba807da02d9351b6 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:25.181778 12986 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:10:25.164208 16285 raft_consensus.cc:2804] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:25.178161 16143 raft_consensus.cc:515] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:25.155895 16368 consensus_queue.cc:1048] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 12:10:25.187783 16324 leader_election.cc:290] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:25.113044 16349 raft_consensus.cc:493] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:25.187887 16143 leader_election.cc:290] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:25.175326 14190 raft_consensus.cc:1275] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:25.189337 16349 raft_consensus.cc:515] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:25.190394 16302 leader_election.cc:290] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:10:25.160655 16408 log.cc:927] Time spent T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 12:10:25.192426 12986 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:10:25.191349 16143 raft_consensus.cc:493] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:25.195094 16143 raft_consensus.cc:515] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:25.196096 16374 raft_consensus.cc:493] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:25.198475 16374 raft_consensus.cc:515] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:25.194458 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:25.201906 16222 leader_election.cc:290] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:25.200778 16143 leader_election.cc:290] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:25.207051 16399 leader_election.cc:290] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:25.208344 16326 leader_election.cc:290] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:25.210762 16364 leader_election.cc:290] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:25.211956 16413 raft_consensus.cc:2804] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:25.212626 16413 raft_consensus.cc:493] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:25.213126 16413 raft_consensus.cc:3060] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:25.155035 16112 consensus_queue.cc:1048] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 12:10:25.184814 16285 raft_consensus.cc:493] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:25.209944 16375 consensus_queue.cc:237] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:25.193401 16414 raft_consensus.cc:2749] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:25.248586 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:25.251394 14186 raft_consensus.cc:1240] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 2. Current term is 3. Ops: []
W20260709 12:10:25.253791 14302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:25.277047 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 345774us
W20260709 12:10:25.279788 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 129022us
I20260709 12:10:25.184121 16295 leader_election.cc:290] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:25.164229 16145 raft_consensus.cc:493] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:25.285106 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:25.292598 14181 raft_consensus.cc:3060] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:25.227829 16285 raft_consensus.cc:3060] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:25.192852 16349 leader_election.cc:290] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:25.231060 16331 raft_consensus.cc:2749] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:25.207136 16412 consensus_queue.cc:1048] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.075s
I20260709 12:10:25.309247 14908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:10:25.275044 16324 raft_consensus.cc:493] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:10:25.327085 16324 raft_consensus.cc:515] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } }
I20260709 12:10:25.330447 16416 consensus_queue.cc:1048] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:25.331614 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:10:25.332535 14905 raft_consensus.cc:3060] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:25.336503 16412 consensus_queue.cc:1243] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer 65c9c1653b3346b39a0e118540e6080c log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:10:25.337189 16349 raft_consensus.cc:3055] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:25.326115 16354 consensus_queue.cc:1048] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:25.303709 16145 raft_consensus.cc:3060] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:25.303249 16265 raft_consensus.cc:493] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:25.352564 14336 raft_consensus.cc:2468] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 6.
I20260709 12:10:25.304423 16295 raft_consensus.cc:493] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:25.353978 16295 raft_consensus.cc:515] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:25.342480 16324 leader_election.cc:290] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:25.357542 16295 leader_election.cc:290] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:25.342898 14334 raft_consensus.cc:1240] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:25.345389 16349 raft_consensus.cc:740] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:10:25.361234 16349 consensus_queue.cc:260] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:25.367650 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:25.369163 14333 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50856 (request call id 1606) took 1417 ms. Trace:
I20260709 12:10:25.369439 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:25.370044 14336 raft_consensus.cc:3060] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:25.358022 16265 raft_consensus.cc:515] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:25.386655 16224 raft_consensus.cc:515] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:25.388381 14190 raft_consensus.cc:1240] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:10:25.390875 16265 leader_election.cc:290] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:25.402848 14336 raft_consensus.cc:2468] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 5.
I20260709 12:10:25.344704 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:25.322372 14908 raft_consensus.cc:2368] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for earlier term 3. Current term is 4.
I20260709 12:10:25.343942 16428 consensus_queue.cc:1048] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:25.330735 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:25.290488 16415 consensus_queue.cc:1048] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.058s
I20260709 12:10:25.342203 14339 raft_consensus.cc:1275] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:10:25.369598 14333 rpcz_store.cc:276] 0709 12:10:23.951574 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:24.383605 (+432031us) service_pool.cc:224] Handling call
0709 12:10:24.383911 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:24.407515 (+ 23604us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:25.368933 (+961418us) spinlock_profiling.cc:243] Waited 22.7 ms on lock 0x7b540010d6d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:10:25.369103 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":52224384}
I20260709 12:10:25.344390 14229 leader_election.cc:304] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:25.406129 16349 raft_consensus.cc:3060] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:25.409814 14088 catalog_manager.cc:5697] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf reported cstate change: term changed from 3 to 4, leader changed from 885067a0d31741bfb5c9935788e315bf (127.12.174.129) to 65c9c1653b3346b39a0e118540e6080c (127.12.174.131). New cstate: current_term: 4 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } }
I20260709 12:10:25.393571 16392 raft_consensus.cc:515] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:10:25.433386 14230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:25.457399 14088 catalog_manager.cc:5697] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf reported cstate change: term changed from 3 to 4, leader changed from 885067a0d31741bfb5c9935788e315bf (127.12.174.129) to 65c9c1653b3346b39a0e118540e6080c (127.12.174.131). New cstate: current_term: 4 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } }
I20260709 12:10:25.468078 16296 raft_consensus.cc:493] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:25.474743 14088 catalog_manager.cc:5697] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf reported cstate change: term changed from 1 to 3, leader changed from 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130) to 65c9c1653b3346b39a0e118540e6080c (127.12.174.131). New cstate: current_term: 3 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } }
I20260709 12:10:25.486529 16164 raft_consensus.cc:493] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:25.472503 16412 raft_consensus.cc:493] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:25.487368 16164 raft_consensus.cc:515] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:25.439945 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:25.439884 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:25.404744 16385 raft_consensus.cc:515] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:25.486109 16416 raft_consensus.cc:493] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:25.500510 14230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:25.507932 14088 catalog_manager.cc:5697] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "885067a0d31741bfb5c9935788e315bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:25.509481 14183 raft_consensus.cc:1240] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:10:25.468421 16354 raft_consensus.cc:2749] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:25.443364 14181 raft_consensus.cc:2468] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 5.
I20260709 12:10:25.373358 16413 raft_consensus.cc:515] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:25.487793 16412 raft_consensus.cc:515] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:25.514990 14088 catalog_manager.cc:5697] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf reported cstate change: term changed from 4 to 6, leader changed from 65c9c1653b3346b39a0e118540e6080c (127.12.174.131) to 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130). New cstate: current_term: 6 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } }
I20260709 12:10:25.533644 14088 catalog_manager.cc:5697] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf reported cstate change: term changed from 4 to 6, leader changed from 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130) to 65c9c1653b3346b39a0e118540e6080c (127.12.174.131). New cstate: current_term: 6 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } }
W20260709 12:10:25.537707 14302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:25.553570 14088 catalog_manager.cc:5697] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "885067a0d31741bfb5c9935788e315bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:25.508378 16296 raft_consensus.cc:515] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:25.603353 14088 catalog_manager.cc:5697] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf reported cstate change: term changed from 1 to 2, leader changed from 885067a0d31741bfb5c9935788e315bf (127.12.174.129) to 65c9c1653b3346b39a0e118540e6080c (127.12.174.131). New cstate: current_term: 2 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } }
I20260709 12:10:25.931898 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:25.551057 16428 raft_consensus.cc:493] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:25.586884 16429 raft_consensus.cc:493] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:25.766228 16414 raft_consensus.cc:493] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:25.933786 14905 consensus_meta.cc:287] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db: Time spent flushing consensus metadata: real 0.545s	user 0.010s	sys 0.001s
W20260709 12:10:26.002337 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 843261us
I20260709 12:10:25.471091 16425 consensus_queue.cc:1048] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.464s
I20260709 12:10:26.002856 14335 raft_consensus.cc:1275] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 12:10:26.002936 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 658593us
I20260709 12:10:26.007200 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:10:26.008980 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 519483us
I20260709 12:10:25.877431 16285 raft_consensus.cc:515] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:25.521219 16416 raft_consensus.cc:515] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:25.955319 14905 raft_consensus.cc:2468] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 5.
I20260709 12:10:26.008494 15738 raft_consensus.cc:3060] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:26.045598 16164 leader_election.cc:290] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:26.045886 16224 leader_election.cc:290] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 4 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:25.948298 16428 raft_consensus.cc:515] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:26.049940 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:10:26.108585 14337 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.593s	user 0.039s	sys 0.081s
W20260709 12:10:26.119485 14337 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.604s	user 0.042s	sys 0.088s
I20260709 12:10:25.950371 16429 raft_consensus.cc:515] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:25.958611 16414 raft_consensus.cc:515] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:10:26.122630 14302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:26.123594 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:26.160149 14259 raft_consensus.cc:2468] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 5.
I20260709 12:10:26.069674 16296 leader_election.cc:290] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:10:26.152415 16145 consensus_meta.cc:287] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.797s	user 0.009s	sys 0.004s
I20260709 12:10:26.153802 16412 leader_election.cc:290] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:26.126008 14257 raft_consensus.cc:2468] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 4.
I20260709 12:10:26.154696 16413 leader_election.cc:290] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 6 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:26.156311 16285 leader_election.cc:290] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:10:26.213851 14230 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.593s	user 0.017s	sys 0.030s
W20260709 12:10:26.214607 14230 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.594s	user 0.017s	sys 0.030s
I20260709 12:10:26.120561 16224 raft_consensus.cc:493] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
W20260709 12:10:26.216400 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 195123us
W20260709 12:10:26.215003 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 594858us
I20260709 12:10:26.163034 16262 raft_consensus.cc:493] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:26.182593 16392 leader_election.cc:290] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:26.214854 16413 raft_consensus.cc:493] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:26.255580 16435 log.cc:927] Time spent T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 12:10:26.236829 16385 leader_election.cc:290] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:26.273658 16364 consensus_queue.cc:1048] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:26.264564 16279 raft_consensus.cc:493] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:26.278373 16279 raft_consensus.cc:515] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:10:26.265280 14229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:26.282505 14331 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 263) took 1273 ms. Trace:
I20260709 12:10:26.283025 14331 rpcz_store.cc:276] 0709 12:10:25.009272 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:25.170283 (+161011us) service_pool.cc:224] Handling call
0709 12:10:25.170633 (+   350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:25.173671 (+  3038us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:25.173716 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:25.173792 (+    76us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:25.173826 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:26.282207 (+1108381us) spinlock_profiling.cc:243] Waited 2.6 ms on lock 0x7b540023c154. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:10:26.282263 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:26.282430 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5985536}
I20260709 12:10:26.262367 16413 raft_consensus.cc:515] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:10:26.266637 16407 log.cc:927] Time spent T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 1.361s	user 0.018s	sys 0.025s
I20260709 12:10:26.266496 16412 raft_consensus.cc:493] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:26.266999 16424 raft_consensus.cc:493] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:26.267925 16354 raft_consensus.cc:493] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:10:26.257769 16262 raft_consensus.cc:515] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:26.186815 16145 raft_consensus.cc:515] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:26.237680 16285 raft_consensus.cc:493] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
W20260709 12:10:26.295202 14876 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.009s	sys 0.009s
I20260709 12:10:26.083246 16358 consensus_queue.cc:1048] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.164s
I20260709 12:10:26.281548 16279 leader_election.cc:290] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:10:26.316812 14876 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.550s	user 0.013s	sys 0.012s
W20260709 12:10:26.331226 14878 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.000s	sys 0.025s
W20260709 12:10:26.331853 14878 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.565s	user 0.000s	sys 0.025s
I20260709 12:10:26.332755 16326 raft_consensus.cc:493] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:26.347334 16414 leader_election.cc:290] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:26.347651 16326 raft_consensus.cc:515] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:26.349321 16414 raft_consensus.cc:493] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:10:26.334151 16428 leader_election.cc:290] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:26.351271 16262 leader_election.cc:290] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:26.253021 16224 raft_consensus.cc:515] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:26.299015 16345 raft_consensus.cc:493] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
W20260709 12:10:26.356701 14153 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.563s	user 0.002s	sys 0.022s
I20260709 12:10:26.318608 16392 raft_consensus.cc:493] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:10:26.371383 16392 raft_consensus.cc:515] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:26.357894 16414 raft_consensus.cc:515] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:26.352032 16279 raft_consensus.cc:493] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:26.359750 16262 raft_consensus.cc:993] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c: : Instructing follower 17aab1bbf5014936aa18cc21818b26ec to start an election
I20260709 12:10:26.302841 16424 raft_consensus.cc:515] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:26.357578 16428 raft_consensus.cc:493] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:26.393021 14258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41764 (request call id 2029) took 1400 ms. Trace:
I20260709 12:10:26.398897 14190 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 1995) took 1148 ms. Trace:
I20260709 12:10:26.332918 16285 raft_consensus.cc:515] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:26.399535 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:26.397265 14258 rpcz_store.cc:276] 0709 12:10:24.992521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:24.992771 (+   250us) service_pool.cc:224] Handling call
0709 12:10:26.392178 (+1399407us) spinlock_profiling.cc:243] Waited 2.33 ms on lock 0x7b5800060c98. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2124016b71 00007f2124016a22 00007f212cf2f8d9 00007f212c089ee0 00007f212c1530ab 00007f212c153131 00007f212c114fc0 00007f212c0ff929 00007f212c0ff3d2 00007f2125676bd4
0709 12:10:26.392433 (+   255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:26.392645 (+   212us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:26.392668 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:26.392712 (+    44us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:26.392743 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:26.392809 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:26.392951 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5369216}
I20260709 12:10:26.403867 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:26.393157 16326 leader_election.cc:290] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:26.399379 14190 rpcz_store.cc:276] 0709 12:10:25.246329 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:25.248162 (+  1833us) service_pool.cc:224] Handling call
0709 12:10:25.284603 (+ 36441us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:25.388831 (+104228us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:26.394089 (+1005258us) spinlock_profiling.cc:243] Waited 103 ms on lock 0x7b54004623d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:10:26.394335 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":237987584}
W20260709 12:10:26.406301 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 649996us
I20260709 12:10:26.407302 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:26.317173 16354 raft_consensus.cc:515] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:10:26.412209 14230 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.174.131:45957 timed out after 2.292s (SENT) [suppressed 13 similar messages]
W20260709 12:10:26.413188 14230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:26.413784 14230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:26.380256 16279 raft_consensus.cc:515] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:26.392581 16416 leader_election.cc:290] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:26.300843 16412 raft_consensus.cc:515] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:26.400748 16262 raft_consensus.cc:493] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:26.359869 16345 raft_consensus.cc:515] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:26.437752 14339 raft_consensus.cc:1275] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:26.385663 16385 consensus_queue.cc:1048] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 12:10:26.427371 14337 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 267) took 1346 ms. Trace:
W20260709 12:10:26.497628 14302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:26.589004 14337 rpcz_store.cc:276] 0709 12:10:25.080891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:25.200280 (+119389us) service_pool.cc:224] Handling call
0709 12:10:25.200556 (+   276us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:25.201011 (+   455us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:10:25.444335 (+243324us) log.cc:844] Serialized 14 byte log entry
0709 12:10:26.363796 (+919461us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:26.369359 (+  5563us) log.cc:844] Serialized 26 byte log entry
0709 12:10:26.384509 (+ 15150us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:26.384558 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:26.384654 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:26.427094 (+ 42440us) raft_consensus.cc:1685] finished
0709 12:10:26.427118 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:26.427290 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43258,"prepare.queue_time_us":138906,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":162141,"raft.run_cpu_time_us":217,"raft.run_wall_time_us":217,"thread_start_us":1047781,"threads_started":3,"wal-append.queue_time_us":765465}
I20260709 12:10:26.599186 14334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50856 (request call id 1611) took 1653 ms. Trace:
I20260709 12:10:26.408952 16428 raft_consensus.cc:515] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:10:26.421798 16434 log.cc:927] Time spent T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
W20260709 12:10:26.422259 16432 log.cc:927] Time spent T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.169s	user 0.000s	sys 0.000s
I20260709 12:10:26.624416 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:26.423661 16354 leader_election.cc:290] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:26.419870 16439 raft_consensus.cc:493] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
W20260709 12:10:26.663514 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 378830us
I20260709 12:10:26.590996 16416 raft_consensus.cc:493] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:26.670948 14334 rpcz_store.cc:276] 0709 12:10:24.945626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:24.948117 (+  2491us) service_pool.cc:224] Handling call
0709 12:10:25.342693 (+394576us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:25.359567 (+ 16874us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:26.598886 (+1239319us) spinlock_profiling.cc:243] Waited 394 ms on lock 0x7b540001ac50. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713a8ad 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:10:26.599099 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":906434944}
I20260709 12:10:26.682224 16354 raft_consensus.cc:493] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:26.629492 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:26.683314 16339 raft_consensus.cc:493] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:26.674950 16392 leader_election.cc:290] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:26.684926 16224 leader_election.cc:290] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:26.625262 16446 raft_consensus.cc:493] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:26.591813 16262 raft_consensus.cc:515] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:10:26.671813 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 425598us
I20260709 12:10:26.752305 14184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 1997) took 1505 ms. Trace:
W20260709 12:10:26.839564 14154 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.656s	user 0.000s	sys 0.010s
W20260709 12:10:26.870260 14154 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.687s	user 0.000s	sys 0.011s
I20260709 12:10:26.632694 16453 raft_consensus.cc:1081] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 5 LEADER]: Signalling peer 17aab1bbf5014936aa18cc21818b26ec to start an election
I20260709 12:10:26.686390 16285 leader_election.cc:290] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:26.631258 16413 leader_election.cc:290] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:26.643196 16429 leader_election.cc:290] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:10:27.027390 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 49484.2us
W20260709 12:10:26.765403 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 319746us
I20260709 12:10:27.046970 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
W20260709 12:10:26.872874 14878 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.000s	sys 0.008s
I20260709 12:10:26.896942 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:26.961131 14908 raft_consensus.cc:1275] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
W20260709 12:10:26.942934 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 62671.4us
I20260709 12:10:27.048794 14303 leader_election.cc:304] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:26.963604 14338 raft_consensus.cc:1240] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:10:26.964730 14333 raft_consensus.cc:1240] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 4. Current term is 5. Ops: [2.2-4.3]
I20260709 12:10:26.966879 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:27.052605 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:26.686498 16414 leader_election.cc:290] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:10:26.736708 16349 consensus_meta.cc:287] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 1.242s	user 0.010s	sys 0.005s
W20260709 12:10:27.048691 14878 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.716s	user 0.000s	sys 0.017s
I20260709 12:10:27.051458 14258 raft_consensus.cc:3060] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:26.692761 16371 raft_consensus.cc:493] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:27.066371 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:27.082633 14256 raft_consensus.cc:2468] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 2.
I20260709 12:10:27.083323 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:27.053624 14333 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50856 (request call id 1624) took 1620 ms. Trace:
I20260709 12:10:27.084685 14333 rpcz_store.cc:276] 0709 12:10:25.433658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:26.964075 (+1530417us) service_pool.cc:224] Handling call
0709 12:10:26.964415 (+   340us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:27.053346 (+ 88931us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:27.053568 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:27.063338 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:27.085944 14911 raft_consensus.cc:2468] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 4.
I20260709 12:10:27.051517 14338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50856 (request call id 1623) took 1618 ms. Trace:
I20260709 12:10:26.694458 16450 raft_consensus.cc:493] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:26.882754 15738 consensus_meta.cc:287] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.791s	user 0.009s	sys 0.004s
I20260709 12:10:27.097703 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:26.694025 16298 raft_consensus.cc:493] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:27.087466 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:26.870756 16412 leader_election.cc:290] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:26.695814 16456 raft_consensus.cc:493] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:26.898559 16345 leader_election.cc:290] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:26.694675 16359 raft_consensus.cc:493] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:10:26.846664 16451 raft_consensus.cc:493] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
W20260709 12:10:26.834929 16441 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.008s	sys 0.002s
I20260709 12:10:27.103549 16465 raft_consensus.cc:2749] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:10:27.103984 16441 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.818s	user 0.018s	sys 0.003s
I20260709 12:10:27.030611 16325 raft_consensus.cc:493] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:10:27.104926 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:10:27.105372 16325 raft_consensus.cc:515] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:27.106333 14907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:27.107318 14907 raft_consensus.cc:2468] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 4.
I20260709 12:10:27.108124 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:27.108773 14187 raft_consensus.cc:2468] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 3.
I20260709 12:10:27.109863 16450 raft_consensus.cc:515] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:27.111223 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:27.112030 14263 raft_consensus.cc:2393] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 4: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:10:27.112805 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:27.114326 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:27.117462 14906 raft_consensus.cc:1275] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:27.118433 14187 raft_consensus.cc:2468] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 5.
I20260709 12:10:27.001964 16460 raft_consensus.cc:493] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
W20260709 12:10:27.094159 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 45428.6us
I20260709 12:10:27.125864 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:27.007803 16224 raft_consensus.cc:493] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:27.095481 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:27.131736 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:26.879849 16416 raft_consensus.cc:515] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:27.092248 14338 rpcz_store.cc:276] 0709 12:10:25.433386 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:26.962921 (+1529535us) service_pool.cc:224] Handling call
0709 12:10:26.963321 (+   400us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:27.051142 (+ 87821us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:27.051455 (+   313us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:26.687021 16374 leader_election.cc:290] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:26.882375 16392 raft_consensus.cc:493] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:10:27.098739 14185 raft_consensus.cc:2468] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 3.
I20260709 12:10:27.013375 16428 leader_election.cc:290] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:26.965020 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:27.100081 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:27.151510 14259 raft_consensus.cc:2468] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 3.
I20260709 12:10:26.956518 16424 leader_election.cc:290] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:26.965818 16233 raft_consensus.cc:493] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:26.998063 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:26.702843 16419 raft_consensus.cc:493] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:27.101475 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:26.867276 14184 rpcz_store.cc:276] 0709 12:10:25.247055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:25.249933 (+  2878us) service_pool.cc:224] Handling call
0709 12:10:25.250354 (+   421us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:25.275057 (+ 24703us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:25.275091 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:25.321719 (+ 46628us) log.cc:844] Serialized 52 byte log entry
0709 12:10:25.540876 (+219157us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:26.358926 (+818050us) log.cc:844] Serialized 14 byte log entry
0709 12:10:26.751859 (+392933us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:26.751958 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:26.752022 (+    64us) raft_consensus.cc:1685] finished
0709 12:10:26.752035 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:26.752222 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24192,"prepare.queue_time_us":1150639,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":59,"raft.queue_time_us":363576,"raft.run_cpu_time_us":467,"raft.run_wall_time_us":27690,"thread_start_us":882430,"threads_started":3,"wal-append.queue_time_us":770949}
I20260709 12:10:27.030524 16464 raft_consensus.cc:493] T f4739bc22bfe44fcba807da02d9351b6 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:27.088064 16458 raft_consensus.cc:493] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:27.088316 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:27.115496 16298 raft_consensus.cc:515] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:27.118971 14336 raft_consensus.cc:2468] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 3.
I20260709 12:10:27.031296 16461 raft_consensus.cc:493] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
W20260709 12:10:26.690580 16448 log.cc:927] Time spent T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.271s	user 0.000s	sys 0.000s
I20260709 12:10:26.880847 16339 raft_consensus.cc:515] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:27.123183 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:27.122100 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:26.880678 16446 raft_consensus.cc:515] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:26.882157 14257 raft_consensus.cc:2468] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 4.
I20260709 12:10:27.117305 16325 leader_election.cc:290] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:27.113423 16450 leader_election.cc:290] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:27.096455 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:27.090790 16326 raft_consensus.cc:493] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:27.138419 14265 raft_consensus.cc:1240] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:27.251421 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:27.143026 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:26.882200 16354 raft_consensus.cc:515] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:27.144407 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:27.053071 16285 consensus_queue.cc:1048] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.077s
I20260709 12:10:27.147114 14187 raft_consensus.cc:1275] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:27.171042 16262 leader_election.cc:290] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:26.882272 16439 raft_consensus.cc:515] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:27.150048 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:27.151757 14304 leader_election.cc:304] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:10:27.103354 16456 raft_consensus.cc:515] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:26.966938 16266 consensus_queue.cc:260] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:27.095112 16371 raft_consensus.cc:515] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:27.161255 16469 raft_consensus.cc:493] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:27.161643 16419 raft_consensus.cc:515] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:27.166040 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:27.180709 16394 raft_consensus.cc:493] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:27.077064 16279 leader_election.cc:290] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:27.144311 15738 raft_consensus.cc:493] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:27.125511 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:27.150695 14907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:27.299326 14337 raft_consensus.cc:2410] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for term 6 because replica has last-logged OpId of term: 5 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:10:27.130694 16359 raft_consensus.cc:515] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:27.191196 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:27.257882 14338 raft_consensus.cc:2393] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 4: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:10:27.264493 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:26.923589 16447 consensus_queue.cc:1048] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.231s
I20260709 12:10:27.142479 16224 raft_consensus.cc:515] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:27.286082 16285 raft_consensus.cc:2804] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:10:27.269376 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 117692us
I20260709 12:10:27.152139 16392 raft_consensus.cc:515] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:27.271219 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
W20260709 12:10:27.273870 16470 log.cc:927] Time spent T 00000000000000000000000000000000 P d07070be2c074f4cb9ad35f1580c4ef7: Append to log took a long time: real 0.073s	user 0.000s	sys 0.003s
I20260709 12:10:27.283700 14229 leader_election.cc:304] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:10:27.130462 16451 raft_consensus.cc:515] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:27.286644 14912 raft_consensus.cc:1275] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:27.288942 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:27.248642 14331 raft_consensus.cc:1275] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:27.314471 16279 raft_consensus.cc:2804] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:27.170248 16233 raft_consensus.cc:515] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:27.246209 16433 raft_consensus.cc:493] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:27.170606 16457 raft_consensus.cc:493] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:27.305332 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 165218us
I20260709 12:10:27.308425 14187 raft_consensus.cc:2393] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 3: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:10:27.308974 16285 raft_consensus.cc:493] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:27.310962 14181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56046 (request call id 1752) took 1215 ms. Trace:
I20260709 12:10:27.147318 16460 raft_consensus.cc:515] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:27.315222 16451 leader_election.cc:290] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:27.315056 16279 raft_consensus.cc:493] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:27.319037 14181 rpcz_store.cc:276] 0709 12:10:26.096104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:26.096244 (+   140us) service_pool.cc:224] Handling call
0709 12:10:26.124375 (+ 28131us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:26.124778 (+   403us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:26.124809 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:26.125447 (+   638us) log.cc:844] Serialized 52 byte log entry
0709 12:10:26.216995 (+ 91548us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:10:26.217045 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:26.217124 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:27.310726 (+1093602us) raft_consensus.cc:1685] finished
0709 12:10:27.310751 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:27.310894 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":161772,"raft.run_cpu_time_us":194,"raft.run_wall_time_us":5993,"thread_start_us":91149,"threads_started":1,"wal-append.queue_time_us":256763}
I20260709 12:10:27.266752 16326 raft_consensus.cc:515] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:27.327208 14303 leader_election.cc:304] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:10:27.182077 16458 raft_consensus.cc:515] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:27.336383 14187 raft_consensus.cc:1275] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:27.317476 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:27.315723 16433 raft_consensus.cc:515] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:27.340549 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:27.341300 16465 raft_consensus.cc:2804] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:27.342164 16446 leader_election.cc:290] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:27.343151 16371 leader_election.cc:290] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:27.344398 16326 leader_election.cc:290] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:27.335112 16451 raft_consensus.cc:493] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:27.253955 16461 raft_consensus.cc:515] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:27.345952 16262 raft_consensus.cc:493] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:27.346549 16359 leader_election.cc:290] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:27.347749 16416 leader_election.cc:290] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:27.347915 16419 leader_election.cc:290] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:27.309537 16455 consensus_queue.cc:1059] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.037s
I20260709 12:10:27.321455 16354 leader_election.cc:290] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:27.319380 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:27.322661 16365 raft_consensus.cc:493] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:27.322505 16285 raft_consensus.cc:3060] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:27.356324 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:27.311358 16394 raft_consensus.cc:515] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:27.302946 16469 raft_consensus.cc:515] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:27.315846 16424 consensus_queue.cc:1048] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 12:10:27.329478 16279 raft_consensus.cc:3060] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:27.305009 15738 raft_consensus.cc:515] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:27.367076 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:27.344893 16339 leader_election.cc:290] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:27.370987 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:27.450465 14188 raft_consensus.cc:3060] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:27.238838 16464 raft_consensus.cc:515] T f4739bc22bfe44fcba807da02d9351b6 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:27.369891 16465 raft_consensus.cc:697] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 5 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:27.388695 14907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:27.390445 16433 leader_election.cc:290] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:27.394320 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:27.400861 16419 raft_consensus.cc:493] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:27.408300 14258 raft_consensus.cc:2468] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 4.
I20260709 12:10:27.416985 16355 leader_election.cc:290] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:27.422467 16456 leader_election.cc:290] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:27.425118 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:27.385180 16262 raft_consensus.cc:515] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:27.479290 16145 leader_election.cc:290] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:27.385401 16298 leader_election.cc:290] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:27.432475 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:27.435735 16439 leader_election.cc:290] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:27.315753 16457 raft_consensus.cc:515] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:10:27.445549 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 48006.1us
I20260709 12:10:27.457932 14910 raft_consensus.cc:3060] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:27.461880 14256 raft_consensus.cc:1240] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:10:27.467206 14229 leader_election.cc:304] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:27.473587 16419 raft_consensus.cc:515] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:27.382454 16451 raft_consensus.cc:515] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:27.511349 16451 leader_election.cc:290] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:27.458992 14187 raft_consensus.cc:2468] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 5.
I20260709 12:10:27.383831 16447 consensus_queue.cc:1059] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.067s
I20260709 12:10:27.481258 16262 leader_election.cc:290] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:27.505332 14260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41768 (request call id 1354) took 1495 ms. Trace:
I20260709 12:10:27.522864 14260 rpcz_store.cc:276] 0709 12:10:26.010053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:26.010207 (+   154us) service_pool.cc:224] Handling call
0709 12:10:27.432274 (+1422067us) spinlock_profiling.cc:243] Waited 1.65 ms on lock 0x7b5800060c98. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2124016b71 00007f2124016a22 00007f212cf2f8d9 00007f212c089ee0 00007f212c1530ab 00007f212c153131 00007f212c1010a0 00007f212c100984 00007f212567b6d4 00007f212567b662
0709 12:10:27.505263 (+ 72989us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3796864}
I20260709 12:10:27.506160 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:27.530537 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:27.475275 16465 consensus_queue.cc:237] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:27.542718 14188 raft_consensus.cc:2468] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 6.
I20260709 12:10:27.569804 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:27.573422 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:27.645918 16460 leader_election.cc:290] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:27.506103 16145 raft_consensus.cc:493] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
W20260709 12:10:27.757499 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 290497us
I20260709 12:10:27.760330 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:27.764055 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 7 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:27.765023 14339 raft_consensus.cc:2410] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:10:27.714361 14876 leader_election.cc:304] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
W20260709 12:10:27.768926 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 67627.6us
I20260709 12:10:27.778884 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:27.779783 14333 raft_consensus.cc:2468] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 2.
I20260709 12:10:27.782035 16262 raft_consensus.cc:3055] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:27.782625 16262 raft_consensus.cc:740] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:27.784003 16262 consensus_queue.cc:260] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:27.781381 16359 raft_consensus.cc:493] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:10:27.786499 16359 raft_consensus.cc:515] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:27.842541 14260 raft_consensus.cc:1275] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:27.845489 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:27.846362 14337 raft_consensus.cc:2468] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 4.
I20260709 12:10:27.848696 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:10:27.875558 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 115914us
I20260709 12:10:27.849478 14190 raft_consensus.cc:2468] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 2.
I20260709 12:10:27.727391 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 7 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:27.442159 16365 raft_consensus.cc:515] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:27.901883 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:27.934975 14190 raft_consensus.cc:2468] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 2.
W20260709 12:10:27.904392 16473 log.cc:927] Time spent T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.334s	user 0.000s	sys 0.009s
I20260709 12:10:27.914081 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:27.790339 16385 raft_consensus.cc:2804] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:27.766076 16419 leader_election.cc:290] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:27.768107 16224 leader_election.cc:290] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:10:27.940958 14302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:27.948071 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:27.949146 14190 raft_consensus.cc:2468] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 4.
I20260709 12:10:27.770994 16145 raft_consensus.cc:515] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:27.966187 14260 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da"
dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
 from {username='slave'} at 127.0.0.1:41764
I20260709 12:10:27.966964 14260 raft_consensus.cc:493] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:27.967336 14260 raft_consensus.cc:3060] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:27.903682 16359 leader_election.cc:290] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:27.862051 16285 raft_consensus.cc:515] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:27.943102 16385 raft_consensus.cc:493] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:28.002039 16456 raft_consensus.cc:493] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:10:27.938012 16424 consensus_queue.cc:1048] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.074s
I20260709 12:10:27.957497 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:27.955593 14331 raft_consensus.cc:2468] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 4.
I20260709 12:10:28.097059 16457 leader_election.cc:290] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:28.019196 16420 raft_consensus.cc:2804] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:10:28.110028 14910 consensus_meta.cc:287] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db: Time spent flushing consensus metadata: real 0.604s	user 0.006s	sys 0.005s
I20260709 12:10:28.111655 14910 raft_consensus.cc:2468] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 6.
I20260709 12:10:28.113727 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:28.121106 16469 leader_election.cc:290] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:28.090001 16385 raft_consensus.cc:3060] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:28.132817 16365 leader_election.cc:290] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:28.099713 16456 raft_consensus.cc:515] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:28.180963 16456 leader_election.cc:290] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:28.140400 16145 leader_election.cc:290] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:28.100679 15738 leader_election.cc:290] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:28.109272 16420 raft_consensus.cc:493] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:28.183480 16420 raft_consensus.cc:3060] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:28.185209 14190 raft_consensus.cc:2468] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 6.
I20260709 12:10:28.186358 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:10:28.189528 14304 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.857s	user 0.014s	sys 0.029s
W20260709 12:10:28.189946 14304 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.858s	user 0.014s	sys 0.029s
I20260709 12:10:28.190765 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:28.191498 14304 leader_election.cc:304] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:10:28.193945 14260 raft_consensus.cc:515] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:28.196345 14260 leader_election.cc:290] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:10:28.193871 14264 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.012s	user 0.010s	sys 0.041s
W20260709 12:10:28.197901 14264 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.016s	user 0.011s	sys 0.041s
W20260709 12:10:28.205255 14185 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.825s	user 0.011s	sys 0.008s
W20260709 12:10:28.205796 14185 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.826s	user 0.011s	sys 0.008s
W20260709 12:10:28.241199 14189 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.090s	user 0.004s	sys 0.010s
W20260709 12:10:28.242023 14189 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.091s	user 0.004s	sys 0.010s
W20260709 12:10:28.242681 14259 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.978s	user 0.012s	sys 0.002s
I20260709 12:10:28.242722 16461 leader_election.cc:290] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:28.235519 16484 raft_consensus.cc:2804] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:28.241637 16475 raft_consensus.cc:493] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:28.240828 15738 raft_consensus.cc:493] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:10:28.241854 16359 raft_consensus.cc:493] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:28.251164 14261 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.958s	user 0.006s	sys 0.007s
W20260709 12:10:28.251585 14261 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.963s	user 0.006s	sys 0.008s
I20260709 12:10:28.252750 14261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41764 (request call id 2033) took 1189 ms. Trace:
W20260709 12:10:28.240729 14303 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.907s	user 0.004s	sys 0.010s
W20260709 12:10:28.257216 14303 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.923s	user 0.004s	sys 0.010s
W20260709 12:10:28.257609 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 923684us
I20260709 12:10:28.246299 16433 raft_consensus.cc:493] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
W20260709 12:10:28.279485 14305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:28.243157 14259 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.978s	user 0.012s	sys 0.002s
I20260709 12:10:28.318009 14259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41764 (request call id 2043) took 1176 ms. Trace:
I20260709 12:10:28.253187 14261 rpcz_store.cc:276] 0709 12:10:27.063022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:27.063457 (+   435us) service_pool.cc:224] Handling call
0709 12:10:27.063793 (+   336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:27.064043 (+   250us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:10:27.288718 (+224675us) log.cc:844] Serialized 14 byte log entry
0709 12:10:28.252332 (+963614us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:28.252409 (+    77us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:28.252467 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:28.252540 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:28.252687 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":257799,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":53,"thread_start_us":1166220,"threads_started":2}
I20260709 12:10:28.247820 16484 raft_consensus.cc:493] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:28.318753 14259 rpcz_store.cc:276] 0709 12:10:27.141310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:27.152353 (+ 11043us) service_pool.cc:224] Handling call
0709 12:10:27.172895 (+ 20542us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:27.173327 (+   432us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:27.173359 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:27.173911 (+   552us) log.cc:844] Serialized 26 byte log entry
0709 12:10:28.317609 (+1143698us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:28.317653 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:28.317728 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:28.317793 (+    65us) raft_consensus.cc:1685] finished
0709 12:10:28.317804 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:28.317942 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":122,"raft.run_cpu_time_us":292,"raft.run_wall_time_us":33338,"thread_start_us":1052807,"threads_started":1,"wal-append.queue_time_us":976149}
W20260709 12:10:28.250805 16215 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.794s	user 0.001s	sys 0.010s
I20260709 12:10:28.335855 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:28.359817 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:28.360690 14190 raft_consensus.cc:2468] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 2.
W20260709 12:10:28.321369 14904 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.152s	user 0.007s	sys 0.015s
I20260709 12:10:28.372949 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:10:28.372447 14875 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.873s	user 0.005s	sys 0.016s
W20260709 12:10:28.374703 14875 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.927s	user 0.005s	sys 0.016s
W20260709 12:10:28.376780 14877 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.929s	user 0.036s	sys 0.048s
W20260709 12:10:28.377278 14877 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.929s	user 0.036s	sys 0.048s
I20260709 12:10:28.377329 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:10:28.377912 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 932530us
I20260709 12:10:28.378993 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:28.379207 14877 leader_election.cc:304] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:10:28.261879 16359 raft_consensus.cc:515] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:28.251693 15738 raft_consensus.cc:515] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:28.380672 14877 leader_election.cc:304] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:28.335639 16484 raft_consensus.cc:3060] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:28.248163 16475 raft_consensus.cc:515] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:28.384223 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:28.320756 16433 raft_consensus.cc:515] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:10:28.383450 14904 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.213s	user 0.008s	sys 0.017s
I20260709 12:10:28.385725 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
W20260709 12:10:28.383787 16470 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.017s	user 0.007s	sys 0.014s
I20260709 12:10:28.399514 14181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56652 (request call id 371) took 1235 ms. Trace:
I20260709 12:10:28.400033 14181 rpcz_store.cc:276] 0709 12:10:27.163936 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:27.331495 (+167559us) service_pool.cc:224] Handling call
0709 12:10:27.341603 (+ 10108us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:27.485378 (+143775us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:10:27.485418 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:27.485466 (+    48us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:27.485499 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:28.399253 (+913754us) spinlock_profiling.cc:243] Waited 143 ms on lock 0x7b540019cdd4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:10:28.399306 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:28.399435 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":329965824}
I20260709 12:10:28.401046 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:28.393834 14190 raft_consensus.cc:2393] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db in current term 6: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:10:28.401836 14909 raft_consensus.cc:2468] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 5.
I20260709 12:10:28.403834 14181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56046 (request call id 1759) took 1114 ms. Trace:
W20260709 12:10:28.342566 16215 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.895s	user 0.002s	sys 0.014s
I20260709 12:10:28.409051 14189 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 2008) took 1321 ms. Trace:
I20260709 12:10:28.411634 14190 raft_consensus.cc:1240] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 4. Current term is 5. Ops: [4.3-4.3]
W20260709 12:10:28.401883 16470 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.042s	user 0.007s	sys 0.015s
I20260709 12:10:28.367105 16285 leader_election.cc:290] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:10:28.384335 16339 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.891s	user 0.010s	sys 0.009s
I20260709 12:10:28.404387 14181 rpcz_store.cc:276] 0709 12:10:27.289575 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:28.401454 (+1111879us) service_pool.cc:224] Handling call
0709 12:10:28.403074 (+  1620us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:28.403365 (+   291us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:28.403394 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:28.403456 (+    62us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:28.403503 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:28.403618 (+   115us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:28.403758 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:28.406486 16487 raft_consensus.cc:493] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:28.408121 16433 leader_election.cc:290] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:28.402855 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:10:28.408700 14154 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.913s	user 0.018s	sys 0.051s
W20260709 12:10:28.444584 14154 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.949s	user 0.018s	sys 0.051s
I20260709 12:10:28.444645 14334 raft_consensus.cc:2468] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 3.
W20260709 12:10:28.444979 14154 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 949617us
W20260709 12:10:28.413635 16279 consensus_meta.cc:287] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.960s	user 0.010s	sys 0.003s
I20260709 12:10:28.406492 14183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 1991) took 3233 ms. Trace:
I20260709 12:10:28.409495 14189 rpcz_store.cc:276] 0709 12:10:27.087319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:27.145523 (+ 58204us) service_pool.cc:224] Handling call
0709 12:10:27.145870 (+   347us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:27.149958 (+  4088us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:27.149989 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:27.150528 (+   539us) log.cc:844] Serialized 26 byte log entry
0709 12:10:28.285356 (+1134828us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:28.285418 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:28.285500 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:28.408807 (+123307us) raft_consensus.cc:1685] finished
0709 12:10:28.408828 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:28.408974 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3628,"raft.queue_time_us":5789,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":6391,"thread_start_us":1091664,"threads_started":1,"wal-append.queue_time_us":1100808}
W20260709 12:10:28.449147 14302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:28.365662 14303 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:28.449962 14334 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50856 (request call id 1631) took 1325 ms (client timeout 1692 ms). Trace:
W20260709 12:10:28.450062 14303 connection.cc:256] RPC call timeout handler was delayed by -1.3892112590001489s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.189s for a response
I20260709 12:10:28.389922 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
W20260709 12:10:28.442282 14182 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.005s	sys 0.014s
I20260709 12:10:28.414651 14190 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56046 (request call id 1760) took 1111 ms. Trace:
W20260709 12:10:28.443876 16339 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.959s	user 0.010s	sys 0.009s
I20260709 12:10:28.446058 14154 leader_election.cc:304] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
W20260709 12:10:28.451956 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 71343.9us
I20260709 12:10:28.451362 14190 rpcz_store.cc:276] 0709 12:10:27.303046 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:28.411062 (+1108016us) service_pool.cc:224] Handling call
0709 12:10:28.411415 (+   353us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:28.414337 (+  2922us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:28.414580 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:28.454532 14337 raft_consensus.cc:1240] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:28.455053 14190 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56046 (request call id 1764) took 1116 ms. Trace:
I20260709 12:10:28.455410 14190 rpcz_store.cc:276] 0709 12:10:27.338592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:28.454298 (+1115706us) service_pool.cc:224] Handling call
0709 12:10:28.454557 (+   259us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:28.454735 (+   178us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:28.454760 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:28.454798 (+    38us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:10:28.454834 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:28.454884 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:28.454986 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:28.457230 14190 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56046 (request call id 1767) took 1087 ms. Trace:
W20260709 12:10:28.451299 14182 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.558s	user 0.005s	sys 0.014s
I20260709 12:10:28.447978 14183 rpcz_store.cc:276] 0709 12:10:25.169312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:25.170073 (+   761us) service_pool.cc:224] Handling call
0709 12:10:25.170482 (+   409us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:25.515756 (+345274us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:28.402363 (+2886607us) spinlock_profiling.cc:243] Waited 339 ms on lock 0x7b540019b9d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:10:28.402583 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":778906368}
I20260709 12:10:28.459247 14189 raft_consensus.cc:1240] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 4. Current term is 5. Ops: [4.2-4.2]
W20260709 12:10:28.450424 14334 rpcz_store.cc:269] 0709 12:10:27.124312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:27.145358 (+ 21046us) service_pool.cc:224] Handling call
0709 12:10:28.402665 (+1257307us) spinlock_profiling.cc:243] Waited 2.44 ms on lock 0x7b5800065d98. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2124016b71 00007f2124016a22 00007f212cf2f8d9 00007f212c089ee0 00007f212c1530ab 00007f212c153131 00007f212c1010a0 00007f212c100984 00007f212567b6d4 00007f212567b662
0709 12:10:28.449884 (+ 47219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5615488}
I20260709 12:10:28.423056 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:28.476131 14183 raft_consensus.cc:1275] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:10:28.476856 14183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56046 (request call id 1770) took 1030 ms. Trace:
I20260709 12:10:28.478248 14189 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56046 (request call id 1762) took 1147 ms. Trace:
I20260709 12:10:28.478711 14189 rpcz_store.cc:276] 0709 12:10:27.330659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:28.449047 (+1118388us) service_pool.cc:224] Handling call
0709 12:10:28.449507 (+   460us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:28.477889 (+ 28382us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:28.478172 (+   283us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:28.480074 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 78119.4us
I20260709 12:10:28.481820 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:28.486361 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:28.487699 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:28.488058 16475 leader_election.cc:290] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:28.475648 16433 raft_consensus.cc:493] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:28.446494 16487 raft_consensus.cc:515] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:28.490435 16433 raft_consensus.cc:515] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:28.491554 16495 raft_consensus.cc:2804] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:28.491998 16495 raft_consensus.cc:493] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:28.447297 16461 raft_consensus.cc:493] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:28.480572 16285 raft_consensus.cc:493] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:28.492843 16285 raft_consensus.cc:515] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:28.474056 16419 raft_consensus.cc:2804] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:28.494730 16419 raft_consensus.cc:697] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 5 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
W20260709 12:10:28.495662 14910 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53200 (request call id 373) took 1405 ms (client timeout 1828 ms). Trace:
I20260709 12:10:28.491362 16224 consensus_queue.cc:1048] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:28.477195 14183 rpcz_store.cc:276] 0709 12:10:27.446860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:28.475432 (+1028572us) service_pool.cc:224] Handling call
0709 12:10:28.475780 (+   348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:28.476571 (+   791us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:28.476792 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:28.497417 16494 raft_consensus.cc:493] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:28.496115 14910 rpcz_store.cc:269] 0709 12:10:27.090248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:27.090370 (+   122us) service_pool.cc:224] Handling call
0709 12:10:28.495492 (+1405122us) spinlock_profiling.cc:243] Waited 338 ms on lock 0x7b5400088754. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:10:28.495601 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":776666496}
I20260709 12:10:28.492211 16215 raft_consensus.cc:2749] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:28.464193 14190 rpcz_store.cc:276] 0709 12:10:27.369563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:28.456265 (+1086702us) service_pool.cc:224] Handling call
0709 12:10:28.456527 (+   262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:28.456905 (+   378us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:28.456933 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:28.456974 (+    41us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:28.457008 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:28.457073 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:28.457179 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:28.492311 16495 raft_consensus.cc:3060] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:28.521541 14182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 2004) took 1437 ms. Trace:
I20260709 12:10:28.516882 16475 raft_consensus.cc:493] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:28.562158 14303 leader_election.cc:400] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 election: Vote denied by peer 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341) with higher term. Message: Invalid argument: T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for earlier term 3. Current term is 4.
I20260709 12:10:28.562510 14303 leader_election.cc:403] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:10:28.562680 15738 leader_election.cc:290] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:28.563236 15738 raft_consensus.cc:2749] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341) with higher term. Message: Invalid argument: T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for earlier term 3. Current term is 4.
I20260709 12:10:28.564345 14303 leader_election.cc:304] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:10:28.460470 16279 raft_consensus.cc:515] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:10:28.564913 16490 log.cc:927] Time spent T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:10:28.492750 16461 raft_consensus.cc:515] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:28.495594 16419 consensus_queue.cc:237] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:28.566481 16285 leader_election.cc:290] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:28.567106 16285 raft_consensus.cc:2804] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:28.567492 16285 raft_consensus.cc:493] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:28.567871 16285 raft_consensus.cc:3060] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:28.568419 14303 leader_election.cc:304] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:10:28.560418 14182 rpcz_store.cc:276] 0709 12:10:27.084314 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:27.084433 (+   119us) service_pool.cc:224] Handling call
0709 12:10:27.084766 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:27.085002 (+   236us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:10:27.085280 (+   278us) log.cc:844] Serialized 14 byte log entry
0709 12:10:27.881496 (+796216us) spinlock_profiling.cc:243] Waited 1.39 ms on lock 0x7b1800295ea0. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f212cf16ab1 00007f212cf23281 00007f2124030e07 00007f212ce8b9a9 00007f212404d69b 00007f212404b93f 00007f212404dc02 00007f2126cd520b 00007f2126cdad23 00007f2126cdb23a 00007f2127145a2a
0709 12:10:28.521050 (+639554us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:28.521125 (+    75us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:28.521205 (+    80us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:28.521293 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:28.521444 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":122,"prepare.run_cpu_time_us":85,"prepare.run_wall_time_us":2581,"spinlock_wait_cycles":3194624,"thread_start_us":627507,"threads_started":2,"wal-append.queue_time_us":1404537}
I20260709 12:10:28.569339 14303 leader_election.cc:304] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
W20260709 12:10:28.571200 14154 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 118235us
I20260709 12:10:28.489665 16359 leader_election.cc:290] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:28.590257 14303 leader_election.cc:304] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:28.591675 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:28.603667 14258 raft_consensus.cc:2393] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db in current term 5: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:10:28.601706 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:28.600492 14184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56046 (request call id 1754) took 1472 ms. Trace:
I20260709 12:10:28.605377 14184 rpcz_store.cc:276] 0709 12:10:27.128628 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:27.164966 (+ 36338us) service_pool.cc:224] Handling call
0709 12:10:27.165364 (+   398us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:27.329720 (+164356us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:27.329781 (+    61us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:27.329830 (+    49us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:27.329863 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:28.600275 (+1270412us) spinlock_profiling.cc:243] Waited 164 ms on lock 0x7b5400422554. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:10:28.600322 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:28.600435 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":377439488}
I20260709 12:10:28.606086 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:28.606673 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:28.601910 14303 leader_election.cc:304] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:28.607345 14184 raft_consensus.cc:2393] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 5: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:10:28.607373 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:28.608743 14182 raft_consensus.cc:2410] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:10:28.499768 16385 raft_consensus.cc:515] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:28.610769 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:28.611426 14303 leader_election.cc:304] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:10:28.612265 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:28.612628 14303 leader_election.cc:304] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:28.588938 16392 leader_election.cc:290] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:28.614457 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:28.590562 16364 raft_consensus.cc:2804] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:28.617328 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:28.597957 16465 raft_consensus.cc:2749] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:28.599759 15738 raft_consensus.cc:2749] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:28.620620 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:28.621035 14877 leader_election.cc:304] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:28.622536 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:28.626853 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:28.627424 14184 raft_consensus.cc:3060] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:28.616194 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:28.613714 16359 raft_consensus.cc:2749] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:28.611367 14904 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53200 (request call id 379) took 1466 ms. Trace:
I20260709 12:10:28.617589 16364 raft_consensus.cc:493] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:28.529570 16494 raft_consensus.cc:515] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:28.634361 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:28.618240 16365 raft_consensus.cc:2804] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:28.587591 16475 raft_consensus.cc:515] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:28.572490 16420 raft_consensus.cc:515] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:28.646164 14906 raft_consensus.cc:2393] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 6: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:10:28.651719 16501 raft_consensus.cc:493] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:28.652333 16501 raft_consensus.cc:515] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:28.643355 16364 raft_consensus.cc:3060] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:28.654258 16498 raft_consensus.cc:493] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:28.654825 16498 raft_consensus.cc:515] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:28.655550 16420 leader_election.cc:290] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 6 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:28.657128 16498 leader_election.cc:290] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:28.657927 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:28.663271 14908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:28.664635 16342 raft_consensus.cc:493] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
W20260709 12:10:28.664901 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:28.665879 16342 raft_consensus.cc:515] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:28.667793 16475 leader_election.cc:290] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:28.642880 16392 raft_consensus.cc:493] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:10:28.667026 16484 raft_consensus.cc:515] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:28.670260 16392 raft_consensus.cc:515] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:28.673032 14912 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53200 (request call id 371) took 1584 ms. Trace:
I20260709 12:10:28.673468 14912 rpcz_store.cc:276] 0709 12:10:27.089078 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:27.089930 (+   852us) service_pool.cc:224] Handling call
0709 12:10:27.090256 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:27.312986 (+222730us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:28.672750 (+1359764us) spinlock_profiling.cc:243] Waited 178 ms on lock 0x7b5400040954. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:10:28.672950 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":410454400}
I20260709 12:10:28.640928 15738 raft_consensus.cc:2749] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:28.672276 16392 leader_election.cc:290] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:28.683522 16464 leader_election.cc:290] T f4739bc22bfe44fcba807da02d9351b6 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:28.641029 14904 rpcz_store.cc:276] 0709 12:10:27.133474 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:27.166503 (+ 33029us) service_pool.cc:224] Handling call
0709 12:10:27.167101 (+   598us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:27.167747 (+   646us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:27.167819 (+    72us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:27.168742 (+   923us) log.cc:844] Serialized 26 byte log entry
0709 12:10:28.409018 (+1240276us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:28.413699 (+  4681us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:28.422305 (+  8606us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:28.570958 (+148653us) raft_consensus.cc:1685] finished
0709 12:10:28.570981 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:28.599396 (+ 28415us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2455,"raft.run_cpu_time_us":333,"raft.run_wall_time_us":33416,"thread_start_us":1227341,"threads_started":1,"wal-append.queue_time_us":1291329}
I20260709 12:10:28.683192 16484 leader_election.cc:290] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 4 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:28.677573 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:28.686216 16461 leader_election.cc:290] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:28.667936 16342 leader_election.cc:290] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:28.679015 16385 leader_election.cc:290] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 4 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:10:28.687656 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 75115.7us
I20260709 12:10:28.681267 14258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53050 (request call id 330) took 1241 ms. Trace:
I20260709 12:10:28.683267 16501 leader_election.cc:290] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:28.680704 16279 leader_election.cc:290] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:28.688469 14258 rpcz_store.cc:276] 0709 12:10:27.440270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:27.573052 (+132782us) service_pool.cc:224] Handling call
0709 12:10:28.681053 (+1108001us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b5400031954. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:10:28.681205 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2364303232}
I20260709 12:10:28.689900 14303 leader_election.cc:304] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:10:28.675089 16433 leader_election.cc:290] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:28.645218 16365 raft_consensus.cc:493] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:28.708889 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:28.740660 14263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41764 (request call id 2051) took 1447 ms. Trace:
I20260709 12:10:28.717226 14335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50856 (request call id 1625) took 3283 ms. Trace:
W20260709 12:10:28.742118 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 119638us
W20260709 12:10:28.725226 14230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:28.744333 14877 leader_election.cc:304] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec
W20260709 12:10:28.698406 14332 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50858 (request call id 1378) took 2296 ms (client timeout 2015 ms). Trace:
W20260709 12:10:28.745201 14332 rpcz_store.cc:269] 0709 12:10:26.402523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:28.698197 (+2295674us) service_pool.cc:211] Skipping call since client already timed out
0709 12:10:28.698322 (+   125us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:10:28.740986 14263 rpcz_store.cc:276] 0709 12:10:27.293625 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:27.314022 (+ 20397us) service_pool.cc:224] Handling call
0709 12:10:28.708685 (+1394663us) spinlock_profiling.cc:243] Waited 3.69 ms on lock 0x7b5800060c98. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2124016b71 00007f2124016a22 00007f212cf2f8d9 00007f212c089ee0 00007f212c1530ab 00007f212c153131 00007f212c1010a0 00007f212c100984 00007f212567b6d4 00007f212567b662
0709 12:10:28.740593 (+ 31908us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8494336}
I20260709 12:10:28.742784 14335 rpcz_store.cc:276] 0709 12:10:25.433955 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:28.716318 (+3282363us) service_pool.cc:224] Handling call
0709 12:10:28.716691 (+   373us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:28.716888 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:28.716913 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:28.716957 (+    44us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:28.716986 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:28.717039 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:28.717158 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:28.721638 14303 leader_election.cc:304] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:28.749982 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:28.750228 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:28.750773 14334 raft_consensus.cc:2393] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 3: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:10:28.751385 14303 leader_election.cc:304] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:28.751585 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:28.752135 14338 raft_consensus.cc:1275] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:10:28.753088 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:28.734774 14185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 2009) took 1647 ms. Trace:
I20260709 12:10:28.755939 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:28.753634 14338 raft_consensus.cc:2468] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 6.
I20260709 12:10:28.772220 14303 leader_election.cc:304] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:28.777375 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:28.700850 16494 leader_election.cc:290] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:28.724136 16365 raft_consensus.cc:3060] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:28.779217 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:28.781675 14335 raft_consensus.cc:3055] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:28.782037 14335 raft_consensus.cc:740] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:28.782964 14335 consensus_queue.cc:260] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:28.783905 14335 raft_consensus.cc:3060] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:28.719270 16455 raft_consensus.cc:2804] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:28.712975 16458 leader_election.cc:290] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:10:28.774842 14230 connection.cc:256] RPC call timeout handler was delayed by -1.6251873539999906s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1876s for a response
W20260709 12:10:28.786584 14230 connection.cc:256] RPC call timeout handler was delayed by -1.514487354000039s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19990000000000002s for a response
I20260709 12:10:28.786113 16455 raft_consensus.cc:493] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:10:28.787190 16455 raft_consensus.cc:3060] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:28.721242 16359 consensus_queue.cc:1048] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.059s
I20260709 12:10:28.703075 14904 raft_consensus.cc:1275] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:28.721359 16487 leader_election.cc:290] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:28.717898 16499 raft_consensus.cc:2749] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:28.804798 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:28.797787 14335 raft_consensus.cc:2468] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 6.
I20260709 12:10:28.754163 14185 rpcz_store.cc:276] 0709 12:10:27.087606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:27.148412 (+ 60806us) service_pool.cc:224] Handling call
0709 12:10:27.148794 (+   382us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:27.354670 (+205876us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:10:27.379763 (+ 25093us) log.cc:844] Serialized 14 byte log entry
0709 12:10:28.206256 (+826493us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:28.206329 (+    73us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:28.206380 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:28.734486 (+528106us) spinlock_profiling.cc:243] Waited 206 ms on lock 0x7b540028a5d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:10:28.734554 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:28.734701 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":28121,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":50,"raft.queue_time_us":6318,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":115,"spinlock_wait_cycles":472842112,"thread_start_us":826082,"threads_started":1,"wal-append.queue_time_us":823541}
I20260709 12:10:28.696219 14184 raft_consensus.cc:2468] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 6.
I20260709 12:10:28.805563 14333 raft_consensus.cc:2468] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 6.
I20260709 12:10:28.806329 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:28.778630 14337 raft_consensus.cc:2468] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 2.
I20260709 12:10:28.753835 14877 leader_election.cc:304] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:28.808408 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:28.700335 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:28.811045 14230 leader_election.cc:304] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:28.777359 16484 raft_consensus.cc:2749] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:28.724051 16266 raft_consensus.cc:3060] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:28.813762 16425 raft_consensus.cc:2749] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:28.813128 16487 raft_consensus.cc:2804] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:28.817121 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:28.775997 16358 raft_consensus.cc:2749] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:28.775761 15827 raft_consensus.cc:2804] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:28.815214 16487 raft_consensus.cc:493] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:28.835090 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:28.777879 16383 raft_consensus.cc:2749] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:28.823066 14229 leader_election.cc:304] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
W20260709 12:10:28.813282 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 59529.8us
I20260709 12:10:28.819535 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:28.838037 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:10:28.839775 14304 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:28.803710 16279 raft_consensus.cc:493] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:10:28.722838 16453 consensus_queue.cc:1059] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.094s
I20260709 12:10:28.846429 14185 raft_consensus.cc:2468] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 8.
I20260709 12:10:28.847769 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:28.847983 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:28.845978 14229 leader_election.cc:304] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:28.851078 14303 leader_election.cc:304] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:28.834491 15827 raft_consensus.cc:493] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:10:28.852247 15827 raft_consensus.cc:3060] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:28.848528 14185 raft_consensus.cc:2468] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 5.
I20260709 12:10:28.812315 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:28.854533 14155 leader_election.cc:304] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:10:28.854300 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:28.856361 14229 leader_election.cc:304] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:28.877813 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:28.866663 14185 raft_consensus.cc:2393] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 6: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:10:28.879110 14333 raft_consensus.cc:2468] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 4.
I20260709 12:10:28.811910 16458 consensus_queue.cc:1048] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 12:10:28.812301 16385 consensus_queue.cc:1048] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 12:10:28.883082 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:28.902979 14185 raft_consensus.cc:3060] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:28.811692 16335 consensus_queue.cc:1048] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.044s
I20260709 12:10:28.734001 16285 raft_consensus.cc:515] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:28.885787 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:28.907253 14181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56046 (request call id 1761) took 1580 ms. Trace:
I20260709 12:10:28.844148 16487 raft_consensus.cc:3060] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:28.818773 16342 consensus_queue.cc:1048] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.042s
I20260709 12:10:28.877833 16501 raft_consensus.cc:2804] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:28.834232 16425 consensus_queue.cc:1048] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.047s
I20260709 12:10:28.922906 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:28.907685 14181 rpcz_store.cc:276] 0709 12:10:27.326647 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:28.430248 (+1103601us) service_pool.cc:224] Handling call
0709 12:10:28.452055 (+ 21807us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:28.452441 (+   386us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:28.452466 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:28.452940 (+   474us) log.cc:844] Serialized 26 byte log entry
0709 12:10:28.639938 (+186998us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:10:28.639984 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:28.640076 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:28.906986 (+266910us) raft_consensus.cc:1685] finished
0709 12:10:28.907011 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:28.907180 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1230,"raft.queue_time_us":937,"raft.run_cpu_time_us":216,"raft.run_wall_time_us":31649,"thread_start_us":82373,"threads_started":1,"wal-append.queue_time_us":330067}
I20260709 12:10:28.855252 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:10:28.857975 16419 raft_consensus.cc:493] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:10:28.853147 16495 raft_consensus.cc:515] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:28.855577 16424 consensus_queue.cc:1059] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.137s
W20260709 12:10:29.121984 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:29.259177 14302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:28.928521 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:28.938191 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:28.936570 14337 raft_consensus.cc:3060] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:29.731295 14190 raft_consensus.cc:3060] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:29.316299 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:10:29.395177 16266 consensus_meta.cc:287] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.581s	user 0.013s	sys 0.001s
I20260709 12:10:29.132175 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:29.109153 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:29.734315 14189 raft_consensus.cc:2468] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 3.
W20260709 12:10:29.114634 14305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:29.006793 16510 log.cc:927] Time spent T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
W20260709 12:10:29.009126 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 67435.2us
I20260709 12:10:29.145752 14256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41764 (request call id 2035) took 2059 ms. Trace:
I20260709 12:10:29.226078 14264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41768 (request call id 1351) took 3219 ms. Trace:
I20260709 12:10:29.011626 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:10:29.106273 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:10:29.109952 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:29.146034 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
W20260709 12:10:29.655088 14229 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.798s	user 0.000s	sys 0.008s
W20260709 12:10:29.761821 14229 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.905s	user 0.001s	sys 0.008s
W20260709 12:10:29.008355 14336 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50856 (request call id 1621) took 3575 ms (client timeout 1999 ms). Trace:
I20260709 12:10:28.853354 16456 raft_consensus.cc:2804] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:28.885497 16358 raft_consensus.cc:2804] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:28.880692 14331 raft_consensus.cc:2376] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 3. Re-sending same reply.
I20260709 12:10:29.144466 16484 raft_consensus.cc:3055] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:29.117014 16262 raft_consensus.cc:3060] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:29.735301 14909 raft_consensus.cc:2468] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 4.
W20260709 12:10:29.740072 14339 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55492 (request call id 278) took 1854 ms (client timeout 2134 ms). Trace:
W20260709 12:10:29.440605 16455 consensus_meta.cc:287] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.653s	user 0.009s	sys 0.005s
I20260709 12:10:28.926450 16415 raft_consensus.cc:2804] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:29.759263 16447 raft_consensus.cc:493] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:10:29.746636 16452 raft_consensus.cc:493] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:10:29.746140 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:28.905768 16392 consensus_queue.cc:1048] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.840s
I20260709 12:10:29.002626 16364 raft_consensus.cc:515] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:28.936321 16285 leader_election.cc:290] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 4 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:29.733702 16419 raft_consensus.cc:515] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:28.994896 16114 consensus_queue.cc:1059] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.761s
I20260709 12:10:29.752290 16495 leader_election.cc:290] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 5 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:29.768762 14905 raft_consensus.cc:3060] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:29.758249 14908 raft_consensus.cc:2393] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 5: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
I20260709 12:10:29.147051 14907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:10:29.102100 16233 leader_election.cc:290] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:28.933161 16394 leader_election.cc:290] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:29.727504 16501 raft_consensus.cc:493] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:10:28.858455 16279 raft_consensus.cc:515] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:29.441135 16487 raft_consensus.cc:515] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:28.938460 16517 raft_consensus.cc:2804] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:10:29.774281 14909 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53194 (request call id 661) took 1375 ms (client timeout 1554 ms). Trace:
I20260709 12:10:29.769162 16358 raft_consensus.cc:493] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:29.759812 15827 consensus_meta.cc:287] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db: Time spent flushing consensus metadata: real 0.907s	user 0.011s	sys 0.003s
I20260709 12:10:29.775569 16415 raft_consensus.cc:493] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:29.767253 16335 raft_consensus.cc:493] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:29.741262 16424 consensus_queue.cc:1243] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer 65c9c1653b3346b39a0e118540e6080c log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
W20260709 12:10:29.767362 16354 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.755s	user 0.003s	sys 0.012s
I20260709 12:10:29.233258 16365 raft_consensus.cc:515] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:29.763329 16266 raft_consensus.cc:493] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:10:29.779265 16456 raft_consensus.cc:697] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 6 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:10:29.774607 16484 raft_consensus.cc:740] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:29.789186 16279 leader_election.cc:290] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:29.785194 16364 leader_election.cc:290] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 6 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:10:29.824791 16354 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.814s	user 0.004s	sys 0.013s
I20260709 12:10:29.878743 14154 leader_election.cc:304] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
W20260709 12:10:29.880077 14155 connection.cc:256] RPC call timeout handler was delayed by -2.298648840000169s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2118s for a response
I20260709 12:10:29.750104 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:29.881479 14183 raft_consensus.cc:2468] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 3.
I20260709 12:10:29.011364 14185 raft_consensus.cc:2468] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 4.
I20260709 12:10:29.108453 14186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56652 (request call id 367) took 2122 ms. Trace:
I20260709 12:10:29.996464 14185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56046 (request call id 1789) took 1161 ms. Trace:
I20260709 12:10:29.998607 14186 rpcz_store.cc:276] 0709 12:10:26.986524 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:26.986694 (+   170us) service_pool.cc:224] Handling call
0709 12:10:27.016568 (+ 29874us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:27.290850 (+274282us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:27.290886 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:27.290945 (+    59us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:27.290980 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:29.108149 (+1817169us) spinlock_profiling.cc:243] Waited 274 ms on lock 0x7b5400421154. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:10:29.108199 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:29.108375 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":630110464}
I20260709 12:10:29.728948 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:29.740821 14189 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56044 (request call id 2015) took 1135 ms. Trace:
I20260709 12:10:30.006747 14189 rpcz_store.cc:276] 0709 12:10:28.599596 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:28.600047 (+   451us) service_pool.cc:224] Handling call
0709 12:10:29.103331 (+503284us) spinlock_profiling.cc:243] Waited 1.15 ms on lock 0x7b5800001298. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2124016b71 00007f2124016a22 00007f212cf2f8d9 00007f212c089ee0 00007f212c1530ab 00007f212c153131 00007f212c1010a0 00007f212c100984 00007f212567b6d4 00007f212567b662
0709 12:10:29.734981 (+631650us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2649344}
I20260709 12:10:30.008826 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:29.152347 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:29.759791 14190 raft_consensus.cc:2468] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 6.
I20260709 12:10:30.010895 14190 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56652 (request call id 380) took 1085 ms. Trace:
I20260709 12:10:30.011010 14188 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56652 (request call id 383) took 1084 ms. Trace:
W20260709 12:10:29.887295 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 1.0308e+06us
I20260709 12:10:30.012116 14188 rpcz_store.cc:276] 0709 12:10:28.926300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:29.151989 (+225689us) service_pool.cc:224] Handling call
0709 12:10:30.010756 (+858767us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:30.013103 14229 leader_election.cc:304] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
W20260709 12:10:29.888149 14230 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.009s	user 0.001s	sys 0.009s
I20260709 12:10:29.743103 14256 rpcz_store.cc:276] 0709 12:10:27.086274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:27.086463 (+   189us) service_pool.cc:224] Handling call
0709 12:10:27.459926 (+373463us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:27.502670 (+ 42744us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:29.145421 (+1642751us) spinlock_profiling.cc:243] Waited 373 ms on lock 0x7b54003a0a50. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713a8ad 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:10:29.145643 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":858046848}
I20260709 12:10:29.741761 14264 rpcz_store.cc:276] 0709 12:10:26.007080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:26.007217 (+   137us) service_pool.cc:224] Handling call
0709 12:10:26.007542 (+   325us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:26.091889 (+ 84347us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:26.091921 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:27.170111 (+1078190us) spinlock_profiling.cc:243] Waited 2.74 ms on lock 0x7b2c0005ad88. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2125a34a11 00007f2125a44372 00007f2127176a01 00007f212713b43a 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2
0709 12:10:27.170600 (+   489us) log.cc:844] Serialized 26 byte log entry
0709 12:10:28.198815 (+1028215us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:10:28.199057 (+   242us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:29.225602 (+1026545us) spinlock_profiling.cc:243] Waited 74.7 ms on lock 0x7b5400210a54. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:10:29.225687 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:29.225756 (+    69us) raft_consensus.cc:1685] finished
0709 12:10:29.225770 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:29.225989 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9156,"raft.queue_time_us":14215,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":19655,"spinlock_wait_cycles":178050048,"thread_start_us":1016674,"threads_started":1,"wal-append.queue_time_us":1012729,"wal-append.run_cpu_time_us":2571,"wal-append.run_wall_time_us":1023967}
W20260709 12:10:29.741777 14304 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:29.751294 14330 raft_consensus.cc:2468] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 3.
I20260709 12:10:29.752133 14332 raft_consensus.cc:1240] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:29.750887 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:10:30.019912 14330 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50856 (request call id 1588) took 6250 ms (client timeout 2292 ms). Trace:
I20260709 12:10:30.020606 14333 raft_consensus.cc:2393] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db in current term 6: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:10:30.021468 15924 raft_consensus.cc:493] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:29.767639 14336 rpcz_store.cc:269] 0709 12:10:25.432822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:25.439710 (+  6888us) service_pool.cc:224] Handling call
0709 12:10:29.008077 (+3568367us) spinlock_profiling.cc:243] Waited 1.61 s on lock 0x7b540029ed54. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:10:29.008221 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3708701312}
I20260709 12:10:29.746685 14337 raft_consensus.cc:2468] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 5.
I20260709 12:10:30.022451 15924 raft_consensus.cc:515] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:10:29.774684 14339 rpcz_store.cc:269] 0709 12:10:27.885516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:27.894110 (+  8594us) service_pool.cc:224] Handling call
0709 12:10:28.928337 (+1034227us) spinlock_profiling.cc:243] Waited 19.9 ms on lock 0x7b5800065d98. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2124016b71 00007f2124016a22 00007f212cf2f8d9 00007f212c089ee0 00007f212c1530ab 00007f212c153131 00007f212c1010a0 00007f212c100984 00007f212567b6d4 00007f212567b662
0709 12:10:29.740005 (+811668us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":45750144}
W20260709 12:10:29.789753 14909 rpcz_store.cc:269] 0709 12:10:28.399180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:28.404428 (+  5248us) service_pool.cc:224] Handling call
0709 12:10:29.108954 (+704526us) spinlock_profiling.cc:243] Waited 4.6 ms on lock 0x7b5800096698. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2124016b71 00007f2124016a22 00007f212cf2f8d9 00007f212c089ee0 00007f212c1530ab 00007f212c153131 00007f212c1010a0 00007f212c100984 00007f212567b6d4 00007f212567b662
0709 12:10:29.774195 (+665241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10581248}
I20260709 12:10:30.024711 14183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56046 (request call id 1791) took 1174 ms. Trace:
I20260709 12:10:29.782583 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:29.791569 16358 raft_consensus.cc:3060] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:29.823007 16419 leader_election.cc:290] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:29.787551 16501 raft_consensus.cc:3060] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:30.025916 14230 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.147s	user 0.001s	sys 0.009s
W20260709 12:10:30.026459 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 1.14728e+06us
I20260709 12:10:30.025250 14183 rpcz_store.cc:276] 0709 12:10:28.850087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:29.118071 (+267984us) service_pool.cc:224] Handling call
0709 12:10:29.316042 (+197971us) spinlock_profiling.cc:243] Waited 14.2 ms on lock 0x7b5800001298. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2124016b71 00007f2124016a22 00007f212cf2f8d9 00007f212c089ee0 00007f212c1530ab 00007f212c153131 00007f212c1010a0 00007f212c100984 00007f212567b6d4 00007f212567b662
0709 12:10:30.024407 (+708365us) spinlock_profiling.cc:243] Waited 148 ms on lock 0x7b54003b1354. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:10:30.024619 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":373049984}
I20260709 12:10:29.789558 16517 raft_consensus.cc:493] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:30.020471 16528 raft_consensus.cc:2749] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:30.030248 16517 raft_consensus.cc:3060] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:30.019901 14154 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 141702us
I20260709 12:10:30.014067 14186 raft_consensus.cc:1275] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:10:30.032618 14186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 2029) took 1236 ms. Trace:
I20260709 12:10:30.032965 14186 rpcz_store.cc:276] 0709 12:10:28.796599 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:30.000635 (+1204036us) service_pool.cc:224] Handling call
0709 12:10:30.001359 (+   724us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:30.032223 (+ 30864us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:30.032506 (+   283us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:29.778321 16521 raft_consensus.cc:493] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:30.034152 16528 consensus_queue.cc:1048] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:30.034544 16521 raft_consensus.cc:515] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:29.789724 16487 leader_election.cc:290] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 5 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:30.055153 14910 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53194 (request call id 664) took 1235 ms. Trace:
I20260709 12:10:29.825822 16415 raft_consensus.cc:3060] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:29.778754 16455 raft_consensus.cc:515] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } }
I20260709 12:10:30.077981 16531 raft_consensus.cc:2749] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:30.080595 16455 leader_election.cc:290] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 4 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:10:30.082636 14303 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:30.086328 16521 leader_election.cc:290] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:30.076869 14189 raft_consensus.cc:1240] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:30.087798 14189 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 2034) took 1289 ms. Trace:
I20260709 12:10:30.088136 14189 rpcz_store.cc:276] 0709 12:10:28.798097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:30.076004 (+1277907us) service_pool.cc:224] Handling call
0709 12:10:30.076590 (+   586us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:30.087479 (+ 10889us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:30.087705 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:29.938233 16498 raft_consensus.cc:493] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:30.095775 16279 raft_consensus.cc:493] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:30.095623 16498 raft_consensus.cc:515] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:29.822466 16335 raft_consensus.cc:515] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:29.791901 16447 raft_consensus.cc:515] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:30.096547 16279 raft_consensus.cc:515] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:30.098038 14187 raft_consensus.cc:2468] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 3.
I20260709 12:10:30.098495 16335 leader_election.cc:290] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:30.098843 16447 leader_election.cc:290] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:29.941917 16456 consensus_queue.cc:237] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:30.105279 16498 leader_election.cc:290] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:30.105661 14230 leader_election.cc:304] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:30.106400 16279 leader_election.cc:290] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:10:30.106658 14302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:29.950945 16365 leader_election.cc:290] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 6 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:29.824035 15827 raft_consensus.cc:515] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:29.952461 14331 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50856 (request call id 1638) took 1202 ms. Trace:
I20260709 12:10:29.848747 16484 consensus_queue.cc:260] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:29.793886 16452 raft_consensus.cc:515] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:29.954726 14904 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59144 (request call id 226) took 1019 ms. Trace:
W20260709 12:10:29.968446 14908 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53194 (request call id 654) took 2916 ms (client timeout 3097 ms). Trace:
I20260709 12:10:29.953282 16464 raft_consensus.cc:493] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:29.843827 16266 raft_consensus.cc:515] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:30.112797 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:30.113220 14331 rpcz_store.cc:276] 0709 12:10:28.749267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:28.757325 (+  8058us) service_pool.cc:224] Handling call
0709 12:10:29.940204 (+1182879us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:30.114153 14182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56046 (request call id 1778) took 1510 ms. Trace:
I20260709 12:10:30.114588 16266 leader_election.cc:290] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:29.989576 14181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56044 (request call id 2025) took 1193 ms. Trace:
I20260709 12:10:30.115260 14181 rpcz_store.cc:276] 0709 12:10:28.795471 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:29.739830 (+944359us) service_pool.cc:224] Handling call
0709 12:10:29.989244 (+249414us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:29.987426 14155 connection.cc:256] RPC call timeout handler was delayed by -1.4779962259999593s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15610000000000002s for a response
W20260709 12:10:30.117990 14155 connection.cc:256] RPC call timeout handler was delayed by -1.4059962260000702s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16410000000000002s for a response
W20260709 12:10:30.118571 14155 connection.cc:256] RPC call timeout handler was delayed by -1.310596225999916s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17470000000000002s for a response
W20260709 12:10:30.118928 14155 connection.cc:256] RPC call timeout handler was delayed by -1.0693962259999807s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2015s for a response
W20260709 12:10:30.119280 14155 connection.cc:256] RPC call timeout handler was delayed by -1.0693962259999807s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2015s for a response
I20260709 12:10:30.120268 14155 leader_election.cc:304] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:30.011404 14190 rpcz_store.cc:276] 0709 12:10:28.925264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:28.937914 (+ 12650us) service_pool.cc:224] Handling call
0709 12:10:30.010635 (+1072721us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:30.111922 14904 rpcz_store.cc:276] 0709 12:10:28.935111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:29.723267 (+788156us) service_pool.cc:224] Handling call
0709 12:10:29.737833 (+ 14566us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:29.767930 (+ 30097us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:29.774973 (+  7043us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:29.779695 (+  4722us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:29.781828 (+  2133us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:29.954101 (+172273us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:29.954414 (+   313us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:29.776441 14338 raft_consensus.cc:2468] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 4.
I20260709 12:10:29.998622 14185 rpcz_store.cc:276] 0709 12:10:28.835105 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:28.882857 (+ 47752us) service_pool.cc:224] Handling call
0709 12:10:29.996225 (+1113368us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:30.014112 14188 raft_consensus.cc:1240] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:30.055662 14910 rpcz_store.cc:276] 0709 12:10:28.820000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:28.820123 (+   123us) service_pool.cc:224] Handling call
0709 12:10:29.782429 (+962306us) spinlock_profiling.cc:243] Waited 3.8 ms on lock 0x7b5800096698. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2124016b71 00007f2124016a22 00007f212cf2f8d9 00007f212c089ee0 00007f212c1530ab 00007f212c153131 00007f212c1010a0 00007f212c100984 00007f212567b6d4 00007f212567b662
0709 12:10:30.054895 (+272466us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8734976}
I20260709 12:10:30.123503 14190 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56046 (request call id 1785) took 1302 ms. Trace:
W20260709 12:10:30.020465 14330 rpcz_store.cc:269] 0709 12:10:23.768993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:23.784185 (+ 15192us) service_pool.cc:224] Handling call
0709 12:10:30.019476 (+6235291us) spinlock_profiling.cc:243] Waited 5.84 s on lock 0x7b540010c7d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:10:30.019686 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13420989696}
I20260709 12:10:30.063330 16532 raft_consensus.cc:493] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:30.124966 14185 raft_consensus.cc:1275] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 12:10:30.125648 14337 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50856 (request call id 1652) took 1291 ms (client timeout 1635 ms). Trace:
I20260709 12:10:30.063608 14183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 2032) took 1266 ms. Trace:
W20260709 12:10:30.126176 14337 rpcz_store.cc:269] 0709 12:10:28.834534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:28.834832 (+   298us) service_pool.cc:224] Handling call
0709 12:10:30.125259 (+1290427us) spinlock_profiling.cc:243] Waited 99.1 ms on lock 0x7b5400019d54. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:10:30.125458 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":227932928}
I20260709 12:10:30.126467 14183 rpcz_store.cc:276] 0709 12:10:28.797442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:30.029222 (+1231780us) service_pool.cc:224] Handling call
0709 12:10:30.029693 (+   471us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:30.030201 (+   508us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:10:30.031258 (+  1057us) log.cc:844] Serialized 14 byte log entry
0709 12:10:30.063178 (+ 31920us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:30.063236 (+    58us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:30.063290 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:30.063363 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:30.063513 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":318,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":74,"raft.queue_time_us":1799,"raft.run_cpu_time_us":236,"raft.run_wall_time_us":238,"thread_start_us":29248,"threads_started":1,"wal-append.queue_time_us":75862}
W20260709 12:10:30.076269 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 63503.5us
I20260709 12:10:30.130295 14181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56046 (request call id 1783) took 1310 ms. Trace:
I20260709 12:10:30.076826 14184 raft_consensus.cc:1240] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:10:30.126777 16464 raft_consensus.cc:515] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:10:30.124658 14908 rpcz_store.cc:269] 0709 12:10:27.052188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:27.063054 (+ 10866us) service_pool.cc:224] Handling call
0709 12:10:28.663115 (+1600061us) spinlock_profiling.cc:243] Waited 2.84 ms on lock 0x7b5800096698. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2124016b71 00007f2124016a22 00007f212cf2f8d9 00007f212c089ee0 00007f212c1530ab 00007f212c153131 00007f212c1010a0 00007f212c100984 00007f212567b6d4 00007f212567b662
0709 12:10:29.967795 (+1304680us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b5400648f54. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:10:29.968200 (+   405us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2522846336}
I20260709 12:10:30.131809 16534 raft_consensus.cc:493] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:30.077231 16451 consensus_queue.cc:1048] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.016s
I20260709 12:10:30.129451 14183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56046 (request call id 1788) took 1308 ms. Trace:
I20260709 12:10:30.094471 14189 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 2035) took 1296 ms. Trace:
I20260709 12:10:30.111598 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
W20260709 12:10:30.114750 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 255532us
I20260709 12:10:30.125792 14185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56046 (request call id 1786) took 1304 ms. Trace:
I20260709 12:10:30.114624 14182 rpcz_store.cc:276] 0709 12:10:28.603229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:28.635867 (+ 32638us) service_pool.cc:224] Handling call
0709 12:10:28.636157 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:28.636364 (+   207us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:10:28.811009 (+174645us) log.cc:844] Serialized 14 byte log entry
0709 12:10:29.739829 (+928820us) log.cc:844] Serialized 14 byte log entry
0709 12:10:30.026050 (+286221us) spinlock_profiling.cc:243] Waited 6.05 ms on lock 0x7b1800198f40. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f212cf16ab1 00007f212cf23281 00007f212404e3f3 00007f21240507c1 00007f2124050779 00007f2124050709 00007f21240506d1 00007f212404f9cd 0000000000388634 0000000000388479 00007f212403183a
0709 12:10:30.032882 (+  6832us) spinlock_profiling.cc:243] Waited 5.96 ms on lock 0x7b1800198f40. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f212cf16ab1 00007f212cf23281 00007f212404e3f3 00007f21240507c1 00007f2124050779 00007f2124050709 00007f21240506d1 00007f212404f9cd 0000000000388634 0000000000388479 00007f212403183a
0709 12:10:30.068384 (+ 35502us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:30.072708 (+  4324us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:30.101475 (+ 28767us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:30.113781 (+ 12306us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:30.113934 (+   153us) inbound_call.cc:177] Queueing success response
0709 12:10:30.118505 (+  4571us) spinlock_profiling.cc:243] Waited 5.62 ms on lock 0x7b1800198f40. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f212cf16ab1 00007f212cf23281 00007f212404e522 00007f21240507c1 00007f2124050779 00007f2124050709 00007f21240506d1 00007f212404f9cd 0000000000388634 0000000000388479 00007f212403183a
Metrics: {"mutex_wait_us":689934,"prepare.queue_time_us":238617,"prepare.run_cpu_time_us":105,"prepare.run_wall_time_us":107,"raft.queue_time_us":714625,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":8339,"spinlock_wait_cycles":66660224,"thread_start_us":648753,"threads_started":3,"wal-append.queue_time_us":943202}
I20260709 12:10:30.135638 14183 rpcz_store.cc:276] 0709 12:10:28.821515 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:30.128338 (+1306823us) service_pool.cc:224] Handling call
0709 12:10:30.128723 (+   385us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:30.129057 (+   334us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:30.129084 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:30.129145 (+    61us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:30.129175 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:30.129231 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:30.129385 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:30.123991 14190 rpcz_store.cc:276] 0709 12:10:28.820680 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:30.122263 (+1301583us) service_pool.cc:224] Handling call
0709 12:10:30.122755 (+   492us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:30.123128 (+   373us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:30.123155 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:30.123216 (+    61us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:30.123250 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:30.123307 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:30.123418 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:30.073427 14186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 2033) took 1275 ms. Trace:
I20260709 12:10:30.130736 14229 leader_election.cc:304] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:30.130710 14181 rpcz_store.cc:276] 0709 12:10:28.819972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:30.116250 (+1296278us) service_pool.cc:224] Handling call
0709 12:10:30.116825 (+   575us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:30.117362 (+   537us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:30.117398 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:30.117480 (+    82us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:30.117643 (+   163us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:30.129971 (+ 12328us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:30.130222 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:30.136279 14185 rpcz_store.cc:276] 0709 12:10:28.820942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:30.123959 (+1303017us) service_pool.cc:224] Handling call
0709 12:10:30.124475 (+   516us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:30.125447 (+   972us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:30.125702 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:30.111418 15827 leader_election.cc:290] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 3 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:30.146879 16495 raft_consensus.cc:3055] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:30.147382 16495 raft_consensus.cc:740] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:10:30.147784 14909 raft_consensus.cc:1240] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:10:30.148607 16495 consensus_queue.cc:260] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:30.149816 16364 raft_consensus.cc:493] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:30.150206 16452 leader_election.cc:290] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:30.150804 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:30.142171 16498 raft_consensus.cc:2749] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:30.151835 14185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56652 (request call id 381) took 1226 ms. Trace:
I20260709 12:10:30.152292 14187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56044 (request call id 2037) took 1218 ms. Trace:
I20260709 12:10:30.152616 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:30.153591 14182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56652 (request call id 382) took 1227 ms. Trace:
I20260709 12:10:30.154011 14182 rpcz_store.cc:276] 0709 12:10:28.926015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:30.152421 (+1226406us) service_pool.cc:224] Handling call
0709 12:10:30.152850 (+   429us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:30.153211 (+   361us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:30.153240 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:30.153287 (+    47us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:30.153355 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:30.153421 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:30.153524 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:30.150161 15924 leader_election.cc:290] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:30.154749 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:30.142802 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:30.144426 14184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56046 (request call id 1780) took 1540 ms. Trace:
I20260709 12:10:30.144618 16532 raft_consensus.cc:515] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:30.145404 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:30.145521 14188 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 2031) took 1343 ms. Trace:
I20260709 12:10:30.160611 14188 rpcz_store.cc:276] 0709 12:10:28.797131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:30.013226 (+1216095us) service_pool.cc:224] Handling call
0709 12:10:30.013769 (+   543us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:30.139931 (+126162us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:30.140258 (+   327us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:30.159758 14187 rpcz_store.cc:276] 0709 12:10:28.934176 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:29.115413 (+181237us) service_pool.cc:224] Handling call
0709 12:10:29.728774 (+613361us) spinlock_profiling.cc:243] Waited 16.7 ms on lock 0x7b5800001298. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2124016b71 00007f2124016a22 00007f212cf2f8d9 00007f212c089ee0 00007f212c1530ab 00007f212c153131 00007f212c1010a0 00007f212c100984 00007f212567b6d4 00007f212567b662
0709 12:10:30.152039 (+423265us) spinlock_profiling.cc:243] Waited 91.2 ms on lock 0x7b540019bed4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:10:30.152221 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":248157312}
I20260709 12:10:30.152287 14185 rpcz_store.cc:276] 0709 12:10:28.925551 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:30.139441 (+1213890us) service_pool.cc:224] Handling call
0709 12:10:30.150935 (+ 11494us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:30.151290 (+   355us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:30.151314 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:30.151370 (+    56us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:30.151555 (+   185us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:30.151637 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:30.151761 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:30.138469 14189 rpcz_store.cc:276] 0709 12:10:28.798395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:30.088960 (+1290565us) service_pool.cc:224] Handling call
0709 12:10:30.089515 (+   555us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:30.094018 (+  4503us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:30.094057 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:30.094121 (+    64us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:30.094155 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:30.094212 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:30.094354 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:30.160010 14184 rpcz_store.cc:276] 0709 12:10:28.603730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:29.974973 (+1371243us) service_pool.cc:224] Handling call
0709 12:10:30.038302 (+ 63329us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:30.131126 (+ 92824us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:30.144146 (+ 13020us) spinlock_profiling.cc:243] Waited 47.2 ms on lock 0x7b54003a34d0. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713a8ad 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:10:30.144316 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":108641024}
I20260709 12:10:30.167620 16364 raft_consensus.cc:515] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:30.170348 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:30.171468 16364 leader_election.cc:290] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:30.171927 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:30.172426 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:30.173094 14877 leader_election.cc:304] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:30.174317 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:30.175025 14332 raft_consensus.cc:2468] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 3.
I20260709 12:10:30.175134 14339 raft_consensus.cc:2410] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:10:30.173496 14333 raft_consensus.cc:1275] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:10:30.185170 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:30.172302 16532 leader_election.cc:290] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:30.186008 14337 raft_consensus.cc:2468] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 2.
W20260709 12:10:30.186872 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 81519.6us
I20260709 12:10:30.190265 16464 leader_election.cc:290] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:30.190830 16335 raft_consensus.cc:2749] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:30.191565 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:30.193699 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:30.196177 14335 raft_consensus.cc:2468] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 3.
I20260709 12:10:30.190174 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:30.197930 14332 raft_consensus.cc:2468] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 4.
I20260709 12:10:30.198601 15827 raft_consensus.cc:2749] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:30.199029 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:30.150370 16455 raft_consensus.cc:493] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:10:30.200022 16455 raft_consensus.cc:515] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:30.200410 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:30.201220 14337 raft_consensus.cc:3060] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:30.201421 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
W20260709 12:10:30.201713 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 81703us
I20260709 12:10:30.202293 14333 raft_consensus.cc:3060] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:30.202744 14155 leader_election.cc:304] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:30.203372 16354 raft_consensus.cc:3055] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:30.203836 16354 raft_consensus.cc:740] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:10:30.204547 14155 leader_election.cc:304] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:30.201357 16224 consensus_queue.cc:1059] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 12:10:30.187297 14912 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59144 (request call id 227) took 1141 ms. Trace:
I20260709 12:10:30.206336 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:30.206856 14261 raft_consensus.cc:1240] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:30.207746 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:30.206570 14912 rpcz_store.cc:276] 0709 12:10:29.052822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:29.765887 (+713065us) service_pool.cc:224] Handling call
0709 12:10:29.774984 (+  9097us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:29.789846 (+ 14862us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:29.789882 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:29.821867 (+ 31985us) log.cc:844] Serialized 26 byte log entry
0709 12:10:30.059782 (+237915us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:30.068745 (+  8963us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:30.070620 (+  1875us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:30.120854 (+ 50234us) spinlock_profiling.cc:243] Waited 1.91 ms on lock 0x7b54005800a0. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f21270b0dbe 00007f21270bb930 00007f21270bb8d8 00007f21270bb858 00007f21270bb813 00007f21270baa9c 00007f212cfa62f6 00007f212cfa0aa8 00007f21270f77cb 00007f21270fa2c0
0709 12:10:30.133437 (+ 12583us) raft_consensus.cc:1685] finished
0709 12:10:30.133459 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:30.186891 (+ 53432us) spinlock_profiling.cc:243] Waited 8.5 ms on lock 0x7b540020c450. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713a8ad 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:10:30.187054 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3013,"raft.queue_time_us":5094,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":143,"spinlock_wait_cycles":23946880,"thread_start_us":67681,"threads_started":1,"wal-append.queue_time_us":128110}
I20260709 12:10:30.208679 14258 raft_consensus.cc:2468] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 2.
I20260709 12:10:30.211148 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:30.211972 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:30.214879 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:30.215761 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:30.216012 16498 raft_consensus.cc:2804] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:30.216583 16498 raft_consensus.cc:493] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:30.217011 16498 raft_consensus.cc:3060] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:30.217420 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:30.216584 14260 raft_consensus.cc:3060] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:30.218389 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:30.219151 14336 raft_consensus.cc:3060] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:30.222810 16224 raft_consensus.cc:3055] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:30.223491 16224 raft_consensus.cc:740] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:10:30.219063 14257 raft_consensus.cc:1240] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:30.223054 16484 raft_consensus.cc:3060] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:30.226747 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:30.227507 14259 raft_consensus.cc:2468] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 8.
I20260709 12:10:30.228509 14338 raft_consensus.cc:3060] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:30.228675 16419 raft_consensus.cc:493] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:10:30.226213 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:30.229375 16419 raft_consensus.cc:515] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:30.205019 16415 raft_consensus.cc:515] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:30.230140 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:30.231837 16419 leader_election.cc:290] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:30.232240 16415 leader_election.cc:290] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:30.233032 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:30.233893 14331 raft_consensus.cc:2468] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 4.
I20260709 12:10:30.234011 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:30.205070 16354 consensus_queue.cc:260] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:30.235421 16354 raft_consensus.cc:3060] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:30.235872 16464 raft_consensus.cc:2804] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:30.132865 16534 raft_consensus.cc:515] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:30.240227 16534 leader_election.cc:290] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:10:30.241135 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 110580us
W20260709 12:10:30.184823 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 90835.9us
I20260709 12:10:30.233301 16415 raft_consensus.cc:2804] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:10:30.251446 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 62375.7us
I20260709 12:10:30.224963 16224 consensus_queue.cc:260] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:10:30.256690 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 120140us
I20260709 12:10:30.257105 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:30.258606 14261 raft_consensus.cc:2410] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:10:30.259424 14183 raft_consensus.cc:1240] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 12:10:30.202766 16455 leader_election.cc:290] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:10:30.267957 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 63551.9us
I20260709 12:10:30.137441 14186 rpcz_store.cc:276] 0709 12:10:28.797775 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:30.033889 (+1236114us) service_pool.cc:224] Handling call
0709 12:10:30.034607 (+   718us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:30.035064 (+   457us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:10:30.035839 (+   775us) log.cc:844] Serialized 14 byte log entry
0709 12:10:30.073122 (+ 37283us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:30.073172 (+    50us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:30.073208 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:30.073263 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:30.073365 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":187,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":66,"raft.queue_time_us":1524,"raft.run_cpu_time_us":215,"raft.run_wall_time_us":9850,"thread_start_us":31819,"threads_started":1}
I20260709 12:10:30.263638 14183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56046 (request call id 1790) took 1423 ms. Trace:
I20260709 12:10:30.270417 14183 rpcz_store.cc:276] 0709 12:10:28.840651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:30.137129 (+1296478us) service_pool.cc:224] Handling call
0709 12:10:30.245024 (+107895us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:30.263289 (+ 18265us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:30.263550 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:30.264392 14190 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56652 (request call id 379) took 1339 ms. Trace:
I20260709 12:10:30.251674 16415 raft_consensus.cc:493] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:30.282398 14303 leader_election.cc:304] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:30.288002 14230 leader_election.cc:304] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:10:30.271545 14190 rpcz_store.cc:276] 0709 12:10:28.924997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:30.158777 (+1233780us) service_pool.cc:224] Handling call
0709 12:10:30.167463 (+  8686us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:30.167928 (+   465us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:10:30.168351 (+   423us) log.cc:844] Serialized 14 byte log entry
0709 12:10:30.264059 (+ 95708us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:30.264116 (+    57us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:30.264158 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:30.264222 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:30.264330 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5022,"prepare.queue_time_us":1188,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":60,"raft.queue_time_us":15940,"thread_start_us":81982,"threads_started":1}
I20260709 12:10:30.297611 14229 leader_election.cc:304] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:30.298362 14337 raft_consensus.cc:2468] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 5.
W20260709 12:10:30.299240 14878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:30.276768 16415 raft_consensus.cc:3060] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:30.255177 16279 consensus_queue.cc:1048] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 12:10:30.308822 14230 leader_election.cc:304] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:10:30.310458 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:30.314054 16532 raft_consensus.cc:2749] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:30.315179 16443 consensus_queue.cc:1048] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 12:10:30.299881 16531 raft_consensus.cc:2804] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:30.318050 16531 raft_consensus.cc:493] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:30.318331 16279 raft_consensus.cc:2804] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:10:30.314499 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 51058.1us
I20260709 12:10:30.319233 16279 raft_consensus.cc:493] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:10:30.319700 16279 raft_consensus.cc:3060] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:30.320197 14229 leader_election.cc:304] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:30.314071 16495 raft_consensus.cc:3060] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:30.318334 14230 leader_election.cc:304] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:10:30.322657 16164 raft_consensus.cc:2804] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:30.321444 14229 leader_election.cc:304] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:30.324724 16224 raft_consensus.cc:3060] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:30.323091 16164 raft_consensus.cc:493] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:30.318475 16531 raft_consensus.cc:3060] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:30.326373 16164 raft_consensus.cc:3060] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:30.319439 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:30.326083 16424 raft_consensus.cc:2749] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:30.332116 14338 raft_consensus.cc:2468] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 3.
I20260709 12:10:30.327404 14230 leader_election.cc:304] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:10:30.338014 14229 leader_election.cc:304] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:30.340075 14336 raft_consensus.cc:2468] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 5.
I20260709 12:10:30.340431 14260 raft_consensus.cc:2468] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 3.
I20260709 12:10:30.325990 14876 leader_election.cc:304] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:30.334561 14339 raft_consensus.cc:2468] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 3.
I20260709 12:10:30.341701 16534 raft_consensus.cc:2804] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:30.343644 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:30.343950 16534 raft_consensus.cc:493] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:30.344383 16534 raft_consensus.cc:3060] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:30.345116 14156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:30.346163 14905 consensus_meta.cc:287] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db: Time spent flushing consensus metadata: real 0.560s	user 0.007s	sys 0.013s
I20260709 12:10:30.346632 14905 raft_consensus.cc:2468] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 5.
W20260709 12:10:30.347252 14905 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53200 (request call id 388) took 1494 ms (client timeout 1635 ms). Trace:
W20260709 12:10:30.347657 14905 rpcz_store.cc:269] 0709 12:10:28.852797 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:28.916517 (+ 63720us) service_pool.cc:224] Handling call
0709 12:10:30.347168 (+1430651us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:30.322731 16443 raft_consensus.cc:2804] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:30.350745 16501 raft_consensus.cc:515] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:10:30.352098 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 96647.5us
I20260709 12:10:30.342654 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:30.354398 14333 raft_consensus.cc:2468] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 5.
I20260709 12:10:30.357869 16532 raft_consensus.cc:2804] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:30.358246 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:10:30.359690 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 77497.1us
I20260709 12:10:30.305663 16498 raft_consensus.cc:515] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:30.357895 15827 raft_consensus.cc:2804] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:30.367458 14088 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60410 (request call id 255) took 8861 ms. Trace:
I20260709 12:10:30.362679 16532 raft_consensus.cc:493] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:30.374444 16532 raft_consensus.cc:3060] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:30.375388 16545 consensus_queue.cc:1048] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:30.374675 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:30.376670 14304 leader_election.cc:304] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
W20260709 12:10:30.377166 16542 log.cc:927] Time spent T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
I20260709 12:10:30.347412 16464 raft_consensus.cc:493] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:30.377902 16545 raft_consensus.cc:2749] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:30.383981 15827 raft_consensus.cc:697] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 6 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:10:30.378459 16464 raft_consensus.cc:3060] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:30.396207 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 68299.3us
I20260709 12:10:30.398660 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:30.380815 16456 raft_consensus.cc:2749] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:30.363584 16443 raft_consensus.cc:697] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 6 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:10:30.385633 16498 leader_election.cc:290] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 6 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:30.391163 16501 leader_election.cc:290] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 4 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:30.418903 16443 consensus_queue.cc:237] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:30.385251 15827 consensus_queue.cc:237] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:30.430701 14256 raft_consensus.cc:2468] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 5.
I20260709 12:10:30.434607 14261 raft_consensus.cc:3060] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:30.437077 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:30.384073 16534 raft_consensus.cc:515] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:30.441504 14258 raft_consensus.cc:2468] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 2.
I20260709 12:10:30.390798 16358 raft_consensus.cc:515] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:30.457784 14332 raft_consensus.cc:2393] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 9: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:10:30.460011 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:30.456488 14260 raft_consensus.cc:3055] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:30.462059 14260 raft_consensus.cc:740] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:10:30.466640 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:30.466503 14155 leader_election.cc:304] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:30.446264 16517 raft_consensus.cc:515] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:30.474143 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
W20260709 12:10:30.479624 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:30.512079 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:10:30.513352 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 48172.4us
I20260709 12:10:30.519070 14260 consensus_queue.cc:260] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:30.520679 14303 leader_election.cc:304] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:30.520514 16285 consensus_queue.cc:1059] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:30.521945 16285 raft_consensus.cc:3055] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:30.522327 16285 raft_consensus.cc:740] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:30.522759 16517 leader_election.cc:290] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:30.523288 16285 consensus_queue.cc:260] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:30.524596 16285 raft_consensus.cc:3060] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:30.525959 14263 raft_consensus.cc:1240] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:30.526405 14330 raft_consensus.cc:2410] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:10:30.526791 16544 raft_consensus.cc:2804] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:30.527290 16544 raft_consensus.cc:493] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:30.527637 16544 raft_consensus.cc:3060] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:30.520543 14260 raft_consensus.cc:3060] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:30.533898 14230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:30.537192 14230 leader_election.cc:304] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
W20260709 12:10:30.537972 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 84698.4us
I20260709 12:10:30.540720 16145 raft_consensus.cc:2804] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:30.541584 16145 raft_consensus.cc:697] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 4 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:10:30.541839 14258 raft_consensus.cc:2368] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for earlier term 4. Current term is 5.
I20260709 12:10:30.543134 16145 consensus_queue.cc:237] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:30.545311 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:30.550733 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:30.550902 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:30.547540 14336 raft_consensus.cc:1240] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:30.545441 14338 raft_consensus.cc:1240] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:10:30.548178 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:30.553148 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:30.554383 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:30.544413 16484 raft_consensus.cc:493] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:30.549259 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:30.550189 16447 raft_consensus.cc:493] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:30.549760 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:30.554833 16358 leader_election.cc:290] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 9 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:30.556039 14187 raft_consensus.cc:2468] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 1.
I20260709 12:10:30.556787 14189 raft_consensus.cc:2468] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 2.
I20260709 12:10:30.555683 14188 raft_consensus.cc:3060] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:30.557281 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:30.555286 16484 raft_consensus.cc:515] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:30.558677 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:30.559414 14184 raft_consensus.cc:2393] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 4: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:10:30.560432 16484 leader_election.cc:290] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:30.560659 14184 raft_consensus.cc:1240] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 5. Current term is 6. Ops: []
W20260709 12:10:30.555224 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 44453us
I20260709 12:10:30.556268 16447 raft_consensus.cc:515] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:30.554813 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:10:30.551687 14183 raft_consensus.cc:2468] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 3.
I20260709 12:10:30.544121 16544 raft_consensus.cc:515] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:30.551640 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:30.555286 14185 raft_consensus.cc:2468] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 4.
I20260709 12:10:30.548892 14186 raft_consensus.cc:1240] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:10:30.367987 14088 rpcz_store.cc:276] 0709 12:10:21.506165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:21.521923 (+ 15758us) service_pool.cc:224] Handling call
0709 12:10:30.367135 (+8845212us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:26.427825 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:26.428846 (+  1021us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:26.428907 (+    61us) write_op.cc:435] Acquired schema lock
0709 12:10:26.428953 (+    46us) tablet.cc:662] Decoding operations
0709 12:10:26.751994 (+323041us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:26.763399 (+ 11405us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:26.806866 (+ 43467us) tablet.cc:685] Acquiring locks for 8 operations
0709 12:10:26.930750 (+123884us) tablet.cc:701] Row locks acquired
0709 12:10:26.930771 (+    21us) write_op.cc:260] PREPARE: finished
0709 12:10:26.931062 (+   291us) write_op.cc:270] Start()
0709 12:10:26.931247 (+   185us) write_op.cc:276] Timestamp: P: 1783599026930972 usec, L: 0
0709 12:10:26.931268 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:10:26.933090 (+  1822us) log.cc:844] Serialized 3282 byte log entry
0709 12:10:28.497512 (+1564422us) op_driver.cc:464] REPLICATION: finished
0709 12:10:28.668146 (+170634us) write_op.cc:301] APPLY: starting
0709 12:10:28.668249 (+   103us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:28.668491 (+   242us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:28.668606 (+   115us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:28.669608 (+  1002us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:28.669845 (+   237us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=8
0709 12:10:28.669894 (+    49us) write_op.cc:312] APPLY: finished
0709 12:10:28.670146 (+   252us) log.cc:844] Serialized 65 byte log entry
0709 12:10:28.670312 (+   166us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:28.670437 (+   125us) write_op.cc:454] Released schema lock
0709 12:10:28.670499 (+    62us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:28.670870 (+   371us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:28.670895 (+    25us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":13657,"reported_tablets":20,"child_traces":[["op",{"apply.queue_time_us":170359,"apply.run_cpu_time_us":2708,"apply.run_wall_time_us":2708,"num_ops":8,"prepare.queue_time_us":270312,"prepare.run_cpu_time_us":22095,"prepare.run_wall_time_us":658499,"raft.queue_time_us":1115271,"raft.run_cpu_time_us":25394,"raft.run_wall_time_us":123139,"replication_time_us":1566045,"thread_start_us":1446687,"threads_started":4,"wal-append.queue_time_us":210710,"wal-append.run_cpu_time_us":29296,"wal-append.run_wall_time_us":2522993}]]}
I20260709 12:10:30.581836 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:30.596177 14912 raft_consensus.cc:3060] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:30.602253 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:30.622687 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:30.586385 16521 raft_consensus.cc:2804] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:30.630424 14188 raft_consensus.cc:2468] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 6.
I20260709 12:10:30.636617 14259 raft_consensus.cc:2468] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 3.
W20260709 12:10:30.639663 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 111929us
W20260709 12:10:30.644690 14230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:30.631806 16534 leader_election.cc:290] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 4 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:30.649266 14877 leader_election.cc:304] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:30.653849 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:30.606123 16531 raft_consensus.cc:515] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:30.660677 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:30.659523 16335 consensus_queue.cc:1059] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 12:10:30.686586 16335 raft_consensus.cc:3055] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:30.687042 16335 raft_consensus.cc:740] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
W20260709 12:10:30.687283 16553 log.cc:927] Time spent T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.109s	user 0.000s	sys 0.001s
I20260709 12:10:30.688112 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:10:30.692586 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 47060.5us
I20260709 12:10:30.693601 14259 raft_consensus.cc:2468] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 4.
I20260709 12:10:30.694804 14181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 2036) took 1765 ms. Trace:
I20260709 12:10:30.669946 16452 raft_consensus.cc:493] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:10:30.697994 16335 consensus_queue.cc:260] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:10:30.701812 14305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:30.666141 16279 raft_consensus.cc:515] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:10:30.713194 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 73750.1us
I20260709 12:10:30.687299 16531 leader_election.cc:290] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 7 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:10:30.684305 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 64753.3us
I20260709 12:10:30.695184 14181 rpcz_store.cc:276] 0709 12:10:28.925370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:30.138397 (+1213027us) service_pool.cc:224] Handling call
0709 12:10:30.211989 (+ 73592us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:30.251303 (+ 39314us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:30.251342 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:30.296007 (+ 44665us) log.cc:844] Serialized 26 byte log entry
0709 12:10:30.436297 (+140290us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:30.436350 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:30.436440 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:30.690739 (+254299us) raft_consensus.cc:1685] finished
0709 12:10:30.690766 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:30.690916 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28923,"raft.queue_time_us":37763,"raft.run_cpu_time_us":220,"raft.run_wall_time_us":18898,"thread_start_us":109081,"threads_started":1,"wal-append.queue_time_us":127988}
I20260709 12:10:30.724717 14877 leader_election.cc:304] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:30.735342 14182 raft_consensus.cc:2410] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:10:30.737653 16521 raft_consensus.cc:697] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 5 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:10:30.749454 15827 raft_consensus.cc:2804] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:30.726109 16415 raft_consensus.cc:515] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:10:30.765196 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 51941.2us
I20260709 12:10:30.785018 16335 raft_consensus.cc:3060] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:30.758901 16452 raft_consensus.cc:515] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:30.785840 14877 leader_election.cc:304] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:10:30.786780 14877 leader_election.cc:304] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:10:30.787623 14877 leader_election.cc:304] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:10:30.761073 16544 leader_election.cc:290] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 4 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:30.750605 16355 consensus_queue.cc:1059] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.121s
I20260709 12:10:30.784590 14339 consensus_queue.cc:237] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } }
I20260709 12:10:30.792984 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:30.774324 15827 raft_consensus.cc:493] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:10:30.802068 16521 consensus_queue.cc:237] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:30.803709 16355 raft_consensus.cc:3055] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:30.804138 16355 raft_consensus.cc:740] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:10:30.806196 14330 raft_consensus.cc:1240] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 12:10:30.798414 16114 raft_consensus.cc:2804] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:30.807202 16114 raft_consensus.cc:697] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 3 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:10:30.808353 16114 consensus_queue.cc:237] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:30.787544 16452 leader_election.cc:290] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:30.801542 16415 leader_election.cc:290] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 7 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:30.793263 16495 raft_consensus.cc:2804] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:30.811946 15827 raft_consensus.cc:3060] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:30.815558 14338 raft_consensus.cc:1240] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:10:30.816242 14912 raft_consensus.cc:2468] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 6.
I20260709 12:10:30.818475 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:30.818681 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:30.828985 14334 raft_consensus.cc:2393] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 4: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:10:30.819262 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:10:30.801559 16562 log.cc:927] Time spent T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 12:10:30.820549 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:30.832947 14335 raft_consensus.cc:3060] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:30.819329 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:30.818244 14261 raft_consensus.cc:2468] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 4.
I20260709 12:10:30.829676 14337 raft_consensus.cc:2393] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 5: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:10:30.819869 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:30.805130 16355 consensus_queue.cc:260] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:30.835500 14256 raft_consensus.cc:1240] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:30.838195 14338 raft_consensus.cc:1240] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 5 LEADER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 4. Current term is 5. Ops: [4.3-4.3]
W20260709 12:10:30.554910 16456 consensus_queue.cc:1175] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "885067a0d31741bfb5c9935788e315bf" responder_term: 5 status { last_received { term: 2 index: 2 } last_committed_idx: 2 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 4. Current term is 5. Ops: [4.3-4.3]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:10:30.840451 14333 raft_consensus.cc:2393] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 4: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:10:30.842249 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
W20260709 12:10:30.842628 14302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:30.843134 14264 raft_consensus.cc:3060] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:30.846055 16296 raft_consensus.cc:2804] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:10:30.836061 16556 log.cc:927] Time spent T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.180s	user 0.002s	sys 0.000s
I20260709 12:10:30.850091 14336 raft_consensus.cc:2393] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 6: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:10:30.852480 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:30.858600 14338 raft_consensus.cc:1240] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:10:30.795485 16563 consensus_queue.cc:1048] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.048s
I20260709 12:10:30.874123 16447 leader_election.cc:290] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:10:30.877071 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 326897us
I20260709 12:10:30.877616 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:30.879822 14303 leader_election.cc:304] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:30.865309 16355 raft_consensus.cc:3060] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:30.839077 16210 raft_consensus.cc:2749] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:30.901363 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:30.867559 14155 leader_election.cc:304] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:30.902714 14332 raft_consensus.cc:2468] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 3.
I20260709 12:10:30.869692 16279 leader_election.cc:290] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:10:30.872946 16164 consensus_meta.cc:287] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.546s	user 0.010s	sys 0.004s
W20260709 12:10:30.919797 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 52385.1us
I20260709 12:10:30.881405 14303 leader_election.cc:304] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:10:30.881816 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:30.886389 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:30.903671 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:30.903834 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:30.831782 16464 raft_consensus.cc:515] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:30.914083 14905 raft_consensus.cc:1240] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:30.914839 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:30.916136 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:30.927865 14335 raft_consensus.cc:2468] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 4.
I20260709 12:10:30.915716 14087 catalog_manager.cc:5697] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c reported cstate change: term changed from 2 to 5, leader changed from 885067a0d31741bfb5c9935788e315bf (127.12.174.129) to 65c9c1653b3346b39a0e118540e6080c (127.12.174.131). New cstate: current_term: 5 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:30.882913 16296 raft_consensus.cc:697] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 5 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:10:30.938267 16296 consensus_queue.cc:237] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:30.939383 16464 leader_election.cc:290] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:30.849040 16495 raft_consensus.cc:697] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 5 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
W20260709 12:10:30.941856 14156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:30.941712 16495 consensus_queue.cc:237] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:30.942617 14229 leader_election.cc:304] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:30.943718 16563 raft_consensus.cc:2749] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:30.903900 16447 raft_consensus.cc:2749] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:10:30.906250 16532 consensus_meta.cc:287] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.531s	user 0.007s	sys 0.005s
I20260709 12:10:30.922739 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:30.928725 14330 raft_consensus.cc:1240] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:10:30.929409 14335 raft_consensus.cc:1240] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 8. Current term is 9. Ops: [8.5-8.5]
W20260709 12:10:30.930038 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 48724.9us
I20260709 12:10:30.930546 16544 raft_consensus.cc:2804] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:30.931257 14259 raft_consensus.cc:2410] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:10:30.932435 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:30.933058 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:30.933331 16145 raft_consensus.cc:2804] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:30.954715 14336 raft_consensus.cc:2368] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 3. Current term is 4.
I20260709 12:10:30.904712 14331 raft_consensus.cc:1240] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 4. Current term is 5. Ops: [2.2-4.3]
I20260709 12:10:30.946331 16532 raft_consensus.cc:515] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:10:31.082551 14303 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:31.017107 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
W20260709 12:10:31.234978 14303 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:31.049454 14183 raft_consensus.cc:1240] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:31.162755 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:30.959563 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:31.044564 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:31.046310 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:31.049110 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:30.947958 16164 raft_consensus.cc:515] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:10:31.002215 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:31.046741 14908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:31.096186 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:31.024147 14087 catalog_manager.cc:5697] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:31.095386 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
W20260709 12:10:31.053248 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 45143us
I20260709 12:10:31.250123 14186 raft_consensus.cc:2410] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:10:31.237921 14256 raft_consensus.cc:2468] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 8.
I20260709 12:10:30.999554 14333 raft_consensus.cc:2393] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db in current term 5: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
W20260709 12:10:31.050344 14304 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:31.048292 14260 raft_consensus.cc:1275] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 12:10:31.008044 14155 leader_election.cc:304] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:31.044627 14264 raft_consensus.cc:2468] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 5.
I20260709 12:10:31.122871 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:31.253115 14258 raft_consensus.cc:3060] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:10:31.048704 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:31.244333 14182 raft_consensus.cc:3060] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:31.110013 14188 raft_consensus.cc:1275] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:31.246661 14181 raft_consensus.cc:3060] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:31.049511 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:31.241375 14261 raft_consensus.cc:2410] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for term 5 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 1.
I20260709 12:10:31.045687 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:10:30.968727 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:31.235133 14259 raft_consensus.cc:2376] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 4. Re-sending same reply.
I20260709 12:10:31.259057 14261 raft_consensus.cc:1240] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:31.259529 16394 raft_consensus.cc:493] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:31.260085 16394 raft_consensus.cc:515] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:31.260578 14230 leader_election.cc:304] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:31.260948 16545 consensus_queue.cc:1059] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:31.260118 14087 catalog_manager.cc:5697] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:31.262061 16545 raft_consensus.cc:3055] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:31.262444 16545 raft_consensus.cc:740] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:31.263478 16545 consensus_queue.cc:260] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:30.983433 15827 raft_consensus.cc:515] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:31.259148 14904 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98"
dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
mode: GRACEFUL
new_leader_uuid: "17aab1bbf5014936aa18cc21818b26ec"
 from {username='slave'} at 127.0.0.1:38628
I20260709 12:10:31.260653 14303 leader_election.cc:304] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:31.271353 14262 raft_consensus.cc:1240] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:30.955780 16145 raft_consensus.cc:493] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:31.281787 14303 leader_election.cc:304] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:31.273128 14912 raft_consensus.cc:1240] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 4. Current term is 5. Ops: []
W20260709 12:10:31.269079 14230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:31.270987 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:10:31.300987 14302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:31.289139 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 341140us
I20260709 12:10:31.002622 16544 raft_consensus.cc:697] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 6 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:31.251955 14260 pending_rounds.cc:85] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec: Aborting all ops after (but not including) 2
I20260709 12:10:31.266407 14087 catalog_manager.cc:5697] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c reported cstate change: term changed from 2 to 3, leader changed from 65c9c1653b3346b39a0e118540e6080c (127.12.174.131) to 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130). New cstate: current_term: 3 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } }
W20260709 12:10:31.344455 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 62777us
I20260709 12:10:31.334842 14189 raft_consensus.cc:2468] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 6.
W20260709 12:10:31.336558 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 45813.9us
I20260709 12:10:31.289989 14264 raft_consensus.cc:1240] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:31.339752 14260 pending_rounds.cc:107] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:10:31.349334 14260 raft_consensus.cc:2889] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:31.266642 16456 raft_consensus.cc:2804] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:31.264717 16545 raft_consensus.cc:3060] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:31.282002 16484 raft_consensus.cc:2804] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:31.272462 16164 leader_election.cc:290] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:31.275689 15827 leader_election.cc:290] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 5 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:31.350250 16354 raft_consensus.cc:493] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:31.379498 16354 raft_consensus.cc:515] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:31.380191 16456 raft_consensus.cc:697] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 3 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:10:31.340399 14087 catalog_manager.cc:5697] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c reported cstate change: term changed from 2 to 3, leader changed from 885067a0d31741bfb5c9935788e315bf (127.12.174.129) to 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130). New cstate: current_term: 3 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } }
I20260709 12:10:31.386493 14087 catalog_manager.cc:5697] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:10:31.388103 14155 leader_election.cc:304] T f4739bc22bfe44fcba807da02d9351b6 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:31.388990 16354 leader_election.cc:290] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:31.349647 16285 raft_consensus.cc:2804] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:31.008373 16279 consensus_queue.cc:1059] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.340s
I20260709 12:10:31.332990 16498 raft_consensus.cc:2804] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:31.274067 14904 raft_consensus.cc:606] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 2 LEADER]: Received request to transfer leadership to TS 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:10:31.388494 14087 catalog_manager.cc:5697] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c reported cstate change: term changed from 2 to 3, leader changed from 65c9c1653b3346b39a0e118540e6080c (127.12.174.131) to 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130). New cstate: current_term: 3 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } }
I20260709 12:10:31.389129 16464 raft_consensus.cc:2749] T f4739bc22bfe44fcba807da02d9351b6 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:31.389375 14155 leader_election.cc:304] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:31.357597 14303 leader_election.cc:304] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:31.270531 16394 leader_election.cc:290] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:31.338593 16145 raft_consensus.cc:3060] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:31.381292 16456 consensus_queue.cc:237] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:10:31.405077 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 220966us
I20260709 12:10:31.369486 16484 raft_consensus.cc:493] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:10:31.398705 16285 raft_consensus.cc:493] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
W20260709 12:10:31.410555 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 53074.7us
I20260709 12:10:31.411499 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:31.404095 16498 raft_consensus.cc:493] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:10:31.413601 14087 catalog_manager.cc:5697] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c reported cstate change: term changed from 1 to 3, leader changed from 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130) to 65c9c1653b3346b39a0e118540e6080c (127.12.174.131). New cstate: current_term: 3 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } }
W20260709 12:10:31.408372 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 61039.7us
I20260709 12:10:31.424232 14303 leader_election.cc:304] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:31.419795 16464 raft_consensus.cc:2804] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:31.405864 16501 consensus_queue.cc:1059] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 12:10:31.399693 16540 consensus_queue.cc:1048] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 12:10:31.404297 16224 consensus_queue.cc:1059] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 12:10:31.417924 16452 raft_consensus.cc:2804] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:31.426952 14229 leader_election.cc:304] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:31.427423 14303 leader_election.cc:304] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:31.431263 14087 catalog_manager.cc:5697] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:31.448280 16464 raft_consensus.cc:493] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:31.462843 16464 raft_consensus.cc:3060] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:31.465890 16544 consensus_queue.cc:237] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:31.466073 16394 raft_consensus.cc:2804] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:31.425091 16285 raft_consensus.cc:3060] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:31.470371 16578 log.cc:927] Time spent T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:10:31.424185 16484 raft_consensus.cc:3060] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:10:31.480436 14156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:31.437723 16545 raft_consensus.cc:2804] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:31.448280 16498 raft_consensus.cc:3060] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:31.456117 16452 raft_consensus.cc:493] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
W20260709 12:10:31.495462 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 70474.1us
I20260709 12:10:31.489822 16545 raft_consensus.cc:493] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:31.482014 16279 raft_consensus.cc:2804] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:31.476642 16211 consensus_queue.cc:1059] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 12:10:31.509953 15827 consensus_queue.cc:1059] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:31.514274 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:31.515148 14337 raft_consensus.cc:1275] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:31.516360 14330 raft_consensus.cc:1275] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:10:31.513551 14335 raft_consensus.cc:1240] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:31.516793 14264 raft_consensus.cc:3055] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:31.543159 14264 raft_consensus.cc:740] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:10:31.517779 14260 raft_consensus.cc:1240] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 12:10:31.514184 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:31.544644 14334 raft_consensus.cc:3060] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:31.499362 16452 raft_consensus.cc:3060] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:31.523460 14257 raft_consensus.cc:1275] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:10:31.524302 16573 consensus_queue.cc:1059] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:31.524670 14265 raft_consensus.cc:3055] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:31.524484 14904 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb"
dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
mode: GRACEFUL
new_leader_uuid: "17aab1bbf5014936aa18cc21818b26ec"
 from {username='slave'} at 127.0.0.1:38628
W20260709 12:10:31.532006 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 105144us
I20260709 12:10:31.525617 16532 leader_election.cc:290] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:31.547084 14155 leader_election.cc:304] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:31.549002 14265 raft_consensus.cc:740] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:10:31.540918 16279 raft_consensus.cc:493] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:31.554147 16279 raft_consensus.cc:3060] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:31.530529 16580 raft_consensus.cc:493] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:31.540350 16545 raft_consensus.cc:3060] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:31.557550 14877 leader_election.cc:304] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:31.557211 14229 leader_election.cc:304] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:31.554476 14265 consensus_queue.cc:260] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:10:31.563419 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 68704.6us
I20260709 12:10:31.555481 14904 raft_consensus.cc:606] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Received request to transfer leadership to TS 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:10:31.567958 16532 raft_consensus.cc:2749] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:31.561225 16394 raft_consensus.cc:697] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 6 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:31.569919 14264 consensus_queue.cc:260] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:31.571774 14904 raft_consensus.cc:614] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:10:31.599227 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 58631.3us
I20260709 12:10:31.582960 16591 raft_consensus.cc:3055] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:31.601933 14304 leader_election.cc:304] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:31.600088 14265 raft_consensus.cc:3060] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:31.596750 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 130217us
I20260709 12:10:31.604799 14264 raft_consensus.cc:3060] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:31.585829 16536 raft_consensus.cc:3055] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:31.606771 16536 raft_consensus.cc:740] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:10:31.607731 16536 consensus_queue.cc:260] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:31.580400 16584 consensus_queue.cc:1048] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 12:10:31.609457 14258 raft_consensus.cc:2468] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 4.
I20260709 12:10:31.610844 14229 leader_election.cc:304] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:31.609699 14182 raft_consensus.cc:2468] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 9.
I20260709 12:10:31.615657 14264 raft_consensus.cc:1275] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 12:10:31.616139 14264 pending_rounds.cc:85] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec: Aborting all ops after (but not including) 6
I20260709 12:10:31.616460 14264 pending_rounds.cc:107] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 12:10:31.616660 14264 raft_consensus.cc:2889] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:31.598709 16573 raft_consensus.cc:2749] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:10:31.617071 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 56352.5us
I20260709 12:10:31.622902 14181 raft_consensus.cc:2468] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 4.
I20260709 12:10:31.610587 16335 raft_consensus.cc:493] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:31.602305 16591 raft_consensus.cc:740] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:10:31.573042 16580 raft_consensus.cc:515] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:31.634009 14181 raft_consensus.cc:1275] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 12:10:31.634594 14181 pending_rounds.cc:85] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf: Aborting all ops after (but not including) 5
I20260709 12:10:31.634929 14181 pending_rounds.cc:107] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 12:10:31.635275 14181 raft_consensus.cc:2889] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:31.624910 16164 raft_consensus.cc:2804] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:10:31.643746 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 86285.7us
I20260709 12:10:31.647192 16114 raft_consensus.cc:3055] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:31.647706 16114 raft_consensus.cc:740] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:10:31.648662 16114 consensus_queue.cc:260] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:10:31.650363 16585 log.cc:927] Time spent T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 12:10:31.652209 16590 raft_consensus.cc:2804] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:31.652768 16590 raft_consensus.cc:493] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:10:31.653134 16590 raft_consensus.cc:3060] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:31.653618 16596 raft_consensus.cc:493] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:31.654232 16596 raft_consensus.cc:515] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:31.656644 16596 leader_election.cc:290] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:31.657636 16591 consensus_queue.cc:260] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:31.629185 16335 raft_consensus.cc:515] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:31.659072 16591 raft_consensus.cc:3060] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:31.661448 14304 leader_election.cc:304] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:31.662220 14182 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686"
dest_uuid: "885067a0d31741bfb5c9935788e315bf"
mode: GRACEFUL
new_leader_uuid: "17aab1bbf5014936aa18cc21818b26ec"
 from {username='slave'} at 127.0.0.1:52548
I20260709 12:10:31.671320 14182 raft_consensus.cc:606] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Received request to transfer leadership to TS 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:10:31.671693 14182 raft_consensus.cc:614] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:31.659353 16580 leader_election.cc:290] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:31.677762 14155 leader_election.cc:304] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:31.680939 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:31.670028 16447 raft_consensus.cc:2749] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:31.683861 14155 leader_election.cc:304] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:31.666560 16164 raft_consensus.cc:697] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 4 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
W20260709 12:10:31.686301 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:31.695971 16576 log.cc:927] Time spent T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.209s	user 0.000s	sys 0.004s
I20260709 12:10:31.707043 14304 leader_election.cc:304] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:31.707912 14265 raft_consensus.cc:1275] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:31.675688 16335 leader_election.cc:290] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:10:31.716655 14230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:31.678478 16114 raft_consensus.cc:3060] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:31.721246 16498 raft_consensus.cc:515] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:31.722088 16279 raft_consensus.cc:515] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:31.723660 16498 leader_election.cc:290] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 3 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:31.721668 14304 leader_election.cc:400] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 4 election: Vote denied by peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673) with higher term. Message: Invalid argument: T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for earlier term 4. Current term is 5.
I20260709 12:10:31.728680 14304 leader_election.cc:403] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
W20260709 12:10:31.724697 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 111806us
I20260709 12:10:31.673810 16544 consensus_queue.cc:1059] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 12:10:31.726852 14155 leader_election.cc:304] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:31.680717 16224 raft_consensus.cc:2749] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:10:31.730216 14230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:31.724725 16354 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
I20260709 12:10:31.659267 16394 consensus_queue.cc:237] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:31.740154 12986 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:10:31.740370 16464 raft_consensus.cc:515] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:31.726649 16447 raft_consensus.cc:2749] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:31.741771 16570 raft_consensus.cc:493] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:31.739646 16279 leader_election.cc:290] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:31.729789 16285 raft_consensus.cc:515] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:31.744118 16279 consensus_queue.cc:1048] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:31.744433 16285 leader_election.cc:290] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:31.736495 14304 leader_election.cc:304] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
W20260709 12:10:31.746652 14156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:31.747677 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 101436us
I20260709 12:10:31.739732 14155 leader_election.cc:304] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:31.727803 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:31.733441 16593 raft_consensus.cc:2804] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:31.727337 16597 raft_consensus.cc:2804] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:31.746575 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:31.761793 12986 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:10:31.723687 16452 raft_consensus.cc:515] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:31.762331 16534 raft_consensus.cc:2749] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:31.763401 16495 consensus_queue.cc:1048] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:31.763551 14304 leader_election.cc:304] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:31.764099 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:10:31.764207 14303 leader_election.cc:304] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:31.761575 16464 leader_election.cc:290] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 4 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:31.778074 14334 raft_consensus.cc:2468] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 5.
I20260709 12:10:31.751458 16584 raft_consensus.cc:2804] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:31.798969 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:31.805869 14264 raft_consensus.cc:1240] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:31.800984 16598 consensus_queue.cc:1048] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 12:10:31.767863 16593 raft_consensus.cc:493] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:10:31.812077 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:31.812441 16593 raft_consensus.cc:3060] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:31.799944 16540 consensus_queue.cc:1048] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.014s
W20260709 12:10:31.814425 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 50321.3us
W20260709 12:10:31.814654 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 51186.6us
I20260709 12:10:31.815316 14304 leader_election.cc:304] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:31.785220 14155 leader_election.cc:304] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:31.742322 16570 raft_consensus.cc:515] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:31.748700 16279 consensus_queue.cc:1059] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 12:10:31.815212 14303 leader_election.cc:304] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:31.784235 14189 raft_consensus.cc:2468] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 5.
I20260709 12:10:31.825955 16586 raft_consensus.cc:2749] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673) with higher term. Message: Invalid argument: T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for earlier term 4. Current term is 5.
I20260709 12:10:31.826200 16447 raft_consensus.cc:2804] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:31.826742 16447 raft_consensus.cc:493] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:31.829854 14303 leader_election.cc:304] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:31.796307 16536 raft_consensus.cc:3060] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:31.832062 14877 leader_election.cc:304] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:31.771937 16597 raft_consensus.cc:493] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:10:31.775504 16498 raft_consensus.cc:2804] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:31.840803 14303 leader_election.cc:304] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:31.827976 16584 raft_consensus.cc:697] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 5 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:10:31.853569 16584 consensus_queue.cc:237] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:31.857079 16602 raft_consensus.cc:2749] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:10:31.859822 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:31.796003 16603 consensus_queue.cc:1059] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 12:10:31.827131 16447 raft_consensus.cc:3060] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:31.830549 16534 raft_consensus.cc:2804] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:31.872972 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:31.878315 14187 raft_consensus.cc:2393] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 3: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
W20260709 12:10:31.875542 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 90290.2us
I20260709 12:10:31.876734 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:31.881269 14188 raft_consensus.cc:1275] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:10:31.837306 16586 raft_consensus.cc:2804] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:31.837203 16464 raft_consensus.cc:2749] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:31.860255 16501 raft_consensus.cc:3055] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:31.838841 16498 raft_consensus.cc:493] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:10:31.836269 16597 raft_consensus.cc:3060] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:31.859165 16456 raft_consensus.cc:493] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:31.815781 16164 consensus_queue.cc:237] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:31.835981 16598 consensus_queue.cc:1059] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 12:10:31.853466 16590 raft_consensus.cc:515] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:10:32.030972 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 151719us
I20260709 12:10:31.957141 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:31.882473 16534 raft_consensus.cc:493] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:31.954061 16582 log.cc:927] Time spent T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
W20260709 12:10:32.013909 14875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:32.034936 16534 raft_consensus.cc:3060] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:32.036662 16498 raft_consensus.cc:3060] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:32.037345 16532 raft_consensus.cc:493] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:32.037984 16532 raft_consensus.cc:515] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:32.038707 16456 raft_consensus.cc:515] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:31.925134 16210 raft_consensus.cc:3055] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:32.039857 16210 raft_consensus.cc:740] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:10:32.040398 16532 leader_election.cc:290] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:32.040825 16210 consensus_queue.cc:260] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:31.972409 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:31.836535 16279 raft_consensus.cc:3055] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:10:31.948244 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 67011.8us
W20260709 12:10:32.035666 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 203693us
W20260709 12:10:32.050249 14229 connection.cc:256] RPC call timeout handler was delayed by -2.8415249380000205s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17270000000000002s for a response
W20260709 12:10:32.067135 14229 connection.cc:256] RPC call timeout handler was delayed by -2.8050997319999169s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17290000000000003s for a response
W20260709 12:10:32.053612 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 181577us
I20260709 12:10:31.871672 16602 raft_consensus.cc:493] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:32.065364 14876 leader_election.cc:304] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
W20260709 12:10:32.000233 14230 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.174.131:45957 timed out after 1.573s (SENT) [suppressed 23 similar messages]
W20260709 12:10:32.072587 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 72419.2us
I20260709 12:10:32.073045 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:10:32.071270 14304 leader_election.cc:304] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:31.884641 16495 raft_consensus.cc:2749] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:32.019464 16588 raft_consensus.cc:2804] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:32.075598 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:31.884865 16211 raft_consensus.cc:493] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:10:32.080899 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:10:31.906904 16394 raft_consensus.cc:2749] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:32.031502 16501 raft_consensus.cc:740] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:10:31.970842 16452 leader_election.cc:290] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:31.948375 16545 raft_consensus.cc:515] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:32.064411 16279 raft_consensus.cc:740] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
W20260709 12:10:32.086431 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 245708us
I20260709 12:10:32.100144 14908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:10:32.100476 14155 leader_election.cc:304] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:32.104156 14303 leader_election.cc:304] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:32.103113 14304 leader_election.cc:304] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:32.092567 16114 raft_consensus.cc:2804] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:32.081959 16580 consensus_queue.cc:1048] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
W20260709 12:10:32.147493 14155 connection.cc:256] RPC call timeout handler was delayed by -1.5785338119999324s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18560000000000001s for a response
I20260709 12:10:32.109256 16586 raft_consensus.cc:697] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 9 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:32.075310 16602 raft_consensus.cc:515] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:32.167753 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
W20260709 12:10:32.164600 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 99319.7us
I20260709 12:10:32.168244 14330 raft_consensus.cc:1240] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 4. Current term is 5. Ops: [4.5-4.5]
I20260709 12:10:32.169418 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
W20260709 12:10:32.169979 14155 connection.cc:256] RPC call timeout handler was delayed by -1.5452338119998785s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18930000000000002s for a response
W20260709 12:10:32.171475 14155 connection.cc:256] RPC call timeout handler was delayed by -1.5434338119998756s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1895s for a response
I20260709 12:10:32.168684 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:32.171622 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:10:32.171926 14155 connection.cc:256] RPC call timeout handler was delayed by -1.5254338119998465s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1915s for a response
I20260709 12:10:32.159850 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:10:32.172282 14155 connection.cc:256] RPC call timeout handler was delayed by -1.5236338119998436s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1917s for a response
W20260709 12:10:32.173053 14155 connection.cc:256] RPC call timeout handler was delayed by -1.5056338119998145s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1937s for a response
W20260709 12:10:32.173410 14155 connection.cc:256] RPC call timeout handler was delayed by -1.4417338119999386s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2008s for a response
I20260709 12:10:32.172329 14339 raft_consensus.cc:2468] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 4.
I20260709 12:10:32.172853 14185 raft_consensus.cc:2393] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 5: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
W20260709 12:10:32.168408 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 100793us
I20260709 12:10:32.157929 16591 raft_consensus.cc:2804] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:32.179208 14187 raft_consensus.cc:2468] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 3.
I20260709 12:10:32.170143 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:32.177786 14912 raft_consensus.cc:2468] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 3.
I20260709 12:10:32.142022 16114 raft_consensus.cc:493] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:32.180354 14333 raft_consensus.cc:2393] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 4: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:10:32.098989 16211 raft_consensus.cc:515] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:32.182212 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:32.159178 16570 leader_election.cc:290] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:32.143407 15827 consensus_queue.cc:1048] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 12:10:32.185420 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:10:32.243413 14229 connection.cc:256] RPC call timeout handler was delayed by -2.612009258000171s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20110000000000003s for a response
W20260709 12:10:32.244086 14229 connection.cc:256] RPC call timeout handler was delayed by -2.5543156650001038s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19630000000000003s for a response
W20260709 12:10:32.244591 14229 connection.cc:256] RPC call timeout handler was delayed by -1.4538035260000015s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1635s for a response
I20260709 12:10:32.244596 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:10:32.192327 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 89345.6us
I20260709 12:10:32.171244 16588 raft_consensus.cc:697] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 4 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:32.191277 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:10:32.191499 16613 raft_consensus.cc:493] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:32.185201 16591 raft_consensus.cc:697] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 4 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:10:32.171841 16296 consensus_queue.cc:1048] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.060s
I20260709 12:10:32.183501 16114 raft_consensus.cc:3060] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:32.233095 16617 raft_consensus.cc:2749] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:32.237757 16590 leader_election.cc:290] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:32.254812 14304 leader_election.cc:304] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
W20260709 12:10:32.269361 14230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:32.352211 14230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:32.319672 14181 raft_consensus.cc:1240] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:32.322804 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:32.285072 14185 raft_consensus.cc:1275] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 12:10:32.245841 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 146600us
W20260709 12:10:32.309293 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 129928us
I20260709 12:10:32.283145 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:32.283597 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
W20260709 12:10:32.284358 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:32.253723 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:32.286473 14189 raft_consensus.cc:1240] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 5. Current term is 6. Ops: [5.3-5.3]
W20260709 12:10:32.305902 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 50841.3us
I20260709 12:10:32.364845 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:32.372269 14182 raft_consensus.cc:1240] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:32.366535 14303 leader_election.cc:304] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
W20260709 12:10:32.271322 16612 log.cc:927] Time spent T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
W20260709 12:10:32.314637 16484 consensus_meta.cc:287] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.818s	user 0.013s	sys 0.000s
W20260709 12:10:32.292263 16607 log.cc:927] Time spent T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.159s	user 0.000s	sys 0.001s
W20260709 12:10:32.276492 16610 log.cc:927] Time spent T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.184s	user 0.000s	sys 0.001s
I20260709 12:10:32.246552 16394 raft_consensus.cc:2804] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:32.263438 16602 leader_election.cc:290] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:32.380510 14908 raft_consensus.cc:1240] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 4. Current term is 5. Ops: []
W20260709 12:10:32.323693 16606 log.cc:927] Time spent T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.399s	user 0.000s	sys 0.006s
I20260709 12:10:32.268781 16587 raft_consensus.cc:493] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:32.311797 16616 log.cc:927] Time spent T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.050s	user 0.000s	sys 0.001s
W20260709 12:10:32.312812 16611 log.cc:927] Time spent T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.180s	user 0.000s	sys 0.000s
W20260709 12:10:32.369005 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 284427us
I20260709 12:10:32.276086 14907 raft_consensus.cc:1275] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:10:32.298017 16545 leader_election.cc:290] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 4 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:32.316351 16487 raft_consensus.cc:3055] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:32.385203 14184 raft_consensus.cc:1240] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:32.191304 16279 consensus_queue.cc:260] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:32.343107 16277 raft_consensus.cc:3055] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:32.344290 16210 raft_consensus.cc:3060] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:32.297333 16456 leader_election.cc:290] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:32.383899 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:32.278503 16211 leader_election.cc:290] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:10:32.389421 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 134686us
I20260709 12:10:32.321676 16285 raft_consensus.cc:3055] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:32.400794 16602 raft_consensus.cc:2749] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:32.407729 16285 raft_consensus.cc:740] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:32.408675 16285 consensus_queue.cc:260] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:32.410137 16285 raft_consensus.cc:3060] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:32.412361 16114 raft_consensus.cc:515] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:32.296787 16618 raft_consensus.cc:2749] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:32.335808 14906 raft_consensus.cc:2468] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 3.
W20260709 12:10:32.382440 16145 consensus_meta.cc:287] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.908s	user 0.013s	sys 0.001s
I20260709 12:10:32.414417 16145 raft_consensus.cc:515] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:32.415520 14229 leader_election.cc:304] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
W20260709 12:10:32.415846 16447 consensus_meta.cc:287] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.510s	user 0.010s	sys 0.001s
I20260709 12:10:32.416323 16447 raft_consensus.cc:515] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:32.416689 16145 leader_election.cc:290] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 4 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:32.274976 16593 raft_consensus.cc:515] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:32.417953 14334 raft_consensus.cc:1240] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:32.337631 16534 raft_consensus.cc:515] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:32.339550 16498 raft_consensus.cc:515] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:32.400986 16487 raft_consensus.cc:740] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:10:32.397513 16587 raft_consensus.cc:515] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:32.424835 16487 consensus_queue.cc:260] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:32.425446 16498 leader_election.cc:290] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 4 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:32.322379 16597 raft_consensus.cc:515] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:32.425977 16587 leader_election.cc:290] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:32.384469 16484 raft_consensus.cc:515] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:32.276108 16613 raft_consensus.cc:515] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:32.426620 14188 raft_consensus.cc:1240] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:32.427695 16597 leader_election.cc:290] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:32.427909 16484 leader_election.cc:290] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 2 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:32.428131 16613 leader_election.cc:290] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:32.428776 14335 raft_consensus.cc:2468] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 5.
I20260709 12:10:32.428855 16626 raft_consensus.cc:2749] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:32.430505 16456 raft_consensus.cc:493] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:32.421387 16495 consensus_queue.cc:1059] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 12:10:32.431195 16456 raft_consensus.cc:515] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:32.426158 16487 raft_consensus.cc:3060] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:32.279968 16586 consensus_queue.cc:237] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:32.185773 16501 consensus_queue.cc:260] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:32.386787 16394 raft_consensus.cc:493] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:10:32.402877 14182 raft_consensus.cc:2393] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 5: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
W20260709 12:10:32.404740 14155 connection.cc:256] RPC call timeout handler was delayed by -1.3805338119998396s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2076s for a response
W20260709 12:10:32.443076 14155 connection.cc:256] RPC call timeout handler was delayed by -1.3544338119997974s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21050000000000002s for a response
W20260709 12:10:32.443478 14155 connection.cc:256] RPC call timeout handler was delayed by -1.299533811999936s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21660000000000001s for a response
W20260709 12:10:32.443749 14155 connection.cc:256] RPC call timeout handler was delayed by -1.2545338119998632s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22160000000000002s for a response
W20260709 12:10:32.444025 14155 connection.cc:256] RPC call timeout handler was delayed by -1.0448338119999789s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2449s for a response
W20260709 12:10:32.444295 14155 connection.cc:256] RPC call timeout handler was delayed by -1.0268338119999498s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2469s for a response
I20260709 12:10:32.405435 14905 raft_consensus.cc:1275] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:32.407397 14304 leader_election.cc:304] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:32.277628 16591 consensus_queue.cc:237] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:32.422623 16593 leader_election.cc:290] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 6 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:32.402673 16277 raft_consensus.cc:740] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:10:32.423441 16534 leader_election.cc:290] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 7 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:32.463932 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:32.464700 14877 leader_election.cc:304] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:32.465310 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:32.466005 14333 raft_consensus.cc:3060] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:32.438414 14875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:32.426095 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:32.468142 14190 raft_consensus.cc:3060] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Advancing to term 5
W20260709 12:10:32.468339 14875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:32.433945 16279 raft_consensus.cc:3060] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:32.470211 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:10:32.419118 14303 consensus_peers.cc:597] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c -> Peer 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341): Couldn't send request to peer 73d01e9b1a9d49358da4985b21d681db. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 35b39d0f3270452a8bd4f4b1800a837c. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:10:32.438174 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:10:32.445403 16594 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.000s	sys 0.023s
I20260709 12:10:32.445760 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:32.260828 16588 consensus_queue.cc:237] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:32.448141 16394 raft_consensus.cc:3060] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:32.454806 14263 raft_consensus.cc:1240] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 12:10:32.459381 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:10:32.472754 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 72042.1us
I20260709 12:10:32.472934 14188 raft_consensus.cc:2468] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 4.
I20260709 12:10:32.474114 14338 raft_consensus.cc:1240] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:32.474267 14337 raft_consensus.cc:1240] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:32.476289 14184 raft_consensus.cc:2393] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 6: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:10:32.470836 14264 raft_consensus.cc:2468] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 3.
I20260709 12:10:32.453517 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:32.458086 16624 raft_consensus.cc:493] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:32.483879 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 76556us
I20260709 12:10:32.463275 16501 raft_consensus.cc:3060] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:32.475660 16594 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.617s	user 0.000s	sys 0.024s
I20260709 12:10:32.451771 16456 leader_election.cc:290] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:32.497368 14334 raft_consensus.cc:2468] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 3.
I20260709 12:10:32.498255 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:32.438803 16164 raft_consensus.cc:2749] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:32.496086 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:32.499004 14181 raft_consensus.cc:2468] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 5.
I20260709 12:10:32.484483 16630 raft_consensus.cc:2804] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:32.478101 16532 raft_consensus.cc:493] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:32.512504 14304 leader_election.cc:304] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:32.512899 14187 raft_consensus.cc:1275] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 12:10:32.516045 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:32.560207 14187 pending_rounds.cc:85] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf: Aborting all ops after (but not including) 6
I20260709 12:10:32.560488 14187 pending_rounds.cc:107] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 12:10:32.560796 14187 raft_consensus.cc:2889] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:32.484772 16626 raft_consensus.cc:2804] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:32.519106 14188 raft_consensus.cc:2393] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 5: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:10:32.556355 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
W20260709 12:10:32.557229 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 81810.4us
I20260709 12:10:32.521982 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:32.566210 14338 raft_consensus.cc:2393] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 5: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:10:32.565397 14334 raft_consensus.cc:2393] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 4: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:10:32.569777 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:32.570374 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:32.570487 14186 raft_consensus.cc:3060] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:32.572310 14183 raft_consensus.cc:2393] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 4: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:10:32.559475 14877 leader_election.cc:304] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:10:32.573905 14333 raft_consensus.cc:2468] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 5.
W20260709 12:10:32.575942 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 63536.3us
W20260709 12:10:32.578258 14230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:32.590597 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:32.575223 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:32.584621 14303 leader_election.cc:304] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
W20260709 12:10:32.641992 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 57491.7us
I20260709 12:10:32.575809 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
W20260709 12:10:32.607928 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 48532us
I20260709 12:10:32.637107 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
W20260709 12:10:32.638365 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 164244us
I20260709 12:10:32.571192 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:32.640175 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:32.637010 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:32.493621 16624 raft_consensus.cc:515] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:32.609249 16630 raft_consensus.cc:697] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 5 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:10:32.618108 16484 raft_consensus.cc:2749] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:32.557994 16613 consensus_queue.cc:1059] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.114s
I20260709 12:10:32.619230 16618 raft_consensus.cc:493] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:32.634014 16626 raft_consensus.cc:697] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 4 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:32.645823 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:32.651491 14303 leader_election.cc:304] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:32.653128 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:32.654836 14877 leader_election.cc:304] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:32.619027 16603 raft_consensus.cc:2804] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:32.645255 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:32.638676 16164 raft_consensus.cc:493] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:32.575224 16447 leader_election.cc:290] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:32.660285 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:32.651471 16586 raft_consensus.cc:2749] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:32.668979 14263 raft_consensus.cc:2376] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 3. Re-sending same reply.
I20260709 12:10:32.574952 16532 raft_consensus.cc:515] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:32.667788 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:32.664273 14184 raft_consensus.cc:2468] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 4.
I20260709 12:10:32.645135 16114 leader_election.cc:290] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 6 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:32.630951 16602 consensus_queue.cc:1048] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 12:10:32.686861 14230 leader_election.cc:400] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 pre-election: Vote denied by peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957) with higher term. Message: Invalid argument: T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 3. Current term is 4.
I20260709 12:10:32.689869 14230 leader_election.cc:403] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:32.693068 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:32.693869 14333 raft_consensus.cc:2468] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 5.
I20260709 12:10:32.693243 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:32.668308 16603 raft_consensus.cc:493] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:32.674922 15827 raft_consensus.cc:2749] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:32.693802 14334 raft_consensus.cc:1240] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:32.695103 14338 raft_consensus.cc:3060] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:32.696134 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:32.722043 14333 raft_consensus.cc:2468] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 5.
I20260709 12:10:32.696321 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:32.697539 14337 raft_consensus.cc:1240] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 3. Current term is 4. Ops: []
W20260709 12:10:32.698240 16634 log.cc:927] Time spent T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.137s	user 0.000s	sys 0.000s
W20260709 12:10:32.699640 16631 log.cc:927] Time spent T 00000000000000000000000000000000 P d07070be2c074f4cb9ad35f1580c4ef7: Append to log took a long time: real 0.230s	user 0.001s	sys 0.000s
I20260709 12:10:32.699925 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:32.674281 16618 raft_consensus.cc:515] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:32.650163 16277 consensus_queue.cc:260] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:32.714315 16630 consensus_queue.cc:237] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:10:32.680418 16635 log.cc:927] Time spent T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
I20260709 12:10:32.719261 14229 leader_election.cc:304] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:32.728107 14332 raft_consensus.cc:1240] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:32.732797 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:32.747148 14336 raft_consensus.cc:2468] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 5.
I20260709 12:10:32.735869 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:32.749135 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:32.749660 14334 raft_consensus.cc:2468] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 5.
I20260709 12:10:32.750519 14334 raft_consensus.cc:1240] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:32.735759 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:32.720449 16603 raft_consensus.cc:3060] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:32.729561 16534 raft_consensus.cc:2804] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:32.758646 16534 raft_consensus.cc:493] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:32.759063 16534 raft_consensus.cc:3060] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:32.759392 16532 leader_election.cc:290] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:32.674427 16619 consensus_queue.cc:1048] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.082s
I20260709 12:10:32.761824 14331 raft_consensus.cc:1240] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:32.757448 16638 consensus_queue.cc:1059] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 12:10:32.689226 16164 raft_consensus.cc:515] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:32.772352 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:32.780951 16618 leader_election.cc:290] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:32.781643 16626 consensus_queue.cc:237] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:32.781997 16534 raft_consensus.cc:515] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:32.784310 16534 leader_election.cc:290] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 6 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:32.773608 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:32.789326 14330 raft_consensus.cc:2468] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 6.
I20260709 12:10:32.789937 14338 raft_consensus.cc:2468] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 5.
W20260709 12:10:32.790841 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 139420us
I20260709 12:10:32.774170 16532 raft_consensus.cc:2749] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957) with higher term. Message: Invalid argument: T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 3. Current term is 4.
I20260709 12:10:32.795814 16532 raft_consensus.cc:3055] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:32.796231 16532 raft_consensus.cc:740] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:10:32.744277 16355 consensus_queue.cc:1059] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 12:10:32.806365 14190 raft_consensus.cc:2468] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 5.
I20260709 12:10:32.797088 16532 consensus_queue.cc:260] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:32.809440 16618 consensus_queue.cc:1048] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 12:10:32.811379 16532 raft_consensus.cc:3060] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:32.811888 16624 leader_election.cc:290] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:32.809023 14303 leader_election.cc:304] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:32.819557 16534 raft_consensus.cc:2804] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:32.820235 16534 raft_consensus.cc:493] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:32.821208 16534 raft_consensus.cc:3060] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:32.822667 14190 raft_consensus.cc:1275] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:10:32.824182 14910 raft_consensus.cc:2468] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 3.
I20260709 12:10:32.826890 16164 leader_election.cc:290] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:32.798620 16638 raft_consensus.cc:2749] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:10:32.830054 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 159788us
I20260709 12:10:32.832403 16452 raft_consensus.cc:3055] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:32.832859 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:32.832909 16452 raft_consensus.cc:740] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:32.834904 16452 consensus_queue.cc:260] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:32.836024 16452 raft_consensus.cc:3060] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:32.842453 14230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:32.846578 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:32.847285 14189 raft_consensus.cc:3060] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:32.848730 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
W20260709 12:10:32.855549 14154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:32.850971 14303 leader_election.cc:304] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:32.870906 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:32.878212 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:32.865542 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:32.894654 14186 raft_consensus.cc:2468] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 7.
I20260709 12:10:32.874408 14304 leader_election.cc:304] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:32.893328 14189 raft_consensus.cc:2468] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 6.
I20260709 12:10:32.865985 14261 raft_consensus.cc:1275] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:10:32.866513 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:32.883842 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:32.907366 16544 raft_consensus.cc:2749] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:10:32.873920 14878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:32.908725 14339 raft_consensus.cc:2393] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 5: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:10:32.905583 14184 raft_consensus.cc:2468] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 6.
W20260709 12:10:32.910167 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 59306.5us
I20260709 12:10:32.913391 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:10:32.903774 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 184605us
I20260709 12:10:32.916303 14229 leader_election.cc:304] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:10:32.917680 14263 raft_consensus.cc:2393] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 7: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:10:32.919865 14182 raft_consensus.cc:1240] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 4 LEADER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:32.920275 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:32.955758 14303 leader_election.cc:304] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:32.994518 14303 leader_election.cc:304] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:32.913834 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:32.992308 14339 raft_consensus.cc:1275] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:10:33.043982 14877 leader_election.cc:304] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
W20260709 12:10:33.044476 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 50066.3us
W20260709 12:10:33.043152 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 168808us
I20260709 12:10:33.045387 14304 leader_election.cc:304] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:33.046568 14303 leader_election.cc:304] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:33.060854 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:33.061793 14261 raft_consensus.cc:2468] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 4.
I20260709 12:10:33.063062 14910 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53200 (request call id 391) took 1032 ms. Trace:
I20260709 12:10:33.063511 14910 rpcz_store.cc:276] 0709 12:10:32.030738 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:32.030920 (+   182us) service_pool.cc:224] Handling call
0709 12:10:33.062868 (+1031948us) spinlock_profiling.cc:243] Waited 574 ms on lock 0x7b540020b7d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:10:33.062992 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1319364480}
I20260709 12:10:33.068673 16456 raft_consensus.cc:2804] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:33.069296 16456 raft_consensus.cc:697] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 3 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:10:33.070223 16456 consensus_queue.cc:237] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:33.070972 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:32.919729 16534 raft_consensus.cc:515] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:10:33.081141 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 155405us
I20260709 12:10:33.034237 16484 raft_consensus.cc:2804] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:32.983614 16647 raft_consensus.cc:2749] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:33.007676 16618 consensus_queue.cc:1048] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.093s
W20260709 12:10:33.090816 16657 log.cc:927] Time spent T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 12:10:32.922086 16394 raft_consensus.cc:515] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:33.092212 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:10:33.092689 16279 consensus_meta.cc:287] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.613s	user 0.002s	sys 0.007s
I20260709 12:10:33.092901 14256 raft_consensus.cc:2468] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 4.
I20260709 12:10:33.093546 14260 raft_consensus.cc:2410] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:10:33.093654 16452 raft_consensus.cc:2804] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:33.094251 16452 raft_consensus.cc:697] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 3 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:33.095227 16452 consensus_queue.cc:237] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:33.073438 16630 raft_consensus.cc:2749] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:33.080570 16652 consensus_queue.cc:1059] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.049s
I20260709 12:10:33.099759 16534 leader_election.cc:290] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:33.086825 14230 leader_election.cc:304] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:10:33.101769 14910 raft_consensus.cc:1240] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:33.102984 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:33.103863 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:33.074735 16588 raft_consensus.cc:2804] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:33.074342 16619 raft_consensus.cc:2804] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:33.116621 16619 raft_consensus.cc:697] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 6 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:33.117867 16619 consensus_queue.cc:237] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:10:33.106716 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 61404.5us
I20260709 12:10:33.130716 16532 consensus_queue.cc:1059] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:33.131659 16277 raft_consensus.cc:3060] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:33.132345 16532 raft_consensus.cc:3055] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:33.132731 16532 raft_consensus.cc:740] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:10:33.133766 14257 raft_consensus.cc:2393] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 3: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:10:33.135810 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:33.136521 14184 raft_consensus.cc:3060] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:33.092927 16394 leader_election.cc:290] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 9 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:33.073300 16164 consensus_queue.cc:1059] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
W20260709 12:10:33.147450 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 231200us
I20260709 12:10:33.107766 16484 raft_consensus.cc:697] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 7 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:33.110680 16588 raft_consensus.cc:493] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:33.137359 16638 raft_consensus.cc:2804] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:33.162806 14229 leader_election.cc:304] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:10:33.167135 14182 raft_consensus.cc:1275] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:10:33.169409 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:33.173682 14229 leader_election.cc:304] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:10:33.133569 16532 consensus_queue.cc:260] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:10:33.178241 16650 log.cc:927] Time spent T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
I20260709 12:10:33.178548 16532 raft_consensus.cc:3060] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:33.180190 16484 consensus_queue.cc:237] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:33.163086 16588 raft_consensus.cc:3060] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:33.163347 16638 raft_consensus.cc:493] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:33.186439 16638 raft_consensus.cc:3060] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:33.190217 16591 raft_consensus.cc:493] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:33.190932 16591 raft_consensus.cc:515] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:33.170785 16164 consensus_queue.cc:1048] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
W20260709 12:10:33.192965 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 102740us
I20260709 12:10:33.194494 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:33.194808 16648 raft_consensus.cc:3055] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:33.195276 16648 raft_consensus.cc:740] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:10:33.190344 16629 raft_consensus.cc:493] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:33.196578 16591 leader_election.cc:290] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:33.196324 16648 consensus_queue.cc:260] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:33.196287 16629 raft_consensus.cc:515] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:33.196448 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:33.201229 14877 leader_election.cc:304] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:33.155967 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
W20260709 12:10:33.196941 16649 log.cc:927] Time spent T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
I20260709 12:10:33.211140 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:33.214561 14257 raft_consensus.cc:3060] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:33.199385 16629 leader_election.cc:290] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:33.167441 16603 raft_consensus.cc:515] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:33.167586 16580 consensus_queue.cc:1048] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 12:10:33.218219 16603 leader_election.cc:290] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 4 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:33.220080 16662 raft_consensus.cc:2804] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:33.220785 16662 raft_consensus.cc:697] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 3 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:10:33.221915 16662 consensus_queue.cc:237] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:33.222977 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:33.223852 14906 raft_consensus.cc:2393] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 3: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
W20260709 12:10:33.199278 16653 log.cc:927] Time spent T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
W20260709 12:10:33.228631 16656 log.cc:927] Time spent T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:10:33.230857 16624 raft_consensus.cc:2804] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:33.231339 16624 raft_consensus.cc:493] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:33.231750 16624 raft_consensus.cc:3060] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:33.175875 16587 consensus_queue.cc:1048] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.062s
I20260709 12:10:33.236667 16652 raft_consensus.cc:3055] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:33.237169 16652 raft_consensus.cc:740] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:10:33.205440 16647 raft_consensus.cc:493] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
W20260709 12:10:33.239516 14154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:33.239202 16647 raft_consensus.cc:515] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:33.242475 16652 consensus_queue.cc:260] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:33.244014 16652 raft_consensus.cc:3060] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:33.253351 16651 log.cc:927] Time spent T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.153s	user 0.001s	sys 0.003s
I20260709 12:10:33.254310 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:33.256624 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:33.257722 14265 raft_consensus.cc:3060] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:33.257936 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 136197us
I20260709 12:10:33.264735 14184 raft_consensus.cc:2468] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 5.
W20260709 12:10:33.276417 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:33.197707 16648 raft_consensus.cc:3060] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:33.283113 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:33.289155 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:33.339468 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:33.340132 14262 raft_consensus.cc:3060] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:33.288998 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:33.323997 14258 raft_consensus.cc:1275] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 12:10:33.331051 14155 leader_election.cc:304] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:10:33.341907 14258 pending_rounds.cc:85] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec: Aborting all ops after (but not including) 4
I20260709 12:10:33.342161 14258 pending_rounds.cc:107] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 12:10:33.342257 14303 leader_election.cc:304] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:33.341645 14263 raft_consensus.cc:2468] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 6.
I20260709 12:10:33.342412 14258 raft_consensus.cc:2889] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:33.334960 14337 raft_consensus.cc:1240] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:33.344980 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:33.335505 14332 raft_consensus.cc:1240] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:33.270560 16164 raft_consensus.cc:2804] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:10:33.336545 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 162916us
I20260709 12:10:33.317837 16647 leader_election.cc:290] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:33.270113 16532 consensus_queue.cc:1048] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.070s
I20260709 12:10:33.395183 14265 raft_consensus.cc:2468] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 5.
W20260709 12:10:33.398290 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 45604.9us
W20260709 12:10:33.397524 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 55379.2us
I20260709 12:10:33.402014 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:33.407143 16394 consensus_queue.cc:1059] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 12:10:33.411844 14906 raft_consensus.cc:2468] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 6.
W20260709 12:10:33.414291 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 83345.9us
I20260709 12:10:33.415196 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:33.415951 14264 raft_consensus.cc:3060] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:33.414471 14303 leader_election.cc:304] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:10:33.417752 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:10:33.402714 16651 log.cc:927] Time spent T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:10:33.427104 16394 raft_consensus.cc:3055] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:33.421674 16164 raft_consensus.cc:697] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 3 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:10:33.418534 16671 raft_consensus.cc:493] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:33.422519 16658 ts_tablet_manager.cc:933] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db: Initiating tablet copy from peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:33.422026 16484 raft_consensus.cc:2804] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:33.442869 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:10:33.474390 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 69519.7us
I20260709 12:10:33.443643 14257 raft_consensus.cc:2468] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 6.
I20260709 12:10:33.427299 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:33.425390 14155 leader_election.cc:304] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:33.427701 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:33.404410 16591 raft_consensus.cc:2764] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
W20260709 12:10:33.449649 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 114462us
I20260709 12:10:33.453759 14264 raft_consensus.cc:2468] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 4.
W20260709 12:10:33.455958 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 122949us
W20260709 12:10:33.427318 16660 log.cc:927] Time spent T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 12:10:33.484308 14230 leader_election.cc:304] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:10:33.485002 14184 raft_consensus.cc:1275] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:10:33.486024 14304 leader_election.cc:304] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:33.486752 14877 leader_election.cc:304] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:33.487674 14304 leader_election.cc:304] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:33.492717 16210 raft_consensus.cc:2749] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:33.495352 14230 leader_election.cc:304] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:10:33.495890 16674 raft_consensus.cc:2749] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:33.496627 14230 leader_election.cc:304] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:10:33.449002 16394 raft_consensus.cc:740] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:33.499977 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:33.449115 16501 raft_consensus.cc:493] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
W20260709 12:10:33.501765 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:33.502969 14259 raft_consensus.cc:2393] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 7: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:10:33.413480 16588 raft_consensus.cc:515] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:33.495730 16532 raft_consensus.cc:2804] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:33.478940 16667 raft_consensus.cc:493] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:33.490365 16484 raft_consensus.cc:697] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 5 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:33.522804 14304 leader_election.cc:304] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:33.535718 14304 leader_election.cc:304] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:33.513865 16626 raft_consensus.cc:3060] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:33.495348 16544 consensus_queue.cc:1048] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 12:10:33.526762 16532 raft_consensus.cc:493] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:33.479321 16671 raft_consensus.cc:515] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:33.547326 14304 leader_election.cc:304] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:33.553644 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:33.519469 16279 consensus_queue.cc:1059] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 12:10:33.520802 16664 raft_consensus.cc:2804] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:33.520886 16501 raft_consensus.cc:515] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:33.525983 16591 raft_consensus.cc:2749] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:33.518496 16354 consensus_queue.cc:1059] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 12:10:33.540089 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:33.525619 16355 consensus_queue.cc:1048] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 12:10:33.557138 14262 raft_consensus.cc:2468] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 9.
I20260709 12:10:33.550604 16452 raft_consensus.cc:2749] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:33.548903 16677 raft_consensus.cc:2749] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:33.560166 16532 raft_consensus.cc:3060] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:33.573968 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:33.568317 16664 raft_consensus.cc:493] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:33.548067 16638 raft_consensus.cc:515] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:33.530652 16667 raft_consensus.cc:515] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:33.577670 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:33.581249 14304 leader_election.cc:304] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:33.586529 14262 raft_consensus.cc:2468] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 3.
I20260709 12:10:33.571812 14906 raft_consensus.cc:1275] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:33.568224 16662 raft_consensus.cc:2804] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:33.589325 16587 raft_consensus.cc:3060] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:33.589306 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:33.580328 16484 consensus_queue.cc:237] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:33.597978 14257 raft_consensus.cc:2410] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:10:33.582320 16279 raft_consensus.cc:493] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:33.598692 16279 raft_consensus.cc:515] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:33.600227 16501 leader_election.cc:290] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:33.600858 16279 leader_election.cc:290] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:33.576244 16682 raft_consensus.cc:3060] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:33.611658 14261 raft_consensus.cc:3060] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:33.556228 16394 consensus_queue.cc:260] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:33.618225 14258 raft_consensus.cc:2410] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
W20260709 12:10:33.618693 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 124966us
I20260709 12:10:33.585160 16664 raft_consensus.cc:3060] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:33.620409 14304 leader_election.cc:304] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:33.625689 16452 raft_consensus.cc:2749] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:33.628513 14877 leader_election.cc:304] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 65c9c1653b3346b39a0e118540e6080c
W20260709 12:10:33.630781 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 134192us
I20260709 12:10:33.588579 16662 raft_consensus.cc:493] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:33.633003 14304 leader_election.cc:304] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:33.610638 16647 raft_consensus.cc:2804] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:33.613255 16279 raft_consensus.cc:3055] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:33.610558 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:33.574119 16164 consensus_queue.cc:237] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:10:33.713421 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 288081us
W20260709 12:10:33.688990 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 56034.6us
I20260709 12:10:33.714342 14190 raft_consensus.cc:1275] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:33.714821 14155 leader_election.cc:304] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:33.715361 14304 leader_election.cc:304] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:33.717727 14261 raft_consensus.cc:2468] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 6.
I20260709 12:10:33.737944 14230 leader_election.cc:304] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:33.639320 16279 raft_consensus.cc:740] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:10:33.634578 16662 raft_consensus.cc:3060] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:33.758430 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 127804us
I20260709 12:10:33.639793 16581 raft_consensus.cc:2804] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:33.767594 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:33.688069 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:33.637872 16452 consensus_queue.cc:1048] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.125s
I20260709 12:10:33.781044 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
W20260709 12:10:33.778663 14230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:33.779561 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 64265.2us
I20260709 12:10:33.736120 16685 raft_consensus.cc:2804] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:33.782497 14190 raft_consensus.cc:3060] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:33.783440 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:33.768993 16501 raft_consensus.cc:493] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:33.776103 16581 raft_consensus.cc:697] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 4 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:10:33.783563 16690 raft_consensus.cc:2749] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:33.781371 16354 consensus_queue.cc:1059] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.012s
I20260709 12:10:33.784540 14257 raft_consensus.cc:2468] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 4.
I20260709 12:10:33.781028 16689 raft_consensus.cc:493] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:33.781586 14905 raft_consensus.cc:2393] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 6: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
I20260709 12:10:33.787222 14304 leader_election.cc:304] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:33.808059 14190 raft_consensus.cc:2468] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 7.
I20260709 12:10:33.774506 16588 leader_election.cc:290] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 7 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:33.802785 16501 raft_consensus.cc:515] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:10:33.789876 16683 log.cc:927] Time spent T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 12:10:33.780833 16679 raft_consensus.cc:2804] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:33.816395 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:10:33.794214 16666 log.cc:927] Time spent T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.225s	user 0.000s	sys 0.001s
W20260709 12:10:33.789202 16680 log.cc:927] Time spent T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.152s	user 0.000s	sys 0.000s
I20260709 12:10:33.795249 16691 raft_consensus.cc:2804] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:33.870332 16691 raft_consensus.cc:493] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:33.870872 16691 raft_consensus.cc:3060] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:33.825569 16501 leader_election.cc:290] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:10:33.794885 16681 log.cc:927] Time spent T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 12:10:33.812026 16685 raft_consensus.cc:697] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 5 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:33.796294 16638 leader_election.cc:290] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:10:33.867596 16684 log.cc:927] Time spent T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 12:10:33.792749 16587 raft_consensus.cc:2749] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:33.829104 16602 raft_consensus.cc:2804] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:33.820561 16689 raft_consensus.cc:515] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:10:33.893353 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 178617us
W20260709 12:10:33.893992 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 107979us
I20260709 12:10:33.895054 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:33.896620 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:33.858870 16626 raft_consensus.cc:2749] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:33.787002 16687 consensus_queue.cc:1059] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.112s
I20260709 12:10:33.913870 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:33.912947 16501 consensus_queue.cc:1059] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 12:10:33.896140 16671 leader_election.cc:290] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:33.916464 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:33.916663 16671 consensus_queue.cc:1059] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:10:33.905807 16697 log.cc:927] Time spent T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 12:10:33.917488 16671 consensus_queue.cc:1059] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:10:33.918982 16671 raft_consensus.cc:3055] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:33.919392 16671 raft_consensus.cc:740] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:10:33.920246 16671 consensus_queue.cc:260] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:33.916857 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:33.917932 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:33.923430 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:33.924268 14260 raft_consensus.cc:2393] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 4: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:10:33.925132 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:33.926015 14260 raft_consensus.cc:2393] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 6: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:10:33.807480 16279 consensus_queue.cc:260] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:10:33.929664 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:33.930771 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:33.932794 14305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:33.934083 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:33.934851 14263 raft_consensus.cc:2468] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 9.
I20260709 12:10:33.935863 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:33.863569 16658 tablet_copy_client.cc:323] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db: tablet copy: Beginning tablet copy session from remote peer at address 127.12.174.131:45957
I20260709 12:10:33.911506 16679 raft_consensus.cc:697] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 6 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:33.921459 16671 raft_consensus.cc:3060] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:33.933661 14257 raft_consensus.cc:2368] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 4. Current term is 5.
I20260709 12:10:33.948958 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:33.949815 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:33.950201 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:33.952903 16587 raft_consensus.cc:493] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:33.953457 16587 raft_consensus.cc:515] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:33.955636 16587 leader_election.cc:290] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:33.958177 16689 leader_election.cc:290] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:33.951107 14338 raft_consensus.cc:2368] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 6. Current term is 7.
I20260709 12:10:33.959393 16667 leader_election.cc:290] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:33.960197 14230 leader_election.cc:400] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 election: Vote denied by peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957) with higher term. Message: Invalid argument: T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 6. Current term is 7.
I20260709 12:10:33.960511 14230 leader_election.cc:403] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 12:10:33.955317 16691 raft_consensus.cc:515] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:33.962827 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:33.950489 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:33.971041 14332 raft_consensus.cc:2376] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 5. Re-sending same reply.
W20260709 12:10:33.972940 16669 log.cc:927] Time spent T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.477s	user 0.002s	sys 0.000s
I20260709 12:10:33.975967 16652 raft_consensus.cc:3055] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:33.975762 16685 consensus_queue.cc:237] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:33.976403 16652 raft_consensus.cc:740] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:10:33.976995 16532 raft_consensus.cc:515] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:33.961701 16667 raft_consensus.cc:3060] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:33.946674 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:33.934243 16164 raft_consensus.cc:3055] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 1 LEADER]: Stepping down as leader of term 1
W20260709 12:10:33.947992 16648 consensus_meta.cc:287] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.597s	user 0.009s	sys 0.003s
I20260709 12:10:33.978391 14333 raft_consensus.cc:1240] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:33.987850 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:10:33.946223 16624 consensus_meta.cc:287] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db: Time spent flushing consensus metadata: real 0.714s	user 0.011s	sys 0.002s
I20260709 12:10:33.940730 16602 raft_consensus.cc:697] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 9 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:33.914655 16581 consensus_queue.cc:237] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:33.995520 14189 raft_consensus.cc:1240] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 8. Current term is 9. Ops: [8.5-8.5]
W20260709 12:10:33.996274 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 82205us
I20260709 12:10:33.990386 14185 raft_consensus.cc:1240] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:34.001708 14155 leader_election.cc:304] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:34.000190 14230 leader_election.cc:304] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:10:34.003909 14189 raft_consensus.cc:1240] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:33.993466 16164 raft_consensus.cc:740] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:10:34.006523 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:34.008037 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:34.008669 16687 consensus_queue.cc:1059] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:34.009859 16687 raft_consensus.cc:3055] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:34.010357 16687 raft_consensus.cc:740] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:10:34.010982 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:34.011322 16687 consensus_queue.cc:260] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:34.006376 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:34.012843 14905 raft_consensus.cc:2410] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for term 7 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 12:10:34.008078 16602 consensus_queue.cc:237] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:34.002691 16624 raft_consensus.cc:515] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:33.980202 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:34.014768 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:10:34.015565 16676 log.cc:927] Time spent T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.476s	user 0.000s	sys 0.002s
I20260709 12:10:34.015988 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:34.016623 16624 leader_election.cc:290] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 5 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:34.017328 14910 raft_consensus.cc:1240] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:34.014796 14908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:34.009721 14190 raft_consensus.cc:3060] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:33.986037 16679 consensus_queue.cc:237] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:34.026753 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:34.018463 16706 raft_consensus.cc:2804] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:34.014271 14907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:10:34.030658 16682 raft_consensus.cc:2749] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:34.031023 14907 raft_consensus.cc:2376] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 6. Re-sending same reply.
I20260709 12:10:34.034646 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:10:34.035921 14229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:34.038790 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:34.039034 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:33.977325 16652 consensus_queue.cc:260] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } }
I20260709 12:10:34.041705 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:34.042398 14333 raft_consensus.cc:1240] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 9 LEADER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:34.043107 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:34.043308 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:33.981019 16664 raft_consensus.cc:515] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:34.045578 14905 raft_consensus.cc:1275] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:34.046643 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:34.056182 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:34.056622 14339 raft_consensus.cc:3060] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:34.056733 14190 raft_consensus.cc:1275] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:34.049603 14189 raft_consensus.cc:2368] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 5. Current term is 6.
I20260709 12:10:34.053236 14260 raft_consensus.cc:2468] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 4.
I20260709 12:10:34.049083 14259 raft_consensus.cc:2468] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 9.
I20260709 12:10:34.057228 14338 raft_consensus.cc:2468] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 6.
I20260709 12:10:34.012862 16687 raft_consensus.cc:3060] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:34.047097 16532 leader_election.cc:290] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:34.017338 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:10:34.058965 14229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:34.040890 16501 consensus_queue.cc:1243] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer 65c9c1653b3346b39a0e118540e6080c log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:10:34.039552 16662 raft_consensus.cc:515] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:33.982718 16701 consensus_queue.cc:1059] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 5.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.075s
I20260709 12:10:34.071599 14189 raft_consensus.cc:3060] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:34.066782 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:34.073282 14264 raft_consensus.cc:2368] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 5. Current term is 6.
I20260709 12:10:34.073436 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:34.074488 16501 raft_consensus.cc:2804] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:34.008034 16164 consensus_queue.cc:260] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:34.077482 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:34.074638 14229 leader_election.cc:304] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:34.076390 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:34.078187 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:34.056807 16706 raft_consensus.cc:697] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 5 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:10:34.082413 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:34.082799 14190 raft_consensus.cc:2468] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 6.
I20260709 12:10:34.090304 14189 raft_consensus.cc:1275] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:34.092275 14256 raft_consensus.cc:2368] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 5. Current term is 6.
I20260709 12:10:34.096259 14336 raft_consensus.cc:1275] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:10:34.097920 14263 raft_consensus.cc:2393] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 5: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:10:34.100421 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
W20260709 12:10:34.103199 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:34.103528 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:34.076231 16532 raft_consensus.cc:493] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:10:34.106833 16532 raft_consensus.cc:515] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:34.104888 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:34.109591 16691 leader_election.cc:290] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 6 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:34.105712 16652 raft_consensus.cc:3060] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:34.106626 16708 raft_consensus.cc:2749] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:34.119199 16662 leader_election.cc:290] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:34.120525 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
W20260709 12:10:34.123934 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:34.124825 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:34.126919 16664 leader_election.cc:290] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:34.082405 16701 raft_consensus.cc:3055] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:34.142979 14185 raft_consensus.cc:1240] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:34.173694 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:34.174678 14256 raft_consensus.cc:2410] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 12:10:34.178653 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 104103us
I20260709 12:10:34.179610 14229 leader_election.cc:304] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:34.186448 14260 raft_consensus.cc:2468] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 3.
I20260709 12:10:34.186422 14229 leader_election.cc:304] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:34.187146 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:34.191039 14337 raft_consensus.cc:3060] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:34.193315 15827 consensus_queue.cc:1059] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:34.193476 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:34.141438 16701 raft_consensus.cc:740] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:10:34.177275 16664 consensus_queue.cc:1048] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 12:10:34.194972 16706 consensus_queue.cc:237] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:34.195479 16701 consensus_queue.cc:260] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.2, Last appended by leader: 2, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:34.197448 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:34.197762 16647 raft_consensus.cc:493] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:10:34.198282 16647 raft_consensus.cc:3060] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:34.193931 14332 raft_consensus.cc:2468] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 5.
I20260709 12:10:34.200814 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:34.200814 14229 leader_election.cc:304] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:34.203358 14229 leader_election.cc:304] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:34.201681 14332 raft_consensus.cc:2468] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 5.
I20260709 12:10:34.205842 14256 raft_consensus.cc:1240] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:34.205081 16662 raft_consensus.cc:2749] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:34.208071 14258 raft_consensus.cc:1240] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:34.113517 16452 raft_consensus.cc:2955] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 5 LEADER]: Committing config change with OpId 5.5: config changed from index -1 to 5, NON_VOTER 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } } }
I20260709 12:10:34.193254 16692 raft_consensus.cc:2749] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:34.217620 14260 raft_consensus.cc:1240] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:34.218346 16667 raft_consensus.cc:2749] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957) with higher term. Message: Invalid argument: T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 6. Current term is 7.
I20260709 12:10:34.204362 16708 raft_consensus.cc:2749] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:34.173550 16164 raft_consensus.cc:3060] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:10:34.421275 14305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:34.284318 14304 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:34.280150 14230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:34.409937 16701 raft_consensus.cc:3060] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:34.220188 14260 raft_consensus.cc:1275] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 12:10:34.269304 14256 raft_consensus.cc:1275] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:10:34.441926 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 241039us
I20260709 12:10:34.268529 16501 raft_consensus.cc:697] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 5 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:10:34.313555 14257 raft_consensus.cc:2468] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 7.
I20260709 12:10:34.266748 14337 raft_consensus.cc:2468] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 6.
W20260709 12:10:34.410874 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 205608us
I20260709 12:10:34.300115 14339 raft_consensus.cc:2468] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 6.
I20260709 12:10:34.204906 16664 raft_consensus.cc:2804] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:34.450485 14260 pending_rounds.cc:85] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec: Aborting all ops after (but not including) 2
I20260709 12:10:34.453428 14260 pending_rounds.cc:107] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 12:10:34.453728 14260 raft_consensus.cc:2889] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:10:34.455847 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:34.455978 14155 connection.cc:256] RPC call timeout handler was delayed by -1.0206982189999962s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.27340000000000003s for a response
I20260709 12:10:34.457396 14229 leader_election.cc:304] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:34.407457 16638 raft_consensus.cc:3055] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:34.410537 16532 leader_election.cc:290] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:34.460733 14229 leader_election.cc:304] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:34.462026 16710 raft_consensus.cc:493] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:34.462560 16710 raft_consensus.cc:515] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:34.462981 16696 consensus_queue.cc:1048] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:34.458045 16664 raft_consensus.cc:493] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:34.460815 16706 consensus_queue.cc:1048] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.009s
W20260709 12:10:34.492157 14228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:34.461529 16638 raft_consensus.cc:740] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:10:34.460014 16671 raft_consensus.cc:2749] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:34.466529 16667 raft_consensus.cc:2749] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:34.493057 14256 raft_consensus.cc:1275] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:34.490967 16664 raft_consensus.cc:3060] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:34.460033 16452 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:55478 (request call id 15) took 3754 ms. Trace:
I20260709 12:10:34.482692 16710 leader_election.cc:290] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:34.499418 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:34.500185 14258 raft_consensus.cc:1240] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:34.505054 14337 raft_consensus.cc:1240] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:10:34.491474 16691 raft_consensus.cc:493] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:10:34.510897 14190 raft_consensus.cc:3060] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:10:34.511291 14155 leader_election.cc:304] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
W20260709 12:10:34.500322 16723 log.cc:927] Time spent T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 12:10:34.491251 16532 consensus_queue.cc:1059] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.020s
I20260709 12:10:34.508024 16715 raft_consensus.cc:493] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:10:34.512068 16602 raft_consensus.cc:493] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:34.529069 14155 leader_election.cc:304] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:34.525025 16501 consensus_queue.cc:237] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:34.530480 16591 raft_consensus.cc:2749] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:34.522238 16710 raft_consensus.cc:2749] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:34.526691 16602 raft_consensus.cc:515] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:34.496464 16452 rpcz_store.cc:276] 0709 12:10:30.701610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:30.704269 (+  2659us) service_pool.cc:224] Handling call
0709 12:10:30.833767 (+129498us) log.cc:844] Serialized 513 byte log entry
0709 12:10:31.262077 (+428310us) spinlock_profiling.cc:243] Waited 24.3 ms on lock 0x7b18000aff60. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f212cf16ab1 00007f212cf23281 00007f212404e3f3 00007f21240507c1 00007f2124050779 00007f2124050709 00007f21240506d1 00007f212404f9cd 0000000000388634 0000000000388479 00007f212403183a
0709 12:10:31.277371 (+ 15294us) spinlock_profiling.cc:243] Waited 6.08 ms on lock 0x7b18000aff60. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f212cf16ab1 00007f212cf23281 00007f212404e3f3 00007f21240507c1 00007f2124050779 00007f2124050709 00007f21240506d1 00007f212404f9cd 0000000000388634 0000000000388479 00007f212403183a
0709 12:10:34.454422 (+3177051us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":3101,"mutex_wait_us":18228,"raft.queue_time_us":64565,"raft.run_cpu_time_us":2444,"raft.run_wall_time_us":157127,"spinlock_wait_cycles":69835392,"thread_start_us":110301,"threads_started":1,"wal-append.queue_time_us":162886,"wal-append.run_cpu_time_us":2059,"wal-append.run_wall_time_us":1002050}
I20260709 12:10:34.532606 14339 raft_consensus.cc:1240] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:34.537292 16602 leader_election.cc:290] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:10:34.533938 14155 leader_election.cc:336] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Timed out: RequestConsensusVote RPC to 127.12.174.130:36673 timed out after 1.615s (SENT)
I20260709 12:10:34.538378 15827 raft_consensus.cc:493] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:34.526923 16647 raft_consensus.cc:515] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:34.538791 15827 raft_consensus.cc:515] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:34.517988 16691 raft_consensus.cc:515] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } }
I20260709 12:10:34.534716 14332 raft_consensus.cc:1240] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:34.543617 14190 raft_consensus.cc:2468] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 6.
I20260709 12:10:34.546331 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:34.551671 14335 raft_consensus.cc:1240] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:34.552757 15827 leader_election.cc:290] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:34.531728 16715 raft_consensus.cc:515] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:34.556078 16715 leader_election.cc:290] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:34.558030 16540 raft_consensus.cc:493] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:34.558609 16540 raft_consensus.cc:515] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:34.559912 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:34.560189 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:34.560688 16540 leader_election.cc:290] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:34.564311 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:34.565177 15827 raft_consensus.cc:493] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:34.566040 14229 leader_election.cc:304] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:34.565999 15827 raft_consensus.cc:515] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:34.565337 14190 raft_consensus.cc:2393] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 5: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:10:34.567214 14259 raft_consensus.cc:2468] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 5.
I20260709 12:10:34.564116 16210 raft_consensus.cc:493] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:34.571684 14912 raft_consensus.cc:1275] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:34.574517 15827 leader_election.cc:290] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:34.575840 16532 raft_consensus.cc:2749] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:34.579412 14907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:34.583141 14265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53050 (request call id 381) took 1224 ms. Trace:
I20260709 12:10:34.583580 14265 rpcz_store.cc:276] 0709 12:10:33.358548 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:33.465866 (+107318us) service_pool.cc:224] Handling call
0709 12:10:33.466308 (+   442us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:33.572272 (+105964us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:33.572302 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:33.572345 (+    43us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:33.572375 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:34.582877 (+1010502us) spinlock_profiling.cc:243] Waited 106 ms on lock 0x7b54001c2854. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:10:34.582927 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:34.583051 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":243237632}
I20260709 12:10:34.585311 14265 raft_consensus.cc:1240] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:34.585762 16664 raft_consensus.cc:515] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:34.588217 14333 raft_consensus.cc:1240] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:34.588807 14229 leader_election.cc:304] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:34.590471 16706 raft_consensus.cc:2749] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:34.574282 16210 raft_consensus.cc:515] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:34.602273 16456 consensus_queue.cc:1048] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
W20260709 12:10:34.608002 14261 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41764 (request call id 2115) took 1345 ms (client timeout 1770 ms). Trace:
I20260709 12:10:34.608937 14256 raft_consensus.cc:1275] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:34.610407 16691 leader_election.cc:290] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:10:34.608603 14261 rpcz_store.cc:269] 0709 12:10:33.262289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:33.262411 (+   122us) service_pool.cc:224] Handling call
0709 12:10:34.607776 (+1345365us) spinlock_profiling.cc:243] Waited 272 ms on lock 0x7b5400031e54. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:10:34.607892 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":625795840}
I20260709 12:10:34.614858 14907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:34.616472 14261 raft_consensus.cc:1275] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 12:10:34.616961 14261 pending_rounds.cc:85] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec: Aborting all ops after (but not including) 2
I20260709 12:10:34.617244 14261 pending_rounds.cc:107] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:10:34.617489 14261 raft_consensus.cc:2889] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:34.618263 16647 leader_election.cc:290] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 7 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:34.133119 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:34.621394 16638 consensus_queue.cc:260] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:34.624167 16638 raft_consensus.cc:3060] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:34.608134 16210 leader_election.cc:290] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:34.632000 16708 consensus_queue.cc:1048] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:34.629511 14908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:34.635602 14908 raft_consensus.cc:2468] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 3.
I20260709 12:10:34.641696 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:34.643847 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:34.644598 14186 raft_consensus.cc:2468] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 3.
I20260709 12:10:34.645334 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:34.646409 14189 raft_consensus.cc:1240] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:34.647097 14185 raft_consensus.cc:2468] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 3.
I20260709 12:10:34.646018 14182 raft_consensus.cc:2468] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 2.
I20260709 12:10:34.650614 14154 leader_election.cc:304] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:34.645875 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:34.644609 16691 raft_consensus.cc:493] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:34.638748 14907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:10:34.657338 14303 leader_election.cc:304] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:34.658308 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:34.660336 14258 raft_consensus.cc:2393] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 4: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:10:34.661336 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:34.662356 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:34.631883 14261 consensus_queue.cc:237] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } }
I20260709 12:10:34.662743 14258 raft_consensus.cc:2376] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 4. Re-sending same reply.
I20260709 12:10:34.664942 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:34.665630 14186 raft_consensus.cc:2468] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 4.
I20260709 12:10:34.668006 14876 leader_election.cc:304] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:34.644203 16664 leader_election.cc:290] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 4 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:34.656404 16501 raft_consensus.cc:2804] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:34.675954 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:34.677867 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:34.678114 14876 leader_election.cc:304] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:34.678648 14256 raft_consensus.cc:2368] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 5. Current term is 6.
I20260709 12:10:34.677117 14258 raft_consensus.cc:2376] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 3. Re-sending same reply.
I20260709 12:10:34.675326 16501 raft_consensus.cc:493] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:34.680894 16501 raft_consensus.cc:3060] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:34.681751 16581 raft_consensus.cc:2804] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:34.682173 16581 raft_consensus.cc:493] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:34.682541 16581 raft_consensus.cc:3060] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:34.679114 14876 leader_election.cc:304] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:34.684597 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:34.685504 14262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41768 (request call id 1369) took 1046 ms. Trace:
I20260709 12:10:34.669978 16588 raft_consensus.cc:2804] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:34.685876 14262 rpcz_store.cc:276] 0709 12:10:33.639031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:33.639173 (+   142us) service_pool.cc:224] Handling call
0709 12:10:34.684424 (+1045251us) spinlock_profiling.cc:243] Waited 48.7 ms on lock 0x7b5800060c98. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2124016b71 00007f2124016a22 00007f212cf2f8d9 00007f212c089ee0 00007f212c1530ab 00007f212c153131 00007f212c1010a0 00007f212c100984 00007f212567b6d4 00007f212567b662
0709 12:10:34.685431 (+  1007us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":112022400}
I20260709 12:10:34.694963 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:34.697445 14182 raft_consensus.cc:3060] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:34.699036 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:34.711939 14190 raft_consensus.cc:1275] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:34.712934 16279 raft_consensus.cc:3060] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:34.680622 16540 raft_consensus.cc:2804] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:34.656495 16647 consensus_queue.cc:1048] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 12:10:34.656704 16618 consensus_queue.cc:1059] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 12:10:34.661252 16682 consensus_queue.cc:1048] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 12:10:34.723444 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:34.661890 16691 raft_consensus.cc:515] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:34.727114 14333 raft_consensus.cc:2468] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 7.
I20260709 12:10:34.730540 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:34.731364 14229 leader_election.cc:304] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:34.732724 14335 raft_consensus.cc:1275] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:10:34.733415 14229 leader_election.cc:304] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:34.735157 14229 leader_election.cc:304] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:34.738843 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
W20260709 12:10:34.729342 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 67132.7us
I20260709 12:10:34.739711 14265 raft_consensus.cc:2410] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:10:34.675905 16629 consensus_queue.cc:1059] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 12:10:34.738062 14182 raft_consensus.cc:1275] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:34.739933 14229 leader_election.cc:304] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:34.726253 16540 raft_consensus.cc:493] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:34.754264 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:34.715850 16725 raft_consensus.cc:2804] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:34.758284 16725 raft_consensus.cc:493] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:34.758736 16725 raft_consensus.cc:3060] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:34.758904 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:34.760495 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:34.761701 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:34.762408 14256 raft_consensus.cc:2468] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 7.
I20260709 12:10:34.763510 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:34.764906 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:10:34.730794 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 46306.4us
I20260709 12:10:34.769433 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:34.767099 14876 leader_election.cc:304] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:34.729799 16652 raft_consensus.cc:493] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:34.741690 16687 raft_consensus.cc:2749] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:34.741760 16667 raft_consensus.cc:493] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:34.755162 16706 raft_consensus.cc:493] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:34.752229 16671 raft_consensus.cc:2749] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:34.790324 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:34.779022 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:34.757434 16164 raft_consensus.cc:2749] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:34.741554 16456 consensus_queue.cc:1059] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 12:10:34.797663 16667 raft_consensus.cc:515] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:34.768541 16629 raft_consensus.cc:493] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:34.798784 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:34.767825 16540 raft_consensus.cc:3060] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:34.802819 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:34.792886 16734 raft_consensus.cc:493] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:34.788496 16664 raft_consensus.cc:2749] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:34.787504 16570 raft_consensus.cc:2804] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:34.831671 14256 raft_consensus.cc:2368] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 5. Current term is 6.
I20260709 12:10:34.836527 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:34.838671 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:34.839272 14260 raft_consensus.cc:3060] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:34.840132 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:34.840873 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:34.841131 14333 raft_consensus.cc:2468] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 4.
I20260709 12:10:34.841506 14257 raft_consensus.cc:2468] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 5.
I20260709 12:10:34.842425 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:34.845829 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:34.846520 14265 raft_consensus.cc:2368] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 5. Current term is 6.
I20260709 12:10:34.846869 14332 raft_consensus.cc:3055] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:34.847266 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:34.845459 14257 raft_consensus.cc:2410] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for term 6 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:10:34.847223 14332 raft_consensus.cc:740] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:34.849015 14332 consensus_queue.cc:260] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:34.841017 16570 raft_consensus.cc:493] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:34.849984 14332 raft_consensus.cc:3060] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:34.850145 16570 raft_consensus.cc:3060] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:34.855037 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:34.856367 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:34.860973 16501 raft_consensus.cc:515] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:34.840521 16734 raft_consensus.cc:515] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:10:34.863092 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:34.864665 14085 catalog_manager.cc:5697] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 1 to 3, leader changed from 885067a0d31741bfb5c9935788e315bf (127.12.174.129) to 73d01e9b1a9d49358da4985b21d681db (127.12.174.132). New cstate: current_term: 3 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:34.804692 16731 raft_consensus.cc:493] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:34.857440 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:34.848358 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:34.868602 14877 leader_election.cc:304] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:10:34.792117 16652 raft_consensus.cc:515] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:34.886224 14332 raft_consensus.cc:1275] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 12:10:34.849017 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:34.890609 14332 pending_rounds.cc:85] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c: Aborting all ops after (but not including) 5
I20260709 12:10:34.890929 14332 pending_rounds.cc:107] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 12:10:34.891191 14332 raft_consensus.cc:2889] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:34.893898 14263 raft_consensus.cc:2393] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 4: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:10:34.894088 14265 raft_consensus.cc:2393] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 7: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:10:34.850090 16487 raft_consensus.cc:3055] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:34.899487 14256 raft_consensus.cc:1275] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:10:34.900624 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:34.900965 14260 raft_consensus.cc:2468] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 5.
W20260709 12:10:34.903889 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 61874.6us
I20260709 12:10:34.845052 16733 raft_consensus.cc:493] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
W20260709 12:10:34.904172 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 164325us
I20260709 12:10:34.906301 14261 raft_consensus.cc:1240] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:34.907328 14229 leader_election.cc:304] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:34.835158 16629 raft_consensus.cc:515] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:34.902040 16737 raft_consensus.cc:3055] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:34.901727 16487 raft_consensus.cc:740] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:10:34.909694 14229 leader_election.cc:400] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 election: Vote denied by peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187) with higher term. Message: Invalid argument: T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 5. Current term is 6.
I20260709 12:10:34.832473 16706 raft_consensus.cc:515] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:34.928123 16706 leader_election.cc:290] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:34.922281 16501 leader_election.cc:290] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 4 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:34.922611 16741 consensus_queue.cc:1048] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 12:10:34.910063 16733 raft_consensus.cc:515] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:34.919467 16682 consensus_queue.cc:1048] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:34.923683 14908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:10:34.932768 16588 raft_consensus.cc:697] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 7 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:34.931227 16743 raft_consensus.cc:493] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:34.918825 16737 raft_consensus.cc:740] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:34.940557 14229 leader_election.cc:403] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:10:34.908752 16735 raft_consensus.cc:2804] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:34.903630 16739 raft_consensus.cc:493] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:34.909303 16708 raft_consensus.cc:2749] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:34.893347 16731 raft_consensus.cc:515] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:34.905086 16540 raft_consensus.cc:515] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:34.908448 14348 tablet_copy_service.cc:140] P 65c9c1653b3346b39a0e118540e6080c: Received BeginTabletCopySession request for tablet 35b39d0f3270452a8bd4f4b1800a837c from peer 73d01e9b1a9d49358da4985b21d681db ({username='slave'} at 127.0.0.1:55492)
I20260709 12:10:34.908666 16355 consensus_queue.cc:1048] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 12:10:34.920987 16487 consensus_queue.cc:260] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:34.943636 16685 raft_consensus.cc:493] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
W20260709 12:10:34.961347 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 221341us
W20260709 12:10:34.954638 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 45096.3us
I20260709 12:10:34.963184 14229 leader_election.cc:304] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:34.964483 14229 leader_election.cc:304] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:34.965003 14182 raft_consensus.cc:1275] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:34.957360 14877 leader_election.cc:304] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:34.944125 16691 leader_election.cc:290] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:34.960070 16739 raft_consensus.cc:515] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:34.968665 16734 leader_election.cc:290] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:34.968699 16739 leader_election.cc:290] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:34.969446 16739 consensus_queue.cc:1048] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:34.970209 16734 consensus_queue.cc:1048] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:10:34.970474 14181 raft_consensus.cc:1275] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:10:34.971108 16570 raft_consensus.cc:515] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:34.972231 16733 leader_election.cc:290] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:34.972852 16625 raft_consensus.cc:2804] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:34.973230 16570 leader_election.cc:290] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 5 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:34.973392 16625 raft_consensus.cc:697] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 5 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:10:34.974313 16625 consensus_queue.cc:237] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:34.975152 14182 raft_consensus.cc:2955] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Committing config change with OpId 5.5: config changed from index -1 to 5, NON_VOTER 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } } }
I20260709 12:10:34.976471 14912 raft_consensus.cc:1240] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 4 LEADER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:34.951920 16743 raft_consensus.cc:515] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:34.978708 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:34.979533 16743 leader_election.cc:290] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:34.980024 14264 raft_consensus.cc:1275] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 12:10:34.980368 14264 pending_rounds.cc:85] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec: Aborting all ops after (but not including) 3
I20260709 12:10:34.980587 14264 pending_rounds.cc:107] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 12:10:34.980840 16629 leader_election.cc:290] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:34.945303 16696 consensus_queue.cc:1048] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 12:10:34.980801 14264 raft_consensus.cc:2889] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:34.980960 16581 raft_consensus.cc:515] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:34.982620 16588 consensus_queue.cc:237] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:34.983654 16738 raft_consensus.cc:2804] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:34.984210 16738 raft_consensus.cc:493] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:34.984575 16738 raft_consensus.cc:3060] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:34.986148 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:34.986894 14190 raft_consensus.cc:2468] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 4.
I20260709 12:10:34.988823 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:34.953356 16735 raft_consensus.cc:493] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:34.989626 14912 raft_consensus.cc:2393] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 5: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
I20260709 12:10:34.990248 16685 raft_consensus.cc:515] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:34.952919 16706 raft_consensus.cc:2749] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187) with higher term. Message: Invalid argument: T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 5. Current term is 6.
I20260709 12:10:34.999178 14908 raft_consensus.cc:2393] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 4: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
I20260709 12:10:35.001178 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:10:35.003028 14229 leader_election.cc:304] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:34.989898 16735 raft_consensus.cc:3060] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:10:35.005610 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 165690us
I20260709 12:10:35.008121 14190 raft_consensus.cc:3055] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:35.008538 14190 raft_consensus.cc:740] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:10:34.958595 16742 raft_consensus.cc:493] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:34.989553 16652 leader_election.cc:290] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:35.010913 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:35.013290 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:35.017817 14332 raft_consensus.cc:3060] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:35.017920 14184 raft_consensus.cc:3060] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:35.014101 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:35.014830 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:35.020920 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
W20260709 12:10:35.022432 14228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:34.988727 16741 consensus_queue.cc:1048] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 12:10:35.000908 16708 raft_consensus.cc:493] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:35.021085 14188 raft_consensus.cc:3060] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:34.998493 14348 tablet_copy_service.cc:161] P 65c9c1653b3346b39a0e118540e6080c: Beginning new tablet copy session on tablet 35b39d0f3270452a8bd4f4b1800a837c from peer 73d01e9b1a9d49358da4985b21d681db at {username='slave'} at 127.0.0.1:55492: session id = 73d01e9b1a9d49358da4985b21d681db-35b39d0f3270452a8bd4f4b1800a837c
I20260709 12:10:35.030413 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:35.062976 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:35.007288 16671 raft_consensus.cc:2804] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:35.066396 14262 raft_consensus.cc:2468] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 5.
I20260709 12:10:35.021565 16706 raft_consensus.cc:2749] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:35.062674 14190 consensus_queue.cc:260] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:35.023387 16487 raft_consensus.cc:3060] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:35.022992 16581 leader_election.cc:290] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 4 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:35.027509 16667 leader_election.cc:290] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:35.027829 16748 raft_consensus.cc:493] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:35.031769 14187 raft_consensus.cc:1240] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:35.016651 16630 consensus_queue.cc:1048] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 12:10:35.085357 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:35.075002 16743 raft_consensus.cc:493] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:35.074815 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:35.033869 14184 raft_consensus.cc:2468] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 5.
I20260709 12:10:35.025135 16279 consensus_queue.cc:1048] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.055s
I20260709 12:10:35.033886 14189 raft_consensus.cc:1240] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:10:35.099993 14190 raft_consensus.cc:3060] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:35.115566 16743 raft_consensus.cc:515] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:35.007521 16725 raft_consensus.cc:515] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:35.024549 16742 raft_consensus.cc:515] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:35.119338 16725 leader_election.cc:290] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 4 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:35.119851 16742 leader_election.cc:290] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:35.126312 16701 raft_consensus.cc:493] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:35.126852 16701 raft_consensus.cc:515] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:35.127554 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:35.128914 16701 leader_election.cc:290] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:35.129124 16394 raft_consensus.cc:3060] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:35.130568 16745 log.cc:927] Time spent T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.197s	user 0.000s	sys 0.002s
I20260709 12:10:35.132576 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:35.102803 16671 raft_consensus.cc:697] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 6 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:10:35.134443 14877 leader_election.cc:304] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:35.135219 16630 raft_consensus.cc:2749] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:35.136512 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:35.137796 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:35.100719 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:35.102483 14339 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3"
dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
mode: GRACEFUL
new_leader_uuid: "885067a0d31741bfb5c9935788e315bf"
 from {username='slave'} at 127.0.0.1:50896
I20260709 12:10:35.101266 14303 leader_election.cc:304] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:35.108505 14188 raft_consensus.cc:2468] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 4.
I20260709 12:10:35.081892 14332 raft_consensus.cc:2468] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 5.
W20260709 12:10:35.145947 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 44803.7us
I20260709 12:10:35.111863 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:35.114461 16638 raft_consensus.cc:493] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:35.149869 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:35.149915 14183 raft_consensus.cc:2468] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 6.
I20260709 12:10:35.153383 14190 raft_consensus.cc:1275] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:10:35.150821 14912 raft_consensus.cc:2468] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 6.
I20260709 12:10:35.147467 14877 leader_election.cc:304] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:10:35.034344 16652 consensus_queue.cc:1048] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.102s
W20260709 12:10:35.158519 14229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:35.160476 14186 raft_consensus.cc:1240] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:10:35.158496 14154 leader_election.cc:304] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:35.166175 14303 leader_election.cc:304] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:35.173699 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:35.176160 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:35.176862 14190 raft_consensus.cc:3060] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:35.183655 14876 leader_election.cc:304] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:10:35.203928 14186 raft_consensus.cc:2393] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db in current term 4: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:10:35.098153 16708 raft_consensus.cc:515] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:35.150899 16696 raft_consensus.cc:2749] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:35.162329 16701 raft_consensus.cc:2804] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:35.162688 16355 raft_consensus.cc:2804] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:35.113770 16748 raft_consensus.cc:515] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } }
I20260709 12:10:35.157552 16742 consensus_queue.cc:1048] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.056s
I20260709 12:10:35.207176 16719 raft_consensus.cc:2804] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:35.157243 16638 raft_consensus.cc:515] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:35.134477 16671 consensus_queue.cc:237] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:35.220187 16682 raft_consensus.cc:2764] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:10:35.205957 16746 consensus_queue.cc:1048] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.064s
I20260709 12:10:35.216009 16701 raft_consensus.cc:493] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:35.219158 16685 leader_election.cc:290] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:35.241792 14190 raft_consensus.cc:2468] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 4.
W20260709 12:10:35.247131 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 79685.1us
W20260709 12:10:35.230288 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 285508us
I20260709 12:10:35.249719 14190 raft_consensus.cc:1275] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:10:35.251617 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:35.252460 14190 raft_consensus.cc:2393] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 6: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:10:35.253583 14230 leader_election.cc:304] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:35.254051 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:35.254746 16667 raft_consensus.cc:2804] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:35.255251 16667 raft_consensus.cc:697] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 5 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:10:35.255714 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:35.256172 16667 consensus_queue.cc:237] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:35.257545 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:35.260318 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:35.261045 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
W20260709 12:10:35.266335 16757 log.cc:927] Time spent T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:10:35.271358 14190 raft_consensus.cc:1240] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 3. Current term is 4. Ops: [3.6-3.6]
W20260709 12:10:35.275018 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:35.265442 14336 raft_consensus.cc:2468] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 6.
I20260709 12:10:35.237623 16731 leader_election.cc:290] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:35.275892 14339 raft_consensus.cc:606] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Received request to transfer leadership to TS 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:35.284292 14339 raft_consensus.cc:614] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:35.279533 14230 leader_election.cc:304] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:35.284857 14260 raft_consensus.cc:1275] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:10:35.282008 14265 raft_consensus.cc:1240] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:35.286197 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:35.243170 16701 raft_consensus.cc:3060] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:35.292112 14912 raft_consensus.cc:2468] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 6.
I20260709 12:10:35.291605 14265 raft_consensus.cc:2955] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Committing config change with OpId 5.5: config changed from index -1 to 5, NON_VOTER 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } } }
I20260709 12:10:35.293334 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:35.296411 14260 raft_consensus.cc:2468] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 7.
I20260709 12:10:35.297343 14230 leader_election.cc:304] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:35.298024 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:35.299000 14260 raft_consensus.cc:2468] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 5.
I20260709 12:10:35.300854 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:35.301891 14260 raft_consensus.cc:2410] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:10:35.239724 16738 raft_consensus.cc:515] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:35.297869 14348 tablet_copy_source_session.cc:215] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 12:10:35.308708 16722 log.cc:927] Time spent T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.818s	user 0.005s	sys 0.000s
W20260709 12:10:35.310289 16754 log.cc:927] Time spent T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
W20260709 12:10:35.311690 16759 log.cc:927] Time spent T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 12:10:35.314168 16743 leader_election.cc:290] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:35.318580 16708 leader_election.cc:290] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:35.283766 16652 raft_consensus.cc:493] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:35.323150 16652 raft_consensus.cc:515] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:35.334180 16456 consensus_queue.cc:1059] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:10:35.341805 14256 raft_consensus.cc:1240] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:10:35.295302 16706 raft_consensus.cc:2804] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:35.306394 16687 raft_consensus.cc:2749] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:10:35.354168 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 166470us
I20260709 12:10:35.357350 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:35.358043 14332 raft_consensus.cc:2468] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 5.
I20260709 12:10:35.358150 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:35.361359 14876 leader_election.cc:304] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:10:35.365309 15827 raft_consensus.cc:2804] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:35.365877 15827 raft_consensus.cc:697] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 4 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:10:35.362776 14331 raft_consensus.cc:1275] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:10:35.375365 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:35.366665 15827 consensus_queue.cc:237] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:35.375005 14304 leader_election.cc:304] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:35.379395 14304 leader_election.cc:304] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:10:35.382674 14304 leader_election.cc:304] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:35.387032 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:35.387797 14265 raft_consensus.cc:2468] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 5.
I20260709 12:10:35.392000 14304 leader_election.cc:304] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:35.357877 16452 raft_consensus.cc:493] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:35.361889 16355 raft_consensus.cc:697] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [term 5 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:10:35.302479 16749 consensus_queue.cc:1059] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.063s
I20260709 12:10:35.374411 16742 consensus_queue.cc:1048] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 12:10:35.398149 14304 leader_election.cc:304] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:35.358531 16706 raft_consensus.cc:697] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 6 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:10:35.396064 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:35.412377 14183 raft_consensus.cc:2468] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 3.
I20260709 12:10:35.419632 14186 raft_consensus.cc:3055] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:35.420037 14186 raft_consensus.cc:740] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
W20260709 12:10:35.436167 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:35.441979 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:35.420888 14186 consensus_queue.cc:260] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:35.444152 14186 raft_consensus.cc:3060] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:35.382398 16719 raft_consensus.cc:697] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 4 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:10:35.398507 16685 raft_consensus.cc:2749] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:35.397270 16696 raft_consensus.cc:2804] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:35.398360 16394 raft_consensus.cc:2804] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:35.408785 16760 raft_consensus.cc:2749] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:35.379132 16731 consensus_queue.cc:1059] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.042s
I20260709 12:10:35.418784 16739 raft_consensus.cc:2804] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:35.457310 14186 raft_consensus.cc:1275] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:35.420213 16762 raft_consensus.cc:493] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:35.409893 16452 raft_consensus.cc:515] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:35.449404 16748 leader_election.cc:290] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:35.408973 16674 consensus_queue.cc:1059] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 12:10:35.449954 16696 raft_consensus.cc:493] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:35.462182 14155 leader_election.cc:304] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:35.460302 16687 raft_consensus.cc:493] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:35.451159 16394 raft_consensus.cc:493] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:35.445612 16652 leader_election.cc:290] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:35.460856 16739 raft_consensus.cc:493] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:35.465696 16685 raft_consensus.cc:493] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:35.482847 14230 leader_election.cc:304] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:10:35.488184 16685 raft_consensus.cc:515] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:35.469185 16355 consensus_queue.cc:237] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:35.492048 16685 leader_election.cc:290] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:35.465651 16762 raft_consensus.cc:515] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:35.479950 14905 raft_consensus.cc:1240] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 5 LEADER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:10:35.494184 16762 leader_election.cc:290] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:35.478253 16696 raft_consensus.cc:3060] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:35.495883 16664 raft_consensus.cc:2804] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:35.496284 16664 raft_consensus.cc:493] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:35.496649 16664 raft_consensus.cc:3060] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:35.479852 16501 raft_consensus.cc:2804] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:35.495329 14230 leader_election.cc:304] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:35.507105 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:35.505290 14303 leader_election.cc:304] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:35.479012 16700 raft_consensus.cc:3055] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:35.518718 14303 leader_election.cc:304] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:35.506515 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:35.480805 16394 raft_consensus.cc:3060] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:35.519706 16667 raft_consensus.cc:2749] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:35.521862 16784 consensus_queue.cc:1059] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:35.529214 14187 raft_consensus.cc:2468] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 3.
I20260709 12:10:35.531770 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:35.488037 16739 raft_consensus.cc:3060] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:35.498070 16501 raft_consensus.cc:493] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:35.546342 16501 raft_consensus.cc:3060] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:35.527498 16700 raft_consensus.cc:740] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:10:35.489009 16735 raft_consensus.cc:515] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:35.471669 16706 consensus_queue.cc:237] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:35.527846 16738 leader_election.cc:290] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 7 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:10:35.554332 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 77077us
W20260709 12:10:35.557965 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 181852us
I20260709 12:10:35.485948 16687 raft_consensus.cc:515] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:35.573336 14155 leader_election.cc:304] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
W20260709 12:10:35.552459 16709 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
W20260709 12:10:35.586431 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 82211.3us
I20260709 12:10:35.527976 16749 consensus_queue.cc:1059] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 12:10:35.528432 16652 consensus_queue.cc:1059] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 12:10:35.488466 16719 consensus_queue.cc:237] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:10:35.655385 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 82153.9us
W20260709 12:10:35.637051 14154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:35.554383 16691 raft_consensus.cc:3055] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:35.576472 16667 consensus_queue.cc:1059] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.228s
W20260709 12:10:35.818418 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:36.061592 14259 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41768 (request call id 1404) took 2077 ms (client timeout 2025 ms). Trace:
I20260709 12:10:35.637652 16658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35b39d0f3270452a8bd4f4b1800a837c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:10:35.646608 16767 log.cc:927] Time spent T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.181s	user 0.001s	sys 0.000s
W20260709 12:10:35.626927 16761 log.cc:927] Time spent T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.169s	user 0.001s	sys 0.001s
W20260709 12:10:35.647189 16769 log.cc:927] Time spent T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.172s	user 0.001s	sys 0.000s
I20260709 12:10:35.869127 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:35.787922 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:10:35.993918 16771 log.cc:927] Time spent T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.140s	user 0.001s	sys 0.000s
I20260709 12:10:35.651762 16452 leader_election.cc:290] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:10:35.621104 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 116832us
W20260709 12:10:36.062152 14259 rpcz_store.cc:269] 0709 12:10:33.983883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.081374 (+ 97491us) service_pool.cc:224] Handling call
0709 12:10:36.061358 (+1979984us) spinlock_profiling.cc:243] Waited 402 ms on lock 0x7b54002229d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:10:36.061516 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":924356480}
I20260709 12:10:36.098677 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:36.020804 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:36.100282 14260 raft_consensus.cc:2468] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 4.
W20260709 12:10:36.059989 16501 consensus_meta.cc:287] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.513s	user 0.003s	sys 0.008s
W20260709 12:10:36.078024 16739 consensus_meta.cc:287] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.518s	user 0.010s	sys 0.000s
I20260709 12:10:35.590643 16709 raft_consensus.cc:493] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:36.084365 14258 raft_consensus.cc:2468] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 3.
W20260709 12:10:36.070457 14155 leader_election.cc:336] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Timed out: RequestConsensusVote RPC to 127.12.174.130:36673 timed out after 1.759s (SENT)
W20260709 12:10:36.078181 16664 consensus_meta.cc:287] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.581s	user 0.010s	sys 0.001s
I20260709 12:10:36.059993 16789 raft_consensus.cc:2749] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:36.110204 14257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41768 (request call id 1422) took 1455 ms. Trace:
I20260709 12:10:35.625834 16701 raft_consensus.cc:515] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:10:36.111070 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:36.112870 14338 raft_consensus.cc:1240] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 6 LEADER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:36.011955 16687 leader_election.cc:290] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:35.830303 16749 raft_consensus.cc:3055] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:36.017885 16776 raft_consensus.cc:493] T f4739bc22bfe44fcba807da02d9351b6 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:36.018335 16735 leader_election.cc:290] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 8 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:35.665545 16691 raft_consensus.cc:740] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:10:35.619532 16671 consensus_queue.cc:1059] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.481s
I20260709 12:10:35.863543 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:36.120460 14155 leader_election.cc:304] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:36.018332 16777 raft_consensus.cc:493] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:35.972981 14904 raft_consensus.cc:1240] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 4 LEADER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:10:35.648967 16785 consensus_queue.cc:1059] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.453s
I20260709 12:10:35.716988 16394 raft_consensus.cc:515] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:35.864274 16661 consensus_queue.cc:1048] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.259s
W20260709 12:10:36.227829 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:36.130565 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:36.228976 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:36.228309 14257 rpcz_store.cc:276] 0709 12:10:34.655283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.842202 (+186919us) service_pool.cc:224] Handling call
0709 12:10:36.109969 (+1267767us) spinlock_profiling.cc:243] Waited 2.34 ms on lock 0x7b54001c1e54. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:10:36.110130 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5377920}
I20260709 12:10:36.235450 14257 raft_consensus.cc:1275] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:36.119350 16501 raft_consensus.cc:515] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:35.649258 16700 consensus_queue.cc:260] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:10:36.260887 14154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:36.206377 16696 consensus_meta.cc:287] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.710s	user 0.011s	sys 0.000s
I20260709 12:10:36.200136 16782 raft_consensus.cc:3055] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:10:36.202069 16775 log.cc:927] Time spent T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
I20260709 12:10:36.269297 16789 raft_consensus.cc:2749] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:36.267925 16501 leader_election.cc:290] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 6 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:36.237702 14261 raft_consensus.cc:1275] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:10:36.128312 16742 raft_consensus.cc:3055] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:36.125007 16709 raft_consensus.cc:515] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:36.129510 16664 raft_consensus.cc:515] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:36.202884 16783 raft_consensus.cc:493] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:36.308497 16709 leader_election.cc:290] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:36.288722 16782 raft_consensus.cc:740] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:10:36.227505 16749 raft_consensus.cc:740] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:10:36.267970 16701 leader_election.cc:290] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 7 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:36.122298 16739 raft_consensus.cc:515] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:36.301448 16742 raft_consensus.cc:740] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:36.290170 16696 raft_consensus.cc:515] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:36.346191 14905 raft_consensus.cc:1240] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 4 LEADER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:10:36.270149 16777 raft_consensus.cc:515] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:36.347467 16664 leader_election.cc:290] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:36.347712 16394 leader_election.cc:290] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 6 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:36.314635 16783 raft_consensus.cc:515] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:36.348264 16782 consensus_queue.cc:260] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:36.349634 16782 raft_consensus.cc:3060] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:36.329114 16790 raft_consensus.cc:493] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:10:36.348637 16777 leader_election.cc:290] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:36.237082 16776 raft_consensus.cc:515] T f4739bc22bfe44fcba807da02d9351b6 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:36.360188 16638 leader_election.cc:290] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:36.368414 16749 consensus_queue.cc:260] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:36.376506 16766 raft_consensus.cc:493] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:10:36.353682 16783 leader_election.cc:290] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:10:36.407564 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 337128us
I20260709 12:10:36.408416 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
W20260709 12:10:36.408381 14155 leader_election.cc:336] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Timed out: RequestConsensusVote RPC to 127.12.174.130:36673 timed out after 1.809s (SENT)
I20260709 12:10:36.409312 14155 leader_election.cc:304] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:36.411928 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
W20260709 12:10:36.402462 14906 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.715s	user 0.006s	sys 0.017s
I20260709 12:10:36.406448 16749 raft_consensus.cc:3060] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:36.390287 16766 raft_consensus.cc:515] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:10:36.419395 16768 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.943s	user 0.014s	sys 0.024s
I20260709 12:10:36.422690 14908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59144 (request call id 248) took 1500 ms. Trace:
I20260709 12:10:36.431565 14908 rpcz_store.cc:276] 0709 12:10:34.921877 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.923418 (+  1541us) service_pool.cc:224] Handling call
0709 12:10:36.422450 (+1499032us) spinlock_profiling.cc:243] Waited 52.6 ms on lock 0x7b5400292cd4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:10:36.422620 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":121046400}
I20260709 12:10:36.423372 14907 raft_consensus.cc:1240] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 3. Current term is 4. Ops: []
W20260709 12:10:36.427388 16779 log.cc:927] Time spent T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.903s	user 0.016s	sys 0.006s
I20260709 12:10:36.370757 16790 raft_consensus.cc:515] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:36.434329 14189 raft_consensus.cc:1240] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:36.435861 14190 raft_consensus.cc:1275] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 12:10:36.430287 14906 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.760s	user 0.006s	sys 0.018s
W20260709 12:10:36.432061 16768 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.961s	user 0.015s	sys 0.024s
I20260709 12:10:36.402701 16742 consensus_queue.cc:260] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:36.447929 16739 leader_election.cc:290] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 6 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:36.451633 16776 leader_election.cc:290] T f4739bc22bfe44fcba807da02d9351b6 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:36.457196 14190 raft_consensus.cc:1275] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:36.458169 15827 consensus_queue.cc:1059] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:36.456735 14908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:36.460186 16696 leader_election.cc:290] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 8 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:10:36.461755 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:36.462931 16783 raft_consensus.cc:493] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:36.463348 16706 raft_consensus.cc:493] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:36.463397 16783 raft_consensus.cc:515] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:36.463855 16706 raft_consensus.cc:515] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:36.465401 16783 leader_election.cc:290] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:36.438634 16815 raft_consensus.cc:2749] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:36.466243 16706 leader_election.cc:290] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:36.485812 16742 raft_consensus.cc:3060] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:36.486744 14264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41764 (request call id 2130) took 2448 ms. Trace:
I20260709 12:10:36.486467 16815 raft_consensus.cc:493] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:36.489123 16652 raft_consensus.cc:3055] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:36.488870 16815 raft_consensus.cc:515] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:36.490661 16737 consensus_queue.cc:260] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:36.492008 16737 raft_consensus.cc:3060] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:36.489570 16652 raft_consensus.cc:740] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:10:36.487567 14264 rpcz_store.cc:276] 0709 12:10:34.037873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.593789 (+555916us) service_pool.cc:224] Handling call
0709 12:10:34.601790 (+  8001us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:34.981970 (+380180us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:36.486107 (+1504137us) spinlock_profiling.cc:243] Waited 378 ms on lock 0x7b54002fd354. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:10:36.486621 (+   514us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":869067520}
I20260709 12:10:36.485838 14906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53194 (request call id 691) took 1139 ms. Trace:
W20260709 12:10:36.506476 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 69037.9us
I20260709 12:10:36.513613 16785 raft_consensus.cc:493] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:36.516127 14155 leader_election.cc:304] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:36.516367 16701 consensus_queue.cc:1059] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:10:36.516579 16785 raft_consensus.cc:515] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } }
I20260709 12:10:36.515563 16777 consensus_queue.cc:1059] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:10:36.519192 16114 raft_consensus.cc:3055] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:36.505162 16801 consensus_queue.cc:1048] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 12:10:36.518814 14155 leader_election.cc:304] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:36.517078 16701 consensus_queue.cc:1243] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer 17aab1bbf5014936aa18cc21818b26ec log is divergent from this leader: its last log entry 4.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:10:36.517378 16709 raft_consensus.cc:2749] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:36.522200 16785 leader_election.cc:290] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:36.512305 16652 consensus_queue.cc:260] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } }
I20260709 12:10:36.511582 16815 leader_election.cc:290] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:36.519594 16114 raft_consensus.cc:740] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:10:36.530203 16766 leader_election.cc:290] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:36.525189 16789 raft_consensus.cc:2749] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:36.530725 16114 consensus_queue.cc:260] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:36.532074 16114 raft_consensus.cc:3060] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:36.534865 14155 leader_election.cc:400] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 election: Vote denied by peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673) with higher term. Message: Invalid argument: T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 5. Current term is 6.
I20260709 12:10:36.535347 16164 raft_consensus.cc:493] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:36.536026 16164 raft_consensus.cc:515] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:36.497596 14906 rpcz_store.cc:276] 0709 12:10:35.346461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:35.347048 (+   587us) service_pool.cc:224] Handling call
0709 12:10:35.362395 (+ 15347us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:35.375158 (+ 12763us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:35.377991 (+  2833us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:35.457943 (+ 79952us) log.cc:844] Serialized 26 byte log entry
0709 12:10:35.535595 (+ 77652us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:36.108175 (+572580us) spinlock_profiling.cc:243] Waited 7.9 ms on lock 0x7b1800292360. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f212cf16ab1 00007f212cf23281 00007f212404e3f3 00007f21240507c1 00007f2124050779 00007f2124050709 00007f21240506d1 00007f212404f9cd 0000000000388634 0000000000388479 00007f212403183a
0709 12:10:36.457698 (+349523us) log.cc:844] Serialized 14 byte log entry
0709 12:10:36.482073 (+ 24375us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:36.482947 (+   874us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:36.483348 (+   401us) raft_consensus.cc:1685] finished
0709 12:10:36.484036 (+   688us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:36.485376 (+  1340us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1203,"prepare.queue_time_us":605870,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":66,"raft.queue_time_us":2903,"raft.run_cpu_time_us":201,"raft.run_wall_time_us":202,"spinlock_wait_cycles":18169728,"thread_start_us":815829,"threads_started":2,"wal-append.queue_time_us":52667}
I20260709 12:10:36.537256 16540 leader_election.cc:290] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 4 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:36.538349 16501 raft_consensus.cc:3055] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:36.535811 14155 leader_election.cc:304] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:36.538825 16501 raft_consensus.cc:740] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:10:36.541585 16813 raft_consensus.cc:2749] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:36.541498 16798 raft_consensus.cc:3055] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:36.505514 16814 consensus_queue.cc:1048] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 12:10:36.538808 16164 leader_election.cc:290] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:36.544755 14339 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:50896 (request call id 20) took 1466 ms. Trace:
I20260709 12:10:36.545673 16708 raft_consensus.cc:3055] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:36.546103 16708 raft_consensus.cc:740] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:10:36.547194 14333 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 345) took 1704 ms. Trace:
I20260709 12:10:36.546913 16708 consensus_queue.cc:260] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:36.542297 16798 raft_consensus.cc:740] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:10:36.548097 16708 raft_consensus.cc:3060] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:36.545192 14339 rpcz_store.cc:276] 0709 12:10:35.082385 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:35.082568 (+   183us) service_pool.cc:224] Handling call
0709 12:10:36.544545 (+1461977us) spinlock_profiling.cc:243] Waited 131 ms on lock 0x7b540023bc54. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f2127135853 00007f212c10360a 00007f21256897d4 00007f2125689762 00007f2125689691 00007f212568960c 00007f21256888c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:10:36.544665 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":300791552}
I20260709 12:10:36.548786 14155 leader_election.cc:304] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:36.550318 16798 consensus_queue.cc:260] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:36.541997 16501 consensus_queue.cc:260] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.2, Last appended by leader: 2, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:36.551752 16798 raft_consensus.cc:3060] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:36.547586 14333 rpcz_store.cc:276] 0709 12:10:34.842606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.842751 (+   145us) service_pool.cc:224] Handling call
0709 12:10:36.546421 (+1703670us) spinlock_profiling.cc:243] Waited 27.9 ms on lock 0x7b5800065d98. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2124016b71 00007f2124016a22 00007f212cf2f8d9 00007f212c089ee0 00007f212c1530ab 00007f212c153131 00007f212c114fc0 00007f212c0ff929 00007f212c0ff3d2 00007f2125676bd4
0709 12:10:36.546648 (+   227us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:36.546828 (+   180us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:36.546855 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:36.546896 (+    41us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:36.546926 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:36.546984 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:36.547099 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":64236416}
I20260709 12:10:36.547498 16691 consensus_queue.cc:260] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:36.560119 16691 raft_consensus.cc:3060] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:36.561865 16813 raft_consensus.cc:2749] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:10:36.562273 16778 log.cc:927] Time spent T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 1.038s	user 0.006s	sys 0.031s
I20260709 12:10:36.573553 14907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53200 (request call id 408) took 1876 ms. Trace:
I20260709 12:10:36.578027 14155 leader_election.cc:304] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
W20260709 12:10:36.582543 14228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:36.583254 16790 leader_election.cc:290] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:36.584882 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:36.585629 14260 raft_consensus.cc:3060] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:36.588074 16627 consensus_queue.cc:1048] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:36.589494 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:10:36.589562 14229 consensus_peers.cc:597] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec -> Peer 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341): Couldn't send request to peer 73d01e9b1a9d49358da4985b21d681db. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e5c1eed5e91b4c908f1f9ebf315fbc6f. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:10:36.590818 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 467698us
I20260709 12:10:36.592073 16776 raft_consensus.cc:2749] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:36.592399 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:36.590281 14189 raft_consensus.cc:2468] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 6.
I20260709 12:10:36.593053 14264 raft_consensus.cc:2468] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 2.
I20260709 12:10:36.594130 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:36.594422 14876 leader_election.cc:304] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:36.595919 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:36.597178 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:36.597775 14265 raft_consensus.cc:2468] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 4.
I20260709 12:10:36.599015 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:36.599804 14257 raft_consensus.cc:2410] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:10:36.601217 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:36.602310 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:36.602543 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:36.603251 14186 raft_consensus.cc:2468] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 1.
I20260709 12:10:36.603639 14229 leader_election.cc:304] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:36.604720 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:36.603420 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:36.605341 14183 raft_consensus.cc:3060] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:36.607007 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:36.607708 14189 raft_consensus.cc:2410] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:10:36.608017 14155 leader_election.cc:304] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:36.609014 14155 leader_election.cc:304] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:36.611850 14260 raft_consensus.cc:2468] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 8.
I20260709 12:10:36.612514 14263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53050 (request call id 391) took 1745 ms. Trace:
I20260709 12:10:36.614383 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:36.614089 14263 rpcz_store.cc:276] 0709 12:10:34.867188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.900674 (+ 33486us) service_pool.cc:224] Handling call
0709 12:10:36.110636 (+1209962us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:36.110839 (+   203us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:36.110863 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:36.110901 (+    38us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:36.110931 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:36.110997 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:36.612338 (+501341us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b54001c1e50. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713a8ad 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:10:36.612456 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2782055680}
I20260709 12:10:36.616614 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:36.618054 14261 raft_consensus.cc:2468] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 7.
I20260709 12:10:36.588112 16501 raft_consensus.cc:3060] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:36.621369 14259 raft_consensus.cc:1275] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:36.615346 16164 raft_consensus.cc:2749] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:36.622993 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:36.624676 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:36.618854 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:36.626889 14264 raft_consensus.cc:2376] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 3. Re-sending same reply.
I20260709 12:10:36.617200 14229 leader_election.cc:304] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:36.619877 14257 raft_consensus.cc:1240] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:36.631497 14229 leader_election.cc:304] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:36.634397 14331 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 351) took 1156 ms. Trace:
I20260709 12:10:36.613081 16776 raft_consensus.cc:2749] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:36.639560 16762 raft_consensus.cc:493] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:36.640731 16682 raft_consensus.cc:493] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:10:36.641196 16743 raft_consensus.cc:493] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:36.641723 16760 raft_consensus.cc:2749] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:36.616281 16790 raft_consensus.cc:2804] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:36.634479 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:10:36.658378 14155 leader_election.cc:304] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:36.658668 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:36.634788 16731 raft_consensus.cc:2749] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:10:36.654734 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:36.661711 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:36.656538 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:36.647037 14229 leader_election.cc:304] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:36.660027 16682 raft_consensus.cc:515] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:36.660353 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:36.660742 14155 leader_election.cc:400] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 election: Vote denied by peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673) with higher term. Message: Invalid argument: T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 5. Current term is 6.
I20260709 12:10:36.664271 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:36.665905 14877 leader_election.cc:304] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:10:36.636859 16164 raft_consensus.cc:2749] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:36.667740 14333 raft_consensus.cc:2393] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 4: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:10:36.670349 14259 raft_consensus.cc:2410] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:10:36.669986 14155 leader_election.cc:403] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:10:36.645447 16749 raft_consensus.cc:2804] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:36.672078 14181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 2122) took 1321 ms. Trace:
I20260709 12:10:36.671447 14332 raft_consensus.cc:1275] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:36.672281 14334 raft_consensus.cc:1275] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:10:36.649255 16782 raft_consensus.cc:493] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:36.651062 16279 raft_consensus.cc:493] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:36.678880 14330 raft_consensus.cc:1240] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 5 LEADER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:10:36.679255 14155 leader_election.cc:304] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:36.672547 14181 rpcz_store.cc:276] 0709 12:10:35.350916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:35.351064 (+   148us) service_pool.cc:224] Handling call
0709 12:10:35.351473 (+   409us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:35.354894 (+  3421us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:10:35.397381 (+ 42487us) log.cc:844] Serialized 14 byte log entry
0709 12:10:35.526531 (+129150us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:35.528127 (+  1596us) log.cc:844] Serialized 26 byte log entry
0709 12:10:35.528275 (+   148us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:35.528309 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:35.528375 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:36.561117 (+1032742us) spinlock_profiling.cc:243] Waited 7.63 ms on lock 0x7b4400022b4c. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2123f74c85 00007f2123f756a2 00007f2126ce71db 00007f2126ce2aaf 00007f2126cd686e 00007f2126cd5bb6 00007f2126cd57d8 00007f2126cdf221 00007f2126cdf1d9 00007f2126cdf169
0709 12:10:36.671776 (+110659us) raft_consensus.cc:1685] finished
0709 12:10:36.671867 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:36.672009 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":17555,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":56,"raft.queue_time_us":5985,"raft.run_cpu_time_us":213,"raft.run_wall_time_us":20844,"spinlock_wait_cycles":17556864,"thread_start_us":140626,"threads_started":3,"wal-append.queue_time_us":104905}
I20260709 12:10:36.680294 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:36.660275 16815 raft_consensus.cc:2749] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:10:36.680953 14336 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50858 (request call id 1430) took 2486 ms (client timeout 1845 ms). Trace:
I20260709 12:10:36.681885 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:10:36.685197 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 1.16649e+06us
I20260709 12:10:36.655200 16790 raft_consensus.cc:493] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
W20260709 12:10:36.682331 14336 rpcz_store.cc:269] 0709 12:10:34.194633 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.197156 (+  2523us) service_pool.cc:224] Handling call
0709 12:10:36.680783 (+2483627us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b540023bc54. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:10:36.680885 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2454391168}
I20260709 12:10:36.694655 14265 raft_consensus.cc:1275] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 12:10:36.694892 14262 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41768 (request call id 1412) took 2061 ms (client timeout 1915 ms). Trace:
W20260709 12:10:36.717808 14262 rpcz_store.cc:269] 0709 12:10:34.633385 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.694710 (+ 61325us) service_pool.cc:224] Handling call
0709 12:10:36.694151 (+1999441us) spinlock_profiling.cc:243] Waited 339 ms on lock 0x7b54001b26d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:10:36.694802 (+   651us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":780093696}
I20260709 12:10:36.671535 16741 raft_consensus.cc:2749] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:36.671330 16394 raft_consensus.cc:493] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:36.574122 14907 rpcz_store.cc:276] 0709 12:10:34.696757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:35.639290 (+942533us) service_pool.cc:224] Handling call
0709 12:10:36.423116 (+783826us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:36.435249 (+ 12133us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:36.573277 (+138028us) spinlock_profiling.cc:243] Waited 769 ms on lock 0x7b5400292cd0. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713a8ad 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:10:36.573467 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1769833216}
I20260709 12:10:36.673285 16749 raft_consensus.cc:493] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:36.731978 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:36.734421 14154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:36.655498 16762 raft_consensus.cc:515] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:36.678247 16627 raft_consensus.cc:2804] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:10:36.736310 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:36.676117 16789 raft_consensus.cc:2749] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673) with higher term. Message: Invalid argument: T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 5. Current term is 6.
W20260709 12:10:36.736994 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 57808.6us
W20260709 12:10:36.738317 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 51899.1us
I20260709 12:10:36.658185 16743 raft_consensus.cc:515] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:36.739356 14304 leader_election.cc:304] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:10:36.741664 14155 leader_election.cc:400] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 pre-election: Vote denied by peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673) with higher term. Message: Invalid argument: T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 5. Current term is 6.
I20260709 12:10:36.785777 14155 leader_election.cc:403] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:10:36.743614 14912 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53194 (request call id 687) took 1490 ms (client timeout 1865 ms). Trace:
W20260709 12:10:36.786355 14912 rpcz_store.cc:269] 0709 12:10:35.253606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:35.253801 (+   195us) service_pool.cc:224] Handling call
0709 12:10:36.743419 (+1489618us) spinlock_profiling.cc:243] Waited 37.4 ms on lock 0x7b540066a3d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:10:36.743552 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":86116224}
I20260709 12:10:36.748793 14338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50858 (request call id 1434) took 2216 ms. Trace:
I20260709 12:10:36.755436 16682 leader_election.cc:290] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:36.714509 16790 raft_consensus.cc:3060] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:36.694008 16114 consensus_queue.cc:1059] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.066s
I20260709 12:10:36.715027 16785 raft_consensus.cc:2804] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:36.693702 16279 raft_consensus.cc:515] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:36.787647 16627 raft_consensus.cc:697] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 8 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:10:36.798337 16785 raft_consensus.cc:493] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:36.799047 16785 raft_consensus.cc:3060] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:36.713506 16532 raft_consensus.cc:493] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:36.729557 16813 raft_consensus.cc:2749] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:36.683846 16735 consensus_queue.cc:1048] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 12:10:36.787842 14338 rpcz_store.cc:276] 0709 12:10:34.532626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.532868 (+   242us) service_pool.cc:224] Handling call
0709 12:10:34.533153 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:36.228728 (+1695575us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:36.748474 (+519746us) spinlock_profiling.cc:243] Waited 1.58 s on lock 0x7b540023a354. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:10:36.748676 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3632510848}
I20260709 12:10:36.681707 16782 raft_consensus.cc:515] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:36.737970 16749 raft_consensus.cc:3060] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:36.814069 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 72556.3us
I20260709 12:10:36.818041 14155 leader_election.cc:304] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:36.819453 14155 leader_election.cc:304] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:36.820987 14155 leader_election.cc:304] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:36.822826 14339 raft_consensus.cc:2393] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 2: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:10:36.786188 16741 raft_consensus.cc:493] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
W20260709 12:10:36.829838 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 87736.1us
I20260709 12:10:36.831230 14303 leader_election.cc:304] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:36.832906 16731 raft_consensus.cc:2749] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:10:36.833654 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 94375.1us
I20260709 12:10:36.833956 16452 raft_consensus.cc:2804] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:36.834393 14304 leader_election.cc:304] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:10:36.837392 14155 leader_election.cc:304] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:36.839407 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:36.840086 14336 raft_consensus.cc:3060] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:36.761883 16742 consensus_queue.cc:1048] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.064s
I20260709 12:10:36.801703 16816 raft_consensus.cc:493] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:36.841526 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:36.844314 14184 raft_consensus.cc:1275] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:36.816563 16602 raft_consensus.cc:493] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:36.850530 14333 raft_consensus.cc:1275] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:10:36.838598 14335 raft_consensus.cc:1275] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 12:10:36.824405 16815 raft_consensus.cc:2749] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:36.851153 14335 pending_rounds.cc:85] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c: Aborting all ops after (but not including) 5
I20260709 12:10:36.854883 14335 pending_rounds.cc:107] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 12:10:36.847110 14334 raft_consensus.cc:1240] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:36.855190 14335 raft_consensus.cc:2889] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:36.824905 16456 raft_consensus.cc:493] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:36.823781 16685 raft_consensus.cc:493] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:36.799808 16532 raft_consensus.cc:515] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:36.799258 16627 consensus_queue.cc:237] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:36.845120 16544 raft_consensus.cc:2804] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:36.852734 14185 raft_consensus.cc:2468] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 5.
I20260709 12:10:36.741073 16394 raft_consensus.cc:515] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:36.834486 16452 raft_consensus.cc:493] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:36.816387 16709 raft_consensus.cc:2749] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673) with higher term. Message: Invalid argument: T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 5. Current term is 6.
I20260709 12:10:36.853380 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:36.874176 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:36.853354 16776 raft_consensus.cc:3060] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:36.856775 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:36.829901 16784 raft_consensus.cc:493] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:36.835471 16777 raft_consensus.cc:2749] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:36.932750 14336 raft_consensus.cc:2468] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 8.
I20260709 12:10:36.856141 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:36.869859 14229 leader_election.cc:304] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
W20260709 12:10:36.934161 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 64426.2us
I20260709 12:10:36.848088 16652 raft_consensus.cc:3060] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:36.832835 16737 consensus_queue.cc:1048] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 12:10:36.866742 16685 raft_consensus.cc:515] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:36.874814 14333 raft_consensus.cc:2468] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 4.
I20260709 12:10:36.860971 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:36.899407 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:36.896821 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:36.900786 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:36.842430 16741 raft_consensus.cc:515] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:36.875644 16452 raft_consensus.cc:3060] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:36.866501 16456 raft_consensus.cc:515] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:36.872516 16544 raft_consensus.cc:493] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:36.902000 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
W20260709 12:10:36.902575 16823 log.cc:927] Time spent T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:10:36.903264 14230 leader_election.cc:304] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:36.903868 16638 consensus_queue.cc:1048] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:36.901384 16164 raft_consensus.cc:493] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:36.906481 14303 leader_election.cc:304] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:36.908193 16706 raft_consensus.cc:493] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:36.908470 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:36.871847 16725 consensus_queue.cc:1048] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 12:10:36.857357 16602 raft_consensus.cc:515] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:36.850914 16739 consensus_queue.cc:1048] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.029s
W20260709 12:10:36.913908 14875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:36.858464 16816 raft_consensus.cc:515] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } }
I20260709 12:10:36.915555 14188 raft_consensus.cc:2468] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 3.
I20260709 12:10:36.871753 16750 raft_consensus.cc:493] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:36.918990 14257 raft_consensus.cc:1275] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:10:36.847389 16733 consensus_queue.cc:1048] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 12:10:36.929606 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:36.933804 16789 raft_consensus.cc:2749] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:36.959039 16760 consensus_queue.cc:1048] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:36.959554 14332 raft_consensus.cc:2468] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 2.
I20260709 12:10:36.959968 16760 consensus_queue.cc:1243] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer 885067a0d31741bfb5c9935788e315bf log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:10:36.961207 14332 raft_consensus.cc:1275] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:36.963117 16741 leader_election.cc:290] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:36.964234 16602 leader_election.cc:290] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:36.941260 16738 raft_consensus.cc:2804] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:36.958374 16544 raft_consensus.cc:3060] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:36.965642 16164 raft_consensus.cc:515] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:36.969310 16706 raft_consensus.cc:515] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:36.941874 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:10:36.970634 16819 log.cc:927] Time spent T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.113s	user 0.000s	sys 0.001s
I20260709 12:10:36.940760 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:36.972546 14330 raft_consensus.cc:3060] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:36.973981 14265 raft_consensus.cc:2393] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 6: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
W20260709 12:10:36.936086 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 98770us
I20260709 12:10:36.974102 14335 raft_consensus.cc:1240] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 5. Current term is 6. Ops: []
W20260709 12:10:36.974162 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 70994.5us
I20260709 12:10:36.974550 14259 raft_consensus.cc:3060] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:36.977083 14230 leader_election.cc:304] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:36.937270 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:36.938845 14334 raft_consensus.cc:2393] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 6: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:10:36.939401 14183 raft_consensus.cc:2468] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 7.
I20260709 12:10:36.923574 16743 leader_election.cc:290] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:36.975090 14155 leader_election.cc:304] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:36.979039 14336 raft_consensus.cc:2468] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 3.
I20260709 12:10:36.932370 16279 leader_election.cc:290] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:36.983717 14190 raft_consensus.cc:1275] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
W20260709 12:10:36.982983 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 76595.8us
I20260709 12:10:36.986788 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:36.988117 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:36.981544 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:36.965194 16738 raft_consensus.cc:493] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:37.016160 16738 raft_consensus.cc:3060] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:37.016759 16602 consensus_queue.cc:1048] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:36.956475 16782 leader_election.cc:290] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:36.964236 16456 leader_election.cc:290] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:36.949491 16661 raft_consensus.cc:493] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:37.011286 16279 raft_consensus.cc:2749] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:37.019408 14333 raft_consensus.cc:1275] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:10:37.020540 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:36.972259 16685 leader_election.cc:290] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:37.022384 16777 consensus_queue.cc:1048] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:36.991710 14334 raft_consensus.cc:2468] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 5.
I20260709 12:10:36.950505 16762 leader_election.cc:290] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:36.954978 16658 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:53194 (request call id 676) took 4110 ms. Trace:
I20260709 12:10:37.003934 16674 raft_consensus.cc:2749] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:10:36.984450 16818 log.cc:927] Time spent T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 12:10:36.994781 16737 raft_consensus.cc:493] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.008169 16394 leader_election.cc:290] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:36.935667 16784 raft_consensus.cc:515] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:37.011204 16532 leader_election.cc:290] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:37.011571 16706 leader_election.cc:290] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:37.013849 16638 raft_consensus.cc:2804] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:37.021793 16501 raft_consensus.cc:3060] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:36.992098 14336 raft_consensus.cc:2393] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 8: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:10:37.036105 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:37.038266 14187 raft_consensus.cc:1240] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:37.041661 14155 leader_election.cc:304] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:37.049651 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
W20260709 12:10:37.050416 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 112387us
I20260709 12:10:37.050331 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:10:37.052965 14303 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:37.068703 14303 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:36.989238 16164 leader_election.cc:290] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:37.069559 14183 raft_consensus.cc:2468] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 4.
I20260709 12:10:37.080401 14187 raft_consensus.cc:1275] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 5 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:10:37.083112 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:36.958496 16750 raft_consensus.cc:515] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:37.083431 14190 raft_consensus.cc:1275] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:10:37.072430 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:37.114697 14189 raft_consensus.cc:2393] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 4: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:10:37.052148 16638 raft_consensus.cc:493] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:37.051698 16279 raft_consensus.cc:493] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
W20260709 12:10:37.112877 14228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:37.117178 14330 raft_consensus.cc:2468] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 7.
I20260709 12:10:37.051913 16743 raft_consensus.cc:493] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:10:37.027549 16658 rpcz_store.cc:276] 0709 12:10:32.844720 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:32.850713 (+  5993us) service_pool.cc:224] Handling call
0709 12:10:33.479194 (+628481us) ts_tablet_manager.cc:934] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db: Initiating tablet copy from peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
0709 12:10:35.345832 (+1866638us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:10:36.490785 (+1144953us) tablet_metadata.cc:665] Metadata flushed
0709 12:10:36.490923 (+   138us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:10:36.953707 (+462784us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:10:36.954215 (+   508us) tablet_replica.cc:206] Creating consensus instance
0709 12:10:36.954741 (+   526us) ts_tablet_manager.cc:989] Replica registered.
0709 12:10:36.954833 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":82080,"tablet-copy.queue_time_us":403662,"thread_start_us":412786,"threads_started":2}
I20260709 12:10:37.123723 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:37.130318 14189 raft_consensus.cc:2468] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 1.
W20260709 12:10:37.130699 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:37.128434 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:37.137163 14259 raft_consensus.cc:2468] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 8.
I20260709 12:10:37.071368 16777 raft_consensus.cc:2749] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:37.039074 16661 raft_consensus.cc:515] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:37.050678 16737 raft_consensus.cc:515] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:37.131682 14190 raft_consensus.cc:2468] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 5.
I20260709 12:10:37.138754 14304 leader_election.cc:304] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
W20260709 12:10:37.141543 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 99986.3us
I20260709 12:10:37.141805 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:37.142635 14155 leader_election.cc:304] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:37.143623 14155 leader_election.cc:304] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
W20260709 12:10:37.127375 16794 log.cc:927] Time spent T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:10:37.146425 14155 leader_election.cc:304] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:37.079066 14907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:10:37.148561 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:37.118597 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:37.149554 14912 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8"
dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
mode: GRACEFUL
new_leader_uuid: "885067a0d31741bfb5c9935788e315bf"
 from {username='slave'} at 127.0.0.1:38628
I20260709 12:10:37.188213 14912 raft_consensus.cc:606] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Received request to transfer leadership to TS 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:37.188623 14912 raft_consensus.cc:614] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:37.151167 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:37.152071 16828 raft_consensus.cc:2749] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:37.139813 16279 raft_consensus.cc:515] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:37.141598 16743 raft_consensus.cc:515] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:37.158201 16737 leader_election.cc:290] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:37.159041 16785 raft_consensus.cc:515] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:37.160902 16750 leader_election.cc:290] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:10:37.166379 16708 consensus_meta.cc:287] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.618s	user 0.007s	sys 0.009s
I20260709 12:10:37.148880 16742 raft_consensus.cc:2804] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:37.171294 16776 raft_consensus.cc:2749] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:37.173311 16658 tablet_copy_client.cc:806] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db: tablet copy: Starting download of 0 data blocks...
W20260709 12:10:37.176576 16824 log.cc:927] Time spent T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.263s	user 0.000s	sys 0.003s
I20260709 12:10:37.179620 16661 leader_election.cc:290] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:36.634905 14331 rpcz_store.cc:276] 0709 12:10:35.477849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:35.479865 (+  2016us) service_pool.cc:224] Handling call
0709 12:10:35.490664 (+ 10799us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:35.490876 (+   212us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:10:35.491160 (+   284us) log.cc:844] Serialized 14 byte log entry
0709 12:10:36.525893 (+1034733us) spinlock_profiling.cc:243] Waited 3.92 ms on lock 0x7b18003e9980. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f212cf16ab1 00007f212cf23281 00007f212404e522 00007f21240507c1 00007f2124050779 00007f2124050709 00007f21240506d1 00007f212404f9cd 0000000000388634 0000000000388479 00007f212403183a
0709 12:10:36.626213 (+100320us) spinlock_profiling.cc:243] Waited 9.15 ms on lock 0x7b18003e9980. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f212cf16ab1 00007f212cf23281 00007f2123fc8c0a 00007f212d708219 00007f2124050a40 00007f212404b4e4 00007f212404b455 00007f2127133060 00007f2127145716 00007f2127156287 00007f2127156208
0709 12:10:36.633967 (+  7754us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:36.634050 (+    83us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:36.634107 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:36.634184 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:36.634317 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26984,"prepare.queue_time_us":26168,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":43,"raft.queue_time_us":1142880,"spinlock_wait_cycles":30067456}
I20260709 12:10:37.181216 16691 raft_consensus.cc:2804] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:37.183172 14155 leader_election.cc:304] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:37.183305 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:37.231541 14188 raft_consensus.cc:2393] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db in current term 7: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:10:37.177666 16790 raft_consensus.cc:515] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:37.189839 14190 raft_consensus.cc:2393] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 7: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:10:37.193845 16701 raft_consensus.cc:2804] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:10:37.197592 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 220563us
I20260709 12:10:37.236356 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:10:37.169590 16798 consensus_meta.cc:287] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.616s	user 0.009s	sys 0.003s
I20260709 12:10:37.150936 16638 raft_consensus.cc:3060] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:37.243847 16700 raft_consensus.cc:3060] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:37.209661 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:37.245147 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:37.245453 14336 raft_consensus.cc:1275] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:10:37.244655 14263 raft_consensus.cc:1275] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 12:10:37.246079 14263 pending_rounds.cc:85] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec: Aborting all ops after (but not including) 5
I20260709 12:10:37.246452 14263 pending_rounds.cc:107] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 12:10:37.244692 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:37.171511 16784 leader_election.cc:290] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:37.215515 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:37.244621 14187 raft_consensus.cc:2468] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 6.
I20260709 12:10:37.206342 16394 raft_consensus.cc:493] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:10:37.184185 14261 raft_consensus.cc:2410] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for term 4 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:10:37.248596 14334 raft_consensus.cc:1275] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:37.232653 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:37.209959 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:37.246804 14263 raft_consensus.cc:2889] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:37.246855 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:10:37.231657 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 48567.9us
I20260709 12:10:37.247778 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:37.232926 14185 raft_consensus.cc:3060] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:37.232600 16828 raft_consensus.cc:2749] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:37.230834 16691 raft_consensus.cc:493] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:10:37.234105 16749 raft_consensus.cc:515] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:37.249836 16658 tablet_copy_client.cc:670] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db: tablet copy: Starting download of 1 WAL segments...
I20260709 12:10:37.286056 14190 raft_consensus.cc:2468] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 7.
I20260709 12:10:37.287355 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:37.236639 16701 raft_consensus.cc:493] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
W20260709 12:10:37.279103 14154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:37.286667 14155 leader_election.cc:304] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:37.231233 16742 raft_consensus.cc:697] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 8 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:37.298888 14155 leader_election.cc:304] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:37.300700 14155 leader_election.cc:304] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:37.301582 16828 raft_consensus.cc:2749] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:37.299631 16674 raft_consensus.cc:493] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.299744 16602 raft_consensus.cc:493] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.299584 16762 raft_consensus.cc:493] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.296845 16701 raft_consensus.cc:3060] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:37.302551 16835 raft_consensus.cc:493] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:37.293048 16691 raft_consensus.cc:3060] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:37.318190 16790 leader_election.cc:290] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 7 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:37.303747 16777 raft_consensus.cc:2804] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:37.319077 16777 raft_consensus.cc:493] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
W20260709 12:10:37.320092 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:37.311074 14229 leader_election.cc:304] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:37.251610 16394 raft_consensus.cc:515] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:37.326112 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:37.328545 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:37.329696 14229 leader_election.cc:304] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:37.330336 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:37.330862 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:37.314546 16785 leader_election.cc:290] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 6 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:37.334093 16783 consensus_queue.cc:1048] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:37.334483 14330 raft_consensus.cc:1240] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:37.333635 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:37.338042 14258 raft_consensus.cc:2393] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 3: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:10:37.317158 16835 raft_consensus.cc:515] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:37.342087 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:37.352229 14229 leader_election.cc:304] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:37.352694 16544 raft_consensus.cc:515] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:37.353215 16831 raft_consensus.cc:2804] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:37.353682 16831 raft_consensus.cc:493] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:37.354038 16831 raft_consensus.cc:3060] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:37.355145 16394 leader_election.cc:290] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:37.340448 16279 leader_election.cc:290] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:37.356206 16279 raft_consensus.cc:2804] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:37.356534 16279 raft_consensus.cc:493] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:37.356835 16279 raft_consensus.cc:3060] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:37.304281 16674 raft_consensus.cc:515] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:37.305086 16734 raft_consensus.cc:493] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.360724 16734 raft_consensus.cc:515] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:37.319732 16452 raft_consensus.cc:515] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } }
I20260709 12:10:37.361646 16661 raft_consensus.cc:493] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.314003 16652 raft_consensus.cc:493] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.340700 16738 raft_consensus.cc:515] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:37.363041 14229 leader_election.cc:304] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:37.364679 16708 raft_consensus.cc:2804] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:37.365041 16708 raft_consensus.cc:493] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:37.365371 16708 raft_consensus.cc:3060] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:37.365934 16738 leader_election.cc:290] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:37.367796 16501 raft_consensus.cc:2749] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:37.368849 14181 raft_consensus.cc:1240] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:37.305297 16762 raft_consensus.cc:515] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:37.371867 16762 leader_election.cc:290] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:37.313846 16741 raft_consensus.cc:493] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:37.372969 16741 raft_consensus.cc:515] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:37.363056 16734 leader_election.cc:290] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:37.363580 16452 leader_election.cc:290] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:37.301878 16822 raft_consensus.cc:493] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.319480 16777 raft_consensus.cc:3060] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:37.377022 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:37.325284 16776 raft_consensus.cc:2804] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:37.389407 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:37.389748 14184 raft_consensus.cc:2393] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 6: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:10:37.378108 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:37.382561 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:37.390286 14262 raft_consensus.cc:2410] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for term 4 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:10:37.390395 14182 raft_consensus.cc:3060] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:37.391050 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:37.392099 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:37.382647 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:37.385118 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:37.384958 14331 raft_consensus.cc:1240] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 5. Current term is 6. Ops: [5.2-5.2]
I20260709 12:10:37.385900 14186 raft_consensus.cc:1275] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 5 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
W20260709 12:10:37.390519 14155 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.174.131:45957 timed out after 1.845s (SENT) [suppressed 43 similar messages]
I20260709 12:10:37.303653 16743 leader_election.cc:290] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:37.386868 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:37.388726 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:37.394465 14261 raft_consensus.cc:2410] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:10:37.398051 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:37.401546 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:37.402302 14262 raft_consensus.cc:2368] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 5. Current term is 6.
I20260709 12:10:37.341238 16832 raft_consensus.cc:2804] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:37.336900 16828 consensus_queue.cc:1048] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.066s
I20260709 12:10:37.419384 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:37.304782 16602 raft_consensus.cc:515] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:37.406319 14182 raft_consensus.cc:2468] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 6.
I20260709 12:10:37.407642 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:37.415748 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:37.428694 14259 raft_consensus.cc:2468] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 6.
I20260709 12:10:37.429278 16638 raft_consensus.cc:515] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:37.431777 14907 raft_consensus.cc:1240] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:37.363898 16652 raft_consensus.cc:515] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:37.435007 16835 leader_election.cc:290] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:37.394570 16822 raft_consensus.cc:515] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:37.392155 16164 raft_consensus.cc:493] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:37.438244 16164 raft_consensus.cc:515] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:37.438939 16822 leader_election.cc:290] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:37.440117 16741 leader_election.cc:290] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:37.440330 16164 leader_election.cc:290] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:37.445950 16544 leader_election.cc:290] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 4 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:37.363758 16742 consensus_queue.cc:237] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:37.452127 16701 raft_consensus.cc:515] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } }
I20260709 12:10:37.418960 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:37.414392 16114 raft_consensus.cc:493] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.397269 16829 raft_consensus.cc:493] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:10:37.418921 16776 raft_consensus.cc:697] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 3 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:10:37.453500 16832 raft_consensus.cc:697] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 7 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:10:37.454672 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:37.456673 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:37.363662 16661 raft_consensus.cc:515] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:37.464488 14185 raft_consensus.cc:2468] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 8.
I20260709 12:10:37.413226 14229 leader_election.cc:304] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
W20260709 12:10:37.494963 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 81859.5us
I20260709 12:10:37.397800 16674 leader_election.cc:290] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:37.471120 14257 raft_consensus.cc:2468] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 5.
W20260709 12:10:37.470520 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 172557us
I20260709 12:10:37.485685 14335 raft_consensus.cc:3060] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:37.503188 14303 leader_election.cc:304] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:37.458874 14265 raft_consensus.cc:1240] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:10:37.499666 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:37.500500 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:37.504562 14303 leader_election.cc:304] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:37.505187 14182 raft_consensus.cc:2468] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 9.
I20260709 12:10:37.507551 14303 leader_election.cc:304] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:37.510212 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:37.510993 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:37.511981 14190 raft_consensus.cc:2410] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:10:37.513227 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:37.514184 14186 raft_consensus.cc:2410] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for term 7 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:10:37.515791 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:10:37.517541 14875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:37.522284 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:37.522886 14190 raft_consensus.cc:1240] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:37.522997 14912 raft_consensus.cc:2468] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 6.
I20260709 12:10:37.524307 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:37.526330 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:37.526886 14190 raft_consensus.cc:2468] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 5.
I20260709 12:10:37.530009 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:37.532182 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:37.532848 14190 raft_consensus.cc:3060] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:37.482679 16114 raft_consensus.cc:515] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:37.538239 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:37.502791 16164 raft_consensus.cc:2749] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:37.541075 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:37.519021 16544 raft_consensus.cc:2804] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:37.515604 16822 raft_consensus.cc:2749] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:37.521150 16835 raft_consensus.cc:2749] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:10:37.547101 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:37.548921 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:37.550086 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:37.551851 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:37.552382 14257 raft_consensus.cc:3060] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:37.554368 14330 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f"
dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
mode: GRACEFUL
new_leader_uuid: "17aab1bbf5014936aa18cc21818b26ec"
 from {username='slave'} at 127.0.0.1:50896
I20260709 12:10:37.556694 14335 raft_consensus.cc:2468] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 6.
I20260709 12:10:37.485306 16829 raft_consensus.cc:515] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:37.529618 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
W20260709 12:10:37.557466 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 166094us
I20260709 12:10:37.558445 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:37.561896 14257 raft_consensus.cc:2468] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 6.
I20260709 12:10:37.570539 14190 raft_consensus.cc:2468] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 5.
I20260709 12:10:37.545980 14907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:37.546594 16544 raft_consensus.cc:493] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:37.582000 16544 raft_consensus.cc:3060] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:37.586731 16701 leader_election.cc:290] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 4 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:37.574853 14330 raft_consensus.cc:606] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 4 LEADER]: Received request to transfer leadership to TS 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:10:37.578778 16829 leader_election.cc:290] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:37.570829 14303 leader_election.cc:304] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
W20260709 12:10:37.595409 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 86754.6us
I20260709 12:10:37.546680 16708 raft_consensus.cc:515] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:37.599329 14155 leader_election.cc:304] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:37.600281 14229 leader_election.cc:304] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:37.601213 14155 leader_election.cc:304] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:37.601859 14303 leader_election.cc:304] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:37.602098 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:37.602231 14229 leader_election.cc:304] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:37.602770 14181 raft_consensus.cc:2468] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 6.
I20260709 12:10:37.605239 14303 leader_election.cc:304] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:37.573441 14905 raft_consensus.cc:2468] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 5.
I20260709 12:10:37.611261 16822 raft_consensus.cc:3060] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:37.610071 14155 leader_election.cc:304] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:37.610296 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:37.606177 14303 leader_election.cc:304] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:37.611313 16843 raft_consensus.cc:2804] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:37.612349 16784 raft_consensus.cc:2749] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:37.613935 16783 raft_consensus.cc:2804] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:37.614419 16394 consensus_queue.cc:1048] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:37.607563 16452 consensus_queue.cc:1048] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 12:10:37.617931 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:37.591639 16709 raft_consensus.cc:493] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.593604 16846 consensus_queue.cc:1059] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 12:10:37.651886 16709 raft_consensus.cc:515] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:37.652634 16846 raft_consensus.cc:3055] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:37.653005 16846 raft_consensus.cc:740] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:37.654150 16709 leader_election.cc:290] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:37.653853 16846 consensus_queue.cc:260] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:37.631636 16815 raft_consensus.cc:2749] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:37.640019 16602 leader_election.cc:290] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:37.613466 16782 raft_consensus.cc:2804] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:37.655921 16782 raft_consensus.cc:697] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 6 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:10:37.656836 16782 consensus_queue.cc:237] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:37.651886 16544 raft_consensus.cc:515] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:37.660938 16544 leader_election.cc:290] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 6 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:37.661245 16749 leader_election.cc:290] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:37.568543 16832 consensus_queue.cc:237] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:37.594921 16785 consensus_queue.cc:1048] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.034s
I20260709 12:10:37.626909 14303 leader_election.cc:304] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:37.628809 14155 leader_election.cc:304] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:37.606621 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:37.629683 16843 raft_consensus.cc:493] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:37.595391 16828 consensus_queue.cc:1048] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 12:10:37.673761 16843 raft_consensus.cc:3060] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:37.603861 16701 raft_consensus.cc:2749] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:37.604728 16748 raft_consensus.cc:2804] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:37.676110 16748 raft_consensus.cc:493] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:37.676558 16748 raft_consensus.cc:3060] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:37.678826 16602 consensus_queue.cc:1059] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:37.680178 16602 raft_consensus.cc:3055] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:37.680557 16602 raft_consensus.cc:740] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:37.631508 16696 raft_consensus.cc:2764] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:10:37.626438 14335 raft_consensus.cc:2368] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 4. Current term is 5.
I20260709 12:10:37.623225 14230 leader_election.cc:304] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:37.655117 16846 raft_consensus.cc:3060] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:37.738340 16797 raft_consensus.cc:3055] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:37.738823 16797 raft_consensus.cc:740] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:10:37.739355 16843 raft_consensus.cc:515] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:37.633309 14876 leader_election.cc:304] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:37.611423 16661 leader_election.cc:290] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:37.667760 14155 leader_election.cc:304] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
W20260709 12:10:37.743018 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 75327.3us
I20260709 12:10:37.743961 14155 leader_election.cc:400] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 election: Vote denied by peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673) with higher term. Message: Invalid argument: T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 5. Current term is 6.
I20260709 12:10:37.744280 14155 leader_election.cc:403] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:10:37.669940 14303 leader_election.cc:304] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:37.672437 16815 raft_consensus.cc:2749] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:37.597054 16279 raft_consensus.cc:515] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:37.604065 16829 consensus_queue.cc:1048] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.042s
I20260709 12:10:37.666514 16532 raft_consensus.cc:493] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:37.689365 16544 raft_consensus.cc:2749] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:37.640444 16783 raft_consensus.cc:493] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:37.600106 16777 raft_consensus.cc:515] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:37.693442 16831 raft_consensus.cc:515] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:37.587446 16776 consensus_queue.cc:237] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:37.767755 16279 leader_election.cc:290] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 7 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:37.694394 16731 raft_consensus.cc:493] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.694839 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:37.681525 16602 consensus_queue.cc:260] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:37.617725 16114 leader_election.cc:290] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:37.613382 16708 leader_election.cc:290] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 8 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:37.696137 16691 raft_consensus.cc:515] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:37.697438 14256 raft_consensus.cc:2410] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:10:37.717491 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:10:37.625075 16842 log.cc:927] Time spent T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
I20260709 12:10:37.721506 14330 raft_consensus.cc:1240] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 5. Current term is 6. Ops: []
W20260709 12:10:37.723516 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 100397us
I20260709 12:10:37.796873 14230 leader_election.cc:304] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:37.796906 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:37.723376 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:37.798329 14339 raft_consensus.cc:2468] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 6.
I20260709 12:10:37.727869 16749 raft_consensus.cc:2749] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:37.730906 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:37.799770 14230 leader_election.cc:304] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:37.800763 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:37.733786 16763 consensus_queue.cc:1048] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:37.734164 14877 leader_election.cc:304] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:37.734748 16795 consensus_queue.cc:1059] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:10:37.745419 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 75552.5us
W20260709 12:10:37.746017 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 112817us
I20260709 12:10:37.804433 14187 raft_consensus.cc:3060] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:37.748056 14155 leader_election.cc:304] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:37.740130 16797 consensus_queue.cc:260] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:37.756240 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:37.805908 14303 leader_election.cc:304] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:37.806375 14335 raft_consensus.cc:2468] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 4.
I20260709 12:10:37.757139 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:37.761068 14260 raft_consensus.cc:2393] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 7: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:10:37.770074 16731 raft_consensus.cc:515] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:37.771564 16777 leader_election.cc:290] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 8 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:37.772137 14182 raft_consensus.cc:1240] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:37.759531 16783 raft_consensus.cc:3060] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:37.749531 16394 raft_consensus.cc:2804] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:37.757609 16532 raft_consensus.cc:515] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:37.780294 16831 leader_election.cc:290] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 4 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:37.754124 16785 raft_consensus.cc:2749] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673) with higher term. Message: Invalid argument: T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 5. Current term is 6.
I20260709 12:10:37.846787 16532 leader_election.cc:290] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:37.754179 16829 consensus_queue.cc:1243] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer 885067a0d31741bfb5c9935788e315bf log is divergent from this leader: its last log entry 5.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:10:37.749763 16540 raft_consensus.cc:2804] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:37.749939 16813 raft_consensus.cc:2749] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:37.848980 16540 raft_consensus.cc:493] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:37.849440 16540 raft_consensus.cc:3060] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:37.850265 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:37.807996 16602 raft_consensus.cc:3060] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:37.851982 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 117904us
W20260709 12:10:37.786725 16627 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.754s	user 0.009s	sys 0.014s
W20260709 12:10:37.852900 16627 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.847s	user 0.010s	sys 0.015s
I20260709 12:10:37.853463 16750 raft_consensus.cc:2749] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:37.854233 16750 consensus_queue.cc:1048] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:37.787681 14264 raft_consensus.cc:2468] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 6.
I20260709 12:10:37.855087 16731 leader_election.cc:290] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:37.856042 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:37.850927 14259 raft_consensus.cc:3060] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:37.857208 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:37.859334 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:37.860021 14258 raft_consensus.cc:2468] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 7.
I20260709 12:10:37.860546 14264 raft_consensus.cc:3060] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:37.860960 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:37.860956 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:10:37.863165 16822 raft_consensus.cc:2749] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:37.864507 14263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53050 (request call id 401) took 1246 ms. Trace:
I20260709 12:10:37.864904 14263 rpcz_store.cc:276] 0709 12:10:36.617661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:36.617816 (+   155us) service_pool.cc:224] Handling call
0709 12:10:36.618158 (+   342us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:37.251198 (+633040us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:37.864262 (+613064us) spinlock_profiling.cc:243] Waited 626 ms on lock 0x7b540022abd4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:10:37.864444 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1440001792}
I20260709 12:10:37.866228 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:37.801501 14230 leader_election.cc:304] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:37.803011 14304 leader_election.cc:304] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:37.794018 16164 raft_consensus.cc:493] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.868655 16164 raft_consensus.cc:515] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:37.842191 16394 raft_consensus.cc:493] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:37.861594 14258 raft_consensus.cc:2468] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 4.
I20260709 12:10:37.869705 16394 raft_consensus.cc:3060] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:37.799045 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 196858us
I20260709 12:10:37.872655 16452 raft_consensus.cc:2804] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:37.873780 14263 raft_consensus.cc:1240] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 12:10:37.841341 14333 raft_consensus.cc:2468] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 7.
I20260709 12:10:37.866814 16797 raft_consensus.cc:3060] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:37.867436 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:37.869259 14264 raft_consensus.cc:2468] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 5.
I20260709 12:10:37.871511 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:37.840868 16748 raft_consensus.cc:515] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:37.874709 16843 leader_election.cc:290] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:37.889971 14262 raft_consensus.cc:2393] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 4: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:10:37.841233 16815 raft_consensus.cc:2749] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:10:37.877162 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 75746.7us
I20260709 12:10:37.803541 16279 raft_consensus.cc:2749] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:10:37.809065 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 61084.1us
I20260709 12:10:37.894655 14230 leader_election.cc:304] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
W20260709 12:10:37.897578 14155 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:37.887542 14259 raft_consensus.cc:2468] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 4.
I20260709 12:10:37.891583 14303 leader_election.cc:304] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:37.809051 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:10:37.898834 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 95924.6us
I20260709 12:10:37.899252 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:37.903373 14304 leader_election.cc:304] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:10:37.904778 14304 leader_election.cc:304] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:10:37.907632 14303 leader_election.cc:304] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:10:37.810251 16708 raft_consensus.cc:2749] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:37.909340 14229 leader_election.cc:304] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:37.892654 16831 raft_consensus.cc:2749] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:37.913101 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
W20260709 12:10:37.913992 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 60960.5us
I20260709 12:10:37.917297 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:37.920142 14155 leader_election.cc:304] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:37.921203 14230 leader_election.cc:304] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
W20260709 12:10:37.922158 14303 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:37.913966 14265 raft_consensus.cc:2393] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 3: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:10:37.802354 16661 consensus_queue.cc:1048] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.107s
I20260709 12:10:37.901844 16835 raft_consensus.cc:2749] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:37.925067 14155 leader_election.cc:304] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:37.926133 14304 leader_election.cc:304] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:37.923391 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:37.925187 14330 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8"
dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
mode: GRACEFUL
new_leader_uuid: "885067a0d31741bfb5c9935788e315bf"
 from {username='slave'} at 127.0.0.1:50896
I20260709 12:10:37.929505 14330 raft_consensus.cc:606] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 5 LEADER]: Received request to transfer leadership to TS 885067a0d31741bfb5c9935788e315bf
W20260709 12:10:37.929765 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 74771.3us
I20260709 12:10:37.908226 16846 raft_consensus.cc:2804] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:37.913911 16843 raft_consensus.cc:2749] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:37.899094 16540 raft_consensus.cc:515] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:37.937640 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:37.939253 14265 raft_consensus.cc:1240] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:37.940536 14187 raft_consensus.cc:2468] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 3.
I20260709 12:10:37.912958 16452 raft_consensus.cc:697] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 5 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:37.926811 16544 raft_consensus.cc:2804] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:37.948668 16738 raft_consensus.cc:2749] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:37.928985 16674 raft_consensus.cc:2804] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:37.947606 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:37.953276 14265 raft_consensus.cc:2368] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 4. Current term is 5.
I20260709 12:10:37.950923 16544 raft_consensus.cc:493] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:10:37.955222 16544 raft_consensus.cc:3060] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:37.943491 16853 consensus_queue.cc:1048] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 12:10:37.961779 16658 tablet_copy_client.cc:538] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:10:37.935361 16822 raft_consensus.cc:2749] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:37.963721 14155 leader_election.cc:400] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 4 election: Vote denied by peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673) with higher term. Message: Invalid argument: T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 4. Current term is 5.
I20260709 12:10:37.964074 14155 leader_election.cc:403] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:10:37.964610 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:37.940834 16846 raft_consensus.cc:493] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:37.942229 16831 raft_consensus.cc:493] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.943933 16798 raft_consensus.cc:493] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.926855 16708 raft_consensus.cc:2749] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:37.926743 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:37.935935 16776 raft_consensus.cc:2804] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:37.934274 16700 raft_consensus.cc:2749] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:37.948134 14230 leader_election.cc:304] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:37.978510 16776 raft_consensus.cc:697] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 6 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:10:37.980113 14230 leader_election.cc:304] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:37.981406 16829 raft_consensus.cc:2749] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:37.934641 16813 consensus_queue.cc:1059] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 12:10:37.982379 16813 raft_consensus.cc:3055] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:37.982801 16813 raft_consensus.cc:740] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:10:37.983641 16813 consensus_queue.cc:260] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:37.984941 16813 raft_consensus.cc:3060] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:37.985911 14906 raft_consensus.cc:2368] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for earlier term 6. Current term is 7.
I20260709 12:10:37.986518 16748 leader_election.cc:290] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:37.988605 16691 leader_election.cc:290] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 2 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:37.928836 16815 raft_consensus.cc:2804] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:37.949426 16832 consensus_queue.cc:1048] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:10:37.918947 16855 consensus_queue.cc:1059] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 12:10:37.965423 14265 raft_consensus.cc:2468] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 5.
I20260709 12:10:37.962859 16674 raft_consensus.cc:493] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:37.938388 16739 consensus_queue.cc:1059] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 12:10:37.967661 14877 leader_election.cc:304] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:37.968225 16785 raft_consensus.cc:2749] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673) with higher term. Message: Invalid argument: T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 4. Current term is 5.
W20260709 12:10:37.990477 14304 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:37.989295 14087 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60436 (request call id 284) took 14645 ms (client timeout 15000 ms). Trace:
I20260709 12:10:37.992592 14230 leader_election.cc:304] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:10:37.997783 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:38.004585 14265 raft_consensus.cc:2368] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 2. Current term is 3.
I20260709 12:10:38.005189 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:38.005527 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:38.006032 14330 raft_consensus.cc:2368] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 2. Current term is 3.
I20260709 12:10:38.006763 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:37.973021 16831 raft_consensus.cc:515] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:37.969905 16846 raft_consensus.cc:3060] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:37.994438 16815 raft_consensus.cc:493] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:37.979597 16776 consensus_queue.cc:237] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:38.013571 16540 leader_election.cc:290] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 7 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:37.985927 16853 raft_consensus.cc:2749] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:38.000305 14085 catalog_manager.cc:5697] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 4 to 5, leader changed from 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130) to 885067a0d31741bfb5c9935788e315bf (127.12.174.129). New cstate: current_term: 5 leader_uuid: "885067a0d31741bfb5c9935788e315bf" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:10:38.012360 16831 leader_election.cc:290] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:37.989692 16798 raft_consensus.cc:515] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:37.998281 16832 consensus_queue.cc:1243] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer 65c9c1653b3346b39a0e118540e6080c log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:10:38.001601 16674 raft_consensus.cc:3060] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:38.026860 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
W20260709 12:10:38.027730 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 60148.4us
I20260709 12:10:38.029114 14330 raft_consensus.cc:2393] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 3: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:10:38.030128 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
W20260709 12:10:38.002585 14087 rpcz_store.cc:269] 0709 12:10:23.343505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:23.345889 (+  2384us) service_pool.cc:224] Handling call
0709 12:10:23.968013 (+622124us) spinlock_profiling.cc:243] Waited 121 ms on lock 0x7b54002e3454. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a5090 00007f2127143f3a 00007f212cef9e9c 00007f212cff804e 00007f212b4b92a4 00007f212b4b9232 00007f212b4b9161 00007f212b4b90dc 00007f212b4b8392 00007f212547648c 00007f21254758c6
0709 12:10:37.989213 (+14021200us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:31.639778 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:31.691594 (+ 51816us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:31.691653 (+    59us) write_op.cc:435] Acquired schema lock
0709 12:10:31.691673 (+    20us) tablet.cc:662] Decoding operations
0709 12:10:31.692730 (+  1057us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:31.692816 (+    86us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:31.692851 (+    35us) tablet.cc:685] Acquiring locks for 9 operations
0709 12:10:31.693686 (+   835us) tablet.cc:701] Row locks acquired
0709 12:10:31.698153 (+  4467us) write_op.cc:260] PREPARE: finished
0709 12:10:31.729650 (+ 31497us) write_op.cc:270] Start()
0709 12:10:31.751178 (+ 21528us) write_op.cc:276] Timestamp: P: 1783599031718958 usec, L: 0
0709 12:10:31.758788 (+  7610us) op_driver.cc:348] REPLICATION: starting
0709 12:10:31.858120 (+ 99332us) log.cc:844] Serialized 3654 byte log entry
0709 12:10:33.234285 (+1376165us) op_driver.cc:464] REPLICATION: finished
0709 12:10:33.444553 (+210268us) write_op.cc:301] APPLY: starting
0709 12:10:33.444727 (+   174us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:33.445010 (+   283us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:33.445157 (+   147us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:33.580000 (+134843us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:33.736877 (+156877us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=9
0709 12:10:33.747209 (+ 10332us) write_op.cc:312] APPLY: finished
0709 12:10:33.796606 (+ 49397us) log.cc:844] Serialized 71 byte log entry
0709 12:10:33.796830 (+   224us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:33.796976 (+   146us) write_op.cc:454] Released schema lock
0709 12:10:33.797043 (+    67us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:33.797455 (+   412us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:33.797483 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":651532,"reported_tablets":33,"spinlock_wait_cycles":278252288,"child_traces":[["op",{"apply.queue_time_us":165365,"apply.run_cpu_time_us":5430,"apply.run_wall_time_us":378301,"num_ops":9,"prepare.queue_time_us":105934,"prepare.run_cpu_time_us":29813,"prepare.run_wall_time_us":941432,"raft.queue_time_us":361183,"raft.run_cpu_time_us":41138,"raft.run_wall_time_us":192625,"replication_time_us":1454058,"thread_start_us":889255,"threads_started":4,"wal-append.queue_time_us":604856,"wal-append.run_cpu_time_us":17071,"wal-append.run_wall_time_us":2334308}]]}
I20260709 12:10:38.044044 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:38.019840 16815 raft_consensus.cc:3060] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:37.980165 16452 consensus_queue.cc:237] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } }
I20260709 12:10:38.027971 14085 catalog_manager.cc:5697] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 3 to 6, leader changed from 885067a0d31741bfb5c9935788e315bf (127.12.174.129) to 73d01e9b1a9d49358da4985b21d681db (127.12.174.132). New cstate: current_term: 6 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:38.070593 14877 leader_election.cc:304] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:38.079262 14085 catalog_manager.cc:5697] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:38.021972 16738 raft_consensus.cc:2804] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:38.068193 16808 raft_consensus.cc:2749] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:38.084539 14085 catalog_manager.cc:5697] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 1 to 2, leader changed from 885067a0d31741bfb5c9935788e315bf (127.12.174.129) to 73d01e9b1a9d49358da4985b21d681db (127.12.174.132). New cstate: current_term: 2 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:38.090799 16798 leader_election.cc:290] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:10:38.096424 14875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:38.086915 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:38.081879 16853 raft_consensus.cc:493] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:38.107190 16853 raft_consensus.cc:515] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:38.110136 14337 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 347) took 3135 ms. Trace:
I20260709 12:10:38.110616 14337 rpcz_store.cc:276] 0709 12:10:34.974610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.974779 (+   169us) service_pool.cc:224] Handling call
0709 12:10:36.067168 (+1092389us) spinlock_profiling.cc:243] Waited 16.8 ms on lock 0x7b5800065d98. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2124016b71 00007f2124016a22 00007f212cf2f8d9 00007f212c089ee0 00007f212c1530ab 00007f212c153131 00007f212c114fc0 00007f212c0ff929 00007f212c0ff3d2 00007f2125676bd4
0709 12:10:36.067371 (+   203us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:36.643602 (+576231us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:36.643639 (+    37us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:36.644338 (+   699us) log.cc:844] Serialized 52 byte log entry
0709 12:10:36.855075 (+210737us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:36.900241 (+ 45166us) log.cc:844] Serialized 14 byte log entry
0709 12:10:36.922363 (+ 22122us) log.cc:844] Serialized 14 byte log entry
0709 12:10:36.922575 (+   212us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:36.922644 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:37.162005 (+239361us) spinlock_profiling.cc:243] Waited 1.67 ms on lock 0x7b18003e9bc0. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f212cf16ab1 00007f212cf23281 00007f212401c2a6 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f212c064aa1 00007f212c05bb37 00007f212c05b9ca 00007f212c15326f
0709 12:10:37.449341 (+287336us) spinlock_profiling.cc:243] Waited 2.69 ms on lock 0x7b4800100bd8. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f212c064aa1 00007f212c05bb37 00007f212c05b9ca 00007f212c15326f 00007f212c152f37 00007f212c16755c 00007f212c167508 00007f212c167488 00007f212c167443 00007f212c1666ec 00007f212b090a96
0709 12:10:37.978617 (+529276us) spinlock_profiling.cc:243] Waited 2.35 ms on lock 0x7b18003e9bc0. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f212cf16ab1 00007f212cf23281 00007f212404e3f3 00007f21240507c1 00007f2124050779 00007f2124050709 00007f21240506d1 00007f212404f9cd 0000000000388634 0000000000388479 00007f212403183a
0709 12:10:38.109842 (+131225us) raft_consensus.cc:1685] finished
0709 12:10:38.109867 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:38.110050 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":575771,"prepare.queue_time_us":79660,"prepare.run_cpu_time_us":120,"prepare.run_wall_time_us":2478,"raft.queue_time_us":586881,"raft.run_cpu_time_us":4437,"raft.run_wall_time_us":537185,"spinlock_wait_cycles":54003584,"thread_start_us":208243,"threads_started":1,"wal-append.queue_time_us":294780}
I20260709 12:10:38.113442 14337 pending_rounds.cc:85] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c: Aborting all ops after (but not including) 1
I20260709 12:10:38.081041 16738 raft_consensus.cc:493] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:38.114331 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:38.114766 16738 raft_consensus.cc:3060] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:38.115031 14339 raft_consensus.cc:3060] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:38.117529 14337 pending_rounds.cc:107] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 12:10:38.117997 14337 raft_consensus.cc:2889] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:38.167725 14339 raft_consensus.cc:2468] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 4.
I20260709 12:10:38.079428 16783 raft_consensus.cc:515] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:38.171326 16768 raft_consensus.cc:493] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:38.190572 16768 raft_consensus.cc:515] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } }
I20260709 12:10:38.191990 16355 raft_consensus.cc:493] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:10:38.116679 16846 raft_consensus.cc:515] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:10:38.172055 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 235454us
I20260709 12:10:38.189246 14230 leader_election.cc:304] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:10:38.200830 16832 raft_consensus.cc:2804] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:38.201455 16832 raft_consensus.cc:697] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 4 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:10:38.193070 16355 raft_consensus.cc:515] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:38.078066 16394 raft_consensus.cc:515] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:38.134922 16689 raft_consensus.cc:2749] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:38.208022 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:38.222047 14187 raft_consensus.cc:3060] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:38.210896 16355 leader_election.cc:290] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:38.233287 14187 raft_consensus.cc:2468] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 7.
I20260709 12:10:38.177484 16831 raft_consensus.cc:493] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:38.193418 16768 leader_election.cc:290] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:38.247282 14332 raft_consensus.cc:2368] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 6. Current term is 7.
I20260709 12:10:38.168366 16627 consensus_queue.cc:1048] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.066s
W20260709 12:10:38.282130 14155 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:38.246687 16831 raft_consensus.cc:515] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:38.267792 16853 leader_election.cc:290] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:38.290562 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:38.298617 14331 raft_consensus.cc:2468] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 4.
I20260709 12:10:38.300680 14230 leader_election.cc:304] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:10:38.277874 16661 raft_consensus.cc:493] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:38.245786 16832 consensus_queue.cc:237] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:38.306753 16853 raft_consensus.cc:2804] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:38.292348 16544 raft_consensus.cc:515] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:10:38.318610 14155 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:38.322657 16816 leader_election.cc:290] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:38.327520 16846 leader_election.cc:290] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 8 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:38.327765 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:38.329375 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:38.330772 14264 raft_consensus.cc:2468] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 7.
I20260709 12:10:38.331777 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:38.332304 14264 raft_consensus.cc:3060] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:38.335042 16738 raft_consensus.cc:515] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:38.310463 16853 raft_consensus.cc:493] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:38.305872 16661 raft_consensus.cc:515] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:38.318547 16658 tablet_bootstrap.cc:492] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db: Bootstrap starting.
I20260709 12:10:38.384491 16394 leader_election.cc:290] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 7 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:38.384690 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:38.385334 14339 raft_consensus.cc:3060] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:38.344702 14264 raft_consensus.cc:2468] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 8.
I20260709 12:10:38.341202 16853 raft_consensus.cc:3060] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:38.326349 16760 raft_consensus.cc:493] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:38.392205 16776 raft_consensus.cc:493] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:38.391237 16783 leader_election.cc:290] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:38.400878 14339 raft_consensus.cc:2468] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 7.
I20260709 12:10:38.402171 14877 leader_election.cc:304] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:10:38.402789 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:38.397554 16625 raft_consensus.cc:493] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:38.403650 14339 raft_consensus.cc:2368] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db for earlier term 7. Current term is 8.
I20260709 12:10:38.406138 14877 leader_election.cc:400] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 7 pre-election: Vote denied by peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957) with higher term. Message: Invalid argument: T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db for earlier term 7. Current term is 8.
I20260709 12:10:38.406476 14877 leader_election.cc:403] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:38.400238 16456 raft_consensus.cc:493] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:38.415092 16708 raft_consensus.cc:3055] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:38.415578 16708 raft_consensus.cc:740] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:10:38.416443 16708 consensus_queue.cc:260] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:38.417466 16708 raft_consensus.cc:3060] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:38.397852 16760 raft_consensus.cc:515] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:38.420781 14338 raft_consensus.cc:1240] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:38.422375 16738 leader_election.cc:290] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:38.422423 16760 leader_election.cc:290] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:38.415140 16456 raft_consensus.cc:515] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:38.409894 16625 raft_consensus.cc:515] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:38.425624 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:38.426080 14155 leader_election.cc:304] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:38.426273 16625 leader_election.cc:290] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:38.427134 16501 raft_consensus.cc:2804] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:38.427591 16501 raft_consensus.cc:493] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:38.427913 16501 raft_consensus.cc:3060] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:38.430371 14265 raft_consensus.cc:1240] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 9. Current term is 10. Ops: []
I20260709 12:10:38.427107 14155 leader_election.cc:400] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 2 election: Vote denied by peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673) with higher term. Message: Invalid argument: T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 2. Current term is 3.
I20260709 12:10:38.435940 14155 leader_election.cc:403] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:10:38.435994 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:38.437994 16813 raft_consensus.cc:2749] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673) with higher term. Message: Invalid argument: T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 2. Current term is 3.
I20260709 12:10:38.442179 16733 raft_consensus.cc:3055] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:38.442698 16733 raft_consensus.cc:740] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:38.443607 16733 consensus_queue.cc:260] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:38.444132 16674 raft_consensus.cc:515] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:38.444947 16733 raft_consensus.cc:3060] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:38.446218 16768 raft_consensus.cc:493] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:38.446760 16768 raft_consensus.cc:515] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:38.448345 14906 raft_consensus.cc:1240] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:38.448833 16768 leader_election.cc:290] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:38.449570 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:38.450227 14184 raft_consensus.cc:3060] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:38.450552 16674 leader_election.cc:290] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:38.451974 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:38.452613 14187 raft_consensus.cc:2468] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 4.
I20260709 12:10:38.453051 14229 leader_election.cc:304] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:38.454566 14261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41768 (request call id 1447) took 1065 ms. Trace:
I20260709 12:10:38.455008 14261 rpcz_store.cc:276] 0709 12:10:37.389607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:37.406489 (+ 16882us) service_pool.cc:224] Handling call
0709 12:10:37.406874 (+   385us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:37.577486 (+170612us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:37.577517 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:37.577560 (+    43us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:37.577593 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:38.454304 (+876711us) spinlock_profiling.cc:243] Waited 170 ms on lock 0x7b54002215d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:10:38.454353 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:38.454486 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":391886080}
I20260709 12:10:38.455369 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:10:38.458946 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 49941.4us
I20260709 12:10:38.457894 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:38.461272 14190 raft_consensus.cc:3060] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:38.462704 14184 raft_consensus.cc:2468] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 8.
I20260709 12:10:38.467378 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:38.470507 14182 raft_consensus.cc:1275] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 12:10:38.470948 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 61236.4us
I20260709 12:10:38.474287 14261 raft_consensus.cc:1275] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 12:10:38.474843 14261 pending_rounds.cc:85] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec: Aborting all ops after (but not including) 5
I20260709 12:10:38.475082 14261 pending_rounds.cc:107] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 12:10:38.475329 14261 raft_consensus.cc:2889] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:38.403332 16831 leader_election.cc:290] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:38.477020 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:38.404369 16812 raft_consensus.cc:2804] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:38.478111 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:38.404572 14907 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f"
dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
mode: GRACEFUL
new_leader_uuid: "17aab1bbf5014936aa18cc21818b26ec"
 from {username='slave'} at 127.0.0.1:38628
I20260709 12:10:38.485193 14184 raft_consensus.cc:3060] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:38.485939 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:38.486742 14912 raft_consensus.cc:2468] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 4.
I20260709 12:10:38.442525 16456 leader_election.cc:290] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:38.475282 14190 raft_consensus.cc:2468] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 7.
I20260709 12:10:38.490377 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:38.475983 16114 raft_consensus.cc:3060] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:10:38.497802 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:38.476382 16768 raft_consensus.cc:2804] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:38.400982 16776 raft_consensus.cc:515] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:38.478839 16738 raft_consensus.cc:493] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:38.508985 14190 raft_consensus.cc:2468] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 6.
I20260709 12:10:38.509212 14229 leader_election.cc:304] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:10:38.491158 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:38.512662 16661 leader_election.cc:290] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:38.517069 14184 raft_consensus.cc:2468] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 4.
I20260709 12:10:38.520021 16831 raft_consensus.cc:2804] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:38.520581 16831 raft_consensus.cc:493] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:38.520946 16831 raft_consensus.cc:3060] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:38.481786 16625 consensus_queue.cc:1059] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 12:10:38.509783 16812 raft_consensus.cc:697] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 7 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:10:38.534142 14188 pending_rounds.cc:85] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf: Aborting all ops after (but not including) 1
I20260709 12:10:38.534945 14188 pending_rounds.cc:107] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf: Aborting uncommitted NO_OP operation due to leader change: 5.2
I20260709 12:10:38.535269 14188 raft_consensus.cc:2889] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:10:38.543625 16863 log.cc:927] Time spent T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.455s	user 0.004s	sys 0.000s
I20260709 12:10:38.512605 16768 raft_consensus.cc:697] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 3 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:10:38.546478 16813 raft_consensus.cc:493] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:38.547087 16813 raft_consensus.cc:515] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:38.547158 16768 consensus_queue.cc:237] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:38.576333 14335 raft_consensus.cc:1240] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:38.554231 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:38.529404 16738 raft_consensus.cc:515] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:38.580240 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:38.592026 16874 consensus_queue.cc:1059] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:38.593164 16874 raft_consensus.cc:3055] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:38.593497 16874 raft_consensus.cc:740] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:10:38.594350 16874 consensus_queue.cc:260] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:38.595633 16874 raft_consensus.cc:3060] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:38.567091 16544 leader_election.cc:290] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 6 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:10:38.604866 16815 consensus_meta.cc:287] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.513s	user 0.007s	sys 0.004s
I20260709 12:10:38.610078 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:38.611266 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:38.611752 14335 raft_consensus.cc:1240] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 3. Current term is 4. Ops: []
W20260709 12:10:38.609171 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 111648us
I20260709 12:10:38.613013 14876 leader_election.cc:304] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:38.554117 16501 raft_consensus.cc:515] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:38.618103 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:38.605456 16815 raft_consensus.cc:515] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:38.618908 14184 raft_consensus.cc:2468] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 4.
I20260709 12:10:38.622665 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:38.624986 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:38.617274 16790 raft_consensus.cc:2804] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:38.631960 16790 raft_consensus.cc:493] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:38.632400 16790 raft_consensus.cc:3060] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:38.636027 16501 leader_election.cc:290] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 6 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:38.636194 16815 leader_election.cc:290] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 6 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:10:38.637602 14256 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41764 (request call id 2156) took 2556 ms (client timeout 2669 ms). Trace:
W20260709 12:10:38.638121 14256 rpcz_store.cc:269] 0709 12:10:36.081045 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:36.102348 (+ 21303us) service_pool.cc:224] Handling call
0709 12:10:38.637269 (+2534921us) spinlock_profiling.cc:243] Waited 1.47 s on lock 0x7b540007b054. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:10:38.637417 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3372414336}
I20260709 12:10:38.640834 16738 leader_election.cc:290] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:38.612659 16812 consensus_queue.cc:237] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:38.642042 16813 leader_election.cc:290] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:38.642764 16790 raft_consensus.cc:515] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:38.643353 16164 leader_election.cc:290] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:38.668812 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:38.669538 14189 raft_consensus.cc:3060] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:38.670089 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:38.671718 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:38.672474 14186 raft_consensus.cc:2468] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 4.
W20260709 12:10:38.692214 14155 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:38.696548 14189 raft_consensus.cc:2468] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 5.
I20260709 12:10:38.689426 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:38.699653 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:38.702178 14190 raft_consensus.cc:2468] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 4.
I20260709 12:10:38.700259 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:38.700687 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:38.701327 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:38.701512 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
W20260709 12:10:38.730240 14155 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:38.881098 14261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41764 (request call id 2189) took 1126 ms. Trace:
I20260709 12:10:38.904467 14184 raft_consensus.cc:3060] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:38.703204 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:38.897255 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:38.892707 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:38.901062 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:38.904719 14261 rpcz_store.cc:276] 0709 12:10:37.754627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:38.479582 (+724955us) service_pool.cc:224] Handling call
0709 12:10:38.479870 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:38.611603 (+131733us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:38.611629 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:38.611674 (+    45us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:38.611709 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:38.880828 (+269119us) spinlock_profiling.cc:243] Waited 131 ms on lock 0x7b5400031e54. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:10:38.880873 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:38.881011 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":301777792}
I20260709 12:10:38.905555 14189 raft_consensus.cc:3060] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:38.820255 14256 raft_consensus.cc:1275] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:10:38.750461 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
W20260709 12:10:38.911803 14302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:38.907155 14182 raft_consensus.cc:2468] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 4.
I20260709 12:10:38.906225 14155 leader_election.cc:304] T f4739bc22bfe44fcba807da02d9351b6 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:38.918951 14155 leader_election.cc:304] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:38.919018 14189 raft_consensus.cc:2468] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 7.
I20260709 12:10:38.920706 14230 leader_election.cc:304] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:38.921819 14876 leader_election.cc:304] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:38.923936 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:38.926936 14261 raft_consensus.cc:1240] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 3. Current term is 4. Ops: []
W20260709 12:10:38.884280 16875 log.cc:927] Time spent T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.487s	user 0.000s	sys 0.001s
I20260709 12:10:38.736692 16815 raft_consensus.cc:493] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:38.934588 16815 raft_consensus.cc:515] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:38.859694 16813 raft_consensus.cc:493] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:38.893959 16638 leader_election.cc:290] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:38.742969 16652 leader_election.cc:290] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:38.911742 16765 raft_consensus.cc:493] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:38.908483 16785 raft_consensus.cc:493] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:38.946123 14189 raft_consensus.cc:1240] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 12:10:38.952576 14184 raft_consensus.cc:2468] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 10.
I20260709 12:10:38.922180 16790 leader_election.cc:290] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 7 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:38.926123 16501 raft_consensus.cc:2749] T f4739bc22bfe44fcba807da02d9351b6 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:38.928829 16708 raft_consensus.cc:2749] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:38.929214 16763 raft_consensus.cc:2804] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:38.955687 16813 raft_consensus.cc:515] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:38.961830 16501 raft_consensus.cc:2749] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:10:38.969280 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 50424.8us
W20260709 12:10:38.970234 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 120913us
I20260709 12:10:38.767262 16831 raft_consensus.cc:515] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:38.972390 14304 leader_election.cc:304] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:38.764870 16853 raft_consensus.cc:515] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } }
I20260709 12:10:38.971325 14155 leader_election.cc:400] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 4 election: Vote denied by peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957) with higher term. Message: Invalid argument: T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 4. Current term is 5.
I20260709 12:10:38.972731 14189 raft_consensus.cc:1240] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 9. Current term is 10. Ops: []
I20260709 12:10:38.980952 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:38.982106 14189 raft_consensus.cc:2368] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for earlier term 6. Current term is 7.
I20260709 12:10:38.984457 14189 raft_consensus.cc:1240] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 5. Current term is 6. Ops: [3.3-5.4]
I20260709 12:10:38.979626 14155 leader_election.cc:304] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:38.988104 14155 leader_election.cc:400] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 2 election: Vote denied by peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957) with higher term. Message: Invalid argument: T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 2. Current term is 3.
I20260709 12:10:38.956189 16860 consensus_queue.cc:1048] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 12:10:38.988109 16501 raft_consensus.cc:2749] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:10:38.997943 14189 raft_consensus.cc:1240] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 12:10:38.974032 16763 raft_consensus.cc:697] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 7 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:10:38.960157 16765 raft_consensus.cc:515] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:10:39.005077 14260 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41768 (request call id 1440) took 1618 ms (client timeout 1631 ms). Trace:
I20260709 12:10:39.001871 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:39.008483 14184 raft_consensus.cc:2393] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 3: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:10:38.965076 16785 raft_consensus.cc:515] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:39.005652 14263 raft_consensus.cc:1240] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 6. Current term is 7. Ops: []
W20260709 12:10:39.007459 14260 rpcz_store.cc:269] 0709 12:10:37.386375 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:37.386589 (+   214us) service_pool.cc:224] Handling call
0709 12:10:39.004852 (+1618263us) spinlock_profiling.cc:243] Waited 362 ms on lock 0x7b5400210a54. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:10:39.005005 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":831893248}
I20260709 12:10:38.996146 16114 raft_consensus.cc:2749] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957) with higher term. Message: Invalid argument: T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db for earlier term 7. Current term is 8.
I20260709 12:10:39.004451 16813 leader_election.cc:290] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:39.020769 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:39.005589 16831 leader_election.cc:290] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:39.004240 14907 raft_consensus.cc:606] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [term 2 LEADER]: Received request to transfer leadership to TS 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:10:39.020016 16624 raft_consensus.cc:3055] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:39.006116 16501 consensus_queue.cc:1059] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.017s
I20260709 12:10:39.030591 16624 raft_consensus.cc:740] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
W20260709 12:10:39.030893 16894 log.cc:927] Time spent T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:10:39.015072 16815 leader_election.cc:290] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:39.031762 16624 consensus_queue.cc:260] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:10:39.036566 16891 log.cc:927] Time spent T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:10:39.037174 16624 raft_consensus.cc:3060] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:39.036690 16898 raft_consensus.cc:493] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:39.039599 14189 raft_consensus.cc:1275] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:10:39.038551 16898 raft_consensus.cc:515] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:39.040597 12986 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:10:39.044318 14260 raft_consensus.cc:1275] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:10:39.048074 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:39.049660 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:39.050560 14184 raft_consensus.cc:3060] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:39.054545 12986 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:10:39.055681 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:39.057072 14186 raft_consensus.cc:1240] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:39.057433 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:39.058106 14189 raft_consensus.cc:3060] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Advancing to term 7
W20260709 12:10:39.059895 14333 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55492 (request call id 362) took 1342 ms (client timeout 1571 ms). Trace:
W20260709 12:10:39.060359 14333 rpcz_store.cc:269] 0709 12:10:37.716987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:37.717140 (+   153us) service_pool.cc:224] Handling call
0709 12:10:39.059690 (+1342550us) spinlock_profiling.cc:243] Waited 47.5 ms on lock 0x7b540023b754. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:10:39.059822 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":109162368}
W20260709 12:10:39.064122 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 74013.8us
I20260709 12:10:39.065155 14155 leader_election.cc:400] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 6 pre-election: Vote denied by peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957) with higher term. Message: Invalid argument: T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 6. Current term is 7.
I20260709 12:10:39.065542 14155 leader_election.cc:403] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:39.078758 14189 raft_consensus.cc:2468] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 7.
I20260709 12:10:39.078876 14155 leader_election.cc:304] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:39.042119 16898 leader_election.cc:290] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:39.052748 16815 raft_consensus.cc:3055] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:39.087967 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:39.095149 14877 leader_election.cc:304] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:39.104770 14335 raft_consensus.cc:1240] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:39.108750 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:39.061609 16808 consensus_queue.cc:1048] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 12:10:39.125793 16886 raft_consensus.cc:2804] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:39.130085 14184 raft_consensus.cc:2468] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 5.
I20260709 12:10:39.094573 16815 raft_consensus.cc:740] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:10:39.102743 16898 raft_consensus.cc:2749] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957) with higher term. Message: Invalid argument: T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 6. Current term is 7.
I20260709 12:10:39.197220 14907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:39.190052 14905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53194 (request call id 703) took 1111 ms. Trace:
I20260709 12:10:39.079844 16763 consensus_queue.cc:237] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:39.144239 16886 raft_consensus.cc:493] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:39.198875 14905 rpcz_store.cc:276] 0709 12:10:38.072264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:38.072918 (+   654us) service_pool.cc:224] Handling call
0709 12:10:39.144413 (+1071495us) spinlock_profiling.cc:243] Waited 203 ms on lock 0x7b5c004afd8c. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f212aaa5161 00007f212ac46a79 00007f212c100545 00007f212c115105 00007f212c1150b3 00007f212c0ff93b 00007f212c0ff3d2 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c
0709 12:10:39.183600 (+ 39187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":466839296}
W20260709 12:10:39.252553 14230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:39.261983 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 165669us
I20260709 12:10:39.263162 14155 leader_election.cc:304] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
W20260709 12:10:39.265868 16881 log.cc:927] Time spent T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 12:10:39.205849 16901 raft_consensus.cc:2749] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:39.230876 16886 raft_consensus.cc:3060] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:39.266234 16892 log.cc:927] Time spent T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.259s	user 0.001s	sys 0.001s
I20260709 12:10:39.230151 16853 leader_election.cc:290] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:39.289932 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:39.294358 16501 raft_consensus.cc:2749] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:39.307140 14264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41764 (request call id 2177) took 1614 ms. Trace:
I20260709 12:10:39.282820 16785 leader_election.cc:290] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:39.307677 14264 rpcz_store.cc:276] 0709 12:10:37.692236 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:38.389988 (+697752us) service_pool.cc:224] Handling call
0709 12:10:38.390341 (+   353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:38.390611 (+   270us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:10:38.391561 (+   950us) log.cc:844] Serialized 14 byte log entry
0709 12:10:39.265233 (+873672us) spinlock_profiling.cc:243] Waited 3.96 ms on lock 0x7b180028a680. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f212cf16ab1 00007f212cf23281 00007f2124030e07 00007f212ce8b9a9 00007f212404d69b 00007f212404b93f 00007f212404dc02 00007f2126cd520b 00007f2126cdad23 00007f2126cdb23a 00007f2127145a2a
0709 12:10:39.306760 (+ 41527us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:39.306816 (+    56us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:39.306870 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:39.306944 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:39.307074 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":532,"prepare.queue_time_us":127,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":1639,"raft.queue_time_us":647,"spinlock_wait_cycles":9107712,"thread_start_us":39964,"threads_started":1}
I20260709 12:10:39.312605 14265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41768 (request call id 1451) took 1370 ms. Trace:
I20260709 12:10:39.331394 14265 rpcz_store.cc:276] 0709 12:10:37.942677 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:38.626243 (+683566us) service_pool.cc:224] Handling call
0709 12:10:38.626703 (+   460us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:38.627458 (+   755us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:38.627496 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:38.628191 (+   695us) log.cc:844] Serialized 26 byte log entry
0709 12:10:38.698995 (+ 70804us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:38.699035 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:38.699107 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:39.312272 (+613165us) raft_consensus.cc:1685] finished
0709 12:10:39.312294 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:39.312536 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":116,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":113,"thread_start_us":70352,"threads_started":1,"wal-append.queue_time_us":343504}
W20260709 12:10:39.315953 16899 log.cc:927] Time spent T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.185s	user 0.000s	sys 0.001s
I20260709 12:10:39.288475 16765 leader_election.cc:290] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:39.300663 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:10:39.270418 16815 consensus_queue.cc:260] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:39.326674 16785 raft_consensus.cc:493] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:39.308849 14907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:10:39.347976 14906 raft_consensus.cc:3060] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:39.351892 16785 raft_consensus.cc:515] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:39.376130 16776 leader_election.cc:290] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:39.377686 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:39.379215 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
W20260709 12:10:39.387882 14302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:39.391471 16886 raft_consensus.cc:515] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:39.363238 16815 raft_consensus.cc:3060] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:39.404809 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:39.405685 14186 raft_consensus.cc:2393] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db in current term 7: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:10:39.407946 14257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41764 (request call id 2167) took 1791 ms. Trace:
I20260709 12:10:39.408380 14257 rpcz_store.cc:276] 0709 12:10:37.616526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:37.617569 (+  1043us) service_pool.cc:224] Handling call
0709 12:10:39.407745 (+1790176us) spinlock_profiling.cc:243] Waited 1.37 s on lock 0x7b54002229d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:10:39.407878 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3153464192}
I20260709 12:10:39.403358 14263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41764 (request call id 2173) took 1761 ms. Trace:
W20260709 12:10:39.385382 14085 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44116 (request call id 156) took 14272 ms (client timeout 15000 ms). Trace:
I20260709 12:10:39.422359 14263 rpcz_store.cc:276] 0709 12:10:37.641822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:37.900090 (+258268us) service_pool.cc:224] Handling call
0709 12:10:39.005428 (+1105338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:39.009719 (+  4291us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:39.403145 (+393426us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b5400210a50. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713a8ad 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:10:39.403287 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2513657600}
I20260709 12:10:39.445901 16886 leader_election.cc:290] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 7 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:10:39.426715 14085 rpcz_store.cc:269] 0709 12:10:25.113293 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:25.152156 (+ 38863us) service_pool.cc:224] Handling call
0709 12:10:39.385299 (+14233143us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:38.285224 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:38.344117 (+ 58893us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:38.344154 (+    37us) write_op.cc:435] Acquired schema lock
0709 12:10:38.344172 (+    18us) tablet.cc:662] Decoding operations
0709 12:10:38.384714 (+ 40542us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:38.384791 (+    77us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:38.384823 (+    32us) tablet.cc:685] Acquiring locks for 5 operations
0709 12:10:38.385417 (+   594us) tablet.cc:701] Row locks acquired
0709 12:10:38.385438 (+    21us) write_op.cc:260] PREPARE: finished
0709 12:10:38.385645 (+   207us) write_op.cc:270] Start()
0709 12:10:38.385806 (+   161us) write_op.cc:276] Timestamp: P: 1783599038385581 usec, L: 0
0709 12:10:38.385829 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 12:10:38.406239 (+ 20410us) log.cc:844] Serialized 2148 byte log entry
0709 12:10:38.979282 (+573043us) op_driver.cc:464] REPLICATION: finished
0709 12:10:39.096814 (+117532us) write_op.cc:301] APPLY: starting
0709 12:10:39.126221 (+ 29407us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:39.185016 (+ 58795us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:39.244662 (+ 59646us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:39.245464 (+   802us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:39.245722 (+   258us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 12:10:39.245796 (+    74us) write_op.cc:312] APPLY: finished
0709 12:10:39.246094 (+   298us) log.cc:844] Serialized 47 byte log entry
0709 12:10:39.246326 (+   232us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:39.246463 (+   137us) write_op.cc:454] Released schema lock
0709 12:10:39.246517 (+    54us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:39.246993 (+   476us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:39.247020 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3683720,"reported_tablets":12,"child_traces":[["op",{"apply.queue_time_us":98735,"apply.run_cpu_time_us":3275,"apply.run_wall_time_us":162353,"num_ops":5,"prepare.queue_time_us":164274,"prepare.run_cpu_time_us":26429,"prepare.run_wall_time_us":273658,"raft.queue_time_us":330052,"raft.run_cpu_time_us":17027,"raft.run_wall_time_us":43765,"replication_time_us":593187,"thread_start_us":401789,"threads_started":4,"wal-append.queue_time_us":156554}]]}
I20260709 12:10:39.431484 16776 raft_consensus.cc:493] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:39.376149 16785 leader_election.cc:290] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:39.453500 14907 raft_consensus.cc:2468] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 5.
I20260709 12:10:39.454978 16907 raft_consensus.cc:493] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:39.466636 14155 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:39.457087 16776 raft_consensus.cc:515] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:39.481940 16776 leader_election.cc:290] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:39.466027 16907 raft_consensus.cc:515] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:39.479285 14155 leader_election.cc:304] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:39.484133 16907 leader_election.cc:290] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:39.484742 16907 raft_consensus.cc:2749] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:10:39.487133 16871 log.cc:927] Time spent T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 1.181s	user 0.010s	sys 0.012s
I20260709 12:10:39.488246 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:39.488979 14186 raft_consensus.cc:3060] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:39.495468 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:39.495695 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:39.496229 14182 raft_consensus.cc:3060] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:39.498526 14187 raft_consensus.cc:1275] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:10:39.500159 14190 raft_consensus.cc:1275] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:39.497387 14906 raft_consensus.cc:2468] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 7.
I20260709 12:10:39.501359 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:39.496389 14263 raft_consensus.cc:2468] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 6.
I20260709 12:10:39.506840 14186 raft_consensus.cc:2468] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 5.
I20260709 12:10:39.513667 14182 raft_consensus.cc:2468] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 5.
I20260709 12:10:39.510447 16768 raft_consensus.cc:493] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
W20260709 12:10:39.526100 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 1.0687e+06us
I20260709 12:10:39.525864 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:39.526554 16768 raft_consensus.cc:515] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:39.527042 14903 raft_consensus.cc:2468] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 7.
I20260709 12:10:39.527585 14303 leader_election.cc:304] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:39.519861 14330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50856 (request call id 1757) took 1501 ms. Trace:
I20260709 12:10:39.530699 14330 rpcz_store.cc:276] 0709 12:10:38.018447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:38.102510 (+ 84063us) service_pool.cc:224] Handling call
0709 12:10:38.103036 (+   526us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:38.115596 (+ 12560us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:38.115632 (+    36us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:38.116269 (+   637us) log.cc:844] Serialized 52 byte log entry
0709 12:10:38.285392 (+169123us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:38.404006 (+118614us) log.cc:844] Serialized 14 byte log entry
0709 12:10:38.404656 (+   650us) log.cc:844] Serialized 14 byte log entry
0709 12:10:39.509221 (+1104565us) spinlock_profiling.cc:243] Waited 11.9 ms on lock 0x7b18002f7ca0. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f212cf16ab1 00007f212cf23281 00007f2123fc8c0a 00007f212d708219 00007f2124050a40 00007f212404b4e4 00007f212404b455 00007f2127133060 00007f2127145716 00007f2127156287 00007f2127156208
0709 12:10:39.509446 (+   225us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:39.509530 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:39.519556 (+ 10026us) raft_consensus.cc:1685] finished
0709 12:10:39.519585 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:39.519788 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1114905,"prepare.queue_time_us":38937,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":71,"raft.queue_time_us":1119393,"raft.run_cpu_time_us":398,"raft.run_wall_time_us":30002,"spinlock_wait_cycles":27436416,"thread_start_us":268522,"threads_started":2,"wal-append.queue_time_us":193182}
I20260709 12:10:39.605821 16731 raft_consensus.cc:2749] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:39.609376 16394 raft_consensus.cc:2749] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:39.609841 14154 leader_election.cc:304] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
W20260709 12:10:39.612109 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 639783us
I20260709 12:10:39.510797 16853 raft_consensus.cc:493] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:39.612938 14304 leader_election.cc:304] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
W20260709 12:10:39.612443 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 103948us
I20260709 12:10:39.613440 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:39.613699 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:39.621404 14334 raft_consensus.cc:2410] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for term 7 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 2.
I20260709 12:10:39.614063 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:39.622712 14155 leader_election.cc:304] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:39.614270 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:39.624082 14339 raft_consensus.cc:2468] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 7.
W20260709 12:10:39.616976 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 108851us
I20260709 12:10:39.626073 14155 leader_election.cc:304] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:39.626214 14229 leader_election.cc:304] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:39.617057 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:39.632488 14229 leader_election.cc:304] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:39.627336 14907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
W20260709 12:10:39.633591 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 56229.7us
I20260709 12:10:39.637331 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:39.638123 14303 leader_election.cc:400] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 6 election: Vote denied by peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187) with higher term. Message: Invalid argument: T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for earlier term 6. Current term is 7.
I20260709 12:10:39.638507 14303 leader_election.cc:403] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 12:10:39.635702 14877 leader_election.cc:304] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:10:39.640084 14332 raft_consensus.cc:1275] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 12:10:39.620347 16813 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.009s	sys 0.018s
I20260709 12:10:39.642561 14304 leader_election.cc:304] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:39.629002 16776 raft_consensus.cc:2804] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:39.625162 16815 raft_consensus.cc:493] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:39.633337 16911 raft_consensus.cc:493] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:39.614732 16685 consensus_queue.cc:1059] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 12:10:39.631367 16785 raft_consensus.cc:2749] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:39.661955 14304 leader_election.cc:304] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:39.638335 16831 raft_consensus.cc:2804] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:10:39.648970 16813 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.570s	user 0.009s	sys 0.018s
I20260709 12:10:39.640369 16902 raft_consensus.cc:2749] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:39.670312 16674 raft_consensus.cc:493] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:39.670708 16795 raft_consensus.cc:993] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db: : Instructing follower 17aab1bbf5014936aa18cc21818b26ec to start an election
I20260709 12:10:39.640753 16768 leader_election.cc:290] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:39.647997 16544 consensus_queue.cc:1059] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 5.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.036s
I20260709 12:10:39.670979 16685 raft_consensus.cc:2749] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187) with higher term. Message: Invalid argument: T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for earlier term 6. Current term is 7.
I20260709 12:10:39.692485 16685 consensus_queue.cc:1059] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:39.693231 14339 raft_consensus.cc:1275] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:10:39.674090 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:39.653996 14907 raft_consensus.cc:3060] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:39.655437 16812 raft_consensus.cc:2804] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:39.654556 16737 raft_consensus.cc:2804] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:39.654379 16832 raft_consensus.cc:2749] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:10:39.693240 16685 consensus_queue.cc:1243] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer 885067a0d31741bfb5c9935788e315bf log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:10:39.705054 16902 raft_consensus.cc:493] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:39.705682 16902 raft_consensus.cc:515] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:39.706751 16795 raft_consensus.cc:1081] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [term 2 LEADER]: Signalling peer 17aab1bbf5014936aa18cc21818b26ec to start an election
I20260709 12:10:39.707994 16902 leader_election.cc:290] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:39.712827 14905 raft_consensus.cc:2468] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 8.
I20260709 12:10:39.681663 16679 raft_consensus.cc:2749] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:39.713836 16627 consensus_queue.cc:1048] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:39.699318 16812 raft_consensus.cc:493] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:39.724367 16812 raft_consensus.cc:3060] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:39.669086 16911 raft_consensus.cc:515] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:39.679010 14188 raft_consensus.cc:1275] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:10:39.735998 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:39.655051 16776 raft_consensus.cc:493] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:39.737579 16776 raft_consensus.cc:3060] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:39.681692 16821 raft_consensus.cc:3055] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:39.664861 16815 raft_consensus.cc:515] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:39.646108 16731 consensus_queue.cc:1059] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 12:10:39.660362 16696 raft_consensus.cc:493] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:10:39.682407 16831 raft_consensus.cc:697] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 8 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:10:39.694538 14330 raft_consensus.cc:2468] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 6.
I20260709 12:10:39.671368 16602 raft_consensus.cc:2749] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:10:39.741387 16915 log.cc:927] Time spent T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.220s	user 0.000s	sys 0.001s
I20260709 12:10:39.631155 16853 raft_consensus.cc:515] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:39.741248 16874 consensus_queue.cc:1048] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
W20260709 12:10:39.744987 16918 log.cc:927] Time spent T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
I20260709 12:10:39.687759 16674 raft_consensus.cc:515] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:39.741909 16821 raft_consensus.cc:740] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
W20260709 12:10:39.783540 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 151156us
I20260709 12:10:39.783890 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:39.782642 16674 leader_election.cc:290] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:10:39.834300 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 164699us
W20260709 12:10:39.866351 14230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:39.892215 14303 leader_election.cc:304] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:39.875459 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:39.878245 14190 raft_consensus.cc:1275] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:10:39.776470 16739 raft_consensus.cc:3055] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:39.782903 16902 consensus_queue.cc:1048] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 12:10:39.765334 16696 raft_consensus.cc:515] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:10:39.880147 14154 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 94729.2us
W20260709 12:10:39.875550 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 90861.2us
I20260709 12:10:39.902632 14229 leader_election.cc:304] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:39.897787 14303 leader_election.cc:304] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:39.868341 16114 raft_consensus.cc:493] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:39.911634 14229 leader_election.cc:304] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:39.910097 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:10:39.881626 16731 raft_consensus.cc:3055] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:10:39.915315 16815 leader_election.cc:290] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:39.919476 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:39.922465 16853 leader_election.cc:290] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:39.923139 16911 leader_election.cc:290] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:10:39.927824 14303 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:39.928929 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:39.933140 14338 raft_consensus.cc:2468] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 7.
I20260709 12:10:39.899894 16768 raft_consensus.cc:493] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:39.942116 14332 raft_consensus.cc:2468] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 4.
I20260709 12:10:39.884702 16832 consensus_queue.cc:1048] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.052s
I20260709 12:10:39.899071 16739 raft_consensus.cc:740] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:39.909649 16795 consensus_queue.cc:1048] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 12:10:39.937214 16928 raft_consensus.cc:2804] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:39.962702 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:39.973253 14184 raft_consensus.cc:2393] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 5: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:10:39.908515 16907 raft_consensus.cc:493] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:39.905911 16674 consensus_queue.cc:1048] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.053s
I20260709 12:10:39.937933 16922 raft_consensus.cc:2749] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:39.932781 16731 raft_consensus.cc:740] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:39.938372 16924 raft_consensus.cc:2804] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:39.926820 16679 consensus_queue.cc:1059] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
W20260709 12:10:39.985528 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 323638us
I20260709 12:10:39.957199 16853 raft_consensus.cc:493] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:39.994369 14304 leader_election.cc:304] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:39.935945 16114 raft_consensus.cc:515] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:39.904734 16831 consensus_queue.cc:237] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:39.985411 16737 raft_consensus.cc:697] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 4 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:39.987159 16928 raft_consensus.cc:697] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 5 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:39.963562 16768 raft_consensus.cc:515] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:40.034304 16928 consensus_queue.cc:237] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:40.035538 16768 leader_election.cc:290] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:40.026729 16731 consensus_queue.cc:260] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:40.003059 16853 raft_consensus.cc:515] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:40.039023 16853 leader_election.cc:290] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:40.012653 16674 raft_consensus.cc:493] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:10:40.039825 16674 raft_consensus.cc:515] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:39.940420 16821 consensus_queue.cc:260] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:40.031205 16658 tablet_bootstrap.cc:492] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:10:40.042079 16674 leader_election.cc:290] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:40.042800 16658 tablet_bootstrap.cc:492] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db: Bootstrap complete.
I20260709 12:10:40.043704 16658 ts_tablet_manager.cc:1403] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db: Time spent bootstrapping tablet: real 1.725s	user 0.055s	sys 0.057s
I20260709 12:10:40.012136 16737 consensus_queue.cc:237] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:40.025151 14907 raft_consensus.cc:2468] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 5.
I20260709 12:10:40.026082 16832 raft_consensus.cc:493] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:40.029624 16394 raft_consensus.cc:3055] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:40.002312 16924 raft_consensus.cc:697] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 7 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:39.983489 16907 raft_consensus.cc:515] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:39.998651 16739 consensus_queue.cc:260] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:39.999671 16922 raft_consensus.cc:2749] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:40.030100 16733 raft_consensus.cc:2749] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:40.020430 16114 leader_election.cc:290] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:40.055325 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:40.059365 14263 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f"
dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
 from {username='slave'} at 127.0.0.1:53050
I20260709 12:10:40.074188 14263 raft_consensus.cc:493] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:40.074640 14263 raft_consensus.cc:3060] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:40.060164 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:40.076318 14189 raft_consensus.cc:2468] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 6.
I20260709 12:10:40.034934 16696 leader_election.cc:290] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:40.073868 14261 raft_consensus.cc:2468] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 7.
I20260709 12:10:40.077490 14876 leader_election.cc:304] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:40.051131 16926 raft_consensus.cc:493] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:40.059514 16394 raft_consensus.cc:740] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:40.094511 16910 raft_consensus.cc:2804] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:40.095165 16910 raft_consensus.cc:493] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:40.095551 16910 raft_consensus.cc:3060] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:40.080125 16776 raft_consensus.cc:515] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:40.099821 16602 raft_consensus.cc:3055] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:40.100288 16602 raft_consensus.cc:740] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:40.067725 16815 raft_consensus.cc:493] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
W20260709 12:10:40.102742 14303 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:40.067876 16853 raft_consensus.cc:493] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:40.073717 16821 raft_consensus.cc:3060] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:40.104409 14303 leader_election.cc:400] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 6 election: Vote denied by peer 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341) with higher term. Message: Invalid argument: T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for earlier term 6. Current term is 7.
I20260709 12:10:40.108050 14263 raft_consensus.cc:515] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:40.071161 16768 raft_consensus.cc:493] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
W20260709 12:10:40.113890 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 202342us
I20260709 12:10:40.116511 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:40.117101 14229 leader_election.cc:304] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:40.117268 14336 raft_consensus.cc:3060] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:10:40.118532 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 124252us
I20260709 12:10:40.112602 14303 leader_election.cc:304] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:40.119424 14304 leader_election.cc:304] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:40.120532 14303 leader_election.cc:304] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:10:40.123505 14303 leader_election.cc:304] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:10:40.128742 14263 leader_election.cc:290] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:40.101313 16776 leader_election.cc:290] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 8 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:40.114168 16922 raft_consensus.cc:493] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:40.071558 16832 raft_consensus.cc:515] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:40.157866 14304 leader_election.cc:304] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:40.124337 16733 raft_consensus.cc:2749] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:40.112766 16658 raft_consensus.cc:359] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 5 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } }
I20260709 12:10:40.101691 16815 raft_consensus.cc:515] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:40.179360 16934 raft_consensus.cc:493] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:40.180024 16934 raft_consensus.cc:515] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } }
I20260709 12:10:40.180748 16815 leader_election.cc:290] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:40.180913 16930 raft_consensus.cc:2749] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:40.181689 16930 raft_consensus.cc:993] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c: : Instructing follower 885067a0d31741bfb5c9935788e315bf to start an election
I20260709 12:10:40.182143 16930 raft_consensus.cc:1081] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 5 LEADER]: Signalling peer 885067a0d31741bfb5c9935788e315bf to start an election
I20260709 12:10:40.173689 16394 consensus_queue.cc:260] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:40.184604 16394 raft_consensus.cc:3060] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:40.101130 16602 consensus_queue.cc:260] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:40.186507 16602 raft_consensus.cc:3060] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:40.187379 16936 consensus_queue.cc:1175] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "17aab1bbf5014936aa18cc21818b26ec" responder_term: 5 status { last_received { term: 5 index: 4 } last_committed_idx: 4 last_received_current_leader { term: 5 index: 4 } }
I20260709 12:10:40.150503 16923 raft_consensus.cc:2804] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:40.189594 16923 raft_consensus.cc:697] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 8 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:40.190297 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:40.191061 14330 raft_consensus.cc:2468] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 5.
I20260709 12:10:40.190663 16923 consensus_queue.cc:237] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:40.104656 16926 raft_consensus.cc:515] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:10:40.171404 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 54392.8us
I20260709 12:10:40.174314 14336 raft_consensus.cc:2468] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 8.
I20260709 12:10:40.170352 16785 raft_consensus.cc:493] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:10:40.107347 16812 raft_consensus.cc:515] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:40.156143 16924 consensus_queue.cc:237] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:40.203241 16812 leader_election.cc:290] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 7 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:40.205729 16939 raft_consensus.cc:2804] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:40.206384 16939 raft_consensus.cc:697] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 7 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:10:40.206554 16907 leader_election.cc:290] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:40.114607 16853 raft_consensus.cc:515] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:40.121660 16931 raft_consensus.cc:2749] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:40.128582 16696 raft_consensus.cc:2804] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:40.194774 14229 leader_election.cc:304] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:40.153204 16831 raft_consensus.cc:493] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:40.201225 16933 raft_consensus.cc:493] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:40.210844 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:40.197283 16815 raft_consensus.cc:493] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:40.213197 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:40.212519 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:40.213892 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:40.122611 16768 raft_consensus.cc:515] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:40.231680 14337 raft_consensus.cc:3060] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:40.174544 16813 raft_consensus.cc:493] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:10:40.174120 16658 raft_consensus.cc:740] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 5 LEARNER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Initialized, Role: LEARNER
I20260709 12:10:40.201310 16832 leader_election.cc:290] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:10:40.225385 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 67105.4us
I20260709 12:10:40.300828 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:40.228660 14330 raft_consensus.cc:1275] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:40.212487 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:40.228123 14229 leader_election.cc:304] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:40.226609 14332 raft_consensus.cc:1275] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:10:40.192507 14155 leader_election.cc:304] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:40.316385 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:40.313542 14331 raft_consensus.cc:1275] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:10:40.229043 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:40.318387 14332 raft_consensus.cc:2468] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 8.
I20260709 12:10:40.313539 14330 raft_consensus.cc:1275] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:40.318962 14336 raft_consensus.cc:3060] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:40.320248 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:40.321210 14332 raft_consensus.cc:2468] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 6.
I20260709 12:10:40.322397 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:40.229967 14333 raft_consensus.cc:1240] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 5. Current term is 6. Ops: []
W20260709 12:10:40.316561 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 88399.2us
I20260709 12:10:40.348296 14229 leader_election.cc:304] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:40.331442 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:40.240947 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:40.356156 14338 raft_consensus.cc:3060] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:40.359040 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:40.332751 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:40.331329 14263 raft_consensus.cc:1240] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:40.364138 14877 leader_election.cc:304] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:40.252460 16658 consensus_queue.cc:260] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } }
I20260709 12:10:40.222187 16679 consensus_queue.cc:1048] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 12:10:40.367159 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:40.266073 16731 raft_consensus.cc:3060] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:40.327250 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:40.343938 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:40.232829 16696 raft_consensus.cc:697] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 5 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:40.375887 16658 ts_tablet_manager.cc:1434] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db: Time spent starting tablet: real 0.332s	user 0.009s	sys 0.003s
I20260709 12:10:40.341089 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
W20260709 12:10:40.317150 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 124596us
I20260709 12:10:40.365139 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:40.377969 14257 raft_consensus.cc:3060] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:40.377552 16696 consensus_queue.cc:237] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:40.380916 14155 leader_election.cc:304] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:40.350931 14907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:10:40.382441 14907 raft_consensus.cc:3060] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:40.385857 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:40.386454 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:40.387670 14189 raft_consensus.cc:2468] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 5.
I20260709 12:10:40.214329 16785 raft_consensus.cc:515] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:40.390276 14182 raft_consensus.cc:2468] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 5.
I20260709 12:10:40.392046 16785 leader_election.cc:290] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:40.253274 16768 leader_election.cc:290] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:40.388963 14912 raft_consensus.cc:2468] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 6.
I20260709 12:10:40.239686 16813 raft_consensus.cc:515] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:40.440382 14186 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8"
dest_uuid: "885067a0d31741bfb5c9935788e315bf"
 from {username='slave'} at 127.0.0.1:56044
I20260709 12:10:40.443015 14186 raft_consensus.cc:493] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:40.443531 14186 raft_consensus.cc:3060] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:40.235536 16815 raft_consensus.cc:515] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } }
I20260709 12:10:40.229297 16831 raft_consensus.cc:515] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:40.256691 16853 leader_election.cc:290] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:40.268177 16910 raft_consensus.cc:515] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:40.171077 16922 raft_consensus.cc:515] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:40.244413 16926 leader_election.cc:290] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:40.232877 16933 raft_consensus.cc:515] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:40.247398 16934 leader_election.cc:290] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187)
W20260709 12:10:40.219054 16938 log.cc:927] Time spent T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 12:10:40.207338 16939 consensus_queue.cc:237] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.2, Last appended by leader: 2, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:40.226804 16943 raft_consensus.cc:2749] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:40.418154 16911 raft_consensus.cc:493] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:40.420173 14155 leader_election.cc:304] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:40.421273 16785 raft_consensus.cc:2804] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:40.426419 16832 raft_consensus.cc:2749] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:40.467577 16768 raft_consensus.cc:2749] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:40.486622 14336 raft_consensus.cc:2468] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 5.
W20260709 12:10:40.819052 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 471036us
I20260709 12:10:40.498327 14331 raft_consensus.cc:3060] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:10:40.821352 14229 leader_election.cc:304] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:40.822592 14229 leader_election.cc:304] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:40.498596 16831 leader_election.cc:290] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:10:40.828336 14304 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:40.445480 16907 raft_consensus.cc:2804] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:40.501754 14188 raft_consensus.cc:1275] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:40.828898 16831 raft_consensus.cc:2804] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:40.837114 16965 raft_consensus.cc:2804] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:40.837258 16831 raft_consensus.cc:493] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:40.838131 16831 raft_consensus.cc:3060] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:40.835307 14331 raft_consensus.cc:1275] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:10:40.839103 14229 leader_election.cc:304] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:40.840198 14229 leader_election.cc:304] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
W20260709 12:10:40.500788 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 71356.9us
I20260709 12:10:40.838083 16965 raft_consensus.cc:697] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 5 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:10:40.836110 16907 raft_consensus.cc:493] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:10:40.708820 14257 raft_consensus.cc:2468] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 7.
I20260709 12:10:40.606842 14337 raft_consensus.cc:2410] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:10:40.604462 14338 raft_consensus.cc:2468] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 5.
I20260709 12:10:40.848682 14186 raft_consensus.cc:515] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:10:40.516029 16912 log.cc:927] Time spent T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
W20260709 12:10:40.862063 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 442163us
I20260709 12:10:40.863847 16776 raft_consensus.cc:2804] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:40.864303 16776 raft_consensus.cc:493] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:40.857980 14229 leader_election.cc:304] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:40.852497 16907 raft_consensus.cc:3060] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:40.865532 16965 consensus_queue.cc:237] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:40.866598 16733 raft_consensus.cc:493] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:40.867141 16733 raft_consensus.cc:515] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:40.868129 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:40.869903 14260 raft_consensus.cc:1275] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:40.871856 16922 leader_election.cc:290] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:40.872565 16922 raft_consensus.cc:2749] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:10:40.873984 14303 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:40.875010 14303 leader_election.cc:304] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:10:40.875896 16768 consensus_queue.cc:1048] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:40.876241 16943 consensus_queue.cc:1048] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:40.877038 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:40.877259 16911 raft_consensus.cc:515] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:40.626899 16932 raft_consensus.cc:493] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:40.878875 16923 raft_consensus.cc:2804] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:40.879424 16923 raft_consensus.cc:493] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:40.879858 16923 raft_consensus.cc:3060] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:40.514544 16815 leader_election.cc:290] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:40.882393 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:40.882952 16926 raft_consensus.cc:493] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:40.883196 14262 raft_consensus.cc:2468] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 5.
I20260709 12:10:40.884177 16544 raft_consensus.cc:493] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:40.883538 16926 raft_consensus.cc:515] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:40.886377 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:40.886690 16926 leader_election.cc:290] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:40.887342 14265 raft_consensus.cc:2393] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 5: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:10:40.888094 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:40.889391 14348 tablet_copy_service.cc:342] P 65c9c1653b3346b39a0e118540e6080c: Request end of tablet copy session 73d01e9b1a9d49358da4985b21d681db-35b39d0f3270452a8bd4f4b1800a837c received from {username='slave'} at 127.0.0.1:55492
I20260709 12:10:40.862206 16934 raft_consensus.cc:2804] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:40.890244 16679 raft_consensus.cc:493] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:40.866066 16813 leader_election.cc:290] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:10:40.808146 16394 consensus_meta.cc:287] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.623s	user 0.015s	sys 0.004s
I20260709 12:10:40.864689 16776 raft_consensus.cc:3060] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:40.893525 16832 raft_consensus.cc:2804] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:10:40.879946 16911 leader_election.cc:290] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:40.864711 16933 leader_election.cc:290] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:40.917569 14186 leader_election.cc:290] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 6 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:40.906850 16934 raft_consensus.cc:493] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:40.916009 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:40.908844 16696 raft_consensus.cc:493] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:40.884908 16544 raft_consensus.cc:515] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:40.924813 14332 raft_consensus.cc:2468] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 6.
I20260709 12:10:40.879444 16932 raft_consensus.cc:515] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:40.932170 16946 consensus_queue.cc:1059] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 12:10:40.932420 16821 raft_consensus.cc:493] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:40.923947 16934 raft_consensus.cc:3060] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:40.933171 14185 raft_consensus.cc:3060] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:10:40.929724 14348 tablet_copy_service.cc:434] P 65c9c1653b3346b39a0e118540e6080c: ending tablet copy session 73d01e9b1a9d49358da4985b21d681db-35b39d0f3270452a8bd4f4b1800a837c on tablet 35b39d0f3270452a8bd4f4b1800a837c with peer 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:40.948946 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:40.926561 16832 raft_consensus.cc:697] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 10 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
W20260709 12:10:40.952103 16602 consensus_meta.cc:287] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.759s	user 0.015s	sys 0.005s
W20260709 12:10:40.965976 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 206659us
I20260709 12:10:40.966241 16790 consensus_queue.cc:1048] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
W20260709 12:10:40.938063 14907 consensus_meta.cc:287] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db: Time spent flushing consensus metadata: real 0.555s	user 0.005s	sys 0.009s
I20260709 12:10:40.970502 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:40.970981 14907 raft_consensus.cc:2468] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 8.
I20260709 12:10:40.945506 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:40.953476 14912 raft_consensus.cc:1275] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:10:40.938882 14906 raft_consensus.cc:1275] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:10:40.936506 16679 raft_consensus.cc:515] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:40.955830 16821 raft_consensus.cc:515] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:40.957393 14303 leader_election.cc:304] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:40.957952 14258 raft_consensus.cc:3060] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:40.958185 14190 raft_consensus.cc:1240] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:40.971395 14335 raft_consensus.cc:3060] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:40.974092 16933 raft_consensus.cc:493] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:40.977301 14185 raft_consensus.cc:2468] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 8.
I20260709 12:10:40.978129 16627 raft_consensus.cc:2764] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Leader election decision vote started in defunct term 7: won
I20260709 12:10:40.979228 16679 leader_election.cc:290] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:40.979964 14303 leader_election.cc:304] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:40.981037 16910 leader_election.cc:290] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 8 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:40.982048 16602 raft_consensus.cc:2804] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:40.982470 16602 raft_consensus.cc:493] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:10:40.982825 16602 raft_consensus.cc:3060] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:40.983470 16933 raft_consensus.cc:515] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:40.985088 16625 raft_consensus.cc:3055] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:40.985491 16625 raft_consensus.cc:740] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:10:40.934540 16911 raft_consensus.cc:493] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:41.000254 14258 raft_consensus.cc:2468] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 8.
I20260709 12:10:40.979813 16679 raft_consensus.cc:2764] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:10:40.944658 16544 leader_election.cc:290] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:40.930083 16696 raft_consensus.cc:515] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:10:41.001976 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 139065us
I20260709 12:10:41.008258 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:41.015483 16696 leader_election.cc:290] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:40.979377 16821 leader_election.cc:290] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:41.037081 16625 consensus_queue.cc:260] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:41.038688 16625 raft_consensus.cc:3060] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:41.015357 16739 raft_consensus.cc:3060] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:40.970606 16832 consensus_queue.cc:237] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:41.043083 16911 raft_consensus.cc:515] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:41.045998 14877 leader_election.cc:304] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:10:41.047080 16926 consensus_queue.cc:1048] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:10:41.047739 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 60781.6us
I20260709 12:10:40.985657 16933 leader_election.cc:290] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:41.072615 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:41.071919 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:41.076591 14335 raft_consensus.cc:2468] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 7.
I20260709 12:10:41.075326 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:10:41.080636 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 214432us
I20260709 12:10:41.084720 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:41.081990 14229 leader_election.cc:304] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:41.064553 16821 consensus_queue.cc:1048] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 12:10:41.077909 16733 leader_election.cc:290] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:41.096551 14330 raft_consensus.cc:2468] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 4.
I20260709 12:10:41.075793 16785 raft_consensus.cc:697] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 8 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:10:41.086124 16910 raft_consensus.cc:2804] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:41.084448 16946 raft_consensus.cc:493] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:10:41.102061 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:41.070355 16926 consensus_queue.cc:1048] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 12:10:41.115875 14877 leader_election.cc:304] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
W20260709 12:10:41.138209 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 60518.4us
I20260709 12:10:41.140370 14155 leader_election.cc:304] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:41.142211 14905 raft_consensus.cc:1217] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 5 LEARNER]: Deduplicated request from leader. Original: 5.4->[5.5-5.5]   Dedup: 5.5->[]
I20260709 12:10:41.148037 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:41.109350 16947 raft_consensus.cc:2804] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:41.146736 14229 leader_election.cc:304] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
W20260709 12:10:41.150759 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 44717.3us
I20260709 12:10:41.129665 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:41.153879 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:41.155742 16812 raft_consensus.cc:2804] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:41.156410 16812 raft_consensus.cc:697] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 8 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:10:41.103276 16831 raft_consensus.cc:515] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:41.160315 16831 leader_election.cc:290] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:41.160946 16926 consensus_queue.cc:1048] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:41.162200 16923 raft_consensus.cc:515] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:41.162948 14304 leader_election.cc:304] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:41.157537 16812 consensus_queue.cc:237] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:41.108965 16932 leader_election.cc:290] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:41.164453 16932 raft_consensus.cc:493] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:41.165071 16932 raft_consensus.cc:515] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:41.166863 16926 raft_consensus.cc:2749] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:41.167457 16934 raft_consensus.cc:515] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:41.108278 16910 raft_consensus.cc:697] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 7 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:10:41.187052 14261 raft_consensus.cc:2393] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 5: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:10:41.193450 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:41.195276 14258 raft_consensus.cc:1240] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:41.200243 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:41.114580 16968 raft_consensus.cc:493] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:10:41.103410 16907 raft_consensus.cc:515] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:41.151343 16815 raft_consensus.cc:493] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:41.170866 16923 leader_election.cc:290] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 7 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:10:41.200017 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 69634.6us
I20260709 12:10:41.204981 14265 raft_consensus.cc:2410] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for term 6 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:10:41.184801 16934 leader_election.cc:290] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:10:41.205693 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 57827.5us
I20260709 12:10:41.205827 14257 raft_consensus.cc:3060] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:41.191093 16947 raft_consensus.cc:697] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 5 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:10:41.209389 14154 leader_election.cc:304] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:41.207389 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:41.207190 14907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:10:41.218786 14230 leader_election.cc:304] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:41.226027 16971 raft_consensus.cc:2804] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:41.226744 16971 raft_consensus.cc:493] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:41.227154 16971 raft_consensus.cc:3060] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:41.229048 14155 leader_election.cc:336] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Timed out: RequestConsensusVote RPC to 127.12.174.130:36673 timed out after 1.631s (SENT)
I20260709 12:10:41.229607 14155 leader_election.cc:304] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:41.230139 16910 consensus_queue.cc:237] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:41.231215 14086 catalog_manager.cc:5697] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf reported cstate change: term changed from 3 to 5, now has a pending config: VOTER 885067a0d31741bfb5c9935788e315bf (127.12.174.129), VOTER 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130), VOTER 65c9c1653b3346b39a0e118540e6080c (127.12.174.131), NON_VOTER 73d01e9b1a9d49358da4985b21d681db (127.12.174.132). New cstate: current_term: 5 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } } pending_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } } }
I20260709 12:10:41.212555 16933 raft_consensus.cc:2804] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:41.199358 16776 raft_consensus.cc:515] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:41.200350 16946 raft_consensus.cc:515] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:41.239936 14304 leader_election.cc:304] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
W20260709 12:10:41.247210 14154 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 170560us
I20260709 12:10:41.249917 16923 raft_consensus.cc:2749] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:41.238884 14907 raft_consensus.cc:3060] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:41.262061 14086 catalog_manager.cc:5697] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:10:41.254544 16934 raft_consensus.cc:2749] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:10:41.269953 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 51280.6us
I20260709 12:10:41.254914 16933 raft_consensus.cc:697] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 5 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
W20260709 12:10:41.272797 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 88243us
I20260709 12:10:41.277125 16967 raft_consensus.cc:2749] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:41.277505 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:41.278429 14259 raft_consensus.cc:2468] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 4.
I20260709 12:10:41.284116 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:41.239835 16815 raft_consensus.cc:515] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:41.226563 16968 raft_consensus.cc:515] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:10:41.289364 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 69778.5us
I20260709 12:10:41.295487 14907 raft_consensus.cc:2468] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 7.
I20260709 12:10:41.270041 14086 catalog_manager.cc:5697] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf reported cstate change: term changed from 4 to 6, leader changed from 885067a0d31741bfb5c9935788e315bf (127.12.174.129) to 65c9c1653b3346b39a0e118540e6080c (127.12.174.131). New cstate: current_term: 6 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } }
I20260709 12:10:41.299015 14257 raft_consensus.cc:1275] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:41.290433 16832 consensus_queue.cc:1048] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 12:10:41.270959 16932 leader_election.cc:290] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:41.302165 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:41.278640 16776 leader_election.cc:290] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 6 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:41.308014 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:41.310753 14258 raft_consensus.cc:2393] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 3: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:10:41.299942 14303 leader_election.cc:304] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:10:41.246467 16785 consensus_queue.cc:237] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:41.323321 14260 raft_consensus.cc:1275] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:41.323625 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:41.326316 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:41.300510 16813 raft_consensus.cc:2749] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:41.242811 16947 consensus_queue.cc:237] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:41.311352 16980 raft_consensus.cc:493] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:41.287766 16602 raft_consensus.cc:515] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:41.331360 14230 leader_election.cc:304] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:10:41.336915 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:41.334568 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:41.339033 14260 raft_consensus.cc:2468] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 5.
I20260709 12:10:41.330206 16923 raft_consensus.cc:2804] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:41.348758 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:41.349792 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:10:41.350219 14154 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 101737us
I20260709 12:10:41.355917 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:41.356510 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:41.317711 16965 consensus_queue.cc:1048] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 12:10:41.356885 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:41.357340 14335 raft_consensus.cc:2410] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:10:41.352051 14086 catalog_manager.cc:5697] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf reported cstate change: term changed from 1 to 2, leader changed from 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130) to 885067a0d31741bfb5c9935788e315bf (127.12.174.129). New cstate: current_term: 2 leader_uuid: "885067a0d31741bfb5c9935788e315bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:41.357153 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:41.342710 16907 leader_election.cc:290] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 6 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:41.360569 16934 raft_consensus.cc:2804] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:41.369805 16939 consensus_queue.cc:1048] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:41.376089 14333 raft_consensus.cc:3060] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:41.372359 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:41.370354 14334 raft_consensus.cc:2410] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:10:41.354801 16923 raft_consensus.cc:697] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 7 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:41.380458 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:41.379199 14336 raft_consensus.cc:3060] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:41.381306 16831 consensus_queue.cc:1059] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:41.387107 16965 raft_consensus.cc:3055] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:41.388594 16965 raft_consensus.cc:740] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:10:41.382509 16911 leader_election.cc:290] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:41.382936 16946 leader_election.cc:290] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:41.384575 14265 raft_consensus.cc:2468] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 5.
I20260709 12:10:41.386165 16731 raft_consensus.cc:493] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:41.395751 14336 raft_consensus.cc:2468] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 6.
I20260709 12:10:41.374430 16934 raft_consensus.cc:493] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:41.389935 16965 consensus_queue.cc:260] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:41.402916 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:41.399843 14086 catalog_manager.cc:5697] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:10:41.403766 16934 raft_consensus.cc:3060] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:41.413100 14086 catalog_manager.cc:5697] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf reported cstate change: term changed from 6 to 8, leader changed from 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130) to 885067a0d31741bfb5c9935788e315bf (127.12.174.129). New cstate: current_term: 8 leader_uuid: "885067a0d31741bfb5c9935788e315bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:41.415647 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:41.379842 16832 consensus_queue.cc:1048] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 12:10:41.416287 14265 raft_consensus.cc:3060] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:41.417016 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:41.417152 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:41.361130 16980 raft_consensus.cc:515] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:41.418002 14187 raft_consensus.cc:1275] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:10:41.420043 14086 catalog_manager.cc:5697] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf reported cstate change: term changed from 3 to 5, leader changed from 885067a0d31741bfb5c9935788e315bf (127.12.174.129) to 65c9c1653b3346b39a0e118540e6080c (127.12.174.131). New cstate: current_term: 5 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } }
I20260709 12:10:41.422798 16968 leader_election.cc:290] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:41.423632 16923 consensus_queue.cc:237] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:10:41.424329 16979 log.cc:927] Time spent T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.124s	user 0.000s	sys 0.003s
I20260709 12:10:41.438608 14189 raft_consensus.cc:2468] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 5.
I20260709 12:10:41.438710 16967 raft_consensus.cc:493] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:41.445168 16737 raft_consensus.cc:493] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:41.448047 16967 raft_consensus.cc:515] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:41.450419 16967 leader_election.cc:290] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:41.451538 16602 leader_election.cc:290] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 6 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:41.446631 14086 catalog_manager.cc:5697] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "885067a0d31741bfb5c9935788e315bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:41.454701 14086 catalog_manager.cc:5697] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf reported cstate change: term changed from 1 to 2, leader changed from 65c9c1653b3346b39a0e118540e6080c (127.12.174.131) to 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130). New cstate: current_term: 2 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } }
I20260709 12:10:41.378176 16933 consensus_queue.cc:237] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } }
I20260709 12:10:41.448112 16737 raft_consensus.cc:515] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:41.445360 16980 leader_election.cc:290] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:41.399930 16731 raft_consensus.cc:515] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:41.480674 16965 raft_consensus.cc:3060] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:41.487846 14086 catalog_manager.cc:5697] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "885067a0d31741bfb5c9935788e315bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:41.488909 16763 raft_consensus.cc:493] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:41.456825 14155 leader_election.cc:304] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:41.490075 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:10:41.492391 16983 log.cc:927] Time spent T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 12:10:41.494158 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:41.494185 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:41.495327 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:41.498245 14181 raft_consensus.cc:1275] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:10:41.509685 14333 raft_consensus.cc:2468] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 6.
I20260709 12:10:41.515007 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:41.558647 14905 consensus_queue.cc:237] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:41.623962 14907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
W20260709 12:10:41.514732 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 57960us
I20260709 12:10:41.626454 16737 leader_election.cc:290] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:41.627149 14258 raft_consensus.cc:3060] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:41.617457 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:41.619684 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:41.617027 14265 raft_consensus.cc:2468] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 6.
I20260709 12:10:41.540200 14086 catalog_manager.cc:5697] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf reported cstate change: term changed from 1 to 5, leader changed from 885067a0d31741bfb5c9935788e315bf (127.12.174.129) to 65c9c1653b3346b39a0e118540e6080c (127.12.174.131). New cstate: current_term: 5 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } }
I20260709 12:10:41.647277 14907 raft_consensus.cc:2468] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 3.
I20260709 12:10:41.550488 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:41.621184 14190 raft_consensus.cc:2468] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 8.
I20260709 12:10:41.548545 14259 raft_consensus.cc:2468] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 4.
I20260709 12:10:41.649660 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:41.650398 14333 raft_consensus.cc:2468] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 6.
W20260709 12:10:41.651737 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 237881us
I20260709 12:10:41.653178 14230 leader_election.cc:304] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:41.654495 14230 leader_election.cc:304] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:10:41.549456 16763 raft_consensus.cc:515] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:41.534837 16980 raft_consensus.cc:2804] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:41.655277 16831 raft_consensus.cc:2804] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:41.656970 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:41.657467 16831 raft_consensus.cc:493] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:41.657928 16831 raft_consensus.cc:3060] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:41.658138 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:41.658773 14336 raft_consensus.cc:2468] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 3.
I20260709 12:10:41.659353 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:41.661649 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:41.662369 16980 raft_consensus.cc:697] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 6 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:10:41.668774 14333 raft_consensus.cc:2468] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 10.
I20260709 12:10:41.673623 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:41.681279 14189 raft_consensus.cc:1275] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 12:10:41.674861 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:41.683960 14907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:41.684355 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:41.689378 14912 raft_consensus.cc:2393] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 5: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
W20260709 12:10:41.685002 14878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:41.670073 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:41.681524 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:41.694454 14086 catalog_manager.cc:5697] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf reported cstate change: term changed from 2 to 5. New cstate: current_term: 5 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:10:41.680114 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:41.699309 14258 raft_consensus.cc:2468] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 6.
I20260709 12:10:41.687969 14189 pending_rounds.cc:85] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf: Aborting all ops after (but not including) 2
I20260709 12:10:41.673854 16627 raft_consensus.cc:493] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:41.684659 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:41.707118 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:41.677727 16815 leader_election.cc:290] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:41.680604 16731 leader_election.cc:290] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:41.657056 16763 leader_election.cc:290] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:41.700502 14189 pending_rounds.cc:107] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 12:10:41.706509 14086 catalog_manager.cc:5697] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf reported cstate change: term changed from 2 to 5, leader changed from 885067a0d31741bfb5c9935788e315bf (127.12.174.129) to 65c9c1653b3346b39a0e118540e6080c (127.12.174.131). New cstate: current_term: 5 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } }
I20260709 12:10:41.710389 14189 raft_consensus.cc:2889] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:41.704979 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:41.711285 14190 raft_consensus.cc:3060] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:41.714164 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:41.714681 14336 raft_consensus.cc:2468] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 8.
I20260709 12:10:41.713923 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:41.718046 14906 raft_consensus.cc:2368] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 6. Current term is 7.
I20260709 12:10:41.705047 16832 raft_consensus.cc:2749] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:41.713636 14086 catalog_manager.cc:5697] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf reported cstate change: term changed from 1 to 4. New cstate: current_term: 4 leader_uuid: "885067a0d31741bfb5c9935788e315bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:41.719609 14187 raft_consensus.cc:2393] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 6: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:10:41.665768 16971 raft_consensus.cc:515] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:41.721460 16939 raft_consensus.cc:493] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:41.716456 16627 raft_consensus.cc:515] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:41.722081 16939 raft_consensus.cc:515] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:41.722713 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:41.723469 16627 leader_election.cc:290] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:41.724207 14086 catalog_manager.cc:5697] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } }
I20260709 12:10:41.721482 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:41.664237 16980 consensus_queue.cc:237] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:41.770478 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:41.799607 14187 raft_consensus.cc:1275] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:10:41.726884 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:41.821521 14186 raft_consensus.cc:2468] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 4.
W20260709 12:10:41.819994 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 94251.3us
I20260709 12:10:41.800799 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:41.827138 14337 raft_consensus.cc:3055] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:41.827600 14337 raft_consensus.cc:740] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:41.834188 14086 catalog_manager.cc:5697] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf reported cstate change: term changed from 2 to 5. New cstate: current_term: 5 leader_uuid: "885067a0d31741bfb5c9935788e315bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:41.841871 14183 raft_consensus.cc:2468] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 7.
I20260709 12:10:41.845978 14155 leader_election.cc:304] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:41.848773 14155 leader_election.cc:304] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:41.859473 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:41.860507 14184 raft_consensus.cc:2393] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 8: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:10:41.861538 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:41.863929 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:41.864630 14331 raft_consensus.cc:2468] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 6.
I20260709 12:10:41.724357 16939 leader_election.cc:290] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:41.719230 16731 raft_consensus.cc:493] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:10:41.871470 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:41.872284 14186 raft_consensus.cc:2393] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 6: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:10:41.839566 14337 consensus_queue.cc:260] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:41.867847 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:41.805997 16696 raft_consensus.cc:493] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:41.755236 16815 raft_consensus.cc:493] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:41.879451 14183 raft_consensus.cc:1275] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:10:41.719798 16934 raft_consensus.cc:515] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:41.863979 16971 leader_election.cc:290] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:41.883563 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:41.819882 16967 consensus_queue.cc:1048] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.058s
I20260709 12:10:41.885609 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:41.887002 14337 raft_consensus.cc:3060] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:41.874169 16968 raft_consensus.cc:2749] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:41.889008 14229 leader_election.cc:304] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:10:41.891816 14183 raft_consensus.cc:1240] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:41.892175 14155 leader_election.cc:304] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:41.890772 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:41.899535 14229 leader_election.cc:304] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:41.901798 14186 raft_consensus.cc:2393] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 5: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:10:41.882715 16696 raft_consensus.cc:515] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:41.903586 14187 raft_consensus.cc:2468] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 5.
I20260709 12:10:41.903714 14912 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61"
dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
mode: GRACEFUL
new_leader_uuid: "885067a0d31741bfb5c9935788e315bf"
 from {username='slave'} at 127.0.0.1:38628
I20260709 12:10:41.903811 16939 raft_consensus.cc:2804] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:41.904326 14912 raft_consensus.cc:606] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 4 LEADER]: Received request to transfer leadership to TS 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:41.906093 16939 raft_consensus.cc:697] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 3 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:10:41.909365 16939 consensus_queue.cc:237] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:41.908169 16696 leader_election.cc:290] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:41.885308 16813 raft_consensus.cc:493] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:41.914515 16813 raft_consensus.cc:515] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:41.879606 16911 raft_consensus.cc:493] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:10:41.918388 16911 raft_consensus.cc:515] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:10:41.919646 14875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:41.920940 16911 leader_election.cc:290] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:41.878055 16731 raft_consensus.cc:515] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:41.946843 14261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41764 (request call id 2202) took 1089 ms. Trace:
I20260709 12:10:41.947405 14261 rpcz_store.cc:276] 0709 12:10:40.862127 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:40.867678 (+  5551us) service_pool.cc:224] Handling call
0709 12:10:41.946564 (+1078886us) spinlock_profiling.cc:243] Waited 301 ms on lock 0x7b540007b054. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:10:41.946740 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":692590336}
I20260709 12:10:41.928540 16785 raft_consensus.cc:2749] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:41.948871 14263 raft_consensus.cc:1275] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 12:10:41.949246 14263 pending_rounds.cc:85] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec: Aborting all ops after (but not including) 2
I20260709 12:10:41.949481 14263 pending_rounds.cc:107] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 12:10:41.949717 14263 raft_consensus.cc:2889] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:41.954703 16934 leader_election.cc:290] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 8 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:41.970908 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:41.931135 16933 raft_consensus.cc:2749] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:41.977582 14912 raft_consensus.cc:1275] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:41.979313 14333 raft_consensus.cc:2393] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db in current term 6: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
W20260709 12:10:41.982038 14303 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:41.929682 16815 raft_consensus.cc:515] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:41.935081 16911 raft_consensus.cc:2749] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:41.990638 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:42.003072 14229 leader_election.cc:400] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 pre-election: Vote denied by peer 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341) with higher term. Message: Invalid argument: T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 6. Current term is 7.
I20260709 12:10:42.003482 14229 leader_election.cc:403] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:42.003961 14339 raft_consensus.cc:1275] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 12:10:42.004309 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 73638.8us
I20260709 12:10:42.005371 14339 raft_consensus.cc:1275] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:42.006145 16934 raft_consensus.cc:3060] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:10:42.009570 14907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:42.010293 14907 raft_consensus.cc:2468] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 8.
I20260709 12:10:41.993171 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:41.988456 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:42.028323 14333 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0"
dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
mode: GRACEFUL
new_leader_uuid: "885067a0d31741bfb5c9935788e315bf"
 from {username='slave'} at 127.0.0.1:50896
I20260709 12:10:42.029147 14333 raft_consensus.cc:606] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 6 LEADER]: Received request to transfer leadership to TS 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:42.031265 16602 raft_consensus.cc:493] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:10:41.969377 16831 raft_consensus.cc:515] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:42.045467 14337 raft_consensus.cc:2468] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 6.
I20260709 12:10:42.051227 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:42.052044 14182 raft_consensus.cc:2393] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 8: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:10:42.052874 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:42.070777 14182 raft_consensus.cc:2468] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 6.
I20260709 12:10:42.031842 16602 raft_consensus.cc:515] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:10:42.076792 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 194316us
I20260709 12:10:42.075971 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:42.117022 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:42.117920 14182 raft_consensus.cc:2468] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 6.
I20260709 12:10:42.118854 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:42.119481 14182 raft_consensus.cc:2468] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 6.
W20260709 12:10:42.121317 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 174271us
W20260709 12:10:42.131134 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 102832us
I20260709 12:10:42.139631 14303 leader_election.cc:304] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:42.143865 14155 leader_election.cc:304] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:42.127599 16731 leader_election.cc:290] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:42.156589 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:42.166062 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:42.166795 14262 raft_consensus.cc:2468] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 5.
I20260709 12:10:42.172724 14258 raft_consensus.cc:2468] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 6.
I20260709 12:10:42.149607 16907 raft_consensus.cc:2749] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:42.185820 17011 raft_consensus.cc:2749] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:42.191229 14189 raft_consensus.cc:1275] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:10:42.192760 16815 leader_election.cc:290] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:10:42.194232 16999 log.cc:927] Time spent T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.184s	user 0.001s	sys 0.000s
I20260709 12:10:42.195540 14229 leader_election.cc:304] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:42.196941 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:42.207013 14256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41764 (request call id 2221) took 1016 ms. Trace:
I20260709 12:10:42.217757 14189 raft_consensus.cc:1240] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:10:42.223627 16969 raft_consensus.cc:2749] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:10:42.191275 16972 log.cc:927] Time spent T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 1.082s	user 0.004s	sys 0.000s
I20260709 12:10:42.175132 16731 consensus_queue.cc:1048] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.059s
I20260709 12:10:42.229341 14258 raft_consensus.cc:1275] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 12:10:42.252463 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 77148.5us
I20260709 12:10:42.244856 16831 leader_election.cc:290] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:42.269366 16910 raft_consensus.cc:993] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db: : Instructing follower 885067a0d31741bfb5c9935788e315bf to start an election
I20260709 12:10:42.270046 16910 raft_consensus.cc:1081] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 4 LEADER]: Signalling peer 885067a0d31741bfb5c9935788e315bf to start an election
I20260709 12:10:42.272971 14912 raft_consensus.cc:1275] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:42.287595 17011 raft_consensus.cc:493] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:42.293154 14334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50856 (request call id 1771) took 2081 ms. Trace:
I20260709 12:10:42.292982 17011 raft_consensus.cc:515] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:42.293677 14334 rpcz_store.cc:276] 0709 12:10:40.211831 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:40.213636 (+  1805us) service_pool.cc:224] Handling call
0709 12:10:42.292753 (+2079117us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b54002a5b54. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:10:42.292989 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2618125184}
I20260709 12:10:42.297451 17006 consensus_queue.cc:1048] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:10:42.299321 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 45690.6us
I20260709 12:10:42.300429 14876 leader_election.cc:304] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:42.207548 14256 rpcz_store.cc:276] 0709 12:10:41.190763 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:41.207590 (+ 16827us) service_pool.cc:224] Handling call
0709 12:10:42.205947 (+998357us) spinlock_profiling.cc:243] Waited 2.09 ms on lock 0x7b5800060c98. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2124016b71 00007f2124016eee 000000000036eb39 00007f212c08a1e0 00007f212c1530c4 00007f212c153131 00007f212c114fc0 00007f212c0ff929 00007f212c0ff3d2 00007f2125676bd4
0709 12:10:42.206209 (+   262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:42.206465 (+   256us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:42.206494 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:42.206541 (+    47us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:42.206595 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:42.206656 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:42.206797 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4796800}
I20260709 12:10:42.326561 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:42.330137 14181 raft_consensus.cc:2393] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 8: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
W20260709 12:10:42.335830 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 125010us
W20260709 12:10:42.337505 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 211593us
I20260709 12:10:42.338400 14155 leader_election.cc:304] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:42.339277 14263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41764 (request call id 2215) took 1141 ms. Trace:
I20260709 12:10:42.342249 14182 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61"
dest_uuid: "885067a0d31741bfb5c9935788e315bf"
 from {username='slave'} at 127.0.0.1:56652
I20260709 12:10:42.342849 14182 raft_consensus.cc:493] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:42.343201 14182 raft_consensus.cc:3060] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:42.337255 16821 raft_consensus.cc:493] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:42.347018 16821 raft_consensus.cc:515] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:42.348011 16602 leader_election.cc:290] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:42.349156 16821 leader_election.cc:290] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:42.339816 16627 raft_consensus.cc:2804] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:42.350211 16627 raft_consensus.cc:493] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:42.350600 16627 raft_consensus.cc:3060] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:42.351403 16934 raft_consensus.cc:2749] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341) with higher term. Message: Invalid argument: T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 6. Current term is 7.
I20260709 12:10:42.352331 16989 raft_consensus.cc:493] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:42.352844 16989 raft_consensus.cc:515] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:42.354941 16813 leader_election.cc:290] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:42.342080 14263 rpcz_store.cc:276] 0709 12:10:41.187939 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:41.188118 (+   179us) service_pool.cc:224] Handling call
0709 12:10:41.948499 (+760381us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:41.950181 (+  1682us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:42.328195 (+378014us) spinlock_profiling.cc:243] Waited 746 ms on lock 0x7b540007b050. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713a8ad 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:10:42.329515 (+  1320us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1715262336}
W20260709 12:10:42.359455 14190 consensus_meta.cc:287] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.648s	user 0.005s	sys 0.015s
I20260709 12:10:42.359148 16911 raft_consensus.cc:493] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:42.366627 16911 raft_consensus.cc:515] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:42.368811 16911 leader_election.cc:290] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:10:42.371304 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 175912us
I20260709 12:10:42.372292 14229 leader_election.cc:304] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:42.373111 16943 raft_consensus.cc:2749] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:42.373728 14229 leader_election.cc:304] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:42.376150 16581 consensus_queue.cc:1048] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:42.376672 16989 leader_election.cc:290] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:42.380144 14256 raft_consensus.cc:1275] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:42.380726 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:42.383579 16581 consensus_queue.cc:1048] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:42.359951 14190 raft_consensus.cc:2468] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 3.
I20260709 12:10:42.386608 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:42.387180 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:42.388777 14261 raft_consensus.cc:1275] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:10:42.395186 16627 raft_consensus.cc:515] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:42.398819 16627 leader_election.cc:290] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 6 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:42.426424 17011 leader_election.cc:290] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:10:42.421078 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 47417.8us
I20260709 12:10:42.443491 16934 raft_consensus.cc:493] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:42.444357 16934 raft_consensus.cc:515] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:42.447228 16934 leader_election.cc:290] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:42.448220 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:42.449169 14256 raft_consensus.cc:2468] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 5.
I20260709 12:10:42.450417 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:42.453632 14877 leader_election.cc:304] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:42.454613 16627 raft_consensus.cc:2804] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:42.455036 16627 raft_consensus.cc:493] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:42.455399 16627 raft_consensus.cc:3060] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:42.456434 14877 leader_election.cc:304] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:42.457770 17022 raft_consensus.cc:2804] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:42.458213 17022 raft_consensus.cc:493] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:10:42.458595 17022 raft_consensus.cc:3060] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:42.467011 14263 raft_consensus.cc:2468] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 7.
I20260709 12:10:42.470271 17012 consensus_queue.cc:1059] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:42.471372 16926 consensus_queue.cc:1048] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:42.471668 17012 raft_consensus.cc:3055] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:42.472460 17012 raft_consensus.cc:740] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:42.473416 17012 consensus_queue.cc:260] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:42.474767 17012 raft_consensus.cc:3060] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:42.443424 14229 leader_election.cc:304] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:42.483049 16934 raft_consensus.cc:2749] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:42.483557 14229 leader_election.cc:304] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:42.484580 16934 raft_consensus.cc:2804] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:42.485021 16934 raft_consensus.cc:493] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:42.485373 16934 raft_consensus.cc:3060] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:42.485324 17013 consensus_queue.cc:1048] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:42.488806 14229 leader_election.cc:304] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:42.494911 16934 raft_consensus.cc:515] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:42.498876 16934 leader_election.cc:290] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:42.501350 14331 raft_consensus.cc:1240] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:42.503782 16989 raft_consensus.cc:2749] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:42.511802 16910 consensus_queue.cc:1048] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:42.505113 16627 raft_consensus.cc:515] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:42.519201 16627 leader_election.cc:290] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 6 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:42.520689 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
W20260709 12:10:42.503925 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 165613us
I20260709 12:10:42.526455 14155 leader_election.cc:304] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:42.527753 16989 raft_consensus.cc:2804] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:42.528192 16989 raft_consensus.cc:493] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:42.528827 16989 raft_consensus.cc:3060] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:42.538434 16989 raft_consensus.cc:515] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } }
I20260709 12:10:42.540762 16989 leader_election.cc:290] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 6 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:10:42.549955 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 305725us
I20260709 12:10:42.560703 14182 raft_consensus.cc:515] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:42.567433 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:42.596655 14189 raft_consensus.cc:1240] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 4. Current term is 5. Ops: []
W20260709 12:10:42.571810 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 45458.6us
I20260709 12:10:42.580895 17018 consensus_queue.cc:1048] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:42.598838 14155 leader_election.cc:304] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:42.587615 17013 raft_consensus.cc:2749] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:10:42.590291 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 440924us
I20260709 12:10:42.596572 14187 raft_consensus.cc:3060] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:42.576488 16926 raft_consensus.cc:493] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
W20260709 12:10:42.583721 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 94998.7us
I20260709 12:10:42.620349 14229 leader_election.cc:304] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:42.603761 14303 leader_election.cc:304] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:10:42.622946 14303 leader_election.cc:304] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:42.604804 14155 leader_election.cc:304] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:42.624714 14155 leader_election.cc:304] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:42.606848 14263 raft_consensus.cc:1275] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:42.615029 16943 raft_consensus.cc:2749] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:42.631762 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:42.636523 16785 raft_consensus.cc:2804] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:42.646234 16785 raft_consensus.cc:493] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:42.646661 16785 raft_consensus.cc:3060] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:42.634191 16980 raft_consensus.cc:2749] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:42.636649 16544 raft_consensus.cc:2749] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:42.648986 16544 consensus_queue.cc:1048] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:10:42.637154 16911 raft_consensus.cc:2804] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:42.648731 16750 raft_consensus.cc:2955] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 6 LEADER]: Committing config change with OpId 6.7: config changed from index 4 to 7, VOTER 885067a0d31741bfb5c9935788e315bf (127.12.174.129) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:10:42.637218 16602 raft_consensus.cc:2804] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:42.650543 16602 raft_consensus.cc:493] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:42.650918 16602 raft_consensus.cc:3060] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:42.638283 16926 raft_consensus.cc:515] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:42.652756 14155 leader_election.cc:304] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:10:42.654820 16926 leader_election.cc:290] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:42.655051 16933 raft_consensus.cc:2749] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:42.656469 14261 raft_consensus.cc:1275] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:10:42.659740 14229 leader_election.cc:304] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:42.646064 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:42.660665 14259 raft_consensus.cc:3060] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:42.663981 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:42.664777 14262 raft_consensus.cc:2468] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 6.
I20260709 12:10:42.663981 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:10:42.666359 14912 raft_consensus.cc:3055] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:42.666687 14912 raft_consensus.cc:740] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:10:42.671739 14182 leader_election.cc:290] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:42.671125 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:42.598011 17011 consensus_queue.cc:1048] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.070s
I20260709 12:10:42.665597 16911 raft_consensus.cc:697] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 6 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:10:42.674463 14304 leader_election.cc:304] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:10:42.669174 16989 raft_consensus.cc:2804] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:42.683756 14155 leader_election.cc:304] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:42.678613 16965 raft_consensus.cc:2749] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:42.679960 14912 consensus_queue.cc:260] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:42.689054 14912 raft_consensus.cc:3060] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:42.673214 17006 raft_consensus.cc:493] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:42.695101 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:42.694639 14331 raft_consensus.cc:2955] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Committing config change with OpId 6.7: config changed from index 4 to 7, VOTER 885067a0d31741bfb5c9935788e315bf (127.12.174.129) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:10:42.668169 16946 consensus_queue.cc:1048] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 12:10:42.697453 14155 leader_election.cc:304] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:10:42.703397 14912 raft_consensus.cc:2468] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 5.
I20260709 12:10:42.706485 14229 leader_election.cc:304] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:42.706725 14155 leader_election.cc:304] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:42.710304 14229 leader_election.cc:304] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:42.672791 16737 consensus_queue.cc:1048] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 12:10:42.711736 14304 leader_election.cc:304] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:10:42.695804 16821 raft_consensus.cc:2804] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:42.709656 16980 raft_consensus.cc:493] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:42.695569 16813 raft_consensus.cc:2804] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:42.756258 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:42.767459 14338 raft_consensus.cc:1275] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 12:10:42.770421 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 138682us
I20260709 12:10:42.772217 14259 raft_consensus.cc:2468] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 6.
I20260709 12:10:42.792654 14303 leader_election.cc:304] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:10:42.793906 14262 raft_consensus.cc:1240] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:10:42.795534 14187 raft_consensus.cc:2468] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 6.
I20260709 12:10:42.712894 16943 raft_consensus.cc:2749] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:42.804932 14303 leader_election.cc:304] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:10:42.729435 16821 raft_consensus.cc:493] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:42.697574 17014 consensus_queue.cc:1059] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.076s
I20260709 12:10:42.807761 14336 raft_consensus.cc:1275] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:10:42.729712 16923 raft_consensus.cc:2804] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:42.723349 16814 raft_consensus.cc:493] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:42.724327 16934 raft_consensus.cc:2804] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:42.810326 14303 leader_election.cc:304] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:42.833177 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:42.827005 14332 raft_consensus.cc:1275] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 3. (term mismatch)
I20260709 12:10:42.705210 17010 consensus_queue.cc:1048] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.099s
I20260709 12:10:42.728871 16813 raft_consensus.cc:493] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:10:42.834923 14332 pending_rounds.cc:85] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c: Aborting all ops after (but not including) 2
I20260709 12:10:42.836277 14332 pending_rounds.cc:107] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c: Aborting uncommitted NO_OP operation due to leader change: 6.3
I20260709 12:10:42.713755 17013 consensus_queue.cc:1059] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.111s
I20260709 12:10:42.836692 14332 raft_consensus.cc:2889] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:42.713224 17006 raft_consensus.cc:515] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:42.841449 14337 raft_consensus.cc:1240] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:42.822062 16821 raft_consensus.cc:3060] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:42.821889 16926 raft_consensus.cc:2804] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:42.830713 16923 raft_consensus.cc:493] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:42.852859 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:42.792263 16980 raft_consensus.cc:515] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:42.819600 17035 raft_consensus.cc:2804] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:10:42.839430 17026 log.cc:927] Time spent T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 12:10:42.852037 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:42.857676 14154 leader_election.cc:304] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:42.833148 16934 raft_consensus.cc:493] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:42.817943 16544 consensus_queue.cc:1048] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.034s
W20260709 12:10:42.867195 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 156965us
I20260709 12:10:42.859078 16923 raft_consensus.cc:3060] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:42.854156 16926 raft_consensus.cc:493] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:10:42.839072 16813 raft_consensus.cc:3060] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:42.874151 14336 raft_consensus.cc:2468] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 6.
W20260709 12:10:42.875810 14305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:42.818758 16911 consensus_queue.cc:237] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:10:42.893191 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 82960.9us
I20260709 12:10:42.868526 16934 raft_consensus.cc:3060] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:42.902096 14258 raft_consensus.cc:1240] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:10:42.866096 17035 raft_consensus.cc:493] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:42.904373 14303 leader_election.cc:304] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:10:42.871592 16943 raft_consensus.cc:3055] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:42.863749 16933 raft_consensus.cc:493] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:10:42.835587 16814 raft_consensus.cc:515] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:42.926653 14876 leader_election.cc:304] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:10:42.924697 14334 raft_consensus.cc:2468] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 8.
I20260709 12:10:42.904711 14259 raft_consensus.cc:2955] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Committing config change with OpId 6.7: config changed from index 4 to 7, VOTER 885067a0d31741bfb5c9935788e315bf (127.12.174.129) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
W20260709 12:10:42.928761 14154 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 71154.8us
I20260709 12:10:42.886385 16731 raft_consensus.cc:2749] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:42.889034 16926 raft_consensus.cc:3060] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:42.933398 14229 leader_election.cc:304] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:42.880019 16602 raft_consensus.cc:515] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:42.926271 16943 raft_consensus.cc:740] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:10:42.922163 17035 raft_consensus.cc:3060] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:42.930852 17017 consensus_queue.cc:1048] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 12:10:42.948423 17038 raft_consensus.cc:2804] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:42.948971 17038 raft_consensus.cc:493] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:42.949294 17038 raft_consensus.cc:3060] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:42.949608 16602 leader_election.cc:290] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 6 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:42.950747 14338 raft_consensus.cc:1240] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:42.940693 17010 raft_consensus.cc:2804] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:42.987118 16969 raft_consensus.cc:2749] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:42.987551 17006 leader_election.cc:290] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:42.934316 16933 raft_consensus.cc:515] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:10:42.998390 17025 log.cc:927] Time spent T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
W20260709 12:10:43.002053 17029 log.cc:927] Time spent T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.188s	user 0.000s	sys 0.001s
I20260709 12:10:42.984778 17010 raft_consensus.cc:697] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 6 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:10:43.003399 16980 leader_election.cc:290] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:43.006440 17050 consensus_queue.cc:1048] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 12:10:42.966347 16939 consensus_queue.cc:1048] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
W20260709 12:10:43.060600 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 122914us
I20260709 12:10:43.072829 16965 raft_consensus.cc:3055] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:43.073453 16965 raft_consensus.cc:740] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:10:43.075014 16965 consensus_queue.cc:260] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:43.076776 16965 raft_consensus.cc:3060] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:43.078562 17037 log.cc:927] Time spent T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 12:10:42.968706 17022 raft_consensus.cc:515] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:42.973542 17042 consensus_queue.cc:1059] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.098s
I20260709 12:10:43.088029 16980 raft_consensus.cc:2804] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:43.124881 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:43.125646 14263 raft_consensus.cc:1275] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:10:43.131343 17044 raft_consensus.cc:493] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:10:43.132099 17044 raft_consensus.cc:515] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:43.134941 17044 leader_election.cc:290] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:43.139403 17044 consensus_queue.cc:1059] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:43.140513 17045 raft_consensus.cc:3055] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:43.140908 17045 raft_consensus.cc:740] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:43.141860 17045 consensus_queue.cc:260] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:43.143173 17045 raft_consensus.cc:3060] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:43.147274 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:43.148010 14263 raft_consensus.cc:2468] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 5.
I20260709 12:10:43.069820 14230 leader_election.cc:304] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
W20260709 12:10:43.166914 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 233644us
W20260709 12:10:43.173491 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 466913us
I20260709 12:10:43.174363 14155 leader_election.cc:304] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
W20260709 12:10:43.180986 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 242422us
W20260709 12:10:43.176617 17036 log.cc:927] Time spent T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.307s	user 0.000s	sys 0.001s
I20260709 12:10:43.168426 16750 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:55608 (request call id 0) took 1618 ms. Trace:
I20260709 12:10:43.114439 17042 consensus_queue.cc:1048] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.065s
W20260709 12:10:43.237818 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 61752.4us
I20260709 12:10:43.282588 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:43.274446 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:43.285611 14182 raft_consensus.cc:1275] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:10:43.286271 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:43.291806 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:43.292727 14260 raft_consensus.cc:2410] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:10:43.294267 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:43.295300 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:43.220551 16737 raft_consensus.cc:493] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:10:43.284621 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:43.232731 17053 raft_consensus.cc:2804] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:43.299505 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:43.301833 14188 raft_consensus.cc:2468] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 7.
I20260709 12:10:43.302330 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:43.093698 16943 consensus_queue.cc:260] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:43.272653 17010 consensus_queue.cc:237] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:10:43.635004 14875 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.666s	user 0.000s	sys 0.017s
W20260709 12:10:43.464811 14305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:43.447664 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 193113us
I20260709 12:10:43.354928 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:10:43.488310 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 189732us
I20260709 12:10:43.304570 14190 raft_consensus.cc:1275] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:43.305768 14183 raft_consensus.cc:1275] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:10:43.303417 14186 raft_consensus.cc:1275] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:10:43.396582 14187 raft_consensus.cc:1275] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 5 index: 2. Preceding OpId from leader: term: 7 index: 3. (index mismatch)
W20260709 12:10:43.545567 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 292512us
I20260709 12:10:43.279862 16980 raft_consensus.cc:697] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 5 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
W20260709 12:10:43.428952 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 254646us
I20260709 12:10:43.303851 14263 raft_consensus.cc:2468] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 8.
W20260709 12:10:43.780001 14875 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.811s	user 0.000s	sys 0.023s
I20260709 12:10:43.784571 14303 leader_election.cc:304] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:43.775295 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
W20260709 12:10:43.498689 17047 log.cc:927] Time spent T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.386s	user 0.001s	sys 0.000s
I20260709 12:10:43.777871 14304 leader_election.cc:304] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
W20260709 12:10:43.497339 16926 consensus_meta.cc:287] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.556s	user 0.010s	sys 0.001s
W20260709 12:10:43.780519 14230 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.614s	user 0.000s	sys 0.013s
I20260709 12:10:43.299547 17046 raft_consensus.cc:2804] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:10:43.834797 14230 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.668s	user 0.001s	sys 0.014s
W20260709 12:10:43.835243 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 765469us
I20260709 12:10:43.829918 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:43.747776 16911 raft_consensus.cc:2804] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:10:43.697391 17045 consensus_meta.cc:287] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.554s	user 0.012s	sys 0.006s
I20260709 12:10:43.627146 17022 leader_election.cc:290] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 6 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:43.496716 17052 raft_consensus.cc:493] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:43.303651 16814 leader_election.cc:290] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:43.701894 17061 raft_consensus.cc:493] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:43.702102 17059 raft_consensus.cc:493] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:43.833654 16965 raft_consensus.cc:493] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:43.933068 16625 raft_consensus.cc:493] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:43.932896 16965 raft_consensus.cc:515] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:43.933699 16625 raft_consensus.cc:515] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:43.880985 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:43.931856 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:43.939831 14334 raft_consensus.cc:2468] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 5.
W20260709 12:10:43.840564 14332 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.674s	user 0.011s	sys 0.017s
W20260709 12:10:43.951326 14332 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.785s	user 0.012s	sys 0.017s
W20260709 12:10:43.829576 16696 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.005s	sys 0.026s
I20260709 12:10:43.703405 17067 raft_consensus.cc:493] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
W20260709 12:10:43.832647 17038 consensus_meta.cc:287] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.841s	user 0.014s	sys 0.005s
W20260709 12:10:43.832381 16989 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.063s	user 0.020s	sys 0.018s
I20260709 12:10:43.881106 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:43.496907 17055 raft_consensus.cc:493] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:10:43.779940 16967 raft_consensus.cc:493] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:43.876797 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:43.423429 17053 raft_consensus.cc:697] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 6 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:10:43.931866 17059 raft_consensus.cc:515] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:43.882102 14230 leader_election.cc:304] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:43.841358 16911 raft_consensus.cc:493] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:43.358309 16737 raft_consensus.cc:515] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:43.840246 17046 raft_consensus.cc:493] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:43.438738 17043 consensus_queue.cc:1048] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.469s
I20260709 12:10:43.780565 16947 consensus_queue.cc:1059] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.143s
I20260709 12:10:44.289487 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:10:43.991861 16696 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.697s	user 0.006s	sys 0.026s
I20260709 12:10:43.937054 17045 raft_consensus.cc:493] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:43.497875 17054 consensus_queue.cc:1059] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.693s
I20260709 12:10:43.915716 17050 raft_consensus.cc:493] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
W20260709 12:10:43.992151 17044 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.004s	sys 0.020s
W20260709 12:10:44.062518 16832 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.604s	user 0.008s	sys 0.021s
I20260709 12:10:43.845554 16926 raft_consensus.cc:515] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:43.992223 14332 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50856 (request call id 1812) took 1092 ms. Trace:
W20260709 12:10:44.150087 17060 log.cc:927] Time spent T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.502s	user 0.002s	sys 0.000s
I20260709 12:10:43.992693 17011 raft_consensus.cc:2804] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:10:44.167824 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 390052us
W20260709 12:10:44.323246 14155 leader_election.cc:336] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Timed out: RequestConsensusVote RPC to 127.12.174.130:36673 timed out after 1.633s (SENT)
I20260709 12:10:44.323920 14155 leader_election.cc:304] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:44.168928 14259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53050 (request call id 472) took 1294 ms. Trace:
I20260709 12:10:44.190235 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:44.326583 14335 raft_consensus.cc:2468] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 10.
W20260709 12:10:44.172343 16989 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.458s	user 0.020s	sys 0.026s
W20260709 12:10:44.330803 14303 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.005s	sys 0.017s
W20260709 12:10:44.272993 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 369913us
W20260709 12:10:44.331434 14303 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.503s	user 0.005s	sys 0.017s
I20260709 12:10:44.331905 14876 leader_election.cc:304] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:44.155259 14905 raft_consensus.cc:1275] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:44.291898 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
W20260709 12:10:44.173970 16831 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.744s	user 0.023s	sys 0.025s
I20260709 12:10:44.065436 17038 raft_consensus.cc:515] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:44.292505 17046 raft_consensus.cc:3060] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:44.325604 14189 raft_consensus.cc:1240] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:44.379710 14189 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56046 (request call id 1938) took 1089 ms. Trace:
W20260709 12:10:44.310110 17044 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.873s	user 0.005s	sys 0.021s
I20260709 12:10:44.316262 17045 raft_consensus.cc:515] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:44.290315 16911 raft_consensus.cc:3060] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:44.065693 17067 raft_consensus.cc:515] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:10:44.310494 16832 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.861s	user 0.008s	sys 0.021s
I20260709 12:10:43.914537 17052 raft_consensus.cc:515] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:10:44.310240 17033 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.781s	user 0.004s	sys 0.009s
I20260709 12:10:43.991017 17061 raft_consensus.cc:515] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } }
I20260709 12:10:44.359676 14339 raft_consensus.cc:1240] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 7. Current term is 8. Ops: []
W20260709 12:10:44.371793 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 59300.4us
I20260709 12:10:44.323313 16625 leader_election.cc:290] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:10:44.350822 16831 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.956s	user 0.024s	sys 0.026s
I20260709 12:10:44.294106 16967 raft_consensus.cc:515] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:10:44.374210 14153 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.607s	user 0.017s	sys 0.009s
I20260709 12:10:44.346488 16989 raft_consensus.cc:697] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 6 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:10:44.447265 17051 raft_consensus.cc:993] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c: : Instructing follower 885067a0d31741bfb5c9935788e315bf to start an election
I20260709 12:10:44.447429 16989 consensus_queue.cc:237] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:44.264120 16965 leader_election.cc:290] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:10:44.449975 17065 log.cc:927] Time spent T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.673s	user 0.001s	sys 0.000s
I20260709 12:10:44.450315 17043 raft_consensus.cc:493] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:44.317786 14332 rpcz_store.cc:276] 0709 12:10:42.859691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:42.859953 (+   262us) service_pool.cc:224] Handling call
0709 12:10:42.872793 (+ 12840us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:42.873062 (+   269us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:10:43.166195 (+293133us) spinlock_profiling.cc:243] Waited 3.68 ms on lock 0x7b18004331e0. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f212cf16ab1 00007f212cf23281 00007f2126ce34bc 00007f212403148b 00007f212ce8b9a9 00007f212404d69b 00007f212404b93f 00007f212404b455 00007f212ab333c7 00007f21271459a7 00007f21271550bf
0709 12:10:43.166346 (+   151us) log.cc:844] Serialized 14 byte log entry
0709 12:10:43.952017 (+785671us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:43.952089 (+    72us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:43.952144 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:43.952236 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:43.952396 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12191,"prepare.queue_time_us":29467,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":50,"spinlock_wait_cycles":8458496,"thread_start_us":825786,"threads_started":2}
I20260709 12:10:44.450870 16926 leader_election.cc:290] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 8 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:10:44.372339 16602 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.939s	user 0.023s	sys 0.067s
W20260709 12:10:44.451692 16602 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.022s	user 0.024s	sys 0.067s
I20260709 12:10:44.226943 14331 raft_consensus.cc:1275] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:10:44.452399 14258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41764 (request call id 2248) took 1327 ms. Trace:
I20260709 12:10:44.360466 16910 raft_consensus.cc:2804] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:44.381453 14182 raft_consensus.cc:1240] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:10:44.355109 17022 raft_consensus.cc:493] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:44.327531 14259 rpcz_store.cc:276] 0709 12:10:42.874501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:42.874665 (+   164us) service_pool.cc:224] Handling call
0709 12:10:42.878317 (+  3652us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:42.878757 (+   440us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:42.878786 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:42.879876 (+  1090us) log.cc:844] Serialized 508 byte log entry
0709 12:10:42.904580 (+ 24704us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:42.979006 (+ 74426us) log.cc:844] Serialized 14 byte log entry
0709 12:10:43.097274 (+118268us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:43.097366 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:44.168679 (+1071313us) raft_consensus.cc:1685] finished
0709 12:10:44.168700 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:44.168862 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4544,"raft.queue_time_us":12067,"spinlock_wait_cycles":6471424,"thread_start_us":134291,"threads_started":2,"wal-append.queue_time_us":110361}
W20260709 12:10:44.415509 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 533484us
I20260709 12:10:44.407424 14189 rpcz_store.cc:276] 0709 12:10:43.290617 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:43.449097 (+158480us) service_pool.cc:224] Handling call
0709 12:10:44.325110 (+876013us) spinlock_profiling.cc:243] Waited 2.05 ms on lock 0x7b5800001298. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2124016b71 00007f2124016a22 00007f212cf2f8d9 00007f212c089ee0 00007f212c1530ab 00007f212c153131 00007f212c114fc0 00007f212c0ff929 00007f212c0ff3d2 00007f2125676bd4
0709 12:10:44.325384 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:44.379390 (+ 54006us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:44.379617 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4716416}
I20260709 12:10:44.251891 16980 consensus_queue.cc:237] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:44.285036 17055 raft_consensus.cc:515] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:44.379082 16969 raft_consensus.cc:493] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:44.383488 14905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53200 (request call id 442) took 1085 ms. Trace:
I20260709 12:10:44.406421 17056 raft_consensus.cc:493] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:44.453068 14258 rpcz_store.cc:276] 0709 12:10:43.125440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:43.126604 (+  1164us) service_pool.cc:224] Handling call
0709 12:10:43.126930 (+   326us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:43.127306 (+   376us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:43.127333 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:43.127865 (+   532us) log.cc:844] Serialized 26 byte log entry
0709 12:10:43.273232 (+145367us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:43.273271 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:43.273341 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:44.452166 (+1178825us) raft_consensus.cc:1685] finished
0709 12:10:44.452186 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:44.452328 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":66112,"raft.queue_time_us":47316,"raft.run_cpu_time_us":451,"raft.run_wall_time_us":5856,"spinlock_wait_cycles":1484160,"thread_start_us":144876,"threads_started":1,"wal-append.queue_time_us":344568}
I20260709 12:10:44.322026 17050 raft_consensus.cc:515] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:10:44.437565 14155 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.174.130:36673 timed out after 1.678s (SENT) [suppressed 8 similar messages]
W20260709 12:10:44.444310 14153 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.176s	user 0.018s	sys 0.009s
W20260709 12:10:44.445636 17063 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.004s	sys 0.018s
W20260709 12:10:44.446317 16785 consensus_meta.cc:287] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 1.799s	user 0.014s	sys 0.001s
I20260709 12:10:44.451275 16967 leader_election.cc:290] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:10:44.432381 17033 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 1.458s	user 0.005s	sys 0.014s
I20260709 12:10:44.456182 16696 raft_consensus.cc:2804] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:44.421913 17074 raft_consensus.cc:493] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:44.470654 14905 rpcz_store.cc:276] 0709 12:10:43.290724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:43.290890 (+   166us) service_pool.cc:224] Handling call
0709 12:10:43.912900 (+622010us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:44.345890 (+432990us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:44.376089 (+ 30199us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:43.220060 16750 rpcz_store.cc:276] 0709 12:10:41.503953 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:41.511852 (+  7899us) service_pool.cc:224] Handling call
0709 12:10:41.682691 (+170839us) log.cc:844] Serialized 508 byte log entry
0709 12:10:42.194699 (+512008us) spinlock_profiling.cc:243] Waited 11.8 ms on lock 0x7b4c00255840. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2125407a20 00007f2125418a29 00007f212541913f 00007f21253dd2ab 00007f212540af3c 00007f212540b3fe 00007f212569850b 00007f2127097381 00007f212709526b 00007f212709bd53 00007f212709bcd9
0709 12:10:43.122561 (+927862us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":42953,"raft.queue_time_us":20076,"raft.run_cpu_time_us":3181,"raft.run_wall_time_us":314410,"spinlock_wait_cycles":27217920,"thread_start_us":198644,"threads_started":1,"wal-append.queue_time_us":253566,"wal-append.run_cpu_time_us":1808,"wal-append.run_wall_time_us":1003301}
I20260709 12:10:44.452412 17092 raft_consensus.cc:493] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:44.466305 17094 raft_consensus.cc:493] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:44.466504 17096 raft_consensus.cc:493] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:44.466843 17081 raft_consensus.cc:493] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:44.466787 17061 leader_election.cc:290] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:44.467808 17077 raft_consensus.cc:2749] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:44.425298 17062 raft_consensus.cc:493] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:44.549010 17095 raft_consensus.cc:493] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:44.452863 17082 raft_consensus.cc:493] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:44.453369 17076 raft_consensus.cc:2804] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:44.617954 17081 raft_consensus.cc:515] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:44.549930 16831 consensus_queue.cc:1059] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:44.550622 17069 raft_consensus.cc:493] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:44.471843 16965 raft_consensus.cc:2804] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:10:44.551589 16934 consensus_meta.cc:287] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 1.624s	user 0.012s	sys 0.000s
I20260709 12:10:44.551105 17056 raft_consensus.cc:515] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } }
I20260709 12:10:44.549970 17011 raft_consensus.cc:493] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:10:44.552203 17089 raft_consensus.cc:493] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:44.623704 17011 raft_consensus.cc:3060] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:44.621486 17095 raft_consensus.cc:515] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:44.623795 17089 raft_consensus.cc:515] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:44.624783 17069 raft_consensus.cc:515] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:44.625622 16934 raft_consensus.cc:515] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:44.537184 16969 raft_consensus.cc:515] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:44.467742 16939 raft_consensus.cc:493] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:44.584134 17093 raft_consensus.cc:493] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:44.629791 16939 raft_consensus.cc:515] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:44.629868 17093 raft_consensus.cc:515] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:44.584180 17087 raft_consensus.cc:493] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:44.450891 17043 raft_consensus.cc:515] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:44.459328 17017 raft_consensus.cc:493] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:44.455987 16910 raft_consensus.cc:493] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:44.455410 17078 raft_consensus.cc:493] T f4739bc22bfe44fcba807da02d9351b6 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
W20260709 12:10:44.537220 17063 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.831s	user 0.005s	sys 0.018s
W20260709 12:10:44.452580 17071 log.cc:927] Time spent T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.169s	user 0.000s	sys 0.001s
W20260709 12:10:44.591351 14305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:44.550819 17052 leader_election.cc:290] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:44.462881 17022 raft_consensus.cc:515] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:44.553175 17038 leader_election.cc:290] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 4 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:44.627226 16965 raft_consensus.cc:697] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 8 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:10:44.627800 17089 leader_election.cc:290] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:44.627655 17082 raft_consensus.cc:515] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:44.591470 16967 raft_consensus.cc:493] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:10:44.547777 16785 raft_consensus.cc:515] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:44.604231 17074 raft_consensus.cc:515] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:45.327996 14189 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56652 (request call id 619) took 1540 ms. Trace:
I20260709 12:10:45.331496 14257 raft_consensus.cc:1240] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:45.331490 14189 rpcz_store.cc:276] 0709 12:10:43.787166 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:45.327130 (+1539964us) service_pool.cc:224] Handling call
0709 12:10:45.327496 (+   366us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:45.327684 (+   188us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:45.327709 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:45.327748 (+    39us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:45.327777 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:45.327826 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:45.327929 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:45.333118 14257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41764 (request call id 2249) took 2190 ms. Trace:
W20260709 12:10:44.957854 17051 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.021s	sys 0.037s
I20260709 12:10:44.609529 17018 raft_consensus.cc:1081] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 6 LEADER]: Signalling peer 885067a0d31741bfb5c9935788e315bf to start an election
W20260709 12:10:45.233700 16980 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.647s	user 0.024s	sys 0.062s
I20260709 12:10:45.333535 14257 rpcz_store.cc:276] 0709 12:10:43.142452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:43.142645 (+   193us) service_pool.cc:224] Handling call
0709 12:10:43.143024 (+   379us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:45.332270 (+2189246us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:45.332849 (+   579us) spinlock_profiling.cc:243] Waited 2.19 s on lock 0x7b54001b1cd4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:10:45.333021 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5032585472}
W20260709 12:10:44.682614 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:45.108144 17061 raft_consensus.cc:493] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:45.331143 17087 raft_consensus.cc:515] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:44.976241 17091 raft_consensus.cc:493] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:45.360432 14182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56046 (request call id 1936) took 2039 ms. Trace:
I20260709 12:10:45.361986 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:45.380398 17052 raft_consensus.cc:493] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:44.613546 17092 raft_consensus.cc:515] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:45.381104 16933 leader_election.cc:290] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:45.381786 16933 raft_consensus.cc:493] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:45.331538 17017 raft_consensus.cc:515] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:45.380879 17084 raft_consensus.cc:3055] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:10:44.898597 14875 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.995s	user 0.010s	sys 0.013s
I20260709 12:10:44.987412 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:45.379031 14182 rpcz_store.cc:276] 0709 12:10:43.289502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:43.289623 (+   121us) service_pool.cc:224] Handling call
0709 12:10:43.289954 (+   331us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:44.456099 (+1166145us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:45.328897 (+872798us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b54003e7e54. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:10:45.329148 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2509663488}
I20260709 12:10:45.341215 14339 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50856 (request call id 1813) took 2470 ms. Trace:
W20260709 12:10:44.829610 14877 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.390s	user 0.000s	sys 0.019s
W20260709 12:10:44.913568 14304 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.587s	user 0.004s	sys 0.020s
W20260709 12:10:45.403362 14875 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.500s	user 0.026s	sys 0.025s
W20260709 12:10:44.854982 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 417425us
W20260709 12:10:45.321521 14229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:45.112057 16832 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.652s	user 0.009s	sys 0.013s
W20260709 12:10:45.406126 14304 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.080s	user 0.004s	sys 0.046s
W20260709 12:10:45.334504 17051 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.887s	user 0.051s	sys 0.061s
I20260709 12:10:45.415107 14184 raft_consensus.cc:2393] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 5: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
W20260709 12:10:45.323343 14153 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.006s	sys 0.012s
W20260709 12:10:45.405833 14877 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.967s	user 0.019s	sys 0.031s
W20260709 12:10:45.175160 14183 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.532s	user 0.007s	sys 0.007s
I20260709 12:10:45.357599 14188 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56652 (request call id 616) took 2060 ms. Trace:
I20260709 12:10:45.333122 16910 raft_consensus.cc:3060] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:45.356755 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:10:45.410396 14155 leader_election.cc:336] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Timed out: RequestConsensusVote RPC to 127.12.174.130:36673 timed out after 1.815s (SENT)
W20260709 12:10:45.180905 14302 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.004s	sys 0.017s
I20260709 12:10:45.319638 14186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56652 (request call id 618) took 2021 ms. Trace:
W20260709 12:10:45.413686 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 1.08794e+06us
W20260709 12:10:44.969379 14303 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:45.468472 14302 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.123s	user 0.004s	sys 0.020s
I20260709 12:10:45.385764 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:10:45.320493 16911 consensus_meta.cc:287] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.878s	user 0.015s	sys 0.000s
W20260709 12:10:45.335326 16980 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.749s	user 0.039s	sys 0.062s
I20260709 12:10:45.427512 14183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56046 (request call id 1940) took 2133 ms. Trace:
I20260709 12:10:45.405773 14339 rpcz_store.cc:276] 0709 12:10:42.870393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:42.870673 (+   280us) service_pool.cc:224] Handling call
0709 12:10:42.876305 (+  5632us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:44.437230 (+1560925us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:45.340855 (+903625us) spinlock_profiling.cc:243] Waited 1.48 s on lock 0x7b54002a6554. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:10:45.341076 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3410328448}
I20260709 12:10:45.426385 14188 rpcz_store.cc:276] 0709 12:10:43.296904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:43.882237 (+585333us) service_pool.cc:224] Handling call
0709 12:10:43.969249 (+ 87012us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:44.445178 (+475929us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:44.445218 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:44.445264 (+    46us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:44.445297 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:45.357243 (+911946us) spinlock_profiling.cc:243] Waited 476 ms on lock 0x7b54003b2c54. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:10:45.357298 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:45.357481 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1093915520}
I20260709 12:10:45.473213 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:45.466495 14877 leader_election.cc:304] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 65c9c1653b3346b39a0e118540e6080c
W20260709 12:10:45.459409 14230 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.602s	user 0.010s	sys 0.006s
W20260709 12:10:45.480572 14230 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.623s	user 0.010s	sys 0.006s
I20260709 12:10:45.361486 17067 leader_election.cc:290] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:10:45.129832 16813 consensus_meta.cc:287] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 2.207s	user 0.014s	sys 0.000s
W20260709 12:10:45.365687 17035 consensus_meta.cc:287] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 2.383s	user 0.015s	sys 0.001s
I20260709 12:10:45.250770 17085 raft_consensus.cc:3055] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:10:45.155260 16923 consensus_meta.cc:287] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 2.254s	user 0.015s	sys 0.000s
I20260709 12:10:44.623672 17076 raft_consensus.cc:493] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
W20260709 12:10:44.702015 14878 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.354s	user 0.008s	sys 0.008s
I20260709 12:10:45.189572 17013 raft_consensus.cc:493] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:45.467285 14186 rpcz_store.cc:276] 0709 12:10:43.298133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:44.617027 (+1318894us) service_pool.cc:224] Handling call
0709 12:10:45.319049 (+702022us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:45.319272 (+   223us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:45.319300 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:45.319342 (+    42us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:45.319372 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:45.319431 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:45.319572 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:45.514694 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:45.519064 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:10:45.252009 17083 log.cc:927] Time spent T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.201s	user 0.000s	sys 0.001s
I20260709 12:10:45.376628 17056 leader_election.cc:290] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:10:45.414949 14181 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56046 (request call id 1935) took 2127 ms (client timeout 1922 ms). Trace:
I20260709 12:10:45.472818 14338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50858 (request call id 1503) took 1371 ms. Trace:
W20260709 12:10:44.969552 16821 consensus_meta.cc:287] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 2.109s	user 0.009s	sys 0.006s
I20260709 12:10:45.525627 14338 rpcz_store.cc:276] 0709 12:10:44.101296 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:44.101469 (+   173us) service_pool.cc:224] Handling call
0709 12:10:45.385523 (+1284054us) spinlock_profiling.cc:243] Waited 4.7 ms on lock 0x7b5800065d98. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2124016b71 00007f2124016a22 00007f212cf2f8d9 00007f212c089ee0 00007f212c1530ab 00007f212c153131 00007f212c1010a0 00007f212c100984 00007f212567b6d4 00007f212567b662
0709 12:10:45.472738 (+ 87215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10812800}
I20260709 12:10:44.950057 17044 raft_consensus.cc:1064] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c: attempting to promote NON_VOTER 73d01e9b1a9d49358da4985b21d681db to VOTER
I20260709 12:10:45.485303 14155 leader_election.cc:304] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:45.502569 17041 raft_consensus.cc:2804] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:45.359483 17081 leader_election.cc:290] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:45.474502 14183 rpcz_store.cc:276] 0709 12:10:43.294372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:43.879324 (+584952us) service_pool.cc:224] Handling call
0709 12:10:44.155316 (+275992us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:44.155738 (+   422us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:10:44.642745 (+487007us) log.cc:844] Serialized 14 byte log entry
0709 12:10:45.427067 (+784322us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:45.427134 (+    67us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:45.427190 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:45.427271 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:45.427440 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":1143932,"threads_started":2}
I20260709 12:10:44.631744 17045 leader_election.cc:290] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:45.382658 17084 raft_consensus.cc:740] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:44.914680 17077 raft_consensus.cc:493] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:45.344177 16934 leader_election.cc:290] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 7 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:44.976608 17097 raft_consensus.cc:493] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:45.319396 16989 raft_consensus.cc:493] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:44.619686 17014 raft_consensus.cc:493] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:45.318329 16737 leader_election.cc:290] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:45.416659 17117 raft_consensus.cc:493] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:44.768815 14073 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f4739bc22bfe44fcba807da02d9351b6 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 12)
I20260709 12:10:45.321985 17050 leader_election.cc:290] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:44.640652 17059 leader_election.cc:290] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:10:45.465723 16832 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.970s	user 0.010s	sys 0.019s
I20260709 12:10:45.411639 17061 raft_consensus.cc:515] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:44.979880 17070 raft_consensus.cc:493] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:45.382333 16933 raft_consensus.cc:515] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:45.333243 17069 leader_election.cc:290] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:44.878885 17055 leader_election.cc:290] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:10:45.515492 14878 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.168s	user 0.010s	sys 0.020s
W20260709 12:10:45.426653 14153 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.658s	user 0.007s	sys 0.012s
I20260709 12:10:45.322526 16969 leader_election.cc:290] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:45.333280 17043 leader_election.cc:290] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:45.516877 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:45.354329 17095 leader_election.cc:290] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:45.324175 17118 raft_consensus.cc:493] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:10:45.404809 16967 raft_consensus.cc:515] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:44.976468 17034 consensus_queue.cc:1048] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.703s
I20260709 12:10:45.420904 17112 raft_consensus.cc:493] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:45.381032 17052 raft_consensus.cc:515] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:45.523422 14339 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f"
dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
mode: GRACEFUL
new_leader_uuid: "17aab1bbf5014936aa18cc21818b26ec"
 from {username='slave'} at 127.0.0.1:50896
I20260709 12:10:44.610559 17053 consensus_queue.cc:237] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:45.516944 17076 raft_consensus.cc:3060] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:45.521572 14906 raft_consensus.cc:1275] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:10:45.485998 17038 raft_consensus.cc:493] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:45.529608 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:45.530467 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:44.633708 17011 raft_consensus.cc:515] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:44.624498 16831 consensus_queue.cc:1048] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.880s
W20260709 12:10:45.525461 14181 rpcz_store.cc:269] 0709 12:10:43.282077 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:43.282224 (+   147us) service_pool.cc:224] Handling call
0709 12:10:44.987207 (+1704983us) spinlock_profiling.cc:243] Waited 19.4 ms on lock 0x7b5800001298. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2124016b71 00007f2124016a22 00007f212cf2f8d9 00007f212c089ee0 00007f212c1530ab 00007f212c153131 00007f212c1010a0 00007f212c100984 00007f212567b6d4 00007f212567b662
0709 12:10:45.409765 (+422558us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":44704640}
I20260709 12:10:44.986466 16947 raft_consensus.cc:493] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:45.541925 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:45.543735 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:45.549017 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:45.571759 14907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
W20260709 12:10:45.571208 14228 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.679s	user 0.000s	sys 0.020s
I20260709 12:10:45.513470 17085 raft_consensus.cc:740] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:10:45.509552 16813 raft_consensus.cc:515] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:45.543100 16821 raft_consensus.cc:515] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:44.614971 17096 raft_consensus.cc:515] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:10:45.586609 14184 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56046 (request call id 1937) took 2296 ms (client timeout 2153 ms). Trace:
W20260709 12:10:45.648289 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 127544us
I20260709 12:10:45.384922 17091 raft_consensus.cc:515] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:45.537825 17108 raft_consensus.cc:493] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:45.489303 16911 raft_consensus.cc:515] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:45.647415 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
W20260709 12:10:45.646333 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 235972us
I20260709 12:10:44.770543 17094 raft_consensus.cc:515] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:45.544404 17067 raft_consensus.cc:2749] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 5 LEADER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:44.631942 17062 raft_consensus.cc:515] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:45.579187 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:45.514838 17035 raft_consensus.cc:515] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:45.663275 16934 raft_consensus.cc:493] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
W20260709 12:10:45.664037 17116 log.cc:927] Time spent T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
I20260709 12:10:45.546942 17074 leader_election.cc:290] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:45.413913 17078 raft_consensus.cc:515] T f4739bc22bfe44fcba807da02d9351b6 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:45.516645 16923 raft_consensus.cc:515] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:10:45.656183 17123 log.cc:927] Time spent T 00000000000000000000000000000000 P d07070be2c074f4cb9ad35f1580c4ef7: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 12:10:45.671775 14182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56652 (request call id 621) took 1842 ms. Trace:
I20260709 12:10:45.581607 16939 leader_election.cc:290] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:45.586091 17082 leader_election.cc:290] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:45.684633 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:45.659255 17041 raft_consensus.cc:697] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 6 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:10:45.689167 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:45.689396 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:45.662547 17018 raft_consensus.cc:493] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:45.695571 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:45.531787 17013 raft_consensus.cc:515] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:10:45.690635 14073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 921915us
I20260709 12:10:45.690062 17051 raft_consensus.cc:493] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:10:45.665000 17045 raft_consensus.cc:493] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:45.667989 17117 raft_consensus.cc:515] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:45.649597 17097 raft_consensus.cc:515] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:45.664687 16965 consensus_queue.cc:237] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:45.645761 17077 raft_consensus.cc:515] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:10:46.022348 14230 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.027s	sys 0.031s
W20260709 12:10:45.801707 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 72691.1us
I20260709 12:10:45.709861 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:45.800433 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:10:45.891458 14305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:45.903157 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:45.782766 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:46.077190 14188 raft_consensus.cc:2468] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 7.
I20260709 12:10:45.712031 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:45.711127 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
W20260709 12:10:46.070974 14230 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.590s	user 0.027s	sys 0.032s
I20260709 12:10:46.071834 14339 raft_consensus.cc:606] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 4 LEADER]: Received request to transfer leadership to TS 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:10:46.078313 14264 raft_consensus.cc:3060] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:46.004518 14302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:46.072963 14907 raft_consensus.cc:2468] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 6.
W20260709 12:10:46.072417 14155 leader_election.cc:336] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Timed out: RequestConsensusVote RPC to 127.12.174.130:36673 timed out after 1.901s (SENT)
W20260709 12:10:46.073439 14228 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.658s	user 0.003s	sys 0.025s
I20260709 12:10:46.077543 14187 raft_consensus.cc:2468] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 6.
W20260709 12:10:46.057194 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 54543.2us
W20260709 12:10:46.076155 14184 rpcz_store.cc:269] 0709 12:10:43.290152 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:43.290316 (+   164us) service_pool.cc:224] Handling call
0709 12:10:45.361803 (+2071487us) spinlock_profiling.cc:243] Waited 16.1 ms on lock 0x7b5800001298. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2124016b71 00007f2124016a22 00007f212cf2f8d9 00007f212c089ee0 00007f212c1530ab 00007f212c153131 00007f212c1010a0 00007f212c100984 00007f212567b6d4 00007f212567b662
0709 12:10:45.586354 (+224551us) spinlock_profiling.cc:243] Waited 34.3 ms on lock 0x7b54001117d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:10:45.586526 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":115828352}
I20260709 12:10:45.670979 17050 raft_consensus.cc:493] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:46.081784 14302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:46.070420 14182 rpcz_store.cc:276] 0709 12:10:43.829392 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:45.413229 (+1583837us) service_pool.cc:224] Handling call
0709 12:10:45.487109 (+ 73880us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:45.487357 (+   248us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:10:45.578273 (+ 90916us) log.cc:844] Serialized 14 byte log entry
0709 12:10:45.671388 (+ 93115us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:45.671451 (+    63us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:10:45.671503 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:45.671579 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:45.671710 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17710,"prepare.queue_time_us":85122,"prepare.run_cpu_time_us":8945,"prepare.run_wall_time_us":73999,"raft.queue_time_us":1840,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":12640,"thread_start_us":145953,"threads_started":2,"wal-append.queue_time_us":377290}
I20260709 12:10:46.096184 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:46.099615 14155 leader_election.cc:304] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:46.103467 17082 raft_consensus.cc:2749] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:10:45.898097 17119 log.cc:927] Time spent T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.273s	user 0.001s	sys 0.000s
W20260709 12:10:45.810971 17046 consensus_meta.cc:287] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 1.434s	user 0.007s	sys 0.006s
W20260709 12:10:45.721272 17072 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.002s	sys 0.009s
I20260709 12:10:46.116426 14187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56652 (request call id 623) took 1499 ms. Trace:
I20260709 12:10:45.833413 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:46.117540 14333 raft_consensus.cc:2368] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 6. Current term is 7.
I20260709 12:10:45.862078 17089 raft_consensus.cc:493] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:45.832593 14905 raft_consensus.cc:1275] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:10:46.122273 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:45.843292 16933 leader_election.cc:290] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:45.880872 17022 leader_election.cc:290] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:46.180883 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:45.880857 17092 leader_election.cc:290] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:45.862108 17121 raft_consensus.cc:493] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:46.126474 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:45.809850 17107 raft_consensus.cc:493] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:10:46.123893 14185 raft_consensus.cc:2368] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 6. Current term is 7.
I20260709 12:10:45.897666 17061 leader_election.cc:290] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:46.159359 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:45.898612 16696 raft_consensus.cc:493] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:46.127104 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:46.160279 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:45.911159 16943 raft_consensus.cc:3060] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:46.163337 14262 raft_consensus.cc:2468] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 5.
I20260709 12:10:46.111923 17056 consensus_queue.cc:1048] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.107s
I20260709 12:10:46.096534 16814 raft_consensus.cc:493] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:45.839377 17063 raft_consensus.cc:493] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
W20260709 12:10:46.163620 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 44139us
I20260709 12:10:46.095753 16947 raft_consensus.cc:515] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } }
W20260709 12:10:46.266326 14086 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60410 (request call id 256) took 12629 ms (client timeout 15000 ms). Trace:
I20260709 12:10:46.123632 14330 raft_consensus.cc:1240] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:46.123082 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:46.172633 14188 raft_consensus.cc:3060] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:46.124176 14334 raft_consensus.cc:2368] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db for earlier term 6. Current term is 7.
I20260709 12:10:45.781132 17125 raft_consensus.cc:493] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:46.271623 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:45.866060 16602 raft_consensus.cc:493] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:45.671984 16989 raft_consensus.cc:515] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:10:46.179124 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 106745us
I20260709 12:10:46.161458 14187 rpcz_store.cc:276] 0709 12:10:44.616747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:46.082776 (+1466029us) service_pool.cc:224] Handling call
0709 12:10:46.115831 (+ 33055us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:46.116063 (+   232us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:46.116094 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:46.116141 (+    47us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:46.116175 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:46.116228 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:46.116355 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:45.781546 17081 raft_consensus.cc:493] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:46.180050 14189 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56652 (request call id 620) took 2392 ms. Trace:
I20260709 12:10:45.895784 17093 leader_election.cc:290] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:46.259750 16696 raft_consensus.cc:3060] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:45.912619 17087 leader_election.cc:290] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:45.699131 17014 raft_consensus.cc:515] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:46.203876 14190 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56652 (request call id 617) took 2906 ms. Trace:
I20260709 12:10:45.818172 17095 consensus_queue.cc:1048] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.343s
I20260709 12:10:46.183544 14183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56652 (request call id 622) took 2305 ms. Trace:
I20260709 12:10:46.295524 14183 rpcz_store.cc:276] 0709 12:10:43.878651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:45.570720 (+1692069us) service_pool.cc:224] Handling call
0709 12:10:45.651719 (+ 80999us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:46.121100 (+469381us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:46.121138 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:46.121207 (+    69us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:46.121240 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:46.183280 (+ 62040us) spinlock_profiling.cc:243] Waited 469 ms on lock 0x7b5400321ed4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:10:46.183331 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:46.183476 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1078875008}
I20260709 12:10:45.771983 17059 raft_consensus.cc:493] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
W20260709 12:10:46.208825 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 44192.2us
I20260709 12:10:46.200732 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:46.208729 14907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:46.181881 16939 raft_consensus.cc:493] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:46.212956 17127 raft_consensus.cc:493] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:46.213438 16737 raft_consensus.cc:493] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:10:46.213706 16967 leader_election.cc:290] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:46.214936 17126 consensus_queue.cc:1048] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.118s
I20260709 12:10:46.123202 17067 raft_consensus.cc:493] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:46.215137 14333 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50856 (request call id 1811) took 3362 ms (client timeout 3361 ms). Trace:
I20260709 12:10:46.215076 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:46.222640 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:10:46.173549 17072 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.024s	user 0.004s	sys 0.016s
I20260709 12:10:45.714112 16785 leader_election.cc:290] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:46.259621 14265 raft_consensus.cc:2468] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 5.
I20260709 12:10:46.109123 17050 raft_consensus.cc:515] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:46.177413 17074 raft_consensus.cc:493] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:46.267580 17121 raft_consensus.cc:515] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:46.311491 17059 raft_consensus.cc:515] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:46.095952 17038 raft_consensus.cc:515] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:46.326094 14263 raft_consensus.cc:2410] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:10:46.098140 17045 raft_consensus.cc:515] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:46.326650 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:46.100941 17108 raft_consensus.cc:515] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:46.096836 16934 raft_consensus.cc:515] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:46.176554 17089 raft_consensus.cc:515] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:46.182049 16969 raft_consensus.cc:493] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:46.268503 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:46.275552 14189 rpcz_store.cc:276] 0709 12:10:43.787373 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:45.333213 (+1545840us) service_pool.cc:224] Handling call
0709 12:10:45.333587 (+   374us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:46.118302 (+784715us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:46.118332 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:46.118374 (+    42us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:46.118404 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:46.179746 (+ 61342us) spinlock_profiling.cc:243] Waited 784 ms on lock 0x7b5400422054. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:10:46.179806 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:46.179976 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1804262656}
I20260709 12:10:46.271515 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:45.939266 17017 leader_election.cc:290] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:46.095667 17051 raft_consensus.cc:515] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:46.291316 16544 consensus_queue.cc:1059] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.051s
W20260709 12:10:46.280447 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 104421us
I20260709 12:10:46.282419 16923 leader_election.cc:290] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 7 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:10:46.353832 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 144388us
I20260709 12:10:45.899379 17044 consensus_queue.cc:237] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 3, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:45.691720 17070 raft_consensus.cc:515] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:46.291934 14190 rpcz_store.cc:276] 0709 12:10:43.297863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:44.550977 (+1253114us) service_pool.cc:224] Handling call
0709 12:10:44.551334 (+   357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:46.123702 (+1572368us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:46.123739 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:46.123780 (+    41us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:46.123811 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:46.203603 (+ 79792us) spinlock_profiling.cc:243] Waited 1.57 s on lock 0x7b540035b454. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:10:46.203654 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:46.203799 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3615664384}
I20260709 12:10:46.225332 16832 consensus_queue.cc:1048] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 12:10:46.299865 14260 raft_consensus.cc:3060] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:46.366596 14331 raft_consensus.cc:1275] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:46.179824 17046 raft_consensus.cc:515] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:46.315881 16737 raft_consensus.cc:515] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:46.316920 14258 raft_consensus.cc:2468] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 6.
I20260709 12:10:46.279385 17063 raft_consensus.cc:515] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:10:46.316310 14333 rpcz_store.cc:269] 0709 12:10:42.852295 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:42.852570 (+   275us) service_pool.cc:224] Handling call
0709 12:10:46.214872 (+3362302us) spinlock_profiling.cc:243] Waited 3.26 s on lock 0x7b54002a5b54. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:10:46.215015 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7498694016}
I20260709 12:10:46.322481 17067 raft_consensus.cc:515] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:46.322554 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:46.324640 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:46.307140 16831 raft_consensus.cc:3055] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:46.111219 17118 raft_consensus.cc:515] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:46.327278 14257 raft_consensus.cc:2468] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 3.
I20260709 12:10:46.095988 17018 raft_consensus.cc:515] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:46.271327 17125 raft_consensus.cc:515] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:46.280586 17081 raft_consensus.cc:515] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:10:46.342381 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 249427us
I20260709 12:10:46.344300 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:46.100798 17112 raft_consensus.cc:515] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:46.280365 16602 raft_consensus.cc:515] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:46.352185 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:10:46.354980 14303 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:46.352882 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:46.346477 16969 raft_consensus.cc:515] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:46.360723 17091 leader_election.cc:290] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:46.361325 17103 raft_consensus.cc:493] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:46.361922 17101 consensus_queue.cc:1048] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.265s
W20260709 12:10:46.362900 17131 log.cc:927] Time spent T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
I20260709 12:10:46.363653 17121 leader_election.cc:290] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:46.364141 17017 consensus_queue.cc:1059] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:10:46.364919 16910 consensus_meta.cc:287] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db: Time spent flushing consensus metadata: real 0.866s	user 0.011s	sys 0.000s
I20260709 12:10:46.365501 17013 leader_election.cc:290] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:46.325523 17074 raft_consensus.cc:515] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:10:46.266830 14086 rpcz_store.cc:269] 0709 12:10:33.584420 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:33.597906 (+ 13486us) service_pool.cc:224] Handling call
0709 12:10:46.209457 (+12611551us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:42.547826 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:42.548594 (+   768us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:42.548650 (+    56us) write_op.cc:435] Acquired schema lock
0709 12:10:42.548690 (+    40us) tablet.cc:662] Decoding operations
0709 12:10:42.550314 (+  1624us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:42.550403 (+    89us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:42.550432 (+    29us) tablet.cc:685] Acquiring locks for 16 operations
0709 12:10:42.551982 (+  1550us) tablet.cc:701] Row locks acquired
0709 12:10:42.552037 (+    55us) write_op.cc:260] PREPARE: finished
0709 12:10:42.552261 (+   224us) write_op.cc:270] Start()
0709 12:10:42.552455 (+   194us) write_op.cc:276] Timestamp: P: 1783599042552164 usec, L: 0
0709 12:10:42.552481 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 12:10:42.553327 (+   846us) log.cc:844] Serialized 6650 byte log entry
0709 12:10:42.887034 (+333707us) op_driver.cc:464] REPLICATION: finished
0709 12:10:44.957430 (+2070396us) write_op.cc:301] APPLY: starting
0709 12:10:44.968422 (+ 10992us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:45.252295 (+283873us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:45.252460 (+   165us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:45.254486 (+  2026us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:45.254884 (+   398us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=16
0709 12:10:45.255017 (+   133us) write_op.cc:312] APPLY: finished
0709 12:10:45.255515 (+   498us) log.cc:844] Serialized 113 byte log entry
0709 12:10:45.537393 (+281878us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:45.542934 (+  5541us) write_op.cc:454] Released schema lock
0709 12:10:45.578548 (+ 35614us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:45.579057 (+   509us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:45.579102 (+    45us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":37,"child_traces":[["op",{"apply.queue_time_us":1735673,"apply.run_cpu_time_us":27443,"apply.run_wall_time_us":701209,"num_ops":16,"prepare.queue_time_us":358199,"prepare.run_cpu_time_us":22290,"prepare.run_wall_time_us":116181,"raft.queue_time_us":230738,"raft.run_cpu_time_us":22837,"raft.run_wall_time_us":1697612,"replication_time_us":311373,"thread_start_us":2133112,"threads_started":5,"wal-append.queue_time_us":375927,"wal-append.run_cpu_time_us":54230,"wal-append.run_wall_time_us":1089133}]]}
I20260709 12:10:46.407369 17077 leader_election.cc:290] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:46.327252 17059 leader_election.cc:290] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:46.305313 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:46.316291 16939 raft_consensus.cc:515] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:10:46.355839 17130 log.cc:927] Time spent T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.299s	user 0.001s	sys 0.001s
I20260709 12:10:46.268834 17041 consensus_queue.cc:237] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:46.269110 16814 raft_consensus.cc:515] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:46.381707 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:46.416894 17097 leader_election.cc:290] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:46.381682 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:46.223596 17107 raft_consensus.cc:515] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:46.387867 14265 raft_consensus.cc:2468] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 8.
I20260709 12:10:46.437898 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:46.397233 14260 raft_consensus.cc:2468] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 6.
I20260709 12:10:46.370379 17011 leader_election.cc:290] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 7 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:46.405993 14188 raft_consensus.cc:2468] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 6.
I20260709 12:10:46.409672 14189 raft_consensus.cc:2393] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 4: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:10:46.385532 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:46.409596 14338 raft_consensus.cc:2410] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for term 7 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:10:46.381456 17038 leader_election.cc:290] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:46.333760 17127 raft_consensus.cc:515] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:46.411679 14186 raft_consensus.cc:2468] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 2.
I20260709 12:10:46.385346 16821 leader_election.cc:290] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 7 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:46.413594 14907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:46.451900 14907 raft_consensus.cc:2468] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 6.
I20260709 12:10:46.385705 16831 raft_consensus.cc:740] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
W20260709 12:10:46.415609 14229 connection.cc:256] RPC call timeout handler was delayed by -1.4464502309999716s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1869s for a response
I20260709 12:10:46.388547 17035 leader_election.cc:290] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 9 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:46.417192 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:46.425904 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:46.426119 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:46.407119 17117 leader_election.cc:290] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:46.426769 16910 raft_consensus.cc:515] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:46.432229 16737 leader_election.cc:290] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:46.384945 14183 raft_consensus.cc:3060] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:46.413053 17139 consensus_queue.cc:1059] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 12:10:46.448117 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:46.437302 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:46.428423 17103 raft_consensus.cc:515] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:10:46.490226 14302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:47.007304 14334 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55492 (request call id 435) took 1436 ms (client timeout 1500 ms). Trace:
I20260709 12:10:47.115195 14184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56652 (request call id 624) took 2495 ms. Trace:
I20260709 12:10:47.036258 14265 raft_consensus.cc:1240] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:47.021548 14331 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50858 (request call id 1507) took 1612 ms. Trace:
W20260709 12:10:47.291240 14229 connection.cc:256] RPC call timeout handler was delayed by -1.3987502309998945s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1922s for a response
W20260709 12:10:47.291724 14229 connection.cc:256] RPC call timeout handler was delayed by -1.1908502310000131s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21530000000000002s for a response
W20260709 12:10:47.289188 14334 rpcz_store.cc:269] 0709 12:10:45.570893 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:45.572583 (+  1690us) service_pool.cc:224] Handling call
0709 12:10:47.006983 (+1434400us) spinlock_profiling.cc:243] Waited 52.2 ms on lock 0x7b5400019d54. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:10:47.007211 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":119949184}
I20260709 12:10:47.107424 14336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 442) took 1387 ms. Trace:
I20260709 12:10:47.036891 14263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41768 (request call id 1496) took 1342 ms. Trace:
W20260709 12:10:46.957835 14185 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56046 (request call id 1931) took 3678 ms (client timeout 1869 ms). Trace:
I20260709 12:10:47.290675 14331 rpcz_store.cc:276] 0709 12:10:45.409060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:45.409189 (+   129us) service_pool.cc:224] Handling call
0709 12:10:45.472667 (+ 63478us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:46.366967 (+894300us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:47.021258 (+654291us) spinlock_profiling.cc:243] Waited 894 ms on lock 0x7b5400145854. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:10:47.021468 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2055056640}
W20260709 12:10:47.292101 14229 connection.cc:256] RPC call timeout handler was delayed by -1.1598943110000164s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
I20260709 12:10:46.484854 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:47.287607 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:10:46.511375 14305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:46.514946 17128 log.cc:927] Time spent T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.133s	user 0.000s	sys 0.000s
I20260709 12:10:46.454032 14190 raft_consensus.cc:1240] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 4. Current term is 5. Ops: [4.3-4.3]
W20260709 12:10:47.036119 14260 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41768 (request call id 1499) took 1340 ms (client timeout 1607 ms). Trace:
I20260709 12:10:47.020172 14186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56044 (request call id 2209) took 1526 ms. Trace:
I20260709 12:10:46.530578 14264 raft_consensus.cc:2468] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 5.
I20260709 12:10:47.298453 14184 rpcz_store.cc:276] 0709 12:10:44.619629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:46.171717 (+1552088us) service_pool.cc:224] Handling call
0709 12:10:46.219726 (+ 48009us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:46.298172 (+ 78446us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:46.298208 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:46.298253 (+    45us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:46.298288 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:47.114805 (+816517us) spinlock_profiling.cc:243] Waited 78.2 ms on lock 0x7b54003b2254. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:10:47.114882 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:47.115104 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":179886976}
I20260709 12:10:46.530704 14258 raft_consensus.cc:2468] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 6.
I20260709 12:10:47.337435 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:47.343605 14181 raft_consensus.cc:2393] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 7: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:10:46.439859 16989 leader_election.cc:290] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:10:47.301282 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 247237us
W20260709 12:10:47.348102 14302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:47.349493 14303 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:47.293335 14187 raft_consensus.cc:2468] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 4.
I20260709 12:10:46.655929 14907 raft_consensus.cc:1240] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 6 LEADER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 5. Current term is 6. Ops: [3.6-5.7]
I20260709 12:10:47.340907 14257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41764 (request call id 2261) took 1178 ms. Trace:
W20260709 12:10:47.334493 14185 rpcz_store.cc:269] 0709 12:10:43.278993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:43.280872 (+  1879us) service_pool.cc:224] Handling call
0709 12:10:46.941777 (+3660905us) spinlock_profiling.cc:243] Waited 2.34 s on lock 0x7b54003197d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:10:46.957710 (+ 15933us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5371700992}
I20260709 12:10:47.352205 14257 rpcz_store.cc:276] 0709 12:10:46.128068 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:46.403516 (+275448us) service_pool.cc:224] Handling call
0709 12:10:47.306738 (+903222us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:47.339404 14186 rpcz_store.cc:276] 0709 12:10:45.494201 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:45.541607 (+ 47406us) service_pool.cc:224] Handling call
0709 12:10:47.019893 (+1478286us) spinlock_profiling.cc:243] Waited 336 ms on lock 0x7b54003b1854. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:10:47.020052 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":771947392}
I20260709 12:10:46.452976 14338 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c"
dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
mode: GRACEFUL
new_leader_uuid: "885067a0d31741bfb5c9935788e315bf"
 from {username='slave'} at 127.0.0.1:50896
I20260709 12:10:46.562507 14908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
W20260709 12:10:46.898804 17134 log.cc:927] Time spent T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.118s	user 0.000s	sys 0.001s
W20260709 12:10:46.505288 17135 log.cc:927] Time spent T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 12:10:47.339416 14260 rpcz_store.cc:269] 0709 12:10:45.695723 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:45.709464 (+ 13741us) service_pool.cc:224] Handling call
0709 12:10:47.035827 (+1326363us) spinlock_profiling.cc:243] Waited 227 ms on lock 0x7b5400100c54. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:10:47.036022 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":521029504}
I20260709 12:10:47.340915 14190 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56046 (request call id 1942) took 2001 ms. Trace:
I20260709 12:10:47.365674 14190 rpcz_store.cc:276] 0709 12:10:45.339360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:46.437371 (+1098011us) service_pool.cc:224] Handling call
0709 12:10:46.453759 (+ 16388us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:47.340616 (+886857us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:47.340853 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:47.299226 14263 rpcz_store.cc:276] 0709 12:10:45.694753 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:45.694910 (+   157us) service_pool.cc:224] Handling call
0709 12:10:47.036653 (+1341743us) spinlock_profiling.cc:243] Waited 248 ms on lock 0x7b540007b054. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:10:47.036814 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":570942720}
I20260709 12:10:47.355245 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
W20260709 12:10:47.339720 14264 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41768 (request call id 1500) took 1642 ms (client timeout 2069 ms). Trace:
I20260709 12:10:47.355026 14338 raft_consensus.cc:606] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Received request to transfer leadership to TS 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:47.357036 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:10:46.843539 17146 log.cc:927] Time spent T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.216s	user 0.000s	sys 0.000s
I20260709 12:10:46.550799 16934 leader_election.cc:290] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:47.362444 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:46.446149 16947 leader_election.cc:290] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187)
I20260709 12:10:47.364400 14912 raft_consensus.cc:1240] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:47.333856 14336 rpcz_store.cc:276] 0709 12:10:45.720532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:46.090996 (+370464us) service_pool.cc:224] Handling call
0709 12:10:46.091411 (+   415us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:46.333139 (+241728us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:46.333176 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:46.333228 (+    52us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:46.333259 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:47.107114 (+773855us) spinlock_profiling.cc:243] Waited 241 ms on lock 0x7b5400145354. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:10:47.107176 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:47.107334 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":555304704}
I20260709 12:10:47.387589 14336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50856 (request call id 1821) took 1514 ms. Trace:
I20260709 12:10:47.014846 16813 leader_election.cc:290] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 7 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:46.627794 17051 leader_election.cc:290] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:47.366990 14186 raft_consensus.cc:3060] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:47.389456 16737 raft_consensus.cc:493] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:47.431888 16737 raft_consensus.cc:515] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:47.390002 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:47.402823 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:47.435539 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:47.435915 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:47.357692 14908 raft_consensus.cc:2468] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 5.
I20260709 12:10:47.025943 17107 leader_election.cc:290] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:47.103240 17096 leader_election.cc:290] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:47.099763 17062 leader_election.cc:290] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:47.445427 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:46.941099 17112 leader_election.cc:290] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:47.109311 17063 leader_election.cc:290] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:47.369704 14181 raft_consensus.cc:2468] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 6.
W20260709 12:10:47.416967 16696 consensus_meta.cc:287] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 1.115s	user 0.010s	sys 0.001s
I20260709 12:10:47.369966 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:46.673385 16602 leader_election.cc:290] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:47.288446 17038 raft_consensus.cc:493] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:10:47.107651 17046 leader_election.cc:290] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 9 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:46.496199 17125 leader_election.cc:290] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:46.505126 17127 leader_election.cc:290] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:46.912107 16939 leader_election.cc:290] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:47.110047 17089 leader_election.cc:290] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:47.480696 14188 raft_consensus.cc:1240] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 6. Current term is 7. Ops: []
W20260709 12:10:46.966806 17143 log.cc:927] Time spent T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.534s	user 0.000s	sys 0.001s
I20260709 12:10:47.374469 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:47.482802 14187 raft_consensus.cc:3060] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:47.369634 14264 rpcz_store.cc:269] 0709 12:10:45.697275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:45.697806 (+   531us) service_pool.cc:224] Handling call
0709 12:10:47.339644 (+1641838us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:46.666051 16969 leader_election.cc:290] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:47.109077 17014 leader_election.cc:290] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:46.447400 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:46.468371 17067 leader_election.cc:290] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:46.899844 17081 leader_election.cc:290] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:46.847134 16911 leader_election.cc:290] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 7 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:46.653861 17118 leader_election.cc:290] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:47.378863 14258 raft_consensus.cc:2468] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 5.
I20260709 12:10:47.022926 17070 leader_election.cc:290] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:47.380470 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:47.534716 14185 raft_consensus.cc:2393] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 7: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:10:47.388007 14336 rpcz_store.cc:276] 0709 12:10:45.873376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:47.386850 (+1513474us) service_pool.cc:224] Handling call
0709 12:10:47.387198 (+   348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:47.387348 (+   150us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:47.387363 (+    15us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:47.387392 (+    29us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:47.387411 (+    19us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:47.387446 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:47.387534 (+    88us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:47.536489 14336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50856 (request call id 1822) took 1662 ms. Trace:
I20260709 12:10:47.537047 14336 rpcz_store.cc:276] 0709 12:10:45.873628 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:47.535529 (+1661901us) service_pool.cc:224] Handling call
0709 12:10:47.535885 (+   356us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:47.536105 (+   220us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:47.536134 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:47.536180 (+    46us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:47.536214 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:47.536275 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:47.536418 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:47.486116 17076 consensus_meta.cc:287] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 1.380s	user 0.009s	sys 0.004s
I20260709 12:10:47.353241 17074 leader_election.cc:290] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:47.368623 16989 raft_consensus.cc:493] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:47.353962 16821 raft_consensus.cc:493] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:47.108871 17085 consensus_queue.cc:260] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } }
I20260709 12:10:47.374181 16923 raft_consensus.cc:493] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:47.378383 17101 raft_consensus.cc:3055] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:47.549753 17101 raft_consensus.cc:740] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:10:47.550055 16923 raft_consensus.cc:515] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:47.550808 17101 consensus_queue.cc:260] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:47.551945 17101 raft_consensus.cc:3060] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:47.549921 14904 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53200 (request call id 449) took 1120 ms. Trace:
I20260709 12:10:47.552657 14904 rpcz_store.cc:276] 0709 12:10:46.429226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:46.446892 (+ 17666us) service_pool.cc:224] Handling call
0709 12:10:47.549824 (+1102932us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:47.549840 16821 raft_consensus.cc:515] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:47.554548 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:47.555581 16821 leader_election.cc:290] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:47.555902 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:47.552814 16989 raft_consensus.cc:515] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:47.557327 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:10:47.558032 14904 raft_consensus.cc:3060] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:47.402062 16814 leader_election.cc:290] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:47.037971 17132 raft_consensus.cc:3055] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:47.393523 14263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41764 (request call id 2265) took 1190 ms. Trace:
I20260709 12:10:47.563660 14263 rpcz_store.cc:276] 0709 12:10:46.203122 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:47.372628 (+1169506us) service_pool.cc:224] Handling call
0709 12:10:47.393034 (+ 20406us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:47.393213 (+   179us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:47.393235 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:47.393272 (+    37us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:47.393301 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:47.393355 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:47.393459 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:47.407133 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:47.565692 14184 raft_consensus.cc:2468] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 3.
I20260709 12:10:47.424386 14335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50856 (request call id 1816) took 1552 ms. Trace:
I20260709 12:10:47.394510 14256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41768 (request call id 1495) took 1705 ms. Trace:
I20260709 12:10:47.436872 14908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53200 (request call id 444) took 1031 ms. Trace:
I20260709 12:10:47.440310 14186 raft_consensus.cc:2468] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 9.
I20260709 12:10:47.410552 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
W20260709 12:10:47.441457 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 49223.2us
W20260709 12:10:47.426225 14262 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41768 (request call id 1501) took 1728 ms (client timeout 1952 ms). Trace:
I20260709 12:10:47.438378 14190 raft_consensus.cc:2468] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 5.
I20260709 12:10:47.428782 14257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41764 (request call id 2262) took 1300 ms. Trace:
I20260709 12:10:47.393363 14331 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50856 (request call id 1819) took 1520 ms. Trace:
I20260709 12:10:47.570173 14190 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56044 (request call id 2227) took 1083 ms. Trace:
I20260709 12:10:47.404556 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:47.427902 17050 leader_election.cc:290] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:47.448096 17052 leader_election.cc:290] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:47.448657 14907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:47.568336 14908 rpcz_store.cc:276] 0709 12:10:46.405372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:46.405525 (+   153us) service_pool.cc:224] Handling call
0709 12:10:47.436805 (+1031280us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:47.569911 14262 rpcz_store.cc:269] 0709 12:10:45.698145 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:45.711774 (+ 13629us) service_pool.cc:224] Handling call
0709 12:10:47.426047 (+1714273us) spinlock_profiling.cc:243] Waited 42.8 ms on lock 0x7b54002c0954. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:10:47.426157 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":98467712}
I20260709 12:10:47.451810 17107 raft_consensus.cc:493] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:47.437050 16763 raft_consensus.cc:493] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:10:47.440034 17018 leader_election.cc:290] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:47.455890 17103 leader_election.cc:290] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:47.404757 16831 consensus_queue.cc:260] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:10:47.459370 16943 consensus_meta.cc:287] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 1.195s	user 0.005s	sys 0.006s
I20260709 12:10:47.397848 14905 raft_consensus.cc:2393] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 5: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:10:47.426708 17072 consensus_queue.cc:1048] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 12:10:47.370301 14338 raft_consensus.cc:614] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:10:47.461602 17053 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.938s	user 0.027s	sys 0.077s
I20260709 12:10:47.468140 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:47.469252 14304 leader_election.cc:304] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:47.412210 17095 raft_consensus.cc:3055] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:47.406575 16910 leader_election.cc:290] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 8 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:47.426291 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:47.445050 17034 raft_consensus.cc:493] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:47.033766 17084 consensus_queue.cc:260] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:47.481552 14188 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56046 (request call id 1944) took 2044 ms. Trace:
I20260709 12:10:47.531504 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:47.622499 14188 rpcz_store.cc:276] 0709 12:10:45.436645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:47.473824 (+2037179us) service_pool.cc:224] Handling call
0709 12:10:47.480470 (+  6646us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:47.481264 (+   794us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:47.481488 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:47.532435 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:47.028975 17094 leader_election.cc:290] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:47.537809 14912 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53194 (request call id 725) took 1817 ms. Trace:
I20260709 12:10:47.539535 14182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56652 (request call id 625) took 2219 ms. Trace:
I20260709 12:10:47.539724 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:46.656178 17078 leader_election.cc:290] T f4739bc22bfe44fcba807da02d9351b6 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:47.624990 14258 raft_consensus.cc:3060] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:10:47.474833 16696 raft_consensus.cc:515] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:47.475666 17038 raft_consensus.cc:515] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:47.447360 14183 raft_consensus.cc:2468] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 8.
W20260709 12:10:47.637672 14183 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56044 (request call id 2221) took 1364 ms (client timeout 1783 ms). Trace:
W20260709 12:10:47.638094 14183 rpcz_store.cc:269] 0709 12:10:46.272818 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:46.311817 (+ 38999us) service_pool.cc:224] Handling call
0709 12:10:47.637605 (+1325788us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:47.639623 14183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 2208) took 2168 ms. Trace:
I20260709 12:10:47.639976 14183 rpcz_store.cc:276] 0709 12:10:45.471685 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:47.638776 (+2167091us) service_pool.cc:224] Handling call
0709 12:10:47.639131 (+   355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:47.639320 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:47.639346 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:47.639386 (+    40us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:47.639419 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:47.639467 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:47.639568 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:47.570652 14190 rpcz_store.cc:276] 0709 12:10:46.486932 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:47.435225 (+948293us) service_pool.cc:224] Handling call
0709 12:10:47.570101 (+134876us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:47.570454 14331 rpcz_store.cc:276] 0709 12:10:45.872848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:47.372405 (+1499557us) service_pool.cc:224] Handling call
0709 12:10:47.392826 (+ 20421us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:47.393043 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:47.393068 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:47.393112 (+    44us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:47.393141 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:47.393192 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:47.393296 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:47.570374 14257 rpcz_store.cc:276] 0709 12:10:46.128319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:47.367680 (+1239361us) service_pool.cc:224] Handling call
0709 12:10:47.428260 (+ 60580us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:47.428456 (+   196us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:47.428483 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:47.428524 (+    41us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:47.428554 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:47.428606 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:47.428715 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:47.448607 16737 leader_election.cc:290] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:47.570582 14335 rpcz_store.cc:276] 0709 12:10:45.872100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:46.409784 (+537684us) service_pool.cc:224] Handling call
0709 12:10:46.410118 (+   334us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:46.413933 (+  3815us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:46.413959 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:46.421546 (+  7587us) log.cc:844] Serialized 26 byte log entry
0709 12:10:46.872617 (+451071us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:46.872667 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:46.872756 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:47.424126 (+551370us) raft_consensus.cc:1685] finished
0709 12:10:47.424147 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:47.424311 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":789,"raft.queue_time_us":5819,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":6449,"thread_start_us":431937,"threads_started":1,"wal-append.queue_time_us":991529}
I20260709 12:10:47.566740 14256 rpcz_store.cc:276] 0709 12:10:45.689294 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:45.710081 (+ 20787us) service_pool.cc:224] Handling call
0709 12:10:45.710453 (+   372us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:45.801123 (+ 90670us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:45.801181 (+    58us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:45.818241 (+ 17060us) log.cc:844] Serialized 26 byte log entry
0709 12:10:45.901188 (+ 82947us) spinlock_profiling.cc:243] Waited 14.5 ms on lock 0x7b180033dc00. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f212cf16ab1 00007f212cf23281 00007f2124030e07 00007f212ce8b9a9 00007f212404d69b 00007f212404b93f 00007f212404dc02 00007f2126cd520b 00007f2126cdad23 00007f2126cdb0d1 00007f21270f6a0f
0709 12:10:46.256740 (+355552us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:46.366340 (+109600us) log.cc:844] Serialized 14 byte log entry
0709 12:10:46.373222 (+  6882us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:46.373301 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:47.394175 (+1020874us) raft_consensus.cc:1685] finished
0709 12:10:47.394299 (+   124us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:47.394437 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":96797,"prepare.queue_time_us":159396,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":3165,"raft.queue_time_us":106767,"raft.run_cpu_time_us":338,"raft.run_wall_time_us":22513,"spinlock_wait_cycles":33334016,"thread_start_us":451898,"threads_started":2,"wal-append.queue_time_us":469614}
I20260709 12:10:47.645251 14188 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 2207) took 2203 ms. Trace:
I20260709 12:10:47.552489 16923 leader_election.cc:290] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:47.596273 14259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41764 (request call id 2253) took 1470 ms. Trace:
I20260709 12:10:47.608960 17095 raft_consensus.cc:740] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:10:47.547425 17076 raft_consensus.cc:515] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:47.591626 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:47.603024 14187 raft_consensus.cc:2468] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 7.
I20260709 12:10:47.655036 14262 raft_consensus.cc:2468] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 7.
I20260709 12:10:47.655911 14187 raft_consensus.cc:1240] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:10:47.656517 14332 raft_consensus.cc:2393] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db in current term 9: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:10:47.656689 14187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 2214) took 2105 ms. Trace:
I20260709 12:10:47.657124 14187 rpcz_store.cc:276] 0709 12:10:45.551286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:47.655323 (+2104037us) service_pool.cc:224] Handling call
0709 12:10:47.655669 (+   346us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:47.656407 (+   738us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:47.656627 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:47.604771 14184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 2206) took 2163 ms. Trace:
I20260709 12:10:47.601953 17055 raft_consensus.cc:493] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:47.607264 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 138082us
I20260709 12:10:47.658526 14181 raft_consensus.cc:2468] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 5.
I20260709 12:10:47.659272 14304 leader_election.cc:304] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:10:47.658456 14184 rpcz_store.cc:276] 0709 12:10:45.441275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:47.588901 (+2147626us) service_pool.cc:224] Handling call
0709 12:10:47.604240 (+ 15339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:47.604450 (+   210us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:47.604474 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:47.604515 (+    41us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:47.604558 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:47.604613 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:47.604713 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:47.623626 14905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53200 (request call id 446) took 1206 ms. Trace:
I20260709 12:10:47.609402 14338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:50896 (request call id 25) took 1171 ms. Trace:
I20260709 12:10:47.660835 14338 rpcz_store.cc:276] 0709 12:10:46.430752 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:46.447983 (+ 17231us) service_pool.cc:224] Handling call
0709 12:10:47.602373 (+1154390us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:47.542148 14336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 444) took 1434 ms. Trace:
I20260709 12:10:47.661806 14336 rpcz_store.cc:276] 0709 12:10:46.107609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:47.541247 (+1433638us) service_pool.cc:224] Handling call
0709 12:10:47.541607 (+   360us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:47.541824 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:47.541850 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:47.541898 (+    48us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:47.541927 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:47.541981 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:47.542086 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:47.608520 16965 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.028s	user 0.004s	sys 0.008s
I20260709 12:10:47.624244 14912 rpcz_store.cc:276] 0709 12:10:45.720770 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:45.720946 (+   176us) service_pool.cc:224] Handling call
0709 12:10:45.721367 (+   421us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:47.386572 (+1665205us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:47.537497 (+150925us) spinlock_profiling.cc:243] Waited 1.64 s on lock 0x7b54004bc8d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:10:47.537679 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3778014592}
W20260709 12:10:47.609067 17053 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.100s	user 0.027s	sys 0.078s
W20260709 12:10:47.671146 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 280535us
I20260709 12:10:47.671902 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:47.645334 17084 raft_consensus.cc:3060] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:47.641466 14183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 2211) took 2132 ms. Trace:
I20260709 12:10:47.609328 16831 raft_consensus.cc:3060] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:47.644421 14189 raft_consensus.cc:1240] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 7. Current term is 8. Ops: []
W20260709 12:10:47.664119 16965 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.110s	user 0.004s	sys 0.008s
I20260709 12:10:47.684338 14876 leader_election.cc:304] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:47.685235 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:47.586774 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:47.646505 14335 raft_consensus.cc:1240] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 5. Current term is 6. Ops: [3.4-5.5]
I20260709 12:10:47.563545 17132 raft_consensus.cc:740] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:47.610522 17051 raft_consensus.cc:3060] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:47.590523 16763 raft_consensus.cc:515] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:47.647473 14259 rpcz_store.cc:276] 0709 12:10:46.125841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:46.125984 (+   143us) service_pool.cc:224] Handling call
0709 12:10:46.126330 (+   346us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:46.416709 (+290379us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:46.416742 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:46.426326 (+  9584us) log.cc:844] Serialized 26 byte log entry
0709 12:10:46.851224 (+424898us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:46.851269 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:47.425187 (+573918us) spinlock_profiling.cc:243] Waited 290 ms on lock 0x7b5400101b54. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:10:47.425241 (+    54us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:47.595827 (+170586us) raft_consensus.cc:1685] finished
0709 12:10:47.595864 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:47.596176 (+   312us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8371,"raft.queue_time_us":555,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":3362,"spinlock_wait_cycles":666989312,"thread_start_us":400928,"threads_started":1,"wal-append.queue_time_us":1105168}
I20260709 12:10:47.646339 14188 rpcz_store.cc:276] 0709 12:10:45.441523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:47.623656 (+2182133us) service_pool.cc:224] Handling call
0709 12:10:47.644672 (+ 21016us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:47.644894 (+   222us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:47.644924 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:47.644972 (+    48us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:47.645005 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:47.645065 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:47.645185 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:47.652360 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:47.689509 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:47.690222 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:47.652432 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:47.660265 14304 leader_election.cc:304] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:47.624473 14182 rpcz_store.cc:276] 0709 12:10:45.320505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:46.215405 (+894900us) service_pool.cc:224] Handling call
0709 12:10:47.538718 (+1323313us) spinlock_profiling.cc:243] Waited 4.27 ms on lock 0x7b5800001298. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2124016b71 00007f2124016a22 00007f212cf2f8d9 00007f212c089ee0 00007f212c1530ab 00007f212c153131 00007f212c114fc0 00007f212c0ff929 00007f212c0ff3d2 00007f2125676bd4
0709 12:10:47.538960 (+   242us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:47.539169 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:47.539198 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:47.539243 (+    45us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:47.539273 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:47.539329 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:47.539443 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9811200}
I20260709 12:10:47.629359 16911 raft_consensus.cc:493] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:47.630183 14910 raft_consensus.cc:1240] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 6 LEADER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:10:47.674162 14187 raft_consensus.cc:1240] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:47.675284 14183 rpcz_store.cc:276] 0709 12:10:45.511064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:47.640830 (+2129766us) service_pool.cc:224] Handling call
0709 12:10:47.641078 (+   248us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:47.641234 (+   156us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:47.641249 (+    15us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:47.641278 (+    29us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:47.641296 (+    18us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:47.641330 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:47.641400 (+    70us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:47.692400 14304 leader_election.cc:304] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:47.629587 17034 raft_consensus.cc:515] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:47.673238 16923 raft_consensus.cc:2804] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:47.585705 17107 raft_consensus.cc:515] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:47.723434 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:47.724157 14183 raft_consensus.cc:2468] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 6.
I20260709 12:10:47.725188 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
W20260709 12:10:47.726665 17150 log.cc:927] Time spent T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.165s	user 0.001s	sys 0.000s
I20260709 12:10:47.678628 14184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 2217) took 2006 ms. Trace:
I20260709 12:10:47.681109 14337 raft_consensus.cc:2393] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 6: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:10:47.643831 16989 leader_election.cc:290] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:47.695117 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:47.696163 14335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50856 (request call id 1825) took 1583 ms. Trace:
I20260709 12:10:47.696934 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:47.676369 14336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50856 (request call id 1830) took 1416 ms. Trace:
I20260709 12:10:47.701085 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:47.701594 14187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 2215) took 2112 ms. Trace:
W20260709 12:10:47.713634 14302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:47.717676 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:47.726158 17132 consensus_queue.cc:260] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:47.666270 14905 rpcz_store.cc:276] 0709 12:10:46.415205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:46.416189 (+   984us) service_pool.cc:224] Handling call
0709 12:10:47.621997 (+1205808us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:47.679785 14338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 446) took 1279 ms. Trace:
I20260709 12:10:47.727298 14184 rpcz_store.cc:276] 0709 12:10:45.672306 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:47.660669 (+1988363us) service_pool.cc:224] Handling call
0709 12:10:47.678091 (+ 17422us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:47.678292 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:47.678319 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:47.678362 (+    43us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:47.678400 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:47.678449 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:47.678564 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:47.702168 17018 raft_consensus.cc:2804] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:47.749696 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:47.730068 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:47.692379 14258 raft_consensus.cc:2468] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 7.
I20260709 12:10:47.698635 16737 raft_consensus.cc:2804] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:47.670773 17055 raft_consensus.cc:515] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:47.744414 14335 rpcz_store.cc:276] 0709 12:10:46.112655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:47.645043 (+1532388us) service_pool.cc:224] Handling call
0709 12:10:47.645557 (+   514us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:47.695713 (+ 50156us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:47.696091 (+   378us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:47.692924 16814 raft_consensus.cc:2804] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:47.770076 14256 raft_consensus.cc:2468] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 5.
I20260709 12:10:47.786547 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:47.770282 14262 raft_consensus.cc:2468] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 6.
I20260709 12:10:47.729727 14263 raft_consensus.cc:2468] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 5.
I20260709 12:10:47.743542 14187 rpcz_store.cc:276] 0709 12:10:45.589713 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:47.658809 (+2069096us) service_pool.cc:224] Handling call
0709 12:10:47.673943 (+ 15134us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:47.693567 (+ 19624us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:47.701525 (+  7958us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:47.743048 14336 rpcz_store.cc:276] 0709 12:10:46.260445 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:47.662857 (+1402412us) service_pool.cc:224] Handling call
0709 12:10:47.675781 (+ 12924us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:47.676003 (+   222us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:47.676033 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:47.676080 (+    47us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:47.676113 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:47.676172 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:47.676293 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:47.733707 14230 leader_election.cc:336] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957): Timed out: RequestConsensusVote RPC to 127.12.174.131:45957 timed out after 3.361s (SENT)
I20260709 12:10:47.771003 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:47.785368 14303 leader_election.cc:304] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:47.788340 14182 raft_consensus.cc:2468] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 5.
I20260709 12:10:47.773449 14183 raft_consensus.cc:2468] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 5.
I20260709 12:10:47.789717 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:47.790946 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:47.774614 14188 raft_consensus.cc:2468] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 4.
I20260709 12:10:47.774675 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:47.775753 14338 rpcz_store.cc:276] 0709 12:10:46.400099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:47.675591 (+1275492us) service_pool.cc:224] Handling call
0709 12:10:47.679279 (+  3688us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:47.679446 (+   167us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:47.679470 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:47.679509 (+    39us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:47.679555 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:47.679610 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:47.679716 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:47.782913 14335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 447) took 1365 ms. Trace:
I20260709 12:10:47.718425 16923 raft_consensus.cc:493] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:47.795595 14263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53050 (request call id 473) took 1586 ms. Trace:
W20260709 12:10:47.783468 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 455759us
I20260709 12:10:47.796351 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:47.787258 14259 raft_consensus.cc:2468] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 6.
I20260709 12:10:47.797037 14256 raft_consensus.cc:3060] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:47.793911 14304 leader_election.cc:304] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:10:47.796002 14263 rpcz_store.cc:276] 0709 12:10:46.209369 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:47.794747 (+1585378us) service_pool.cc:224] Handling call
0709 12:10:47.795085 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:47.795260 (+   175us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:47.795287 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:47.795329 (+    42us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:47.795360 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:47.795410 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:47.795516 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:47.802012 14263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53050 (request call id 476) took 1508 ms. Trace:
I20260709 12:10:47.802786 14230 leader_election.cc:304] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:47.801905 14303 leader_election.cc:304] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:47.804031 16965 raft_consensus.cc:2749] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:47.803205 14304 leader_election.cc:304] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:47.794247 14335 rpcz_store.cc:276] 0709 12:10:46.417815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:47.781955 (+1364140us) service_pool.cc:224] Handling call
0709 12:10:47.782361 (+   406us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:47.782567 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:47.782596 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:47.782643 (+    47us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:47.782676 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:47.782730 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:47.782849 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:47.769914 14906 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f52421be255e4fab824173d17981b5bb"
dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
mode: GRACEFUL
new_leader_uuid: "17aab1bbf5014936aa18cc21818b26ec"
 from {username='slave'} at 127.0.0.1:38628
I20260709 12:10:47.698146 17094 consensus_queue.cc:1048] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.095s
I20260709 12:10:47.805723 14334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50856 (request call id 1818) took 1933 ms. Trace:
I20260709 12:10:47.811349 14259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53050 (request call id 475) took 1541 ms. Trace:
I20260709 12:10:47.815490 14183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56652 (request call id 626) took 1743 ms. Trace:
I20260709 12:10:47.791097 16814 raft_consensus.cc:493] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:47.801942 14877 leader_election.cc:304] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:47.806221 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:47.782680 17018 raft_consensus.cc:493] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:47.803429 14263 rpcz_store.cc:276] 0709 12:10:46.293674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:47.801218 (+1507544us) service_pool.cc:224] Handling call
0709 12:10:47.801510 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:47.801679 (+   169us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:47.801704 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:47.801767 (+    63us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:47.801801 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:47.801857 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:47.801953 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:47.804308 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 70654.5us
I20260709 12:10:47.816784 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
W20260709 12:10:47.821976 14230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:47.716801 16911 raft_consensus.cc:515] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:47.807032 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:47.822126 14184 raft_consensus.cc:3060] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:47.822552 14877 leader_election.cc:304] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
W20260709 12:10:47.822435 14332 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55492 (request call id 443) took 1715 ms (client timeout 2088 ms). Trace:
W20260709 12:10:47.826630 14332 rpcz_store.cc:269] 0709 12:10:46.107287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:46.258775 (+151488us) service_pool.cc:224] Handling call
0709 12:10:47.822239 (+1563464us) spinlock_profiling.cc:243] Waited 1.38 s on lock 0x7b540023b754. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:10:47.822370 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3183022464}
I20260709 12:10:47.820595 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:47.827589 14877 leader_election.cc:304] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:47.817605 14259 rpcz_store.cc:276] 0709 12:10:46.269564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:47.805781 (+1536217us) service_pool.cc:224] Handling call
0709 12:10:47.810808 (+  5027us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:47.811032 (+   224us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:47.811056 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:47.811099 (+    43us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:47.811131 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:47.811179 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:47.811288 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:47.824484 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:47.817790 14183 rpcz_store.cc:276] 0709 12:10:46.072289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:47.814694 (+1742405us) service_pool.cc:224] Handling call
0709 12:10:47.814972 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:47.815156 (+   184us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:47.815181 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:47.815221 (+    40us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:47.815255 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:47.815312 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:47.815422 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:47.827883 14262 raft_consensus.cc:2468] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 6.
I20260709 12:10:47.816495 14303 leader_election.cc:304] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:47.836808 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:47.817457 14334 rpcz_store.cc:276] 0709 12:10:45.872616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:47.338399 (+1465783us) service_pool.cc:224] Handling call
0709 12:10:47.346280 (+  7881us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:47.347903 (+  1623us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:47.347937 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:47.368006 (+ 20069us) log.cc:844] Serialized 26 byte log entry
0709 12:10:47.770501 (+402495us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:10:47.770539 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:47.770624 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:47.805486 (+ 34862us) raft_consensus.cc:1685] finished
0709 12:10:47.805510 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:47.805663 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3235,"raft.queue_time_us":2446,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":10022,"thread_start_us":343964,"threads_started":1,"wal-append.queue_time_us":413075}
I20260709 12:10:47.786137 16737 raft_consensus.cc:493] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:47.799849 16923 raft_consensus.cc:3060] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:47.840435 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:47.838402 14339 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50856 (request call id 1817) took 1966 ms. Trace:
I20260709 12:10:47.795433 17105 raft_consensus.cc:3060] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:47.842661 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:47.824934 16814 raft_consensus.cc:3060] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:47.824954 14906 raft_consensus.cc:606] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 8 LEADER]: Received request to transfer leadership to TS 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:10:47.844349 17063 raft_consensus.cc:2804] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:47.742915 17095 consensus_queue.cc:260] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:47.873755 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:47.844901 17156 raft_consensus.cc:476] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 5 LEADER]: Not starting pre-election -- already a leader
I20260709 12:10:47.844403 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:47.846333 16911 leader_election.cc:290] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:47.824817 17018 raft_consensus.cc:3060] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:47.849121 16965 raft_consensus.cc:493] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:47.852651 14877 leader_election.cc:304] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:47.858626 14183 raft_consensus.cc:2393] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 9: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:10:47.858471 14187 raft_consensus.cc:2468] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 2.
I20260709 12:10:47.804471 17132 raft_consensus.cc:3060] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:47.852550 14339 rpcz_store.cc:276] 0709 12:10:45.872360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:46.409708 (+537348us) service_pool.cc:224] Handling call
0709 12:10:46.411697 (+  1989us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:46.418370 (+  6673us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:46.418402 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:46.427846 (+  9444us) log.cc:844] Serialized 26 byte log entry
0709 12:10:46.579007 (+151161us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:46.579050 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:46.579124 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:47.838143 (+1259019us) raft_consensus.cc:1685] finished
0709 12:10:47.838162 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:47.838322 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1977,"raft.queue_time_us":4395,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":2874,"thread_start_us":131263,"threads_started":1,"wal-append.queue_time_us":1040943}
I20260709 12:10:47.883064 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:47.883795 14187 raft_consensus.cc:2393] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 5: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:10:47.865964 14331 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 445) took 1758 ms. Trace:
W20260709 12:10:47.868918 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 52484.1us
I20260709 12:10:47.840476 16910 raft_consensus.cc:2804] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:47.885032 14331 rpcz_store.cc:276] 0709 12:10:46.107861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:47.642519 (+1534658us) service_pool.cc:224] Handling call
0709 12:10:47.654107 (+ 11588us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:47.654366 (+   259us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:10:47.799509 (+145143us) log.cc:844] Serialized 14 byte log entry
0709 12:10:47.865501 (+ 65992us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:47.865564 (+    63us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:47.865622 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:47.865706 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:47.865879 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19644,"prepare.queue_time_us":186521,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":42725,"thread_start_us":170833,"threads_started":3}
I20260709 12:10:47.884824 14262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53050 (request call id 479) took 1502 ms. Trace:
I20260709 12:10:47.894869 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:47.895733 14186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 2205) took 2454 ms. Trace:
I20260709 12:10:47.896260 14187 raft_consensus.cc:2468] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 7.
I20260709 12:10:47.892813 14262 rpcz_store.cc:276] 0709 12:10:46.382393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:47.863005 (+1480612us) service_pool.cc:224] Handling call
0709 12:10:47.884316 (+ 21311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:47.884483 (+   167us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:47.884508 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:47.884559 (+    51us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:47.884592 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:47.884649 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:47.884759 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:47.877249 14182 raft_consensus.cc:2468] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 5.
I20260709 12:10:47.872162 14260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41764 (request call id 2264) took 1695 ms. Trace:
I20260709 12:10:47.880167 12986 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:10:47.854110 16737 raft_consensus.cc:3060] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:47.840174 17006 raft_consensus.cc:2749] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:47.853255 17041 raft_consensus.cc:2804] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:47.885627 14303 leader_election.cc:304] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:47.844405 16696 leader_election.cc:290] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 9 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:47.882176 17070 raft_consensus.cc:2749] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:47.896154 14186 rpcz_store.cc:276] 0709 12:10:45.440959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:47.568822 (+2127863us) service_pool.cc:224] Handling call
0709 12:10:47.569211 (+   389us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:47.569474 (+   263us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:10:47.817187 (+247713us) log.cc:844] Serialized 14 byte log entry
0709 12:10:47.895366 (+ 78179us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:47.895421 (+    55us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:47.895473 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:47.895549 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:47.895673 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":235760,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"thread_start_us":307595,"threads_started":2}
I20260709 12:10:47.984479 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:47.885953 17038 leader_election.cc:290] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:47.906967 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:10:47.989509 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 186343us
I20260709 12:10:47.897624 17074 raft_consensus.cc:2749] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:47.991443 14304 leader_election.cc:304] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
W20260709 12:10:47.913184 14305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:47.890702 17151 log.cc:927] Time spent T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.248s	user 0.001s	sys 0.000s
I20260709 12:10:47.910377 12986 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:10:47.971200 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 85730.2us
I20260709 12:10:47.903021 17034 leader_election.cc:290] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:47.875818 17089 raft_consensus.cc:2804] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:47.891386 17095 raft_consensus.cc:3060] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:10:47.983390 14228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:48.010866 14228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:48.011404 14228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:47.985190 14186 raft_consensus.cc:2468] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 7.
I20260709 12:10:48.012753 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:47.895948 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:47.890009 17111 raft_consensus.cc:3060] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:47.987825 14262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53050 (request call id 480) took 1579 ms. Trace:
I20260709 12:10:47.988173 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:47.870705 17063 raft_consensus.cc:493] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:10:47.891984 16910 raft_consensus.cc:493] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:48.017503 14303 leader_election.cc:304] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:10:47.910665 14260 rpcz_store.cc:276] 0709 12:10:46.176787 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:47.367788 (+1191001us) service_pool.cc:224] Handling call
0709 12:10:47.368166 (+   378us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:47.368403 (+   237us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:10:47.787249 (+418846us) log.cc:844] Serialized 14 byte log entry
0709 12:10:47.871787 (+ 84538us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:47.871844 (+    57us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:10:47.871896 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:47.871965 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:47.872095 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":483736,"prepare.run_cpu_time_us":82,"prepare.run_wall_time_us":1421,"raft.queue_time_us":323,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":6669,"thread_start_us":480539,"threads_started":2,"wal-append.queue_time_us":114549}
I20260709 12:10:48.009315 14304 leader_election.cc:304] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:10:47.978361 17041 raft_consensus.cc:493] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:48.013406 14186 raft_consensus.cc:2468] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 6.
I20260709 12:10:48.013886 14183 raft_consensus.cc:2468] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 5.
I20260709 12:10:48.014292 14262 rpcz_store.cc:276] 0709 12:10:46.408713 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:47.907919 (+1499206us) service_pool.cc:224] Handling call
0709 12:10:47.987257 (+ 79338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:47.987461 (+   204us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:47.987486 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:47.987546 (+    60us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:47.987580 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:47.987635 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:47.987755 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:47.985014 17045 leader_election.cc:290] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:48.015323 14182 raft_consensus.cc:2468] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 7.
I20260709 12:10:47.890306 16965 raft_consensus.cc:515] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:48.018889 14330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50856 (request call id 1807) took 5202 ms. Trace:
I20260709 12:10:48.021508 17076 leader_election.cc:290] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 6 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:48.024210 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:48.021440 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:48.027822 14186 raft_consensus.cc:2468] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 2.
I20260709 12:10:48.026472 17074 raft_consensus.cc:2804] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:48.030246 17074 raft_consensus.cc:493] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:10:48.030639 17074 raft_consensus.cc:3060] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:48.030788 14181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56044 (request call id 2233) took 1372 ms. Trace:
I20260709 12:10:48.031220 14181 rpcz_store.cc:276] 0709 12:10:46.657958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:47.467807 (+809849us) service_pool.cc:224] Handling call
0709 12:10:48.030611 (+562804us) spinlock_profiling.cc:243] Waited 51.8 ms on lock 0x7b54002d1254. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:10:48.030724 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":119190272}
I20260709 12:10:48.036055 16814 raft_consensus.cc:515] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:48.022568 14304 leader_election.cc:304] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:10:48.022270 17041 raft_consensus.cc:3060] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:48.040740 16814 leader_election.cc:290] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 4 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:48.027390 14330 rpcz_store.cc:276] 0709 12:10:42.813701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:42.813876 (+   175us) service_pool.cc:224] Handling call
0709 12:10:42.814226 (+   350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:46.278413 (+3464187us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:48.015919 (+1737506us) spinlock_profiling.cc:243] Waited 3.31 s on lock 0x7b540001b654. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:10:48.016141 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7610579328}
I20260709 12:10:48.049533 14262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53050 (request call id 483) took 1555 ms. Trace:
W20260709 12:10:48.050462 17160 log.cc:927] Time spent T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.153s	user 0.001s	sys 0.000s
I20260709 12:10:48.042960 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:48.048153 14188 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 2218) took 2267 ms. Trace:
I20260709 12:10:48.051137 14183 raft_consensus.cc:3060] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:48.051827 14185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56046 (request call id 1945) took 2614 ms. Trace:
I20260709 12:10:48.051082 14188 rpcz_store.cc:276] 0709 12:10:46.007788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:47.792056 (+1784268us) service_pool.cc:224] Handling call
0709 12:10:47.813373 (+ 21317us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:47.813765 (+   392us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:47.813795 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:47.821300 (+  7505us) log.cc:844] Serialized 26 byte log entry
0709 12:10:47.874748 (+ 53448us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:47.874806 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:47.874876 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:48.047903 (+173027us) raft_consensus.cc:1685] finished
0709 12:10:48.047928 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:48.048082 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":90,"raft.run_cpu_time_us":253,"raft.run_wall_time_us":35662,"thread_start_us":28115,"threads_started":1,"wal-append.queue_time_us":66643}
I20260709 12:10:48.053380 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:48.054049 14188 raft_consensus.cc:2468] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 2.
I20260709 12:10:48.056967 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:48.054986 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:48.058773 14908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:48.059468 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:48.059798 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:48.060334 14908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:48.059455 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:48.061380 14188 raft_consensus.cc:2376] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 6. Re-sending same reply.
I20260709 12:10:48.061857 14908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:48.062667 14185 rpcz_store.cc:276] 0709 12:10:45.436922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:47.544951 (+2108029us) service_pool.cc:224] Handling call
0709 12:10:47.550497 (+  5546us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:47.550903 (+   406us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:47.550933 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:47.551570 (+   637us) log.cc:844] Serialized 26 byte log entry
0709 12:10:47.770837 (+219267us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:47.770875 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:47.770934 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:48.051603 (+280669us) raft_consensus.cc:1685] finished
0709 12:10:48.051627 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:48.051763 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1316,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":95,"thread_start_us":218889,"threads_started":1,"wal-append.queue_time_us":284960}
I20260709 12:10:48.017441 17063 raft_consensus.cc:3060] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:48.018749 17070 raft_consensus.cc:2804] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:48.050086 14262 rpcz_store.cc:276] 0709 12:10:46.503943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:48.021997 (+1518054us) service_pool.cc:224] Handling call
0709 12:10:48.049001 (+ 27004us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:48.049209 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:48.049237 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:48.049276 (+    39us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:48.049309 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:48.049361 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:48.049468 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:48.025602 14260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53050 (request call id 482) took 1590 ms. Trace:
I20260709 12:10:48.010059 17108 leader_election.cc:290] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:48.070758 14183 raft_consensus.cc:2468] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 4.
I20260709 12:10:48.019941 16910 raft_consensus.cc:3060] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:48.071471 14184 raft_consensus.cc:2468] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 7.
I20260709 12:10:48.075816 14260 rpcz_store.cc:276] 0709 12:10:46.435058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:48.018715 (+1583657us) service_pool.cc:224] Handling call
0709 12:10:48.024942 (+  6227us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:48.025264 (+   322us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:48.025291 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:48.025335 (+    44us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:48.025366 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:48.025423 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:48.025539 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:48.064963 14256 raft_consensus.cc:2468] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 7.
I20260709 12:10:48.077142 14876 leader_election.cc:304] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:48.080735 17168 raft_consensus.cc:2804] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:10:48.070930 14904 consensus_meta.cc:287] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db: Time spent flushing consensus metadata: real 0.512s	user 0.007s	sys 0.005s
W20260709 12:10:48.082226 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 59743.5us
I20260709 12:10:48.082818 17034 raft_consensus.cc:2804] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:48.020104 17169 raft_consensus.cc:2804] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:48.095642 14304 leader_election.cc:304] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:10:48.088989 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:48.097524 14183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56652 (request call id 627) took 2024 ms. Trace:
I20260709 12:10:48.098606 14256 raft_consensus.cc:1240] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 5. Current term is 6. Ops: [5.7-5.7]
W20260709 12:10:48.085247 17166 log.cc:927] Time spent T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 12:10:48.102177 14304 leader_election.cc:304] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:48.101449 14183 rpcz_store.cc:276] 0709 12:10:46.072986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:48.076653 (+2003667us) service_pool.cc:224] Handling call
0709 12:10:48.096810 (+ 20157us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:48.097148 (+   338us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:48.097183 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:48.097226 (+    43us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:48.097257 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:48.097319 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:48.097448 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":119}
I20260709 12:10:48.095235 14904 raft_consensus.cc:2468] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 7.
I20260709 12:10:48.099099 17034 raft_consensus.cc:493] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:48.104496 17045 raft_consensus.cc:2804] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:48.095202 17006 raft_consensus.cc:2804] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:10:48.109187 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:48.109688 14304 leader_election.cc:304] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:10:48.110666 14262 raft_consensus.cc:1275] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260709 12:10:48.114697 14262 pending_rounds.cc:85] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec: Aborting all ops after (but not including) 5
I20260709 12:10:48.114984 14262 pending_rounds.cc:107] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 12:10:48.115368 14262 raft_consensus.cc:2889] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:48.108984 17045 raft_consensus.cc:493] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:48.115473 14264 raft_consensus.cc:2468] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 5.
I20260709 12:10:48.115929 14262 pending_rounds.cc:107] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 12:10:48.117488 14183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 2219) took 1984 ms. Trace:
I20260709 12:10:48.117095 14262 raft_consensus.cc:2889] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:48.088356 17168 raft_consensus.cc:493] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:48.091485 17070 raft_consensus.cc:697] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 7 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:48.118244 14185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56652 (request call id 630) took 2014 ms. Trace:
I20260709 12:10:48.118206 14183 rpcz_store.cc:276] 0709 12:10:46.133413 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:48.113196 (+1979783us) service_pool.cc:224] Handling call
0709 12:10:48.116783 (+  3587us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:48.117032 (+   249us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:48.117057 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:48.117102 (+    45us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:48.117134 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:48.117302 (+   168us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:48.117430 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:48.109648 17034 raft_consensus.cc:3060] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:48.123651 14185 rpcz_store.cc:276] 0709 12:10:46.103881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:48.091985 (+1988104us) service_pool.cc:224] Handling call
0709 12:10:48.117712 (+ 25727us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:48.117915 (+   203us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:48.117940 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:48.117981 (+    41us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:48.118014 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:48.118068 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:48.118187 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:48.121511 16696 raft_consensus.cc:2804] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:10:48.127636 14304 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:48.120970 14257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53050 (request call id 485) took 1440 ms. Trace:
W20260709 12:10:48.129791 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:48.130347 14304 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:48.129215 14260 raft_consensus.cc:1275] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:10:48.129643 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:48.118788 17045 raft_consensus.cc:3060] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:48.113611 17169 raft_consensus.cc:697] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 9 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:48.122812 17168 raft_consensus.cc:3060] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:48.153398 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:48.126461 17108 raft_consensus.cc:2804] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:48.156100 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:48.156419 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
W20260709 12:10:48.157768 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 111769us
I20260709 12:10:48.158985 14260 raft_consensus.cc:3060] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:48.135190 14183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56652 (request call id 631) took 1830 ms. Trace:
I20260709 12:10:48.134230 14257 rpcz_store.cc:276] 0709 12:10:46.819899 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:48.032924 (+1213025us) service_pool.cc:224] Handling call
0709 12:10:48.033280 (+   356us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:48.033529 (+   249us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:10:48.038054 (+  4525us) log.cc:844] Serialized 14 byte log entry
0709 12:10:48.120607 (+ 82553us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:48.120667 (+    60us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:48.120711 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:48.120786 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:48.120907 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":4805,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"raft.queue_time_us":568,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":2480,"thread_start_us":81725,"threads_started":1}
I20260709 12:10:48.121628 17006 raft_consensus.cc:697] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [term 4 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:10:48.127712 16696 raft_consensus.cc:493] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:48.143483 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:48.133680 14262 raft_consensus.cc:2468] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 6.
I20260709 12:10:48.160430 14183 rpcz_store.cc:276] 0709 12:10:46.304931 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:48.124101 (+1819170us) service_pool.cc:224] Handling call
0709 12:10:48.129804 (+  5703us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:48.130038 (+   234us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:48.130066 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:48.134522 (+  4456us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:48.134910 (+   388us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:48.134986 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:48.135119 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:48.140239 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:48.161136 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:48.163450 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:48.165803 14183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56652 (request call id 633) took 1682 ms. Trace:
I20260709 12:10:48.166757 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:48.167743 14265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41764 (request call id 2260) took 2039 ms. Trace:
W20260709 12:10:48.165369 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 141923us
I20260709 12:10:48.166237 14183 rpcz_store.cc:276] 0709 12:10:46.483802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:48.164933 (+1681131us) service_pool.cc:224] Handling call
0709 12:10:48.165208 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:48.165465 (+   257us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:48.165496 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:48.165550 (+    54us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:48.165581 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:48.165633 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:48.165729 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:48.168169 14265 rpcz_store.cc:276] 0709 12:10:46.127823 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:46.450800 (+322977us) service_pool.cc:224] Handling call
0709 12:10:47.036007 (+585207us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:47.324839 (+288832us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:48.167559 (+842720us) spinlock_profiling.cc:243] Waited 380 ms on lock 0x7b5400100c50. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713a8ad 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:10:48.167683 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":874883456}
I20260709 12:10:48.172449 14183 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0"
dest_uuid: "885067a0d31741bfb5c9935788e315bf"
 from {username='slave'} at 127.0.0.1:56044
W20260709 12:10:48.173319 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 1.8985e+06us
I20260709 12:10:48.163793 14185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56652 (request call id 632) took 1858 ms. Trace:
I20260709 12:10:48.164417 14187 raft_consensus.cc:1240] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:48.173950 14257 raft_consensus.cc:1240] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:48.174461 14183 raft_consensus.cc:493] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:48.174561 14187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 2224) took 1792 ms. Trace:
I20260709 12:10:48.175169 14183 raft_consensus.cc:3060] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:48.175199 14187 rpcz_store.cc:276] 0709 12:10:46.381705 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:48.163947 (+1782242us) service_pool.cc:224] Handling call
0709 12:10:48.164246 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:48.174270 (+ 10024us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:48.174499 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:48.176234 14185 rpcz_store.cc:276] 0709 12:10:46.305246 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:48.133267 (+1828021us) service_pool.cc:224] Handling call
0709 12:10:48.163254 (+ 29987us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:48.163432 (+   178us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:48.163459 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:48.163505 (+    46us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:48.163549 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:48.163605 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:48.163721 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:48.174000 14155 leader_election.cc:336] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Timed out: RequestConsensusVote RPC to 127.12.174.130:36673 timed out after 2.242s (SENT)
I20260709 12:10:48.178884 14155 leader_election.cc:304] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:48.180424 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:48.180841 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:48.182251 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:48.182662 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:48.186836 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:48.159377 17108 raft_consensus.cc:493] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:48.191475 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:48.190801 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:48.193579 14265 raft_consensus.cc:1275] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:48.169950 16696 raft_consensus.cc:3060] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:48.224534 17072 consensus_queue.cc:1059] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:48.226580 17175 raft_consensus.cc:3055] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:48.227069 17175 raft_consensus.cc:740] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:48.231699 14331 raft_consensus.cc:1240] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:48.237849 17052 raft_consensus.cc:2749] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:48.247315 17107 leader_election.cc:290] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:48.248281 16965 leader_election.cc:290] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:48.161458 16923 raft_consensus.cc:515] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:10:48.287189 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 399187us
I20260709 12:10:48.190649 17108 raft_consensus.cc:3060] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:48.289198 14331 raft_consensus.cc:1240] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:48.289654 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:48.292411 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:48.293334 14256 raft_consensus.cc:2368] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db for earlier term 6. Current term is 7.
I20260709 12:10:48.297523 17089 raft_consensus.cc:493] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:48.298178 17089 raft_consensus.cc:3060] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:48.303686 17112 raft_consensus.cc:993] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c: : Instructing follower 17aab1bbf5014936aa18cc21818b26ec to start an election
I20260709 12:10:48.307335 14189 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56046 (request call id 1943) took 2871 ms. Trace:
I20260709 12:10:48.307869 14189 rpcz_store.cc:276] 0709 12:10:45.436270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:46.447787 (+1011517us) service_pool.cc:224] Handling call
0709 12:10:47.642216 (+1194429us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:47.677837 (+ 35621us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:48.307121 (+629284us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b54003a39d0. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713a8ad 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:10:48.307265 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2665453824}
I20260709 12:10:48.320658 16821 raft_consensus.cc:1081] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 4 LEADER]: Signalling peer 17aab1bbf5014936aa18cc21818b26ec to start an election
W20260709 12:10:48.290918 17163 log.cc:927] Time spent T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.283s	user 0.000s	sys 0.001s
W20260709 12:10:48.327658 17173 log.cc:927] Time spent T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
W20260709 12:10:48.328989 17152 log.cc:927] Time spent T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.408s	user 0.002s	sys 0.000s
W20260709 12:10:48.329684 17171 log.cc:927] Time spent T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.212s	user 0.001s	sys 0.000s
I20260709 12:10:48.318408 17006 consensus_queue.cc:237] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:10:48.334861 14229 consensus_peers.cc:597] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec -> Peer 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341): Couldn't send request to peer 73d01e9b1a9d49358da4985b21d681db. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e5c1eed5e91b4c908f1f9ebf315fbc6f. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:10:48.359282 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 1.02367e+06us
I20260709 12:10:48.360369 14229 leader_election.cc:304] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:48.227932 17175 consensus_queue.cc:260] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } }
I20260709 12:10:48.340750 14334 raft_consensus.cc:2393] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 6: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:10:48.343858 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:48.364810 14331 raft_consensus.cc:2368] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db for earlier term 6. Current term is 7.
W20260709 12:10:48.349470 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 167962us
I20260709 12:10:48.367846 14303 leader_election.cc:304] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:48.357203 14259 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f"
dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
 from {username='slave'} at 127.0.0.1:41764
I20260709 12:10:48.357369 14304 leader_election.cc:304] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
W20260709 12:10:48.361557 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 187583us
I20260709 12:10:48.368674 14259 raft_consensus.cc:493] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:48.369099 14259 raft_consensus.cc:3060] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:48.363507 14229 leader_election.cc:304] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
W20260709 12:10:48.354907 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 169298us
I20260709 12:10:48.376863 14258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53050 (request call id 474) took 2152 ms. Trace:
I20260709 12:10:48.377369 14258 rpcz_store.cc:276] 0709 12:10:46.224859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:47.800067 (+1575208us) service_pool.cc:224] Handling call
0709 12:10:47.800401 (+   334us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:47.800760 (+   359us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:47.800789 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:47.816297 (+ 15508us) log.cc:844] Serialized 26 byte log entry
0709 12:10:47.870070 (+ 53773us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:47.870130 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:47.870220 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:48.376636 (+506416us) raft_consensus.cc:1685] finished
0709 12:10:48.376660 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:48.376796 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":146,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":9967,"thread_start_us":18277,"threads_started":1,"wal-append.queue_time_us":186572}
I20260709 12:10:48.373658 14183 raft_consensus.cc:515] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:48.190045 17070 consensus_queue.cc:237] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:48.392668 14259 raft_consensus.cc:515] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:48.388008 14260 raft_consensus.cc:2468] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 6.
I20260709 12:10:48.391307 14155 leader_election.cc:304] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
W20260709 12:10:48.392510 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:48.362865 16923 leader_election.cc:290] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 6 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:48.397111 14155 leader_election.cc:304] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:48.405702 14303 leader_election.cc:304] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:48.408649 14259 leader_election.cc:290] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:48.384110 17175 raft_consensus.cc:3060] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:48.410813 14304 leader_election.cc:304] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:10:48.412926 14155 leader_election.cc:304] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:48.412392 14303 leader_election.cc:304] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
W20260709 12:10:48.418406 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 54982.8us
I20260709 12:10:48.420027 14229 leader_election.cc:304] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:48.421064 14303 leader_election.cc:304] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:48.421260 17107 raft_consensus.cc:2804] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:48.399753 17052 raft_consensus.cc:2749] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:48.426972 14190 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 2213) took 2898 ms. Trace:
I20260709 12:10:48.382649 16965 consensus_queue.cc:1048] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 12:10:48.422405 17107 raft_consensus.cc:493] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:48.450798 14190 rpcz_store.cc:276] 0709 12:10:45.528649 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:47.642122 (+2113473us) service_pool.cc:224] Handling call
0709 12:10:47.657207 (+ 15085us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:47.665399 (+  8192us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:47.665437 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:47.681576 (+ 16139us) log.cc:844] Serialized 26 byte log entry
0709 12:10:47.802290 (+120714us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:47.802332 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:47.802405 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:48.426687 (+624282us) raft_consensus.cc:1685] finished
0709 12:10:48.426711 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:48.426894 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":124,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":5622,"thread_start_us":72710,"threads_started":1,"wal-append.queue_time_us":171226}
I20260709 12:10:48.406204 17183 raft_consensus.cc:2804] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:10:48.488693 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 68013.1us
I20260709 12:10:48.414263 17181 raft_consensus.cc:2764] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:10:48.419464 17112 raft_consensus.cc:3060] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:48.423722 17094 raft_consensus.cc:2804] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:48.415027 17172 raft_consensus.cc:2804] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:10:48.490280 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 69218.6us
I20260709 12:10:48.423071 16544 raft_consensus.cc:2804] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:48.341993 17169 consensus_queue.cc:237] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:10:48.491477 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 96119.2us
I20260709 12:10:48.416072 16821 consensus_queue.cc:1048] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.076s
I20260709 12:10:48.483059 17052 raft_consensus.cc:2804] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:10:48.488593 17107 raft_consensus.cc:3060] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:48.505795 17193 raft_consensus.cc:2804] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:48.506307 17193 raft_consensus.cc:493] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:48.506697 17193 raft_consensus.cc:3060] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:48.503368 17055 leader_election.cc:290] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:48.510393 17055 consensus_queue.cc:1059] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:48.512063 16910 raft_consensus.cc:515] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:48.501219 17052 raft_consensus.cc:493] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:10:48.513979 17052 raft_consensus.cc:3060] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:48.514503 16910 leader_election.cc:290] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 9 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:48.489135 17183 raft_consensus.cc:697] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 7 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:48.491245 17185 raft_consensus.cc:2749] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:48.515933 16965 raft_consensus.cc:2749] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:48.496668 16544 raft_consensus.cc:493] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:48.523929 16544 raft_consensus.cc:3060] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:48.495646 17172 raft_consensus.cc:493] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
W20260709 12:10:48.605021 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 185075us
W20260709 12:10:48.570339 17041 consensus_meta.cc:287] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db: Time spent flushing consensus metadata: real 0.532s	user 0.007s	sys 0.004s
W20260709 12:10:48.573696 17084 consensus_meta.cc:287] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.893s	user 0.008s	sys 0.005s
W20260709 12:10:48.569903 17051 consensus_meta.cc:287] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.872s	user 0.018s	sys 0.011s
I20260709 12:10:48.555397 17172 raft_consensus.cc:3060] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:48.573967 17132 consensus_meta.cc:287] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.684s	user 0.013s	sys 0.000s
W20260709 12:10:48.597932 17105 consensus_meta.cc:287] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.726s	user 0.018s	sys 0.010s
I20260709 12:10:48.504504 17190 consensus_queue.cc:1059] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.098s
I20260709 12:10:48.590795 16965 raft_consensus.cc:3055] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:48.645109 14229 leader_election.cc:304] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
W20260709 12:10:48.646282 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 150073us
W20260709 12:10:48.648554 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 157412us
I20260709 12:10:48.650025 14303 leader_election.cc:304] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:48.649706 14304 leader_election.cc:304] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:10:48.653564 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:48.654700 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:48.654695 14303 leader_election.cc:304] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:10:48.656906 17084 raft_consensus.cc:2804] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:48.657397 17084 raft_consensus.cc:493] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:48.657814 17084 raft_consensus.cc:3060] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:10:48.653390 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 257533us
I20260709 12:10:48.661881 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:48.662591 14263 raft_consensus.cc:3060] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:48.664628 14230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:48.666042 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:48.666741 14181 raft_consensus.cc:2393] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 6: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:10:48.667238 14303 leader_election.cc:304] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:10:48.639940 17035 raft_consensus.cc:493] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:48.641433 17051 raft_consensus.cc:2749] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:48.646911 17105 raft_consensus.cc:2749] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:10:48.674701 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 261834us
I20260709 12:10:48.671396 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:48.676420 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:48.671810 14303 leader_election.cc:304] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:10:48.646656 16965 raft_consensus.cc:740] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:10:48.670395 14877 leader_election.cc:400] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 6 election: Vote denied by peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673) with higher term. Message: Invalid argument: T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db for earlier term 6. Current term is 7.
I20260709 12:10:48.685781 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:48.687760 14190 raft_consensus.cc:2468] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 5.
I20260709 12:10:48.688714 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:48.686398 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:48.688980 14908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:48.689945 14877 leader_election.cc:403] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 12:10:48.660300 17190 consensus_queue.cc:1243] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer 65c9c1653b3346b39a0e118540e6080c log is divergent from this leader: its last log entry 7.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:10:48.707470 14187 raft_consensus.cc:1240] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:10:48.639125 17041 raft_consensus.cc:515] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:48.669399 17170 raft_consensus.cc:2804] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:48.713658 14335 raft_consensus.cc:1240] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:48.674063 17104 consensus_queue.cc:1048] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
W20260709 12:10:48.718629 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 47079.7us
I20260709 12:10:48.722481 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:48.675143 17070 raft_consensus.cc:2804] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:48.715936 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:48.669698 17194 raft_consensus.cc:2804] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:48.668542 16750 consensus_queue.cc:1048] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 12:10:48.686221 17196 raft_consensus.cc:2804] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:48.707753 16910 raft_consensus.cc:2749] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673) with higher term. Message: Invalid argument: T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db for earlier term 6. Current term is 7.
I20260709 12:10:48.749725 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:48.688512 17038 consensus_queue.cc:1048] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 12:10:48.762478 14912 raft_consensus.cc:1240] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:48.739169 17170 raft_consensus.cc:697] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 6 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
W20260709 12:10:48.779136 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 71093.9us
I20260709 12:10:48.751089 16763 leader_election.cc:290] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:48.679214 17035 raft_consensus.cc:515] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:48.799528 14188 raft_consensus.cc:1275] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:10:48.800817 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:48.802639 17035 leader_election.cc:290] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:48.803586 14330 raft_consensus.cc:2410] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:10:48.785835 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:48.738104 17070 raft_consensus.cc:493] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:10:48.786988 16965 consensus_queue.cc:260] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:48.788415 17203 raft_consensus.cc:993] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db: : Instructing follower 17aab1bbf5014936aa18cc21818b26ec to start an election
W20260709 12:10:48.792924 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 61106.9us
I20260709 12:10:48.794313 14183 leader_election.cc:290] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 8 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:48.796185 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:48.788431 17170 consensus_queue.cc:237] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:48.806133 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:48.807550 14263 raft_consensus.cc:2468] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 6.
W20260709 12:10:48.810700 14155 connection.cc:256] RPC call timeout handler was delayed by -3.4915323669999907s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1577s for a response
W20260709 12:10:48.698076 14228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:48.762256 17105 raft_consensus.cc:2804] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:48.978332 14183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:56044 (request call id 2228) took 2453 ms. Trace:
W20260709 12:10:48.979087 14228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:48.979566 14228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:48.979863 14228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:48.978266 14155 connection.cc:256] RPC call timeout handler was delayed by -3.464532366999947s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1607s for a response
W20260709 12:10:48.981581 14155 connection.cc:256] RPC call timeout handler was delayed by -3.3187323669999387s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1769s for a response
I20260709 12:10:48.981760 14334 raft_consensus.cc:3055] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:10:48.982040 14155 connection.cc:256] RPC call timeout handler was delayed by -3.1594323669999085s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1946s for a response
W20260709 12:10:48.982911 14155 connection.cc:256] RPC call timeout handler was delayed by -3.1540323669998998s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1952s for a response
W20260709 12:10:48.983426 14155 connection.cc:256] RPC call timeout handler was delayed by -3.0487323669999569s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2069s for a response
I20260709 12:10:48.983637 14303 leader_election.cc:304] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:48.896522 14188 raft_consensus.cc:1240] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 8. Current term is 9. Ops: []
W20260709 12:10:48.983739 14155 connection.cc:256] RPC call timeout handler was delayed by -2.5798323670001082s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.259s for a response
W20260709 12:10:48.984316 14155 connection.cc:256] RPC call timeout handler was delayed by -2.3926323670000329s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2798s for a response
W20260709 12:10:48.983850 14304 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:48.984858 14303 leader_election.cc:304] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:10:48.976204 17070 raft_consensus.cc:3060] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:48.982306 14334 raft_consensus.cc:740] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:48.688812 17183 consensus_queue.cc:237] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:10:48.780447 17186 log.cc:927] Time spent T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.288s	user 0.000s	sys 0.001s
W20260709 12:10:48.784572 17111 consensus_meta.cc:287] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db: Time spent flushing consensus metadata: real 0.767s	user 0.007s	sys 0.014s
W20260709 12:10:48.985790 14337 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50856 (request call id 1828) took 2782 ms (client timeout 1844 ms). Trace:
I20260709 12:10:48.988214 14304 leader_election.cc:304] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:10:48.991173 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:10:48.985997 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 169653us
I20260709 12:10:48.987681 14155 leader_election.cc:304] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:48.998766 14260 raft_consensus.cc:2468] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 6.
I20260709 12:10:48.978768 14183 rpcz_store.cc:276] 0709 12:10:46.524629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:48.172212 (+1647583us) service_pool.cc:224] Handling call
0709 12:10:48.793029 (+620817us) spinlock_profiling.cc:243] Waited 1.33 ms on lock 0x7b5400420c54. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f2127132a3d 00007f212c102cd0 00007f2125687254 00007f21256871e2 00007f2125687111 00007f212568708c 00007f2125686342 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:10:48.978264 (+185235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3054976}
I20260709 12:10:48.762247 17041 leader_election.cc:290] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 6 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:48.744084 17194 raft_consensus.cc:493] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
W20260709 12:10:48.997524 14337 rpcz_store.cc:269] 0709 12:10:46.202940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:46.261695 (+ 58755us) service_pool.cc:224] Handling call
0709 12:10:48.985559 (+2723864us) spinlock_profiling.cc:243] Waited 1.34 s on lock 0x7b54000b8454. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:10:48.985694 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3079781760}
I20260709 12:10:48.731215 16911 consensus_queue.cc:1048] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.101s
I20260709 12:10:49.005024 14908 raft_consensus.cc:1240] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [term 4 LEADER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:10:48.764700 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:48.764729 17196 raft_consensus.cc:493] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:10:48.793309 17052 raft_consensus.cc:515] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:49.007720 14185 raft_consensus.cc:1240] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 5. Current term is 6. Ops: [3.4-5.5]
W20260709 12:10:49.023269 14303 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:49.019328 14261 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41768 (request call id 1485) took 5727 ms (client timeout 2225 ms). Trace:
I20260709 12:10:48.978699 17105 raft_consensus.cc:493] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:10:49.008404 14334 consensus_queue.cc:260] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:10:49.033353 14261 rpcz_store.cc:269] 0709 12:10:43.273670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:43.276413 (+  2743us) service_pool.cc:224] Handling call
0709 12:10:49.001048 (+5724635us) spinlock_profiling.cc:243] Waited 3.9 s on lock 0x7b5400200dd4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:10:49.001221 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8963044608}
I20260709 12:10:49.034437 14334 raft_consensus.cc:3060] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:49.001291 17035 raft_consensus.cc:493] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:10:49.035596 17035 raft_consensus.cc:515] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:49.040148 14229 leader_election.cc:304] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:49.045274 14229 leader_election.cc:304] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:49.046854 14229 leader_election.cc:304] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:49.050005 14910 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53194 (request call id 735) took 1637 ms. Trace:
I20260709 12:10:49.052974 14910 rpcz_store.cc:276] 0709 12:10:47.412286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:47.580376 (+168090us) service_pool.cc:224] Handling call
0709 12:10:47.597956 (+ 17580us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:47.699166 (+101210us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:48.394410 (+695244us) spinlock_profiling.cc:243] Waited 36.2 ms on lock 0x7b540039f1a0. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f21270b2dc0 00007f212713ea02 00007f212713add6 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2
0709 12:10:49.049635 (+655225us) spinlock_profiling.cc:243] Waited 29.6 ms on lock 0x7b540039eed4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:10:49.049921 (+   286us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":151298688}
I20260709 12:10:49.054222 14229 leader_election.cc:304] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:49.003578 17072 raft_consensus.cc:2804] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:49.015285 17111 raft_consensus.cc:2749] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:10:49.064682 14303 connection.cc:256] RPC call timeout handler was delayed by -1.005603457999996s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1766s for a response
W20260709 12:10:49.063247 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 75627.8us
I20260709 12:10:49.073783 14155 leader_election.cc:304] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:49.073673 14303 leader_election.cc:304] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:49.041708 17132 raft_consensus.cc:2804] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:49.037482 17105 raft_consensus.cc:3060] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:10:49.068374 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 56854.2us
I20260709 12:10:49.026762 17196 raft_consensus.cc:3060] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:49.014526 17194 raft_consensus.cc:3060] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:49.079066 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:49.024816 17206 raft_consensus.cc:2804] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:10:49.078636 14264 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41764 (request call id 2282) took 1511 ms (client timeout 1848 ms). Trace:
W20260709 12:10:49.109926 14264 rpcz_store.cc:269] 0709 12:10:47.567311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:47.651219 (+ 83908us) service_pool.cc:224] Handling call
0709 12:10:49.078409 (+1427190us) spinlock_profiling.cc:243] Waited 443 ms on lock 0x7b54002fd854. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:10:49.078542 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1018521856}
I20260709 12:10:49.043448 17159 raft_consensus.cc:1081] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 8 LEADER]: Signalling peer 17aab1bbf5014936aa18cc21818b26ec to start an election
I20260709 12:10:49.095198 14334 raft_consensus.cc:2468] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 5.
W20260709 12:10:49.069136 17074 consensus_meta.cc:287] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 1.038s	user 0.011s	sys 0.010s
I20260709 12:10:49.070225 17181 raft_consensus.cc:2804] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:10:49.079684 16544 consensus_meta.cc:287] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.555s	user 0.006s	sys 0.006s
I20260709 12:10:49.063247 17210 raft_consensus.cc:2749] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:49.109099 17214 raft_consensus.cc:2749] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:49.134672 17074 raft_consensus.cc:515] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:49.068868 17190 raft_consensus.cc:2804] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:49.056589 17184 consensus_queue.cc:1059] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.070s
I20260709 12:10:49.119307 17052 leader_election.cc:290] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 11 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:49.119745 17101 raft_consensus.cc:2804] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:49.162751 17101 raft_consensus.cc:493] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:49.163268 17101 raft_consensus.cc:3060] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:49.138753 17112 consensus_meta.cc:287] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.645s	user 0.006s	sys 0.002s
I20260709 12:10:49.164045 17112 raft_consensus.cc:2749] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:49.070071 17072 raft_consensus.cc:493] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:49.056283 17204 raft_consensus.cc:2749] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:10:49.103996 17199 log.cc:927] Time spent T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 12:10:49.144471 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:10:49.121703 17045 consensus_meta.cc:287] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.962s	user 0.003s	sys 0.009s
W20260709 12:10:49.130177 17063 consensus_meta.cc:287] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 1.042s	user 0.026s	sys 0.010s
I20260709 12:10:49.133875 14903 raft_consensus.cc:1240] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:10:49.112792 14303 leader_election.cc:304] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:49.055677 16943 consensus_queue.cc:1059] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.062s
W20260709 12:10:49.162953 17107 consensus_meta.cc:287] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.642s	user 0.010s	sys 0.009s
W20260709 12:10:49.071362 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 261784us
I20260709 12:10:49.156028 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:10:49.127113 16737 consensus_meta.cc:287] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 1.149s	user 0.013s	sys 0.007s
I20260709 12:10:49.114481 17200 raft_consensus.cc:2749] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:10:49.128309 16696 consensus_meta.cc:287] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.878s	user 0.008s	sys 0.006s
W20260709 12:10:49.128952 17089 consensus_meta.cc:287] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.830s	user 0.007s	sys 0.013s
W20260709 12:10:49.137691 17175 consensus_meta.cc:287] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.718s	user 0.010s	sys 0.010s
I20260709 12:10:49.139653 17070 raft_consensus.cc:515] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:10:49.114691 17034 consensus_meta.cc:287] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.968s	user 0.028s	sys 0.011s
I20260709 12:10:49.143611 17181 raft_consensus.cc:493] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:49.143826 17132 raft_consensus.cc:697] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 6 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
W20260709 12:10:49.186748 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 74030.3us
I20260709 12:10:49.191581 14877 leader_election.cc:304] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:49.156195 17190 raft_consensus.cc:493] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
W20260709 12:10:49.211654 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 137970us
I20260709 12:10:49.232919 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:49.179873 17072 raft_consensus.cc:3060] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:49.154426 16544 raft_consensus.cc:515] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:10:49.224650 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 170544us
I20260709 12:10:49.193393 17170 raft_consensus.cc:2749] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:10:49.216789 17095 consensus_meta.cc:287] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 1.203s	user 0.024s	sys 0.000s
I20260709 12:10:49.163522 17074 leader_election.cc:290] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 6 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:49.234661 14877 leader_election.cc:400] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 6 election: Vote denied by peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957) with higher term. Message: Invalid argument: T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db for earlier term 6. Current term is 7.
I20260709 12:10:49.259994 14155 leader_election.cc:304] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:49.258430 14229 leader_election.cc:304] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:49.183105 17045 raft_consensus.cc:515] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:49.264379 14229 leader_election.cc:304] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:49.263623 14155 leader_election.cc:304] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:49.267035 14229 leader_election.cc:304] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
W20260709 12:10:49.225658 17018 consensus_meta.cc:287] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 1.327s	user 0.022s	sys 0.000s
I20260709 12:10:49.267830 14155 leader_election.cc:304] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:49.204710 17107 raft_consensus.cc:515] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:49.274540 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:49.272233 14906 raft_consensus.cc:1240] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:49.226197 17181 raft_consensus.cc:3060] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:49.274379 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:49.207993 16737 raft_consensus.cc:515] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:49.281981 17045 leader_election.cc:290] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 6 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:10:49.264065 17193 consensus_meta.cc:287] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.757s	user 0.011s	sys 0.004s
I20260709 12:10:49.277427 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:49.279165 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:49.280547 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:10:49.271337 17204 raft_consensus.cc:2804] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:49.281486 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:49.282155 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:49.226037 17034 raft_consensus.cc:515] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:49.282691 17052 raft_consensus.cc:2804] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:49.282073 17095 raft_consensus.cc:2749] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:10:49.216207 16696 raft_consensus.cc:515] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:49.281075 14908 raft_consensus.cc:1275] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 5 LEARNER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:10:49.286474 14229 leader_election.cc:304] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:49.234999 17159 raft_consensus.cc:2749] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:10:49.235661 17190 raft_consensus.cc:3060] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:49.354984 14331 raft_consensus.cc:1240] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:49.356222 14333 raft_consensus.cc:2393] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 7: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
W20260709 12:10:49.289779 17168 consensus_meta.cc:287] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 1.126s	user 0.005s	sys 0.019s
I20260709 12:10:49.290095 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:49.292687 14907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:49.217427 17089 raft_consensus.cc:515] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:49.190856 17063 raft_consensus.cc:515] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:49.337584 14258 raft_consensus.cc:3060] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:49.353526 17181 raft_consensus.cc:515] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:49.364394 14257 raft_consensus.cc:1240] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 6. Current term is 7. Ops: []
W20260709 12:10:49.340039 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 51986.2us
I20260709 12:10:49.366145 14912 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59144 (request call id 284) took 1309 ms. Trace:
I20260709 12:10:49.366565 14912 rpcz_store.cc:276] 0709 12:10:48.057161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:48.058768 (+  1607us) service_pool.cc:224] Handling call
0709 12:10:48.059039 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:48.783813 (+724774us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:49.365879 (+582066us) spinlock_profiling.cc:243] Waited 703 ms on lock 0x7b54007481d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:10:49.366074 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1617261440}
I20260709 12:10:49.340703 14265 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f52421be255e4fab824173d17981b5bb"
dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
 from {username='slave'} at 127.0.0.1:53050
I20260709 12:10:49.269673 17200 raft_consensus.cc:2804] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:49.368209 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:49.368592 17200 raft_consensus.cc:697] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 6 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:10:49.369822 14330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50856 (request call id 1839) took 1224 ms. Trace:
I20260709 12:10:49.369534 17200 consensus_queue.cc:237] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } }
I20260709 12:10:49.370203 14339 raft_consensus.cc:1275] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 12:10:49.370692 14339 pending_rounds.cc:85] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c: Aborting all ops after (but not including) 6
I20260709 12:10:49.370919 14339 pending_rounds.cc:107] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 12:10:49.269421 16943 raft_consensus.cc:2749] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:49.370218 14330 rpcz_store.cc:276] 0709 12:10:48.145392 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:48.191252 (+ 45860us) service_pool.cc:224] Handling call
0709 12:10:49.369546 (+1178294us) spinlock_profiling.cc:243] Waited 611 ms on lock 0x7b540023c154. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:10:49.369748 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1405790592}
I20260709 12:10:49.271625 17184 raft_consensus.cc:493] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:49.372121 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:49.372905 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:49.371182 14339 raft_consensus.cc:2889] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:49.373909 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:10:49.344806 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 58463.3us
W20260709 12:10:49.348217 14290 heartbeater.cc:646] Failed to heartbeat to 127.12.174.190:39655 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.12.174.190:39655 timed out after 15.000s (SENT)
I20260709 12:10:49.349619 16544 leader_election.cc:290] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 7 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:49.350167 17034 leader_election.cc:290] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 7 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:10:49.336040 17108 consensus_meta.cc:287] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 1.011s	user 0.012s	sys 0.016s
I20260709 12:10:49.345964 17052 raft_consensus.cc:493] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:49.352238 16737 leader_election.cc:290] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 7 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:49.352207 16696 leader_election.cc:290] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 7 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:49.372709 17184 raft_consensus.cc:515] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:49.272991 17210 raft_consensus.cc:2749] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:49.374612 17051 consensus_queue.cc:1048] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:49.382294 14303 leader_election.cc:304] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:49.375890 14229 leader_election.cc:304] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:49.358426 17216 raft_consensus.cc:2749] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:49.393874 17052 raft_consensus.cc:3060] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:49.391682 14907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:10:49.339252 17193 raft_consensus.cc:515] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:49.395387 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:49.436553 14337 raft_consensus.cc:2468] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 7.
I20260709 12:10:49.398891 14155 leader_election.cc:304] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:49.401108 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:49.364289 17198 raft_consensus.cc:3055] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:49.287388 17018 raft_consensus.cc:515] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:49.415944 14229 leader_election.cc:304] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:49.417048 17185 raft_consensus.cc:2804] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:10:49.387962 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 385612us
W20260709 12:10:49.412281 17084 consensus_meta.cc:287] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.754s	user 0.017s	sys 0.004s
I20260709 12:10:49.235159 17197 consensus_queue.cc:1059] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.108s
I20260709 12:10:49.339371 17204 raft_consensus.cc:493] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:49.431198 14265 raft_consensus.cc:493] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:49.444156 14265 raft_consensus.cc:3060] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:49.394567 17108 raft_consensus.cc:515] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:49.439142 14229 leader_election.cc:304] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:49.383680 17168 raft_consensus.cc:515] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:49.357563 17132 consensus_queue.cc:237] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:49.344309 17170 consensus_queue.cc:1059] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.054s
I20260709 12:10:49.438463 16696 raft_consensus.cc:2749] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:10:49.443570 17215 log.cc:927] Time spent T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 12:10:49.447029 17089 leader_election.cc:290] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 8 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:49.447188 17181 leader_election.cc:290] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 7 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:49.448153 17107 leader_election.cc:290] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 8 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:10:49.505700 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 66656.7us
I20260709 12:10:49.505961 16943 raft_consensus.cc:2804] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:49.439685 17198 raft_consensus.cc:740] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:10:49.442206 17156 raft_consensus.cc:2749] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:49.452796 17105 raft_consensus.cc:515] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:49.453361 14907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:10:49.456478 14338 raft_consensus.cc:2393] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 7: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:10:49.465564 14155 leader_election.cc:304] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:49.466849 14336 raft_consensus.cc:1240] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:49.480628 14258 raft_consensus.cc:2468] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 6.
I20260709 12:10:49.450924 17063 leader_election.cc:290] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 7 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:49.442750 17216 raft_consensus.cc:2749] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:49.511274 14332 raft_consensus.cc:2393] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 7: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:10:49.504802 17185 raft_consensus.cc:697] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 7 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:10:49.453976 17084 raft_consensus.cc:515] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:49.707665 14259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41764 (request call id 2296) took 1043 ms. Trace:
I20260709 12:10:49.713469 14259 rpcz_store.cc:276] 0709 12:10:48.664402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:48.664636 (+   234us) service_pool.cc:224] Handling call
0709 12:10:48.677120 (+ 12484us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:48.677570 (+   450us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:48.677603 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:48.763580 (+ 85977us) log.cc:844] Serialized 572 byte log entry
0709 12:10:49.152705 (+389125us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:49.152750 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:49.152827 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:49.505907 (+353080us) raft_consensus.cc:1685] finished
0709 12:10:49.505931 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:49.707583 (+201652us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":388686,"threads_started":1,"wal-append.queue_time_us":469986}
I20260709 12:10:49.715713 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:10:49.713985 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 248492us
I20260709 12:10:49.455775 17204 raft_consensus.cc:3060] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:49.524060 16943 raft_consensus.cc:493] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:49.748725 14338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50856 (request call id 1855) took 1036 ms. Trace:
W20260709 12:10:49.641716 17196 consensus_meta.cc:287] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.526s	user 0.011s	sys 0.000s
I20260709 12:10:49.734370 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:10:49.704638 17218 log.cc:927] Time spent T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.182s	user 0.000s	sys 0.001s
I20260709 12:10:49.749203 14338 rpcz_store.cc:276] 0709 12:10:48.712983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:49.377950 (+664967us) service_pool.cc:224] Handling call
0709 12:10:49.748649 (+370699us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:49.750638 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:49.753324 14330 raft_consensus.cc:2393] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 8: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:10:49.738588 14265 raft_consensus.cc:515] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:49.754667 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:49.755366 14258 raft_consensus.cc:2468] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 4.
I20260709 12:10:49.515709 17070 leader_election.cc:290] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 7 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:10:49.715502 17206 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.034s	sys 0.084s
I20260709 12:10:49.616572 17180 raft_consensus.cc:493] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:49.760218 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:49.761786 14337 raft_consensus.cc:2368] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 5. Current term is 6.
I20260709 12:10:49.730410 17200 raft_consensus.cc:2764] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:10:49.762253 14184 raft_consensus.cc:1240] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 12:10:49.763628 14337 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50858 (request call id 1516) took 1037 ms. Trace:
I20260709 12:10:49.719283 16696 raft_consensus.cc:3055] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:49.763692 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:49.764671 14184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56046 (request call id 1960) took 1992 ms. Trace:
I20260709 12:10:49.751528 16943 raft_consensus.cc:3060] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:49.717520 17168 leader_election.cc:290] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 6 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:49.765553 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:49.765048 14184 rpcz_store.cc:276] 0709 12:10:47.771853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:48.256531 (+484678us) service_pool.cc:224] Handling call
0709 12:10:49.761785 (+1505254us) spinlock_profiling.cc:243] Waited 29.5 ms on lock 0x7b5800001298. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2124016b71 00007f2124016a22 00007f212cf2f8d9 00007f212c089ee0 00007f212c1530ab 00007f212c153131 00007f212c114fc0 00007f212c0ff929 00007f212c0ff3d2 00007f2125676bd4
0709 12:10:49.762012 (+   227us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:49.764364 (+  2352us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:49.764614 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":67752192}
I20260709 12:10:49.764866 14337 rpcz_store.cc:276] 0709 12:10:48.726285 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:49.727342 (+1001057us) service_pool.cc:224] Handling call
0709 12:10:49.763454 (+ 36112us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:49.767954 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:49.719255 17156 raft_consensus.cc:493] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
W20260709 12:10:49.762725 17206 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.577s	user 0.049s	sys 0.098s
I20260709 12:10:49.759100 17196 raft_consensus.cc:515] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:49.767493 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:10:49.778410 17018 leader_election.cc:290] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 4 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:49.782483 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:49.784246 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:49.785979 14337 raft_consensus.cc:2468] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 2.
I20260709 12:10:49.787740 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:49.786247 14155 leader_election.cc:400] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 election: Vote denied by peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957) with higher term. Message: Invalid argument: T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 5. Current term is 6.
I20260709 12:10:49.788321 14155 leader_election.cc:403] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:10:49.789222 17210 raft_consensus.cc:3060] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:49.792483 14903 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59144 (request call id 286) took 1734 ms. Trace:
I20260709 12:10:49.792976 14903 rpcz_store.cc:276] 0709 12:10:48.057818 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:48.057939 (+   121us) service_pool.cc:224] Handling call
0709 12:10:48.058342 (+   403us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:49.208922 (+1150580us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:49.792023 (+583101us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b540047a254. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:10:49.792406 (+   383us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2410386688}
I20260709 12:10:49.784927 17156 raft_consensus.cc:515] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:49.786607 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:49.803478 14184 raft_consensus.cc:1275] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:10:49.804749 14332 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50856 (request call id 1842) took 1658 ms (client timeout 2051 ms). Trace:
I20260709 12:10:49.751013 17190 raft_consensus.cc:515] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:49.806586 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:49.807384 14260 raft_consensus.cc:2393] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 5: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:10:49.808048 17190 leader_election.cc:290] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:49.808233 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:49.794978 17216 raft_consensus.cc:493] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:49.812342 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:10:49.805246 14332 rpcz_store.cc:269] 0709 12:10:48.146007 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:48.169486 (+ 23479us) service_pool.cc:224] Handling call
0709 12:10:49.804510 (+1635024us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b5400146754. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:10:49.804658 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3028950400}
I20260709 12:10:49.765961 16696 raft_consensus.cc:740] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:49.590356 17194 raft_consensus.cc:515] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:49.845616 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:49.846751 14332 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50858 (request call id 1513) took 1134 ms. Trace:
I20260709 12:10:49.847242 14332 rpcz_store.cc:276] 0709 12:10:48.711963 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:49.845218 (+1133255us) service_pool.cc:224] Handling call
0709 12:10:49.846663 (+  1445us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:49.766142 17180 raft_consensus.cc:515] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:49.864006 14263 raft_consensus.cc:2393] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db in current term 6: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:10:49.852435 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:49.777889 17206 raft_consensus.cc:697] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 6 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:49.556695 17198 consensus_queue.cc:260] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:49.880388 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:49.881946 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:49.882850 14332 raft_consensus.cc:2368] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 6. Current term is 7.
I20260709 12:10:49.845018 17216 raft_consensus.cc:515] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:49.867195 17234 consensus_queue.cc:1048] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 12:10:49.890257 17198 raft_consensus.cc:3060] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:49.905993 17230 log.cc:927] Time spent T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
I20260709 12:10:49.910401 17206 consensus_queue.cc:237] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:49.848817 17185 consensus_queue.cc:237] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:10:49.916471 17072 consensus_meta.cc:287] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.649s	user 0.007s	sys 0.003s
I20260709 12:10:49.917023 17184 leader_election.cc:290] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:49.918166 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:49.919103 14332 raft_consensus.cc:2393] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 7: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:10:49.923954 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:10:49.889595 16696 consensus_queue.cc:260] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:49.926743 16696 raft_consensus.cc:3060] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:49.927959 17108 leader_election.cc:290] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 7 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:49.924149 17084 leader_election.cc:290] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 8 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:10:49.932559 17101 consensus_meta.cc:287] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.769s	user 0.012s	sys 0.002s
I20260709 12:10:49.933077 17101 raft_consensus.cc:515] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:49.933619 14339 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 458) took 1639 ms. Trace:
I20260709 12:10:49.934252 14908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:10:49.926736 17180 leader_election.cc:290] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:49.937080 17052 raft_consensus.cc:515] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:49.934047 14339 rpcz_store.cc:276] 0709 12:10:48.294630 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:48.375203 (+ 80573us) service_pool.cc:224] Handling call
0709 12:10:49.369720 (+994517us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:49.374274 (+  4554us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:49.933396 (+559122us) spinlock_profiling.cc:243] Waited 991 ms on lock 0x7b540023c150. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713a8ad 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:10:49.933546 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2279567232}
I20260709 12:10:49.920116 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:49.942081 14332 raft_consensus.cc:2393] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 8: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:10:49.943392 17196 leader_election.cc:290] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:49.934650 17194 leader_election.cc:290] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:49.895308 17156 leader_election.cc:290] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:49.945063 14336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 454) took 2141 ms. Trace:
I20260709 12:10:49.946108 14336 rpcz_store.cc:276] 0709 12:10:47.803305 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:47.880636 (+ 77331us) service_pool.cc:224] Handling call
0709 12:10:47.880914 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:49.714650 (+1833736us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:49.944752 (+230102us) spinlock_profiling.cc:243] Waited 1.59 s on lock 0x7b540024fed4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:10:49.944980 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3646813568}
I20260709 12:10:49.947870 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:49.948690 14336 raft_consensus.cc:2393] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 8: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:10:49.917044 17072 raft_consensus.cc:515] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:49.953183 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 8 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:49.954336 14335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50856 (request call id 1848) took 1765 ms. Trace:
I20260709 12:10:49.954598 14339 raft_consensus.cc:2393] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 8: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:10:49.944937 17085 raft_consensus.cc:3060] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:49.949635 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:49.956847 14335 rpcz_store.cc:276] 0709 12:10:48.188689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:48.301344 (+112655us) service_pool.cc:224] Handling call
0709 12:10:48.301728 (+   384us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:48.731171 (+429443us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:49.954039 (+1222868us) spinlock_profiling.cc:243] Waited 409 ms on lock 0x7b540023b254. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:10:49.954255 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":939834112}
I20260709 12:10:49.956508 14229 leader_election.cc:304] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
W20260709 12:10:49.959983 14303 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:49.958880 14339 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50858 (request call id 1508) took 1249 ms. Trace:
I20260709 12:10:49.958271 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:49.960168 14229 leader_election.cc:304] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:49.960743 17194 raft_consensus.cc:2749] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:49.962769 17216 leader_election.cc:290] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:10:49.960474 17172 consensus_meta.cc:287] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 1.311s	user 0.013s	sys 0.003s
I20260709 12:10:49.961241 14339 rpcz_store.cc:276] 0709 12:10:48.709266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:49.940330 (+1231064us) service_pool.cc:224] Handling call
0709 12:10:49.958799 (+ 18469us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:49.966045 14335 raft_consensus.cc:3060] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:49.968116 14877 leader_election.cc:304] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:49.957106 14336 raft_consensus.cc:2393] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 6: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:10:49.970835 14229 leader_election.cc:304] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
W20260709 12:10:49.972848 14228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:49.965596 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:49.978379 14338 raft_consensus.cc:2393] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 3: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:10:49.980022 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:49.981369 14908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:10:49.956722 17101 leader_election.cc:290] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:49.991888 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:49.992857 14332 raft_consensus.cc:2393] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 7: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:10:49.976796 17202 raft_consensus.cc:2749] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:49.978912 17184 raft_consensus.cc:2749] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:49.984581 17234 raft_consensus.cc:2804] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:50.000262 14335 raft_consensus.cc:2468] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 11.
I20260709 12:10:50.004802 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: true dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:50.005061 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:50.005466 14335 raft_consensus.cc:3060] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:50.005901 14332 raft_consensus.cc:2410] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:10:49.988684 17226 raft_consensus.cc:493] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:50.006856 14261 raft_consensus.cc:2468] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 7.
I20260709 12:10:50.010074 14332 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50858 (request call id 1512) took 1298 ms. Trace:
I20260709 12:10:50.010672 14332 rpcz_store.cc:276] 0709 12:10:48.711622 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:49.993515 (+1281893us) service_pool.cc:224] Handling call
0709 12:10:50.009991 (+ 16476us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:49.981084 17172 raft_consensus.cc:515] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:50.022854 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:50.024863 17072 leader_election.cc:290] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:50.025895 17234 raft_consensus.cc:697] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 6 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:10:50.027053 17234 consensus_queue.cc:237] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:50.014504 17052 leader_election.cc:290] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 6 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:50.042080 14908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:10:50.043869 14182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56652 (request call id 640) took 2190 ms. Trace:
I20260709 12:10:50.015009 17226 raft_consensus.cc:515] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:50.044317 14182 rpcz_store.cc:276] 0709 12:10:47.853821 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:48.305322 (+451501us) service_pool.cc:224] Handling call
0709 12:10:50.043172 (+1737850us) spinlock_profiling.cc:243] Waited 38.5 ms on lock 0x7b5800001298. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2124016b71 00007f2124016a22 00007f212cf2f8d9 00007f212c089ee0 00007f212c1530ab 00007f212c153131 00007f212c114fc0 00007f212c0ff929 00007f212c0ff3d2 00007f2125676bd4
0709 12:10:50.043370 (+   198us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:50.043557 (+   187us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:50.043581 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:50.043620 (+    39us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:50.043648 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:50.043701 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:50.043808 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":88606080}
I20260709 12:10:50.042387 17195 raft_consensus.cc:3055] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:50.047960 17195 raft_consensus.cc:740] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:10:50.048940 17195 consensus_queue.cc:260] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:50.049996 17195 raft_consensus.cc:3060] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:50.053679 17172 leader_election.cc:290] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:50.054929 14908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:10:50.058765 17105 leader_election.cc:290] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 8 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:10:50.062402 17237 log.cc:927] Time spent T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.152s	user 0.002s	sys 0.000s
I20260709 12:10:50.077564 17193 leader_election.cc:290] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 6 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:50.077903 16910 consensus_queue.cc:1048] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:50.079475 16910 consensus_queue.cc:1059] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:50.080323 17053 raft_consensus.cc:493] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:50.080593 16910 raft_consensus.cc:3055] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:50.084844 14155 leader_election.cc:304] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
W20260709 12:10:50.057524 14302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:50.087415 14229 leader_election.cc:304] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:50.088750 14229 leader_election.cc:304] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:50.090500 14335 raft_consensus.cc:2468] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 8.
I20260709 12:10:50.081033 17053 raft_consensus.cc:515] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } }
I20260709 12:10:50.094365 14155 leader_election.cc:304] T f4739bc22bfe44fcba807da02d9351b6 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:50.092126 14265 leader_election.cc:290] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 9 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:50.097767 16943 raft_consensus.cc:515] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:50.099925 14331 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 457) took 1808 ms. Trace:
I20260709 12:10:50.105320 14331 rpcz_store.cc:276] 0709 12:10:48.291517 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:48.365458 (+ 73941us) service_pool.cc:224] Handling call
0709 12:10:48.365795 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:49.355489 (+989694us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:50.099650 (+744161us) spinlock_profiling.cc:243] Waited 989 ms on lock 0x7b540010dbd4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:10:50.099838 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2274470144}
I20260709 12:10:50.106463 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:50.099481 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:50.103891 14908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:10:50.108628 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:50.109447 14259 raft_consensus.cc:2368] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 6. Current term is 7.
I20260709 12:10:50.110023 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:50.103626 17101 consensus_queue.cc:1059] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.007s
I20260709 12:10:50.111318 17101 raft_consensus.cc:3055] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:50.111660 17101 raft_consensus.cc:740] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:10:50.112519 17101 consensus_queue.cc:260] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:50.094368 17172 consensus_queue.cc:1048] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 12:10:50.113669 17101 raft_consensus.cc:3060] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:50.099249 17247 raft_consensus.cc:493] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:50.118221 17247 raft_consensus.cc:515] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:10:50.119059 17227 log.cc:927] Time spent T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.562s	user 0.000s	sys 0.006s
I20260709 12:10:50.119158 14908 raft_consensus.cc:1275] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:10:50.119912 14330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50858 (request call id 1510) took 1409 ms. Trace:
I20260709 12:10:50.120322 14330 rpcz_store.cc:276] 0709 12:10:48.710314 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:49.372635 (+662321us) service_pool.cc:224] Handling call
0709 12:10:50.119708 (+747073us) spinlock_profiling.cc:243] Waited 380 ms on lock 0x7b54002819d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:10:50.119845 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":872977664}
I20260709 12:10:50.121013 17214 consensus_queue.cc:1048] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:50.121537 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:50.122334 14330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50858 (request call id 1524) took 1001 ms. Trace:
I20260709 12:10:50.122788 14330 rpcz_store.cc:276] 0709 12:10:49.120700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:50.121264 (+1000564us) service_pool.cc:224] Handling call
0709 12:10:50.122273 (+  1009us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:50.123955 14330 raft_consensus.cc:1240] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:50.124557 14330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 459) took 1763 ms. Trace:
I20260709 12:10:50.115360 14331 raft_consensus.cc:2393] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 3: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:10:50.101359 17085 raft_consensus.cc:2749] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:50.124869 14330 rpcz_store.cc:276] 0709 12:10:48.361677 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:50.123433 (+1761756us) service_pool.cc:224] Handling call
0709 12:10:50.123768 (+   335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:50.124316 (+   548us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:50.124503 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:50.126257 14331 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50858 (request call id 1525) took 1005 ms. Trace:
I20260709 12:10:50.126336 17229 raft_consensus.cc:3055] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:50.126694 14330 raft_consensus.cc:1240] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:50.126658 14331 rpcz_store.cc:276] 0709 12:10:49.121000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:50.106221 (+985221us) service_pool.cc:224] Handling call
0709 12:10:50.126177 (+ 19956us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:50.087483 17038 raft_consensus.cc:2749] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:10:50.127499 14330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50856 (request call id 1854) took 1461 ms. Trace:
I20260709 12:10:50.081065 16910 raft_consensus.cc:740] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:10:50.127817 14330 rpcz_store.cc:276] 0709 12:10:48.665946 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:50.126174 (+1460228us) service_pool.cc:224] Handling call
0709 12:10:50.126498 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:50.127246 (+   748us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:50.127435 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:50.128597 14331 raft_consensus.cc:1240] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 6 LEADER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:50.129010 14330 raft_consensus.cc:1240] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:50.094100 17202 raft_consensus.cc:2749] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:50.129659 14330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50858 (request call id 1531) took 1006 ms. Trace:
I20260709 12:10:50.130120 14330 rpcz_store.cc:276] 0709 12:10:49.122834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:50.128578 (+1005744us) service_pool.cc:224] Handling call
0709 12:10:50.128847 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:50.129408 (+   561us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:50.129610 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:50.130548 17226 leader_election.cc:290] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:50.131052 17094 raft_consensus.cc:493] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:10:50.131554 17094 raft_consensus.cc:3060] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:50.132277 17246 raft_consensus.cc:493] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:50.132364 17038 consensus_queue.cc:1059] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:50.132936 17246 raft_consensus.cc:515] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:50.133703 17038 consensus_queue.cc:1059] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:10:50.116837 17105 raft_consensus.cc:493] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:50.117296 17132 raft_consensus.cc:493] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:10:50.133967 17156 raft_consensus.cc:3055] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:50.116477 17035 leader_election.cc:290] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:50.124112 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:50.125612 16965 raft_consensus.cc:3060] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:50.130414 14258 raft_consensus.cc:2410] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:10:50.135813 17229 raft_consensus.cc:740] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:50.138443 17246 leader_election.cc:290] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:50.129144 16910 consensus_queue.cc:260] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:50.152040 16750 consensus_queue.cc:1059] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:10:50.152362 17246 raft_consensus.cc:2749] T f4739bc22bfe44fcba807da02d9351b6 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:50.153208 17229 consensus_queue.cc:260] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:50.154454 17229 raft_consensus.cc:3060] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:50.135052 17105 raft_consensus.cc:515] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:50.141467 17156 raft_consensus.cc:740] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:10:50.095340 17190 consensus_queue.cc:1059] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.063s
I20260709 12:10:50.157990 17156 consensus_queue.cc:260] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:50.158674 17190 raft_consensus.cc:3055] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:50.159019 17190 raft_consensus.cc:740] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:10:50.159317 17156 raft_consensus.cc:3060] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:50.159848 17190 consensus_queue.cc:260] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:50.161077 17190 raft_consensus.cc:3060] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:50.080935 17204 raft_consensus.cc:515] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:50.145640 17226 raft_consensus.cc:3055] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:50.163206 17226 raft_consensus.cc:740] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:10:50.164027 17226 consensus_queue.cc:260] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:50.129249 14331 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50858 (request call id 1514) took 1416 ms. Trace:
I20260709 12:10:50.174437 14331 rpcz_store.cc:276] 0709 12:10:48.712732 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:50.127574 (+1414842us) service_pool.cc:224] Handling call
0709 12:10:50.128387 (+   813us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:50.129004 (+   617us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:50.129193 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:50.149237 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:50.176390 14265 raft_consensus.cc:2468] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 8.
W20260709 12:10:50.149911 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 55948.8us
I20260709 12:10:50.176901 17104 consensus_queue.cc:1059] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:50.177791 14155 leader_election.cc:304] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:50.178361 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:50.179600 14155 leader_election.cc:304] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:50.175683 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:50.157838 17105 leader_election.cc:290] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:50.175669 14256 raft_consensus.cc:1240] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:50.186955 14334 raft_consensus.cc:1240] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:50.188558 14334 raft_consensus.cc:1240] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:50.196808 14155 leader_election.cc:304] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:50.144387 14335 raft_consensus.cc:2468] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 7.
I20260709 12:10:50.199877 14335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50858 (request call id 1526) took 1078 ms. Trace:
I20260709 12:10:50.200309 14335 rpcz_store.cc:276] 0709 12:10:49.121315 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:50.109786 (+988471us) service_pool.cc:224] Handling call
0709 12:10:50.199806 (+ 90020us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:50.153201 16910 raft_consensus.cc:3060] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:50.199900 17244 log.cc:927] Time spent T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.143s	user 0.001s	sys 0.001s
I20260709 12:10:50.140202 14330 raft_consensus.cc:1240] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:10:50.198079 14334 raft_consensus.cc:1240] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:50.179601 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:50.210997 14262 raft_consensus.cc:2393] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 6: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
W20260709 12:10:50.200058 17178 log.cc:927] Time spent T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 1.748s	user 0.008s	sys 0.004s
I20260709 12:10:50.213150 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:50.214583 14334 raft_consensus.cc:1240] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:50.186441 17246 raft_consensus.cc:2804] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:10:50.219357 17249 log.cc:927] Time spent T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
W20260709 12:10:50.220873 14156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:50.223349 17247 leader_election.cc:290] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:50.210273 17052 raft_consensus.cc:2749] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:50.231204 16943 leader_election.cc:290] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 7 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:50.233091 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:50.234174 14262 raft_consensus.cc:2368] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 5. Current term is 6.
I20260709 12:10:50.235150 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:50.236146 14334 raft_consensus.cc:1240] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:50.207718 14155 leader_election.cc:304] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:50.216324 14186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56652 (request call id 639) took 2385 ms. Trace:
I20260709 12:10:50.237673 14186 rpcz_store.cc:276] 0709 12:10:47.830845 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:48.300565 (+469720us) service_pool.cc:224] Handling call
0709 12:10:50.215483 (+1914918us) spinlock_profiling.cc:243] Waited 43.1 ms on lock 0x7b5800001298. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2124016b71 00007f2124016a22 00007f212cf2f8d9 00007f212c089ee0 00007f212c1530ab 00007f212c153131 00007f212c114fc0 00007f212c0ff929 00007f212c0ff3d2 00007f2125676bd4
0709 12:10:50.215710 (+   227us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:50.215936 (+   226us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:50.215966 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:50.216015 (+    49us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:50.216069 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:50.216123 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:50.216260 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":99147648}
I20260709 12:10:50.238471 17053 leader_election.cc:290] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:50.147804 17132 raft_consensus.cc:515] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:50.244445 14332 raft_consensus.cc:2468] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 9.
I20260709 12:10:50.245239 14332 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50858 (request call id 1530) took 1122 ms. Trace:
I20260709 12:10:50.245633 14332 rpcz_store.cc:276] 0709 12:10:49.122511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:50.011732 (+889221us) service_pool.cc:224] Handling call
0709 12:10:50.245163 (+233431us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:50.255371 14330 raft_consensus.cc:1275] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:10:50.247206 14155 leader_election.cc:304] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
W20260709 12:10:50.250509 14154 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 118657us
I20260709 12:10:50.206760 17245 raft_consensus.cc:2749] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:50.275067 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: true dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:50.275919 14262 raft_consensus.cc:3055] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:50.261996 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:50.278313 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:50.279125 14189 raft_consensus.cc:3060] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:50.259178 14155 leader_election.cc:304] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:50.259727 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:50.260856 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:50.281109 14190 raft_consensus.cc:2468] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 4.
I20260709 12:10:50.265055 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:50.276261 14262 raft_consensus.cc:740] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:10:50.268090 14185 raft_consensus.cc:1275] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:50.270157 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:50.272038 14336 raft_consensus.cc:2468] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 9.
I20260709 12:10:50.238837 17243 raft_consensus.cc:3055] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:50.282720 14187 raft_consensus.cc:2393] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 11: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:10:50.266521 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:50.286369 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:50.284384 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:50.287082 14187 raft_consensus.cc:3060] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:50.287426 14185 raft_consensus.cc:3060] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:50.287796 14260 raft_consensus.cc:2468] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 7.
I20260709 12:10:50.289587 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:50.290251 14184 raft_consensus.cc:3060] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:10:50.290979 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:50.293833 14155 leader_election.cc:400] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 pre-election: Vote denied by peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673) with higher term. Message: Invalid argument: T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 5. Current term is 6.
I20260709 12:10:50.285442 17243 raft_consensus.cc:740] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:10:50.299571 17132 leader_election.cc:290] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:50.240309 17246 raft_consensus.cc:493] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:50.213909 16750 consensus_queue.cc:1059] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.073s
I20260709 12:10:50.259413 17210 raft_consensus.cc:2749] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957) with higher term. Message: Invalid argument: T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 5. Current term is 6.
I20260709 12:10:50.324209 17210 raft_consensus.cc:2749] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:50.327064 17239 raft_consensus.cc:3055] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:50.327574 17239 raft_consensus.cc:740] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:10:50.328466 17239 consensus_queue.cc:260] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:50.331225 17094 raft_consensus.cc:515] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:50.334115 14183 raft_consensus.cc:2393] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 6: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:10:50.334501 14185 raft_consensus.cc:2468] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 7.
I20260709 12:10:50.335683 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:50.336928 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:50.338091 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:50.338321 17243 consensus_queue.cc:260] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:50.340505 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
W20260709 12:10:50.307366 14229 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.174.129:37187 timed out after 1.592s (SENT) [suppressed 24 similar messages]
I20260709 12:10:50.251029 17156 raft_consensus.cc:2749] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:50.311733 14184 raft_consensus.cc:2468] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 6.
I20260709 12:10:50.305408 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:50.314554 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:50.368884 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:50.272790 17052 raft_consensus.cc:2764] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:10:50.369874 14184 raft_consensus.cc:3060] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:50.321115 17246 raft_consensus.cc:3060] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:50.348779 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:50.361030 14304 leader_election.cc:304] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:50.360901 14185 raft_consensus.cc:3060] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:50.365878 14303 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:50.286662 14262 consensus_queue.cc:260] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:50.369958 14188 raft_consensus.cc:2468] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 6.
I20260709 12:10:50.313256 14155 leader_election.cc:403] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:50.333475 17094 leader_election.cc:290] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 6 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:50.378075 14262 raft_consensus.cc:3060] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:50.377841 14304 leader_election.cc:304] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
W20260709 12:10:50.376626 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 191021us
W20260709 12:10:50.379325 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 85741.6us
I20260709 12:10:50.379699 14187 raft_consensus.cc:2468] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 8.
I20260709 12:10:50.387208 14155 leader_election.cc:304] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:50.389380 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 8 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:50.390268 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:50.398447 14184 raft_consensus.cc:2468] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 8.
I20260709 12:10:50.388237 14181 raft_consensus.cc:2376] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 8. Re-sending same reply.
I20260709 12:10:50.400033 14184 raft_consensus.cc:1275] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:10:50.400624 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:50.380682 17101 raft_consensus.cc:493] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:50.403800 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:50.404219 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:50.405488 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:50.406080 14182 raft_consensus.cc:3060] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:10:50.382911 17245 raft_consensus.cc:2749] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673) with higher term. Message: Invalid argument: T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 5. Current term is 6.
I20260709 12:10:50.407681 14337 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50858 (request call id 1529) took 1285 ms. Trace:
W20260709 12:10:50.407869 14228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:50.408111 14337 rpcz_store.cc:276] 0709 12:10:49.122224 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:49.787465 (+665241us) service_pool.cc:224] Handling call
0709 12:10:50.407493 (+620028us) spinlock_profiling.cc:243] Waited 441 ms on lock 0x7b540001b154. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:10:50.407620 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1013967616}
I20260709 12:10:50.387446 17034 raft_consensus.cc:2804] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:50.412695 14908 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61"
dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
mode: GRACEFUL
new_leader_uuid: "17aab1bbf5014936aa18cc21818b26ec"
 from {username='slave'} at 127.0.0.1:38628
I20260709 12:10:50.413641 14908 raft_consensus.cc:606] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 6 LEADER]: Received request to transfer leadership to TS 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:10:50.414590 14189 raft_consensus.cc:2468] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 7.
I20260709 12:10:50.415223 14155 leader_election.cc:304] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:50.414062 17034 raft_consensus.cc:493] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:10:50.417405 17034 raft_consensus.cc:3060] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:50.416388 17105 raft_consensus.cc:2955] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 5 LEADER]: Committing config change with OpId 5.6: config changed from index 5 to 6, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:10:50.422590 14182 raft_consensus.cc:2468] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 7.
W20260709 12:10:50.424204 17222 log.cc:927] Time spent T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 1.242s	user 0.005s	sys 0.006s
I20260709 12:10:50.426388 14189 raft_consensus.cc:1240] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:50.411999 17094 raft_consensus.cc:2749] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:50.432353 14185 raft_consensus.cc:2468] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 3.
W20260709 12:10:50.434342 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 127042us
I20260709 12:10:50.436057 14184 raft_consensus.cc:3055] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:50.436511 14184 raft_consensus.cc:740] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:10:50.440801 14155 leader_election.cc:400] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 6 pre-election: Vote denied by peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957) with higher term. Message: Invalid argument: T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 6. Current term is 7.
I20260709 12:10:50.443641 14155 leader_election.cc:403] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:50.444360 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:50.445305 14185 raft_consensus.cc:2468] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 7.
I20260709 12:10:50.445585 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
W20260709 12:10:50.435931 17255 log.cc:927] Time spent T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.115s	user 0.001s	sys 0.000s
I20260709 12:10:50.411109 17101 raft_consensus.cc:515] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:50.450935 14229 leader_election.cc:304] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
W20260709 12:10:50.438500 17232 log.cc:927] Time spent T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.863s	user 0.005s	sys 0.000s
I20260709 12:10:50.451261 14155 leader_election.cc:304] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:50.455004 14155 leader_election.cc:304] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:50.466583 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:50.468094 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:50.468997 14260 raft_consensus.cc:2410] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:10:50.478457 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:50.479360 14260 raft_consensus.cc:3060] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:50.450359 14184 consensus_queue.cc:260] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:50.483896 14155 leader_election.cc:304] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:50.441851 16696 raft_consensus.cc:493] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:50.444634 17245 raft_consensus.cc:2804] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:50.489511 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:50.490480 14258 raft_consensus.cc:2376] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 7. Re-sending same reply.
W20260709 12:10:50.502004 14155 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:50.503189 14260 raft_consensus.cc:2468] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 6.
I20260709 12:10:50.452956 16831 raft_consensus.cc:2749] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:50.506654 14330 raft_consensus.cc:1240] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:50.510577 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:50.511472 14330 raft_consensus.cc:2393] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 5: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:10:50.507779 14184 raft_consensus.cc:3060] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:50.449424 17250 raft_consensus.cc:2749] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957) with higher term. Message: Invalid argument: T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 6. Current term is 7.
I20260709 12:10:50.514041 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:50.504282 14155 leader_election.cc:304] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:50.525873 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:50.526613 14260 raft_consensus.cc:2410] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:10:50.528120 14184 raft_consensus.cc:1275] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:50.486097 17094 raft_consensus.cc:2749] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:50.536973 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:50.537755 14337 raft_consensus.cc:2468] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 8.
I20260709 12:10:50.538902 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:50.539842 14332 raft_consensus.cc:2393] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 6: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:10:50.541219 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:50.487758 17038 raft_consensus.cc:3060] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:10:50.545704 14229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:50.488384 17184 raft_consensus.cc:493] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:50.504758 17063 raft_consensus.cc:493] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:50.499814 17245 raft_consensus.cc:493] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:50.553990 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:50.550341 14908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:10:50.550279 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: true dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:10:50.514030 17156 raft_consensus.cc:3060] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:50.557137 14912 raft_consensus.cc:3055] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:50.560206 14912 raft_consensus.cc:740] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:10:50.561199 14912 consensus_queue.cc:260] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:50.562347 14912 raft_consensus.cc:3060] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:50.557907 17063 raft_consensus.cc:515] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:50.567152 17063 leader_election.cc:290] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:50.568588 14185 raft_consensus.cc:1240] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:50.570046 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:50.536151 17052 raft_consensus.cc:2804] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:50.570976 14185 raft_consensus.cc:3060] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:50.585302 17052 raft_consensus.cc:697] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 7 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:10:50.569451 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:50.500120 16696 raft_consensus.cc:515] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } }
I20260709 12:10:50.549620 17210 raft_consensus.cc:493] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:50.590389 17210 raft_consensus.cc:515] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:10:50.591388 14338 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50858 (request call id 1521) took 1519 ms (client timeout 1641 ms). Trace:
I20260709 12:10:50.591678 16696 leader_election.cc:290] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:50.592655 17210 leader_election.cc:290] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:50.559746 17245 raft_consensus.cc:3060] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:50.602927 14336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55492 (request call id 462) took 1318 ms. Trace:
I20260709 12:10:50.601660 14088 catalog_manager.cc:5697] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: term changed from 1 to 4. New cstate: current_term: 4 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } }
W20260709 12:10:50.603868 14338 rpcz_store.cc:269] 0709 12:10:49.072133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:49.752981 (+680848us) service_pool.cc:224] Handling call
0709 12:10:50.591151 (+838170us) spinlock_profiling.cc:243] Waited 208 ms on lock 0x7b54002a6054. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:10:50.591312 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":477518208}
I20260709 12:10:50.603415 14336 rpcz_store.cc:276] 0709 12:10:49.284714 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:49.979740 (+695026us) service_pool.cc:224] Handling call
0709 12:10:50.602706 (+622966us) spinlock_profiling.cc:243] Waited 264 ms on lock 0x7b54000b8e54. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:10:50.602849 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":607622400}
I20260709 12:10:50.604481 14088 catalog_manager.cc:5697] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: term changed from 4 to 5, leader changed from 65c9c1653b3346b39a0e118540e6080c (127.12.174.131) to 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130). New cstate: current_term: 5 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:50.578953 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:10:50.558480 17184 raft_consensus.cc:515] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:50.610297 17184 leader_election.cc:290] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:50.602080 14335 raft_consensus.cc:1240] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:50.604507 17101 leader_election.cc:290] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:50.612227 14264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53050 (request call id 494) took 1348 ms. Trace:
I20260709 12:10:50.612695 14264 rpcz_store.cc:276] 0709 12:10:49.263377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:49.263559 (+   182us) service_pool.cc:224] Handling call
0709 12:10:50.611497 (+1347938us) spinlock_profiling.cc:243] Waited 1.16 ms on lock 0x7b5800060c98. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2124016b71 00007f2124016eee 000000000036eb39 00007f212c08a1e0 00007f212c1530c4 00007f212c153131 00007f212c114fc0 00007f212c0ff929 00007f212c0ff3d2 00007f2125676bd4
0709 12:10:50.611687 (+   190us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:50.611896 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:50.611923 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:50.611968 (+    45us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:50.612000 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:50.612049 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:50.612157 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2682624}
I20260709 12:10:50.602454 17052 consensus_queue.cc:237] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:10:50.578233 17252 log.cc:927] Time spent T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.157s	user 0.000s	sys 0.001s
I20260709 12:10:50.617667 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:50.619100 14155 leader_election.cc:304] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:50.619591 14258 raft_consensus.cc:2393] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 5: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:10:50.620888 14155 leader_election.cc:304] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:10:50.622383 17153 raft_consensus.cc:2749] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:50.623188 17153 raft_consensus.cc:2804] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:10:50.623677 17153 raft_consensus.cc:697] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 11 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:10:50.624900 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:50.624657 17153 consensus_queue.cc:237] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:50.625499 14259 raft_consensus.cc:3060] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:50.644912 17226 raft_consensus.cc:3060] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:50.645062 14185 raft_consensus.cc:2468] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 5.
I20260709 12:10:50.646054 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:50.646561 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:50.639091 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:50.648605 14189 raft_consensus.cc:2468] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 6.
I20260709 12:10:50.642158 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:50.649538 14181 raft_consensus.cc:2368] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 6. Current term is 7.
I20260709 12:10:50.650396 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:50.651013 14181 raft_consensus.cc:2468] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 5.
I20260709 12:10:50.652258 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:50.652335 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:50.652983 14181 raft_consensus.cc:2393] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 6: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:10:50.642959 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:50.654846 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:50.655694 14257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53050 (request call id 502) took 1307 ms. Trace:
I20260709 12:10:50.655920 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:50.656678 14182 raft_consensus.cc:2368] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 5. Current term is 6.
I20260709 12:10:50.658613 14189 raft_consensus.cc:1240] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:50.640443 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:50.660005 14260 raft_consensus.cc:2393] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 7: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
W20260709 12:10:50.663591 14230 connection.cc:256] RPC call timeout handler was delayed by -1.733230476000017s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2862s for a response
W20260709 12:10:50.664237 14230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:50.664789 14230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:50.665228 14230 connection.cc:256] RPC call timeout handler was delayed by -1.5334304760001487s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3084s for a response
I20260709 12:10:50.666376 17202 raft_consensus.cc:493] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:10:50.666960 17202 raft_consensus.cc:515] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:50.668018 14336 raft_consensus.cc:1240] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:50.668377 14339 raft_consensus.cc:1240] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 10. Current term is 11. Ops: []
I20260709 12:10:50.669152 17202 leader_election.cc:290] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:50.669420 14338 raft_consensus.cc:1240] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:50.669764 14337 raft_consensus.cc:1240] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:50.670535 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:50.671167 14337 raft_consensus.cc:1240] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:50.671425 14256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53050 (request call id 505) took 1251 ms. Trace:
I20260709 12:10:50.671792 14256 rpcz_store.cc:276] 0709 12:10:49.419634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:49.440985 (+ 21351us) service_pool.cc:224] Handling call
0709 12:10:49.441765 (+   780us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:50.185880 (+744115us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:50.671203 (+485323us) spinlock_profiling.cc:243] Waited 724 ms on lock 0x7b540022abd4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:10:50.671366 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1665956736}
W20260709 12:10:50.672705 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:50.674052 14339 raft_consensus.cc:1240] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 9 LEADER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 12:10:50.659111 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:50.674708 17203 raft_consensus.cc:3055] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:10:50.675246 14333 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50856 (request call id 1845) took 2514 ms (client timeout 3084 ms). Trace:
I20260709 12:10:50.675521 14331 raft_consensus.cc:1240] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:10:50.672523 14330 raft_consensus.cc:1240] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 8. Current term is 9. Ops: [8.5-8.5]
W20260709 12:10:50.675660 14333 rpcz_store.cc:269] 0709 12:10:48.162457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:48.186594 (+ 24137us) service_pool.cc:224] Handling call
0709 12:10:50.675041 (+2488447us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b5400145854. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:10:50.675182 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2687386368}
W20260709 12:10:50.677179 14302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:50.671999 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:50.652940 14258 raft_consensus.cc:3060] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:50.633416 17195 consensus_meta.cc:287] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.583s	user 0.007s	sys 0.001s
I20260709 12:10:50.678629 14336 raft_consensus.cc:2393] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 7: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
W20260709 12:10:50.678965 14263 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53050 (request call id 497) took 1402 ms (client timeout 1526 ms). Trace:
W20260709 12:10:50.679391 14263 rpcz_store.cc:269] 0709 12:10:49.276844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:49.277076 (+   232us) service_pool.cc:224] Handling call
0709 12:10:50.678758 (+1401682us) spinlock_profiling.cc:243] Waited 526 ms on lock 0x7b54002215d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:10:50.678896 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1208914304}
I20260709 12:10:50.680685 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:50.661940 17243 raft_consensus.cc:3060] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:50.682333 14185 raft_consensus.cc:2468] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 8.
I20260709 12:10:50.686228 14335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 464) took 1211 ms. Trace:
I20260709 12:10:50.686714 14335 rpcz_store.cc:276] 0709 12:10:49.475287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:50.201228 (+725941us) service_pool.cc:224] Handling call
0709 12:10:50.601848 (+400620us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:50.611112 (+  9264us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:50.686014 (+ 74902us) spinlock_profiling.cc:243] Waited 400 ms on lock 0x7b54002a6050. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713a8ad 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:10:50.686154 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":920327040}
I20260709 12:10:50.689713 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:50.691278 14183 raft_consensus.cc:1240] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:50.647161 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:50.693017 14188 raft_consensus.cc:3060] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:50.693584 17239 raft_consensus.cc:3060] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:50.670389 14332 raft_consensus.cc:1240] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:50.696818 14257 rpcz_store.cc:276] 0709 12:10:49.348423 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:49.354288 (+  5865us) service_pool.cc:224] Handling call
0709 12:10:49.354671 (+   383us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:49.364823 (+ 10152us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:50.655448 (+1290625us) spinlock_profiling.cc:243] Waited 9.54 ms on lock 0x7b54001c1e54. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:10:50.655625 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":21933824}
I20260709 12:10:50.661867 14155 leader_election.cc:304] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:50.700680 14155 leader_election.cc:304] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:50.701453 17210 raft_consensus.cc:2749] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:50.701922 16911 raft_consensus.cc:2804] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:50.702458 16911 raft_consensus.cc:697] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 8 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:10:50.703508 16911 consensus_queue.cc:237] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:50.677999 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
W20260709 12:10:50.705945 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:50.706641 17204 leader_election.cc:290] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:50.675100 17203 raft_consensus.cc:740] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:10:50.708156 17203 consensus_queue.cc:260] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:50.709178 17203 raft_consensus.cc:3060] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:50.712626 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:50.713546 14905 raft_consensus.cc:2393] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 9: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
I20260709 12:10:50.714718 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:10:50.677603 14331 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50858 (request call id 1536) took 1394 ms. Trace:
I20260709 12:10:50.718132 14331 rpcz_store.cc:276] 0709 12:10:49.283138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:50.182967 (+899829us) service_pool.cc:224] Handling call
0709 12:10:50.675268 (+492301us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:50.675938 (+   670us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:50.677398 (+  1460us) spinlock_profiling.cc:243] Waited 492 ms on lock 0x7b5400145850. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713a8ad 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:10:50.677540 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1131375488}
I20260709 12:10:50.723526 17038 raft_consensus.cc:2749] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:50.702623 14155 leader_election.cc:304] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
W20260709 12:10:50.691313 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 496071us
I20260709 12:10:50.731433 14264 raft_consensus.cc:2410] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 12:10:50.741451 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:50.767181 14331 raft_consensus.cc:2468] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 8.
I20260709 12:10:50.741938 17245 raft_consensus.cc:515] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:50.742739 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:50.778441 14263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41768 (request call id 1520) took 1016 ms. Trace:
W20260709 12:10:50.778878 14875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:50.745118 14265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53050 (request call id 506) took 1290 ms. Trace:
I20260709 12:10:50.746512 14256 raft_consensus.cc:1275] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:10:50.747852 14184 raft_consensus.cc:1217] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Deduplicated request from leader. Original: 2.5->[3.6-5.7]   Dedup: 3.6->[5.7-5.7]
I20260709 12:10:50.748883 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:50.780544 14187 raft_consensus.cc:2376] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 5. Re-sending same reply.
I20260709 12:10:50.781575 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:50.780764 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:50.782274 14187 raft_consensus.cc:2468] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 6.
I20260709 12:10:50.750032 14262 raft_consensus.cc:2410] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 12:10:50.783934 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:50.784584 14262 raft_consensus.cc:3060] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:50.780000 14256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41768 (request call id 1514) took 1063 ms. Trace:
I20260709 12:10:50.787919 14256 rpcz_store.cc:276] 0709 12:10:49.716097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:50.710389 (+994292us) service_pool.cc:224] Handling call
0709 12:10:50.745930 (+ 35541us) spinlock_profiling.cc:243] Waited 34.8 ms on lock 0x7b5800060c98. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2124016b71 00007f2124016a22 00007f212cf2f8d9 00007f212c089ee0 00007f212c1530ab 00007f212c153131 00007f212c114fc0 00007f212c0ff929 00007f212c0ff3d2 00007f2125676bd4
0709 12:10:50.746178 (+   248us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:50.779693 (+ 33515us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:50.779930 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":80141696}
I20260709 12:10:50.779560 14265 rpcz_store.cc:276] 0709 12:10:49.454263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:50.685518 (+1231255us) service_pool.cc:224] Handling call
0709 12:10:50.744242 (+ 58724us) spinlock_profiling.cc:243] Waited 56.9 ms on lock 0x7b5800060c98. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2124016b71 00007f2124016a22 00007f212cf2f8d9 00007f212c089ee0 00007f212c1530ab 00007f212c153131 00007f212c114fc0 00007f212c0ff929 00007f212c0ff3d2 00007f2125676bd4
0709 12:10:50.744455 (+   213us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:50.744650 (+   195us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:50.744674 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:50.744714 (+    40us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:50.744744 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:50.744796 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:50.745050 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":130957568}
W20260709 12:10:50.665558 14230 connection.cc:256] RPC call timeout handler was delayed by -1.3030304760000035s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.334s for a response
I20260709 12:10:50.759299 14912 raft_consensus.cc:2468] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 9.
I20260709 12:10:50.741540 14188 raft_consensus.cc:2468] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 7.
I20260709 12:10:50.771297 14259 raft_consensus.cc:2468] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 7.
I20260709 12:10:50.773916 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:50.775614 14257 raft_consensus.cc:1240] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:50.777245 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:50.802552 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:50.803013 14260 raft_consensus.cc:3060] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:50.802552 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:50.806457 14261 raft_consensus.cc:2410] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for term 9 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:10:50.808745 14229 leader_election.cc:304] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:10:50.810200 14257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41768 (request call id 1510) took 1098 ms. Trace:
I20260709 12:10:50.810500 14257 rpcz_store.cc:276] 0709 12:10:49.711620 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:50.697799 (+986179us) service_pool.cc:224] Handling call
0709 12:10:50.775178 (+ 77379us) spinlock_profiling.cc:243] Waited 49 ms on lock 0x7b5800060c98. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2124016b71 00007f2124016a22 00007f212cf2f8d9 00007f212c089ee0 00007f212c1530ab 00007f212c153131 00007f212c114fc0 00007f212c0ff929 00007f212c0ff3d2 00007f2125676bd4
0709 12:10:50.775392 (+   214us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:50.809943 (+ 34551us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:50.810139 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":112598272}
I20260709 12:10:50.811548 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:50.814128 14188 raft_consensus.cc:2468] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 5.
I20260709 12:10:50.814965 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:50.815438 14188 raft_consensus.cc:2468] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 7.
I20260709 12:10:50.817153 14188 raft_consensus.cc:1240] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:50.818656 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:50.818945 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:50.778813 14263 rpcz_store.cc:276] 0709 12:10:49.762585 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:50.681582 (+918997us) service_pool.cc:224] Handling call
0709 12:10:50.778363 (+ 96781us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:50.820072 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:50.795704 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:50.809582 14230 leader_election.cc:304] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:50.818693 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:50.821076 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:50.822268 14256 raft_consensus.cc:2468] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 6.
I20260709 12:10:50.822400 14263 raft_consensus.cc:2393] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 7: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:10:50.821823 14265 raft_consensus.cc:3060] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:50.823180 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:50.823771 14256 raft_consensus.cc:2468] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 7.
I20260709 12:10:50.824874 14256 raft_consensus.cc:1240] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:50.826403 17104 consensus_queue.cc:1059] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:50.826926 17010 consensus_queue.cc:1059] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:50.827041 14877 leader_election.cc:304] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:10:50.827189 16763 consensus_queue.cc:1059] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:10:50.828148 17010 raft_consensus.cc:3055] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:50.828404 16763 raft_consensus.cc:2804] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:50.829020 16763 raft_consensus.cc:697] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 9 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:10:50.829254 17242 consensus_queue.cc:1059] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:50.828516 17010 raft_consensus.cc:740] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:10:50.830291 17104 raft_consensus.cc:3055] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:50.830663 17104 raft_consensus.cc:740] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:10:50.831089 17010 consensus_queue.cc:260] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:50.831497 17104 consensus_queue.cc:260] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:50.832360 17212 raft_consensus.cc:3055] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:50.832705 17104 raft_consensus.cc:3060] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:50.832836 14335 raft_consensus.cc:1240] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:50.833451 14331 raft_consensus.cc:1240] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:50.828832 17041 raft_consensus.cc:3055] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:50.833914 17041 raft_consensus.cc:740] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:10:50.834821 17041 consensus_queue.cc:260] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:10:50.836082 14877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:50.832772 17212 raft_consensus.cc:740] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:10:50.836498 17010 raft_consensus.cc:3060] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:50.838219 17212 consensus_queue.cc:260] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:50.839344 17212 raft_consensus.cc:3060] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:50.835251 14261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41768 (request call id 1518) took 1116 ms. Trace:
I20260709 12:10:50.837301 14877 leader_election.cc:304] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:50.840493 14263 raft_consensus.cc:1240] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:50.840224 14261 rpcz_store.cc:276] 0709 12:10:49.748038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:50.694071 (+946033us) service_pool.cc:224] Handling call
0709 12:10:50.773678 (+ 79607us) spinlock_profiling.cc:243] Waited 52.5 ms on lock 0x7b5800060c98. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2124016b71 00007f2124016a22 00007f212cf2f8d9 00007f212c089ee0 00007f212c1530ab 00007f212c153131 00007f212c1010a0 00007f212c100984 00007f212567b6d4 00007f212567b662
0709 12:10:50.835185 (+ 61507us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":120842112}
I20260709 12:10:50.751410 14258 raft_consensus.cc:2468] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 7.
I20260709 12:10:50.843258 14332 raft_consensus.cc:1240] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:50.597332 17034 raft_consensus.cc:515] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:10:50.848807 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 300353us
I20260709 12:10:50.849843 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:10:50.852197 14303 leader_election.cc:336] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Timed out: RequestConsensusVote RPC to 127.12.174.129:37187 timed out after 1.617s (SENT)
I20260709 12:10:50.850821 14877 leader_election.cc:304] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:50.852154 14263 raft_consensus.cc:2468] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 6.
I20260709 12:10:50.853837 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:50.854139 14259 raft_consensus.cc:1240] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:50.836050 17041 raft_consensus.cc:3060] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:50.851061 17234 raft_consensus.cc:2804] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:50.778471 17239 consensus_queue.cc:1059] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.078s
I20260709 12:10:50.856940 14259 raft_consensus.cc:1275] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 12:10:50.871223 14259 pending_rounds.cc:85] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec: Aborting all ops after (but not including) 5
I20260709 12:10:50.871500 14259 pending_rounds.cc:107] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 12:10:50.871788 14259 raft_consensus.cc:2889] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:50.857245 14263 raft_consensus.cc:1275] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:10:50.872944 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:50.873853 14333 raft_consensus.cc:2393] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 7: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:10:50.857048 16763 consensus_queue.cc:237] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:50.818257 17101 raft_consensus.cc:493] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:50.850346 17204 raft_consensus.cc:2804] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:50.877169 14912 raft_consensus.cc:2955] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 5 to 6, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:10:50.852536 17195 raft_consensus.cc:2749] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:50.869558 17242 raft_consensus.cc:3060] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:50.871380 17234 raft_consensus.cc:493] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:50.830778 17246 raft_consensus.cc:515] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:50.867237 17240 consensus_queue.cc:1059] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 12:10:50.908118 17224 consensus_queue.cc:1059] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 12:10:50.916326 17234 raft_consensus.cc:3060] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:50.930896 17245 leader_election.cc:290] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 3 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:50.904486 17204 raft_consensus.cc:697] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 9 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:10:50.942569 17204 consensus_queue.cc:237] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:50.891628 17219 consensus_queue.cc:1059] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 12:10:50.948858 17246 leader_election.cc:290] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:50.919505 17156 raft_consensus.cc:2749] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:50.966207 17242 raft_consensus.cc:2749] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:50.992585 14190 raft_consensus.cc:1240] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 6. Current term is 7. Ops: []
W20260709 12:10:50.763685 14156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:50.996182 14181 raft_consensus.cc:1240] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 2. Current term is 3. Ops: []
W20260709 12:10:50.996724 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 294009us
I20260709 12:10:50.997390 14183 raft_consensus.cc:1240] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:50.998433 14189 raft_consensus.cc:1240] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:50.999027 14186 raft_consensus.cc:2410] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:10:50.780404 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:51.000401 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: true dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:50.865765 14257 raft_consensus.cc:1240] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:51.166046 14257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41768 (request call id 1534) took 1210 ms. Trace:
I20260709 12:10:51.166554 14257 rpcz_store.cc:276] 0709 12:10:49.955861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:50.865067 (+909206us) service_pool.cc:224] Handling call
0709 12:10:50.865514 (+   447us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:51.165314 (+299800us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:51.165811 (+   497us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:51.167174 14878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:51.002835 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:51.006361 14230 leader_election.cc:304] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:51.001188 14088 catalog_manager.cc:5697] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: term changed from 5 to 6, leader changed from 65c9c1653b3346b39a0e118540e6080c (127.12.174.131) to 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130). New cstate: current_term: 6 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:10:51.008013 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:50.780251 14184 raft_consensus.cc:1240] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 5. Current term is 6. Ops: [3.6-5.7]
I20260709 12:10:51.010072 14259 raft_consensus.cc:1275] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:10:50.869029 14260 raft_consensus.cc:2468] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 7.
I20260709 12:10:50.860616 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:51.187776 14261 raft_consensus.cc:2468] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 4.
I20260709 12:10:50.859787 14262 raft_consensus.cc:2468] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 8.
I20260709 12:10:51.188534 17239 raft_consensus.cc:3055] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:51.189289 17239 raft_consensus.cc:740] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
W20260709 12:10:51.189924 14228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:51.191000 17239 consensus_queue.cc:260] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:50.875182 14265 raft_consensus.cc:2468] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 4.
I20260709 12:10:51.012099 14263 raft_consensus.cc:1275] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 12:10:51.014182 14303 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:51.194064 17052 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.045s	sys 0.036s
W20260709 12:10:51.194733 17052 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.540s	user 0.045s	sys 0.037s
W20260709 12:10:51.016089 14875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:51.026599 14333 raft_consensus.cc:1240] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:51.027894 14304 leader_election.cc:304] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:51.029246 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:51.030507 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:51.040305 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:10:51.051620 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:51.058420 16750 consensus_queue.cc:1048] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:51.200399 14264 raft_consensus.cc:1240] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:51.079824 17034 leader_election.cc:290] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:51.202818 14264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53050 (request call id 510) took 1086 ms. Trace:
W20260709 12:10:51.203204 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 175846us
I20260709 12:10:50.951646 17110 raft_consensus.cc:3055] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:51.203564 14335 raft_consensus.cc:2468] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 5.
I20260709 12:10:51.204056 17110 raft_consensus.cc:740] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:10:51.164072 17212 raft_consensus.cc:493] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:51.172061 14229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:51.172427 17156 raft_consensus.cc:2749] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:51.173699 14088 catalog_manager.cc:5697] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: term changed from 3 to 5, leader changed from 65c9c1653b3346b39a0e118540e6080c (127.12.174.131) to 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130). New cstate: current_term: 5 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:51.181030 16814 raft_consensus.cc:3055] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:51.197279 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:51.192596 14187 raft_consensus.cc:3060] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:50.875161 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:51.200249 14336 raft_consensus.cc:2393] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 9: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
I20260709 12:10:51.191550 14155 leader_election.cc:304] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:51.204505 14264 rpcz_store.cc:276] 0709 12:10:50.116527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:50.855821 (+739294us) service_pool.cc:224] Handling call
0709 12:10:51.199865 (+344044us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:51.201054 (+  1189us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:51.202517 (+  1463us) spinlock_profiling.cc:243] Waited 343 ms on lock 0x7b54001c3250. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713a8ad 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:10:51.202734 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":788459008}
I20260709 12:10:51.207782 16814 raft_consensus.cc:740] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:10:50.890034 17101 raft_consensus.cc:515] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:51.203032 17034 raft_consensus.cc:2749] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:51.222096 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:10:51.239393 14302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:51.240824 14088 catalog_manager.cc:5697] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: term changed from 6 to 8, leader changed from 65c9c1653b3346b39a0e118540e6080c (127.12.174.131) to 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130). New cstate: current_term: 8 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:51.249504 17202 consensus_queue.cc:1059] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:51.212932 17212 raft_consensus.cc:515] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:51.254779 17195 raft_consensus.cc:3055] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:51.255295 17195 raft_consensus.cc:740] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:10:51.256814 17195 consensus_queue.cc:260] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:51.242547 17110 consensus_queue.cc:260] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:51.267026 14258 raft_consensus.cc:1275] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:10:51.267462 17110 raft_consensus.cc:3060] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:51.268924 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 420155us
I20260709 12:10:51.270246 14230 leader_election.cc:304] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:10:51.271330 17202 raft_consensus.cc:2804] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:51.271550 14230 leader_election.cc:304] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:51.271606 14183 raft_consensus.cc:1275] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 12:10:51.274675 14183 pending_rounds.cc:85] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf: Aborting all ops after (but not including) 6
W20260709 12:10:51.261478 14303 leader_election.cc:336] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Timed out: RequestConsensusVote RPC to 127.12.174.129:37187 timed out after 1.783s (SENT)
I20260709 12:10:51.258870 17156 raft_consensus.cc:2749] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:51.281176 14185 raft_consensus.cc:2393] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 7: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:10:51.262022 17204 raft_consensus.cc:2749] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:10:51.283294 14875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:51.278964 14186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56044 (request call id 2254) took 1017 ms. Trace:
I20260709 12:10:51.278357 14183 pending_rounds.cc:107] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 12:10:51.283860 14303 leader_election.cc:304] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:51.285136 14186 rpcz_store.cc:276] 0709 12:10:50.259183 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:50.259430 (+   247us) service_pool.cc:224] Handling call
0709 12:10:51.272455 (+1013025us) spinlock_profiling.cc:243] Waited 717 ms on lock 0x7b540019c8d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:10:51.276012 (+  3557us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1649240320}
I20260709 12:10:51.285789 14183 raft_consensus.cc:2889] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:51.288640 14188 raft_consensus.cc:1240] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:51.288812 17205 raft_consensus.cc:2804] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:51.294224 14304 leader_election.cc:304] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:10:51.292258 14264 raft_consensus.cc:1240] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:51.286062 17101 leader_election.cc:290] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:51.255168 16814 consensus_queue.cc:260] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:10:51.286531 17153 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.032s	sys 0.096s
I20260709 12:10:51.299369 17034 raft_consensus.cc:2749] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:10:51.306632 14257 raft_consensus.cc:1240] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:51.309882 14181 raft_consensus.cc:1240] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:51.304349 17101 raft_consensus.cc:2749] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:10:51.307410 17153 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.677s	user 0.032s	sys 0.097s
W20260709 12:10:51.324563 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 87071.6us
I20260709 12:10:51.312695 14261 raft_consensus.cc:2955] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 5 to 6, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
W20260709 12:10:51.325371 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 134195us
W20260709 12:10:51.327411 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:51.326447 14189 raft_consensus.cc:1240] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:51.335415 14185 raft_consensus.cc:1240] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:51.334025 14155 leader_election.cc:304] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
W20260709 12:10:51.338335 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 59458.8us
I20260709 12:10:51.334731 17195 raft_consensus.cc:3060] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:51.352342 17234 raft_consensus.cc:515] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:51.353089 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:51.353319 14264 raft_consensus.cc:1275] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:51.348937 17239 raft_consensus.cc:3060] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:51.369886 14334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 468) took 1145 ms. Trace:
W20260709 12:10:51.371829 14877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:51.349718 17034 raft_consensus.cc:493] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:51.376344 14259 raft_consensus.cc:1275] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 12:10:51.381358 14182 raft_consensus.cc:1240] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 11 LEADER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 10. Current term is 11. Ops: []
I20260709 12:10:51.382402 17010 consensus_queue.cc:1059] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 12:10:51.383991 17242 raft_consensus.cc:3055] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:51.384461 17242 raft_consensus.cc:740] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:10:51.379932 14259 pending_rounds.cc:85] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec: Aborting all ops after (but not including) 3
I20260709 12:10:51.386957 14259 pending_rounds.cc:107] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 3.4
I20260709 12:10:51.372211 16814 raft_consensus.cc:3060] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:51.374460 17193 raft_consensus.cc:2804] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:10:51.389868 14229 leader_election.cc:336] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Timed out: RequestConsensusVote RPC to 127.12.174.129:37187 timed out after 1.794s (SENT)
I20260709 12:10:51.389460 17034 raft_consensus.cc:515] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:51.392997 14259 raft_consensus.cc:2917] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Aborting config change with OpId 3.4: Aborted: Op aborted by new leader
I20260709 12:10:51.399026 14262 raft_consensus.cc:1275] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:51.398964 14304 leader_election.cc:304] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:10:51.398852 17010 consensus_queue.cc:1059] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 12:10:51.403064 17010 raft_consensus.cc:3055] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:51.403522 17010 raft_consensus.cc:740] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:10:51.376974 14088 catalog_manager.cc:5697] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: term changed from 1 to 2, leader changed from 65c9c1653b3346b39a0e118540e6080c (127.12.174.131) to 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130). New cstate: current_term: 2 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:51.372695 14334 rpcz_store.cc:276] 0709 12:10:50.148419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:50.239989 (+ 91570us) service_pool.cc:224] Handling call
0709 12:10:50.240357 (+   368us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:50.240761 (+   404us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:50.240792 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:50.241307 (+   515us) log.cc:844] Serialized 26 byte log entry
0709 12:10:50.618590 (+377283us) spinlock_profiling.cc:243] Waited 5.49 ms on lock 0x7b180032d760. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f212cf16ab1 00007f212cf23281 00007f2124030e07 00007f212ce8b9a9 00007f212404d69b 00007f212404b93f 00007f212404dc02 00007f2126cd520b 00007f2126cdad23 00007f2126cdb0d1 00007f21270f6a0f
0709 12:10:50.873791 (+255201us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:51.236137 (+362346us) log.cc:844] Serialized 14 byte log entry
0709 12:10:51.275183 (+ 39046us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:51.285212 (+ 10029us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:51.285255 (+    43us) raft_consensus.cc:1685] finished
0709 12:10:51.290796 (+  5541us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:51.293229 (+  2433us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":425563,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":14062,"raft.run_cpu_time_us":476,"raft.run_wall_time_us":39015,"spinlock_wait_cycles":12635392,"thread_start_us":607699,"threads_started":2,"wal-append.queue_time_us":923344}
I20260709 12:10:51.406468 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:51.393663 17202 raft_consensus.cc:697] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 5 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:10:51.403699 17193 raft_consensus.cc:697] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 6 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:51.403561 17205 raft_consensus.cc:493] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:51.419826 17205 raft_consensus.cc:3060] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:51.407073 17010 consensus_queue.cc:260] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:51.417833 17034 leader_election.cc:290] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:51.418340 17105 raft_consensus.cc:2804] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:51.422374 17105 raft_consensus.cc:697] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 7 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:51.422010 17242 consensus_queue.cc:260] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:51.422827 17010 raft_consensus.cc:3060] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:51.423357 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 89606.4us
I20260709 12:10:51.423594 17105 consensus_queue.cc:237] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:51.425571 17153 consensus_queue.cc:1059] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:51.426335 17212 leader_election.cc:290] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:51.426736 17153 raft_consensus.cc:3055] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:51.427192 17153 raft_consensus.cc:740] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:10:51.428431 17153 consensus_queue.cc:260] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:51.428923 16750 consensus_queue.cc:1048] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:51.431816 17153 raft_consensus.cc:3060] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:51.438272 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
W20260709 12:10:51.438750 17271 log.cc:927] Time spent T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.126s	user 0.005s	sys 0.000s
I20260709 12:10:51.426862 17193 consensus_queue.cc:237] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:51.442536 14911 raft_consensus.cc:1240] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 7. Current term is 8. Ops: []
W20260709 12:10:51.457203 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 185806us
I20260709 12:10:51.475630 14187 raft_consensus.cc:2468] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 9.
W20260709 12:10:51.476249 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 50567.3us
I20260709 12:10:51.480060 14259 raft_consensus.cc:2889] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:51.478139 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:10:51.474447 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 68287.2us
I20260709 12:10:51.460722 16911 raft_consensus.cc:2749] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:51.485761 14182 raft_consensus.cc:2410] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
W20260709 12:10:51.501529 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 50887.3us
W20260709 12:10:51.504560 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 113334us
I20260709 12:10:51.442761 17202 consensus_queue.cc:237] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:51.506656 14905 raft_consensus.cc:2393] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 8: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
I20260709 12:10:51.516886 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:51.523173 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
W20260709 12:10:51.526583 14876 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:51.516868 17104 consensus_meta.cc:287] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db: Time spent flushing consensus metadata: real 0.668s	user 0.016s	sys 0.004s
I20260709 12:10:51.529675 14259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:53048 (request call id 10) took 16958 ms. Trace:
I20260709 12:10:51.529840 14256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53050 (request call id 509) took 1398 ms. Trace:
I20260709 12:10:51.521750 14155 leader_election.cc:304] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
W20260709 12:10:51.543445 14229 leader_election.cc:336] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Timed out: RequestConsensusVote RPC to 127.12.174.129:37187 timed out after 1.844s (SENT)
I20260709 12:10:51.545074 17241 raft_consensus.cc:493] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:51.543929 14229 leader_election.cc:304] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:51.555456 14303 leader_election.cc:304] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:51.559482 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:10:51.561100 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 52982.3us
I20260709 12:10:51.564265 16911 raft_consensus.cc:2804] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:51.566088 14334 raft_consensus.cc:2468] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 9.
W20260709 12:10:51.567579 17279 log.cc:927] Time spent T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 12:10:51.572463 17242 raft_consensus.cc:3060] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:51.572994 16911 raft_consensus.cc:697] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 7 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:10:51.574461 16911 consensus_queue.cc:237] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:51.575795 17234 leader_election.cc:290] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 8 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:51.559744 17241 raft_consensus.cc:515] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:10:51.588907 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 69629.1us
I20260709 12:10:51.590047 17196 raft_consensus.cc:2749] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:10:51.590834 17241 leader_election.cc:290] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:51.591842 17101 raft_consensus.cc:2749] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:10:51.593181 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 57326.9us
I20260709 12:10:51.595052 14155 leader_election.cc:304] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:51.596588 17052 raft_consensus.cc:2804] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:51.597188 17052 raft_consensus.cc:697] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 9 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:10:51.598278 17052 consensus_queue.cc:237] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:51.598897 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:51.600756 14334 raft_consensus.cc:1275] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:10:51.533370 14256 rpcz_store.cc:276] 0709 12:10:50.052096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:50.843763 (+791667us) service_pool.cc:224] Handling call
0709 12:10:50.844046 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:50.844249 (+   203us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:10:51.225925 (+381676us) log.cc:844] Serialized 14 byte log entry
0709 12:10:51.397931 (+172006us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:51.398053 (+   122us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:51.409928 (+ 11875us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:51.417030 (+  7102us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:51.450495 (+ 33465us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":295157,"prepare.run_cpu_time_us":2141,"prepare.run_wall_time_us":2931,"raft.queue_time_us":6310,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":1922,"thread_start_us":341770,"threads_started":2,"wal-append.queue_time_us":158090}
I20260709 12:10:51.526226 17105 consensus_queue.cc:1048] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.037s
I20260709 12:10:51.555647 17277 raft_consensus.cc:493] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:51.607983 14303 leader_election.cc:304] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:51.603276 14877 leader_election.cc:304] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:51.610761 14304 leader_election.cc:304] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
W20260709 12:10:51.611966 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:51.530133 14259 rpcz_store.cc:276] 0709 12:10:34.554712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.627935 (+ 73223us) service_pool.cc:224] Handling call
0709 12:10:34.691475 (+ 63540us) log.cc:844] Serialized 513 byte log entry
0709 12:10:35.495882 (+804407us) spinlock_profiling.cc:243] Waited 23.7 ms on lock 0x7b54002105a0. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f21270b0dbe 00007f21270bb930 00007f21270bb8d8 00007f21270bb858 00007f21270bb813 00007f21270baa9c 00007f212cfa62f6 00007f212cfa0aa8 00007f21270f77cb 00007f21270fa2c0
0709 12:10:51.510456 (+16014574us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25775,"raft.queue_time_us":94176,"raft.run_cpu_time_us":2532,"raft.run_wall_time_us":163753,"spinlock_wait_cycles":54601088,"thread_start_us":100881,"threads_started":2,"wal-append.queue_time_us":64823,"wal-append.run_cpu_time_us":7035,"wal-append.run_wall_time_us":1701344}
I20260709 12:10:51.600692 17246 consensus_queue.cc:1048] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 12:10:51.609146 17104 raft_consensus.cc:493] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:51.605152 17110 raft_consensus.cc:493] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:51.622129 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:51.621506 17104 raft_consensus.cc:515] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:51.624212 17104 leader_election.cc:290] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:51.625886 17253 raft_consensus.cc:2804] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:51.626385 17253 raft_consensus.cc:493] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:51.626736 17253 raft_consensus.cc:3060] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:51.609292 16814 consensus_queue.cc:1048] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 12:10:51.632457 17110 raft_consensus.cc:515] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:51.633805 17196 raft_consensus.cc:2804] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:51.634262 17196 raft_consensus.cc:493] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:10:51.634650 17196 raft_consensus.cc:3060] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:51.634932 17110 leader_election.cc:290] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:51.635673 17277 raft_consensus.cc:515] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:51.641111 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:10:51.642882 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 113236us
I20260709 12:10:51.648278 14259 pending_rounds.cc:107] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec: Aborting uncommitted NO_OP operation due to leader change: 5.5
I20260709 12:10:51.648768 14259 raft_consensus.cc:2889] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:10:51.650069 14229 leader_election.cc:336] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Timed out: RequestConsensusVote RPC to 127.12.174.129:37187 timed out after 1.869s (SENT)
I20260709 12:10:51.650564 14304 leader_election.cc:304] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:10:51.651429 14230 leader_election.cc:304] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:51.651417 14155 leader_election.cc:304] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:51.656877 14877 leader_election.cc:304] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:51.646148 17193 raft_consensus.cc:2749] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:51.645416 17105 consensus_queue.cc:1243] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer 885067a0d31741bfb5c9935788e315bf log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:10:51.666215 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:51.667039 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:51.667881 16602 raft_consensus.cc:2804] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:51.668280 16602 raft_consensus.cc:493] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:51.668299 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:51.667225 17219 raft_consensus.cc:2749] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:10:51.668653 14263 raft_consensus.cc:3060] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:51.661270 17101 raft_consensus.cc:2749] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:51.665702 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:51.668653 16602 raft_consensus.cc:3060] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:51.673723 17221 consensus_queue.cc:1048] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:10:51.674499 14332 raft_consensus.cc:2468] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 4.
W20260709 12:10:51.677073 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 67071.9us
I20260709 12:10:51.678167 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:51.678937 14336 raft_consensus.cc:2468] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 8.
W20260709 12:10:51.679905 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 90174.1us
I20260709 12:10:51.680691 14303 leader_election.cc:304] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:10:51.681636 17034 raft_consensus.cc:2804] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:51.682301 17101 consensus_queue.cc:1059] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:51.683133 14303 leader_election.cc:304] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:51.683632 17278 raft_consensus.cc:3055] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:51.684038 17278 raft_consensus.cc:740] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:10:51.685061 17278 consensus_queue.cc:260] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:10:51.685027 14136 auto_rebalancer.cc:629] Failed to schedule move for tablet e5c1eed5e91b4c908f1f9ebf315fbc6f: Aborted: Op aborted by new leader
I20260709 12:10:51.686585 17278 raft_consensus.cc:3060] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:51.692024 17205 raft_consensus.cc:515] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:51.694015 14263 raft_consensus.cc:1275] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:10:51.694105 17277 leader_election.cc:290] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:51.695170 17253 raft_consensus.cc:515] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:51.697355 17253 leader_election.cc:290] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 10 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:51.698375 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:51.699065 14187 raft_consensus.cc:3060] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:10:51.684960 14229 leader_election.cc:336] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Timed out: RequestConsensusVote RPC to 127.12.174.129:37187 timed out after 1.922s (SENT)
I20260709 12:10:51.678535 14304 leader_election.cc:304] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:10:51.689123 17196 raft_consensus.cc:515] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:51.701681 14229 leader_election.cc:304] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:51.722663 14187 raft_consensus.cc:2410] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:10:51.701391 16602 raft_consensus.cc:515] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:51.706643 16911 raft_consensus.cc:2749] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:51.724843 17278 raft_consensus.cc:2749] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:51.720403 17221 consensus_queue.cc:1048] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.007s
I20260709 12:10:51.727085 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:10:51.729594 14877 leader_election.cc:304] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:51.732550 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:51.733187 14334 raft_consensus.cc:3060] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:51.734056 17241 raft_consensus.cc:2749] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:10:51.735550 14230 leader_election.cc:336] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957): Timed out: RequestConsensusVote RPC to 127.12.174.131:45957 timed out after 2.051s (SENT)
W20260709 12:10:51.738021 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 126420us
I20260709 12:10:51.739987 14155 leader_election.cc:304] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:51.741340 14155 leader_election.cc:304] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:51.746333 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:51.742442 14905 raft_consensus.cc:2468] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 3.
I20260709 12:10:51.741336 17153 consensus_queue.cc:1059] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:51.745676 14184 raft_consensus.cc:1275] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:51.746114 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:51.744505 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:10:51.747073 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:51.766816 14877 leader_election.cc:304] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:51.741916 17246 raft_consensus.cc:2804] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:51.728377 17193 raft_consensus.cc:2749] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:51.782433 16911 raft_consensus.cc:3060] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:51.791780 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:10:51.761212 14136 auto_rebalancer.cc:629] Failed to schedule move for tablet e9b8048bcdf74441aac2cd21ac7af4da: Illegal state: Replica 65c9c1653b3346b39a0e118540e6080c is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 9 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } }
W20260709 12:10:51.750746 17280 log.cc:927] Time spent T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.194s	user 0.001s	sys 0.000s
I20260709 12:10:51.795161 14912 raft_consensus.cc:1240] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:51.795509 14187 raft_consensus.cc:2468] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 4.
I20260709 12:10:51.791141 17246 raft_consensus.cc:493] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:51.796267 17246 raft_consensus.cc:3060] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:51.732357 14256 raft_consensus.cc:2468] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 4.
W20260709 12:10:51.742868 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 58008.8us
I20260709 12:10:51.780215 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
W20260709 12:10:51.783553 14156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:51.752648 17205 leader_election.cc:290] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 7 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:10:51.784778 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 106345us
I20260709 12:10:51.783216 14334 raft_consensus.cc:2468] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 10.
I20260709 12:10:51.788899 14877 leader_election.cc:304] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
W20260709 12:10:51.790552 14228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:51.794631 17221 raft_consensus.cc:2804] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:51.816534 17221 raft_consensus.cc:493] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:51.816608 14190 raft_consensus.cc:2376] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 6. Re-sending same reply.
I20260709 12:10:51.817030 17221 raft_consensus.cc:3060] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:10:51.821378 14229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:51.802217 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:51.822579 17196 leader_election.cc:290] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 7 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:51.810323 14188 raft_consensus.cc:2393] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 5: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
W20260709 12:10:51.810323 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 127365us
I20260709 12:10:51.810770 17052 raft_consensus.cc:493] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:51.824599 14303 leader_election.cc:304] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:51.795675 17193 raft_consensus.cc:2804] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:10:51.825832 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:51.824560 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 83308.2us
I20260709 12:10:51.824898 17052 raft_consensus.cc:515] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:51.828294 17052 leader_election.cc:290] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:51.828856 17052 consensus_queue.cc:1059] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:10:51.825990 14229 leader_election.cc:336] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Timed out: RequestConsensusVote RPC to 127.12.174.129:37187 timed out after 2.153s (SENT)
I20260709 12:10:51.830435 14229 leader_election.cc:304] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:51.832401 14185 raft_consensus.cc:2468] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 6.
I20260709 12:10:51.836033 14877 leader_election.cc:304] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:51.839916 17202 raft_consensus.cc:2749] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:51.829833 16602 leader_election.cc:290] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 8 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:51.831947 17034 raft_consensus.cc:697] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 7 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:51.837203 17104 raft_consensus.cc:2804] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:51.842264 17193 raft_consensus.cc:697] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 7 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:51.839192 17253 raft_consensus.cc:493] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:51.844096 17205 raft_consensus.cc:2749] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:10:51.856527 14229 leader_election.cc:304] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:51.859997 14303 leader_election.cc:304] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:10:51.862812 17195 consensus_queue.cc:1059] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:51.864118 17195 raft_consensus.cc:2749] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:51.864820 17195 raft_consensus.cc:3055] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:51.865140 17195 raft_consensus.cc:740] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:10:51.865573 14304 leader_election.cc:304] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:51.868192 17195 consensus_queue.cc:260] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:51.868681 17193 consensus_queue.cc:237] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:51.870236 17034 consensus_queue.cc:237] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:51.871237 14229 leader_election.cc:304] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:51.861601 17221 raft_consensus.cc:515] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:51.872723 17202 raft_consensus.cc:2804] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:51.843526 16763 raft_consensus.cc:2804] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:10:51.876681 14334 raft_consensus.cc:1240] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:51.877086 14229 leader_election.cc:304] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:51.847249 17104 raft_consensus.cc:493] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:51.869565 17195 raft_consensus.cc:3060] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:51.877635 17202 raft_consensus.cc:493] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:51.899817 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 72998.7us
I20260709 12:10:51.885025 17104 raft_consensus.cc:3060] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:51.902794 17298 raft_consensus.cc:3055] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:51.903244 17298 raft_consensus.cc:740] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:10:51.888774 17278 raft_consensus.cc:2804] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:51.927733 17278 raft_consensus.cc:493] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:51.906570 14229 leader_election.cc:304] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
W20260709 12:10:51.928709 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:51.909600 17156 raft_consensus.cc:3055] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:51.891963 17110 consensus_queue.cc:1059] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 12:10:51.891144 16763 raft_consensus.cc:697] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 10 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:10:51.918397 14903 raft_consensus.cc:2468] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 5.
I20260709 12:10:51.921375 17104 raft_consensus.cc:515] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:51.892320 17202 raft_consensus.cc:3060] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:51.937927 16763 consensus_queue.cc:237] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:51.938779 17104 leader_election.cc:290] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 5 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:51.940855 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:51.924018 17295 raft_consensus.cc:2749] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:51.942580 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:51.927013 17052 raft_consensus.cc:493] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:51.931934 17156 raft_consensus.cc:740] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:10:51.943864 17052 raft_consensus.cc:515] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:51.885361 17253 raft_consensus.cc:515] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:51.929826 17278 raft_consensus.cc:3060] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:51.946762 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 102248us
I20260709 12:10:51.947618 14304 leader_election.cc:304] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:10:51.947741 17253 leader_election.cc:290] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:51.897421 17205 raft_consensus.cc:2804] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:51.931160 17221 leader_election.cc:290] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 9 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:10:51.936520 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 43894.5us
I20260709 12:10:51.950243 14229 leader_election.cc:304] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:51.950397 14335 raft_consensus.cc:1240] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:51.951284 14229 leader_election.cc:304] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:51.952342 17101 raft_consensus.cc:2804] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:51.952708 17101 raft_consensus.cc:493] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:51.941557 17277 raft_consensus.cc:2804] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:51.953485 17277 raft_consensus.cc:493] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:51.953897 17277 raft_consensus.cc:3060] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:51.949205 17205 raft_consensus.cc:697] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 8 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:51.960425 17205 consensus_queue.cc:237] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:51.943269 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:51.953069 17212 raft_consensus.cc:3055] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:51.962262 14303 leader_election.cc:304] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:51.926213 17298 consensus_queue.cc:260] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:51.977768 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:51.978590 14334 raft_consensus.cc:3060] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:51.953043 17101 raft_consensus.cc:3060] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:51.968228 17212 raft_consensus.cc:740] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:10:51.987587 14304 leader_election.cc:304] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:51.989154 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:51.990020 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:51.993798 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:51.993913 14336 raft_consensus.cc:3060] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:51.993360 14257 raft_consensus.cc:3060] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:51.995913 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:51.996610 14261 raft_consensus.cc:2468] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 6.
I20260709 12:10:51.984663 17295 consensus_queue.cc:1048] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.019s
I20260709 12:10:52.004288 14331 raft_consensus.cc:2468] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 7.
W20260709 12:10:52.005187 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 54033.2us
I20260709 12:10:52.005491 14877 leader_election.cc:304] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:10:52.006513 17110 raft_consensus.cc:2804] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:51.988545 17034 raft_consensus.cc:2804] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:51.988178 16911 raft_consensus.cc:2749] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:51.944509 17156 consensus_queue.cc:260] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:51.996687 17298 raft_consensus.cc:3060] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:51.995831 17193 raft_consensus.cc:2804] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:10:52.013859 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 80870.8us
I20260709 12:10:52.015702 14334 raft_consensus.cc:2468] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 9.
I20260709 12:10:52.004241 17295 consensus_queue.cc:1243] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer 17aab1bbf5014936aa18cc21818b26ec log is divergent from this leader: its last log entry 8.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
W20260709 12:10:52.018641 14154 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 73678.9us
I20260709 12:10:52.019493 17305 raft_consensus.cc:2749] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:52.019942 17241 raft_consensus.cc:993] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db: : Instructing follower 17aab1bbf5014936aa18cc21818b26ec to start an election
I20260709 12:10:52.020993 17241 raft_consensus.cc:493] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:52.021931 17010 raft_consensus.cc:1081] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 6 LEADER]: Signalling peer 17aab1bbf5014936aa18cc21818b26ec to start an election
I20260709 12:10:52.027066 14877 leader_election.cc:304] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
W20260709 12:10:52.030898 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 61933us
I20260709 12:10:52.014122 17110 raft_consensus.cc:493] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:52.030310 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 45767us
W20260709 12:10:52.032241 14155 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:52.033939 17110 raft_consensus.cc:3060] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:52.021457 17241 raft_consensus.cc:515] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:52.042590 17305 consensus_queue.cc:1059] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 12:10:52.045670 17195 raft_consensus.cc:3055] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:52.046241 17195 raft_consensus.cc:740] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:10:52.047394 17195 consensus_queue.cc:260] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:52.048978 17195 raft_consensus.cc:3060] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:52.050132 14261 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61"
dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
 from {username='slave'} at 127.0.0.1:53050
I20260709 12:10:52.050972 14261 raft_consensus.cc:493] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:52.051337 14261 raft_consensus.cc:3060] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:52.053933 17153 raft_consensus.cc:493] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:52.054633 17153 raft_consensus.cc:515] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:52.056187 16763 raft_consensus.cc:493] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:52.057148 17153 leader_election.cc:290] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:10:52.054703 14230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:52.056803 16763 raft_consensus.cc:515] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:52.058000 17196 consensus_queue.cc:1048] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:52.058827 14229 leader_election.cc:304] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
W20260709 12:10:52.058388 14230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:52.060213 14230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:52.060707 14229 leader_election.cc:304] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:52.060881 17305 raft_consensus.cc:2749] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:52.053984 17212 consensus_queue.cc:260] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:52.067945 17212 raft_consensus.cc:3060] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:52.068069 14303 leader_election.cc:304] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:52.069051 17196 raft_consensus.cc:2749] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:52.069692 14303 leader_election.cc:304] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:10:52.066555 17305 raft_consensus.cc:2749] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:52.040439 16911 consensus_queue.cc:1059] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 12:10:52.072564 14304 leader_election.cc:304] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:52.073593 17105 raft_consensus.cc:2804] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:52.032382 17104 raft_consensus.cc:2804] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:52.030058 17034 raft_consensus.cc:697] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 8 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:52.074087 14304 leader_election.cc:304] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:10:52.080258 14336 raft_consensus.cc:2468] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 5.
W20260709 12:10:52.085539 14154 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 66186.4us
I20260709 12:10:52.073830 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:52.073706 16763 leader_election.cc:290] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:52.096307 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:52.096963 14190 raft_consensus.cc:2468] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 6.
I20260709 12:10:52.097151 17241 leader_election.cc:290] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:52.095798 14333 raft_consensus.cc:2468] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 6.
I20260709 12:10:52.099943 14257 raft_consensus.cc:2468] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 5.
I20260709 12:10:52.095250 14155 leader_election.cc:304] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:52.101500 17104 raft_consensus.cc:697] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 9 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:10:52.103917 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:52.102102 17202 raft_consensus.cc:515] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:52.104589 17104 consensus_queue.cc:237] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:52.106343 17034 consensus_queue.cc:237] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:52.106828 17202 leader_election.cc:290] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 9 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:52.108839 14154 leader_election.cc:304] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:52.109426 14261 raft_consensus.cc:515] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:52.051849 17246 raft_consensus.cc:515] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:52.107882 17305 raft_consensus.cc:493] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:52.114297 17305 raft_consensus.cc:515] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:52.116585 17305 leader_election.cc:290] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:10:52.118780 17304 log.cc:927] Time spent T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 12:10:52.119932 17193 raft_consensus.cc:493] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:10:52.093230 16602 raft_consensus.cc:2764] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Leader election decision vote started in defunct term 4: won
I20260709 12:10:52.095814 17294 raft_consensus.cc:2804] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:52.058393 17296 consensus_queue.cc:1048] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.075s
I20260709 12:10:52.124822 14877 leader_election.cc:304] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:10:52.133443 14185 raft_consensus.cc:3060] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:10:52.137465 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 76862.1us
I20260709 12:10:52.132489 14333 raft_consensus.cc:2468] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 3.
I20260709 12:10:52.135207 14877 leader_election.cc:304] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:10:52.143332 17153 raft_consensus.cc:3055] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:52.143890 17153 raft_consensus.cc:740] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:10:52.144721 17296 consensus_queue.cc:1059] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:52.124874 17193 raft_consensus.cc:3060] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:52.152257 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:52.155606 14256 raft_consensus.cc:1240] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:52.140617 16814 raft_consensus.cc:2804] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:52.161909 16814 raft_consensus.cc:697] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 5 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:10:52.162914 16814 consensus_queue.cc:237] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:52.164136 17052 leader_election.cc:290] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:52.164855 17052 raft_consensus.cc:2804] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:52.165311 17052 raft_consensus.cc:697] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 3 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:10:52.152872 17242 raft_consensus.cc:2804] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:52.165987 17242 raft_consensus.cc:493] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:52.166383 17242 raft_consensus.cc:3060] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:52.172866 17295 raft_consensus.cc:3055] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:52.173461 17295 raft_consensus.cc:740] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:52.145056 17153 consensus_queue.cc:260] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:52.179884 14261 leader_election.cc:290] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 7 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:52.200675 14185 raft_consensus.cc:2468] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 9.
I20260709 12:10:52.186303 17295 consensus_queue.cc:260] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:52.187264 17278 raft_consensus.cc:515] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:52.188575 17010 consensus_queue.cc:1059] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:52.189851 17052 consensus_queue.cc:237] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:52.191326 14877 leader_election.cc:304] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:10:52.192759 17153 raft_consensus.cc:3060] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:52.193401 17156 raft_consensus.cc:3060] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:52.193869 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:52.197960 17314 raft_consensus.cc:2749] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:52.198159 17202 consensus_queue.cc:1059] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 7.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:10:52.198536 14903 raft_consensus.cc:1275] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:10:52.198850 17305 consensus_queue.cc:1059] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:10:52.188505 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 48267.4us
I20260709 12:10:52.156165 17294 raft_consensus.cc:697] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 7 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:52.197954 17195 consensus_queue.cc:1059] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.002s
W20260709 12:10:52.219431 14229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:52.193112 17110 raft_consensus.cc:515] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:52.180531 17196 raft_consensus.cc:2804] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:10:52.223323 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 149350us
I20260709 12:10:52.220855 17105 raft_consensus.cc:697] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 7 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
W20260709 12:10:52.247025 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 151848us
W20260709 12:10:52.243748 14154 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 151572us
I20260709 12:10:52.227525 17241 raft_consensus.cc:3055] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:52.250726 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:52.251767 14257 raft_consensus.cc:1275] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:52.218528 17277 raft_consensus.cc:515] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:52.248981 14154 leader_election.cc:304] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:52.231093 17010 raft_consensus.cc:493] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:52.233364 17202 raft_consensus.cc:3055] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:52.242772 17104 raft_consensus.cc:2804] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:52.241189 17196 raft_consensus.cc:493] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:52.240722 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: true dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:10:52.258230 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:52.260041 14155 leader_election.cc:304] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:52.260411 14304 leader_election.cc:304] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:52.261835 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:52.251197 17314 raft_consensus.cc:493] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:52.260128 17110 leader_election.cc:290] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 8 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:52.278728 14257 raft_consensus.cc:3060] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:10:52.257929 17202 raft_consensus.cc:740] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:10:52.251327 17305 consensus_queue.cc:1243] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer 885067a0d31741bfb5c9935788e315bf log is divergent from this leader: its last log entry 11.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:10:52.278265 17101 raft_consensus.cc:515] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:52.255563 17221 raft_consensus.cc:493] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:52.251572 17241 raft_consensus.cc:740] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:10:52.277772 17196 raft_consensus.cc:3060] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:52.296478 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:52.297304 14333 raft_consensus.cc:3060] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:52.263656 17104 raft_consensus.cc:493] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:52.291962 17319 raft_consensus.cc:2804] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:10:52.315824 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 55891.4us
W20260709 12:10:52.316924 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 206631us
I20260709 12:10:52.317685 14257 raft_consensus.cc:2468] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 8.
I20260709 12:10:52.319223 14877 leader_election.cc:304] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
W20260709 12:10:52.320580 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:52.314636 17195 raft_consensus.cc:3055] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:52.264474 17010 raft_consensus.cc:515] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:52.311862 17104 raft_consensus.cc:3060] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:52.325234 14303 leader_election.cc:304] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
W20260709 12:10:52.326413 14154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:52.330142 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 67359.7us
I20260709 12:10:52.326982 14155 leader_election.cc:304] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:52.319155 17246 leader_election.cc:290] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 8 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:52.332012 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:52.332526 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:10:52.335251 14156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:52.332391 17305 raft_consensus.cc:493] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:52.332585 14185 raft_consensus.cc:1275] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:10:52.326205 17319 raft_consensus.cc:697] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 5 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:10:52.333273 17317 raft_consensus.cc:2749] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:52.333864 17277 leader_election.cc:290] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:52.334120 17278 leader_election.cc:290] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 7 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:52.323232 16814 raft_consensus.cc:2804] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:52.335289 14188 raft_consensus.cc:2376] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 7. Re-sending same reply.
I20260709 12:10:52.341225 14182 raft_consensus.cc:1275] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:52.289577 17314 raft_consensus.cc:515] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:52.321657 17221 raft_consensus.cc:515] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:52.323581 17195 raft_consensus.cc:740] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:10:52.328685 16602 raft_consensus.cc:2804] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:52.326431 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:52.345094 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:52.332531 17315 raft_consensus.cc:493] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:52.344839 17298 raft_consensus.cc:493] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:52.352591 14333 raft_consensus.cc:2468] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 8.
I20260709 12:10:52.364068 17298 raft_consensus.cc:515] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:52.364846 17326 consensus_queue.cc:1048] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 12:10:52.366246 17298 leader_election.cc:290] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:52.367090 17221 leader_election.cc:290] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:52.368188 16602 raft_consensus.cc:697] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 8 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:52.369176 16602 consensus_queue.cc:237] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:52.370013 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:52.370791 14333 raft_consensus.cc:2468] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 8.
I20260709 12:10:52.372035 14877 leader_election.cc:304] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:10:52.372906 17221 raft_consensus.cc:2804] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:52.373497 17221 raft_consensus.cc:493] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:52.373878 17221 raft_consensus.cc:3060] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:10:52.343379 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 85641.5us
I20260709 12:10:52.356724 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:52.359879 14187 raft_consensus.cc:3060] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:52.316047 17202 consensus_queue.cc:260] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:52.357942 17299 raft_consensus.cc:2749] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:52.362918 17315 raft_consensus.cc:515] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:52.364418 17314 leader_election.cc:290] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:52.355996 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: true dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:52.384744 14155 leader_election.cc:304] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:52.384831 14181 raft_consensus.cc:3060] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:52.378551 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:52.382817 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:52.386240 14182 raft_consensus.cc:3060] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:52.383926 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:52.358322 16814 raft_consensus.cc:697] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 8 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:10:52.389053 14185 raft_consensus.cc:3060] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:52.390542 14188 raft_consensus.cc:3060] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:52.356770 17241 consensus_queue.cc:260] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:52.393786 17317 raft_consensus.cc:2749] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:52.394150 17202 raft_consensus.cc:3060] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:52.394857 17241 raft_consensus.cc:3060] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:52.398252 14303 leader_election.cc:304] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:52.398754 17010 leader_election.cc:290] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:52.341100 17294 consensus_queue.cc:237] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:52.402601 17320 raft_consensus.cc:2804] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:52.407886 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:52.408051 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:52.410820 14229 leader_election.cc:304] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:52.346352 17305 raft_consensus.cc:515] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:52.344460 17105 consensus_queue.cc:237] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:52.419037 14333 raft_consensus.cc:2468] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 6.
I20260709 12:10:52.422603 14187 raft_consensus.cc:2468] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 9.
I20260709 12:10:52.420958 14877 leader_election.cc:304] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:10:52.426658 14908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:10:52.427560 14257 raft_consensus.cc:2468] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 5.
I20260709 12:10:52.429211 17318 consensus_queue.cc:1048] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.024s
I20260709 12:10:52.430706 17318 raft_consensus.cc:2749] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:10:52.432331 14155 leader_election.cc:304] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:52.433760 14155 leader_election.cc:304] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:52.437448 14182 raft_consensus.cc:2468] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 6.
I20260709 12:10:52.438333 14181 raft_consensus.cc:2468] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 7.
I20260709 12:10:52.421478 17326 raft_consensus.cc:493] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:52.443132 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:52.444082 14188 raft_consensus.cc:2468] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 8.
I20260709 12:10:52.416184 17277 consensus_queue.cc:1048] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 12:10:52.450662 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:52.454288 14182 raft_consensus.cc:2468] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 8.
I20260709 12:10:52.440757 17295 raft_consensus.cc:3060] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:52.446322 17314 raft_consensus.cc:2749] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:52.444013 17010 raft_consensus.cc:2804] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:52.448716 17317 raft_consensus.cc:2749] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:10:52.478296 14230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:52.458154 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 64393.3us
I20260709 12:10:52.434902 17195 consensus_queue.cc:260] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:52.461390 17010 raft_consensus.cc:493] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:52.524375 14185 raft_consensus.cc:2468] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 7.
I20260709 12:10:52.526968 17328 raft_consensus.cc:2804] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:10:52.530336 14230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:52.456874 17242 raft_consensus.cc:515] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:52.530049 17278 raft_consensus.cc:493] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
W20260709 12:10:52.576241 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 188624us
I20260709 12:10:52.578269 14229 leader_election.cc:304] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:52.554834 17010 raft_consensus.cc:3060] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:52.580382 14229 leader_election.cc:304] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
W20260709 12:10:52.582267 14230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:52.519680 16814 consensus_queue.cc:237] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:52.590245 14229 leader_election.cc:304] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:52.583195 17205 raft_consensus.cc:493] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
W20260709 12:10:52.583945 14136 auto_rebalancer.cc:629] Failed to schedule move for tablet 57e5f03a80374104a130f5b0e70a0280: Illegal state: Replica 885067a0d31741bfb5c9935788e315bf is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 7 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } }
I20260709 12:10:52.584432 17316 raft_consensus.cc:493] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:52.458406 17326 raft_consensus.cc:515] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:52.585247 17196 raft_consensus.cc:515] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:52.558776 17320 raft_consensus.cc:697] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 3 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:52.562311 17325 raft_consensus.cc:493] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:52.585403 17101 leader_election.cc:290] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 8 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:52.580199 17314 raft_consensus.cc:493] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:52.593163 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 125750us
I20260709 12:10:52.425526 17319 consensus_queue.cc:237] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:10:52.607208 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 55163.9us
W20260709 12:10:52.618340 14230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:52.618515 14229 leader_election.cc:304] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:52.599774 16750 raft_consensus.cc:493] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:52.621348 17193 raft_consensus.cc:515] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } }
I20260709 12:10:52.614161 17314 raft_consensus.cc:515] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:52.623805 17193 leader_election.cc:290] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 7 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:52.624780 17314 leader_election.cc:290] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:52.625564 17196 leader_election.cc:290] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:52.625813 14333 raft_consensus.cc:1275] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:10:52.626914 17242 leader_election.cc:290] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 7 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:52.597909 17110 raft_consensus.cc:493] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:52.628222 14228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:52.588006 17277 consensus_queue.cc:1048] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 12:10:52.605584 17195 raft_consensus.cc:3060] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:52.591915 17278 raft_consensus.cc:515] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:52.638345 17110 raft_consensus.cc:515] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:52.644886 14908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
W20260709 12:10:52.628196 17334 log.cc:927] Time spent T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:10:52.649367 14908 raft_consensus.cc:2468] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 7.
I20260709 12:10:52.596709 17205 raft_consensus.cc:515] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:52.630959 16750 raft_consensus.cc:515] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:52.654498 17313 raft_consensus.cc:3055] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:10:52.654999 17313 raft_consensus.cc:740] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:10:52.656315 17212 consensus_queue.cc:1048] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 12:10:52.656649 17331 log.cc:927] Time spent T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 12:10:52.638561 17101 raft_consensus.cc:2804] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:52.626811 17333 consensus_queue.cc:1048] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 12:10:52.677920 17315 leader_election.cc:290] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:52.679867 17205 leader_election.cc:290] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:52.682188 17101 raft_consensus.cc:697] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 9 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:10:52.683264 17101 consensus_queue.cc:237] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:52.670022 17196 consensus_queue.cc:1059] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.016s
I20260709 12:10:52.687166 17034 raft_consensus.cc:3055] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:52.687634 17193 consensus_queue.cc:1048] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:52.650338 17305 leader_election.cc:290] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:52.681450 17278 leader_election.cc:290] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:52.687598 17034 raft_consensus.cc:740] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:52.667531 17341 raft_consensus.cc:2804] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:10:52.706461 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 88018us
I20260709 12:10:52.708824 14229 leader_election.cc:304] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:52.603737 17316 raft_consensus.cc:515] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:52.716296 14155 leader_election.cc:304] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:52.698199 17305 raft_consensus.cc:2804] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:52.699160 17278 raft_consensus.cc:2804] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:52.687305 17296 consensus_queue.cc:1048] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.019s
I20260709 12:10:52.601640 17325 raft_consensus.cc:515] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:10:52.722093 14229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:52.701988 17328 raft_consensus.cc:697] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 7 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
W20260709 12:10:52.723266 14229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:52.718590 17221 raft_consensus.cc:515] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:52.728185 17314 raft_consensus.cc:2749] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:52.655961 17313 consensus_queue.cc:260] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:10:52.729182 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 110707us
I20260709 12:10:52.735641 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:52.736421 14182 raft_consensus.cc:3060] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:52.715756 17341 raft_consensus.cc:697] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 6 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:10:52.742985 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:52.735376 14905 raft_consensus.cc:2468] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 7.
I20260709 12:10:52.739804 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:52.746539 14908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:52.711280 17318 consensus_queue.cc:1048] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.018s
I20260709 12:10:52.742057 14333 raft_consensus.cc:1240] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:52.724278 17277 raft_consensus.cc:493] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:52.754998 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:52.757406 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:52.740969 14185 raft_consensus.cc:1275] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 8. (term mismatch)
I20260709 12:10:52.724413 17305 raft_consensus.cc:697] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 7 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:10:52.759850 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:52.759341 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:52.770776 17034 consensus_queue.cc:260] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:52.795585 17104 raft_consensus.cc:515] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:52.741858 17278 raft_consensus.cc:697] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 8 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:10:52.747695 17153 consensus_queue.cc:1048] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.058s
I20260709 12:10:52.798156 17344 raft_consensus.cc:2804] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:52.806792 14182 raft_consensus.cc:2468] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 7.
I20260709 12:10:52.807413 14333 raft_consensus.cc:2368] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 8. Current term is 9.
I20260709 12:10:52.779312 16814 raft_consensus.cc:493] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:52.710685 17320 consensus_queue.cc:237] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:52.838658 17221 leader_election.cc:290] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 9 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:52.839576 16814 raft_consensus.cc:515] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:52.796959 17341 consensus_queue.cc:237] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:52.754238 16750 leader_election.cc:290] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:52.842986 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:52.843804 14261 raft_consensus.cc:2368] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 6. Current term is 7.
I20260709 12:10:52.810921 14335 raft_consensus.cc:1275] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:10:52.845970 17305 consensus_queue.cc:237] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:10:52.849092 17156 consensus_meta.cc:287] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.618s	user 0.009s	sys 0.000s
W20260709 12:10:52.753747 17332 log.cc:927] Time spent T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.154s	user 0.000s	sys 0.001s
I20260709 12:10:52.754103 17313 raft_consensus.cc:3060] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:52.812880 17246 raft_consensus.cc:493] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:52.854251 17246 raft_consensus.cc:515] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:52.855314 16814 leader_election.cc:290] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:52.856473 17246 leader_election.cc:290] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:10:52.857115 14302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:52.755545 17298 raft_consensus.cc:493] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:52.788539 14185 pending_rounds.cc:85] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf: Aborting all ops after (but not including) 7
I20260709 12:10:52.811551 17326 leader_election.cc:290] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:52.815440 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:10:52.820108 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:52.858214 17298 raft_consensus.cc:515] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:52.859028 14257 raft_consensus.cc:2393] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 6: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:10:52.820547 14256 raft_consensus.cc:1275] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 12:10:52.859783 14256 pending_rounds.cc:85] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec: Aborting all ops after (but not including) 4
I20260709 12:10:52.860093 14256 pending_rounds.cc:107] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 12:10:52.860322 14256 raft_consensus.cc:2889] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:52.860549 17298 leader_election.cc:290] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:52.862311 17278 consensus_queue.cc:237] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:52.864063 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:52.770452 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:52.864892 14256 raft_consensus.cc:2468] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 6.
I20260709 12:10:52.865286 14903 raft_consensus.cc:2393] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 5: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:10:52.822058 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:52.822409 14263 raft_consensus.cc:1275] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 12:10:52.866128 14263 pending_rounds.cc:85] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec: Aborting all ops after (but not including) 4
I20260709 12:10:52.866425 14263 pending_rounds.cc:107] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 12:10:52.866677 14263 raft_consensus.cc:2889] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:52.803176 14332 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3"
dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
mode: GRACEFUL
new_leader_uuid: "885067a0d31741bfb5c9935788e315bf"
 from {username='slave'} at 127.0.0.1:50896
I20260709 12:10:52.867650 17316 leader_election.cc:290] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:52.867784 14332 raft_consensus.cc:606] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Received request to transfer leadership to TS 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:52.868278 14332 raft_consensus.cc:614] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:52.833021 17104 leader_election.cc:290] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 4 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:52.834059 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:52.871337 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:52.834694 17325 leader_election.cc:290] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:52.834952 14333 raft_consensus.cc:1275] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:52.836426 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:52.852322 17348 raft_consensus.cc:493] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:52.852548 17202 raft_consensus.cc:493] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:52.852389 17344 raft_consensus.cc:697] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 7 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:10:52.858147 14185 pending_rounds.cc:107] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 12:10:52.907572 14185 raft_consensus.cc:2889] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:52.819691 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:52.908072 17344 consensus_queue.cc:237] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:52.908641 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:52.909071 14259 raft_consensus.cc:2468] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 9.
I20260709 12:10:52.909262 14190 raft_consensus.cc:3060] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:52.830549 17328 consensus_queue.cc:237] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:52.882213 14330 raft_consensus.cc:2468] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 10.
I20260709 12:10:52.892319 17104 raft_consensus.cc:493] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:52.910677 17104 raft_consensus.cc:515] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:52.911278 17202 raft_consensus.cc:515] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:52.896759 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:52.739708 17052 consensus_queue.cc:1048] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.080s
I20260709 12:10:52.902925 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:52.897506 17338 consensus_queue.cc:1059] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 12:10:52.905512 14876 leader_election.cc:304] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:52.914012 14911 raft_consensus.cc:2468] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 7.
I20260709 12:10:52.946494 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:52.947307 14188 raft_consensus.cc:2468] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 5.
I20260709 12:10:52.951694 14303 leader_election.cc:304] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:10:52.953491 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:52.912810 17104 leader_election.cc:290] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:52.953536 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:52.817049 17277 raft_consensus.cc:515] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } }
I20260709 12:10:52.956647 14182 raft_consensus.cc:3060] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:10:52.957192 14185 raft_consensus.cc:2376] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 7. Re-sending same reply.
I20260709 12:10:52.963709 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:52.965116 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:52.968255 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:52.968642 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:52.933910 17325 raft_consensus.cc:493] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:52.969549 14181 raft_consensus.cc:2393] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 6: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:10:52.943473 17349 raft_consensus.cc:493] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:52.971581 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:52.975731 14185 raft_consensus.cc:3060] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:52.975706 14155 leader_election.cc:304] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:52.950337 17195 raft_consensus.cc:493] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:52.979660 14181 raft_consensus.cc:1275] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:10:52.956707 16763 raft_consensus.cc:2804] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:53.036516 14185 raft_consensus.cc:2468] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 5.
I20260709 12:10:52.985013 14184 raft_consensus.cc:1240] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 7. Current term is 8. Ops: [3.3-7.5]
I20260709 12:10:52.978827 17349 raft_consensus.cc:515] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:52.979111 17195 raft_consensus.cc:515] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:53.046782 14184 raft_consensus.cc:1275] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:10:52.986665 17343 raft_consensus.cc:493] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:53.047652 17343 raft_consensus.cc:515] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:53.047255 17349 leader_election.cc:290] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:53.049183 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:53.049657 14190 raft_consensus.cc:2468] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 9.
I20260709 12:10:52.979189 17325 raft_consensus.cc:515] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:52.986948 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:52.989408 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:52.985962 17246 raft_consensus.cc:2749] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:52.991112 17242 raft_consensus.cc:493] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:53.051702 14183 raft_consensus.cc:2468] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 8.
I20260709 12:10:52.979503 14904 raft_consensus.cc:2393] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 3: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:10:53.003263 17010 raft_consensus.cc:515] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:53.007117 17202 leader_election.cc:290] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:53.008173 14259 raft_consensus.cc:1275] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:53.008885 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:53.009644 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:53.009938 17104 consensus_queue.cc:1048] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:10:53.010358 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:53.070501 14257 raft_consensus.cc:3060] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:53.011104 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:53.074326 14261 raft_consensus.cc:3060] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:53.079154 14338 raft_consensus.cc:1275] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:53.011880 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:53.015403 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:53.085177 14265 raft_consensus.cc:3060] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:53.016479 14335 raft_consensus.cc:1275] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:10:53.018211 14262 pending_rounds.cc:85] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec: Aborting all ops after (but not including) 3
I20260709 12:10:53.086845 14262 pending_rounds.cc:107] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec: Aborting uncommitted NO_OP operation due to leader change: 8.4
I20260709 12:10:53.087177 14262 raft_consensus.cc:2889] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:53.020408 17110 leader_election.cc:290] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:52.933518 17348 raft_consensus.cc:515] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:53.024554 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:52.983588 14189 raft_consensus.cc:2955] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 5 to 6, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:10:52.956931 17316 raft_consensus.cc:493] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:52.956564 17309 raft_consensus.cc:493] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:53.115694 17309 raft_consensus.cc:515] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:52.959370 17196 raft_consensus.cc:2804] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:53.117007 17196 raft_consensus.cc:697] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 7 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:53.118050 17196 consensus_queue.cc:237] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:53.038487 14258 raft_consensus.cc:1275] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:53.120613 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:53.121124 14258 raft_consensus.cc:1275] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:53.121284 14330 raft_consensus.cc:3060] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:53.037312 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
W20260709 12:10:53.043052 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 50356.4us
I20260709 12:10:53.123929 14333 raft_consensus.cc:3060] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:53.124979 14155 leader_election.cc:304] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:53.037896 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:53.125907 17153 consensus_queue.cc:1059] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:52.972568 17034 raft_consensus.cc:3060] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:53.066471 14182 raft_consensus.cc:2468] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 4.
I20260709 12:10:53.055276 14876 leader_election.cc:304] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:52.990103 17239 raft_consensus.cc:493] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:53.103467 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:53.067263 17242 raft_consensus.cc:515] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:53.128067 17316 raft_consensus.cc:515] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:53.109550 14264 raft_consensus.cc:3060] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:53.130721 14181 raft_consensus.cc:1275] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 12:10:53.131157 14181 pending_rounds.cc:85] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf: Aborting all ops after (but not including) 4
I20260709 12:10:53.114089 14905 raft_consensus.cc:1275] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:10:53.112681 14337 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c"
dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
mode: GRACEFUL
new_leader_uuid: "885067a0d31741bfb5c9935788e315bf"
 from {username='slave'} at 127.0.0.1:50896
I20260709 12:10:53.126088 14332 raft_consensus.cc:2468] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 3.
W20260709 12:10:53.115159 17350 log.cc:927] Time spent T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:10:53.133285 14336 raft_consensus.cc:3060] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:53.133852 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:53.139977 14259 raft_consensus.cc:3060] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:53.058109 17156 consensus_queue.cc:1059] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.076s
I20260709 12:10:53.148057 17156 raft_consensus.cc:3055] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:53.148593 17156 raft_consensus.cc:740] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:10:53.131382 14181 pending_rounds.cc:107] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 12:10:53.150097 14181 raft_consensus.cc:2889] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:53.047273 17195 leader_election.cc:290] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:53.127326 17153 raft_consensus.cc:3055] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:53.151304 17153 raft_consensus.cc:740] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:10:53.152415 17153 consensus_queue.cc:260] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:53.154799 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:53.140152 14256 raft_consensus.cc:1275] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:10:53.132233 14337 raft_consensus.cc:606] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 5 LEADER]: Received request to transfer leadership to TS 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:53.175263 14155 leader_election.cc:400] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 8 election: Vote denied by peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957) with higher term. Message: Invalid argument: T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 8. Current term is 9.
I20260709 12:10:53.175890 14155 leader_election.cc:403] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 12:10:53.176072 14908 raft_consensus.cc:2368] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 6. Current term is 7.
I20260709 12:10:53.177001 14257 raft_consensus.cc:2468] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 7.
I20260709 12:10:53.177532 14261 raft_consensus.cc:2468] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 7.
W20260709 12:10:53.179195 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 123995us
I20260709 12:10:53.180059 14876 leader_election.cc:304] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:53.180727 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:53.181614 14263 raft_consensus.cc:2468] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 8.
W20260709 12:10:53.182123 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 44389.6us
I20260709 12:10:53.069370 16763 raft_consensus.cc:697] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [term 7 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
W20260709 12:10:53.183172 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:53.184018 14155 leader_election.cc:304] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:53.185002 17314 raft_consensus.cc:2749] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957) with higher term. Message: Invalid argument: T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 8. Current term is 9.
I20260709 12:10:53.185516 17315 consensus_queue.cc:1048] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:53.186404 17052 consensus_queue.cc:1048] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:53.151018 17010 leader_election.cc:290] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 7 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:53.128311 17278 raft_consensus.cc:493] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:53.175261 17105 raft_consensus.cc:493] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:53.199050 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:53.057912 16814 consensus_queue.cc:1048] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.125s
I20260709 12:10:53.212859 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:53.219102 14338 raft_consensus.cc:2468] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 6.
I20260709 12:10:53.210386 14335 raft_consensus.cc:3060] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:53.220680 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:53.211054 14258 raft_consensus.cc:1275] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:53.246943 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:10:53.230400 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:53.153839 17239 raft_consensus.cc:515] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:53.200183 17153 raft_consensus.cc:3060] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:53.201210 17110 raft_consensus.cc:2804] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:53.201782 17246 raft_consensus.cc:2804] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:10:53.149502 17156 consensus_queue.cc:260] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:53.240903 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:53.202006 17212 raft_consensus.cc:2804] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:53.234324 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:53.270669 14154 leader_election.cc:304] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:53.283758 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:53.284610 14911 raft_consensus.cc:2468] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 5.
I20260709 12:10:53.287904 14154 leader_election.cc:304] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:53.251487 14190 raft_consensus.cc:2393] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 5: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:10:53.254026 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:53.254218 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:53.215549 17343 leader_election.cc:290] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:53.254784 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:53.255868 17338 raft_consensus.cc:493] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:53.256781 17309 leader_election.cc:290] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:53.192503 17296 consensus_queue.cc:1048] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 12:10:53.216830 17314 raft_consensus.cc:493] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:53.262724 14336 raft_consensus.cc:2468] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 4.
I20260709 12:10:53.275199 17246 raft_consensus.cc:493] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:53.270401 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:53.234050 17242 leader_election.cc:290] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:53.296828 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:53.314756 14258 raft_consensus.cc:2468] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 7.
I20260709 12:10:53.297178 14877 leader_election.cc:304] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:53.317257 14336 raft_consensus.cc:1240] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:53.222010 17278 raft_consensus.cc:515] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:53.302848 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:53.272210 17110 raft_consensus.cc:493] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:53.266609 14333 raft_consensus.cc:2468] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 7.
I20260709 12:10:53.223793 17105 raft_consensus.cc:515] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:53.341019 14877 leader_election.cc:304] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:53.341817 14333 raft_consensus.cc:1275] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:10:53.342458 14186 raft_consensus.cc:1240] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:10:53.237993 14188 raft_consensus.cc:1217] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 11 LEADER]: Deduplicated request from leader. Original: 9.5->[10.6-10.6]   Dedup: 10.6->[]
I20260709 12:10:53.318858 14263 raft_consensus.cc:3060] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:10:53.320102 14904 raft_consensus.cc:1275] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:53.320585 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:53.320992 17278 leader_election.cc:290] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:53.299364 17315 raft_consensus.cc:2804] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:53.359097 14181 raft_consensus.cc:1275] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:53.321538 17156 raft_consensus.cc:3060] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:53.303508 17104 consensus_queue.cc:1048] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 12:10:53.321925 14332 raft_consensus.cc:1275] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:10:53.315886 17246 raft_consensus.cc:3060] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:53.301834 17212 raft_consensus.cc:697] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 9 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:10:53.382706 17212 consensus_queue.cc:237] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:53.331188 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:53.386108 14258 raft_consensus.cc:2468] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 6.
I20260709 12:10:53.391505 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:53.391685 14261 raft_consensus.cc:1275] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:10:53.392213 14257 raft_consensus.cc:2468] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 8.
I20260709 12:10:53.391808 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:53.398705 14256 raft_consensus.cc:2468] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 6.
I20260709 12:10:53.346804 14338 raft_consensus.cc:3060] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:53.341513 17110 raft_consensus.cc:3060] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:53.348071 16814 raft_consensus.cc:493] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:53.306422 17325 leader_election.cc:290] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:53.419723 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:53.456117 14261 raft_consensus.cc:1240] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:53.321640 17295 raft_consensus.cc:3055] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:53.438447 14334 raft_consensus.cc:2468] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 6.
I20260709 12:10:53.461951 17295 raft_consensus.cc:740] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:53.429221 14259 raft_consensus.cc:2468] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 7.
I20260709 12:10:53.411670 14258 raft_consensus.cc:1275] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 12:10:53.369977 17342 raft_consensus.cc:2804] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:53.300110 17347 consensus_queue.cc:1048] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 12:10:53.316335 17338 raft_consensus.cc:515] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:53.463418 17034 raft_consensus.cc:493] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:53.463945 17034 raft_consensus.cc:515] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:53.315560 17336 raft_consensus.cc:493] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:53.410472 17316 leader_election.cc:290] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:53.374343 17105 leader_election.cc:290] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:53.376137 17348 leader_election.cc:290] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:53.314752 17314 raft_consensus.cc:515] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:53.308653 16763 consensus_queue.cc:237] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:53.362675 16750 raft_consensus.cc:2804] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:53.359365 17315 raft_consensus.cc:493] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:53.451921 14187 raft_consensus.cc:2410] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:10:53.458592 16814 raft_consensus.cc:515] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:10:53.432508 14088 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60420 (request call id 254) took 21671 ms (client timeout 15000 ms). Trace:
I20260709 12:10:53.459801 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:53.461216 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:53.650462 14184 raft_consensus.cc:2468] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 6.
I20260709 12:10:53.358278 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:53.463075 14257 raft_consensus.cc:1240] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:10:53.361603 14264 raft_consensus.cc:2468] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 5.
I20260709 12:10:53.347376 14188 raft_consensus.cc:1240] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 11 LEADER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 12:10:53.457530 14303 leader_election.cc:304] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
W20260709 12:10:53.653566 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 196152us
I20260709 12:10:53.462961 17295 consensus_queue.cc:260] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:53.465382 17338 leader_election.cc:290] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:53.508304 14330 raft_consensus.cc:2468] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 9.
I20260709 12:10:53.678726 17295 raft_consensus.cc:3060] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:53.436143 14335 raft_consensus.cc:1275] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:53.660989 17110 raft_consensus.cc:515] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:53.454074 14265 raft_consensus.cc:2468] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 8.
I20260709 12:10:53.680555 14911 raft_consensus.cc:1240] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:53.488344 17317 raft_consensus.cc:493] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:53.681488 14260 raft_consensus.cc:1240] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:10:53.681457 17317 raft_consensus.cc:515] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:53.437327 14876 leader_election.cc:304] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
W20260709 12:10:53.682629 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 245371us
W20260709 12:10:53.487823 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:53.431932 14263 raft_consensus.cc:2468] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 7.
I20260709 12:10:53.683952 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:53.520504 14338 raft_consensus.cc:2468] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 7.
I20260709 12:10:53.627002 17344 raft_consensus.cc:493] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:53.614120 17034 leader_election.cc:290] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:53.522485 17342 raft_consensus.cc:493] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:53.622411 17277 leader_election.cc:290] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187)
I20260709 12:10:53.615803 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:53.689692 14912 raft_consensus.cc:2393] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 8: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
I20260709 12:10:53.613301 14904 raft_consensus.cc:1275] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 12:10:53.630492 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 289547us
I20260709 12:10:53.574174 14229 leader_election.cc:304] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
W20260709 12:10:53.636981 14154 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 349170us
I20260709 12:10:53.693349 14877 leader_election.cc:304] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:10:53.549420 17336 raft_consensus.cc:515] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:53.642710 14155 leader_election.cc:400] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 6 pre-election: Vote denied by peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673) with higher term. Message: Invalid argument: T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 6. Current term is 7.
W20260709 12:10:53.695107 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 177794us
W20260709 12:10:53.697508 14154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:53.634474 17104 raft_consensus.cc:493] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:53.644491 16750 raft_consensus.cc:493] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:53.657553 17352 raft_consensus.cc:493] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:53.637946 17368 raft_consensus.cc:493] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:53.663259 17314 leader_election.cc:290] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:53.663918 14185 raft_consensus.cc:1275] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:10:53.664489 17196 raft_consensus.cc:2804] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:53.665594 14905 raft_consensus.cc:1275] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:10:53.667088 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:53.689314 17342 raft_consensus.cc:3060] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:53.706676 16750 raft_consensus.cc:3060] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:53.710067 17352 raft_consensus.cc:515] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:53.649075 17052 raft_consensus.cc:2804] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:53.703387 17347 consensus_queue.cc:1048] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 12:10:53.672740 17246 raft_consensus.cc:515] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:53.655536 17315 raft_consensus.cc:3060] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:53.656096 17156 raft_consensus.cc:493] T f4739bc22bfe44fcba807da02d9351b6 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:53.466883 14258 pending_rounds.cc:85] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec: Aborting all ops after (but not including) 3
I20260709 12:10:53.690361 17335 raft_consensus.cc:2804] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:53.654651 14303 leader_election.cc:304] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:10:53.730628 14337 raft_consensus.cc:2393] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 7: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:10:53.690256 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:53.690656 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:53.691259 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:53.691861 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:53.657399 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:53.733119 14335 raft_consensus.cc:2468] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 9.
I20260709 12:10:53.698181 14229 leader_election.cc:400] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 pre-election: Vote denied by peer 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341) with higher term. Message: Invalid argument: T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 6. Current term is 7.
I20260709 12:10:53.733923 14229 leader_election.cc:403] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:10:53.734277 14230 leader_election.cc:336] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957): Timed out: RequestConsensusVote RPC to 127.12.174.131:45957 timed out after 1.716s (SENT)
I20260709 12:10:53.734489 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:53.734918 14230 leader_election.cc:304] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:53.702384 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:53.704327 14877 leader_election.cc:304] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:10:53.670300 16814 leader_election.cc:290] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:53.737607 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:53.703625 17277 raft_consensus.cc:493] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:53.713284 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:53.736953 14877 leader_election.cc:304] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:10:53.720570 17034 raft_consensus.cc:493] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:53.726809 14258 pending_rounds.cc:107] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 12:10:53.422896 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:10:53.649209 14088 rpcz_store.cc:269] 0709 12:10:31.761476 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:31.761701 (+   225us) service_pool.cc:224] Handling call
0709 12:10:32.632237 (+870536us) spinlock_profiling.cc:243] Waited 728 ms on lock 0x7b54002e3454. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a5090 00007f2127143f3a 00007f212cef9e9c 00007f212cff804e 00007f212b4b92a4 00007f212b4b9232 00007f212b4b9161 00007f212b4b90dc 00007f212b4b8392 00007f212547648c 00007f21254758c6
0709 12:10:53.432369 (+20800132us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:51.791476 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:51.866741 (+ 75265us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:51.866798 (+    57us) write_op.cc:435] Acquired schema lock
0709 12:10:51.866840 (+    42us) tablet.cc:662] Decoding operations
0709 12:10:51.867744 (+   904us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:51.867829 (+    85us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:51.867863 (+    34us) tablet.cc:685] Acquiring locks for 6 operations
0709 12:10:51.868530 (+   667us) tablet.cc:701] Row locks acquired
0709 12:10:51.868576 (+    46us) write_op.cc:260] PREPARE: finished
0709 12:10:51.868752 (+   176us) write_op.cc:270] Start()
0709 12:10:51.868896 (+   144us) write_op.cc:276] Timestamp: P: 1783599051868683 usec, L: 0
0709 12:10:51.868915 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 12:10:51.869678 (+   763us) log.cc:844] Serialized 2490 byte log entry
0709 12:10:52.369844 (+500166us) op_driver.cc:464] REPLICATION: finished
0709 12:10:52.523822 (+153978us) write_op.cc:301] APPLY: starting
0709 12:10:52.557198 (+ 33376us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:52.586372 (+ 29174us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:52.586567 (+   195us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:52.673843 (+ 87276us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:52.674164 (+   321us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 12:10:52.674224 (+    60us) write_op.cc:312] APPLY: finished
0709 12:10:52.674558 (+   334us) log.cc:844] Serialized 53 byte log entry
0709 12:10:52.674765 (+   207us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:52.674875 (+   110us) write_op.cc:454] Released schema lock
0709 12:10:52.674938 (+    63us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:52.675365 (+   427us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:52.675395 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1475,"reported_tablets":36,"spinlock_wait_cycles":1674793344,"child_traces":[["op",{"apply.queue_time_us":87999,"apply.run_cpu_time_us":3799,"apply.run_wall_time_us":158752,"num_ops":6,"prepare.queue_time_us":150777,"prepare.run_cpu_time_us":35573,"prepare.run_wall_time_us":250212,"raft.queue_time_us":197078,"raft.run_cpu_time_us":12002,"raft.run_wall_time_us":71249,"replication_time_us":489596,"thread_start_us":327260,"threads_started":4,"wal-append.queue_time_us":209675,"wal-append.run_cpu_time_us":48074,"wal-append.run_wall_time_us":1575348}]]}
I20260709 12:10:53.686872 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:53.735984 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:53.726083 17052 raft_consensus.cc:493] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:53.735878 14229 leader_election.cc:304] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:53.771360 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:53.709021 17242 raft_consensus.cc:2804] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:53.726644 17326 raft_consensus.cc:493] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:53.769502 14258 raft_consensus.cc:2889] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:53.770051 14256 raft_consensus.cc:2468] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 6.
I20260709 12:10:53.711189 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:53.726951 17343 raft_consensus.cc:493] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:53.738246 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:53.775635 14186 raft_consensus.cc:1240] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 10. Current term is 11. Ops: [10.8-10.8]
W20260709 12:10:53.742385 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 99814.3us
I20260709 12:10:53.706336 17348 raft_consensus.cc:3060] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:53.785960 14333 raft_consensus.cc:2468] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 5.
I20260709 12:10:53.779567 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:53.795246 14263 raft_consensus.cc:2468] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 7.
I20260709 12:10:53.727236 17299 raft_consensus.cc:2749] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:53.782892 14190 raft_consensus.cc:2468] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 7.
I20260709 12:10:53.690366 17344 raft_consensus.cc:515] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:53.740815 17325 raft_consensus.cc:2749] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341) with higher term. Message: Invalid argument: T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 6. Current term is 7.
I20260709 12:10:53.805166 14155 leader_election.cc:304] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:53.783394 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:53.785012 14265 raft_consensus.cc:1275] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:10:53.727650 17196 raft_consensus.cc:493] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:53.787169 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:10:53.789990 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 55749.8us
I20260709 12:10:53.790463 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:53.768719 17212 raft_consensus.cc:2804] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:53.827025 17212 raft_consensus.cc:493] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:53.827196 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:53.824616 14337 raft_consensus.cc:2468] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 8.
I20260709 12:10:53.833422 17196 raft_consensus.cc:3060] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:53.834213 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:53.835016 14339 raft_consensus.cc:3060] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:53.843238 17110 leader_election.cc:290] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 9 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:10:53.797789 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 143185us
I20260709 12:10:53.845018 14303 leader_election.cc:304] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:53.845952 17314 consensus_queue.cc:1048] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:53.846483 14303 leader_election.cc:304] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:53.847637 17373 raft_consensus.cc:2749] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:53.782655 17277 raft_consensus.cc:515] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:53.849442 17246 leader_election.cc:290] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 11 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:53.850003 17277 leader_election.cc:290] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:53.851644 17239 leader_election.cc:290] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:53.852372 17196 raft_consensus.cc:515] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:53.852836 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:53.853682 17336 leader_election.cc:290] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:53.854141 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:53.854947 14338 raft_consensus.cc:2393] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 8: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:10:53.853976 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:53.855898 14337 raft_consensus.cc:2368] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 6. Current term is 7.
I20260709 12:10:53.737898 14903 raft_consensus.cc:2468] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 5.
I20260709 12:10:53.774665 17052 raft_consensus.cc:3060] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:53.775166 17242 raft_consensus.cc:493] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:53.858209 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:53.858021 17242 raft_consensus.cc:3060] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:53.859337 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:53.783394 17278 raft_consensus.cc:2749] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:53.707845 17104 raft_consensus.cc:515] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:53.798537 17343 raft_consensus.cc:515] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:53.862357 17104 leader_election.cc:290] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:53.863574 17343 leader_election.cc:290] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:53.865446 17344 leader_election.cc:290] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:53.726722 17367 consensus_queue.cc:1048] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.110s
I20260709 12:10:53.867022 17367 raft_consensus.cc:493] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:53.867532 17367 raft_consensus.cc:515] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:53.869679 17344 raft_consensus.cc:493] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:53.871592 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:53.775274 17034 raft_consensus.cc:515] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:10:53.825227 14230 leader_election.cc:336] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957): Timed out: RequestConsensusVote RPC to 127.12.174.131:45957 timed out after 1.791s (SENT)
I20260709 12:10:53.854305 14335 raft_consensus.cc:1240] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 5. Current term is 6. Ops: []
W20260709 12:10:53.872750 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 47565.1us
I20260709 12:10:53.870273 17344 raft_consensus.cc:515] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:53.876911 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:53.877666 14188 raft_consensus.cc:3060] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:53.878726 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:53.782400 17313 raft_consensus.cc:2749] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:53.871706 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:53.814733 17298 consensus_queue.cc:1048] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.081s
I20260709 12:10:53.895901 14187 raft_consensus.cc:1275] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:10:53.897284 14187 raft_consensus.cc:1275] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
W20260709 12:10:53.897915 14230 leader_election.cc:336] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957): Timed out: RequestConsensusVote RPC to 127.12.174.131:45957 timed out after 1.861s (SENT)
I20260709 12:10:53.898460 14230 leader_election.cc:304] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:53.880196 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:53.899335 17328 raft_consensus.cc:2749] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:53.900126 14182 raft_consensus.cc:1275] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 12:10:53.900528 14182 pending_rounds.cc:85] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf: Aborting all ops after (but not including) 3
I20260709 12:10:53.900755 14182 pending_rounds.cc:107] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 12:10:53.900982 14182 raft_consensus.cc:2889] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:53.825376 17153 raft_consensus.cc:2804] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:53.901963 17153 raft_consensus.cc:493] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:53.902367 17153 raft_consensus.cc:3060] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:53.905833 14230 leader_election.cc:336] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957): Timed out: RequestConsensusVote RPC to 127.12.174.131:45957 timed out after 1.925s (SENT)
I20260709 12:10:53.881552 14186 raft_consensus.cc:1275] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:53.786396 17368 raft_consensus.cc:515] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:53.820881 14155 leader_election.cc:304] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:53.799183 14336 raft_consensus.cc:2468] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 6.
I20260709 12:10:53.918007 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:53.918706 14256 raft_consensus.cc:2468] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 9.
I20260709 12:10:53.872783 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:10:53.918841 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 98384.5us
I20260709 12:10:53.919495 14337 raft_consensus.cc:2393] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 5: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:10:53.917799 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:53.920313 14262 raft_consensus.cc:2468] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 8.
I20260709 12:10:53.920779 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:53.918726 17298 raft_consensus.cc:2804] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:53.918999 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:53.921618 17298 raft_consensus.cc:493] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:53.921043 14331 raft_consensus.cc:2468] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 8.
I20260709 12:10:53.919881 17314 consensus_queue.cc:1048] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 12:10:53.922067 17298 raft_consensus.cc:3060] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:53.923065 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:53.921957 14265 raft_consensus.cc:1275] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:10:53.924407 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:53.925031 14337 raft_consensus.cc:2468] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 6.
I20260709 12:10:53.919960 14155 leader_election.cc:304] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:53.925901 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:53.926447 14155 leader_election.cc:304] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:53.885872 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:53.927623 14335 raft_consensus.cc:2393] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 7: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:10:53.802886 17338 raft_consensus.cc:2804] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:53.929131 17338 raft_consensus.cc:697] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 7 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:53.929481 17299 raft_consensus.cc:2804] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:53.930007 17299 raft_consensus.cc:493] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:53.930506 17246 raft_consensus.cc:2804] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:53.930212 17338 consensus_queue.cc:237] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:53.930912 17246 raft_consensus.cc:493] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:53.931375 17246 raft_consensus.cc:3060] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:53.741354 17156 raft_consensus.cc:515] T f4739bc22bfe44fcba807da02d9351b6 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:53.932500 17318 raft_consensus.cc:2749] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:53.902274 17052 raft_consensus.cc:515] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:10:53.933562 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 87158us
I20260709 12:10:53.933866 14181 raft_consensus.cc:2468] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 5.
I20260709 12:10:53.872120 16750 raft_consensus.cc:515] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:53.889474 17344 leader_election.cc:290] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:53.797463 17010 raft_consensus.cc:2804] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:53.792333 17326 raft_consensus.cc:515] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:53.935269 17010 raft_consensus.cc:697] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 7 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:10:53.936730 14908 raft_consensus.cc:1240] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:10:53.936437 17010 consensus_queue.cc:237] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:53.937369 14333 raft_consensus.cc:2468] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 8.
I20260709 12:10:53.922026 14336 raft_consensus.cc:2468] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 9.
I20260709 12:10:53.887658 14184 raft_consensus.cc:1275] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:10:53.891700 17317 leader_election.cc:290] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:53.892625 17367 leader_election.cc:290] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:53.895669 17352 leader_election.cc:290] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:53.939893 17298 raft_consensus.cc:515] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:53.906361 14230 leader_election.cc:304] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:53.909662 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:53.936450 16750 leader_election.cc:290] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 9 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:53.935263 17299 raft_consensus.cc:3060] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:10:53.942538 14230 leader_election.cc:336] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957): Timed out: RequestConsensusVote RPC to 127.12.174.131:45957 timed out after 2.016s (SENT)
I20260709 12:10:53.916577 14258 raft_consensus.cc:1240] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 7 LEADER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:10:53.941629 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:53.855757 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:53.917488 14260 raft_consensus.cc:1275] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:53.941053 14261 raft_consensus.cc:2468] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 7.
I20260709 12:10:53.944937 17373 consensus_queue.cc:1048] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:10:53.946807 14337 raft_consensus.cc:3055] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:53.947235 14337 raft_consensus.cc:740] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:53.917455 14257 raft_consensus.cc:1240] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 8 LEADER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:10:53.948101 14337 consensus_queue.cc:260] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:53.936911 17326 leader_election.cc:290] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:53.951290 17326 raft_consensus.cc:2749] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:53.890362 17212 raft_consensus.cc:3060] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:53.897444 14185 raft_consensus.cc:1275] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:10:53.942381 14339 raft_consensus.cc:2468] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 6.
I20260709 12:10:53.931000 17239 consensus_queue.cc:1059] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 12:10:53.953646 14339 raft_consensus.cc:3055] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:53.954505 14339 raft_consensus.cc:740] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:53.955591 17318 consensus_queue.cc:1059] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:53.956529 17318 consensus_queue.cc:1243] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Peer 885067a0d31741bfb5c9935788e315bf log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:10:53.955690 14339 consensus_queue.cc:260] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:53.958719 14339 raft_consensus.cc:3060] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:53.957458 14303 leader_election.cc:304] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:53.890580 17278 raft_consensus.cc:493] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:53.897683 14187 pending_rounds.cc:85] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf: Aborting all ops after (but not including) 3
I20260709 12:10:53.960188 14876 leader_election.cc:304] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:53.961796 14187 pending_rounds.cc:107] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 12:10:53.950776 14331 raft_consensus.cc:3060] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:53.962016 14338 raft_consensus.cc:1275] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:53.962111 14187 raft_consensus.cc:2889] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:10:53.950784 14230 leader_election.cc:336] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957): Timed out: RequestConsensusVote RPC to 127.12.174.131:45957 timed out after 2.027s (SENT)
I20260709 12:10:53.960724 14332 raft_consensus.cc:2468] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 6.
I20260709 12:10:53.963737 14230 leader_election.cc:304] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:53.967036 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:53.967760 14335 raft_consensus.cc:2468] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 11.
I20260709 12:10:53.974915 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:53.976552 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:53.972113 16602 raft_consensus.cc:2804] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:53.972993 17335 raft_consensus.cc:697] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 4 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:10:53.954569 17239 raft_consensus.cc:3055] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:10:53.932119 17242 raft_consensus.cc:515] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:53.994199 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:10:53.994478 14302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:53.998205 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 47454.7us
I20260709 12:10:53.999939 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:53.978232 17337 raft_consensus.cc:2804] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:53.943560 17342 raft_consensus.cc:515] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:54.035923 14155 leader_election.cc:304] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:10:54.021077 14339 raft_consensus.cc:1275] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 12:10:53.953330 17315 raft_consensus.cc:515] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:53.996634 17344 raft_consensus.cc:2749] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:54.021631 14188 raft_consensus.cc:2468] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 9.
I20260709 12:10:54.024397 14230 leader_election.cc:304] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:54.033581 17337 raft_consensus.cc:493] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:53.996412 17239 raft_consensus.cc:740] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:10:54.043236 14876 leader_election.cc:304] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:53.972461 17278 raft_consensus.cc:515] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:54.036914 14339 pending_rounds.cc:85] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c: Aborting all ops after (but not including) 3
I20260709 12:10:54.051573 14339 pending_rounds.cc:107] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 12:10:54.051868 14339 raft_consensus.cc:2889] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:54.041749 17343 consensus_queue.cc:1048] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 12:10:54.053117 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:54.060220 17239 consensus_queue.cc:260] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:54.061340 17343 raft_consensus.cc:493] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.061952 17343 raft_consensus.cc:515] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:54.048051 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:54.068267 14335 raft_consensus.cc:1275] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:10:54.072543 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:54.075323 14155 leader_election.cc:304] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:54.082404 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:54.090313 14184 raft_consensus.cc:1275] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:10:54.091270 14230 leader_election.cc:304] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:54.084586 14183 raft_consensus.cc:1275] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:10:54.037781 17375 raft_consensus.cc:493] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.087103 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:54.051379 17337 raft_consensus.cc:3060] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:54.087343 14190 raft_consensus.cc:1240] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:54.037340 17352 consensus_queue.cc:1059] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.050s
I20260709 12:10:54.040221 17314 raft_consensus.cc:2804] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:54.092741 14230 leader_election.cc:304] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:54.041970 17295 consensus_queue.cc:1048] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 12:10:54.065770 17052 leader_election.cc:290] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:54.150309 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
W20260709 12:10:54.152455 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:54.095322 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:54.038255 17326 raft_consensus.cc:493] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.156912 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:54.153473 14187 raft_consensus.cc:2468] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 6.
I20260709 12:10:54.039351 17317 consensus_queue.cc:1048] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 12:10:54.087911 14188 raft_consensus.cc:2468] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 3.
W20260709 12:10:54.100370 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 57250.1us
I20260709 12:10:54.141573 17110 raft_consensus.cc:2804] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:54.105365 17314 raft_consensus.cc:493] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
W20260709 12:10:54.102381 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 48253.5us
I20260709 12:10:54.057309 17299 raft_consensus.cc:515] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:54.037628 17367 consensus_queue.cc:1048] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 12:10:54.048897 17328 raft_consensus.cc:2749] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:54.172264 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:54.173118 14261 raft_consensus.cc:2393] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 5: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:10:54.093817 17242 leader_election.cc:290] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 8 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:54.094534 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:54.184252 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:54.097769 17196 leader_election.cc:290] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 6 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:54.041092 17104 consensus_queue.cc:1048] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 12:10:54.143477 17325 raft_consensus.cc:2749] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:10:54.093091 17246 raft_consensus.cc:515] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:54.168718 17314 raft_consensus.cc:3060] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:54.159713 17319 raft_consensus.cc:493] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.143741 14230 leader_election.cc:400] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 pre-election: Vote denied by peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957) with higher term. Message: Invalid argument: T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 6. Current term is 7.
I20260709 12:10:54.170387 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
W20260709 12:10:54.201812 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 94922.2us
I20260709 12:10:54.201706 14184 raft_consensus.cc:3060] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:54.201936 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:54.203166 14256 raft_consensus.cc:3060] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:54.203291 14230 leader_election.cc:304] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:54.204211 17382 raft_consensus.cc:2749] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:10:54.090353 17342 leader_election.cc:290] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 4 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:54.103823 17344 raft_consensus.cc:2804] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:54.189757 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:10:54.189383 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 215507us
I20260709 12:10:54.161616 17326 raft_consensus.cc:515] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:54.191603 14877 leader_election.cc:304] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 65c9c1653b3346b39a0e118540e6080c
W20260709 12:10:54.169672 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 94448.7us
I20260709 12:10:54.195621 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:54.200543 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:54.087275 17313 consensus_queue.cc:1048] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.087s
I20260709 12:10:54.104148 17375 raft_consensus.cc:515] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:54.150523 17335 consensus_queue.cc:237] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:54.283141 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:54.170082 17052 raft_consensus.cc:2804] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:54.292146 14265 raft_consensus.cc:2468] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 7.
I20260709 12:10:54.292599 14260 raft_consensus.cc:2468] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 5.
W20260709 12:10:54.203882 14302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:54.267000 14337 raft_consensus.cc:3060] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:54.220605 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:54.273931 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:54.302330 14259 raft_consensus.cc:2468] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 7.
I20260709 12:10:54.227392 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:54.303622 14263 raft_consensus.cc:2468] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 7.
I20260709 12:10:54.308133 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:54.308488 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:54.309193 14335 raft_consensus.cc:2468] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 3.
W20260709 12:10:54.342108 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 150589us
I20260709 12:10:54.188865 17110 raft_consensus.cc:697] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 9 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:10:54.194028 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:10:54.317330 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:54.343822 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:54.346942 14261 raft_consensus.cc:2468] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 7.
I20260709 12:10:54.344632 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:54.351161 14908 raft_consensus.cc:1275] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:54.298615 17344 raft_consensus.cc:493] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:54.299078 17052 raft_consensus.cc:493] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:54.351255 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 59162.5us
I20260709 12:10:54.378022 14877 leader_election.cc:304] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:54.306943 17034 leader_election.cc:290] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:54.381374 14263 raft_consensus.cc:2468] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 7.
I20260709 12:10:54.247812 16602 raft_consensus.cc:697] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 5 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:54.387271 14877 leader_election.cc:304] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:54.378888 14335 raft_consensus.cc:1275] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:10:54.206298 17277 raft_consensus.cc:493] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.237165 17348 raft_consensus.cc:2749] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:54.220228 17298 leader_election.cc:290] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:54.387298 17344 raft_consensus.cc:3060] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:54.347882 16750 raft_consensus.cc:2804] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:54.394394 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
W20260709 12:10:54.486078 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 169936us
W20260709 12:10:54.528451 17386 log.cc:927] Time spent T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.219s	user 0.001s	sys 0.000s
I20260709 12:10:54.219823 17319 raft_consensus.cc:515] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:54.506110 17105 consensus_queue.cc:1048] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.008s
W20260709 12:10:54.502349 17387 log.cc:927] Time spent T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.266s	user 0.000s	sys 0.001s
I20260709 12:10:54.493427 17277 raft_consensus.cc:515] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:10:54.526724 17396 log.cc:927] Time spent T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
I20260709 12:10:54.518937 17326 leader_election.cc:290] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:10:54.514146 17388 log.cc:927] Time spent T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.137s	user 0.000s	sys 0.001s
W20260709 12:10:54.552883 14877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:54.309528 17367 consensus_queue.cc:1059] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.149s
I20260709 12:10:54.520267 17375 leader_election.cc:290] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:54.348361 17343 leader_election.cc:290] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:54.532661 17328 raft_consensus.cc:493] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
W20260709 12:10:54.527882 17397 log.cc:927] Time spent T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:10:54.383095 17010 consensus_queue.cc:1048] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.098s
I20260709 12:10:54.397055 17242 raft_consensus.cc:2749] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:54.479523 14256 raft_consensus.cc:2468] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 9.
I20260709 12:10:54.382860 17315 leader_election.cc:290] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 8 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:54.389604 17052 raft_consensus.cc:3060] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:54.205178 17382 consensus_queue.cc:1059] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.262s
I20260709 12:10:54.306622 17352 consensus_queue.cc:1048] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.121s
W20260709 12:10:54.477015 14331 consensus_meta.cc:287] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.511s	user 0.009s	sys 0.000s
I20260709 12:10:54.382357 17212 raft_consensus.cc:515] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:54.572464 14337 raft_consensus.cc:1275] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
W20260709 12:10:54.575773 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 282632us
I20260709 12:10:54.670149 14337 pending_rounds.cc:85] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c: Aborting all ops after (but not including) 4
I20260709 12:10:54.670423 14337 pending_rounds.cc:107] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 12:10:54.670673 14337 raft_consensus.cc:2889] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:10:54.654927 17153 consensus_meta.cc:287] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.752s	user 0.010s	sys 0.004s
I20260709 12:10:54.464620 17278 leader_election.cc:290] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:54.471093 17034 raft_consensus.cc:493] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.633965 16814 consensus_queue.cc:1048] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.060s
I20260709 12:10:54.695755 16814 raft_consensus.cc:493] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.696273 16814 raft_consensus.cc:515] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:54.632851 17408 raft_consensus.cc:493] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.394609 17110 consensus_queue.cc:237] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:54.703167 17212 leader_election.cc:290] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 7 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:54.703796 17153 raft_consensus.cc:515] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:54.602675 14257 raft_consensus.cc:1275] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:54.608057 14304 leader_election.cc:304] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:54.706121 17153 leader_election.cc:290] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 7 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:54.705947 17408 raft_consensus.cc:515] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:54.611223 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:54.633181 16602 consensus_queue.cc:237] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:54.707183 14338 raft_consensus.cc:3060] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:54.701383 14186 raft_consensus.cc:1275] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:10:54.595510 16750 raft_consensus.cc:493] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:54.625782 14877 leader_election.cc:304] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
W20260709 12:10:54.635128 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 248217us
I20260709 12:10:54.612174 17299 leader_election.cc:290] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 9 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:54.610662 17298 raft_consensus.cc:493] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:54.635473 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:54.734867 14260 raft_consensus.cc:1813] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Handling vote request from an unknown peer 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:54.656054 14229 leader_election.cc:304] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:54.656072 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:54.576534 14184 raft_consensus.cc:2468] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 4.
I20260709 12:10:54.626873 17385 raft_consensus.cc:2804] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:54.627727 17246 leader_election.cc:290] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 7 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:54.679701 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:54.678520 14331 raft_consensus.cc:1275] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:10:54.635599 17328 raft_consensus.cc:515] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:54.692821 17034 raft_consensus.cc:515] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:54.676442 17367 raft_consensus.cc:493] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:54.706508 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 98574.5us
W20260709 12:10:54.616671 14302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:54.745416 14338 raft_consensus.cc:2468] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 4.
I20260709 12:10:54.707403 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
W20260709 12:10:54.746623 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 90677.9us
I20260709 12:10:54.746898 17392 consensus_queue.cc:1048] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:10:54.714527 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 88859.1us
I20260709 12:10:54.718353 16750 raft_consensus.cc:3060] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:54.719144 17156 leader_election.cc:290] T f4739bc22bfe44fcba807da02d9351b6 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:54.722445 17338 consensus_queue.cc:1048] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:10:54.723807 17407 log.cc:927] Time spent T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:10:54.726541 17393 raft_consensus.cc:993] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c: : Instructing follower 885067a0d31741bfb5c9935788e315bf to start an election
I20260709 12:10:54.680418 17315 raft_consensus.cc:493] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:54.729998 17318 raft_consensus.cc:2749] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:54.736419 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:10:54.743798 14260 raft_consensus.cc:2368] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 7. Current term is 8.
I20260709 12:10:54.746546 14189 raft_consensus.cc:3060] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:54.669678 17403 consensus_queue.cc:1048] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.088s
I20260709 12:10:54.734899 17212 raft_consensus.cc:2749] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:10:54.736457 14265 raft_consensus.cc:2393] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 5: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:10:54.754877 14229 leader_election.cc:304] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:54.743865 17010 raft_consensus.cc:493] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.753194 17313 raft_consensus.cc:2804] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:54.754290 17246 raft_consensus.cc:493] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.779050 14189 raft_consensus.cc:2468] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 7.
I20260709 12:10:54.753135 17156 raft_consensus.cc:493] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:54.744192 17295 consensus_queue.cc:1048] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 12:10:54.764735 17315 raft_consensus.cc:515] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:54.812407 17315 leader_election.cc:290] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:54.813316 17319 leader_election.cc:290] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:10:54.802700 17406 log.cc:927] Time spent T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 12:10:54.802878 17395 consensus_queue.cc:1048] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.050s
I20260709 12:10:54.803565 17402 raft_consensus.cc:493] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.806186 17343 consensus_queue.cc:1048] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:54.750952 17373 consensus_queue.cc:1048] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.039s
W20260709 12:10:54.814222 17314 consensus_meta.cc:287] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.587s	user 0.007s	sys 0.003s
I20260709 12:10:54.782562 17278 raft_consensus.cc:2749] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:54.798533 17313 raft_consensus.cc:493] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:54.816684 14907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:54.809537 17328 leader_election.cc:290] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:54.818032 17409 consensus_queue.cc:1048] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:54.818663 14909 raft_consensus.cc:1240] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:54.757722 17299 raft_consensus.cc:493] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:10:54.801424 17348 consensus_queue.cc:1048] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:54.744529 17298 raft_consensus.cc:515] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:54.755623 17367 raft_consensus.cc:515] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:54.800604 17352 consensus_queue.cc:1048] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.103s
I20260709 12:10:54.817560 17344 raft_consensus.cc:515] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:54.797900 17010 raft_consensus.cc:515] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:54.800994 17246 raft_consensus.cc:515] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:54.802614 17404 consensus_queue.cc:1048] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.200s
I20260709 12:10:54.830648 17318 raft_consensus.cc:1081] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 5 LEADER]: Signalling peer 885067a0d31741bfb5c9935788e315bf to start an election
W20260709 12:10:54.867126 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 137608us
I20260709 12:10:54.821529 17326 raft_consensus.cc:3055] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:54.972400 14876 leader_election.cc:304] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
W20260709 12:10:54.946571 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 200560us
W20260709 12:10:54.966008 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 238096us
I20260709 12:10:54.974895 14911 raft_consensus.cc:3060] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:54.976852 14876 leader_election.cc:304] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
W20260709 12:10:54.967094 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 217480us
I20260709 12:10:54.978071 17104 raft_consensus.cc:2804] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:54.883852 17052 raft_consensus.cc:515] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:54.978994 17104 raft_consensus.cc:697] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [term 4 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:10:54.979875 17010 leader_election.cc:290] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:54.980458 17052 leader_election.cc:290] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 7 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:54.979986 17104 consensus_queue.cc:237] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:54.843768 17382 consensus_queue.cc:1048] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.128s
W20260709 12:10:54.981842 17401 log.cc:927] Time spent T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.246s	user 0.001s	sys 0.001s
I20260709 12:10:54.955978 16814 leader_election.cc:290] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:54.971553 17326 raft_consensus.cc:740] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:10:54.984714 17326 consensus_queue.cc:260] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:54.985862 17326 raft_consensus.cc:3060] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:54.957912 17348 consensus_queue.cc:1243] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer 885067a0d31741bfb5c9935788e315bf log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:10:54.851154 17277 leader_election.cc:290] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:54.830386 17156 raft_consensus.cc:515] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:54.992362 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:54.993363 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:55.002836 14189 raft_consensus.cc:2468] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 7.
W20260709 12:10:54.989774 17337 consensus_meta.cc:287] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db: Time spent flushing consensus metadata: real 0.838s	user 0.007s	sys 0.006s
I20260709 12:10:55.007738 14184 raft_consensus.cc:1275] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:10:55.008826 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:54.997921 14877 leader_election.cc:304] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:55.005563 14876 leader_election.cc:304] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:54.962984 17313 raft_consensus.cc:3060] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:54.994652 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:55.004038 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:55.015331 14189 raft_consensus.cc:2393] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 9: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:10:55.004213 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:54.995357 14304 leader_election.cc:304] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:54.850281 17402 raft_consensus.cc:515] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:55.019549 14304 leader_election.cc:304] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:55.017145 14187 raft_consensus.cc:1240] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:10:55.013480 14911 raft_consensus.cc:2468] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 8.
I20260709 12:10:55.033897 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:55.034703 14265 raft_consensus.cc:3060] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:54.992307 17052 raft_consensus.cc:493] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:10:54.964784 17299 raft_consensus.cc:515] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:54.903733 17314 raft_consensus.cc:515] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:54.982595 17242 consensus_queue.cc:1048] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 12:10:55.002715 16814 raft_consensus.cc:2804] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:55.050832 14187 raft_consensus.cc:1240] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:55.052155 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:55.057468 14189 raft_consensus.cc:1275] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 12:10:55.059298 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 235069us
I20260709 12:10:55.018643 17010 raft_consensus.cc:2804] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:55.026588 17342 raft_consensus.cc:2804] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:55.059510 14184 raft_consensus.cc:1275] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:55.040441 17395 raft_consensus.cc:2804] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:55.063740 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:55.067370 14229 leader_election.cc:304] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:55.038709 17412 raft_consensus.cc:493] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:55.005793 16750 raft_consensus.cc:515] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:55.088102 14338 raft_consensus.cc:1275] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 12:10:55.084431 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 64997.6us
I20260709 12:10:55.079345 14229 leader_election.cc:304] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:55.101577 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:55.102340 14189 raft_consensus.cc:2468] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 7.
I20260709 12:10:55.102427 14155 leader_election.cc:304] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:55.105129 14155 leader_election.cc:304] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:55.107514 14155 leader_election.cc:304] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:55.111702 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:55.112617 14189 raft_consensus.cc:2468] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 7.
I20260709 12:10:55.112097 14304 leader_election.cc:304] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:55.115880 14155 leader_election.cc:304] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:55.116884 14265 raft_consensus.cc:2468] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 7.
I20260709 12:10:55.116432 17317 raft_consensus.cc:2804] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:55.126187 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:55.065141 17010 raft_consensus.cc:493] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:55.128913 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:55.129586 14187 raft_consensus.cc:2468] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 5.
I20260709 12:10:55.131868 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
W20260709 12:10:55.133548 14303 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:55.134253 14303 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:55.065034 17319 raft_consensus.cc:493] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:55.135458 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:55.135793 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:55.136585 14260 raft_consensus.cc:3060] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:55.137317 14912 raft_consensus.cc:1240] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 7. Current term is 9. Ops: []
I20260709 12:10:55.018836 17337 raft_consensus.cc:515] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:55.138902 14265 raft_consensus.cc:3060] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:55.051354 17052 raft_consensus.cc:515] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:55.137441 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:55.110473 17318 raft_consensus.cc:493] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:55.117812 17352 raft_consensus.cc:2804] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:55.115957 17393 raft_consensus.cc:2804] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:55.147509 17410 raft_consensus.cc:2804] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:55.116103 17404 raft_consensus.cc:493] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:55.114771 17278 raft_consensus.cc:2804] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:55.110812 16814 raft_consensus.cc:697] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [term 7 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:10:55.121276 17317 raft_consensus.cc:493] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:55.068907 17277 consensus_queue.cc:1048] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.071s
I20260709 12:10:55.125294 17315 raft_consensus.cc:2804] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:55.133450 17413 raft_consensus.cc:493] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:55.150296 14229 leader_election.cc:304] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
W20260709 12:10:55.247316 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 100361us
I20260709 12:10:55.137725 17010 raft_consensus.cc:3060] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:55.085485 17343 consensus_queue.cc:1048] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.059s
I20260709 12:10:55.210300 17410 raft_consensus.cc:493] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:55.137805 17395 raft_consensus.cc:697] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 7 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
W20260709 12:10:55.222693 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 106921us
I20260709 12:10:55.224568 17153 raft_consensus.cc:2804] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:55.227267 17104 raft_consensus.cc:493] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:10:55.220669 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
W20260709 12:10:55.244415 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 105795us
I20260709 12:10:55.229233 14183 raft_consensus.cc:3060] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:55.247630 14188 pending_rounds.cc:85] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf: Aborting all ops after (but not including) 2
I20260709 12:10:55.273878 14188 pending_rounds.cc:107] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:10:55.274184 14188 raft_consensus.cc:2889] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:55.152791 17352 raft_consensus.cc:493] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:55.249477 14229 leader_election.cc:304] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:55.277297 14229 leader_election.cc:304] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:55.238157 17246 leader_election.cc:290] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:55.279320 14304 leader_election.cc:304] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:55.203184 14265 raft_consensus.cc:2468] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 10.
I20260709 12:10:55.143329 17319 raft_consensus.cc:515] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:55.211234 17278 raft_consensus.cc:493] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:55.219599 17317 raft_consensus.cc:3060] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:55.114636 17412 raft_consensus.cc:515] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:55.271052 14155 leader_election.cc:400] T f4739bc22bfe44fcba807da02d9351b6 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 7 pre-election: Vote denied by peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673) with higher term. Message: Invalid argument: T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 7. Current term is 8.
W20260709 12:10:55.225988 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 76460.2us
I20260709 12:10:55.240418 17315 raft_consensus.cc:493] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:55.269646 14904 raft_consensus.cc:2368] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 5. Current term is 6.
I20260709 12:10:55.275621 17421 raft_consensus.cc:2804] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:55.165946 17318 raft_consensus.cc:515] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:55.264065 17410 raft_consensus.cc:3060] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:55.257287 17325 raft_consensus.cc:2804] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:55.307523 14155 leader_election.cc:403] T f4739bc22bfe44fcba807da02d9351b6 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:55.250097 17393 raft_consensus.cc:697] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 7 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:55.273250 17153 raft_consensus.cc:493] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:55.308480 17278 raft_consensus.cc:3060] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:55.303246 17298 leader_election.cc:290] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:55.311528 17315 raft_consensus.cc:3060] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:55.304540 17348 raft_consensus.cc:2804] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:10:55.356456 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 76932.9us
I20260709 12:10:55.328685 17325 raft_consensus.cc:493] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:55.310268 17342 raft_consensus.cc:697] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 9 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:10:55.266472 17367 leader_election.cc:290] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:55.306432 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:55.253340 17338 consensus_queue.cc:1059] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 12:10:55.284475 17352 raft_consensus.cc:3060] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:55.342363 17421 raft_consensus.cc:697] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 8 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:55.238386 17404 raft_consensus.cc:515] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:55.311997 17156 leader_election.cc:290] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:55.315910 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:10:55.313016 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 177899us
I20260709 12:10:55.379225 14304 leader_election.cc:304] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:10:55.337798 17110 raft_consensus.cc:493] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:55.379967 16750 leader_election.cc:290] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 9 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:55.386663 17299 leader_election.cc:290] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:55.383277 17325 raft_consensus.cc:3060] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:55.384500 14265 raft_consensus.cc:2468] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 9.
I20260709 12:10:55.283252 17104 raft_consensus.cc:515] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:55.256572 17413 raft_consensus.cc:515] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:55.343801 17153 raft_consensus.cc:3060] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:55.353107 17314 leader_election.cc:290] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 6 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:55.353986 17348 raft_consensus.cc:493] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:55.357873 17416 consensus_queue.cc:1048] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.299s
I20260709 12:10:55.352892 16814 consensus_queue.cc:237] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:55.415397 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:55.380937 17052 leader_election.cc:290] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:55.386509 17298 raft_consensus.cc:493] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:55.422144 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 151235us
I20260709 12:10:55.478586 14155 leader_election.cc:304] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
W20260709 12:10:55.424301 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 67019.1us
I20260709 12:10:55.427459 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:55.479787 14265 raft_consensus.cc:2468] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 8.
I20260709 12:10:55.480849 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:55.481467 14265 raft_consensus.cc:3060] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:55.411059 17343 raft_consensus.cc:493] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
W20260709 12:10:55.610690 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 132181us
W20260709 12:10:55.447614 17424 log.cc:927] Time spent T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.190s	user 0.001s	sys 0.000s
I20260709 12:10:55.447971 17428 raft_consensus.cc:2804] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:55.423641 17110 raft_consensus.cc:515] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:55.382078 17402 leader_election.cc:290] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:10:55.447727 17414 log.cc:927] Time spent T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.320s	user 0.001s	sys 0.000s
I20260709 12:10:55.462538 17445 raft_consensus.cc:493] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:55.439474 17295 consensus_queue.cc:1059] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.178s
W20260709 12:10:55.609103 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 277144us
I20260709 12:10:55.694618 14877 leader_election.cc:304] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:55.443100 17373 raft_consensus.cc:2804] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:55.439244 17246 raft_consensus.cc:493] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:55.446225 17417 raft_consensus.cc:2804] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:55.621483 14155 leader_election.cc:304] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:55.463071 17348 raft_consensus.cc:3060] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:55.467062 17337 leader_election.cc:290] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 6 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:55.476193 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:10:55.644321 14182 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.019s	sys 0.026s
I20260709 12:10:55.620942 17367 raft_consensus.cc:493] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:55.655680 17110 leader_election.cc:290] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:55.656549 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:55.478305 17338 consensus_queue.cc:1059] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.179s
W20260709 12:10:55.652814 14154 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.174.132:37341 timed out after 1.598s (SENT) [suppressed 21 similar messages]
I20260709 12:10:55.411798 17395 consensus_queue.cc:237] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:55.657634 17385 raft_consensus.cc:493] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
W20260709 12:10:55.751217 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 129835us
I20260709 12:10:55.616231 17298 raft_consensus.cc:515] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:55.621598 17428 raft_consensus.cc:493] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:55.661369 17435 raft_consensus.cc:3060] T f4739bc22bfe44fcba807da02d9351b6 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:10:55.663223 17104 leader_election.cc:290] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:55.666656 17412 leader_election.cc:290] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:55.667498 17449 consensus_queue.cc:1059] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.190s
I20260709 12:10:55.669781 17382 raft_consensus.cc:493] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:55.671736 17344 leader_election.cc:290] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 9 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:55.672622 17368 leader_election.cc:290] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:55.672885 14265 raft_consensus.cc:2468] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 7.
I20260709 12:10:55.837121 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:55.673801 17439 raft_consensus.cc:493] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
W20260709 12:10:55.837837 17426 log.cc:927] Time spent T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.284s	user 0.001s	sys 0.002s
I20260709 12:10:55.675200 17442 consensus_queue.cc:1048] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:55.836853 17382 raft_consensus.cc:515] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:55.838150 17439 raft_consensus.cc:515] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:55.435936 17393 consensus_queue.cc:237] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } }
W20260709 12:10:55.840750 17326 consensus_meta.cc:287] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.854s	user 0.005s	sys 0.007s
I20260709 12:10:55.842607 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:55.683871 17409 consensus_queue.cc:1059] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:55.843344 14906 raft_consensus.cc:2468] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 7.
I20260709 12:10:55.843730 17409 raft_consensus.cc:3055] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:55.685185 17404 leader_election.cc:290] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:55.686280 17318 leader_election.cc:290] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:55.620393 17052 raft_consensus.cc:2804] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:10:55.702075 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 222203us
I20260709 12:10:55.844769 17052 raft_consensus.cc:493] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:55.845228 17052 raft_consensus.cc:3060] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:55.845873 14304 leader_election.cc:304] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
W20260709 12:10:55.591369 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:55.710319 14230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:55.680976 17034 leader_election.cc:290] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:10:55.712204 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 242361us
I20260709 12:10:55.850124 17034 consensus_queue.cc:1048] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:55.850929 17382 leader_election.cc:290] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:55.851608 17034 raft_consensus.cc:2804] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:55.852039 17034 raft_consensus.cc:493] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:10:55.852399 17034 raft_consensus.cc:3060] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:55.716073 14257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41768 (request call id 1564) took 1524 ms. Trace:
I20260709 12:10:55.852487 17368 raft_consensus.cc:493] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:55.852681 14303 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:55.853132 17368 raft_consensus.cc:515] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:55.853901 14257 rpcz_store.cc:276] 0709 12:10:54.171570 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:54.171712 (+   142us) service_pool.cc:224] Handling call
0709 12:10:54.175991 (+  4279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:54.705813 (+529822us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:55.679272 (+973459us) spinlock_profiling.cc:243] Waited 426 ms on lock 0x7b54002c0e54. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:10:55.695769 (+ 16497us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":980325248}
I20260709 12:10:55.723738 14261 raft_consensus.cc:2468] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 6.
I20260709 12:10:55.621057 17343 raft_consensus.cc:515] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:55.855428 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:55.449100 17342 consensus_queue.cc:237] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:55.856073 14257 raft_consensus.cc:3060] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:55.857197 17343 leader_election.cc:290] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:55.657768 17239 raft_consensus.cc:3060] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:55.703591 17373 raft_consensus.cc:493] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:55.720249 17421 consensus_queue.cc:237] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:55.858563 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:55.752379 14155 leader_election.cc:304] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:55.858851 17373 raft_consensus.cc:3060] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:55.657725 17445 raft_consensus.cc:515] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:10:55.859387 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 107076us
I20260709 12:10:55.686300 16602 consensus_queue.cc:1048] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.068s
I20260709 12:10:55.756758 17385 raft_consensus.cc:3060] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:55.765594 17428 raft_consensus.cc:3060] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:55.792724 14190 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56046 (request call id 2026) took 2081 ms. Trace:
I20260709 12:10:55.739924 17367 raft_consensus.cc:515] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:55.724749 17246 raft_consensus.cc:515] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:55.744722 17242 raft_consensus.cc:2749] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:55.760905 17295 raft_consensus.cc:3055] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:55.766950 17156 raft_consensus.cc:2804] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:10:55.782076 17319 leader_election.cc:290] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:55.821033 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
W20260709 12:10:55.829474 17317 consensus_meta.cc:287] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.518s	user 0.007s	sys 0.003s
W20260709 12:10:55.829916 17429 log.cc:927] Time spent T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.384s	user 0.001s	sys 0.001s
I20260709 12:10:55.830457 17452 consensus_queue.cc:1048] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.098s
I20260709 12:10:55.842841 17298 leader_election.cc:290] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:55.844151 17409 raft_consensus.cc:740] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:55.962556 17409 consensus_queue.cc:260] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:55.963827 17338 raft_consensus.cc:3055] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:55.963989 17409 raft_consensus.cc:3060] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:55.840806 17439 leader_election.cc:290] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:55.964854 14333 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50858 (request call id 1564) took 2035 ms. Trace:
W20260709 12:10:55.849478 14230 leader_election.cc:336] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957): Timed out: RequestConsensusVote RPC to 127.12.174.131:45957 timed out after 1.500s (SENT)
W20260709 12:10:55.711162 14260 consensus_meta.cc:287] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.574s	user 0.005s	sys 0.007s
W20260709 12:10:55.723785 14182 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.589s	user 0.019s	sys 0.026s
I20260709 12:10:55.965993 14230 leader_election.cc:304] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:55.853451 14229 leader_election.cc:304] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:10:55.854002 14336 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755"
dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
mode: GRACEFUL
new_leader_uuid: "885067a0d31741bfb5c9935788e315bf"
 from {username='slave'} at 127.0.0.1:50896
I20260709 12:10:55.712134 17417 raft_consensus.cc:493] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
W20260709 12:10:55.860492 14303 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:55.881122 14257 raft_consensus.cc:2468] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 7.
W20260709 12:10:55.872041 14183 consensus_meta.cc:287] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.590s	user 0.008s	sys 0.002s
I20260709 12:10:55.970459 14183 raft_consensus.cc:2410] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:10:55.855722 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:55.860364 14155 leader_election.cc:304] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:55.971719 14181 raft_consensus.cc:2468] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 9.
W20260709 12:10:55.972826 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 112526us
I20260709 12:10:55.927636 17295 raft_consensus.cc:740] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
W20260709 12:10:55.953497 17427 log.cc:927] Time spent T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.303s	user 0.000s	sys 0.002s
W20260709 12:10:55.928025 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 43546.4us
I20260709 12:10:55.928449 14261 raft_consensus.cc:3060] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:55.919137 14190 rpcz_store.cc:276] 0709 12:10:53.699374 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:53.807056 (+107682us) service_pool.cc:224] Handling call
0709 12:10:53.824484 (+ 17428us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:54.098812 (+274328us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:55.781010 (+1682198us) spinlock_profiling.cc:243] Waited 263 ms on lock 0x7b54003a34d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:10:55.781238 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":604043648}
I20260709 12:10:55.951407 14184 raft_consensus.cc:3060] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:55.921013 17430 log.cc:927] Time spent T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.106s	user 0.000s	sys 0.002s
W20260709 12:10:55.886060 17313 consensus_meta.cc:287] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.847s	user 0.003s	sys 0.009s
I20260709 12:10:55.907114 17316 raft_consensus.cc:3055] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:55.973799 14155 leader_election.cc:304] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
W20260709 12:10:55.959941 14904 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59144 (request call id 305) took 1800 ms (client timeout 1598 ms). Trace:
I20260709 12:10:55.967130 14336 raft_consensus.cc:606] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 8 LEADER]: Received request to transfer leadership to TS 885067a0d31741bfb5c9935788e315bf
W20260709 12:10:55.967058 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 113702us
W20260709 12:10:55.967067 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 117626us
I20260709 12:10:55.966077 14260 raft_consensus.cc:2468] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 9.
I20260709 12:10:55.855420 17368 leader_election.cc:290] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:55.965303 14333 rpcz_store.cc:276] 0709 12:10:53.929198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:53.957686 (+ 28488us) service_pool.cc:224] Handling call
0709 12:10:53.958018 (+   332us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:53.958402 (+   384us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:53.958430 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:53.958981 (+   551us) log.cc:844] Serialized 26 byte log entry
0709 12:10:54.251836 (+292855us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:54.251880 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:54.251963 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:55.961869 (+1709906us) spinlock_profiling.cc:243] Waited 9.27 ms on lock 0x7b24001f7288. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2123ed49c4 00007f2123ed2acb 00007f212408ddc9 00007f212408da55 00007f212408cfb0 00007f2126d03488 00007f2126d03be8 00007f2126cdb398 00007f2126cd676a 00007f2126cd5bb6
0709 12:10:55.964523 (+  2654us) raft_consensus.cc:1685] finished
0709 12:10:55.964546 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:55.964780 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4567,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":6770,"spinlock_wait_cycles":21313280,"thread_start_us":292414,"threads_started":1,"wal-append.queue_time_us":385251}
W20260709 12:10:55.952443 17394 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.539s	user 0.023s	sys 0.052s
W20260709 12:10:55.920847 17436 log.cc:927] Time spent T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.059s	user 0.002s	sys 0.000s
W20260709 12:10:55.979329 14230 leader_election.cc:336] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957): Timed out: RequestConsensusVote RPC to 127.12.174.131:45957 timed out after 1.566s (SENT)
I20260709 12:10:55.979600 14181 raft_consensus.cc:1275] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:55.928596 17438 raft_consensus.cc:493] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:55.964318 17338 raft_consensus.cc:740] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:55.976260 17447 raft_consensus.cc:2804] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:55.969559 17326 raft_consensus.cc:2749] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:10:55.972811 17382 raft_consensus.cc:2804] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:55.982399 17319 raft_consensus.cc:2804] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:55.985579 14230 leader_election.cc:304] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:55.994139 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:56.003172 14184 raft_consensus.cc:2468] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 6.
I20260709 12:10:55.976626 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:56.015372 14257 raft_consensus.cc:2468] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 7.
I20260709 12:10:55.958381 17156 raft_consensus.cc:697] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 10 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:10:55.886183 17343 raft_consensus.cc:493] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:56.010006 14261 raft_consensus.cc:2468] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 7.
I20260709 12:10:56.011183 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:55.973021 17417 raft_consensus.cc:3060] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:55.999398 14333 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c"
dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
mode: GRACEFUL
new_leader_uuid: "17aab1bbf5014936aa18cc21818b26ec"
 from {username='slave'} at 127.0.0.1:50896
I20260709 12:10:55.957381 17317 raft_consensus.cc:515] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:10:55.984747 17394 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.590s	user 0.023s	sys 0.052s
I20260709 12:10:55.980377 17344 raft_consensus.cc:493] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:55.980468 17316 raft_consensus.cc:740] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:10:55.986100 17313 raft_consensus.cc:515] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:10:55.996595 17451 log.cc:927] Time spent T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.203s	user 0.000s	sys 0.000s
W20260709 12:10:55.996014 17461 log.cc:927] Time spent T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 12:10:56.016424 17382 raft_consensus.cc:493] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:56.014994 17438 raft_consensus.cc:515] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:56.065790 17382 raft_consensus.cc:3060] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:56.017239 17319 raft_consensus.cc:493] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:56.066718 17319 raft_consensus.cc:3060] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:10:56.052850 17389 log.cc:927] Time spent T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 1.667s	user 0.010s	sys 0.000s
I20260709 12:10:56.060968 14905 raft_consensus.cc:2410] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
W20260709 12:10:56.054039 17410 consensus_meta.cc:287] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.707s	user 0.009s	sys 0.003s
I20260709 12:10:56.068913 17337 raft_consensus.cc:493] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:56.031692 17153 consensus_meta.cc:287] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.583s	user 0.005s	sys 0.006s
I20260709 12:10:56.045488 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:56.043699 17295 consensus_queue.cc:260] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:56.070111 17337 raft_consensus.cc:515] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:56.036041 17196 raft_consensus.cc:3055] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:56.072567 17196 raft_consensus.cc:740] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:56.069538 17410 raft_consensus.cc:515] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:10:55.980335 14904 rpcz_store.cc:269] 0709 12:10:54.159693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:54.161194 (+  1501us) service_pool.cc:224] Handling call
0709 12:10:55.959670 (+1798476us) spinlock_profiling.cc:243] Waited 831 ms on lock 0x7b540020b7d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:10:55.959832 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1911031040}
I20260709 12:10:56.075326 14265 raft_consensus.cc:2393] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 7: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
W20260709 12:10:56.006665 17010 consensus_meta.cc:287] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db: Time spent flushing consensus metadata: real 0.738s	user 0.012s	sys 0.000s
I20260709 12:10:56.076108 17435 raft_consensus.cc:2749] T f4739bc22bfe44fcba807da02d9351b6 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673) with higher term. Message: Invalid argument: T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 7. Current term is 8.
W20260709 12:10:56.020030 17352 consensus_meta.cc:287] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.607s	user 0.007s	sys 0.003s
I20260709 12:10:56.032114 17467 raft_consensus.cc:493] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:56.077301 17352 raft_consensus.cc:515] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:56.068382 17344 raft_consensus.cc:515] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:56.078182 17467 raft_consensus.cc:515] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:56.033456 17448 raft_consensus.cc:493] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:56.063990 17460 log.cc:927] Time spent T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
I20260709 12:10:56.081372 17448 raft_consensus.cc:515] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:56.085891 17153 raft_consensus.cc:515] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:56.077666 17348 raft_consensus.cc:515] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:56.088773 14258 raft_consensus.cc:2393] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db in current term 6: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:10:56.042901 17454 raft_consensus.cc:2804] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:56.076620 17010 raft_consensus.cc:515] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:56.071451 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:56.098397 17454 raft_consensus.cc:697] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 7 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:10:56.098886 14257 raft_consensus.cc:2468] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 6.
I20260709 12:10:56.099947 17348 leader_election.cc:290] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:56.100349 14257 raft_consensus.cc:1240] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 12:10:56.024271 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
W20260709 12:10:55.979872 14154 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 327106us
I20260709 12:10:56.102216 14261 raft_consensus.cc:3060] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:10:56.072095 17295 raft_consensus.cc:3060] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:10:56.048871 17325 consensus_meta.cc:287] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.584s	user 0.009s	sys 0.002s
I20260709 12:10:56.117304 14257 raft_consensus.cc:1240] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:10:56.029803 17277 raft_consensus.cc:2749] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:10:56.109951 17315 consensus_meta.cc:287] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.714s	user 0.005s	sys 0.007s
I20260709 12:10:56.124174 14907 raft_consensus.cc:1240] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:10:56.052639 17052 raft_consensus.cc:515] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:56.130277 17156 consensus_queue.cc:237] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:56.130880 14264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41764 (request call id 2346) took 2227 ms. Trace:
I20260709 12:10:56.134140 14264 rpcz_store.cc:276] 0709 12:10:53.903689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:53.922739 (+ 19050us) service_pool.cc:224] Handling call
0709 12:10:53.923088 (+   349us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:53.934013 (+ 10925us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:53.934048 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:53.934599 (+   551us) log.cc:844] Serialized 26 byte log entry
0709 12:10:54.100437 (+165838us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:54.155890 (+ 55453us) log.cc:844] Serialized 14 byte log entry
0709 12:10:54.156128 (+   238us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:54.156210 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:56.052074 (+1895864us) spinlock_profiling.cc:243] Waited 3.06 ms on lock 0x7b4400022b4c. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2123f74c85 00007f2123f756a2 00007f2126ce71db 00007f2126ce2aaf 00007f2126cd686e 00007f2126cd5bb6 00007f2126cd57d8 00007f2126cdf221 00007f2126cdf1d9 00007f2126cdf169
0709 12:10:56.130515 (+ 78441us) raft_consensus.cc:1685] finished
0709 12:10:56.130628 (+   113us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:56.130787 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10438,"prepare.queue_time_us":58144,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"raft.queue_time_us":10827,"raft.run_cpu_time_us":235,"raft.run_wall_time_us":4337,"spinlock_wait_cycles":7032576,"thread_start_us":165400,"threads_started":1,"wal-append.queue_time_us":315682}
I20260709 12:10:56.030330 17439 consensus_queue.cc:1048] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.093s
I20260709 12:10:56.147900 14155 leader_election.cc:304] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:56.159735 14330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 527) took 1074 ms. Trace:
I20260709 12:10:56.152951 14261 raft_consensus.cc:2468] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 9.
I20260709 12:10:56.032090 17343 raft_consensus.cc:515] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:56.158514 17373 raft_consensus.cc:515] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:56.160130 14330 rpcz_store.cc:276] 0709 12:10:55.085621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:55.086064 (+   443us) service_pool.cc:224] Handling call
0709 12:10:55.125092 (+ 39028us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:55.137825 (+ 12733us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:55.137857 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:55.191495 (+ 53638us) log.cc:844] Serialized 26 byte log entry
0709 12:10:55.378657 (+187162us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:55.378709 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:55.378796 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:55.995824 (+617028us) spinlock_profiling.cc:243] Waited 6.9 ms on lock 0x7b4400022b4c. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2123f74c85 00007f2123f756a2 00007f2126ce71db 00007f2126ce2aaf 00007f2126cd686e 00007f2126cd5bb6 00007f2126cd57d8 00007f2126cdf221 00007f2126cdf1d9 00007f2126cdf169
0709 12:10:56.127300 (+131476us) raft_consensus.cc:1685] finished
0709 12:10:56.127326 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:56.159649 (+ 32323us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14004,"raft.queue_time_us":27326,"raft.run_cpu_time_us":212,"raft.run_wall_time_us":46113,"spinlock_wait_cycles":15878016,"thread_start_us":98678,"threads_started":1,"wal-append.queue_time_us":481423}
I20260709 12:10:56.163805 14155 leader_election.cc:304] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:56.162684 14188 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56046 (request call id 2045) took 1016 ms. Trace:
I20260709 12:10:56.167562 14155 leader_election.cc:304] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:56.164628 14188 rpcz_store.cc:276] 0709 12:10:55.146334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:55.228283 (+ 81949us) service_pool.cc:224] Handling call
0709 12:10:55.247342 (+ 19059us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:10:55.308866 (+ 61524us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:55.308898 (+    32us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:10:55.309640 (+   742us) log.cc:844] Serialized 78 byte log entry
0709 12:10:55.690236 (+380596us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:55.690283 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:55.690368 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:56.162442 (+472074us) raft_consensus.cc:1685] finished
0709 12:10:56.162461 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:56.162617 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":109287,"raft.run_cpu_time_us":239,"raft.run_wall_time_us":21203,"thread_start_us":339287,"threads_started":1,"wal-append.queue_time_us":470077}
I20260709 12:10:56.158054 17413 leader_election.cc:290] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:56.171866 14181 raft_consensus.cc:1240] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 12:10:56.173158 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:56.175318 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:10:56.182139 14264 raft_consensus.cc:1275] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:10:56.181917 14906 raft_consensus.cc:2393] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 6: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
I20260709 12:10:56.180457 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:56.184450 14257 raft_consensus.cc:2468] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 8.
I20260709 12:10:56.186528 14188 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c"
dest_uuid: "885067a0d31741bfb5c9935788e315bf"
 from {username='slave'} at 127.0.0.1:56044
I20260709 12:10:56.123060 17325 raft_consensus.cc:515] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:56.187314 14188 raft_consensus.cc:493] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:56.191119 14188 raft_consensus.cc:3060] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:56.169896 17314 raft_consensus.cc:2804] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:56.171904 17412 raft_consensus.cc:2804] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:56.208300 14181 raft_consensus.cc:1240] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 12:10:56.142697 17315 raft_consensus.cc:515] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:56.162645 17326 consensus_queue.cc:1059] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 12:10:56.182147 17435 raft_consensus.cc:2804] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:56.175647 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:56.238226 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:56.219636 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:56.220340 14337 raft_consensus.cc:1240] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:10:56.225113 14333 raft_consensus.cc:606] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 9 LEADER]: Received request to transfer leadership to TS 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:10:56.230195 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:56.218837 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:56.296078 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:56.298794 14334 raft_consensus.cc:2410] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:10:56.226473 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:56.302662 14184 raft_consensus.cc:1240] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 12:10:56.243976 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:56.209420 17314 raft_consensus.cc:493] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:56.176764 17438 leader_election.cc:290] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:56.166766 17385 raft_consensus.cc:515] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:56.115142 17454 consensus_queue.cc:237] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:56.224872 17368 raft_consensus.cc:493] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:56.336814 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:56.313203 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:10:56.353165 14304 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:56.356141 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:10:56.249209 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:56.361244 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:56.224572 17412 raft_consensus.cc:697] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 7 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:10:56.304193 14181 raft_consensus.cc:1240] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 12:10:56.304193 14257 raft_consensus.cc:2393] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 6: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
W20260709 12:10:56.307963 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 140480us
I20260709 12:10:56.177637 17316 consensus_queue.cc:260] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } }
I20260709 12:10:56.227072 17373 leader_election.cc:290] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 9 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:56.225054 17392 raft_consensus.cc:493] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:56.369192 14336 raft_consensus.cc:2393] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 9: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:10:56.372249 14155 leader_election.cc:304] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:56.229588 17246 leader_election.cc:290] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:56.355068 14188 raft_consensus.cc:515] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:56.376730 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:56.377343 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:56.214983 17393 raft_consensus.cc:493] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:56.334801 17010 leader_election.cc:290] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 8 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:56.347223 17421 raft_consensus.cc:493] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:56.383214 17392 raft_consensus.cc:515] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:56.306191 17435 raft_consensus.cc:697] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 9 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:10:56.360265 17314 raft_consensus.cc:3060] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:56.391572 14331 raft_consensus.cc:2376] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 6. Re-sending same reply.
I20260709 12:10:56.393545 17325 leader_election.cc:290] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 8 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:10:56.387133 17278 consensus_meta.cc:287] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 1.032s	user 0.014s	sys 0.000s
I20260709 12:10:56.380620 14155 leader_election.cc:304] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:56.401459 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:56.368861 17343 leader_election.cc:290] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:56.421428 17278 raft_consensus.cc:515] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:56.424705 17315 leader_election.cc:290] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 8 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:56.425074 17278 leader_election.cc:290] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 4 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:56.396739 17316 raft_consensus.cc:3060] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:56.426903 17435 consensus_queue.cc:237] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.3, Last appended by leader: 3, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:56.407316 14181 raft_consensus.cc:1240] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:56.426394 14155 leader_election.cc:304] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:56.390447 17438 raft_consensus.cc:2804] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:56.435387 14188 leader_election.cc:290] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 6 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:56.395779 17448 leader_election.cc:290] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:56.233155 17338 consensus_queue.cc:260] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:56.450690 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:56.367550 17368 raft_consensus.cc:515] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:56.451587 14257 raft_consensus.cc:2468] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 7.
I20260709 12:10:56.234524 17196 consensus_queue.cc:260] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:56.446982 17315 raft_consensus.cc:2804] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:56.467856 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:56.470831 14257 raft_consensus.cc:3060] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:56.477965 17338 raft_consensus.cc:3060] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:56.478802 17368 leader_election.cc:290] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:56.442180 17478 raft_consensus.cc:2804] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:56.479806 17478 raft_consensus.cc:493] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:56.480489 17478 raft_consensus.cc:3060] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:56.482475 17385 leader_election.cc:290] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 4 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:56.485004 17392 leader_election.cc:290] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:56.399792 17393 raft_consensus.cc:515] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:56.488499 17393 leader_election.cc:290] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:10:56.490247 17475 log.cc:927] Time spent T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 12:10:56.452808 17438 raft_consensus.cc:697] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 7 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:10:56.492151 17438 consensus_queue.cc:237] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:56.409340 17319 raft_consensus.cc:515] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:56.446720 17246 consensus_queue.cc:1059] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.052s
I20260709 12:10:56.407814 17421 raft_consensus.cc:515] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:56.503552 14908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59144 (request call id 301) took 2349 ms. Trace:
I20260709 12:10:56.509397 14908 rpcz_store.cc:276] 0709 12:10:54.149011 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:54.149897 (+   886us) service_pool.cc:224] Handling call
0709 12:10:54.159015 (+  9118us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:54.380188 (+221173us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:56.495224 (+2115036us) spinlock_profiling.cc:243] Waited 190 ms on lock 0x7b54005e0e54. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:10:56.495444 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":437717376}
I20260709 12:10:56.494953 17315 raft_consensus.cc:493] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:56.507795 17196 raft_consensus.cc:3060] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:56.515241 14182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56652 (request call id 730) took 1206 ms. Trace:
I20260709 12:10:56.515769 14182 rpcz_store.cc:276] 0709 12:10:55.309302 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:55.977184 (+667882us) service_pool.cc:224] Handling call
0709 12:10:56.010445 (+ 33261us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:56.022407 (+ 11962us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:56.022443 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:56.032390 (+  9947us) log.cc:844] Serialized 26 byte log entry
0709 12:10:56.182369 (+149979us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:56.182414 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:56.182486 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:56.514944 (+332458us) raft_consensus.cc:1685] finished
0709 12:10:56.514972 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:56.515160 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11547,"raft.queue_time_us":17934,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":8379,"thread_start_us":53174,"threads_started":1,"wal-append.queue_time_us":246500}
I20260709 12:10:56.518057 17315 raft_consensus.cc:3060] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:56.490033 17412 consensus_queue.cc:237] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:56.533484 14257 raft_consensus.cc:2468] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 8.
I20260709 12:10:56.536607 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:56.537442 14257 raft_consensus.cc:3060] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:56.538367 17314 raft_consensus.cc:515] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:56.541508 17314 leader_election.cc:290] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 7 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:56.522154 17439 raft_consensus.cc:3055] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:56.520316 17382 raft_consensus.cc:515] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:56.574471 17442 raft_consensus.cc:493] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:56.575181 17442 raft_consensus.cc:515] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:56.576030 17246 raft_consensus.cc:493] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:56.576620 17246 raft_consensus.cc:515] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:56.579440 17246 leader_election.cc:290] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:10:56.570868 17034 consensus_meta.cc:287] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.610s	user 0.012s	sys 0.001s
I20260709 12:10:56.581048 17034 raft_consensus.cc:515] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:56.582794 17442 leader_election.cc:290] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:56.584136 17034 leader_election.cc:290] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 8 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:56.585188 14330 raft_consensus.cc:2393] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 8: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:10:56.562288 17314 raft_consensus.cc:493] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:56.586119 17314 raft_consensus.cc:515] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:56.591567 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:56.592566 17393 raft_consensus.cc:493] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
W20260709 12:10:56.593510 17428 consensus_meta.cc:287] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.642s	user 0.008s	sys 0.007s
I20260709 12:10:56.593367 17393 raft_consensus.cc:515] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:56.594105 17428 raft_consensus.cc:515] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:56.596716 17393 leader_election.cc:290] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:56.597110 17428 leader_election.cc:290] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 8 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:56.597474 17368 raft_consensus.cc:493] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:56.600104 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:56.604146 14907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53200 (request call id 476) took 1420 ms. Trace:
I20260709 12:10:56.604611 14907 rpcz_store.cc:276] 0709 12:10:55.187135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:55.188382 (+  1247us) service_pool.cc:224] Handling call
0709 12:10:55.188823 (+   441us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:56.127974 (+939151us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:56.603791 (+475817us) spinlock_profiling.cc:243] Waited 935 ms on lock 0x7b54007481d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:10:56.604040 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2150387968}
I20260709 12:10:56.548924 17439 raft_consensus.cc:740] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:10:56.615144 14190 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56046 (request call id 2046) took 1210 ms. Trace:
I20260709 12:10:56.615919 14190 rpcz_store.cc:276] 0709 12:10:55.405261 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:55.998972 (+593711us) service_pool.cc:224] Handling call
0709 12:10:56.148859 (+149887us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:56.149267 (+   408us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:56.149296 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:56.160057 (+ 10761us) log.cc:844] Serialized 26 byte log entry
0709 12:10:56.239915 (+ 79858us) spinlock_profiling.cc:243] Waited 5.67 ms on lock 0x7b1800312820. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f212cf16ab1 00007f212cf23281 00007f2124030e07 00007f212ce8b9a9 00007f212404d69b 00007f212404b93f 00007f212404dc02 00007f2126cd520b 00007f2126cdad23 00007f2126cdb0d1 00007f21270f6a0f
0709 12:10:56.558848 (+318933us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:56.558896 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:56.558974 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:56.606224 (+ 47250us) raft_consensus.cc:1685] finished
0709 12:10:56.606247 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:56.615049 (+  8802us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10660,"spinlock_wait_cycles":22253568,"thread_start_us":318549,"threads_started":1,"wal-append.queue_time_us":441428}
I20260709 12:10:56.626749 14257 raft_consensus.cc:2468] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 8.
I20260709 12:10:56.628041 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: true dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:56.628726 14257 raft_consensus.cc:3060] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:56.605057 17319 leader_election.cc:290] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 9 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:56.627483 17428 consensus_queue.cc:1059] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 12:10:56.654115 17428 raft_consensus.cc:3055] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:56.654599 17428 raft_consensus.cc:740] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:10:56.655827 17428 consensus_queue.cc:260] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:56.659483 17352 leader_election.cc:290] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 8 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:56.659765 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:56.660503 14331 raft_consensus.cc:3060] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:56.662215 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:56.663494 17348 raft_consensus.cc:3055] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:56.664016 17348 raft_consensus.cc:740] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:10:56.661406 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:56.665028 14339 raft_consensus.cc:2410] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:10:56.665885 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:56.666445 14334 raft_consensus.cc:1240] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 7 LEADER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:56.667128 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:56.667487 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
W20260709 12:10:56.609403 17417 consensus_meta.cc:287] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.576s	user 0.014s	sys 0.000s
I20260709 12:10:56.632994 17421 leader_election.cc:290] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:56.638980 14186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56046 (request call id 2047) took 1215 ms. Trace:
I20260709 12:10:56.644203 17382 leader_election.cc:290] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 8 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:10:56.649118 17295 consensus_meta.cc:287] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.526s	user 0.009s	sys 0.005s
I20260709 12:10:56.651422 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:56.657536 17428 raft_consensus.cc:3060] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:56.683403 14259 raft_consensus.cc:2393] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 8: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:10:56.683697 14257 raft_consensus.cc:2468] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 6.
I20260709 12:10:56.650769 17439 consensus_queue.cc:260] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:56.598275 17368 raft_consensus.cc:515] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:56.609591 17314 leader_election.cc:290] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:56.668325 14338 raft_consensus.cc:2468] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 6.
W20260709 12:10:56.690490 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:56.671092 14334 raft_consensus.cc:1240] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 12:10:56.674158 14331 raft_consensus.cc:2468] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 7.
W20260709 12:10:56.678435 14302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:56.672595 14186 rpcz_store.cc:276] 0709 12:10:55.423450 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:55.997962 (+574512us) service_pool.cc:224] Handling call
0709 12:10:56.146385 (+148423us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:56.146848 (+   463us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:56.146881 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:56.147465 (+   584us) log.cc:844] Serialized 26 byte log entry
0709 12:10:56.517129 (+369664us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:56.517174 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:56.517827 (+   653us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:56.638684 (+120857us) raft_consensus.cc:1685] finished
0709 12:10:56.638711 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:56.638887 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":115,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":9363,"thread_start_us":328301,"threads_started":1,"wal-append.queue_time_us":403462}
I20260709 12:10:56.694922 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:56.695086 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:56.695776 14257 raft_consensus.cc:2468] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 6.
I20260709 12:10:56.699312 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:56.700142 14331 raft_consensus.cc:2468] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 9.
I20260709 12:10:56.673228 17337 leader_election.cc:290] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:56.693783 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:56.703431 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:56.682785 17421 raft_consensus.cc:493] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:56.705072 14259 raft_consensus.cc:3060] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:56.665166 17348 consensus_queue.cc:260] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:56.707063 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:56.677546 17417 raft_consensus.cc:515] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:56.708849 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:56.709982 14338 raft_consensus.cc:3060] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:56.709940 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:56.710994 14257 raft_consensus.cc:2393] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 8: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:10:56.722465 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:56.723457 14337 raft_consensus.cc:2393] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 6: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:10:56.726227 17478 raft_consensus.cc:515] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:56.728539 17478 leader_election.cc:290] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 7 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:10:56.730731 17420 log.cc:927] Time spent T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 1.583s	user 0.004s	sys 0.005s
I20260709 12:10:56.709033 17439 raft_consensus.cc:3060] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:56.732116 14263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41768 (request call id 1572) took 2330 ms. Trace:
I20260709 12:10:56.732486 14263 rpcz_store.cc:276] 0709 12:10:54.402179 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:54.594373 (+192194us) service_pool.cc:224] Handling call
0709 12:10:54.594805 (+   432us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:54.708551 (+113746us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:10:54.708582 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:54.733921 (+ 25339us) log.cc:844] Serialized 26 byte log entry
0709 12:10:54.996312 (+262391us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:54.996358 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:54.996439 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:56.730077 (+1733638us) spinlock_profiling.cc:243] Waited 4.29 ms on lock 0x7b4400022b4c. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2123f74c85 00007f2123f756a2 00007f2126ce71db 00007f2126ce2aaf 00007f2126cd686e 00007f2126cd5bb6 00007f2126cd57d8 00007f2126cdf221 00007f2126cdf1d9 00007f2126cdf169
0709 12:10:56.731795 (+  1718us) raft_consensus.cc:1685] finished
0709 12:10:56.731816 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:56.732040 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1949,"raft.queue_time_us":8914,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":6302,"spinlock_wait_cycles":9860352,"thread_start_us":362756,"threads_started":2,"wal-append.queue_time_us":365344}
I20260709 12:10:56.734481 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:56.735056 14263 raft_consensus.cc:3060] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:56.735703 17410 leader_election.cc:290] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 7 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:56.733518 14185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 2322) took 1734 ms. Trace:
I20260709 12:10:56.738026 14185 rpcz_store.cc:276] 0709 12:10:54.998792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:55.000050 (+  1258us) service_pool.cc:224] Handling call
0709 12:10:55.000409 (+   359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:55.004886 (+  4477us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:10:55.027139 (+ 22253us) log.cc:844] Serialized 14 byte log entry
0709 12:10:55.123072 (+ 95933us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:55.123129 (+    57us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:55.123177 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:56.733246 (+1610069us) spinlock_profiling.cc:243] Waited 4.22 ms on lock 0x7b54004628d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:10:56.733300 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:56.733447 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1028,"prepare.queue_time_us":46114,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":44,"raft.queue_time_us":102259,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":110,"spinlock_wait_cycles":9701632,"thread_start_us":94463,"threads_started":1,"wal-append.queue_time_us":396639}
I20260709 12:10:56.742009 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:10:56.742745 14183 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56044 (request call id 2321) took 1746 ms (client timeout 1845 ms). Trace:
I20260709 12:10:56.743330 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:56.743963 14339 raft_consensus.cc:2468] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 4.
I20260709 12:10:56.746397 14263 raft_consensus.cc:2468] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 7.
I20260709 12:10:56.747221 14189 raft_consensus.cc:1240] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:56.742857 14335 raft_consensus.cc:2393] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 6: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:10:56.749297 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:56.754868 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:56.755858 14263 raft_consensus.cc:2393] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 8: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:10:56.761475 14155 leader_election.cc:304] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
W20260709 12:10:56.743269 14183 rpcz_store.cc:269] 0709 12:10:54.996617 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:54.998347 (+  1730us) service_pool.cc:224] Handling call
0709 12:10:56.742465 (+1744118us) spinlock_profiling.cc:243] Waited 193 ms on lock 0x7b540019bed4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:10:56.742640 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":444391680}
I20260709 12:10:56.766969 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:56.767859 14263 raft_consensus.cc:3060] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:56.768797 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:56.768963 14155 leader_election.cc:304] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:10:56.771137 14259 raft_consensus.cc:2468] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 8.
I20260709 12:10:56.772197 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:56.706671 17338 raft_consensus.cc:493] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:56.773976 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:56.778447 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:56.779114 14257 raft_consensus.cc:2376] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 6. Re-sending same reply.
I20260709 12:10:56.775938 14155 leader_election.cc:304] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:56.779349 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:56.782136 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:56.783026 14337 raft_consensus.cc:2410] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for term 7 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:10:56.777132 14259 raft_consensus.cc:2468] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 7.
I20260709 12:10:56.741254 14086 catalog_manager.cc:5697] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c reported cstate change: config changed from index 4 to 7, VOTER 885067a0d31741bfb5c9935788e315bf (127.12.174.129) evicted. New cstate: current_term: 6 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:10:56.709157 17421 raft_consensus.cc:515] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:56.784348 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:56.784627 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:56.785183 14335 raft_consensus.cc:2468] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 4.
I20260709 12:10:56.781463 14263 raft_consensus.cc:2468] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 9.
I20260709 12:10:56.730649 17417 leader_election.cc:290] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 10 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:56.787470 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:56.788120 14339 raft_consensus.cc:2468] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 6.
I20260709 12:10:56.789274 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:56.790436 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:56.766793 17348 raft_consensus.cc:3060] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:56.798142 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: true dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:56.798768 14337 raft_consensus.cc:3055] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:56.799095 14337 raft_consensus.cc:740] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:56.792287 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:56.793888 14155 leader_election.cc:304] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:56.797237 14338 raft_consensus.cc:2468] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 9.
I20260709 12:10:56.774889 17412 raft_consensus.cc:2804] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:56.801373 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:56.828660 17412 raft_consensus.cc:493] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:10:56.829804 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:56.802246 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:56.831301 14335 raft_consensus.cc:2468] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 7.
I20260709 12:10:56.804380 14337 consensus_queue.cc:260] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:56.805486 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
W20260709 12:10:56.806043 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:56.807564 14264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53050 (request call id 566) took 1066 ms. Trace:
I20260709 12:10:56.832777 14264 rpcz_store.cc:276] 0709 12:10:55.740700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:56.136324 (+395624us) service_pool.cc:224] Handling call
0709 12:10:56.136757 (+   433us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:56.182603 (+ 45846us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:56.807276 (+624673us) spinlock_profiling.cc:243] Waited 44.2 ms on lock 0x7b54002003d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:10:56.807488 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":101589376}
I20260709 12:10:56.775897 17298 raft_consensus.cc:2804] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:56.813660 14907 raft_consensus.cc:1275] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:10:56.814504 14908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:56.815856 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:56.839094 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:56.788169 17352 raft_consensus.cc:2804] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:56.819360 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:56.827045 17315 raft_consensus.cc:515] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:56.793895 14086 catalog_manager.cc:5697] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c reported cstate change: term changed from 2 to 4, leader changed from 885067a0d31741bfb5c9935788e315bf (127.12.174.129) to 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130). New cstate: current_term: 4 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } }
I20260709 12:10:56.778228 17403 raft_consensus.cc:493] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:56.839215 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:10:56.846060 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:56.846320 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:56.839373 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:56.816751 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:56.851610 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:56.852711 17314 raft_consensus.cc:2804] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:56.853240 17314 raft_consensus.cc:493] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:56.818099 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:56.855243 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:56.856773 14906 raft_consensus.cc:1240] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 9 LEADER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:10:56.839861 14333 raft_consensus.cc:2468] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 7.
W20260709 12:10:56.797573 14230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:56.857798 14230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:56.858171 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:56.859416 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:56.859891 14155 leader_election.cc:304] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:56.860580 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:56.861106 14339 raft_consensus.cc:3060] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:56.850090 14907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:56.849010 14908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:56.862548 14907 raft_consensus.cc:2393] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 8: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
I20260709 12:10:56.833979 17412 raft_consensus.cc:3060] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:56.868006 14230 leader_election.cc:304] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:56.868310 17403 raft_consensus.cc:515] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:56.876950 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:56.878298 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:56.878643 17325 raft_consensus.cc:2749] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:56.879019 17315 leader_election.cc:290] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 9 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:56.869163 17456 consensus_queue.cc:1048] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:56.879349 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:56.852921 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:56.869786 17277 consensus_queue.cc:1048] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:56.870206 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:56.882725 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:56.883320 14333 raft_consensus.cc:2468] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 6.
I20260709 12:10:56.884526 14333 raft_consensus.cc:1275] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:56.870381 17454 raft_consensus.cc:2804] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:56.870764 17382 consensus_queue.cc:1048] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:56.886282 17368 leader_election.cc:290] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:56.866773 17410 raft_consensus.cc:493] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:56.868597 17278 consensus_queue.cc:1048] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:56.874728 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:56.837663 17298 raft_consensus.cc:493] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:56.880195 14335 raft_consensus.cc:2410] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:10:56.853636 17314 raft_consensus.cc:3060] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:56.876724 14230 leader_election.cc:304] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:56.885640 17454 raft_consensus.cc:493] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:56.841565 17352 raft_consensus.cc:493] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:56.788005 17338 raft_consensus.cc:515] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:56.907147 14333 raft_consensus.cc:1275] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 12:10:56.907756 14333 pending_rounds.cc:85] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c: Aborting all ops after (but not including) 7
I20260709 12:10:56.908028 14333 pending_rounds.cc:107] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 12:10:56.908293 14333 raft_consensus.cc:2889] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:56.912247 14230 leader_election.cc:304] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:56.903707 14335 raft_consensus.cc:1275] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:56.892454 17298 raft_consensus.cc:3060] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:56.919883 17338 leader_election.cc:290] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:56.921433 14086 catalog_manager.cc:5697] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c reported cstate change: term changed from 2 to 5. New cstate: current_term: 5 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:56.924751 14230 leader_election.cc:304] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:56.914621 17352 raft_consensus.cc:3060] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:56.928089 14086 catalog_manager.cc:5697] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:10:56.930527 14339 raft_consensus.cc:2468] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 7.
I20260709 12:10:56.918598 17315 raft_consensus.cc:493] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:56.910485 17454 raft_consensus.cc:3060] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:56.936869 14086 catalog_manager.cc:5697] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c reported cstate change: term changed from 3 to 7, leader changed from 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) to 65c9c1653b3346b39a0e118540e6080c (127.12.174.131). New cstate: current_term: 7 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:56.930119 14230 leader_election.cc:304] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:56.918004 17277 raft_consensus.cc:2749] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:56.915772 17456 raft_consensus.cc:2749] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:10:56.931794 17487 log.cc:927] Time spent T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.131s	user 0.000s	sys 0.001s
I20260709 12:10:56.900089 17410 raft_consensus.cc:515] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:56.932940 17382 raft_consensus.cc:2749] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:56.949332 14086 catalog_manager.cc:5697] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:56.976011 14876 leader_election.cc:304] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:56.976995 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:56.948210 14230 leader_election.cc:304] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:56.977937 14263 raft_consensus.cc:2410] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:10:56.958515 14909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53200 (request call id 480) took 1631 ms. Trace:
I20260709 12:10:56.960498 14258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53050 (request call id 567) took 1218 ms. Trace:
I20260709 12:10:56.967868 14911 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59144 (request call id 306) took 2232 ms. Trace:
I20260709 12:10:56.968554 17408 leader_election.cc:290] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:56.968732 14910 raft_consensus.cc:1240] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:10:56.969473 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:56.970268 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:56.971318 14186 raft_consensus.cc:1240] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 12:10:56.972182 14190 raft_consensus.cc:1240] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:56.972791 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:56.982105 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:56.983924 14907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:56.979760 14909 rpcz_store.cc:276] 0709 12:10:55.327176 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:55.327341 (+   165us) service_pool.cc:224] Handling call
0709 12:10:55.344826 (+ 17485us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:55.466945 (+122119us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:55.466979 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:55.467037 (+    58us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:10:55.467074 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:56.958234 (+1491160us) spinlock_profiling.cc:243] Waited 122 ms on lock 0x7b5400088754. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:10:56.958284 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:56.958440 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":280224640}
I20260709 12:10:56.980948 14911 rpcz_store.cc:276] 0709 12:10:54.735940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:54.736138 (+   198us) service_pool.cc:224] Handling call
0709 12:10:56.967620 (+2231482us) spinlock_profiling.cc:243] Waited 213 ms on lock 0x7b5400040954. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:10:56.967764 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":489622784}
I20260709 12:10:56.989533 14182 raft_consensus.cc:2410] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:10:56.980844 14258 rpcz_store.cc:276] 0709 12:10:55.742538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:56.010912 (+268374us) service_pool.cc:224] Handling call
0709 12:10:56.960260 (+949348us) spinlock_profiling.cc:243] Waited 65 ms on lock 0x7b540022abd4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:10:56.960426 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":149514624}
I20260709 12:10:56.997236 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: true dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:10:56.998262 14911 raft_consensus.cc:3060] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:56.997303 14086 catalog_manager.cc:5697] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c reported cstate change: term changed from 6 to 8, leader changed from 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130) to 65c9c1653b3346b39a0e118540e6080c (127.12.174.131). New cstate: current_term: 8 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:57.003592 14263 raft_consensus.cc:1240] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:57.005236 14264 raft_consensus.cc:1240] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:57.005415 14258 raft_consensus.cc:1240] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:10:57.006505 14264 raft_consensus.cc:1240] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:57.006824 14911 raft_consensus.cc:2468] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 6.
I20260709 12:10:57.007922 14907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:57.008528 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:56.951218 17325 raft_consensus.cc:2749] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:10:57.047524 14304 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:57.062981 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:57.010593 14086 catalog_manager.cc:5697] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:56.997856 14876 leader_election.cc:304] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:57.010958 14263 raft_consensus.cc:1240] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:56.938841 17315 raft_consensus.cc:515] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:56.977901 17278 raft_consensus.cc:493] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:57.065066 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:57.006721 14258 raft_consensus.cc:1240] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 9. Current term is 10. Ops: []
I20260709 12:10:57.088414 14258 raft_consensus.cc:1240] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:57.002732 17337 raft_consensus.cc:2749] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:56.998226 17319 raft_consensus.cc:493] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:57.089895 14086 catalog_manager.cc:5697] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c reported cstate change: term changed from 5 to 6, leader changed from 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130) to 65c9c1653b3346b39a0e118540e6080c (127.12.174.131). New cstate: current_term: 6 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:56.994549 17438 raft_consensus.cc:493] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:57.093866 14263 raft_consensus.cc:1240] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 6. Current term is 7. Ops: [4.3-6.4]
I20260709 12:10:57.009649 17382 raft_consensus.cc:2749] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:10:57.106156 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:57.111155 14181 raft_consensus.cc:2410] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for term 9 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 12:10:56.997115 17316 raft_consensus.cc:493] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:10:57.096820 17421 leader_election.cc:290] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:57.099431 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:10:57.103008 16602 raft_consensus.cc:493] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:57.091881 17278 raft_consensus.cc:515] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:57.138842 14086 catalog_manager.cc:5697] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } }
I20260709 12:10:57.118894 17385 raft_consensus.cc:2804] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:57.107985 17319 raft_consensus.cc:515] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:57.149096 14256 raft_consensus.cc:1240] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:10:57.121811 17316 raft_consensus.cc:515] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:57.145570 14904 raft_consensus.cc:2368] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 5. Current term is 6.
I20260709 12:10:57.155349 14086 catalog_manager.cc:5697] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c reported cstate change: config changed from index -1 to 5, NON_VOTER 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) added, no longer has a pending config: VOTER 885067a0d31741bfb5c9935788e315bf (127.12.174.129), VOTER 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130), VOTER 65c9c1653b3346b39a0e118540e6080c (127.12.174.131), NON_VOTER 73d01e9b1a9d49358da4985b21d681db (127.12.174.132). New cstate: current_term: 5 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } health_report { overall_health: HEALTHY } } }
I20260709 12:10:57.159760 14910 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53200 (request call id 478) took 1965 ms. Trace:
I20260709 12:10:57.160152 14910 rpcz_store.cc:276] 0709 12:10:55.194523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:55.278677 (+ 84154us) service_pool.cc:224] Handling call
0709 12:10:56.968337 (+1689660us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:56.988218 (+ 19881us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:57.159583 (+171365us) spinlock_profiling.cc:243] Waited 1.64 s on lock 0x7b5400040950. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713a8ad 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:10:57.159698 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3764928256}
I20260709 12:10:57.159999 14086 catalog_manager.cc:5697] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c reported cstate change: term changed from 2 to 5, leader changed from 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) to 65c9c1653b3346b39a0e118540e6080c (127.12.174.131). New cstate: current_term: 5 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:57.131006 16602 raft_consensus.cc:515] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:57.161706 14189 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56046 (request call id 2040) took 2039 ms. Trace:
I20260709 12:10:57.182999 17319 leader_election.cc:290] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:57.163018 14086 catalog_manager.cc:5697] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c reported cstate change: term changed from 4 to 5, leader changed from 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130) to 885067a0d31741bfb5c9935788e315bf (127.12.174.129). New cstate: current_term: 5 leader_uuid: "885067a0d31741bfb5c9935788e315bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } }
I20260709 12:10:57.182436 14189 rpcz_store.cc:276] 0709 12:10:55.122798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:55.123396 (+   598us) service_pool.cc:224] Handling call
0709 12:10:56.746988 (+1623592us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:56.750117 (+  3129us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:57.161522 (+411405us) spinlock_profiling.cc:243] Waited 1.62 s on lock 0x7b540019bed0. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713a8ad 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:10:57.161642 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3732161408}
W20260709 12:10:57.163709 14265 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41768 (request call id 1584) took 2021 ms (client timeout 2332 ms). Trace:
I20260709 12:10:57.165068 14184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 2331) took 1726 ms. Trace:
W20260709 12:10:57.190307 14302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:57.196996 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:57.196799 14086 catalog_manager.cc:5697] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c reported cstate change: term changed from 5 to 6, leader changed from 65c9c1653b3346b39a0e118540e6080c (127.12.174.131) to 885067a0d31741bfb5c9935788e315bf (127.12.174.129). New cstate: current_term: 6 leader_uuid: "885067a0d31741bfb5c9935788e315bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } }
I20260709 12:10:57.198956 17447 raft_consensus.cc:493] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:57.198701 14086 catalog_manager.cc:5697] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:57.200280 14086 catalog_manager.cc:5697] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:10:57.184496 14155 leader_election.cc:304] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
W20260709 12:10:57.154162 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 156403us
I20260709 12:10:57.201671 14086 catalog_manager.cc:5697] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:10:57.154078 14257 raft_consensus.cc:1240] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 12:10:57.155875 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:57.112931 17438 raft_consensus.cc:515] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:57.156476 17385 raft_consensus.cc:493] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:10:57.188062 14184 rpcz_store.cc:276] 0709 12:10:55.438406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:56.172350 (+733944us) service_pool.cc:224] Handling call
0709 12:10:56.186140 (+ 13790us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:56.303223 (+117083us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:57.164823 (+861600us) spinlock_profiling.cc:243] Waited 116 ms on lock 0x7b54002d1254. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:10:57.165005 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":267315072}
I20260709 12:10:57.166880 14262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53050 (request call id 551) took 2984 ms. Trace:
W20260709 12:10:57.186326 14265 rpcz_store.cc:269] 0709 12:10:55.142017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:55.836824 (+694807us) service_pool.cc:224] Handling call
0709 12:10:57.163507 (+1326683us) spinlock_profiling.cc:243] Waited 237 ms on lock 0x7b54001c2354. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:10:57.163633 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":545825152}
W20260709 12:10:57.153211 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 205074us
I20260709 12:10:57.205253 14258 raft_consensus.cc:2468] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 7.
W20260709 12:10:57.197630 17495 log.cc:927] Time spent T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.113s	user 0.000s	sys 0.001s
I20260709 12:10:57.206990 14876 leader_election.cc:304] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
W20260709 12:10:57.217195 14154 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 220636us
I20260709 12:10:57.210716 14230 leader_election.cc:304] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:57.199437 17447 raft_consensus.cc:3060] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:10:57.203059 17428 consensus_meta.cc:287] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.511s	user 0.009s	sys 0.002s
I20260709 12:10:57.219676 14155 leader_election.cc:304] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:57.179601 16602 leader_election.cc:290] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:57.172389 17153 leader_election.cc:290] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 8 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:57.221838 14258 raft_consensus.cc:1240] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 12:10:57.214691 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:57.170962 17344 leader_election.cc:290] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:57.211308 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:10:57.206435 17328 raft_consensus.cc:493] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:57.226853 14910 raft_consensus.cc:3060] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:57.180238 17315 leader_election.cc:290] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:57.162847 17467 leader_election.cc:290] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:57.180531 17410 leader_election.cc:290] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:57.165673 17278 leader_election.cc:290] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:57.208806 14262 rpcz_store.cc:276] 0709 12:10:54.182323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:54.189080 (+  6757us) service_pool.cc:224] Handling call
0709 12:10:54.222716 (+ 33636us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:54.615419 (+392703us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:54.615452 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:54.626884 (+ 11432us) log.cc:844] Serialized 26 byte log entry
0709 12:10:54.994244 (+367360us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:54.994290 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:57.166493 (+2172203us) spinlock_profiling.cc:243] Waited 392 ms on lock 0x7b5400221ad4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:10:57.166539 (+    46us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:57.166588 (+    49us) raft_consensus.cc:1685] finished
0709 12:10:57.166599 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:57.166820 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":417,"raft.queue_time_us":5689,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":6043,"spinlock_wait_cycles":902145408,"thread_start_us":366964,"threads_started":1,"wal-append.queue_time_us":506760,"wal-append.run_cpu_time_us":5406,"wal-append.run_wall_time_us":1628907}
I20260709 12:10:57.174119 17445 leader_election.cc:290] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:57.214968 17385 raft_consensus.cc:3060] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:57.251869 14086 catalog_manager.cc:5697] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } }
I20260709 12:10:57.258654 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:57.227783 14230 leader_election.cc:304] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:57.239068 14155 leader_election.cc:304] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:57.239879 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:57.240459 17501 raft_consensus.cc:2749] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:57.241720 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:57.261116 14261 raft_consensus.cc:2393] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 9: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
I20260709 12:10:57.206068 17246 raft_consensus.cc:493] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:57.266048 14155 leader_election.cc:304] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:57.242527 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:57.243021 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
W20260709 12:10:57.243461 17494 log.cc:927] Time spent T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.127s	user 0.000s	sys 0.000s
I20260709 12:10:57.225004 17325 raft_consensus.cc:2749] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:57.211050 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:57.249895 17328 raft_consensus.cc:515] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:57.242079 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
W20260709 12:10:57.266598 14154 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 45988.6us
I20260709 12:10:57.273648 17105 consensus_queue.cc:1059] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:57.273967 17503 consensus_queue.cc:1048] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:57.275115 14910 raft_consensus.cc:2468] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 8.
I20260709 12:10:57.160012 17454 raft_consensus.cc:515] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:57.275381 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:57.276880 14155 leader_election.cc:304] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:57.277480 14256 raft_consensus.cc:2393] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 7: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:10:57.278446 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:57.275381 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:57.302408 14155 leader_election.cc:304] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:57.302597 14261 raft_consensus.cc:2468] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 9.
I20260709 12:10:57.285522 14304 leader_election.cc:304] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:57.274338 17368 consensus_queue.cc:1059] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.012s
I20260709 12:10:57.290820 14265 raft_consensus.cc:2393] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 9: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:10:57.214246 17412 raft_consensus.cc:515] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:57.287288 17299 raft_consensus.cc:2804] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:57.295774 14229 leader_election.cc:304] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:10:57.295938 14262 raft_consensus.cc:1240] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:57.305163 14263 raft_consensus.cc:1275] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:10:57.291663 14086 catalog_manager.cc:5697] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:57.292263 14154 leader_election.cc:304] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
W20260709 12:10:57.293398 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 65694.8us
I20260709 12:10:57.314052 14257 raft_consensus.cc:1240] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:57.314775 14230 leader_election.cc:304] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:57.286902 17439 raft_consensus.cc:2804] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:57.310819 14155 leader_election.cc:304] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:57.319487 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:57.320647 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:57.328874 14190 raft_consensus.cc:2468] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 6.
I20260709 12:10:57.324581 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:57.327168 14230 leader_election.cc:304] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:57.329051 14265 raft_consensus.cc:1275] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:10:57.332996 14229 leader_election.cc:304] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:57.334450 14183 raft_consensus.cc:2393] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 8: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:10:57.296737 17410 raft_consensus.cc:493] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:57.338780 14262 raft_consensus.cc:1240] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:57.339151 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:57.339704 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:57.286728 17392 consensus_queue.cc:1059] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 12:10:57.342633 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:57.353173 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:57.283579 17445 consensus_queue.cc:1048] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 12:10:57.288033 16602 consensus_queue.cc:1059] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 12:10:57.309002 17153 raft_consensus.cc:2804] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:57.304852 17428 raft_consensus.cc:2749] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:57.350026 14190 raft_consensus.cc:3060] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:57.341244 17499 raft_consensus.cc:2804] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:57.350512 14184 raft_consensus.cc:2468] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 6.
I20260709 12:10:57.359611 14230 leader_election.cc:304] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:57.295028 17417 consensus_queue.cc:1059] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.047s
W20260709 12:10:57.364652 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 79230.1us
I20260709 12:10:57.335362 17315 raft_consensus.cc:3060] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:57.377965 17344 raft_consensus.cc:2749] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:57.335109 17439 raft_consensus.cc:493] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:57.418678 17439 raft_consensus.cc:3060] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:57.419772 17508 raft_consensus.cc:2804] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:57.420310 17508 raft_consensus.cc:493] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:57.420684 17508 raft_consensus.cc:3060] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:10:57.422022 17502 log.cc:927] Time spent T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 12:10:57.339620 17467 raft_consensus.cc:2749] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:57.377786 17347 raft_consensus.cc:2804] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:57.334756 17299 raft_consensus.cc:697] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 8 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:10:57.403155 17499 raft_consensus.cc:493] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:57.312062 17500 raft_consensus.cc:2764] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:10:57.328052 17325 raft_consensus.cc:2804] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:57.288800 17246 raft_consensus.cc:515] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:57.287777 17486 consensus_queue.cc:1059] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.054s
W20260709 12:10:57.392735 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 82001.9us
I20260709 12:10:57.369076 17319 raft_consensus.cc:2804] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:57.356877 17367 leader_election.cc:290] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:57.402513 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:57.447244 14155 leader_election.cc:304] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:57.454718 14182 raft_consensus.cc:2468] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 4.
W20260709 12:10:57.407496 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 47983.5us
I20260709 12:10:57.437247 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
W20260709 12:10:57.404609 17497 log.cc:927] Time spent T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.174s	user 0.000s	sys 0.001s
I20260709 12:10:57.362618 17410 raft_consensus.cc:515] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:57.435729 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:57.467172 14184 raft_consensus.cc:2393] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 8: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:10:57.468600 14155 leader_election.cc:304] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:57.443282 17499 raft_consensus.cc:3060] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:57.381712 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 174810us
I20260709 12:10:57.456841 14230 leader_election.cc:304] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:57.456651 17325 raft_consensus.cc:697] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 8 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:10:57.476809 17500 raft_consensus.cc:2804] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:57.477101 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:57.349465 14086 catalog_manager.cc:5697] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c reported cstate change: term changed from 2 to 4, leader changed from 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130) to 65c9c1653b3346b39a0e118540e6080c (127.12.174.131). New cstate: current_term: 4 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:57.477929 14184 raft_consensus.cc:2393] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 6: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
I20260709 12:10:57.477656 17325 consensus_queue.cc:237] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:57.479007 17156 raft_consensus.cc:3060] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:57.478864 14086 catalog_manager.cc:5697] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c reported cstate change: term changed from 4 to 8, leader changed from 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130) to 73d01e9b1a9d49358da4985b21d681db (127.12.174.132). New cstate: current_term: 8 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:10:57.471956 16602 raft_consensus.cc:3055] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:57.446051 17438 leader_election.cc:290] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:57.440892 17316 leader_election.cc:290] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:57.443733 17347 raft_consensus.cc:697] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 6 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:10:57.472988 14155 leader_election.cc:304] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:57.437320 14190 raft_consensus.cc:2468] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 4.
I20260709 12:10:57.492559 14190 raft_consensus.cc:1240] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 9. Current term is 10. Ops: []
I20260709 12:10:57.493383 14258 raft_consensus.cc:1240] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:10:57.482255 14229 leader_election.cc:304] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:57.460155 17319 raft_consensus.cc:697] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 7 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:10:57.478880 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:57.485205 14230 leader_election.cc:304] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:10:57.499897 14229 leader_election.cc:304] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:57.480553 14086 catalog_manager.cc:5697] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c reported cstate change: term changed from 2 to 3, leader changed from 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130) to 73d01e9b1a9d49358da4985b21d681db (127.12.174.132). New cstate: current_term: 3 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:10:57.467342 17368 raft_consensus.cc:2749] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:57.457674 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:57.484521 14154 leader_election.cc:304] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:57.502476 14182 raft_consensus.cc:2393] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 8: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:10:57.495570 14155 leader_election.cc:304] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:57.480834 17277 raft_consensus.cc:2749] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:10:57.507829 14229 leader_election.cc:304] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:57.492825 17105 raft_consensus.cc:3055] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:57.509706 14229 leader_election.cc:304] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:57.480929 16602 raft_consensus.cc:740] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:57.512630 14086 catalog_manager.cc:5697] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c reported cstate change: term changed from 3 to 6, leader changed from 885067a0d31741bfb5c9935788e315bf (127.12.174.129) to 65c9c1653b3346b39a0e118540e6080c (127.12.174.131). New cstate: current_term: 6 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:57.502846 17518 raft_consensus.cc:3055] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:10:57.519189 17507 log.cc:927] Time spent T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.111s	user 0.000s	sys 0.001s
I20260709 12:10:57.519451 17105 raft_consensus.cc:740] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:57.520008 16602 consensus_queue.cc:260] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:57.520447 17105 consensus_queue.cc:260] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:57.504930 17367 raft_consensus.cc:2804] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:57.521955 17367 raft_consensus.cc:493] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:57.522316 17367 raft_consensus.cc:3060] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:57.491875 17500 raft_consensus.cc:697] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 8 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:10:57.524320 17500 consensus_queue.cc:237] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:57.511087 17454 leader_election.cc:290] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 8 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:57.519219 17518 raft_consensus.cc:740] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:57.507992 17392 consensus_queue.cc:1059] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 12:10:57.508057 17520 raft_consensus.cc:3055] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:57.518026 14086 catalog_manager.cc:5697] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c reported cstate change: term changed from 3 to 5, leader changed from 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130) to 65c9c1653b3346b39a0e118540e6080c (127.12.174.131). New cstate: current_term: 5 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:57.527951 17520 raft_consensus.cc:740] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:57.515987 17412 leader_election.cc:290] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:57.516433 17382 raft_consensus.cc:2804] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:57.521497 17246 leader_election.cc:290] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:57.527693 17518 consensus_queue.cc:260] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:57.529510 17382 raft_consensus.cc:493] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:57.530011 17382 raft_consensus.cc:3060] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:57.530246 17518 raft_consensus.cc:3060] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:57.516273 17278 raft_consensus.cc:2804] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:57.533425 17278 raft_consensus.cc:493] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:57.533910 17278 raft_consensus.cc:3060] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:57.534577 14229 leader_election.cc:304] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:57.535923 17520 consensus_queue.cc:260] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:57.537542 17520 raft_consensus.cc:3060] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:57.533635 17277 raft_consensus.cc:2749] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:10:57.542899 17298 consensus_meta.cc:287] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.624s	user 0.010s	sys 0.001s
I20260709 12:10:57.543447 17298 raft_consensus.cc:515] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:57.544638 14186 raft_consensus.cc:2393] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 7: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:10:57.545948 17367 raft_consensus.cc:515] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:57.547849 14086 catalog_manager.cc:5697] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c reported cstate change: term changed from 1 to 7, leader changed from 65c9c1653b3346b39a0e118540e6080c (127.12.174.131) to 73d01e9b1a9d49358da4985b21d681db (127.12.174.132). New cstate: current_term: 7 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:10:57.549490 14086 catalog_manager.cc:5697] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c reported cstate change: term changed from 8 to 9, leader changed from 885067a0d31741bfb5c9935788e315bf (127.12.174.129) to 65c9c1653b3346b39a0e118540e6080c (127.12.174.131). New cstate: current_term: 9 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:57.551404 17456 raft_consensus.cc:2749] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:57.551180 17319 consensus_queue.cc:237] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:57.552498 17392 raft_consensus.cc:3055] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:57.552920 17392 raft_consensus.cc:740] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:57.553767 17392 consensus_queue.cc:260] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:57.554890 17392 raft_consensus.cc:3060] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:10:57.557300 17314 consensus_meta.cc:287] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.642s	user 0.009s	sys 0.001s
I20260709 12:10:57.558171 17347 consensus_queue.cc:237] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:57.508407 17344 raft_consensus.cc:2804] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:57.521395 16602 raft_consensus.cc:3060] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:57.562456 17344 raft_consensus.cc:697] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 7 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:10:57.551200 14086 catalog_manager.cc:5697] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c reported cstate change: term changed from 5 to 6, leader changed from 885067a0d31741bfb5c9935788e315bf (127.12.174.129) to 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130). New cstate: current_term: 6 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } }
W20260709 12:10:57.509107 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 102988us
I20260709 12:10:57.563391 17344 consensus_queue.cc:237] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:57.564527 17514 consensus_queue.cc:1059] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 7.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:57.565547 17521 raft_consensus.cc:3055] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:10:57.562129 17510 log.cc:927] Time spent T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:10:57.561769 17105 raft_consensus.cc:3060] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:57.567281 14304 leader_election.cc:304] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:10:57.568401 17368 raft_consensus.cc:2804] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:57.566095 17521 raft_consensus.cc:740] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
W20260709 12:10:57.571218 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 57797.2us
I20260709 12:10:57.571615 14304 leader_election.cc:304] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
W20260709 12:10:57.574667 14154 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 86712.1us
I20260709 12:10:57.575654 14154 leader_election.cc:304] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
W20260709 12:10:57.619105 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 45046.3us
I20260709 12:10:57.509959 17467 raft_consensus.cc:2749] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:10:57.643603 14154 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 68049us
I20260709 12:10:57.644651 14154 leader_election.cc:304] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:57.575984 17368 raft_consensus.cc:493] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:57.598698 17504 log.cc:927] Time spent T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.175s	user 0.001s	sys 0.001s
W20260709 12:10:57.598918 17512 log.cc:927] Time spent T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
W20260709 12:10:57.619062 17517 log.cc:927] Time spent T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
W20260709 12:10:57.619618 17483 log.cc:927] Time spent T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 12:10:57.705626 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 85742.2us
I20260709 12:10:57.599499 17316 raft_consensus.cc:2804] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:10:57.706632 14154 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 62088.3us
I20260709 12:10:57.584860 17501 raft_consensus.cc:2749] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:10:57.617127 17391 raft_consensus.cc:2804] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:57.493566 17299 consensus_queue.cc:237] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:57.585777 17314 raft_consensus.cc:515] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:57.712917 14189 raft_consensus.cc:1275] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:10:57.732736 14304 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:57.739190 14154 leader_election.cc:304] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
W20260709 12:10:57.706211 17507 log.cc:927] Time spent T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 12:10:57.692333 17277 raft_consensus.cc:493] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:57.585927 17439 raft_consensus.cc:515] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:57.707651 17368 raft_consensus.cc:3060] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:10:57.742264 17348 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.005s	sys 0.019s
W20260709 12:10:57.829087 14304 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:57.833359 14154 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 94260.8us
I20260709 12:10:57.855937 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:57.857394 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:57.858243 14339 raft_consensus.cc:2410] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:10:57.859011 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:57.740491 17445 raft_consensus.cc:2749] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:57.710098 17515 raft_consensus.cc:2804] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:57.617694 17516 consensus_queue.cc:1059] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.246s
I20260709 12:10:57.861959 14230 leader_election.cc:304] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:57.863196 14154 leader_election.cc:304] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
W20260709 12:10:57.834672 17512 log.cc:927] Time spent T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 12:10:57.784839 17391 raft_consensus.cc:493] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:57.789669 17316 raft_consensus.cc:697] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 9 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:10:57.878176 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:57.702569 17153 raft_consensus.cc:697] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 8 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
W20260709 12:10:57.851926 17348 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.671s	user 0.006s	sys 0.020s
I20260709 12:10:57.890700 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:57.891383 14188 raft_consensus.cc:2468] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 11.
I20260709 12:10:57.891480 17153 consensus_queue.cc:237] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:57.892385 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:57.842105 17521 consensus_queue.cc:260] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:57.894527 17521 raft_consensus.cc:3060] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:57.877820 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:57.877535 17519 raft_consensus.cc:2749] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:10:57.882022 17391 raft_consensus.cc:3060] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:57.904074 14189 raft_consensus.cc:1240] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:57.905606 14189 raft_consensus.cc:1275] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:10:57.886412 17316 consensus_queue.cc:237] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:57.882083 17467 raft_consensus.cc:493] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:57.889585 14230 leader_election.cc:304] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:57.911116 14331 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 533) took 1199 ms. Trace:
I20260709 12:10:57.929533 14331 rpcz_store.cc:276] 0709 12:10:56.711499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:56.711641 (+   142us) service_pool.cc:224] Handling call
0709 12:10:56.717991 (+  6350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:56.920670 (+202679us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:56.920700 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:56.920744 (+    44us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:10:56.920786 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:57.910808 (+990022us) spinlock_profiling.cc:243] Waited 202 ms on lock 0x7b54000b8e54. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:10:57.910877 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:57.911021 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":465581312}
I20260709 12:10:57.735287 17522 consensus_queue.cc:1059] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.169s
I20260709 12:10:57.908457 17525 raft_consensus.cc:2804] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:57.843868 17277 raft_consensus.cc:515] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:10:57.941340 17507 log.cc:927] Time spent T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:10:57.933411 17519 raft_consensus.cc:2749] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:57.938313 17456 raft_consensus.cc:493] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:57.939592 17405 raft_consensus.cc:493] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:57.945081 17404 raft_consensus.cc:493] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:57.961349 17385 consensus_meta.cc:287] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db: Time spent flushing consensus metadata: real 0.686s	user 0.012s	sys 0.000s
I20260709 12:10:57.952952 17367 leader_election.cc:290] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 8 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:10:57.962992 17352 consensus_meta.cc:287] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 1.024s	user 0.013s	sys 0.000s
W20260709 12:10:57.971668 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 140770us
I20260709 12:10:57.938397 17467 raft_consensus.cc:515] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:10:57.959519 17508 consensus_meta.cc:287] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.538s	user 0.008s	sys 0.003s
I20260709 12:10:57.962604 17298 leader_election.cc:290] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 7 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:57.967842 17405 raft_consensus.cc:515] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:58.002446 17405 leader_election.cc:290] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:10:58.008869 17499 consensus_meta.cc:287] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.515s	user 0.005s	sys 0.003s
I20260709 12:10:57.988749 17385 raft_consensus.cc:515] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:58.010375 17317 leader_election.cc:290] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 8 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:58.011137 14906 raft_consensus.cc:1240] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 9. Current term is 10. Ops: []
I20260709 12:10:58.009586 17439 leader_election.cc:290] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 8 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:58.012707 17348 raft_consensus.cc:493] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
W20260709 12:10:58.013207 14305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:57.994109 17508 raft_consensus.cc:515] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:58.015410 17318 raft_consensus.cc:493] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:58.015898 17318 raft_consensus.cc:515] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:58.016925 17508 leader_election.cc:290] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 8 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:58.017976 17318 leader_election.cc:290] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:58.019188 17417 raft_consensus.cc:3055] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:10:58.019634 17417 raft_consensus.cc:740] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:58.020546 17417 consensus_queue.cc:260] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:57.966233 17456 raft_consensus.cc:515] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:58.023120 17456 leader_election.cc:290] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:58.023854 17417 raft_consensus.cc:3060] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:58.034700 17314 leader_election.cc:290] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:58.038220 17277 leader_election.cc:290] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:58.013307 17348 raft_consensus.cc:515] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:58.044607 17348 leader_election.cc:290] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:58.045956 14337 raft_consensus.cc:3060] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:58.047818 17315 consensus_meta.cc:287] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.637s	user 0.005s	sys 0.005s
I20260709 12:10:57.991412 17533 raft_consensus.cc:3055] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:58.048727 17533 raft_consensus.cc:740] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:58.049644 17533 consensus_queue.cc:260] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:10:58.014447 17524 log.cc:927] Time spent T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.148s	user 0.001s	sys 0.000s
I20260709 12:10:57.993014 17352 raft_consensus.cc:515] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:58.009369 17499 raft_consensus.cc:515] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:58.081414 17352 leader_election.cc:290] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:58.082243 14185 raft_consensus.cc:2393] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 5: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
W20260709 12:10:58.084975 17447 consensus_meta.cc:287] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.827s	user 0.010s	sys 0.000s
I20260709 12:10:58.094671 14181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56044 (request call id 2343) took 1127 ms. Trace:
W20260709 12:10:58.077041 17382 consensus_meta.cc:287] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.547s	user 0.003s	sys 0.007s
I20260709 12:10:58.011776 17385 leader_election.cc:290] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 10 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:58.076237 17315 raft_consensus.cc:2749] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:57.970324 17404 raft_consensus.cc:515] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:58.088250 17391 raft_consensus.cc:515] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:10:58.089936 17535 log.cc:927] Time spent T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
W20260709 12:10:58.077983 17278 consensus_meta.cc:287] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.544s	user 0.010s	sys 0.001s
I20260709 12:10:58.095415 14181 rpcz_store.cc:276] 0709 12:10:56.967041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:56.986535 (+ 19494us) service_pool.cc:224] Handling call
0709 12:10:58.092270 (+1105735us) spinlock_profiling.cc:243] Waited 30.7 ms on lock 0x7b5400420c54. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:10:58.094590 (+  2320us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":70724352}
I20260709 12:10:58.082175 17499 leader_election.cc:290] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 7 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:58.113303 14337 raft_consensus.cc:2468] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 6.
I20260709 12:10:58.115224 14188 raft_consensus.cc:2410] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:10:58.092386 17533 raft_consensus.cc:3060] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:10:58.118220 14905 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59144 (request call id 302) took 3968 ms (client timeout 2009 ms). Trace:
W20260709 12:10:58.123075 14337 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50858 (request call id 1600) took 1367 ms (client timeout 1728 ms). Trace:
W20260709 12:10:58.098541 17156 consensus_meta.cc:287] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.618s	user 0.008s	sys 0.003s
W20260709 12:10:58.123736 14905 rpcz_store.cc:269] 0709 12:10:54.149443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:54.149998 (+   555us) service_pool.cc:224] Handling call
0709 12:10:58.117907 (+3967909us) spinlock_profiling.cc:243] Waited 1.91 s on lock 0x7b540047a254. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:10:58.118117 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4389852416}
W20260709 12:10:58.107154 17526 log.cc:927] Time spent T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.159s	user 0.000s	sys 0.001s
W20260709 12:10:58.124401 14337 rpcz_store.cc:269] 0709 12:10:56.746717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:56.783593 (+ 36876us) service_pool.cc:224] Handling call
0709 12:10:58.045667 (+1262074us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b5800756ed0. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f21270970aa 00007f2127119447 00007f2127131fe7 00007f21271337de 00007f212713f27c 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c
0709 12:10:58.114156 (+ 68489us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2787501952}
W20260709 12:10:58.113286 17105 consensus_meta.cc:287] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.547s	user 0.003s	sys 0.007s
I20260709 12:10:58.097007 17382 raft_consensus.cc:515] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:58.097087 17447 raft_consensus.cc:515] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:58.128509 17156 raft_consensus.cc:2749] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:58.148283 17391 leader_election.cc:290] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 10 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:58.149808 17404 leader_election.cc:290] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:58.153636 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:58.157660 14910 raft_consensus.cc:2393] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 4: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
I20260709 12:10:58.154959 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:58.114279 17278 raft_consensus.cc:515] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:58.159080 14905 raft_consensus.cc:2393] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 9: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
I20260709 12:10:58.160446 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:58.160605 17385 consensus_queue.cc:1048] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:58.162066 17403 leader_election.cc:290] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:10:58.158406 17492 log.cc:927] Time spent T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 1.068s	user 0.003s	sys 0.001s
I20260709 12:10:58.168190 14876 leader_election.cc:304] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:58.172115 17467 leader_election.cc:290] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:58.178771 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
W20260709 12:10:58.179212 14185 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56044 (request call id 2338) took 1213 ms (client timeout 1585 ms). Trace:
W20260709 12:10:58.197921 14185 rpcz_store.cc:269] 0709 12:10:56.965530 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:56.970014 (+  4484us) service_pool.cc:224] Handling call
0709 12:10:58.178922 (+1208908us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b54003e8354. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:10:58.179130 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2514078976}
I20260709 12:10:58.180055 14189 raft_consensus.cc:1240] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:10:58.197724 14263 raft_consensus.cc:2410] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
W20260709 12:10:58.181885 14302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:58.183286 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:58.185652 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:58.201200 14877 leader_election.cc:304] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:10:58.187884 14259 raft_consensus.cc:1275] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:10:58.189669 14184 raft_consensus.cc:2393] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 10: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:10:58.190467 14260 raft_consensus.cc:1275] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:10:58.192930 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
W20260709 12:10:58.206290 14303 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:58.207144 14303 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:58.207636 14303 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:58.208488 14303 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:58.208834 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:58.209758 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
W20260709 12:10:58.210479 14303 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:58.211624 14303 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:58.214772 17437 raft_consensus.cc:2804] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:10:58.215266 17437 raft_consensus.cc:493] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:58.215577 17337 raft_consensus.cc:2764] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:10:58.215724 17385 consensus_queue.cc:1048] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:10:58.191463 17534 raft_consensus.cc:493] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:58.213376 14303 connection.cc:256] RPC call timeout handler was delayed by -1.7460042329998942s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1845s for a response
I20260709 12:10:58.236325 14877 leader_election.cc:304] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:10:58.215605 17437 raft_consensus.cc:3060] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:10:58.239511 17278 leader_election.cc:290] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 7 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:58.230206 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:58.250228 17545 consensus_queue.cc:1059] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
W20260709 12:10:58.251734 17544 log.cc:927] Time spent T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:10:58.224063 17368 raft_consensus.cc:515] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:58.263222 17196 raft_consensus.cc:493] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:58.265528 17052 leader_election.cc:290] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 8 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:58.268616 17278 raft_consensus.cc:493] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:58.269621 14338 raft_consensus.cc:1240] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:58.239799 17554 raft_consensus.cc:2804] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:58.230760 17534 raft_consensus.cc:515] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:58.275789 17278 raft_consensus.cc:515] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:58.265359 17403 raft_consensus.cc:493] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:58.288172 14183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56044 (request call id 2337) took 1323 ms. Trace:
I20260709 12:10:58.290912 14183 rpcz_store.cc:276] 0709 12:10:56.965206 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:56.969181 (+  3975us) service_pool.cc:224] Handling call
0709 12:10:58.287946 (+1318765us) spinlock_profiling.cc:243] Waited 346 ms on lock 0x7b5400422054. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:10:58.288095 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":795170560}
I20260709 12:10:58.288378 14190 raft_consensus.cc:1240] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 12:10:58.282178 17196 raft_consensus.cc:515] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:58.296046 14303 leader_election.cc:304] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:58.299873 14303 leader_election.cc:304] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:58.300462 17541 consensus_queue.cc:1059] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:58.302711 17541 raft_consensus.cc:3055] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:58.303066 17541 raft_consensus.cc:740] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:58.303987 17541 consensus_queue.cc:260] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:58.305320 17541 raft_consensus.cc:3060] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:58.301072 17455 consensus_queue.cc:1048] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 12:10:58.301725 17196 leader_election.cc:290] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:58.288646 17554 raft_consensus.cc:697] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 9 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:10:58.306855 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:58.309252 14331 raft_consensus.cc:2468] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 10.
I20260709 12:10:58.310669 14303 leader_election.cc:304] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:58.299646 17404 raft_consensus.cc:2749] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:58.316923 14303 leader_election.cc:304] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:58.318869 14303 leader_election.cc:304] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:58.311305 17516 consensus_queue.cc:1059] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 12:10:58.320348 17534 leader_election.cc:290] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:58.295280 17521 consensus_queue.cc:1059] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.017s
I20260709 12:10:58.324572 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:10:58.325122 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:58.326125 14331 raft_consensus.cc:3060] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:58.326332 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:58.326676 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:58.308207 17447 leader_election.cc:290] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:58.295049 17403 raft_consensus.cc:515] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:58.329171 14303 leader_election.cc:304] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:58.334707 17278 leader_election.cc:290] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:58.345219 17516 raft_consensus.cc:2749] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:58.350093 17515 raft_consensus.cc:697] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 8 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:10:58.351830 17515 consensus_queue.cc:237] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:58.353991 14908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:10:58.354417 14258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41764 (request call id 2386) took 1113 ms. Trace:
I20260709 12:10:58.354856 14258 rpcz_store.cc:276] 0709 12:10:57.241103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:57.310325 (+ 69222us) service_pool.cc:224] Handling call
0709 12:10:57.310632 (+   307us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:57.493860 (+183228us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:58.354071 (+860211us) spinlock_profiling.cc:243] Waited 182 ms on lock 0x7b5400221fd4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:10:58.354343 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":419606784}
I20260709 12:10:58.356906 14264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41764 (request call id 2368) took 1278 ms. Trace:
I20260709 12:10:58.357895 14908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
W20260709 12:10:58.356712 14154 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 493575us
I20260709 12:10:58.359853 14154 leader_election.cc:400] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 election: Vote denied by peer 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341) with higher term. Message: Invalid argument: T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 5. Current term is 6.
I20260709 12:10:58.360288 14154 leader_election.cc:403] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:10:58.360373 17511 raft_consensus.cc:3055] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:58.361057 17511 raft_consensus.cc:740] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:58.362763 17454 raft_consensus.cc:2749] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341) with higher term. Message: Invalid argument: T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 5. Current term is 6.
I20260709 12:10:58.364066 14908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:10:58.366046 14337 raft_consensus.cc:1275] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 12:10:58.366444 14184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56046 (request call id 2059) took 1043 ms. Trace:
I20260709 12:10:58.366899 14184 rpcz_store.cc:276] 0709 12:10:57.322917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:57.478598 (+155681us) service_pool.cc:224] Handling call
0709 12:10:58.366226 (+887628us) spinlock_profiling.cc:243] Waited 691 ms on lock 0x7b540038c7d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:10:58.366375 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1589069568}
I20260709 12:10:58.367532 14908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:58.336221 17403 leader_election.cc:290] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:58.337574 14335 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca"
dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
mode: GRACEFUL
new_leader_uuid: "885067a0d31741bfb5c9935788e315bf"
 from {username='slave'} at 127.0.0.1:50896
I20260709 12:10:58.374966 14335 raft_consensus.cc:606] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 8 LEADER]: Received request to transfer leadership to TS 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:58.375016 17529 raft_consensus.cc:3055] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:58.375706 17529 raft_consensus.cc:740] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:58.323334 17034 raft_consensus.cc:2749] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:58.375945 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:58.377869 12986 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
W20260709 12:10:58.378134 14305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:58.336141 14186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56046 (request call id 2051) took 1017 ms. Trace:
I20260709 12:10:58.379210 14186 rpcz_store.cc:276] 0709 12:10:57.319019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:57.319139 (+   120us) service_pool.cc:224] Handling call
0709 12:10:58.335912 (+1016773us) spinlock_profiling.cc:243] Waited 216 ms on lock 0x7b540028a5d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:10:58.336061 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":496743296}
I20260709 12:10:58.373214 14905 raft_consensus.cc:1275] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:10:58.384089 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:58.317013 17382 leader_election.cc:290] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:10:58.368456 17557 log.cc:927] Time spent T 00000000000000000000000000000000 P d07070be2c074f4cb9ad35f1580c4ef7: Append to log took a long time: real 0.070s	user 0.002s	sys 0.000s
I20260709 12:10:58.321343 17391 raft_consensus.cc:2749] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:58.376307 14910 raft_consensus.cc:1240] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:58.385953 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:58.386677 14331 raft_consensus.cc:2468] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 4.
I20260709 12:10:58.357323 14264 rpcz_store.cc:276] 0709 12:10:57.078679 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:57.078961 (+   282us) service_pool.cc:224] Handling call
0709 12:10:57.079350 (+   389us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:57.151027 (+ 71677us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:10:57.311439 (+160412us) log.cc:844] Serialized 14 byte log entry
0709 12:10:57.390550 (+ 79111us) log.cc:844] Serialized 14 byte log entry
0709 12:10:57.574226 (+183676us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:57.574290 (+    64us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:57.574353 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:58.356651 (+782298us) spinlock_profiling.cc:243] Waited 71.4 ms on lock 0x7b5400212354. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:10:58.356705 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:58.356843 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17469,"prepare.queue_time_us":55029,"prepare.run_cpu_time_us":86,"prepare.run_wall_time_us":3818,"raft.queue_time_us":52331,"raft.run_cpu_time_us":249,"raft.run_wall_time_us":2179,"spinlock_wait_cycles":164264192,"thread_start_us":377004,"threads_started":3,"wal-append.queue_time_us":127989}
I20260709 12:10:58.390057 17278 raft_consensus.cc:493] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:58.390661 14187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56046 (request call id 2044) took 3257 ms. Trace:
I20260709 12:10:58.390815 17410 leader_election.cc:290] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:58.391127 17525 raft_consensus.cc:697] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 6 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:10:58.440433 14183 raft_consensus.cc:1240] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 9 LEADER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 8. Current term is 9. Ops: []
W20260709 12:10:58.440973 14305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:58.392921 17408 raft_consensus.cc:2749] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:58.394133 17325 raft_consensus.cc:493] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:58.395735 17105 raft_consensus.cc:2749] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:58.445752 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:58.413215 17328 leader_election.cc:290] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:58.440007 17313 leader_election.cc:290] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 8 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:58.450278 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:10:58.453089 14183 raft_consensus.cc:1275] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:10:58.439416 14187 rpcz_store.cc:276] 0709 12:10:55.133520 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:55.143017 (+  9497us) service_pool.cc:224] Handling call
0709 12:10:55.144358 (+  1341us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:57.620145 (+2475787us) spinlock_profiling.cc:243] Waited 3.64 ms on lock 0x7b18003c9280. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f212cf16ab1 00007f212cf23281 00007f2126ce34bc 00007f212403148b 00007f212ce8b9a9 00007f212404d69b 00007f212404b93f 00007f212404b455 00007f2127133060 00007f2127133bfb 00007f212713e64b
0709 12:10:57.620285 (+   140us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:57.620310 (+    25us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:57.695284 (+ 74974us) log.cc:844] Serialized 52 byte log entry
0709 12:10:57.940866 (+245582us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:57.954426 (+ 13560us) log.cc:844] Serialized 14 byte log entry
0709 12:10:58.390078 (+435652us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:58.390188 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:58.390234 (+    46us) raft_consensus.cc:1685] finished
0709 12:10:58.390366 (+   132us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:58.390534 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":462238,"prepare.queue_time_us":28743,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":2879,"raft.queue_time_us":637871,"raft.run_cpu_time_us":376,"raft.run_wall_time_us":37149,"spinlock_wait_cycles":8373632,"thread_start_us":381644,"threads_started":2,"wal-append.queue_time_us":277920}
I20260709 12:10:58.452246 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:58.402210 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:58.403087 16750 raft_consensus.cc:3055] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:58.396214 14261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41764 (request call id 2384) took 1155 ms. Trace:
I20260709 12:10:58.324247 17196 raft_consensus.cc:2749] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:58.366458 14337 pending_rounds.cc:85] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c: Aborting all ops after (but not including) 7
I20260709 12:10:58.456290 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:58.458370 14337 pending_rounds.cc:107] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 12:10:58.407338 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:58.458617 14187 raft_consensus.cc:2468] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 6.
I20260709 12:10:58.459323 14339 raft_consensus.cc:2410] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for term 9 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 3.
I20260709 12:10:58.408120 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:58.395099 17554 consensus_queue.cc:237] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:58.461719 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:58.409883 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:10:58.413771 14911 raft_consensus.cc:2393] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 8: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
I20260709 12:10:58.413929 14186 raft_consensus.cc:1240] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:58.386299 12986 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:10:58.437536 14908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
W20260709 12:10:58.437273 14330 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50856 (request call id 1912) took 2192 ms (client timeout 1521 ms). Trace:
I20260709 12:10:58.462455 14907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:58.444773 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:10:58.441592 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:58.443555 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
W20260709 12:10:58.463557 14330 rpcz_store.cc:269] 0709 12:10:56.217566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:56.217725 (+   159us) service_pool.cc:224] Handling call
0709 12:10:58.404004 (+2186279us) spinlock_profiling.cc:243] Waited 287 ms on lock 0x7b540023b254. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:10:58.409499 (+  5495us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":660642560}
I20260709 12:10:58.464340 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:58.465608 14907 raft_consensus.cc:2468] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 8.
I20260709 12:10:58.455619 14261 rpcz_store.cc:276] 0709 12:10:57.240584 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:57.309794 (+ 69210us) service_pool.cc:224] Handling call
0709 12:10:57.310059 (+   265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:57.404962 (+ 94903us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:57.404999 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:57.405046 (+    47us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:57.405080 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:58.395969 (+990889us) spinlock_profiling.cc:243] Waited 94.6 ms on lock 0x7b54001b2bd4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:10:58.396018 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:58.396148 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":217668480}
I20260709 12:10:58.467691 14258 raft_consensus.cc:1240] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:58.468586 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:58.469367 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:58.469698 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:58.456583 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:10:58.457183 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:58.472172 14181 raft_consensus.cc:2393] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 5: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:10:58.459602 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:58.409818 14336 raft_consensus.cc:1240] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:58.458676 14337 raft_consensus.cc:2889] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:58.462977 14183 raft_consensus.cc:2393] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 11: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
W20260709 12:10:58.465788 14304 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:58.395994 17319 raft_consensus.cc:2749] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:10:58.451861 17382 raft_consensus.cc:493] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:58.469411 14260 raft_consensus.cc:2393] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 7: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:10:58.470186 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:58.457788 16750 raft_consensus.cc:740] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:10:58.482116 17382 raft_consensus.cc:515] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:58.482637 17513 raft_consensus.cc:493] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:58.483295 16750 consensus_queue.cc:260] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:58.484027 17513 raft_consensus.cc:515] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:58.484833 17382 leader_election.cc:290] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:58.469410 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:58.486078 14262 raft_consensus.cc:2468] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 7.
I20260709 12:10:58.470844 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:58.415647 17335 consensus_queue.cc:1059] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 12:10:58.469411 17391 raft_consensus.cc:493] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:58.494685 17391 raft_consensus.cc:515] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:58.495077 17513 leader_election.cc:290] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:58.496212 16750 raft_consensus.cc:3060] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:58.496847 17488 log.cc:927] Time spent T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 1.704s	user 0.013s	sys 0.000s
I20260709 12:10:58.497184 17391 leader_election.cc:290] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:58.498553 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:58.498440 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:58.499358 14904 raft_consensus.cc:2468] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 8.
I20260709 12:10:58.501461 14303 leader_election.cc:304] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:10:58.506433 17525 consensus_queue.cc:237] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:58.473220 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:10:58.474715 14265 raft_consensus.cc:1275] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:58.478889 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:58.475147 17368 leader_election.cc:290] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 8 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:58.510478 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:58.454223 17325 raft_consensus.cc:515] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:58.511725 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:58.512873 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:58.479689 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:58.480535 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:58.482585 14186 raft_consensus.cc:1240] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 7 LEADER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:10:58.513624 14331 raft_consensus.cc:2410] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 12:10:58.483198 17551 log.cc:927] Time spent T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.172s	user 0.001s	sys 0.000s
I20260709 12:10:58.534291 14332 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50858 (request call id 1576) took 1876 ms. Trace:
I20260709 12:10:58.461800 17338 raft_consensus.cc:493] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
W20260709 12:10:58.490332 14305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:58.535830 14305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:58.535972 14181 raft_consensus.cc:1275] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:10:58.491050 14187 raft_consensus.cc:1240] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:58.491178 14183 raft_consensus.cc:1240] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 10 LEADER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 9. Current term is 10. Ops: []
I20260709 12:10:58.416854 17500 raft_consensus.cc:493] T f4739bc22bfe44fcba807da02d9351b6 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:58.534808 14332 rpcz_store.cc:276] 0709 12:10:56.658372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:56.668944 (+ 10572us) service_pool.cc:224] Handling call
0709 12:10:56.669293 (+   349us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:56.678340 (+  9047us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:10:56.678376 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:58.286980 (+1608604us) spinlock_profiling.cc:243] Waited 4.01 ms on lock 0x7b2c0005b888. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2125a34a11 00007f2125a44372 00007f2127176a01 00007f212713b43a 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2
0709 12:10:58.293030 (+  6050us) log.cc:844] Serialized 26 byte log entry
0709 12:10:58.461614 (+168584us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:58.461653 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:58.461923 (+   270us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:58.514350 (+ 52427us) raft_consensus.cc:1685] finished
0709 12:10:58.514369 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:58.534211 (+ 19842us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12403,"raft.queue_time_us":15455,"raft.run_cpu_time_us":202,"raft.run_wall_time_us":12884,"spinlock_wait_cycles":9231616,"thread_start_us":155350,"threads_started":1,"wal-append.queue_time_us":201131}
I20260709 12:10:58.507215 14336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50858 (request call id 1581) took 1846 ms. Trace:
I20260709 12:10:58.376988 17529 consensus_queue.cc:260] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:58.470189 14257 raft_consensus.cc:2468] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 9.
I20260709 12:10:58.515113 14334 raft_consensus.cc:3060] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:58.540697 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:58.541026 14336 rpcz_store.cc:276] 0709 12:10:56.660592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:56.660735 (+   143us) service_pool.cc:224] Handling call
0709 12:10:58.409598 (+1748863us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:58.472813 (+ 63215us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:58.506982 (+ 34169us) spinlock_profiling.cc:243] Waited 1.75 s on lock 0x7b540023b250. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713a8ad 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:10:58.507135 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4021313792}
I20260709 12:10:58.456073 17278 raft_consensus.cc:515] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:58.565600 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:58.576537 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:58.544453 17523 raft_consensus.cc:2804] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:10:58.589638 14876 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:58.591317 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:10:58.592336 14259 raft_consensus.cc:2393] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 8: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
W20260709 12:10:58.542981 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 278430us
I20260709 12:10:58.570768 14332 raft_consensus.cc:3060] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:58.544785 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:58.513664 17325 leader_election.cc:290] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:58.598526 14264 raft_consensus.cc:1240] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 12:10:58.583288 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:58.596721 14877 leader_election.cc:304] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:58.555508 17347 consensus_queue.cc:1059] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 12:10:58.559485 17385 raft_consensus.cc:3055] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:58.657564 14332 raft_consensus.cc:2468] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 5.
W20260709 12:10:58.655824 17551 log.cc:927] Time spent T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
W20260709 12:10:58.666317 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 69723.5us
W20260709 12:10:58.730074 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 62917.4us
I20260709 12:10:58.731297 14877 leader_election.cc:304] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:58.537398 17437 raft_consensus.cc:515] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:10:58.738109 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 353446us
I20260709 12:10:58.558004 17338 raft_consensus.cc:515] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:58.675709 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:58.735857 14334 raft_consensus.cc:2468] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 5.
I20260709 12:10:58.739028 14229 leader_election.cc:304] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:58.703810 14337 raft_consensus.cc:2468] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 8.
I20260709 12:10:58.597206 17523 raft_consensus.cc:493] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:58.744235 17413 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.868s	user 0.000s	sys 0.041s
I20260709 12:10:58.728825 17529 raft_consensus.cc:3060] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:58.746500 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:58.558459 17500 raft_consensus.cc:515] T f4739bc22bfe44fcba807da02d9351b6 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:58.746879 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:58.727885 17325 raft_consensus.cc:493] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:10:58.778144 17325 raft_consensus.cc:515] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:58.747077 17410 raft_consensus.cc:493] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:58.782990 17410 raft_consensus.cc:515] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:58.746645 17519 raft_consensus.cc:493] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
W20260709 12:10:58.737214 17551 log.cc:927] Time spent T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:10:58.787184 17519 raft_consensus.cc:515] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:58.746459 17534 raft_consensus.cc:2749] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:10:58.743690 17313 raft_consensus.cc:493] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:58.794306 17313 raft_consensus.cc:515] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:58.746789 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:58.749433 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:58.803876 14331 raft_consensus.cc:3060] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:58.804301 14337 raft_consensus.cc:2393] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 7: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:10:58.753618 14334 raft_consensus.cc:2468] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 9.
I20260709 12:10:58.755113 14332 raft_consensus.cc:2410] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:10:58.674928 17344 raft_consensus.cc:493] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:58.761364 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:59.299399 14181 raft_consensus.cc:3060] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:10:59.299463 17579 raft_consensus.cc:493] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:59.301245 17579 raft_consensus.cc:515] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:59.304054 14338 raft_consensus.cc:1275] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 4. (term mismatch)
I20260709 12:10:59.304461 14338 pending_rounds.cc:85] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c: Aborting all ops after (but not including) 3
I20260709 12:10:59.304664 14338 pending_rounds.cc:107] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c: Aborting uncommitted NO_OP operation due to leader change: 8.4
I20260709 12:10:59.304869 14338 raft_consensus.cc:2889] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:58.752787 14229 leader_election.cc:304] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
W20260709 12:10:58.926427 17565 log.cc:927] Time spent T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:10:58.959087 17569 raft_consensus.cc:493] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:59.308413 17569 raft_consensus.cc:515] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:58.995409 17566 raft_consensus.cc:493] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:59.031222 17574 consensus_queue.cc:1048] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:59.310428 17566 raft_consensus.cc:515] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:59.311295 17574 raft_consensus.cc:493] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:59.311815 17574 raft_consensus.cc:515] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:59.313256 17566 leader_election.cc:290] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:59.091246 17571 raft_consensus.cc:493] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:59.314038 14338 raft_consensus.cc:1275] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:10:59.315050 17569 leader_election.cc:290] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:59.315626 17569 raft_consensus.cc:2749] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:10:59.316263 17569 raft_consensus.cc:493] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:59.316684 17569 raft_consensus.cc:515] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:59.094343 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:59.317951 14338 raft_consensus.cc:1275] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 6. (term mismatch)
I20260709 12:10:59.112082 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:59.322068 17569 leader_election.cc:290] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:59.322418 14182 raft_consensus.cc:2393] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 5: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:10:59.323544 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:59.324746 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:59.325501 14182 raft_consensus.cc:2393] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 8: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:10:59.115999 14155 leader_election.cc:304] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:59.314072 17571 raft_consensus.cc:515] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:10:59.326285 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 210353us
W20260709 12:10:59.327105 14230 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.005s	sys 0.009s
W20260709 12:10:59.327452 14230 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.535s	user 0.005s	sys 0.009s
I20260709 12:10:59.327798 17571 leader_election.cc:290] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:58.808380 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:10:59.029788 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 98326.4us
I20260709 12:10:59.106177 14303 leader_election.cc:304] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
W20260709 12:10:59.428435 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 322334us
I20260709 12:10:59.431205 17529 consensus_queue.cc:1048] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:58.894464 14331 raft_consensus.cc:2468] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 8.
I20260709 12:10:59.435648 14331 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50858 (request call id 1621) took 1019 ms. Trace:
I20260709 12:10:59.436012 14331 rpcz_store.cc:276] 0709 12:10:58.416447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:58.694923 (+278476us) service_pool.cc:224] Handling call
0709 12:10:59.435569 (+740646us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:58.789556 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:59.476815 14333 raft_consensus.cc:2468] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 9.
I20260709 12:10:59.477361 14333 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50858 (request call id 1618) took 1062 ms. Trace:
I20260709 12:10:59.477658 14333 rpcz_store.cc:276] 0709 12:10:58.414512 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:58.789146 (+374634us) service_pool.cc:224] Handling call
0709 12:10:59.477297 (+688151us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:58.808661 14332 raft_consensus.cc:1240] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:59.481009 14332 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50858 (request call id 1610) took 1073 ms. Trace:
I20260709 12:10:59.106263 14339 raft_consensus.cc:1275] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 3. (term mismatch)
I20260709 12:10:59.482811 14339 pending_rounds.cc:85] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c: Aborting all ops after (but not including) 2
I20260709 12:10:59.483070 14339 pending_rounds.cc:107] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:10:58.824059 14337 raft_consensus.cc:1240] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 9. Current term is 10. Ops: []
W20260709 12:10:59.029310 14876 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:58.955328 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 207927us
I20260709 12:10:59.109490 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:58.931541 16750 raft_consensus.cc:3055] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:59.495954 16750 raft_consensus.cc:740] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:10:58.759536 14903 raft_consensus.cc:2368] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for earlier term 11. Current term is 12.
I20260709 12:10:58.828341 17325 leader_election.cc:290] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:58.932238 17196 consensus_queue.cc:1059] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:58.929409 17338 leader_election.cc:290] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:58.664357 17385 raft_consensus.cc:740] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:10:58.951237 17410 leader_election.cc:290] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:58.737038 17434 consensus_queue.cc:1048] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 12:10:58.775851 17278 leader_election.cc:290] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:58.749961 17328 raft_consensus.cc:493] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:58.774178 17382 consensus_queue.cc:1059] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:59.517330 17328 raft_consensus.cc:515] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:59.518092 17382 raft_consensus.cc:3055] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:10:59.518504 17382 raft_consensus.cc:740] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:10:59.519310 17382 consensus_queue.cc:260] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:59.519876 17328 leader_election.cc:290] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:59.520545 17382 raft_consensus.cc:3060] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:58.749992 17408 raft_consensus.cc:493] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:59.530828 17408 raft_consensus.cc:515] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } }
I20260709 12:10:58.744364 17455 consensus_queue.cc:1048] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 12:10:58.776551 17467 raft_consensus.cc:2804] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:59.536465 17467 raft_consensus.cc:697] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 4 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:10:59.118335 17499 raft_consensus.cc:493] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:59.539047 17499 raft_consensus.cc:515] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:58.761034 17511 consensus_queue.cc:260] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:58.757143 17513 raft_consensus.cc:493] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:59.071975 17519 leader_election.cc:290] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:58.748802 17523 raft_consensus.cc:3060] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:59.115890 17525 consensus_queue.cc:1059] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:59.552523 17525 raft_consensus.cc:3055] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:59.552937 17525 raft_consensus.cc:740] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
W20260709 12:10:58.938839 17541 consensus_meta.cc:287] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.633s	user 0.011s	sys 0.003s
I20260709 12:10:58.797535 17313 leader_election.cc:290] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:59.562178 14336 raft_consensus.cc:2410] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 12:10:59.563961 14336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50858 (request call id 1614) took 1152 ms. Trace:
I20260709 12:10:59.564301 14336 rpcz_store.cc:276] 0709 12:10:58.411193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:58.576208 (+165015us) service_pool.cc:224] Handling call
0709 12:10:59.563744 (+987536us) spinlock_profiling.cc:243] Waited 984 ms on lock 0x7b5400145d54. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:10:59.563893 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2263625984}
I20260709 12:10:58.991886 17335 raft_consensus.cc:493] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:10:59.566596 17335 raft_consensus.cc:515] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:58.814206 17344 raft_consensus.cc:515] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:10:58.750349 17413 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.874s	user 0.000s	sys 0.041s
I20260709 12:10:58.931855 17417 consensus_queue.cc:1048] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:58.758872 17437 leader_election.cc:290] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 12 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:59.114506 17439 consensus_queue.cc:1059] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:10:58.768769 17558 log.cc:927] Time spent T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.311s	user 0.001s	sys 0.000s
I20260709 12:10:58.734588 17503 raft_consensus.cc:2749] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:10:58.774955 17559 consensus_queue.cc:1048] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 12:10:59.187686 14189 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56652 (request call id 744) took 1357 ms. Trace:
I20260709 12:10:59.581120 14189 rpcz_store.cc:276] 0709 12:10:57.830437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:57.928909 (+ 98472us) service_pool.cc:224] Handling call
0709 12:10:58.179743 (+250834us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:58.198998 (+ 19255us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:59.187383 (+988385us) spinlock_profiling.cc:243] Waited 250 ms on lock 0x7b54003e8350. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713a8ad 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:10:59.187591 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":576063360}
I20260709 12:10:59.220665 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:59.226517 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:59.235045 17577 raft_consensus.cc:493] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:59.239799 14305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:59.245534 17578 raft_consensus.cc:493] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:10:59.318344 14184 raft_consensus.cc:2410] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:10:59.098151 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:59.325035 17105 raft_consensus.cc:493] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:59.328614 17574 leader_election.cc:290] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:59.330077 17367 raft_consensus.cc:2804] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:59.330523 17571 raft_consensus.cc:493] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:10:59.595014 17385 consensus_queue.cc:260] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:59.595304 17367 raft_consensus.cc:697] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 5 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:10:59.330597 17579 leader_election.cc:290] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:10:59.335171 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 582403us
I20260709 12:10:59.336273 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:59.331224 14334 raft_consensus.cc:3055] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:59.336984 14338 pending_rounds.cc:85] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c: Aborting all ops after (but not including) 5
I20260709 12:10:59.347476 14181 raft_consensus.cc:2468] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 12.
I20260709 12:10:59.353888 17501 raft_consensus.cc:493] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:59.356974 17582 raft_consensus.cc:493] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:59.360114 17580 raft_consensus.cc:493] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:59.371544 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:59.377264 14330 raft_consensus.cc:1275] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:59.600358 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:59.396855 17583 consensus_queue.cc:1059] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:59.399641 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:59.409163 14304 leader_election.cc:304] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:59.437562 14331 raft_consensus.cc:1275] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:10:59.601909 14876 leader_election.cc:304] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:59.441493 14303 leader_election.cc:304] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:10:59.448956 14188 raft_consensus.cc:1240] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 9. Current term is 10. Ops: []
I20260709 12:10:59.452554 17500 leader_election.cc:290] T f4739bc22bfe44fcba807da02d9351b6 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:59.604882 17501 raft_consensus.cc:515] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:59.606027 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:59.606660 14184 raft_consensus.cc:2468] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 8.
I20260709 12:10:59.607193 17501 leader_election.cc:290] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:59.474273 14085 catalog_manager.cc:5697] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 3 to 5, leader changed from 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) to 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130). New cstate: current_term: 5 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:10:59.607769 14184 raft_consensus.cc:1240] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:59.608915 14184 raft_consensus.cc:1240] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:59.608337 14085 catalog_manager.cc:5697] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:59.610056 14187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56044 (request call id 2359) took 1068 ms. Trace:
I20260709 12:10:59.610807 17580 raft_consensus.cc:515] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:59.610598 14085 catalog_manager.cc:5697] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:59.613004 17580 leader_election.cc:290] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:59.483292 14339 raft_consensus.cc:2889] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:59.613919 14339 pending_rounds.cc:107] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 12:10:59.613507 17582 raft_consensus.cc:515] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:59.614195 14339 raft_consensus.cc:2889] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:10:59.614728 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 173337us
I20260709 12:10:59.610415 14187 rpcz_store.cc:276] 0709 12:10:58.541944 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:59.399347 (+857403us) service_pool.cc:224] Handling call
0709 12:10:59.609990 (+210643us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:59.614988 14339 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50858 (request call id 1613) took 1204 ms. Trace:
I20260709 12:10:59.485394 14337 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50858 (request call id 1612) took 1074 ms. Trace:
I20260709 12:10:59.481349 14332 rpcz_store.cc:276] 0709 12:10:58.407929 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:58.807932 (+400003us) service_pool.cc:224] Handling call
0709 12:10:58.808460 (+   528us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:59.480703 (+672243us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:59.480936 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":39424}
I20260709 12:10:59.504266 17529 raft_consensus.cc:3055] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:59.505592 14903 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53194 (request call id 784) took 1305 ms. Trace:
I20260709 12:10:59.505807 17368 consensus_queue.cc:1059] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:59.114677 14154 leader_election.cc:304] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:59.630936 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:10:59.631409 14154 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 516779us
I20260709 12:10:59.632632 14182 raft_consensus.cc:1275] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:59.634922 17566 raft_consensus.cc:2804] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:10:59.635576 17566 raft_consensus.cc:697] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 12 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:10:59.511631 16750 consensus_queue.cc:260] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:59.538304 17328 raft_consensus.cc:493] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:59.537408 17467 consensus_queue.cc:237] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:59.636559 17566 consensus_queue.cc:237] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:59.548668 17513 raft_consensus.cc:515] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:10:59.554244 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 53535.2us
I20260709 12:10:59.553797 17525 consensus_queue.cc:260] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:59.638700 17525 raft_consensus.cc:3060] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:59.639120 17513 leader_election.cc:290] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:59.640182 17559 consensus_queue.cc:1048] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:59.641358 17503 consensus_queue.cc:1048] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:59.642458 17582 leader_election.cc:290] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:59.642993 17503 consensus_queue.cc:1048] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:10:59.576462 17447 raft_consensus.cc:3055] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:59.644862 17447 raft_consensus.cc:740] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:10:59.645687 17447 consensus_queue.cc:260] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:59.578380 17408 leader_election.cc:290] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:59.590622 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:59.649659 14877 leader_election.cc:304] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:59.592093 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:59.652704 14190 raft_consensus.cc:1240] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 12:10:59.593593 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:59.594260 17577 raft_consensus.cc:515] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:59.595335 17571 raft_consensus.cc:515] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:59.328657 14155 leader_election.cc:304] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
W20260709 12:10:59.655769 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 327165us
I20260709 12:10:59.656466 14155 leader_election.cc:304] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:59.598086 14334 raft_consensus.cc:740] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:59.597172 14338 pending_rounds.cc:107] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c: Aborting uncommitted NO_OP operation due to leader change: 7.6
I20260709 12:10:59.658595 14338 raft_consensus.cc:2889] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:59.659271 14338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50858 (request call id 1631) took 1238 ms. Trace:
W20260709 12:10:59.601938 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 192856us
I20260709 12:10:59.484351 17585 raft_consensus.cc:2749] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:59.616345 14187 raft_consensus.cc:1275] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:10:59.661329 14304 leader_election.cc:304] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:10:59.615859 14337 rpcz_store.cc:276] 0709 12:10:58.410785 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:58.809832 (+399047us) service_pool.cc:224] Handling call
0709 12:10:58.823818 (+ 13986us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:59.485132 (+661314us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:59.485337 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:59.617617 14184 raft_consensus.cc:1240] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:59.615680 14339 rpcz_store.cc:276] 0709 12:10:58.411000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:59.105539 (+694539us) service_pool.cc:224] Handling call
0709 12:10:59.105889 (+   350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:59.614738 (+508849us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:59.614922 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:59.599748 14229 leader_election.cc:304] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:59.664835 14304 leader_election.cc:304] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:59.622208 17529 raft_consensus.cc:740] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:10:59.625881 17584 raft_consensus.cc:2804] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:59.622373 14903 rpcz_store.cc:276] 0709 12:10:58.199961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:58.207059 (+  7098us) service_pool.cc:224] Handling call
0709 12:10:59.505266 (+1298207us) spinlock_profiling.cc:243] Waited 506 ms on lock 0x7b540047a254. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:10:59.505446 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1164531456}
I20260709 12:10:59.627067 17368 consensus_queue.cc:1243] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer 885067a0d31741bfb5c9935788e315bf log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:10:59.622113 17580 raft_consensus.cc:493] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:59.628422 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:59.596948 17578 raft_consensus.cc:515] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:59.596617 17367 consensus_queue.cc:237] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:59.597119 17105 raft_consensus.cc:515] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:59.629797 17344 leader_election.cc:290] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:59.630045 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:10:59.673660 14188 raft_consensus.cc:3060] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:59.622961 17574 raft_consensus.cc:2749] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:10:59.546866 17511 raft_consensus.cc:3060] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:59.556651 17499 leader_election.cc:290] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:59.646893 14185 raft_consensus.cc:2410] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for term 9 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 12:10:59.594885 17335 leader_election.cc:290] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:10:59.615507 14303 leader_election.cc:304] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:59.597234 17509 consensus_queue.cc:1059] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 12:10:59.659579 14338 rpcz_store.cc:276] 0709 12:10:58.421256 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:59.315087 (+893831us) service_pool.cc:224] Handling call
0709 12:10:59.316357 (+  1270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:59.659049 (+342692us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:59.659215 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:59.665967 14155 leader_election.cc:304] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:10:59.657891 14334 consensus_queue.cc:260] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:59.668191 14304 leader_election.cc:304] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
W20260709 12:10:59.668305 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 68664.8us
I20260709 12:10:59.624475 17385 raft_consensus.cc:3060] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:59.667100 17408 raft_consensus.cc:2804] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:59.669806 17582 raft_consensus.cc:3060] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:59.711081 14258 raft_consensus.cc:1275] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:10:59.648859 17501 raft_consensus.cc:2749] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:10:59.683179 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:10:59.693295 17447 raft_consensus.cc:3060] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:59.687014 14257 raft_consensus.cc:1240] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:59.687687 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:59.697315 14261 raft_consensus.cc:1240] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:59.698920 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:59.663826 17347 consensus_queue.cc:1059] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 12:10:59.670364 17577 leader_election.cc:290] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:59.655345 17571 leader_election.cc:290] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:59.700766 17578 leader_election.cc:290] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:10:59.673035 17580 raft_consensus.cc:515] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:59.663206 17541 raft_consensus.cc:493] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:59.666312 17500 raft_consensus.cc:2749] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:59.761430 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:59.667311 17584 raft_consensus.cc:493] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:59.703471 14086 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60436 (request call id 285) took 10579 ms. Trace:
I20260709 12:10:59.711180 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:59.671051 17338 raft_consensus.cc:2804] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:59.708196 14229 leader_election.cc:304] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
W20260709 12:10:59.711971 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 46099.2us
I20260709 12:10:59.676646 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:59.716342 14330 raft_consensus.cc:1275] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 12:10:59.718317 17278 raft_consensus.cc:493] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:59.767088 14155 leader_election.cc:304] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:59.769855 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:59.771657 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:59.772496 14339 raft_consensus.cc:2393] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 10: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:10:59.744274 17583 raft_consensus.cc:2749] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:59.686107 14259 raft_consensus.cc:1240] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 7. Current term is 8. Ops: [7.7-7.7]
W20260709 12:10:59.721123 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 105682us
I20260709 12:10:59.773562 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:59.781677 14303 leader_election.cc:304] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:59.696866 17519 raft_consensus.cc:493] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:59.692770 17417 raft_consensus.cc:2804] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:59.742606 14262 raft_consensus.cc:2410] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:10:59.662592 17328 raft_consensus.cc:515] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:59.711555 17574 raft_consensus.cc:2749] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:10:59.698064 17588 raft_consensus.cc:2804] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:59.694465 17579 consensus_queue.cc:1048] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 12:10:59.750818 14265 raft_consensus.cc:2468] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 5.
I20260709 12:10:59.764243 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:59.710927 14334 raft_consensus.cc:3060] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:59.718977 17536 raft_consensus.cc:2804] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:59.774693 17437 raft_consensus.cc:493] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:59.703738 17455 consensus_queue.cc:1048] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 12:10:59.767027 14256 raft_consensus.cc:2468] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 7.
W20260709 12:10:59.774462 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 66371us
I20260709 12:10:59.719516 14332 raft_consensus.cc:3060] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:10:59.777827 14188 raft_consensus.cc:2468] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 7.
I20260709 12:10:59.782146 14339 raft_consensus.cc:2468] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 7.
I20260709 12:10:59.766228 17338 raft_consensus.cc:493] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:59.751787 17408 raft_consensus.cc:697] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 5 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:10:59.788739 14155 leader_election.cc:304] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:59.763808 14086 rpcz_store.cc:276] 0709 12:10:49.123969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:49.124159 (+   190us) service_pool.cc:224] Handling call
0709 12:10:59.703377 (+10579218us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:58.185344 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:58.185914 (+   570us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:58.185951 (+    37us) write_op.cc:435] Acquired schema lock
0709 12:10:58.185970 (+    19us) tablet.cc:662] Decoding operations
0709 12:10:58.204789 (+ 18819us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:58.204857 (+    68us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:58.204882 (+    25us) tablet.cc:685] Acquiring locks for 27 operations
0709 12:10:58.216011 (+ 11129us) tablet.cc:701] Row locks acquired
0709 12:10:58.216028 (+    17us) write_op.cc:260] PREPARE: finished
0709 12:10:58.216208 (+   180us) write_op.cc:270] Start()
0709 12:10:58.216349 (+   141us) write_op.cc:276] Timestamp: P: 1783599058216145 usec, L: 0
0709 12:10:58.216368 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 12:10:58.239412 (+ 23044us) log.cc:844] Serialized 10707 byte log entry
0709 12:10:58.928345 (+688933us) op_driver.cc:464] REPLICATION: finished
0709 12:10:59.030004 (+101659us) write_op.cc:301] APPLY: starting
0709 12:10:59.030242 (+   238us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:59.032374 (+  2132us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:59.032526 (+   152us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:59.038971 (+  6445us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:59.039333 (+   362us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=27
0709 12:10:59.039377 (+    44us) write_op.cc:312] APPLY: finished
0709 12:10:59.039935 (+   558us) log.cc:844] Serialized 182 byte log entry
0709 12:10:59.043459 (+  3524us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:59.043736 (+   277us) write_op.cc:454] Released schema lock
0709 12:10:59.043807 (+    71us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:59.044206 (+   399us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:59.044234 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1040,"reported_tablets":43,"child_traces":[["op",{"apply.queue_time_us":100612,"apply.run_cpu_time_us":8779,"apply.run_wall_time_us":14912,"num_ops":27,"prepare.queue_time_us":224975,"prepare.run_cpu_time_us":16311,"prepare.run_wall_time_us":84744,"raft.queue_time_us":454903,"raft.run_cpu_time_us":17558,"raft.run_wall_time_us":91790,"replication_time_us":711751,"thread_start_us":498869,"threads_started":4,"wal-append.queue_time_us":58362}]]}
I20260709 12:10:59.768011 17584 raft_consensus.cc:3060] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:59.766947 14330 pending_rounds.cc:85] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c: Aborting all ops after (but not including) 3
W20260709 12:10:59.833478 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 51885.6us
W20260709 12:10:59.826809 17576 log.cc:927] Time spent T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:10:59.779580 17503 consensus_queue.cc:1048] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.062s
I20260709 12:10:59.789695 17417 raft_consensus.cc:493] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:59.798768 17519 raft_consensus.cc:515] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:10:59.853720 14303 leader_election.cc:304] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:59.766399 17541 raft_consensus.cc:515] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:10:59.854756 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 66114.7us
I20260709 12:10:59.861375 14303 leader_election.cc:304] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:59.862073 14155 leader_election.cc:304] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:10:59.856292 14330 pending_rounds.cc:107] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 12:10:59.862905 14330 raft_consensus.cc:2889] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:59.838569 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:59.806684 17513 raft_consensus.cc:2804] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:10:59.826988 17591 log.cc:927] Time spent T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.124s	user 0.000s	sys 0.001s
I20260709 12:10:59.780315 17278 raft_consensus.cc:515] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:59.863397 14155 leader_election.cc:304] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:10:59.863912 14339 raft_consensus.cc:2393] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 10: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:10:59.857446 17402 raft_consensus.cc:2804] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:59.836802 17446 raft_consensus.cc:493] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:59.841849 17196 raft_consensus.cc:2749] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:59.877363 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:59.877826 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:59.890439 14256 raft_consensus.cc:2468] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 7.
I20260709 12:10:59.890658 14262 raft_consensus.cc:2468] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 11.
I20260709 12:10:59.887161 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:59.879724 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:59.892335 14339 raft_consensus.cc:2468] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 7.
I20260709 12:10:59.879444 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:59.860723 17417 raft_consensus.cc:3060] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:59.882438 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:59.837284 17588 raft_consensus.cc:697] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 4 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:10:59.977280 14333 raft_consensus.cc:2468] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 9.
I20260709 12:10:59.977952 17588 consensus_queue.cc:237] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:59.879769 14332 raft_consensus.cc:2468] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 12.
W20260709 12:10:59.982156 17592 log.cc:927] Time spent T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.208s	user 0.000s	sys 0.001s
I20260709 12:10:59.982376 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:59.983847 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:59.984758 14332 raft_consensus.cc:2393] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 8: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:10:59.806844 17501 consensus_queue.cc:1048] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.054s
I20260709 12:10:59.874083 14303 leader_election.cc:304] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:10:59.849454 17437 raft_consensus.cc:515] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:10:59.886386 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:59.851488 17574 raft_consensus.cc:493] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:59.991992 14330 raft_consensus.cc:2468] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 9.
I20260709 12:10:59.871583 14334 raft_consensus.cc:1275] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 12:11:00.000810 14334 pending_rounds.cc:85] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c: Aborting all ops after (but not including) 3
I20260709 12:11:00.001163 14334 pending_rounds.cc:107] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 12:11:00.001458 14334 raft_consensus.cc:2889] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:00.005170 14334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50858 (request call id 1633) took 1468 ms. Trace:
I20260709 12:10:59.806457 17500 consensus_queue.cc:1048] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.055s
I20260709 12:10:59.849664 17536 raft_consensus.cc:697] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 8 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:10:59.891705 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:10:59.873296 17439 raft_consensus.cc:2804] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:59.871783 14229 leader_election.cc:304] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:11:00.005650 14334 rpcz_store.cc:276] 0709 12:10:58.536839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:59.330675 (+793836us) service_pool.cc:224] Handling call
0709 12:10:59.331061 (+   386us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:00.004809 (+673748us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:00.005088 (+   279us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:11:00.006505 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 134808us
I20260709 12:10:59.852232 17338 raft_consensus.cc:3060] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:59.892513 14257 raft_consensus.cc:2468] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 7.
W20260709 12:10:59.939203 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:59.893005 14261 raft_consensus.cc:2468] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 10.
W20260709 12:10:59.938306 14875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:59.978423 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:59.841873 14903 raft_consensus.cc:1275] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 12:10:59.993808 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 119837us
I20260709 12:10:59.872465 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 9 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:00.008917 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:11:00.024251 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:59.866801 17513 raft_consensus.cc:493] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:00.054632 17513 raft_consensus.cc:3060] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:00.055878 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:00.058071 14908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:00.059469 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:59.893330 17446 raft_consensus.cc:515] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:00.057590 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:00.065308 14182 raft_consensus.cc:2393] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 7: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:11:00.027555 14332 raft_consensus.cc:2468] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 8.
I20260709 12:10:59.889714 17413 raft_consensus.cc:2749] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:11:00.079414 14875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:00.029381 14338 raft_consensus.cc:2410] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for term 9 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:11:00.031418 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:00.035331 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:11:00.090001 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 57494.8us
I20260709 12:11:00.036911 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:00.041726 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 9 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:00.042353 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:10:59.893712 17402 raft_consensus.cc:697] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 8 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:11:00.047195 17328 leader_election.cc:290] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:10:59.894105 17319 consensus_queue.cc:1048] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.154s
I20260709 12:11:00.047523 17434 raft_consensus.cc:3055] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:00.049077 17278 leader_election.cc:290] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:00.051215 17437 leader_election.cc:290] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:00.051977 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:10:59.893245 17447 consensus_queue.cc:1048] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.220s
I20260709 12:11:00.129899 14330 raft_consensus.cc:2468] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 6.
I20260709 12:11:00.130884 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:00.132148 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:00.053987 14303 leader_election.cc:304] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:00.035579 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:00.111029 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:11:00.133213 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 79326.6us
I20260709 12:11:00.023480 17439 raft_consensus.cc:493] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:10:59.881569 17382 consensus_queue.cc:1048] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.144s
I20260709 12:11:00.118069 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:00.136279 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:00.118366 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:00.118793 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:10:59.993381 17583 raft_consensus.cc:493] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:00.112185 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:00.117511 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:11:00.086181 17391 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
W20260709 12:11:00.066210 17589 log.cc:927] Time spent T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.283s	user 0.000s	sys 0.001s
I20260709 12:10:59.885888 17499 consensus_queue.cc:1059] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.201s
I20260709 12:11:00.068126 17585 raft_consensus.cc:2749] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:00.065330 17410 raft_consensus.cc:2804] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:00.128250 14908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:00.128700 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:00.090346 17579 raft_consensus.cc:2749] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:00.121361 17317 consensus_queue.cc:1059] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 12:11:00.134949 14303 leader_election.cc:304] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:00.113335 14339 raft_consensus.cc:2468] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 9.
I20260709 12:11:00.090294 17105 leader_election.cc:290] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:00.135810 17439 raft_consensus.cc:3060] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:59.962401 14176 tablet_service.cc:1558] Processing DeleteTablet for tablet f4739bc22bfe44fcba807da02d9351b6 with delete_type TABLET_DATA_TOMBSTONED (TS 885067a0d31741bfb5c9935788e315bf not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:59324
I20260709 12:11:00.141920 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:00.138902 14338 raft_consensus.cc:2468] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 5.
I20260709 12:11:00.122886 17434 raft_consensus.cc:740] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:11:00.146371 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:00.119036 17196 raft_consensus.cc:2749] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:00.175012 14908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:00.148857 14877 leader_election.cc:304] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:00.150148 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:00.150254 17402 consensus_queue.cc:237] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:00.157075 17413 raft_consensus.cc:493] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:11:00.155337 14230 leader_election.cc:304] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:11:00.155607 14189 raft_consensus.cc:2410] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for term 10 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 12:11:00.068523 17519 leader_election.cc:290] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:00.065586 17574 raft_consensus.cc:515] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:11:00.139739 17557 log.cc:927] Time spent T 00000000000000000000000000000000 P d07070be2c074f4cb9ad35f1580c4ef7: Append to log took a long time: real 0.145s	user 0.001s	sys 0.000s
I20260709 12:11:00.155771 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:00.158733 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:00.189378 14181 raft_consensus.cc:2393] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 9: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:11:00.161592 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:00.190033 14339 raft_consensus.cc:2468] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 9.
I20260709 12:11:00.166055 14303 leader_election.cc:304] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:00.122855 17367 consensus_queue.cc:1048] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 12:11:00.126333 17368 consensus_queue.cc:1048] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 12:11:00.171341 14330 raft_consensus.cc:2468] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 6.
I20260709 12:11:00.172567 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:00.177371 14304 leader_election.cc:304] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:11:00.176785 14188 raft_consensus.cc:2468] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 6.
I20260709 12:11:00.154558 17410 raft_consensus.cc:493] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:00.177649 14877 leader_election.cc:304] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:00.173971 17580 leader_election.cc:290] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:00.136572 17568 consensus_queue.cc:1048] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 12:11:00.142623 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:00.204844 14912 raft_consensus.cc:2468] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 6.
I20260709 12:11:00.142431 17437 consensus_queue.cc:1059] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 12:11:00.153316 17605 raft_consensus.cc:2749] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:00.209507 17196 raft_consensus.cc:2804] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:00.141695 17455 consensus_queue.cc:1059] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 12:11:00.210016 17196 raft_consensus.cc:493] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:11:00.210543 17196 raft_consensus.cc:3060] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:00.188681 14333 raft_consensus.cc:2468] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 8.
I20260709 12:11:00.211513 17437 raft_consensus.cc:3055] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:00.211823 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:00.151820 17583 raft_consensus.cc:515] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:00.194218 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:00.132675 17408 consensus_queue.cc:237] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:00.163513 17545 consensus_queue.cc:1059] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 12:11:00.200333 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:00.225912 14330 raft_consensus.cc:2468] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 5.
I20260709 12:11:00.227172 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:00.199091 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:00.171854 17602 raft_consensus.cc:2749] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:11:00.210065 17525 consensus_meta.cc:287] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.571s	user 0.006s	sys 0.006s
I20260709 12:11:00.180933 17554 raft_consensus.cc:2749] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:00.180256 17344 raft_consensus.cc:2749] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:00.237896 14338 raft_consensus.cc:2410] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:11:00.203621 14877 leader_election.cc:304] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:11:00.205513 14303 leader_election.cc:304] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
W20260709 12:11:00.210618 14286 debug-util.cc:398] Leaking SignalData structure 0x7b080025d0e0 after lost signal to thread 12989
I20260709 12:11:00.182482 14230 leader_election.cc:304] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:11:00.191516 17413 raft_consensus.cc:515] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:11:00.245605 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 63194.9us
I20260709 12:11:00.189877 17499 raft_consensus.cc:2804] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:00.214612 14182 raft_consensus.cc:2410] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:11:00.229295 14339 raft_consensus.cc:2468] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 9.
I20260709 12:11:00.228606 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:00.204063 17410 raft_consensus.cc:3060] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:00.257537 17597 log.cc:927] Time spent T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.171s	user 0.000s	sys 0.000s
I20260709 12:11:00.258235 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:00.259119 14339 raft_consensus.cc:2410] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:11:00.260027 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:00.180393 17417 raft_consensus.cc:515] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:11:00.261386 17385 consensus_meta.cc:287] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db: Time spent flushing consensus metadata: real 0.548s	user 0.008s	sys 0.000s
I20260709 12:11:00.262295 14188 raft_consensus.cc:1240] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:11:00.262950 17417 leader_election.cc:290] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 10 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:00.238301 14186 raft_consensus.cc:2468] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 8.
I20260709 12:11:00.263846 14188 raft_consensus.cc:1240] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 5 LEADER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:11:00.264190 14339 raft_consensus.cc:2410] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 12:11:00.265100 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:00.266126 16750 raft_consensus.cc:3060] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:11:00.266486 17599 log.cc:927] Time spent T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.144s	user 0.000s	sys 0.000s
I20260709 12:11:00.268366 17338 raft_consensus.cc:515] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:00.270802 17338 leader_election.cc:290] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 8 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:00.215631 17437 raft_consensus.cc:740] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:11:00.248402 14330 raft_consensus.cc:2468] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 6.
I20260709 12:11:00.249487 14230 leader_election.cc:304] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:11:00.283833 14230 leader_election.cc:304] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:11:00.285138 14230 leader_election.cc:304] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:11:00.254887 17499 raft_consensus.cc:493] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:00.255460 17519 raft_consensus.cc:2804] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:00.212982 17607 raft_consensus.cc:2804] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:11:00.256647 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:00.161676 17536 consensus_queue.cc:237] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:11:00.274150 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 68773.6us
W20260709 12:11:00.245936 14286 debug-util.cc:398] Leaking SignalData structure 0x7b0800313500 after lost signal to thread 14122
I20260709 12:11:00.287573 14230 leader_election.cc:304] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:00.240222 17580 raft_consensus.cc:493] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:00.303912 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:11:00.305989 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 62748.4us
W20260709 12:11:00.288465 17523 consensus_meta.cc:287] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.738s	user 0.011s	sys 0.002s
I20260709 12:11:00.309209 14230 leader_election.cc:304] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
W20260709 12:11:00.309293 14286 debug-util.cc:398] Leaking SignalData structure 0x7b08002f5fe0 after lost signal to thread 14214
I20260709 12:11:00.310261 14303 leader_election.cc:304] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:00.315254 14230 leader_election.cc:304] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:11:00.312358 14877 leader_election.cc:304] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:00.273277 17568 raft_consensus.cc:2804] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:00.282879 17368 raft_consensus.cc:2749] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:11:00.314728 14286 debug-util.cc:398] Leaking SignalData structure 0x7b08002f4760 after lost signal to thread 14215
I20260709 12:11:00.309262 14339 raft_consensus.cc:1275] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:11:00.286684 17499 raft_consensus.cc:3060] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:00.327991 14303 leader_election.cc:304] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:00.302031 17571 raft_consensus.cc:2804] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:00.302201 17519 raft_consensus.cc:493] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:00.327873 14230 leader_election.cc:304] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
W20260709 12:11:00.330746 14286 debug-util.cc:398] Leaking SignalData structure 0x7b0800164880 after lost signal to thread 14289
W20260709 12:11:00.335850 14286 debug-util.cc:398] Leaking SignalData structure 0x7b0800164860 after lost signal to thread 14290
W20260709 12:11:00.337230 14286 debug-util.cc:398] Leaking SignalData structure 0x7b0800364500 after lost signal to thread 14363
W20260709 12:11:00.337545 14286 debug-util.cc:398] Leaking SignalData structure 0x7b08003b3f40 after lost signal to thread 14364
I20260709 12:11:00.333648 14330 raft_consensus.cc:1240] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 12:11:00.308845 17313 raft_consensus.cc:2804] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:00.305867 17607 raft_consensus.cc:493] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:11:00.312491 17278 raft_consensus.cc:2804] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:00.313949 17328 raft_consensus.cc:3060] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:00.302136 17554 consensus_queue.cc:1059] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
W20260709 12:11:00.349268 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 83286.5us
I20260709 12:11:00.327234 17568 raft_consensus.cc:493] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:00.330494 17602 raft_consensus.cc:2749] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:00.344828 14303 leader_election.cc:304] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:00.360597 14303 leader_election.cc:304] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:00.329770 17577 raft_consensus.cc:2804] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:00.312150 17609 raft_consensus.cc:2749] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:00.334079 17571 raft_consensus.cc:493] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:00.348428 17338 raft_consensus.cc:2749] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:11:00.343333 14286 debug-util.cc:398] Leaking SignalData structure 0x7b0800372cc0 after lost signal to thread 14936
I20260709 12:11:00.338842 17519 raft_consensus.cc:3060] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:00.347913 17278 raft_consensus.cc:493] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:00.326828 17580 raft_consensus.cc:515] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:00.341817 17313 raft_consensus.cc:493] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
W20260709 12:11:00.372054 14286 debug-util.cc:398] Leaking SignalData structure 0x7b08003c1440 after lost signal to thread 14937
I20260709 12:11:00.356966 17568 raft_consensus.cc:3060] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:00.365854 17545 raft_consensus.cc:2804] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:11:00.329906 17523 raft_consensus.cc:515] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:00.370270 17571 raft_consensus.cc:3060] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:00.334570 17605 consensus_queue.cc:1059] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 12:11:00.366402 17105 raft_consensus.cc:2749] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:00.364754 17554 consensus_queue.cc:1243] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer 885067a0d31741bfb5c9935788e315bf log is divergent from this leader: its last log entry 5.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:11:00.366144 17577 raft_consensus.cc:493] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:00.350178 17607 raft_consensus.cc:3060] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:00.334769 17417 consensus_queue.cc:1059] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
W20260709 12:11:00.384264 17511 consensus_meta.cc:287] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.680s	user 0.011s	sys 0.000s
I20260709 12:11:00.340426 17608 consensus_queue.cc:1059] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 12:11:00.372601 17368 raft_consensus.cc:2749] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:00.382243 17278 raft_consensus.cc:3060] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:11:00.389133 17613 log.cc:927] Time spent T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 12:11:00.371192 17579 consensus_queue.cc:1059] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 12:11:00.388144 17313 raft_consensus.cc:3060] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:00.390081 17545 raft_consensus.cc:493] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:00.405855 17619 tablet_replica.cc:333] T f4739bc22bfe44fcba807da02d9351b6 P 885067a0d31741bfb5c9935788e315bf: stopping tablet replica
W20260709 12:11:00.407557 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 79800.2us
I20260709 12:11:00.409698 14303 leader_election.cc:400] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 11 pre-election: Vote denied by peer 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341) with higher term. Message: Invalid argument: T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for earlier term 11. Current term is 12.
I20260709 12:11:00.409607 14335 raft_consensus.cc:2410] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:11:00.351033 17437 consensus_queue.cc:260] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:00.401711 17467 raft_consensus.cc:2804] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:00.442049 17467 raft_consensus.cc:493] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:00.442598 17467 raft_consensus.cc:3060] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:00.407853 14331 raft_consensus.cc:2393] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db in current term 9: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:11:00.402871 17577 raft_consensus.cc:3060] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:00.404565 17578 raft_consensus.cc:2804] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:11:00.418182 14230 leader_election.cc:304] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:11:00.418545 14303 leader_election.cc:403] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:00.419507 14155 leader_election.cc:304] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:00.458037 14155 leader_election.cc:304] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:00.459040 14155 leader_election.cc:304] T f4739bc22bfe44fcba807da02d9351b6 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:00.416756 17545 raft_consensus.cc:3060] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:00.423626 17585 raft_consensus.cc:493] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:00.414904 17574 leader_election.cc:290] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:00.406826 17439 raft_consensus.cc:515] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:11:00.439384 17610 log.cc:927] Time spent T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.157s	user 0.001s	sys 0.001s
I20260709 12:11:00.439762 17367 consensus_queue.cc:1048] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:11:00.440213 17523 leader_election.cc:290] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 9 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:00.422895 17529 consensus_queue.cc:260] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:00.440405 17616 consensus_queue.cc:1048] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:11:00.411731 17584 consensus_meta.cc:287] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.547s	user 0.007s	sys 0.004s
W20260709 12:11:00.460942 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 51400.5us
I20260709 12:11:00.439625 17583 leader_election.cc:290] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:11:00.484974 14878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:00.483912 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 139086us
I20260709 12:11:00.466001 17585 raft_consensus.cc:515] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:00.470703 17627 raft_consensus.cc:2804] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:00.486127 17627 raft_consensus.cc:493] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:00.464531 17605 raft_consensus.cc:2749] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341) with higher term. Message: Invalid argument: T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for earlier term 11. Current term is 12.
I20260709 12:11:00.464080 17317 raft_consensus.cc:2804] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:00.455994 17413 leader_election.cc:290] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:11:00.467144 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 49050us
I20260709 12:11:00.464675 17525 raft_consensus.cc:2804] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:00.487344 14184 raft_consensus.cc:1240] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:00.421968 17408 consensus_queue.cc:1048] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 12:11:00.465251 17500 raft_consensus.cc:2749] T f4739bc22bfe44fcba807da02d9351b6 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:11:00.478308 17582 consensus_meta.cc:287] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.760s	user 0.019s	sys 0.000s
I20260709 12:11:00.486483 17627 raft_consensus.cc:3060] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:00.502702 17582 raft_consensus.cc:2749] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:00.504470 14256 raft_consensus.cc:1240] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:00.488874 17317 raft_consensus.cc:493] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:00.513172 17317 raft_consensus.cc:3060] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:00.513583 17410 raft_consensus.cc:515] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:00.515293 17439 leader_election.cc:290] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:00.515882 17410 leader_election.cc:290] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 9 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:00.494597 17529 raft_consensus.cc:3060] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:00.522025 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:00.523579 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:00.524818 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:00.529134 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:00.487013 17584 raft_consensus.cc:515] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:00.525991 17582 raft_consensus.cc:493] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:00.530503 17582 raft_consensus.cc:515] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:00.531077 17559 raft_consensus.cc:3055] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:11:00.531482 17559 raft_consensus.cc:740] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:11:00.531754 14333 raft_consensus.cc:2393] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 7: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:11:00.522495 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:00.527992 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:00.525305 17602 raft_consensus.cc:3055] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:00.532342 17559 consensus_queue.cc:260] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:00.533063 17602 raft_consensus.cc:740] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:00.534046 17602 consensus_queue.cc:260] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:00.533074 14264 raft_consensus.cc:3060] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:00.533535 14333 raft_consensus.cc:1275] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 12:11:00.536013 14333 pending_rounds.cc:85] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c: Aborting all ops after (but not including) 7
I20260709 12:11:00.536255 14333 pending_rounds.cc:107] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 12:11:00.536543 14332 raft_consensus.cc:2393] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 8: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:11:00.537480 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:11:00.538224 14302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:00.536494 14333 raft_consensus.cc:2889] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:00.539964 14230 leader_election.cc:304] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:00.541421 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:00.543188 14333 raft_consensus.cc:1275] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:11:00.549032 14260 raft_consensus.cc:2393] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 5: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:11:00.549908 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:00.492590 17525 raft_consensus.cc:493] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:00.552501 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:00.562975 14264 raft_consensus.cc:2468] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 9.
I20260709 12:11:00.529170 17317 raft_consensus.cc:515] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:00.535374 17602 raft_consensus.cc:3060] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:00.546938 17628 raft_consensus.cc:493] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:00.574795 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:00.574790 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
W20260709 12:11:00.581250 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:00.552739 17410 raft_consensus.cc:2749] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:00.563531 17525 raft_consensus.cc:3060] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:00.562309 17582 leader_election.cc:290] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:00.574405 17559 raft_consensus.cc:3060] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:11:00.601941 17580 leader_election.cc:290] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:11:00.604089 17604 log.cc:927] Time spent T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.602s	user 0.003s	sys 0.000s
I20260709 12:11:00.605232 17501 raft_consensus.cc:3055] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:00.607076 17196 raft_consensus.cc:515] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:00.607918 17408 raft_consensus.cc:493] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:00.493852 17626 consensus_queue.cc:1048] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.106s
I20260709 12:11:00.607812 17434 consensus_queue.cc:260] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:11:00.611749 14335 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50858 (request call id 1608) took 2204 ms (client timeout 1565 ms). Trace:
I20260709 12:11:00.612481 17328 raft_consensus.cc:2749] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:00.628749 14264 raft_consensus.cc:2468] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 10.
W20260709 12:11:00.613404 17513 consensus_meta.cc:287] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.558s	user 0.009s	sys 0.002s
I20260709 12:11:00.614279 17619 raft_consensus.cc:2243] T f4739bc22bfe44fcba807da02d9351b6 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:00.525331 17607 raft_consensus.cc:515] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:00.612797 17313 raft_consensus.cc:515] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:11:00.627871 14875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:00.642748 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
W20260709 12:11:00.641767 14335 rpcz_store.cc:269] 0709 12:10:58.407268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:58.407858 (+   590us) service_pool.cc:224] Handling call
0709 12:11:00.611508 (+2203650us) spinlock_profiling.cc:243] Waited 1.95 s on lock 0x7b5400145854. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:11:00.611668 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4479651712}
W20260709 12:11:00.643970 14155 leader_election.cc:336] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Timed out: RequestConsensusVote RPC to 127.12.174.130:36673 timed out after 2.332s (SENT)
I20260709 12:11:00.618305 17501 raft_consensus.cc:740] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:11:00.650130 14335 raft_consensus.cc:1275] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:11:00.656649 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:11:00.657766 14877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:00.660485 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:11:00.661237 14264 raft_consensus.cc:2468] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 5.
I20260709 12:11:00.662195 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:00.665799 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:00.666556 14903 raft_consensus.cc:2468] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 8.
I20260709 12:11:00.666810 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:00.668026 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:00.669198 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:00.671904 17196 leader_election.cc:290] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 12 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:00.672787 17317 leader_election.cc:290] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:00.674817 17607 leader_election.cc:290] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 6 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:00.620427 17582 consensus_queue.cc:1048] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 12:11:00.677215 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:11:00.680675 14264 raft_consensus.cc:1275] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 7 index: 3. (index mismatch)
I20260709 12:11:00.658418 14335 raft_consensus.cc:1275] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 12:11:00.685597 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:00.686211 14335 pending_rounds.cc:85] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c: Aborting all ops after (but not including) 3
I20260709 12:11:00.598727 17628 raft_consensus.cc:515] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:00.686797 14335 pending_rounds.cc:107] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 12:11:00.688169 14335 raft_consensus.cc:2889] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:00.689873 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:11:00.693320 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 151585us
I20260709 12:11:00.697201 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:00.698653 14190 raft_consensus.cc:1275] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:11:00.699996 17278 raft_consensus.cc:515] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:00.700888 14303 leader_election.cc:304] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:11:00.704500 17519 raft_consensus.cc:515] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:00.705551 17437 raft_consensus.cc:3060] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:00.705945 17616 consensus_queue.cc:1048] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:11:00.698697 17501 consensus_queue.cc:260] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:00.706437 14229 leader_election.cc:304] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:00.647560 17513 raft_consensus.cc:515] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:00.707767 17578 raft_consensus.cc:493] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
W20260709 12:11:00.708174 17625 log.cc:927] Time spent T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.133s	user 0.001s	sys 0.000s
I20260709 12:11:00.647046 17615 consensus_queue.cc:1059] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 12:11:00.710412 17338 raft_consensus.cc:3055] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:00.761581 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:11:00.714298 17629 log.cc:927] Time spent T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 12:11:00.714880 17446 leader_election.cc:290] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:00.645167 17408 raft_consensus.cc:515] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:00.719018 14304 leader_election.cc:304] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:00.740252 17603 raft_consensus.cc:3055] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:00.722759 14335 raft_consensus.cc:3060] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:00.720196 14230 leader_election.cc:304] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
W20260709 12:11:00.776149 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 56016.3us
I20260709 12:11:00.754453 17578 raft_consensus.cc:3060] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:00.723847 14260 raft_consensus.cc:3060] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:00.724900 14336 raft_consensus.cc:1275] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:11:00.708510 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:00.726763 14332 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50856 (request call id 1957) took 1009 ms. Trace:
I20260709 12:11:00.733180 17278 leader_election.cc:290] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 7 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:00.734119 17580 raft_consensus.cc:2804] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:00.734352 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:00.734570 17500 raft_consensus.cc:493] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:00.735282 14908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:11:00.736449 14906 raft_consensus.cc:1275] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 7. (term mismatch)
I20260709 12:11:00.783546 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:00.734458 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:00.659611 17439 consensus_queue.cc:1048] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.060s
W20260709 12:11:00.743517 14303 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:00.744068 14229 leader_election.cc:304] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
W20260709 12:11:00.747153 14302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:00.747987 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:00.824146 14187 raft_consensus.cc:2468] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 4.
I20260709 12:11:00.825142 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:00.825440 14303 leader_election.cc:304] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:11:00.825834 14187 raft_consensus.cc:2468] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 8.
I20260709 12:11:00.826401 17196 raft_consensus.cc:2804] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:11:00.826628 17513 leader_election.cc:290] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:00.748755 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 8 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:00.826828 17196 raft_consensus.cc:493] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:00.755095 14337 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 550) took 1054 ms. Trace:
W20260709 12:11:00.721670 17633 log.cc:927] Time spent T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.122s	user 0.000s	sys 0.001s
I20260709 12:11:00.827329 17196 raft_consensus.cc:3060] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:11:00.742359 14903 raft_consensus.cc:1275] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
W20260709 12:11:00.769625 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 50670.6us
I20260709 12:11:00.676251 17619 raft_consensus.cc:2272] T f4739bc22bfe44fcba807da02d9351b6 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:00.773355 14188 raft_consensus.cc:1240] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:00.737655 17541 leader_election.cc:290] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:00.781503 14334 raft_consensus.cc:2393] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 8: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:11:00.855676 14334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50856 (request call id 1948) took 1147 ms. Trace:
I20260709 12:11:00.856096 14334 rpcz_store.cc:276] 0709 12:10:59.708602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:00.006659 (+298057us) service_pool.cc:224] Handling call
0709 12:11:00.734181 (+727522us) spinlock_profiling.cc:243] Waited 4.21 ms on lock 0x7b5800065d98. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2124016b71 00007f2124016a22 00007f212cf2f8d9 00007f212c089ee0 00007f212c1530ab 00007f212c153131 00007f212c1010a0 00007f212c100984 00007f212567b6d4 00007f212567b662
0709 12:11:00.855603 (+121422us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9677568}
I20260709 12:11:00.780282 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:00.783821 14906 pending_rounds.cc:85] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db: Aborting all ops after (but not including) 6
I20260709 12:11:00.737377 17606 raft_consensus.cc:3055] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:11:00.784366 14912 raft_consensus.cc:2393] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 10: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
I20260709 12:11:00.858165 17278 raft_consensus.cc:2749] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:11:00.784786 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:00.859428 14259 raft_consensus.cc:2468] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 8.
I20260709 12:11:00.860332 17408 leader_election.cc:290] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:00.860564 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:00.861243 14259 raft_consensus.cc:3060] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:00.784989 14264 raft_consensus.cc:2393] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 10: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:11:00.723062 17627 raft_consensus.cc:515] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:00.777014 17529 raft_consensus.cc:2804] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:00.769956 17626 raft_consensus.cc:3055] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:00.761157 17338 raft_consensus.cc:740] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:00.774160 17603 raft_consensus.cc:740] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:00.761343 17455 consensus_queue.cc:1048] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 12:11:00.745906 17643 consensus_queue.cc:1048] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.063s
I20260709 12:11:00.783269 17580 raft_consensus.cc:493] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:00.782780 17410 raft_consensus.cc:2749] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:00.823076 14335 raft_consensus.cc:2468] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 10.
I20260709 12:11:00.779906 14332 rpcz_store.cc:276] 0709 12:10:59.717608 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:00.550944 (+833336us) service_pool.cc:224] Handling call
0709 12:11:00.551185 (+   241us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:00.551349 (+   164us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:11:00.621205 (+ 69856us) log.cc:844] Serialized 14 byte log entry
0709 12:11:00.721455 (+100250us) log.cc:844] Serialized 14 byte log entry
0709 12:11:00.726019 (+  4564us) log.cc:844] Serialized 14 byte log entry
0709 12:11:00.726330 (+   311us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:00.726391 (+    61us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:00.726448 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:00.726528 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:00.726683 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11911,"prepare.queue_time_us":39265,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":110,"raft.queue_time_us":97,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":89,"spinlock_wait_cycles":25986432,"thread_start_us":146131,"threads_started":2,"wal-append.queue_time_us":148230}
I20260709 12:11:00.826882 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:00.827437 14337 rpcz_store.cc:276] 0709 12:10:59.700652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:00.343753 (+643101us) service_pool.cc:224] Handling call
0709 12:11:00.365242 (+ 21489us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:00.392909 (+ 27667us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:00.392947 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:00.403968 (+ 11021us) log.cc:844] Serialized 26 byte log entry
0709 12:11:00.490303 (+ 86335us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:00.546927 (+ 56624us) log.cc:844] Serialized 14 byte log entry
0709 12:11:00.547288 (+   361us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:00.739321 (+192033us) spinlock_profiling.cc:243] Waited 24.2 ms on lock 0x7b54002a6054. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:11:00.739370 (+    49us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:00.743754 (+  4384us) raft_consensus.cc:1685] finished
0709 12:11:00.754861 (+ 11107us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:00.755027 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16870,"prepare.queue_time_us":51782,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":8604,"raft.run_cpu_time_us":364,"raft.run_wall_time_us":20616,"spinlock_wait_cycles":55608576,"thread_start_us":46919,"threads_started":1,"wal-append.queue_time_us":185430}
I20260709 12:11:00.872922 14155 leader_election.cc:304] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:00.830483 14304 leader_election.cc:304] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
W20260709 12:11:00.874365 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 43989.1us
I20260709 12:11:00.836305 14303 leader_election.cc:304] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:00.872097 14187 raft_consensus.cc:2468] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 7.
I20260709 12:11:00.866184 17606 raft_consensus.cc:740] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:11:00.877375 14258 raft_consensus.cc:1240] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:00.837395 14333 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50856 (request call id 1956) took 1124 ms. Trace:
I20260709 12:11:00.818958 14260 raft_consensus.cc:2468] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 8.
W20260709 12:11:00.839686 14876 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:00.836774 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 92813.5us
I20260709 12:11:00.878254 14333 rpcz_store.cc:276] 0709 12:10:59.712731 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:00.544169 (+831438us) service_pool.cc:224] Handling call
0709 12:11:00.544480 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:00.544744 (+   264us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:11:00.643016 (+ 98272us) log.cc:844] Serialized 14 byte log entry
0709 12:11:00.836975 (+193959us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:00.837045 (+    70us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:11:00.837099 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:00.837179 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:00.837321 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":37874,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":4742,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":109,"thread_start_us":282306,"threads_started":2,"wal-append.queue_time_us":222435}
I20260709 12:11:00.841905 14339 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50856 (request call id 1959) took 1122 ms. Trace:
I20260709 12:11:00.817891 17628 leader_election.cc:290] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:00.812611 17500 raft_consensus.cc:515] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:11:00.883841 17644 log.cc:927] Time spent T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 12:11:00.885228 17500 leader_election.cc:290] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:00.867738 17626 raft_consensus.cc:740] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:11:00.886034 14184 raft_consensus.cc:2468] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 8.
I20260709 12:11:00.886636 17626 consensus_queue.cc:260] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:00.888019 17626 raft_consensus.cc:3060] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:00.786446 17467 raft_consensus.cc:515] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:00.891268 17467 leader_election.cc:290] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 9 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:00.892486 17619 ts_tablet_manager.cc:1916] T f4739bc22bfe44fcba807da02d9351b6 P 885067a0d31741bfb5c9935788e315bf: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 12:11:00.896878 17623 log.cc:927] Time spent T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.457s	user 0.000s	sys 0.003s
W20260709 12:11:00.902345 17648 log.cc:927] Time spent T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
I20260709 12:11:00.902557 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:00.903333 14257 raft_consensus.cc:2468] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 8.
I20260709 12:11:00.904247 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 8 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:00.904781 14257 raft_consensus.cc:3060] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:00.816270 17413 consensus_queue.cc:1048] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 12:11:00.858794 17630 raft_consensus.cc:493] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:00.858213 14906 pending_rounds.cc:107] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260709 12:11:00.830037 14903 pending_rounds.cc:85] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db: Aborting all ops after (but not including) 5
I20260709 12:11:00.907119 14336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50858 (request call id 1636) took 1321 ms. Trace:
I20260709 12:11:00.907186 14906 raft_consensus.cc:2889] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:00.865603 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:00.892750 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:00.908061 14264 raft_consensus.cc:2393] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 10: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:11:00.908371 17519 leader_election.cc:290] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:00.866442 17529 raft_consensus.cc:493] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:00.908694 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:00.909130 17529 raft_consensus.cc:3060] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:00.909474 14331 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55492 (request call id 544) took 1227 ms. Trace:
I20260709 12:11:00.907176 17630 raft_consensus.cc:515] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:00.848435 14183 raft_consensus.cc:1275] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:11:00.913978 17338 consensus_queue.cc:260] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:00.915913 17338 raft_consensus.cc:3060] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:00.918993 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:00.908815 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:00.919806 14330 raft_consensus.cc:2468] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 8.
I20260709 12:11:00.910035 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:00.857409 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:00.880966 14337 raft_consensus.cc:1240] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:00.920881 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:00.921988 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:00.909852 14903 pending_rounds.cc:107] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 12:11:00.880853 17606 consensus_queue.cc:260] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:00.926712 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:00.926908 17606 raft_consensus.cc:3060] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:11:00.927994 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:00.909884 14331 rpcz_store.cc:276] 0709 12:10:59.682251 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:59.682788 (+   537us) service_pool.cc:224] Handling call
0709 12:11:00.909305 (+1226517us) spinlock_profiling.cc:243] Waited 643 ms on lock 0x7b5400019d54. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:11:00.909414 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1480046336}
I20260709 12:11:00.931381 14331 raft_consensus.cc:1240] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 12:11:00.932945 14331 raft_consensus.cc:1240] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 7. Current term is 8. Ops: [7.3-7.3]
I20260709 12:11:00.933175 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:00.933763 17559 consensus_queue.cc:1059] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:00.936048 17559 consensus_queue.cc:1059] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:00.881354 17513 raft_consensus.cc:2804] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:00.937268 17513 raft_consensus.cc:697] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 10 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:11:00.922693 14903 raft_consensus.cc:2889] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:00.937570 14264 raft_consensus.cc:1275] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:11:00.938437 17545 raft_consensus.cc:515] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:00.939319 14264 raft_consensus.cc:1240] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:00.941493 14256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41764 (request call id 2409) took 1061 ms. Trace:
I20260709 12:11:00.941910 14256 rpcz_store.cc:276] 0709 12:10:59.880217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:59.891339 (+ 11122us) service_pool.cc:224] Handling call
0709 12:10:59.891769 (+   430us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:00.504899 (+613130us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:00.941266 (+436367us) spinlock_profiling.cc:243] Waited 612 ms on lock 0x7b5400212354. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:11:00.941429 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1408714624}
I20260709 12:11:00.943686 14256 raft_consensus.cc:1275] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
W20260709 12:11:00.944077 17640 log.cc:927] Time spent T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.126s	user 0.000s	sys 0.003s
I20260709 12:11:00.945025 14256 raft_consensus.cc:1275] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:11:00.877036 17580 raft_consensus.cc:3060] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:00.884686 17603 consensus_queue.cc:260] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:00.940735 14258 raft_consensus.cc:1275] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 12:11:00.878042 17621 log.cc:927] Time spent T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.401s	user 0.002s	sys 0.000s
I20260709 12:11:00.949702 17603 raft_consensus.cc:3060] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:11:00.952093 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 77004.1us
I20260709 12:11:00.952345 17541 raft_consensus.cc:2804] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:00.953017 17541 raft_consensus.cc:493] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:00.954020 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 120943us
I20260709 12:11:00.922286 14334 raft_consensus.cc:1275] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:11:00.955155 14303 leader_election.cc:304] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:00.958141 14256 raft_consensus.cc:1275] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:11:00.907516 14336 rpcz_store.cc:276] 0709 12:10:59.585788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:59.586633 (+   845us) service_pool.cc:224] Handling call
0709 12:10:59.586873 (+   240us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:00.778551 (+1191678us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:00.906850 (+128299us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b54002823d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:11:00.907046 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2611236096}
I20260709 12:11:00.960497 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:00.962354 14337 raft_consensus.cc:1240] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:11:00.878893 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:00.964074 14335 raft_consensus.cc:2410] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
W20260709 12:11:00.834440 17566 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.851s	user 0.000s	sys 0.016s
I20260709 12:11:00.936656 14261 raft_consensus.cc:2468] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 8.
I20260709 12:11:00.967929 14256 raft_consensus.cc:1275] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
W20260709 12:11:00.968600 14305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:00.968134 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:00.969970 14261 raft_consensus.cc:1275] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 12:11:00.970484 14261 pending_rounds.cc:85] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec: Aborting all ops after (but not including) 7
I20260709 12:11:00.970803 17574 raft_consensus.cc:493] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:00.971688 17574 raft_consensus.cc:515] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:00.971350 14877 leader_election.cc:304] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:00.970906 14261 pending_rounds.cc:107] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 12:11:00.974931 14261 raft_consensus.cc:2889] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:00.977021 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:00.977164 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:00.978060 14336 raft_consensus.cc:3060] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:00.953549 17541 raft_consensus.cc:3060] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:00.975838 14155 leader_election.cc:304] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:00.840735 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:00.985342 14256 raft_consensus.cc:1240] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:00.992221 14262 raft_consensus.cc:2393] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 7: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:11:00.991231 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:00.992964 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:00.986068 14229 leader_election.cc:304] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:00.996642 14261 raft_consensus.cc:2393] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 9: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:11:00.937489 17559 raft_consensus.cc:3055] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:00.988343 14259 raft_consensus.cc:2468] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 9.
I20260709 12:11:00.998957 14877 leader_election.cc:304] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:00.980028 14339 rpcz_store.cc:276] 0709 12:10:59.719461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:00.614203 (+894742us) service_pool.cc:224] Handling call
0709 12:11:00.614562 (+   359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:00.614791 (+   229us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:11:00.615112 (+   321us) log.cc:844] Serialized 14 byte log entry
0709 12:11:00.841455 (+226343us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:00.841519 (+    64us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:11:00.841580 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:00.841661 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:00.841832 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4895,"prepare.queue_time_us":1446,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":5035,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":113,"spinlock_wait_cycles":12627840,"thread_start_us":220948,"threads_started":1,"wal-append.queue_time_us":201588}
I20260709 12:11:01.000325 14257 raft_consensus.cc:2468] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 8.
I20260709 12:11:01.000515 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:01.001490 14261 raft_consensus.cc:1275] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:11:01.001629 14339 raft_consensus.cc:2393] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 10: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:11:01.002238 14256 raft_consensus.cc:1240] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:11:01.006160 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:01.006603 14256 raft_consensus.cc:1240] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 4. Current term is 5. Ops: []
I20260709 12:11:01.007028 14339 raft_consensus.cc:3060] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:00.966538 17566 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.092s	user 0.001s	sys 0.017s
I20260709 12:11:01.012112 14229 leader_election.cc:304] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:01.018191 14336 raft_consensus.cc:2468] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 7.
I20260709 12:11:01.019009 14339 raft_consensus.cc:2468] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 9.
I20260709 12:11:01.001925 14257 raft_consensus.cc:1240] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 12:11:00.952045 17630 leader_election.cc:290] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:11:00.981026 17577 consensus_meta.cc:287] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.524s	user 0.012s	sys 0.000s
I20260709 12:11:00.866088 17525 raft_consensus.cc:515] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:11:01.039024 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 83939.4us
W20260709 12:11:01.049539 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 50678.9us
W20260709 12:11:01.011565 17608 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.579s	user 0.009s	sys 0.006s
I20260709 12:11:01.038702 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:00.966239 17335 raft_consensus.cc:493] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:00.982736 17105 raft_consensus.cc:2804] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:11:01.050498 14877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:01.048310 14303 leader_election.cc:304] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:01.038470 17347 raft_consensus.cc:2749] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:11:01.053175 17417 raft_consensus.cc:2804] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:01.064473 17417 raft_consensus.cc:493] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:01.065078 17417 raft_consensus.cc:3060] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:01.066773 17578 raft_consensus.cc:515] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:01.010617 17367 raft_consensus.cc:2804] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:01.034371 14229 leader_election.cc:304] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:01.060913 14261 raft_consensus.cc:1240] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:01.073410 14229 leader_election.cc:304] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:01.010118 17559 raft_consensus.cc:740] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
W20260709 12:11:01.079308 14302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:01.080627 14336 raft_consensus.cc:1240] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:11:01.082230 14336 raft_consensus.cc:1240] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:01.083707 14336 raft_consensus.cc:1275] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:11:01.045105 17410 raft_consensus.cc:2749] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:11:01.039500 17545 leader_election.cc:290] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 6 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:01.090354 14229 leader_election.cc:304] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
W20260709 12:11:01.056126 17608 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.623s	user 0.009s	sys 0.006s
W20260709 12:11:01.092291 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 111580us
I20260709 12:11:01.053550 17328 raft_consensus.cc:3060] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:01.048931 17503 raft_consensus.cc:493] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:01.094272 14229 leader_election.cc:304] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
W20260709 12:11:01.061640 17499 consensus_meta.cc:287] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.721s	user 0.013s	sys 0.001s
I20260709 12:11:01.038978 17402 consensus_queue.cc:1048] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 12:11:00.991778 17455 consensus_queue.cc:1048] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.074s
W20260709 12:11:01.099354 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 51147.1us
I20260709 12:11:01.020787 17519 raft_consensus.cc:2749] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:01.020624 17616 consensus_queue.cc:1059] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.056s
I20260709 12:11:01.056517 17566 raft_consensus.cc:2749] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:01.097029 14304 leader_election.cc:304] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:01.038527 17643 consensus_queue.cc:1048] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.053s
I20260709 12:11:01.099647 17344 raft_consensus.cc:2749] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:01.071211 17105 raft_consensus.cc:493] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:01.074554 17367 raft_consensus.cc:493] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:01.090550 17582 raft_consensus.cc:2804] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:01.114544 17402 consensus_queue.cc:1243] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer 65c9c1653b3346b39a0e118540e6080c log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
W20260709 12:11:01.122159 14154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:01.128939 17417 raft_consensus.cc:515] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:01.109104 17602 raft_consensus.cc:2804] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:01.095441 17628 raft_consensus.cc:2749] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:01.108618 17627 leader_election.cc:290] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:01.070878 17577 raft_consensus.cc:515] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:01.106716 17446 raft_consensus.cc:3055] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:01.071055 17335 raft_consensus.cc:515] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:01.095588 17513 consensus_queue.cc:237] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:01.110548 17503 raft_consensus.cc:515] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:01.141098 14304 leader_election.cc:304] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:01.141880 17632 raft_consensus.cc:2804] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:11:01.147439 14302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:01.156641 14155 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.174.130:36673 timed out after 2.841s (SENT) [suppressed 34 similar messages]
I20260709 12:11:01.138674 17105 raft_consensus.cc:3060] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:01.137079 17367 raft_consensus.cc:3060] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:01.157712 17196 raft_consensus.cc:515] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:01.139552 17519 raft_consensus.cc:2749] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:01.115785 17499 raft_consensus.cc:515] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:01.237358 14264 raft_consensus.cc:1240] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:01.239233 17499 leader_election.cc:290] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 8 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:01.242364 17196 leader_election.cc:290] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:11:01.147060 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:01.168581 14259 raft_consensus.cc:1240] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 9. Current term is 10. Ops: [9.8-9.8]
W20260709 12:11:01.148264 17568 consensus_meta.cc:287] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db: Time spent flushing consensus metadata: real 0.751s	user 0.007s	sys 0.009s
I20260709 12:11:01.145362 17578 leader_election.cc:290] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:01.149029 17602 raft_consensus.cc:493] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:01.210999 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 69975.3us
W20260709 12:11:01.211254 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 54642.5us
I20260709 12:11:01.160094 17446 raft_consensus.cc:740] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:11:01.148181 17582 raft_consensus.cc:697] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 7 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
W20260709 12:11:01.227118 17657 log.cc:927] Time spent T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
W20260709 12:11:01.229883 17659 log.cc:927] Time spent T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.063s	user 0.006s	sys 0.000s
I20260709 12:11:01.246276 17335 leader_election.cc:290] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:01.250494 14339 raft_consensus.cc:1240] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 4. Current term is 5. Ops: []
W20260709 12:11:01.251026 14302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:01.215795 17654 raft_consensus.cc:493] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:11:01.209908 17583 raft_consensus.cc:2749] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:01.279810 14304 leader_election.cc:304] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:11:01.299286 14304 leader_election.cc:304] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
W20260709 12:11:01.266598 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 172403us
I20260709 12:11:01.141541 17559 consensus_queue.cc:260] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:01.217856 17632 raft_consensus.cc:493] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:11:01.269631 17602 raft_consensus.cc:3060] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:01.287518 17571 consensus_meta.cc:287] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.884s	user 0.013s	sys 0.001s
W20260709 12:11:01.289853 17658 log.cc:927] Time spent T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
W20260709 12:11:01.290982 17653 log.cc:927] Time spent T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.143s	user 0.000s	sys 0.000s
W20260709 12:11:01.292306 17651 log.cc:927] Time spent T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.122s	user 0.000s	sys 0.001s
I20260709 12:11:01.294040 17577 leader_election.cc:290] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:01.296038 17417 leader_election.cc:290] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 8 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:11:01.274624 17642 log.cc:927] Time spent T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 12:11:01.303341 17632 raft_consensus.cc:3060] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:01.301192 17654 raft_consensus.cc:515] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:01.304658 17582 consensus_queue.cc:237] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:01.306121 17525 leader_election.cc:290] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 7 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:01.308537 17529 raft_consensus.cc:515] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:01.312523 17391 raft_consensus.cc:2804] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:01.313470 17579 raft_consensus.cc:2804] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:01.302742 14229 leader_election.cc:304] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
W20260709 12:11:01.401448 14878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:01.317665 17408 raft_consensus.cc:493] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:01.481889 14302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:01.276172 17196 consensus_queue.cc:1059] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.173s
I20260709 12:11:01.297005 17446 consensus_queue.cc:260] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:11:01.452368 17338 consensus_meta.cc:287] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.536s	user 0.014s	sys 0.002s
I20260709 12:11:01.444253 17523 raft_consensus.cc:493] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:01.344568 17574 leader_election.cc:290] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:01.264145 17568 raft_consensus.cc:515] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:01.500918 17559 raft_consensus.cc:3060] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:01.516710 14331 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50858 (request call id 1652) took 1043 ms. Trace:
I20260709 12:11:01.460119 17616 raft_consensus.cc:493] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:01.444753 17571 raft_consensus.cc:515] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:01.505215 17577 raft_consensus.cc:493] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:01.523038 14331 rpcz_store.cc:276] 0709 12:11:00.473557 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:00.940664 (+467107us) service_pool.cc:224] Handling call
0709 12:11:00.940987 (+   323us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:00.972819 (+ 31832us) raft_consensus.cc:1534] Early marking committed up to index 1
0709 12:11:00.972854 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:00.973331 (+   477us) log.cc:844] Serialized 26 byte log entry
0709 12:11:01.086758 (+113427us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:11:01.086803 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:01.086874 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:01.516442 (+429568us) raft_consensus.cc:1685] finished
0709 12:11:01.516464 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:01.516639 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":89350,"raft.queue_time_us":41039,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":5106,"thread_start_us":113091,"threads_started":1,"wal-append.queue_time_us":173162}
I20260709 12:11:01.525703 14333 raft_consensus.cc:1240] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 7. Current term is 8. Ops: [7.5-7.5]
W20260709 12:11:01.528316 17646 log.cc:927] Time spent T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.711s	user 0.002s	sys 0.000s
I20260709 12:11:01.528805 17382 raft_consensus.cc:3055] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:01.515707 17661 raft_consensus.cc:2749] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:01.520140 17391 raft_consensus.cc:697] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 9 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:01.517421 17579 raft_consensus.cc:697] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 8 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
W20260709 12:11:01.535175 17437 consensus_meta.cc:287] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db: Time spent flushing consensus metadata: real 0.784s	user 0.013s	sys 0.000s
W20260709 12:11:01.540477 17580 consensus_meta.cc:287] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.594s	user 0.010s	sys 0.003s
I20260709 12:11:01.541210 17654 leader_election.cc:290] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:01.541342 17328 raft_consensus.cc:2749] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:11:01.541860 17606 consensus_meta.cc:287] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db: Time spent flushing consensus metadata: real 0.614s	user 0.005s	sys 0.011s
W20260709 12:11:01.528788 17626 consensus_meta.cc:287] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db: Time spent flushing consensus metadata: real 0.640s	user 0.006s	sys 0.008s
I20260709 12:11:01.552012 17367 raft_consensus.cc:515] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:11:01.551551 17603 consensus_meta.cc:287] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.601s	user 0.012s	sys 0.003s
I20260709 12:11:01.514387 17408 raft_consensus.cc:515] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:01.560091 17568 leader_election.cc:290] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 9 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:01.529798 17503 leader_election.cc:290] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:01.524942 17446 raft_consensus.cc:3060] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:01.591519 17650 log.cc:927] Time spent T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.733s	user 0.000s	sys 0.004s
I20260709 12:11:01.583734 17580 raft_consensus.cc:515] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:01.592378 17579 consensus_queue.cc:237] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:01.521929 17523 raft_consensus.cc:515] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:01.575196 17577 raft_consensus.cc:515] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:01.567091 17616 raft_consensus.cc:515] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:11:01.515431 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 212759us
I20260709 12:11:01.548745 14336 raft_consensus.cc:1240] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 12:11:01.560914 14911 raft_consensus.cc:2393] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 9: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
I20260709 12:11:01.562158 17105 raft_consensus.cc:515] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:01.574885 17382 raft_consensus.cc:740] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:11:01.597162 17408 leader_election.cc:290] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:01.845261 17408 raft_consensus.cc:493] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:11:01.846359 17408 raft_consensus.cc:515] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:01.845942 17382 consensus_queue.cc:260] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:01.848230 17382 raft_consensus.cc:3060] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:01.763866 14878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:01.853353 14336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 565) took 1117 ms. Trace:
I20260709 12:11:01.851166 17408 leader_election.cc:290] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:01.591325 17391 consensus_queue.cc:237] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:01.846378 17317 raft_consensus.cc:3055] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:01.736111 14188 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56652 (request call id 774) took 1198 ms. Trace:
I20260709 12:11:01.820744 14085 catalog_manager.cc:5244] ChangeConfig:REMOVE_PEER RPC for tablet f4739bc22bfe44fcba807da02d9351b6 with cas_config_opid_index 4: aborting the task: latest config opid_index 7; task opid_index 4
I20260709 12:11:01.751899 14332 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50858 (request call id 1646) took 1579 ms. Trace:
I20260709 12:11:01.853240 14229 leader_election.cc:304] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
W20260709 12:11:01.809098 14305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:01.740511 14334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50858 (request call id 1653) took 1231 ms. Trace:
I20260709 12:11:01.740592 14337 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 556) took 1515 ms. Trace:
W20260709 12:11:01.903051 14155 leader_election.cc:336] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Timed out: RequestConsensusVote RPC to 127.12.174.130:36673 timed out after 1.514s (SENT)
I20260709 12:11:01.830559 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:01.786298 14264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41768 (request call id 1636) took 1139 ms. Trace:
W20260709 12:11:01.801961 14876 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:01.783771 14260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41768 (request call id 1626) took 1241 ms. Trace:
I20260709 12:11:01.878492 14230 leader_election.cc:304] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:11:01.893643 17500 consensus_queue.cc:1059] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 12:11:01.835258 17313 leader_election.cc:290] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 9 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:01.942216 14155 leader_election.cc:304] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:01.944859 17577 leader_election.cc:290] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:01.940227 14260 rpcz_store.cc:276] 0709 12:11:00.541579 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:00.571366 (+ 29787us) service_pool.cc:224] Handling call
0709 12:11:01.783091 (+1211725us) spinlock_profiling.cc:243] Waited 128 ms on lock 0x7b54002210d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:11:01.783410 (+   319us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":295432064}
I20260709 12:11:01.832791 14331 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50858 (request call id 1658) took 1007 ms. Trace:
I20260709 12:11:01.627440 17584 leader_election.cc:290] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 7 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:01.895622 17417 raft_consensus.cc:493] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:01.950359 17417 raft_consensus.cc:515] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:01.951175 17580 leader_election.cc:290] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 9 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:01.951442 17616 leader_election.cc:290] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:01.952229 17616 raft_consensus.cc:2749] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:01.948688 14331 rpcz_store.cc:276] 0709 12:11:00.825491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:01.568047 (+742556us) service_pool.cc:224] Handling call
0709 12:11:01.568466 (+   419us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:01.572709 (+  4243us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:01.572751 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:01.573350 (+   599us) log.cc:844] Serialized 26 byte log entry
0709 12:11:01.831308 (+257958us) spinlock_profiling.cc:243] Waited 91.3 ms on lock 0x7b180029b240. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f212cf16ab1 00007f212cf23281 00007f2126ce34bc 00007f212403148b 00007f212ce8b9a9 00007f212404d69b 00007f212404b93f 00007f212404dc02 00007f2126cd520b 00007f2126cdad23 00007f2126cdb0d1
0709 12:11:01.831752 (+   444us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:11:01.831878 (+   126us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:01.832033 (+   155us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:01.832116 (+    83us) raft_consensus.cc:1685] finished
0709 12:11:01.832130 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:01.832569 (+   439us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3712,"raft.queue_time_us":6524,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":1673,"spinlock_wait_cycles":209990400,"thread_start_us":165716,"threads_started":1,"wal-append.queue_time_us":7401}
I20260709 12:11:01.953236 17417 leader_election.cc:290] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:01.929085 14336 rpcz_store.cc:276] 0709 12:11:00.736218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:01.548044 (+811826us) service_pool.cc:224] Handling call
0709 12:11:01.548456 (+   412us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:01.852551 (+304095us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:01.853134 (+   583us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:01.827656 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:01.955278 14187 raft_consensus.cc:3060] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:11:01.956636 17408 raft_consensus.cc:3055] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:01.957274 17408 raft_consensus.cc:740] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
W20260709 12:11:01.895612 14156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:01.621425 17571 leader_election.cc:290] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 8 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:01.633097 17434 raft_consensus.cc:3060] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:01.960176 17338 raft_consensus.cc:493] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:01.961102 17338 raft_consensus.cc:515] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:01.852108 17402 raft_consensus.cc:493] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:11:01.751129 14183 raft_consensus.cc:1240] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:11:01.636536 17501 raft_consensus.cc:3060] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:01.962368 17402 raft_consensus.cc:515] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:01.963658 17338 leader_election.cc:290] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:01.964288 17338 raft_consensus.cc:493] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:01.855670 17367 leader_election.cc:290] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 9 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:01.964985 17402 leader_election.cc:290] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:01.879799 17439 consensus_queue.cc:1059] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 12:11:01.826941 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:01.966308 17654 raft_consensus.cc:493] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:01.967437 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:01.967636 17654 raft_consensus.cc:515] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:01.968336 14184 raft_consensus.cc:2468] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 8.
I20260709 12:11:01.635228 17511 raft_consensus.cc:3055] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:01.968537 17523 leader_election.cc:290] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:01.969019 17511 raft_consensus.cc:740] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:01.939415 17317 raft_consensus.cc:740] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:11:01.970405 17511 consensus_queue.cc:260] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:01.971403 17317 consensus_queue.cc:260] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.3, Last appended by leader: 3, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:11:01.952490 14878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:01.972815 14331 raft_consensus.cc:1240] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 12:11:01.966393 17439 raft_consensus.cc:3055] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:11:01.644526 17541 consensus_meta.cc:287] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.624s	user 0.010s	sys 0.002s
W20260709 12:11:01.974596 14085 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44116 (request call id 157) took 21671 ms (client timeout 15000 ms). Trace:
I20260709 12:11:01.974586 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:01.975512 17541 raft_consensus.cc:515] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:11:01.799317 14877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:01.884796 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:01.735553 14265 raft_consensus.cc:1240] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:01.824707 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:01.785034 14262 raft_consensus.cc:1240] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 7. Current term is 8. Ops: [7.5-7.5]
W20260709 12:11:01.823355 14875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:01.819170 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:01.883685 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:01.752305 14189 raft_consensus.cc:1240] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:01.751443 14335 raft_consensus.cc:2410] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:11:01.751082 14339 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50856 (request call id 1977) took 1253 ms. Trace:
I20260709 12:11:01.749432 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
W20260709 12:11:01.935182 14911 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53194 (request call id 796) took 1258 ms (client timeout 1634 ms). Trace:
I20260709 12:11:01.826169 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:01.857635 17413 consensus_queue.cc:1048] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.089s
I20260709 12:11:01.947002 17105 leader_election.cc:290] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 9 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:11:01.948202 14302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:01.759049 14333 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50858 (request call id 1647) took 1566 ms. Trace:
I20260709 12:11:01.937652 14188 rpcz_store.cc:276] 0709 12:11:00.537417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:00.537582 (+   165us) service_pool.cc:224] Handling call
0709 12:11:00.554609 (+ 17027us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:00.842948 (+288339us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:01.735464 (+892516us) spinlock_profiling.cc:243] Waited 219 ms on lock 0x7b54003a43d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:11:01.735855 (+   391us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":502598912}
I20260709 12:11:01.965385 17583 raft_consensus.cc:493] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:01.728783 14182 raft_consensus.cc:1240] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 8 LEADER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 12:11:01.829196 17196 raft_consensus.cc:493] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:01.836768 14154 leader_election.cc:304] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
W20260709 12:11:02.033851 14876 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:01.973676 14331 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50856 (request call id 1984) took 1018 ms. Trace:
I20260709 12:11:02.043061 14331 rpcz_store.cc:276] 0709 12:11:00.955660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:01.971802 (+1016142us) service_pool.cc:224] Handling call
0709 12:11:01.972405 (+   603us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:01.973306 (+   901us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:01.973557 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:02.036859 14333 rpcz_store.cc:276] 0709 12:11:00.192751 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:00.882292 (+689541us) service_pool.cc:224] Handling call
0709 12:11:00.882637 (+   345us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:01.567969 (+685332us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:01.758308 (+190339us) spinlock_profiling.cc:243] Waited 642 ms on lock 0x7b54000b8454. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:11:01.758830 (+   522us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1475521792}
I20260709 12:11:01.972141 17511 raft_consensus.cc:3060] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:02.033859 14911 rpcz_store.cc:269] 0709 12:11:00.676787 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:00.676927 (+   140us) service_pool.cc:224] Handling call
0709 12:11:01.934565 (+1257638us) spinlock_profiling.cc:243] Waited 883 ms on lock 0x7b5400692dd4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:11:01.934896 (+   331us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2030264192}
I20260709 12:11:01.938962 14337 rpcz_store.cc:276] 0709 12:11:00.229288 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:00.921837 (+692549us) service_pool.cc:224] Handling call
0709 12:11:00.962116 (+ 40279us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:00.962773 (+   657us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:01.739950 (+777177us) spinlock_profiling.cc:243] Waited 39.9 ms on lock 0x7b540047e350. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713a8ad 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:11:01.740297 (+   347us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":91685632}
I20260709 12:11:01.974370 17439 raft_consensus.cc:740] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:11:01.940146 14264 rpcz_store.cc:276] 0709 12:11:00.647279 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:00.941863 (+294584us) service_pool.cc:224] Handling call
0709 12:11:00.942147 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:01.237905 (+295758us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:01.785596 (+547691us) spinlock_profiling.cc:243] Waited 295 ms on lock 0x7b54001b26d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:11:01.786069 (+   473us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":678454016}
I20260709 12:11:02.033416 14339 rpcz_store.cc:276] 0709 12:11:00.497259 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:01.019785 (+522526us) service_pool.cc:224] Handling call
0709 12:11:01.020079 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:01.275169 (+255090us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:01.750429 (+475260us) spinlock_profiling.cc:243] Waited 230 ms on lock 0x7b5400338e54. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:11:01.750832 (+   403us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":529188608}
I20260709 12:11:02.053107 14336 raft_consensus.cc:1275] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
W20260709 12:11:01.640765 17647 log.cc:927] Time spent T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.790s	user 0.005s	sys 0.003s
I20260709 12:11:02.065306 14336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50858 (request call id 1660) took 1177 ms. Trace:
I20260709 12:11:02.066175 14336 rpcz_store.cc:276] 0709 12:11:00.883259 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:01.954780 (+1071521us) service_pool.cc:224] Handling call
0709 12:11:01.955534 (+   754us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:02.059279 (+103745us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:02.060346 (+  1067us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:02.067693 14331 raft_consensus.cc:1275] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:11:02.067421 17196 raft_consensus.cc:515] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:02.068423 17541 leader_election.cc:290] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 11 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:02.068569 14331 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50858 (request call id 1662) took 1110 ms. Trace:
W20260709 12:11:02.069398 14154 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 233077us
I20260709 12:11:02.070101 17439 consensus_queue.cc:260] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:02.071659 17439 raft_consensus.cc:3060] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:01.958704 17408 consensus_queue.cc:260] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:02.073853 17616 raft_consensus.cc:493] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
W20260709 12:11:02.074486 14876 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:02.075166 14190 raft_consensus.cc:2393] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 7: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:11:02.074765 17616 raft_consensus.cc:515] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:02.076449 14185 raft_consensus.cc:3060] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:02.076766 17500 consensus_queue.cc:1048] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:02.078341 17568 consensus_queue.cc:1059] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:02.078933 17577 raft_consensus.cc:2804] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:02.069084 14331 rpcz_store.cc:276] 0709 12:11:00.958300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:02.056920 (+1098620us) service_pool.cc:224] Handling call
0709 12:11:02.064903 (+  7983us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:02.068172 (+  3269us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:02.068394 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:02.079576 17577 raft_consensus.cc:493] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:11:02.080121 17577 raft_consensus.cc:3060] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:02.080487 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:02.082792 14331 raft_consensus.cc:2393] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 7: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:11:02.082312 17583 raft_consensus.cc:515] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:01.635653 17602 raft_consensus.cc:515] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:02.084582 17437 raft_consensus.cc:3055] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:02.085112 17437 raft_consensus.cc:740] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:11:01.937973 14332 rpcz_store.cc:276] 0709 12:11:00.170018 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:00.873334 (+703316us) service_pool.cc:224] Handling call
0709 12:11:00.873705 (+   371us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:00.954174 (+ 80469us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:11:00.954206 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:00.954700 (+   494us) log.cc:844] Serialized 26 byte log entry
0709 12:11:01.748392 (+793692us) spinlock_profiling.cc:243] Waited 13.9 ms on lock 0x7b1800047560. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f212cf16ab1 00007f212cf23281 00007f2126ce34bc 00007f212403148b 00007f212ce8b9a9 00007f212404d69b 00007f212404b93f 00007f212404dc02 00007f2126cd520b 00007f2126cdad23 00007f2126cdb0d1
0709 12:11:01.748879 (+   487us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:11:01.749019 (+   140us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:01.749194 (+   175us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:01.749259 (+    65us) raft_consensus.cc:1685] finished
0709 12:11:01.749274 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:01.749625 (+   351us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":79946,"raft.queue_time_us":92254,"raft.run_cpu_time_us":183,"raft.run_wall_time_us":18638,"spinlock_wait_cycles":31924864,"thread_start_us":49123,"threads_started":1,"wal-append.queue_time_us":155740}
W20260709 12:11:01.975236 14085 rpcz_store.cc:269] 0709 12:10:40.303530 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:40.304291 (+   761us) service_pool.cc:224] Handling call
0709 12:10:40.938189 (+633898us) spinlock_profiling.cc:243] Waited 6.22 ms on lock 0x7b5400030890. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2124016e9c 00007f21240170f6 00007f212cf90759 00007f212cf28a76 00007f212cef9d58 00007f212cff804e 00007f212b4b92a4 00007f212b4b9232 00007f212b4b9161 00007f212b4b90dc
0709 12:11:01.974400 (+21036211us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:59.771303 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:59.771909 (+   606us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:59.771949 (+    40us) write_op.cc:435] Acquired schema lock
0709 12:10:59.771971 (+    22us) tablet.cc:662] Decoding operations
0709 12:10:59.772565 (+   594us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:59.772649 (+    84us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:59.772675 (+    26us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:10:59.773019 (+   344us) tablet.cc:701] Row locks acquired
0709 12:10:59.773036 (+    17us) write_op.cc:260] PREPARE: finished
0709 12:10:59.773244 (+   208us) write_op.cc:270] Start()
0709 12:10:59.773384 (+   140us) write_op.cc:276] Timestamp: P: 1783599059773169 usec, L: 0
0709 12:10:59.773404 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 12:10:59.871158 (+ 97754us) log.cc:844] Serialized 1311 byte log entry
0709 12:11:00.413241 (+542083us) op_driver.cc:464] REPLICATION: finished
0709 12:11:00.659784 (+246543us) write_op.cc:301] APPLY: starting
0709 12:11:00.664629 (+  4845us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:00.696170 (+ 31541us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:00.698246 (+  2076us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:00.698737 (+   491us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:00.698937 (+   200us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 12:11:00.698986 (+    49us) write_op.cc:312] APPLY: finished
0709 12:11:00.699212 (+   226us) log.cc:844] Serialized 35 byte log entry
0709 12:11:00.699407 (+   195us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:00.699506 (+    99us) write_op.cc:454] Released schema lock
0709 12:11:00.699558 (+    52us) write_op.cc:341] FINISH: Updating metrics
0709 12:11:00.699943 (+   385us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:00.699972 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":242607,"reported_tablets":17,"spinlock_wait_cycles":14306560,"child_traces":[["op",{"apply.queue_time_us":227461,"apply.run_cpu_time_us":2247,"apply.run_wall_time_us":43282,"num_ops":3,"prepare.queue_time_us":55324,"prepare.run_cpu_time_us":18006,"prepare.run_wall_time_us":225273,"replication_time_us":633074,"thread_start_us":179296,"threads_started":2}]]}
I20260709 12:11:02.086495 17437 consensus_queue.cc:260] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:02.088088 17437 raft_consensus.cc:3060] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:02.088438 14877 leader_election.cc:304] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:02.084132 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:02.089577 17588 raft_consensus.cc:2749] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:01.938647 14334 rpcz_store.cc:276] 0709 12:11:00.509256 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:01.055495 (+546239us) service_pool.cc:224] Handling call
0709 12:11:01.055854 (+   359us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:01.093054 (+ 37200us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:01.093092 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:01.093645 (+   553us) log.cc:844] Serialized 26 byte log entry
0709 12:11:01.318666 (+225021us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:11:01.318717 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:01.318807 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:01.739636 (+420829us) raft_consensus.cc:1685] finished
0709 12:11:01.739688 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:01.740107 (+   419us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37585,"raft.queue_time_us":42316,"raft.run_cpu_time_us":187,"raft.run_wall_time_us":9300,"thread_start_us":188403,"threads_started":1,"wal-append.queue_time_us":457366}
I20260709 12:11:02.085094 17408 raft_consensus.cc:3060] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:02.084906 17105 raft_consensus.cc:493] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:02.094614 17105 raft_consensus.cc:515] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:02.074234 17536 raft_consensus.cc:2749] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:11:02.096946 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 244083us
I20260709 12:11:02.095100 14339 raft_consensus.cc:1275] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:11:02.065109 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:02.094549 14331 raft_consensus.cc:2468] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 7.
I20260709 12:11:02.099323 14182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 2375) took 1363 ms. Trace:
I20260709 12:11:01.970337 17654 leader_election.cc:290] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:11:02.100806 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:01.964923 17338 raft_consensus.cc:515] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:02.097500 17500 consensus_queue.cc:1048] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:02.099852 14182 rpcz_store.cc:276] 0709 12:11:00.735753 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:00.746409 (+ 10656us) service_pool.cc:224] Handling call
0709 12:11:00.746857 (+   448us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:01.728058 (+981201us) spinlock_profiling.cc:243] Waited 5.25 ms on lock 0x7b5400318920. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f21270b2dc0 00007f212713d1c0 00007f212713e231 00007f212713ad8f 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c
0709 12:11:02.055845 (+327787us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:02.099257 (+ 43412us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12072704}
I20260709 12:11:02.106822 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:02.105235 14339 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50858 (request call id 1663) took 1140 ms. Trace:
I20260709 12:11:02.110229 14339 rpcz_store.cc:276] 0709 12:11:00.958681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:02.056335 (+1097654us) service_pool.cc:224] Handling call
0709 12:11:02.094622 (+ 38287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:02.098498 (+  3876us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:02.098723 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:11:02.109958 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 231814us
I20260709 12:11:02.112088 17105 leader_election.cc:290] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:02.112366 17367 raft_consensus.cc:493] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:02.113031 17367 raft_consensus.cc:515] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:02.115630 17367 leader_election.cc:290] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:02.117290 14260 raft_consensus.cc:2468] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 7.
I20260709 12:11:02.118055 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:02.119810 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:02.122514 17571 raft_consensus.cc:2804] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:02.123225 17571 raft_consensus.cc:697] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 7 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:11:02.124554 17571 consensus_queue.cc:237] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:02.124601 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:01.618629 17529 leader_election.cc:290] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 8 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:02.129072 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:01.621980 17585 leader_election.cc:290] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:02.132026 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:11:02.138150 14155 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:02.141062 14330 raft_consensus.cc:1240] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 12:11:02.122627 17616 leader_election.cc:290] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:02.141559 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:02.139936 14332 pending_rounds.cc:85] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c: Aborting all ops after (but not including) 4
I20260709 12:11:02.131625 17317 raft_consensus.cc:3060] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:02.143647 14183 raft_consensus.cc:2468] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 8.
I20260709 12:11:02.133478 17105 raft_consensus.cc:493] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:11:02.143662 14332 pending_rounds.cc:107] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 12:11:02.150321 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:02.152109 14332 raft_consensus.cc:2889] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:02.130385 17654 raft_consensus.cc:493] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:11:02.160720 14333 raft_consensus.cc:1240] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:11:02.165503 14333 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50856 (request call id 1987) took 1185 ms. Trace:
I20260709 12:11:02.166136 14333 rpcz_store.cc:276] 0709 12:11:00.979872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:02.066750 (+1086878us) service_pool.cc:224] Handling call
0709 12:11:02.134333 (+ 67583us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:02.161265 (+ 26932us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:02.165416 (+  4151us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:02.167917 17434 raft_consensus.cc:493] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:02.168576 17434 raft_consensus.cc:515] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:02.169041 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:02.170564 14904 raft_consensus.cc:2468] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 7.
W20260709 12:11:02.171315 14156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:02.163367 17338 leader_election.cc:290] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:02.174319 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:02.177536 17105 raft_consensus.cc:515] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:02.178831 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:11:02.179629 17525 raft_consensus.cc:493] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:02.180027 17105 leader_election.cc:290] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:02.180225 17525 raft_consensus.cc:515] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:02.180719 14184 raft_consensus.cc:3060] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:02.184805 14903 raft_consensus.cc:1240] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 5. Current term is 6. Ops: []
I20260709 12:11:02.187028 14906 raft_consensus.cc:1240] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 5. Current term is 6. Ops: []
I20260709 12:11:02.191257 14908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:02.192859 14265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41768 (request call id 1616) took 1654 ms. Trace:
I20260709 12:11:01.666527 17632 raft_consensus.cc:515] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:02.195683 14907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:02.196158 17632 leader_election.cc:290] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 9 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:02.159147 14876 leader_election.cc:304] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:02.170929 17434 leader_election.cc:290] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:02.193262 14265 rpcz_store.cc:276] 0709 12:11:00.538624 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:00.538750 (+   126us) service_pool.cc:224] Handling call
0709 12:11:00.555485 (+ 16735us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:02.064265 (+1508780us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:02.192514 (+128249us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b54002c0954. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:11:02.192761 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2712397056}
I20260709 12:11:02.204011 14230 leader_election.cc:304] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:11:02.235741 14187 raft_consensus.cc:2468] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 5.
I20260709 12:11:02.242211 14185 raft_consensus.cc:2468] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 8.
I20260709 12:11:02.246490 14189 raft_consensus.cc:2393] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 10: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
W20260709 12:11:02.248941 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 119067us
I20260709 12:11:02.204753 17196 leader_election.cc:290] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:02.277768 14337 raft_consensus.cc:1240] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 8 LEADER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 7. Current term is 8. Ops: [7.3-7.3]
W20260709 12:11:02.280529 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 139830us
W20260709 12:11:02.282142 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 74321.6us
I20260709 12:11:02.244895 17583 leader_election.cc:290] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:02.287834 17602 leader_election.cc:290] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 9 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:11:02.288424 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 96261.8us
I20260709 12:11:02.299881 17385 raft_consensus.cc:493] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:02.300750 17385 raft_consensus.cc:515] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:02.303849 17385 leader_election.cc:290] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:02.304565 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:11:02.295166 14908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:02.305548 14910 raft_consensus.cc:3060] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:02.309088 14302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:02.312734 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:02.318285 14907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:02.322417 14185 raft_consensus.cc:2393] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 8: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:11:02.299757 17434 raft_consensus.cc:2804] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:02.262146 17654 raft_consensus.cc:515] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:02.322952 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:02.329128 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:02.329769 14908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:02.312692 17313 raft_consensus.cc:493] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:02.332691 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:02.332947 14330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50858 (request call id 1648) took 2133 ms. Trace:
I20260709 12:11:02.335850 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:02.335412 14331 raft_consensus.cc:2468] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 7.
I20260709 12:11:02.334743 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:02.335541 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:02.326045 17434 raft_consensus.cc:493] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:02.335896 14330 rpcz_store.cc:276] 0709 12:11:00.193488 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:00.920735 (+727247us) service_pool.cc:224] Handling call
0709 12:11:00.964501 (+ 43766us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:02.141630 (+1177129us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:02.316282 (+174652us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b54000fd7d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:11:02.326336 (+ 10054us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2470416768}
I20260709 12:11:02.341944 14907 raft_consensus.cc:2468] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 5.
I20260709 12:11:02.348675 14154 leader_election.cc:304] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:02.346101 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:02.341435 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:02.338601 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:11:02.352947 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:02.347329 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:02.353013 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:02.340497 17382 raft_consensus.cc:2804] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:02.347752 17434 raft_consensus.cc:3060] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:02.352433 14335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50856 (request call id 1981) took 1390 ms. Trace:
I20260709 12:11:02.351154 14908 raft_consensus.cc:2468] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 10.
I20260709 12:11:02.371095 14909 raft_consensus.cc:3060] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:02.371383 14189 raft_consensus.cc:2468] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 4.
I20260709 12:11:02.371766 17391 raft_consensus.cc:493] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:02.372324 17391 raft_consensus.cc:515] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:02.373291 14339 raft_consensus.cc:2393] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 8: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:11:02.371173 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:02.375344 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:02.345665 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:02.377823 14336 raft_consensus.cc:2393] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 9: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:11:02.378069 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:02.369783 14335 rpcz_store.cc:276] 0709 12:11:00.954894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:00.967847 (+ 12953us) service_pool.cc:224] Handling call
0709 12:11:02.333108 (+1365261us) spinlock_profiling.cc:243] Waited 780 ms on lock 0x7b54000b7a54. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:11:02.344830 (+ 11722us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1793368832}
I20260709 12:11:02.376593 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:02.382455 14187 raft_consensus.cc:1240] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 4. Current term is 5. Ops: []
I20260709 12:11:02.385056 14265 raft_consensus.cc:2393] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 8: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:11:02.380687 14876 leader_election.cc:304] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
W20260709 12:11:02.387410 14154 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 52562.8us
I20260709 12:11:02.383543 14260 raft_consensus.cc:2468] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 8.
I20260709 12:11:02.384269 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:02.387972 14331 raft_consensus.cc:2468] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 4.
I20260709 12:11:02.394754 14185 raft_consensus.cc:3060] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:02.397908 17408 raft_consensus.cc:2804] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:02.398430 17408 raft_consensus.cc:493] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:02.398838 17408 raft_consensus.cc:3060] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:11:02.403116 17647 log.cc:927] Time spent T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 12:11:02.406131 17582 raft_consensus.cc:493] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:02.407780 14259 raft_consensus.cc:2393] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 10: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:11:02.406399 14338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 551) took 2705 ms. Trace:
I20260709 12:11:02.371524 17382 raft_consensus.cc:697] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 9 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:11:02.407086 17582 raft_consensus.cc:515] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:02.410849 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:02.411826 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:02.412278 17619 ts_tablet_manager.cc:1929] T f4739bc22bfe44fcba807da02d9351b6 P 885067a0d31741bfb5c9935788e315bf: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 6.6
I20260709 12:11:02.412813 14903 raft_consensus.cc:1240] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:02.413996 17503 raft_consensus.cc:493] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:11:02.414387 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:02.415031 17607 raft_consensus.cc:2804] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:11:02.415418 17391 leader_election.cc:290] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:02.419092 17654 leader_election.cc:290] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:02.419445 14333 raft_consensus.cc:1240] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:02.428790 14910 raft_consensus.cc:2468] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 9.
I20260709 12:11:02.448382 14909 raft_consensus.cc:2468] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 9.
I20260709 12:11:02.450048 14339 raft_consensus.cc:2468] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 6.
I20260709 12:11:02.454072 14262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41764 (request call id 2412) took 1733 ms. Trace:
I20260709 12:11:02.453676 17583 raft_consensus.cc:493] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:02.448350 14154 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 54746us
I20260709 12:11:02.449523 14337 raft_consensus.cc:2468] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 8.
I20260709 12:11:02.451299 14303 leader_election.cc:304] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:02.461858 14262 rpcz_store.cc:276] 0709 12:11:00.720414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:00.996492 (+276078us) service_pool.cc:224] Handling call
0709 12:11:01.784172 (+787680us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:02.055986 (+271814us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:02.452307 (+396321us) spinlock_profiling.cc:243] Waited 773 ms on lock 0x7b54002210d0. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713a8ad 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:11:02.453992 (+  1685us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1778029952}
I20260709 12:11:02.456080 14185 raft_consensus.cc:2468] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 9.
I20260709 12:11:02.458524 14155 leader_election.cc:304] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:02.455379 17607 raft_consensus.cc:493] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:02.408241 14338 rpcz_store.cc:276] 0709 12:10:59.700952 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:00.528520 (+827568us) service_pool.cc:224] Handling call
0709 12:11:00.528845 (+   325us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:00.529218 (+   373us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:00.529247 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:00.540515 (+ 11268us) log.cc:844] Serialized 26 byte log entry
0709 12:11:00.769951 (+229436us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:00.780538 (+ 10587us) log.cc:844] Serialized 14 byte log entry
0709 12:11:00.780826 (+   288us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:00.780900 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:01.219263 (+438363us) spinlock_profiling.cc:243] Waited 29.9 ms on lock 0x7b18003d2be0. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f212cf16ab1 00007f212cf23281 00007f212404e3f3 00007f21240507c1 00007f2124050779 00007f2124050709 00007f21240506d1 00007f212404f9cd 0000000000388634 0000000000388479 00007f212403183a
0709 12:11:01.640121 (+420858us) spinlock_profiling.cc:243] Waited 16.6 ms on lock 0x7b4400022b4c. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2123f74c85 00007f2123f756a2 00007f2126ce71db 00007f2126ce2aaf 00007f2126cd686e 00007f2126cd5bb6 00007f2126cd57d8 00007f2126cdf221 00007f2126cdf1d9 00007f2126cdf169
0709 12:11:02.405824 (+765703us) raft_consensus.cc:1685] finished
0709 12:11:02.405867 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:02.406134 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4168,"prepare.queue_time_us":6515,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":4083,"raft.queue_time_us":7297,"raft.run_cpu_time_us":365,"raft.run_wall_time_us":21576,"spinlock_wait_cycles":106847872,"thread_start_us":229108,"threads_started":1,"wal-append.queue_time_us":309349}
W20260709 12:11:02.473984 14156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:02.453635 17317 consensus_queue.cc:1059] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
W20260709 12:11:02.483516 17676 log.cc:927] Time spent T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 12:11:02.483232 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:02.484372 17382 consensus_queue.cc:237] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:02.485357 17511 raft_consensus.cc:2749] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:02.470703 17619 log.cc:1199] T f4739bc22bfe44fcba807da02d9351b6 P 885067a0d31741bfb5c9935788e315bf: Deleting WAL directory at /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598886212958-12986-0/minicluster-data/ts-0-root/wals/f4739bc22bfe44fcba807da02d9351b6
I20260709 12:11:02.457994 17503 raft_consensus.cc:515] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:02.479328 17588 consensus_queue.cc:1059] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 12:11:02.491902 14333 raft_consensus.cc:1275] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
W20260709 12:11:02.497520 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:02.499487 17582 leader_election.cc:290] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:02.505213 17583 raft_consensus.cc:515] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:02.453222 17568 consensus_queue.cc:1048] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 12:11:02.533990 17446 raft_consensus.cc:493] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:02.534600 17446 raft_consensus.cc:515] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:02.536366 17513 raft_consensus.cc:3055] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:11:02.536866 17513 raft_consensus.cc:740] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:11:02.537173 17446 leader_election.cc:290] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:02.537842 17616 consensus_queue.cc:1059] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:02.538204 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:02.538932 14333 raft_consensus.cc:3060] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:02.539391 17619 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:59324 (request call id 78) took 2775 ms. Trace:
I20260709 12:11:02.539855 17619 rpcz_store.cc:276] 0709 12:10:59.790843 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:59.828759 (+ 37916us) service_pool.cc:224] Handling call
0709 12:11:00.371765 (+543006us) ts_tablet_manager.cc:1151] Deleting tablet f4739bc22bfe44fcba807da02d9351b6
0709 12:11:00.388176 (+ 16411us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 12:11:01.648084 (+1259908us) tablet_metadata.cc:665] Metadata flushed
0709 12:11:02.411992 (+763908us) tablet_metadata.cc:665] Metadata flushed
0709 12:11:02.539287 (+127295us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":151858,"tablet-delete.queue_time_us":164434,"thread_start_us":122867,"threads_started":1}
I20260709 12:11:02.540802 14339 raft_consensus.cc:2468] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 7.
W20260709 12:11:02.533433 17681 log.cc:927] Time spent T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.137s	user 0.000s	sys 0.001s
I20260709 12:11:02.536484 17583 leader_election.cc:290] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:02.514422 14181 raft_consensus.cc:2468] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 12.
I20260709 12:11:02.545156 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:02.546042 14331 raft_consensus.cc:2468] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 8.
W20260709 12:11:02.546631 14875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:02.547276 17467 consensus_queue.cc:1059] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:11:02.548456 17467 consensus_queue.cc:1059] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:11:02.549314 17467 consensus_queue.cc:1243] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer 65c9c1653b3346b39a0e118540e6080c log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:11:02.468561 17607 raft_consensus.cc:3060] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:02.479697 17439 raft_consensus.cc:2749] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:11:02.528025 14154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:02.512285 14904 raft_consensus.cc:1240] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:11:02.458178 17313 raft_consensus.cc:515] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:02.532380 17588 raft_consensus.cc:3055] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:02.559222 14184 raft_consensus.cc:2468] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 9.
I20260709 12:11:02.572512 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:02.592549 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
W20260709 12:11:02.573771 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 164529us
W20260709 12:11:02.577852 14878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:02.570155 17467 raft_consensus.cc:3055] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:11:02.560631 17582 raft_consensus.cc:3055] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:02.570204 17588 raft_consensus.cc:740] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:11:02.537952 17385 consensus_queue.cc:1059] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.064s
I20260709 12:11:02.624161 17568 consensus_queue.cc:1048] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:02.626080 14338 raft_consensus.cc:1240] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 12:11:02.607385 14073 catalog_manager.cc:5028] TS 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): tablet f4739bc22bfe44fcba807da02d9351b6 (table test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]) successfully deleted
I20260709 12:11:02.624148 17500 raft_consensus.cc:3055] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:11:02.628574 17500 raft_consensus.cc:740] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:11:02.629797 17500 consensus_queue.cc:260] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:02.615497 17467 raft_consensus.cc:740] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:11:02.634847 17500 raft_consensus.cc:3060] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:02.648005 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:02.615726 17582 raft_consensus.cc:740] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
W20260709 12:11:02.656876 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:02.660830 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:02.664338 14184 raft_consensus.cc:2393] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 8: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
W20260709 12:11:02.674288 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 282706us
W20260709 12:11:02.674472 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 295724us
I20260709 12:11:02.677392 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
W20260709 12:11:02.680895 14876 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:02.681406 14876 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:02.679548 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:02.688719 14181 raft_consensus.cc:2393] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 7: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:11:02.571973 17577 raft_consensus.cc:515] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:02.693797 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:02.599622 17513 consensus_queue.cc:260] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:02.688812 17511 raft_consensus.cc:493] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:02.715981 17583 raft_consensus.cc:493] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:02.716622 17511 raft_consensus.cc:515] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:02.716866 17583 raft_consensus.cc:515] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:02.719640 17583 leader_election.cc:290] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:02.686815 17525 leader_election.cc:290] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:11:02.723623 14155 leader_election.cc:336] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Timed out: RequestConsensusVote RPC to 127.12.174.130:36673 timed out after 1.677s (SENT)
I20260709 12:11:02.711922 14188 raft_consensus.cc:2468] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 10.
I20260709 12:11:02.710722 17632 raft_consensus.cc:493] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:02.729820 17313 leader_election.cc:290] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:02.730490 17313 raft_consensus.cc:493] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:02.730311 17632 raft_consensus.cc:515] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:02.731130 17313 raft_consensus.cc:515] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } }
I20260709 12:11:02.732880 17632 leader_election.cc:290] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:02.733409 17313 leader_election.cc:290] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187)
I20260709 12:11:02.638648 17588 consensus_queue.cc:260] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:02.738070 14332 raft_consensus.cc:2468] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 8.
I20260709 12:11:02.738658 17588 raft_consensus.cc:3060] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:02.739457 17685 log.cc:927] Time spent T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.215s	user 0.000s	sys 0.001s
W20260709 12:11:02.743825 17687 log.cc:927] Time spent T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.067s	user 0.002s	sys 0.000s
W20260709 12:11:02.747992 14156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:02.745595 17434 raft_consensus.cc:515] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:02.749994 14906 raft_consensus.cc:2368] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 8. Current term is 9.
I20260709 12:11:02.749215 14087 catalog_manager.cc:5697] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:11:02.752846 17434 leader_election.cc:290] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 9 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:02.752185 14087 catalog_manager.cc:5697] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf reported cstate change: term changed from 5 to 6, leader changed from 65c9c1653b3346b39a0e118540e6080c (127.12.174.131) to 885067a0d31741bfb5c9935788e315bf (127.12.174.129). New cstate: current_term: 6 leader_uuid: "885067a0d31741bfb5c9935788e315bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:02.768675 14087 catalog_manager.cc:5697] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:11:02.762374 17503 leader_election.cc:290] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:02.765930 17467 consensus_queue.cc:260] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:02.770871 17467 raft_consensus.cc:3060] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:11:02.719668 17511 leader_election.cc:290] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:02.714579 17568 raft_consensus.cc:3055] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:02.775261 17568 raft_consensus.cc:740] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
W20260709 12:11:02.776978 14305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:02.776535 17568 consensus_queue.cc:260] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:02.778155 17582 consensus_queue.cc:260] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:02.779726 17582 raft_consensus.cc:3060] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:02.782132 14155 leader_election.cc:304] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:02.786764 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
W20260709 12:11:02.787861 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 75047.3us
I20260709 12:11:02.761729 14877 leader_election.cc:304] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 885067a0d31741bfb5c9935788e315bf
W20260709 12:11:02.790006 17695 log.cc:927] Time spent T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.103s	user 0.001s	sys 0.001s
I20260709 12:11:02.801901 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:02.802265 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
W20260709 12:11:02.801527 17680 log.cc:927] Time spent T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 12:11:02.809029 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:11:02.797042 17687 log.cc:927] Time spent T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.052s	user 0.003s	sys 0.000s
I20260709 12:11:02.813831 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:02.814530 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:02.817999 14181 raft_consensus.cc:2410] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 12:11:02.823717 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:02.691980 17571 consensus_queue.cc:1059] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.108s
I20260709 12:11:02.816314 14876 leader_election.cc:304] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:02.826817 14303 leader_election.cc:304] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:02.798336 17317 raft_consensus.cc:2749] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:02.838378 14256 raft_consensus.cc:1240] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:02.838443 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:02.797681 17313 raft_consensus.cc:493] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:02.806666 17513 raft_consensus.cc:3060] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:02.846338 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:02.799022 17632 raft_consensus.cc:493] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:02.845573 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:02.849525 14190 raft_consensus.cc:3060] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:02.854003 14262 raft_consensus.cc:1240] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 5. Current term is 6. Ops: []
I20260709 12:11:02.844719 14087 catalog_manager.cc:5697] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf reported cstate change: term changed from 5 to 6, leader changed from 65c9c1653b3346b39a0e118540e6080c (127.12.174.131) to 885067a0d31741bfb5c9935788e315bf (127.12.174.129). New cstate: current_term: 6 leader_uuid: "885067a0d31741bfb5c9935788e315bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } }
W20260709 12:11:02.860424 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 44197.9us
I20260709 12:11:02.853082 14264 raft_consensus.cc:2468] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 7.
W20260709 12:11:02.867574 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 161862us
I20260709 12:11:02.870221 14265 raft_consensus.cc:2393] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db in current term 9: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:11:02.868824 14303 leader_election.cc:304] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:02.853602 17385 raft_consensus.cc:2804] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:02.857518 17511 raft_consensus.cc:2804] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:02.852669 17568 raft_consensus.cc:3060] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:02.880223 14259 raft_consensus.cc:2468] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 8.
W20260709 12:11:02.879374 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 117760us
W20260709 12:11:02.884414 14156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:02.877261 17696 log.cc:927] Time spent T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 12:11:02.911034 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:11:02.910749 14087 catalog_manager.cc:5697] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:11:02.912988 14154 leader_election.cc:304] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:02.914788 17317 raft_consensus.cc:2749] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:11:02.913460 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:02.915894 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 43550.8us
I20260709 12:11:02.916839 14304 leader_election.cc:304] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
W20260709 12:11:02.921380 14302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:02.922712 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:02.923604 14263 raft_consensus.cc:2468] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 8.
W20260709 12:11:02.926070 14878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:02.913120 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:02.934187 14190 raft_consensus.cc:2468] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 9.
I20260709 12:11:02.934430 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:02.871021 17692 raft_consensus.cc:2804] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:02.912945 14087 catalog_manager.cc:5697] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf reported cstate change: term changed from 8 to 11, leader changed from 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130) to 885067a0d31741bfb5c9935788e315bf (127.12.174.129). New cstate: current_term: 11 leader_uuid: "885067a0d31741bfb5c9935788e315bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } }
W20260709 12:11:02.930523 14908 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.174s	sys 0.265s
I20260709 12:11:02.912997 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
W20260709 12:11:02.938120 14908 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.527s	user 0.174s	sys 0.266s
W20260709 12:11:02.941391 14155 leader_election.cc:336] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Timed out: RequestConsensusVote RPC to 127.12.174.130:36673 timed out after 1.682s (SENT)
I20260709 12:11:02.941915 14155 leader_election.cc:304] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
W20260709 12:11:02.941943 14156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:02.943759 17583 raft_consensus.cc:2804] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:02.944249 17583 raft_consensus.cc:493] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:11:02.944645 17583 raft_consensus.cc:3060] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:02.945241 14087 catalog_manager.cc:5697] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "885067a0d31741bfb5c9935788e315bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:02.947227 14087 catalog_manager.cc:5697] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf reported cstate change: term changed from 4 to 7, leader changed from 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130) to 885067a0d31741bfb5c9935788e315bf (127.12.174.129). New cstate: current_term: 7 leader_uuid: "885067a0d31741bfb5c9935788e315bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:02.944005 17577 leader_election.cc:290] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 8 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:02.949141 14087 catalog_manager.cc:5697] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf reported cstate change: term changed from 6 to 8, leader changed from 65c9c1653b3346b39a0e118540e6080c (127.12.174.131) to 885067a0d31741bfb5c9935788e315bf (127.12.174.129). New cstate: current_term: 8 leader_uuid: "885067a0d31741bfb5c9935788e315bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:02.882227 17385 raft_consensus.cc:493] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:11:02.965798 14264 raft_consensus.cc:2468] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 9.
I20260709 12:11:02.886627 17511 raft_consensus.cc:493] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:02.863071 17632 raft_consensus.cc:515] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:02.956141 14303 leader_election.cc:304] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:11:02.963122 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:02.874321 17313 raft_consensus.cc:515] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:11:02.968791 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 52054.2us
I20260709 12:11:02.990991 14304 leader_election.cc:304] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:02.940176 17571 raft_consensus.cc:493] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:02.951800 17692 raft_consensus.cc:493] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:02.972697 17437 consensus_meta.cc:287] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db: Time spent flushing consensus metadata: real 0.883s	user 0.015s	sys 0.001s
I20260709 12:11:02.995215 14263 raft_consensus.cc:3060] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:02.993446 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:02.997260 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:02.997532 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:03.002002 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:03.000892 14259 raft_consensus.cc:2468] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 8.
I20260709 12:11:03.002914 14257 raft_consensus.cc:3060] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:02.963903 17654 raft_consensus.cc:2804] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:11:02.971217 17385 raft_consensus.cc:3060] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:02.974205 17511 raft_consensus.cc:3060] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:03.005528 14333 raft_consensus.cc:2468] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 6.
I20260709 12:11:03.005718 14304 leader_election.cc:304] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:03.019233 17632 leader_election.cc:290] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:03.012936 14260 raft_consensus.cc:2468] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 5.
I20260709 12:11:02.998172 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:03.011348 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:02.992465 17439 raft_consensus.cc:2749] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:03.025014 14256 raft_consensus.cc:3060] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:03.026683 14262 raft_consensus.cc:3060] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:03.027638 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:03.010682 17408 consensus_meta.cc:287] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.611s	user 0.012s	sys 0.006s
I20260709 12:11:03.003677 17692 raft_consensus.cc:3060] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:03.034196 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:03.008816 17577 raft_consensus.cc:493] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:03.037515 14877 leader_election.cc:304] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:11:03.035890 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:03.038885 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:03.044610 14189 raft_consensus.cc:2393] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 7: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:11:03.030725 17632 raft_consensus.cc:2804] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:03.046598 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:11:03.048193 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 146080us
I20260709 12:11:03.017463 17583 raft_consensus.cc:515] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:11:03.051525 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:03.034220 17602 raft_consensus.cc:2804] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:03.052778 14258 raft_consensus.cc:2468] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 9.
I20260709 12:11:03.056164 14263 raft_consensus.cc:2468] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 11.
I20260709 12:11:03.058697 14877 leader_election.cc:304] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:03.058275 14184 raft_consensus.cc:1240] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 12:11:03.059441 14261 raft_consensus.cc:2468] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 10.
I20260709 12:11:03.064198 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:11:03.065564 14264 raft_consensus.cc:1275] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 12:11:03.061826 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 154276us
I20260709 12:11:03.053777 17437 raft_consensus.cc:2804] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:03.075747 14911 raft_consensus.cc:2468] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 10.
I20260709 12:11:03.076426 14876 leader_election.cc:304] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:03.029628 17571 raft_consensus.cc:515] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:03.057063 17602 raft_consensus.cc:493] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
W20260709 12:11:03.079617 14155 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:03.045378 17577 raft_consensus.cc:515] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:03.038268 17408 raft_consensus.cc:515] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:03.077124 17437 raft_consensus.cc:493] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:03.081797 17434 raft_consensus.cc:2804] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:11:03.082029 17602 raft_consensus.cc:3060] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:03.109822 14229 leader_election.cc:304] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:03.082459 17503 raft_consensus.cc:2804] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:03.111955 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
W20260709 12:11:03.112298 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 68630.1us
I20260709 12:11:03.102648 17437 raft_consensus.cc:3060] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:03.126093 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:03.133853 17503 raft_consensus.cc:697] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [term 9 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:11:03.135020 17503 consensus_queue.cc:237] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:11:03.136633 17698 log.cc:927] Time spent T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:11:03.145840 17434 raft_consensus.cc:697] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 6 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:11:03.150198 17571 leader_election.cc:290] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:03.150348 17434 consensus_queue.cc:237] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:03.151649 17467 raft_consensus.cc:2749] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:03.151719 17317 consensus_queue.cc:1059] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:11:03.153427 17317 raft_consensus.cc:3055] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:03.138113 17654 raft_consensus.cc:697] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 5 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:03.153837 17317 raft_consensus.cc:740] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:11:03.154960 17654 consensus_queue.cc:237] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:03.127193 17382 raft_consensus.cc:493] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:03.170498 14256 raft_consensus.cc:2468] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 9.
I20260709 12:11:03.163573 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:03.129549 17615 raft_consensus.cc:493] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:03.178117 14911 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59144 (request call id 339) took 1034 ms. Trace:
I20260709 12:11:03.154985 17317 consensus_queue.cc:260] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:03.178552 14911 rpcz_store.cc:276] 0709 12:11:02.159867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:02.178523 (+ 18656us) service_pool.cc:224] Handling call
0709 12:11:03.174009 (+995486us) spinlock_profiling.cc:243] Waited 825 ms on lock 0x7b54004bc8d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:11:03.174138 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1897773952}
I20260709 12:11:03.177556 14265 raft_consensus.cc:2468] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 9.
I20260709 12:11:03.217507 17632 raft_consensus.cc:697] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 8 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:03.219264 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:11:03.221359 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 285401us
I20260709 12:11:03.151829 17616 consensus_queue.cc:1048] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 12:11:03.234704 14261 raft_consensus.cc:2468] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 8.
I20260709 12:11:03.234833 17632 consensus_queue.cc:237] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:03.237382 14906 raft_consensus.cc:2468] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 9.
W20260709 12:11:03.234781 17693 log.cc:927] Time spent T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.124s	user 0.000s	sys 0.001s
I20260709 12:11:03.239832 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:03.242903 14259 raft_consensus.cc:3060] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:11:03.241357 14155 leader_election.cc:304] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
W20260709 12:11:03.245890 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:03.241681 14303 leader_election.cc:304] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
W20260709 12:11:03.254842 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 148989us
I20260709 12:11:03.218852 17313 leader_election.cc:290] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:03.238139 17571 raft_consensus.cc:493] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:03.178726 17382 raft_consensus.cc:515] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:11:03.258777 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 253106us
I20260709 12:11:03.266860 14304 leader_election.cc:304] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:03.201618 17615 raft_consensus.cc:515] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:03.283020 14229 leader_election.cc:304] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
W20260709 12:11:03.285377 17700 log.cc:927] Time spent T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.147s	user 0.000s	sys 0.001s
I20260709 12:11:03.286525 17382 leader_election.cc:290] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:11:03.287299 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 45701.5us
I20260709 12:11:03.287714 17705 raft_consensus.cc:2749] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:11:03.289889 14305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:03.292532 14304 leader_election.cc:304] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:03.260281 17583 leader_election.cc:290] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 8 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:03.297955 14303 leader_election.cc:304] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:03.265661 17317 raft_consensus.cc:3060] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:11:03.329408 14878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:03.308159 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:03.253433 17697 consensus_queue.cc:1048] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
W20260709 12:11:03.341938 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 49503.4us
I20260709 12:11:03.350677 14908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59144 (request call id 348) took 1030 ms. Trace:
I20260709 12:11:03.335167 17408 leader_election.cc:290] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 7 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:11:03.355436 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:03.370855 14257 raft_consensus.cc:2468] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 9.
I20260709 12:11:03.347371 17616 raft_consensus.cc:2804] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:11:03.376919 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 79101.8us
I20260709 12:11:03.346868 17582 raft_consensus.cc:2749] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:11:03.375094 17511 raft_consensus.cc:515] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:03.302592 17571 raft_consensus.cc:515] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:03.377715 14905 raft_consensus.cc:2410] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:11:03.379333 17704 raft_consensus.cc:2804] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:03.340911 17602 raft_consensus.cc:515] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:03.284251 17692 raft_consensus.cc:515] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:03.382077 17703 raft_consensus.cc:2804] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:03.352772 14908 rpcz_store.cc:276] 0709 12:11:02.319964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:02.382136 (+ 62172us) service_pool.cc:224] Handling call
0709 12:11:02.382512 (+   376us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:02.382943 (+   431us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:02.382979 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:02.393410 (+ 10431us) log.cc:844] Serialized 26 byte log entry
0709 12:11:02.956772 (+563362us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:02.956830 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:02.956915 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:03.350401 (+393486us) raft_consensus.cc:1685] finished
0709 12:11:03.350422 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:03.350593 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4490,"raft.queue_time_us":4669,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":16708,"thread_start_us":527489,"threads_started":1,"wal-append.queue_time_us":645867}
I20260709 12:11:03.376767 17616 raft_consensus.cc:493] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:03.387602 17616 raft_consensus.cc:3060] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:03.388824 17692 leader_election.cc:290] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 11 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:11:03.389909 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 119310us
I20260709 12:11:03.391062 17602 leader_election.cc:290] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 9 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:03.391578 14229 leader_election.cc:304] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
W20260709 12:11:03.395579 14154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:03.396229 14154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:03.376637 17705 raft_consensus.cc:3060] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:03.403098 14304 leader_election.cc:304] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:03.383100 17583 raft_consensus.cc:2749] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:03.354503 17437 raft_consensus.cc:515] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:03.407829 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:03.392666 17577 leader_election.cc:290] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:03.406880 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:03.415329 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:03.416656 14184 raft_consensus.cc:2468] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 9.
I20260709 12:11:03.405174 17582 raft_consensus.cc:2749] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:11:03.418335 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:03.418725 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:03.419121 14188 raft_consensus.cc:2468] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 6.
I20260709 12:11:03.419611 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:03.422462 14189 raft_consensus.cc:2393] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 9: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:11:03.422341 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:03.427783 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:03.423344 14182 raft_consensus.cc:2468] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 7.
I20260709 12:11:03.430133 14304 leader_election.cc:304] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:11:03.432164 14304 leader_election.cc:304] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:11:03.433066 14304 leader_election.cc:304] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:03.434623 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:03.435307 14185 raft_consensus.cc:2468] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 10.
I20260709 12:11:03.434590 14304 leader_election.cc:304] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:11:03.406325 17703 raft_consensus.cc:697] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 9 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
W20260709 12:11:03.445106 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:03.450148 14262 raft_consensus.cc:2468] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 9.
I20260709 12:11:03.447752 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:03.457692 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:03.458767 14182 raft_consensus.cc:2410] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for term 8 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 12:11:03.459182 17716 log.cc:927] Time spent T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:11:03.462085 17725 raft_consensus.cc:2804] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:03.412168 17704 raft_consensus.cc:697] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 12 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:03.442962 14259 raft_consensus.cc:2468] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 9.
W20260709 12:11:03.478214 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 241280us
W20260709 12:11:03.494374 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 78412.2us
I20260709 12:11:03.474073 17728 raft_consensus.cc:493] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:03.463398 17723 raft_consensus.cc:2804] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:03.479686 14877 leader_election.cc:304] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:03.506888 17703 consensus_queue.cc:237] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:03.507956 17707 raft_consensus.cc:2804] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:03.510519 17704 consensus_queue.cc:237] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:03.512627 17615 leader_election.cc:290] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:03.501890 17709 raft_consensus.cc:2804] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:03.501377 17722 raft_consensus.cc:2804] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:03.552291 17722 raft_consensus.cc:493] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:03.552668 17722 raft_consensus.cc:3060] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:03.552884 17437 leader_election.cc:290] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 9 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:03.474583 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:03.527619 17602 raft_consensus.cc:493] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:03.558202 17602 raft_consensus.cc:515] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:11:03.532830 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:03.518097 17500 consensus_meta.cc:287] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.876s	user 0.015s	sys 0.005s
I20260709 12:11:03.552104 17709 raft_consensus.cc:493] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:11:03.541304 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:11:03.543463 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:03.559598 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:03.546561 14904 raft_consensus.cc:1275] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:11:03.560343 17602 leader_election.cc:290] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:03.562091 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:03.551687 17707 raft_consensus.cc:493] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:03.562863 17707 raft_consensus.cc:3060] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:03.546813 17385 consensus_meta.cc:287] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db: Time spent flushing consensus metadata: real 0.514s	user 0.011s	sys 0.001s
I20260709 12:11:03.563366 17385 raft_consensus.cc:515] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:03.564415 14908 raft_consensus.cc:1240] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:03.547247 17691 raft_consensus.cc:3055] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:03.566615 17691 raft_consensus.cc:740] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
W20260709 12:11:03.567131 17513 consensus_meta.cc:287] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.712s	user 0.011s	sys 0.000s
I20260709 12:11:03.567749 14912 raft_consensus.cc:2468] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 7.
I20260709 12:11:03.567606 17691 consensus_queue.cc:260] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:03.568861 17691 raft_consensus.cc:3060] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:03.541095 17607 consensus_meta.cc:287] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db: Time spent flushing consensus metadata: real 0.931s	user 0.013s	sys 0.007s
I20260709 12:11:03.547794 17511 leader_election.cc:290] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 9 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:03.569847 17607 raft_consensus.cc:515] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:03.558436 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:03.565593 17385 leader_election.cc:290] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 9 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:03.572125 17607 leader_election.cc:290] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 6 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:03.559532 17709 raft_consensus.cc:3060] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:03.474763 14304 leader_election.cc:304] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
W20260709 12:11:03.586073 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 169458us
I20260709 12:11:03.552099 14229 leader_election.cc:304] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:03.586503 14154 leader_election.cc:304] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
W20260709 12:11:03.588493 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 108889us
W20260709 12:11:03.589391 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 114714us
I20260709 12:11:03.589706 17500 consensus_queue.cc:1059] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:03.591468 14304 leader_election.cc:304] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:11:03.545334 17723 raft_consensus.cc:493] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:03.595567 14156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:03.615023 14156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:03.597114 17382 raft_consensus.cc:2804] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:11:03.597993 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 46065.2us
I20260709 12:11:03.597375 17385 consensus_queue.cc:1059] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:03.592129 17615 raft_consensus.cc:2749] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:03.599381 14155 leader_election.cc:304] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:03.600347 17408 consensus_queue.cc:1059] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:03.587462 17616 raft_consensus.cc:515] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:03.610085 17500 raft_consensus.cc:3055] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:03.627187 17500 raft_consensus.cc:740] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:11:03.628187 17500 consensus_queue.cc:260] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:03.629005 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:03.629424 17500 raft_consensus.cc:3060] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:03.631573 17408 raft_consensus.cc:3055] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:03.631973 17408 raft_consensus.cc:740] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:11:03.632901 17408 consensus_queue.cc:260] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:03.611688 17602 raft_consensus.cc:493] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:11:03.612648 14304 leader_election.cc:304] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:11:03.613199 17511 raft_consensus.cc:2804] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:03.613565 17583 raft_consensus.cc:493] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:03.613766 17654 raft_consensus.cc:493] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:11:03.597005 14877 leader_election.cc:304] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:03.540674 17725 raft_consensus.cc:697] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 11 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:03.623816 14155 leader_election.cc:304] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:03.590273 17703 raft_consensus.cc:2804] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:03.622481 17382 raft_consensus.cc:493] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:03.626776 17616 leader_election.cc:290] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 8 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:03.629594 14185 raft_consensus.cc:3060] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:03.610595 17513 raft_consensus.cc:2804] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:03.634011 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:03.634742 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:03.678644 14182 raft_consensus.cc:2468] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 6.
I20260709 12:11:03.480891 17632 consensus_queue.cc:1048] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.107s
I20260709 12:11:03.652485 14229 leader_election.cc:304] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
W20260709 12:11:03.658025 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 61096.7us
I20260709 12:11:03.658643 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:03.629918 17697 raft_consensus.cc:2804] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:03.627331 17385 raft_consensus.cc:3055] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:11:03.621915 17723 raft_consensus.cc:3060] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:03.680101 14876 leader_election.cc:304] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:03.682366 14183 raft_consensus.cc:3060] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:11:03.653641 17511 raft_consensus.cc:493] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:03.634598 17602 raft_consensus.cc:515] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:03.635811 17735 raft_consensus.cc:493] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:03.577275 17728 raft_consensus.cc:515] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:03.693868 14303 leader_election.cc:304] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:03.622219 17709 raft_consensus.cc:515] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:03.703665 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:03.704255 14257 raft_consensus.cc:3060] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:03.699101 14155 leader_election.cc:304] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:03.682248 17607 raft_consensus.cc:2804] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:03.659310 17571 leader_election.cc:290] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:03.702013 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:03.710821 14262 raft_consensus.cc:3060] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:03.678218 17382 raft_consensus.cc:3060] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:03.700570 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:03.701576 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:03.706269 14303 leader_election.cc:304] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:03.712373 14336 raft_consensus.cc:3060] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:03.685791 17697 raft_consensus.cc:493] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:11:03.715442 17697 raft_consensus.cc:3060] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:03.684813 17385 raft_consensus.cc:740] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:11:03.718263 17385 consensus_queue.cc:260] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:03.694651 17513 raft_consensus.cc:697] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 7 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:11:03.720288 17513 consensus_queue.cc:237] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:11:03.714056 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:03.723372 14336 raft_consensus.cc:2468] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 9.
W20260709 12:11:03.724154 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:03.703555 17699 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.012s	sys 0.009s
I20260709 12:11:03.734786 17731 raft_consensus.cc:493] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:03.695277 17511 raft_consensus.cc:3060] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:03.697785 17408 raft_consensus.cc:3060] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:03.746212 17733 log.cc:927] Time spent T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 12:11:03.747390 17616 raft_consensus.cc:2804] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:03.747788 17616 raft_consensus.cc:493] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:11:03.748133 17616 raft_consensus.cc:3060] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:03.710002 17582 raft_consensus.cc:2804] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:03.750236 17582 raft_consensus.cc:697] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 9 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:11:03.750119 17725 consensus_queue.cc:237] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:03.751171 17582 consensus_queue.cc:237] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:03.657549 17583 raft_consensus.cc:515] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:03.693024 17704 raft_consensus.cc:493] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:03.734978 17699 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.584s	user 0.012s	sys 0.009s
I20260709 12:11:03.735425 17731 raft_consensus.cc:515] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:03.713101 14338 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78"
dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
mode: GRACEFUL
new_leader_uuid: "17aab1bbf5014936aa18cc21818b26ec"
 from {username='slave'} at 127.0.0.1:50896
I20260709 12:11:03.779700 14338 raft_consensus.cc:606] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Received request to transfer leadership to TS 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:11:03.779793 14877 leader_election.cc:304] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:11:03.740562 17728 leader_election.cc:290] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:03.697988 17437 raft_consensus.cc:2804] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:03.710225 17607 raft_consensus.cc:493] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:11:03.742298 17744 raft_consensus.cc:2804] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:03.742182 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:11:03.754809 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:03.754743 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 142171us
I20260709 12:11:03.757956 14185 raft_consensus.cc:2468] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 11.
I20260709 12:11:03.761698 14257 raft_consensus.cc:2468] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 6.
I20260709 12:11:03.776500 14262 raft_consensus.cc:2468] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 9.
I20260709 12:11:03.780141 14338 raft_consensus.cc:614] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:03.738822 17732 raft_consensus.cc:2804] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:11:03.782804 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:03.795336 14332 raft_consensus.cc:3060] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:03.796842 14259 raft_consensus.cc:2468] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 5.
I20260709 12:11:03.684870 17654 raft_consensus.cc:515] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:03.796649 14876 leader_election.cc:304] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:03.776136 17705 raft_consensus.cc:2749] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:03.801822 14336 raft_consensus.cc:1275] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:11:03.807754 17583 leader_election.cc:290] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:03.808449 17583 raft_consensus.cc:2804] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:11:03.808816 17583 raft_consensus.cc:493] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:11:03.809185 17583 raft_consensus.cc:3060] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:03.810418 17707 raft_consensus.cc:515] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:03.812098 17385 raft_consensus.cc:3060] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:03.812692 17707 leader_election.cc:290] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 11 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:03.813259 17707 raft_consensus.cc:493] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:03.814042 17745 raft_consensus.cc:493] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:11:03.814587 17745 raft_consensus.cc:515] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:03.817185 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:03.817785 14263 raft_consensus.cc:3060] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:03.818115 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:03.818745 14259 raft_consensus.cc:2468] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 6.
I20260709 12:11:03.819355 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:03.819841 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:03.820900 14337 raft_consensus.cc:1240] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:11:03.821615 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:03.822073 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:03.822700 14330 raft_consensus.cc:2468] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 10.
I20260709 12:11:03.822781 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:03.823511 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 9 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:03.823923 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:03.825028 14331 raft_consensus.cc:1275] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:11:03.825341 14334 raft_consensus.cc:1275] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:11:03.827138 14229 leader_election.cc:400] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 8 pre-election: Vote denied by peer 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341) with higher term. Message: Invalid argument: T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 8. Current term is 9.
I20260709 12:11:03.827450 14229 leader_election.cc:403] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:11:03.827926 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 64493.5us
I20260709 12:11:03.828029 17571 raft_consensus.cc:2749] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341) with higher term. Message: Invalid argument: T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 8. Current term is 9.
I20260709 12:11:03.828681 14229 leader_election.cc:304] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:03.829515 17571 raft_consensus.cc:2749] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:11:03.823455 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:03.821013 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:03.822204 14264 raft_consensus.cc:3060] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:03.818112 14261 raft_consensus.cc:1275] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 8 index: 3. (index mismatch)
I20260709 12:11:03.832329 14229 leader_election.cc:304] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:03.733377 17697 raft_consensus.cc:515] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:03.786952 17437 raft_consensus.cc:493] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:03.840777 14339 raft_consensus.cc:2468] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 10.
I20260709 12:11:03.841109 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:03.816723 17745 leader_election.cc:290] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:03.846385 14262 raft_consensus.cc:1240] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 5. Current term is 6. Ops: []
I20260709 12:11:03.846480 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:03.860148 14265 raft_consensus.cc:3060] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:03.847210 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:03.860860 14258 raft_consensus.cc:2468] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 10.
I20260709 12:11:03.847878 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:03.792816 17607 raft_consensus.cc:3060] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:03.827096 17740 log.cc:927] Time spent T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 12:11:03.844416 17722 raft_consensus.cc:515] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:03.856132 14183 raft_consensus.cc:2468] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 6.
I20260709 12:11:03.825263 17726 raft_consensus.cc:2804] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:03.858976 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:03.831151 17632 raft_consensus.cc:2749] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:11:03.870195 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 171184us
I20260709 12:11:03.863308 14264 raft_consensus.cc:2468] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 8.
I20260709 12:11:03.851349 17703 raft_consensus.cc:697] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 9 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:03.851891 17437 raft_consensus.cc:3060] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:03.866298 14335 raft_consensus.cc:2368] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 8. Current term is 9.
I20260709 12:11:03.797611 17732 raft_consensus.cc:493] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:03.867152 14261 raft_consensus.cc:3060] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:03.710628 17735 raft_consensus.cc:515] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:11:03.894050 17694 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.008s	sys 0.015s
W20260709 12:11:03.894435 17694 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.734s	user 0.008s	sys 0.016s
I20260709 12:11:03.895993 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:03.896270 17697 leader_election.cc:290] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 8 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:03.896893 14258 raft_consensus.cc:2393] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 10: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:11:03.898276 17703 consensus_queue.cc:237] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:03.813721 17707 raft_consensus.cc:515] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:03.903347 17735 leader_election.cc:290] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:03.903790 17707 leader_election.cc:290] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:03.891741 17732 raft_consensus.cc:3060] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:11:03.813674 17382 raft_consensus.cc:515] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:03.906738 17382 leader_election.cc:290] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 7 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:03.907639 17616 raft_consensus.cc:515] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:03.910215 14264 raft_consensus.cc:1275] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:11:03.867420 14876 leader_election.cc:304] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:03.785530 17704 raft_consensus.cc:515] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:03.918622 17704 leader_election.cc:290] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:03.870922 14155 leader_election.cc:304] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
W20260709 12:11:03.876394 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 76147.9us
I20260709 12:11:03.919836 14230 leader_election.cc:304] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:11:03.921554 14336 raft_consensus.cc:2393] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 9: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
W20260709 12:11:03.877305 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 45073.5us
I20260709 12:11:03.923982 14229 leader_election.cc:304] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:03.858280 17588 raft_consensus.cc:2804] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:03.888583 14256 raft_consensus.cc:2393] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 10: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:11:03.857263 14263 raft_consensus.cc:2468] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 9.
W20260709 12:11:03.933637 14154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:03.935315 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 64469.7us
I20260709 12:11:03.936167 14155 leader_election.cc:304] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
W20260709 12:11:03.941220 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 235014us
I20260709 12:11:03.939229 14304 leader_election.cc:304] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:11:03.943549 14230 leader_election.cc:304] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:11:03.944741 14303 leader_election.cc:304] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec
W20260709 12:11:03.947273 14154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:03.929334 14332 raft_consensus.cc:2468] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 9.
I20260709 12:11:03.950249 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:03.887506 17577 raft_consensus.cc:2804] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:03.951031 14263 raft_consensus.cc:2468] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 8.
W20260709 12:11:03.951352 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 84044.9us
I20260709 12:11:03.922857 17616 leader_election.cc:290] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 7 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:03.955936 14303 leader_election.cc:304] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:03.945815 14304 leader_election.cc:304] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:11:03.934221 17691 raft_consensus.cc:2804] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:03.933488 17726 raft_consensus.cc:697] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 9 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:11:03.959673 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 11 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:03.964818 14265 raft_consensus.cc:2468] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 9.
I20260709 12:11:03.974078 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:03.974277 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:03.975024 14263 raft_consensus.cc:2376] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 10. Re-sending same reply.
I20260709 12:11:03.977042 17446 raft_consensus.cc:493] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:03.960098 17745 consensus_queue.cc:1048] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 12:11:03.978138 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:03.978791 14258 raft_consensus.cc:2376] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 9. Re-sending same reply.
I20260709 12:11:03.952587 17699 consensus_queue.cc:1048] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 12:11:03.977658 17446 raft_consensus.cc:515] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:03.978554 14256 raft_consensus.cc:2468] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 10.
I20260709 12:11:03.981530 17446 leader_election.cc:290] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:03.983510 17731 leader_election.cc:290] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:03.951347 17718 raft_consensus.cc:2749] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:03.958181 17503 raft_consensus.cc:2804] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:11:03.987829 17503 raft_consensus.cc:697] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [term 6 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:11:03.951195 17707 raft_consensus.cc:2804] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:03.990387 17707 raft_consensus.cc:493] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:03.990761 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 45055.4us
I20260709 12:11:03.946399 17511 raft_consensus.cc:515] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:03.991717 14304 leader_election.cc:304] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:11:03.993052 14304 leader_election.cc:304] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:11:03.951138 17735 consensus_queue.cc:1048] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.042s
I20260709 12:11:03.994040 17745 raft_consensus.cc:2804] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:03.994474 17745 raft_consensus.cc:493] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:03.994814 17745 raft_consensus.cc:3060] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:03.996821 17583 raft_consensus.cc:515] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:03.997975 17705 raft_consensus.cc:2804] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:03.998620 17705 raft_consensus.cc:697] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 8 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:03.999063 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:03.999687 17705 consensus_queue.cc:237] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:04.002346 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:11:04.003360 14904 raft_consensus.cc:2393] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 9: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
I20260709 12:11:03.952788 17513 consensus_queue.cc:1059] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 12:11:03.950490 17571 raft_consensus.cc:2749] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:11:04.006640 14156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:03.954357 17408 raft_consensus.cc:2804] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:04.007002 14304 leader_election.cc:304] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:03.934469 17382 consensus_queue.cc:1048] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 12:11:03.950788 17714 raft_consensus.cc:493] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:11:04.007020 14261 raft_consensus.cc:2468] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 11.
I20260709 12:11:04.008744 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
W20260709 12:11:04.022311 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:04.024276 14156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:03.957777 17632 raft_consensus.cc:2804] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:03.957650 17720 raft_consensus.cc:493] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:04.060262 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 11 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:04.062071 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:04.056988 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:04.033615 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:04.065383 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:04.034694 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:03.988991 17503 consensus_queue.cc:237] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:03.960940 17691 raft_consensus.cc:493] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:04.019750 17408 raft_consensus.cc:493] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:03.970796 17568 consensus_queue.cc:1048] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.083s
I20260709 12:11:04.049825 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:04.050037 17571 raft_consensus.cc:2804] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:04.050379 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:04.050621 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:04.051188 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:04.051412 17583 leader_election.cc:290] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 6 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:04.051890 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:03.990854 17707 raft_consensus.cc:3060] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:04.066433 14261 raft_consensus.cc:2368] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 8. Current term is 9.
I20260709 12:11:04.066409 14190 raft_consensus.cc:3060] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:04.078594 14258 raft_consensus.cc:2393] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 9: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:11:04.081220 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:04.078672 14256 raft_consensus.cc:2376] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 8. Re-sending same reply.
I20260709 12:11:04.078730 14265 raft_consensus.cc:2393] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 7: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:11:04.065892 14182 raft_consensus.cc:2468] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 10.
I20260709 12:11:04.084255 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:04.084865 14182 raft_consensus.cc:3060] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:04.066804 14187 raft_consensus.cc:2368] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for earlier term 10. Current term is 11.
W20260709 12:11:04.067857 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 94230.8us
I20260709 12:11:04.067915 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:04.077212 17735 raft_consensus.cc:3060] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:04.106984 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:04.044589 17718 raft_consensus.cc:493] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:04.027185 17746 raft_consensus.cc:2804] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:04.046873 17704 raft_consensus.cc:2749] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:04.126719 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:04.059269 17439 raft_consensus.cc:3055] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:11:04.134090 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 48344.2us
I20260709 12:11:04.128274 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:04.134323 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:04.068233 17691 raft_consensus.cc:3060] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:04.147032 14188 raft_consensus.cc:1275] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 8 index: 3. (term mismatch)
I20260709 12:11:04.077819 17408 raft_consensus.cc:3060] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:04.147526 14188 pending_rounds.cc:85] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf: Aborting all ops after (but not including) 2
I20260709 12:11:04.148530 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:04.081383 17571 raft_consensus.cc:493] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:04.077786 17632 raft_consensus.cc:697] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 9 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:04.139398 14186 raft_consensus.cc:2468] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 8.
I20260709 12:11:04.143265 14304 leader_election.cc:304] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:11:04.151202 14188 pending_rounds.cc:107] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf: Aborting uncommitted NO_OP operation due to leader change: 7.3
I20260709 12:11:04.150911 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:04.150964 14335 raft_consensus.cc:2468] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 10.
I20260709 12:11:04.152880 14190 raft_consensus.cc:2468] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 11.
I20260709 12:11:04.153692 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:04.155282 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:04.155818 17746 raft_consensus.cc:697] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 9 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:04.156142 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:04.157454 17654 leader_election.cc:290] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:04.159492 14877 leader_election.cc:304] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
W20260709 12:11:04.175742 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:04.127573 17709 leader_election.cc:290] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 10 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:11:04.218983 14156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:04.247121 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 87705.7us
I20260709 12:11:04.064175 17714 raft_consensus.cc:515] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:11:04.282426 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 338922us
I20260709 12:11:04.284879 14261 raft_consensus.cc:2468] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 10.
W20260709 12:11:04.260721 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 99814.8us
I20260709 12:11:04.288941 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:04.289773 14257 raft_consensus.cc:3060] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:04.116008 17744 raft_consensus.cc:697] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 9 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:04.292640 14258 raft_consensus.cc:2368] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 5. Current term is 6.
I20260709 12:11:04.244588 14188 raft_consensus.cc:2889] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:04.134730 17439 raft_consensus.cc:740] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
W20260709 12:11:04.242619 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 99443.7us
I20260709 12:11:04.296416 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:04.298385 14304 leader_election.cc:304] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:11:04.299162 14264 raft_consensus.cc:2393] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 8: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:11:04.300709 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:04.302389 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:04.303007 14259 raft_consensus.cc:3060] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:04.297060 14877 leader_election.cc:304] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:11:04.160190 17571 raft_consensus.cc:3060] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:04.306432 14304 leader_election.cc:304] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:11:04.316190 14230 leader_election.cc:400] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 8 election: Vote denied by peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957) with higher term. Message: Invalid argument: T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 8. Current term is 9.
I20260709 12:11:04.339306 14230 leader_election.cc:403] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 12:11:04.149080 17745 raft_consensus.cc:515] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:04.295496 17725 raft_consensus.cc:2804] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:04.078207 17720 raft_consensus.cc:515] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:04.295810 17317 raft_consensus.cc:493] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:04.338326 14261 raft_consensus.cc:1275] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:11:04.136409 17718 raft_consensus.cc:515] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:04.300995 17692 raft_consensus.cc:493] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:04.342720 14256 raft_consensus.cc:2468] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 9.
I20260709 12:11:04.301235 17701 raft_consensus.cc:493] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:04.307639 17446 raft_consensus.cc:2804] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:04.354394 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:11:04.360725 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 54397.7us
I20260709 12:11:04.318606 17709 raft_consensus.cc:2804] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:04.365447 14303 leader_election.cc:304] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:04.311589 17588 raft_consensus.cc:697] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 11 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:11:04.375101 14257 raft_consensus.cc:2468] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 10.
I20260709 12:11:04.377349 17385 raft_consensus.cc:2804] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:04.249449 17726 consensus_queue.cc:237] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:04.379765 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:04.366066 17725 raft_consensus.cc:493] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:04.382655 17745 leader_election.cc:290] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 11 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:04.382920 14259 raft_consensus.cc:2468] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 10.
I20260709 12:11:04.383234 17720 leader_election.cc:290] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:04.387094 17746 consensus_queue.cc:237] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:04.394451 17382 consensus_queue.cc:1048] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:04.398561 17616 consensus_queue.cc:1059] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:11:04.345501 17582 consensus_queue.cc:1048] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.057s
W20260709 12:11:04.401168 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:04.401168 17500 consensus_meta.cc:287] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.771s	user 0.011s	sys 0.000s
W20260709 12:11:04.468150 17607 consensus_meta.cc:287] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db: Time spent flushing consensus metadata: real 0.561s	user 0.005s	sys 0.006s
I20260709 12:11:04.333105 17513 raft_consensus.cc:493] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:04.422154 17632 consensus_queue.cc:237] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:04.426999 17511 leader_election.cc:290] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 10 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:11:04.428679 17732 consensus_meta.cc:287] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.524s	user 0.008s	sys 0.000s
I20260709 12:11:04.444679 17446 raft_consensus.cc:697] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [term 9 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:11:04.436203 14258 raft_consensus.cc:2368] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 4. Current term is 5.
I20260709 12:11:04.354353 17748 raft_consensus.cc:493] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:04.439755 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 74388us
I20260709 12:11:04.440059 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:04.507368 14257 raft_consensus.cc:2393] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 9: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:11:04.508884 14303 leader_election.cc:304] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:11:04.372023 17704 raft_consensus.cc:2804] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:04.355264 17615 raft_consensus.cc:493] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:11:04.444129 14261 raft_consensus.cc:2368] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 7. Current term is 8.
I20260709 12:11:04.445117 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:04.449108 14182 raft_consensus.cc:2468] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 10.
W20260709 12:11:04.460331 14154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:04.470813 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:04.406203 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:04.442934 17385 raft_consensus.cc:493] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:04.469146 17725 raft_consensus.cc:3060] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:04.434151 14304 leader_election.cc:304] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:11:04.431358 17317 raft_consensus.cc:515] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:04.468647 17583 raft_consensus.cc:2749] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:04.444682 17709 raft_consensus.cc:697] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 9 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:04.444875 17577 raft_consensus.cc:697] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 9 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
W20260709 12:11:04.506532 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:04.511662 14303 leader_election.cc:304] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:04.434609 17692 raft_consensus.cc:515] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:04.512081 14265 raft_consensus.cc:1275] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 12:11:04.489615 17747 raft_consensus.cc:3055] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:11:04.522046 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 88000.1us
I20260709 12:11:04.579202 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:04.644992 14188 raft_consensus.cc:2468] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 10.
I20260709 12:11:04.520113 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:04.646042 14257 raft_consensus.cc:2393] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 10: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:11:04.520859 17500 raft_consensus.cc:493] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:04.521704 17385 raft_consensus.cc:3060] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:04.513934 17745 raft_consensus.cc:2804] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:04.512693 17704 raft_consensus.cc:493] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:04.591876 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
W20260709 12:11:04.576293 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 267977us
I20260709 12:11:04.655483 14230 leader_election.cc:304] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:11:04.592365 14183 raft_consensus.cc:1275] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:11:04.440322 17439 consensus_queue.cc:260] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:04.570149 14182 raft_consensus.cc:1240] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:04.438746 17701 raft_consensus.cc:515] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:04.502247 17607 raft_consensus.cc:515] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:11:04.593276 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 296295us
I20260709 12:11:04.501802 17513 raft_consensus.cc:515] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:04.543660 17602 leader_election.cc:290] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:04.673399 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:04.673836 14335 raft_consensus.cc:1275] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:11:04.594681 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:04.595233 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:04.551487 17763 raft_consensus.cc:2804] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:04.638470 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:04.444696 17744 consensus_queue.cc:237] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:04.639251 14184 raft_consensus.cc:2468] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 9.
I20260709 12:11:04.642617 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
W20260709 12:11:04.643185 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:04.644198 17747 raft_consensus.cc:740] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
W20260709 12:11:04.648658 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 270600us
I20260709 12:11:04.512432 17732 raft_consensus.cc:515] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:11:04.602586 17723 consensus_meta.cc:287] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.902s	user 0.004s	sys 0.008s
I20260709 12:11:04.523643 17615 raft_consensus.cc:515] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:04.692860 17769 raft_consensus.cc:493] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:11:04.693954 17771 raft_consensus.cc:2804] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:04.694305 17701 leader_election.cc:290] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:04.694180 17769 raft_consensus.cc:515] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:04.695976 17615 leader_election.cc:290] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:11:04.696532 17758 log.cc:927] Time spent T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.134s	user 0.000s	sys 0.001s
I20260709 12:11:04.696635 17769 leader_election.cc:290] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:04.545558 17766 raft_consensus.cc:2749] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957) with higher term. Message: Invalid argument: T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 8. Current term is 9.
W20260709 12:11:04.648263 17756 log.cc:927] Time spent T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.136s	user 0.000s	sys 0.001s
I20260709 12:11:04.519209 17748 raft_consensus.cc:515] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:04.699013 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:04.699558 17748 leader_election.cc:290] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:04.700582 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:04.701440 14260 raft_consensus.cc:2393] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 11: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:11:04.701891 17709 consensus_queue.cc:237] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:04.702927 14190 raft_consensus.cc:1240] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 4. Current term is 5. Ops: []
I20260709 12:11:04.705188 17747 consensus_queue.cc:260] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:04.705858 17723 raft_consensus.cc:515] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:04.706337 17747 raft_consensus.cc:3060] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:04.708257 17723 leader_election.cc:290] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 11 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:04.708395 17577 consensus_queue.cc:237] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:04.601440 17588 consensus_queue.cc:237] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:04.712661 17718 leader_election.cc:290] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:04.716230 17439 raft_consensus.cc:3060] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:04.717248 17607 leader_election.cc:290] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 9 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:04.719606 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:04.673468 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:04.652783 17745 raft_consensus.cc:493] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:11:04.680383 14181 raft_consensus.cc:2468] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 7.
W20260709 12:11:04.643020 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 131457us
I20260709 12:11:04.682915 14908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:11:04.747469 14908 raft_consensus.cc:3060] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:04.747534 14303 leader_election.cc:304] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:04.684953 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:04.749696 14339 raft_consensus.cc:2393] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db in current term 6: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:11:04.688838 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:04.649788 17714 leader_election.cc:290] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:04.661569 17704 raft_consensus.cc:3060] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:04.761588 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:04.679446 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:04.762573 14265 raft_consensus.cc:2393] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 9: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
W20260709 12:11:04.680192 14229 connection.cc:256] RPC call timeout handler was delayed by -1.0516935410000769s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15080000000000002s for a response
I20260709 12:11:04.692852 17768 raft_consensus.cc:493] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:04.702337 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:04.720496 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:04.766100 14257 raft_consensus.cc:2393] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 10: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:11:04.639582 17770 raft_consensus.cc:493] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:04.766702 17770 raft_consensus.cc:515] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:04.767392 17768 raft_consensus.cc:515] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:04.769398 17770 leader_election.cc:290] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:04.693359 17750 raft_consensus.cc:493] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:04.752343 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:04.783813 14181 raft_consensus.cc:2468] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 5.
I20260709 12:11:04.751933 14189 raft_consensus.cc:2468] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 9.
I20260709 12:11:04.770097 17768 leader_election.cc:290] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:04.770422 17692 leader_election.cc:290] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:04.643903 17446 consensus_queue.cc:237] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:04.770563 14912 raft_consensus.cc:2468] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 10.
I20260709 12:11:04.789350 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:04.692992 17763 raft_consensus.cc:697] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 11 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:04.792088 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:04.792657 17763 consensus_queue.cc:237] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:04.701639 17732 leader_election.cc:290] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:04.720945 17771 raft_consensus.cc:493] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:04.794129 17771 raft_consensus.cc:3060] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:04.797089 17408 consensus_meta.cc:287] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.539s	user 0.006s	sys 0.003s
I20260709 12:11:04.784390 14904 raft_consensus.cc:2468] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 7.
W20260709 12:11:04.781642 17437 consensus_meta.cc:287] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db: Time spent flushing consensus metadata: real 0.850s	user 0.014s	sys 0.006s
I20260709 12:11:04.654129 17500 raft_consensus.cc:515] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:04.689297 17582 raft_consensus.cc:493] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:04.699733 14186 raft_consensus.cc:2468] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 10.
I20260709 12:11:04.779057 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:11:04.720427 17511 raft_consensus.cc:2749] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:11:04.812634 17582 raft_consensus.cc:515] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:04.816726 17582 leader_election.cc:290] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:04.820638 17500 leader_election.cc:290] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:11:04.809176 17707 consensus_meta.cc:287] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.657s	user 0.007s	sys 0.003s
I20260709 12:11:04.821556 17707 raft_consensus.cc:515] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:04.823685 17707 leader_election.cc:290] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 8 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:11:04.825095 17691 consensus_meta.cc:287] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.575s	user 0.003s	sys 0.007s
I20260709 12:11:04.825546 17691 raft_consensus.cc:515] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:04.828112 14263 raft_consensus.cc:2393] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 7: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:11:04.752688 17745 raft_consensus.cc:3060] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:04.827684 17571 raft_consensus.cc:515] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:04.829528 14260 raft_consensus.cc:2393] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 11: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:11:04.833055 17385 raft_consensus.cc:515] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:11:04.777681 17775 log.cc:927] Time spent T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.071s	user 0.000s	sys 0.003s
I20260709 12:11:04.749133 17718 raft_consensus.cc:493] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:11:04.775378 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:04.801880 17703 raft_consensus.cc:2749] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:04.793840 14189 raft_consensus.cc:1275] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 12:11:04.802057 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:04.844698 14257 raft_consensus.cc:2393] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 7: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:11:04.844091 14189 pending_rounds.cc:85] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf: Aborting all ops after (but not including) 5
I20260709 12:11:04.845527 14189 pending_rounds.cc:107] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf: Aborting uncommitted NO_OP operation due to leader change: 8.6
W20260709 12:11:04.803550 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 56114.1us
I20260709 12:11:04.806702 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 9 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:11:04.807085 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 128599us
I20260709 12:11:04.846803 14181 raft_consensus.cc:2468] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 8.
I20260709 12:11:04.807436 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:04.847908 14188 raft_consensus.cc:2393] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 6: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
I20260709 12:11:04.797531 17408 raft_consensus.cc:515] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:04.841890 17772 consensus_queue.cc:1048] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 12:11:04.790321 17750 raft_consensus.cc:515] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:04.850598 17408 leader_election.cc:290] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 9 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:04.851497 14185 raft_consensus.cc:2393] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 9: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:11:04.852480 17750 leader_election.cc:290] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:04.750922 17748 raft_consensus.cc:493] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:04.853492 17748 raft_consensus.cc:515] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:04.855700 17748 leader_election.cc:290] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:04.827978 17691 leader_election.cc:290] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 7 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:04.810981 17317 leader_election.cc:290] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:04.844209 17500 consensus_queue.cc:1048] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 12:11:04.866031 17722 leader_election.cc:290] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 9 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:04.870617 14184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56652 (request call id 805) took 1240 ms. Trace:
I20260709 12:11:04.871078 14184 rpcz_store.cc:276] 0709 12:11:03.630579 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:03.633714 (+  3135us) service_pool.cc:224] Handling call
0709 12:11:04.870406 (+1236692us) spinlock_profiling.cc:243] Waited 811 ms on lock 0x7b5400422054. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:11:04.870514 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1865666816}
I20260709 12:11:04.836679 17437 raft_consensus.cc:515] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:04.833729 14262 raft_consensus.cc:1275] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:11:04.789834 14304 leader_election.cc:304] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:11:04.841250 14908 raft_consensus.cc:2410] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:11:04.842303 14258 raft_consensus.cc:3060] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:04.801749 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:04.786105 14229 leader_election.cc:304] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:04.845801 14189 raft_consensus.cc:2889] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:04.850312 17718 raft_consensus.cc:515] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:11:04.884999 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 99048.3us
I20260709 12:11:04.848382 14303 leader_election.cc:304] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:04.898459 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:04.899273 14912 raft_consensus.cc:2468] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 10.
I20260709 12:11:04.901171 14229 leader_election.cc:304] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:04.847862 14877 leader_election.cc:304] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
W20260709 12:11:04.904400 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 114651us
I20260709 12:11:04.905211 14304 leader_election.cc:304] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
W20260709 12:11:04.908802 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 61004.7us
I20260709 12:11:04.884452 17691 raft_consensus.cc:2749] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:04.884295 17437 leader_election.cc:290] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 7 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:04.927294 17780 raft_consensus.cc:2804] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:04.927564 17760 raft_consensus.cc:2749] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:04.928221 17571 leader_election.cc:290] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 11 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:04.929888 17766 raft_consensus.cc:493] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:04.930936 17385 leader_election.cc:290] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 11 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:04.903414 17772 consensus_queue.cc:1048] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 12:11:04.942138 17784 raft_consensus.cc:2804] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:04.969833 17784 raft_consensus.cc:697] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 10 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:04.970824 17784 consensus_queue.cc:237] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:11:04.943035 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 94802.4us
W20260709 12:11:04.974347 14156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:04.976523 14303 leader_election.cc:400] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 10 pre-election: Vote denied by peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187) with higher term. Message: Invalid argument: T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for earlier term 10. Current term is 11.
I20260709 12:11:04.976878 14303 leader_election.cc:403] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:11:04.960070 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 49352us
I20260709 12:11:04.978062 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:04.979871 14190 raft_consensus.cc:1275] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 12:11:04.980258 14190 pending_rounds.cc:85] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf: Aborting all ops after (but not including) 6
I20260709 12:11:04.980489 14190 pending_rounds.cc:107] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 12:11:04.980718 14190 raft_consensus.cc:2889] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:11:04.981938 17779 log.cc:927] Time spent T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.184s	user 0.004s	sys 0.000s
I20260709 12:11:04.982123 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:04.983026 14188 raft_consensus.cc:2410] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db for term 10 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:11:04.983476 14155 leader_election.cc:304] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:04.983850 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:04.963095 17780 raft_consensus.cc:697] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 10 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:04.984860 14155 leader_election.cc:304] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:04.943625 17697 consensus_queue.cc:1048] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 12:11:04.985441 17780 consensus_queue.cc:237] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:04.961308 17439 consensus_queue.cc:1048] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 12:11:04.921944 17731 raft_consensus.cc:2804] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:04.971210 17718 leader_election.cc:290] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:04.962302 14229 leader_election.cc:304] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:04.945483 14258 raft_consensus.cc:2468] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 9.
I20260709 12:11:04.989933 14303 leader_election.cc:304] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
W20260709 12:11:04.990569 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 46005.2us
I20260709 12:11:05.008737 14188 raft_consensus.cc:1275] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:11:05.017692 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:05.020092 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:04.961972 17705 raft_consensus.cc:2749] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:05.018432 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:05.024456 14339 raft_consensus.cc:3060] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:05.027436 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:05.028182 14258 raft_consensus.cc:3060] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:11:05.030723 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:05.031446 14261 raft_consensus.cc:3060] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:05.032440 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:05.002329 17731 raft_consensus.cc:493] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:05.005777 17317 raft_consensus.cc:2804] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:05.006102 17439 raft_consensus.cc:2804] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:05.038029 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:05.038494 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:05.038825 14259 raft_consensus.cc:1275] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:11:05.048200 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:05.048990 14259 raft_consensus.cc:2393] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db in current term 7: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:11:05.012898 17751 raft_consensus.cc:3060] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:11:05.055501 14264 raft_consensus.cc:3060] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:05.057572 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:05.040004 14262 raft_consensus.cc:1275] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:11:04.998960 17704 raft_consensus.cc:515] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:05.043286 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:11:05.043629 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 100797us
I20260709 12:11:05.044697 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:05.044670 14304 leader_election.cc:304] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:11:05.064356 14257 raft_consensus.cc:1275] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 12:11:05.024219 17691 raft_consensus.cc:2749] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:05.066999 14257 pending_rounds.cc:85] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec: Aborting all ops after (but not including) 3
I20260709 12:11:05.069386 14260 raft_consensus.cc:1275] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:11:05.069403 14257 pending_rounds.cc:107] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 12:11:05.070091 14257 raft_consensus.cc:2889] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:05.060703 14155 leader_election.cc:400] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 8 election: Vote denied by peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673) with higher term. Message: Invalid argument: T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 8. Current term is 9.
I20260709 12:11:05.070664 14155 leader_election.cc:403] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 12:11:05.000716 17748 consensus_queue.cc:1059] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.046s
I20260709 12:11:05.066270 14183 raft_consensus.cc:2468] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 9.
W20260709 12:11:05.044155 17735 consensus_meta.cc:287] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.917s	user 0.008s	sys 0.004s
I20260709 12:11:05.035300 17760 raft_consensus.cc:493] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:05.071863 14229 leader_election.cc:304] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:04.990674 17745 raft_consensus.cc:515] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:05.073904 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:05.086242 14262 raft_consensus.cc:3060] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:05.075755 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:05.046777 17731 raft_consensus.cc:3060] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:05.095628 14229 leader_election.cc:304] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:05.095783 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:05.096306 17503 raft_consensus.cc:493] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:05.096596 14331 raft_consensus.cc:2393] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 11: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:11:05.097396 17577 raft_consensus.cc:2749] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:05.097945 14336 raft_consensus.cc:1240] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:05.098325 17577 raft_consensus.cc:2749] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:05.099009 17745 leader_election.cc:290] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 7 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:04.969516 17766 raft_consensus.cc:515] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:05.087535 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:05.024061 17437 consensus_queue.cc:1059] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 12:11:05.092773 14261 raft_consensus.cc:2468] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 8.
I20260709 12:11:05.085366 17735 raft_consensus.cc:2749] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:05.093524 17760 raft_consensus.cc:515] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:05.093967 17771 raft_consensus.cc:515] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:05.097429 14229 leader_election.cc:304] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:05.064922 17746 raft_consensus.cc:3060] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:05.099784 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:05.105765 14260 raft_consensus.cc:2468] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 10.
I20260709 12:11:05.101658 14258 raft_consensus.cc:2468] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 11.
I20260709 12:11:05.106720 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:05.117179 14261 raft_consensus.cc:3060] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:11:05.107906 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:05.072907 17439 raft_consensus.cc:697] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 8 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:11:05.114624 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:05.080513 17632 raft_consensus.cc:2804] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:05.188966 17632 raft_consensus.cc:697] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 9 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:05.190076 17632 consensus_queue.cc:237] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:05.039211 17725 raft_consensus.cc:515] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:05.118384 14330 raft_consensus.cc:2368] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 7. Current term is 8.
I20260709 12:11:05.118772 14183 raft_consensus.cc:3060] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:05.194311 17725 leader_election.cc:290] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 9 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:05.119840 17764 consensus_queue.cc:1048] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.103s
I20260709 12:11:05.121317 17771 leader_election.cc:290] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 11 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:05.123219 14229 leader_election.cc:304] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:05.126799 17439 consensus_queue.cc:237] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:05.129465 17691 raft_consensus.cc:2749] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:05.131707 17709 consensus_queue.cc:1048] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 12:11:05.125691 14262 raft_consensus.cc:2468] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 9.
I20260709 12:11:05.132087 17753 consensus_queue.cc:1048] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.013s
I20260709 12:11:05.131057 14304 leader_election.cc:304] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
W20260709 12:11:05.229276 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 98308.5us
I20260709 12:11:05.231482 14339 raft_consensus.cc:2410] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:11:05.232762 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:11:05.140641 17783 log.cc:927] Time spent T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 12:11:05.140820 17785 raft_consensus.cc:493] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:05.131852 17723 consensus_queue.cc:1048] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 12:11:05.135507 17746 raft_consensus.cc:2749] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:05.127538 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:05.238010 14260 raft_consensus.cc:3060] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:05.143253 14876 leader_election.cc:304] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
W20260709 12:11:05.139155 17789 log.cc:927] Time spent T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:11:05.150718 14154 leader_election.cc:304] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
W20260709 12:11:05.241166 14154 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 90579.9us
I20260709 12:11:05.153096 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:05.162082 14261 raft_consensus.cc:2468] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 7.
I20260709 12:11:05.166882 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:05.087720 17317 raft_consensus.cc:697] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 10 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
W20260709 12:11:05.256004 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:05.258394 17525 raft_consensus.cc:2804] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:05.259018 17525 raft_consensus.cc:493] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:05.259462 17525 raft_consensus.cc:3060] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:05.240609 17768 raft_consensus.cc:2749] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:05.237010 17735 raft_consensus.cc:2804] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:05.261572 17735 raft_consensus.cc:697] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 8 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:05.262605 17735 consensus_queue.cc:237] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:05.263559 14905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53194 (request call id 808) took 1255 ms. Trace:
I20260709 12:11:05.263943 14905 rpcz_store.cc:276] 0709 12:11:04.008206 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:04.008405 (+   199us) service_pool.cc:224] Handling call
0709 12:11:05.263318 (+1254913us) spinlock_profiling.cc:243] Waited 902 ms on lock 0x7b540020c454. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:11:05.263491 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2073521408}
I20260709 12:11:05.171878 17766 leader_election.cc:290] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:05.174170 17704 leader_election.cc:290] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 11 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:05.087854 17697 raft_consensus.cc:2749] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673) with higher term. Message: Invalid argument: T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 8. Current term is 9.
I20260709 12:11:05.108589 17503 raft_consensus.cc:515] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:05.184125 17760 leader_election.cc:290] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:05.184841 17718 raft_consensus.cc:3055] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:11:05.186050 17790 log.cc:927] Time spent T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 12:11:05.188256 17777 raft_consensus.cc:3055] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:11:05.195928 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 206062us
I20260709 12:11:05.281972 14303 leader_election.cc:304] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
W20260709 12:11:05.198000 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 78569.6us
I20260709 12:11:05.224517 14263 raft_consensus.cc:1275] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 12:11:05.226106 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 185072us
I20260709 12:11:05.226616 14264 raft_consensus.cc:1275] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:11:05.130656 17744 consensus_queue.cc:1048] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.015s
W20260709 12:11:05.236482 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 113345us
I20260709 12:11:05.286818 14229 leader_election.cc:304] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:05.225380 17764 consensus_queue.cc:1243] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer 17aab1bbf5014936aa18cc21818b26ec log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:11:05.143352 17767 consensus_queue.cc:1048] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.111s
I20260709 12:11:05.276281 17718 raft_consensus.cc:740] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:11:05.243119 14335 raft_consensus.cc:3060] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:05.244966 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:05.298178 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:05.298777 14330 raft_consensus.cc:3060] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:05.255514 17317 consensus_queue.cc:237] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:05.170961 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:05.303584 14333 raft_consensus.cc:2393] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db in current term 11: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
W20260709 12:11:05.267575 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 124396us
I20260709 12:11:05.244086 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:05.273267 14183 raft_consensus.cc:2468] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 7.
I20260709 12:11:05.272969 17751 raft_consensus.cc:2749] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187) with higher term. Message: Invalid argument: T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for earlier term 10. Current term is 11.
I20260709 12:11:05.239728 14230 leader_election.cc:400] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 7 election: Vote denied by peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957) with higher term. Message: Invalid argument: T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 7. Current term is 8.
I20260709 12:11:05.273170 17615 raft_consensus.cc:3060] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:05.293309 14185 raft_consensus.cc:1275] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:11:05.309351 14230 leader_election.cc:403] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 12:11:05.294905 14339 raft_consensus.cc:1275] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:11:05.302273 14190 raft_consensus.cc:1275] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 8. (term mismatch)
I20260709 12:11:05.305903 14188 raft_consensus.cc:1275] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:11:05.284574 14877 leader_election.cc:304] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:05.307647 14189 raft_consensus.cc:1275] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:11:05.244616 17720 consensus_queue.cc:1059] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 12:11:05.313264 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:05.309605 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:11:05.312322 14190 pending_rounds.cc:85] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf: Aborting all ops after (but not including) 7
I20260709 12:11:05.314766 14190 pending_rounds.cc:107] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf: Aborting uncommitted NO_OP operation due to leader change: 10.8
I20260709 12:11:05.309441 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:05.315048 14190 raft_consensus.cc:2889] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:05.311687 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:05.315685 14186 raft_consensus.cc:3060] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:11:05.315075 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 80176.3us
I20260709 12:11:05.286842 17777 raft_consensus.cc:740] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:11:05.294319 17704 raft_consensus.cc:3060] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:05.268399 17785 raft_consensus.cc:515] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:05.324765 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:11:05.339071 14912 raft_consensus.cc:3060] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:05.338595 14184 raft_consensus.cc:1275] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:11:05.341022 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:05.342124 17746 raft_consensus.cc:493] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:05.342756 17746 raft_consensus.cc:515] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:05.344625 17766 raft_consensus.cc:3055] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:05.345074 17746 leader_election.cc:290] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:05.341995 14184 raft_consensus.cc:2393] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 7: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:11:05.326143 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:05.338982 14229 leader_election.cc:304] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:05.327867 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:05.350193 14183 raft_consensus.cc:3060] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:05.308223 17780 consensus_queue.cc:1048] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 12:11:05.328307 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:05.321765 17437 consensus_queue.cc:1048] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 12:11:05.333962 17771 consensus_queue.cc:1048] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:11:05.318100 17760 raft_consensus.cc:2749] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957) with higher term. Message: Invalid argument: T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 7. Current term is 8.
I20260709 12:11:05.310367 17768 raft_consensus.cc:2749] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:05.351380 14330 raft_consensus.cc:2468] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 11.
I20260709 12:11:05.351019 14335 raft_consensus.cc:2468] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 11.
I20260709 12:11:05.469000 14155 leader_election.cc:304] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:05.341939 17577 consensus_queue.cc:1059] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.018s
I20260709 12:11:05.354581 17720 raft_consensus.cc:2749] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:05.353925 14905 raft_consensus.cc:2393] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 9: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:11:05.352749 14229 leader_election.cc:304] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:05.320871 17770 raft_consensus.cc:2749] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:05.360793 14912 raft_consensus.cc:2468] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 11.
W20260709 12:11:05.409920 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:05.460121 14184 raft_consensus.cc:1275] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:11:05.345098 17766 raft_consensus.cc:740] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:11:05.324909 17723 raft_consensus.cc:493] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:05.358424 17751 raft_consensus.cc:493] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:05.355988 14303 leader_election.cc:304] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
W20260709 12:11:05.483578 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 130903us
I20260709 12:11:05.507920 14183 raft_consensus.cc:2468] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 11.
I20260709 12:11:05.497409 14229 leader_election.cc:304] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
W20260709 12:11:05.512609 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 156719us
I20260709 12:11:05.467944 17769 raft_consensus.cc:493] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:05.478878 17748 raft_consensus.cc:2749] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:11:05.482168 17616 raft_consensus.cc:493] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:05.531998 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:05.509652 17772 raft_consensus.cc:493] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:05.513265 17709 raft_consensus.cc:2749] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:05.527658 17768 raft_consensus.cc:2804] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:11:05.557533 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 60198.1us
I20260709 12:11:05.528774 17720 raft_consensus.cc:2804] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:11:05.551990 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 91082.8us
I20260709 12:11:05.567545 14229 leader_election.cc:304] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:05.557036 17772 raft_consensus.cc:515] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:11:05.571774 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 45182.2us
I20260709 12:11:05.577589 14303 leader_election.cc:304] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:11:05.574306 14229 leader_election.cc:304] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:05.518922 17751 raft_consensus.cc:515] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:05.582715 17810 raft_consensus.cc:2804] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:11:05.583557 14155 leader_election.cc:400] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 pre-election: Vote denied by peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673) with higher term. Message: Invalid argument: T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 5. Current term is 6.
I20260709 12:11:05.558969 17503 leader_election.cc:290] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:05.592144 14155 leader_election.cc:403] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:05.527474 14903 raft_consensus.cc:2468] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 7.
I20260709 12:11:05.515091 17723 raft_consensus.cc:515] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:05.473654 17718 consensus_queue.cc:260] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:05.586392 14229 leader_election.cc:304] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:05.588788 14303 leader_election.cc:304] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:05.590245 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 11 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:05.573026 17768 raft_consensus.cc:493] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:05.590131 14335 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc"
dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
mode: GRACEFUL
new_leader_uuid: "885067a0d31741bfb5c9935788e315bf"
 from {username='slave'} at 127.0.0.1:50896
I20260709 12:11:05.618614 17582 raft_consensus.cc:2749] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:11:05.530990 17769 raft_consensus.cc:515] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:05.576105 17720 raft_consensus.cc:493] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:05.551892 17616 raft_consensus.cc:515] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:05.670668 14335 raft_consensus.cc:606] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Received request to transfer leadership to TS 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:05.676494 14335 raft_consensus.cc:614] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:11:05.672851 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 86532.1us
I20260709 12:11:05.620385 17810 raft_consensus.cc:493] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:05.648476 17780 raft_consensus.cc:2804] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:05.810199 14905 raft_consensus.cc:1275] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:11:05.825675 14184 raft_consensus.cc:1275] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
W20260709 12:11:05.828280 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:05.672881 17768 raft_consensus.cc:3060] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:05.865726 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 276984us
I20260709 12:11:05.826599 17810 raft_consensus.cc:3060] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:05.876643 14303 leader_election.cc:304] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:05.877934 17707 raft_consensus.cc:2749] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:05.878679 17707 consensus_queue.cc:1048] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 12:11:05.879062 17805 log.cc:927] Time spent T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.294s	user 0.000s	sys 0.000s
W20260709 12:11:05.881564 17803 log.cc:927] Time spent T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.234s	user 0.001s	sys 0.000s
I20260709 12:11:05.882082 17780 raft_consensus.cc:697] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 11 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:05.677347 17577 raft_consensus.cc:2804] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:05.672907 17699 raft_consensus.cc:2749] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673) with higher term. Message: Invalid argument: T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 5. Current term is 6.
I20260709 12:11:05.585356 17525 raft_consensus.cc:515] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:05.910472 17780 consensus_queue.cc:237] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:05.676586 17720 raft_consensus.cc:3060] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:05.871445 14184 raft_consensus.cc:1275] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:11:05.894676 14229 leader_election.cc:304] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:05.908802 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
W20260709 12:11:05.909785 14186 consensus_meta.cc:287] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.589s	user 0.011s	sys 0.000s
W20260709 12:11:05.912021 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 335283us
I20260709 12:11:05.915231 14188 raft_consensus.cc:1275] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:11:05.918285 14229 leader_election.cc:304] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:05.919247 14186 raft_consensus.cc:2468] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 8.
W20260709 12:11:05.885373 17731 consensus_meta.cc:287] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db: Time spent flushing consensus metadata: real 0.791s	user 0.000s	sys 0.011s
I20260709 12:11:05.585875 17766 consensus_queue.cc:260] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:05.938148 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:05.874193 17705 raft_consensus.cc:2749] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:11:05.938941 14912 raft_consensus.cc:2468] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 9.
I20260709 12:11:05.921872 14303 leader_election.cc:304] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:11:05.942759 17809 raft_consensus.cc:2804] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:05.943224 17809 raft_consensus.cc:493] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:05.943549 17809 raft_consensus.cc:3060] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:05.914714 17577 raft_consensus.cc:493] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:05.918076 17725 consensus_queue.cc:1048] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 12:11:05.963366 14155 leader_election.cc:304] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:05.926088 17771 raft_consensus.cc:2749] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:11:05.916546 17709 consensus_queue.cc:1048] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 12:11:05.969033 17705 raft_consensus.cc:493] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:05.969115 17748 raft_consensus.cc:493] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:05.965427 17577 raft_consensus.cc:3060] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:05.962703 17632 raft_consensus.cc:2804] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:11:05.969982 14260 consensus_meta.cc:287] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.721s	user 0.010s	sys 0.002s
I20260709 12:11:05.999691 14260 raft_consensus.cc:2468] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 11.
I20260709 12:11:05.979951 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:05.917258 17582 consensus_queue.cc:1048] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 12:11:06.003101 17723 leader_election.cc:290] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:05.939664 17764 consensus_queue.cc:1048] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 12:11:05.941638 17746 consensus_queue.cc:1048] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 12:11:05.971340 17699 raft_consensus.cc:2749] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:06.013954 17732 raft_consensus.cc:493] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:06.014605 17732 raft_consensus.cc:515] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:05.969341 17811 consensus_queue.cc:1048] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.051s
W20260709 12:11:06.017706 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 712457us
I20260709 12:11:06.019315 17701 consensus_queue.cc:1048] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:06.020140 17632 raft_consensus.cc:697] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 11 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:06.021148 17632 consensus_queue.cc:237] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:05.965092 17785 leader_election.cc:290] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:06.001034 14905 raft_consensus.cc:2393] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 10: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
W20260709 12:11:06.027104 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:05.972400 14155 leader_election.cc:400] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 4 pre-election: Vote denied by peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673) with higher term. Message: Invalid argument: T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 4. Current term is 5.
I20260709 12:11:06.027720 14155 leader_election.cc:403] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:05.971966 17766 raft_consensus.cc:3060] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:06.028175 14264 raft_consensus.cc:1275] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:11:06.030337 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:06.031518 14259 raft_consensus.cc:3060] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:06.019767 17615 consensus_meta.cc:287] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db: Time spent flushing consensus metadata: real 0.701s	user 0.011s	sys 0.000s
I20260709 12:11:06.037281 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:06.039343 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 11 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:06.040125 14263 raft_consensus.cc:3060] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:06.046092 14259 raft_consensus.cc:2468] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 9.
I20260709 12:11:06.047102 14876 leader_election.cc:304] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:06.050063 14304 leader_election.cc:304] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:06.057965 14264 raft_consensus.cc:1275] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:11:06.048807 14876 leader_election.cc:304] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:05.942361 17731 raft_consensus.cc:515] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:06.064445 14189 raft_consensus.cc:1275] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:11:06.041057 17615 raft_consensus.cc:2749] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:11:06.000315 17748 raft_consensus.cc:515] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:05.997524 17705 raft_consensus.cc:515] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:06.029480 17771 consensus_queue.cc:1048] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 12:11:06.051338 17699 raft_consensus.cc:2749] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673) with higher term. Message: Invalid argument: T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 4. Current term is 5.
I20260709 12:11:06.065366 17446 raft_consensus.cc:2804] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:06.038802 17810 raft_consensus.cc:515] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:11:06.068653 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 96390.2us
I20260709 12:11:06.055940 17692 raft_consensus.cc:2804] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:06.091558 17446 raft_consensus.cc:697] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 7 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:11:06.092674 17446 consensus_queue.cc:237] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:06.064935 17385 raft_consensus.cc:493] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:06.094094 17385 raft_consensus.cc:515] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:06.091660 17692 raft_consensus.cc:493] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:06.095324 17692 raft_consensus.cc:3060] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:06.096421 17385 leader_election.cc:290] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:06.103629 17810 leader_election.cc:290] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:06.105722 17731 leader_election.cc:290] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 11 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:06.070281 17751 leader_election.cc:290] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:06.106608 14155 leader_election.cc:400] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 7 election: Vote denied by peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673) with higher term. Message: Invalid argument: T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 7. Current term is 8.
I20260709 12:11:06.105989 17692 raft_consensus.cc:515] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:06.067960 17725 raft_consensus.cc:2804] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:06.107522 17725 raft_consensus.cc:697] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 9 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
W20260709 12:11:06.108495 17704 consensus_meta.cc:287] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.769s	user 0.012s	sys 0.000s
I20260709 12:11:06.109014 17704 raft_consensus.cc:2749] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:06.108522 17725 consensus_queue.cc:237] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:06.106997 14155 leader_election.cc:403] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
W20260709 12:11:06.060979 17735 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.794s	user 0.024s	sys 0.042s
I20260709 12:11:06.053071 17784 consensus_queue.cc:1048] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 12:11:06.053298 17703 consensus_queue.cc:1048] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 12:11:06.136756 14263 raft_consensus.cc:2468] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 11.
I20260709 12:11:06.138229 14304 leader_election.cc:304] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:11:06.139714 17704 raft_consensus.cc:2804] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:06.140352 17704 raft_consensus.cc:697] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 11 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:06.141374 17704 consensus_queue.cc:237] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:06.073836 17772 leader_election.cc:290] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:06.086495 17769 leader_election.cc:290] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:11:06.128402 17807 log.cc:927] Time spent T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.401s	user 0.000s	sys 0.001s
W20260709 12:11:06.134593 17735 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.868s	user 0.025s	sys 0.043s
I20260709 12:11:06.073539 17720 raft_consensus.cc:515] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } }
W20260709 12:11:06.147879 17806 log.cc:927] Time spent T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.461s	user 0.001s	sys 0.000s
I20260709 12:11:06.171358 14303 leader_election.cc:304] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:06.152788 17699 raft_consensus.cc:2749] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673) with higher term. Message: Invalid argument: T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 7. Current term is 8.
I20260709 12:11:06.185643 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:06.356359 17705 leader_election.cc:290] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:06.357882 14331 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686"
dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
mode: GRACEFUL
new_leader_uuid: "885067a0d31741bfb5c9935788e315bf"
 from {username='slave'} at 127.0.0.1:50896
I20260709 12:11:06.358390 17720 leader_election.cc:290] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 8 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187)
I20260709 12:11:06.358578 14331 raft_consensus.cc:606] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Received request to transfer leadership to TS 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:06.358954 14331 raft_consensus.cc:614] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:06.360117 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:06.360786 14337 raft_consensus.cc:2468] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 5.
I20260709 12:11:06.361948 14332 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50856 (request call id 2006) took 1342 ms. Trace:
I20260709 12:11:06.362329 14332 rpcz_store.cc:276] 0709 12:11:05.019119 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:05.019276 (+   157us) service_pool.cc:224] Handling call
0709 12:11:05.034788 (+ 15512us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:05.044450 (+  9662us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:05.044480 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:05.073405 (+ 28925us) log.cc:844] Serialized 26 byte log entry
0709 12:11:05.477652 (+404247us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:11:05.477696 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:05.477791 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:06.361693 (+883902us) raft_consensus.cc:1685] finished
0709 12:11:06.361713 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:06.361880 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17011,"raft.queue_time_us":9915,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":12578,"thread_start_us":367145,"threads_started":1,"wal-append.queue_time_us":486004}
I20260709 12:11:06.349498 14905 raft_consensus.cc:2468] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 6.
I20260709 12:11:06.366030 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:06.368083 14303 leader_election.cc:304] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:11:06.370638 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:06.376173 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:11:06.385578 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:06.407222 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 300770us
I20260709 12:11:06.408676 14263 raft_consensus.cc:2468] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 6.
I20260709 12:11:06.410848 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:06.411653 14264 raft_consensus.cc:3060] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:11:06.411652 14877 leader_election.cc:304] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:06.414470 14877 leader_election.cc:304] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:06.347306 17750 raft_consensus.cc:3060] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:06.454526 14155 leader_election.cc:304] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:06.449162 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:06.402601 17705 raft_consensus.cc:2804] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:11:06.467556 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 53150.5us
I20260709 12:11:06.402079 17720 raft_consensus.cc:493] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:06.471199 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:06.472090 14337 raft_consensus.cc:3060] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:06.449959 17731 raft_consensus.cc:2804] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:11:06.476922 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 553449us
I20260709 12:11:06.469401 17705 raft_consensus.cc:493] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:06.483075 14229 leader_election.cc:304] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:11:06.481242 14905 raft_consensus.cc:1275] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:11:06.485598 14264 raft_consensus.cc:2468] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 11.
I20260709 12:11:06.510375 14332 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca"
dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
mode: GRACEFUL
new_leader_uuid: "885067a0d31741bfb5c9935788e315bf"
 from {username='slave'} at 127.0.0.1:50896
I20260709 12:11:06.512418 14332 raft_consensus.cc:606] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 10 LEADER]: Received request to transfer leadership to TS 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:06.481683 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:06.496244 17731 raft_consensus.cc:697] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 9 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:11:06.480751 17446 raft_consensus.cc:2749] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:06.480651 17705 raft_consensus.cc:3060] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:06.482863 17699 raft_consensus.cc:2749] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:11:06.509791 17780 raft_consensus.cc:493] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
W20260709 12:11:06.521291 17809 consensus_meta.cc:287] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.575s	user 0.005s	sys 0.009s
I20260709 12:11:06.520342 17815 raft_consensus.cc:2804] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:11:06.540841 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:06.519327 17820 consensus_queue.cc:1048] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 12:11:06.476146 17720 raft_consensus.cc:515] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:06.555507 14186 raft_consensus.cc:1275] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:11:06.557533 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:06.561239 14189 raft_consensus.cc:3060] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:11:06.558279 14155 leader_election.cc:304] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:06.521068 17692 leader_election.cc:290] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 11 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:06.524389 17748 leader_election.cc:290] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:06.524556 17500 consensus_queue.cc:1048] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.038s
I20260709 12:11:06.549677 17694 raft_consensus.cc:493] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:06.522693 17725 consensus_queue.cc:1048] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 12:11:06.559175 17815 raft_consensus.cc:493] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:06.580649 14903 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6"
dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
mode: GRACEFUL
new_leader_uuid: "17aab1bbf5014936aa18cc21818b26ec"
 from {username='slave'} at 127.0.0.1:38628
I20260709 12:11:06.581453 17446 consensus_queue.cc:1048] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:11:06.573138 17577 consensus_meta.cc:287] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.544s	user 0.011s	sys 0.000s
I20260709 12:11:06.586854 14186 raft_consensus.cc:1275] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:11:06.596467 14189 raft_consensus.cc:2468] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 11.
I20260709 12:11:06.597311 14912 raft_consensus.cc:1275] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:11:06.556612 17731 consensus_queue.cc:237] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:11:06.626394 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 157508us
I20260709 12:11:06.565796 17821 raft_consensus.cc:2749] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:06.627750 14877 leader_election.cc:304] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:11:06.559096 17809 raft_consensus.cc:515] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:11:06.656316 17829 log.cc:927] Time spent T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 12:11:06.581528 14903 raft_consensus.cc:606] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 8 LEADER]: Received request to transfer leadership to TS 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:11:06.659297 14155 leader_election.cc:304] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:06.660465 17748 raft_consensus.cc:2749] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:11:06.662691 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:06.666716 17720 leader_election.cc:290] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:06.558835 17780 raft_consensus.cc:515] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:06.672240 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:11:06.667128 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 81989.8us
I20260709 12:11:06.667373 17692 raft_consensus.cc:2804] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:06.674269 17692 raft_consensus.cc:697] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 11 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:11:06.675268 17692 consensus_queue.cc:237] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:06.674263 17385 consensus_queue.cc:1048] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 12:11:06.678282 17385 consensus_queue.cc:1048] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:06.679998 17385 raft_consensus.cc:993] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db: : Instructing follower 17aab1bbf5014936aa18cc21818b26ec to start an election
I20260709 12:11:06.683889 17385 raft_consensus.cc:1081] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 8 LEADER]: Signalling peer 17aab1bbf5014936aa18cc21818b26ec to start an election
W20260709 12:11:06.686364 17825 log.cc:927] Time spent T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 12:11:06.681455 14876 leader_election.cc:304] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:06.686264 14912 raft_consensus.cc:1275] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:11:06.682971 17767 consensus_queue.cc:1048] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:06.688555 17744 consensus_queue.cc:1048] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:06.579324 17815 raft_consensus.cc:3060] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:06.699172 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:06.695596 17767 raft_consensus.cc:2804] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:06.704455 17767 raft_consensus.cc:697] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 11 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:11:06.708668 14256 raft_consensus.cc:2368] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 7. Current term is 8.
I20260709 12:11:06.716431 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:06.720038 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:06.721572 14333 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39"
dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
mode: GRACEFUL
new_leader_uuid: "885067a0d31741bfb5c9935788e315bf"
 from {username='slave'} at 127.0.0.1:50896
I20260709 12:11:06.722453 14333 raft_consensus.cc:606] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Received request to transfer leadership to TS 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:06.722906 14333 raft_consensus.cc:614] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:06.585450 17694 raft_consensus.cc:515] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:06.790769 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:06.792057 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:06.792212 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:06.696206 17513 leader_election.cc:290] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:06.644555 17577 raft_consensus.cc:515] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:06.693003 17818 consensus_queue.cc:1048] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.103s
I20260709 12:11:06.806583 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:06.806854 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:06.807363 14261 raft_consensus.cc:2468] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 5.
I20260709 12:11:06.807565 14262 raft_consensus.cc:2393] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 9: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:11:06.808404 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:11:06.809406 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 133412us
I20260709 12:11:06.810755 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:06.812541 14261 raft_consensus.cc:1240] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:11:06.813179 14333 raft_consensus.cc:1275] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:11:06.815052 14257 raft_consensus.cc:1240] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 9. Current term is 10. Ops: [7.5-9.6]
I20260709 12:11:06.815120 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:06.815806 14263 raft_consensus.cc:2468] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 9.
I20260709 12:11:06.814680 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:06.816663 14258 raft_consensus.cc:2468] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 8.
I20260709 12:11:06.800248 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:06.820693 14262 raft_consensus.cc:1240] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 12:11:06.799579 17744 raft_consensus.cc:493] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:11:06.804252 17704 raft_consensus.cc:493] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:06.827629 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:11:06.820911 17768 consensus_meta.cc:287] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.908s	user 0.010s	sys 0.003s
I20260709 12:11:06.814567 17816 raft_consensus.cc:493] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:11:06.822638 17513 raft_consensus.cc:493] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:06.840065 12986 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:11:06.852989 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:11:06.840644 17766 consensus_meta.cc:287] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.805s	user 0.014s	sys 0.002s
I20260709 12:11:06.841923 17385 raft_consensus.cc:493] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:06.833398 14155 leader_election.cc:304] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:06.837031 14262 raft_consensus.cc:1240] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 8. Current term is 9. Ops: [7.5-8.6]
I20260709 12:11:06.853816 14257 raft_consensus.cc:2468] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 10.
W20260709 12:11:06.860378 14304 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.174.130:36673 timed out after 1.759s (SENT) [suppressed 10 similar messages]
I20260709 12:11:06.868652 14337 raft_consensus.cc:2468] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 11.
I20260709 12:11:06.812332 17767 consensus_queue.cc:237] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:11:06.884946 17827 log.cc:927] Time spent T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:11:06.899483 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:06.900420 14259 raft_consensus.cc:2393] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 11: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:11:06.900759 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 9 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:06.835899 17744 raft_consensus.cc:515] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:06.867444 17439 raft_consensus.cc:2749] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:06.901598 14262 raft_consensus.cc:2393] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 9: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:11:06.902967 14261 raft_consensus.cc:1240] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 12:11:06.903056 14257 raft_consensus.cc:1240] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:11:06.908972 14260 raft_consensus.cc:2468] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 7.
I20260709 12:11:06.911918 14155 leader_election.cc:304] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:06.914511 14188 raft_consensus.cc:1240] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 4. Current term is 5. Ops: []
I20260709 12:11:06.918635 14261 raft_consensus.cc:1240] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 10. Current term is 11. Ops: [8.4-10.5]
I20260709 12:11:06.919341 14335 raft_consensus.cc:1240] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 9 LEADER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:06.924947 14155 leader_election.cc:304] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:06.925993 14155 leader_election.cc:304] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:06.850682 17768 raft_consensus.cc:515] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:06.838178 17704 raft_consensus.cc:515] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:06.859139 17513 raft_consensus.cc:515] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:06.935710 17760 raft_consensus.cc:3055] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:06.938433 14335 raft_consensus.cc:1240] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:06.939493 14330 raft_consensus.cc:1240] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 9 LEADER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:11:06.940435 14334 raft_consensus.cc:1240] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 8 LEADER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:06.941617 17811 raft_consensus.cc:2804] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:06.942137 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:06.941506 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:06.931862 17616 leader_election.cc:290] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:06.855065 17816 raft_consensus.cc:515] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:06.902266 17735 raft_consensus.cc:493] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:06.977922 14335 raft_consensus.cc:1240] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:06.865371 17385 raft_consensus.cc:515] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:06.923170 17753 raft_consensus.cc:493] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:11:06.979132 14265 raft_consensus.cc:2368] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 10. Current term is 11.
I20260709 12:11:06.927965 17821 raft_consensus.cc:2804] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:11:07.016863 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 74183.4us
I20260709 12:11:07.033344 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
W20260709 12:11:06.981524 17834 log.cc:927] Time spent T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.094s	user 0.001s	sys 0.001s
I20260709 12:11:06.972296 17811 raft_consensus.cc:493] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:07.066103 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 140175us
I20260709 12:11:06.963801 17760 raft_consensus.cc:740] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
W20260709 12:11:07.075161 17837 log.cc:927] Time spent T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.210s	user 0.000s	sys 0.001s
W20260709 12:11:07.198274 17705 consensus_meta.cc:287] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.639s	user 0.005s	sys 0.013s
W20260709 12:11:07.090752 17832 log.cc:927] Time spent T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.196s	user 0.001s	sys 0.000s
I20260709 12:11:06.981382 14339 raft_consensus.cc:1275] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:11:07.125697 17777 consensus_queue.cc:260] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:06.964210 17819 consensus_queue.cc:1059] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.115s
I20260709 12:11:07.178540 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:06.964694 17830 raft_consensus.cc:493] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:07.179558 14337 raft_consensus.cc:1240] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 5. Current term is 6. Ops: []
I20260709 12:11:07.179737 14336 raft_consensus.cc:1240] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 10 LEADER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:07.180388 14338 raft_consensus.cc:1240] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 11 LEADER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 10. Current term is 11. Ops: [8.4-10.5]
I20260709 12:11:06.980808 14335 raft_consensus.cc:1240] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:07.272236 14330 raft_consensus.cc:3060] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:06.928149 17748 consensus_queue.cc:1059] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.091s
W20260709 12:11:07.093212 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 232817us
I20260709 12:11:06.943300 17699 raft_consensus.cc:2804] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:07.180500 12986 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:07.186519 17704 leader_election.cc:290] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:07.191015 14185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56652 (request call id 822) took 2105 ms. Trace:
I20260709 12:11:07.196166 14334 raft_consensus.cc:2393] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 7: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:11:07.204666 14155 leader_election.cc:304] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:07.288458 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:07.021406 17735 raft_consensus.cc:515] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:07.260072 17809 leader_election.cc:290] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 8 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:07.262852 17780 leader_election.cc:290] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:07.210873 17811 raft_consensus.cc:3060] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:07.270591 14877 leader_election.cc:304] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:07.189932 17768 leader_election.cc:290] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 11 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:07.284129 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:07.289506 14336 raft_consensus.cc:2410] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:11:07.329614 14335 raft_consensus.cc:2468] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 8.
I20260709 12:11:07.329020 14330 raft_consensus.cc:2468] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 8.
I20260709 12:11:07.331188 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:07.199119 17821 raft_consensus.cc:493] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:07.333211 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:07.314895 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:07.288311 14185 rpcz_store.cc:276] 0709 12:11:05.076426 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:05.076887 (+   461us) service_pool.cc:224] Handling call
0709 12:11:05.103462 (+ 26575us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:05.311129 (+207667us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:07.055401 (+1744272us) spinlock_profiling.cc:243] Waited 185 ms on lock 0x7b54001108d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:11:07.181796 (+126395us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":426612096}
I20260709 12:11:07.317154 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
W20260709 12:11:07.320955 17835 log.cc:927] Time spent T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.127s	user 0.000s	sys 0.000s
I20260709 12:11:07.283776 17699 raft_consensus.cc:493] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:07.370071 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:07.316393 17819 raft_consensus.cc:3055] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:07.330868 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
W20260709 12:11:07.333309 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 62955.4us
W20260709 12:11:07.312461 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 107878us
I20260709 12:11:07.372104 14155 leader_election.cc:400] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 7 pre-election: Vote denied by peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673) with higher term. Message: Invalid argument: T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 7. Current term is 8.
I20260709 12:11:07.367090 14330 raft_consensus.cc:2468] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 12.
I20260709 12:11:07.367547 14337 raft_consensus.cc:3060] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:11:07.371230 14336 raft_consensus.cc:2468] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 9.
I20260709 12:11:07.269651 17616 consensus_queue.cc:1059] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.066s
I20260709 12:11:07.383899 14912 raft_consensus.cc:1240] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 5. Current term is 6. Ops: []
W20260709 12:11:07.380791 14154 connection.cc:256] RPC call timeout handler was delayed by -1.5843965409999328s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
I20260709 12:11:07.377463 14877 leader_election.cc:304] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:11:07.331312 17513 leader_election.cc:290] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:07.376315 17819 raft_consensus.cc:740] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
W20260709 12:11:07.365813 17844 log.cc:927] Time spent T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
I20260709 12:11:07.328830 17748 raft_consensus.cc:2804] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:07.198939 17753 raft_consensus.cc:515] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:07.307286 17830 raft_consensus.cc:515] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:07.283777 17838 consensus_queue.cc:1059] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.104s
I20260709 12:11:07.286135 17697 consensus_queue.cc:1059] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.092s
I20260709 12:11:07.398702 17851 raft_consensus.cc:3055] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:07.421918 17317 raft_consensus.cc:3055] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:07.422052 17851 raft_consensus.cc:740] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:11:07.422389 17317 raft_consensus.cc:740] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:11:07.423076 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:07.423349 17317 consensus_queue.cc:260] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:07.423833 17725 consensus_queue.cc:1048] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:11:07.424618 17753 leader_election.cc:290] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:07.424783 17317 raft_consensus.cc:3060] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:07.425911 17385 leader_election.cc:290] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:07.426157 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:07.427284 17753 consensus_queue.cc:1048] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:11:07.277596 17705 raft_consensus.cc:515] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:07.372390 17446 raft_consensus.cc:2749] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:07.366990 17821 raft_consensus.cc:3060] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:07.376595 17699 raft_consensus.cc:3060] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:07.387753 17726 consensus_queue.cc:1048] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 12:11:07.401889 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:07.402482 14337 raft_consensus.cc:2468] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 5.
I20260709 12:11:07.403224 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:07.446468 14334 raft_consensus.cc:2468] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 11.
I20260709 12:11:07.381675 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 9 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:07.407486 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:07.408463 17819 consensus_queue.cc:260] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:11:07.412704 17843 log.cc:927] Time spent T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.229s	user 0.000s	sys 0.001s
I20260709 12:11:07.416782 17831 consensus_queue.cc:1048] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:07.397938 17771 raft_consensus.cc:493] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:07.397665 17809 raft_consensus.cc:493] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:07.371186 17760 consensus_queue.cc:260] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:07.418593 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:07.419121 17853 consensus_queue.cc:1059] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.013s
I20260709 12:11:07.419821 14903 raft_consensus.cc:1240] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:07.398226 17816 leader_election.cc:290] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:07.398862 17748 raft_consensus.cc:493] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:07.421053 17735 leader_election.cc:290] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:07.333554 17848 raft_consensus.cc:3055] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:07.428299 14877 leader_election.cc:304] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
W20260709 12:11:07.437849 17847 log.cc:927] Time spent T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 12:11:07.438313 17732 leader_election.cc:290] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:07.438969 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:07.440312 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:07.464674 17771 raft_consensus.cc:515] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:07.447892 14338 raft_consensus.cc:3060] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:11:07.491475 17771 leader_election.cc:290] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:07.492700 17836 raft_consensus.cc:2804] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:07.493336 17836 raft_consensus.cc:697] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 11 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:11:07.494282 17836 consensus_queue.cc:237] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:07.499044 14338 raft_consensus.cc:2468] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 11.
I20260709 12:11:07.452200 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:11:07.445322 17846 log.cc:927] Time spent T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:11:07.452543 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:07.405850 17852 raft_consensus.cc:2804] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:07.521665 17852 raft_consensus.cc:493] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:07.522257 17852 raft_consensus.cc:3060] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:07.425935 17780 consensus_queue.cc:1048] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
W20260709 12:11:07.479873 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 51660.2us
I20260709 12:11:07.482172 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:07.591302 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:07.431028 17513 consensus_queue.cc:1059] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 12:11:07.483578 17816 raft_consensus.cc:493] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:11:07.595820 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:07.596688 14183 raft_consensus.cc:2368] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 7. Current term is 8.
I20260709 12:11:07.503916 14335 raft_consensus.cc:2468] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 8.
I20260709 12:11:07.597762 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:07.599323 14335 raft_consensus.cc:1240] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:07.507392 17525 leader_election.cc:290] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 11 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:11:07.508419 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:07.582739 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 54400.3us
I20260709 12:11:07.536711 17819 raft_consensus.cc:3060] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:07.600605 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:07.601305 17697 raft_consensus.cc:493] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:07.601915 17697 raft_consensus.cc:515] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:07.598003 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:07.604189 17697 leader_election.cc:290] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:07.605146 14337 raft_consensus.cc:1275] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 12:11:07.606173 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 200617us
W20260709 12:11:07.586270 14260 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41764 (request call id 2481) took 1562 ms (client timeout 1759 ms). Trace:
I20260709 12:11:07.477903 17748 raft_consensus.cc:3060] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:07.587383 14333 raft_consensus.cc:1240] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 12:11:07.423110 17851 consensus_queue.cc:260] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:07.477232 17704 raft_consensus.cc:493] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:07.479846 17750 consensus_meta.cc:287] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 1.025s	user 0.011s	sys 0.008s
W20260709 12:11:07.482946 17815 consensus_meta.cc:287] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.774s	user 0.008s	sys 0.006s
I20260709 12:11:07.484695 17848 raft_consensus.cc:740] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
W20260709 12:11:07.556622 17854 log.cc:927] Time spent T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.183s	user 0.001s	sys 0.002s
I20260709 12:11:07.584954 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:07.587849 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:07.642195 14189 raft_consensus.cc:2393] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 12: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:11:07.590121 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:07.642897 14182 raft_consensus.cc:2468] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 8.
I20260709 12:11:07.465581 17809 raft_consensus.cc:515] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:07.607474 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:07.608667 14335 raft_consensus.cc:1240] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 4. Current term is 5. Ops: []
W20260709 12:11:07.609231 14260 rpcz_store.cc:269] 0709 12:11:06.023444 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:06.036960 (+ 13516us) service_pool.cc:224] Handling call
0709 12:11:07.520910 (+1483950us) spinlock_profiling.cc:243] Waited 826 ms on lock 0x7b54002fd854. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:11:07.586188 (+ 65278us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1898804096}
I20260709 12:11:07.610958 14230 leader_election.cc:304] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:11:07.607474 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:07.650879 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:07.651640 14188 raft_consensus.cc:2468] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 9.
I20260709 12:11:07.614064 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:07.653398 14187 raft_consensus.cc:2393] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 11: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:11:07.616401 14190 raft_consensus.cc:1275] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:11:07.635373 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:07.654314 14183 raft_consensus.cc:2410] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for term 10 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:11:07.643217 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:07.654817 14189 raft_consensus.cc:3060] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:11:07.657896 14156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:07.663872 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:07.664702 14182 raft_consensus.cc:3060] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:07.618286 17697 raft_consensus.cc:493] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:07.637207 17750 raft_consensus.cc:2749] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:07.691649 14155 leader_election.cc:304] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
W20260709 12:11:07.695665 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 95984.6us
I20260709 12:11:07.605648 17816 raft_consensus.cc:515] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:07.711653 14182 raft_consensus.cc:2468] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 6.
I20260709 12:11:07.712930 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:07.620679 17839 consensus_queue.cc:1048] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.059s
W20260709 12:11:07.737118 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 122279us
I20260709 12:11:07.738267 14183 raft_consensus.cc:1240] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:07.661605 17851 raft_consensus.cc:3060] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:07.721938 14905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53194 (request call id 822) took 1016 ms. Trace:
I20260709 12:11:07.636269 17820 consensus_queue.cc:1048] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.063s
I20260709 12:11:07.745947 14155 leader_election.cc:304] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:07.632658 17704 raft_consensus.cc:515] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:07.742076 14905 rpcz_store.cc:276] 0709 12:11:06.705637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:06.705830 (+   193us) service_pool.cc:224] Handling call
0709 12:11:06.706225 (+   395us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:06.795402 (+ 89177us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:06.795439 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:06.796199 (+   760us) log.cc:844] Serialized 26 byte log entry
0709 12:11:06.954134 (+157935us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:06.954186 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:06.954273 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:07.529555 (+575282us) spinlock_profiling.cc:243] Waited 4.95 ms on lock 0x7b4800100d58. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f212c064aa1 00007f212c05bb37 00007f212c05b9ca 00007f212c15326f 00007f212c152f37 00007f212c16755c 00007f212c167508 00007f212c167488 00007f212c167443 00007f212c1666ec 00007f212b090a96
0709 12:11:07.696192 (+166637us) raft_consensus.cc:1685] finished
0709 12:11:07.696220 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:07.721847 (+ 25627us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":117764,"raft.run_cpu_time_us":2885,"raft.run_wall_time_us":703102,"spinlock_wait_cycles":11394816,"thread_start_us":213498,"threads_started":2,"wal-append.queue_time_us":459236}
I20260709 12:11:07.756685 14189 raft_consensus.cc:2468] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 8.
I20260709 12:11:07.752437 14331 raft_consensus.cc:2468] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 9.
I20260709 12:11:07.758734 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:07.640300 17815 raft_consensus.cc:515] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:07.795365 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:07.796370 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:11:07.797715 14183 raft_consensus.cc:2368] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for earlier term 10. Current term is 11.
I20260709 12:11:07.688735 17525 consensus_queue.cc:1059] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.074s
I20260709 12:11:07.804538 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:07.744777 17853 raft_consensus.cc:2749] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:11:07.810762 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 64916.2us
I20260709 12:11:07.811657 14184 raft_consensus.cc:2393] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db in current term 11: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:11:07.681128 17697 raft_consensus.cc:515] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:11:07.793674 17837 log.cc:927] Time spent T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 12:11:07.761102 17859 raft_consensus.cc:493] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:07.798043 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 187097us
I20260709 12:11:07.796810 17705 leader_election.cc:290] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 6 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:07.803934 17830 leader_election.cc:290] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:07.823350 17525 consensus_queue.cc:1243] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer 65c9c1653b3346b39a0e118540e6080c log is divergent from this leader: its last log entry 9.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:11:07.832041 17772 raft_consensus.cc:2749] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:11:07.905508 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:07.854110 17853 consensus_queue.cc:1059] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 12:11:07.801602 17848 consensus_queue.cc:260] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:07.859463 17525 consensus_queue.cc:1059] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 12:11:07.925218 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:11:07.825230 17859 raft_consensus.cc:515] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:07.926262 14906 raft_consensus.cc:3060] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:07.911365 17874 raft_consensus.cc:493] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:07.934209 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
W20260709 12:11:07.970010 14877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:07.985379 14906 raft_consensus.cc:2468] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 8.
I20260709 12:11:07.848037 17811 raft_consensus.cc:515] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:07.992164 17864 raft_consensus.cc:2804] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:11:07.981407 17871 log.cc:927] Time spent T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.138s	user 0.000s	sys 0.003s
I20260709 12:11:07.959086 17809 leader_election.cc:290] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:11:07.997426 17860 log.cc:927] Time spent T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.083s	user 0.000s	sys 0.003s
W20260709 12:11:08.008607 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 186885us
W20260709 12:11:08.046165 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 71335us
I20260709 12:11:08.002884 17816 leader_election.cc:290] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:08.004283 17815 leader_election.cc:290] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:08.041821 14230 leader_election.cc:304] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
W20260709 12:11:08.053654 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:08.038746 17704 leader_election.cc:290] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:11:08.059600 17873 log.cc:927] Time spent T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
W20260709 12:11:08.060983 17880 log.cc:927] Time spent T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
W20260709 12:11:08.062443 17699 consensus_meta.cc:287] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.611s	user 0.007s	sys 0.004s
I20260709 12:11:08.062877 17699 raft_consensus.cc:515] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:08.065220 17699 leader_election.cc:290] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:08.066399 17882 raft_consensus.cc:493] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:08.047506 17870 raft_consensus.cc:493] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:07.990221 17874 raft_consensus.cc:515] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:08.067021 17882 raft_consensus.cc:515] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:08.049949 17697 leader_election.cc:290] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:08.039906 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:08.071017 17870 raft_consensus.cc:515] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:08.083166 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:08.075927 14181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56652 (request call id 838) took 1178 ms. Trace:
I20260709 12:11:08.048131 17809 raft_consensus.cc:493] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:08.084538 14181 rpcz_store.cc:276] 0709 12:11:06.897064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:06.899061 (+  1997us) service_pool.cc:224] Handling call
0709 12:11:06.927863 (+ 28802us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:07.331839 (+403976us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:07.331873 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:07.367924 (+ 36051us) log.cc:844] Serialized 26 byte log entry
0709 12:11:07.619039 (+251115us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:07.619074 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:07.619145 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:08.075661 (+456516us) raft_consensus.cc:1685] finished
0709 12:11:08.075689 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:08.075850 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1645,"raft.queue_time_us":15517,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":22430,"thread_start_us":592438,"threads_started":2,"wal-append.queue_time_us":430732}
I20260709 12:11:08.088567 14188 raft_consensus.cc:2393] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 9: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:11:08.090794 17870 leader_election.cc:290] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:08.096014 17577 leader_election.cc:290] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 9 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:08.098699 17859 leader_election.cc:290] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:08.102063 17888 raft_consensus.cc:493] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:08.102741 17888 raft_consensus.cc:515] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:08.104913 17869 raft_consensus.cc:493] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:08.105531 17869 raft_consensus.cc:515] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:11:08.106904 17819 consensus_meta.cc:287] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.506s	user 0.012s	sys 0.000s
I20260709 12:11:08.108168 17811 leader_election.cc:290] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 9 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:08.108629 17869 leader_election.cc:290] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:11:08.109683 17852 consensus_meta.cc:287] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db: Time spent flushing consensus metadata: real 0.587s	user 0.011s	sys 0.001s
I20260709 12:11:08.110186 17852 raft_consensus.cc:515] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:08.112514 17852 leader_election.cc:290] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 7 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:08.113340 14905 raft_consensus.cc:2368] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for earlier term 6. Current term is 7.
I20260709 12:11:08.131798 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:08.130972 17616 raft_consensus.cc:3055] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:08.142567 14181 raft_consensus.cc:2393] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 5: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
W20260709 12:11:08.143368 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 331474us
W20260709 12:11:08.144078 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 283923us
I20260709 12:11:08.163406 17882 leader_election.cc:290] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:08.157269 17718 raft_consensus.cc:3060] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:08.166186 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:08.167866 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:08.169998 17870 raft_consensus.cc:493] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:08.170670 17870 raft_consensus.cc:515] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:08.171268 17887 raft_consensus.cc:493] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:08.171841 17887 raft_consensus.cc:515] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:08.172808 17870 leader_election.cc:290] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:08.128898 17815 raft_consensus.cc:493] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:08.173401 17870 raft_consensus.cc:2749] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:08.142783 17869 raft_consensus.cc:493] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:08.219273 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:11:08.208103 17317 consensus_meta.cc:287] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.750s	user 0.007s	sys 0.007s
I20260709 12:11:08.142380 17616 raft_consensus.cc:740] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:11:08.105566 17888 leader_election.cc:290] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:08.230849 14190 raft_consensus.cc:1240] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 5. Current term is 6. Ops: [3.3-5.4]
I20260709 12:11:08.237393 14187 raft_consensus.cc:1275] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 12:11:08.237852 14187 pending_rounds.cc:85] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf: Aborting all ops after (but not including) 5
I20260709 12:11:08.238106 14187 pending_rounds.cc:107] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 12:11:08.238373 14187 raft_consensus.cc:2889] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:11:08.232730 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 183297us
I20260709 12:11:08.240295 14229 leader_election.cc:304] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:11:08.235075 14303 leader_election.cc:400] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 6 election: Vote denied by peer 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341) with higher term. Message: Invalid argument: T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for earlier term 6. Current term is 7.
I20260709 12:11:08.127893 17809 raft_consensus.cc:515] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:08.240954 14303 leader_election.cc:403] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 12:11:08.218575 17704 raft_consensus.cc:493] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:08.232661 17821 consensus_meta.cc:287] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.760s	user 0.009s	sys 0.003s
I20260709 12:11:08.242722 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:08.225407 17500 raft_consensus.cc:493] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:08.251808 17748 consensus_meta.cc:287] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.628s	user 0.009s	sys 0.002s
I20260709 12:11:08.252324 17748 raft_consensus.cc:515] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:08.255141 17748 leader_election.cc:290] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 11 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:08.260792 14903 raft_consensus.cc:1240] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:08.261699 17887 leader_election.cc:290] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:08.262465 17616 consensus_queue.cc:260] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:11:08.235532 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 193823us
I20260709 12:11:08.269217 14303 leader_election.cc:304] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:08.264060 17500 raft_consensus.cc:515] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:08.272421 17900 raft_consensus.cc:493] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:08.273049 17900 raft_consensus.cc:515] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:08.245808 17816 raft_consensus.cc:3060] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:08.274011 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:11:08.274708 14903 raft_consensus.cc:3060] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:08.275331 17900 leader_election.cc:290] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:08.279692 17500 leader_election.cc:290] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:08.280880 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:08.283658 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:08.214556 17815 raft_consensus.cc:515] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:08.286795 14181 raft_consensus.cc:2393] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 9: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
W20260709 12:11:08.284946 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 44745.1us
I20260709 12:11:08.237293 17869 raft_consensus.cc:515] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:08.290347 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:11:08.263846 17874 leader_election.cc:290] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:08.298012 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:08.299620 14908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:08.300104 17815 leader_election.cc:290] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:08.249217 17704 raft_consensus.cc:515] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:08.291292 14303 leader_election.cc:304] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:08.293334 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:08.301595 14260 raft_consensus.cc:2468] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 12.
I20260709 12:11:08.294049 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:08.301724 17750 raft_consensus.cc:2749] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:08.250237 17821 raft_consensus.cc:515] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:08.304154 17760 raft_consensus.cc:3060] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:08.304381 17821 leader_election.cc:290] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 6 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:08.304677 14185 raft_consensus.cc:2393] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 6: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:11:08.305262 17750 consensus_queue.cc:1059] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:11:08.306449 17798 raft_consensus.cc:3055] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:11:08.306839 17798 raft_consensus.cc:740] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:08.284951 17894 raft_consensus.cc:2749] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:08.298272 17869 leader_election.cc:290] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:08.309070 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:08.293298 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:08.314868 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:08.316526 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:08.317421 14181 raft_consensus.cc:2393] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 8: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:11:08.317528 14184 raft_consensus.cc:2468] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 12.
I20260709 12:11:08.284862 17864 raft_consensus.cc:697] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 11 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:11:08.320736 17890 raft_consensus.cc:493] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:08.307621 17809 leader_election.cc:290] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:08.321985 17439 consensus_queue.cc:1059] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:11:08.322597 17888 consensus_queue.cc:1059] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:11:08.307729 17798 consensus_queue.cc:260] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:08.318882 17870 raft_consensus.cc:493] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:08.304771 17513 raft_consensus.cc:3055] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:11:08.325495 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:08.335513 14259 raft_consensus.cc:1240] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 9. Current term is 10. Ops: []
W20260709 12:11:08.321020 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 174499us
I20260709 12:11:08.336863 14184 raft_consensus.cc:1275] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:11:08.304374 14903 raft_consensus.cc:2468] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 11.
W20260709 12:11:08.338732 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 46390.3us
I20260709 12:11:08.340137 14256 raft_consensus.cc:1275] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:11:08.341708 14264 raft_consensus.cc:1275] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:11:08.341883 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:08.361217 14258 raft_consensus.cc:2393] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 6: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:11:08.343353 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:11:08.336033 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 44976.2us
I20260709 12:11:08.361817 14263 raft_consensus.cc:2468] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 8.
I20260709 12:11:08.347854 14261 raft_consensus.cc:1240] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 5. Current term is 6. Ops: [3.3-5.4]
I20260709 12:11:08.309113 17704 leader_election.cc:290] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:08.317098 17861 raft_consensus.cc:2804] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:08.355029 14184 raft_consensus.cc:1275] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:11:08.337879 17816 raft_consensus.cc:2749] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341) with higher term. Message: Invalid argument: T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for earlier term 6. Current term is 7.
W20260709 12:11:08.355837 14156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:08.356753 14155 leader_election.cc:304] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:08.347185 17890 raft_consensus.cc:515] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:08.365625 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:08.426139 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:11:08.522167 14331 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55492 (request call id 603) took 2118 ms (client timeout 1798 ms). Trace:
I20260709 12:11:08.405867 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:08.519511 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:08.522486 14338 raft_consensus.cc:1275] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:11:08.661383 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:08.662526 14336 raft_consensus.cc:2468] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 8.
I20260709 12:11:08.495188 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:08.663141 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:08.463250 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:08.406574 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:08.406288 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:08.664223 14264 raft_consensus.cc:2468] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 8.
I20260709 12:11:08.685096 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:08.686411 14184 raft_consensus.cc:2393] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 11: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
W20260709 12:11:08.664397 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 307719us
W20260709 12:11:08.602635 17902 log.cc:927] Time spent T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
W20260709 12:11:08.404134 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 44036.6us
I20260709 12:11:08.658919 14154 leader_election.cc:304] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:08.691340 14155 leader_election.cc:304] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:11:08.695005 14229 leader_election.cc:304] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:08.359210 17439 consensus_queue.cc:1243] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer 65c9c1653b3346b39a0e118540e6080c log is divergent from this leader: its last log entry 11.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
W20260709 12:11:08.659679 14331 rpcz_store.cc:269] 0709 12:11:06.403750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:06.403910 (+   160us) service_pool.cc:224] Handling call
0709 12:11:08.521913 (+2118003us) spinlock_profiling.cc:243] Waited 1.29 s on lock 0x7b54000fcdd4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:11:08.522045 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2973329792}
I20260709 12:11:08.698671 14258 raft_consensus.cc:1275] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:11:08.700520 14155 leader_election.cc:304] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:08.698832 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:08.350515 17513 raft_consensus.cc:740] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:11:08.515096 17744 leader_election.cc:290] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:11:08.526840 17881 log.cc:927] Time spent T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.534s	user 0.003s	sys 0.000s
I20260709 12:11:08.583341 17735 raft_consensus.cc:493] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:08.350616 17697 consensus_queue.cc:1059] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.340s
I20260709 12:11:08.711143 14155 leader_election.cc:304] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:08.720487 14264 raft_consensus.cc:1240] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 8. Current term is 9. Ops: []
W20260709 12:11:08.531680 17863 log.cc:927] Time spent T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.617s	user 0.000s	sys 0.001s
I20260709 12:11:08.665668 17798 raft_consensus.cc:3060] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:08.661906 17857 raft_consensus.cc:493] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:08.353176 17870 raft_consensus.cc:515] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:08.716321 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:08.462654 17704 raft_consensus.cc:493] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:08.684589 17853 raft_consensus.cc:2749] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:11:08.700740 17851 raft_consensus.cc:2804] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:08.709575 17317 raft_consensus.cc:2804] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:08.742082 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:08.408975 17819 consensus_queue.cc:1059] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.306s
I20260709 12:11:08.687278 17811 raft_consensus.cc:493] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:08.743904 14155 leader_election.cc:304] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:08.495103 17750 raft_consensus.cc:493] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:08.683621 17694 leader_election.cc:290] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:08.684190 17777 raft_consensus.cc:3060] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:11:08.684778 17748 raft_consensus.cc:493] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:08.404103 17893 consensus_queue.cc:1059] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.371s
I20260709 12:11:08.712360 17718 raft_consensus.cc:2749] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:08.709339 17840 consensus_queue.cc:1048] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.080s
I20260709 12:11:08.781967 14264 raft_consensus.cc:1275] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:11:08.712543 17439 raft_consensus.cc:493] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
W20260709 12:11:08.783449 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 68033.6us
I20260709 12:11:08.718183 17809 raft_consensus.cc:493] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:08.807996 14258 raft_consensus.cc:1275] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:11:08.720477 17744 raft_consensus.cc:493] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:08.745606 14155 leader_election.cc:304] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:09.000175 17894 raft_consensus.cc:493] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:09.086647 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:08.722043 17857 raft_consensus.cc:515] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:08.719074 17887 raft_consensus.cc:493] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:08.719339 17732 raft_consensus.cc:3055] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:08.723439 17861 raft_consensus.cc:697] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 8 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:11:08.963593 14261 raft_consensus.cc:1240] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:08.735102 17735 raft_consensus.cc:515] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:08.998852 14256 raft_consensus.cc:1275] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
W20260709 12:11:08.968353 14303 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:08.975827 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:08.742681 17900 raft_consensus.cc:2804] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:08.961542 14911 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53200 (request call id 522) took 1206 ms. Trace:
W20260709 12:11:08.978555 17767 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.985s	user 0.035s	sys 0.031s
I20260709 12:11:08.747287 17768 raft_consensus.cc:493] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:08.744189 17879 raft_consensus.cc:2749] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:08.908234 17317 raft_consensus.cc:697] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 8 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:11:08.911195 17851 raft_consensus.cc:697] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 11 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:11:09.057255 14229 leader_election.cc:304] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:08.789223 17577 consensus_queue.cc:1048] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.219s
I20260709 12:11:08.750505 17704 raft_consensus.cc:515] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:11:09.129199 17767 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.136s	user 0.036s	sys 0.038s
I20260709 12:11:09.055218 17439 raft_consensus.cc:515] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:08.512823 17864 consensus_queue.cc:237] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:09.063679 17875 raft_consensus.cc:2749] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:11:09.064862 17908 log.cc:927] Time spent T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
W20260709 12:11:09.065889 17909 log.cc:927] Time spent T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
W20260709 12:11:09.075568 17760 consensus_meta.cc:287] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.759s	user 0.009s	sys 0.000s
I20260709 12:11:09.009187 17718 raft_consensus.cc:493] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:08.800370 17748 raft_consensus.cc:515] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:08.788832 17750 raft_consensus.cc:515] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:09.055380 17694 raft_consensus.cc:493] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:11:09.087949 14189 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 2450) took 1269 ms. Trace:
I20260709 12:11:09.092734 14264 raft_consensus.cc:1275] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 11 index: 4. (index mismatch)
I20260709 12:11:08.783226 17811 raft_consensus.cc:515] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:09.077494 17771 raft_consensus.cc:3055] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:09.118127 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:09.122181 14911 rpcz_store.cc:276] 0709 12:11:07.749448 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:07.749617 (+   169us) service_pool.cc:224] Handling call
0709 12:11:07.779909 (+ 30292us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:07.800253 (+ 20344us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:07.800284 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:07.800862 (+   578us) log.cc:844] Serialized 26 byte log entry
0709 12:11:08.526133 (+725271us) spinlock_profiling.cc:243] Waited 1.35 ms on lock 0x7b4400022b4c. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2123f74c85 00007f2123f756a2 00007f2126ce71db 00007f2126ce2aaf 00007f2126cd686e 00007f2126cd5bb6 00007f2126cd57d8 00007f2126cdf221 00007f2126cdf1d9 00007f2126cdf169
0709 12:11:08.528314 (+  2181us) spinlock_profiling.cc:243] Waited 3.85 ms on lock 0x7b18004338a0. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f212cf16ab1 00007f212cf23281 00007f2126ce34bc 00007f212403148b 00007f212ce8b9a9 00007f212404d69b 00007f212404b93f 00007f212404dc02 00007f2126cd520b 00007f2126cdad23 00007f2126cdb0d1
0709 12:11:08.528509 (+   195us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:08.528549 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:08.528628 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:08.955695 (+427067us) raft_consensus.cc:1685] finished
0709 12:11:08.955717 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:08.955884 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30409,"raft.queue_time_us":43583,"raft.run_cpu_time_us":202,"raft.run_wall_time_us":14863,"spinlock_wait_cycles":11952128,"thread_start_us":19866,"threads_started":1,"wal-append.queue_time_us":174978}
I20260709 12:11:09.128961 14263 raft_consensus.cc:1275] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:11:09.129242 14190 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56652 (request call id 849) took 1220 ms. Trace:
I20260709 12:11:09.148496 17893 raft_consensus.cc:493] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:09.171414 14189 rpcz_store.cc:276] 0709 12:11:07.818785 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:07.990689 (+171904us) service_pool.cc:224] Handling call
0709 12:11:07.991069 (+   380us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:08.310289 (+319220us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:08.310328 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:08.325960 (+ 15632us) log.cc:844] Serialized 26 byte log entry
0709 12:11:08.748558 (+422598us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:08.748603 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:08.748675 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:09.087687 (+339012us) raft_consensus.cc:1685] finished
0709 12:11:09.087712 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:09.087870 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":318746,"raft.queue_time_us":327382,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":144,"thread_start_us":422214,"threads_started":1,"wal-append.queue_time_us":681555}
I20260709 12:11:09.127096 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:09.098119 17744 raft_consensus.cc:515] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:09.093598 17819 raft_consensus.cc:2804] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:11:09.144080 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 86919.1us
I20260709 12:11:09.144259 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:09.101383 17732 raft_consensus.cc:740] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
W20260709 12:11:09.010324 17905 log.cc:927] Time spent T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.404s	user 0.001s	sys 0.000s
I20260709 12:11:09.101166 17815 raft_consensus.cc:493] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:09.062141 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 316624us
I20260709 12:11:09.122143 17900 raft_consensus.cc:493] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:09.090178 17809 raft_consensus.cc:515] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:11:09.163748 14156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:09.150132 17888 raft_consensus.cc:2804] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:11:09.169559 14331 raft_consensus.cc:2410] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for term 12 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:11:09.116945 17887 raft_consensus.cc:515] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:09.130605 14184 raft_consensus.cc:2468] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 11.
I20260709 12:11:09.174410 14190 rpcz_store.cc:276] 0709 12:11:07.909322 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:08.239764 (+330442us) service_pool.cc:224] Handling call
0709 12:11:08.249822 (+ 10058us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:08.326073 (+ 76251us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:08.326111 (+    38us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:08.326737 (+   626us) log.cc:844] Serialized 52 byte log entry
0709 12:11:08.534572 (+207835us) spinlock_profiling.cc:243] Waited 2.46 ms on lock 0x7b4800270558. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f212c064aa1 00007f212c05bb37 00007f212c05b9ca 00007f212c15326f 00007f212c152f37 00007f212c16755c 00007f212c167508 00007f212c167488 00007f212c167443 00007f212c1666ec 00007f212b090a96
0709 12:11:08.702125 (+167553us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:08.808630 (+106505us) log.cc:844] Serialized 14 byte log entry
0709 12:11:09.089639 (+281009us) log.cc:844] Serialized 14 byte log entry
0709 12:11:09.091477 (+  1838us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:09.091579 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:09.128961 (+ 37382us) raft_consensus.cc:1685] finished
0709 12:11:09.128989 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:09.129174 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":215100,"raft.queue_time_us":217488,"raft.run_cpu_time_us":2511,"raft.run_wall_time_us":254641,"spinlock_wait_cycles":5649280,"thread_start_us":553276,"threads_started":3,"wal-append.queue_time_us":633708}
I20260709 12:11:09.136116 14303 leader_election.cc:304] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:09.097795 17894 raft_consensus.cc:515] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:09.178578 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:09.180593 14332 raft_consensus.cc:2410] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:11:09.180910 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:09.187489 14256 raft_consensus.cc:2393] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 6: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:11:09.187520 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:09.140205 17768 raft_consensus.cc:515] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:09.206256 14229 leader_election.cc:304] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:09.166934 17922 raft_consensus.cc:493] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:09.257620 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:09.214378 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:09.224278 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:09.224445 14155 leader_election.cc:304] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:09.173493 17771 raft_consensus.cc:740] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:11:09.230182 17616 raft_consensus.cc:3060] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:09.230590 17748 leader_election.cc:290] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:11:09.268455 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 62315.7us
I20260709 12:11:09.222947 17760 consensus_queue.cc:1059] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 12:11:09.231705 17870 leader_election.cc:290] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:09.178833 17694 raft_consensus.cc:515] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:09.272720 17916 raft_consensus.cc:2804] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:09.277024 17916 raft_consensus.cc:493] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:09.277421 17916 raft_consensus.cc:3060] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:09.278592 17694 leader_election.cc:290] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:09.229581 17732 consensus_queue.cc:260] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:09.277679 17882 raft_consensus.cc:2804] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:09.281142 17882 raft_consensus.cc:697] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 8 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:11:09.282172 17882 consensus_queue.cc:237] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } }
I20260709 12:11:09.282639 17735 leader_election.cc:290] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:09.272918 17879 raft_consensus.cc:2804] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:11:09.267294 17888 raft_consensus.cc:697] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 6 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
W20260709 12:11:09.284224 17919 log.cc:927] Time spent T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 12:11:09.236088 17900 raft_consensus.cc:3060] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:09.174829 17718 raft_consensus.cc:515] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:11:09.235910 14185 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56046 (request call id 2122) took 1645 ms (client timeout 1716 ms). Trace:
I20260709 12:11:09.173527 17899 raft_consensus.cc:493] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:09.291917 17899 raft_consensus.cc:515] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:09.186178 17819 raft_consensus.cc:493] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:09.258445 14189 raft_consensus.cc:3060] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:09.262545 14263 raft_consensus.cc:2468] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 8.
W20260709 12:11:09.264438 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 128400us
I20260709 12:11:09.294507 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:09.215925 17893 raft_consensus.cc:515] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:09.272114 14258 raft_consensus.cc:1275] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:11:09.270394 14187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 2453) took 1347 ms. Trace:
I20260709 12:11:09.277498 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:09.274915 14262 raft_consensus.cc:2376] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 7. Re-sending same reply.
I20260709 12:11:09.286382 14229 leader_election.cc:304] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
W20260709 12:11:09.289357 14185 rpcz_store.cc:269] 0709 12:11:07.590901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:07.591041 (+   140us) service_pool.cc:224] Handling call
0709 12:11:09.235692 (+1644651us) spinlock_profiling.cc:243] Waited 713 ms on lock 0x7b54003e7e54. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:11:09.235845 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1638806784}
I20260709 12:11:09.289652 14261 raft_consensus.cc:2468] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 9.
I20260709 12:11:09.243330 17890 leader_election.cc:290] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:09.282684 17887 leader_election.cc:290] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:09.284152 17879 raft_consensus.cc:697] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 5 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:11:09.292392 17718 leader_election.cc:290] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:09.293207 14264 raft_consensus.cc:2468] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 8.
W20260709 12:11:09.225957 17908 log.cc:927] Time spent T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:11:09.297016 14260 raft_consensus.cc:1275] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:11:09.267122 14155 leader_election.cc:304] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:09.275336 17317 consensus_queue.cc:237] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:09.309449 14256 raft_consensus.cc:2393] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db in current term 11: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:11:09.308879 14187 rpcz_store.cc:276] 0709 12:11:07.922913 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:08.316928 (+394015us) service_pool.cc:224] Handling call
0709 12:11:08.317290 (+   362us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:08.327210 (+  9920us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:08.327248 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:08.327697 (+   449us) log.cc:844] Serialized 26 byte log entry
0709 12:11:08.664767 (+337070us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:08.664815 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:08.664886 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:09.270117 (+605231us) raft_consensus.cc:1685] finished
0709 12:11:09.270144 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:09.270306 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9504,"raft.queue_time_us":18953,"spinlock_wait_cycles":151122816,"thread_start_us":311813,"threads_started":1,"wal-append.queue_time_us":369977}
I20260709 12:11:09.252501 17925 raft_consensus.cc:493] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:11:09.321273 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:09.240852 17815 raft_consensus.cc:515] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:09.188258 17861 consensus_queue.cc:237] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:09.330890 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:09.293960 17915 raft_consensus.cc:493] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:09.306355 17819 raft_consensus.cc:3060] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:09.334484 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 67468.4us
I20260709 12:11:09.362210 14155 leader_election.cc:304] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:09.335610 14190 raft_consensus.cc:2468] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 5.
I20260709 12:11:09.348950 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:09.336177 17874 raft_consensus.cc:493] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:09.364105 17874 raft_consensus.cc:515] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:09.350157 14229 leader_election.cc:304] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:09.323380 17577 raft_consensus.cc:493] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:09.366411 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:09.263971 17924 consensus_queue.cc:1048] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.079s
I20260709 12:11:09.311549 17918 consensus_queue.cc:1048] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.056s
I20260709 12:11:09.345085 17890 raft_consensus.cc:2749] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:09.360040 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:09.360778 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:09.256906 17851 consensus_queue.cc:237] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:09.366228 17577 raft_consensus.cc:515] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:09.346973 17718 raft_consensus.cc:2804] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:09.357719 17439 leader_election.cc:290] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:11:09.367981 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 63178.2us
I20260709 12:11:09.364096 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:09.271924 17922 raft_consensus.cc:515] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:09.372545 14189 raft_consensus.cc:2468] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 9.
I20260709 12:11:09.399533 14189 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56046 (request call id 2135) took 1041 ms. Trace:
I20260709 12:11:09.399919 14189 rpcz_store.cc:276] 0709 12:11:08.358233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:09.257326 (+899093us) service_pool.cc:224] Handling call
0709 12:11:09.399453 (+142127us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:09.400990 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:11:09.373536 17777 consensus_meta.cc:287] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db: Time spent flushing consensus metadata: real 0.586s	user 0.010s	sys 0.000s
I20260709 12:11:09.407474 17842 raft_consensus.cc:493] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:09.408017 17842 raft_consensus.cc:515] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:09.410236 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:09.410146 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:09.415112 14259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41764 (request call id 2498) took 1061 ms. Trace:
I20260709 12:11:09.376032 14155 leader_election.cc:304] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
W20260709 12:11:09.377077 17798 consensus_meta.cc:287] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.638s	user 0.008s	sys 0.003s
I20260709 12:11:09.379240 17900 raft_consensus.cc:515] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:09.420651 17900 leader_election.cc:290] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:09.367483 17760 raft_consensus.cc:2749] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:09.369648 17915 raft_consensus.cc:515] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:09.383122 14181 raft_consensus.cc:1275] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:11:09.355371 17925 raft_consensus.cc:515] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:09.426263 17925 leader_election.cc:290] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:09.361024 17735 consensus_queue.cc:1048] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 12:11:09.386533 17744 leader_election.cc:290] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:09.360821 17887 raft_consensus.cc:493] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:09.428902 17887 raft_consensus.cc:515] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:09.431497 17887 leader_election.cc:290] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:11:09.387084 17910 log.cc:927] Time spent T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 12:11:09.388680 14188 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 2451) took 1542 ms. Trace:
I20260709 12:11:09.434167 17926 raft_consensus.cc:2749] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:09.433349 14188 rpcz_store.cc:276] 0709 12:11:07.846279 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:08.089357 (+243078us) service_pool.cc:224] Handling call
0709 12:11:08.089763 (+   406us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:08.319294 (+229531us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:11:08.319327 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:08.326643 (+  7316us) log.cc:844] Serialized 26 byte log entry
0709 12:11:08.719095 (+392452us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:11:08.719146 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:08.719225 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:09.388414 (+669189us) raft_consensus.cc:1685] finished
0709 12:11:09.388441 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:09.388605 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":229085,"raft.queue_time_us":229262,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":90,"thread_start_us":392020,"threads_started":1,"wal-append.queue_time_us":948387}
I20260709 12:11:09.435140 17704 leader_election.cc:290] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:09.435384 17811 leader_election.cc:290] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:09.435487 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:09.435804 17879 consensus_queue.cc:237] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:09.436395 14257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41764 (request call id 2490) took 1103 ms. Trace:
I20260709 12:11:09.436823 14257 rpcz_store.cc:276] 0709 12:11:08.333282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:08.334220 (+   938us) service_pool.cc:224] Handling call
0709 12:11:08.350208 (+ 15988us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:08.365163 (+ 14955us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:08.365199 (+    36us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:08.410418 (+ 45219us) log.cc:844] Serialized 52 byte log entry
0709 12:11:08.700400 (+289982us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:11:08.700439 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:08.700511 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:09.436124 (+735613us) raft_consensus.cc:1685] finished
0709 12:11:09.436147 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:09.436326 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":171983,"raft.queue_time_us":112543,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":4324,"thread_start_us":289540,"threads_started":1,"wal-append.queue_time_us":762118}
I20260709 12:11:09.438921 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:09.389667 14263 raft_consensus.cc:2468] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 7.
I20260709 12:11:09.359943 17857 leader_election.cc:290] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:09.440762 17811 raft_consensus.cc:493] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:09.441519 17811 raft_consensus.cc:515] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:09.442083 14263 raft_consensus.cc:1275] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:11:09.442435 17577 leader_election.cc:290] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:09.443564 14263 raft_consensus.cc:1275] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:11:09.443720 17811 leader_election.cc:290] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:09.397135 14187 raft_consensus.cc:2468] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 9.
I20260709 12:11:09.331111 17916 raft_consensus.cc:515] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:11:09.418685 17914 log.cc:927] Time spent T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.173s	user 0.000s	sys 0.000s
I20260709 12:11:09.394860 17718 raft_consensus.cc:493] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
W20260709 12:11:09.373915 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 60593.1us
I20260709 12:11:09.416672 14256 raft_consensus.cc:3060] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:09.417836 17439 raft_consensus.cc:2804] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:09.410465 14910 raft_consensus.cc:2468] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 5.
W20260709 12:11:09.423413 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 47456.5us
I20260709 12:11:09.412971 14912 raft_consensus.cc:2468] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 7.
I20260709 12:11:09.415536 14259 rpcz_store.cc:276] 0709 12:11:08.353566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:08.353783 (+   217us) service_pool.cc:224] Handling call
0709 12:11:08.354133 (+   350us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:08.659376 (+305243us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:08.659409 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:08.688491 (+ 29082us) log.cc:844] Serialized 52 byte log entry
0709 12:11:09.056033 (+367542us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:11:09.056079 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:09.056161 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:09.414885 (+358724us) raft_consensus.cc:1685] finished
0709 12:11:09.414907 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:09.415039 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":156708,"raft.queue_time_us":307530,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":6525,"thread_start_us":317091,"threads_started":1,"wal-append.queue_time_us":430948}
I20260709 12:11:09.367069 14260 raft_consensus.cc:2468] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 9.
I20260709 12:11:09.446542 14188 raft_consensus.cc:2468] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 8.
I20260709 12:11:09.460203 14877 leader_election.cc:304] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:11:09.451077 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:09.452792 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:09.389727 17888 consensus_queue.cc:237] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:09.455152 17718 raft_consensus.cc:3060] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:09.464133 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:09.461948 14187 raft_consensus.cc:2468] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 10.
I20260709 12:11:09.466751 14187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56046 (request call id 2141) took 1106 ms. Trace:
I20260709 12:11:09.467152 14187 rpcz_store.cc:276] 0709 12:11:08.360141 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:09.452473 (+1092332us) service_pool.cc:224] Handling call
0709 12:11:09.466679 (+ 14206us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:09.465996 14877 leader_election.cc:304] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:09.468082 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:09.469028 14334 raft_consensus.cc:2393] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db in current term 11: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:11:09.469274 14263 raft_consensus.cc:2393] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 10: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:11:09.462779 17927 raft_consensus.cc:2804] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:09.470167 17927 raft_consensus.cc:493] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:09.470311 17931 raft_consensus.cc:2749] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:09.470572 17927 raft_consensus.cc:3060] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:09.473403 14877 leader_election.cc:304] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:09.475587 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:09.478319 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:09.479205 14188 raft_consensus.cc:2410] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:11:09.476416 14263 raft_consensus.cc:2468] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 10.
I20260709 12:11:09.481052 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:09.488189 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:09.488503 14188 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56046 (request call id 2137) took 1129 ms. Trace:
I20260709 12:11:09.489147 14188 rpcz_store.cc:276] 0709 12:11:08.359053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:09.459113 (+1100060us) service_pool.cc:224] Handling call
0709 12:11:09.488398 (+ 29285us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:09.488972 14187 raft_consensus.cc:2468] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 9.
I20260709 12:11:09.491437 14187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56046 (request call id 2144) took 1130 ms. Trace:
I20260709 12:11:09.491778 14187 rpcz_store.cc:276] 0709 12:11:08.360915 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:09.467994 (+1107079us) service_pool.cc:224] Handling call
0709 12:11:09.491373 (+ 23379us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:09.463689 17750 leader_election.cc:290] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:09.481995 17694 raft_consensus.cc:2749] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:09.463385 17439 raft_consensus.cc:493] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:11:09.496884 17439 raft_consensus.cc:3060] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:09.497884 17893 leader_election.cc:290] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:09.407912 17771 consensus_queue.cc:260] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:09.508046 14339 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50856 (request call id 2035) took 1023 ms. Trace:
I20260709 12:11:09.510080 14256 raft_consensus.cc:2468] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 7.
I20260709 12:11:09.514508 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:09.517037 17439 raft_consensus.cc:515] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:09.489446 14260 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6"
dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
 from {username='slave'} at 127.0.0.1:53050
I20260709 12:11:09.524950 17815 leader_election.cc:290] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:09.527163 17819 raft_consensus.cc:515] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:09.525382 17916 leader_election.cc:290] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 13 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:09.534648 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:09.545046 14910 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53194 (request call id 825) took 2122 ms. Trace:
I20260709 12:11:09.566359 17768 leader_election.cc:290] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:09.542763 14332 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50856 (request call id 2039) took 1034 ms. Trace:
I20260709 12:11:09.619351 14188 raft_consensus.cc:2468] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 8.
I20260709 12:11:09.627403 14188 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56046 (request call id 2140) took 1267 ms. Trace:
I20260709 12:11:09.626608 14332 rpcz_store.cc:276] 0709 12:11:08.507972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:08.699304 (+191332us) service_pool.cc:224] Handling call
0709 12:11:09.542486 (+843182us) spinlock_profiling.cc:243] Waited 455 ms on lock 0x7b540047de54. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:11:09.542660 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1046217600}
I20260709 12:11:09.627960 14188 rpcz_store.cc:276] 0709 12:11:08.359884 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:09.490069 (+1130185us) service_pool.cc:224] Handling call
0709 12:11:09.627326 (+137257us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:09.619449 14260 raft_consensus.cc:493] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:09.535768 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:09.633894 14330 raft_consensus.cc:2468] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 6.
I20260709 12:11:09.634227 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:09.634932 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:09.583873 17809 leader_election.cc:290] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:09.581876 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:09.619686 14910 rpcz_store.cc:276] 0709 12:11:07.422584 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:07.422753 (+   169us) service_pool.cc:224] Handling call
0709 12:11:09.544843 (+2122090us) spinlock_profiling.cc:243] Waited 1.99 s on lock 0x7b5400649bd4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:11:09.544956 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4569029888}
I20260709 12:11:09.543874 14184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56046 (request call id 2138) took 1184 ms. Trace:
I20260709 12:11:09.580052 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:11:09.600620 14155 connection.cc:256] RPC call timeout handler was delayed by -1.0073007309999866s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1988s for a response
I20260709 12:11:09.569949 17915 leader_election.cc:290] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:09.639393 14262 raft_consensus.cc:2468] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 8.
I20260709 12:11:09.639128 14184 rpcz_store.cc:276] 0709 12:11:08.359325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:08.698537 (+339212us) service_pool.cc:224] Handling call
0709 12:11:09.543674 (+845137us) spinlock_profiling.cc:243] Waited 424 ms on lock 0x7b5400421b54. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:11:09.543806 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":974437248}
I20260709 12:11:09.587036 17926 raft_consensus.cc:493] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:09.635650 14330 raft_consensus.cc:2468] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 8.
I20260709 12:11:09.640029 14155 leader_election.cc:400] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 pre-election: Vote denied by peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673) with higher term. Message: Invalid argument: T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 10. Current term is 11.
I20260709 12:11:09.640650 14155 leader_election.cc:403] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:09.641077 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:09.641834 14330 raft_consensus.cc:2468] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 9.
I20260709 12:11:09.631649 17916 raft_consensus.cc:493] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:09.647132 14155 leader_election.cc:304] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:09.648372 14188 raft_consensus.cc:1275] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:11:09.648540 14155 leader_election.cc:304] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:09.649479 14188 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 2460) took 1575 ms. Trace:
I20260709 12:11:09.649930 14188 rpcz_store.cc:276] 0709 12:11:08.074084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:09.630688 (+1556604us) service_pool.cc:224] Handling call
0709 12:11:09.645264 (+ 14576us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:09.648857 (+  3593us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:09.649100 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:09.650415 14155 leader_election.cc:304] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:09.575116 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:09.651273 14337 raft_consensus.cc:2468] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 9.
I20260709 12:11:09.652858 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:09.654446 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:09.655776 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:09.656378 14258 raft_consensus.cc:2468] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 10.
I20260709 12:11:09.657366 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:09.657860 17858 raft_consensus.cc:493] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:09.658018 14258 raft_consensus.cc:2468] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 6.
I20260709 12:11:09.658460 17858 raft_consensus.cc:515] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:09.659111 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:09.659431 17857 raft_consensus.cc:2804] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:09.659777 14258 raft_consensus.cc:3060] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:09.665326 17925 raft_consensus.cc:3060] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:09.668707 14258 raft_consensus.cc:2468] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 9.
I20260709 12:11:09.670006 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:09.636482 14877 leader_election.cc:304] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:11:09.568449 14187 raft_consensus.cc:1275] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:11:09.644551 14260 raft_consensus.cc:3060] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:09.643220 14184 raft_consensus.cc:1275] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:11:09.643328 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:09.571852 17439 leader_election.cc:290] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 9 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:09.601578 17317 raft_consensus.cc:493] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:09.670745 14258 raft_consensus.cc:2468] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 8.
I20260709 12:11:09.676144 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:09.676973 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:09.678368 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:09.674564 14155 leader_election.cc:304] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:09.674851 14184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 2464) took 1544 ms. Trace:
I20260709 12:11:09.679088 14332 raft_consensus.cc:2468] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 10.
I20260709 12:11:09.672607 14877 leader_election.cc:304] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:11:09.679508 14184 rpcz_store.cc:276] 0709 12:11:08.130763 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:09.642297 (+1511534us) service_pool.cc:224] Handling call
0709 12:11:09.642880 (+   583us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:09.674059 (+ 31179us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:09.674780 (+   721us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:09.688163 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:09.688465 14184 raft_consensus.cc:1240] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 9. Current term is 10. Ops: [7.4-9.5]
I20260709 12:11:09.680195 14155 leader_election.cc:304] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:09.574447 17927 raft_consensus.cc:515] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:09.647851 17811 raft_consensus.cc:2749] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673) with higher term. Message: Invalid argument: T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 10. Current term is 11.
I20260709 12:11:09.690022 14184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 2469) took 1434 ms. Trace:
I20260709 12:11:09.694370 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:09.694334 14184 rpcz_store.cc:276] 0709 12:11:08.255422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:09.687851 (+1432429us) service_pool.cc:224] Handling call
0709 12:11:09.688212 (+   361us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:09.689605 (+  1393us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:09.689956 (+   351us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:09.680645 14258 raft_consensus.cc:2468] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 5.
I20260709 12:11:09.693832 14155 leader_election.cc:304] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:09.670410 17857 raft_consensus.cc:493] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:09.677809 17616 raft_consensus.cc:2804] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:09.697472 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:09.678047 17841 raft_consensus.cc:2804] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:09.695557 17839 raft_consensus.cc:2804] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:09.689533 17439 raft_consensus.cc:2804] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:09.547612 17513 consensus_queue.cc:260] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:09.704948 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:09.719725 14261 raft_consensus.cc:2468] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 11.
I20260709 12:11:09.711231 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:09.721241 14336 raft_consensus.cc:3060] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:09.711781 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:09.697556 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:09.713392 14258 raft_consensus.cc:2468] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 7.
I20260709 12:11:09.709224 14303 leader_election.cc:304] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 885067a0d31741bfb5c9935788e315bf
W20260709 12:11:09.728055 14156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:09.723954 14257 raft_consensus.cc:3060] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:09.756026 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 46882.3us
I20260709 12:11:09.649223 17926 raft_consensus.cc:515] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:09.679787 17317 raft_consensus.cc:515] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:09.675132 17916 raft_consensus.cc:515] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:09.687026 17851 consensus_queue.cc:1059] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.137s
I20260709 12:11:09.819936 14261 raft_consensus.cc:1240] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:09.697031 17879 raft_consensus.cc:2804] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:09.847121 14258 raft_consensus.cc:1275] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 12:11:09.818800 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 125064us
I20260709 12:11:09.851313 14261 raft_consensus.cc:1275] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:11:09.853981 14155 leader_election.cc:304] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:09.854892 14261 raft_consensus.cc:1275] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 12:11:09.826364 17944 log.cc:927] Time spent T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
I20260709 12:11:09.858863 14257 raft_consensus.cc:2468] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 11.
I20260709 12:11:09.860909 14257 raft_consensus.cc:1275] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 12:11:09.772908 14303 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:09.803562 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
W20260709 12:11:09.804618 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 44652.5us
W20260709 12:11:09.703891 17895 log.cc:927] Time spent T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 1.215s	user 0.002s	sys 0.000s
I20260709 12:11:09.701440 17839 raft_consensus.cc:493] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:11:09.865798 14912 raft_consensus.cc:1240] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:09.716897 17513 raft_consensus.cc:3060] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:09.700954 17841 raft_consensus.cc:493] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:09.700107 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:09.700496 17857 raft_consensus.cc:3060] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:09.700598 17616 raft_consensus.cc:493] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:09.712994 17811 raft_consensus.cc:2804] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:09.898300 14181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 2454) took 1933 ms. Trace:
I20260709 12:11:09.938097 14181 rpcz_store.cc:276] 0709 12:11:07.965421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:08.318244 (+352823us) service_pool.cc:224] Handling call
0709 12:11:08.344134 (+ 25890us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:09.422672 (+1078538us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:09.898008 (+475336us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b54001112d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:11:09.898228 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2388517248}
I20260709 12:11:09.706583 17439 raft_consensus.cc:493] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:09.901997 14261 raft_consensus.cc:1240] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:09.712136 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:11:09.803797 17924 raft_consensus.cc:2764] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:11:09.856880 17879 raft_consensus.cc:493] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:09.916263 14257 raft_consensus.cc:1240] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 8 LEADER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:09.708057 17718 raft_consensus.cc:515] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:09.922323 14336 raft_consensus.cc:2468] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 9.
I20260709 12:11:09.736389 14260 raft_consensus.cc:515] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:11:09.913924 17938 log.cc:927] Time spent T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.270s	user 0.001s	sys 0.000s
I20260709 12:11:09.949297 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:09.934640 17841 raft_consensus.cc:3060] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:09.937299 17851 raft_consensus.cc:493] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:09.926749 17875 raft_consensus.cc:2804] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:09.923834 17819 leader_election.cc:290] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 13 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:09.932454 17839 raft_consensus.cc:3060] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:09.945484 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 91598.1us
I20260709 12:11:09.951093 14258 raft_consensus.cc:1240] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:09.941767 17616 raft_consensus.cc:3060] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:09.954273 14912 raft_consensus.cc:2410] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:11:09.909384 17861 raft_consensus.cc:493] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:09.955953 14181 raft_consensus.cc:1240] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:09.939743 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:09.970487 14332 raft_consensus.cc:3060] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:09.962494 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:09.937872 17831 consensus_queue.cc:1059] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 12:11:09.934633 17915 consensus_queue.cc:1059] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 12:11:09.938827 17446 consensus_queue.cc:1048] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 12:11:09.941653 17811 raft_consensus.cc:493] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:09.942673 17927 leader_election.cc:290] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 10 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:09.968205 14155 leader_election.cc:304] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:09.951149 17879 raft_consensus.cc:3060] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:09.941923 17840 consensus_queue.cc:1048] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 12:11:09.946043 17694 consensus_queue.cc:1048] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 12:11:09.963271 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:09.943354 17439 raft_consensus.cc:3060] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:10.250821 14185 raft_consensus.cc:2468] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 6.
W20260709 12:11:10.096972 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:10.255404 14156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:10.253710 14260 leader_election.cc:290] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 9 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:10.080781 14332 raft_consensus.cc:2468] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 9.
I20260709 12:11:10.257583 14336 raft_consensus.cc:2468] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 7.
I20260709 12:11:10.011819 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:11:09.984433 14181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 2474) took 1727 ms. Trace:
W20260709 12:11:10.262277 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:10.263182 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:09.508615 14339 rpcz_store.cc:276] 0709 12:11:08.484327 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:09.128423 (+644096us) service_pool.cc:224] Handling call
0709 12:11:09.128770 (+   347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:09.128995 (+   225us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:11:09.354516 (+225521us) log.cc:844] Serialized 14 byte log entry
0709 12:11:09.507331 (+152815us) log.cc:844] Serialized 14 byte log entry
0709 12:11:09.507675 (+   344us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:09.507724 (+    49us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:09.507775 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:09.507849 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:09.507974 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2186,"prepare.queue_time_us":248995,"prepare.run_cpu_time_us":84,"prepare.run_wall_time_us":88,"raft.queue_time_us":254,"raft.run_cpu_time_us":274,"raft.run_wall_time_us":15364,"thread_start_us":357502,"threads_started":3,"wal-append.queue_time_us":38792}
I20260709 12:11:10.264722 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:10.262138 14336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55492 (request call id 618) took 1031 ms. Trace:
I20260709 12:11:10.268988 14186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 2471) took 2013 ms. Trace:
I20260709 12:11:10.266048 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:10.280393 14336 rpcz_store.cc:276] 0709 12:11:09.230669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:09.959196 (+728527us) service_pool.cc:224] Handling call
0709 12:11:10.262057 (+302861us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:10.260624 17811 raft_consensus.cc:3060] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:10.281044 14339 raft_consensus.cc:3060] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:10.288059 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:10.288561 14260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:53050 (request call id 640) took 1094 ms. Trace:
I20260709 12:11:10.289248 14910 raft_consensus.cc:2393] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 7: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
I20260709 12:11:09.967185 17875 raft_consensus.cc:493] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:10.289038 14260 rpcz_store.cc:276] 0709 12:11:09.169090 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:09.467231 (+298141us) service_pool.cc:224] Handling call
0709 12:11:10.259553 (+792322us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:09.965549 17858 leader_election.cc:290] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:10.112017 17925 raft_consensus.cc:2749] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:10.262827 14181 rpcz_store.cc:276] 0709 12:11:08.256847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:09.939123 (+1682276us) service_pool.cc:224] Handling call
0709 12:11:09.950452 (+ 11329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:09.984148 (+ 33696us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:09.984366 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:10.173367 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:10.250623 17839 raft_consensus.cc:515] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:10.231325 17841 raft_consensus.cc:515] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:10.299850 17839 leader_election.cc:290] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 10 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:10.300082 17841 leader_election.cc:290] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 7 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:10.294015 17875 raft_consensus.cc:3060] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:11:10.293493 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 325330us
I20260709 12:11:10.307869 14155 leader_election.cc:304] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:10.308996 14155 leader_election.cc:304] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:10.310045 17819 raft_consensus.cc:2804] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:10.310448 17819 raft_consensus.cc:493] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:10.310835 17819 raft_consensus.cc:3060] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:10.314196 17853 raft_consensus.cc:2804] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:11:10.314697 17853 raft_consensus.cc:493] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:10.315042 17853 raft_consensus.cc:3060] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:10.316133 14261 raft_consensus.cc:1240] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:11:10.030964 17916 leader_election.cc:290] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:10.280097 14186 rpcz_store.cc:276] 0709 12:11:08.256026 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:09.855446 (+1599420us) service_pool.cc:224] Handling call
0709 12:11:09.904254 (+ 48808us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:10.117760 (+213506us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:10.117798 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:10.118373 (+   575us) log.cc:844] Serialized 26 byte log entry
0709 12:11:10.234786 (+116413us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:11:10.234827 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:10.234909 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:10.264806 (+ 29897us) raft_consensus.cc:1685] finished
0709 12:11:10.264831 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:10.268891 (+  4060us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":50214,"raft.run_cpu_time_us":182,"raft.run_wall_time_us":11318,"thread_start_us":274643,"threads_started":2,"wal-append.queue_time_us":101630}
I20260709 12:11:10.028481 17718 leader_election.cc:290] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:10.296211 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:10.297438 17950 raft_consensus.cc:2804] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:11:10.301301 14303 leader_election.cc:336] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Timed out: RequestConsensusVote RPC to 127.12.174.129:37187 timed out after 1.987s (SENT)
I20260709 12:11:10.302037 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:10.303097 14181 raft_consensus.cc:1240] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 5. Current term is 6. Ops: []
I20260709 12:11:10.303858 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:10.326324 14303 leader_election.cc:304] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:10.326864 14260 raft_consensus.cc:3060] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:10.326970 14181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 2475) took 2069 ms. Trace:
I20260709 12:11:07.403443 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:10.327385 14181 rpcz_store.cc:276] 0709 12:11:08.257094 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:10.302570 (+2045476us) service_pool.cc:224] Handling call
0709 12:11:10.302902 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:10.326687 (+ 23785us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:10.326906 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:10.229146 17616 raft_consensus.cc:515] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:10.026952 17815 raft_consensus.cc:493] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:10.130795 17932 raft_consensus.cc:493] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:10.018119 17842 leader_election.cc:290] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:10.293727 17857 raft_consensus.cc:515] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:10.328471 14186 raft_consensus.cc:3055] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:10.378881 14186 raft_consensus.cc:740] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:11:10.378090 14256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53050 (request call id 650) took 1085 ms. Trace:
I20260709 12:11:10.381330 14303 leader_election.cc:304] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:10.381532 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:10.382074 14905 raft_consensus.cc:1240] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 5. Current term is 7. Ops: []
W20260709 12:11:10.378705 14190 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56046 (request call id 2142) took 2018 ms (client timeout 1972 ms). Trace:
I20260709 12:11:10.356069 14910 raft_consensus.cc:1275] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:11:10.347731 14262 raft_consensus.cc:1240] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:11:10.317437 14261 raft_consensus.cc:1240] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 11 LEADER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:10.351131 14337 raft_consensus.cc:1240] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 12. Current term is 13. Ops: []
W20260709 12:11:10.382902 14190 rpcz_store.cc:269] 0709 12:11:08.360388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:09.257113 (+896725us) service_pool.cc:224] Handling call
0709 12:11:10.378518 (+1121405us) spinlock_profiling.cc:243] Waited 26.4 ms on lock 0x7b5400421154. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:11:10.378628 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":60678016}
I20260709 12:11:10.380060 14256 rpcz_store.cc:276] 0709 12:11:09.292593 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:09.343469 (+ 50876us) service_pool.cc:224] Handling call
0709 12:11:10.377900 (+1034431us) spinlock_profiling.cc:243] Waited 26.6 ms on lock 0x7b5400221ad4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:11:10.378023 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":61104384}
I20260709 12:11:10.385548 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
W20260709 12:11:10.385972 14185 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56652 (request call id 855) took 1675 ms (client timeout 1754 ms). Trace:
W20260709 12:11:10.387140 14185 rpcz_store.cc:269] 0709 12:11:08.710987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:09.320900 (+609913us) service_pool.cc:224] Handling call
0709 12:11:10.385811 (+1064911us) spinlock_profiling.cc:243] Waited 906 ms on lock 0x7b54003e8354. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:11:10.385916 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2082816896}
I20260709 12:11:10.387102 14337 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 615) took 1209 ms. Trace:
I20260709 12:11:10.388954 14337 rpcz_store.cc:276] 0709 12:11:09.178216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:10.350578 (+1172362us) service_pool.cc:224] Handling call
0709 12:11:10.350937 (+   359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:10.384308 (+ 33371us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:10.387040 (+  2732us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:10.355516 14335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 616) took 1125 ms. Trace:
I20260709 12:11:10.390393 14335 rpcz_store.cc:276] 0709 12:11:09.230013 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:10.354659 (+1124646us) service_pool.cc:224] Handling call
0709 12:11:10.354981 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:10.355176 (+   195us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:10.355201 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:10.355248 (+    47us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:10.355283 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:10.355341 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:10.355449 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:10.391922 14190 raft_consensus.cc:1240] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:09.979244 17317 leader_election.cc:290] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:09.964965 17930 consensus_queue.cc:1048] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.335s
I20260709 12:11:10.032048 17926 leader_election.cc:290] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:09.966524 17851 raft_consensus.cc:515] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:10.011037 17861 raft_consensus.cc:515] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:10.405150 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:10.306259 14084 catalog_manager.cc:5697] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:10.317050 14155 leader_election.cc:304] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
W20260709 12:11:10.388330 14304 connection.cc:256] RPC call timeout handler was delayed by -1.6274747169998136s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16080000000000003s for a response
W20260709 12:11:10.409346 14304 connection.cc:256] RPC call timeout handler was delayed by -1.5671747169999435s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1675s for a response
I20260709 12:11:10.409500 14337 raft_consensus.cc:1275] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:11:10.410197 14337 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 620) took 1179 ms. Trace:
I20260709 12:11:10.400170 14260 raft_consensus.cc:2468] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 10.
I20260709 12:11:10.380008 14186 consensus_queue.cc:260] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:10.416415 14186 raft_consensus.cc:3060] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:10.401427 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:10.403462 14190 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56652 (request call id 850) took 1717 ms. Trace:
I20260709 12:11:10.405714 14331 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50856 (request call id 2038) took 1902 ms. Trace:
I20260709 12:11:10.417322 14256 raft_consensus.cc:1240] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 12:11:10.338999 17899 leader_election.cc:290] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:11:10.410887 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 93949.7us
I20260709 12:11:10.390131 17932 raft_consensus.cc:515] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:10.389995 17815 raft_consensus.cc:515] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:10.412879 17500 raft_consensus.cc:2804] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:10.413214 17857 leader_election.cc:290] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 13 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:10.343770 17894 leader_election.cc:290] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:10.414110 17851 leader_election.cc:290] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:10.386235 17950 raft_consensus.cc:697] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 9 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:11:10.354072 17697 raft_consensus.cc:3055] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:10.417333 14190 rpcz_store.cc:276] 0709 12:11:08.685940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:10.385207 (+1699267us) service_pool.cc:224] Handling call
0709 12:11:10.385586 (+   379us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:10.403229 (+ 17643us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:10.403405 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:10.418202 14331 rpcz_store.cc:276] 0709 12:11:08.503096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:08.718766 (+215670us) service_pool.cc:224] Handling call
0709 12:11:10.405513 (+1686747us) spinlock_profiling.cc:243] Waited 425 ms on lock 0x7b54002a6a54. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:11:10.405653 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":977501056}
I20260709 12:11:10.418970 14262 raft_consensus.cc:2468] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 7.
I20260709 12:11:10.468904 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:11:10.469873 17932 leader_election.cc:290] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:10.471007 14908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:10.471864 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:10.329010 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:10.419364 14337 rpcz_store.cc:276] 0709 12:11:09.231233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:10.403058 (+1171825us) service_pool.cc:224] Handling call
0709 12:11:10.409175 (+  6117us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:10.409936 (+   761us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:10.410139 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:10.399662 14339 raft_consensus.cc:2468] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 11.
I20260709 12:11:10.346167 17916 raft_consensus.cc:2749] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:10.420557 14905 raft_consensus.cc:1240] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 9 LEADER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:10.476634 17875 raft_consensus.cc:515] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:10.477802 14185 raft_consensus.cc:1240] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:10.480646 17875 leader_election.cc:290] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 7 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:10.482272 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:10.482995 17815 leader_election.cc:290] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:10.406797 17853 raft_consensus.cc:515] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:10.485307 17853 leader_election.cc:290] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 6 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:10.467573 17697 raft_consensus.cc:740] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:11:10.487166 17697 consensus_queue.cc:260] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:10.488513 17697 raft_consensus.cc:3060] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:10.335770 17879 raft_consensus.cc:515] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:10.411757 17955 raft_consensus.cc:493] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:10.490191 17955 raft_consensus.cc:515] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:10.491533 17879 leader_election.cc:290] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:10.492489 17955 leader_election.cc:290] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:10.492942 14262 raft_consensus.cc:1240] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:10.444595 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
W20260709 12:11:10.445461 14154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:10.411643 17616 leader_election.cc:290] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 11 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:10.450279 14912 raft_consensus.cc:1275] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 12:11:10.450803 17958 raft_consensus.cc:2804] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:10.454218 14230 leader_election.cc:304] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
W20260709 12:11:10.498241 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 44118.9us
I20260709 12:11:10.499732 14230 leader_election.cc:304] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:10.462200 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:10.465754 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:11:10.410363 17953 raft_consensus.cc:493] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:10.466002 17894 raft_consensus.cc:493] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:10.349772 17848 raft_consensus.cc:3060] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:10.470914 14190 raft_consensus.cc:1240] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:10.443801 17500 raft_consensus.cc:493] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:10.475282 14331 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 623) took 1243 ms. Trace:
I20260709 12:11:10.421299 14155 leader_election.cc:304] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
W20260709 12:11:10.495858 14154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:10.500958 14260 raft_consensus.cc:2468] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 11.
I20260709 12:11:10.522393 14331 rpcz_store.cc:276] 0709 12:11:09.232105 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:10.468038 (+1235933us) service_pool.cc:224] Handling call
0709 12:11:10.474714 (+  6676us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:10.474926 (+   212us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:10.474952 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:10.475012 (+    60us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:10.475046 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:10.475104 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:10.475214 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:11:10.522781 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 101589us
I20260709 12:11:10.524510 14155 leader_election.cc:304] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:10.511350 17955 raft_consensus.cc:2749] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:10.523429 14184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 2470) took 2267 ms. Trace:
I20260709 12:11:10.527056 14184 rpcz_store.cc:276] 0709 12:11:08.255748 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:09.695277 (+1439529us) service_pool.cc:224] Handling call
0709 12:11:09.696283 (+  1006us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:09.696651 (+   368us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:09.696683 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:09.697194 (+   511us) log.cc:844] Serialized 26 byte log entry
0709 12:11:10.308296 (+611102us) spinlock_profiling.cc:243] Waited 1.38 ms on lock 0x7b18003a1380. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f212cf16ab1 00007f212cf23281 00007f2124030e07 00007f212ce8b9a9 00007f212404d69b 00007f212404b93f 00007f212404dc02 00007f2126cd520b 00007f2126cdad23 00007f2126cdb0d1 00007f21270f6a0f
0709 12:11:10.501546 (+193250us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:11:10.501604 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:10.501688 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:10.501758 (+    70us) raft_consensus.cc:1685] finished
0709 12:11:10.501770 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:10.523355 (+ 21585us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6234,"raft.queue_time_us":86,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":2428,"spinlock_wait_cycles":3174656,"thread_start_us":193035,"threads_started":1,"wal-append.queue_time_us":761401}
I20260709 12:11:10.525295 17500 raft_consensus.cc:3060] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:10.529695 14184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56652 (request call id 853) took 1839 ms. Trace:
I20260709 12:11:10.532716 14184 rpcz_store.cc:276] 0709 12:11:08.690261 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:10.528792 (+1838531us) service_pool.cc:224] Handling call
0709 12:11:10.529179 (+   387us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:10.529368 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:10.529394 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:10.529439 (+    45us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:10.529474 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:10.529525 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:10.529631 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:10.531648 17616 raft_consensus.cc:2804] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:10.535773 17616 raft_consensus.cc:493] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:10.536168 17616 raft_consensus.cc:3060] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:10.538446 14331 raft_consensus.cc:1240] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:10.539178 14331 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50858 (request call id 1708) took 1081 ms. Trace:
I20260709 12:11:10.539460 14331 rpcz_store.cc:276] 0709 12:11:09.458199 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:10.524087 (+1065888us) service_pool.cc:224] Handling call
0709 12:11:10.538248 (+ 14161us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:10.538895 (+   647us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:10.539103 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:10.540686 14331 raft_consensus.cc:1240] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 5. Current term is 6. Ops: []
I20260709 12:11:10.541258 14331 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50858 (request call id 1716) took 1050 ms. Trace:
I20260709 12:11:10.541998 17811 raft_consensus.cc:515] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:10.542408 17861 leader_election.cc:290] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:10.543210 17950 consensus_queue.cc:237] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:10.544235 17811 leader_election.cc:290] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 11 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:10.541548 14331 rpcz_store.cc:276] 0709 12:11:09.490988 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:10.540196 (+1049208us) service_pool.cc:224] Handling call
0709 12:11:10.540516 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:10.541002 (+   486us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:10.541205 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:11:10.518801 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 137552us
I20260709 12:11:10.520885 14186 raft_consensus.cc:1275] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:11:10.526369 14190 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56652 (request call id 852) took 1838 ms. Trace:
I20260709 12:11:10.546917 14190 rpcz_store.cc:276] 0709 12:11:08.688723 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:10.470378 (+1781655us) service_pool.cc:224] Handling call
0709 12:11:10.470731 (+   353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:10.526093 (+ 55362us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:10.526305 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:10.548158 14190 raft_consensus.cc:1240] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 5. Current term is 6. Ops: []
I20260709 12:11:10.549183 14186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 2476) took 2291 ms. Trace:
I20260709 12:11:10.549510 14186 rpcz_store.cc:276] 0709 12:11:08.257361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:10.324291 (+2066930us) service_pool.cc:224] Handling call
0709 12:11:10.328344 (+  4053us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:10.548979 (+220635us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:10.549132 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:10.550554 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:10.551430 14186 raft_consensus.cc:2393] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 10: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:11:10.499601 17958 raft_consensus.cc:493] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:10.559938 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:10.560566 14264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53050 (request call id 641) took 1379 ms. Trace:
I20260709 12:11:10.560746 14190 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56652 (request call id 857) took 1430 ms. Trace:
I20260709 12:11:10.562117 14190 rpcz_store.cc:276] 0709 12:11:09.130084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:10.547731 (+1417647us) service_pool.cc:224] Handling call
0709 12:11:10.548018 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:10.548401 (+   383us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:10.560669 (+ 12268us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:10.563306 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:10.560950 14264 rpcz_store.cc:276] 0709 12:11:09.181143 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:09.705782 (+524639us) service_pool.cc:224] Handling call
0709 12:11:09.706112 (+   330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:09.715167 (+  9055us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:09.715199 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:09.715753 (+   554us) log.cc:844] Serialized 26 byte log entry
0709 12:11:10.307757 (+592004us) spinlock_profiling.cc:243] Waited 5.08 ms on lock 0x7b18003c1c00. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f212cf16ab1 00007f212cf23281 00007f2124030e07 00007f212ce8b9a9 00007f212404d69b 00007f212404b93f 00007f212404dc02 00007f2126cd520b 00007f2126cdad23 00007f2126cdb0d1 00007f21270f6a0f
0709 12:11:10.456513 (+148756us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:10.546882 (+ 90369us) log.cc:844] Serialized 14 byte log entry
0709 12:11:10.547210 (+   328us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:10.547336 (+   126us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:10.547372 (+    36us) raft_consensus.cc:1685] finished
0709 12:11:10.559939 (+ 12567us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:10.560116 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11683,"raft.queue_time_us":9195,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":42185,"spinlock_wait_cycles":11691776,"thread_start_us":238473,"threads_started":2,"wal-append.queue_time_us":740665}
I20260709 12:11:10.564105 14190 raft_consensus.cc:2393] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 6: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:11:10.522519 17897 raft_consensus.cc:2764] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
W20260709 12:11:10.569005 14304 connection.cc:256] RPC call timeout handler was delayed by -1.1799091969999154s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1759s for a response
W20260709 12:11:10.569489 14304 connection.cc:256] RPC call timeout handler was delayed by -1.1351747169999271s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2155s for a response
W20260709 12:11:10.569873 14304 connection.cc:256] RPC call timeout handler was delayed by -1.08540919699999s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1864s for a response
I20260709 12:11:10.569908 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:10.570819 14190 raft_consensus.cc:2393] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 11: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:11:10.571998 14331 raft_consensus.cc:1240] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 9 LEADER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:10.572715 14331 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50858 (request call id 1717) took 1081 ms. Trace:
I20260709 12:11:10.573041 14331 rpcz_store.cc:276] 0709 12:11:09.491681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:10.546365 (+1054684us) service_pool.cc:224] Handling call
0709 12:11:10.571787 (+ 25422us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:10.572447 (+   660us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:10.572651 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:10.586364 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:10.589416 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:11:10.588595 14155 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:10.546566 17874 leader_election.cc:290] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:11:10.592267 14155 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:10.589690 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:10.593952 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:10.602694 14908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:11:10.603099 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:11:10.604511 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:11:10.553009 17875 raft_consensus.cc:493] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:10.607311 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:11:10.606815 14155 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:10.561633 17811 raft_consensus.cc:493] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:10.566423 17879 raft_consensus.cc:493] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:10.609452 14154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:10.611718 14186 raft_consensus.cc:2468] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 6.
I20260709 12:11:10.626452 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:10.627118 14186 raft_consensus.cc:2468] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 7.
I20260709 12:11:10.627508 14229 leader_election.cc:304] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:10.628005 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:10.628829 14186 raft_consensus.cc:2393] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 13: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:11:10.566938 17958 raft_consensus.cc:3060] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:10.525779 17894 raft_consensus.cc:515] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:10.531522 17819 raft_consensus.cc:515] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:10.589105 17853 raft_consensus.cc:2804] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:10.633783 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:10.634886 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:10.591478 17851 raft_consensus.cc:493] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:10.636574 14331 raft_consensus.cc:3060] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:10.638058 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:10.641930 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:10.642607 14260 raft_consensus.cc:2468] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 9.
I20260709 12:11:10.640703 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:10.643816 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:10.644438 14257 raft_consensus.cc:3060] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:10.522362 17953 raft_consensus.cc:515] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:10.568176 17957 consensus_queue.cc:1048] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.070s
I20260709 12:11:10.650488 14229 leader_election.cc:304] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:10.618269 17718 raft_consensus.cc:493] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:10.647716 14181 raft_consensus.cc:1240] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 8. Current term is 9. Ops: [8.5-8.5]
W20260709 12:11:10.648659 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 74535.7us
I20260709 12:11:10.648949 17976 consensus_queue.cc:1048] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:11:10.612697 17946 raft_consensus.cc:493] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:10.632967 17925 raft_consensus.cc:493] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:10.656548 14333 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 621) took 1425 ms. Trace:
I20260709 12:11:10.659909 14333 rpcz_store.cc:276] 0709 12:11:09.231541 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:10.451680 (+1220139us) service_pool.cc:224] Handling call
0709 12:11:10.452078 (+   398us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:10.452448 (+   370us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:10.452478 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:10.453132 (+   654us) log.cc:844] Serialized 52 byte log entry
0709 12:11:10.640115 (+186983us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:10.640153 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:10.640223 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:10.656172 (+ 15949us) raft_consensus.cc:1685] finished
0709 12:11:10.656194 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:10.656435 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":23739,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":116,"thread_start_us":186044,"threads_started":1,"wal-append.queue_time_us":194802}
I20260709 12:11:10.662145 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:10.654224 14229 leader_election.cc:304] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:10.607167 17915 consensus_queue.cc:1059] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
W20260709 12:11:10.662890 14304 connection.cc:256] RPC call timeout handler was delayed by -1.0161091969998779s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19410000000000002s for a response
I20260709 12:11:10.640395 17735 raft_consensus.cc:493] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:10.640789 17874 raft_consensus.cc:2804] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:10.645967 17853 raft_consensus.cc:697] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 11 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:11:10.666497 14257 raft_consensus.cc:2468] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 13.
I20260709 12:11:10.632539 17811 raft_consensus.cc:515] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:10.668411 17956 raft_consensus.cc:2804] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:10.668998 14259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53050 (request call id 639) took 1507 ms. Trace:
I20260709 12:11:10.635118 17879 raft_consensus.cc:515] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:11:10.670446 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:10.655177 17965 raft_consensus.cc:2749] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:10.680481 14259 rpcz_store.cc:276] 0709 12:11:09.161270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:09.466673 (+305403us) service_pool.cc:224] Handling call
0709 12:11:09.704944 (+238271us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:09.742381 (+ 37437us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:09.742422 (+    41us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:09.816234 (+ 73812us) log.cc:844] Serialized 52 byte log entry
0709 12:11:09.924319 (+108085us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:09.924364 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:09.924440 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:10.084211 (+159771us) raft_consensus.cc:1685] finished
0709 12:11:10.084236 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:10.668704 (+584468us) spinlock_profiling.cc:243] Waited 238 ms on lock 0x7b54002003d0. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713a8ad 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:11:10.668934 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":41301,"raft.queue_time_us":11136,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":94,"spinlock_wait_cycles":546926976,"thread_start_us":102853,"threads_started":1,"wal-append.queue_time_us":150887}
I20260709 12:11:10.685438 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:10.686236 14259 raft_consensus.cc:3060] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:10.686160 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:10.643390 17851 raft_consensus.cc:515] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } }
I20260709 12:11:10.675909 17819 leader_election.cc:290] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 9 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:10.610473 17964 consensus_queue.cc:1048] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 12:11:10.677539 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:10.664937 14186 raft_consensus.cc:2468] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 10.
I20260709 12:11:10.669122 14338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50856 (request call id 2023) took 3085 ms. Trace:
I20260709 12:11:10.694245 14338 rpcz_store.cc:276] 0709 12:11:07.584001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:07.584147 (+   146us) service_pool.cc:224] Handling call
0709 12:11:08.522060 (+937913us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:08.661340 (+139280us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:10.668887 (+2007547us) spinlock_profiling.cc:243] Waited 937 ms on lock 0x7b54000fcdd0. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713a8ad 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:11:10.669032 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2156226816}
I20260709 12:11:10.680579 14911 raft_consensus.cc:1275] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:11:10.634452 17875 raft_consensus.cc:515] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:10.681496 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:10.680382 17956 raft_consensus.cc:493] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:10.702723 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:10.678275 17735 raft_consensus.cc:515] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:10.707741 17735 leader_election.cc:290] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:10.708915 17439 raft_consensus.cc:515] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:10.709473 17875 leader_election.cc:290] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:10.711197 17439 leader_election.cc:290] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 9 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:10.711781 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:10.713181 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:10.713963 14338 raft_consensus.cc:2410] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:11:10.672681 17874 raft_consensus.cc:493] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:10.714450 17874 raft_consensus.cc:3060] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:10.714852 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:10.715256 14304 leader_election.cc:304] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:10.715906 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:10.664136 17946 raft_consensus.cc:515] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:10.716989 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:10.698418 14256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41768 (request call id 1710) took 1206 ms. Trace:
I20260709 12:11:10.719568 14256 rpcz_store.cc:276] 0709 12:11:09.492370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:10.386534 (+894164us) service_pool.cc:224] Handling call
0709 12:11:10.409012 (+ 22478us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:10.418051 (+  9039us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:10.698138 (+280087us) spinlock_profiling.cc:243] Waited 8.01 ms on lock 0x7b54001b21d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:11:10.698349 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":18426624}
I20260709 12:11:10.697098 17816 consensus_queue.cc:1059] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:11:10.695519 14257 raft_consensus.cc:2410] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:11:10.657668 17718 raft_consensus.cc:515] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:10.713773 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:10.663952 17500 raft_consensus.cc:515] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:10.717585 14304 leader_election.cc:304] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:10.745079 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:10.674054 14229 leader_election.cc:304] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:10.717790 14182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 2457) took 2677 ms. Trace:
I20260709 12:11:10.718227 14336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 612) took 1572 ms. Trace:
I20260709 12:11:10.718866 17976 consensus_queue.cc:1048] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:11:10.666778 17925 raft_consensus.cc:515] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:10.722713 14331 raft_consensus.cc:2468] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 10.
I20260709 12:11:10.745623 14259 raft_consensus.cc:2468] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 11.
W20260709 12:11:10.724848 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:10.746548 14336 rpcz_store.cc:276] 0709 12:11:09.145614 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:10.286447 (+1140833us) service_pool.cc:224] Handling call
0709 12:11:10.286850 (+   403us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:10.292088 (+  5238us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:10.292124 (+    36us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:10.295826 (+  3702us) log.cc:844] Serialized 52 byte log entry
0709 12:11:10.559825 (+263999us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:10.559870 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:10.559948 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:10.717978 (+158030us) raft_consensus.cc:1685] finished
0709 12:11:10.718001 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:10.718159 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":772,"raft.queue_time_us":4808,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":117,"thread_start_us":233975,"threads_started":1,"wal-append.queue_time_us":312015}
I20260709 12:11:10.723416 17875 raft_consensus.cc:493] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:10.730039 14334 raft_consensus.cc:2468] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 7.
W20260709 12:11:10.746511 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 72577us
I20260709 12:11:10.746142 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:10.677412 17853 consensus_queue.cc:237] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:10.703787 17956 raft_consensus.cc:3060] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:10.746078 14182 rpcz_store.cc:276] 0709 12:11:08.040170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:08.327464 (+287294us) service_pool.cc:224] Handling call
0709 12:11:08.327849 (+   385us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:08.338415 (+ 10566us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:11:08.338472 (+    57us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:08.339521 (+  1049us) log.cc:844] Serialized 26 byte log entry
0709 12:11:10.338068 (+1998547us) spinlock_profiling.cc:243] Waited 5.18 ms on lock 0x7b180037ea00. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f212cf16ab1 00007f212cf23281 00007f2124030e07 00007f212ce8b9a9 00007f212404d69b 00007f212404b93f 00007f212404dc02 00007f2126cd520b 00007f2126cdad23 00007f2126cdb0d1 00007f21270f6a0f
0709 12:11:10.612496 (+274428us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:11:10.612533 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:10.612622 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:10.717455 (+104833us) raft_consensus.cc:1685] finished
0709 12:11:10.717477 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:10.717706 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13099,"raft.queue_time_us":8981,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":5750,"spinlock_wait_cycles":11911040,"thread_start_us":274243,"threads_started":1,"wal-append.queue_time_us":2326212}
I20260709 12:11:10.760910 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:10.761854 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:10.762296 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:10.763110 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:10.685434 14339 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 625) took 1452 ms. Trace:
I20260709 12:11:10.763916 14338 raft_consensus.cc:1240] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 11 LEADER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 10. Current term is 11. Ops: [8.4-10.5]
I20260709 12:11:10.751107 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:10.752123 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:10.718310 17894 leader_election.cc:290] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:10.755560 14229 leader_election.cc:304] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:10.715934 17879 leader_election.cc:290] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:10.757292 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:10.747432 14333 raft_consensus.cc:2393] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 13: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:11:10.751077 17864 raft_consensus.cc:2804] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:10.767933 14336 raft_consensus.cc:1240] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:10.792929 14336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 627) took 1074 ms. Trace:
I20260709 12:11:10.793318 14336 rpcz_store.cc:276] 0709 12:11:09.718755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:10.767421 (+1048666us) service_pool.cc:224] Handling call
0709 12:11:10.767745 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:10.792635 (+ 24890us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:10.792863 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:10.794862 14336 raft_consensus.cc:1275] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:11:10.764241 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:10.796244 14182 raft_consensus.cc:2393] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 11: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:11:10.768610 14339 rpcz_store.cc:276] 0709 12:11:09.232667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:10.484918 (+1252251us) service_pool.cc:224] Handling call
0709 12:11:10.485284 (+   366us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:10.485684 (+   400us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:10.485718 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:10.486522 (+   804us) log.cc:844] Serialized 26 byte log entry
0709 12:11:10.649294 (+162772us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:10.649350 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:10.649423 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:10.685196 (+ 35773us) raft_consensus.cc:1685] finished
0709 12:11:10.685219 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:10.685369 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":24141,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":155,"thread_start_us":162410,"threads_started":1,"wal-append.queue_time_us":162085}
I20260709 12:11:10.714450 17735 consensus_queue.cc:1059] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 12:11:10.766738 14338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50858 (request call id 1718) took 1273 ms. Trace:
I20260709 12:11:10.790462 14229 leader_election.cc:304] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:10.799048 14338 rpcz_store.cc:276] 0709 12:11:09.493775 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:10.763209 (+1269434us) service_pool.cc:224] Handling call
0709 12:11:10.763620 (+   411us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:10.766470 (+  2850us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:10.766681 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:10.790647 14333 raft_consensus.cc:1240] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:10.693804 17963 consensus_queue.cc:1059] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.066s
W20260709 12:11:10.805289 17966 log.cc:927] Time spent T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:11:10.806274 17500 leader_election.cc:290] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:10.770267 17932 raft_consensus.cc:2764] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:11:10.808251 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
W20260709 12:11:10.811559 14334 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55492 (request call id 619) took 1580 ms (client timeout 1636 ms). Trace:
W20260709 12:11:10.813874 14334 rpcz_store.cc:269] 0709 12:11:09.230938 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:09.514122 (+283184us) service_pool.cc:224] Handling call
0709 12:11:10.811358 (+1297236us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b540024fed4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:11:10.811488 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2603278592}
I20260709 12:11:10.816352 17777 raft_consensus.cc:3055] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:10.816787 17777 raft_consensus.cc:740] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:11:10.818660 14181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 2478) took 2161 ms. Trace:
I20260709 12:11:10.819128 14181 rpcz_store.cc:276] 0709 12:11:08.657576 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:10.328156 (+1670580us) service_pool.cc:224] Handling call
0709 12:11:10.328422 (+   266us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:10.653193 (+324771us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:10.818373 (+165180us) spinlock_profiling.cc:243] Waited 319 ms on lock 0x7b540019b9d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:11:10.818588 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":733736192}
I20260709 12:11:10.820425 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:10.820535 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:10.821456 14186 raft_consensus.cc:2410] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:11:10.797601 17864 raft_consensus.cc:493] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:10.822551 14261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41768 (request call id 1702) took 1357 ms. Trace:
I20260709 12:11:10.803560 17735 consensus_queue.cc:1243] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer 17aab1bbf5014936aa18cc21818b26ec log is divergent from this leader: its last log entry 8.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:11:10.823783 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:10.824482 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:10.825906 14186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56652 (request call id 858) took 1572 ms. Trace:
I20260709 12:11:10.826663 17851 leader_election.cc:290] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:10.822902 17925 leader_election.cc:290] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:10.789661 17915 consensus_queue.cc:1048] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 12:11:10.797849 17815 raft_consensus.cc:3060] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:10.826279 14186 rpcz_store.cc:276] 0709 12:11:09.253057 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:10.824704 (+1571647us) service_pool.cc:224] Handling call
0709 12:11:10.825371 (+   667us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:10.825564 (+   193us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:10.825590 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:10.825631 (+    41us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:10.825665 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:10.825720 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:10.825847 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:10.822834 17616 raft_consensus.cc:515] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:10.830087 14183 raft_consensus.cc:1275] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:11:10.830302 17616 leader_election.cc:290] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 8 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:10.830709 17811 leader_election.cc:290] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:10.831007 14184 raft_consensus.cc:1240] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:10.801401 17965 raft_consensus.cc:2749] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:10.834729 17963 raft_consensus.cc:2804] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:10.834887 17735 raft_consensus.cc:3055] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:10.835212 17963 raft_consensus.cc:493] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:10.835393 17735 raft_consensus.cc:740] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:10.835688 17963 raft_consensus.cc:3060] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:10.836099 14877 leader_election.cc:304] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:11:10.836570 17915 raft_consensus.cc:3055] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:10.836310 17735 consensus_queue.cc:260] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:10.836966 17915 raft_consensus.cc:740] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:10.837831 17915 consensus_queue.cc:260] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } }
I20260709 12:11:10.839051 17915 raft_consensus.cc:3060] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:10.839864 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:10.840441 14333 raft_consensus.cc:3060] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:10.842819 17925 consensus_queue.cc:1048] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:10.843245 14187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 2459) took 2769 ms. Trace:
I20260709 12:11:10.843638 14187 rpcz_store.cc:276] 0709 12:11:08.073700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:09.512406 (+1438706us) service_pool.cc:224] Handling call
0709 12:11:09.568090 (+ 55684us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:09.671999 (+103909us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:10.843017 (+1171018us) spinlock_profiling.cc:243] Waited 20.9 ms on lock 0x7b5400421b50. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713a8ad 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:11:10.843178 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":48141568}
I20260709 12:11:10.844444 17925 consensus_queue.cc:1048] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:10.845059 14187 raft_consensus.cc:1240] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:10.822382 17864 raft_consensus.cc:3060] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:10.846009 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:10.846658 14334 raft_consensus.cc:2468] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 5.
I20260709 12:11:10.837611 17735 raft_consensus.cc:3060] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:10.849323 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 182185us
I20260709 12:11:10.852609 14261 rpcz_store.cc:276] 0709 12:11:09.464842 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:10.316998 (+852156us) service_pool.cc:224] Handling call
0709 12:11:10.317264 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:10.384033 (+ 66769us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:10.822269 (+438236us) spinlock_profiling.cc:243] Waited 7.32 ms on lock 0x7b540006a2a0. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f21270b2dc0 00007f212713ea02 00007f212713add6 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2
0709 12:11:10.822483 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16837376}
I20260709 12:11:10.821146 17958 raft_consensus.cc:515] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:10.860467 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:10.861294 14334 raft_consensus.cc:3060] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:10.862519 17748 raft_consensus.cc:493] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:10.867990 14333 raft_consensus.cc:2468] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 10.
W20260709 12:11:10.869297 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 151782us
I20260709 12:11:10.875648 14337 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 626) took 1642 ms. Trace:
I20260709 12:11:10.821344 14181 raft_consensus.cc:2410] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:11:10.878919 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:10.879777 14877 leader_election.cc:304] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:11:10.837111 17924 raft_consensus.cc:3055] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:10.888455 14303 leader_election.cc:304] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:10.876144 14337 rpcz_store.cc:276] 0709 12:11:09.232930 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:10.494231 (+1261301us) service_pool.cc:224] Handling call
0709 12:11:10.494569 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:10.494987 (+   418us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:11:10.622542 (+127555us) log.cc:844] Serialized 14 byte log entry
0709 12:11:10.875231 (+252689us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:10.875300 (+    69us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:10.875358 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:10.875431 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:10.875566 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18874,"prepare.queue_time_us":106225,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":31,"raft.queue_time_us":30129,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":91,"thread_start_us":360511,"threads_started":3,"wal-append.queue_time_us":127223}
I20260709 12:11:10.890161 14877 leader_election.cc:304] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:11:10.760298 17875 raft_consensus.cc:515] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:10.800055 14229 leader_election.cc:304] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:10.888103 14331 raft_consensus.cc:2393] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 9: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:11:10.846658 17922 leader_election.cc:290] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:10.907881 14303 leader_election.cc:304] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:10.875175 17866 raft_consensus.cc:2804] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:10.911651 14187 raft_consensus.cc:1240] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 12:11:10.943356 17866 raft_consensus.cc:697] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 7 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:11:10.944267 17866 consensus_queue.cc:237] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:10.947170 17921 consensus_queue.cc:1048] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:11:10.920903 14334 raft_consensus.cc:2468] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 7.
I20260709 12:11:10.922565 17856 consensus_queue.cc:1059] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:10.914604 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:11:10.908412 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 108440us
I20260709 12:11:10.906890 17616 raft_consensus.cc:493] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:11:10.926191 17718 leader_election.cc:290] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:10.863127 17748 raft_consensus.cc:515] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:10.906832 17929 raft_consensus.cc:2804] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:10.927237 17875 leader_election.cc:290] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:10.910642 17615 raft_consensus.cc:2804] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:10.911002 17890 raft_consensus.cc:2749] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:10.936102 17874 raft_consensus.cc:515] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:10.936501 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:10.937165 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:10.863695 17777 consensus_queue.cc:260] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:10.910380 17976 consensus_queue.cc:1048] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 12:11:10.949663 14229 leader_election.cc:304] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:10.926345 17957 consensus_queue.cc:1059] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 8.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:11:11.000419 14155 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:10.905651 17953 leader_election.cc:290] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:10.888927 17924 raft_consensus.cc:740] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:10.910177 17983 consensus_queue.cc:1048] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.109s
W20260709 12:11:11.017982 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 68404.3us
I20260709 12:11:10.951319 17922 raft_consensus.cc:2749] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:11.014086 17929 raft_consensus.cc:697] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 10 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:11:11.032401 14262 raft_consensus.cc:2393] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 11: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:11:11.025264 14229 leader_election.cc:304] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:11.036926 14229 leader_election.cc:304] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:11.019336 17768 raft_consensus.cc:2804] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:10.961442 17785 consensus_queue.cc:1048] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.068s
I20260709 12:11:11.015821 17615 raft_consensus.cc:493] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:10.999632 17616 raft_consensus.cc:515] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:11.021003 17976 consensus_queue.cc:1243] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer 885067a0d31741bfb5c9935788e315bf log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:11:11.044675 14229 leader_election.cc:304] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:11.028446 17777 raft_consensus.cc:3060] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:11.031805 17957 raft_consensus.cc:2749] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:11:11.055151 14229 leader_election.cc:304] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:11.057926 14332 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 614) took 1892 ms. Trace:
W20260709 12:11:11.091404 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 184880us
I20260709 12:11:11.050630 17615 raft_consensus.cc:3060] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:11.047209 17890 raft_consensus.cc:2804] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:11.046746 17768 raft_consensus.cc:493] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:11.086197 14185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56652 (request call id 851) took 2400 ms. Trace:
I20260709 12:11:11.058820 17965 raft_consensus.cc:2749] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:11.048295 17953 raft_consensus.cc:2749] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:11.083900 14258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53050 (request call id 651) took 1791 ms. Trace:
I20260709 12:11:11.052454 17981 raft_consensus.cc:3055] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:11.089201 14332 rpcz_store.cc:276] 0709 12:11:09.165556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:10.328576 (+1163020us) service_pool.cc:224] Handling call
0709 12:11:10.405781 (+ 77205us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:10.406019 (+   238us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:11:10.562541 (+156522us) log.cc:844] Serialized 14 byte log entry
0709 12:11:11.057499 (+494958us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:11.057569 (+    70us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:11.057617 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:11.057683 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:11.057853 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4619,"prepare.queue_time_us":194930,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":63,"raft.queue_time_us":30174,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":90,"thread_start_us":601977,"threads_started":3,"wal-append.queue_time_us":448498}
W20260709 12:11:11.077953 17980 log.cc:927] Time spent T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 12:11:11.096297 14876 leader_election.cc:304] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:11:11.098279 14185 rpcz_store.cc:276] 0709 12:11:08.686233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:10.388021 (+1701788us) service_pool.cc:224] Handling call
0709 12:11:10.388325 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:10.478166 (+ 89841us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:11.085904 (+607738us) spinlock_profiling.cc:243] Waited 89.3 ms on lock 0x7b54003f2ad4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:11:11.086121 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":205309312}
I20260709 12:11:11.104396 14304 leader_election.cc:304] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
W20260709 12:11:11.100517 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 201255us
I20260709 12:11:11.100268 14258 rpcz_store.cc:276] 0709 12:11:09.292896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:09.857235 (+564339us) service_pool.cc:224] Handling call
0709 12:11:09.858964 (+  1729us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:09.968089 (+109125us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:11.083562 (+1115473us) spinlock_profiling.cc:243] Waited 91.9 ms on lock 0x7b5400072954. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:11:11.083812 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":211451264}
I20260709 12:11:11.104609 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:11:11.098664 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 190886us
I20260709 12:11:11.129249 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:11.131078 14185 raft_consensus.cc:3060] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:11.131496 14304 leader_election.cc:304] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:11.130300 14303 leader_election.cc:304] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:11.100320 17768 raft_consensus.cc:3060] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:11.140163 14304 leader_election.cc:304] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:11.142174 14303 leader_election.cc:304] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:11.100419 17958 leader_election.cc:290] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 9 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:11.092000 17929 consensus_queue.cc:237] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:11.127465 17718 raft_consensus.cc:493] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:11.071682 17924 consensus_queue.cc:260] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:11.103281 17981 raft_consensus.cc:740] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:11.099929 17984 consensus_queue.cc:1048] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 12:11:11.135053 17957 raft_consensus.cc:2749] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:11.151748 14185 raft_consensus.cc:2468] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 7.
W20260709 12:11:11.171286 14155 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:11.134107 17976 consensus_queue.cc:1048] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.023s
W20260709 12:11:11.165982 14878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:11.159032 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:11.156391 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 101320us
I20260709 12:11:11.150207 17965 raft_consensus.cc:2749] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:11.108037 17963 raft_consensus.cc:515] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:11.179721 14229 leader_election.cc:304] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:11.163231 17958 raft_consensus.cc:2749] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:11.172856 17924 raft_consensus.cc:3060] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:11.155237 17991 raft_consensus.cc:2749] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:11.162302 17874 leader_election.cc:290] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 11 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:11:11.192941 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 50874.7us
W20260709 12:11:11.194223 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 54141.9us
I20260709 12:11:11.172412 17989 raft_consensus.cc:2764] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:11:11.155076 17718 raft_consensus.cc:515] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:11.154791 17987 consensus_queue.cc:1048] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
W20260709 12:11:11.198107 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 101909us
I20260709 12:11:11.181648 17957 raft_consensus.cc:2749] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 12:11:11.199576 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 70989.2us
I20260709 12:11:11.187719 17990 raft_consensus.cc:2804] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:11.207171 14304 leader_election.cc:304] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:11.198930 17890 raft_consensus.cc:697] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 10 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:11:11.206557 17990 raft_consensus.cc:493] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
W20260709 12:11:11.212383 17985 log.cc:927] Time spent T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.139s	user 0.001s	sys 0.000s
I20260709 12:11:11.239248 17990 raft_consensus.cc:3060] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:11.210866 17616 leader_election.cc:290] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:11.206830 17692 consensus_queue.cc:1048] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 12:11:11.204911 17735 consensus_queue.cc:1048] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 12:11:11.211249 17965 raft_consensus.cc:2749] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:11.237691 17957 raft_consensus.cc:2804] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:11.211002 17983 consensus_queue.cc:1048] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
W20260709 12:11:11.286568 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 54223.5us
W20260709 12:11:11.286911 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:11.199488 17981 consensus_queue.cc:260] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.3, Last appended by leader: 3, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:11.294715 14304 leader_election.cc:304] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:11.296219 14304 leader_election.cc:304] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
W20260709 12:11:11.289675 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 110026us
I20260709 12:11:11.302660 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: true dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:11:11.303432 14910 raft_consensus.cc:3055] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:11.303758 14910 raft_consensus.cc:740] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:11:11.304366 14911 raft_consensus.cc:1240] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 9. Current term is 10. Ops: []
W20260709 12:11:11.285509 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 81824us
I20260709 12:11:11.313606 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:11.331640 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:11.333706 14261 raft_consensus.cc:1240] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 10. Current term is 11. Ops: [8.4-10.5]
I20260709 12:11:11.336647 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:11.337421 14259 raft_consensus.cc:3060] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:11.339152 14229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:11.340953 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:11.341782 14257 raft_consensus.cc:2468] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 9.
I20260709 12:11:11.342922 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:11.344161 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:11.344762 14257 raft_consensus.cc:2468] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 8.
I20260709 12:11:11.345657 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:11.348681 14257 raft_consensus.cc:2410] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 12:11:11.335566 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:11.250784 14077 maintenance_manager.cc:419] P d07070be2c074f4cb9ad35f1580c4ef7: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033379
I20260709 12:11:11.209504 17989 consensus_queue.cc:1048] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.075s
I20260709 12:11:11.363968 14261 raft_consensus.cc:2468] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 6.
I20260709 12:11:11.239354 17890 consensus_queue.cc:237] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:11:11.369827 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 163882us
I20260709 12:11:11.211194 17874 consensus_queue.cc:1048] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.077s
W20260709 12:11:11.368602 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 62437.1us
I20260709 12:11:11.371920 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:11.372658 14260 raft_consensus.cc:2468] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 9.
I20260709 12:11:11.370190 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:11.374003 14256 raft_consensus.cc:3060] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:11.374749 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:11.375957 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:11.376840 14257 raft_consensus.cc:3060] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:11.378552 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:11.383634 14185 raft_consensus.cc:2468] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 8.
I20260709 12:11:11.379499 14910 consensus_queue.cc:260] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:11.391577 14910 raft_consensus.cc:3060] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:11.240312 17996 consensus_queue.cc:1059] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.125s
I20260709 12:11:11.354239 14259 raft_consensus.cc:2468] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 9.
I20260709 12:11:11.399160 14260 raft_consensus.cc:1275] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:11:11.382223 17981 raft_consensus.cc:3060] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:11.357581 18000 consensus_queue.cc:1048] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.107s
I20260709 12:11:11.412108 18004 consensus_queue.cc:1059] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:11.371351 17882 consensus_queue.cc:1059] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 12:11:11.409050 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:11.427217 14185 raft_consensus.cc:2393] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 10: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:11:11.410857 17991 raft_consensus.cc:2804] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:11.441962 17615 raft_consensus.cc:515] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:11.446453 14257 raft_consensus.cc:2468] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 8.
I20260709 12:11:11.446635 17615 leader_election.cc:290] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 8 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:11.430238 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:11.448710 14185 raft_consensus.cc:2393] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 11: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:11:11.449857 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:11.450706 14185 raft_consensus.cc:2393] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 12: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:11:11.420568 17997 raft_consensus.cc:493] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:11.426287 17983 raft_consensus.cc:2804] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:11.451629 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:11.463476 14185 raft_consensus.cc:2468] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 11.
I20260709 12:11:11.464573 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:11.465430 14185 raft_consensus.cc:2393] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 6: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:11:11.466336 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:11.466936 14185 raft_consensus.cc:2376] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 9. Re-sending same reply.
I20260709 12:11:11.467819 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:11.468544 14185 raft_consensus.cc:2368] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 12. Current term is 13.
I20260709 12:11:11.469348 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:11.456914 14256 raft_consensus.cc:2468] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 12.
I20260709 12:11:11.391922 17995 consensus_queue.cc:1059] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 12:11:11.477252 14910 raft_consensus.cc:2468] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 9.
I20260709 12:11:11.431896 17963 leader_election.cc:290] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 9 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:11.480273 14265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41764 (request call id 2488) took 3143 ms. Trace:
I20260709 12:11:11.480278 14188 raft_consensus.cc:3055] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:11.487709 14188 raft_consensus.cc:740] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:11:11.482203 14185 raft_consensus.cc:2410] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for term 10 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
W20260709 12:11:11.489423 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 193274us
I20260709 12:11:11.488539 14188 consensus_queue.cc:260] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:11.493294 14188 raft_consensus.cc:3060] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:11.493788 17998 log.cc:927] Time spent T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.135s	user 0.000s	sys 0.001s
I20260709 12:11:11.496340 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:11.486014 14265 rpcz_store.cc:276] 0709 12:11:08.331919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:08.332128 (+   209us) service_pool.cc:224] Handling call
0709 12:11:08.332593 (+   465us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:08.908828 (+576235us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:08.908862 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:08.955546 (+ 46684us) log.cc:844] Serialized 52 byte log entry
0709 12:11:10.302323 (+1346777us) spinlock_profiling.cc:243] Waited 920 us on lock 0x7b1800365da0. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f212cf16ab1 00007f212cf23281 00007f2124030e07 00007f212ce8b9a9 00007f212404d69b 00007f212404b93f 00007f212404dc02 00007f2126cd520b 00007f2126cdad23 00007f2126cdb0d1 00007f21270f6a0f
0709 12:11:10.454048 (+151725us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:11:10.454089 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:11.474716 (+1020627us) spinlock_profiling.cc:243] Waited 467 ms on lock 0x7b54002012d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:11:11.474774 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:11.474820 (+    46us) raft_consensus.cc:1685] finished
0709 12:11:11.474832 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:11.475018 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46900,"raft.queue_time_us":47211,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":47547,"spinlock_wait_cycles":1075243520,"thread_start_us":151520,"threads_started":1,"wal-append.queue_time_us":1456375,"wal-append.run_cpu_time_us":1884,"wal-append.run_wall_time_us":1001895}
I20260709 12:11:11.478076 17718 leader_election.cc:290] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:11.497547 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:11:11.498796 18001 log.cc:927] Time spent T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:11:11.499449 14187 raft_consensus.cc:1275] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:11:11.500592 14187 raft_consensus.cc:3055] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:11.500882 14187 raft_consensus.cc:740] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:11:11.501644 14187 consensus_queue.cc:260] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:11.506794 14187 raft_consensus.cc:3060] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:11.514535 14304 leader_election.cc:304] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:11.516651 14188 raft_consensus.cc:1275] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 4. (term mismatch)
I20260709 12:11:11.517187 14188 pending_rounds.cc:85] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf: Aborting all ops after (but not including) 3
I20260709 12:11:11.517474 14188 pending_rounds.cc:107] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf: Aborting uncommitted NO_OP operation due to leader change: 8.4
I20260709 12:11:11.442880 17991 raft_consensus.cc:493] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:11.517786 14188 raft_consensus.cc:2889] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:11.518291 14188 pending_rounds.cc:107] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf: Aborting uncommitted NO_OP operation due to leader change: 10.5
I20260709 12:11:11.518597 14188 raft_consensus.cc:2889] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:11:11.519327 17772 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 11 current term: 11 is higher.
I20260709 12:11:11.520032 14188 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 2465) took 3388 ms. Trace:
I20260709 12:11:11.521476 14188 rpcz_store.cc:276] 0709 12:11:08.131160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:09.650757 (+1519597us) service_pool.cc:224] Handling call
0709 12:11:09.686029 (+ 35272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:11.480162 (+1794133us) spinlock_profiling.cc:243] Waited 157 ms on lock 0x7b5400316b20. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f21270b2dc0 00007f212713d1c0 00007f212713e231 00007f212713ad8f 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c
0709 12:11:11.519131 (+ 38969us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:11.519962 (+   831us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":361040256}
I20260709 12:11:11.475952 17983 raft_consensus.cc:493] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:11:11.527431 17983 raft_consensus.cc:3060] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:11:11.530541 18002 log.cc:927] Time spent T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:11:11.545543 14187 raft_consensus.cc:1275] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 8. (term mismatch)
I20260709 12:11:11.546160 14187 pending_rounds.cc:85] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf: Aborting all ops after (but not including) 7
I20260709 12:11:11.546476 14187 pending_rounds.cc:107] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf: Aborting uncommitted NO_OP operation due to leader change: 10.8
I20260709 12:11:11.546797 14187 raft_consensus.cc:2889] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:11.552098 14304 leader_election.cc:304] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:11.552894 14185 raft_consensus.cc:1240] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:11.553792 17989 raft_consensus.cc:2804] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:11.554239 17989 raft_consensus.cc:493] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:11.439669 17996 consensus_queue.cc:1059] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.050s
I20260709 12:11:11.440488 17767 consensus_queue.cc:1059] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 12:11:11.555275 17963 raft_consensus.cc:2749] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:11.555548 17995 raft_consensus.cc:3055] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:11.554627 17989 raft_consensus.cc:3060] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:11.556028 17995 raft_consensus.cc:740] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:11:11.557108 17995 consensus_queue.cc:260] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:11.558475 17995 raft_consensus.cc:3060] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:11.555338 17503 raft_consensus.cc:3055] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:11.559985 17503 raft_consensus.cc:740] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:11:11.560799 17503 consensus_queue.cc:260] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:11.563197 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:11:11.563901 17915 consensus_meta.cc:287] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.724s	user 0.010s	sys 0.003s
I20260709 12:11:11.563247 14332 raft_consensus.cc:1240] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:11.564595 14333 raft_consensus.cc:2468] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 8.
I20260709 12:11:11.567929 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:11.568122 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:11.568727 14339 raft_consensus.cc:2468] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 11.
W20260709 12:11:11.568126 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 184112us
I20260709 12:11:11.572983 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:11.573966 14335 raft_consensus.cc:2393] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 7: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
I20260709 12:11:11.579157 14187 raft_consensus.cc:1240] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 9. Current term is 10. Ops: []
W20260709 12:11:11.589395 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:11.589032 14187 raft_consensus.cc:1275] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 7. (term mismatch)
I20260709 12:11:11.592252 14187 pending_rounds.cc:85] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf: Aborting all ops after (but not including) 6
I20260709 12:11:11.592551 14187 pending_rounds.cc:107] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260709 12:11:11.592809 14187 raft_consensus.cc:2889] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:11.611030 14187 raft_consensus.cc:1240] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:11.611390 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:11.613902 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:11.614588 14187 raft_consensus.cc:1275] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 12:11:11.617825 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 234590us
I20260709 12:11:11.550680 17991 raft_consensus.cc:3060] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:11.618999 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:11.619463 14876 leader_election.cc:304] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:11.566869 17718 raft_consensus.cc:493] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:11.625070 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: true dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:11.634717 14339 raft_consensus.cc:2393] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 9: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:11:11.478655 17997 raft_consensus.cc:515] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:11.642287 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:11:11.650455 14878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:11.649969 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 269702us
W20260709 12:11:11.636193 17950 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.035s	user 0.005s	sys 0.010s
I20260709 12:11:11.633695 17926 raft_consensus.cc:493] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:11.653854 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:11.654366 14337 raft_consensus.cc:1275] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 12:11:11.644178 17956 consensus_meta.cc:287] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.853s	user 0.010s	sys 0.003s
I20260709 12:11:11.650357 17957 raft_consensus.cc:697] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 7 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
W20260709 12:11:11.655579 17815 consensus_meta.cc:287] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.828s	user 0.008s	sys 0.005s
I20260709 12:11:11.639940 18016 raft_consensus.cc:2804] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:11.671195 14262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41768 (request call id 1721) took 1062 ms. Trace:
I20260709 12:11:11.662436 14877 leader_election.cc:304] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:11.675704 14262 rpcz_store.cc:276] 0709 12:11:10.608905 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:10.629148 (+ 20243us) service_pool.cc:224] Handling call
0709 12:11:11.670903 (+1041755us) spinlock_profiling.cc:243] Waited 387 ms on lock 0x7b54001b2bd4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:11:11.671095 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":890039040}
W20260709 12:11:11.659801 17950 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.059s	user 0.005s	sys 0.011s
I20260709 12:11:11.664958 17926 raft_consensus.cc:515] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:11:11.682078 17864 consensus_meta.cc:287] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.836s	user 0.005s	sys 0.007s
I20260709 12:11:11.682590 17864 raft_consensus.cc:515] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:11.683501 17926 leader_election.cc:290] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:11.686100 14258 raft_consensus.cc:2393] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 9: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:11:11.637202 17718 raft_consensus.cc:515] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:11.687525 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:11.705933 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:11:11.711117 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 48757.7us
I20260709 12:11:11.711360 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:11.707424 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:11.712077 14877 leader_election.cc:304] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:11:11.706333 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:11.693590 14181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 2488) took 1143 ms. Trace:
I20260709 12:11:11.670090 17732 raft_consensus.cc:3060] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:11.714022 14181 rpcz_store.cc:276] 0709 12:11:10.549900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:10.881575 (+331675us) service_pool.cc:224] Handling call
0709 12:11:10.912070 (+ 30495us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:10.912440 (+   370us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:10.912471 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:10.934566 (+ 22095us) log.cc:844] Serialized 26 byte log entry
0709 12:11:11.566301 (+631735us) spinlock_profiling.cc:243] Waited 7.15 ms on lock 0x7b18002a0e20. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f212cf16ab1 00007f212cf23281 00007f2124030e07 00007f212ce8b9a9 00007f212404d69b 00007f212404b93f 00007f212404dc02 00007f2126cd520b 00007f2126cdad23 00007f2126cdb0d1 00007f21270f6a0f
0709 12:11:11.641173 (+ 74872us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:11:11.641236 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:11.641304 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:11.675433 (+ 34129us) raft_consensus.cc:1685] finished
0709 12:11:11.675461 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:11.693488 (+ 18027us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2942,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":101,"spinlock_wait_cycles":16456064,"thread_start_us":74566,"threads_started":1,"wal-append.queue_time_us":730400}
I20260709 12:11:11.677573 17815 raft_consensus.cc:2749] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:11:11.661922 17836 consensus_queue.cc:1059] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.054s
W20260709 12:11:11.733592 14877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:11.662743 17990 raft_consensus.cc:515] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:11.710773 18016 raft_consensus.cc:697] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 7 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:11:11.674492 17956 raft_consensus.cc:515] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:11.714846 18018 raft_consensus.cc:2804] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:11:11.748840 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:11.749549 14185 raft_consensus.cc:2468] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 6.
I20260709 12:11:11.732139 17995 raft_consensus.cc:2804] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:11.750954 14181 raft_consensus.cc:1240] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:11.751175 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:11.760176 14188 raft_consensus.cc:2393] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 12: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:11:11.665951 17957 consensus_queue.cc:237] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:11:11.761613 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 84358.4us
I20260709 12:11:11.679620 17989 raft_consensus.cc:515] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:11:11.746922 17768 consensus_meta.cc:287] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.596s	user 0.010s	sys 0.002s
I20260709 12:11:11.748610 18018 raft_consensus.cc:493] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:11.772636 14181 raft_consensus.cc:1240] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 12:11:11.776805 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:11.778362 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:11.765933 17997 leader_election.cc:290] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:11.767617 17768 raft_consensus.cc:515] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:11.779318 14181 raft_consensus.cc:2393] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 9: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:11:11.783543 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:11.784515 17768 leader_election.cc:290] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 8 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:11.786139 18016 consensus_queue.cc:237] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:11.786923 17718 leader_election.cc:290] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:11.766273 17995 raft_consensus.cc:697] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 10 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
W20260709 12:11:11.778528 17993 log.cc:927] Time spent T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.494s	user 0.002s	sys 0.000s
I20260709 12:11:11.774926 18018 raft_consensus.cc:3060] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:11.809026 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:11.811707 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:11.783885 17990 leader_election.cc:290] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 10 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:11.830327 17771 raft_consensus.cc:3060] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:11:11.834789 14156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:11.876873 14189 raft_consensus.cc:2468] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 7.
I20260709 12:11:11.878710 17500 raft_consensus.cc:493] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:11.879305 17500 raft_consensus.cc:515] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:11:11.880286 14303 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:11.883558 17956 leader_election.cc:290] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:11.884289 17926 raft_consensus.cc:493] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:11.884862 17926 raft_consensus.cc:515] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:11.886119 14264 raft_consensus.cc:1275] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:11:11.818481 17995 consensus_queue.cc:237] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:11.888202 17926 leader_election.cc:290] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:11.889220 17983 raft_consensus.cc:515] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:11.903806 14338 raft_consensus.cc:2468] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 8.
I20260709 12:11:11.890560 17991 raft_consensus.cc:515] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:11.888257 14188 pending_rounds.cc:85] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf: Aborting all ops after (but not including) 4
W20260709 12:11:11.904832 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:11.905051 14188 pending_rounds.cc:107] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 12:11:11.905431 14188 raft_consensus.cc:2889] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:11.907676 17989 leader_election.cc:290] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 8 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:11.914084 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:11.914652 17894 raft_consensus.cc:3055] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:11:11.915138 17894 raft_consensus.cc:740] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:11.916196 17777 raft_consensus.cc:3055] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:11.916643 17777 raft_consensus.cc:740] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:11:11.917614 17777 consensus_queue.cc:260] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:11.919027 17777 raft_consensus.cc:3060] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:11.915033 14181 raft_consensus.cc:2393] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 8: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:11:11.909152 17975 raft_consensus.cc:3055] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:11.930572 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:11.916234 17894 consensus_queue.cc:260] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:11.933065 18018 raft_consensus.cc:515] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:11.937162 17894 raft_consensus.cc:3060] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:11.952746 17748 leader_election.cc:290] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:11.931742 17975 raft_consensus.cc:740] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:11.957870 14185 raft_consensus.cc:1240] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 9. Current term is 10. Ops: [7.4-9.5]
I20260709 12:11:11.960280 14304 leader_election.cc:304] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:11.961557 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:11.962580 17771 raft_consensus.cc:493] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:11.956620 17975 consensus_queue.cc:260] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:11.972069 17771 raft_consensus.cc:515] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:11.937458 17983 leader_election.cc:290] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 8 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:11.974495 17771 leader_election.cc:290] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:11.964768 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:11.969776 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:11.970758 14259 raft_consensus.cc:1240] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 12:11:11.975418 14265 raft_consensus.cc:1240] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 9. Current term is 10. Ops: [9.6-9.6]
W20260709 12:11:11.975951 14156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:11.972417 17975 raft_consensus.cc:3060] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:11.976046 14257 raft_consensus.cc:2393] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 11: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:11:11.976649 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:11.965772 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:11.984974 14258 raft_consensus.cc:2410] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for term 12 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:11:11.986716 14265 raft_consensus.cc:2393] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 9: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:11:11.988895 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:11.989825 14259 raft_consensus.cc:2393] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 9: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:11:11.990978 14259 raft_consensus.cc:1240] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 12:11:12.002472 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:11.963835 18018 leader_election.cc:290] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 6 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:11.984261 17982 raft_consensus.cc:2804] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:12.028612 14186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 2483) took 1480 ms. Trace:
I20260709 12:11:12.029217 14186 rpcz_store.cc:276] 0709 12:11:10.548479 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:10.834089 (+285610us) service_pool.cc:224] Handling call
0709 12:11:10.842188 (+  8099us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:10.848017 (+  5829us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:11:11.046759 (+198742us) log.cc:844] Serialized 14 byte log entry
0709 12:11:11.777901 (+731142us) spinlock_profiling.cc:243] Waited 1.89 ms on lock 0x7b4400022b4c. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2123f74c85 00007f2123f756a2 00007f2126ce71db 00007f2126ce2aaf 00007f2126cd686e 00007f2126cd5bb6 00007f2126cd57d8 00007f2126cdf221 00007f2126cdf1d9 00007f2126cdf169
0709 12:11:11.955634 (+177733us) spinlock_profiling.cc:243] Waited 3.6 ms on lock 0x7b180003fa00. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f212cf16ab1 00007f212cf23281 00007f2126ce34bc 00007f212403148b 00007f212ce8b9a9 00007f212404d69b 00007f212404b93f 00007f212404dc02 00007f2126cd520b 00007f2126cdad23 00007f2126cdb23a
0709 12:11:11.985171 (+ 29537us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:11.985708 (+   537us) log.cc:844] Serialized 26 byte log entry
0709 12:11:11.985938 (+   230us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:11.985976 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:11.986048 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:12.028293 (+ 42245us) raft_consensus.cc:1685] finished
0709 12:11:12.028320 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:12.028524 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3981,"prepare.queue_time_us":280016,"prepare.run_cpu_time_us":86,"prepare.run_wall_time_us":2979,"raft.queue_time_us":12112,"raft.run_cpu_time_us":231,"raft.run_wall_time_us":21670,"spinlock_wait_cycles":12620032,"thread_start_us":271605,"threads_started":2,"wal-append.queue_time_us":156628}
W20260709 12:11:12.039793 14878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:12.008167 17991 leader_election.cc:290] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 10 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:11:12.060015 14304 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:12.074294 14304 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:12.080323 18036 log.cc:927] Time spent T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.106s	user 0.000s	sys 0.001s
W20260709 12:11:12.087839 18019 log.cc:927] Time spent T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.433s	user 0.002s	sys 0.000s
I20260709 12:11:12.092361 14084 catalog_manager.cc:5697] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:12.093667 14183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56652 (request call id 847) took 4289 ms. Trace:
I20260709 12:11:12.094162 14183 rpcz_store.cc:276] 0709 12:11:07.804628 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:07.914882 (+110254us) service_pool.cc:224] Handling call
0709 12:11:07.926455 (+ 11573us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:10.850256 (+2923801us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:12.093331 (+1243075us) spinlock_profiling.cc:243] Waited 2.9 s on lock 0x7b54003a34d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:11:12.093580 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6676958592}
W20260709 12:11:12.098428 14875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:12.099262 14875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:12.101665 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
W20260709 12:11:12.102453 14189 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56652 (request call id 854) took 3400 ms (client timeout 2324 ms). Trace:
W20260709 12:11:12.102880 14189 rpcz_store.cc:269] 0709 12:11:08.701587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:09.400677 (+699090us) service_pool.cc:224] Handling call
0709 12:11:12.102225 (+2701548us) spinlock_profiling.cc:243] Waited 2.47 s on lock 0x7b540028afd4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:11:12.102341 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5692478208}
I20260709 12:11:12.105211 18016 raft_consensus.cc:493] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:12.106005 18016 raft_consensus.cc:515] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:12.108420 18016 leader_election.cc:290] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:12.136426 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:12.160506 14912 raft_consensus.cc:1240] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 5. Current term is 6. Ops: [5.8-5.8]
I20260709 12:11:12.094798 14084 catalog_manager.cc:5697] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:12.162180 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
W20260709 12:11:12.163282 14087 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60410 (request call id 257) took 19830 ms (client timeout 15000 ms). Trace:
I20260709 12:11:12.162765 14084 catalog_manager.cc:5697] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:12.036288 17982 raft_consensus.cc:493] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
W20260709 12:11:12.166965 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 68861.1us
I20260709 12:11:12.162652 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:12.191267 14910 raft_consensus.cc:2468] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 12.
W20260709 12:11:12.167970 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:12.170531 14189 raft_consensus.cc:1240] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 12. Current term is 13. Ops: []
W20260709 12:11:12.077118 18037 log.cc:927] Time spent T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
W20260709 12:11:12.212049 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 91542.4us
I20260709 12:11:12.214030 17990 consensus_queue.cc:1048] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:12.215211 14903 raft_consensus.cc:1240] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 10 LEADER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:12.203475 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:11:12.216506 14912 raft_consensus.cc:2393] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 8: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
I20260709 12:11:12.205130 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:11:12.102279 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:11:12.214848 14084 catalog_manager.cc:5697] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 7 to 9, leader changed from 65c9c1653b3346b39a0e118540e6080c (127.12.174.131) to 73d01e9b1a9d49358da4985b21d681db (127.12.174.132). New cstate: current_term: 9 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:12.228706 17981 consensus_queue.cc:1048] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:12.231472 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:11:12.232631 14910 raft_consensus.cc:2393] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 9: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:11:12.241252 14264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41768 (request call id 1719) took 1644 ms. Trace:
I20260709 12:11:12.241681 14264 rpcz_store.cc:276] 0709 12:11:10.597102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:10.597604 (+   502us) service_pool.cc:224] Handling call
0709 12:11:10.597985 (+   381us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:11.886549 (+1288564us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:12.240907 (+354358us) spinlock_profiling.cc:243] Waited 1.29 s on lock 0x7b54001b30d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:11:12.241151 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2961608960}
I20260709 12:11:12.243837 14264 raft_consensus.cc:1240] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 10. Current term is 11. Ops: [7.5-10.7]
I20260709 12:11:12.196765 17861 raft_consensus.cc:493] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:12.198341 17982 raft_consensus.cc:3060] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:12.274555 17861 raft_consensus.cc:515] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:12.197237 18000 consensus_queue.cc:1059] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.081s
I20260709 12:11:12.279189 18000 raft_consensus.cc:3055] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:12.279629 18000 raft_consensus.cc:740] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:12.280593 18000 consensus_queue.cc:260] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:11:12.163782 14087 rpcz_store.cc:269] 0709 12:10:52.333229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:52.333555 (+   326us) service_pool.cc:224] Handling call
0709 12:10:52.527661 (+194106us) spinlock_profiling.cc:243] Waited 66.5 ms on lock 0x7b54002e3454. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a5090 00007f2127143f3a 00007f212cef9e9c 00007f212cff804e 00007f212b4b92a4 00007f212b4b9232 00007f212b4b9161 00007f212b4b90dc 00007f212b4b8392 00007f212547648c 00007f21254758c6
0709 12:11:12.163158 (+19635497us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:11:03.286935 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:11:03.287659 (+   724us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:11:03.287710 (+    51us) write_op.cc:435] Acquired schema lock
0709 12:11:03.287723 (+    13us) tablet.cc:662] Decoding operations
0709 12:11:03.288784 (+  1061us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:11:03.288881 (+    97us) write_op.cc:641] Partition lock acquired for write op
0709 12:11:03.288910 (+    29us) tablet.cc:685] Acquiring locks for 9 operations
0709 12:11:03.289877 (+   967us) tablet.cc:701] Row locks acquired
0709 12:11:03.289927 (+    50us) write_op.cc:260] PREPARE: finished
0709 12:11:03.290119 (+   192us) write_op.cc:270] Start()
0709 12:11:03.290282 (+   163us) write_op.cc:276] Timestamp: P: 1783599063290043 usec, L: 0
0709 12:11:03.290326 (+    44us) op_driver.cc:348] REPLICATION: starting
0709 12:11:03.291064 (+   738us) log.cc:844] Serialized 3654 byte log entry
0709 12:11:03.830086 (+539022us) op_driver.cc:464] REPLICATION: finished
0709 12:11:04.513056 (+682970us) write_op.cc:301] APPLY: starting
0709 12:11:04.541053 (+ 27997us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:04.653811 (+112758us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:04.710366 (+ 56555us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:04.711736 (+  1370us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:04.712050 (+   314us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=9
0709 12:11:04.712129 (+    79us) write_op.cc:312] APPLY: finished
0709 12:11:04.712487 (+   358us) log.cc:844] Serialized 71 byte log entry
0709 12:11:04.712744 (+   257us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:04.712878 (+   134us) write_op.cc:454] Released schema lock
0709 12:11:04.712945 (+    67us) write_op.cc:341] FINISH: Updating metrics
0709 12:11:04.770870 (+ 57925us) spinlock_profiling.cc:243] Waited 20 ms on lock 0x7b1800038e60. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f212cf16ab1 00007f212cf23281 00007f212404e522 00007f21240507c1 00007f2124050779 00007f2124050709 00007f21240506d1 00007f212404f9cd 0000000000388634 0000000000388479 00007f212403183a
0709 12:11:04.770991 (+   121us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:04.771019 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":43614,"reported_tablets":34,"spinlock_wait_cycles":152909568,"child_traces":[["op",{"apply.queue_time_us":627469,"apply.run_cpu_time_us":4233,"apply.run_wall_time_us":214457,"num_ops":9,"prepare.queue_time_us":163871,"prepare.run_cpu_time_us":22206,"prepare.run_wall_time_us":193853,"raft.queue_time_us":185439,"raft.run_cpu_time_us":53117,"raft.run_wall_time_us":495930,"replication_time_us":497368,"spinlock_wait_cycles":46044032,"thread_start_us":743534,"threads_started":4,"wal-append.queue_time_us":215747,"wal-append.run_cpu_time_us":19675,"wal-append.run_wall_time_us":2300482}]]}
I20260709 12:11:12.266579 14264 raft_consensus.cc:1240] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:11:12.241048 17991 consensus_queue.cc:1059] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 12:11:12.283026 17991 raft_consensus.cc:3055] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:12.283461 17991 raft_consensus.cc:740] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:12.235936 17946 leader_election.cc:290] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:12.267932 18020 raft_consensus.cc:493] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:12.272553 14183 raft_consensus.cc:1240] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 5. Current term is 6. Ops: []
I20260709 12:11:12.277472 17861 leader_election.cc:290] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:12.299533 18020 raft_consensus.cc:515] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:12.331174 18020 leader_election.cc:290] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:11:12.334801 14877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:12.236217 17836 consensus_queue.cc:1059] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.081s
I20260709 12:11:12.303088 18000 raft_consensus.cc:3060] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:12.284525 17991 consensus_queue.cc:260] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:12.360167 17856 raft_consensus.cc:493] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:12.377242 14303 leader_election.cc:304] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:11:12.380102 17991 raft_consensus.cc:3060] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:12.403265 14303 leader_election.cc:304] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
W20260709 12:11:12.404321 14305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:12.381467 17816 raft_consensus.cc:2804] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:12.378010 17983 consensus_queue.cc:1048] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 12:11:12.399480 17861 raft_consensus.cc:493] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:12.379345 17856 raft_consensus.cc:515] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:11:12.420867 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:12.439579 14156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:12.398193 17982 raft_consensus.cc:515] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:12.412681 17816 raft_consensus.cc:493] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:12.410771 17957 raft_consensus.cc:2804] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:11:12.492208 17894 consensus_meta.cc:287] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.539s	user 0.005s	sys 0.007s
W20260709 12:11:12.506433 14156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:12.507470 14154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:12.512358 14154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:12.512894 14154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:12.513382 14154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:12.370586 14084 catalog_manager.cc:5697] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:11:12.505257 17975 consensus_meta.cc:287] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.517s	user 0.010s	sys 0.003s
I20260709 12:11:12.422716 17921 consensus_queue.cc:1059] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.085s
I20260709 12:11:12.422227 17981 consensus_queue.cc:1059] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.086s
I20260709 12:11:12.505932 17816 raft_consensus.cc:3060] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:12.430935 17861 raft_consensus.cc:515] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:12.522353 14181 raft_consensus.cc:1240] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 11. Current term is 12. Ops: [11.6-11.6]
W20260709 12:11:12.525602 14877 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.174.130:36673 timed out after 1.686s (SENT) [suppressed 18 similar messages]
I20260709 12:11:12.508930 17957 raft_consensus.cc:493] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:12.517218 17956 raft_consensus.cc:493] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:12.532833 17957 raft_consensus.cc:3060] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:12.533109 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
W20260709 12:11:12.568166 14878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:12.538980 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:12.543948 17956 raft_consensus.cc:515] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:11:12.588738 14875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:12.530568 17851 consensus_queue.cc:1059] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 12:11:12.542500 17921 consensus_queue.cc:1059] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 12:11:12.595527 17982 leader_election.cc:290] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 12 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:12.595960 17851 raft_consensus.cc:3055] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:11:12.596416 17851 raft_consensus.cc:740] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:11:12.598028 17982 raft_consensus.cc:3055] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:12.598556 17982 raft_consensus.cc:740] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
W20260709 12:11:12.598872 18038 log.cc:927] Time spent T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260709 12:11:12.599594 17982 consensus_queue.cc:260] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:12.597499 17851 consensus_queue.cc:260] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:11:12.600823 18040 log.cc:927] Time spent T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 12:11:12.600369 17956 leader_election.cc:290] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:12.601493 17851 raft_consensus.cc:3060] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:12.601609 17861 leader_election.cc:290] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:12.603035 17838 raft_consensus.cc:3055] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:11:12.603559 17838 raft_consensus.cc:740] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:11:12.604759 17838 consensus_queue.cc:260] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:11:12.608899 18024 log.cc:927] Time spent T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.827s	user 0.004s	sys 0.000s
I20260709 12:11:12.613085 17864 leader_election.cc:290] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 9 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:12.620079 17503 raft_consensus.cc:3060] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:12.595335 17856 leader_election.cc:290] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:12.646643 17982 raft_consensus.cc:3060] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:12.686626 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:12.688869 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:12.690065 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:12.690670 14258 raft_consensus.cc:3060] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:12.691636 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:12.692458 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:12.694638 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:12.699580 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:12.695775 14084 catalog_manager.cc:5697] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db reported cstate change: config changed from index 5 to 6, term changed from 5 to 6, leader changed from 65c9c1653b3346b39a0e118540e6080c (127.12.174.131) to <none>, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New cstate: current_term: 6 committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:11:12.701504 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:12.714295 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:12.714026 14084 catalog_manager.cc:5697] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:12.727267 14084 catalog_manager.cc:5697] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 8 to 9, leader changed from 65c9c1653b3346b39a0e118540e6080c (127.12.174.131) to 73d01e9b1a9d49358da4985b21d681db (127.12.174.132). New cstate: current_term: 9 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:12.738370 17838 raft_consensus.cc:3060] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:12.692832 14260 raft_consensus.cc:3060] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:12.767139 14184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56652 (request call id 856) took 4053 ms. Trace:
W20260709 12:11:12.769182 14190 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56044 (request call id 2489) took 2218 ms (client timeout 1847 ms). Trace:
I20260709 12:11:12.774753 14265 raft_consensus.cc:2468] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 8.
W20260709 12:11:12.839121 14190 rpcz_store.cc:269] 0709 12:11:10.550227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:10.589367 (+ 39140us) service_pool.cc:224] Handling call
0709 12:11:12.768588 (+2179221us) spinlock_profiling.cc:243] Waited 435 ms on lock 0x7b540019b4d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:11:12.768864 (+   276us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1000630656}
I20260709 12:11:12.852803 18000 raft_consensus.cc:3055] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:12.853577 18000 raft_consensus.cc:740] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:12.855383 18000 consensus_queue.cc:260] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:12.866564 14258 raft_consensus.cc:2468] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 10.
I20260709 12:11:12.838956 14184 rpcz_store.cc:276] 0709 12:11:08.713816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:10.534204 (+1820388us) service_pool.cc:224] Handling call
0709 12:11:10.534549 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:10.831447 (+296898us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:12.766432 (+1934985us) spinlock_profiling.cc:243] Waited 296 ms on lock 0x7b54003a48d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:11:12.766887 (+   455us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":681331456}
I20260709 12:11:12.882846 14256 raft_consensus.cc:1240] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 12. Current term is 13. Ops: []
W20260709 12:11:12.888948 14257 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.657s	user 0.014s	sys 0.010s
W20260709 12:11:12.890969 14257 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.659s	user 0.015s	sys 0.010s
W20260709 12:11:12.890031 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 384655us
I20260709 12:11:12.893643 14257 raft_consensus.cc:1240] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 7. Current term is 8. Ops: [7.8-7.8]
W20260709 12:11:12.916323 14305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:12.918008 17809 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.024s	sys 0.009s
W20260709 12:11:12.918598 17809 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.540s	user 0.024s	sys 0.010s
I20260709 12:11:12.921927 14084 catalog_manager.cc:5697] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:11:12.930143 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 404424us
I20260709 12:11:12.936275 17500 leader_election.cc:290] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:11:12.938035 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 437319us
I20260709 12:11:12.930398 17840 raft_consensus.cc:3055] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 12 LEADER]: Stepping down as leader of term 12
W20260709 12:11:12.954854 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:12.957720 14333 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50858 (request call id 1742) took 2079 ms (client timeout 2482 ms). Trace:
W20260709 12:11:12.958294 14333 rpcz_store.cc:269] 0709 12:11:10.878460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:10.878636 (+   176us) service_pool.cc:224] Handling call
0709 12:11:12.957210 (+2078574us) spinlock_profiling.cc:243] Waited 684 ms on lock 0x7b5400338954. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:11:12.957438 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1573084544}
I20260709 12:11:12.960314 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:12.961438 14334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50856 (request call id 2055) took 1279 ms. Trace:
I20260709 12:11:12.962316 17981 raft_consensus.cc:493] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:12.963402 17981 raft_consensus.cc:515] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:12.963897 14330 raft_consensus.cc:1275] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:11:12.950805 17840 raft_consensus.cc:740] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
W20260709 12:11:12.966459 14156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:12.966985 18000 raft_consensus.cc:3060] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:12.967366 17840 consensus_queue.cc:260] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:12.968670 17840 raft_consensus.cc:3060] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:12.971215 18055 raft_consensus.cc:493] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:12.972230 18055 raft_consensus.cc:515] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:12.974666 14335 raft_consensus.cc:1275] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:11:12.976944 18054 raft_consensus.cc:493] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:12.978957 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:12.980046 14181 raft_consensus.cc:2468] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 10.
I20260709 12:11:12.982012 14189 raft_consensus.cc:1275] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:11:12.983132 17996 raft_consensus.cc:493] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:11:12.983984 17996 raft_consensus.cc:515] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:11:12.984841 14331 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50858 (request call id 1738) took 2265 ms (client timeout 1795 ms). Trace:
W20260709 12:11:12.985301 14331 rpcz_store.cc:269] 0709 12:11:10.719758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:10.750818 (+ 31060us) service_pool.cc:224] Handling call
0709 12:11:12.956571 (+2205753us) spinlock_profiling.cc:243] Waited 121 ms on lock 0x7b540010d6d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:11:12.984632 (+ 28061us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":278820224}
I20260709 12:11:12.991111 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:12.992266 14903 raft_consensus.cc:2393] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 8: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
I20260709 12:11:12.995959 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:12.962591 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:12.998682 14338 raft_consensus.cc:2468] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 9.
I20260709 12:11:12.961844 14334 rpcz_store.cc:276] 0709 12:11:11.682208 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:11.684590 (+  2382us) service_pool.cc:224] Handling call
0709 12:11:12.959857 (+1275267us) spinlock_profiling.cc:243] Waited 2.13 ms on lock 0x7b5800065d98. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2124016b71 00007f2124016a22 00007f212cf2f8d9 00007f212c089ee0 00007f212c1530ab 00007f212c153131 00007f212c1010a0 00007f212c100984 00007f212567b6d4 00007f212567b662
0709 12:11:12.961353 (+  1496us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4893440}
W20260709 12:11:13.013077 14156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:12.941409 14303 leader_election.cc:304] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
W20260709 12:11:13.020480 14877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:13.020222 14903 raft_consensus.cc:1240] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 9. Current term is 10. Ops: []
W20260709 12:11:13.041237 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 100010us
W20260709 12:11:13.056597 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 55227.9us
I20260709 12:11:13.057376 14260 raft_consensus.cc:2468] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 8.
I20260709 12:11:13.066416 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:13.044574 18054 raft_consensus.cc:515] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:13.073179 14188 raft_consensus.cc:1240] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:13.076756 18054 leader_election.cc:290] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:13.071760 14264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41764 (request call id 2544) took 1082 ms. Trace:
W20260709 12:11:13.082703 18061 log.cc:927] Time spent T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.146s	user 0.005s	sys 0.000s
I20260709 12:11:13.083377 14261 raft_consensus.cc:1275] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 12:11:13.085172 14332 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50856 (request call id 2043) took 1518 ms (client timeout 1942 ms). Trace:
W20260709 12:11:13.085678 14332 rpcz_store.cc:269] 0709 12:11:11.567055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:11.567180 (+   125us) service_pool.cc:224] Handling call
0709 12:11:13.084740 (+1517560us) spinlock_profiling.cc:243] Waited 322 ms on lock 0x7b540001ac54. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:11:13.084986 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":741441408}
I20260709 12:11:13.090413 17983 raft_consensus.cc:3055] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:13.091114 17983 raft_consensus.cc:740] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:13.092469 17983 consensus_queue.cc:260] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:13.095522 17983 raft_consensus.cc:3060] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:13.099831 14335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50856 (request call id 2048) took 1480 ms. Trace:
I20260709 12:11:13.100417 14335 rpcz_store.cc:276] 0709 12:11:11.619689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:11.620274 (+   585us) service_pool.cc:224] Handling call
0709 12:11:12.973968 (+1353694us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:12.975203 (+  1235us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:13.099494 (+124291us) spinlock_profiling.cc:243] Waited 1.35 s on lock 0x7b5400338950. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713a8ad 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:11:13.099712 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3112131328}
I20260709 12:11:13.103245 14877 leader_election.cc:304] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:13.078055 14264 rpcz_store.cc:276] 0709 12:11:11.987961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:12.715966 (+728005us) service_pool.cc:224] Handling call
0709 12:11:12.716559 (+   593us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:12.717165 (+   606us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:11:12.846354 (+129189us) log.cc:844] Serialized 14 byte log entry
0709 12:11:13.068576 (+222222us) log.cc:844] Serialized 14 byte log entry
0709 12:11:13.070084 (+  1508us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:13.070136 (+    52us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:13.070182 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:13.070263 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:13.070403 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":27404,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":70,"raft.queue_time_us":10823,"raft.run_cpu_time_us":334,"raft.run_wall_time_us":12032,"thread_start_us":170144,"threads_started":1}
I20260709 12:11:13.056907 17981 leader_election.cc:290] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:11:13.128800 14876 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:13.129549 14876 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:13.114224 17503 raft_consensus.cc:2749] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:11:13.112702 18026 log.cc:927] Time spent T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 1.343s	user 0.000s	sys 0.004s
I20260709 12:11:13.077083 18059 raft_consensus.cc:2749] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:12.956002 14084 catalog_manager.cc:5697] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:13.148448 14257 raft_consensus.cc:2393] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db in current term 10: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:11:13.146456 14304 leader_election.cc:304] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:13.152565 14264 raft_consensus.cc:1240] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:13.156517 14260 raft_consensus.cc:1240] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 10 LEADER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:13.146003 17981 raft_consensus.cc:493] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:13.163503 17897 raft_consensus.cc:493] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:13.164069 17981 raft_consensus.cc:515] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:13.164322 17897 raft_consensus.cc:515] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:13.166760 17981 leader_election.cc:290] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:11:13.163306 14155 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:13.169950 14155 connection.cc:256] RPC call timeout handler was delayed by -1.4989577210001244s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2009s for a response
I20260709 12:11:13.159538 18055 leader_election.cc:290] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:11:13.175766 14878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:13.177974 17816 consensus_meta.cc:287] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.621s	user 0.011s	sys 0.011s
I20260709 12:11:13.178615 17816 raft_consensus.cc:515] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:13.147123 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:13.161301 17996 leader_election.cc:290] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:11:13.163398 17991 consensus_meta.cc:287] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.731s	user 0.015s	sys 0.003s
I20260709 12:11:13.189363 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
W20260709 12:11:13.193871 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:13.184931 18059 raft_consensus.cc:2749] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:13.195698 14903 raft_consensus.cc:1275] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 12:11:13.199204 17957 consensus_meta.cc:287] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.622s	user 0.011s	sys 0.008s
I20260709 12:11:13.200218 14331 raft_consensus.cc:1240] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:13.200474 14334 raft_consensus.cc:1240] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 11. Current term is 12. Ops: []
W20260709 12:11:13.202976 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 52087.4us
I20260709 12:11:13.203661 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:13.205099 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:13.232195 14333 raft_consensus.cc:3060] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:13.232300 14184 raft_consensus.cc:2468] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 8.
I20260709 12:11:13.189183 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:13.234154 14332 raft_consensus.cc:2393] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db in current term 8: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
W20260709 12:11:13.206087 14154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:13.232265 14905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59144 (request call id 383) took 1097 ms. Trace:
W20260709 12:11:13.235497 14154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:13.235616 14905 rpcz_store.cc:276] 0709 12:11:12.134383 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:12.134533 (+   150us) service_pool.cc:224] Handling call
0709 12:11:12.134821 (+   288us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:12.214142 (+ 79321us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:12.214179 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:12.922131 (+707952us) spinlock_profiling.cc:243] Waited 2.92 ms on lock 0x7b2c00125df8. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2125a34a11 00007f2125a44372 00007f2127176a01 00007f212713b43a 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2
0709 12:11:12.922853 (+   722us) log.cc:844] Serialized 26 byte log entry
0709 12:11:13.064102 (+141249us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:13.070409 (+  6307us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:13.121478 (+ 51069us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:13.231022 (+109544us) raft_consensus.cc:1685] finished
0709 12:11:13.231044 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:13.231989 (+   945us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":78801,"raft.queue_time_us":93549,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":107,"spinlock_wait_cycles":6724480,"thread_start_us":140689,"threads_started":1,"wal-append.queue_time_us":236745}
I20260709 12:11:13.235146 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:11:13.236012 14154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:13.242329 14154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:13.210672 14259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41764 (request call id 2539) took 1229 ms. Trace:
I20260709 12:11:13.202834 14330 raft_consensus.cc:1240] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:13.212432 17897 leader_election.cc:290] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:11:13.212669 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 80234us
W20260709 12:11:13.215745 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 52663.5us
I20260709 12:11:13.235082 14339 raft_consensus.cc:1275] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:11:13.218616 14904 raft_consensus.cc:2410] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:11:13.219566 14084 catalog_manager.cc:5697] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:13.222855 14336 raft_consensus.cc:1275] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:11:13.224522 17996 consensus_queue.cc:1059] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:13.242838 14332 raft_consensus.cc:1275] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:11:13.226454 14876 leader_election.cc:304] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:11:13.226724 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:11:13.228168 17982 consensus_meta.cc:287] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.581s	user 0.008s	sys 0.008s
I20260709 12:11:13.217478 17816 leader_election.cc:290] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 12 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:13.260735 14337 raft_consensus.cc:2468] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 10.
I20260709 12:11:13.239328 14334 raft_consensus.cc:1275] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:11:13.226689 17503 raft_consensus.cc:493] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:13.261950 14333 raft_consensus.cc:2468] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 6.
I20260709 12:11:13.265416 17991 consensus_queue.cc:1059] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 12:11:13.267170 17991 raft_consensus.cc:3055] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:13.266578 17503 raft_consensus.cc:515] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:13.267618 17991 raft_consensus.cc:740] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:13.273140 14330 raft_consensus.cc:1240] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 5. Current term is 6. Ops: []
I20260709 12:11:13.242856 14259 rpcz_store.cc:276] 0709 12:11:11.981378 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:11.991917 (+ 10539us) service_pool.cc:224] Handling call
0709 12:11:11.992265 (+   348us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:12.003528 (+ 11263us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:12.003570 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:12.006569 (+  2999us) log.cc:844] Serialized 26 byte log entry
0709 12:11:12.864232 (+857663us) spinlock_profiling.cc:243] Waited 2.65 ms on lock 0x7b18003c1d20. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f212cf16ab1 00007f212cf23281 00007f2124030e07 00007f212ce8b9a9 00007f212404d69b 00007f212404b93f 00007f212404dc02 00007f2126cd520b 00007f2126cdad23 00007f2126cdb0d1 00007f21270f6a0f
0709 12:11:13.052615 (+188383us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:13.084747 (+ 32132us) log.cc:844] Serialized 14 byte log entry
0709 12:11:13.186938 (+102191us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:13.187062 (+   124us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:13.210144 (+ 23082us) raft_consensus.cc:1685] finished
0709 12:11:13.210250 (+   106us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:13.210476 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":99493,"prepare.queue_time_us":4788,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":71,"raft.queue_time_us":112125,"raft.run_cpu_time_us":298,"raft.run_wall_time_us":7252,"spinlock_wait_cycles":6090112,"thread_start_us":136398,"threads_started":1,"wal-append.queue_time_us":1118493}
I20260709 12:11:13.267202 17838 raft_consensus.cc:3055] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:13.285147 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:13.279910 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:13.276593 17996 raft_consensus.cc:2804] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:13.284720 17836 consensus_queue.cc:1048] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 12:11:13.295264 17840 consensus_queue.cc:1048] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:13.298182 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:11:13.261535 17957 raft_consensus.cc:515] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:13.282678 17838 raft_consensus.cc:740] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:11:13.298082 14304 leader_election.cc:304] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:13.302357 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:13.268857 17991 consensus_queue.cc:260] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:13.301537 17957 leader_election.cc:290] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 7 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:13.293205 17996 raft_consensus.cc:493] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:13.326287 14330 raft_consensus.cc:2468] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 9.
W20260709 12:11:13.328372 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 157557us
I20260709 12:11:13.330164 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:11:13.329763 14155 connection.cc:256] RPC call timeout handler was delayed by -1.454794412000183s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18180000000000002s for a response
I20260709 12:11:13.333148 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:13.322860 17996 raft_consensus.cc:3060] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:13.343761 14336 raft_consensus.cc:2468] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 10.
I20260709 12:11:13.347061 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:13.350147 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:13.341226 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:13.363590 14331 raft_consensus.cc:1275] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 12:11:13.363607 14229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:13.361680 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:13.362336 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
W20260709 12:11:13.367854 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:13.370385 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:13.374538 14184 raft_consensus.cc:2393] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 9: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
W20260709 12:11:13.377465 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 96527.3us
I20260709 12:11:13.374050 18072 raft_consensus.cc:2749] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:13.381989 14189 raft_consensus.cc:3060] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:13.363420 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:13.386888 14188 raft_consensus.cc:3060] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:13.387972 17840 consensus_queue.cc:1059] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 12:11:13.395234 17840 raft_consensus.cc:3055] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:13.395653 17840 raft_consensus.cc:740] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:11:13.396627 17840 consensus_queue.cc:260] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:13.362123 14084 catalog_manager.cc:5697] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 5 to 7, leader changed from 885067a0d31741bfb5c9935788e315bf (127.12.174.129) to 73d01e9b1a9d49358da4985b21d681db (127.12.174.132). New cstate: current_term: 7 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:13.398517 17503 leader_election.cc:290] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:13.399495 14084 catalog_manager.cc:5697] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:13.402159 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:13.403502 14903 raft_consensus.cc:2468] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 9.
I20260709 12:11:13.402427 17991 raft_consensus.cc:3060] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:13.408831 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
W20260709 12:11:13.420601 14875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:13.429945 17692 raft_consensus.cc:493] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:13.430667 17692 raft_consensus.cc:515] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:11:13.426080 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 157202us
I20260709 12:11:13.361790 18014 consensus_queue.cc:1059] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.105s
W20260709 12:11:13.456312 14155 connection.cc:256] RPC call timeout handler was delayed by -1.4431577210000341s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20710000000000003s for a response
I20260709 12:11:13.457828 14304 leader_election.cc:304] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:13.456286 17840 raft_consensus.cc:3060] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:13.468101 17894 raft_consensus.cc:493] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:13.468981 17692 leader_election.cc:290] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:13.468871 17894 raft_consensus.cc:515] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:13.471251 17894 leader_election.cc:290] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:13.481215 14911 raft_consensus.cc:2468] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 12.
I20260709 12:11:13.497933 17957 raft_consensus.cc:2749] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:11:13.503039 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 74301.6us
W20260709 12:11:13.504900 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 73231.5us
I20260709 12:11:13.507416 14303 leader_election.cc:304] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:11:13.509342 18071 raft_consensus.cc:493] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:13.510203 18071 raft_consensus.cc:515] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:13.512646 18071 leader_election.cc:290] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:13.522305 14303 leader_election.cc:304] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
W20260709 12:11:13.524991 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 437603us
I20260709 12:11:13.528023 14304 leader_election.cc:304] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
W20260709 12:11:13.528600 14230 connection.cc:256] RPC call timeout handler was delayed by -1.6096969870000066s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19390000000000002s for a response
W20260709 12:11:13.529068 14230 connection.cc:256] RPC call timeout handler was delayed by -1.550296987000138s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2005s for a response
W20260709 12:11:13.529506 14230 connection.cc:256] RPC call timeout handler was delayed by -1.4501970850001271s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1704s for a response
W20260709 12:11:13.529846 14230 connection.cc:256] RPC call timeout handler was delayed by -1.326196987000003s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22540000000000002s for a response
W20260709 12:11:13.532342 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 67743.6us
W20260709 12:11:13.533804 14155 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:13.534229 14155 connection.cc:256] RPC call timeout handler was delayed by -1.3639577210001335s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21589999999999998s for a response
W20260709 12:11:13.534621 14155 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:13.534940 14155 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:13.535475 14155 connection.cc:256] RPC call timeout handler was delayed by -1.2226577210001324s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2316s for a response
W20260709 12:11:13.535871 14155 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:13.538436 17946 raft_consensus.cc:493] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:11:13.478821 17996 raft_consensus.cc:515] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:13.539166 17946 raft_consensus.cc:515] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:13.541528 17946 leader_election.cc:290] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:13.541553 17996 leader_election.cc:290] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 11 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:13.543917 14155 leader_election.cc:304] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:11:13.545019 17946 raft_consensus.cc:2804] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:13.526863 18071 raft_consensus.cc:2804] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:13.545946 17946 raft_consensus.cc:697] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 9 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:11:13.529207 17981 raft_consensus.cc:2749] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:11:13.552832 14156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:13.550680 17946 consensus_queue.cc:237] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:13.552368 17809 raft_consensus.cc:3055] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:13.558271 17809 raft_consensus.cc:740] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:11:13.559456 17809 consensus_queue.cc:260] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:13.560334 14265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41764 (request call id 2549) took 1163 ms. Trace:
I20260709 12:11:13.551265 17957 raft_consensus.cc:2804] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:13.561333 17957 raft_consensus.cc:697] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 12 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:13.562291 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:13.562561 17957 consensus_queue.cc:237] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:13.563117 14910 raft_consensus.cc:2468] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 13.
I20260709 12:11:13.565490 14304 leader_election.cc:304] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
W20260709 12:11:13.566201 14230 connection.cc:256] RPC call timeout handler was delayed by -1.0494441219998407s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16000000000000003s for a response
I20260709 12:11:13.566581 17859 raft_consensus.cc:493] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:13.560685 17809 raft_consensus.cc:3060] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:13.567152 17897 raft_consensus.cc:493] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:13.567997 17897 raft_consensus.cc:515] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:13.567159 14230 leader_election.cc:304] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:13.570124 17997 raft_consensus.cc:493] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:13.560819 14265 rpcz_store.cc:276] 0709 12:11:12.396854 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:12.864780 (+467926us) service_pool.cc:224] Handling call
0709 12:11:12.912444 (+ 47664us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:12.942253 (+ 29809us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:11:12.942777 (+   524us) log.cc:844] Serialized 14 byte log entry
0709 12:11:13.270402 (+327625us) log.cc:844] Serialized 14 byte log entry
0709 12:11:13.559754 (+289352us) spinlock_profiling.cc:243] Waited 3.2 ms on lock 0x7b18003658c0. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f212cf16ab1 00007f212cf23281 00007f2123fc8c0a 00007f212d708219 00007f2124050a40 00007f212404b4e4 00007f212404b455 00007f2127133060 00007f2127145716 00007f2127156287 00007f2127156208
0709 12:11:13.559926 (+   172us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:13.559979 (+    53us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:13.560035 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:13.560110 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:13.560256 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":405780,"prepare.queue_time_us":2406,"prepare.run_cpu_time_us":99,"prepare.run_wall_time_us":100,"raft.queue_time_us":414809,"raft.run_cpu_time_us":331,"raft.run_wall_time_us":8639,"spinlock_wait_cycles":7371136,"thread_start_us":203154,"threads_started":1,"wal-append.queue_time_us":264016}
W20260709 12:11:13.554950 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 101597us
I20260709 12:11:13.574643 14188 raft_consensus.cc:2468] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 8.
I20260709 12:11:13.577265 17718 raft_consensus.cc:493] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:13.577690 14156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:13.578060 17718 raft_consensus.cc:515] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:13.585115 17718 leader_election.cc:290] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:13.588583 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:13.589564 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:13.590402 14332 raft_consensus.cc:2468] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 9.
I20260709 12:11:13.582531 14303 leader_election.cc:304] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:11:13.566067 17848 raft_consensus.cc:493] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:13.595222 17848 raft_consensus.cc:515] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:13.596024 14189 raft_consensus.cc:2410] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:11:13.597023 17953 raft_consensus.cc:493] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:13.598714 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:13.600289 17897 leader_election.cc:290] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:13.600975 17897 raft_consensus.cc:2749] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:13.546255 18071 raft_consensus.cc:493] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:13.594408 17864 raft_consensus.cc:493] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:13.598730 18054 raft_consensus.cc:2749] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:13.606813 17864 raft_consensus.cc:515] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:13.611208 17864 leader_election.cc:290] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:13.613869 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:13.613436 17859 raft_consensus.cc:515] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:13.571010 17997 raft_consensus.cc:515] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:11:13.625835 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 82111.8us
I20260709 12:11:13.627713 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
W20260709 12:11:13.627875 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 57053.5us
W20260709 12:11:13.629861 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:13.622160 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:13.605141 18071 raft_consensus.cc:3060] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:13.635250 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:13.617640 18054 raft_consensus.cc:2804] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:13.618445 17848 leader_election.cc:290] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:13.653350 14261 raft_consensus.cc:2468] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 6.
I20260709 12:11:13.597802 17953 raft_consensus.cc:515] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:13.645133 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:13.656222 14184 raft_consensus.cc:2468] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 7.
I20260709 12:11:13.659045 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:13.659935 14182 raft_consensus.cc:3060] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:13.661875 14263 raft_consensus.cc:1275] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:11:13.642648 18054 raft_consensus.cc:493] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:13.664420 18054 raft_consensus.cc:3060] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:13.665560 17838 consensus_queue.cc:260] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:13.667819 17838 raft_consensus.cc:3060] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:13.669323 18000 raft_consensus.cc:493] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:13.670078 18000 raft_consensus.cc:515] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:13.671352 17859 leader_election.cc:290] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:13.673543 18000 leader_election.cc:290] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:13.678843 14876 leader_election.cc:304] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:13.680096 14187 raft_consensus.cc:2468] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 8.
I20260709 12:11:13.638921 17840 raft_consensus.cc:493] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:13.690065 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 123065us
I20260709 12:11:13.692055 14264 raft_consensus.cc:2468] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 9.
I20260709 12:11:13.691948 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
W20260709 12:11:13.697575 18090 log.cc:927] Time spent T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.120s	user 0.000s	sys 0.001s
I20260709 12:11:13.699434 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:13.700557 14229 leader_election.cc:304] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:13.701570 18094 raft_consensus.cc:2804] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:13.702051 18094 raft_consensus.cc:493] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:13.702396 18094 raft_consensus.cc:3060] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:13.702570 17856 raft_consensus.cc:2804] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:13.710515 17856 raft_consensus.cc:493] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:13.711015 17856 raft_consensus.cc:3060] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:13.718513 14876 leader_election.cc:304] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:13.718938 14182 raft_consensus.cc:2468] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 11.
I20260709 12:11:13.702302 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:11:13.725844 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 85485us
I20260709 12:11:13.726173 14877 leader_election.cc:304] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:13.735594 14230 leader_election.cc:304] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:13.745296 14304 leader_election.cc:304] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:13.754455 14229 leader_election.cc:304] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:13.758781 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:13.729012 17840 raft_consensus.cc:515] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:13.744760 18081 raft_consensus.cc:2749] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:13.748324 17953 leader_election.cc:290] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:13.747825 17897 raft_consensus.cc:2749] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:13.772279 14186 raft_consensus.cc:2393] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 12: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:11:13.764904 17983 raft_consensus.cc:493] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:13.767721 17957 raft_consensus.cc:2804] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:11:13.780112 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 83324.4us
I20260709 12:11:13.780951 18089 raft_consensus.cc:2804] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:13.785858 17957 raft_consensus.cc:697] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 8 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:13.779325 14304 leader_election.cc:304] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:13.781493 18089 raft_consensus.cc:493] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:11:13.801074 18089 raft_consensus.cc:3060] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:13.802054 17983 raft_consensus.cc:515] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:13.804129 17983 leader_election.cc:290] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:13.813663 18089 raft_consensus.cc:515] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:13.816918 18089 leader_election.cc:290] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 9 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:13.818209 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:13.818524 14230 leader_election.cc:304] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:13.819064 14183 raft_consensus.cc:3060] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:13.819434 17953 raft_consensus.cc:2804] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:13.819967 17953 raft_consensus.cc:493] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:13.820179 14230 leader_election.cc:304] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:13.797637 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:13.821010 14190 raft_consensus.cc:3060] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:13.818302 17897 consensus_queue.cc:1059] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 12:11:13.826038 17997 leader_election.cc:290] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:13.781163 18095 raft_consensus.cc:2749] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:13.820386 17953 raft_consensus.cc:3060] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:13.798497 18094 raft_consensus.cc:515] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:13.827104 18093 raft_consensus.cc:3055] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:13.828164 18093 raft_consensus.cc:740] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:11:13.829320 18093 consensus_queue.cc:260] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:11:13.830992 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:13.830752 18093 raft_consensus.cc:3060] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:13.834478 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 55212.3us
I20260709 12:11:13.835206 17983 raft_consensus.cc:2804] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:13.835867 14229 leader_election.cc:304] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:13.838963 17840 leader_election.cc:290] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:13.794050 17957 consensus_queue.cc:237] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:13.840802 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:13.848105 14876 leader_election.cc:304] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:13.851174 14183 raft_consensus.cc:2468] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 9.
I20260709 12:11:13.850565 14184 raft_consensus.cc:2468] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 10.
I20260709 12:11:13.855265 14876 leader_election.cc:304] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:13.860318 14877 leader_election.cc:304] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:13.850351 17848 raft_consensus.cc:493] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:13.850350 17838 consensus_queue.cc:1059] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 12:11:13.854526 17503 raft_consensus.cc:2804] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:13.876535 14876 leader_election.cc:304] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:13.856954 17983 raft_consensus.cc:697] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 10 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:13.861400 17836 raft_consensus.cc:2804] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:13.863361 18095 raft_consensus.cc:2749] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:13.888971 14190 raft_consensus.cc:2468] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 7.
I20260709 12:11:13.893939 18088 raft_consensus.cc:3055] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:13.902887 17836 raft_consensus.cc:697] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 9 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:11:13.896056 17503 raft_consensus.cc:697] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [term 11 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:11:13.896944 14155 leader_election.cc:304] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:13.909303 17503 consensus_queue.cc:237] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:13.910313 18054 raft_consensus.cc:515] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:13.912586 18054 leader_election.cc:290] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:13.897586 18094 leader_election.cc:290] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 9 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:13.897951 17983 consensus_queue.cc:237] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:13.861560 17997 raft_consensus.cc:2804] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:13.874243 18014 raft_consensus.cc:2749] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:13.902714 18088 raft_consensus.cc:740] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:11:13.895859 18089 raft_consensus.cc:2804] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:11:13.915601 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 79841.5us
I20260709 12:11:13.918077 14230 leader_election.cc:304] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:13.923008 17836 consensus_queue.cc:237] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:13.924582 18092 raft_consensus.cc:2749] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:13.925359 17894 raft_consensus.cc:493] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:13.879473 17848 raft_consensus.cc:515] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:13.914394 18071 raft_consensus.cc:515] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:13.944905 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:13.945621 14184 raft_consensus.cc:2468] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 13.
I20260709 12:11:13.929663 17997 raft_consensus.cc:493] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:13.936213 18089 raft_consensus.cc:493] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:13.950340 14228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:13.950995 18098 log.cc:927] Time spent T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
I20260709 12:11:13.951957 18088 consensus_queue.cc:260] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:13.952528 17848 leader_election.cc:290] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:13.953341 18088 raft_consensus.cc:3060] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:13.950344 18089 raft_consensus.cc:3060] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:13.957294 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 74075.2us
I20260709 12:11:13.949841 14258 raft_consensus.cc:1275] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:11:13.938746 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:11:13.940878 18094 raft_consensus.cc:2749] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:13.962785 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:13.963444 18000 raft_consensus.cc:493] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:13.968081 18089 raft_consensus.cc:515] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:13.962903 14155 leader_election.cc:304] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:13.973366 14229 leader_election.cc:304] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
W20260709 12:11:13.974539 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 90141.5us
I20260709 12:11:13.940425 17996 consensus_queue.cc:1048] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 12:11:13.948848 17997 raft_consensus.cc:3060] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:13.979431 14230 leader_election.cc:304] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:13.974120 14904 raft_consensus.cc:3060] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:13.982877 14877 leader_election.cc:304] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:13.984400 17692 raft_consensus.cc:2804] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:11:13.984731 14877 leader_election.cc:304] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:11:13.976455 18092 raft_consensus.cc:2749] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:11:13.996330 14181 raft_consensus.cc:1240] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:13.981539 17809 raft_consensus.cc:3060] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:13.977803 18014 consensus_queue.cc:1048] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 12:11:13.976125 17953 raft_consensus.cc:515] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:13.975881 17894 raft_consensus.cc:515] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:13.993506 17859 raft_consensus.cc:2749] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:13.981374 18000 raft_consensus.cc:515] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:14.024402 18000 leader_election.cc:290] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:14.024973 18000 raft_consensus.cc:493] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:14.025449 18000 raft_consensus.cc:515] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } }
I20260709 12:11:14.029150 18000 leader_election.cc:290] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:13.997568 17838 consensus_queue.cc:1048] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 12:11:14.029803 18071 leader_election.cc:290] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 11 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:14.029948 14229 leader_election.cc:304] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:14.031862 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:11:14.035432 17894 leader_election.cc:290] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:11:14.036659 14156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:14.037158 17953 leader_election.cc:290] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:14.004703 17840 raft_consensus.cc:2804] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:13.998489 17856 raft_consensus.cc:515] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:14.046540 14155 leader_election.cc:304] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:14.058293 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:14.047399 14230 leader_election.cc:304] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:14.042182 17692 raft_consensus.cc:697] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 6 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:11:14.061118 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:14.061936 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:14.062057 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:14.059149 14261 raft_consensus.cc:2468] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 10.
W20260709 12:11:14.129326 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 82025.5us
I20260709 12:11:14.140516 14264 raft_consensus.cc:2468] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 10.
I20260709 12:11:14.128208 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:14.143970 14263 raft_consensus.cc:2468] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 9.
W20260709 12:11:14.141286 14156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:14.151854 14904 raft_consensus.cc:2468] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 14.
I20260709 12:11:14.152303 17856 leader_election.cc:290] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 8 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:14.154004 18094 raft_consensus.cc:2804] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:14.154517 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:14.155808 14264 raft_consensus.cc:2410] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 12:11:14.154845 18094 raft_consensus.cc:697] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 9 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:11:14.157349 18094 consensus_queue.cc:237] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.3, Last appended by leader: 3, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:14.058176 17840 raft_consensus.cc:493] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:14.163748 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:14.164141 17848 raft_consensus.cc:2804] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:14.164405 14183 raft_consensus.cc:3060] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:14.164801 17848 raft_consensus.cc:697] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 10 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:11:14.166054 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:14.165843 17848 consensus_queue.cc:237] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:14.166714 14184 raft_consensus.cc:2468] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 11.
I20260709 12:11:14.152962 18087 consensus_queue.cc:1048] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.191s
I20260709 12:11:14.148782 18071 raft_consensus.cc:493] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:11:14.170904 14303 leader_election.cc:304] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:11:14.170291 14262 raft_consensus.cc:1240] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:14.172582 14183 raft_consensus.cc:2468] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 8.
I20260709 12:11:14.173641 14876 leader_election.cc:304] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
W20260709 12:11:14.185804 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 155984us
I20260709 12:11:14.146165 18093 raft_consensus.cc:2749] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:11:14.193782 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 199344us
I20260709 12:11:14.194418 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:14.202361 14183 raft_consensus.cc:3060] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:14.194945 18072 raft_consensus.cc:493] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:14.195538 17957 raft_consensus.cc:493] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:14.196746 18054 raft_consensus.cc:493] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:14.197016 17981 raft_consensus.cc:2804] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:14.209067 14155 leader_election.cc:304] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:14.210345 17987 raft_consensus.cc:493] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:14.210868 17767 raft_consensus.cc:493] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:14.169544 17840 raft_consensus.cc:3060] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:14.213996 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:14.196525 18000 raft_consensus.cc:493] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:14.216039 14183 raft_consensus.cc:2468] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 14.
W20260709 12:11:14.216325 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 231666us
I20260709 12:11:14.169239 18071 raft_consensus.cc:515] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:14.224742 18071 leader_election.cc:290] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:14.226758 14184 raft_consensus.cc:1275] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:11:14.155823 17692 consensus_queue.cc:237] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:14.206434 18088 raft_consensus.cc:2804] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:14.234408 14877 leader_election.cc:304] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
W20260709 12:11:14.236140 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:14.229434 18054 raft_consensus.cc:515] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:14.261703 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:14.262475 18093 consensus_queue.cc:1048] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:14.262778 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:14.263608 18054 leader_election.cc:290] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:14.220366 17946 raft_consensus.cc:2749] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:14.229684 17981 raft_consensus.cc:697] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 14 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:14.260883 14229 leader_election.cc:400] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 pre-election: Vote denied by peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187) with higher term. Message: Invalid argument: T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 12. Current term is 13.
I20260709 12:11:14.268303 14229 leader_election.cc:403] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:14.275457 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:14.277956 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:14.220763 18072 raft_consensus.cc:515] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:11:14.279706 18109 log.cc:927] Time spent T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.142s	user 0.001s	sys 0.000s
W20260709 12:11:14.279858 18108 log.cc:927] Time spent T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.233s	user 0.001s	sys 0.000s
I20260709 12:11:14.280507 18093 raft_consensus.cc:2749] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187) with higher term. Message: Invalid argument: T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 12. Current term is 13.
I20260709 12:11:14.280827 18072 leader_election.cc:290] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:11:14.281872 18112 log.cc:927] Time spent T 00000000000000000000000000000000 P d07070be2c074f4cb9ad35f1580c4ef7: Append to log took a long time: real 0.121s	user 0.000s	sys 0.002s
I20260709 12:11:14.234972 17767 raft_consensus.cc:515] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:14.284591 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:14.285230 14258 raft_consensus.cc:3060] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:14.288417 14877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:14.285684 14230 leader_election.cc:304] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:14.266898 17503 raft_consensus.cc:2804] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:14.229238 17957 raft_consensus.cc:515] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:14.240526 18000 raft_consensus.cc:515] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:14.271023 18089 leader_election.cc:290] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 11 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:14.265313 18088 raft_consensus.cc:697] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [term 8 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
W20260709 12:11:14.310098 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 101132us
I20260709 12:11:14.293812 17859 raft_consensus.cc:2749] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:14.323850 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:14.262856 17987 raft_consensus.cc:515] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:14.324605 14188 raft_consensus.cc:2468] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 9.
I20260709 12:11:14.320084 14155 leader_election.cc:304] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:14.322240 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:14.326440 14261 raft_consensus.cc:2468] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 9.
I20260709 12:11:14.294154 17503 raft_consensus.cc:493] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:14.317817 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:14.330054 14181 raft_consensus.cc:2468] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 8.
W20260709 12:11:14.339041 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 46959.3us
I20260709 12:11:14.341662 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:11:14.331148 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 115403us
I20260709 12:11:14.338644 14332 raft_consensus.cc:2468] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 10.
I20260709 12:11:14.351063 14258 raft_consensus.cc:2468] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 11.
I20260709 12:11:14.325245 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:14.355551 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:14.332521 17503 raft_consensus.cc:3060] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:14.355594 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 70047.1us
I20260709 12:11:14.367672 14331 raft_consensus.cc:1240] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:14.371852 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:14.372156 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:14.373468 14261 raft_consensus.cc:3060] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:11:14.347383 18071 raft_consensus.cc:493] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:14.347309 17894 raft_consensus.cc:493] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:14.382575 14259 raft_consensus.cc:1240] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:14.347679 17946 raft_consensus.cc:2749] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:14.381659 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:14.363425 18072 raft_consensus.cc:493] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:14.384620 14230 leader_election.cc:304] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:14.386654 14337 raft_consensus.cc:2410] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:11:14.345813 18087 consensus_queue.cc:1048] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
W20260709 12:11:14.380604 14228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:14.389238 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:14.390537 14265 raft_consensus.cc:2468] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 9.
I20260709 12:11:14.394935 14330 raft_consensus.cc:3060] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:14.397541 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 77570.2us
I20260709 12:11:14.401355 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:14.402117 14184 raft_consensus.cc:2468] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 7.
I20260709 12:11:14.377277 17983 raft_consensus.cc:493] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:14.416143 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:14.420264 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
W20260709 12:11:14.419371 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 58260.7us
I20260709 12:11:14.421342 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
W20260709 12:11:14.422703 14154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:14.432648 14156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:14.410135 18114 log.cc:927] Time spent T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.241s	user 0.001s	sys 0.000s
I20260709 12:11:14.458941 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
W20260709 12:11:14.501598 18117 log.cc:927] Time spent T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.236s	user 0.000s	sys 0.001s
I20260709 12:11:14.448750 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:14.385367 18071 raft_consensus.cc:515] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:11:14.484093 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 99557.3us
I20260709 12:11:14.390393 18072 raft_consensus.cc:515] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:14.403563 17840 raft_consensus.cc:515] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:14.442845 14337 raft_consensus.cc:2410] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:11:14.387362 17981 consensus_queue.cc:237] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:14.416555 17894 raft_consensus.cc:515] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:14.396726 18088 consensus_queue.cc:237] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:14.423152 17983 raft_consensus.cc:515] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:11:14.511098 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 93355.6us
I20260709 12:11:14.385491 17996 consensus_queue.cc:1048] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 12:11:14.444264 17946 consensus_queue.cc:1048] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 12:11:14.513986 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:14.490837 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:14.494242 17859 raft_consensus.cc:2749] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:11:14.511155 14154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:14.534480 14229 leader_election.cc:304] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:14.506875 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:14.537611 14230 leader_election.cc:304] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:14.544584 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:14.551829 14910 raft_consensus.cc:3060] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:14.549752 14332 raft_consensus.cc:2393] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 11: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:11:14.550786 18000 leader_election.cc:290] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:14.558332 14155 leader_election.cc:304] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
W20260709 12:11:14.560034 17809 consensus_meta.cc:287] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.553s	user 0.009s	sys 0.000s
I20260709 12:11:14.560262 14155 leader_election.cc:304] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
W20260709 12:11:14.560920 18129 log.cc:927] Time spent T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:11:14.562819 17983 leader_election.cc:290] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:14.566087 18092 raft_consensus.cc:2749] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:14.566826 18092 raft_consensus.cc:2804] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:14.567154 18092 raft_consensus.cc:493] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:14.567464 18092 raft_consensus.cc:3060] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:14.570727 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:14.571064 18071 leader_election.cc:290] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:14.552039 14337 raft_consensus.cc:2468] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 8.
I20260709 12:11:14.575189 14330 raft_consensus.cc:2468] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 11.
I20260709 12:11:14.546520 17957 leader_election.cc:290] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:14.576396 14877 leader_election.cc:304] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:14.580207 14331 raft_consensus.cc:1240] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:14.581079 17894 leader_election.cc:290] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:14.582315 18136 raft_consensus.cc:2804] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:14.583042 18136 raft_consensus.cc:697] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 11 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
W20260709 12:11:14.583626 18124 log.cc:927] Time spent T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:11:14.584038 18136 consensus_queue.cc:237] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:14.571496 17946 consensus_queue.cc:1048] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 12:11:14.580986 17840 leader_election.cc:290] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 10 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:14.582394 18072 leader_election.cc:290] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:11:14.587715 18128 log.cc:927] Time spent T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
W20260709 12:11:14.589527 18126 log.cc:927] Time spent T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
W20260709 12:11:14.591352 18125 log.cc:927] Time spent T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:11:14.593242 14261 raft_consensus.cc:2468] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 8.
W20260709 12:11:14.595366 17997 consensus_meta.cc:287] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.603s	user 0.011s	sys 0.005s
I20260709 12:11:14.598276 14904 raft_consensus.cc:2393] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 10: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
I20260709 12:11:14.576140 14304 leader_election.cc:304] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db
W20260709 12:11:14.599622 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 65267.7us
I20260709 12:11:14.604570 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:14.610426 14331 raft_consensus.cc:2368] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db for earlier term 10. Current term is 11.
W20260709 12:11:14.586731 18121 log.cc:927] Time spent T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
I20260709 12:11:14.614916 14183 raft_consensus.cc:1275] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:11:14.613440 14877 leader_election.cc:400] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 10 election: Vote denied by peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957) with higher term. Message: Invalid argument: T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db for earlier term 10. Current term is 11.
I20260709 12:11:14.616496 14877 leader_election.cc:403] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
W20260709 12:11:14.623384 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 85853.7us
I20260709 12:11:14.624248 14230 leader_election.cc:304] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:14.625869 14304 leader_election.cc:304] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:14.578390 17809 raft_consensus.cc:2749] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:11:14.638540 14910 raft_consensus.cc:2468] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 11.
I20260709 12:11:14.639788 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:14.640635 14155 leader_election.cc:304] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:14.597090 17997 raft_consensus.cc:515] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:11:14.653270 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 52424.2us
I20260709 12:11:14.613409 17983 raft_consensus.cc:2804] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:14.655143 14304 leader_election.cc:304] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
W20260709 12:11:14.657419 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 78583.5us
I20260709 12:11:14.677840 14155 leader_election.cc:304] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:14.692129 14304 leader_election.cc:304] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:14.700076 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:11:14.701581 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 77430.7us
I20260709 12:11:14.706457 14304 leader_election.cc:304] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:11:14.639588 18094 raft_consensus.cc:3060] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:14.705677 14181 raft_consensus.cc:2468] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 6.
I20260709 12:11:14.649914 17692 raft_consensus.cc:2749] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957) with higher term. Message: Invalid argument: T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db for earlier term 10. Current term is 11.
W20260709 12:11:14.710315 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 95571.4us
I20260709 12:11:14.707616 14304 leader_election.cc:304] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:11:14.711932 14182 raft_consensus.cc:2468] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 11.
I20260709 12:11:14.715183 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:14.716380 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:14.712507 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:14.712174 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:14.719861 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:14.720191 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:14.720561 14187 raft_consensus.cc:2468] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 10.
I20260709 12:11:14.718374 14184 raft_consensus.cc:2468] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 6.
I20260709 12:11:14.725049 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:14.723582 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:14.727645 14264 raft_consensus.cc:1240] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:14.691372 17848 raft_consensus.cc:2804] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:14.728981 14186 raft_consensus.cc:2468] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 11.
I20260709 12:11:14.732548 17894 raft_consensus.cc:2804] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:14.733106 17894 raft_consensus.cc:697] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 11 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:14.649076 17836 consensus_queue.cc:1059] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.064s
I20260709 12:11:14.734057 17894 consensus_queue.cc:237] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:14.735193 17946 raft_consensus.cc:2804] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:14.735633 17946 raft_consensus.cc:493] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:14.735987 17946 raft_consensus.cc:3060] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:14.656935 17996 consensus_queue.cc:1048] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.069s
I20260709 12:11:14.724009 17983 raft_consensus.cc:493] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:14.738121 17983 raft_consensus.cc:3060] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:14.741683 18134 consensus_queue.cc:1059] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 12:11:14.714183 17987 leader_election.cc:290] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:14.742712 18134 raft_consensus.cc:3055] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:11:14.743089 18122 log.cc:927] Time spent T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.426s	user 0.003s	sys 0.000s
I20260709 12:11:14.745071 18138 consensus_queue.cc:1048] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:14.747185 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:14.715857 14185 raft_consensus.cc:2468] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 13.
I20260709 12:11:14.701838 17809 raft_consensus.cc:493] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:14.757943 14181 raft_consensus.cc:1275] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:11:14.743112 18134 raft_consensus.cc:740] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:14.711848 18093 raft_consensus.cc:2749] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:14.713188 17957 raft_consensus.cc:2749] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:14.720710 18071 raft_consensus.cc:2804] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:11:14.774843 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 44643us
I20260709 12:11:14.780866 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:14.787729 14264 raft_consensus.cc:2468] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 6.
I20260709 12:11:14.729808 18054 raft_consensus.cc:2804] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:14.794236 14230 leader_election.cc:304] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:14.750633 17848 raft_consensus.cc:493] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:11:14.797183 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:14.797474 14265 raft_consensus.cc:2468] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 11.
I20260709 12:11:14.813026 14256 raft_consensus.cc:2368] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db for earlier term 10. Current term is 11.
I20260709 12:11:14.786572 18071 raft_consensus.cc:493] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:14.816372 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 140545us
W20260709 12:11:14.826421 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 148660us
I20260709 12:11:14.828742 17953 raft_consensus.cc:2749] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:14.829457 17767 leader_election.cc:290] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:14.831297 17953 consensus_queue.cc:1048] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:14.833252 17953 consensus_queue.cc:1048] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:14.813390 17848 raft_consensus.cc:3060] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:14.752637 17503 raft_consensus.cc:515] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:14.792074 18054 raft_consensus.cc:493] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:14.847834 14183 raft_consensus.cc:1275] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:11:14.826725 18071 raft_consensus.cc:3060] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:14.790658 17809 raft_consensus.cc:515] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:14.875197 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:14.876806 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:14.879146 18095 consensus_queue.cc:1048] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:14.873526 14303 leader_election.cc:304] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:14.873811 14876 leader_election.cc:304] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:14.851065 18054 raft_consensus.cc:3060] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:14.862421 18120 raft_consensus.cc:2749] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:14.899494 17503 leader_election.cc:290] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 10 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:14.901443 17997 leader_election.cc:290] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:11:14.902359 18139 log.cc:927] Time spent T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.150s	user 0.001s	sys 0.000s
I20260709 12:11:14.871057 18140 raft_consensus.cc:2749] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:14.906091 18000 raft_consensus.cc:2749] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:11:14.885372 14303 leader_election.cc:304] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
W20260709 12:11:14.910030 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 202445us
I20260709 12:11:14.936131 14304 leader_election.cc:304] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
W20260709 12:11:14.938220 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 152481us
W20260709 12:11:14.941459 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 56187.4us
W20260709 12:11:14.913843 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 84721us
I20260709 12:11:14.921960 17996 consensus_queue.cc:1048] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:14.924515 17809 leader_election.cc:290] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:14.942718 14155 leader_election.cc:304] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:14.957396 14187 raft_consensus.cc:1275] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 8. (term mismatch)
I20260709 12:11:14.958065 14187 pending_rounds.cc:85] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf: Aborting all ops after (but not including) 7
I20260709 12:11:14.931020 17840 raft_consensus.cc:2804] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:11:14.967900 14156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:14.960521 18094 raft_consensus.cc:2749] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:14.970084 14904 raft_consensus.cc:1275] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:11:14.971894 18152 consensus_queue.cc:1048] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:11:14.972784 18162 raft_consensus.cc:2764] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:11:14.961678 14187 pending_rounds.cc:107] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf: Aborting uncommitted NO_OP operation due to leader change: 5.8
I20260709 12:11:14.980062 14187 raft_consensus.cc:2889] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:11:14.986446 14228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:14.990761 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 47952.7us
I20260709 12:11:14.996505 14303 leader_election.cc:304] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:11:15.000697 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:15.001534 14263 raft_consensus.cc:3060] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:15.002547 14265 raft_consensus.cc:3055] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:15.003012 14265 raft_consensus.cc:740] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:11:14.966269 17840 raft_consensus.cc:493] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:14.969064 17957 raft_consensus.cc:2804] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:15.012531 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:15.013368 14336 raft_consensus.cc:3060] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:15.006536 17840 raft_consensus.cc:3060] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:15.018992 14335 raft_consensus.cc:1275] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:11:15.024518 18143 consensus_queue.cc:1048] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 12:11:15.026620 18153 raft_consensus.cc:2749] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:15.032481 14256 raft_consensus.cc:3055] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:15.032977 14256 raft_consensus.cc:740] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:11:15.033998 14256 consensus_queue.cc:260] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:15.007663 17957 raft_consensus.cc:493] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:15.046994 17957 raft_consensus.cc:3060] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:15.052274 17848 raft_consensus.cc:515] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:15.021224 14265 consensus_queue.cc:260] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:15.017241 17894 raft_consensus.cc:2804] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:15.054512 17894 raft_consensus.cc:697] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 7 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:15.055526 17894 consensus_queue.cc:237] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:15.055909 18134 consensus_queue.cc:260] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:15.057178 18134 raft_consensus.cc:3060] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:11:15.060025 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 117377us
W20260709 12:11:15.064038 14154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:15.063824 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 71837.5us
I20260709 12:11:15.064921 14260 raft_consensus.cc:1240] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:15.087468 14336 raft_consensus.cc:2468] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 10.
I20260709 12:11:15.037350 17983 raft_consensus.cc:515] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:15.041484 18092 raft_consensus.cc:515] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } }
I20260709 12:11:15.102479 14229 leader_election.cc:304] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
W20260709 12:11:15.088554 18165 log.cc:927] Time spent T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.052s	user 0.001s	sys 0.001s
I20260709 12:11:15.106179 14303 leader_election.cc:304] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
W20260709 12:11:15.124601 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 126008us
I20260709 12:11:15.126750 14877 leader_election.cc:400] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 10 election: Vote denied by peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673) with higher term. Message: Invalid argument: T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db for earlier term 10. Current term is 11.
W20260709 12:11:15.127233 14154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:15.134479 14265 raft_consensus.cc:3060] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:15.069005 18071 raft_consensus.cc:515] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:15.152315 14229 leader_election.cc:304] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
W20260709 12:11:15.133550 18136 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.009s	sys 0.021s
I20260709 12:11:15.155081 17838 consensus_queue.cc:1059] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.011s
I20260709 12:11:15.167840 18014 raft_consensus.cc:3055] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:15.170938 18092 leader_election.cc:290] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 9 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:15.172241 18161 consensus_queue.cc:1048] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.049s
I20260709 12:11:15.179080 18151 raft_consensus.cc:493] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:11:15.181552 18159 raft_consensus.cc:2749] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:15.181833 18157 raft_consensus.cc:2804] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:15.182585 18140 raft_consensus.cc:493] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
W20260709 12:11:15.178544 18136 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.587s	user 0.009s	sys 0.021s
W20260709 12:11:15.188642 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 82953.5us
I20260709 12:11:15.189050 14229 leader_election.cc:304] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:15.128432 17946 raft_consensus.cc:515] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:15.178357 18000 raft_consensus.cc:2804] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:11:15.203464 14228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:15.179370 18014 raft_consensus.cc:740] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
W20260709 12:11:15.204845 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 75613.1us
I20260709 12:11:15.209933 14303 leader_election.cc:304] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
W20260709 12:11:15.207540 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 132054us
I20260709 12:11:15.217185 14265 raft_consensus.cc:1275] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
I20260709 12:11:15.217639 14265 pending_rounds.cc:85] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec: Aborting all ops after (but not including) 9
I20260709 12:11:15.217945 14265 pending_rounds.cc:107] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 12:11:15.218245 14265 raft_consensus.cc:2889] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:15.207340 18000 raft_consensus.cc:493] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:15.223752 18000 raft_consensus.cc:3060] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:15.194686 18157 raft_consensus.cc:493] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:15.235406 18157 raft_consensus.cc:3060] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:15.239207 18094 raft_consensus.cc:2804] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:15.215816 14303 leader_election.cc:304] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:15.247609 14303 leader_election.cc:304] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:15.239775 18172 consensus_queue.cc:1048] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:15.242220 17894 raft_consensus.cc:2804] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:15.259034 14303 leader_election.cc:304] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:15.266292 14263 raft_consensus.cc:2468] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 10.
I20260709 12:11:15.201835 17848 leader_election.cc:290] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:15.265301 14155 leader_election.cc:304] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
W20260709 12:11:15.270063 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 53165.6us
W20260709 12:11:15.271577 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 82588.7us
I20260709 12:11:15.262322 17894 raft_consensus.cc:493] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:15.272787 14229 leader_election.cc:304] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:15.271642 18094 raft_consensus.cc:697] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 8 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:11:15.200384 18151 raft_consensus.cc:515] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:15.288748 14155 leader_election.cc:304] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:15.273718 17894 raft_consensus.cc:3060] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:15.277469 18092 raft_consensus.cc:2804] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:15.293670 14229 leader_election.cc:304] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:15.295482 14229 leader_election.cc:304] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:15.215523 18140 raft_consensus.cc:515] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:15.298770 17946 leader_election.cc:290] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:15.301016 18140 leader_election.cc:290] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:15.302320 18071 leader_election.cc:290] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 10 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:15.307863 18014 consensus_queue.cc:260] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:15.309314 18014 raft_consensus.cc:3060] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:15.310830 18054 raft_consensus.cc:515] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:15.293246 18092 raft_consensus.cc:493] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:15.314440 18092 raft_consensus.cc:3060] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:15.315267 18151 leader_election.cc:290] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:15.316223 18094 consensus_queue.cc:237] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:15.321120 18120 raft_consensus.cc:2804] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:15.321676 18120 raft_consensus.cc:493] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:11:15.322088 18120 raft_consensus.cc:3060] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:11:15.329560 18169 log.cc:927] Time spent T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.156s	user 0.010s	sys 0.000s
I20260709 12:11:15.330143 17859 raft_consensus.cc:2764] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Leader election decision vote started in defunct term 9: won
I20260709 12:11:15.323859 14904 raft_consensus.cc:1240] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 11 LEADER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 10. Current term is 11. Ops: []
W20260709 12:11:15.333936 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 45344.5us
I20260709 12:11:15.337917 18177 raft_consensus.cc:2749] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:11:15.334298 18167 log.cc:927] Time spent T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.127s	user 0.002s	sys 0.000s
I20260709 12:11:15.338725 18177 raft_consensus.cc:2804] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:15.338899 14155 leader_election.cc:304] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:15.339020 18155 consensus_queue.cc:1059] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:15.340006 18158 raft_consensus.cc:2749] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:15.340467 18172 raft_consensus.cc:3055] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:15.340641 14155 leader_election.cc:304] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:15.341056 18172 raft_consensus.cc:740] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:15.330065 18093 raft_consensus.cc:2749] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:15.341868 18168 raft_consensus.cc:2804] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:15.342016 18172 consensus_queue.cc:260] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:15.342810 18168 raft_consensus.cc:697] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 13 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:11:15.343787 18168 consensus_queue.cc:237] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:15.328629 17957 raft_consensus.cc:515] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:15.339167 18151 consensus_queue.cc:1048] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 12:11:15.347745 17957 leader_election.cc:290] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 10 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:15.350474 17840 raft_consensus.cc:515] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:15.352942 17840 leader_election.cc:290] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 7 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:15.358435 14256 raft_consensus.cc:3060] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:15.342265 17848 raft_consensus.cc:2749] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:11:15.365036 17983 leader_election.cc:290] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 11 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:15.335168 18089 raft_consensus.cc:493] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:15.332846 14877 leader_election.cc:304] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:11:15.367058 18089 raft_consensus.cc:515] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:15.331962 18138 consensus_queue.cc:1059] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 12:11:15.369993 17996 raft_consensus.cc:2804] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:15.370581 18138 raft_consensus.cc:3055] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:15.371061 18138 raft_consensus.cc:740] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:11:15.341951 18177 raft_consensus.cc:493] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:15.371783 18177 raft_consensus.cc:3060] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:15.372087 18138 consensus_queue.cc:260] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:15.378191 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:15.378922 14338 raft_consensus.cc:2468] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 11.
I20260709 12:11:15.379359 14265 raft_consensus.cc:1275] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:11:15.378867 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:15.380173 14260 raft_consensus.cc:3060] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:11:15.380443 18175 log.cc:927] Time spent T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 12:11:15.388648 17848 consensus_queue.cc:1059] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:15.389542 17848 consensus_queue.cc:1243] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer 73d01e9b1a9d49358da4985b21d681db log is divergent from this leader: its last log entry 11.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:11:15.390084 17848 raft_consensus.cc:3055] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:15.390414 17848 raft_consensus.cc:740] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:11:15.334821 14229 leader_election.cc:304] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:15.396368 14260 raft_consensus.cc:2468] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 7.
I20260709 12:11:15.313149 18157 raft_consensus.cc:515] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:15.373565 18138 raft_consensus.cc:3060] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:15.403095 17848 consensus_queue.cc:260] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:15.405964 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:15.423219 14190 raft_consensus.cc:3060] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:15.406812 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:11:15.407791 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 67261.2us
I20260709 12:11:15.331426 17946 raft_consensus.cc:2749] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:11:15.409770 14228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:15.313088 18054 leader_election.cc:290] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 10 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:11:15.429561 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 158372us
W20260709 12:11:15.463037 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 128301us
I20260709 12:11:15.464855 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:15.428082 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:15.370630 17996 raft_consensus.cc:697] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 10 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:11:15.476234 14188 raft_consensus.cc:1275] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:11:15.428035 14182 raft_consensus.cc:2468] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 7.
I20260709 12:11:15.426430 17809 raft_consensus.cc:2749] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:15.470695 14304 leader_election.cc:304] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:15.473798 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:15.401103 14256 raft_consensus.cc:1275] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 12:11:15.478873 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 51951us
W20260709 12:11:15.478754 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 60153.5us
I20260709 12:11:15.482992 14181 raft_consensus.cc:2468] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 11.
I20260709 12:11:15.420272 17503 raft_consensus.cc:493] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:15.478606 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
W20260709 12:11:15.487622 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 59632.3us
I20260709 12:11:15.488476 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:15.489635 14181 raft_consensus.cc:2410] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for term 10 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:11:15.490187 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:11:15.490669 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:15.490420 14190 raft_consensus.cc:2468] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 7.
I20260709 12:11:15.484913 14304 leader_election.cc:304] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:11:15.494550 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:15.495256 14182 raft_consensus.cc:3060] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:15.497933 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:15.498075 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:15.500635 14230 leader_election.cc:304] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
W20260709 12:11:15.505410 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 246462us
I20260709 12:11:15.478143 17848 raft_consensus.cc:3060] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:15.508203 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:15.476495 18170 raft_consensus.cc:493] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:15.487370 17953 raft_consensus.cc:493] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:15.510416 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:15.508797 14181 raft_consensus.cc:3060] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:15.507113 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:15.511118 14260 raft_consensus.cc:2468] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 11.
I20260709 12:11:15.510986 14261 raft_consensus.cc:1275] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:11:15.516292 14155 leader_election.cc:304] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:15.487003 18054 raft_consensus.cc:2749] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:15.507865 14303 leader_election.cc:304] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:15.509871 17856 consensus_queue.cc:1048] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 12:11:15.523168 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:15.524519 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:15.525189 14263 raft_consensus.cc:2468] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 13.
W20260709 12:11:15.525873 14302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:15.526074 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:15.526512 14259 raft_consensus.cc:1275] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 12:11:15.526824 14256 raft_consensus.cc:2393] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 10: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:11:15.527019 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:15.527619 14265 raft_consensus.cc:2468] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 10.
I20260709 12:11:15.528258 18092 raft_consensus.cc:515] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:15.529138 17981 raft_consensus.cc:2804] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:15.529584 17981 raft_consensus.cc:493] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:15.529932 17981 raft_consensus.cc:3060] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:15.530439 18092 leader_election.cc:290] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:15.495785 17503 raft_consensus.cc:515] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:15.537247 17503 leader_election.cc:290] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:15.518361 14258 raft_consensus.cc:1240] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:15.527540 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:15.540693 14259 raft_consensus.cc:3060] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:15.543205 14304 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:15.522203 14303 leader_election.cc:304] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:15.475742 18000 raft_consensus.cc:515] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:15.547966 14303 leader_election.cc:304] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:15.498075 18089 leader_election.cc:290] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:15.478427 17692 consensus_queue.cc:1048] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 12:11:15.559136 14911 raft_consensus.cc:1275] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:11:15.505056 18180 raft_consensus.cc:2804] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:15.575310 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:15.562585 14188 raft_consensus.cc:1240] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 12:11:15.504966 17997 raft_consensus.cc:2749] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:15.568444 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:15.582178 14303 leader_election.cc:304] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:15.582887 14330 raft_consensus.cc:2410] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for term 12 because replica has last-logged OpId of term: 9 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 3.
I20260709 12:11:15.569181 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:15.583492 14303 leader_election.cc:304] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:15.584029 14332 raft_consensus.cc:2393] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 10: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
I20260709 12:11:15.582129 14905 raft_consensus.cc:1275] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:11:15.572301 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
W20260709 12:11:15.573355 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 72841.3us
I20260709 12:11:15.523085 18171 raft_consensus.cc:493] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:15.567749 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:15.579499 14257 raft_consensus.cc:1240] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 8 LEADER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:11:15.579896 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:11:15.588186 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:15.595467 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:11:15.595721 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 81074.7us
I20260709 12:11:15.596423 14338 raft_consensus.cc:2410] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:11:15.597149 14155 leader_election.cc:304] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:15.594971 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:15.598784 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:15.599457 14260 raft_consensus.cc:3060] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:15.588873 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:15.560314 18143 raft_consensus.cc:493] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:15.601483 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:15.603740 14337 raft_consensus.cc:2410] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for term 10 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:11:15.594910 14336 raft_consensus.cc:2393] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 10: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:11:15.606096 14182 raft_consensus.cc:2468] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 9.
I20260709 12:11:15.574535 18180 raft_consensus.cc:493] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:15.869840 18092 raft_consensus.cc:2749] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:15.870016 18180 raft_consensus.cc:3060] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:15.871302 14189 raft_consensus.cc:1240] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:15.869917 17997 raft_consensus.cc:493] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:15.872812 17997 raft_consensus.cc:515] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:15.872424 17809 raft_consensus.cc:493] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:15.607165 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:15.538990 17953 raft_consensus.cc:515] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:11:15.668581 14878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:15.847427 18120 consensus_meta.cc:287] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.525s	user 0.015s	sys 0.002s
I20260709 12:11:15.658746 18088 raft_consensus.cc:493] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:15.602921 18094 consensus_queue.cc:1059] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.074s
W20260709 12:11:15.699363 18182 log.cc:927] Time spent T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 12:11:15.602963 18171 raft_consensus.cc:515] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:11:15.713056 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 218318us
W20260709 12:11:15.782552 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 198925us
W20260709 12:11:15.808620 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 202288us
I20260709 12:11:15.575210 18054 raft_consensus.cc:2804] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:15.813148 17946 raft_consensus.cc:2804] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:11:15.813441 18014 consensus_meta.cc:287] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db: Time spent flushing consensus metadata: real 0.504s	user 0.008s	sys 0.007s
I20260709 12:11:15.571183 18185 raft_consensus.cc:2804] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:15.889817 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:15.602397 18178 raft_consensus.cc:493] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:15.891008 14182 raft_consensus.cc:3060] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:15.606410 14332 raft_consensus.cc:1240] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 12:11:15.583338 17996 consensus_queue.cc:237] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:15.839489 14260 raft_consensus.cc:2468] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 10.
I20260709 12:11:15.841509 14259 raft_consensus.cc:2468] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 10.
I20260709 12:11:15.893980 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:15.894568 14260 raft_consensus.cc:3060] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:15.849375 14190 raft_consensus.cc:1240] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 6. Current term is 7. Ops: [4.3-6.4]
I20260709 12:11:15.848536 18196 raft_consensus.cc:2749] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:15.855167 18157 leader_election.cc:290] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 9 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:11:15.855904 14229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:15.879993 18134 raft_consensus.cc:493] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:15.849851 14331 raft_consensus.cc:1275] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 8 index: 3. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
I20260709 12:11:15.810321 14912 raft_consensus.cc:1275] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:11:15.860530 14181 raft_consensus.cc:2468] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 12.
W20260709 12:11:15.846865 17894 consensus_meta.cc:287] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.532s	user 0.021s	sys 0.000s
I20260709 12:11:15.873881 17809 raft_consensus.cc:515] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:15.540678 18170 raft_consensus.cc:515] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:15.891367 18094 consensus_queue.cc:1243] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer 65c9c1653b3346b39a0e118540e6080c log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:11:15.886463 14264 raft_consensus.cc:2468] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 6.
I20260709 12:11:15.938311 14260 raft_consensus.cc:2468] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 10.
I20260709 12:11:15.840478 18143 raft_consensus.cc:515] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:15.575845 17957 consensus_queue.cc:1048] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.084s
I20260709 12:11:15.891017 14189 raft_consensus.cc:1240] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:15.894465 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:15.855011 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:15.951895 14257 raft_consensus.cc:2410] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 12:11:15.896087 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:15.896108 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:15.900452 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
W20260709 12:11:15.874290 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 277228us
I20260709 12:11:15.943089 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:15.905323 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:15.908699 14904 raft_consensus.cc:1240] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 10 LEADER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:15.886961 18054 raft_consensus.cc:493] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:15.960069 14259 raft_consensus.cc:2410] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:11:15.916142 14182 raft_consensus.cc:2468] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 9.
I20260709 12:11:15.885092 14877 leader_election.cc:304] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
W20260709 12:11:15.929363 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:15.931872 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:15.890363 18185 raft_consensus.cc:493] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:15.879195 18120 raft_consensus.cc:515] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:15.902690 18168 raft_consensus.cc:493] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:15.943444 14184 raft_consensus.cc:1240] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:15.880344 18088 raft_consensus.cc:515] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:15.955032 14335 raft_consensus.cc:1275] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 12:11:15.955610 14230 leader_election.cc:304] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:15.952755 14332 raft_consensus.cc:2468] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 8.
I20260709 12:11:15.969713 14335 pending_rounds.cc:85] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c: Aborting all ops after (but not including) 4
I20260709 12:11:15.970052 14335 pending_rounds.cc:107] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 12:11:15.968155 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:15.972261 14186 raft_consensus.cc:3060] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:15.962944 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:15.975008 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:11:15.963092 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 78071us
I20260709 12:11:15.965840 14339 raft_consensus.cc:2393] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 12: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:11:15.977316 18089 consensus_queue.cc:1048] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:15.979741 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:15.980408 14260 raft_consensus.cc:2468] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 8.
W20260709 12:11:15.980914 18177 consensus_meta.cc:287] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.609s	user 0.006s	sys 0.013s
I20260709 12:11:15.981431 18177 raft_consensus.cc:515] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:15.968853 18014 raft_consensus.cc:2804] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:15.982373 18014 raft_consensus.cc:697] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 7 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:11:15.983316 18014 consensus_queue.cc:237] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:15.983858 18177 leader_election.cc:290] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 12 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:15.990273 18177 consensus_queue.cc:1048] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:15.907092 18178 raft_consensus.cc:515] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:15.992563 14186 raft_consensus.cc:2468] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 10.
I20260709 12:11:15.994961 17957 raft_consensus.cc:493] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:15.995507 17957 raft_consensus.cc:515] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:15.970269 14335 raft_consensus.cc:2889] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:16.017477 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:15.940582 18094 raft_consensus.cc:493] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:16.019057 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:16.020337 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:16.024466 14260 raft_consensus.cc:2468] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 10.
I20260709 12:11:16.028296 14336 raft_consensus.cc:1240] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:15.967025 18054 raft_consensus.cc:3060] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:15.970638 18185 raft_consensus.cc:3060] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:15.917953 17894 raft_consensus.cc:515] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } }
I20260709 12:11:16.024677 18178 leader_election.cc:290] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:16.001513 18157 raft_consensus.cc:2749] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:16.044965 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:15.971199 18000 leader_election.cc:290] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 12 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:15.997690 17997 leader_election.cc:290] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:15.998992 18170 leader_election.cc:290] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:16.000278 17809 leader_election.cc:290] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:11:16.051828 14302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:16.021622 18186 raft_consensus.cc:2749] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:16.095805 14155 leader_election.cc:304] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:15.918180 18134 raft_consensus.cc:515] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:16.053514 14910 raft_consensus.cc:2468] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 12.
I20260709 12:11:16.106995 14337 raft_consensus.cc:1240] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 8. Current term is 9. Ops: [8.7-8.7]
W20260709 12:11:16.110306 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 59755.6us
I20260709 12:11:16.111150 14877 leader_election.cc:304] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 885067a0d31741bfb5c9935788e315bf
W20260709 12:11:16.107687 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 138003us
I20260709 12:11:16.001868 18168 raft_consensus.cc:515] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:16.145126 18168 leader_election.cc:290] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:16.145728 18168 raft_consensus.cc:493] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:16.146255 18168 raft_consensus.cc:515] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:16.148321 18170 raft_consensus.cc:2804] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:16.148602 18172 raft_consensus.cc:3060] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:16.149273 18171 leader_election.cc:290] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:16.033478 18094 raft_consensus.cc:515] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:11:16.122577 18198 log.cc:927] Time spent T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.180s	user 0.000s	sys 0.000s
I20260709 12:11:16.137035 18092 raft_consensus.cc:2804] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:16.160989 14339 raft_consensus.cc:2468] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 8.
I20260709 12:11:16.055751 17953 leader_election.cc:290] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:11:16.159768 17981 consensus_meta.cc:287] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.627s	user 0.013s	sys 0.004s
I20260709 12:11:16.153668 18138 raft_consensus.cc:3055] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:16.154666 18120 leader_election.cc:290] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 8 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:11:16.165783 17848 consensus_meta.cc:287] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.642s	user 0.009s	sys 0.007s
I20260709 12:11:16.122287 18143 leader_election.cc:290] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:16.172772 18092 raft_consensus.cc:493] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:16.159662 18170 raft_consensus.cc:493] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:11:16.160351 17946 raft_consensus.cc:697] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 11 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:11:16.162936 18088 leader_election.cc:290] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:11:16.185148 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 299442us
I20260709 12:11:16.194945 14229 leader_election.cc:304] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:16.160601 17997 consensus_queue.cc:1059] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 12:11:16.183073 18138 raft_consensus.cc:740] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:11:16.209354 14229 leader_election.cc:304] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:16.191910 17957 leader_election.cc:290] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:16.184940 17953 consensus_queue.cc:1048] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.024s
I20260709 12:11:16.206600 18170 raft_consensus.cc:3060] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:16.182899 17981 raft_consensus.cc:515] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:16.199545 18092 raft_consensus.cc:3060] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:16.237073 18138 consensus_queue.cc:260] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:16.238154 14304 leader_election.cc:304] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:11:16.212025 18143 raft_consensus.cc:493] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:16.247370 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:11:16.249706 17946 consensus_queue.cc:237] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:16.250573 18183 consensus_queue.cc:1048] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:16.251617 17894 leader_election.cc:290] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 9 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:11:16.266149 14228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:16.273664 14304 leader_election.cc:304] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:11:16.282879 14304 leader_election.cc:304] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:11:16.283924 14304 leader_election.cc:304] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:16.198890 18180 raft_consensus.cc:515] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:16.260548 17953 raft_consensus.cc:2749] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:11:16.299403 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 185379us
I20260709 12:11:16.228734 18120 consensus_queue.cc:1059] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.052s
W20260709 12:11:16.303128 14230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:16.304234 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:16.304931 14261 raft_consensus.cc:3060] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:16.304958 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 209260us
I20260709 12:11:16.306895 14155 leader_election.cc:304] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:16.308137 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:16.308591 17848 raft_consensus.cc:2804] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:16.309036 17848 raft_consensus.cc:493] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:16.309425 17848 raft_consensus.cc:3060] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:16.308166 14155 leader_election.cc:304] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:16.311968 14230 leader_election.cc:304] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:16.312548 14265 raft_consensus.cc:1275] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:11:16.313954 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:16.314186 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:16.315834 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:16.316555 14259 raft_consensus.cc:2468] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 10.
I20260709 12:11:16.282464 17957 raft_consensus.cc:2804] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:16.252391 18155 consensus_queue.cc:1048] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.065s
I20260709 12:11:16.310699 18205 raft_consensus.cc:2749] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:16.299988 18177 raft_consensus.cc:2749] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:16.300285 18186 raft_consensus.cc:2804] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:16.242393 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:16.300659 18179 raft_consensus.cc:2804] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:16.370222 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:16.371582 14264 raft_consensus.cc:1240] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 8. Current term is 9. Ops: []
W20260709 12:11:16.375867 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 67784.5us
I20260709 12:11:16.376097 17953 raft_consensus.cc:493] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:16.355386 14261 raft_consensus.cc:2468] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 12.
I20260709 12:11:16.374629 17997 raft_consensus.cc:2804] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:16.350378 18168 leader_election.cc:290] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:16.351166 17996 raft_consensus.cc:493] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:16.395412 18094 leader_election.cc:290] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:16.353850 18203 raft_consensus.cc:3055] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:16.373188 17894 raft_consensus.cc:3055] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:11:16.398164 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 512862us
I20260709 12:11:16.272207 18200 consensus_queue.cc:1048] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.142s
I20260709 12:11:16.407655 14903 raft_consensus.cc:2468] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 12.
I20260709 12:11:16.409668 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:16.286523 18143 raft_consensus.cc:515] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:16.353260 18138 raft_consensus.cc:3060] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:16.452932 18203 raft_consensus.cc:740] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:11:16.454866 17996 raft_consensus.cc:515] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:11:16.415588 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 206303us
I20260709 12:11:16.319319 14337 raft_consensus.cc:2393] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 7: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
W20260709 12:11:16.419448 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 307984us
I20260709 12:11:16.439800 17997 raft_consensus.cc:493] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
W20260709 12:11:16.421578 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 109661us
I20260709 12:11:16.448522 17953 raft_consensus.cc:515] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:16.477856 14229 leader_election.cc:304] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:16.515451 14229 leader_election.cc:304] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
W20260709 12:11:16.516685 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 51171.1us
I20260709 12:11:16.475356 14304 leader_election.cc:304] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:11:16.513345 14155 leader_election.cc:304] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:16.516799 14229 leader_election.cc:304] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:16.466154 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:16.507391 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:16.522951 14264 raft_consensus.cc:2468] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 8.
I20260709 12:11:16.523062 14903 raft_consensus.cc:2468] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 14.
I20260709 12:11:16.500695 14185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56652 (request call id 920) took 1096 ms. Trace:
I20260709 12:11:16.532266 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:16.533291 14182 raft_consensus.cc:3060] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:16.466357 14084 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44116 (request call id 158) took 18221 ms (client timeout 15000 ms). Trace:
I20260709 12:11:16.535192 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:16.536056 14190 raft_consensus.cc:2393] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 10: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:11:16.537094 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:16.467686 18143 leader_election.cc:290] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:16.475858 18196 raft_consensus.cc:493] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:16.538419 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:16.472420 18178 consensus_queue.cc:1048] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.067s
I20260709 12:11:16.538470 18196 raft_consensus.cc:515] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:16.540485 18218 raft_consensus.cc:2749] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:16.476846 18179 raft_consensus.cc:697] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 10 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:16.504463 18134 leader_election.cc:290] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:16.535394 18201 raft_consensus.cc:493] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:16.541450 18196 leader_election.cc:290] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:16.542394 18201 raft_consensus.cc:515] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:16.542518 18179 consensus_queue.cc:237] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:16.544790 18201 leader_election.cc:290] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:16.478250 17997 raft_consensus.cc:3060] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:16.478454 18170 raft_consensus.cc:515] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:16.548131 18170 leader_election.cc:290] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 12 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:16.469951 18180 leader_election.cc:290] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 12 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:16.496129 17953 leader_election.cc:290] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:16.473961 17957 raft_consensus.cc:697] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 10 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:16.550872 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:16.551972 17957 consensus_queue.cc:237] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:16.474879 18203 consensus_queue.cc:260] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:16.478072 18186 raft_consensus.cc:697] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 10 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:16.535542 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:16.482427 18185 raft_consensus.cc:515] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:16.477156 17996 leader_election.cc:290] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:16.552827 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
W20260709 12:11:16.574946 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 55175.8us
I20260709 12:11:16.575032 14190 raft_consensus.cc:2393] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 9: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:11:16.465649 17894 raft_consensus.cc:740] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:16.473868 18213 raft_consensus.cc:2804] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:16.479422 18094 consensus_queue.cc:1048] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.077s
I20260709 12:11:16.541390 18218 raft_consensus.cc:2749] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:16.488669 18153 raft_consensus.cc:493] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:16.526819 14185 rpcz_store.cc:276] 0709 12:11:15.404519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:15.409747 (+  5228us) service_pool.cc:224] Handling call
0709 12:11:15.425542 (+ 15795us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:16.190606 (+765064us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:11:16.190638 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:16.190680 (+    42us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:16.190732 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:16.500335 (+309603us) spinlock_profiling.cc:243] Waited 765 ms on lock 0x7b540035b454. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:11:16.500394 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:16.500588 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":18333,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":12494,"spinlock_wait_cycles":1758676352}
I20260709 12:11:16.550832 17953 raft_consensus.cc:2749] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:16.591955 14188 raft_consensus.cc:2468] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 10.
I20260709 12:11:16.523622 18200 raft_consensus.cc:2804] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:11:16.598070 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 80340us
I20260709 12:11:16.595381 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:16.612816 14190 raft_consensus.cc:3060] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:16.613164 14188 raft_consensus.cc:1275] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
W20260709 12:11:16.584177 18202 log.cc:927] Time spent T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.180s	user 0.001s	sys 0.000s
I20260709 12:11:16.490532 17809 consensus_queue.cc:1059] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.106s
I20260709 12:11:16.616672 14877 leader_election.cc:304] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:16.618978 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:16.619798 14189 raft_consensus.cc:2468] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 7.
I20260709 12:11:16.623237 18000 consensus_queue.cc:1059] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:16.623584 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:16.624258 14339 raft_consensus.cc:2468] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 12.
I20260709 12:11:16.624372 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:16.624583 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:16.502534 18209 consensus_queue.cc:1059] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.098s
I20260709 12:11:16.626870 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:16.627887 14182 raft_consensus.cc:2468] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 12.
W20260709 12:11:16.534899 14084 rpcz_store.cc:269] 0709 12:10:58.245314 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:58.269561 (+ 24247us) service_pool.cc:224] Handling call
0709 12:11:16.466189 (+18196628us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:11:13.836665 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:11:13.837314 (+   649us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:11:13.837368 (+    54us) write_op.cc:435] Acquired schema lock
0709 12:11:13.837407 (+    39us) tablet.cc:662] Decoding operations
0709 12:11:13.903883 (+ 66476us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:11:13.910440 (+  6557us) write_op.cc:641] Partition lock acquired for write op
0709 12:11:13.910476 (+    36us) tablet.cc:685] Acquiring locks for 14 operations
0709 12:11:13.912772 (+  2296us) tablet.cc:701] Row locks acquired
0709 12:11:13.912825 (+    53us) write_op.cc:260] PREPARE: finished
0709 12:11:13.913125 (+   300us) write_op.cc:270] Start()
0709 12:11:13.913294 (+   169us) write_op.cc:276] Timestamp: P: 1783599073912979 usec, L: 0
0709 12:11:13.913348 (+    54us) op_driver.cc:348] REPLICATION: starting
0709 12:11:13.963365 (+ 50017us) log.cc:844] Serialized 5584 byte log entry
0709 12:11:14.870931 (+907566us) op_driver.cc:464] REPLICATION: finished
0709 12:11:15.163116 (+292185us) write_op.cc:301] APPLY: starting
0709 12:11:15.163231 (+   115us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:15.164298 (+  1067us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:15.164424 (+   126us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:15.165550 (+  1126us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:15.213053 (+ 47503us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=28
0709 12:11:15.223372 (+ 10319us) write_op.cc:312] APPLY: finished
0709 12:11:15.223823 (+   451us) log.cc:844] Serialized 101 byte log entry
0709 12:11:15.240679 (+ 16856us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:15.240974 (+   295us) write_op.cc:454] Released schema lock
0709 12:11:15.241090 (+   116us) write_op.cc:341] FINISH: Updating metrics
0709 12:11:15.241899 (+   809us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:15.241952 (+    53us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3795328,"reported_tablets":25,"child_traces":[["op",{"apply.queue_time_us":290774,"apply.run_cpu_time_us":8875,"apply.run_wall_time_us":78683,"num_ops":14,"prepare.queue_time_us":138203,"prepare.run_cpu_time_us":10541,"prepare.run_wall_time_us":140218,"raft.queue_time_us":417498,"raft.run_cpu_time_us":21169,"raft.run_wall_time_us":337164,"replication_time_us":901377,"thread_start_us":516187,"threads_started":4,"wal-append.queue_time_us":33311,"wal-append.run_cpu_time_us":14322,"wal-append.run_wall_time_us":2242187}]]}
I20260709 12:11:16.559775 18072 consensus_queue.cc:1048] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.073s
I20260709 12:11:16.596302 18213 raft_consensus.cc:493] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:16.634610 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 170042us
I20260709 12:11:16.600917 18160 raft_consensus.cc:2804] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:16.607578 17981 leader_election.cc:290] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 7 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:16.643141 14190 raft_consensus.cc:2468] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 7.
I20260709 12:11:16.692982 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:16.615574 18200 raft_consensus.cc:493] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:16.695628 14155 leader_election.cc:304] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
W20260709 12:11:16.699764 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 220122us
I20260709 12:11:16.702098 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:11:16.703408 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 72522.3us
I20260709 12:11:16.704173 14303 leader_election.cc:304] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:16.703733 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:16.705654 14338 raft_consensus.cc:3060] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:16.703300 18205 raft_consensus.cc:2804] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:16.607110 18014 consensus_queue.cc:1048] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.084s
I20260709 12:11:16.636205 17836 raft_consensus.cc:2804] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:16.636449 18072 consensus_queue.cc:1243] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer 17aab1bbf5014936aa18cc21818b26ec log is divergent from this leader: its last log entry 8.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:11:16.638777 18203 raft_consensus.cc:3060] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:16.710029 18205 raft_consensus.cc:493] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:16.717519 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:16.636912 18213 raft_consensus.cc:3060] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:16.718258 14187 raft_consensus.cc:2468] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 14.
I20260709 12:11:16.712430 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:16.714146 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:16.719229 14189 raft_consensus.cc:2468] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 8.
I20260709 12:11:16.611307 18153 raft_consensus.cc:515] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:11:16.710043 18217 log.cc:927] Time spent T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
W20260709 12:11:16.710109 18202 log.cc:927] Time spent T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
W20260709 12:11:16.720679 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 203966us
I20260709 12:11:16.705191 17953 raft_consensus.cc:3055] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:16.721019 14303 leader_election.cc:304] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:16.702549 18200 raft_consensus.cc:3060] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:16.638672 18160 raft_consensus.cc:493] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:16.726817 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:16.728628 14229 leader_election.cc:304] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:16.743139 18160 raft_consensus.cc:3060] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:16.714774 17836 raft_consensus.cc:493] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:16.730352 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
W20260709 12:11:16.721514 18206 log.cc:927] Time spent T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.202s	user 0.000s	sys 0.001s
W20260709 12:11:16.732620 18216 log.cc:927] Time spent T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.143s	user 0.000s	sys 0.000s
I20260709 12:11:16.717291 17981 raft_consensus.cc:3055] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:16.757256 17981 raft_consensus.cc:740] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:16.720335 18205 raft_consensus.cc:3060] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:16.757896 14183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56046 (request call id 2191) took 1261 ms. Trace:
I20260709 12:11:16.758301 14183 rpcz_store.cc:276] 0709 12:11:15.496365 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:15.503371 (+  7006us) service_pool.cc:224] Handling call
0709 12:11:15.519671 (+ 16300us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:15.579328 (+ 59657us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:11:15.874643 (+295315us) log.cc:844] Serialized 14 byte log entry
0709 12:11:16.164600 (+289957us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:16.185402 (+ 20802us) log.cc:844] Serialized 26 byte log entry
0709 12:11:16.185556 (+   154us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:16.185588 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:16.185656 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:16.757656 (+572000us) raft_consensus.cc:1685] finished
0709 12:11:16.757679 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:16.757832 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32000,"prepare.queue_time_us":234558,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":50,"raft.queue_time_us":69644,"raft.run_cpu_time_us":255,"raft.run_wall_time_us":18958,"thread_start_us":476581,"threads_started":2,"wal-append.queue_time_us":406231}
I20260709 12:11:16.760720 18185 leader_election.cc:290] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 11 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:11:16.752679 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 110976us
I20260709 12:11:16.763283 14155 leader_election.cc:304] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:16.765202 18168 consensus_queue.cc:1048] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:11:16.755180 17836 raft_consensus.cc:3060] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:16.730228 17953 raft_consensus.cc:740] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:11:16.767606 17953 consensus_queue.cc:260] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } }
I20260709 12:11:16.752784 18177 raft_consensus.cc:2749] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:16.769071 17953 raft_consensus.cc:3060] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:16.766384 14155 leader_election.cc:304] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:16.730444 18134 raft_consensus.cc:493] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:16.771274 18072 consensus_queue.cc:1048] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:16.771648 18134 raft_consensus.cc:515] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:16.772171 14155 leader_election.cc:304] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:16.774089 18134 leader_election.cc:290] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:16.775622 17997 raft_consensus.cc:515] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:11:16.776661 18172 consensus_meta.cc:287] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.628s	user 0.012s	sys 0.000s
I20260709 12:11:16.777477 14256 raft_consensus.cc:1275] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 12:11:16.779450 18054 consensus_meta.cc:287] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.733s	user 0.008s	sys 0.004s
I20260709 12:11:16.779884 18054 raft_consensus.cc:515] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:16.725579 17987 raft_consensus.cc:3060] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:16.783434 14154 leader_election.cc:304] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:16.756592 14303 leader_election.cc:304] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:16.639629 17894 consensus_queue.cc:260] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:16.797935 14303 leader_election.cc:304] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:16.764767 18214 raft_consensus.cc:2804] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:16.778474 18223 raft_consensus.cc:2749] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:11:16.795439 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 48024us
I20260709 12:11:16.804857 14876 leader_election.cc:304] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:16.805570 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:16.806404 14876 leader_election.cc:304] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:16.771618 18211 raft_consensus.cc:2804] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:16.808280 14155 leader_election.cc:304] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
W20260709 12:11:16.799105 18092 consensus_meta.cc:287] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.516s	user 0.005s	sys 0.005s
I20260709 12:11:16.805548 18185 raft_consensus.cc:2804] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:16.801761 18204 raft_consensus.cc:2804] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:16.812577 17840 raft_consensus.cc:2804] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:16.830160 18153 leader_election.cc:290] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:16.772208 17848 raft_consensus.cc:515] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:16.827885 14333 raft_consensus.cc:2468] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 12.
I20260709 12:11:16.813825 18195 raft_consensus.cc:2804] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:16.814020 18178 raft_consensus.cc:2804] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:16.725281 18186 consensus_queue.cc:237] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:16.875174 14186 raft_consensus.cc:1240] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:16.864629 18231 raft_consensus.cc:2804] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:16.874527 18199 raft_consensus.cc:493] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:16.859411 18223 raft_consensus.cc:493] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:16.823796 18054 leader_election.cc:290] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:16.824163 18092 raft_consensus.cc:515] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:16.859835 17840 raft_consensus.cc:493] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:16.871986 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 63797.7us
I20260709 12:11:16.870561 18195 raft_consensus.cc:493] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:16.870612 18185 raft_consensus.cc:697] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 7 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
W20260709 12:11:16.904497 14154 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 121163us
I20260709 12:11:16.905977 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:16.876741 18180 raft_consensus.cc:493] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:16.878237 18231 raft_consensus.cc:493] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:16.877439 17997 leader_election.cc:290] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:16.911687 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:16.913702 14182 raft_consensus.cc:3060] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:16.913563 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:16.914485 14184 raft_consensus.cc:1275] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:11:16.880450 18178 raft_consensus.cc:697] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 12 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:16.905150 18195 raft_consensus.cc:3060] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:16.903383 17946 raft_consensus.cc:2749] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:16.905510 17840 raft_consensus.cc:3060] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:16.901577 18214 raft_consensus.cc:697] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 9 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
W20260709 12:11:16.961385 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 232820us
I20260709 12:11:16.998112 14182 raft_consensus.cc:2468] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 11.
I20260709 12:11:16.923985 14155 leader_election.cc:304] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:16.928265 14183 raft_consensus.cc:1240] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:16.898164 18196 raft_consensus.cc:493] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:16.934345 14338 raft_consensus.cc:2468] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 12.
W20260709 12:11:16.950479 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 221545us
I20260709 12:11:17.018337 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:11:17.022209 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 59933.8us
I20260709 12:11:17.023175 14229 leader_election.cc:304] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:17.023227 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:16.915378 18231 raft_consensus.cc:3060] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:16.880507 18199 raft_consensus.cc:515] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:17.027199 14229 leader_election.cc:304] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:17.024756 14303 leader_election.cc:304] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:17.036339 14229 leader_election.cc:304] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:17.036613 18172 raft_consensus.cc:2804] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:17.037139 18172 raft_consensus.cc:697] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 11 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:17.036944 18134 consensus_queue.cc:1059] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:17.038448 18134 raft_consensus.cc:3055] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:17.038156 18172 consensus_queue.cc:237] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:17.038839 18134 raft_consensus.cc:740] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:17.039831 18134 consensus_queue.cc:260] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:17.040838 18134 raft_consensus.cc:3060] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:17.037655 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:16.914292 18180 raft_consensus.cc:515] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:17.043195 14183 raft_consensus.cc:2468] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 8.
I20260709 12:11:16.888197 18223 raft_consensus.cc:515] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:16.951288 17848 leader_election.cc:290] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 9 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:17.022099 17997 raft_consensus.cc:493] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
W20260709 12:11:17.071466 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 145133us
I20260709 12:11:17.028223 18234 raft_consensus.cc:493] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:17.068382 18237 raft_consensus.cc:2749] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:17.067484 18222 raft_consensus.cc:2804] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:17.067740 18204 raft_consensus.cc:697] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 12 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:11:17.042055 18138 consensus_queue.cc:1059] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.045s
I20260709 12:11:17.095948 14155 leader_election.cc:304] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:17.098234 18204 consensus_queue.cc:237] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:17.034449 18196 raft_consensus.cc:515] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:17.031958 17957 consensus_queue.cc:1048] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.058s
I20260709 12:11:17.106400 14183 raft_consensus.cc:3055] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:17.108978 14183 raft_consensus.cc:740] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:11:17.077246 18160 raft_consensus.cc:515] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:17.098378 18205 raft_consensus.cc:515] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:17.102962 17836 raft_consensus.cc:515] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:17.111865 18214 consensus_queue.cc:237] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:17.114370 17836 leader_election.cc:290] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 9 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:17.115175 14904 raft_consensus.cc:2393] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 9: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
W20260709 12:11:17.107465 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:17.116487 18205 leader_election.cc:290] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:17.109817 17946 raft_consensus.cc:2749] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:17.098592 18092 leader_election.cc:290] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:17.076073 17997 raft_consensus.cc:515] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:17.140275 17997 leader_election.cc:290] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:17.142457 18160 leader_election.cc:290] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 7 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:17.143429 14189 raft_consensus.cc:1240] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:17.108374 18236 raft_consensus.cc:2804] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:17.151283 18223 leader_election.cc:290] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:17.079216 18178 consensus_queue.cc:237] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:17.108139 17848 consensus_queue.cc:1048] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 12:11:17.102447 18235 raft_consensus.cc:493] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:17.163589 18235 raft_consensus.cc:515] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:17.075542 18185 consensus_queue.cc:237] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:17.092046 18234 raft_consensus.cc:515] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:17.111171 14183 consensus_queue.cc:260] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:17.169094 14183 raft_consensus.cc:3060] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:17.170044 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 63952.7us
I20260709 12:11:17.101671 17987 raft_consensus.cc:2749] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:11:17.189393 14303 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:17.119573 18241 raft_consensus.cc:2804] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:17.199612 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:17.167128 18236 raft_consensus.cc:697] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 12 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
W20260709 12:11:17.216374 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 144467us
I20260709 12:11:17.214181 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:17.214630 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:17.217711 14336 raft_consensus.cc:2393] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 8: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:11:17.216778 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:17.218954 14338 raft_consensus.cc:2393] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 8: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:11:17.223119 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:17.224335 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:17.224958 14332 raft_consensus.cc:2376] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 11. Re-sending same reply.
W20260709 12:11:17.230880 14155 connection.cc:256] RPC call timeout handler was delayed by -2.9211630259999311s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1674s for a response
W20260709 12:11:17.231472 14155 connection.cc:256] RPC call timeout handler was delayed by -2.758263025999895s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1855s for a response
W20260709 12:11:17.231784 14155 connection.cc:256] RPC call timeout handler was delayed by -2.5494630259997848s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20870000000000002s for a response
W20260709 12:11:17.232088 14155 connection.cc:256] RPC call timeout handler was delayed by -2.0238630259998445s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2671s for a response
I20260709 12:11:17.232882 14155 leader_election.cc:304] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:17.235993 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:17.238803 14337 raft_consensus.cc:2368] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 11. Current term is 12.
W20260709 12:11:17.239228 14229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:17.239482 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:17.233646 14183 raft_consensus.cc:1275] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 12:11:17.240145 14183 pending_rounds.cc:85] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf: Aborting all ops after (but not including) 5
I20260709 12:11:17.240388 14183 pending_rounds.cc:107] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 12:11:17.241019 14183 raft_consensus.cc:2889] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:11:17.241961 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 221269us
I20260709 12:11:17.242708 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:17.179044 17953 consensus_queue.cc:1059] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 12:11:17.244673 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:17.245285 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:17.188948 18200 raft_consensus.cc:515] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:17.216720 18235 leader_election.cc:290] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:17.249231 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:17.251075 14331 raft_consensus.cc:1240] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 10 LEADER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:17.215638 18222 raft_consensus.cc:697] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 9 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:11:17.256322 14335 raft_consensus.cc:1240] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 12:11:17.195151 18240 consensus_queue.cc:1048] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.053s
I20260709 12:11:17.238498 18241 raft_consensus.cc:697] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 9 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:11:17.249145 18160 raft_consensus.cc:2749] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:11:17.264330 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:17.265060 14260 raft_consensus.cc:2468] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 10.
I20260709 12:11:17.265468 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:17.267910 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:17.268390 18138 raft_consensus.cc:493] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:17.268934 18138 raft_consensus.cc:515] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:17.270996 14334 raft_consensus.cc:1240] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 10 LEADER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 9. Current term is 10. Ops: [7.5-9.6]
I20260709 12:11:17.274230 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:17.278702 18234 leader_election.cc:290] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:17.279798 18241 consensus_queue.cc:237] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:17.271016 18138 leader_election.cc:290] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:17.284693 18200 leader_election.cc:290] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 11 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:17.253235 18203 raft_consensus.cc:493] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:17.268572 14155 leader_election.cc:304] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:17.295511 14258 raft_consensus.cc:2393] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 8: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
I20260709 12:11:17.291365 18231 raft_consensus.cc:515] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:17.305493 14183 raft_consensus.cc:2393] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 7: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:11:17.321141 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:17.321637 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:17.266788 18243 raft_consensus.cc:493] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:17.328925 14184 raft_consensus.cc:1240] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 12:11:17.320286 18223 raft_consensus.cc:493] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:17.330085 18223 raft_consensus.cc:515] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:17.332427 18223 leader_election.cc:290] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:17.307348 18203 raft_consensus.cc:515] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:17.335057 18138 raft_consensus.cc:493] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:17.336351 18203 leader_election.cc:290] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:17.337091 18222 consensus_queue.cc:237] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:17.335752 18138 raft_consensus.cc:515] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:17.316697 18180 leader_election.cc:290] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:11:17.341434 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 72941.9us
I20260709 12:11:17.342991 18138 leader_election.cc:290] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:17.343637 14155 leader_election.cc:304] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:17.345036 14155 leader_election.cc:304] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:17.346593 18196 leader_election.cc:290] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:17.347225 18231 leader_election.cc:290] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 15 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:17.315687 18160 raft_consensus.cc:2749] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:17.318778 18247 raft_consensus.cc:493] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:17.349531 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:17.349844 18247 raft_consensus.cc:515] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:11:17.354099 18213 consensus_meta.cc:287] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.626s	user 0.011s	sys 0.000s
I20260709 12:11:17.350560 14909 raft_consensus.cc:2393] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 12: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:11:17.361088 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:17.363711 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:17.363216 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:17.364503 14331 raft_consensus.cc:2393] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 9: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:11:17.364732 14260 raft_consensus.cc:2410] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 12:11:17.354712 18213 raft_consensus.cc:515] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:17.370023 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:17.373924 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:17.374677 14155 leader_election.cc:304] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:17.362514 18234 raft_consensus.cc:2749] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:17.385650 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:17.366190 18240 raft_consensus.cc:2749] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:17.388494 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:17.389169 14258 raft_consensus.cc:3060] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:17.378377 18160 raft_consensus.cc:2749] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:17.361826 18243 raft_consensus.cc:515] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:17.399072 18218 raft_consensus.cc:3055] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:17.399577 18218 raft_consensus.cc:740] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:11:17.400564 18218 consensus_queue.cc:260] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:17.328052 18236 consensus_queue.cc:237] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:17.400321 14258 raft_consensus.cc:2468] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 10.
I20260709 12:11:17.392069 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:17.392467 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:17.405810 14256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41764 (request call id 2600) took 1094 ms. Trace:
I20260709 12:11:17.406257 14256 rpcz_store.cc:276] 0709 12:11:16.311829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:16.311945 (+   116us) service_pool.cc:224] Handling call
0709 12:11:16.353352 (+ 41407us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:16.777873 (+424521us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:17.405524 (+627651us) spinlock_profiling.cc:243] Waited 424 ms on lock 0x7b54003818d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:11:17.405718 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":974588288}
I20260709 12:11:17.410326 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:17.410995 14262 raft_consensus.cc:3060] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:17.410215 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:17.411437 14229 leader_election.cc:304] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:17.412714 14229 leader_election.cc:304] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:17.404784 18247 leader_election.cc:290] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:17.411109 14265 raft_consensus.cc:1240] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:11:17.414387 18247 raft_consensus.cc:2804] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:17.414788 18247 raft_consensus.cc:493] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:17.415179 18247 raft_consensus.cc:3060] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:17.412477 17840 raft_consensus.cc:515] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:17.417886 14155 leader_election.cc:304] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:17.419489 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:17.420830 14911 raft_consensus.cc:2468] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 10.
I20260709 12:11:17.425810 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:17.426209 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:17.426724 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:17.427466 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:17.427871 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:17.428100 14337 raft_consensus.cc:2468] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 4.
I20260709 12:11:17.428730 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:17.425851 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:17.430055 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:17.430538 14336 raft_consensus.cc:2468] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 8.
I20260709 12:11:17.414980 18213 leader_election.cc:290] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 9 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:17.432106 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:17.433337 17981 consensus_queue.cc:260] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:17.436265 14877 leader_election.cc:304] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:17.407817 18160 raft_consensus.cc:493] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:17.438342 18160 raft_consensus.cc:515] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:17.438958 14336 raft_consensus.cc:1275] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:11:17.440999 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:17.441915 14155 leader_election.cc:304] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:17.433279 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:17.442914 14190 raft_consensus.cc:2468] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 11.
I20260709 12:11:17.448063 14334 raft_consensus.cc:1240] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:17.448841 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:17.449625 14258 raft_consensus.cc:3060] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:17.451690 18234 raft_consensus.cc:2804] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:17.452169 18234 raft_consensus.cc:493] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:11:17.452550 18234 raft_consensus.cc:3060] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:17.457000 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:17.457779 14185 raft_consensus.cc:2468] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 6.
I20260709 12:11:17.459831 14181 raft_consensus.cc:1240] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 8. Current term is 9. Ops: [7.4-8.5]
I20260709 12:11:17.460927 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:17.461407 18199 leader_election.cc:290] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:17.462108 18212 raft_consensus.cc:2804] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:17.462546 18212 raft_consensus.cc:493] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:17.462935 18212 raft_consensus.cc:3060] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:17.463124 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:17.463774 14188 raft_consensus.cc:2468] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 12.
I20260709 12:11:17.464630 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:17.402724 18218 raft_consensus.cc:3060] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:17.441816 18241 raft_consensus.cc:2804] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:17.465708 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:17.488693 14188 raft_consensus.cc:2393] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 10: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:11:17.469949 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:17.489864 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:17.490327 14256 raft_consensus.cc:3060] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:17.490477 14337 raft_consensus.cc:1240] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:17.475499 14912 raft_consensus.cc:1240] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 12:11:17.476660 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:17.470497 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:17.496474 14262 raft_consensus.cc:2468] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 7.
I20260709 12:11:17.481138 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:17.487429 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:17.479790 14155 leader_election.cc:400] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 11 pre-election: Vote denied by peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957) with higher term. Message: Invalid argument: T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 11. Current term is 12.
I20260709 12:11:17.480054 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:17.492370 14303 leader_election.cc:304] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:17.474093 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:17.502871 14331 raft_consensus.cc:3060] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:17.506731 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:17.507751 14190 raft_consensus.cc:3060] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:17.515475 14303 leader_election.cc:304] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:17.518162 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:11:17.518361 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:17.519181 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:11:17.470350 18195 consensus_meta.cc:287] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db: Time spent flushing consensus metadata: real 0.518s	user 0.011s	sys 0.000s
I20260709 12:11:17.518258 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:17.523524 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:17.519842 14265 raft_consensus.cc:2468] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 8.
I20260709 12:11:17.523209 14229 leader_election.cc:304] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:17.519903 14877 leader_election.cc:304] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:11:17.486900 18213 raft_consensus.cc:493] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:17.529084 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:11:17.527719 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:17.472026 17997 raft_consensus.cc:3055] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:17.528667 14877 leader_election.cc:304] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:17.476838 17840 leader_election.cc:290] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 15 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:17.547896 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:17.535995 14304 leader_election.cc:304] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:17.550933 14304 leader_election.cc:304] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:17.552322 14304 leader_election.cc:304] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:17.521885 14303 leader_election.cc:304] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:17.536769 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:17.479383 18241 raft_consensus.cc:697] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 12 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:11:17.535210 14229 leader_election.cc:304] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:17.480006 18231 raft_consensus.cc:3060] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:17.553891 18222 raft_consensus.cc:2804] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:17.554286 14229 leader_election.cc:304] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:17.469619 18243 leader_election.cc:290] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:17.559650 14229 leader_election.cc:304] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:17.474586 18160 leader_election.cc:290] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:17.537345 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
W20260709 12:11:17.537261 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 57614.1us
I20260709 12:11:17.538143 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:17.538930 14261 raft_consensus.cc:1240] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:17.540059 14258 raft_consensus.cc:2468] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 10.
I20260709 12:11:17.561662 14155 leader_election.cc:304] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:17.562383 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:17.514227 17987 raft_consensus.cc:2804] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:17.553419 14265 raft_consensus.cc:2468] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 10.
I20260709 12:11:17.527850 18120 raft_consensus.cc:2804] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:17.571946 18120 raft_consensus.cc:493] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:17.572396 18120 raft_consensus.cc:3060] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:17.569077 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:17.485055 18234 raft_consensus.cc:515] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:17.576484 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
W20260709 12:11:17.571343 18211 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.701s	user 0.024s	sys 0.005s
I20260709 12:11:17.568966 14229 leader_election.cc:304] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:11:17.524504 18185 consensus_queue.cc:1048] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 12:11:17.576221 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:17.540791 17809 raft_consensus.cc:2749] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:17.542025 18193 raft_consensus.cc:2804] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:17.574553 14256 raft_consensus.cc:2468] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 9.
I20260709 12:11:17.581086 14229 leader_election.cc:304] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
W20260709 12:11:17.601009 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 72421us
W20260709 12:11:17.735786 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:17.569587 18186 raft_consensus.cc:2749] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:11:17.628912 18211 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.769s	user 0.025s	sys 0.005s
I20260709 12:11:17.734983 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:17.741052 14263 raft_consensus.cc:3060] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:17.541299 17997 raft_consensus.cc:740] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
W20260709 12:11:17.653384 14156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:17.528203 18072 consensus_queue.cc:1059] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.047s
I20260709 12:11:17.582119 14230 leader_election.cc:304] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:17.742990 18236 raft_consensus.cc:2749] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:11:17.743348 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 161326us
I20260709 12:11:17.576261 18207 raft_consensus.cc:2804] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:17.577803 17840 raft_consensus.cc:2749] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:17.560539 18222 raft_consensus.cc:493] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:17.735951 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:17.547046 18213 raft_consensus.cc:515] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:17.560576 18200 raft_consensus.cc:2749] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:17.737429 14877 leader_election.cc:304] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:11:17.570670 17987 raft_consensus.cc:493] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:17.737850 14186 raft_consensus.cc:2468] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 10.
W20260709 12:11:17.738415 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 157415us
I20260709 12:11:17.575387 18243 raft_consensus.cc:2749] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:11:17.732618 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 162303us
I20260709 12:11:17.746116 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:17.735129 18193 raft_consensus.cc:493] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:17.733574 14339 raft_consensus.cc:2393] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 14: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:11:17.534585 18195 raft_consensus.cc:515] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:17.580498 18160 raft_consensus.cc:3060] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:17.755060 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:17.793619 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:17.758236 14256 raft_consensus.cc:3060] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:17.612160 14190 raft_consensus.cc:2468] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 11.
I20260709 12:11:17.794610 14257 raft_consensus.cc:2468] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 12.
W20260709 12:11:17.758459 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 196888us
I20260709 12:11:17.745126 18211 raft_consensus.cc:697] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 8 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:11:17.766849 14263 raft_consensus.cc:2468] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 9.
I20260709 12:11:17.572997 18172 consensus_queue.cc:1059] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.172s
I20260709 12:11:17.735034 18252 raft_consensus.cc:2804] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:17.578369 17957 consensus_queue.cc:1059] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.177s
I20260709 12:11:17.744778 18214 raft_consensus.cc:493] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:17.747606 18183 raft_consensus.cc:493] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:17.748431 18207 raft_consensus.cc:493] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:17.746846 18138 raft_consensus.cc:2749] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:17.786854 18268 raft_consensus.cc:2804] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:17.847780 18268 raft_consensus.cc:697] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 12 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:11:17.849071 18234 leader_election.cc:290] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:17.848767 18268 consensus_queue.cc:237] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:17.744737 18196 consensus_queue.cc:1048] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 12:11:17.850008 18196 consensus_queue.cc:1243] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer 17aab1bbf5014936aa18cc21818b26ec log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:11:17.788383 14183 raft_consensus.cc:1275] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:11:17.790890 14229 leader_election.cc:304] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:17.792132 14258 raft_consensus.cc:2468] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 11.
I20260709 12:11:17.767072 18222 raft_consensus.cc:3060] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:17.856786 18213 leader_election.cc:290] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:17.860749 14910 raft_consensus.cc:2393] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 9: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
I20260709 12:11:17.800380 18252 raft_consensus.cc:493] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:17.862205 18252 raft_consensus.cc:3060] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:17.800086 18150 consensus_queue.cc:1048] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.066s
I20260709 12:11:17.794641 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:17.799968 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:17.874684 14263 raft_consensus.cc:2468] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 9.
W20260709 12:11:17.823526 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:17.781862 17987 raft_consensus.cc:3060] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:17.833163 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:17.835602 17957 raft_consensus.cc:3055] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 14 LEADER]: Stepping down as leader of term 14
W20260709 12:11:17.836488 18258 log.cc:927] Time spent T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.256s	user 0.001s	sys 0.000s
I20260709 12:11:17.799705 17997 consensus_queue.cc:260] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:17.842581 18212 raft_consensus.cc:515] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:17.793843 17809 raft_consensus.cc:493] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:17.845055 14189 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56652 (request call id 929) took 1209 ms. Trace:
W20260709 12:11:17.845930 14333 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50856 (request call id 2082) took 1960 ms (client timeout 1623 ms). Trace:
W20260709 12:11:17.901010 14333 rpcz_store.cc:269] 0709 12:11:15.886030 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:15.886163 (+   133us) service_pool.cc:224] Handling call
0709 12:11:17.845715 (+1959552us) spinlock_profiling.cc:243] Waited 825 ms on lock 0x7b54000fd7d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:11:17.845851 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1897524096}
I20260709 12:11:17.846203 18183 raft_consensus.cc:515] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:17.790102 18235 raft_consensus.cc:493] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:17.845863 18207 raft_consensus.cc:3060] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:17.794193 18193 raft_consensus.cc:3060] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:17.870333 14331 raft_consensus.cc:2468] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 9.
I20260709 12:11:17.911186 14333 raft_consensus.cc:1240] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:17.912142 14331 raft_consensus.cc:1240] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 9. Current term is 10. Ops: []
W20260709 12:11:17.891714 18263 log.cc:927] Time spent T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
W20260709 12:11:17.882499 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 86544.5us
I20260709 12:11:17.886199 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:17.886696 17957 raft_consensus.cc:740] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
W20260709 12:11:17.893091 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 102326us
I20260709 12:11:17.900171 14189 rpcz_store.cc:276] 0709 12:11:16.635370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:16.719763 (+ 84393us) service_pool.cc:224] Handling call
0709 12:11:16.728412 (+  8649us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:17.143886 (+415474us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:17.844760 (+700874us) spinlock_profiling.cc:243] Waited 415 ms on lock 0x7b5400321ed4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:11:17.844974 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":953918208}
I20260709 12:11:17.759696 18247 raft_consensus.cc:515] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:17.909264 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:17.924602 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:17.861824 18195 leader_election.cc:290] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 9 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:17.926719 14330 raft_consensus.cc:2410] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for term 13 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
W20260709 12:11:17.904505 18260 log.cc:927] Time spent T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.330s	user 0.001s	sys 0.000s
I20260709 12:11:17.910912 18235 raft_consensus.cc:515] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:17.917038 14155 leader_election.cc:304] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:17.847872 18211 consensus_queue.cc:237] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:17.771512 18241 consensus_queue.cc:237] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:17.834401 18214 raft_consensus.cc:515] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:17.935272 18183 leader_election.cc:290] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:17.938704 14155 leader_election.cc:304] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:17.912369 18180 raft_consensus.cc:2764] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:11:17.947167 14259 raft_consensus.cc:2468] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 12.
I20260709 12:11:17.943202 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:17.948276 14263 raft_consensus.cc:3060] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:17.911166 18138 raft_consensus.cc:3060] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:17.910504 17997 raft_consensus.cc:3060] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:17.795760 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
W20260709 12:11:17.957111 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:17.908469 17809 raft_consensus.cc:515] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:17.943390 18266 raft_consensus.cc:2749] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:17.974658 14190 pending_rounds.cc:85] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf: Aborting all ops after (but not including) 8
I20260709 12:11:17.999486 14190 pending_rounds.cc:107] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 12:11:17.999881 14190 raft_consensus.cc:2889] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:17.976279 14263 raft_consensus.cc:2468] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 11.
I20260709 12:11:17.935338 18213 consensus_queue.cc:1048] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 12:11:18.002517 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:18.003238 14263 raft_consensus.cc:3060] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:17.950165 18240 raft_consensus.cc:2749] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:18.014465 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:18.021024 14263 raft_consensus.cc:2468] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 14.
I20260709 12:11:18.022272 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:18.024587 14189 raft_consensus.cc:3055] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:18.024946 14189 raft_consensus.cc:740] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:11:18.015232 18212 leader_election.cc:290] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 11 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:11:18.025262 18272 log.cc:927] Time spent T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 12:11:18.028555 14189 consensus_queue.cc:260] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:18.018169 18240 consensus_queue.cc:1059] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.013s
I20260709 12:11:18.054306 14256 raft_consensus.cc:2468] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 12.
I20260709 12:11:18.055889 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:18.070894 18120 raft_consensus.cc:515] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:18.075877 14188 raft_consensus.cc:1240] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 9. Current term is 10. Ops: [9.4-9.4]
I20260709 12:11:18.077679 14339 raft_consensus.cc:1240] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:18.080399 14189 raft_consensus.cc:3060] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:18.087174 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
W20260709 12:11:18.080684 14260 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.000s	sys 0.019s
W20260709 12:11:18.088428 14260 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.550s	user 0.000s	sys 0.020s
I20260709 12:11:18.088157 14263 raft_consensus.cc:3060] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:18.057389 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:18.092489 14256 raft_consensus.cc:1240] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:18.098134 14263 raft_consensus.cc:2468] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 11.
I20260709 12:11:18.100523 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:17.997399 17957 consensus_queue.cc:260] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:18.114566 18160 raft_consensus.cc:2749] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:18.135931 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:18.102001 18247 leader_election.cc:290] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:18.117272 18235 leader_election.cc:290] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:18.125038 14256 pending_rounds.cc:85] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec: Aborting all ops after (but not including) 7
I20260709 12:11:18.127557 14877 leader_election.cc:304] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:18.129431 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
W20260709 12:11:18.131948 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 182381us
I20260709 12:11:18.101538 17809 leader_election.cc:290] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:18.136648 14265 raft_consensus.cc:3060] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:18.141243 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:18.142161 14256 pending_rounds.cc:107] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 12:11:18.148254 14256 raft_consensus.cc:2889] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:11:18.136600 18276 log.cc:927] Time spent T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 12:11:18.155856 17957 raft_consensus.cc:3060] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:11:18.166669 14303 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:18.169477 18278 log.cc:927] Time spent T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
W20260709 12:11:18.171187 18269 log.cc:927] Time spent T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.173s	user 0.001s	sys 0.000s
I20260709 12:11:18.145577 14155 leader_election.cc:304] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:18.149777 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:18.151100 14877 leader_election.cc:304] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:18.174353 14155 leader_election.cc:304] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:18.186183 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:18.188498 14263 raft_consensus.cc:3060] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:18.153719 18120 leader_election.cc:290] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 7 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:18.244906 14265 raft_consensus.cc:2468] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 11.
I20260709 12:11:18.198390 18214 leader_election.cc:290] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:18.133525 18268 consensus_queue.cc:1059] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 12:11:18.198963 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:11:18.200367 18231 consensus_meta.cc:287] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.640s	user 0.010s	sys 0.001s
I20260709 12:11:18.161026 18207 raft_consensus.cc:515] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:18.186108 18115 raft_consensus.cc:2804] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:18.207515 14877 leader_election.cc:304] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
W20260709 12:11:18.180455 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:18.209549 14182 raft_consensus.cc:1240] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:18.210348 14155 leader_election.cc:304] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:18.214514 14189 raft_consensus.cc:1275] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 5. (term mismatch)
I20260709 12:11:18.150274 18014 raft_consensus.cc:2804] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:18.186517 18160 raft_consensus.cc:2804] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:11:18.226109 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:18.226365 18222 raft_consensus.cc:515] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:11:18.227083 18279 log.cc:927] Time spent T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.073s	user 0.001s	sys 0.004s
I20260709 12:11:18.221110 17840 consensus_queue.cc:1059] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.006s
I20260709 12:11:18.228083 18138 raft_consensus.cc:2749] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:18.229984 18280 raft_consensus.cc:2804] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:18.231323 18193 raft_consensus.cc:515] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:18.231580 18252 raft_consensus.cc:515] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:18.238214 14904 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53194 (request call id 876) took 1433 ms. Trace:
I20260709 12:11:18.242177 18248 raft_consensus.cc:3055] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:18.194657 14088 catalog_manager.cc:5697] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: term changed from 6 to 7, leader changed from 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) to 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130). New cstate: current_term: 7 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:18.248543 14189 pending_rounds.cc:85] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf: Aborting all ops after (but not including) 4
I20260709 12:11:18.272308 14189 pending_rounds.cc:107] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 12:11:18.272667 14189 raft_consensus.cc:2889] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:18.273006 14189 pending_rounds.cc:107] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 12:11:18.273226 14189 raft_consensus.cc:2889] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:18.269889 14904 rpcz_store.cc:276] 0709 12:11:16.805120 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:16.805267 (+   147us) service_pool.cc:224] Handling call
0709 12:11:18.237905 (+1432638us) spinlock_profiling.cc:243] Waited 309 ms on lock 0x7b54007bfcd4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:11:18.238098 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":709842176}
I20260709 12:11:18.249955 14265 raft_consensus.cc:1240] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 12:11:18.250679 14182 raft_consensus.cc:1275] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:11:18.253067 14155 leader_election.cc:304] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:18.276350 14261 raft_consensus.cc:2393] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 12: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:11:18.254215 18231 raft_consensus.cc:2749] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:18.276683 14265 raft_consensus.cc:1240] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:18.277100 14155 leader_election.cc:304] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:18.277962 14265 raft_consensus.cc:1240] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:18.253851 14181 raft_consensus.cc:1240] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 9. Current term is 10. Ops: []
W20260709 12:11:18.243028 18281 log.cc:927] Time spent T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.052s	user 0.003s	sys 0.001s
W20260709 12:11:18.258802 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 51413.9us
I20260709 12:11:18.252161 18014 raft_consensus.cc:493] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:18.254518 14303 leader_election.cc:304] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:18.256748 18214 raft_consensus.cc:2749] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:18.281410 17848 raft_consensus.cc:2749] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:18.281728 18157 raft_consensus.cc:2749] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:18.282266 18211 raft_consensus.cc:2749] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:18.286137 14263 raft_consensus.cc:2468] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 9.
I20260709 12:11:18.252374 18115 raft_consensus.cc:493] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:18.252424 18160 raft_consensus.cc:493] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:18.294595 14183 raft_consensus.cc:1275] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:11:18.280759 14155 leader_election.cc:304] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:18.296067 14910 raft_consensus.cc:2368] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 12. Current term is 13.
I20260709 12:11:18.297552 14265 raft_consensus.cc:1275] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:11:18.271281 18248 raft_consensus.cc:740] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:11:18.298265 18275 consensus_queue.cc:1059] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:18.268100 18280 raft_consensus.cc:493] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:18.269346 17836 raft_consensus.cc:2804] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:18.297073 14088 catalog_manager.cc:5697] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:18.391063 14088 catalog_manager.cc:5697] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: term changed from 5 to 6, leader changed from 885067a0d31741bfb5c9935788e315bf (127.12.174.129) to 65c9c1653b3346b39a0e118540e6080c (127.12.174.131). New cstate: current_term: 6 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } }
I20260709 12:11:18.302857 17987 raft_consensus.cc:515] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:18.358628 14181 raft_consensus.cc:1275] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
W20260709 12:11:18.321906 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:18.294724 18014 raft_consensus.cc:3060] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:18.298954 18000 raft_consensus.cc:2804] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:18.364933 14912 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53194 (request call id 877) took 1533 ms. Trace:
I20260709 12:11:18.344751 14260 raft_consensus.cc:1275] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:11:18.342818 14188 raft_consensus.cc:1275] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:11:18.294605 17957 raft_consensus.cc:493] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:18.399362 14302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:18.400290 14336 raft_consensus.cc:1240] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:11:18.397514 14912 rpcz_store.cc:276] 0709 12:11:16.831380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:16.831521 (+   141us) service_pool.cc:224] Handling call
0709 12:11:16.834032 (+  2511us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:17.491545 (+657513us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:18.322132 (+830587us) spinlock_profiling.cc:243] Waited 641 ms on lock 0x7b540047a254. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:11:18.364840 (+ 42708us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1474619136}
I20260709 12:11:18.316947 18160 raft_consensus.cc:3060] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:11:18.341431 14187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56044 (request call id 2565) took 1436 ms. Trace:
W20260709 12:11:18.346163 14230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:18.347041 18072 raft_consensus.cc:3055] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:18.307251 18115 raft_consensus.cc:3060] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:18.411711 14187 rpcz_store.cc:276] 0709 12:11:16.905490 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:16.905635 (+   145us) service_pool.cc:224] Handling call
0709 12:11:18.323803 (+1418168us) spinlock_profiling.cc:243] Waited 635 ms on lock 0x7b54003b2754. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:11:18.341262 (+ 17459us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1459842432}
I20260709 12:11:18.392156 18236 raft_consensus.cc:493] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:18.386752 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 106069us
I20260709 12:11:18.387401 14229 leader_election.cc:304] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:18.408632 14188 raft_consensus.cc:1275] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:11:18.383674 18094 raft_consensus.cc:493] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:18.426812 14187 raft_consensus.cc:1240] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:18.390004 18280 raft_consensus.cc:3060] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:18.424500 14155 leader_election.cc:304] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:18.429173 14155 leader_election.cc:304] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:18.375538 14154 leader_election.cc:304] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:18.396005 18211 raft_consensus.cc:2749] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:18.404363 17894 raft_consensus.cc:3060] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:18.410718 14258 raft_consensus.cc:1275] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
W20260709 12:11:18.442111 14154 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 66698.8us
I20260709 12:11:18.422041 14230 leader_election.cc:304] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:18.443343 14258 raft_consensus.cc:1240] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:18.445868 14230 leader_election.cc:304] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:18.414518 18000 raft_consensus.cc:697] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 11 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
W20260709 12:11:18.457899 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 160031us
I20260709 12:11:18.455569 14258 raft_consensus.cc:1275] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:11:18.463807 14190 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56652 (request call id 938) took 1185 ms. Trace:
I20260709 12:11:18.464113 14190 rpcz_store.cc:276] 0709 12:11:17.278623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:17.795417 (+516794us) service_pool.cc:224] Handling call
0709 12:11:17.831285 (+ 35868us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:18.000540 (+169255us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:18.000591 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:18.001100 (+   509us) log.cc:844] Serialized 26 byte log entry
0709 12:11:18.128434 (+127334us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:18.128483 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:18.344415 (+215932us) spinlock_profiling.cc:243] Waited 143 ms on lock 0x7b540035b454. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:11:18.344464 (+    49us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:18.454840 (+110376us) raft_consensus.cc:1685] finished
0709 12:11:18.454863 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:18.463736 (+  8873us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":328960768,"thread_start_us":126916,"threads_started":1,"wal-append.queue_time_us":189113}
I20260709 12:11:18.465085 14258 raft_consensus.cc:1275] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:11:18.407195 17957 raft_consensus.cc:515] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:18.415786 18072 raft_consensus.cc:740] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:18.462893 14088 catalog_manager.cc:5697] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: term changed from 6 to 5, leader changed from <none> to 65c9c1653b3346b39a0e118540e6080c (127.12.174.131). New cstate: current_term: 5 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:11:18.430692 17997 raft_consensus.cc:2749] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:18.448422 18240 raft_consensus.cc:2804] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:18.490434 18240 raft_consensus.cc:697] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 10 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:11:18.491636 18240 consensus_queue.cc:237] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:18.495412 18000 consensus_queue.cc:237] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:18.451740 14155 leader_election.cc:304] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:18.477222 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:18.426739 18120 consensus_queue.cc:1059] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 12:11:18.500919 18120 raft_consensus.cc:3055] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:18.501385 18120 raft_consensus.cc:740] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:18.501688 14877 leader_election.cc:304] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:18.502331 18120 consensus_queue.cc:260] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:18.503082 14877 leader_election.cc:304] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:11:18.503623 18120 raft_consensus.cc:3060] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:18.505416 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:18.426573 18054 consensus_queue.cc:1048] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 12:11:18.454988 18213 raft_consensus.cc:2749] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:18.453663 18214 raft_consensus.cc:2749] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:11:18.441481 18094 raft_consensus.cc:515] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:11:18.482543 18285 log.cc:927] Time spent T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:11:18.454802 18231 raft_consensus.cc:2749] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:18.455803 18235 raft_consensus.cc:2749] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:11:18.508292 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 56666us
I20260709 12:11:18.430604 18236 raft_consensus.cc:515] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:18.511871 14190 raft_consensus.cc:3060] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:18.516644 14155 leader_election.cc:304] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:18.523308 14155 leader_election.cc:304] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:18.459635 17848 consensus_queue.cc:1059] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 12:11:18.497893 18268 raft_consensus.cc:3055] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:18.529951 14088 catalog_manager.cc:5697] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: term changed from 5 to 6, leader changed from 65c9c1653b3346b39a0e118540e6080c (127.12.174.131) to 73d01e9b1a9d49358da4985b21d681db (127.12.174.132). New cstate: current_term: 6 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:11:18.529685 17809 raft_consensus.cc:493] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:18.541805 18072 consensus_queue.cc:260] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:18.538043 18234 raft_consensus.cc:2804] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:18.542057 17809 raft_consensus.cc:515] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:18.543207 18072 raft_consensus.cc:3060] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:18.544456 17809 leader_election.cc:290] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:18.537844 18203 raft_consensus.cc:493] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:18.546438 18203 raft_consensus.cc:515] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:18.549002 18203 leader_election.cc:290] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:18.531275 18247 raft_consensus.cc:493] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:18.549978 18151 raft_consensus.cc:2804] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:18.550750 18247 raft_consensus.cc:515] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:18.551257 18151 raft_consensus.cc:697] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 11 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:11:18.553241 18151 consensus_queue.cc:237] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:18.519065 18213 raft_consensus.cc:493] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:18.555514 18213 raft_consensus.cc:515] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:18.517333 18214 raft_consensus.cc:2804] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:18.507344 17836 raft_consensus.cc:697] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 9 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
W20260709 12:11:18.576419 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:18.575580 14088 catalog_manager.cc:5697] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:18.531700 17981 raft_consensus.cc:3060] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:18.531173 18211 raft_consensus.cc:2804] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:18.558673 18268 raft_consensus.cc:740] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:11:18.538612 17987 leader_election.cc:290] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 9 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:18.569366 18193 leader_election.cc:290] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 13 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:18.587270 14190 raft_consensus.cc:2468] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 11.
I20260709 12:11:18.531111 18222 leader_election.cc:290] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:18.423974 18201 consensus_queue.cc:1059] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 12:11:18.424217 18183 consensus_queue.cc:1048] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 12:11:18.553556 18247 leader_election.cc:290] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:18.610296 18212 raft_consensus.cc:3055] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 10 LEADER]: Stepping down as leader of term 10
W20260709 12:11:18.612246 14305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:18.633544 14257 raft_consensus.cc:2468] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 7.
W20260709 12:11:18.618506 14304 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:18.602105 14088 catalog_manager.cc:5697] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: term changed from 2 to 9, leader changed from 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) to 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130). New cstate: current_term: 9 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:11:18.622426 14303 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:18.627976 18284 log.cc:927] Time spent T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.168s	user 0.001s	sys 0.000s
I20260709 12:11:18.636409 14258 pending_rounds.cc:85] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec: Aborting all ops after (but not including) 2
I20260709 12:11:18.584445 18252 leader_election.cc:290] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 11 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:18.656994 14258 pending_rounds.cc:107] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:11:18.643858 18207 leader_election.cc:290] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 13 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:11:18.652061 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 149062us
I20260709 12:11:18.595279 18294 raft_consensus.cc:2804] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:18.658710 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:18.666718 14190 raft_consensus.cc:3060] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:18.656886 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 129357us
I20260709 12:11:18.583236 18214 raft_consensus.cc:697] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 7 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:11:18.659732 14258 raft_consensus.cc:2889] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:18.668392 14258 pending_rounds.cc:107] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 12:11:18.668689 14258 raft_consensus.cc:2889] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:18.674155 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:18.657626 14088 catalog_manager.cc:5697] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } }
I20260709 12:11:18.676110 14337 raft_consensus.cc:1275] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 12:11:18.676746 14335 raft_consensus.cc:1275] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 6. (term mismatch)
I20260709 12:11:18.677096 14335 pending_rounds.cc:85] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c: Aborting all ops after (but not including) 5
I20260709 12:11:18.677316 14335 pending_rounds.cc:107] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c: Aborting uncommitted NO_OP operation due to leader change: 11.6
I20260709 12:11:18.677541 14335 raft_consensus.cc:2889] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:18.677691 14304 leader_election.cc:304] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:18.678503 14330 raft_consensus.cc:1240] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:18.669144 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:18.681119 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:18.681953 14331 raft_consensus.cc:2393] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 12: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:11:18.677850 14339 raft_consensus.cc:1275] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:11:18.684598 14262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53050 (request call id 711) took 1160 ms. Trace:
I20260709 12:11:18.688258 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:18.690332 14331 raft_consensus.cc:1275] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:11:18.691810 14331 raft_consensus.cc:1240] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:18.692584 14304 leader_election.cc:304] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:11:18.685027 14262 rpcz_store.cc:276] 0709 12:11:17.523738 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:17.523955 (+   217us) service_pool.cc:224] Handling call
0709 12:11:17.547359 (+ 23404us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:17.774509 (+227150us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:17.774543 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:17.774625 (+    82us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:17.774675 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:18.684335 (+909660us) spinlock_profiling.cc:243] Waited 227 ms on lock 0x7b54001c1e54. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:11:18.684391 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:18.684522 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":521825536}
I20260709 12:11:18.647286 18212 raft_consensus.cc:740] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:11:18.702391 14304 leader_election.cc:304] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:18.654220 14912 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18"
dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
mode: GRACEFUL
new_leader_uuid: "17aab1bbf5014936aa18cc21818b26ec"
 from {username='slave'} at 127.0.0.1:38628
I20260709 12:11:18.712522 14912 raft_consensus.cc:606] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Received request to transfer leadership to TS 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:11:18.713092 14912 raft_consensus.cc:614] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:18.711251 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:18.671218 18201 raft_consensus.cc:493] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:18.718366 14190 raft_consensus.cc:2468] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 13.
I20260709 12:11:18.721076 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:18.682602 18199 raft_consensus.cc:493] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
W20260709 12:11:18.737685 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 79608us
I20260709 12:11:18.743175 14088 catalog_manager.cc:5697] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: term changed from 4 to 5, leader changed from 65c9c1653b3346b39a0e118540e6080c (127.12.174.131) to 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130). New cstate: current_term: 5 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:18.744985 18155 raft_consensus.cc:2804] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:18.693950 18178 raft_consensus.cc:2804] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:18.709827 18207 raft_consensus.cc:2804] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:18.705847 18234 raft_consensus.cc:697] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 9 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:11:18.821790 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
W20260709 12:11:18.842111 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:18.739637 18213 leader_election.cc:290] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:18.820540 18178 raft_consensus.cc:493] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:18.855719 18294 raft_consensus.cc:697] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 9 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
W20260709 12:11:18.857323 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 107699us
W20260709 12:11:18.859757 18286 log.cc:927] Time spent T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.223s	user 0.001s	sys 0.000s
W20260709 12:11:18.860591 14877 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.174.130:36673 timed out after 1.906s (SENT) [suppressed 8 similar messages]
I20260709 12:11:18.861688 14256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41764 (request call id 2611) took 1033 ms. Trace:
I20260709 12:11:18.710533 18290 consensus_queue.cc:1059] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.145s
I20260709 12:11:18.833760 18207 raft_consensus.cc:493] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:18.862125 14256 rpcz_store.cc:276] 0709 12:11:17.828186 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:18.093381 (+265195us) service_pool.cc:224] Handling call
0709 12:11:18.124743 (+ 31362us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:18.152722 (+ 27979us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:18.152778 (+    56us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:18.212649 (+ 59871us) log.cc:844] Serialized 52 byte log entry
0709 12:11:18.500790 (+288141us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:18.501520 (+   730us) log.cc:844] Serialized 14 byte log entry
0709 12:11:18.526603 (+ 25083us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:18.526702 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:18.861434 (+334732us) raft_consensus.cc:1685] finished
0709 12:11:18.861455 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:18.861621 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28256,"prepare.queue_time_us":161,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":61,"raft.queue_time_us":31898,"raft.run_cpu_time_us":277,"raft.run_wall_time_us":25720,"thread_start_us":242147,"threads_started":1,"wal-append.queue_time_us":325242}
W20260709 12:11:18.855926 18292 log.cc:927] Time spent T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.259s	user 0.000s	sys 0.001s
I20260709 12:11:18.834522 18211 raft_consensus.cc:697] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 10 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:11:18.842104 18155 raft_consensus.cc:697] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 14 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
W20260709 12:11:18.873776 14302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:18.748852 18201 raft_consensus.cc:515] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:11:18.878280 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 175969us
I20260709 12:11:18.882768 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:18.884032 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:18.884733 14338 raft_consensus.cc:3060] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:18.712471 18212 consensus_queue.cc:260] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:18.862332 18178 raft_consensus.cc:3060] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:18.829290 18199 raft_consensus.cc:515] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:11:18.917980 18295 log.cc:927] Time spent T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 12:11:18.861984 18094 leader_election.cc:290] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:18.870757 18207 raft_consensus.cc:3060] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:18.925400 18155 consensus_queue.cc:237] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:18.926599 18213 raft_consensus.cc:493] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
W20260709 12:11:18.927102 14155 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:18.856994 18294 consensus_queue.cc:237] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:11:18.928105 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 46063.3us
I20260709 12:11:18.843842 17836 consensus_queue.cc:237] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:18.479923 18248 consensus_queue.cc:260] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:18.748055 18268 consensus_queue.cc:260] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:18.932618 14912 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af"
dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
mode: GRACEFUL
new_leader_uuid: "885067a0d31741bfb5c9935788e315bf"
 from {username='slave'} at 127.0.0.1:38628
I20260709 12:11:18.953539 14912 raft_consensus.cc:606] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 11 LEADER]: Received request to transfer leadership to TS 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:18.954890 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:18.929210 18266 raft_consensus.cc:3055] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:18.948189 14304 leader_election.cc:304] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:18.957659 14256 raft_consensus.cc:1275] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
W20260709 12:11:18.960187 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 99626.2us
I20260709 12:11:18.963865 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:11:18.876323 18014 raft_consensus.cc:515] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:18.990693 14304 leader_election.cc:304] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
W20260709 12:11:18.991026 14305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:18.997860 14338 raft_consensus.cc:2468] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 13.
I20260709 12:11:19.003455 14256 raft_consensus.cc:1275] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:11:18.870901 18214 consensus_queue.cc:237] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:19.007233 14331 raft_consensus.cc:1275] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:11:19.013162 18302 raft_consensus.cc:493] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:18.959689 18266 raft_consensus.cc:740] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:11:19.013803 18302 raft_consensus.cc:515] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:19.013208 14910 raft_consensus.cc:1240] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 11 LEADER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 10. Current term is 11. Ops: []
W20260709 12:11:19.015106 18301 log.cc:927] Time spent T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:11:19.014752 18266 consensus_queue.cc:260] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:19.016135 18266 raft_consensus.cc:3060] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:19.016464 18297 log.cc:927] Time spent T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.187s	user 0.000s	sys 0.001s
W20260709 12:11:19.017625 18300 log.cc:927] Time spent T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.132s	user 0.000s	sys 0.000s
I20260709 12:11:19.017500 18211 consensus_queue.cc:237] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:19.018970 18306 raft_consensus.cc:493] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:19.019572 18306 raft_consensus.cc:515] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:11:19.021190 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:18.951267 18213 raft_consensus.cc:515] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:19.023567 18213 leader_election.cc:290] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:18.963404 18212 raft_consensus.cc:3060] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:19.047191 18199 leader_election.cc:290] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:11:19.049785 18120 consensus_meta.cc:287] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.546s	user 0.009s	sys 0.004s
W20260709 12:11:19.054556 18160 consensus_meta.cc:287] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.636s	user 0.010s	sys 0.001s
I20260709 12:11:19.055119 18160 raft_consensus.cc:515] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:19.057430 18160 leader_election.cc:290] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:19.059917 14263 raft_consensus.cc:1240] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:19.061040 18150 raft_consensus.cc:3055] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:11:19.066771 18115 consensus_meta.cc:287] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db: Time spent flushing consensus metadata: real 0.639s	user 0.010s	sys 0.001s
I20260709 12:11:18.990621 18234 consensus_queue.cc:237] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:19.068848 18201 leader_election.cc:290] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:19.069911 18168 raft_consensus.cc:3055] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:11:19.071820 18308 log.cc:927] Time spent T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
W20260709 12:11:19.076509 14305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:19.002838 18304 raft_consensus.cc:493] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
W20260709 12:11:19.092862 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:19.001068 18277 log.cc:927] Time spent T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.829s	user 0.000s	sys 0.005s
I20260709 12:11:19.005962 18071 raft_consensus.cc:3060] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:19.103500 14332 raft_consensus.cc:2468] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 10.
I20260709 12:11:19.004431 18268 raft_consensus.cc:3060] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:19.127370 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:18.998894 18309 raft_consensus.cc:2804] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:19.003767 18307 raft_consensus.cc:493] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:19.102396 18150 raft_consensus.cc:740] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:11:19.135140 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:11:19.149380 14904 raft_consensus.cc:1240] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 12 LEADER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:19.153221 14910 raft_consensus.cc:2368] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 10. Current term is 11.
I20260709 12:11:19.123925 18303 raft_consensus.cc:493] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:19.131440 18168 raft_consensus.cc:740] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:11:19.146713 18213 raft_consensus.cc:493] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:19.159168 18160 consensus_queue.cc:1048] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:11:19.146780 18231 consensus_queue.cc:1048] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 12:11:19.154657 18298 consensus_queue.cc:1048] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 12:11:19.138875 17983 raft_consensus.cc:493] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:19.168733 18000 raft_consensus.cc:493] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:19.198462 14264 raft_consensus.cc:1240] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 11. Current term is 12. Ops: []
W20260709 12:11:19.198370 14261 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41768 (request call id 1761) took 1629 ms (client timeout 1592 ms). Trace:
I20260709 12:11:19.170383 18305 raft_consensus.cc:493] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
W20260709 12:11:19.172089 14259 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53050 (request call id 709) took 1682 ms (client timeout 1906 ms). Trace:
W20260709 12:11:19.201982 14259 rpcz_store.cc:269] 0709 12:11:17.490027 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:17.490240 (+   213us) service_pool.cc:224] Handling call
0709 12:11:19.171829 (+1681589us) spinlock_profiling.cc:243] Waited 428 ms on lock 0x7b5400101b54. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:11:19.171974 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":984481024}
I20260709 12:11:19.129453 17848 raft_consensus.cc:493] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:19.130322 18306 leader_election.cc:290] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:19.189363 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:11:19.199188 14261 rpcz_store.cc:269] 0709 12:11:17.568624 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:17.568775 (+   151us) service_pool.cc:224] Handling call
0709 12:11:19.198111 (+1629336us) spinlock_profiling.cc:243] Waited 703 ms on lock 0x7b54001b1cd4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:11:19.198289 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1615774080}
I20260709 12:11:19.207516 14186 raft_consensus.cc:2468] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 9.
W20260709 12:11:19.212388 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 211765us
I20260709 12:11:19.213066 14303 leader_election.cc:304] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:19.147430 18309 raft_consensus.cc:697] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 12 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:19.126325 18115 raft_consensus.cc:515] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:19.206244 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
W20260709 12:11:19.115661 18280 consensus_meta.cc:287] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.668s	user 0.004s	sys 0.007s
I20260709 12:11:19.232654 14154 leader_election.cc:400] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 election: Vote denied by peer 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341) with higher term. Message: Invalid argument: T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 10. Current term is 11.
I20260709 12:11:19.235229 14154 leader_election.cc:403] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 12:11:19.140122 18304 raft_consensus.cc:515] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:19.235103 14304 leader_election.cc:304] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:19.256960 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:19.211833 18298 raft_consensus.cc:493] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:19.212111 18231 raft_consensus.cc:493] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:19.263514 14912 raft_consensus.cc:1240] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:19.212172 18000 raft_consensus.cc:515] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:19.279886 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:19.281663 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:19.282737 14186 raft_consensus.cc:2393] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db in current term 15: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:11:19.283659 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:19.284250 14186 raft_consensus.cc:3060] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:19.147760 18307 raft_consensus.cc:515] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:19.289773 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:19.290668 14904 raft_consensus.cc:2468] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 11.
I20260709 12:11:19.204916 18180 consensus_queue.cc:1048] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 12:11:19.199066 18213 raft_consensus.cc:515] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:19.211849 18054 consensus_queue.cc:1048] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.055s
I20260709 12:11:19.262022 17981 raft_consensus.cc:2804] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:19.187469 18303 raft_consensus.cc:515] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:11:19.266945 17894 consensus_meta.cc:287] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.819s	user 0.007s	sys 0.007s
I20260709 12:11:19.205150 17983 raft_consensus.cc:515] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:19.217038 17848 raft_consensus.cc:515] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:19.316673 14876 leader_election.cc:304] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:19.317237 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:19.233683 18014 leader_election.cc:290] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 11 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:19.292204 18195 raft_consensus.cc:493] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:19.312388 18312 log.cc:927] Time spent T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:11:19.261710 18306 raft_consensus.cc:2749] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341) with higher term. Message: Invalid argument: T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 10. Current term is 11.
I20260709 12:11:19.252691 18199 consensus_queue.cc:1059] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 12:11:19.251744 18280 raft_consensus.cc:515] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:19.217310 18305 raft_consensus.cc:515] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:19.277086 18236 leader_election.cc:290] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:19.345762 14186 raft_consensus.cc:2468] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 9.
I20260709 12:11:19.286510 18298 raft_consensus.cc:515] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:19.279639 18231 raft_consensus.cc:515] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:11:19.364579 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 113626us
I20260709 12:11:19.366556 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:19.339933 18153 raft_consensus.cc:493] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:19.372332 14186 raft_consensus.cc:2393] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db in current term 11: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:11:19.340863 18296 raft_consensus.cc:2749] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:11:19.368427 14182 raft_consensus.cc:1240] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:11:19.349620 18155 raft_consensus.cc:2749] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:19.382090 14186 raft_consensus.cc:1240] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 4. Current term is 5. Ops: []
I20260709 12:11:19.339274 18207 raft_consensus.cc:515] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:19.385208 14186 raft_consensus.cc:1275] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 12:11:19.385656 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 240500us
I20260709 12:11:19.259028 18150 consensus_queue.cc:260] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:19.343623 18195 raft_consensus.cc:515] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:19.297324 18168 consensus_queue.cc:260] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:19.400470 14303 leader_election.cc:304] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:11:19.403993 14155 leader_election.cc:304] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:19.409552 14187 raft_consensus.cc:1275] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:11:19.412957 14335 raft_consensus.cc:1240] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 14 LEADER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:19.408839 18291 consensus_queue.cc:1048] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 12:11:19.417531 18180 raft_consensus.cc:2804] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:19.418093 18180 raft_consensus.cc:493] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:19.418594 14335 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f"
dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
mode: GRACEFUL
new_leader_uuid: "17aab1bbf5014936aa18cc21818b26ec"
 from {username='slave'} at 127.0.0.1:50896
I20260709 12:11:19.419229 14335 raft_consensus.cc:606] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Received request to transfer leadership to TS 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:11:19.418231 14303 leader_election.cc:304] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:19.420275 18199 raft_consensus.cc:2804] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:19.420725 18199 raft_consensus.cc:493] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:19.421097 18199 raft_consensus.cc:3060] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:19.425294 18000 leader_election.cc:290] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:19.427438 18195 leader_election.cc:290] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:19.428485 18115 leader_election.cc:290] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 12 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:19.430045 18213 leader_election.cc:290] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:19.376857 18153 raft_consensus.cc:515] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:19.434470 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:19.437287 18305 leader_election.cc:290] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:19.396991 18275 consensus_queue.cc:1059] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 12:11:19.437987 18305 raft_consensus.cc:2749] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:19.438838 18275 raft_consensus.cc:3055] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:11:19.439242 18275 raft_consensus.cc:740] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:11:19.439571 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:19.440186 18275 consensus_queue.cc:260] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:19.441520 14264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41764 (request call id 2614) took 1509 ms. Trace:
I20260709 12:11:19.374699 18309 consensus_queue.cc:237] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:19.441947 14264 rpcz_store.cc:276] 0709 12:11:17.932287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:18.150854 (+218567us) service_pool.cc:224] Handling call
0709 12:11:19.198259 (+1047405us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:19.204860 (+  6601us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:19.441315 (+236455us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b54001b1cd0. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713a8ad 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:11:19.441452 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2364263680}
I20260709 12:11:19.445469 14335 raft_consensus.cc:614] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:19.391230 18302 leader_election.cc:290] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:11:19.419369 18314 log.cc:927] Time spent T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
W20260709 12:11:19.447360 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:19.418512 18180 raft_consensus.cc:3060] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:19.449286 14187 raft_consensus.cc:1275] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:11:19.463860 14334 raft_consensus.cc:1240] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 9. Current term is 10. Ops: [9.5-9.5]
W20260709 12:11:19.464381 18315 log.cc:927] Time spent T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.165s	user 0.001s	sys 0.000s
I20260709 12:11:19.466498 18071 raft_consensus.cc:2749] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:19.444494 18275 raft_consensus.cc:3060] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:11:19.465348 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:19.456073 18155 consensus_queue.cc:1048] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.014s
I20260709 12:11:19.462432 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:19.480337 14186 raft_consensus.cc:2410] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 12:11:19.420392 18280 leader_election.cc:290] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 9 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:19.446992 18150 raft_consensus.cc:3060] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:11:19.499349 14185 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56046 (request call id 2201) took 2256 ms (client timeout 2833 ms). Trace:
W20260709 12:11:19.501475 14185 rpcz_store.cc:269] 0709 12:11:17.243343 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:17.528190 (+284847us) service_pool.cc:224] Handling call
0709 12:11:19.499085 (+1970895us) spinlock_profiling.cc:243] Waited 732 ms on lock 0x7b54003a48d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:11:19.499268 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1682466560}
W20260709 12:11:19.459342 14303 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:19.448400 18305 raft_consensus.cc:493] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
W20260709 12:11:19.518405 14305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:19.549594 18321 raft_consensus.cc:493] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:19.551146 18318 log.cc:927] Time spent T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.155s	user 0.000s	sys 0.001s
W20260709 12:11:19.552729 14228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:19.557979 18299 raft_consensus.cc:493] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:19.558609 18320 log.cc:927] Time spent T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 12:11:19.615005 18304 leader_election.cc:290] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:11:19.559067 14257 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41764 (request call id 2609) took 1802 ms (client timeout 1534 ms). Trace:
I20260709 12:11:19.560891 14262 raft_consensus.cc:1275] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 12:11:19.616504 14257 rpcz_store.cc:269] 0709 12:11:17.756402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:17.795520 (+ 39118us) service_pool.cc:224] Handling call
0709 12:11:19.558793 (+1763273us) spinlock_profiling.cc:243] Waited 340 ms on lock 0x7b54001c2d54. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:11:19.558972 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":782274816}
I20260709 12:11:19.652307 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:19.653237 14260 raft_consensus.cc:2468] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 12.
I20260709 12:11:19.564059 18241 raft_consensus.cc:493] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:19.564072 18303 leader_election.cc:290] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:19.565797 18207 leader_election.cc:290] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 10 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:19.566205 18236 raft_consensus.cc:493] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:19.566720 17848 leader_election.cc:290] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:19.567965 18307 leader_election.cc:290] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:19.568672 14910 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "afce5304599246a580d798fc0c843964"
dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
mode: GRACEFUL
new_leader_uuid: "885067a0d31741bfb5c9935788e315bf"
 from {username='slave'} at 127.0.0.1:38628
I20260709 12:11:19.570173 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
W20260709 12:11:19.569670 14877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:19.671867 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:19.571971 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:19.413007 18240 consensus_queue.cc:1059] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.090s
I20260709 12:11:19.409432 18120 consensus_queue.cc:1059] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.082s
I20260709 12:11:19.598385 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:19.612979 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:19.683948 14259 raft_consensus.cc:3060] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:19.684072 14910 raft_consensus.cc:606] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 9 LEADER]: Received request to transfer leadership to TS 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:19.661777 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
W20260709 12:11:19.662204 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 427147us
I20260709 12:11:19.668220 14256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53050 (request call id 722) took 1044 ms. Trace:
I20260709 12:11:19.669083 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:11:19.683794 14877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:19.685199 14330 raft_consensus.cc:2468] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 12.
W20260709 12:11:19.687747 14877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:19.659351 18268 consensus_meta.cc:287] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db: Time spent flushing consensus metadata: real 0.517s	user 0.009s	sys 0.002s
I20260709 12:11:19.685865 14256 rpcz_store.cc:276] 0709 12:11:18.623420 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:19.005810 (+382390us) service_pool.cc:224] Handling call
0709 12:11:19.013547 (+  7737us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:19.013795 (+   248us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:11:19.379756 (+365961us) log.cc:844] Serialized 14 byte log entry
0709 12:11:19.667150 (+287394us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:19.667210 (+    60us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:19.667271 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:19.668003 (+   732us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:19.668153 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":38097,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":2866,"thread_start_us":646821,"threads_started":2}
I20260709 12:11:19.690393 14264 raft_consensus.cc:2393] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db in current term 11: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:11:19.662823 18094 raft_consensus.cc:493] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:19.700894 14230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:19.704697 14230 leader_election.cc:304] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:19.574932 18305 raft_consensus.cc:515] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:19.738492 14259 raft_consensus.cc:2468] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 12.
I20260709 12:11:19.741259 14304 leader_election.cc:304] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:19.615097 18299 raft_consensus.cc:515] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:11:19.740736 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:19.711275 18120 consensus_queue.cc:1243] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer 73d01e9b1a9d49358da4985b21d681db log is divergent from this leader: its last log entry 11.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:11:19.750527 14911 raft_consensus.cc:2468] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 7.
I20260709 12:11:19.756814 14189 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 2588) took 1589 ms. Trace:
W20260709 12:11:19.721916 18214 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.641s	user 0.008s	sys 0.043s
I20260709 12:11:19.713197 18213 raft_consensus.cc:493] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
W20260709 12:11:19.733645 18178 consensus_meta.cc:287] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.791s	user 0.012s	sys 0.000s
I20260709 12:11:19.760015 14336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50856 (request call id 2092) took 2265 ms. Trace:
I20260709 12:11:19.648711 18321 raft_consensus.cc:515] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:19.669946 18241 raft_consensus.cc:515] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:19.694888 18153 leader_election.cc:290] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:19.761510 14336 rpcz_store.cc:276] 0709 12:11:17.491642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:17.493837 (+  2195us) service_pool.cc:224] Handling call
0709 12:11:17.519663 (+ 25826us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:18.404989 (+885326us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:19.756579 (+1351590us) spinlock_profiling.cc:243] Waited 880 ms on lock 0x7b540001ac54. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:11:19.756848 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2024559488}
I20260709 12:11:19.719959 17981 raft_consensus.cc:697] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 13 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:19.764254 14908 raft_consensus.cc:1240] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 9 LEADER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 8. Current term is 9. Ops: []
W20260709 12:11:19.764875 18323 log.cc:927] Time spent T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:11:19.765386 18298 leader_election.cc:290] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:19.691834 18236 raft_consensus.cc:515] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:19.765918 18178 raft_consensus.cc:515] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:19.719147 18268 consensus_queue.cc:1048] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 12:11:19.766600 18313 raft_consensus.cc:993] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db: : Instructing follower 885067a0d31741bfb5c9935788e315bf to start an election
I20260709 12:11:19.767439 18199 raft_consensus.cc:515] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:19.770573 18305 leader_election.cc:290] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:19.746625 18231 leader_election.cc:290] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:19.740888 18240 consensus_queue.cc:1243] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer 65c9c1653b3346b39a0e118540e6080c log is divergent from this leader: its last log entry 10.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:11:19.694841 17894 consensus_queue.cc:1059] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.061s
I20260709 12:11:19.716295 18151 consensus_queue.cc:1048] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
W20260709 12:11:19.757772 18214 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.677s	user 0.008s	sys 0.043s
I20260709 12:11:19.716714 18000 consensus_queue.cc:1048] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
W20260709 12:11:19.777938 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 223965us
I20260709 12:11:19.721407 18071 consensus_queue.cc:1048] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 12:11:19.722339 18094 raft_consensus.cc:515] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:19.791534 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:19.792732 14333 raft_consensus.cc:1240] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:19.891819 14333 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 694) took 1030 ms. Trace:
I20260709 12:11:19.892247 14333 rpcz_store.cc:276] 0709 12:11:18.861904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:18.865228 (+  3324us) service_pool.cc:224] Handling call
0709 12:11:19.792346 (+927118us) spinlock_profiling.cc:243] Waited 2.2 ms on lock 0x7b5800065d98. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2124016b71 00007f2124016eee 000000000036eb39 00007f212c08a1e0 00007f212c1530c4 00007f212c153131 00007f212c114fc0 00007f212c0ff929 00007f212c0ff3d2 00007f2125676bd4
0709 12:11:19.792542 (+   196us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:19.891449 (+ 98907us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:19.891739 (+   290us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5053312}
I20260709 12:11:19.724422 18324 consensus_queue.cc:1048] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.056s
I20260709 12:11:19.798065 14904 raft_consensus.cc:1275] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:11:19.799783 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:19.800024 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:19.757997 18183 consensus_queue.cc:1059] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 12:11:19.803118 14908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:11:19.779292 18207 raft_consensus.cc:493] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:11:19.833801 14331 raft_consensus.cc:1240] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 12. Current term is 13. Ops: [12.6-12.6]
W20260709 12:11:19.833696 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 139137us
W20260709 12:11:19.835085 14876 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:19.837139 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:19.838726 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:19.903394 14336 raft_consensus.cc:2393] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 9: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:11:19.841351 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:19.904621 14334 raft_consensus.cc:2410] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:11:19.842965 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:19.844779 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:11:19.846472 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 105322us
I20260709 12:11:19.906112 14338 raft_consensus.cc:2393] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 12: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
W20260709 12:11:19.847824 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 143272us
I20260709 12:11:19.907052 14230 leader_election.cc:304] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:19.874394 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:19.798426 18325 raft_consensus.cc:2749] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:19.775082 18213 raft_consensus.cc:515] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:19.830338 18313 raft_consensus.cc:1081] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 11 LEADER]: Signalling peer 885067a0d31741bfb5c9935788e315bf to start an election
I20260709 12:11:19.928660 14186 raft_consensus.cc:2410] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
W20260709 12:11:19.895022 14155 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:19.899435 14181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56044 (request call id 2597) took 1240 ms. Trace:
I20260709 12:11:19.907651 14908 raft_consensus.cc:2393] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 11: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
I20260709 12:11:19.909194 18207 raft_consensus.cc:515] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:19.930660 14912 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6"
dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
mode: GRACEFUL
new_leader_uuid: "17aab1bbf5014936aa18cc21818b26ec"
 from {username='slave'} at 127.0.0.1:38628
I20260709 12:11:19.931425 14912 raft_consensus.cc:606] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 10 LEADER]: Received request to transfer leadership to TS 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:11:19.902271 18305 raft_consensus.cc:493] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:19.932423 14258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41764 (request call id 2628) took 1312 ms. Trace:
I20260709 12:11:19.910224 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:19.929229 14181 rpcz_store.cc:276] 0709 12:11:18.658614 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:18.660138 (+  1524us) service_pool.cc:224] Handling call
0709 12:11:19.791329 (+1131191us) spinlock_profiling.cc:243] Waited 5.68 ms on lock 0x7b5800001298. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2124016b71 00007f2124016a22 00007f212cf2f8d9 00007f212c089ee0 00007f212c1530ab 00007f212c153131 00007f212c1010a0 00007f212c100984 00007f212567b6d4 00007f212567b662
0709 12:11:19.899338 (+108009us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13067008}
I20260709 12:11:19.909641 14335 raft_consensus.cc:2393] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 10: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
W20260709 12:11:19.897171 18297 log.cc:927] Time spent T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 12:11:19.898296 18214 raft_consensus.cc:493] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
W20260709 12:11:19.928838 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:19.929268 14155 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:19.934413 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:19.932796 14258 rpcz_store.cc:276] 0709 12:11:18.620409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:18.621884 (+  1475us) service_pool.cc:224] Handling call
0709 12:11:18.636090 (+ 14206us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:11:18.669656 (+ 33566us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:18.669688 (+    32us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:11:18.670390 (+   702us) log.cc:844] Serialized 78 byte log entry
0709 12:11:19.206560 (+536170us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:19.219112 (+ 12552us) log.cc:844] Serialized 14 byte log entry
0709 12:11:19.232659 (+ 13547us) log.cc:844] Serialized 14 byte log entry
0709 12:11:19.233067 (+   408us) log.cc:844] Serialized 14 byte log entry
0709 12:11:19.233249 (+   182us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:19.233327 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:19.563812 (+330485us) spinlock_profiling.cc:243] Waited 8.3 ms on lock 0x7b180040e6a0. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f212cf16ab1 00007f212cf23281 00007f212404e522 00007f21240507c1 00007f2124050779 00007f2124050709 00007f21240506d1 00007f212404f9cd 0000000000388634 0000000000388479 00007f212403183a
0709 12:11:19.569910 (+  6098us) spinlock_profiling.cc:243] Waited 11.7 ms on lock 0x7b48001b0258. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f212c064aa1 00007f212c05bb37 00007f212c05b9ca 00007f212c15326f 00007f212c152f37 00007f212c16755c 00007f212c167508 00007f212c167488 00007f212c167443 00007f212c1666ec 00007f212b090a96
0709 12:11:19.932190 (+362280us) raft_consensus.cc:1685] finished
0709 12:11:19.932212 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:19.932355 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":13389,"prepare.run_wall_time_us":7812,"raft.queue_time_us":2047,"raft.run_cpu_time_us":2922,"raft.run_wall_time_us":398177,"spinlock_wait_cycles":106670464,"thread_start_us":460331,"threads_started":1,"wal-append.queue_time_us":638587}
I20260709 12:11:19.939388 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:19.982506 12986 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:11:19.907274 17981 consensus_queue.cc:237] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:20.019160 14181 raft_consensus.cc:2468] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 9.
I20260709 12:11:20.028077 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:20.028725 14181 raft_consensus.cc:2468] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 11.
I20260709 12:11:20.029587 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:19.916792 17894 raft_consensus.cc:493] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:20.011865 18231 consensus_queue.cc:1059] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:20.013188 14155 leader_election.cc:304] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
W20260709 12:11:19.987138 18327 log.cc:927] Time spent T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.180s	user 0.000s	sys 0.001s
I20260709 12:11:19.986846 14877 leader_election.cc:304] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec
W20260709 12:11:20.126670 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 209541us
I20260709 12:11:20.125244 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:20.024226 12986 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:20.154084 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
W20260709 12:11:20.154590 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 141592us
W20260709 12:11:20.099225 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 192243us
I20260709 12:11:20.159041 14230 leader_election.cc:304] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
W20260709 12:11:20.154315 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 190746us
I20260709 12:11:19.941519 18305 raft_consensus.cc:515] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:20.156977 14183 raft_consensus.cc:2468] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 8.
I20260709 12:11:19.978096 18338 raft_consensus.cc:493] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
W20260709 12:11:20.049459 18330 log.cc:927] Time spent T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.128s	user 0.000s	sys 0.001s
I20260709 12:11:20.202620 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:20.211155 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:11:20.210289 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 48183.5us
I20260709 12:11:20.014217 18309 consensus_queue.cc:1048] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.184s
W20260709 12:11:20.092242 18329 log.cc:927] Time spent T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.262s	user 0.000s	sys 0.000s
W20260709 12:11:20.215185 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 58744.3us
I20260709 12:11:20.136586 18178 leader_election.cc:290] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 13 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:20.090713 18094 leader_election.cc:290] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:20.093381 18207 leader_election.cc:290] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:20.094548 18344 raft_consensus.cc:493] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
W20260709 12:11:20.213330 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 49699.3us
I20260709 12:11:20.246671 18354 raft_consensus.cc:2749] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:20.247545 18354 raft_consensus.cc:493] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:20.248057 18354 raft_consensus.cc:515] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:20.246981 14155 leader_election.cc:304] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:20.117656 18299 leader_election.cc:290] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:20.247992 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:20.091373 18321 leader_election.cc:290] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:20.123931 18241 leader_election.cc:290] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:11:20.221324 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 119735us
I20260709 12:11:20.090780 18199 leader_election.cc:290] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 10 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:19.964653 18214 raft_consensus.cc:515] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:20.223452 14181 raft_consensus.cc:2410] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for term 11 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:11:20.222267 18326 consensus_queue.cc:1048] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 12:11:20.124516 18236 leader_election.cc:290] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:20.231695 17957 leader_election.cc:290] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:20.163172 18342 raft_consensus.cc:2749] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:20.219929 18338 raft_consensus.cc:515] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:20.263265 18094 consensus_queue.cc:1048] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 12:11:20.162357 18275 raft_consensus.cc:2804] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:20.209045 18231 consensus_queue.cc:1243] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer 65c9c1653b3346b39a0e118540e6080c log is divergent from this leader: its last log entry 14.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:11:20.241714 14186 raft_consensus.cc:2410] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:11:20.217454 18348 raft_consensus.cc:493] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:20.244207 18316 consensus_queue.cc:1059] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 11.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 12:11:20.216152 18313 consensus_queue.cc:1048] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 12:11:20.220767 18234 consensus_queue.cc:1059] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
W20260709 12:11:20.252665 18180 consensus_meta.cc:287] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.755s	user 0.011s	sys 0.003s
I20260709 12:11:20.263880 18322 raft_consensus.cc:2749] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:20.268567 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:20.268990 18361 raft_consensus.cc:493] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:20.269153 18355 raft_consensus.cc:493] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:20.311170 18180 raft_consensus.cc:515] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:20.311321 18355 raft_consensus.cc:515] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:20.271996 14337 raft_consensus.cc:1275] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:11:20.314045 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:20.314716 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:20.315184 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:20.273485 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:20.274506 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:20.275592 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:20.276062 18214 leader_election.cc:290] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:20.242865 18359 raft_consensus.cc:493] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:20.256927 18207 raft_consensus.cc:493] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:20.189641 17894 raft_consensus.cc:515] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:20.260066 17987 raft_consensus.cc:3055] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:20.263549 18299 raft_consensus.cc:2749] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:11:20.277017 18337 log.cc:927] Time spent T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.142s	user 0.001s	sys 0.000s
I20260709 12:11:20.334211 18361 raft_consensus.cc:515] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:20.262986 18213 leader_election.cc:290] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:11:20.345338 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:20.345573 18338 leader_election.cc:290] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:20.313624 18180 leader_election.cc:290] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 12 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:20.346123 18361 leader_election.cc:290] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:11:20.283898 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 57258.5us
I20260709 12:11:20.283916 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:20.270627 18178 raft_consensus.cc:493] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:20.292169 18354 leader_election.cc:290] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:20.162824 18298 raft_consensus.cc:2749] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:11:20.294334 18231 raft_consensus.cc:493] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:20.354840 18231 raft_consensus.cc:515] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:20.355530 17983 leader_election.cc:290] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:20.343647 17987 raft_consensus.cc:740] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:20.357072 17987 consensus_queue.cc:260] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:20.358436 17987 raft_consensus.cc:3060] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:20.359457 14332 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50858 (request call id 1771) took 2970 ms (client timeout 1912 ms). Trace:
W20260709 12:11:20.361265 18356 log.cc:927] Time spent T 00000000000000000000000000000000 P d07070be2c074f4cb9ad35f1580c4ef7: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 12:11:20.285451 18150 consensus_meta.cc:287] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db: Time spent flushing consensus metadata: real 0.779s	user 0.013s	sys 0.000s
I20260709 12:11:20.283149 18241 consensus_queue.cc:1048] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 12:11:20.283835 18211 raft_consensus.cc:493] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:20.310775 18309 raft_consensus.cc:3055] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:20.313598 18355 leader_election.cc:290] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:20.346016 17894 leader_election.cc:290] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:20.309674 18275 raft_consensus.cc:697] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 13 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:11:20.331583 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:20.332362 14334 raft_consensus.cc:2410] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:11:20.257113 18344 raft_consensus.cc:515] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:20.429540 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:20.337634 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:20.430503 14338 raft_consensus.cc:2393] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 7: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
W20260709 12:11:20.306118 18328 log.cc:927] Time spent T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.323s	user 0.001s	sys 0.001s
I20260709 12:11:20.357308 18178 raft_consensus.cc:515] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:11:20.359894 14332 rpcz_store.cc:269] 0709 12:11:17.391592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:17.391764 (+   172us) service_pool.cc:224] Handling call
0709 12:11:20.359256 (+2967492us) spinlock_profiling.cc:243] Waited 1.63 s on lock 0x7b540010d1d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:11:20.359384 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3738430208}
I20260709 12:11:20.297564 14229 leader_election.cc:304] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:20.315376 18153 raft_consensus.cc:3055] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:20.330297 18350 raft_consensus.cc:493] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:20.392958 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:20.364346 18354 raft_consensus.cc:493] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:20.346835 18305 leader_election.cc:290] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:20.362607 18207 raft_consensus.cc:515] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } }
I20260709 12:11:20.343724 18359 raft_consensus.cc:515] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:20.425705 17983 raft_consensus.cc:493] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:20.308601 18348 raft_consensus.cc:515] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } }
I20260709 12:11:20.425993 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:11:20.425823 18360 log.cc:927] Time spent T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.063s	user 0.002s	sys 0.004s
I20260709 12:11:20.445155 14260 raft_consensus.cc:2410] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 12:11:20.426736 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:20.427189 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:20.446823 14265 raft_consensus.cc:3060] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:20.427295 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 268374us
I20260709 12:11:20.392822 14877 leader_election.cc:304] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec
W20260709 12:11:20.450819 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 58185.9us
I20260709 12:11:20.391896 18361 raft_consensus.cc:493] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:20.356964 18231 leader_election.cc:290] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:20.334865 14339 raft_consensus.cc:2468] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 12.
I20260709 12:11:20.431717 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:20.432123 18180 raft_consensus.cc:493] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:20.466480 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:20.432595 18211 raft_consensus.cc:515] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:20.433305 14337 raft_consensus.cc:1275] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 12:11:20.337579 18214 raft_consensus.cc:493] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:20.436570 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 164722us
I20260709 12:11:20.438488 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:20.393253 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:20.473565 14229 leader_election.cc:304] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:20.474243 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:20.454370 14230 leader_election.cc:304] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:20.458673 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:20.459846 14330 raft_consensus.cc:1275] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:11:20.458689 14336 raft_consensus.cc:2468] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 8.
I20260709 12:11:20.467489 14265 raft_consensus.cc:2468] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 10.
I20260709 12:11:20.470003 14337 pending_rounds.cc:85] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c: Aborting all ops after (but not including) 4
I20260709 12:11:20.433717 18309 raft_consensus.cc:740] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
W20260709 12:11:20.520236 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 65970.6us
I20260709 12:11:20.440068 18153 raft_consensus.cc:740] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:20.519368 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:11:20.521354 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 43799.8us
I20260709 12:11:20.523046 14337 pending_rounds.cc:107] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 12:11:20.467952 18151 raft_consensus.cc:2804] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:20.526201 14260 raft_consensus.cc:3060] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:20.524278 14337 raft_consensus.cc:2889] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:20.529670 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:20.527316 18151 raft_consensus.cc:493] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:20.449488 18354 raft_consensus.cc:515] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:20.520567 18213 raft_consensus.cc:2749] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:11:20.534377 14076 tablet_replica.cc:1411] Time spent flushing the Log queue took a long time: real 0.659s	user 0.000s	sys 0.000s
I20260709 12:11:20.455704 17983 raft_consensus.cc:515] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:20.524372 14230 leader_election.cc:304] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:20.466706 18361 raft_consensus.cc:515] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:20.477252 14229 leader_election.cc:304] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:20.472199 18180 raft_consensus.cc:515] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:11:20.556607 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 79414.2us
I20260709 12:11:20.557716 14229 leader_election.cc:304] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:20.549010 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:20.523612 18299 raft_consensus.cc:2749] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:20.519483 18214 raft_consensus.cc:515] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:20.443672 18350 raft_consensus.cc:515] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:20.530920 18363 raft_consensus.cc:2804] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:20.558573 14265 raft_consensus.cc:2468] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 10.
I20260709 12:11:20.566814 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:20.557602 14230 leader_election.cc:304] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:20.571434 14230 leader_election.cc:304] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:20.572969 14260 raft_consensus.cc:2468] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 13.
I20260709 12:11:20.544111 18316 raft_consensus.cc:493] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:20.551106 18151 raft_consensus.cc:3060] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:20.575423 14259 raft_consensus.cc:2468] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 9.
I20260709 12:11:20.575826 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:20.580441 14260 raft_consensus.cc:2468] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 12.
I20260709 12:11:20.581542 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:20.582485 14260 raft_consensus.cc:2468] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 7.
I20260709 12:11:20.583847 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:20.570541 18241 raft_consensus.cc:2804] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:20.575436 18094 raft_consensus.cc:2749] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:20.531314 18275 consensus_queue.cc:237] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:20.575192 18342 raft_consensus.cc:2749] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:20.577433 18299 raft_consensus.cc:2749] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:20.579768 18363 raft_consensus.cc:697] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 11 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:11:20.575028 18340 raft_consensus.cc:493] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:20.574432 18369 raft_consensus.cc:2804] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:20.581485 18316 raft_consensus.cc:515] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:20.571156 18309 consensus_queue.cc:260] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.4, Last appended by leader: 4, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:20.584249 18213 consensus_queue.cc:1048] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 12:11:20.598037 14230 leader_election.cc:304] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:20.586570 18241 raft_consensus.cc:493] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:20.598385 18340 raft_consensus.cc:515] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:20.591276 18354 leader_election.cc:290] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:11:20.668124 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 70542us
I20260709 12:11:20.591843 18344 leader_election.cc:290] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:20.587021 18236 consensus_queue.cc:1059] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.111s
I20260709 12:11:20.580137 18153 consensus_queue.cc:260] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:20.961000 18348 leader_election.cc:290] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187)
I20260709 12:11:20.806038 14262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41764 (request call id 2630) took 2185 ms. Trace:
W20260709 12:11:20.963629 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 365668us
I20260709 12:11:20.963399 14262 rpcz_store.cc:276] 0709 12:11:18.621071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:18.835854 (+214783us) service_pool.cc:224] Handling call
0709 12:11:19.560424 (+724570us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:19.616599 (+ 56175us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:20.805796 (+1189197us) spinlock_profiling.cc:243] Waited 709 ms on lock 0x7b54001c2d50. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713a8ad 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:11:20.805957 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1630233472}
I20260709 12:11:20.893630 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:20.967666 14256 raft_consensus.cc:2468] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 9.
W20260709 12:11:20.803663 14911 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53194 (request call id 888) took 1842 ms (client timeout 1598 ms). Trace:
W20260709 12:11:20.599964 18358 log.cc:927] Time spent T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.166s	user 0.000s	sys 0.001s
W20260709 12:11:20.969270 14911 rpcz_store.cc:269] 0709 12:11:18.961058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:18.963597 (+  2539us) service_pool.cc:224] Handling call
0709 12:11:20.803433 (+1839836us) spinlock_profiling.cc:243] Waited 702 ms on lock 0x7b54007760d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:11:20.803563 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1613687552}
I20260709 12:11:20.972077 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:20.595659 18369 raft_consensus.cc:493] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:20.973109 14155 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:20.976325 14230 leader_election.cc:304] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:20.601084 18211 leader_election.cc:290] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:11:20.742435 18373 log.cc:927] Time spent T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.146s	user 0.000s	sys 0.000s
I20260709 12:11:21.016292 14338 raft_consensus.cc:3055] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 10 LEADER]: Stepping down as leader of term 10
W20260709 12:11:20.702253 18366 log.cc:927] Time spent T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.247s	user 0.001s	sys 0.000s
I20260709 12:11:20.680218 18241 raft_consensus.cc:3060] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:20.741184 18280 raft_consensus.cc:3055] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:20.594851 18362 consensus_queue.cc:1059] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.415s
I20260709 12:11:20.986515 18309 raft_consensus.cc:3060] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:20.964152 18248 raft_consensus.cc:3060] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:20.714927 18266 raft_consensus.cc:493] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:20.939963 18160 raft_consensus.cc:493] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:21.019145 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:21.023823 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:21.010780 18234 raft_consensus.cc:493] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:20.738278 18180 leader_election.cc:290] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:21.021358 14229 leader_election.cc:400] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 election: Vote denied by peer 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341) with higher term. Message: Invalid argument: T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 12. Current term is 13.
I20260709 12:11:21.051573 14229 leader_election.cc:403] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 12:11:20.767948 18354 raft_consensus.cc:493] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:20.727871 18363 consensus_queue.cc:237] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:20.971243 18195 raft_consensus.cc:493] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:20.728463 18340 leader_election.cc:290] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:20.715432 18207 leader_election.cc:290] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:20.993235 18367 consensus_queue.cc:1059] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.074s
I20260709 12:11:21.015053 14230 leader_election.cc:304] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:20.991387 18168 raft_consensus.cc:3060] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:21.043109 18361 leader_election.cc:290] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:20.678609 18342 raft_consensus.cc:2749] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:21.016928 14338 raft_consensus.cc:740] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
W20260709 12:11:21.042083 14339 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.012s	sys 0.044s
W20260709 12:11:21.117419 14339 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.585s	user 0.013s	sys 0.044s
I20260709 12:11:21.048485 18214 leader_election.cc:290] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:11:21.043967 14263 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.015s	sys 0.063s
W20260709 12:11:21.118319 14263 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.585s	user 0.015s	sys 0.063s
I20260709 12:11:21.050655 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:21.033869 18280 raft_consensus.cc:740] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:11:21.050050 17983 leader_election.cc:290] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:21.011782 18213 consensus_queue.cc:1048] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 12:11:21.061851 14229 leader_election.cc:304] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
W20260709 12:11:21.125764 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 64013.4us
I20260709 12:11:21.127271 14229 leader_election.cc:304] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:21.041065 18316 leader_election.cc:290] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:20.982740 18369 raft_consensus.cc:3060] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:21.123556 14256 raft_consensus.cc:2393] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 12: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:11:21.129652 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:21.117982 14338 consensus_queue.cc:260] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:21.131915 14338 raft_consensus.cc:3060] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:21.111894 18362 raft_consensus.cc:3060] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:21.134048 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:21.051577 18266 raft_consensus.cc:515] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:21.121052 18361 raft_consensus.cc:2749] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:21.126606 18367 consensus_queue.cc:1243] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer 73d01e9b1a9d49358da4985b21d681db log is divergent from this leader: its last log entry 9.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:11:21.192732 14185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 2607) took 1743 ms. Trace:
I20260709 12:11:21.132411 18236 raft_consensus.cc:2749] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:21.201519 14262 raft_consensus.cc:2468] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 7.
I20260709 12:11:21.132817 18342 raft_consensus.cc:2749] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:21.052501 18160 raft_consensus.cc:515] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:21.104048 18354 raft_consensus.cc:515] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:21.055299 18234 raft_consensus.cc:515] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:21.111554 18195 raft_consensus.cc:515] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:21.214121 14185 rpcz_store.cc:276] 0709 12:11:19.449427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:20.246848 (+797421us) service_pool.cc:224] Handling call
0709 12:11:20.247290 (+   442us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:20.251685 (+  4395us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:20.251721 (+    36us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:20.252365 (+   644us) log.cc:844] Serialized 52 byte log entry
0709 12:11:20.292940 (+ 40575us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:20.292989 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:20.293071 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:21.136566 (+843495us) raft_consensus.cc:1685] finished
0709 12:11:21.136589 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:21.192626 (+ 56037us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3808,"raft.queue_time_us":8788,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":120,"thread_start_us":12282,"threads_started":1,"wal-append.queue_time_us":81999}
I20260709 12:11:21.258877 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:21.249527 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:21.251294 14338 raft_consensus.cc:1275] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:11:21.262743 14262 raft_consensus.cc:2468] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 7.
I20260709 12:11:21.260887 14877 leader_election.cc:304] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:21.264163 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:21.265758 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:21.259724 14185 raft_consensus.cc:2468] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 10.
W20260709 12:11:21.251299 18374 log.cc:927] Time spent T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.446s	user 0.002s	sys 0.000s
W20260709 12:11:21.270859 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 255888us
I20260709 12:11:21.269706 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:21.268503 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:21.271833 14230 leader_election.cc:304] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:21.271963 14185 raft_consensus.cc:2393] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 10: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:11:21.277025 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:21.280964 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:21.282970 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:21.284184 14185 raft_consensus.cc:2468] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 9.
I20260709 12:11:21.285301 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:21.276587 18266 leader_election.cc:290] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:21.271963 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:21.287703 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:21.286849 14185 raft_consensus.cc:2468] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 9.
I20260709 12:11:21.290442 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:21.294425 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:21.294950 14262 raft_consensus.cc:2393] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 12: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:11:21.295274 14304 leader_election.cc:304] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:21.295163 14911 raft_consensus.cc:2468] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 7.
I20260709 12:11:21.296169 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:21.296892 14262 raft_consensus.cc:2468] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 10.
I20260709 12:11:21.297907 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:21.298986 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:21.302676 14304 leader_election.cc:304] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:21.305163 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:21.270563 18214 raft_consensus.cc:493] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
W20260709 12:11:21.306933 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 179788us
I20260709 12:11:21.209075 18380 consensus_queue.cc:1048] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.143s
I20260709 12:11:21.273706 18340 raft_consensus.cc:2804] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:21.310380 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:21.307637 14304 leader_election.cc:304] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:11:21.317880 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:21.316843 14304 leader_election.cc:304] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:11:21.318923 14185 raft_consensus.cc:2468] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 11.
I20260709 12:11:21.292181 18344 raft_consensus.cc:493] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:21.291879 17983 raft_consensus.cc:493] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:11:21.303419 18342 raft_consensus.cc:2749] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:21.296324 18266 raft_consensus.cc:493] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:21.251416 18280 consensus_queue.cc:260] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:21.308732 17987 raft_consensus.cc:2749] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:21.306546 18326 raft_consensus.cc:2749] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:21.330816 14155 leader_election.cc:304] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:21.333076 14184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 2610) took 1875 ms. Trace:
I20260709 12:11:21.315521 18313 raft_consensus.cc:493] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:21.326556 18340 raft_consensus.cc:697] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 12 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:11:21.422989 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:21.423843 14188 raft_consensus.cc:2468] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 12.
I20260709 12:11:21.377826 18195 leader_election.cc:290] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:21.378005 18342 consensus_queue.cc:1048] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:11:21.371587 14184 rpcz_store.cc:276] 0709 12:11:19.458093 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:20.435880 (+977787us) service_pool.cc:224] Handling call
0709 12:11:20.442862 (+  6982us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:20.443111 (+   249us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:20.443143 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:20.455301 (+ 12158us) log.cc:844] Serialized 26 byte log entry
0709 12:11:20.580860 (+125559us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:20.581284 (+   424us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:20.581355 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:21.332795 (+751440us) raft_consensus.cc:1685] finished
0709 12:11:21.332823 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:21.332994 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":60903,"threads_started":1,"wal-append.queue_time_us":183748}
I20260709 12:11:21.424495 18313 raft_consensus.cc:515] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:11:21.379302 18378 log.cc:927] Time spent T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.125s	user 0.000s	sys 0.001s
I20260709 12:11:21.425928 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:21.365913 18266 raft_consensus.cc:515] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:21.381865 18280 raft_consensus.cc:3060] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:21.428337 18266 leader_election.cc:290] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:21.385872 18234 leader_election.cc:290] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:21.429499 14258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41764 (request call id 2641) took 1001 ms. Trace:
I20260709 12:11:21.365100 18207 raft_consensus.cc:2804] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:21.391462 18211 raft_consensus.cc:3055] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:21.391705 18306 raft_consensus.cc:493] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:21.366314 17983 raft_consensus.cc:515] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:11:21.392624 18383 log.cc:927] Time spent T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.152s	user 0.000s	sys 0.000s
I20260709 12:11:21.395212 14190 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 2603) took 2215 ms. Trace:
I20260709 12:11:21.396338 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:21.399773 18359 leader_election.cc:290] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:21.432966 14187 raft_consensus.cc:2410] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:11:21.400552 17848 raft_consensus.cc:3055] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:21.430006 14258 rpcz_store.cc:276] 0709 12:11:20.428238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:20.460125 (+ 31887us) service_pool.cc:224] Handling call
0709 12:11:20.473796 (+ 13671us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:20.474152 (+   356us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:20.474183 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:20.474549 (+   366us) log.cc:844] Serialized 26 byte log entry
0709 12:11:20.595697 (+121148us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:21.131378 (+535681us) log.cc:844] Serialized 14 byte log entry
0709 12:11:21.131638 (+   260us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:21.131728 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:21.426972 (+295244us) spinlock_profiling.cc:243] Waited 6.8 ms on lock 0x7b180040e760. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f212cf16ab1 00007f212cf23281 00007f212404e3f3 00007f21240507c1 00007f2124050779 00007f2124050709 00007f21240506d1 00007f212404f9cd 0000000000388634 0000000000388479 00007f212403183a
0709 12:11:21.429157 (+  2185us) raft_consensus.cc:1685] finished
0709 12:11:21.429269 (+   112us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:21.429422 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6613,"prepare.queue_time_us":677003,"prepare.run_cpu_time_us":87,"prepare.run_wall_time_us":4266,"raft.queue_time_us":143536,"raft.run_cpu_time_us":460,"raft.run_wall_time_us":57896,"spinlock_wait_cycles":15631616,"thread_start_us":221544,"threads_started":2,"wal-append.queue_time_us":118224}
I20260709 12:11:19.757349 14189 rpcz_store.cc:276] 0709 12:11:18.167872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:18.280535 (+112663us) service_pool.cc:224] Handling call
0709 12:11:18.280830 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:18.281049 (+   219us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:11:18.517394 (+236345us) log.cc:844] Serialized 14 byte log entry
0709 12:11:19.439835 (+922441us) spinlock_profiling.cc:243] Waited 17.7 ms on lock 0x7b180009f7c0. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f212cf16ab1 00007f212cf23281 00007f2126ce34bc 00007f212403148b 00007f212ce8b9a9 00007f212404d69b 00007f212404b93f 00007f212404b455 00007f2127133060 00007f2127145716 00007f2127156287
0709 12:11:19.723758 (+283923us) log.cc:844] Serialized 14 byte log entry
0709 12:11:19.741559 (+ 17801us) log.cc:844] Serialized 14 byte log entry
0709 12:11:19.741819 (+   260us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:19.741865 (+    46us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:19.741914 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:19.741983 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:19.756737 (+ 14754us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33340,"prepare.queue_time_us":65510,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":57,"raft.queue_time_us":118240,"raft.run_cpu_time_us":419,"raft.run_wall_time_us":20743,"spinlock_wait_cycles":40711040,"thread_start_us":704134,"threads_started":4,"wal-append.queue_time_us":176698}
W20260709 12:11:21.415936 18155 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 11 current term: 11 is higher.
I20260709 12:11:21.418434 18178 leader_election.cc:290] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:21.422073 18392 raft_consensus.cc:2804] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:21.423378 18340 consensus_queue.cc:237] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:21.458854 14258 raft_consensus.cc:1275] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:21.431294 18211 raft_consensus.cc:740] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:11:21.320616 18214 raft_consensus.cc:515] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:21.403961 18341 consensus_queue.cc:1048] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:21.432065 14190 rpcz_store.cc:276] 0709 12:11:19.179394 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:19.207724 (+ 28330us) service_pool.cc:224] Handling call
0709 12:11:19.233164 (+ 25440us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:19.381043 (+147879us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:19.381089 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:19.381781 (+   692us) log.cc:844] Serialized 52 byte log entry
0709 12:11:19.687311 (+305530us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:11:19.687359 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:21.394798 (+1707439us) spinlock_profiling.cc:243] Waited 147 ms on lock 0x7b540019b9d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:11:21.394849 (+    51us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:21.394889 (+    40us) raft_consensus.cc:1685] finished
0709 12:11:21.394900 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:21.395138 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":975,"raft.run_cpu_time_us":439,"raft.run_wall_time_us":9439,"spinlock_wait_cycles":339064192,"thread_start_us":258077,"threads_started":1,"wal-append.queue_time_us":369798,"wal-append.run_cpu_time_us":18575,"wal-append.run_wall_time_us":1469766}
W20260709 12:11:21.441284 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 110587us
I20260709 12:11:21.412596 14259 raft_consensus.cc:1275] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:11:21.447796 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:21.362509 18367 raft_consensus.cc:493] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:21.453296 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 136555us
I20260709 12:11:21.457336 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:21.487701 14304 leader_election.cc:304] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:11:21.487872 14184 raft_consensus.cc:2410] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:11:21.488791 14259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41764 (request call id 2647) took 1048 ms. Trace:
I20260709 12:11:21.487936 14258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41764 (request call id 2648) took 1046 ms. Trace:
I20260709 12:11:21.431666 18306 raft_consensus.cc:515] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:21.495586 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:21.494994 14910 raft_consensus.cc:1275] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:11:21.494562 14259 rpcz_store.cc:276] 0709 12:11:20.440163 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:21.411798 (+971635us) service_pool.cc:224] Handling call
0709 12:11:21.412209 (+   411us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:21.488512 (+ 76303us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:21.488733 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:21.495160 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:21.491928 14155 leader_election.cc:304] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:21.446807 17848 raft_consensus.cc:740] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:11:21.493682 14258 rpcz_store.cc:276] 0709 12:11:20.441728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:21.453318 (+1011590us) service_pool.cc:224] Handling call
0709 12:11:21.454197 (+   879us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:21.461057 (+  6860us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:21.487858 (+ 26801us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:21.500504 14912 raft_consensus.cc:2393] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 7: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:11:21.345811 18344 raft_consensus.cc:515] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:21.503383 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:21.505597 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:21.506335 14338 raft_consensus.cc:2468] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 10.
I20260709 12:11:21.506877 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:21.507285 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:21.507927 14338 raft_consensus.cc:2468] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 10.
I20260709 12:11:21.508092 14332 raft_consensus.cc:1240] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:11:21.508829 14230 leader_election.cc:304] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:11:21.462728 18266 raft_consensus.cc:493] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:21.459925 18392 raft_consensus.cc:493] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:21.506050 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:21.512084 14184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56652 (request call id 960) took 1845 ms. Trace:
I20260709 12:11:21.432289 18389 consensus_queue.cc:1048] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.126s
I20260709 12:11:21.471071 18313 leader_election.cc:290] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:21.486016 18361 raft_consensus.cc:2749] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:21.516811 14259 raft_consensus.cc:1240] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:21.462981 18234 raft_consensus.cc:493] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:21.514374 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:21.526850 14911 raft_consensus.cc:2468] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 12.
I20260709 12:11:21.527984 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:21.511561 18155 raft_consensus.cc:2804] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:21.457482 18207 raft_consensus.cc:697] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 10 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:21.516315 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:21.462246 18390 raft_consensus.cc:2804] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:21.490363 18379 raft_consensus.cc:493] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:21.519945 14229 leader_election.cc:304] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:21.520552 14230 leader_election.cc:304] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:11:21.530984 14336 raft_consensus.cc:2468] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 9.
I20260709 12:11:21.513514 14184 rpcz_store.cc:276] 0709 12:11:19.666389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:21.502824 (+1836435us) service_pool.cc:224] Handling call
0709 12:11:21.511472 (+  8648us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:21.511702 (+   230us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:21.511744 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:21.511793 (+    49us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:21.511835 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:21.511894 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:21.512011 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:21.521886 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:21.513943 18392 raft_consensus.cc:3060] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:21.542021 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
W20260709 12:11:21.543910 18365 log.cc:927] Time spent T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 1.102s	user 0.002s	sys 0.000s
I20260709 12:11:21.545517 14182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56046 (request call id 2216) took 3541 ms. Trace:
I20260709 12:11:21.545964 14182 rpcz_store.cc:276] 0709 12:11:18.004142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:18.276195 (+272053us) service_pool.cc:224] Handling call
0709 12:11:18.276500 (+   305us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:19.374185 (+1097685us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:21.545224 (+2171039us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b54003d0254. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:11:21.545447 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2498462464}
I20260709 12:11:21.547683 14182 raft_consensus.cc:1275] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:11:21.548292 14182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56046 (request call id 2224) took 1754 ms. Trace:
I20260709 12:11:21.548592 14182 rpcz_store.cc:276] 0709 12:11:19.794323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:21.546958 (+1752635us) service_pool.cc:224] Handling call
0709 12:11:21.547328 (+   370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:21.548043 (+   715us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:21.548231 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:21.537849 18393 raft_consensus.cc:493] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:21.550398 18307 raft_consensus.cc:3055] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:21.551030 18307 raft_consensus.cc:740] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:11:21.551899 18307 consensus_queue.cc:260] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:21.552629 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:11:21.520586 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 244644us
I20260709 12:11:21.554526 14264 raft_consensus.cc:2468] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 9.
I20260709 12:11:21.523882 14259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41764 (request call id 2649) took 1081 ms. Trace:
I20260709 12:11:21.520897 18396 raft_consensus.cc:2804] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:21.516149 18266 raft_consensus.cc:515] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:21.532202 14912 raft_consensus.cc:1240] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 9 LEADER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:11:21.499864 18367 raft_consensus.cc:515] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:21.532696 18344 leader_election.cc:290] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:11:21.533452 18151 consensus_meta.cc:287] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db: Time spent flushing consensus metadata: real 0.947s	user 0.012s	sys 0.001s
I20260709 12:11:21.576072 18151 raft_consensus.cc:515] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:11:21.576967 18357 log.cc:927] Time spent T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 1.151s	user 0.003s	sys 0.000s
I20260709 12:11:21.578473 18151 leader_election.cc:290] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 13 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:21.533891 18211 consensus_queue.cc:260] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:21.579424 18211 raft_consensus.cc:3060] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:21.579840 18399 raft_consensus.cc:2804] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:21.580343 18399 raft_consensus.cc:493] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:21.580714 18399 raft_consensus.cc:3060] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:21.520777 14190 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56652 (request call id 959) took 1951 ms. Trace:
I20260709 12:11:21.582293 14264 raft_consensus.cc:1240] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:21.582999 14264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41764 (request call id 2655) took 1058 ms. Trace:
I20260709 12:11:21.522322 14155 leader_election.cc:304] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:21.581972 14190 rpcz_store.cc:276] 0709 12:11:19.569465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:21.491439 (+1921974us) service_pool.cc:224] Handling call
0709 12:11:21.520196 (+ 28757us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:21.520417 (+   221us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:21.520444 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:21.520486 (+    42us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:21.520526 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:21.520589 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:21.520712 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:21.513444 18380 raft_consensus.cc:2804] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:21.583312 14264 rpcz_store.cc:276] 0709 12:11:20.524433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:21.557084 (+1032651us) service_pool.cc:224] Handling call
0709 12:11:21.582124 (+ 25040us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:21.582732 (+   608us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:21.582933 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:11:21.565112 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 44625.8us
W20260709 12:11:21.565725 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 45863us
I20260709 12:11:21.538069 18390 raft_consensus.cc:493] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:21.555884 18155 raft_consensus.cc:697] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 13 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:21.550348 18393 raft_consensus.cc:515] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:21.559906 18396 raft_consensus.cc:493] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:21.573608 18391 raft_consensus.cc:2804] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:21.575096 18362 raft_consensus.cc:2749] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341) with higher term. Message: Invalid argument: T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 12. Current term is 13.
I20260709 12:11:21.556778 14259 rpcz_store.cc:276] 0709 12:11:20.442788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:21.502388 (+1059600us) service_pool.cc:224] Handling call
0709 12:11:21.516604 (+ 14216us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:21.523595 (+  6991us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:21.523815 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:21.552978 18307 raft_consensus.cc:3060] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:21.565491 14184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56652 (request call id 961) took 1716 ms. Trace:
I20260709 12:11:21.538617 18160 leader_election.cc:290] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:21.585613 14229 leader_election.cc:304] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:21.604362 14190 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56652 (request call id 962) took 1754 ms. Trace:
I20260709 12:11:21.604539 14184 rpcz_store.cc:276] 0709 12:11:19.849610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:21.555250 (+1705640us) service_pool.cc:224] Handling call
0709 12:11:21.564942 (+  9692us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:21.565151 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:21.565181 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:21.565226 (+    45us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:21.565267 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:21.565324 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:21.565429 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:21.604852 14190 rpcz_store.cc:276] 0709 12:11:19.850026 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:21.603454 (+1753428us) service_pool.cc:224] Handling call
0709 12:11:21.603805 (+   351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:21.603990 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:21.604016 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:21.604060 (+    44us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:21.604099 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:21.604171 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:21.604298 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:21.606252 14229 leader_election.cc:304] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:21.607581 14229 leader_election.cc:304] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:21.584656 14189 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56652 (request call id 958) took 2031 ms. Trace:
I20260709 12:11:21.585922 14230 leader_election.cc:304] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:21.609931 14189 rpcz_store.cc:276] 0709 12:11:19.553464 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:21.462227 (+1908763us) service_pool.cc:224] Handling call
0709 12:11:21.498856 (+ 36629us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:21.582281 (+ 83425us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:21.582311 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:21.582358 (+    47us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:21.582404 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:21.584414 (+  2010us) spinlock_profiling.cc:243] Waited 83.1 ms on lock 0x7b540028afd4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:11:21.584461 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:21.584592 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2806,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":5707,"spinlock_wait_cycles":191071488}
I20260709 12:11:21.611848 14230 leader_election.cc:304] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
W20260709 12:11:21.588621 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 190960us
I20260709 12:11:21.530530 18234 raft_consensus.cc:515] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:21.562003 18354 leader_election.cc:290] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:21.587595 18380 raft_consensus.cc:493] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:21.579607 18367 leader_election.cc:290] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:21.530050 17848 consensus_queue.cc:260] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:21.552939 18207 consensus_queue.cc:237] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:21.603261 18391 raft_consensus.cc:493] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:21.667732 14182 raft_consensus.cc:1240] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:21.601357 18396 raft_consensus.cc:3060] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:21.591812 18390 raft_consensus.cc:3060] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:21.668071 14876 leader_election.cc:304] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:21.619541 18160 raft_consensus.cc:493] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:21.676587 14076 maintenance_manager.cc:643] P d07070be2c074f4cb9ad35f1580c4ef7: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 10.272s	user 0.237s	sys 0.083s Metrics: {"bytes_written":30348,"cfile_init":1,"delete_count":0,"dirs.queue_time_us":181681,"dirs.run_cpu_time_us":388,"dirs.run_wall_time_us":5112,"drs_written":1,"lbm_read_time_us":430,"lbm_reads_lt_1ms":4,"lbm_write_time_us":315934,"lbm_writes_1-10_ms":6,"lbm_writes_10-100_ms":8,"lbm_writes_lt_1ms":20,"peak_mem_usage":0,"reinsert_count":0,"rows_written":63,"thread_start_us":100473,"threads_started":1,"update_count":14}
I20260709 12:11:21.626817 18380 raft_consensus.cc:3060] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:21.618213 18359 raft_consensus.cc:2804] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:21.590330 18392 raft_consensus.cc:515] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:21.664878 18354 raft_consensus.cc:2749] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:21.617112 18402 raft_consensus.cc:2804] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:21.735047 14258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41764 (request call id 2651) took 1267 ms. Trace:
I20260709 12:11:21.738453 14258 rpcz_store.cc:276] 0709 12:11:20.467246 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:21.499048 (+1031802us) service_pool.cc:224] Handling call
0709 12:11:21.499428 (+   380us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:21.499857 (+   429us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:21.499888 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:21.500449 (+   561us) log.cc:844] Serialized 26 byte log entry
0709 12:11:21.593817 (+ 93368us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:11:21.593858 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:21.593923 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:21.734756 (+140833us) raft_consensus.cc:1685] finished
0709 12:11:21.734782 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:21.734965 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4675,"raft.queue_time_us":1172,"raft.run_cpu_time_us":179,"raft.run_wall_time_us":13607,"thread_start_us":93001,"threads_started":1,"wal-append.queue_time_us":203999}
I20260709 12:11:21.619181 14190 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 2615) took 1705 ms. Trace:
I20260709 12:11:21.556107 18379 raft_consensus.cc:515] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:21.666338 14184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56652 (request call id 963) took 1759 ms. Trace:
I20260709 12:11:21.617808 18168 raft_consensus.cc:2804] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:21.669456 18155 consensus_queue.cc:237] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:21.665972 17983 leader_election.cc:290] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:11:21.703900 18248 consensus_meta.cc:287] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.655s	user 0.010s	sys 0.000s
I20260709 12:11:21.679021 18266 leader_election.cc:290] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:21.686149 18401 raft_consensus.cc:493] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
W20260709 12:11:21.741365 14303 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:21.741837 14258 raft_consensus.cc:1240] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:21.782441 14258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41768 (request call id 1764) took 1216 ms. Trace:
I20260709 12:11:21.782852 14258 rpcz_store.cc:276] 0709 12:11:20.565942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:21.740183 (+1174241us) service_pool.cc:224] Handling call
0709 12:11:21.741619 (+  1436us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:21.782062 (+ 40443us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:21.782353 (+   291us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:21.785542 17983 consensus_queue.cc:1059] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:21.786792 17983 raft_consensus.cc:3055] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:21.787173 17983 raft_consensus.cc:740] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:21.788249 17983 consensus_queue.cc:260] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:21.790385 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:11:21.791320 14910 raft_consensus.cc:2376] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 7. Re-sending same reply.
I20260709 12:11:21.793442 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:21.671779 18381 raft_consensus.cc:493] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:21.796010 18381 raft_consensus.cc:515] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:21.801949 14181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 2609) took 2347 ms. Trace:
I20260709 12:11:21.802527 14181 rpcz_store.cc:276] 0709 12:11:19.454459 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:20.269855 (+815396us) service_pool.cc:224] Handling call
0709 12:11:20.270203 (+   348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:20.270420 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:11:20.276221 (+  5801us) log.cc:844] Serialized 14 byte log entry
0709 12:11:21.543489 (+1267268us) spinlock_profiling.cc:243] Waited 47.9 ms on lock 0x7b2400177668. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2123ed49c4 00007f2123ed2acb 00007f212408ddc9 00007f212408da55 00007f212408d09d 00007f2126cbf10e 00007f2126cd688c 00007f2126cd5bb6 00007f2126cd57d8 00007f2126cdf221
0709 12:11:21.800941 (+257452us) spinlock_profiling.cc:243] Waited 14 ms on lock 0x7b1800456dc0. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f212cf16ab1 00007f212cf23281 00007f2126ce34bc 00007f212403148b 00007f212ce8b9a9 00007f212404d69b 00007f212404b93f 00007f212404dc02 00007f2126cd520b 00007f2126cdad23 00007f2126cdb23a
0709 12:11:21.801433 (+   492us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:21.801518 (+    85us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:21.801590 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:21.801681 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:21.801865 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":5942,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"spinlock_wait_cycles":142348928,"thread_start_us":16234,"threads_started":1,"wal-append.queue_time_us":138887}
I20260709 12:11:21.804435 14181 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af"
dest_uuid: "885067a0d31741bfb5c9935788e315bf"
 from {username='slave'} at 127.0.0.1:56652
I20260709 12:11:21.744905 14184 rpcz_store.cc:276] 0709 12:11:19.907457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:21.617380 (+1709923us) service_pool.cc:224] Handling call
0709 12:11:21.665769 (+ 48389us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:21.665974 (+   205us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:21.665999 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:21.666044 (+    45us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:21.666084 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:21.666138 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:21.666267 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1824640}
I20260709 12:11:21.815557 18350 leader_election.cc:290] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:21.741365 14190 rpcz_store.cc:276] 0709 12:11:19.914227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:21.618106 (+1703879us) service_pool.cc:224] Handling call
0709 12:11:21.618591 (+   485us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:21.618783 (+   192us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:21.618807 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:21.618850 (+    43us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:11:21.618883 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:21.618941 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:21.619100 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:21.817821 14190 raft_consensus.cc:1240] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 12:11:21.818037 18299 raft_consensus.cc:3055] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:21.818647 18299 raft_consensus.cc:740] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:11:21.617357 18213 raft_consensus.cc:2749] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:21.820277 18299 consensus_queue.cc:260] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:21.822204 18299 raft_consensus.cc:3060] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:21.687466 18391 raft_consensus.cc:3060] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:21.825521 18153 raft_consensus.cc:3060] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:21.775152 14335 raft_consensus.cc:2393] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 11: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:11:21.781451 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:21.829537 14261 raft_consensus.cc:1240] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:21.830359 14261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41768 (request call id 1766) took 1260 ms. Trace:
I20260709 12:11:21.830722 14261 rpcz_store.cc:276] 0709 12:11:20.569935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:21.828981 (+1259046us) service_pool.cc:224] Handling call
0709 12:11:21.829342 (+   361us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:21.830080 (+   738us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:21.830294 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:21.831993 14261 raft_consensus.cc:1240] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:21.832713 14261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41768 (request call id 1767) took 1259 ms. Trace:
I20260709 12:11:21.833005 14261 rpcz_store.cc:276] 0709 12:11:20.573217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:21.831468 (+1258251us) service_pool.cc:224] Handling call
0709 12:11:21.831789 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:21.832463 (+   674us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:21.832656 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:21.829703 14334 raft_consensus.cc:2393] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db in current term 12: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:11:21.836230 14261 raft_consensus.cc:1240] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:21.837085 14261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41768 (request call id 1769) took 1263 ms. Trace:
I20260709 12:11:21.837435 14261 rpcz_store.cc:276] 0709 12:11:20.573757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:21.835717 (+1261960us) service_pool.cc:224] Handling call
0709 12:11:21.836021 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:21.836816 (+   795us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:21.837020 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:21.838830 14261 raft_consensus.cc:1240] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:21.839670 14261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41768 (request call id 1771) took 1261 ms. Trace:
I20260709 12:11:21.840015 14261 rpcz_store.cc:276] 0709 12:11:20.578587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:21.838272 (+1259685us) service_pool.cc:224] Handling call
0709 12:11:21.838663 (+   391us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:21.839332 (+   669us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:21.839604 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:21.844628 14182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56046 (request call id 2229) took 2033 ms. Trace:
I20260709 12:11:21.845199 14182 rpcz_store.cc:276] 0709 12:11:19.810916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:21.549304 (+1738388us) service_pool.cc:224] Handling call
0709 12:11:21.549641 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:21.670514 (+120873us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:21.844268 (+173754us) spinlock_profiling.cc:243] Waited 118 ms on lock 0x7b54002d1254. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:11:21.844528 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":271133568}
I20260709 12:11:21.860894 14338 raft_consensus.cc:2468] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 12.
I20260709 12:11:21.866633 14330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50858 (request call id 1797) took 1594 ms. Trace:
I20260709 12:11:21.867205 14330 rpcz_store.cc:276] 0709 12:11:20.272231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:20.272350 (+   119us) service_pool.cc:224] Handling call
0709 12:11:20.272622 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:20.524588 (+251966us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:21.843875 (+1319287us) spinlock_profiling.cc:243] Waited 187 ms on lock 0x7b54000fc8d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:11:21.866565 (+ 22690us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":429627136}
I20260709 12:11:21.866654 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:21.874053 18348 raft_consensus.cc:3055] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:21.874608 18348 raft_consensus.cc:740] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:11:21.875648 18348 consensus_queue.cc:260] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:21.877013 18348 raft_consensus.cc:3060] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:21.884323 14333 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 706) took 1431 ms. Trace:
I20260709 12:11:21.884793 14333 rpcz_store.cc:276] 0709 12:11:20.452862 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:20.453933 (+  1071us) service_pool.cc:224] Handling call
0709 12:11:20.472340 (+ 18407us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:20.578869 (+106529us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:20.578902 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:20.578948 (+    46us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:20.578990 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:21.884030 (+1305040us) spinlock_profiling.cc:243] Waited 106 ms on lock 0x7b540047e354. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:11:21.884084 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:21.884250 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":244481792}
W20260709 12:11:21.886723 14186 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56046 (request call id 2227) took 2076 ms (client timeout 1636 ms). Trace:
W20260709 12:11:21.887200 14186 rpcz_store.cc:269] 0709 12:11:19.810281 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:19.938936 (+128655us) service_pool.cc:224] Handling call
0709 12:11:21.886490 (+1947554us) spinlock_profiling.cc:243] Waited 230 ms on lock 0x7b54003b1854. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:11:21.886648 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":528505216}
I20260709 12:11:21.888397 18306 leader_election.cc:290] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:11:21.886891 14305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:21.893285 14304 leader_election.cc:304] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:11:21.894119 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:21.894220 18000 consensus_queue.cc:1048] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:11:21.895082 18326 raft_consensus.cc:2804] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:21.895551 18326 raft_consensus.cc:493] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:21.895908 18326 raft_consensus.cc:3060] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:21.896100 18178 consensus_queue.cc:1048] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:21.899168 14256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41768 (request call id 1783) took 1051 ms. Trace:
I20260709 12:11:21.899596 14256 rpcz_store.cc:276] 0709 12:11:20.847675 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:20.979936 (+132261us) service_pool.cc:224] Handling call
0709 12:11:21.898955 (+919019us) spinlock_profiling.cc:243] Waited 73.7 ms on lock 0x7b54001b1cd4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:11:21.899100 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":169415424}
I20260709 12:11:21.900840 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:11:21.901535 14910 raft_consensus.cc:3060] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:21.906575 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:21.908362 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:21.907852 18326 raft_consensus.cc:515] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:21.695919 17848 raft_consensus.cc:3060] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:21.710364 18403 raft_consensus.cc:2804] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:21.625330 18342 consensus_queue.cc:1059] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.126s
W20260709 12:11:21.949618 14303 connection.cc:256] RPC call timeout handler was delayed by -1.1393833550000636s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2207s for a response
I20260709 12:11:21.909282 14331 raft_consensus.cc:2410] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db for term 16 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 12:11:21.698634 18234 leader_election.cc:290] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:21.704356 18393 leader_election.cc:290] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:21.741415 18402 raft_consensus.cc:493] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:21.701239 18214 leader_election.cc:290] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:21.931602 14261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41768 (request call id 1779) took 1228 ms. Trace:
I20260709 12:11:21.980690 14261 rpcz_store.cc:276] 0709 12:11:20.703158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:21.840852 (+1137694us) service_pool.cc:224] Handling call
0709 12:11:21.860663 (+ 19811us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:21.931218 (+ 70555us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:21.931251 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:21.931297 (+    46us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:21.931329 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:21.931399 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:21.931534 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":70170,"raft.queue_time_us":96358}
I20260709 12:11:21.805207 14181 raft_consensus.cc:493] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:21.982398 14181 raft_consensus.cc:3060] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:21.890291 14305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:21.924427 14154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:21.926616 14262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41764 (request call id 2643) took 1495 ms. Trace:
I20260709 12:11:21.986158 14262 rpcz_store.cc:276] 0709 12:11:20.431297 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:21.299832 (+868535us) service_pool.cc:224] Handling call
0709 12:11:21.300148 (+   316us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:21.451564 (+151416us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:21.451597 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:21.457246 (+  5649us) log.cc:844] Serialized 52 byte log entry
0709 12:11:21.593391 (+136145us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:11:21.593429 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:21.593863 (+   434us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:21.926337 (+332474us) raft_consensus.cc:1685] finished
0709 12:11:21.926360 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:21.926536 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":93045,"raft.run_cpu_time_us":57,"raft.run_wall_time_us":57,"thread_start_us":231382,"threads_started":2,"wal-append.queue_time_us":168468}
I20260709 12:11:21.987875 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:21.988210 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:21.955760 14904 raft_consensus.cc:1240] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 12:11:21.987323 18000 raft_consensus.cc:493] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
W20260709 12:11:21.910727 18395 log.cc:927] Time spent T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.186s	user 0.000s	sys 0.004s
I20260709 12:11:21.989269 18000 raft_consensus.cc:515] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:21.746451 18359 raft_consensus.cc:493] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:21.991725 18000 leader_election.cc:290] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:21.992054 18359 raft_consensus.cc:3060] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:21.993374 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:21.994107 14263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41764 (request call id 2642) took 1564 ms. Trace:
I20260709 12:11:21.749063 18168 raft_consensus.cc:493] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:21.950816 14303 leader_election.cc:304] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:21.995252 14259 raft_consensus.cc:1217] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Deduplicated request from leader. Original: 6.4->[7.5-9.6]   Dedup: 7.5->[9.6-9.6]
W20260709 12:11:21.995580 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 44887.9us
I20260709 12:11:21.994619 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:21.995980 18168 raft_consensus.cc:3060] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:21.996649 17894 raft_consensus.cc:2749] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:21.994539 14263 rpcz_store.cc:276] 0709 12:11:20.429274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:20.521126 (+ 91852us) service_pool.cc:224] Handling call
0709 12:11:20.521495 (+   369us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:20.527452 (+  5957us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:11:21.118703 (+591251us) log.cc:844] Serialized 14 byte log entry
0709 12:11:21.296397 (+177694us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:21.298020 (+  1623us) log.cc:844] Serialized 26 byte log entry
0709 12:11:21.298229 (+   209us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:21.300700 (+  2471us) log.cc:844] Serialized 14 byte log entry
0709 12:11:21.484991 (+184291us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:21.485089 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:21.993844 (+508755us) raft_consensus.cc:1685] finished
0709 12:11:21.993868 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:21.994035 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5924,"prepare.queue_time_us":666647,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":82,"raft.queue_time_us":190989,"raft.run_cpu_time_us":315,"raft.run_wall_time_us":4152,"thread_start_us":935751,"threads_started":3,"wal-append.queue_time_us":389259}
I20260709 12:11:21.959564 14188 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 2612) took 2453 ms. Trace:
I20260709 12:11:21.909513 18381 leader_election.cc:290] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:21.997851 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:22.011399 14262 raft_consensus.cc:2468] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 13.
I20260709 12:11:22.016525 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:21.933025 18403 raft_consensus.cc:493] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:22.068333 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:21.998359 14259 raft_consensus.cc:1240] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 9. Current term is 10. Ops: [7.5-9.6]
I20260709 12:11:21.704717 18160 raft_consensus.cc:515] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:21.980024 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:21.960945 18115 raft_consensus.cc:493] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:22.009997 14908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:21.924911 17983 raft_consensus.cc:3060] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:22.123735 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:22.010428 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:21.998050 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:22.125603 14261 raft_consensus.cc:2393] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 9: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:11:22.126317 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:22.127581 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:11:22.009452 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 58726.1us
I20260709 12:11:21.960736 18153 raft_consensus.cc:493] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:22.128515 18153 raft_consensus.cc:515] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:21.911724 18094 raft_consensus.cc:493] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:22.130810 18094 raft_consensus.cc:515] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:22.014360 14187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 2611) took 2508 ms. Trace:
I20260709 12:11:22.021943 14910 raft_consensus.cc:2468] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 12.
I20260709 12:11:21.996405 14303 leader_election.cc:304] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:11:21.896030 18120 consensus_queue.cc:1048] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.104s
W20260709 12:11:22.069638 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 547377us
I20260709 12:11:21.998114 14188 rpcz_store.cc:276] 0709 12:11:19.506258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:21.436530 (+1930272us) service_pool.cc:224] Handling call
0709 12:11:21.436942 (+   412us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:21.437210 (+   268us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:11:21.590672 (+153462us) log.cc:844] Serialized 14 byte log entry
0709 12:11:21.959153 (+368481us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:21.959214 (+    61us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:21.959277 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:21.959354 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:21.959492 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":336609,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":18857,"raft.queue_time_us":839,"spinlock_wait_cycles":87909248,"thread_start_us":499241,"threads_started":2,"wal-append.queue_time_us":422192}
I20260709 12:11:22.134497 14257 raft_consensus.cc:2468] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 10.
I20260709 12:11:22.135195 14155 leader_election.cc:304] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:22.069142 14333 raft_consensus.cc:2468] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 12.
I20260709 12:11:22.134155 14187 rpcz_store.cc:276] 0709 12:11:19.505845 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:21.433854 (+1928009us) service_pool.cc:224] Handling call
0709 12:11:21.434311 (+   457us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:21.458203 (+ 23892us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:21.458240 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:21.486036 (+ 27796us) log.cc:844] Serialized 26 byte log entry
0709 12:11:21.917581 (+431545us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:11:21.917626 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:21.917699 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:22.014062 (+ 96363us) raft_consensus.cc:1685] finished
0709 12:11:22.014092 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:22.014278 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25704,"raft.queue_time_us":44275,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":10107,"thread_start_us":406178,"threads_started":1,"wal-append.queue_time_us":509781}
I20260709 12:11:22.137207 14333 raft_consensus.cc:1240] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 14 LEADER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 12:11:22.137560 18231 raft_consensus.cc:2749] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:22.069846 14911 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3832505489c04d04a69e256187061921"
dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
mode: GRACEFUL
new_leader_uuid: "885067a0d31741bfb5c9935788e315bf"
 from {username='slave'} at 127.0.0.1:38628
I20260709 12:11:22.074990 18403 raft_consensus.cc:3060] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:21.980334 18402 raft_consensus.cc:3060] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:22.077854 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:22.081645 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:22.144573 14190 raft_consensus.cc:2468] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 15.
I20260709 12:11:22.000321 14256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41768 (request call id 1781) took 1276 ms. Trace:
I20260709 12:11:22.145431 14256 rpcz_store.cc:276] 0709 12:11:20.724458 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:21.900510 (+1176052us) service_pool.cc:224] Handling call
0709 12:11:21.900893 (+   383us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:21.999938 (+ 99045us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:21.999971 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:22.000016 (+    45us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:11:22.000058 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:22.000122 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:22.000252 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":99587,"raft.queue_time_us":99501,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":10314}
I20260709 12:11:22.089332 14908 raft_consensus.cc:2468] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 5.
W20260709 12:11:22.091971 18409 log.cc:927] Time spent T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 12:11:22.096104 18160 leader_election.cc:290] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:22.157326 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:22.158244 14910 raft_consensus.cc:2468] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 15.
I20260709 12:11:21.979988 18361 raft_consensus.cc:493] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:21.999220 18213 raft_consensus.cc:493] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:22.098558 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
W20260709 12:11:22.073444 18241 consensus_meta.cc:287] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.978s	user 0.008s	sys 0.006s
I20260709 12:11:21.934602 18401 raft_consensus.cc:515] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:22.107383 18390 raft_consensus.cc:515] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:21.961227 18248 raft_consensus.cc:493] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:22.198457 18248 raft_consensus.cc:515] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:22.200755 18248 leader_election.cc:290] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:22.108815 18392 leader_election.cc:290] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 11 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:11:22.111645 18211 consensus_meta.cc:287] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.532s	user 0.011s	sys 0.002s
W20260709 12:11:22.113341 18399 consensus_meta.cc:287] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.532s	user 0.007s	sys 0.007s
I20260709 12:11:22.202540 18399 raft_consensus.cc:515] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:22.206131 14184 raft_consensus.cc:1275] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 12:11:22.206540 14184 pending_rounds.cc:85] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf: Aborting all ops after (but not including) 8
I20260709 12:11:22.206703 14184 pending_rounds.cc:107] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 12:11:22.206866 14184 raft_consensus.cc:2889] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:11:22.119381 18307 consensus_meta.cc:287] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.501s	user 0.009s	sys 0.000s
I20260709 12:11:22.137151 14155 leader_election.cc:304] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
W20260709 12:11:22.214524 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 77430.2us
I20260709 12:11:22.215284 14155 leader_election.cc:304] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:22.216260 14155 leader_election.cc:304] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:22.154762 18367 raft_consensus.cc:493] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:21.957424 17987 raft_consensus.cc:493] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:11:22.139024 14911 raft_consensus.cc:606] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 6 LEADER]: Received request to transfer leadership to TS 885067a0d31741bfb5c9935788e315bf
W20260709 12:11:22.140065 14230 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.037s	sys 0.105s
W20260709 12:11:22.224115 14230 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.606s	user 0.037s	sys 0.105s
W20260709 12:11:22.224865 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 613076us
I20260709 12:11:22.138988 18115 raft_consensus.cc:515] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:22.142830 14261 raft_consensus.cc:1275] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 12:11:22.087523 18280 consensus_meta.cc:287] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.660s	user 0.009s	sys 0.006s
I20260709 12:11:22.081285 18391 raft_consensus.cc:515] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:22.242221 14077 maintenance_manager.cc:419] P d07070be2c074f4cb9ad35f1580c4ef7: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 9244 bytes on disk
I20260709 12:11:22.243003 18391 leader_election.cc:290] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 11 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:22.085462 14335 raft_consensus.cc:2393] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 11: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
W20260709 12:11:22.154958 14154 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 168488us
W20260709 12:11:22.246444 14154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:22.248520 14189 raft_consensus.cc:1275] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 9. (term mismatch)
I20260709 12:11:22.249045 14189 pending_rounds.cc:85] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf: Aborting all ops after (but not including) 8
I20260709 12:11:22.107241 18379 leader_election.cc:290] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:22.169298 14258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41768 (request call id 1765) took 1599 ms. Trace:
I20260709 12:11:22.165124 14181 raft_consensus.cc:515] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:22.148490 18120 raft_consensus.cc:2804] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:22.170147 14330 raft_consensus.cc:1240] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 10. Current term is 11. Ops: []
W20260709 12:11:22.197419 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 242380us
I20260709 12:11:22.232057 18266 raft_consensus.cc:2804] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:11:22.227042 14230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:22.140743 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 144426us
I20260709 12:11:22.285830 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:22.231873 14261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41768 (request call id 1784) took 1377 ms. Trace:
I20260709 12:11:22.232460 17987 raft_consensus.cc:515] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:22.249311 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:22.287109 14261 rpcz_store.cc:276] 0709 12:11:20.854186 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:22.142170 (+1287984us) service_pool.cc:224] Handling call
0709 12:11:22.142501 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:22.231575 (+ 89074us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:22.231809 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:22.250254 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:22.169059 18213 raft_consensus.cc:515] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:22.249282 14189 pending_rounds.cc:107] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf: Aborting uncommitted NO_OP operation due to leader change: 13.9
I20260709 12:11:22.290876 14189 raft_consensus.cc:2889] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:22.261772 14076 maintenance_manager.cc:643] P d07070be2c074f4cb9ad35f1580c4ef7: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.002s	user 0.002s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":352,"lbm_reads_lt_1ms":4}
I20260709 12:11:22.287308 14230 leader_election.cc:304] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:22.219333 18398 raft_consensus.cc:2749] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:22.296502 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:22.275228 14181 leader_election.cc:290] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:22.226192 18160 raft_consensus.cc:2804] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:22.251947 14258 rpcz_store.cc:276] 0709 12:11:20.569613 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:21.783764 (+1214151us) service_pool.cc:224] Handling call
0709 12:11:21.784170 (+   406us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:21.784432 (+   262us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:11:21.784789 (+   357us) log.cc:844] Serialized 14 byte log entry
0709 12:11:22.168917 (+384128us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:22.168977 (+    60us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:22.169026 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:22.169094 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:22.169226 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15185,"prepare.queue_time_us":14868,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":50,"raft.queue_time_us":7267,"raft.run_cpu_time_us":244,"raft.run_wall_time_us":32779,"thread_start_us":381799,"threads_started":1}
I20260709 12:11:22.303110 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:22.303436 14258 raft_consensus.cc:1275] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 9. (term mismatch)
I20260709 12:11:22.303818 14258 pending_rounds.cc:85] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec: Aborting all ops after (but not including) 8
I20260709 12:11:22.304069 14258 pending_rounds.cc:107] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec: Aborting uncommitted NO_OP operation due to leader change: 12.9
I20260709 12:11:22.304304 14258 raft_consensus.cc:2889] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:22.304492 14187 raft_consensus.cc:2468] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 10.
I20260709 12:11:22.222097 14155 leader_election.cc:304] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
W20260709 12:11:22.305632 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 83622us
I20260709 12:11:22.306545 14155 leader_election.cc:304] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:22.307896 14155 leader_election.cc:304] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:22.309134 14155 leader_election.cc:304] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:22.233441 18211 raft_consensus.cc:3060] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:22.168377 18241 raft_consensus.cc:515] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:22.166749 18361 raft_consensus.cc:515] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:22.227259 18367 raft_consensus.cc:515] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:22.316015 18307 raft_consensus.cc:2804] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:22.299922 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:22.313243 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:22.313920 14181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:56652 (request call id 964) took 2248 ms. Trace:
I20260709 12:11:22.315850 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:22.316540 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:22.311985 18160 raft_consensus.cc:493] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:22.319355 18414 consensus_queue.cc:1059] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:22.320529 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:22.313094 14333 raft_consensus.cc:1275] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:11:22.282991 18120 raft_consensus.cc:493] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:11:22.318713 14155 leader_election.cc:304] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:22.284921 18266 raft_consensus.cc:493] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:22.325110 14181 rpcz_store.cc:276] 0709 12:11:20.076996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:21.804272 (+1727276us) service_pool.cc:224] Handling call
0709 12:11:22.298323 (+494051us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:22.329140 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:22.312108 17848 raft_consensus.cc:493] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:22.314303 18299 raft_consensus.cc:3060] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:22.316452 18231 raft_consensus.cc:2749] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:22.362952 14187 raft_consensus.cc:2468] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 9.
I20260709 12:11:22.316236 18415 raft_consensus.cc:2749] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:22.370707 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:22.364071 14260 raft_consensus.cc:2368] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 12. Current term is 13.
I20260709 12:11:22.363878 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:22.332995 14229 leader_election.cc:304] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 885067a0d31741bfb5c9935788e315bf
W20260709 12:11:22.376014 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 57393us
W20260709 12:11:22.374930 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 85067.7us
W20260709 12:11:22.353364 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:22.377624 14230 leader_election.cc:304] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:22.321130 18280 raft_consensus.cc:2804] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:11:22.272998 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 200800us
I20260709 12:11:22.376255 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:22.379220 14190 raft_consensus.cc:2393] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 12: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:11:22.380280 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:22.380903 14330 raft_consensus.cc:2468] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 10.
W20260709 12:11:22.382880 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 50000.9us
I20260709 12:11:22.383869 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:22.384775 14333 raft_consensus.cc:2410] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for term 10 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:11:22.384047 14229 leader_election.cc:304] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
W20260709 12:11:22.367178 18369 consensus_meta.cc:287] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 1.174s	user 0.015s	sys 0.000s
I20260709 12:11:22.324287 18307 raft_consensus.cc:493] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:22.363857 18266 raft_consensus.cc:3060] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:22.334097 18363 raft_consensus.cc:493] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:22.333882 18160 raft_consensus.cc:3060] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:22.333305 18362 raft_consensus.cc:493] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:22.400822 14155 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:22.426285 14155 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:22.426777 14155 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:22.332649 18342 raft_consensus.cc:493] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:22.327589 18213 leader_election.cc:290] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:22.406015 14876 leader_election.cc:304] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:22.403980 18414 raft_consensus.cc:3060] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:22.402443 18350 raft_consensus.cc:3060] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:22.365633 18120 raft_consensus.cc:3060] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:22.405947 14304 leader_election.cc:304] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
W20260709 12:11:22.455440 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 49586.5us
I20260709 12:11:22.327723 18413 raft_consensus.cc:493] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
W20260709 12:11:22.435894 18396 consensus_meta.cc:287] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.742s	user 0.006s	sys 0.008s
I20260709 12:11:22.458173 18413 raft_consensus.cc:515] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:22.459107 18168 raft_consensus.cc:515] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:22.420651 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:22.462154 14190 raft_consensus.cc:2468] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 5.
I20260709 12:11:22.370035 17848 raft_consensus.cc:515] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:22.462524 18213 raft_consensus.cc:2749] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:22.463492 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:22.463647 18213 raft_consensus.cc:493] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:22.464933 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:22.379452 18236 raft_consensus.cc:3055] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:22.465132 17848 leader_election.cc:290] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:22.465595 18236 raft_consensus.cc:740] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:11:22.379977 18280 raft_consensus.cc:493] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:22.402807 18393 raft_consensus.cc:2804] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:22.467581 18393 raft_consensus.cc:493] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:11:22.386498 18214 raft_consensus.cc:3055] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:22.467479 18280 raft_consensus.cc:3060] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:22.468596 18362 raft_consensus.cc:515] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:22.404316 18231 raft_consensus.cc:493] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:22.470124 18231 raft_consensus.cc:515] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:22.472178 18362 leader_election.cc:290] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:22.431820 18363 raft_consensus.cc:515] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:22.474056 14190 raft_consensus.cc:2468] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 10.
I20260709 12:11:22.413497 18369 raft_consensus.cc:515] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:22.441808 18401 leader_election.cc:290] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:11:22.443010 18419 log.cc:927] Time spent T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 12:11:22.445259 18275 raft_consensus.cc:2804] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:22.446072 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:22.431715 18248 raft_consensus.cc:493] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:22.424408 18399 leader_election.cc:290] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:22.424315 18326 leader_election.cc:290] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 11 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:22.494498 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:22.466846 18115 leader_election.cc:290] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:11:22.458202 18420 log.cc:927] Time spent T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
W20260709 12:11:22.419401 18411 log.cc:927] Time spent T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.273s	user 0.002s	sys 0.000s
W20260709 12:11:22.499455 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 67638.9us
I20260709 12:11:22.475281 14182 raft_consensus.cc:1240] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:22.439049 18306 consensus_queue.cc:1059] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:11:22.406647 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:22.476321 14876 leader_election.cc:304] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:22.501858 14155 leader_election.cc:304] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:22.486922 14230 leader_election.cc:304] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:11:22.503527 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:22.504308 14181 raft_consensus.cc:2468] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 6.
I20260709 12:11:22.473373 18231 leader_election.cc:290] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:22.488890 14330 raft_consensus.cc:3060] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:22.468422 18428 log.cc:927] Time spent T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 12:11:22.403757 18354 consensus_queue.cc:1059] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.071s
W20260709 12:11:22.454617 18422 log.cc:927] Time spent T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 12:11:22.468401 18355 raft_consensus.cc:2804] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:22.464460 18213 raft_consensus.cc:515] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:22.468329 18393 raft_consensus.cc:3060] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:22.478266 18415 consensus_queue.cc:1048] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
W20260709 12:11:22.498514 14303 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:22.529526 14303 leader_election.cc:304] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:22.530745 14339 raft_consensus.cc:1240] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 10 LEADER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 12:11:22.531724 14303 leader_election.cc:304] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:11:22.531946 18155 raft_consensus.cc:2804] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:22.532691 18155 raft_consensus.cc:697] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 7 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:22.533106 14303 leader_election.cc:304] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:11:22.414376 18307 raft_consensus.cc:3060] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:22.534577 18155 consensus_queue.cc:237] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:22.468561 18214 raft_consensus.cc:740] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:11:22.510637 14155 leader_election.cc:304] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:11:22.490305 18275 raft_consensus.cc:493] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:22.512861 14230 leader_election.cc:304] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:22.513633 14154 leader_election.cc:304] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:22.490916 18413 leader_election.cc:290] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:22.493938 18362 raft_consensus.cc:493] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:22.496333 18390 leader_election.cc:290] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 13 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:22.467057 18236 consensus_queue.cc:260] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:22.497152 14190 raft_consensus.cc:2393] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 5: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
W20260709 12:11:22.525789 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 141747us
I20260709 12:11:22.533375 18207 raft_consensus.cc:2804] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:22.523978 18399 raft_consensus.cc:2804] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:22.509301 18115 raft_consensus.cc:2804] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:11:22.479574 18400 consensus_queue.cc:1048] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 12:11:22.564802 14336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50856 (request call id 2130) took 1057 ms. Trace:
I20260709 12:11:22.474530 18342 raft_consensus.cc:515] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:22.481474 18396 raft_consensus.cc:515] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:22.515026 18231 raft_consensus.cc:2749] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:22.496098 18248 raft_consensus.cc:515] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:22.514604 18355 raft_consensus.cc:493] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:22.595947 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:22.562243 18416 raft_consensus.cc:493] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:22.571527 18413 raft_consensus.cc:493] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:22.538951 18275 raft_consensus.cc:3060] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:22.521763 18168 leader_election.cc:290] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:22.518805 18437 raft_consensus.cc:493] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:22.584805 18236 raft_consensus.cc:3060] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:22.568377 18326 raft_consensus.cc:2804] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:11:22.584198 14336 rpcz_store.cc:276] 0709 12:11:21.507461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:21.556389 (+ 48928us) service_pool.cc:224] Handling call
0709 12:11:21.556772 (+   383us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:21.568234 (+ 11462us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:11:21.568267 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:21.568792 (+   525us) log.cc:844] Serialized 26 byte log entry
0709 12:11:21.742442 (+173650us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:11:21.742492 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:21.742577 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:22.564515 (+821938us) raft_consensus.cc:1685] finished
0709 12:11:22.564540 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:22.564717 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10943,"raft.queue_time_us":17008,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":97,"thread_start_us":173284,"threads_started":1,"wal-append.queue_time_us":440735}
I20260709 12:11:22.570629 18354 raft_consensus.cc:2749] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:22.579629 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:22.573557 18321 raft_consensus.cc:3060] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:22.590843 18207 raft_consensus.cc:697] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 12 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:22.568620 17848 raft_consensus.cc:2804] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:22.616132 14330 raft_consensus.cc:2468] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 11.
I20260709 12:11:22.568488 18306 consensus_queue.cc:1059] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 12:11:22.584275 18115 raft_consensus.cc:493] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:22.582221 18399 raft_consensus.cc:493] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
W20260709 12:11:22.606446 18429 log.cc:927] Time spent T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.139s	user 0.000s	sys 0.005s
I20260709 12:11:22.589350 18363 leader_election.cc:290] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:22.626381 14183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 2606) took 3179 ms. Trace:
I20260709 12:11:22.657546 14183 rpcz_store.cc:276] 0709 12:11:19.447171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:20.213640 (+766469us) service_pool.cc:224] Handling call
0709 12:11:20.214080 (+   440us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:11:20.216928 (+  2848us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:20.216959 (+    31us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:11:20.217720 (+   761us) log.cc:844] Serialized 78 byte log entry
0709 12:11:21.744571 (+1526851us) spinlock_profiling.cc:243] Waited 8.18 ms on lock 0x7b18003a3ae0. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f212cf16ab1 00007f212cf23281 00007f2124030e07 00007f212ce8b9a9 00007f212404d69b 00007f212404b93f 00007f212404dc02 00007f2126cd520b 00007f2126cdad23 00007f2126cdb0d1 00007f21270f6a0f
0709 12:11:22.147069 (+402498us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:11:22.147116 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:22.147219 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:22.616068 (+468849us) raft_consensus.cc:1685] finished
0709 12:11:22.616089 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:22.626297 (+ 10208us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2313,"raft.queue_time_us":2421,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":5763,"spinlock_wait_cycles":18822016,"thread_start_us":402170,"threads_started":1,"wal-append.queue_time_us":2032976}
I20260709 12:11:22.601085 18355 raft_consensus.cc:3060] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:22.622138 18326 raft_consensus.cc:493] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:22.571208 18362 raft_consensus.cc:515] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:22.630951 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:22.668771 14190 raft_consensus.cc:2468] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 9.
I20260709 12:11:22.632736 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:22.640689 14259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41768 (request call id 1762) took 2075 ms. Trace:
I20260709 12:11:22.614113 18416 raft_consensus.cc:515] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:11:22.643642 18427 log.cc:927] Time spent T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.160s	user 0.001s	sys 0.001s
W20260709 12:11:22.644975 18421 log.cc:927] Time spent T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.170s	user 0.000s	sys 0.001s
I20260709 12:11:22.577913 18214 consensus_queue.cc:260] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:22.652129 18342 leader_election.cc:290] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:22.610918 18361 leader_election.cc:290] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:22.655233 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:22.653376 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:22.660437 18354 raft_consensus.cc:493] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:22.670212 14183 raft_consensus.cc:1275] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 12:11:22.670940 14230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:22.670739 14259 rpcz_store.cc:276] 0709 12:11:20.565355 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:21.604043 (+1038688us) service_pool.cc:224] Handling call
0709 12:11:21.995069 (+391026us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:22.069520 (+ 74451us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:22.640409 (+570889us) spinlock_profiling.cc:243] Waited 372 ms on lock 0x7b54001b26d0. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713a8ad 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:11:22.640599 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":856116992}
W20260709 12:11:22.689667 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 97096.8us
I20260709 12:11:22.560750 18403 raft_consensus.cc:515] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:22.667246 18326 raft_consensus.cc:3060] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:11:22.694712 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:22.698598 14190 raft_consensus.cc:1240] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 10 LEADER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:22.633802 17848 raft_consensus.cc:493] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
W20260709 12:11:22.701419 14229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:22.698675 18231 consensus_queue.cc:1048] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
W20260709 12:11:22.647583 14265 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41768 (request call id 1763) took 2081 ms (client timeout 1561 ms). Trace:
I20260709 12:11:22.654685 18399 raft_consensus.cc:3060] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:22.621417 18413 raft_consensus.cc:515] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:22.649303 18115 raft_consensus.cc:3060] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:22.721583 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:11:22.630410 18412 log.cc:927] Time spent T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.327s	user 0.002s	sys 0.000s
I20260709 12:11:22.727710 14261 raft_consensus.cc:2468] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 10.
I20260709 12:11:22.742812 14183 raft_consensus.cc:1275] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:11:22.771768 14183 raft_consensus.cc:1240] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 7. Current term is 8. Ops: []
W20260709 12:11:22.747718 14265 rpcz_store.cc:269] 0709 12:11:20.565650 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:20.566521 (+   871us) service_pool.cc:224] Handling call
0709 12:11:22.647316 (+2080795us) spinlock_profiling.cc:243] Waited 1.34 s on lock 0x7b5400222ed4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:11:22.647487 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3092226304}
I20260709 12:11:22.768782 14904 raft_consensus.cc:1240] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 12. Current term is 13. Ops: []
W20260709 12:11:22.771075 14154 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 257548us
I20260709 12:11:22.776665 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:22.642077 18438 consensus_queue.cc:1048] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.235s
I20260709 12:11:22.736321 18354 raft_consensus.cc:515] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:22.778604 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:11:22.779246 18402 consensus_meta.cc:287] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.618s	user 0.009s	sys 0.010s
I20260709 12:11:22.779879 18354 leader_election.cc:290] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:22.778098 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:22.782541 18248 leader_election.cc:290] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:22.673131 18363 consensus_queue.cc:1048] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.069s
I20260709 12:11:22.788559 14330 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807"
dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
mode: GRACEFUL
new_leader_uuid: "17aab1bbf5014936aa18cc21818b26ec"
 from {username='slave'} at 127.0.0.1:50896
I20260709 12:11:22.793380 14330 raft_consensus.cc:606] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Received request to transfer leadership to TS 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:11:22.794003 14330 raft_consensus.cc:614] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:22.788779 14154 leader_election.cc:304] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:22.746356 17848 raft_consensus.cc:3060] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:22.626032 18437 raft_consensus.cc:515] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:22.797053 14154 leader_election.cc:304] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:22.799991 14331 raft_consensus.cc:1240] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:11:22.805135 14303 leader_election.cc:304] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:22.810591 14185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56046 (request call id 2237) took 1750 ms. Trace:
I20260709 12:11:22.774068 18214 raft_consensus.cc:3060] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:22.811336 14261 raft_consensus.cc:2468] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 9.
I20260709 12:11:22.768234 18369 leader_election.cc:290] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 9 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:22.811129 14185 rpcz_store.cc:276] 0709 12:11:21.059772 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:21.808555 (+748783us) service_pool.cc:224] Handling call
0709 12:11:21.809005 (+   450us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:21.809455 (+   450us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:21.809483 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:21.810166 (+   683us) log.cc:844] Serialized 26 byte log entry
0709 12:11:22.161245 (+351079us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:22.161291 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:22.161364 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:22.810281 (+648917us) raft_consensus.cc:1685] finished
0709 12:11:22.810310 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:22.810503 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":79844,"raft.run_cpu_time_us":51,"raft.run_wall_time_us":51,"thread_start_us":350666,"threads_started":1,"wal-append.queue_time_us":569143}
I20260709 12:11:22.820883 14303 leader_election.cc:304] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:22.787563 18153 leader_election.cc:290] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:22.835543 14303 leader_election.cc:304] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:11:22.836691 18153 raft_consensus.cc:2804] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:22.837141 18153 raft_consensus.cc:493] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:11:22.837244 14303 leader_election.cc:304] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:22.845853 14303 leader_election.cc:304] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:22.850471 14303 leader_election.cc:304] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:22.846419 18390 raft_consensus.cc:2804] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:22.779819 18402 raft_consensus.cc:515] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:22.826944 18400 raft_consensus.cc:2749] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:22.764869 18207 consensus_queue.cc:237] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:22.837585 18153 raft_consensus.cc:3060] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:22.849493 18392 raft_consensus.cc:2749] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:22.830438 18178 raft_consensus.cc:2749] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:22.833724 18416 leader_election.cc:290] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:22.859272 18440 raft_consensus.cc:2804] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:22.852265 18433 raft_consensus.cc:3060] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:22.870370 14331 raft_consensus.cc:1240] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:11:22.881155 18440 raft_consensus.cc:493] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:22.885571 18403 leader_election.cc:290] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 13 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:22.858527 18299 raft_consensus.cc:2749] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:11:22.880605 18359 consensus_meta.cc:287] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.888s	user 0.016s	sys 0.000s
I20260709 12:11:22.887188 18359 raft_consensus.cc:515] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } }
I20260709 12:11:22.887770 18413 leader_election.cc:290] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:22.890251 18437 leader_election.cc:290] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:11:22.872852 18439 log.cc:927] Time spent T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260709 12:11:22.897011 18433 raft_consensus.cc:2749] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:22.859882 18390 raft_consensus.cc:493] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:22.897825 18390 raft_consensus.cc:3060] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:22.864856 18183 raft_consensus.cc:2804] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:22.897789 18359 leader_election.cc:290] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187)
I20260709 12:11:22.906363 18321 raft_consensus.cc:2749] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:22.912705 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 14 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:22.941287 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:22.942256 14339 raft_consensus.cc:2468] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 12.
I20260709 12:11:22.915753 18402 leader_election.cc:290] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 13 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:22.919723 18241 leader_election.cc:290] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 13 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:22.919453 18390 raft_consensus.cc:515] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:22.917146 18153 raft_consensus.cc:515] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:11:22.935554 18380 consensus_meta.cc:287] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 1.174s	user 0.012s	sys 0.003s
W20260709 12:11:22.936559 18211 consensus_meta.cc:287] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.615s	user 0.007s	sys 0.006s
I20260709 12:11:22.868183 18350 raft_consensus.cc:2749] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:22.869156 18396 leader_election.cc:290] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 8 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:22.937625 18183 raft_consensus.cc:493] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:22.870180 18442 raft_consensus.cc:493] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:22.881716 18440 raft_consensus.cc:3060] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:22.958693 18211 raft_consensus.cc:2749] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:22.959601 18183 raft_consensus.cc:3060] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:22.961297 18362 leader_election.cc:290] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:11:22.976095 18160 consensus_meta.cc:287] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.534s	user 0.010s	sys 0.004s
I20260709 12:11:23.066318 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:23.067070 18160 raft_consensus.cc:515] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:23.070794 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:23.072422 14335 raft_consensus.cc:2468] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 9.
I20260709 12:11:22.926270 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:22.953313 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:23.076704 18153 leader_election.cc:290] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 9 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:11:23.056643 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:23.060209 14263 raft_consensus.cc:2393] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 10: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:11:23.061190 14265 raft_consensus.cc:3060] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:22.945551 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:22.881520 18120 raft_consensus.cc:515] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:11:23.059474 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 208876us
W20260709 12:11:23.054018 14155 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:22.947737 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:22.958182 18380 raft_consensus.cc:515] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:23.002828 18390 leader_election.cc:290] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 13 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:23.128532 14262 raft_consensus.cc:2393] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 11: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:11:22.989260 18393 raft_consensus.cc:515] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:11:23.131472 18266 consensus_meta.cc:287] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.698s	user 0.010s	sys 0.005s
I20260709 12:11:23.131816 14333 raft_consensus.cc:2410] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for term 16 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
W20260709 12:11:23.132464 18307 consensus_meta.cc:287] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.598s	user 0.012s	sys 0.001s
I20260709 12:11:23.132779 18393 leader_election.cc:290] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 8 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:22.987753 18399 raft_consensus.cc:515] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:11:23.135183 18280 consensus_meta.cc:287] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.666s	user 0.007s	sys 0.008s
I20260709 12:11:23.135875 18280 raft_consensus.cc:515] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:23.136299 18399 leader_election.cc:290] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 11 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:11:23.009615 18414 consensus_meta.cc:287] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.536s	user 0.011s	sys 0.002s
I20260709 12:11:23.138062 18414 raft_consensus.cc:2749] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:11:23.008965 18418 log.cc:927] Time spent T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.596s	user 0.000s	sys 0.002s
I20260709 12:11:23.142817 14264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53050 (request call id 735) took 2616 ms. Trace:
W20260709 12:11:22.999418 18430 log.cc:927] Time spent T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.555s	user 0.006s	sys 0.000s
I20260709 12:11:23.146838 18362 raft_consensus.cc:493] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:23.147931 18362 raft_consensus.cc:515] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:22.969249 18442 raft_consensus.cc:515] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:23.057265 14184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56652 (request call id 966) took 2072 ms. Trace:
I20260709 12:11:23.076824 14339 raft_consensus.cc:2468] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 7.
I20260709 12:11:23.150403 14184 rpcz_store.cc:276] 0709 12:11:20.984607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:21.806238 (+821631us) service_pool.cc:224] Handling call
0709 12:11:21.806693 (+   455us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:22.207193 (+400500us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:23.056431 (+849238us) spinlock_profiling.cc:243] Waited 399 ms on lock 0x7b54003a48d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:11:23.056967 (+   536us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":917731072}
I20260709 12:11:23.151471 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:23.152299 18442 leader_election.cc:290] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:23.102558 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:11:23.107443 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:23.108104 14303 leader_election.cc:304] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:23.110838 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:23.156101 14336 raft_consensus.cc:2468] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 9.
W20260709 12:11:23.157153 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 52044.6us
I20260709 12:11:23.158535 17981 raft_consensus.cc:2749] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:23.111265 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:23.153501 14256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53050 (request call id 736) took 2186 ms. Trace:
I20260709 12:11:23.114594 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: true dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:23.133208 18307 raft_consensus.cc:515] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:11:23.122792 14257 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41764 (request call id 2645) took 2686 ms (client timeout 2040 ms). Trace:
I20260709 12:11:23.143326 14264 rpcz_store.cc:276] 0709 12:11:20.525959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:21.586281 (+1060322us) service_pool.cc:224] Handling call
0709 12:11:21.613086 (+ 26805us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:21.617973 (+  4887us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:21.618006 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:21.622747 (+  4741us) log.cc:844] Serialized 26 byte log entry
0709 12:11:22.197111 (+574364us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:22.197157 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:22.197235 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:23.008122 (+810887us) spinlock_profiling.cc:243] Waited 6.89 ms on lock 0x7b4400022b4c. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2123f74c85 00007f2123f756a2 00007f2126ce71db 00007f2126ce2aaf 00007f2126cd686e 00007f2126cd5bb6 00007f2126cd57d8 00007f2126cdf221 00007f2126cdf1d9 00007f2126cdf169
0709 12:11:23.141984 (+133862us) raft_consensus.cc:1685] finished
0709 12:11:23.142033 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:23.142523 (+   490us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4447,"raft.queue_time_us":5044,"raft.run_cpu_time_us":193,"raft.run_wall_time_us":44601,"spinlock_wait_cycles":15848704,"thread_start_us":471228,"threads_started":1,"wal-append.queue_time_us":630073}
I20260709 12:11:23.133306 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:11:23.143460 14260 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41768 (request call id 1773) took 2541 ms (client timeout 2122 ms). Trace:
I20260709 12:11:23.102064 18350 raft_consensus.cc:493] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
W20260709 12:11:23.163301 14260 rpcz_store.cc:269] 0709 12:11:20.582875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:20.583347 (+   472us) service_pool.cc:224] Handling call
0709 12:11:23.123714 (+2540367us) spinlock_profiling.cc:243] Waited 1.78 s on lock 0x7b54002fc954. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:11:23.124158 (+   444us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4092382464}
W20260709 12:11:23.162070 14257 rpcz_store.cc:269] 0709 12:11:20.435627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:20.438208 (+  2581us) service_pool.cc:224] Handling call
0709 12:11:23.122116 (+2683908us) spinlock_profiling.cc:243] Waited 1.66 s on lock 0x7b54003822d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:11:23.122380 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3819904896}
I20260709 12:11:23.171175 18393 raft_consensus.cc:3055] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:23.171780 18393 raft_consensus.cc:740] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
W20260709 12:11:23.175071 18453 log.cc:927] Time spent T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 12:11:23.177691 18120 leader_election.cc:290] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 10 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:23.180153 18213 leader_election.cc:290] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:23.181424 18211 consensus_queue.cc:1048] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:23.187000 18094 leader_election.cc:290] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:23.186815 14155 leader_election.cc:304] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:23.201519 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:23.202796 14260 raft_consensus.cc:2468] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 13.
I20260709 12:11:23.204632 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:23.204690 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:23.204852 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:11:23.167155 18266 raft_consensus.cc:515] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:23.209347 18350 raft_consensus.cc:515] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:23.205489 14260 raft_consensus.cc:2468] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 9.
I20260709 12:11:23.214504 14188 raft_consensus.cc:2393] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 10: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:11:23.215317 18452 raft_consensus.cc:493] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:23.216455 18452 raft_consensus.cc:515] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:23.223764 18350 leader_election.cc:290] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:23.225299 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:23.227022 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:23.227526 14910 raft_consensus.cc:1275] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:11:23.228470 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:23.230624 18160 leader_election.cc:290] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 8 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:23.231590 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:23.231942 18153 raft_consensus.cc:493] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:23.173336 18393 consensus_queue.cc:260] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:23.233589 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:23.232712 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:23.245891 14904 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53194 (request call id 900) took 1175 ms. Trace:
I20260709 12:11:23.246506 14904 rpcz_store.cc:276] 0709 12:11:22.070462 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:22.086727 (+ 16265us) service_pool.cc:224] Handling call
0709 12:11:22.087075 (+   348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:22.772526 (+685451us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:23.245231 (+472705us) spinlock_profiling.cc:243] Waited 679 ms on lock 0x7b540020c454. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:11:23.245606 (+   375us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1560845056}
I20260709 12:11:23.248884 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:23.254300 18307 leader_election.cc:290] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 11 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:23.255637 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:23.256654 18266 leader_election.cc:290] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 8 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:23.160099 14256 rpcz_store.cc:276] 0709 12:11:20.967006 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:22.146741 (+1179735us) service_pool.cc:224] Handling call
0709 12:11:22.166189 (+ 19448us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:22.166568 (+   379us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:22.166596 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:22.218853 (+ 52257us) log.cc:844] Serialized 26 byte log entry
0709 12:11:22.378362 (+159509us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:22.511496 (+133134us) log.cc:844] Serialized 14 byte log entry
0709 12:11:22.512843 (+  1347us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:22.512917 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:22.950262 (+437345us) spinlock_profiling.cc:243] Waited 31.6 ms on lock 0x7b4400022b4c. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2123f74c85 00007f2123f756a2 00007f2126ce71db 00007f2126ce2aaf 00007f2126cd686e 00007f2126cd5bb6 00007f2126cd57d8 00007f2126cdf221 00007f2126cdf1d9 00007f2126cdf169
0709 12:11:23.152912 (+202650us) raft_consensus.cc:1685] finished
0709 12:11:23.153049 (+   137us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:23.153285 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8754,"prepare.queue_time_us":197840,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":53,"raft.queue_time_us":9903,"raft.run_cpu_time_us":443,"raft.run_wall_time_us":68865,"spinlock_wait_cycles":72729856,"thread_start_us":207419,"threads_started":2,"wal-append.queue_time_us":206833}
I20260709 12:11:23.257177 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:23.259159 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:23.250677 14185 raft_consensus.cc:1240] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:23.252230 14183 raft_consensus.cc:1240] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 7. Current term is 8. Ops: []
W20260709 12:11:23.263474 17983 consensus_meta.cc:287] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 1.125s	user 0.013s	sys 0.007s
I20260709 12:11:23.264760 14186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56652 (request call id 969) took 1193 ms. Trace:
I20260709 12:11:23.265166 14183 raft_consensus.cc:1275] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 5. (term mismatch)
I20260709 12:11:23.253628 14189 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 2616) took 3332 ms. Trace:
W20260709 12:11:23.265333 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 78806.2us
I20260709 12:11:23.249061 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:23.265693 14189 rpcz_store.cc:276] 0709 12:11:19.921233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:21.617288 (+1696055us) service_pool.cc:224] Handling call
0709 12:11:21.664962 (+ 47674us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:22.291447 (+626485us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:23.252977 (+961530us) spinlock_profiling.cc:243] Waited 574 ms on lock 0x7b5400110dd4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:11:23.253388 (+   411us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1320179072}
I20260709 12:11:23.266585 14184 raft_consensus.cc:2393] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 11: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:11:23.267050 18438 raft_consensus.cc:2764] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 12:11:23.267544 14186 rpcz_store.cc:276] 0709 12:11:22.070763 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:22.070904 (+   141us) service_pool.cc:224] Handling call
0709 12:11:22.079863 (+  8959us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:22.094788 (+ 14925us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:22.094821 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:22.095382 (+   561us) log.cc:844] Serialized 26 byte log entry
0709 12:11:22.269952 (+174570us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:22.269997 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:22.466958 (+196961us) spinlock_profiling.cc:243] Waited 6.83 ms on lock 0x7b4400022b4c. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2123f74c85 00007f2123f756a2 00007f2126ce71db 00007f2126ce2aaf 00007f2126cd686e 00007f2126cd5bb6 00007f2126cd57d8 00007f2126cdf221 00007f2126cdf1d9 00007f2126cdf169
0709 12:11:23.264062 (+797104us) spinlock_profiling.cc:243] Waited 14.5 ms on lock 0x7b54003a43d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:11:23.264160 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:23.264277 (+   117us) raft_consensus.cc:1685] finished
0709 12:11:23.264291 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:23.264541 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1181,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":99,"spinlock_wait_cycles":49036928,"thread_start_us":174217,"threads_started":1,"wal-append.queue_time_us":239529}
I20260709 12:11:23.270562 18438 raft_consensus.cc:493] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:23.271407 18438 raft_consensus.cc:515] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:23.274647 18438 leader_election.cc:290] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:23.267117 14155 leader_election.cc:304] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:23.278187 14303 leader_election.cc:304] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
W20260709 12:11:23.280764 14302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:23.261257 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:23.268587 14258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41764 (request call id 2660) took 1314 ms. Trace:
I20260709 12:11:23.283463 18307 raft_consensus.cc:493] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:23.282763 14876 leader_election.cc:304] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:23.285353 18309 raft_consensus.cc:2804] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:23.286636 18151 raft_consensus.cc:2804] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:23.286602 18309 raft_consensus.cc:493] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:23.287272 18151 raft_consensus.cc:493] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:23.287918 18151 raft_consensus.cc:3060] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:23.289090 14182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56652 (request call id 967) took 2155 ms. Trace:
I20260709 12:11:23.289505 14182 rpcz_store.cc:276] 0709 12:11:21.133642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:21.846296 (+712654us) service_pool.cc:224] Handling call
0709 12:11:21.887460 (+ 41164us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:22.502305 (+614845us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:23.288585 (+786280us) spinlock_profiling.cc:243] Waited 588 ms on lock 0x7b54003a34d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:11:23.288912 (+   327us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1351425920}
I20260709 12:11:23.291530 14262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41764 (request call id 2661) took 1336 ms. Trace:
I20260709 12:11:23.292309 14263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41764 (request call id 2657) took 1338 ms. Trace:
I20260709 12:11:23.292773 14911 raft_consensus.cc:2368] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 11. Current term is 12.
I20260709 12:11:23.294229 17987 leader_election.cc:290] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:23.294670 18397 consensus_queue.cc:1059] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:23.284529 14258 rpcz_store.cc:276] 0709 12:11:21.954437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:22.334531 (+380094us) service_pool.cc:224] Handling call
0709 12:11:22.334861 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:22.617478 (+282617us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:22.617514 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:22.617563 (+    49us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:22.617607 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:23.268071 (+650464us) spinlock_profiling.cc:243] Waited 282 ms on lock 0x7b54002012d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:11:23.268149 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:23.268379 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":649442688}
I20260709 12:11:23.284821 14183 pending_rounds.cc:85] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf: Aborting all ops after (but not including) 4
I20260709 12:11:23.296487 14183 pending_rounds.cc:107] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf: Aborting uncommitted NO_OP operation due to leader change: 9.5
I20260709 12:11:23.296799 18452 leader_election.cc:290] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:23.297103 18150 raft_consensus.cc:3055] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:23.297588 18150 raft_consensus.cc:740] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:11:23.299135 18306 raft_consensus.cc:3055] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:23.299012 18150 consensus_queue.cc:260] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:23.299630 18306 raft_consensus.cc:740] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:11:23.297091 14183 raft_consensus.cc:2889] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:23.302412 18341 consensus_queue.cc:1048] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:23.303339 18367 leader_election.cc:290] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:23.266055 17983 raft_consensus.cc:493] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:23.291981 14262 rpcz_store.cc:276] 0709 12:11:21.954706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:22.067980 (+113274us) service_pool.cc:224] Handling call
0709 12:11:23.291245 (+1223265us) spinlock_profiling.cc:243] Waited 980 ms on lock 0x7b54002652d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:11:23.291421 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2254406400}
I20260709 12:11:23.249558 18280 leader_election.cc:290] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 11 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:23.322748 14265 raft_consensus.cc:2468] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 11.
I20260709 12:11:23.292800 14263 rpcz_store.cc:276] 0709 12:11:21.953515 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:22.127321 (+173806us) service_pool.cc:224] Handling call
0709 12:11:23.292043 (+1164722us) spinlock_profiling.cc:243] Waited 931 ms on lock 0x7b5400100c54. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:11:23.292224 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2140841344}
I20260709 12:11:23.300731 18388 raft_consensus.cc:993] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db: : Instructing follower 885067a0d31741bfb5c9935788e315bf to start an election
I20260709 12:11:23.330914 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:23.342152 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:23.328742 17983 raft_consensus.cc:515] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:23.337391 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:23.341585 14910 raft_consensus.cc:1240] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 12:11:23.326516 18438 raft_consensus.cc:2749] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:23.300779 18150 raft_consensus.cc:3060] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:23.338164 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:23.334714 14337 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 712) took 2736 ms. Trace:
I20260709 12:11:23.387781 18452 raft_consensus.cc:493] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:23.388741 14188 raft_consensus.cc:1275] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:11:23.390830 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:23.391481 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:23.391829 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
W20260709 12:11:23.392978 18214 consensus_meta.cc:287] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.562s	user 0.010s	sys 0.010s
I20260709 12:11:23.393113 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:23.394361 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:23.395097 18180 raft_consensus.cc:493] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:11:23.395757 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:23.395989 18180 raft_consensus.cc:515] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:23.403671 18180 leader_election.cc:290] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:23.232772 18153 raft_consensus.cc:515] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:23.405721 14257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41764 (request call id 2664) took 1450 ms. Trace:
I20260709 12:11:23.406037 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:23.397502 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:11:23.400290 18207 raft_consensus.cc:493] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:23.400748 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:23.319482 18309 raft_consensus.cc:3060] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:23.408869 14335 raft_consensus.cc:2468] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 12.
I20260709 12:11:23.401549 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:23.406211 18153 leader_election.cc:290] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:23.407037 14257 rpcz_store.cc:276] 0709 12:11:21.955403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:23.404718 (+1449315us) service_pool.cc:224] Handling call
0709 12:11:23.405133 (+   415us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:23.405387 (+   254us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:23.405413 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:23.405453 (+    40us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:23.405483 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:23.405533 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:23.405632 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:23.397390 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:23.395188 14331 raft_consensus.cc:3060] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:23.414417 14262 raft_consensus.cc:2468] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 10.
I20260709 12:11:23.304931 18307 raft_consensus.cc:515] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:23.418164 14155 leader_election.cc:304] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:23.419376 14264 raft_consensus.cc:2468] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 9.
I20260709 12:11:23.429447 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:23.385788 14337 rpcz_store.cc:276] 0709 12:11:20.598032 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:20.598192 (+   160us) service_pool.cc:224] Handling call
0709 12:11:21.838320 (+1240128us) spinlock_profiling.cc:243] Waited 1.46 ms on lock 0x7b5800065d98. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2124016b71 00007f2124016a22 00007f212cf2f8d9 00007f212c089ee0 00007f212c1530ab 00007f212c153131 00007f212c114fc0 00007f212c0ff929 00007f212c0ff3d2 00007f2125676bd4
0709 12:11:22.641522 (+803202us) spinlock_profiling.cc:243] Waited 73.6 ms on lock 0x7b5800065d98. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2124016e9c 00007f2124016a5b 00007f212cf2f8d9 00007f212c089ee0 00007f212c1530ab 00007f212c153131 00007f212c114fc0 00007f212c0ff929 00007f212c0ff3d2 00007f2125676bd4
0709 12:11:22.648307 (+  6785us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:22.648616 (+   309us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:11:22.649500 (+   884us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:22.667567 (+ 18067us) log.cc:844] Serialized 26 byte log entry
0709 12:11:23.333880 (+666313us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:23.333984 (+   104us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:23.334136 (+   152us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:23.334199 (+    63us) raft_consensus.cc:1685] finished
0709 12:11:23.334218 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:23.334486 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":172561024,"thread_start_us":476462,"threads_started":1,"wal-append.queue_time_us":512981}
I20260709 12:11:23.432566 14181 raft_consensus.cc:2393] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 10: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
W20260709 12:11:23.434716 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 58450.1us
I20260709 12:11:23.436365 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:23.434216 14904 raft_consensus.cc:2468] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 11.
I20260709 12:11:23.436996 14336 raft_consensus.cc:2468] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 12.
I20260709 12:11:23.408420 18362 leader_election.cc:290] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:23.331662 18440 raft_consensus.cc:515] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:23.451102 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:23.451545 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:23.437352 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 14 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:11:23.454062 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 78024.7us
I20260709 12:11:23.447571 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:23.388695 18452 raft_consensus.cc:515] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:23.457578 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:23.426373 18397 raft_consensus.cc:1081] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 6 LEADER]: Signalling peer 885067a0d31741bfb5c9935788e315bf to start an election
I20260709 12:11:23.397343 18000 consensus_queue.cc:1048] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.059s
I20260709 12:11:23.459384 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:23.463887 14183 raft_consensus.cc:2410] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for term 14 because replica has last-logged OpId of term: 12 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 12:11:23.461859 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:23.466331 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:23.463809 18280 raft_consensus.cc:2804] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:23.470084 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:23.457620 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:23.474572 14185 raft_consensus.cc:2393] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 16: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:11:23.478083 18413 raft_consensus.cc:493] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:23.478825 18413 raft_consensus.cc:515] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:23.479856 18350 raft_consensus.cc:493] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:23.480429 18350 raft_consensus.cc:515] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:23.468086 18280 raft_consensus.cc:493] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:23.482931 18280 raft_consensus.cc:3060] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:23.483480 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:23.489289 18348 raft_consensus.cc:493] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:23.490156 18348 raft_consensus.cc:515] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:11:23.491266 18355 consensus_meta.cc:287] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.735s	user 0.010s	sys 0.010s
I20260709 12:11:23.491988 18355 raft_consensus.cc:515] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:23.494148 14338 raft_consensus.cc:1240] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:23.493404 18348 leader_election.cc:290] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:23.498603 14230 leader_election.cc:304] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:11:23.472744 18207 raft_consensus.cc:515] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:23.504460 18207 leader_election.cc:290] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:23.504804 18391 raft_consensus.cc:2804] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:23.505090 18000 consensus_queue.cc:1243] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer 885067a0d31741bfb5c9935788e315bf log is divergent from this leader: its last log entry 11.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:11:23.467480 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: true dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:11:23.505494 18391 raft_consensus.cc:697] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 11 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:11:23.506136 14903 raft_consensus.cc:3055] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:23.506512 14903 raft_consensus.cc:740] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:11:23.481416 18413 leader_election.cc:290] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:23.508021 14262 raft_consensus.cc:1275] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:11:23.508808 14262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41764 (request call id 2667) took 1552 ms. Trace:
I20260709 12:11:23.509197 14262 rpcz_store.cc:276] 0709 12:11:21.956105 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:23.422334 (+1466229us) service_pool.cc:224] Handling call
0709 12:11:23.476299 (+ 53965us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:23.508472 (+ 32173us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:23.508708 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:23.508279 18391 consensus_queue.cc:237] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:23.512606 14184 raft_consensus.cc:1240] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:23.515529 14229 leader_election.cc:304] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
W20260709 12:11:23.518280 18275 consensus_meta.cc:287] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db: Time spent flushing consensus metadata: real 0.892s	user 0.010s	sys 0.011s
I20260709 12:11:23.518510 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:23.518836 18275 raft_consensus.cc:515] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:23.519692 14908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:11:23.520120 14906 raft_consensus.cc:2393] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 16: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
W20260709 12:11:23.467878 18115 consensus_meta.cc:287] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db: Time spent flushing consensus metadata: real 0.642s	user 0.000s	sys 0.020s
I20260709 12:11:23.521417 18115 raft_consensus.cc:515] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:23.523840 18115 leader_election.cc:290] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 6 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:23.524865 14257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41764 (request call id 2666) took 1569 ms. Trace:
I20260709 12:11:23.476481 14263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41764 (request call id 2662) took 1513 ms. Trace:
I20260709 12:11:23.489202 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:23.525974 14263 rpcz_store.cc:276] 0709 12:11:21.954957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:23.378673 (+1423716us) service_pool.cc:224] Handling call
0709 12:11:23.408600 (+ 29927us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:23.460483 (+ 51883us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:23.460515 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:23.468542 (+  8027us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:23.468594 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:23.468658 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:23.468792 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:11:23.529654 14877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:23.529920 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
W20260709 12:11:23.530931 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:23.552510 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:23.532701 14330 raft_consensus.cc:3060] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:23.534224 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:11:23.504501 14230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:23.535300 18362 raft_consensus.cc:2749] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:23.525280 14257 rpcz_store.cc:276] 0709 12:11:21.955884 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:23.416910 (+1461026us) service_pool.cc:224] Handling call
0709 12:11:23.440150 (+ 23240us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:23.475818 (+ 35668us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:23.475850 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:23.524572 (+ 48722us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:23.524624 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:23.524682 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:23.524802 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:23.559384 14258 raft_consensus.cc:2393] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 10: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
W20260709 12:11:23.559635 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 103829us
I20260709 12:11:23.482678 18350 leader_election.cc:290] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:23.515684 18398 consensus_queue.cc:1048] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.047s
W20260709 12:11:23.565188 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 49852us
I20260709 12:11:23.507453 14903 consensus_queue.cc:260] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:23.577621 14903 raft_consensus.cc:3060] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:23.582338 14256 raft_consensus.cc:2393] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 11: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:11:23.582773 14186 raft_consensus.cc:3060] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:11:23.582983 14256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41764 (request call id 2671) took 1011 ms. Trace:
I20260709 12:11:23.583400 14256 rpcz_store.cc:276] 0709 12:11:22.571903 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:23.473284 (+901381us) service_pool.cc:224] Handling call
0709 12:11:23.582913 (+109629us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:23.584676 14256 raft_consensus.cc:1240] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:23.585315 14256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53050 (request call id 740) took 1409 ms. Trace:
I20260709 12:11:23.586133 18452 leader_election.cc:290] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:11:23.586167 17848 consensus_meta.cc:287] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.758s	user 0.009s	sys 0.012s
I20260709 12:11:23.589151 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:23.587023 17848 raft_consensus.cc:515] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:23.591392 14155 leader_election.cc:304] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:23.592603 14188 raft_consensus.cc:3060] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:23.594115 14190 raft_consensus.cc:1240] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:23.572836 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:23.595743 18151 raft_consensus.cc:515] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:23.596858 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:23.597837 18275 leader_election.cc:290] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 16 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:23.598079 18438 raft_consensus.cc:2804] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:23.598706 18438 raft_consensus.cc:493] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:23.599188 18438 raft_consensus.cc:3060] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:23.599882 18183 raft_consensus.cc:515] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:23.490661 18388 consensus_queue.cc:1059] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.073s
I20260709 12:11:23.575057 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:23.605670 14155 leader_election.cc:304] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
W20260709 12:11:23.512704 18326 consensus_meta.cc:287] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.749s	user 0.013s	sys 0.005s
I20260709 12:11:23.585635 14256 rpcz_store.cc:276] 0709 12:11:22.176324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:23.584090 (+1407766us) service_pool.cc:224] Handling call
0709 12:11:23.584490 (+   400us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:23.585052 (+   562us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:23.585233 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:23.613526 14903 raft_consensus.cc:2468] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 12.
I20260709 12:11:23.614629 14260 raft_consensus.cc:2468] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 11.
I20260709 12:11:23.615284 14260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41764 (request call id 2672) took 1043 ms. Trace:
I20260709 12:11:23.615675 14260 rpcz_store.cc:276] 0709 12:11:22.572192 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:23.324304 (+752112us) service_pool.cc:224] Handling call
0709 12:11:23.615220 (+290916us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:11:23.612248 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 57982.6us
W20260709 12:11:23.481348 18236 consensus_meta.cc:287] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.854s	user 0.006s	sys 0.014s
I20260709 12:11:23.617067 14331 raft_consensus.cc:2468] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 13.
I20260709 12:11:23.618920 14336 raft_consensus.cc:2410] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
W20260709 12:11:23.621933 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:23.626695 14229 leader_election.cc:304] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:23.611572 18452 raft_consensus.cc:493] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:23.635224 14257 raft_consensus.cc:1275] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:11:23.616564 17848 leader_election.cc:290] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:23.637452 14257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53050 (request call id 737) took 1680 ms. Trace:
I20260709 12:11:23.640581 14257 rpcz_store.cc:276] 0709 12:11:21.957073 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:23.574805 (+1617732us) service_pool.cc:224] Handling call
0709 12:11:23.631763 (+ 56958us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:23.635668 (+  3905us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:23.637379 (+  1711us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:23.643246 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:23.644697 14334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 719) took 2033 ms. Trace:
I20260709 12:11:23.645125 18231 raft_consensus.cc:2804] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:23.650480 14258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53050 (request call id 739) took 1496 ms. Trace:
I20260709 12:11:23.654074 14258 rpcz_store.cc:276] 0709 12:11:22.154484 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:23.564163 (+1409679us) service_pool.cc:224] Handling call
0709 12:11:23.632526 (+ 68363us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:23.642818 (+ 10292us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:23.642851 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:23.642896 (+    45us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:23.650293 (+  7397us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:23.650344 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:23.650421 (+    77us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:23.639336 18150 raft_consensus.cc:3055] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:23.636049 18151 leader_election.cc:290] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 8 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:23.669190 14184 raft_consensus.cc:2468] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 9.
I20260709 12:11:23.650784 18231 raft_consensus.cc:493] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:23.671016 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:23.671454 14188 raft_consensus.cc:2468] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 6.
I20260709 12:11:23.625857 18326 raft_consensus.cc:515] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:23.645169 14334 rpcz_store.cc:276] 0709 12:11:21.571377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:21.835295 (+263918us) service_pool.cc:224] Handling call
0709 12:11:21.909903 (+ 74608us) spinlock_profiling.cc:243] Waited 71.8 ms on lock 0x7b5800065d98. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2124016b71 00007f2124016a22 00007f212cf2f8d9 00007f212c089ee0 00007f212c1530ab 00007f212c153131 00007f212c114fc0 00007f212c0ff929 00007f212c0ff3d2 00007f2125676bd4
0709 12:11:21.910110 (+   207us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:21.910475 (+   365us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:21.910503 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:23.080293 (+1169790us) spinlock_profiling.cc:243] Waited 16.4 ms on lock 0x7b18001f9de0. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f212cf16ab1 00007f212cf23281 00007f212401c2a6 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2125a34a11 00007f2125a44372 00007f2127176a01 00007f212713b43a
0709 12:11:23.254681 (+174388us) spinlock_profiling.cc:243] Waited 4.11 ms on lock 0x7b2c0005b888. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2125a34a11 00007f2125a44372 00007f2127176a01 00007f212713b43a 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2
0709 12:11:23.255451 (+   770us) log.cc:844] Serialized 26 byte log entry
0709 12:11:23.416866 (+161415us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:23.416918 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:23.429263 (+ 12345us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:23.604620 (+175357us) raft_consensus.cc:1685] finished
0709 12:11:23.604642 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:23.604794 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2884,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":21872,"spinlock_wait_cycles":212302464,"thread_start_us":153076,"threads_started":1,"wal-append.queue_time_us":346954}
I20260709 12:11:23.653252 17983 leader_election.cc:290] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:23.649431 18362 raft_consensus.cc:2749] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:23.681944 18183 leader_election.cc:290] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 11 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:23.663686 18150 raft_consensus.cc:740] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
W20260709 12:11:23.679201 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 66391.7us
I20260709 12:11:23.675911 14260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53050 (request call id 743) took 1340 ms. Trace:
I20260709 12:11:23.685521 14257 raft_consensus.cc:1275] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:11:23.686205 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:23.673753 18231 raft_consensus.cc:3060] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:23.690958 14188 raft_consensus.cc:3060] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:23.702968 14256 raft_consensus.cc:1275] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:11:23.691427 17894 consensus_queue.cc:1048] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 12:11:23.694232 18306 consensus_queue.cc:260] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:23.697150 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:23.658419 18452 raft_consensus.cc:515] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:23.698624 18150 consensus_queue.cc:260] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:23.699841 18326 leader_election.cc:290] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:23.686793 14876 leader_election.cc:304] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:23.691207 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:23.704483 14190 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 2635) took 1376 ms. Trace:
I20260709 12:11:23.715241 14183 raft_consensus.cc:3060] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:23.702080 14332 raft_consensus.cc:2468] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 5.
I20260709 12:11:23.730782 14155 leader_election.cc:304] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:23.680891 18307 leader_election.cc:290] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:23.727685 14190 rpcz_store.cc:276] 0709 12:11:22.328498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:22.741899 (+413401us) service_pool.cc:224] Handling call
0709 12:11:22.773109 (+ 31210us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:23.594547 (+821438us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:23.704137 (+109590us) spinlock_profiling.cc:243] Waited 821 ms on lock 0x7b540038c7d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:11:23.704380 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1887289728}
I20260709 12:11:23.674248 18155 raft_consensus.cc:493] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:23.736917 14188 raft_consensus.cc:2468] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 9.
I20260709 12:11:23.716866 14330 raft_consensus.cc:2468] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 9.
I20260709 12:11:23.690346 14260 rpcz_store.cc:276] 0709 12:11:22.329909 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:23.624129 (+1294220us) service_pool.cc:224] Handling call
0709 12:11:23.649603 (+ 25474us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:23.662711 (+ 13108us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:23.662739 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:23.670344 (+  7605us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:23.670409 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:23.670485 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:23.670620 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:23.674443 18440 leader_election.cc:290] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 16 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:23.715299 14257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53050 (request call id 744) took 1379 ms. Trace:
I20260709 12:11:23.739336 14257 rpcz_store.cc:276] 0709 12:11:22.335772 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:23.648034 (+1312262us) service_pool.cc:224] Handling call
0709 12:11:23.680355 (+ 32321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:23.690426 (+ 10071us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:23.715218 (+ 24792us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:23.720168 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:23.722771 18236 raft_consensus.cc:493] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:11:23.724345 18306 raft_consensus.cc:3060] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:23.725030 14335 raft_consensus.cc:3060] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:23.726418 18150 raft_consensus.cc:3060] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:23.741029 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 54343.3us
I20260709 12:11:23.742048 14258 raft_consensus.cc:1275] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:11:23.716405 14256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53050 (request call id 741) took 1411 ms. Trace:
I20260709 12:11:23.739867 14229 leader_election.cc:400] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 11 pre-election: Vote denied by peer 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341) with higher term. Message: Invalid argument: T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 11. Current term is 12.
I20260709 12:11:23.743194 14256 rpcz_store.cc:276] 0709 12:11:22.304819 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:23.618181 (+1313362us) service_pool.cc:224] Handling call
0709 12:11:23.672481 (+ 54300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:23.714736 (+ 42255us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:23.716340 (+  1604us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:23.744438 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:23.745152 14330 raft_consensus.cc:2468] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 9.
I20260709 12:11:23.745615 14229 leader_election.cc:403] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:23.750418 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:23.735320 17848 raft_consensus.cc:2804] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:23.757087 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:23.764693 14334 raft_consensus.cc:1240] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:23.750974 18115 raft_consensus.cc:2804] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:11:23.770282 18115 raft_consensus.cc:697] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [term 6 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:11:23.770978 18452 leader_election.cc:290] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:23.771322 18115 consensus_queue.cc:237] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:23.776796 18280 raft_consensus.cc:515] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:23.777861 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:23.778450 17848 raft_consensus.cc:697] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 12 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:11:23.778674 14187 raft_consensus.cc:3060] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:23.779613 17848 consensus_queue.cc:237] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:23.780483 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:11:23.778113 14184 raft_consensus.cc:2393] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 11: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:11:23.785967 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:23.786012 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:11:23.787437 14912 raft_consensus.cc:1240] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:23.788386 14909 raft_consensus.cc:2393] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 13: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
I20260709 12:11:23.788606 14912 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6"
dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
mode: GRACEFUL
new_leader_uuid: "17aab1bbf5014936aa18cc21818b26ec"
 from {username='slave'} at 127.0.0.1:38628
I20260709 12:11:23.787447 14903 raft_consensus.cc:2393] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 13: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
W20260709 12:11:23.789564 14155 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:23.789851 18362 raft_consensus.cc:3060] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:11:23.786516 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
W20260709 12:11:23.790376 14155 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:23.793255 14155 leader_election.cc:304] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:23.794202 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:23.794849 14155 leader_election.cc:304] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:23.795727 18452 raft_consensus.cc:493] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:23.796283 14155 leader_election.cc:304] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:23.776675 14304 leader_election.cc:304] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:11:23.797386 18214 raft_consensus.cc:2804] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:23.797868 18214 raft_consensus.cc:493] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:23.789386 14912 raft_consensus.cc:606] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 10 LEADER]: Received request to transfer leadership to TS 17aab1bbf5014936aa18cc21818b26ec
W20260709 12:11:23.798553 14302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:23.785854 14228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:23.798091 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 87896.8us
I20260709 12:11:23.805459 14188 raft_consensus.cc:3060] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:23.806381 14330 raft_consensus.cc:1275] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:11:23.798202 17983 raft_consensus.cc:2804] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:23.802018 18214 raft_consensus.cc:3060] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:23.746243 18236 raft_consensus.cc:515] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:23.817655 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:23.821401 14256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53050 (request call id 748) took 1438 ms. Trace:
I20260709 12:11:23.824632 14256 rpcz_store.cc:276] 0709 12:11:22.383020 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:23.744036 (+1361016us) service_pool.cc:224] Handling call
0709 12:11:23.805213 (+ 61177us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:23.820928 (+ 15715us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:23.820963 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:23.821036 (+    73us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:23.821093 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:23.821171 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:23.821335 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:23.822399 14260 raft_consensus.cc:1240] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:23.796377 18452 raft_consensus.cc:515] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:11:23.819783 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 89283.7us
I20260709 12:11:23.818602 17983 raft_consensus.cc:493] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:11:23.830109 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:23.841459 14190 raft_consensus.cc:3060] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:23.804991 18440 raft_consensus.cc:2749] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:23.831902 14260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53050 (request call id 749) took 1445 ms. Trace:
I20260709 12:11:23.810774 18307 raft_consensus.cc:2749] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:23.842377 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:23.840204 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:23.842247 14260 rpcz_store.cc:276] 0709 12:11:22.386858 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:23.759117 (+1372259us) service_pool.cc:224] Handling call
0709 12:11:23.819278 (+ 60161us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:23.831476 (+ 12198us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:23.831824 (+   348us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:23.804212 18326 consensus_queue.cc:1048] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 12:11:23.851743 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:23.786375 18155 raft_consensus.cc:515] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:23.849327 14905 raft_consensus.cc:2468] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 8.
I20260709 12:11:23.858803 14188 raft_consensus.cc:2468] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 11.
I20260709 12:11:23.860149 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:23.860898 14188 raft_consensus.cc:2468] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 8.
I20260709 12:11:23.861968 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:23.863281 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:23.843197 17983 raft_consensus.cc:3060] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:23.864151 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 67975.6us
I20260709 12:11:23.867720 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:11:23.873257 14155 leader_election.cc:304] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:23.883044 14903 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f52421be255e4fab824173d17981b5bb"
dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
mode: GRACEFUL
new_leader_uuid: "885067a0d31741bfb5c9935788e315bf"
 from {username='slave'} at 127.0.0.1:38628
I20260709 12:11:23.883771 14903 raft_consensus.cc:606] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 11 LEADER]: Received request to transfer leadership to TS 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:23.897939 14877 leader_election.cc:304] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:23.903867 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:23.905207 14304 leader_election.cc:304] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:23.863970 18180 raft_consensus.cc:493] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
W20260709 12:11:23.920140 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 50686.8us
I20260709 12:11:23.921506 14335 raft_consensus.cc:2468] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 13.
I20260709 12:11:23.922664 14256 raft_consensus.cc:2393] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 9: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:11:23.894199 18440 raft_consensus.cc:493] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:23.942632 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:11:23.964205 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:11:23.914796 18307 raft_consensus.cc:2749] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:23.924152 18275 raft_consensus.cc:2749] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:23.932914 18280 leader_election.cc:290] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 11 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:23.979887 14187 raft_consensus.cc:2468] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 10.
I20260709 12:11:23.988147 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 13 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:23.988912 14187 raft_consensus.cc:2468] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 12.
I20260709 12:11:23.987211 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:23.996836 14186 raft_consensus.cc:2468] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 13.
I20260709 12:11:23.958483 18153 raft_consensus.cc:3060] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:24.003589 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
W20260709 12:11:24.008802 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 124584us
I20260709 12:11:24.016718 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:23.965265 18440 raft_consensus.cc:515] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:24.017699 14187 raft_consensus.cc:2368] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for earlier term 5. Current term is 6.
W20260709 12:11:24.019042 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 56456.2us
I20260709 12:11:24.021526 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
W20260709 12:11:24.030845 18458 log.cc:927] Time spent T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.263s	user 0.000s	sys 0.006s
I20260709 12:11:24.034200 18236 leader_election.cc:290] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:24.034922 18380 leader_election.cc:290] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 11 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:24.020718 14263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41764 (request call id 2670) took 2051 ms. Trace:
I20260709 12:11:23.964852 18180 raft_consensus.cc:515] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:24.059913 14155 leader_election.cc:304] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:24.078346 14304 leader_election.cc:304] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:24.078768 14183 raft_consensus.cc:2468] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 8.
I20260709 12:11:24.081420 14256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41764 (request call id 2676) took 1497 ms. Trace:
I20260709 12:11:24.083734 14256 rpcz_store.cc:276] 0709 12:11:22.584058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:24.005014 (+1420956us) service_pool.cc:224] Handling call
0709 12:11:24.005451 (+   437us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:24.005725 (+   274us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:24.049136 (+ 43411us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:24.049197 (+    61us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:24.081126 (+ 31929us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:24.081225 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:24.081352 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:24.085686 14877 leader_election.cc:304] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:24.088358 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:24.044739 14263 rpcz_store.cc:276] 0709 12:11:21.956822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:23.526954 (+1570132us) service_pool.cc:224] Handling call
0709 12:11:23.527427 (+   473us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:23.527750 (+   323us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:11:23.760357 (+232607us) log.cc:844] Serialized 14 byte log entry
0709 12:11:24.008006 (+247649us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:24.008073 (+    67us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:24.008128 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:24.008196 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:24.008331 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":366502,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":2500,"raft.queue_time_us":29528,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":13977,"thread_start_us":421205,"threads_started":2}
W20260709 12:11:24.108122 18464 log.cc:927] Time spent T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.114s	user 0.000s	sys 0.001s
I20260709 12:11:24.108383 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:24.109905 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:11:24.044757 18207 consensus_queue.cc:1059] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.064s
I20260709 12:11:24.109905 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
W20260709 12:11:24.090637 14303 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.174.129:37187 timed out after 2.040s (SENT) [suppressed 9 similar messages]
I20260709 12:11:24.087211 18362 raft_consensus.cc:2749] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341) with higher term. Message: Invalid argument: T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 11. Current term is 12.
I20260709 12:11:24.115399 14182 raft_consensus.cc:2393] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 11: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:11:24.120496 14184 raft_consensus.cc:3060] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:24.130394 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:24.102434 18115 raft_consensus.cc:2749] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:11:24.137342 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 142247us
I20260709 12:11:24.140453 14182 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3832505489c04d04a69e256187061921"
dest_uuid: "885067a0d31741bfb5c9935788e315bf"
 from {username='slave'} at 127.0.0.1:56652
I20260709 12:11:24.141320 14182 raft_consensus.cc:493] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:24.141726 14182 raft_consensus.cc:3060] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:11:24.142079 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 61434.8us
W20260709 12:11:24.130599 18461 log.cc:927] Time spent T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.136s	user 0.001s	sys 0.000s
I20260709 12:11:24.143040 14877 leader_election.cc:304] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:24.140516 14229 leader_election.cc:304] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:24.146306 14256 raft_consensus.cc:1240] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 11 LEADER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:24.147310 14262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41764 (request call id 2669) took 2190 ms. Trace:
I20260709 12:11:24.149044 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:24.141798 18393 raft_consensus.cc:3060] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:24.125484 18380 raft_consensus.cc:493] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:24.152070 14256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41768 (request call id 1796) took 1539 ms. Trace:
W20260709 12:11:24.153889 14265 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41764 (request call id 2674) took 1581 ms (client timeout 1587 ms). Trace:
W20260709 12:11:24.154034 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 75799.3us
I20260709 12:11:24.127269 18155 leader_election.cc:290] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:24.154217 18341 raft_consensus.cc:2749] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:24.134527 18183 raft_consensus.cc:2804] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:24.134193 18280 raft_consensus.cc:2804] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:24.178524 18280 raft_consensus.cc:493] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:24.178999 18280 raft_consensus.cc:3060] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:24.181259 18440 leader_election.cc:290] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:11:24.161190 18466 log.cc:927] Time spent T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.138s	user 0.000s	sys 0.000s
I20260709 12:11:24.157549 14263 raft_consensus.cc:1240] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:11:24.164777 14256 rpcz_store.cc:276] 0709 12:11:22.612211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:24.099216 (+1487005us) service_pool.cc:224] Handling call
0709 12:11:24.146098 (+ 46882us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:24.151799 (+  5701us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:24.152006 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:24.147730 14262 rpcz_store.cc:276] 0709 12:11:21.956588 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:23.510054 (+1553466us) service_pool.cc:224] Handling call
0709 12:11:23.510668 (+   614us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:23.511204 (+   536us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:23.511231 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:23.511942 (+   711us) log.cc:844] Serialized 52 byte log entry
0709 12:11:23.760650 (+248708us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:23.979312 (+218662us) log.cc:844] Serialized 14 byte log entry
0709 12:11:23.979559 (+   247us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:23.979638 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:24.147053 (+167415us) raft_consensus.cc:1685] finished
0709 12:11:24.147075 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:24.147242 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12885,"prepare.queue_time_us":161268,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":49,"raft.queue_time_us":6947,"raft.run_cpu_time_us":299,"raft.run_wall_time_us":11937,"thread_start_us":417797,"threads_started":2,"wal-append.queue_time_us":394119}
W20260709 12:11:24.159264 18309 consensus_meta.cc:287] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.726s	user 0.011s	sys 0.003s
W20260709 12:11:24.158620 18438 consensus_meta.cc:287] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.559s	user 0.014s	sys 0.000s
I20260709 12:11:24.177420 14877 leader_election.cc:304] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:24.178009 18183 raft_consensus.cc:697] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 11 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
W20260709 12:11:24.164057 14155 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:24.129422 18231 raft_consensus.cc:515] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:24.189716 14263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41768 (request call id 1801) took 1569 ms. Trace:
I20260709 12:11:24.192755 14263 rpcz_store.cc:276] 0709 12:11:22.620056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:24.099525 (+1479469us) service_pool.cc:224] Handling call
0709 12:11:24.151923 (+ 52398us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:24.189326 (+ 37403us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:24.189633 (+   307us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:11:24.164444 14265 rpcz_store.cc:269] 0709 12:11:22.572722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:22.777818 (+205096us) service_pool.cc:224] Handling call
0709 12:11:24.150923 (+1373105us) spinlock_profiling.cc:243] Waited 278 ms on lock 0x7b54001c1954. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:11:24.153810 (+  2887us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":639978240}
I20260709 12:11:24.166424 18348 raft_consensus.cc:2749] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:24.165695 17894 raft_consensus.cc:493] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:24.198609 14262 raft_consensus.cc:1275] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:11:24.199651 18362 raft_consensus.cc:493] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:24.202368 14229 leader_election.cc:304] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:24.219554 14188 raft_consensus.cc:2393] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 10: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:11:24.219398 14183 raft_consensus.cc:2468] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 10.
W20260709 12:11:24.225502 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 142243us
I20260709 12:11:24.221964 14182 raft_consensus.cc:515] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:24.228585 14183 raft_consensus.cc:1240] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:24.167704 18380 raft_consensus.cc:515] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:24.218008 18151 raft_consensus.cc:2764] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 12:11:24.235556 14182 leader_election.cc:290] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 7 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:24.204792 18438 raft_consensus.cc:515] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:24.191952 18309 raft_consensus.cc:515] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } }
I20260709 12:11:24.244675 14262 raft_consensus.cc:1275] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
W20260709 12:11:24.252822 18150 consensus_meta.cc:287] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db: Time spent flushing consensus metadata: real 0.501s	user 0.011s	sys 0.001s
I20260709 12:11:24.262851 14181 raft_consensus.cc:1240] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:24.253903 14257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41764 (request call id 2673) took 1681 ms. Trace:
I20260709 12:11:24.260321 14186 raft_consensus.cc:1240] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 7. Current term is 8. Ops: []
W20260709 12:11:24.261279 18459 log.cc:927] Time spent T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.235s	user 0.000s	sys 0.002s
I20260709 12:11:24.225567 18391 raft_consensus.cc:2749] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:24.268931 14339 raft_consensus.cc:2393] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 10: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:11:24.217533 18362 raft_consensus.cc:515] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:24.271986 14260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41764 (request call id 2675) took 1695 ms. Trace:
I20260709 12:11:24.272378 14260 rpcz_store.cc:276] 0709 12:11:22.576478 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:23.844356 (+1267878us) service_pool.cc:224] Handling call
0709 12:11:23.844771 (+   415us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:23.851098 (+  6327us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:11:24.062495 (+211397us) log.cc:844] Serialized 14 byte log entry
0709 12:11:24.271510 (+209015us) log.cc:844] Serialized 14 byte log entry
0709 12:11:24.271703 (+   193us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:24.271752 (+    49us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:24.271795 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:24.271842 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:24.271934 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":143210,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":67,"thread_start_us":334938,"threads_started":2}
I20260709 12:11:24.280203 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:24.280740 14907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: true dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:11:24.281436 14907 raft_consensus.cc:3055] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:24.281816 14907 raft_consensus.cc:740] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:11:24.282625 18000 raft_consensus.cc:3055] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:24.283106 18000 raft_consensus.cc:740] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:24.284030 18000 consensus_queue.cc:260] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:11:24.289367 18476 log.cc:927] Time spent T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 12:11:24.285586 18000 raft_consensus.cc:3060] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:24.232293 17894 raft_consensus.cc:515] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:24.292261 14259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41764 (request call id 2668) took 2335 ms. Trace:
W20260709 12:11:24.290920 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 113711us
I20260709 12:11:24.264040 18180 leader_election.cc:290] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:24.275018 14230 leader_election.cc:304] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:24.264672 14257 rpcz_store.cc:276] 0709 12:11:22.572438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:23.756521 (+1184083us) service_pool.cc:224] Handling call
0709 12:11:23.774249 (+ 17728us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:23.774695 (+   446us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:11:24.001968 (+227273us) log.cc:844] Serialized 14 byte log entry
0709 12:11:24.122531 (+120563us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:24.167935 (+ 45404us) log.cc:844] Serialized 26 byte log entry
0709 12:11:24.168164 (+   229us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:24.168203 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:24.168275 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:24.253636 (+ 85361us) raft_consensus.cc:1685] finished
0709 12:11:24.253657 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:24.253826 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40166,"prepare.queue_time_us":200775,"prepare.run_cpu_time_us":311,"prepare.run_wall_time_us":4267,"raft.queue_time_us":8829,"raft.run_cpu_time_us":324,"raft.run_wall_time_us":7296,"thread_start_us":260461,"threads_started":2,"wal-append.queue_time_us":132526}
I20260709 12:11:24.229630 18214 raft_consensus.cc:515] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:24.282655 14907 consensus_queue.cc:260] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:24.301334 14907 raft_consensus.cc:3060] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:24.292745 14259 rpcz_store.cc:276] 0709 12:11:21.956337 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:23.434481 (+1478144us) service_pool.cc:224] Handling call
0709 12:11:23.478000 (+ 43519us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:23.478575 (+   575us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:23.478611 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:23.479304 (+   693us) log.cc:844] Serialized 26 byte log entry
0709 12:11:23.714753 (+235449us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:11:23.714798 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:23.714896 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:24.292029 (+577133us) raft_consensus.cc:1685] finished
0709 12:11:24.292057 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:24.292197 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3487,"raft.run_cpu_time_us":214,"raft.run_wall_time_us":215,"thread_start_us":235002,"threads_started":1,"wal-append.queue_time_us":384826}
I20260709 12:11:24.304778 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:24.304836 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:24.305840 14333 raft_consensus.cc:2393] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 11: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:11:24.301805 14186 pending_rounds.cc:85] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf: Aborting all ops after (but not including) 6
I20260709 12:11:24.307049 14186 pending_rounds.cc:107] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 12:11:24.307248 14186 raft_consensus.cc:2889] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:24.308252 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:24.308566 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:24.281962 18183 consensus_queue.cc:237] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:24.309909 14229 leader_election.cc:304] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:24.314210 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 13 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:24.295143 18355 leader_election.cc:290] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:24.317189 18475 raft_consensus.cc:493] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:24.317927 18475 raft_consensus.cc:515] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:24.320839 18475 leader_election.cc:290] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:24.322935 18362 leader_election.cc:290] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:24.323549 14188 raft_consensus.cc:1240] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 12:11:24.325120 14188 raft_consensus.cc:1240] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 7. Current term is 8. Ops: []
W20260709 12:11:24.327137 18474 log.cc:927] Time spent T 00000000000000000000000000000000 P d07070be2c074f4cb9ad35f1580c4ef7: Append to log took a long time: real 0.173s	user 0.000s	sys 0.002s
I20260709 12:11:24.306169 18153 raft_consensus.cc:2749] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:24.314973 14337 raft_consensus.cc:2468] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 12.
I20260709 12:11:24.293275 18207 consensus_queue.cc:1059] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 12:11:24.331948 18155 consensus_queue.cc:1059] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 12:11:24.337129 14333 raft_consensus.cc:1240] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:24.339445 17894 leader_election.cc:290] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:24.340747 14182 raft_consensus.cc:1275] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 6. (term mismatch)
I20260709 12:11:24.276196 18280 raft_consensus.cc:515] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:24.341224 14182 pending_rounds.cc:85] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf: Aborting all ops after (but not including) 5
I20260709 12:11:24.350063 14182 pending_rounds.cc:107] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf: Aborting uncommitted NO_OP operation due to leader change: 12.6
I20260709 12:11:24.350482 14182 raft_consensus.cc:2889] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:24.350420 14907 raft_consensus.cc:2468] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 7.
W20260709 12:11:24.353942 14190 consensus_meta.cc:287] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.502s	user 0.012s	sys 0.000s
I20260709 12:11:24.354828 14190 raft_consensus.cc:2468] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 13.
W20260709 12:11:24.358879 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 88531.8us
I20260709 12:11:24.364353 17894 raft_consensus.cc:3055] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:24.364724 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:24.364379 18475 raft_consensus.cc:493] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:24.365624 14333 raft_consensus.cc:2468] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 11.
I20260709 12:11:24.365624 18475 raft_consensus.cc:515] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:24.368221 18475 leader_election.cc:290] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:24.364893 17894 raft_consensus.cc:740] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:24.358654 18391 raft_consensus.cc:2749] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:24.369488 17894 consensus_queue.cc:260] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:24.370647 14330 raft_consensus.cc:1275] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:11:24.370965 17894 raft_consensus.cc:3060] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:24.372810 18214 leader_election.cc:290] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 14 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:11:24.374409 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 78977.6us
I20260709 12:11:24.375687 14229 leader_election.cc:304] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:24.377097 14229 leader_election.cc:304] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:24.380029 18236 consensus_queue.cc:1048] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:24.381263 18280 leader_election.cc:290] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:24.381901 18236 raft_consensus.cc:2749] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:24.382740 18236 raft_consensus.cc:2749] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:24.380034 18207 consensus_queue.cc:1048] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 12:11:24.389250 14185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56044 (request call id 2644) took 1140 ms. Trace:
W20260709 12:11:24.391680 14878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:24.398205 14878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:24.392030 18426 raft_consensus.cc:993] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db: : Instructing follower 17aab1bbf5014936aa18cc21818b26ec to start an election
I20260709 12:11:24.393121 18326 raft_consensus.cc:3055] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:24.393034 14154 leader_election.cc:304] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:24.394822 14185 rpcz_store.cc:276] 0709 12:11:23.248592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:23.260847 (+ 12255us) service_pool.cc:224] Handling call
0709 12:11:24.388911 (+1128064us) spinlock_profiling.cc:243] Waited 191 ms on lock 0x7b540019c8d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:11:24.389132 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":439531264}
I20260709 12:11:24.391547 18452 leader_election.cc:290] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:24.358685 18362 raft_consensus.cc:2749] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:24.405134 14339 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50856 (request call id 2150) took 1011 ms. Trace:
I20260709 12:11:24.393623 18151 consensus_queue.cc:1048] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:24.405603 14339 rpcz_store.cc:276] 0709 12:11:23.393409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:23.397065 (+  3656us) service_pool.cc:224] Handling call
0709 12:11:24.404881 (+1007816us) spinlock_profiling.cc:243] Waited 856 ms on lock 0x7b5400338954. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:11:24.405055 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1968029568}
W20260709 12:11:24.419831 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 60069.5us
I20260709 12:11:24.425179 14338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 723) took 2727 ms. Trace:
I20260709 12:11:24.427084 14230 leader_election.cc:304] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:24.423601 14258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53050 (request call id 747) took 2048 ms. Trace:
I20260709 12:11:24.428098 14258 rpcz_store.cc:276] 0709 12:11:22.375384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:23.657189 (+1281805us) service_pool.cc:224] Handling call
0709 12:11:23.710559 (+ 53370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:23.742486 (+ 31927us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:24.421383 (+678897us) spinlock_profiling.cc:243] Waited 19.5 ms on lock 0x7b54002003d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:11:24.423504 (+  2121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":44787968}
I20260709 12:11:24.430501 14877 leader_election.cc:304] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
W20260709 12:11:24.432205 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 55222.1us
W20260709 12:11:24.433382 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 131200us
I20260709 12:11:24.425614 14338 rpcz_store.cc:276] 0709 12:11:21.697341 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:21.902237 (+204896us) service_pool.cc:224] Handling call
0709 12:11:22.632933 (+730696us) spinlock_profiling.cc:243] Waited 9.42 ms on lock 0x7b5800065d98. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2124016b71 00007f2124016a22 00007f212cf2f8d9 00007f212c089ee0 00007f212c1530ab 00007f212c153131 00007f212c114fc0 00007f212c0ff929 00007f212c0ff3d2 00007f2125676bd4
0709 12:11:22.633142 (+   209us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:23.496078 (+862936us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:24.421285 (+925207us) spinlock_profiling.cc:243] Waited 861 ms on lock 0x7b54002a6a54. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:11:24.425104 (+  3819us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2000874240}
I20260709 12:11:24.401963 18326 raft_consensus.cc:740] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:24.437875 14229 leader_election.cc:304] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:24.444031 14229 leader_election.cc:304] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:24.445173 14154 leader_election.cc:304] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:24.429896 18452 raft_consensus.cc:2804] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:24.446483 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:24.434962 18275 consensus_queue.cc:1059] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.012s
I20260709 12:11:24.447134 14229 leader_election.cc:304] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:24.425786 18231 leader_election.cc:290] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:24.451551 17836 consensus_queue.cc:1048] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 12:11:24.452167 14336 raft_consensus.cc:1240] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 11 LEADER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 12:11:24.453127 14230 leader_election.cc:304] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:11:24.455586 18380 leader_election.cc:290] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:24.441340 18362 raft_consensus.cc:2804] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:24.456400 18362 raft_consensus.cc:493] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:24.456780 18362 raft_consensus.cc:3060] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:24.458293 14184 raft_consensus.cc:2468] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 10.
I20260709 12:11:24.459160 14187 raft_consensus.cc:1240] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 9. Current term is 10. Ops: [7.4-9.5]
I20260709 12:11:24.432936 18426 raft_consensus.cc:1081] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 10 LEADER]: Signalling peer 17aab1bbf5014936aa18cc21818b26ec to start an election
I20260709 12:11:24.460377 18388 raft_consensus.cc:2749] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:24.419835 18150 consensus_queue.cc:1048] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 12:11:24.443569 18326 consensus_queue.cc:260] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:24.461966 18275 raft_consensus.cc:3055] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:24.462368 18275 raft_consensus.cc:740] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
W20260709 12:11:24.462831 17983 consensus_meta.cc:287] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.577s	user 0.013s	sys 0.000s
I20260709 12:11:24.462967 18326 raft_consensus.cc:3060] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:24.463318 17983 raft_consensus.cc:515] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:24.463430 18275 consensus_queue.cc:260] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:24.464915 14154 leader_election.cc:304] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:24.465880 17848 raft_consensus.cc:2749] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:24.466838 18399 raft_consensus.cc:2804] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:24.467826 18309 leader_election.cc:290] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 10 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:24.467140 14303 leader_election.cc:304] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:24.471387 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:24.471709 18309 raft_consensus.cc:2804] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:24.472199 14265 raft_consensus.cc:2468] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 11.
I20260709 12:11:24.475485 18438 leader_election.cc:290] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 8 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:24.471417 14303 leader_election.cc:304] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:24.480335 14229 leader_election.cc:304] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:24.485973 14303 leader_election.cc:400] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 election: Vote denied by peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187) with higher term. Message: Invalid argument: T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for earlier term 5. Current term is 6.
I20260709 12:11:24.465154 18275 raft_consensus.cc:3060] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:24.472163 18309 raft_consensus.cc:493] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:24.497064 14303 leader_election.cc:403] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:11:24.450297 18452 raft_consensus.cc:493] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:24.446555 18391 raft_consensus.cc:2749] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:24.499804 14229 leader_election.cc:304] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:24.478435 17848 raft_consensus.cc:2804] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:24.467365 18399 raft_consensus.cc:493] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:24.478613 18183 consensus_queue.cc:1048] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 12:11:24.503679 14338 raft_consensus.cc:1240] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 12:11:24.485276 18236 raft_consensus.cc:2804] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:24.499233 18309 raft_consensus.cc:3060] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:24.480149 17983 leader_election.cc:290] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 10 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:24.507911 14230 leader_election.cc:304] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:11:24.502233 14154 leader_election.cc:304] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:24.508757 17848 raft_consensus.cc:697] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 8 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:11:24.510691 14229 leader_election.cc:304] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:24.498078 18180 raft_consensus.cc:2749] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:24.516085 14155 leader_election.cc:304] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:24.506273 18452 raft_consensus.cc:3060] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:24.522460 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:24.522480 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:24.506824 18348 raft_consensus.cc:2804] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:24.529168 14258 raft_consensus.cc:1275] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 12:11:24.527982 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:24.530962 14339 raft_consensus.cc:2468] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 9.
I20260709 12:11:24.513090 18399 raft_consensus.cc:3060] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:24.512020 18380 raft_consensus.cc:2804] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:24.537678 14908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:11:24.534643 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:24.534935 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 13 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:24.538782 14256 raft_consensus.cc:2468] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 12.
I20260709 12:11:24.531210 18391 raft_consensus.cc:2804] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:24.539825 18391 raft_consensus.cc:493] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:24.540181 18391 raft_consensus.cc:3060] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:24.540557 18231 raft_consensus.cc:2749] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:24.513592 18398 raft_consensus.cc:2804] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:24.543327 14154 leader_election.cc:304] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:24.537434 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:24.522274 18000 raft_consensus.cc:3060] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:24.554801 14230 leader_election.cc:304] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:11:24.556128 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:24.530786 18153 consensus_queue.cc:1059] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 12:11:24.558877 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
W20260709 12:11:24.561098 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 45120.6us
I20260709 12:11:24.562079 14256 raft_consensus.cc:3060] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:24.538093 18214 raft_consensus.cc:2804] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:24.541765 18355 consensus_queue.cc:1059] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 12:11:24.523823 18207 consensus_queue.cc:1048] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 12:11:24.548414 18398 raft_consensus.cc:493] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
W20260709 12:11:24.567883 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 57284.1us
W20260709 12:11:24.565253 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 134857us
I20260709 12:11:24.565987 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:24.566431 14876 leader_election.cc:304] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:24.570355 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:24.553419 18231 raft_consensus.cc:2749] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:24.569509 14229 leader_election.cc:304] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:24.584990 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:24.589773 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:24.590756 14336 raft_consensus.cc:2393] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 11: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
W20260709 12:11:24.590932 14155 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:24.569489 18492 raft_consensus.cc:2749] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:24.593868 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
W20260709 12:11:24.594503 14302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:24.594252 18493 consensus_queue.cc:1059] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:24.560691 17894 consensus_queue.cc:1059] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 12:11:24.607332 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:24.572070 18214 raft_consensus.cc:697] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 7 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:11:24.572808 18398 raft_consensus.cc:3060] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:24.582055 18151 raft_consensus.cc:2804] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:24.614856 14337 raft_consensus.cc:3060] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:11:24.613083 14155 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:24.617108 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:11:24.619768 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 54116.6us
I20260709 12:11:24.623750 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:24.627971 14333 raft_consensus.cc:2368] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 12. Current term is 13.
I20260709 12:11:24.607698 18307 raft_consensus.cc:493] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:24.573526 18362 raft_consensus.cc:515] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:11:24.635895 18487 log.cc:927] Time spent T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 12:11:24.619768 18231 raft_consensus.cc:493] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:24.638144 18231 raft_consensus.cc:515] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:24.638299 18214 consensus_queue.cc:237] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:11:24.640307 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 51358us
I20260709 12:11:24.629885 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:24.642096 14257 raft_consensus.cc:2468] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 11.
I20260709 12:11:24.633379 18380 raft_consensus.cc:697] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 13 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:11:24.644683 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:24.646513 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
W20260709 12:11:24.654600 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 95052.9us
I20260709 12:11:24.656721 18307 raft_consensus.cc:515] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:24.659307 18307 leader_election.cc:290] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:24.664372 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:24.690188 14908 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f"
dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
mode: GRACEFUL
new_leader_uuid: "17aab1bbf5014936aa18cc21818b26ec"
 from {username='slave'} at 127.0.0.1:38628
I20260709 12:11:24.691783 14908 raft_consensus.cc:606] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [term 8 LEADER]: Received request to transfer leadership to TS 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:11:24.697021 14303 leader_election.cc:304] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:11:24.699329 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:24.700132 14260 raft_consensus.cc:2468] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 9.
I20260709 12:11:24.701025 14184 raft_consensus.cc:1240] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 7. Current term is 8. Ops: []
W20260709 12:11:24.702164 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 85760.8us
W20260709 12:11:24.704248 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 134872us
I20260709 12:11:24.711782 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:24.669008 18236 raft_consensus.cc:697] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 9 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:11:24.667282 18348 raft_consensus.cc:697] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 11 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:11:24.718734 14331 raft_consensus.cc:2393] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 9: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:11:24.719508 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:24.721177 14260 raft_consensus.cc:2376] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 11. Re-sending same reply.
I20260709 12:11:24.692829 18492 raft_consensus.cc:2804] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:11:24.723985 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 197687us
I20260709 12:11:24.696022 18151 raft_consensus.cc:697] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 8 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:11:24.732406 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:24.678884 17836 consensus_queue.cc:1048] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.049s
W20260709 12:11:24.723179 18483 log.cc:927] Time spent T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.207s	user 0.002s	sys 0.000s
I20260709 12:11:24.736681 14230 leader_election.cc:304] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:11:24.630016 17848 consensus_queue.cc:237] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:24.739099 14260 raft_consensus.cc:1275] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:11:24.758606 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:24.746356 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:24.725432 17894 raft_consensus.cc:3055] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:24.712702 18452 raft_consensus.cc:515] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:24.756206 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:24.759982 14333 raft_consensus.cc:3060] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:24.759979 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 45433.6us
I20260709 12:11:24.761387 18231 leader_election.cc:290] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:24.761847 18362 leader_election.cc:290] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 13 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:24.738298 18355 raft_consensus.cc:3055] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:24.764230 18494 raft_consensus.cc:2804] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:24.764521 18496 consensus_queue.cc:1048] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:11:24.734119 18492 raft_consensus.cc:697] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 13 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
W20260709 12:11:24.810633 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 83697.8us
I20260709 12:11:24.769402 14256 raft_consensus.cc:2468] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 14.
I20260709 12:11:24.792701 18501 raft_consensus.cc:2804] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:24.792937 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:11:24.793355 18462 log.cc:927] Time spent T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.873s	user 0.002s	sys 0.006s
I20260709 12:11:24.777901 14230 leader_election.cc:304] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
W20260709 12:11:24.868963 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 91152.9us
I20260709 12:11:24.774494 17894 raft_consensus.cc:740] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:24.852000 14229 leader_election.cc:304] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:24.842913 18494 raft_consensus.cc:493] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:24.829381 18355 raft_consensus.cc:740] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:24.754168 18380 consensus_queue.cc:237] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:24.881512 14337 raft_consensus.cc:2410] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db for term 16 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 12:11:24.883296 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: true dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
W20260709 12:11:24.874505 18393 consensus_meta.cc:287] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.711s	user 0.010s	sys 0.003s
I20260709 12:11:24.903108 14256 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6"
dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
 from {username='slave'} at 127.0.0.1:53050
I20260709 12:11:24.938458 14256 raft_consensus.cc:493] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:24.938915 14256 raft_consensus.cc:3060] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:24.858839 18504 raft_consensus.cc:2804] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:24.796658 18503 consensus_queue.cc:1059] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.081s
I20260709 12:11:24.935437 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:24.936797 14331 raft_consensus.cc:3060] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:11:24.942018 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 72294.8us
W20260709 12:11:24.943751 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 227261us
I20260709 12:11:24.948436 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:24.948953 14261 raft_consensus.cc:2410] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 12:11:24.858716 17836 consensus_queue.cc:1059] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.076s
I20260709 12:11:24.962404 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:24.881671 18509 raft_consensus.cc:2804] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:11:24.960896 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 256706us
I20260709 12:11:24.881117 18494 raft_consensus.cc:3060] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:24.968452 14337 raft_consensus.cc:2468] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 9.
I20260709 12:11:24.971088 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:24.883232 18151 consensus_queue.cc:237] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:24.974809 12986 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:11:24.860603 18236 consensus_queue.cc:237] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:11:25.007791 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 156195us
I20260709 12:11:25.008809 14229 leader_election.cc:304] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:24.965672 18509 raft_consensus.cc:493] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:11:24.981905 18504 raft_consensus.cc:697] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 10 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:25.010900 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:25.022634 14337 raft_consensus.cc:3060] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:25.022714 14331 raft_consensus.cc:2468] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 7.
I20260709 12:11:24.998775 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:25.046890 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:24.960506 18362 consensus_queue.cc:1048] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 12:11:25.030097 14330 raft_consensus.cc:1275] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:11:25.048957 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:25.050096 14334 raft_consensus.cc:2468] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 10.
I20260709 12:11:24.938265 18348 consensus_queue.cc:237] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.4, Last appended by leader: 4, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:25.054065 18519 raft_consensus.cc:493] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:25.054701 17836 raft_consensus.cc:3055] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:25.055209 18000 raft_consensus.cc:2749] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187) with higher term. Message: Invalid argument: T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for earlier term 5. Current term is 6.
I20260709 12:11:25.055703 18489 consensus_queue.cc:1059] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:25.056885 18115 raft_consensus.cc:993] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db: : Instructing follower 885067a0d31741bfb5c9935788e315bf to start an election
I20260709 12:11:24.989344 18506 consensus_queue.cc:1048] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.070s
I20260709 12:11:25.016145 18509 raft_consensus.cc:3060] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:25.014897 18492 consensus_queue.cc:237] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:25.043848 17894 consensus_queue.cc:260] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:25.059230 18398 raft_consensus.cc:515] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:11:25.054132 14302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:25.056808 18508 log.cc:927] Time spent T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.196s	user 0.001s	sys 0.000s
I20260709 12:11:25.103615 18519 raft_consensus.cc:515] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:11:25.104460 14303 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:25.099646 18504 consensus_queue.cc:237] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:25.006285 14256 raft_consensus.cc:515] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:25.061616 18511 consensus_queue.cc:1048] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.059s
I20260709 12:11:25.121218 17836 raft_consensus.cc:740] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:11:25.133648 14333 raft_consensus.cc:2468] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 11.
W20260709 12:11:25.097355 18275 consensus_meta.cc:287] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db: Time spent flushing consensus metadata: real 0.591s	user 0.016s	sys 0.000s
I20260709 12:11:25.157231 14303 leader_election.cc:304] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:25.139923 18115 raft_consensus.cc:1081] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 11 LEADER]: Signalling peer 885067a0d31741bfb5c9935788e315bf to start an election
I20260709 12:11:25.162987 18398 leader_election.cc:290] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 9 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:25.163483 14184 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f52421be255e4fab824173d17981b5bb"
dest_uuid: "885067a0d31741bfb5c9935788e315bf"
 from {username='slave'} at 127.0.0.1:56652
I20260709 12:11:25.164141 14184 raft_consensus.cc:493] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:25.164521 14184 raft_consensus.cc:3060] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:25.047502 18355 consensus_queue.cc:260] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:25.154503 17894 raft_consensus.cc:3060] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:25.192224 14256 leader_election.cc:290] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 11 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:11:25.168941 18326 consensus_meta.cc:287] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.703s	user 0.012s	sys 0.001s
W20260709 12:11:25.202925 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 45784.1us
I20260709 12:11:25.168334 14908 raft_consensus.cc:1275] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:11:25.186827 14337 raft_consensus.cc:2468] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 10.
I20260709 12:11:25.189801 14304 leader_election.cc:304] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:25.181955 18501 raft_consensus.cc:697] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 10 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:11:25.200489 14184 raft_consensus.cc:515] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:11:25.206842 18522 log.cc:927] Time spent T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:11:25.207257 18180 raft_consensus.cc:3055] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:25.207743 18180 raft_consensus.cc:740] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:25.208889 14256 raft_consensus.cc:1240] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 12:11:25.208745 18180 consensus_queue.cc:260] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:25.211374 17836 consensus_queue.cc:260] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:25.212785 17836 raft_consensus.cc:3060] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:25.215593 14339 raft_consensus.cc:2468] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 6.
I20260709 12:11:25.218569 14303 leader_election.cc:304] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:25.221496 14184 leader_election.cc:290] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:25.206871 18519 leader_election.cc:290] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:25.207767 18512 raft_consensus.cc:2749] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:25.217938 18180 raft_consensus.cc:3060] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:25.204902 18452 leader_election.cc:290] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:25.240267 14338 raft_consensus.cc:2468] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 8.
W20260709 12:11:25.243654 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 53997.8us
I20260709 12:11:25.246940 14184 raft_consensus.cc:1240] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:25.247761 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:25.248705 14186 raft_consensus.cc:2368] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for earlier term 10. Current term is 11.
W20260709 12:11:25.236248 18391 consensus_meta.cc:287] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.696s	user 0.006s	sys 0.006s
I20260709 12:11:25.258720 14304 leader_election.cc:304] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:25.260355 18000 raft_consensus.cc:3060] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:25.260775 14304 leader_election.cc:304] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:25.260675 18326 consensus_queue.cc:1048] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:11:25.261847 18513 raft_consensus.cc:2749] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:25.262702 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:25.263514 14185 raft_consensus.cc:2393] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 10: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
W20260709 12:11:25.263727 18533 log.cc:927] Time spent T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
W20260709 12:11:25.243820 18472 log.cc:927] Time spent T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.095s	user 0.003s	sys 0.000s
I20260709 12:11:25.265785 14304 leader_election.cc:304] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:11:25.272333 14304 leader_election.cc:304] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:25.274955 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:25.266347 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:25.275875 14181 raft_consensus.cc:1240] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:25.276824 14184 raft_consensus.cc:2368] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for earlier term 10. Current term is 11.
I20260709 12:11:25.277509 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
W20260709 12:11:25.277828 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 59352.2us
I20260709 12:11:25.287392 14190 raft_consensus.cc:1240] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 12:11:25.291709 14907 raft_consensus.cc:1275] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:11:25.292888 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:25.293977 14908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:25.255261 18355 raft_consensus.cc:3060] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:25.296311 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:11:25.299427 14912 raft_consensus.cc:3060] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:25.270596 18153 raft_consensus.cc:2749] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:25.244616 18528 raft_consensus.cc:2804] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:11:25.276187 18309 consensus_meta.cc:287] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.748s	user 0.013s	sys 0.003s
I20260709 12:11:25.305142 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: true dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:11:25.308995 14303 leader_election.cc:400] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 10 pre-election: Vote denied by peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187) with higher term. Message: Invalid argument: T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for earlier term 10. Current term is 11.
I20260709 12:11:25.311594 14905 raft_consensus.cc:3055] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:25.310884 14188 raft_consensus.cc:1275] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 12:11:25.312063 14188 pending_rounds.cc:85] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf: Aborting all ops after (but not including) 5
I20260709 12:11:25.312341 14188 pending_rounds.cc:107] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 12:11:25.312652 14188 raft_consensus.cc:2889] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:25.311966 14905 raft_consensus.cc:740] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:11:25.277132 18155 raft_consensus.cc:2804] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:25.314302 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:25.316598 14184 raft_consensus.cc:2468] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 9.
I20260709 12:11:25.320956 14188 raft_consensus.cc:1240] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:25.323173 14303 leader_election.cc:400] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 10 election: Vote denied by peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187) with higher term. Message: Invalid argument: T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for earlier term 10. Current term is 11.
I20260709 12:11:25.323589 14303 leader_election.cc:403] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
W20260709 12:11:25.323783 18539 log.cc:927] Time spent T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
W20260709 12:11:25.325420 18524 log.cc:927] Time spent T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
I20260709 12:11:25.314193 18519 raft_consensus.cc:2804] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:11:25.326270 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 53991.7us
I20260709 12:11:25.305227 18326 raft_consensus.cc:493] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:25.265064 18391 raft_consensus.cc:515] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:25.312763 18528 raft_consensus.cc:493] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
W20260709 12:11:25.322319 18399 consensus_meta.cc:287] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.761s	user 0.009s	sys 0.004s
I20260709 12:11:25.339597 18513 consensus_queue.cc:1048] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:25.342161 14257 raft_consensus.cc:2368] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for earlier term 10. Current term is 11.
W20260709 12:11:25.344079 18536 log.cc:927] Time spent T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260709 12:11:25.344405 18509 raft_consensus.cc:515] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:25.345993 18391 leader_election.cc:290] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 11 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:25.334412 18501 consensus_queue.cc:237] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } }
I20260709 12:11:25.346252 18497 raft_consensus.cc:493] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:25.346843 18497 raft_consensus.cc:515] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:25.347474 18509 leader_election.cc:290] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:25.316304 18155 raft_consensus.cc:493] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:25.297178 18440 consensus_queue.cc:1048] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 12:11:25.315089 18309 raft_consensus.cc:515] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:25.354112 14303 leader_election.cc:304] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:25.336199 14304 leader_election.cc:304] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:25.334071 14905 consensus_queue.cc:260] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:25.337707 18399 raft_consensus.cc:515] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:11:25.370302 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 361591us
I20260709 12:11:25.369093 14905 raft_consensus.cc:3060] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:25.330860 18519 raft_consensus.cc:697] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 11 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:25.371448 14229 leader_election.cc:304] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:25.368396 14188 raft_consensus.cc:1240] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:25.359983 18155 raft_consensus.cc:3060] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:25.358403 18153 raft_consensus.cc:2749] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187) with higher term. Message: Invalid argument: T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for earlier term 10. Current term is 11.
W20260709 12:11:25.397670 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 61546.3us
I20260709 12:11:25.403234 14303 leader_election.cc:304] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:25.353680 18528 raft_consensus.cc:3060] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:25.334674 18326 raft_consensus.cc:515] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:25.415169 18529 raft_consensus.cc:2804] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:25.416549 18362 raft_consensus.cc:493] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:25.420344 14905 raft_consensus.cc:2468] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 12.
I20260709 12:11:25.369428 18512 raft_consensus.cc:2804] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:25.431770 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:25.432941 14154 leader_election.cc:304] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:25.433629 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: true dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:25.434336 14333 raft_consensus.cc:3060] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:25.374166 18505 raft_consensus.cc:2749] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:25.369185 18513 consensus_queue.cc:1048] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
W20260709 12:11:25.451407 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 48278.6us
I20260709 12:11:25.413749 18504 raft_consensus.cc:2804] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:25.405014 18348 raft_consensus.cc:493] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:25.431174 18487 log.cc:927] Time spent T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:11:25.456885 14303 leader_election.cc:304] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:25.452912 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:25.459136 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:25.479404 14337 raft_consensus.cc:3060] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:25.461889 14878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:25.463954 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:25.482383 14330 raft_consensus.cc:2393] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 11: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:11:25.440615 18512 raft_consensus.cc:493] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:25.486308 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 114972us
I20260709 12:11:25.485266 14333 raft_consensus.cc:2468] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 11.
I20260709 12:11:25.377554 18521 consensus_queue.cc:1059] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.100s
I20260709 12:11:25.439813 18391 raft_consensus.cc:493] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:25.460440 18393 raft_consensus.cc:3060] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:25.439858 18529 raft_consensus.cc:493] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:25.498363 14912 raft_consensus.cc:2468] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 12.
I20260709 12:11:25.506448 14337 raft_consensus.cc:2468] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 13.
I20260709 12:11:25.450680 18362 raft_consensus.cc:515] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:25.481453 18504 raft_consensus.cc:697] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 14 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:25.487893 18512 raft_consensus.cc:3060] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:25.420317 18519 consensus_queue.cc:237] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:25.528733 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:25.499274 18509 raft_consensus.cc:493] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:25.520076 18275 raft_consensus.cc:493] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:25.520709 17894 raft_consensus.cc:2749] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:25.537768 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:25.543047 14258 raft_consensus.cc:3060] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:25.517628 18529 raft_consensus.cc:3060] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:25.544914 14259 raft_consensus.cc:1240] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:25.481253 18348 raft_consensus.cc:515] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:25.531258 18493 raft_consensus.cc:2749] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:25.523083 18236 consensus_queue.cc:1059] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.024s
W20260709 12:11:25.547530 18494 consensus_meta.cc:287] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.570s	user 0.010s	sys 0.002s
I20260709 12:11:25.518882 18391 raft_consensus.cc:515] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:25.559257 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:25.573827 18326 leader_election.cc:290] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:25.575335 18000 raft_consensus.cc:2749] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:25.550345 18275 raft_consensus.cc:515] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:25.576929 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
W20260709 12:11:25.578402 18538 log.cc:927] Time spent T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 12:11:25.546249 18509 raft_consensus.cc:515] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:11:25.579396 14302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:25.580250 18362 leader_election.cc:290] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:25.581218 18399 leader_election.cc:290] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:25.580893 18504 consensus_queue.cc:237] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:25.614179 14262 raft_consensus.cc:1275] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:11:25.615142 18309 leader_election.cc:290] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 13 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:25.617146 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:25.618376 18348 leader_election.cc:290] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:25.622808 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:25.623535 14256 raft_consensus.cc:2468] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 11.
I20260709 12:11:25.624477 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:25.633456 18150 raft_consensus.cc:3055] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:25.633929 18150 raft_consensus.cc:740] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:11:25.634363 18393 raft_consensus.cc:2749] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:25.634789 18150 consensus_queue.cc:260] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:25.635315 18391 leader_election.cc:290] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:25.623692 14338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50858 (request call id 1834) took 1058 ms. Trace:
I20260709 12:11:25.625578 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:25.636536 14338 rpcz_store.cc:276] 0709 12:11:24.565563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:24.565862 (+   299us) service_pool.cc:224] Handling call
0709 12:11:25.623476 (+1057614us) spinlock_profiling.cc:243] Waited 630 ms on lock 0x7b5400338e54. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:11:25.623603 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1447996800}
I20260709 12:11:25.637795 14262 raft_consensus.cc:3060] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:11:25.562258 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 105450us
I20260709 12:11:25.590310 14260 raft_consensus.cc:2410] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:11:25.599336 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:25.599301 18494 raft_consensus.cc:515] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:25.610808 18275 leader_election.cc:290] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:25.612864 18509 leader_election.cc:290] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:25.635809 18150 raft_consensus.cc:3060] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:25.640404 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:25.644635 18000 raft_consensus.cc:493] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:25.645203 18000 raft_consensus.cc:515] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:25.646311 18494 leader_election.cc:290] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 13 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:25.647096 18515 raft_consensus.cc:993] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db: : Instructing follower 17aab1bbf5014936aa18cc21818b26ec to start an election
I20260709 12:11:25.647390 18000 leader_election.cc:290] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:25.647574 18515 raft_consensus.cc:1081] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [term 8 LEADER]: Signalling peer 17aab1bbf5014936aa18cc21818b26ec to start an election
I20260709 12:11:25.648806 18398 raft_consensus.cc:3055] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:25.649206 18398 raft_consensus.cc:740] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:11:25.645215 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:25.650110 18398 consensus_queue.cc:260] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:25.650712 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:25.651543 14259 raft_consensus.cc:2393] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 11: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:11:25.652436 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:25.653106 14259 raft_consensus.cc:2468] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 10.
I20260709 12:11:25.655019 14336 raft_consensus.cc:2410] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 12:11:25.641229 18309 consensus_queue.cc:1048] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 12:11:25.654481 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
W20260709 12:11:25.657752 14155 leader_election.cc:336] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Timed out: RequestConsensusVote RPC to 127.12.174.130:36673 timed out after 2.122s (SENT)
I20260709 12:11:25.651624 18398 raft_consensus.cc:3060] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:25.658154 14907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:25.660379 18207 raft_consensus.cc:3055] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:25.660755 18207 raft_consensus.cc:740] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:25.658059 14259 raft_consensus.cc:2393] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 11: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:11:25.651487 18528 raft_consensus.cc:515] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:25.658250 14155 leader_election.cc:304] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:25.658759 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:25.665980 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:25.661787 18207 consensus_queue.cc:260] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:25.667534 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:25.652697 18512 raft_consensus.cc:515] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:25.667780 14256 raft_consensus.cc:3060] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:25.670125 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:25.674415 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:25.677337 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:25.681928 14258 raft_consensus.cc:2468] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 8.
I20260709 12:11:25.682232 14334 raft_consensus.cc:2393] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 10: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
W20260709 12:11:25.675173 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 128318us
I20260709 12:11:25.684927 14264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41764 (request call id 2689) took 1124 ms. Trace:
I20260709 12:11:25.686336 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:25.691285 14256 raft_consensus.cc:2468] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 11.
I20260709 12:11:25.693994 14258 raft_consensus.cc:2410] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:11:25.678449 18207 raft_consensus.cc:3060] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:25.723893 14258 raft_consensus.cc:1240] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 12:11:25.692190 14264 rpcz_store.cc:276] 0709 12:11:24.560878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:24.561029 (+   151us) service_pool.cc:224] Handling call
0709 12:11:25.684727 (+1123698us) spinlock_profiling.cc:243] Waited 627 ms on lock 0x7b54002652d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:11:25.684869 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1441202560}
I20260709 12:11:25.731309 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
W20260709 12:11:25.742823 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 50498.7us
I20260709 12:11:25.743649 14304 leader_election.cc:400] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 10 election: Vote denied by peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673) with higher term. Message: Invalid argument: T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for earlier term 10. Current term is 11.
W20260709 12:11:25.730368 17836 consensus_meta.cc:287] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db: Time spent flushing consensus metadata: real 0.511s	user 0.008s	sys 0.004s
I20260709 12:11:25.752624 14262 raft_consensus.cc:2468] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 8.
I20260709 12:11:25.755272 18493 consensus_queue.cc:1048] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:11:25.758131 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:25.759258 18495 raft_consensus.cc:493] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:11:25.763736 18495 raft_consensus.cc:515] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:25.761158 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:25.765527 14264 raft_consensus.cc:2376] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 8. Re-sending same reply.
I20260709 12:11:25.767539 18495 leader_election.cc:290] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:11:25.771476 14261 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53050 (request call id 746) took 3405 ms (client timeout 2232 ms). Trace:
W20260709 12:11:25.771894 14261 rpcz_store.cc:269] 0709 12:11:22.366135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:23.390305 (+1024170us) service_pool.cc:224] Handling call
0709 12:11:25.771260 (+2380955us) spinlock_profiling.cc:243] Waited 1.56 s on lock 0x7b54001c3254. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:11:25.771404 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3580809600}
I20260709 12:11:25.772250 18495 raft_consensus.cc:493] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:25.772746 18495 raft_consensus.cc:515] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:25.773226 14339 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55492 (request call id 736) took 1184 ms. Trace:
I20260709 12:11:25.758546 14304 leader_election.cc:304] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:25.774173 17983 raft_consensus.cc:2749] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:25.773667 14339 rpcz_store.cc:276] 0709 12:11:24.589127 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:24.589261 (+   134us) service_pool.cc:224] Handling call
0709 12:11:24.664176 (+ 74915us) spinlock_profiling.cc:243] Waited 1.57 ms on lock 0x7b5800065d98. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2124016b71 00007f2124016eee 000000000036eb39 00007f212c08a1e0 00007f212c1530c4 00007f212c153131 00007f212c1010a0 00007f212c100984 00007f212567b6d4 00007f212567b662
0709 12:11:25.773055 (+1108879us) spinlock_profiling.cc:243] Waited 463 ms on lock 0x7b54002a6054. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:11:25.773160 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1068067968}
W20260709 12:11:25.775031 14877 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.896s	user 0.032s	sys 0.032s
W20260709 12:11:25.775372 14877 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.896s	user 0.032s	sys 0.032s
W20260709 12:11:25.775632 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 903729us
I20260709 12:11:25.778277 14334 raft_consensus.cc:1240] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 12. Current term is 13. Ops: [12.10-12.10]
W20260709 12:11:25.784056 14875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:25.786626 14304 leader_election.cc:304] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:25.786824 18155 raft_consensus.cc:515] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:25.787890 18502 raft_consensus.cc:3055] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:25.788300 18502 raft_consensus.cc:740] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:25.789033 18155 leader_election.cc:290] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 12 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:25.789198 18502 consensus_queue.cc:260] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:25.790974 18502 raft_consensus.cc:3060] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:25.790999 18512 leader_election.cc:290] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 10 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:25.791313 14908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:11:25.794234 18495 leader_election.cc:290] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:25.794610 18452 raft_consensus.cc:2804] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:25.835495 18452 raft_consensus.cc:697] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 12 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:11:25.836591 18452 consensus_queue.cc:237] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:25.795051 18440 raft_consensus.cc:493] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:25.797159 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 139470us
I20260709 12:11:25.797924 18307 raft_consensus.cc:2749] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:25.801697 17983 raft_consensus.cc:2749] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:11:25.794495 14154 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 361655us
I20260709 12:11:25.802973 18497 leader_election.cc:290] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:25.803028 14230 leader_election.cc:304] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:11:25.808746 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: true dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:25.844386 14264 raft_consensus.cc:3060] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:25.845245 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:25.810282 14910 raft_consensus.cc:1240] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 12:11:25.846711 14186 raft_consensus.cc:1275] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:11:25.810503 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:25.847411 14258 raft_consensus.cc:2468] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 11.
I20260709 12:11:25.848353 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:25.810868 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:25.848927 14258 raft_consensus.cc:2468] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 10.
I20260709 12:11:25.849510 14912 raft_consensus.cc:2393] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 8: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:11:25.811089 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:11:25.811558 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:11:25.812206 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:25.785338 18529 raft_consensus.cc:515] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:25.816766 18438 raft_consensus.cc:493] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:25.791666 18528 leader_election.cc:290] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 12 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:25.860384 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:25.860620 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:25.860766 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:11:25.861568 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:25.862464 14333 raft_consensus.cc:1275] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 12:11:25.861164 14259 raft_consensus.cc:2393] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 10: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:11:25.863124 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:25.863752 14188 raft_consensus.cc:2468] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 9.
I20260709 12:11:25.820058 14332 raft_consensus.cc:1240] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:25.821717 14257 raft_consensus.cc:2468] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 10.
I20260709 12:11:25.846939 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:11:25.838981 14155 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:25.838483 18440 raft_consensus.cc:515] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:25.848750 14338 raft_consensus.cc:1275] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:11:25.865617 14334 raft_consensus.cc:2468] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 13.
I20260709 12:11:25.843686 14230 leader_election.cc:304] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:11:25.855906 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: true dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:11:25.856192 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:25.828668 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:25.867660 14906 raft_consensus.cc:3055] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 10 LEADER]: Stepping down as leader of term 10
W20260709 12:11:25.866693 14155 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:25.868522 14184 raft_consensus.cc:2468] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 10.
I20260709 12:11:25.868009 14906 raft_consensus.cc:740] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:11:25.871884 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 13 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:25.872016 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:25.870045 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:25.872670 14333 raft_consensus.cc:2393] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 13: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:11:25.860242 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 13 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:25.874658 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:25.870136 14876 leader_election.cc:304] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:25.874400 14181 raft_consensus.cc:2468] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 12.
I20260709 12:11:25.877238 14187 raft_consensus.cc:1240] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 12:11:25.878100 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:25.878634 14188 raft_consensus.cc:3060] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:25.879663 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:25.882225 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:25.884475 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:25.885205 14186 raft_consensus.cc:2393] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 11: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:11:25.888906 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:25.881067 14229 leader_election.cc:304] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:25.890067 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:25.891549 14184 raft_consensus.cc:2468] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 11.
I20260709 12:11:25.892416 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 13 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:25.892926 14184 raft_consensus.cc:3060] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:25.893972 14335 raft_consensus.cc:2468] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 11.
I20260709 12:11:25.894029 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:25.895015 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:25.882815 14909 raft_consensus.cc:2468] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 13.
I20260709 12:11:25.875360 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:25.894979 14155 leader_election.cc:304] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:25.896571 14230 leader_election.cc:304] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:11:25.894377 18393 raft_consensus.cc:493] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:25.899065 18393 raft_consensus.cc:515] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:25.899888 14229 leader_election.cc:304] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
W20260709 12:11:25.900815 18516 log.cc:927] Time spent T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.778s	user 0.000s	sys 0.002s
I20260709 12:11:25.901160 14229 leader_election.cc:304] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
W20260709 12:11:25.894069 18498 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.804s	user 0.012s	sys 0.020s
W20260709 12:11:25.902069 18498 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.848s	user 0.013s	sys 0.021s
I20260709 12:11:25.902518 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:25.902905 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:25.903540 18348 raft_consensus.cc:2749] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:25.903084 14190 raft_consensus.cc:3060] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:25.903746 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 13 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:25.904378 14185 raft_consensus.cc:1275] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:11:25.905117 14189 raft_consensus.cc:1275] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:11:25.906077 14181 raft_consensus.cc:2393] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 11: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:11:25.907117 14181 raft_consensus.cc:1240] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:25.908537 18440 leader_election.cc:290] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:25.911270 14155 leader_election.cc:400] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 election: Vote denied by peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957) with higher term. Message: Invalid argument: T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 12. Current term is 13.
I20260709 12:11:25.911872 14155 leader_election.cc:403] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 12:11:25.913003 14190 raft_consensus.cc:2468] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 10.
I20260709 12:11:25.915014 14260 raft_consensus.cc:1240] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:25.916035 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:25.860164 18494 raft_consensus.cc:493] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:25.874365 18509 raft_consensus.cc:2804] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:25.935180 14336 raft_consensus.cc:1275] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:11:25.927711 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:25.927471 14155 leader_election.cc:304] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
W20260709 12:11:25.930529 14875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:25.936180 14187 raft_consensus.cc:3060] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:25.917518 18214 raft_consensus.cc:2804] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:25.901180 18393 leader_election.cc:290] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:25.942005 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:25.894901 18507 raft_consensus.cc:2804] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:25.868456 18497 consensus_queue.cc:1048] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.060s
I20260709 12:11:25.901674 18307 consensus_queue.cc:1059] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 12:11:25.942806 18214 raft_consensus.cc:493] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:25.957367 14154 leader_election.cc:304] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:25.901747 18438 raft_consensus.cc:515] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:25.926388 18380 raft_consensus.cc:2749] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:25.934427 17848 raft_consensus.cc:2749] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957) with higher term. Message: Invalid argument: T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 12. Current term is 13.
I20260709 12:11:25.956589 18440 raft_consensus.cc:2749] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:11:25.965651 14183 raft_consensus.cc:1275] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:11:25.966041 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:25.928840 18398 raft_consensus.cc:2804] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:25.985167 14184 raft_consensus.cc:2468] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 13.
I20260709 12:11:25.980403 12986 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:25.961387 18507 raft_consensus.cc:493] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:26.008890 14188 raft_consensus.cc:2468] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 9.
I20260709 12:11:26.016250 14187 raft_consensus.cc:2468] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 10.
I20260709 12:11:26.022378 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:26.024304 18440 raft_consensus.cc:2804] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:26.024821 18440 raft_consensus.cc:697] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 12 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:11:25.988813 18509 raft_consensus.cc:697] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 13 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:11:26.030260 18509 consensus_queue.cc:237] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:26.018251 18507 raft_consensus.cc:3060] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:26.017818 18398 raft_consensus.cc:493] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:26.038154 18398 raft_consensus.cc:3060] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:25.983772 18153 raft_consensus.cc:493] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:25.959721 18399 consensus_queue.cc:1048] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 12:11:26.037935 18549 raft_consensus.cc:2804] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:25.940896 18494 raft_consensus.cc:515] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:25.986487 18214 raft_consensus.cc:3060] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:26.043354 14190 raft_consensus.cc:2468] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 13.
I20260709 12:11:26.043684 14264 raft_consensus.cc:2468] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 12.
I20260709 12:11:25.979362 18393 consensus_queue.cc:1048] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.063s
W20260709 12:11:26.058615 14302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:26.061666 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:26.092782 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 13 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:26.093703 14263 raft_consensus.cc:2393] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 13: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:11:26.056308 18236 raft_consensus.cc:2749] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:26.101080 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:26.102428 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:26.103225 14262 raft_consensus.cc:2393] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 12: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:11:26.103998 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:26.105020 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:26.106128 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:26.106760 14257 raft_consensus.cc:3060] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:26.078846 18150 raft_consensus.cc:493] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:26.128545 14257 raft_consensus.cc:2468] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 12.
I20260709 12:11:26.044440 18153 raft_consensus.cc:515] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:26.105557 14262 raft_consensus.cc:3060] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:26.155543 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 228155us
I20260709 12:11:26.057648 18549 raft_consensus.cc:697] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 11 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:11:26.157137 14155 leader_election.cc:304] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:26.158288 14257 raft_consensus.cc:1240] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:26.180042 14263 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f"
dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
 from {username='slave'} at 127.0.0.1:53050
I20260709 12:11:26.180785 14263 raft_consensus.cc:493] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:26.181161 14263 raft_consensus.cc:3060] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:26.183758 18438 leader_election.cc:290] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:26.180104 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:26.185604 14260 raft_consensus.cc:2468] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 10.
I20260709 12:11:26.186116 14155 leader_election.cc:304] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
W20260709 12:11:26.110841 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 291462us
I20260709 12:11:26.108783 18528 raft_consensus.cc:493] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:26.109051 18502 raft_consensus.cc:493] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:26.196022 14154 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 238730us
W20260709 12:11:26.200110 14305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:26.204972 14261 raft_consensus.cc:1240] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:26.080965 18440 consensus_queue.cc:237] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:26.206845 18502 raft_consensus.cc:515] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:26.304208 18549 consensus_queue.cc:237] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:26.205229 14906 consensus_queue.cc:260] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:26.197989 17848 raft_consensus.cc:2749] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:26.193601 18511 raft_consensus.cc:493] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:26.156735 18150 raft_consensus.cc:515] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:26.193141 18497 raft_consensus.cc:493] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:26.392760 14878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:26.222601 18521 raft_consensus.cc:493] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:26.206681 18528 raft_consensus.cc:515] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:26.399581 18153 leader_election.cc:290] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:26.400836 14262 raft_consensus.cc:2410] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:11:26.223443 18507 raft_consensus.cc:515] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:26.420305 18574 raft_consensus.cc:2764] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:11:26.421561 18180 raft_consensus.cc:493] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:26.422924 18452 raft_consensus.cc:493] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:26.422003 18497 raft_consensus.cc:515] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:26.424147 17848 consensus_queue.cc:1048] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 12:11:26.417014 18511 raft_consensus.cc:515] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:26.457072 18438 raft_consensus.cc:493] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:26.425724 18521 raft_consensus.cc:515] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:26.447121 18180 raft_consensus.cc:515] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:26.449640 18452 raft_consensus.cc:515] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:26.510807 18521 leader_election.cc:290] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:26.515347 14257 raft_consensus.cc:1240] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 13 LEADER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 12:11:26.495918 18438 raft_consensus.cc:515] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:26.519747 14877 leader_election.cc:304] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:26.530661 18115 raft_consensus.cc:2749] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:11:26.515236 18150 leader_election.cc:290] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:26.528817 14263 raft_consensus.cc:515] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:26.536258 18214 raft_consensus.cc:515] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:26.542879 14260 raft_consensus.cc:1240] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 8. Current term is 10. Ops: []
I20260709 12:11:26.544150 18214 leader_election.cc:290] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:26.544667 14189 raft_consensus.cc:1240] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:26.544862 18150 consensus_queue.cc:1059] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:11:26.545800 18150 raft_consensus.cc:3055] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:26.546152 18150 raft_consensus.cc:740] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:11:26.547024 18150 consensus_queue.cc:260] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:26.547979 14263 leader_election.cc:290] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:26.548198 18150 raft_consensus.cc:3060] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:26.550343 14182 raft_consensus.cc:3055] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:26.550814 14182 raft_consensus.cc:740] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:11:26.550957 18115 consensus_queue.cc:1059] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:26.552181 18115 raft_consensus.cc:3055] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:26.552315 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:26.553085 14335 raft_consensus.cc:2468] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 12.
I20260709 12:11:26.553355 18115 raft_consensus.cc:740] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:11:26.554412 18115 consensus_queue.cc:260] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:26.555676 18115 raft_consensus.cc:3060] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:26.560135 14182 consensus_queue.cc:260] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:26.561264 14182 raft_consensus.cc:3060] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:26.564188 18577 log.cc:927] Time spent T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.056s	user 0.000s	sys 0.002s
I20260709 12:11:26.567186 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:26.533557 18502 leader_election.cc:290] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:26.573272 14335 raft_consensus.cc:1275] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:11:26.574736 14182 raft_consensus.cc:1275] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 12:11:26.575423 14182 pending_rounds.cc:85] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf: Aborting all ops after (but not including) 5
I20260709 12:11:26.540534 18507 leader_election.cc:290] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 11 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:26.536197 18275 consensus_queue.cc:1059] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 12:11:26.575798 14182 pending_rounds.cc:107] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 12:11:26.577951 14182 raft_consensus.cc:2889] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:26.578256 14304 leader_election.cc:304] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:26.580729 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:26.024755 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:11:26.581547 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 378647us
I20260709 12:11:26.582327 14335 raft_consensus.cc:2468] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 13.
I20260709 12:11:26.582547 14155 leader_election.cc:304] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:26.583694 14155 leader_election.cc:304] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:26.584842 18576 raft_consensus.cc:2804] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:26.585361 18576 raft_consensus.cc:697] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 11 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
W20260709 12:11:26.580654 18307 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 11 current term: 11 is higher.
I20260709 12:11:26.586230 14155 leader_election.cc:304] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:26.574997 18528 leader_election.cc:290] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:26.575279 18452 leader_election.cc:290] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:26.590276 18576 consensus_queue.cc:237] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:26.584355 14084 catalog_manager.cc:5697] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:26.588862 14155 leader_election.cc:304] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:26.594477 14877 leader_election.cc:304] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:26.592664 18574 raft_consensus.cc:2804] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:26.588325 18214 raft_consensus.cc:2804] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:26.602059 14335 raft_consensus.cc:1275] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:11:26.603746 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:26.604431 14335 raft_consensus.cc:2468] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 6.
I20260709 12:11:26.606338 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:26.606585 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:26.607725 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:26.608356 14336 raft_consensus.cc:2468] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 13.
I20260709 12:11:26.617712 14906 raft_consensus.cc:3060] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:26.621977 14877 leader_election.cc:304] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:11:26.598959 18214 raft_consensus.cc:493] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:26.624150 14875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:26.599294 18574 raft_consensus.cc:697] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 10 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
W20260709 12:11:26.634472 14154 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 436333us
I20260709 12:11:26.630517 18214 raft_consensus.cc:3060] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:26.647425 18398 consensus_meta.cc:287] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.609s	user 0.008s	sys 0.004s
I20260709 12:11:26.647918 18398 raft_consensus.cc:515] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:26.637404 18581 consensus_queue.cc:1048] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 12:11:26.629137 18585 raft_consensus.cc:2804] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:26.625095 18452 raft_consensus.cc:2804] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:26.662875 14181 raft_consensus.cc:1275] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:11:26.662921 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:26.665184 14182 raft_consensus.cc:1275] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 8 index: 3. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 12:11:26.662312 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:26.627697 18275 raft_consensus.cc:493] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:26.629693 18115 raft_consensus.cc:2804] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:26.663796 18438 leader_election.cc:290] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:26.668802 14258 raft_consensus.cc:1240] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 11 LEADER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:26.674081 18574 consensus_queue.cc:237] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:11:26.677692 18573 log.cc:927] Time spent T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.148s	user 0.000s	sys 0.005s
I20260709 12:11:26.663709 18583 raft_consensus.cc:493] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:26.679404 18583 raft_consensus.cc:515] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } }
I20260709 12:11:26.667058 14189 raft_consensus.cc:2468] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 11.
I20260709 12:11:26.691871 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:26.662978 18585 raft_consensus.cc:493] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:11:26.681537 18583 leader_election.cc:290] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:26.703059 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:26.704346 14906 raft_consensus.cc:2468] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 11.
I20260709 12:11:26.668300 18398 leader_election.cc:290] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 14 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:26.683087 18115 raft_consensus.cc:493] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:26.694653 18585 raft_consensus.cc:3060] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:26.733165 14875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:26.691309 18452 raft_consensus.cc:697] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 8 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:11:26.743305 14182 raft_consensus.cc:2468] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 13.
I20260709 12:11:26.746745 14908 raft_consensus.cc:1275] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 10. (term mismatch)
I20260709 12:11:26.747159 14908 pending_rounds.cc:85] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db: Aborting all ops after (but not including) 9
I20260709 12:11:26.747376 14908 pending_rounds.cc:107] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db: Aborting uncommitted NO_OP operation due to leader change: 13.10
I20260709 12:11:26.747607 14908 raft_consensus.cc:2889] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:11:26.747815 14305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:26.749250 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:26.751827 18348 raft_consensus.cc:493] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:26.752450 18348 raft_consensus.cc:515] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:26.754551 14263 raft_consensus.cc:1275] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:11:26.755345 18348 leader_election.cc:290] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:26.755553 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:26.756610 18362 raft_consensus.cc:493] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:26.757103 18362 raft_consensus.cc:515] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:26.757495 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:26.757922 18380 consensus_queue.cc:1048] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:26.758116 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:26.758867 14257 raft_consensus.cc:3060] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:26.759217 18362 leader_election.cc:290] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:26.759497 14230 leader_election.cc:304] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:11:26.759788 18583 raft_consensus.cc:493] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:26.759989 14261 raft_consensus.cc:1275] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:26.760354 18583 raft_consensus.cc:515] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:26.761049 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:26.761726 18391 raft_consensus.cc:2764] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:11:26.758179 14260 raft_consensus.cc:2468] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 11.
I20260709 12:11:26.759166 14262 raft_consensus.cc:1275] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:11:26.762485 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:26.766494 14261 raft_consensus.cc:2368] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db for earlier term 13. Current term is 14.
W20260709 12:11:26.767060 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 157929us
I20260709 12:11:26.733525 18115 raft_consensus.cc:3060] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:26.780956 14256 raft_consensus.cc:1240] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 11. Current term is 12. Ops: [10.9-11.10]
I20260709 12:11:26.702458 18275 raft_consensus.cc:515] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:26.795140 14257 raft_consensus.cc:2468] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 11.
I20260709 12:11:26.799094 14908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
W20260709 12:11:26.795830 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 61146us
I20260709 12:11:26.738530 18503 raft_consensus.cc:493] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:26.762511 18583 leader_election.cc:290] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:26.804998 18554 raft_consensus.cc:493] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:26.809020 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: true dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:26.809717 14185 raft_consensus.cc:3060] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:26.809849 14910 raft_consensus.cc:2468] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 11.
I20260709 12:11:26.804891 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:26.805898 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:26.812819 14182 raft_consensus.cc:2393] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 8: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:11:26.814108 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:26.814484 14905 raft_consensus.cc:1275] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:11:26.815701 14877 leader_election.cc:400] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 13 election: Vote denied by peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673) with higher term. Message: Invalid argument: T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db for earlier term 13. Current term is 14.
I20260709 12:11:26.816027 14877 leader_election.cc:403] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 12:11:26.816641 14908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:11:26.817571 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:26.746220 18509 consensus_queue.cc:1059] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.061s
I20260709 12:11:26.826539 14907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:26.802613 18341 consensus_queue.cc:1059] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 12:11:26.802894 18391 raft_consensus.cc:493] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:26.824584 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: true dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:11:26.822638 14229 leader_election.cc:304] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:26.825968 18275 leader_election.cc:290] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:26.826761 18509 raft_consensus.cc:3055] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:26.806416 18514 raft_consensus.cc:493] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:11:26.825237 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:11:26.784128 17836 consensus_queue.cc:1059] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 12:11:26.826289 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:26.862067 14904 raft_consensus.cc:3060] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:26.808316 18503 raft_consensus.cc:515] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:26.819554 18554 raft_consensus.cc:515] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:27.031962 14903 raft_consensus.cc:3055] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:26.982132 14331 raft_consensus.cc:1275] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 12:11:27.037060 14331 pending_rounds.cc:85] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c: Aborting all ops after (but not including) 7
I20260709 12:11:27.036898 14903 raft_consensus.cc:740] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:11:27.037832 14331 pending_rounds.cc:107] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 12:11:27.038231 14331 raft_consensus.cc:2889] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:11:26.922740 14154 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 59392.5us
I20260709 12:11:27.038605 14185 raft_consensus.cc:2468] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 10.
I20260709 12:11:26.959544 14904 raft_consensus.cc:2468] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 14.
W20260709 12:11:26.981952 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 401102us
I20260709 12:11:27.004701 14303 leader_election.cc:304] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:27.040524 14903 consensus_queue.cc:260] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:26.855854 18509 raft_consensus.cc:740] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:11:27.041621 14905 raft_consensus.cc:1275] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:11:26.998307 18214 raft_consensus.cc:515] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:26.904860 18393 raft_consensus.cc:2764] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:11:26.924631 18574 consensus_queue.cc:1059] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 11.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.119s
I20260709 12:11:26.905551 18452 consensus_queue.cc:237] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:26.869382 18514 raft_consensus.cc:515] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:26.948057 18519 raft_consensus.cc:2749] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:26.987116 14332 raft_consensus.cc:1240] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:27.045981 14907 raft_consensus.cc:1275] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 12:11:26.994086 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 178514us
W20260709 12:11:27.048166 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 54407.1us
I20260709 12:11:26.957329 18155 raft_consensus.cc:493] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
W20260709 12:11:27.076088 14877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:27.076745 14877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:27.049198 18495 raft_consensus.cc:2749] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:27.036518 14912 raft_consensus.cc:2468] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 14.
I20260709 12:11:27.069864 14903 raft_consensus.cc:3060] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Advancing to term 10
W20260709 12:11:26.866740 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 44236.3us
I20260709 12:11:27.077225 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:11:27.039820 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 178351us
I20260709 12:11:27.016659 18528 raft_consensus.cc:493] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:27.062765 14304 leader_election.cc:304] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:27.072283 14263 raft_consensus.cc:2468] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 12.
W20260709 12:11:26.993474 18591 log.cc:927] Time spent T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.163s	user 0.001s	sys 0.000s
I20260709 12:11:27.077946 14331 raft_consensus.cc:2468] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 11.
W20260709 12:11:26.979357 18595 log.cc:927] Time spent T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.141s	user 0.001s	sys 0.000s
I20260709 12:11:27.078904 14229 leader_election.cc:304] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:26.993638 17894 raft_consensus.cc:493] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:27.079526 14155 leader_election.cc:304] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:27.079258 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:27.084105 14303 leader_election.cc:304] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:27.050151 18275 raft_consensus.cc:2749] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673) with higher term. Message: Invalid argument: T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db for earlier term 13. Current term is 14.
I20260709 12:11:27.089439 14229 leader_election.cc:304] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:27.086148 14262 raft_consensus.cc:2468] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 11.
I20260709 12:11:26.993479 18153 raft_consensus.cc:493] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:27.048653 17836 consensus_queue.cc:1243] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer 17aab1bbf5014936aa18cc21818b26ec log is divergent from this leader: its last log entry 13.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:11:27.085704 14155 leader_election.cc:304] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
W20260709 12:11:27.081669 18150 consensus_meta.cc:287] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db: Time spent flushing consensus metadata: real 0.533s	user 0.013s	sys 0.000s
I20260709 12:11:27.116400 14229 leader_election.cc:304] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:26.860178 18438 consensus_queue.cc:1059] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.228s
I20260709 12:11:27.086393 18500 raft_consensus.cc:2804] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:26.946609 18607 consensus_queue.cc:1048] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.171s
I20260709 12:11:26.858582 18391 raft_consensus.cc:515] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:27.098336 18582 raft_consensus.cc:2749] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:27.126248 14155 leader_election.cc:304] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:27.126727 14903 raft_consensus.cc:2468] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 10.
I20260709 12:11:27.104156 18393 consensus_queue.cc:1059] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 12:11:27.098711 18596 raft_consensus.cc:2749] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:27.098500 18493 consensus_queue.cc:1059] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
W20260709 12:11:27.160686 18592 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 10 current term: 10 is higher.
I20260709 12:11:27.163122 18554 leader_election.cc:290] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:27.163841 18514 leader_election.cc:290] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:27.164568 18115 raft_consensus.cc:515] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:27.124260 18599 raft_consensus.cc:2749] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:27.123226 18519 raft_consensus.cc:2804] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:27.150405 14155 leader_election.cc:304] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:27.168633 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:27.087828 18528 raft_consensus.cc:515] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:27.171227 18498 raft_consensus.cc:2749] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:27.171927 18528 leader_election.cc:290] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:27.172048 18498 raft_consensus.cc:2749] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:27.172320 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:27.178565 18503 leader_election.cc:290] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:27.178710 14189 raft_consensus.cc:2468] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 13.
I20260709 12:11:27.100755 18155 raft_consensus.cc:515] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:27.179462 18115 leader_election.cc:290] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 14 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:27.179802 18585 raft_consensus.cc:515] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:27.180907 14909 raft_consensus.cc:3055] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:27.148244 18574 raft_consensus.cc:2749] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:27.111495 17848 consensus_queue.cc:1048] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.071s
I20260709 12:11:27.182601 18521 raft_consensus.cc:3055] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:27.168669 14155 leader_election.cc:304] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:27.157920 18214 leader_election.cc:290] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 11 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:27.183720 14909 raft_consensus.cc:740] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
W20260709 12:11:27.159647 18588 log.cc:927] Time spent T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.374s	user 0.003s	sys 0.000s
I20260709 12:11:27.165925 14906 raft_consensus.cc:2393] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 14: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
I20260709 12:11:27.111320 17894 raft_consensus.cc:515] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:27.174091 18606 raft_consensus.cc:3055] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:27.171953 14182 raft_consensus.cc:1275] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 12:11:27.151914 14875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:27.177171 18511 leader_election.cc:290] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:27.122404 18600 raft_consensus.cc:2749] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:27.171182 14188 raft_consensus.cc:1240] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:27.177726 18497 leader_election.cc:290] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:27.147975 14229 leader_election.cc:304] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:27.182993 18521 raft_consensus.cc:740] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:27.199265 18600 raft_consensus.cc:2804] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:27.199698 18600 raft_consensus.cc:493] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:27.200115 18600 raft_consensus.cc:3060] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:27.190349 18503 raft_consensus.cc:493] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:11:27.200989 18503 raft_consensus.cc:515] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:27.203379 18503 leader_election.cc:290] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:27.190055 18606 raft_consensus.cc:740] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:11:27.205456 18606 consensus_queue.cc:260] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:27.207131 18606 raft_consensus.cc:3060] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:27.209184 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 61321.9us
I20260709 12:11:27.210592 18494 leader_election.cc:290] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:27.211858 18585 leader_election.cc:290] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 13 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:27.214048 14229 leader_election.cc:304] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:27.215332 14229 leader_election.cc:304] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:27.184211 14186 raft_consensus.cc:1240] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 8. Current term is 10. Ops: []
I20260709 12:11:27.184689 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:27.187958 14155 leader_election.cc:304] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:27.127321 14303 leader_election.cc:304] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:27.121923 17836 consensus_queue.cc:1048] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.068s
I20260709 12:11:27.111307 18307 consensus_queue.cc:1048] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 12:11:27.113368 18153 raft_consensus.cc:515] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:27.194546 18514 consensus_queue.cc:1059] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:27.195291 18155 leader_election.cc:290] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:27.182327 18519 raft_consensus.cc:697] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 10 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:27.219973 14185 raft_consensus.cc:3060] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:27.219441 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 141332us
W20260709 12:11:27.220945 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 93703.6us
I20260709 12:11:27.222795 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:27.238966 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:27.240231 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:27.224041 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:27.241341 14182 raft_consensus.cc:3060] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:27.242098 14303 leader_election.cc:304] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:27.242452 14336 raft_consensus.cc:1240] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 12:11:27.243698 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:27.244575 14262 raft_consensus.cc:2393] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db in current term 8: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:11:27.225205 14155 leader_election.cc:304] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:27.219007 14909 consensus_queue.cc:260] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:27.192373 18498 raft_consensus.cc:2804] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:27.240690 14229 leader_election.cc:304] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:27.246102 14909 raft_consensus.cc:3060] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:27.228997 18528 raft_consensus.cc:2749] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:27.259943 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:27.250890 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:11:27.260630 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 172043us
I20260709 12:11:27.260982 14262 raft_consensus.cc:2468] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 8.
I20260709 12:11:27.250466 14303 leader_election.cc:304] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:11:27.247534 14877 leader_election.cc:304] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:11:27.260667 14336 raft_consensus.cc:3060] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:27.262895 14185 raft_consensus.cc:2468] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 11.
I20260709 12:11:27.267336 18529 leader_election.cc:290] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 11 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:27.199730 18521 consensus_queue.cc:260] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:27.274106 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:27.306159 14332 raft_consensus.cc:2468] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 7.
I20260709 12:11:27.250011 18596 raft_consensus.cc:2749] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:27.258329 18493 raft_consensus.cc:2749] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:27.274163 14182 raft_consensus.cc:2468] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 14.
I20260709 12:11:27.275275 14909 raft_consensus.cc:1275] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 10. (term mismatch)
I20260709 12:11:27.280553 14190 raft_consensus.cc:1275] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:11:27.282492 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:27.282721 18592 raft_consensus.cc:2804] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:27.283929 17894 leader_election.cc:290] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:27.248461 18498 raft_consensus.cc:493] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:27.286921 18609 consensus_queue.cc:1048] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:11:27.287617 14303 leader_election.cc:304] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:11:27.288244 18155 raft_consensus.cc:2804] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:27.238703 18494 raft_consensus.cc:2749] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:27.232832 18585 consensus_queue.cc:1048] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 12:11:27.236011 17848 raft_consensus.cc:2749] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:27.289116 18497 raft_consensus.cc:3055] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:27.289930 14258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53050 (request call id 758) took 1512 ms. Trace:
I20260709 12:11:27.239393 18503 raft_consensus.cc:2749] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:27.292186 14910 raft_consensus.cc:1240] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:27.296389 14336 raft_consensus.cc:2468] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 14.
I20260709 12:11:27.292228 14877 leader_election.cc:304] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
W20260709 12:11:27.310918 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 85788.3us
W20260709 12:11:27.360422 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 61533.6us
I20260709 12:11:27.316298 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:27.363996 14909 pending_rounds.cc:85] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db: Aborting all ops after (but not including) 9
I20260709 12:11:27.392259 14332 raft_consensus.cc:3060] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:27.392336 14229 leader_election.cc:304] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:27.364696 18362 consensus_queue.cc:1048] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 12:11:27.376053 18391 leader_election.cc:290] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:27.298370 18514 raft_consensus.cc:493] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:27.267550 18153 leader_election.cc:290] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:11:27.402088 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 109928us
I20260709 12:11:27.298045 18607 raft_consensus.cc:2749] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:27.388381 14258 rpcz_store.cc:276] 0709 12:11:25.777115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:25.859159 (+ 82044us) service_pool.cc:224] Handling call
0709 12:11:25.859431 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:26.669195 (+809764us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:27.289651 (+620456us) spinlock_profiling.cc:243] Waited 809 ms on lock 0x7b5400072954. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:11:27.289862 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1860936064}
I20260709 12:11:27.392916 14909 pending_rounds.cc:107] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db: Aborting uncommitted NO_OP operation due to leader change: 12.10
W20260709 12:11:27.398201 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 110690us
I20260709 12:11:27.229574 18509 consensus_queue.cc:260] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:27.358397 18592 raft_consensus.cc:493] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:27.398866 14229 leader_election.cc:304] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:27.268661 18519 consensus_queue.cc:237] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:27.367422 18498 raft_consensus.cc:3060] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:27.411202 14909 raft_consensus.cc:2889] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:27.365933 18554 raft_consensus.cc:493] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:27.417815 14877 leader_election.cc:304] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:27.425266 14229 leader_election.cc:304] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:27.259552 18600 raft_consensus.cc:515] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:27.388113 18497 raft_consensus.cc:740] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:11:27.399870 18521 raft_consensus.cc:3060] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:27.311303 18599 consensus_queue.cc:1048] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.106s
I20260709 12:11:27.410627 18399 raft_consensus.cc:2749] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:27.446847 14229 leader_election.cc:304] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:27.411566 18500 raft_consensus.cc:697] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 12 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:27.410617 17983 consensus_queue.cc:1048] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 12:11:27.419178 18115 raft_consensus.cc:2804] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:27.411569 18155 raft_consensus.cc:697] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 13 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:27.390112 17894 consensus_queue.cc:1048] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 12:11:27.448892 14229 leader_election.cc:304] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:27.422559 18502 raft_consensus.cc:2804] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:27.426095 18592 raft_consensus.cc:3060] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:27.431787 18507 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 13 current term: 13 is higher.
I20260709 12:11:27.455590 14303 leader_election.cc:304] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:27.458470 18611 raft_consensus.cc:3060] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:27.414254 18574 consensus_queue.cc:1059] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 12:11:27.443169 18391 raft_consensus.cc:2764] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Leader election decision vote started in defunct term 9: won
I20260709 12:11:27.427872 18511 raft_consensus.cc:493] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:27.433068 18503 raft_consensus.cc:2804] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:27.490325 14258 raft_consensus.cc:1275] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:11:27.419621 18514 raft_consensus.cc:515] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:27.457079 18393 raft_consensus.cc:2804] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:27.488674 18115 raft_consensus.cc:697] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 11 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:11:27.500815 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:27.522666 14257 raft_consensus.cc:2393] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 11: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
W20260709 12:11:27.498437 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 198301us
I20260709 12:11:27.524431 14304 leader_election.cc:304] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
W20260709 12:11:27.508497 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 90805.3us
I20260709 12:11:27.525972 14877 leader_election.cc:304] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:27.527004 18275 raft_consensus.cc:2804] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:27.527459 18275 raft_consensus.cc:493] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:11:27.527864 18275 raft_consensus.cc:3060] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:27.454174 18494 consensus_queue.cc:1048] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 12:11:27.440634 18554 raft_consensus.cc:515] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:27.454303 18529 consensus_queue.cc:1048] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.049s
W20260709 12:11:27.511523 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 56017.2us
I20260709 12:11:27.493067 18502 raft_consensus.cc:493] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:27.454455 18596 consensus_queue.cc:1048] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 12:11:27.498224 14155 leader_election.cc:304] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:27.501554 18399 consensus_queue.cc:1048] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 12:11:27.519905 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:27.536463 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:27.516729 18393 raft_consensus.cc:493] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:27.517412 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:27.520440 18610 raft_consensus.cc:2804] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:27.541193 14155 leader_election.cc:304] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:27.550625 14155 leader_election.cc:304] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:27.531581 18503 raft_consensus.cc:697] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 10 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:11:27.532760 18528 raft_consensus.cc:493] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:27.511294 18616 consensus_queue.cc:1048] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 12:11:27.554196 18452 raft_consensus.cc:2764] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 12:11:27.558383 18438 raft_consensus.cc:2749] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:27.551447 18155 consensus_queue.cc:237] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.4, Last appended by leader: 4, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:27.551448 18393 raft_consensus.cc:3060] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:27.516800 18497 consensus_queue.cc:260] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:27.564863 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:27.564314 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:27.566911 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:27.571645 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:27.574177 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:27.543396 18502 raft_consensus.cc:3060] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:27.566479 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:27.576449 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:27.564980 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:27.517007 18511 raft_consensus.cc:515] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:27.595979 18600 leader_election.cc:290] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:27.551707 18622 raft_consensus.cc:493] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:27.626808 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:27.627049 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:27.628037 14183 raft_consensus.cc:2393] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 13: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:11:27.628262 14256 raft_consensus.cc:3060] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:27.599225 18180 leader_election.cc:290] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:27.627085 18554 leader_election.cc:290] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:27.623520 18393 raft_consensus.cc:515] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:27.632025 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:27.632234 18393 leader_election.cc:290] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:27.547547 18307 raft_consensus.cc:2804] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:27.577180 14259 raft_consensus.cc:2376] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 8. Re-sending same reply.
I20260709 12:11:27.551553 18362 raft_consensus.cc:2804] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:27.634124 18362 raft_consensus.cc:697] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 10 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:11:27.635136 18362 consensus_queue.cc:237] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:27.636890 18275 raft_consensus.cc:515] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:27.612329 14332 raft_consensus.cc:2468] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 13.
I20260709 12:11:27.638556 14259 raft_consensus.cc:1275] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:11:27.602483 18497 raft_consensus.cc:3060] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:27.615371 18438 raft_consensus.cc:493] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:27.639838 18438 raft_consensus.cc:515] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:27.612133 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:27.561617 18503 consensus_queue.cc:237] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:27.642028 18622 raft_consensus.cc:515] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:27.562029 18528 raft_consensus.cc:515] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:27.613126 14262 raft_consensus.cc:2393] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 11: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:11:27.613170 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:27.564308 18495 raft_consensus.cc:2804] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:27.552362 18610 raft_consensus.cc:493] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:27.567201 18514 leader_election.cc:290] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:27.597446 18115 consensus_queue.cc:237] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:11:27.596095 18617 log.cc:927] Time spent T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 12:11:27.614570 18599 raft_consensus.cc:493] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:27.621863 18494 raft_consensus.cc:493] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:27.533310 18500 consensus_queue.cc:237] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:27.623577 18511 leader_election.cc:290] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:27.625456 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:27.655401 14187 raft_consensus.cc:2393] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 14: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:11:27.625870 14907 raft_consensus.cc:1275] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 12:11:27.656366 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 127242us
I20260709 12:11:27.637055 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:27.657176 14263 raft_consensus.cc:2376] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 11. Re-sending same reply.
I20260709 12:11:27.644218 14261 raft_consensus.cc:3060] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:27.642414 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:27.659296 14260 raft_consensus.cc:2410] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for term 11 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 12:11:27.642544 14264 raft_consensus.cc:1275] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:11:27.650835 14257 raft_consensus.cc:2368] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 11. Current term is 12.
I20260709 12:11:27.652220 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:27.647194 14155 leader_election.cc:304] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:27.646754 18610 raft_consensus.cc:3060] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:27.662230 14908 raft_consensus.cc:1240] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:27.671514 14229 leader_election.cc:304] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:27.671954 14155 leader_election.cc:304] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:27.644610 18495 raft_consensus.cc:493] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:27.674857 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 150571us
I20260709 12:11:27.644412 18622 leader_election.cc:290] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:27.636950 14256 raft_consensus.cc:2468] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 11.
I20260709 12:11:27.683769 14229 leader_election.cc:304] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:11:27.659300 18348 raft_consensus.cc:493] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:27.644351 18307 raft_consensus.cc:493] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:27.685663 14877 leader_election.cc:304] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:27.669824 18600 raft_consensus.cc:493] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:27.671378 18393 raft_consensus.cc:493] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:27.669896 18554 raft_consensus.cc:493] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:27.685582 17894 consensus_queue.cc:1048] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 12:11:27.709144 14229 leader_election.cc:304] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:11:27.711745 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:11:27.711968 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 172663us
I20260709 12:11:27.678810 18619 raft_consensus.cc:493] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:27.713093 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:11:27.748214 14154 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 68979.1us
I20260709 12:11:27.748558 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:27.677981 18399 raft_consensus.cc:493] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:27.714424 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:27.753440 14260 raft_consensus.cc:2468] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 8.
I20260709 12:11:27.715193 18622 raft_consensus.cc:493] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:27.715845 14877 leader_election.cc:304] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:11:27.754760 14304 leader_election.cc:304] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:11:27.755558 14877 leader_election.cc:304] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:27.723695 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:27.761976 17836 raft_consensus.cc:2804] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:27.762622 17836 raft_consensus.cc:697] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 14 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:11:27.763674 17836 consensus_queue.cc:237] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:27.764863 18626 raft_consensus.cc:2804] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:27.765472 18626 raft_consensus.cc:697] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 13 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:11:27.766433 18626 consensus_queue.cc:237] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:27.725217 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:27.767757 14335 raft_consensus.cc:3060] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:27.726562 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:27.771251 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:27.772505 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:27.773116 14333 raft_consensus.cc:2468] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 14.
I20260709 12:11:27.727380 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:27.728775 14334 raft_consensus.cc:1275] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:11:27.729121 14337 raft_consensus.cc:1275] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:11:27.731014 14330 raft_consensus.cc:1275] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
W20260709 12:11:27.736460 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 54830.6us
I20260709 12:11:27.677702 18214 raft_consensus.cc:3060] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:27.743925 18438 leader_election.cc:290] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:27.676405 18528 leader_election.cc:290] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:27.674407 18596 raft_consensus.cc:493] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:27.778441 18596 raft_consensus.cc:515] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:27.682279 18495 raft_consensus.cc:3060] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:27.780417 18622 raft_consensus.cc:515] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:27.656296 18587 consensus_queue.cc:1048] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 12:11:27.749250 14262 raft_consensus.cc:2468] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 10.
I20260709 12:11:27.783001 18622 leader_election.cc:290] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:27.783730 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:27.712625 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:27.659053 18494 raft_consensus.cc:515] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:27.788321 18494 leader_election.cc:290] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:27.788976 18494 raft_consensus.cc:2804] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:27.654469 18599 raft_consensus.cc:515] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:27.708263 18307 raft_consensus.cc:3060] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:11:27.779043 14877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:27.789475 18494 raft_consensus.cc:697] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 14 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
W20260709 12:11:27.793704 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 121830us
I20260709 12:11:27.687961 18380 raft_consensus.cc:2749] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:27.798722 14155 leader_election.cc:304] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:27.784097 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:27.706765 18391 raft_consensus.cc:493] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
W20260709 12:11:27.800081 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 53896.3us
I20260709 12:11:27.807544 14155 leader_election.cc:304] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:27.807894 14331 raft_consensus.cc:2468] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 11.
I20260709 12:11:27.809283 14335 raft_consensus.cc:2468] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 14.
I20260709 12:11:27.808987 14155 leader_election.cc:304] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:27.812830 14155 leader_election.cc:304] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:27.706136 18348 raft_consensus.cc:515] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:27.797905 17848 raft_consensus.cc:2749] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:27.825639 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:27.831821 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:27.815361 14333 raft_consensus.cc:1275] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:11:27.851279 14331 raft_consensus.cc:2468] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 9.
I20260709 12:11:27.744854 18600 raft_consensus.cc:515] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:11:27.856657 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 55978.8us
I20260709 12:11:27.750665 18393 raft_consensus.cc:515] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:27.752537 18554 raft_consensus.cc:515] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:11:27.856359 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 53190.3us
I20260709 12:11:27.805083 18629 raft_consensus.cc:493] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:27.871775 18629 raft_consensus.cc:515] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:27.797925 18636 raft_consensus.cc:2804] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:27.874001 18636 raft_consensus.cc:493] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:27.874432 18636 raft_consensus.cc:3060] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:11:27.878952 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 124279us
I20260709 12:11:27.816210 18440 raft_consensus.cc:2749] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:27.791574 18606 consensus_queue.cc:1048] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.054s
I20260709 12:11:27.817392 18438 raft_consensus.cc:2749] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:27.843794 18576 raft_consensus.cc:2749] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:27.816030 18521 raft_consensus.cc:2804] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:11:27.891361 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 144532us
I20260709 12:11:27.791193 18619 raft_consensus.cc:515] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:27.850112 18452 raft_consensus.cc:2749] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:27.794189 18399 raft_consensus.cc:515] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:27.895552 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:27.895848 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:27.806293 18391 raft_consensus.cc:515] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:27.892743 18521 raft_consensus.cc:493] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:27.858037 18380 consensus_queue.cc:1048] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.053s
W20260709 12:11:27.906148 18614 log.cc:927] Time spent T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.357s	user 0.001s	sys 0.002s
W20260709 12:11:27.955452 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 45445.2us
I20260709 12:11:27.907364 18440 raft_consensus.cc:493] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:27.991863 14262 raft_consensus.cc:2468] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 12.
I20260709 12:11:27.887205 18625 raft_consensus.cc:493] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:27.999058 14230 leader_election.cc:304] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:28.001076 14303 leader_election.cc:304] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:28.002758 14186 raft_consensus.cc:3060] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:27.955008 18521 raft_consensus.cc:3060] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:28.004002 14261 raft_consensus.cc:2468] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 8.
I20260709 12:11:28.002168 14263 raft_consensus.cc:2468] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 9.
I20260709 12:11:28.005708 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:28.006552 14261 raft_consensus.cc:3060] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:28.009558 14303 leader_election.cc:304] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:28.011528 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:28.020879 18612 raft_consensus.cc:493] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:27.905764 18498 raft_consensus.cc:515] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:28.026480 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:28.068535 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:28.069000 14907 raft_consensus.cc:1275] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:11:28.004259 18440 raft_consensus.cc:515] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:11:28.071657 18639 log.cc:927] Time spent T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 12:11:27.904395 18494 consensus_queue.cc:237] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:28.073225 18440 leader_election.cc:290] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:27.998839 18511 raft_consensus.cc:493] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:28.075462 14261 raft_consensus.cc:2468] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 9.
I20260709 12:11:28.080662 14259 raft_consensus.cc:1240] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:11:28.080092 14263 raft_consensus.cc:1240] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:11:28.081956 14261 raft_consensus.cc:1275] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:11:28.083209 14186 raft_consensus.cc:2468] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 12.
I20260709 12:11:28.008991 18622 raft_consensus.cc:2749] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:28.089368 18391 leader_election.cc:290] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:28.091733 14185 raft_consensus.cc:2393] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 12: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:11:28.013963 18625 raft_consensus.cc:515] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:11:28.081058 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 52846.7us
I20260709 12:11:28.111388 18502 raft_consensus.cc:515] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:28.004710 17894 consensus_queue.cc:1048] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.083s
I20260709 12:11:28.075428 18528 raft_consensus.cc:2749] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:28.113858 18596 leader_election.cc:290] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:28.120570 14155 leader_election.cc:304] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:28.127951 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:28.141955 14910 raft_consensus.cc:2468] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 16.
I20260709 12:11:28.021983 18612 raft_consensus.cc:515] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:28.137404 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:28.144980 14303 leader_election.cc:304] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:11:28.152426 14907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:28.161610 14338 raft_consensus.cc:1240] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 12:11:28.162271 14155 leader_election.cc:304] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:28.135321 18497 raft_consensus.cc:493] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:28.130743 18629 leader_election.cc:290] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:28.173308 14155 leader_election.cc:304] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:28.193385 17848 raft_consensus.cc:2804] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:28.193616 14155 leader_election.cc:304] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:28.135581 18391 raft_consensus.cc:2804] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:28.194157 17848 raft_consensus.cc:697] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 11 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:11:28.194419 18391 raft_consensus.cc:493] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:28.195025 18391 raft_consensus.cc:3060] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:28.195360 17848 consensus_queue.cc:237] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:11:28.170111 18592 consensus_meta.cc:287] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db: Time spent flushing consensus metadata: real 0.656s	user 0.011s	sys 0.000s
I20260709 12:11:28.198284 18438 raft_consensus.cc:2804] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:28.154949 18622 raft_consensus.cc:493] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:28.198938 18438 raft_consensus.cc:697] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 8 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:11:28.199083 18622 raft_consensus.cc:515] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:28.199928 18438 consensus_queue.cc:237] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:28.084949 18511 raft_consensus.cc:515] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:28.163596 18644 raft_consensus.cc:493] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:28.138319 18606 consensus_queue.cc:1048] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 12:11:28.157874 18628 raft_consensus.cc:493] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:28.212471 18649 consensus_queue.cc:1059] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:28.215221 18653 consensus_queue.cc:1048] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.072s
W20260709 12:11:28.216053 18631 log.cc:927] Time spent T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.231s	user 0.000s	sys 0.001s
W20260709 12:11:28.217401 18640 log.cc:927] Time spent T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:11:28.218950 18625 leader_election.cc:290] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:28.198351 18592 raft_consensus.cc:515] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:28.168723 18440 raft_consensus.cc:2804] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:11:28.224838 14181 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.011s	sys 0.026s
I20260709 12:11:28.182483 18452 raft_consensus.cc:2749] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:28.246838 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:11:28.251748 14181 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.596s	user 0.012s	sys 0.026s
W20260709 12:11:28.248265 18634 log.cc:927] Time spent T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.253s	user 0.000s	sys 0.001s
I20260709 12:11:28.174078 18616 consensus_queue.cc:1048] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.066s
I20260709 12:11:28.244624 18644 raft_consensus.cc:515] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:28.252251 14906 raft_consensus.cc:2468] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 12.
I20260709 12:11:28.249217 18348 leader_election.cc:290] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:28.190102 18497 raft_consensus.cc:515] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:11:28.266450 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 267453us
W20260709 12:11:28.271982 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 975674us
I20260709 12:11:28.252470 18393 leader_election.cc:290] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:28.284171 18643 raft_consensus.cc:2804] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:11:28.284750 18643 raft_consensus.cc:493] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:28.284947 18521 raft_consensus.cc:515] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:28.254860 18619 leader_election.cc:290] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:11:28.319252 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 46259.7us
I20260709 12:11:28.322587 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:28.327095 14230 leader_election.cc:304] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:28.248358 18649 consensus_queue.cc:1048] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 12:11:28.266038 18440 raft_consensus.cc:697] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 11 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:11:28.264518 18596 raft_consensus.cc:493] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:28.329893 14230 leader_election.cc:304] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:28.267678 18399 leader_election.cc:290] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:28.342031 18440 consensus_queue.cc:237] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:11:28.345886 18624 log.cc:927] Time spent T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.722s	user 0.003s	sys 0.000s
I20260709 12:11:28.348062 18554 leader_election.cc:290] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:11:28.350821 18655 log.cc:927] Time spent T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 12:11:28.353892 18600 leader_election.cc:290] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:28.288306 18642 consensus_queue.cc:1048] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.066s
I20260709 12:11:28.358399 18502 leader_election.cc:290] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:28.360708 18497 leader_election.cc:290] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:28.363873 18644 leader_election.cc:290] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:28.334101 18348 raft_consensus.cc:2804] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:28.365125 18521 leader_election.cc:290] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 9 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:11:28.366040 18638 log.cc:927] Time spent T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.291s	user 0.001s	sys 0.000s
I20260709 12:11:28.243201 18628 raft_consensus.cc:515] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:28.320284 18643 raft_consensus.cc:3060] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:11:28.373173 18307 consensus_meta.cc:287] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.571s	user 0.010s	sys 0.001s
I20260709 12:11:28.410856 14260 raft_consensus.cc:1240] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 11. Current term is 12. Ops: [11.7-11.7]
W20260709 12:11:28.387822 18611 consensus_meta.cc:287] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db: Time spent flushing consensus metadata: real 0.878s	user 0.009s	sys 0.003s
I20260709 12:11:28.390682 18616 raft_consensus.cc:493] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:28.412744 18611 raft_consensus.cc:2749] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:28.412901 18616 raft_consensus.cc:515] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:28.413395 18307 raft_consensus.cc:515] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:11:28.409513 18635 log.cc:927] Time spent T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.407s	user 0.001s	sys 0.000s
I20260709 12:11:28.416621 14909 raft_consensus.cc:1240] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:28.417335 18599 leader_election.cc:290] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:28.416872 18307 leader_election.cc:290] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 7 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:28.368637 18596 raft_consensus.cc:515] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:11:28.424281 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 51954.6us
I20260709 12:11:28.288055 18494 consensus_queue.cc:1048] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.083s
I20260709 12:11:28.391952 18452 raft_consensus.cc:493] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:28.426144 18452 raft_consensus.cc:515] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:28.428637 18452 leader_election.cc:290] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:28.392669 18511 leader_election.cc:290] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:11:28.392860 18495 consensus_meta.cc:287] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.613s	user 0.012s	sys 0.000s
I20260709 12:11:28.430158 18495 raft_consensus.cc:515] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:28.431280 18596 leader_election.cc:290] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:28.430856 18616 leader_election.cc:290] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:28.432560 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:28.433534 14188 raft_consensus.cc:1240] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:11:28.394284 18592 leader_election.cc:290] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 12 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:28.435091 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:28.435918 14182 raft_consensus.cc:2468] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 8.
W20260709 12:11:28.397601 18657 log.cc:927] Time spent T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.055s	user 0.000s	sys 0.004s
I20260709 12:11:28.419328 18554 raft_consensus.cc:2749] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:28.438109 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:28.438759 14183 raft_consensus.cc:2468] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 10.
I20260709 12:11:28.439190 18582 raft_consensus.cc:3055] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:28.439608 18582 raft_consensus.cc:740] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:11:28.440495 18582 consensus_queue.cc:260] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:28.441916 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:28.445971 18391 raft_consensus.cc:515] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:28.446641 18583 raft_consensus.cc:3055] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:28.447037 18583 raft_consensus.cc:740] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:11:28.447855 18583 consensus_queue.cc:260] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:28.448554 18391 leader_election.cc:290] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 14 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:28.398851 18612 leader_election.cc:290] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:28.327992 18380 consensus_queue.cc:1048] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.071s
I20260709 12:11:28.403765 18628 leader_election.cc:290] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:11:28.384550 18214 consensus_meta.cc:287] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.608s	user 0.008s	sys 0.001s
W20260709 12:11:28.453905 14187 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.057s	sys 0.108s
W20260709 12:11:28.454337 14187 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.548s	user 0.057s	sys 0.108s
W20260709 12:11:28.412156 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 82181us
I20260709 12:11:28.390877 18498 leader_election.cc:290] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:28.422483 18348 raft_consensus.cc:697] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 11 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
W20260709 12:11:28.456035 14154 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.008s	sys 0.010s
W20260709 12:11:28.471253 14154 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.565s	user 0.011s	sys 0.011s
I20260709 12:11:28.480896 14230 leader_election.cc:304] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:28.485580 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:28.486938 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:28.487573 14261 raft_consensus.cc:2468] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 9.
W20260709 12:11:28.475179 14154 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 571766us
W20260709 12:11:28.454039 18636 consensus_meta.cc:287] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.579s	user 0.010s	sys 0.002s
I20260709 12:11:28.494757 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:28.500752 14876 leader_election.cc:304] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:28.501169 14181 raft_consensus.cc:2410] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:11:28.496070 14182 raft_consensus.cc:1240] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:28.497514 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:28.499436 18362 consensus_queue.cc:1048] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 12:11:28.502952 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:28.503633 14339 raft_consensus.cc:2468] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 7.
I20260709 12:11:28.504344 18592 consensus_queue.cc:1059] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:28.505528 14155 leader_election.cc:400] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 11 election: Vote denied by peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673) with higher term. Message: Invalid argument: T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 11. Current term is 12.
I20260709 12:11:28.505892 14155 leader_election.cc:403] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 12:11:28.506057 14908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:28.507537 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:28.508108 18452 raft_consensus.cc:2749] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673) with higher term. Message: Invalid argument: T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 11. Current term is 12.
I20260709 12:11:28.468675 18214 raft_consensus.cc:2749] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:28.432519 18495 leader_election.cc:290] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 12 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:28.499938 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:28.514024 14876 leader_election.cc:304] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:28.519850 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:28.474673 18582 raft_consensus.cc:3060] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:28.524847 14155 leader_election.cc:304] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:28.523489 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:28.535292 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:28.524613 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:28.525710 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:28.536067 14189 raft_consensus.cc:2468] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 10.
I20260709 12:11:28.526181 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:28.526404 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:28.525416 14229 leader_election.cc:304] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:28.527832 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:28.537349 14911 raft_consensus.cc:2468] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 12.
I20260709 12:11:28.536005 14908 raft_consensus.cc:1275] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:11:28.536136 14182 raft_consensus.cc:2468] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 14.
I20260709 12:11:28.542277 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:28.542302 18380 raft_consensus.cc:2804] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:28.543910 18380 raft_consensus.cc:697] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 12 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
W20260709 12:11:28.545111 18601 log.cc:927] Time spent T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 1.599s	user 0.003s	sys 0.004s
I20260709 12:11:28.545569 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:28.542119 14907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:28.527406 18592 raft_consensus.cc:2804] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:28.546954 14265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41764 (request call id 2717) took 2455 ms. Trace:
I20260709 12:11:28.547139 18592 raft_consensus.cc:493] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:28.545015 18380 consensus_queue.cc:237] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:28.547847 18622 leader_election.cc:290] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:28.549825 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:28.546661 14907 raft_consensus.cc:2468] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 11.
I20260709 12:11:28.552379 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:28.547416 14265 rpcz_store.cc:276] 0709 12:11:26.091428 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:26.091627 (+   199us) service_pool.cc:224] Handling call
0709 12:11:26.119621 (+ 27994us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:26.732324 (+612703us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:26.732355 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:26.762241 (+ 29886us) log.cc:844] Serialized 26 byte log entry
0709 12:11:26.896995 (+134754us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:26.897056 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:26.897136 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:28.544398 (+1647262us) spinlock_profiling.cc:243] Waited 5.02 ms on lock 0x7b4400022b4c. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2123f74c85 00007f2123f756a2 00007f2126ce71db 00007f2126ce2aaf 00007f2126cd686e 00007f2126cd5bb6 00007f2126cd57d8 00007f2126cdf221 00007f2126cdf1d9 00007f2126cdf169
0709 12:11:28.546547 (+  2149us) raft_consensus.cc:1685] finished
0709 12:11:28.546574 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:28.546850 (+   276us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":591603,"raft.queue_time_us":576409,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":3452,"spinlock_wait_cycles":11556736,"thread_start_us":134320,"threads_started":1,"wal-append.queue_time_us":183546}
I20260709 12:11:28.554646 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:28.555393 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:28.537602 14183 raft_consensus.cc:2468] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 16.
I20260709 12:11:28.557114 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:28.555107 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:28.557884 14182 raft_consensus.cc:2468] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 10.
I20260709 12:11:28.558163 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:28.558817 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:28.559521 18214 raft_consensus.cc:2804] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:28.559654 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:28.553329 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:28.561465 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:28.561951 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:28.546371 14259 raft_consensus.cc:2468] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 11.
I20260709 12:11:28.562242 14190 raft_consensus.cc:2393] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 14: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:11:28.560073 18214 raft_consensus.cc:493] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:28.565057 18214 raft_consensus.cc:3060] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:28.522414 18511 raft_consensus.cc:2804] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:28.567955 18511 raft_consensus.cc:493] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:28.568351 18511 raft_consensus.cc:3060] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:28.568570 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:28.569273 14262 raft_consensus.cc:3060] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:28.519017 18636 raft_consensus.cc:515] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:28.571002 14332 raft_consensus.cc:2393] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db in current term 12: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:11:28.554656 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:28.553450 14186 raft_consensus.cc:2468] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 13.
I20260709 12:11:28.562182 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:28.539927 14188 raft_consensus.cc:2468] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 10.
I20260709 12:11:28.521809 18583 raft_consensus.cc:3060] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:28.521603 18554 raft_consensus.cc:2804] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:28.595265 14265 raft_consensus.cc:2468] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 12.
I20260709 12:11:28.591410 14229 leader_election.cc:304] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:28.603370 14877 leader_election.cc:304] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:28.634385 14262 raft_consensus.cc:2468] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 12.
I20260709 12:11:28.602416 14229 leader_election.cc:304] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:28.636300 14877 leader_election.cc:304] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:28.647491 14877 leader_election.cc:304] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:28.642596 14229 leader_election.cc:304] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:28.573925 18592 raft_consensus.cc:3060] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:28.649827 14229 leader_election.cc:304] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:28.650803 14186 raft_consensus.cc:1275] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:11:28.650803 14188 raft_consensus.cc:1275] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:11:28.606878 18554 raft_consensus.cc:493] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:11:28.670655 14877 leader_election.cc:304] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:28.592203 18616 consensus_queue.cc:1059] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.063s
I20260709 12:11:28.649120 18514 raft_consensus.cc:2804] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:28.651643 18653 raft_consensus.cc:2804] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:28.651962 18115 raft_consensus.cc:2749] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:28.640654 18665 raft_consensus.cc:2804] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:28.571240 18643 raft_consensus.cc:515] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:28.657183 18605 raft_consensus.cc:2804] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:28.679167 18554 raft_consensus.cc:3060] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:28.683065 18150 raft_consensus.cc:2804] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:28.687475 18653 raft_consensus.cc:493] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:28.703794 18665 raft_consensus.cc:493] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:28.708413 18514 raft_consensus.cc:697] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 9 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:11:28.722965 18653 raft_consensus.cc:3060] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:28.668864 18348 consensus_queue.cc:237] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:28.716171 18150 raft_consensus.cc:493] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
W20260709 12:11:28.736614 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 66060.7us
I20260709 12:11:28.759805 18150 raft_consensus.cc:3060] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:28.760571 14877 leader_election.cc:304] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:28.761967 18581 raft_consensus.cc:2804] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:28.762521 18581 raft_consensus.cc:493] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:28.762529 18625 raft_consensus.cc:3055] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:28.762943 18581 raft_consensus.cc:3060] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:28.763247 18625 raft_consensus.cc:740] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:11:28.759637 18115 raft_consensus.cc:493] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:28.764211 18625 consensus_queue.cc:260] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:28.764940 18115 raft_consensus.cc:515] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:28.765435 18625 raft_consensus.cc:3060] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:28.761898 14877 leader_election.cc:304] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:28.768884 18115 leader_election.cc:290] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:28.769975 18115 raft_consensus.cc:2804] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:28.770645 18115 raft_consensus.cc:697] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 12 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:11:28.772274 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:28.773183 14265 raft_consensus.cc:2393] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db in current term 15: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:11:28.773092 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:28.774088 18115 consensus_queue.cc:237] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:11:28.774865 14155 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:28.778947 18150 raft_consensus.cc:515] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:28.782116 14188 raft_consensus.cc:1240] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:11:28.729923 18665 raft_consensus.cc:3060] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:28.790473 18275 leader_election.cc:290] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 9 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:28.775228 14877 leader_election.cc:304] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
W20260709 12:11:28.793931 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 142124us
I20260709 12:11:28.753925 18380 raft_consensus.cc:2804] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:28.821275 18641 raft_consensus.cc:2804] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:28.823772 18643 leader_election.cc:290] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 17 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:28.838148 14229 leader_election.cc:304] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
W20260709 12:11:28.825263 18610 consensus_meta.cc:287] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 1.147s	user 0.011s	sys 0.003s
I20260709 12:11:28.827387 18681 raft_consensus.cc:3060] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:28.845137 18632 raft_consensus.cc:2804] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:28.845666 18632 raft_consensus.cc:493] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:28.846108 18632 raft_consensus.cc:3060] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:28.840906 18380 raft_consensus.cc:493] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:11:28.851037 18380 raft_consensus.cc:3060] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:28.864794 18554 raft_consensus.cc:515] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:28.871853 14905 raft_consensus.cc:1275] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:11:28.838342 18641 raft_consensus.cc:493] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
W20260709 12:11:28.886873 18674 log.cc:927] Time spent T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 12:11:28.884920 18636 leader_election.cc:290] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:28.890262 18682 raft_consensus.cc:2804] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:28.891101 18682 raft_consensus.cc:493] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:28.891829 14256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41764 (request call id 2734) took 1204 ms. Trace:
I20260709 12:11:28.892277 14256 rpcz_store.cc:276] 0709 12:11:27.687910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:27.689125 (+  1215us) service_pool.cc:224] Handling call
0709 12:11:27.689512 (+   387us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:27.804583 (+115071us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:11:27.856198 (+ 51615us) log.cc:844] Serialized 14 byte log entry
0709 12:11:28.135825 (+279627us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:28.135884 (+    59us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:28.135951 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:28.891538 (+755587us) spinlock_profiling.cc:243] Waited 115 ms on lock 0x7b54002c0954. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:11:28.891593 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:28.891757 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20806,"prepare.queue_time_us":149224,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":30,"raft.queue_time_us":23710,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":10455,"spinlock_wait_cycles":264014208,"thread_start_us":308410,"threads_started":2,"wal-append.queue_time_us":395905}
I20260709 12:11:28.899341 18498 raft_consensus.cc:3055] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:28.899827 18511 raft_consensus.cc:515] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:28.890362 18605 raft_consensus.cc:493] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:11:28.902472 18605 raft_consensus.cc:3060] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:28.841096 18596 consensus_queue.cc:1048] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 12:11:28.866055 18348 raft_consensus.cc:493] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:28.842713 18610 raft_consensus.cc:515] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:28.891673 18682 raft_consensus.cc:3060] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:28.883822 18641 raft_consensus.cc:3060] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:11:28.925340 18640 log.cc:927] Time spent T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.054s	user 0.004s	sys 0.000s
I20260709 12:11:28.916129 18498 raft_consensus.cc:740] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
W20260709 12:11:28.930616 18669 log.cc:927] Time spent T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.176s	user 0.000s	sys 0.003s
I20260709 12:11:28.839779 18514 consensus_queue.cc:237] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:11:28.932394 18670 log.cc:927] Time spent T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.173s	user 0.000s	sys 0.004s
W20260709 12:11:28.939503 18680 log.cc:927] Time spent T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.096s	user 0.000s	sys 0.003s
I20260709 12:11:28.956313 14334 raft_consensus.cc:2368] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 13. Current term is 14.
I20260709 12:11:28.936071 18642 raft_consensus.cc:493] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:28.972721 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:28.936511 18440 raft_consensus.cc:493] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:28.931797 18348 raft_consensus.cc:515] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:28.995289 14339 raft_consensus.cc:1275] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:11:28.998054 14256 raft_consensus.cc:1275] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 12:11:28.997097 18668 log.cc:927] Time spent T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.219s	user 0.000s	sys 0.001s
I20260709 12:11:28.981725 18642 raft_consensus.cc:515] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:11:29.009385 18672 log.cc:927] Time spent T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.091s	user 0.000s	sys 0.003s
I20260709 12:11:29.012442 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:29.013890 14183 raft_consensus.cc:2410] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
W20260709 12:11:29.017874 14156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:29.009413 18675 log.cc:927] Time spent T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.206s	user 0.000s	sys 0.001s
I20260709 12:11:29.008328 18275 consensus_queue.cc:1048] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 12:11:29.022236 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:29.022874 14187 raft_consensus.cc:3060] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:28.983225 18665 raft_consensus.cc:515] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:28.983573 18440 raft_consensus.cc:515] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:29.047853 14187 raft_consensus.cc:2468] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 9.
I20260709 12:11:29.049520 14876 leader_election.cc:304] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:29.050604 18585 raft_consensus.cc:2804] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:29.050452 18214 raft_consensus.cc:515] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:11:29.051064 18676 log.cc:927] Time spent T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.166s	user 0.000s	sys 0.001s
I20260709 12:11:29.051261 18585 raft_consensus.cc:697] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 9 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
W20260709 12:11:29.050645 18677 log.cc:927] Time spent T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.098s	user 0.002s	sys 0.002s
I20260709 12:11:29.052310 18585 consensus_queue.cc:237] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:29.052802 18214 leader_election.cc:290] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:29.050391 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:29.055006 14339 raft_consensus.cc:3060] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:11:29.052273 14903 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59144 (request call id 443) took 1751 ms. Trace:
I20260709 12:11:29.056206 14903 rpcz_store.cc:276] 0709 12:11:27.300837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:27.300973 (+   136us) service_pool.cc:224] Handling call
0709 12:11:27.301452 (+   479us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:27.305998 (+  4546us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:27.306035 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:27.362389 (+ 56354us) log.cc:844] Serialized 26 byte log entry
0709 12:11:28.418414 (+1056025us) spinlock_profiling.cc:243] Waited 10.7 ms on lock 0x7b1800372520. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f212cf16ab1 00007f212cf23281 00007f2124030e07 00007f212ce8b9a9 00007f212404d69b 00007f212404b93f 00007f212404dc02 00007f2126cd520b 00007f2126cdad23 00007f2126cdb0d1 00007f21270f6a0f
0709 12:11:28.647766 (+229352us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:28.647805 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:28.647896 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:29.051930 (+404034us) raft_consensus.cc:1685] finished
0709 12:11:29.051952 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:29.052203 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16417,"raft.queue_time_us":66121,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":4611,"spinlock_wait_cycles":24640896,"thread_start_us":229152,"threads_started":1,"wal-append.queue_time_us":1377725}
I20260709 12:11:29.058187 18529 raft_consensus.cc:493] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:29.058750 18529 raft_consensus.cc:515] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:29.061046 18529 leader_election.cc:290] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:29.034431 18511 leader_election.cc:290] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 9 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:11:29.048430 18686 log.cc:927] Time spent T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.170s	user 0.002s	sys 0.000s
I20260709 12:11:29.065840 18610 leader_election.cc:290] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:29.011829 18150 leader_election.cc:290] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 12 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:29.070714 14304 leader_election.cc:304] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:11:29.005697 18626 consensus_queue.cc:1048] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 12:11:29.131001 14339 raft_consensus.cc:2468] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 9.
W20260709 12:11:29.144799 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 67786.2us
I20260709 12:11:29.084745 18581 raft_consensus.cc:515] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:29.149809 18581 leader_election.cc:290] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 13 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:29.156236 18616 raft_consensus.cc:493] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:11:29.156975 18616 raft_consensus.cc:515] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:29.159312 18616 leader_election.cc:290] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:29.162328 18682 raft_consensus.cc:515] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:29.163758 14262 raft_consensus.cc:2393] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db in current term 12: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:11:29.164808 18682 leader_election.cc:290] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:29.166118 18509 raft_consensus.cc:3060] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:29.170907 18610 raft_consensus.cc:2804] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:29.171452 18610 raft_consensus.cc:493] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:29.171813 18610 raft_consensus.cc:3060] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:29.145706 14304 leader_election.cc:304] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:11:29.177714 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:29.178454 14263 raft_consensus.cc:3060] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:29.184324 14265 raft_consensus.cc:1240] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 12:11:29.189985 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:29.193142 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:29.193975 14259 raft_consensus.cc:2468] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 11.
I20260709 12:11:29.197168 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:29.197551 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:29.190797 14265 raft_consensus.cc:2468] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 14.
W20260709 12:11:29.143616 18662 log.cc:927] Time spent T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 12:11:29.207450 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:29.005960 18498 consensus_queue.cc:260] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:29.218379 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:29.219244 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:29.220053 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:29.081182 18348 leader_election.cc:290] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:29.240762 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:29.245613 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:29.246703 14261 raft_consensus.cc:2393] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 11: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:11:29.251194 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:29.251994 14184 raft_consensus.cc:3060] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:29.252912 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:29.254371 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:29.254976 14189 raft_consensus.cc:3060] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:29.194571 18643 raft_consensus.cc:2804] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:29.261353 14339 raft_consensus.cc:1275] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:11:29.192166 18554 leader_election.cc:290] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:29.264865 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:29.268592 14261 raft_consensus.cc:2393] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 12: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
I20260709 12:11:29.279812 14184 raft_consensus.cc:2468] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 14.
W20260709 12:11:29.259375 18592 consensus_meta.cc:287] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db: Time spent flushing consensus metadata: real 0.591s	user 0.012s	sys 0.000s
W20260709 12:11:29.289098 14906 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53200 (request call id 603) took 1266 ms (client timeout 1561 ms). Trace:
W20260709 12:11:29.290040 14906 rpcz_store.cc:269] 0709 12:11:28.009552 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:28.009668 (+   116us) service_pool.cc:224] Handling call
0709 12:11:29.275491 (+1265823us) spinlock_profiling.cc:243] Waited 183 ms on lock 0x7b5400692dd4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:11:29.275775 (+   284us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":420772736}
I20260709 12:11:29.249558 18214 raft_consensus.cc:493] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
W20260709 12:11:29.293751 14230 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.174.131:45957 timed out after 2.077s (SENT) [suppressed 19 similar messages]
I20260709 12:11:29.299736 14263 raft_consensus.cc:2468] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 13.
I20260709 12:11:29.261304 18643 raft_consensus.cc:493] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:29.271450 18581 raft_consensus.cc:493] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:29.338240 14877 leader_election.cc:304] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:29.345604 14877 leader_election.cc:304] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:29.287010 18498 raft_consensus.cc:3060] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:29.340521 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:29.350760 14262 raft_consensus.cc:2468] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 11.
I20260709 12:11:29.338027 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:29.357177 14263 raft_consensus.cc:3060] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:11:29.301885 17836 raft_consensus.cc:493] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:29.305934 18587 raft_consensus.cc:493] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:29.341244 18643 raft_consensus.cc:3060] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:29.380285 14156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:29.362017 18341 raft_consensus.cc:2804] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:29.388281 18341 raft_consensus.cc:697] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 13 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
W20260709 12:11:29.390712 18692 log.cc:927] Time spent T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.320s	user 0.001s	sys 0.000s
I20260709 12:11:29.392792 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:29.393555 14330 raft_consensus.cc:2468] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 8.
I20260709 12:11:29.347976 18585 raft_consensus.cc:2749] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:11:29.399022 14185 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56046 (request call id 2302) took 1747 ms (client timeout 1764 ms). Trace:
W20260709 12:11:29.399653 14185 rpcz_store.cc:269] 0709 12:11:27.651774 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:27.651928 (+   154us) service_pool.cc:224] Handling call
0709 12:11:29.398734 (+1746806us) spinlock_profiling.cc:243] Waited 431 ms on lock 0x7b54003b1d54. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:11:29.398935 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":991769344}
I20260709 12:11:29.401069 14181 raft_consensus.cc:1240] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 11. Current term is 12. Ops: []
W20260709 12:11:29.394085 14330 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50856 (request call id 2194) took 1662 ms (client timeout 2077 ms). Trace:
I20260709 12:11:29.304425 18592 raft_consensus.cc:515] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:29.337684 18214 raft_consensus.cc:515] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:29.381587 18115 raft_consensus.cc:493] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:11:29.278949 18611 consensus_queue.cc:1048] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.074s
W20260709 12:11:29.402320 14330 rpcz_store.cc:269] 0709 12:11:27.731575 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:29.392466 (+1660891us) service_pool.cc:224] Handling call
0709 12:11:29.394018 (+  1552us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:29.083866 18653 raft_consensus.cc:515] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:29.402921 18626 raft_consensus.cc:493] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:29.389245 18341 consensus_queue.cc:237] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:11:29.442480 14155 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:29.443410 14155 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:29.444918 18666 raft_consensus.cc:493] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:29.426070 18683 raft_consensus.cc:493] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:29.445791 18683 raft_consensus.cc:515] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:29.445604 18666 raft_consensus.cc:515] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:29.448274 18683 leader_election.cc:290] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:29.449036 18666 leader_election.cc:290] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:11:29.451342 14334 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50856 (request call id 2191) took 1720 ms (client timeout 2110 ms). Trace:
W20260709 12:11:29.451829 14334 rpcz_store.cc:269] 0709 12:11:27.730775 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:28.137104 (+406329us) service_pool.cc:224] Handling call
0709 12:11:29.451101 (+1313997us) spinlock_profiling.cc:243] Waited 806 ms on lock 0x7b54002a6f54. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:11:29.451272 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1854101376}
I20260709 12:11:29.454236 18666 raft_consensus.cc:493] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:29.454878 18666 raft_consensus.cc:515] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:29.455715 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:29.456333 14259 raft_consensus.cc:3060] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:29.457129 18666 leader_election.cc:290] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:29.355736 18581 raft_consensus.cc:515] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:29.458138 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:29.459182 18581 leader_election.cc:290] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:11:29.409245 18583 consensus_meta.cc:287] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.801s	user 0.008s	sys 0.006s
I20260709 12:11:29.428642 14911 raft_consensus.cc:1240] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:29.461494 14338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50856 (request call id 2186) took 1734 ms. Trace:
I20260709 12:11:29.461882 14338 rpcz_store.cc:276] 0709 12:11:27.726734 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:27.726878 (+   144us) service_pool.cc:224] Handling call
0709 12:11:27.727295 (+   417us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:28.162153 (+434858us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:29.461243 (+1299090us) spinlock_profiling.cc:243] Waited 434 ms on lock 0x7b540001b654. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:11:29.461432 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":998199552}
I20260709 12:11:29.431984 18626 raft_consensus.cc:515] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:11:29.434983 18631 log.cc:927] Time spent T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 1.182s	user 0.002s	sys 0.003s
I20260709 12:11:29.404229 18616 raft_consensus.cc:493] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:11:29.456933 18596 consensus_queue.cc:1048] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:29.483482 14259 raft_consensus.cc:2468] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 10.
I20260709 12:11:29.411149 18153 raft_consensus.cc:493] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:29.468812 14261 raft_consensus.cc:1240] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 10. Current term is 11. Ops: [10.6-10.6]
W20260709 12:11:29.423481 14156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:29.459451 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:29.456337 18529 raft_consensus.cc:493] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:29.471024 18626 leader_election.cc:290] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:29.460901 14909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59144 (request call id 444) took 1914 ms. Trace:
I20260709 12:11:29.522555 14909 rpcz_store.cc:276] 0709 12:11:27.546457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:27.546610 (+   153us) service_pool.cc:224] Handling call
0709 12:11:27.557655 (+ 11045us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:28.417173 (+859518us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:29.460652 (+1043479us) spinlock_profiling.cc:243] Waited 859 ms on lock 0x7b540020b7d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:11:29.460838 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1974928128}
I20260709 12:11:29.382489 17836 raft_consensus.cc:515] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:29.525619 17836 leader_election.cc:290] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:29.478294 14229 leader_election.cc:304] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:29.483395 14262 raft_consensus.cc:1240] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:29.484730 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:29.466657 14189 raft_consensus.cc:2468] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 17.
I20260709 12:11:29.518347 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:29.520598 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:29.396196 18587 raft_consensus.cc:515] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:29.528949 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:29.531272 14185 raft_consensus.cc:2468] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 10.
I20260709 12:11:29.529651 14183 raft_consensus.cc:2468] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 10.
W20260709 12:11:29.528452 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 50284.8us
I20260709 12:11:29.533591 14876 leader_election.cc:304] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:29.534191 14229 leader_election.cc:304] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:29.534781 17836 raft_consensus.cc:2804] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:29.535346 17836 raft_consensus.cc:493] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:29.535887 17836 raft_consensus.cc:3060] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:29.536142 18393 raft_consensus.cc:2749] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:29.536985 18393 raft_consensus.cc:2749] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:29.471673 18554 consensus_queue.cc:1048] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.011s
I20260709 12:11:29.514240 18687 raft_consensus.cc:493] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:29.482405 18609 raft_consensus.cc:493] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:29.575899 18440 leader_election.cc:290] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:29.582129 18214 leader_election.cc:290] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:29.584321 18592 leader_election.cc:290] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 11 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:29.543578 18153 raft_consensus.cc:515] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:11:29.591255 18695 log.cc:927] Time spent T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.167s	user 0.000s	sys 0.000s
I20260709 12:11:29.592067 18153 leader_election.cc:290] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:29.593400 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:29.594122 14183 raft_consensus.cc:3060] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:29.466974 18115 raft_consensus.cc:515] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:29.603389 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
W20260709 12:11:29.574949 18615 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.947s	user 0.007s	sys 0.059s
I20260709 12:11:29.481884 18616 raft_consensus.cc:515] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:29.611672 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:29.616376 14263 raft_consensus.cc:2468] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 14.
I20260709 12:11:29.620468 14183 raft_consensus.cc:2468] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 11.
I20260709 12:11:29.613252 14334 raft_consensus.cc:2468] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 9.
I20260709 12:11:29.570331 18529 raft_consensus.cc:515] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:11:29.609445 18697 log.cc:927] Time spent T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.203s	user 0.000s	sys 0.001s
I20260709 12:11:29.640069 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:29.641094 14330 raft_consensus.cc:2410] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db for term 15 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
W20260709 12:11:29.609603 18615 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 2.003s	user 0.008s	sys 0.059s
I20260709 12:11:29.641176 14876 leader_election.cc:304] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
W20260709 12:11:29.641884 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 348175us
I20260709 12:11:29.632416 14189 raft_consensus.cc:1275] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:11:29.643298 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
W20260709 12:11:29.644177 14337 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50856 (request call id 2198) took 1911 ms (client timeout 1913 ms). Trace:
W20260709 12:11:29.644593 14337 rpcz_store.cc:269] 0709 12:11:27.732724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:29.623747 (+1891023us) service_pool.cc:224] Handling call
0709 12:11:29.644108 (+ 20361us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:29.649217 14303 leader_election.cc:304] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:29.651192 14303 leader_election.cc:304] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
W20260709 12:11:29.653550 14230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:29.580945 18687 raft_consensus.cc:515] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:29.667794 18529 leader_election.cc:290] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:29.671087 14877 leader_election.cc:304] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:29.674129 18702 consensus_queue.cc:1059] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:29.675992 18699 raft_consensus.cc:2749] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:29.676757 18153 raft_consensus.cc:493] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:29.659344 18626 raft_consensus.cc:2804] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:29.689322 14265 raft_consensus.cc:2468] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 12.
I20260709 12:11:29.598145 18609 raft_consensus.cc:515] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:11:29.688158 18380 consensus_meta.cc:287] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.837s	user 0.015s	sys 0.000s
I20260709 12:11:29.682754 18511 raft_consensus.cc:2749] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:11:29.728976 18701 log.cc:927] Time spent T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
I20260709 12:11:29.659845 18644 consensus_queue.cc:1048] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.056s
W20260709 12:11:29.736388 18641 consensus_meta.cc:287] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.785s	user 0.008s	sys 0.003s
I20260709 12:11:29.700845 18153 raft_consensus.cc:515] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:29.701226 17836 raft_consensus.cc:515] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:11:29.743168 18605 consensus_meta.cc:287] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db: Time spent flushing consensus metadata: real 0.840s	user 0.010s	sys 0.005s
W20260709 12:11:29.747766 18509 consensus_meta.cc:287] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.581s	user 0.008s	sys 0.004s
I20260709 12:11:29.749003 18643 raft_consensus.cc:515] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:29.722353 18626 raft_consensus.cc:697] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 11 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
W20260709 12:11:29.771344 18632 consensus_meta.cc:287] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db: Time spent flushing consensus metadata: real 0.901s	user 0.009s	sys 0.004s
I20260709 12:11:29.815032 14258 raft_consensus.cc:1275] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 12:11:29.880125 14258 pending_rounds.cc:85] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec: Aborting all ops after (but not including) 9
I20260709 12:11:29.880481 14258 pending_rounds.cc:107] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 12:11:29.880733 14258 raft_consensus.cc:2889] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:11:29.788718 14156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:29.773360 18610 consensus_meta.cc:287] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.601s	user 0.011s	sys 0.002s
I20260709 12:11:29.723042 18704 raft_consensus.cc:2749] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:29.856572 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:30.006320 14334 raft_consensus.cc:2468] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 10.
I20260709 12:11:29.856804 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:29.857522 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:30.007748 14336 raft_consensus.cc:3060] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:30.007871 14332 raft_consensus.cc:2410] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for term 12 because replica has last-logged OpId of term: 11 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 3.
W20260709 12:11:29.865454 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 331332us
W20260709 12:11:29.812701 18707 log.cc:927] Time spent T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
W20260709 12:11:29.934759 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 283641us
W20260709 12:11:29.991430 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 118110us
W20260709 12:11:30.022974 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 270047us
W20260709 12:11:30.024580 14155 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:30.000197 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:30.031394 14330 raft_consensus.cc:2393] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 14: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:11:29.771607 18641 raft_consensus.cc:515] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:29.752368 18380 raft_consensus.cc:515] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:30.066851 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:29.884915 18637 raft_consensus.cc:493] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:30.067301 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:30.122582 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:30.123133 14910 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53200 (request call id 608) took 1602 ms. Trace:
I20260709 12:11:30.123425 14334 raft_consensus.cc:2468] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 12.
I20260709 12:11:30.124513 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:30.125941 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:30.126999 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:30.127206 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:30.127718 14330 raft_consensus.cc:2468] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 9.
I20260709 12:11:30.128590 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:30.128985 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:29.812197 18605 raft_consensus.cc:515] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:11:30.119776 14156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:30.128221 14229 leader_election.cc:304] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:30.021512 18702 raft_consensus.cc:493] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:30.079545 14230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:30.000980 18348 raft_consensus.cc:493] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:11:30.063539 18214 raft_consensus.cc:493] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:30.134748 14910 rpcz_store.cc:276] 0709 12:11:28.520919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:28.521058 (+   139us) service_pool.cc:224] Handling call
0709 12:11:28.521412 (+   354us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:28.526358 (+  4946us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:28.526393 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:28.526947 (+   554us) log.cc:844] Serialized 26 byte log entry
0709 12:11:28.716509 (+189562us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:28.717177 (+   668us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:28.717488 (+   311us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:29.838742 (+1121254us) spinlock_profiling.cc:243] Waited 6.68 ms on lock 0x7b2400318e18. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2123ed49c4 00007f2123ed2acb 00007f212408ddc9 00007f212408da55 00007f212408cfb0 00007f2126d03488 00007f2126d03be8 00007f2126cdb398 00007f2126cd676a 00007f2126cd5bb6
0709 12:11:30.122778 (+284036us) raft_consensus.cc:1685] finished
0709 12:11:30.122804 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:30.123057 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":12145,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":127,"spinlock_wait_cycles":15357184,"thread_start_us":161108,"threads_started":1,"wal-append.queue_time_us":180884}
I20260709 12:11:30.014969 18666 raft_consensus.cc:493] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:30.206663 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:30.167192 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:11:30.016091 18705 log.cc:927] Time spent T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.198s	user 0.000s	sys 0.001s
I20260709 12:11:30.071327 18440 raft_consensus.cc:493] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:30.143640 14336 raft_consensus.cc:2468] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 11.
I20260709 12:11:30.166769 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:30.166292 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:30.064481 18622 raft_consensus.cc:493] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:30.266897 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:30.271529 14263 raft_consensus.cc:2468] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 13.
I20260709 12:11:30.273527 14262 raft_consensus.cc:1275] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:29.995188 18632 raft_consensus.cc:515] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:30.122663 18704 raft_consensus.cc:493] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:11:30.138386 18529 raft_consensus.cc:493] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:30.272862 14332 raft_consensus.cc:2468] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 9.
W20260709 12:11:30.144352 18698 log.cc:927] Time spent T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.130s	user 0.000s	sys 0.001s
I20260709 12:11:30.162112 18115 leader_election.cc:290] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:30.136071 18682 raft_consensus.cc:493] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:30.300891 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:30.168246 18554 raft_consensus.cc:2804] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:30.323236 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:11:30.303481 14336 raft_consensus.cc:1240] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:30.270875 14330 raft_consensus.cc:3060] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:30.139497 18708 raft_consensus.cc:493] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:30.105517 18519 raft_consensus.cc:493] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:30.335268 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:30.168484 17836 leader_election.cc:290] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 11 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:30.267392 18592 raft_consensus.cc:493] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:30.263752 18710 raft_consensus.cc:493] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:30.071601 18610 raft_consensus.cc:515] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:11:30.325265 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 260193us
I20260709 12:11:30.169512 18399 consensus_queue.cc:1059] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.150s
I20260709 12:11:30.185405 18494 consensus_queue.cc:1048] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.140s
I20260709 12:11:30.162487 18348 raft_consensus.cc:515] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:30.268929 18666 raft_consensus.cc:515] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:30.156533 18637 raft_consensus.cc:515] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:30.342175 18715 raft_consensus.cc:493] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
W20260709 12:11:30.364027 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 285307us
I20260709 12:11:30.167326 18609 leader_election.cc:290] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:30.323644 18554 raft_consensus.cc:493] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:30.373009 14335 raft_consensus.cc:1240] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:30.373837 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:11:30.374471 14903 raft_consensus.cc:3060] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:30.374686 14905 raft_consensus.cc:1240] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 13 LEADER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:30.300113 18440 raft_consensus.cc:515] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:30.376407 14330 raft_consensus.cc:2410] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:11:30.319296 18529 raft_consensus.cc:515] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:30.361487 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:30.225675 18702 raft_consensus.cc:515] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:30.365315 14155 leader_election.cc:304] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:30.365255 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:30.386140 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:30.386761 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:30.387435 14187 raft_consensus.cc:2468] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 12.
I20260709 12:11:30.388309 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:30.388885 14187 raft_consensus.cc:2468] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 11.
I20260709 12:11:30.389446 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:30.281371 18214 raft_consensus.cc:515] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:30.395942 14907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:11:30.396660 14907 raft_consensus.cc:2393] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 12: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
I20260709 12:11:30.360209 18615 raft_consensus.cc:493] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:30.367005 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:11:30.344931 18681 consensus_meta.cc:287] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db: Time spent flushing consensus metadata: real 1.500s	user 0.015s	sys 0.001s
I20260709 12:11:30.290412 18622 raft_consensus.cc:515] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } }
I20260709 12:11:30.165833 18626 consensus_queue.cc:237] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:30.407140 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:30.411417 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:30.353188 18592 raft_consensus.cc:515] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:30.378221 14182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 2721) took 1160 ms. Trace:
I20260709 12:11:30.418396 14182 rpcz_store.cc:276] 0709 12:11:29.221802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:29.261559 (+ 39757us) service_pool.cc:224] Handling call
0709 12:11:29.261938 (+   379us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:11:29.270392 (+  8454us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:29.270422 (+    30us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:11:29.284763 (+ 14341us) log.cc:844] Serialized 78 byte log entry
0709 12:11:29.641466 (+356703us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:11:29.641513 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:29.641646 (+   133us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:30.377973 (+736327us) raft_consensus.cc:1685] finished
0709 12:11:30.377993 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:30.378158 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":30384,"raft.run_cpu_time_us":197,"raft.run_wall_time_us":46369,"thread_start_us":257156,"threads_started":1,"wal-append.queue_time_us":389070}
I20260709 12:11:30.379784 14332 raft_consensus.cc:2468] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 14.
I20260709 12:11:30.421206 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:30.379784 14905 raft_consensus.cc:1240] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 12:11:30.422549 14332 raft_consensus.cc:2468] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 11.
I20260709 12:11:30.393362 14903 raft_consensus.cc:2468] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 17.
I20260709 12:11:30.395622 14908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:11:30.397007 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:30.366679 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:30.328585 18682 raft_consensus.cc:515] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:30.402269 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:30.424018 14188 raft_consensus.cc:2468] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 11.
I20260709 12:11:30.403085 14907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:30.319579 18704 raft_consensus.cc:515] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:30.337935 18708 raft_consensus.cc:515] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:30.401327 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:30.443934 14184 raft_consensus.cc:2468] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 10.
I20260709 12:11:30.339457 18519 raft_consensus.cc:515] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:30.447921 14259 raft_consensus.cc:1275] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:30.448489 14907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:30.449524 14907 raft_consensus.cc:2393] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 11: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
I20260709 12:11:30.404685 18643 leader_election.cc:290] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 11 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:30.352265 14303 leader_election.cc:304] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:30.427531 14187 raft_consensus.cc:1275] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:30.378429 18554 raft_consensus.cc:3060] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:30.353451 18710 raft_consensus.cc:515] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:30.440004 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:11:30.456394 14904 raft_consensus.cc:2410] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:11:30.441241 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 14 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:30.442427 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:30.416781 18681 raft_consensus.cc:2749] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:30.400779 18153 leader_election.cc:290] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:30.470985 18519 leader_election.cc:290] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:30.379053 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:30.451669 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:30.472987 14336 raft_consensus.cc:2368] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 10. Current term is 11.
I20260709 12:11:30.474663 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:30.461406 14334 raft_consensus.cc:2468] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 11.
I20260709 12:11:30.414803 18498 raft_consensus.cc:493] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
W20260709 12:11:30.484695 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 132507us
I20260709 12:11:30.457481 14182 raft_consensus.cc:2468] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 13.
I20260709 12:11:30.465989 18605 leader_election.cc:290] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 8 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:30.468246 18710 leader_election.cc:290] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:30.474810 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:30.452363 14184 raft_consensus.cc:1240] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 12:11:30.471493 18708 leader_election.cc:290] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:30.482507 18622 leader_election.cc:290] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:30.483403 18642 leader_election.cc:290] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:30.490423 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
W20260709 12:11:30.473155 18709 log.cc:927] Time spent T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.318s	user 0.001s	sys 0.001s
I20260709 12:11:30.493834 18554 raft_consensus.cc:515] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:30.504181 14184 raft_consensus.cc:1275] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:11:30.490945 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:30.509599 14332 raft_consensus.cc:1275] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:30.512598 14331 raft_consensus.cc:1275] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:11:30.378545 18715 raft_consensus.cc:515] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:30.523545 14332 raft_consensus.cc:1275] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 12:11:30.520584 14154 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 125670us
I20260709 12:11:30.525084 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:30.407421 18615 raft_consensus.cc:515] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:30.537667 18735 raft_consensus.cc:2804] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:30.545199 18721 raft_consensus.cc:2749] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:30.499119 18498 raft_consensus.cc:515] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:11:30.545755 18728 log.cc:927] Time spent T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 12:11:30.471815 18729 raft_consensus.cc:493] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:30.548573 14330 raft_consensus.cc:1275] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 12:11:30.550621 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 185333us
W20260709 12:11:30.654686 14154 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 118226us
I20260709 12:11:30.565609 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:11:30.660678 14154 leader_election.cc:304] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:30.660954 14904 raft_consensus.cc:2393] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 13: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
I20260709 12:11:30.534756 18380 leader_election.cc:290] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 13 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:30.662634 14155 leader_election.cc:304] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:30.667351 14154 leader_election.cc:304] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:30.654089 18610 leader_election.cc:290] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 11 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:30.565609 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:30.652328 18682 leader_election.cc:290] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:30.552033 18641 leader_election.cc:290] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 14 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:30.673128 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:30.576505 18735 raft_consensus.cc:697] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 10 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:11:30.552686 18704 leader_election.cc:290] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:30.535329 18642 raft_consensus.cc:493] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:30.576874 18632 leader_election.cc:290] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 13 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:30.676235 18529 leader_election.cc:290] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:30.676321 18440 leader_election.cc:290] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:30.715654 18214 leader_election.cc:290] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:30.807463 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
W20260709 12:11:30.819983 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 334361us
I20260709 12:11:30.829959 14303 leader_election.cc:304] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:30.807734 18666 leader_election.cc:290] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:30.704349 18729 raft_consensus.cc:515] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:30.814299 18615 leader_election.cc:290] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:30.677721 18348 leader_election.cc:290] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:30.742683 18726 raft_consensus.cc:493] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:30.677223 18731 consensus_queue.cc:1059] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.140s
I20260709 12:11:30.855515 18731 raft_consensus.cc:3055] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:30.855896 18731 raft_consensus.cc:740] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:11:30.829975 18702 leader_election.cc:290] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:30.856729 18731 consensus_queue.cc:260] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:30.830440 18214 raft_consensus.cc:2804] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:30.806042 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:30.736138 18642 raft_consensus.cc:515] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:30.756886 18735 consensus_queue.cc:237] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:30.814188 18440 raft_consensus.cc:2749] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:30.841820 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 14 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:30.810576 14910 raft_consensus.cc:2468] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 15.
I20260709 12:11:30.705171 18738 raft_consensus.cc:493] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:30.858160 14189 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56652 (request call id 1045) took 1126 ms. Trace:
I20260709 12:11:30.831544 18576 raft_consensus.cc:2749] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:30.866981 14189 rpcz_store.cc:276] 0709 12:11:29.731904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:29.732103 (+   199us) service_pool.cc:224] Handling call
0709 12:11:29.732497 (+   394us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:29.732949 (+   452us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:29.732980 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:29.733571 (+   591us) log.cc:844] Serialized 26 byte log entry
0709 12:11:30.065595 (+332024us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:30.065644 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:30.065729 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:30.857888 (+792159us) raft_consensus.cc:1685] finished
0709 12:11:30.857912 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:30.858087 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4052,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":96,"thread_start_us":331459,"threads_started":1,"wal-append.queue_time_us":971633}
I20260709 12:11:30.853920 18741 raft_consensus.cc:2804] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:30.854594 18554 leader_election.cc:290] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 13 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:30.862237 18214 raft_consensus.cc:493] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:30.857999 18592 leader_election.cc:290] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:30.864660 18715 leader_election.cc:290] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:30.873600 18738 raft_consensus.cc:515] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:30.875159 18642 leader_election.cc:290] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:11:30.873540 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:30.866811 18731 raft_consensus.cc:3060] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:30.879002 14260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41764 (request call id 2741) took 3166 ms. Trace:
I20260709 12:11:30.879398 14303 leader_election.cc:304] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:30.885201 14260 rpcz_store.cc:276] 0709 12:11:27.712673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:27.754234 (+ 41561us) service_pool.cc:224] Handling call
0709 12:11:28.410523 (+656289us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:28.411413 (+   890us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:30.878780 (+2467367us) spinlock_profiling.cc:243] Waited 656 ms on lock 0x7b54001c1950. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713a8ad 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:11:30.878934 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1508311424}
I20260709 12:11:30.871872 18741 raft_consensus.cc:493] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:30.888456 14303 leader_election.cc:304] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:30.899101 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:30.900159 14912 raft_consensus.cc:2393] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 8: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
I20260709 12:11:30.878325 18729 leader_election.cc:290] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:30.877619 18214 raft_consensus.cc:3060] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:30.859265 18726 raft_consensus.cc:515] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:30.883208 18498 leader_election.cc:290] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:30.908548 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:30.910892 14911 raft_consensus.cc:1240] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:30.912536 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:30.900578 18721 raft_consensus.cc:2804] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:11:30.909188 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:30.890543 18741 raft_consensus.cc:3060] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:30.918092 14908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
W20260709 12:11:30.903749 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 241274us
I20260709 12:11:30.889789 18702 raft_consensus.cc:2804] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:30.930070 14908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:30.932024 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:30.932580 14155 leader_election.cc:304] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
W20260709 12:11:30.934095 18742 log.cc:927] Time spent T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 12:11:30.934188 18702 raft_consensus.cc:697] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 14 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:30.934293 18609 raft_consensus.cc:493] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:11:30.937458 18609 raft_consensus.cc:515] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:30.937831 18702 consensus_queue.cc:237] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:30.940634 18609 leader_election.cc:290] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:11:30.933619 14154 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 266349us
W20260709 12:11:30.945225 14303 connection.cc:256] RPC call timeout handler was delayed by -1.104986641999858s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19510000000000002s for a response
I20260709 12:11:30.949772 14155 leader_election.cc:304] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:30.926859 18721 raft_consensus.cc:697] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 17 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:30.950160 14303 leader_election.cc:304] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:30.953372 18587 leader_election.cc:290] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:30.956166 14257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41768 (request call id 1863) took 2471 ms. Trace:
I20260709 12:11:30.958825 14261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41764 (request call id 2753) took 1672 ms. Trace:
I20260709 12:11:30.959229 14261 rpcz_store.cc:276] 0709 12:11:29.286746 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:29.287627 (+   881us) service_pool.cc:224] Handling call
0709 12:11:29.288104 (+   477us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:29.515268 (+227164us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:30.958536 (+1443268us) spinlock_profiling.cc:243] Waited 180 ms on lock 0x7b540007b054. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:11:30.958757 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":414906112}
I20260709 12:11:30.956621 14257 rpcz_store.cc:276] 0709 12:11:28.484696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:28.484959 (+   263us) service_pool.cc:224] Handling call
0709 12:11:28.570962 (+ 86003us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:28.571423 (+   461us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:28.571457 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:28.572243 (+   786us) log.cc:844] Serialized 26 byte log entry
0709 12:11:28.719957 (+147714us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:28.720011 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:28.720082 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:29.026699 (+306617us) raft_consensus.cc:1685] finished
0709 12:11:29.026721 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:30.955825 (+1929104us) spinlock_profiling.cc:243] Waited 76.7 ms on lock 0x7b54002008d0. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713a8ad 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:11:30.956077 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":408,"raft.queue_time_us":2344,"raft.run_cpu_time_us":201,"raft.run_wall_time_us":10583,"spinlock_wait_cycles":176362752,"thread_start_us":64613,"threads_started":1,"wal-append.queue_time_us":186279,"wal-append.run_cpu_time_us":5601,"wal-append.run_wall_time_us":1274136}
I20260709 12:11:30.967403 14155 leader_election.cc:304] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:30.976421 14155 leader_election.cc:304] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:30.947464 18729 consensus_queue.cc:1048] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 12:11:30.975878 18582 raft_consensus.cc:2749] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:30.983273 14908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
W20260709 12:11:30.987231 18716 log.cc:927] Time spent T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.617s	user 0.002s	sys 0.000s
I20260709 12:11:30.988322 14185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56652 (request call id 1040) took 1471 ms. Trace:
I20260709 12:11:30.988971 14185 rpcz_store.cc:276] 0709 12:11:29.516741 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:29.517854 (+  1113us) service_pool.cc:224] Handling call
0709 12:11:30.988119 (+1470265us) spinlock_profiling.cc:243] Waited 1.74 ms on lock 0x7b54003f2ad4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:11:30.988255 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4011392}
I20260709 12:11:30.974264 18609 raft_consensus.cc:2749] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:30.990444 14335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50858 (request call id 1865) took 1133 ms. Trace:
I20260709 12:11:30.991204 18738 leader_election.cc:290] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:30.995590 14330 raft_consensus.cc:1275] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:11:30.996836 14330 raft_consensus.cc:3055] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:30.997144 14330 raft_consensus.cc:740] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:30.997644 18721 consensus_queue.cc:237] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:30.999457 18509 raft_consensus.cc:3055] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:31.000018 18509 raft_consensus.cc:740] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:11:30.974516 18587 consensus_queue.cc:1059] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 12:11:30.990837 14335 rpcz_store.cc:276] 0709 12:11:29.857379 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:29.857504 (+   125us) service_pool.cc:224] Handling call
0709 12:11:29.857826 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:30.373505 (+515679us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:30.990177 (+616672us) spinlock_profiling.cc:243] Waited 515 ms on lock 0x7b540001b154. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:11:30.990371 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1184335616}
I20260709 12:11:30.979801 14907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:31.006240 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:30.979427 18748 raft_consensus.cc:2804] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:31.006230 14330 consensus_queue.cc:260] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:31.010377 14330 raft_consensus.cc:3060] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:30.972417 18749 raft_consensus.cc:2804] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:31.013602 14908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:31.014212 14155 leader_election.cc:304] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:31.038340 18666 raft_consensus.cc:493] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:31.039094 18666 raft_consensus.cc:515] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:31.041954 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:31.041849 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:31.042387 18612 raft_consensus.cc:493] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:31.043471 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:31.043429 14155 leader_election.cc:304] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:11:31.032980 14909 raft_consensus.cc:1240] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:31.044286 14189 raft_consensus.cc:3060] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:31.044663 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:31.045240 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:31.045871 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:31.047405 14182 raft_consensus.cc:1275] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 12:11:31.043864 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:31.048297 14155 leader_election.cc:304] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:31.043220 18612 raft_consensus.cc:515] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:31.050276 18737 raft_consensus.cc:2804] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:31.050745 18737 raft_consensus.cc:493] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:11:31.051113 18737 raft_consensus.cc:3060] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:31.052155 14184 raft_consensus.cc:2468] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 9.
I20260709 12:11:31.030982 14330 raft_consensus.cc:1275] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 12:11:31.012817 18748 raft_consensus.cc:493] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:31.059717 14189 raft_consensus.cc:2468] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 11.
I20260709 12:11:31.063526 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:31.043160 18440 raft_consensus.cc:2749] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:31.067562 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:31.036291 18749 raft_consensus.cc:493] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:11:31.035071 18582 raft_consensus.cc:2749] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:31.042863 18735 raft_consensus.cc:493] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:31.074090 14182 raft_consensus.cc:1240] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 10 LEADER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:31.072367 14339 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 782) took 1445 ms. Trace:
I20260709 12:11:31.065032 14155 leader_election.cc:304] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:31.078190 14339 rpcz_store.cc:276] 0709 12:11:29.626594 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:29.626736 (+   142us) service_pool.cc:224] Handling call
0709 12:11:29.627092 (+   356us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:29.645820 (+ 18728us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:29.645857 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:29.650360 (+  4503us) log.cc:844] Serialized 26 byte log entry
0709 12:11:30.000084 (+349724us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:30.000127 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:30.000197 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:30.986310 (+986113us) spinlock_profiling.cc:243] Waited 8.51 ms on lock 0x7b4400022b4c. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2123f74c85 00007f2123f756a2 00007f2126ce71db 00007f2126ce2aaf 00007f2126cd686e 00007f2126cd5bb6 00007f2126cd57d8 00007f2126cdf221 00007f2126cdf1d9 00007f2126cdf169
0709 12:11:31.064485 (+ 78175us) raft_consensus.cc:1685] finished
0709 12:11:31.064507 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:31.072284 (+  7777us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18278,"raft.queue_time_us":21208,"raft.run_cpu_time_us":225,"raft.run_wall_time_us":25228,"spinlock_wait_cycles":19566976,"thread_start_us":336541,"threads_started":1,"wal-append.queue_time_us":657656}
I20260709 12:11:31.081437 14334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50858 (request call id 1876) took 1181 ms. Trace:
I20260709 12:11:31.081907 14334 rpcz_store.cc:276] 0709 12:11:29.900211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:30.124235 (+224024us) service_pool.cc:224] Handling call
0709 12:11:31.081249 (+957014us) spinlock_profiling.cc:243] Waited 336 ms on lock 0x7b5400145854. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:11:31.081372 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":773032320}
I20260709 12:11:31.067703 14189 raft_consensus.cc:2468] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 12.
I20260709 12:11:31.062134 18498 raft_consensus.cc:2804] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:31.053929 18666 leader_election.cc:290] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:31.036005 18704 consensus_queue.cc:1059] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 12:11:31.064041 18748 raft_consensus.cc:3060] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:31.001299 18509 consensus_queue.cc:260] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:31.090859 14334 raft_consensus.cc:1275] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:31.092164 18687 leader_election.cc:290] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:31.100972 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:31.076692 18749 raft_consensus.cc:3060] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:31.102775 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:31.104705 14182 raft_consensus.cc:3060] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:31.072362 18576 consensus_queue.cc:1059] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 12:11:31.085670 18498 raft_consensus.cc:493] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:31.085894 18440 raft_consensus.cc:2749] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:11:31.108695 14303 leader_election.cc:304] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:31.105835 18509 raft_consensus.cc:3060] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:31.118904 14154 leader_election.cc:304] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:31.103643 18616 leader_election.cc:290] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:31.035107 14084 catalog_manager.cc:5697] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:31.109072 18498 raft_consensus.cc:3060] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:31.103004 18666 consensus_queue.cc:1048] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 12:11:31.140333 14303 leader_election.cc:304] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:31.084223 18735 raft_consensus.cc:515] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:31.088958 18582 consensus_queue.cc:1048] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 12:11:31.137827 18609 raft_consensus.cc:3060] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:31.056391 14330 pending_rounds.cc:85] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c: Aborting all ops after (but not including) 6
I20260709 12:11:31.171633 14330 pending_rounds.cc:107] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 12:11:31.172560 14330 raft_consensus.cc:2889] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:31.174196 14303 leader_election.cc:304] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:31.147857 18616 raft_consensus.cc:2749] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:31.177829 18724 consensus_queue.cc:1059] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 12:11:31.213169 18702 raft_consensus.cc:2804] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:31.213902 18702 raft_consensus.cc:493] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:31.214524 18702 raft_consensus.cc:3060] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:31.218719 14302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:31.141906 18704 consensus_queue.cc:1048] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 12:11:31.158629 18612 leader_election.cc:290] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:11:31.213042 18699 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 12 current term: 12 is higher.
I20260709 12:11:31.178144 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:31.233387 14190 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56652 (request call id 1037) took 2207 ms. Trace:
W20260709 12:11:31.231580 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 145870us
I20260709 12:11:31.233946 14190 rpcz_store.cc:276] 0709 12:11:29.019301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:29.025866 (+  6565us) service_pool.cc:224] Handling call
0709 12:11:29.026284 (+   418us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:29.464528 (+438244us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:29.464564 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:29.464608 (+    44us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:29.464643 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:31.225997 (+1761354us) spinlock_profiling.cc:243] Waited 438 ms on lock 0x7b540035b454. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:11:31.226056 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:31.226236 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":14652,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":36989,"spinlock_wait_cycles":1007080704}
I20260709 12:11:31.166531 18721 raft_consensus.cc:2804] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:31.203346 18735 leader_election.cc:290] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:31.156520 14182 raft_consensus.cc:2468] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 14.
W20260709 12:11:31.238854 18757 log.cc:927] Time spent T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.094s	user 0.004s	sys 0.000s
W20260709 12:11:31.240097 18755 log.cc:927] Time spent T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.075s	user 0.000s	sys 0.004s
I20260709 12:11:31.252852 18735 raft_consensus.cc:493] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:31.241869 18754 log.cc:927] Time spent T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.124s	user 0.000s	sys 0.003s
I20260709 12:11:31.246809 18724 consensus_queue.cc:1243] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer 885067a0d31741bfb5c9935788e315bf log is divergent from this leader: its last log entry 10.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:11:31.241047 18731 consensus_queue.cc:1048] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 12:11:31.247107 18612 consensus_queue.cc:1048] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 12:11:31.247031 18616 consensus_queue.cc:1059] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 12:11:31.259253 18721 raft_consensus.cc:697] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 11 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:31.280139 18737 raft_consensus.cc:515] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:31.298890 14182 raft_consensus.cc:1240] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:31.265717 18735 raft_consensus.cc:515] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:31.292806 18764 raft_consensus.cc:493] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:31.297076 18616 raft_consensus.cc:493] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:31.281176 18214 raft_consensus.cc:515] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:31.295806 18724 raft_consensus.cc:493] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:31.321405 18768 log.cc:927] Time spent T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 12:11:31.321648 18735 leader_election.cc:290] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:31.312139 18764 raft_consensus.cc:515] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:11:31.332166 18718 log.cc:927] Time spent T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.992s	user 0.003s	sys 0.000s
W20260709 12:11:31.337707 18713 log.cc:927] Time spent T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.999s	user 0.002s	sys 0.000s
I20260709 12:11:31.337963 18770 raft_consensus.cc:493] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:31.349918 18770 raft_consensus.cc:515] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:31.338428 18721 consensus_queue.cc:237] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:31.338428 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:31.341766 14185 raft_consensus.cc:1240] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:31.350669 18764 leader_election.cc:290] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:31.296979 18576 consensus_queue.cc:1059] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 12:11:31.342907 14904 raft_consensus.cc:1240] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 12. Current term is 13. Ops: [12.11-12.11]
W20260709 12:11:31.345314 14228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:31.342350 18587 raft_consensus.cc:3055] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:31.313678 18616 raft_consensus.cc:515] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:31.310312 18741 raft_consensus.cc:515] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:31.355355 18770 leader_election.cc:290] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:31.357477 14264 raft_consensus.cc:1240] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:31.379117 14908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
W20260709 12:11:31.350554 14265 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41768 (request call id 1870) took 1894 ms (client timeout 1836 ms). Trace:
I20260709 12:11:31.387140 18735 consensus_queue.cc:1059] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:11:31.383379 18587 raft_consensus.cc:740] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:11:31.359055 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:31.384593 18741 leader_election.cc:290] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 15 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:31.391613 18587 consensus_queue.cc:260] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:31.393362 18587 raft_consensus.cc:3060] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:31.394012 14338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 779) took 1913 ms. Trace:
I20260709 12:11:31.384372 14259 raft_consensus.cc:1240] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 9. Current term is 10. Ops: []
W20260709 12:11:31.386798 14265 rpcz_store.cc:269] 0709 12:11:29.455832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:29.459183 (+  3351us) service_pool.cc:224] Handling call
0709 12:11:31.350351 (+1891168us) spinlock_profiling.cc:243] Waited 171 ms on lock 0x7b5400210a54. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:11:31.350470 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":393261312}
I20260709 12:11:31.395416 18616 leader_election.cc:290] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:31.396011 14337 raft_consensus.cc:1217] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Deduplicated request from leader. Original: 11.9->[12.10-12.10]   Dedup: 12.10->[]
I20260709 12:11:31.394418 14338 rpcz_store.cc:276] 0709 12:11:29.480513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:29.480653 (+   140us) service_pool.cc:224] Handling call
0709 12:11:29.481061 (+   408us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:29.571533 (+ 90472us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:29.571566 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:29.580537 (+  8971us) log.cc:844] Serialized 52 byte log entry
0709 12:11:29.814627 (+234090us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:29.814671 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:29.814752 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:31.336993 (+1522241us) spinlock_profiling.cc:243] Waited 7.71 ms on lock 0x7b4400022b4c. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2123f74c85 00007f2123f756a2 00007f2126ce71db 00007f2126ce2aaf 00007f2126cd686e 00007f2126cd5bb6 00007f2126cd57d8 00007f2126cdf221 00007f2126cdf1d9 00007f2126cdf169
0709 12:11:31.393689 (+ 56696us) raft_consensus.cc:1685] finished
0709 12:11:31.393712 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:31.393938 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9550,"raft.queue_time_us":91319,"raft.run_cpu_time_us":267,"raft.run_wall_time_us":29447,"spinlock_wait_cycles":17727360,"thread_start_us":183629,"threads_started":1,"wal-append.queue_time_us":536023}
I20260709 12:11:31.396554 14337 raft_consensus.cc:1240] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 12:11:31.398379 14261 raft_consensus.cc:1240] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:31.399026 14904 raft_consensus.cc:2468] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 8.
I20260709 12:11:31.400429 14154 leader_election.cc:304] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:31.318564 18724 raft_consensus.cc:515] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:31.344611 18769 raft_consensus.cc:493] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
W20260709 12:11:31.412811 14156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:31.415154 18665 leader_election.cc:290] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 11 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:31.418035 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:31.404417 18616 raft_consensus.cc:2804] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:31.422864 14184 raft_consensus.cc:1275] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:11:31.424461 14876 leader_election.cc:304] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:11:31.436102 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:31.380970 18749 raft_consensus.cc:515] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } }
I20260709 12:11:31.441586 14184 raft_consensus.cc:1275] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:11:31.455600 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:31.433017 18731 raft_consensus.cc:493] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:31.437466 18616 raft_consensus.cc:493] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:31.460649 14304 leader_election.cc:304] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:31.464915 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:31.486838 14909 raft_consensus.cc:1240] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:31.470060 14184 raft_consensus.cc:3060] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:11:31.495347 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 70977.3us
W20260709 12:11:31.498680 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 76437.8us
I20260709 12:11:31.434957 18748 raft_consensus.cc:515] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:31.478868 18616 raft_consensus.cc:3060] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:31.435259 18769 raft_consensus.cc:515] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:31.463410 18704 raft_consensus.cc:493] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:31.519273 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:31.523294 14183 raft_consensus.cc:2393] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 13: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:11:31.529896 14184 raft_consensus.cc:2468] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 15.
I20260709 12:11:31.506884 18623 raft_consensus.cc:493] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:11:31.488952 18498 raft_consensus.cc:515] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:31.471422 18731 raft_consensus.cc:515] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:31.468948 18643 consensus_queue.cc:1059] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.045s
W20260709 12:11:31.538705 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 68297.8us
I20260709 12:11:31.538354 14184 raft_consensus.cc:1275] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:11:31.534917 18721 consensus_queue.cc:1059] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 13.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 12:11:31.549530 14186 raft_consensus.cc:2393] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db in current term 11: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
W20260709 12:11:31.558374 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 52855.7us
I20260709 12:11:31.522985 18704 raft_consensus.cc:515] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:11:31.560302 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 99765.5us
I20260709 12:11:31.539438 18214 leader_election.cc:290] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 14 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:31.561239 14303 leader_election.cc:304] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:31.539222 18779 raft_consensus.cc:2804] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:31.549218 18741 raft_consensus.cc:3055] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:31.569335 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:31.570182 14184 raft_consensus.cc:2468] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 11.
I20260709 12:11:31.551252 18724 leader_election.cc:290] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:31.569134 18780 raft_consensus.cc:493] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:31.584597 18780 raft_consensus.cc:515] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:31.586464 18498 leader_election.cc:290] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 11 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:31.542966 18623 raft_consensus.cc:515] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:31.591642 18704 leader_election.cc:290] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:31.591791 18623 leader_election.cc:290] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:31.569648 18741 raft_consensus.cc:740] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:31.551519 18748 leader_election.cc:290] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 13 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:31.593297 18741 consensus_queue.cc:260] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:31.556380 18731 leader_election.cc:290] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:31.544180 18774 raft_consensus.cc:2804] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:31.594520 18774 raft_consensus.cc:493] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:31.594933 18774 raft_consensus.cc:3060] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:31.544787 18702 raft_consensus.cc:515] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:31.563267 14304 leader_election.cc:304] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:31.573609 18592 consensus_queue.cc:1048] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:31.578470 18749 leader_election.cc:290] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 11 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:31.583268 18637 leader_election.cc:290] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:31.568907 18779 raft_consensus.cc:493] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:11:31.601302 18779 raft_consensus.cc:3060] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:31.599700 18702 leader_election.cc:290] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 13 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:31.572507 18643 raft_consensus.cc:2804] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:31.567684 18721 consensus_queue.cc:1059] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:11:31.605690 18616 raft_consensus.cc:515] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:31.620805 14337 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50858 (request call id 1860) took 1765 ms. Trace:
I20260709 12:11:31.624276 18153 raft_consensus.cc:3055] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:31.624749 18153 raft_consensus.cc:740] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:31.625528 14187 raft_consensus.cc:2393] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db in current term 9: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:11:31.621258 14337 rpcz_store.cc:276] 0709 12:11:29.855768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:29.855944 (+   176us) service_pool.cc:224] Handling call
0709 12:11:31.395853 (+1539909us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:31.396909 (+  1056us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:31.620598 (+223689us) spinlock_profiling.cc:243] Waited 1.39 s on lock 0x7b540029e850. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713a8ad 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:11:31.620740 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3200401152}
I20260709 12:11:31.627681 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:11:31.606846 14304 leader_election.cc:304] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:31.635747 14912 raft_consensus.cc:2393] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 11: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
I20260709 12:11:31.637161 18616 leader_election.cc:290] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 9 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:31.638136 18153 consensus_queue.cc:260] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:31.642952 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:11:31.643718 14909 raft_consensus.cc:3060] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:31.644690 14304 leader_election.cc:304] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:31.647591 14304 leader_election.cc:304] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:31.655047 14304 leader_election.cc:304] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:31.577013 18609 raft_consensus.cc:2749] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:31.661302 14910 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53200 (request call id 612) took 1339 ms. Trace:
I20260709 12:11:31.661718 14910 rpcz_store.cc:276] 0709 12:11:30.322746 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:30.322909 (+   163us) service_pool.cc:224] Handling call
0709 12:11:31.661097 (+1338188us) spinlock_profiling.cc:243] Waited 184 ms on lock 0x7b5400648f54. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:11:31.661240 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":422532992}
I20260709 12:11:31.663414 14906 raft_consensus.cc:1240] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 14. Current term is 15. Ops: [14.10-14.10]
W20260709 12:11:31.637115 18694 log.cc:927] Time spent T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 2.061s	user 0.020s	sys 0.018s
I20260709 12:11:31.606276 18643 raft_consensus.cc:697] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 15 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:31.607030 18702 raft_consensus.cc:2749] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:31.594695 18741 raft_consensus.cc:3060] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:31.616396 18779 raft_consensus.cc:515] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:11:31.670774 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 111623us
W20260709 12:11:31.671576 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 105308us
I20260709 12:11:31.676453 14909 raft_consensus.cc:2468] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 9.
I20260709 12:11:31.615617 18737 leader_election.cc:290] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:31.668512 18726 leader_election.cc:290] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:31.683882 14303 leader_election.cc:304] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:31.681638 14154 leader_election.cc:304] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:31.670987 18724 raft_consensus.cc:2804] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:31.664220 18782 raft_consensus.cc:2749] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:31.660672 18704 raft_consensus.cc:2749] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:31.689862 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:31.692344 18702 raft_consensus.cc:2804] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:31.695919 18702 raft_consensus.cc:493] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:31.696287 18702 raft_consensus.cc:3060] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:31.662294 18615 raft_consensus.cc:2749] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:31.692689 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:31.697901 14182 raft_consensus.cc:2468] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 7.
I20260709 12:11:31.698035 18615 raft_consensus.cc:493] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:31.698537 18615 raft_consensus.cc:515] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:31.700047 14332 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50856 (request call id 2203) took 1406 ms. Trace:
I20260709 12:11:31.700459 14332 rpcz_store.cc:276] 0709 12:11:30.293575 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:30.536458 (+242883us) service_pool.cc:224] Handling call
0709 12:11:31.081385 (+544927us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:31.081569 (+   184us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:31.081595 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:31.081636 (+    41us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:31.081666 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:31.081718 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:31.699878 (+618160us) spinlock_profiling.cc:243] Waited 532 ms on lock 0x7b5400145850. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713a8ad 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:11:31.699982 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1223613696}
I20260709 12:11:31.617090 18774 raft_consensus.cc:515] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:31.694381 18712 raft_consensus.cc:2804] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:31.708302 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:11:31.677264 18609 consensus_queue.cc:1059] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 12:11:31.710783 14912 raft_consensus.cc:1275] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
W20260709 12:11:31.712450 14333 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50858 (request call id 1867) took 1814 ms (client timeout 1642 ms). Trace:
I20260709 12:11:31.713925 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:31.714589 14909 raft_consensus.cc:2468] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 7.
I20260709 12:11:31.691958 18724 raft_consensus.cc:493] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:31.712899 14333 rpcz_store.cc:269] 0709 12:11:29.897793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:31.712209 (+1814416us) service_pool.cc:211] Skipping call since client already timed out
0709 12:11:31.712367 (+   158us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:11:31.691360 18632 consensus_queue.cc:1048] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 12:11:31.717968 18712 raft_consensus.cc:697] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 9 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:11:31.690815 18625 consensus_queue.cc:1048] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 12:11:31.717883 18724 raft_consensus.cc:3060] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:31.740746 14257 raft_consensus.cc:1275] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 5. (term mismatch)
I20260709 12:11:31.734074 14181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 2707) took 3217 ms. Trace:
I20260709 12:11:31.743763 14265 raft_consensus.cc:1240] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:31.746636 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:31.747291 14265 raft_consensus.cc:2468] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 9.
I20260709 12:11:31.748503 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:31.749171 14261 raft_consensus.cc:2468] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 12.
I20260709 12:11:31.745716 14181 rpcz_store.cc:276] 0709 12:11:28.516274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:28.516695 (+   421us) service_pool.cc:224] Handling call
0709 12:11:29.400840 (+884145us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:29.401580 (+   740us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:31.733875 (+2332295us) spinlock_profiling.cc:243] Waited 884 ms on lock 0x7b54003b1d50. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713a8ad 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:11:31.734011 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2032608128}
I20260709 12:11:31.750932 18774 leader_election.cc:290] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 12 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:31.751749 18609 consensus_queue.cc:1059] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:31.754227 18779 leader_election.cc:290] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 11 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:31.755172 18615 leader_election.cc:290] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:31.718808 18643 consensus_queue.cc:237] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:31.745226 18637 raft_consensus.cc:493] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:31.761363 18637 raft_consensus.cc:515] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:31.764127 18637 leader_election.cc:290] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:31.770464 18729 raft_consensus.cc:3055] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:31.771106 18729 raft_consensus.cc:740] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:11:31.728135 18653 leader_election.cc:290] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 11 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:31.772212 18729 consensus_queue.cc:260] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:31.775665 18781 raft_consensus.cc:3055] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:31.776240 18781 raft_consensus.cc:740] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:31.780824 18519 consensus_queue.cc:1059] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:11:31.782425 18519 consensus_queue.cc:1059] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:11:31.783366 18519 raft_consensus.cc:3055] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:31.783738 18519 raft_consensus.cc:740] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:31.784772 18519 consensus_queue.cc:260] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:31.743767 14257 pending_rounds.cc:85] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec: Aborting all ops after (but not including) 4
I20260709 12:11:31.786545 14257 pending_rounds.cc:107] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 12:11:31.786772 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
W20260709 12:11:31.787895 14156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:31.770542 18712 consensus_queue.cc:237] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:31.786944 14257 raft_consensus.cc:2889] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:11:31.791126 14305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:31.798177 18740 raft_consensus.cc:3055] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:31.798668 18740 raft_consensus.cc:740] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:31.799458 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:31.800408 14188 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56046 (request call id 2331) took 1430 ms. Trace:
I20260709 12:11:31.800806 14188 rpcz_store.cc:276] 0709 12:11:30.369685 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:30.430924 (+ 61239us) service_pool.cc:224] Handling call
0709 12:11:30.988272 (+557348us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:31.032028 (+ 43756us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:31.032066 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:31.037021 (+  4955us) log.cc:844] Serialized 26 byte log entry
0709 12:11:31.139846 (+102825us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:31.139896 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:31.139969 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:31.248907 (+108938us) raft_consensus.cc:1685] finished
0709 12:11:31.248928 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:31.800125 (+551197us) spinlock_profiling.cc:243] Waited 557 ms on lock 0x7b54003f2ad0. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713a8ad 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:11:31.800342 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43553,"raft.queue_time_us":43867,"raft.run_cpu_time_us":200,"raft.run_wall_time_us":20986,"spinlock_wait_cycles":1280498432,"thread_start_us":65406,"threads_started":1,"wal-append.queue_time_us":80058}
I20260709 12:11:31.802115 18519 raft_consensus.cc:3060] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:31.802652 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:31.803444 14332 raft_consensus.cc:2393] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 13: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:11:31.793233 14258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41768 (request call id 1839) took 4244 ms. Trace:
I20260709 12:11:31.799530 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:31.805549 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:31.806563 14263 raft_consensus.cc:1275] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 11 index: 4. Preceding OpId from leader: term: 13 index: 5. (index mismatch)
I20260709 12:11:31.806767 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:31.804731 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:31.808025 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:31.808637 14256 raft_consensus.cc:1240] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:31.805675 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:31.812206 14263 raft_consensus.cc:1275] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:11:31.813191 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:31.799633 18740 consensus_queue.cc:260] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:31.816877 18740 raft_consensus.cc:3060] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:31.819060 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:31.819604 14264 raft_consensus.cc:1240] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:31.801934 18786 raft_consensus.cc:493] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:31.804567 14258 rpcz_store.cc:276] 0709 12:11:27.549043 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:27.549332 (+   289us) service_pool.cc:224] Handling call
0709 12:11:27.549684 (+   352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:29.881270 (+2331586us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:31.792957 (+1911687us) spinlock_profiling.cc:243] Waited 2.26 s on lock 0x7b5400222ed4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:11:31.793137 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5203907456}
I20260709 12:11:31.822579 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:31.823458 14261 raft_consensus.cc:2468] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 7.
I20260709 12:11:31.824793 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:31.826454 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:31.827210 14338 raft_consensus.cc:2468] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 9.
I20260709 12:11:31.827704 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:31.827979 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:31.828393 14335 raft_consensus.cc:2468] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 12.
I20260709 12:11:31.789610 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:31.829417 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:31.829408 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:31.830129 14259 raft_consensus.cc:3060] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:11:31.830909 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:31.832149 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:31.830879 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:31.834326 14330 raft_consensus.cc:2468] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 11.
I20260709 12:11:31.835269 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:31.835431 14304 leader_election.cc:304] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:31.836226 14262 raft_consensus.cc:3060] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:31.837002 14263 raft_consensus.cc:3060] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:31.840953 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:31.842196 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:31.842940 14336 raft_consensus.cc:2468] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 8.
I20260709 12:11:31.843667 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:31.820894 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:31.844461 14256 raft_consensus.cc:3060] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:31.846246 14304 leader_election.cc:304] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:11:31.847533 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:31.849586 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:31.854228 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:31.855053 14339 raft_consensus.cc:2468] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 7.
I20260709 12:11:31.856014 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:31.857517 14339 raft_consensus.cc:2468] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 9.
I20260709 12:11:31.858686 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:31.859661 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:31.860522 14336 raft_consensus.cc:2393] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 11: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:11:31.781360 18780 leader_election.cc:290] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:31.868299 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:31.869915 14304 leader_election.cc:304] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:31.872023 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:31.874379 18622 raft_consensus.cc:2804] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:31.875133 18507 raft_consensus.cc:493] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:11:31.875768 18507 raft_consensus.cc:515] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:31.876271 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:31.878341 14337 raft_consensus.cc:1240] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:11:31.874936 18714 consensus_queue.cc:1048] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:11:31.879714 14304 leader_election.cc:304] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:31.878341 14332 raft_consensus.cc:1240] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 12:11:31.868314 18609 raft_consensus.cc:2804] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:31.881142 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:31.773662 18729 raft_consensus.cc:3060] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:31.882503 14228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:31.882877 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:31.884361 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:31.777194 18781 consensus_queue.cc:260] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:31.886564 14336 raft_consensus.cc:1240] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 7. Current term is 8. Ops: []
W20260709 12:11:31.893824 14156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:31.901609 14304 leader_election.cc:304] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:31.895087 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:11:31.890255 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 197235us
I20260709 12:11:31.905967 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:31.910144 14912 raft_consensus.cc:1240] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 13 LEADER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:31.874891 18622 raft_consensus.cc:493] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:31.913162 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:31.915617 14337 raft_consensus.cc:1240] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:11:31.895112 14263 raft_consensus.cc:2468] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 12.
W20260709 12:11:31.920753 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:31.917872 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:31.930850 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:31.931821 14336 raft_consensus.cc:3060] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:11:31.887825 18609 raft_consensus.cc:493] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:31.946771 14155 leader_election.cc:304] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:31.956609 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:31.959685 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:31.956878 14155 leader_election.cc:304] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:31.883479 18702 raft_consensus.cc:515] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:31.921964 18622 raft_consensus.cc:3060] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:31.969931 14259 raft_consensus.cc:2468] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 11.
I20260709 12:11:31.820914 18786 raft_consensus.cc:515] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:31.974287 14155 leader_election.cc:304] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 73d01e9b1a9d49358da4985b21d681db
W20260709 12:11:31.960474 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 139132us
I20260709 12:11:31.921360 18789 raft_consensus.cc:2749] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:32.024557 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:32.011662 14256 raft_consensus.cc:2468] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 15.
I20260709 12:11:32.008221 18574 raft_consensus.cc:3060] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:31.958606 17848 raft_consensus.cc:2749] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:32.030298 14262 raft_consensus.cc:2410] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:11:32.032492 14263 raft_consensus.cc:1275] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:11:32.031790 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:32.033625 14259 raft_consensus.cc:2468] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 12.
I20260709 12:11:32.034574 14261 raft_consensus.cc:1275] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:11:32.035871 14259 raft_consensus.cc:1275] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 12:11:32.033684 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:32.036382 14259 pending_rounds.cc:85] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec: Aborting all ops after (but not including) 8
I20260709 12:11:32.036779 14259 pending_rounds.cc:107] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 12:11:32.035754 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:32.037199 14259 raft_consensus.cc:2889] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:32.037637 14258 raft_consensus.cc:2468] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 8.
I20260709 12:11:32.038661 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:32.039836 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:32.036995 14257 raft_consensus.cc:2393] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db in current term 13: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:11:32.042263 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:32.042551 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:32.043077 14257 raft_consensus.cc:2393] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db in current term 13: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:11:31.958667 18609 raft_consensus.cc:3060] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:32.057477 14230 connection.cc:256] RPC call timeout handler was delayed by -1.3620406929999263s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2178s for a response
W20260709 12:11:32.060109 14230 connection.cc:256] RPC call timeout handler was delayed by -1.3323406929998782s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2211s for a response
W20260709 12:11:32.060703 14230 connection.cc:256] RPC call timeout handler was delayed by -1.2897037200000341s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.163s for a response
I20260709 12:11:32.052254 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:32.062331 18632 consensus_queue.cc:1048] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:31.921696 18699 consensus_queue.cc:1059] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 13.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.091s
W20260709 12:11:32.206797 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 305295us
I20260709 12:11:32.207847 14304 leader_election.cc:304] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
W20260709 12:11:32.061348 14230 connection.cc:256] RPC call timeout handler was delayed by -1.0268179769998369s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17900000000000002s for a response
I20260709 12:11:31.979329 18507 leader_election.cc:290] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:32.241981 14304 leader_election.cc:304] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
W20260709 12:11:32.138121 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 163888us
I20260709 12:11:32.246019 14155 leader_election.cc:304] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:31.981037 18782 raft_consensus.cc:2749] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:32.045110 18780 raft_consensus.cc:493] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:32.185246 14336 raft_consensus.cc:2468] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 11.
I20260709 12:11:32.185761 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:31.979658 18519 raft_consensus.cc:2749] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:32.077585 14338 raft_consensus.cc:2393] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 12: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:11:32.064607 18600 raft_consensus.cc:493] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:32.232460 14230 leader_election.cc:304] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:11:32.062402 14877 leader_election.cc:304] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:32.021418 18626 raft_consensus.cc:493] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
W20260709 12:11:32.283280 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 405314us
I20260709 12:11:32.296710 14339 raft_consensus.cc:2468] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 8.
I20260709 12:11:32.192524 17848 raft_consensus.cc:2804] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:32.363128 17848 raft_consensus.cc:493] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:32.363699 17848 raft_consensus.cc:3060] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:32.193126 18653 raft_consensus.cc:493] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:32.185415 18749 raft_consensus.cc:493] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:11:32.366479 18653 raft_consensus.cc:515] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:32.366645 18749 raft_consensus.cc:515] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:11:32.339525 14156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:32.368831 18749 leader_election.cc:290] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:11:32.373484 14187 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.006s	sys 0.027s
W20260709 12:11:32.374785 14187 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.553s	user 0.007s	sys 0.027s
I20260709 12:11:32.274713 18712 raft_consensus.cc:2749] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:32.271863 18600 raft_consensus.cc:515] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:32.257620 18637 consensus_queue.cc:1059] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.118s
W20260709 12:11:32.374742 18724 consensus_meta.cc:287] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.608s	user 0.011s	sys 0.000s
I20260709 12:11:32.429183 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:11:32.419445 14330 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.033s	sys 0.039s
I20260709 12:11:32.300036 18737 consensus_queue.cc:1059] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.111s
W20260709 12:11:32.430832 14330 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.545s	user 0.034s	sys 0.039s
I20260709 12:11:32.298413 18626 raft_consensus.cc:515] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:32.417840 18507 raft_consensus.cc:2804] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:11:32.451990 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 219631us
I20260709 12:11:32.469600 14230 leader_election.cc:304] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:32.309077 18780 raft_consensus.cc:515] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:32.391667 18802 raft_consensus.cc:2749] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:11:32.486491 14228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:32.427069 18574 raft_consensus.cc:2749] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:32.467465 18519 raft_consensus.cc:2749] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:11:32.513216 18792 log.cc:927] Time spent T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
W20260709 12:11:32.513901 14302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:32.514220 18791 log.cc:927] Time spent T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.274s	user 0.000s	sys 0.000s
I20260709 12:11:32.468140 18507 raft_consensus.cc:493] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:11:32.487484 18737 raft_consensus.cc:3055] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:32.440901 18724 raft_consensus.cc:515] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:11:32.557775 14334 consensus_meta.cc:287] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.668s	user 0.012s	sys 0.001s
I20260709 12:11:32.558261 14334 raft_consensus.cc:2468] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 12.
I20260709 12:11:32.559036 18780 leader_election.cc:290] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:32.559293 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:32.560050 14334 raft_consensus.cc:2468] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 13.
I20260709 12:11:32.440649 18712 consensus_queue.cc:1059] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.098s
I20260709 12:11:32.477432 18643 consensus_queue.cc:1059] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.069s
I20260709 12:11:32.550200 18507 raft_consensus.cc:3060] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:32.585311 14333 raft_consensus.cc:1240] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 11. Current term is 12. Ops: [11.7-11.7]
W20260709 12:11:32.584913 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 341585us
I20260709 12:11:32.544189 18702 leader_election.cc:290] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 12 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:32.595970 14304 leader_election.cc:304] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db
W20260709 12:11:32.596588 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 340606us
I20260709 12:11:32.597677 14303 leader_election.cc:304] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:32.550689 18737 raft_consensus.cc:740] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:11:32.604285 14304 leader_election.cc:304] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:32.609434 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:32.616752 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:11:32.607719 18741 consensus_meta.cc:287] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.929s	user 0.012s	sys 0.004s
I20260709 12:11:32.616086 18714 raft_consensus.cc:493] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:11:32.673560 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:32.675516 14912 raft_consensus.cc:1240] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 11 LEADER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 12:11:32.678010 18724 leader_election.cc:290] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 12 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:32.673941 18809 raft_consensus.cc:2764] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
W20260709 12:11:32.683262 18804 log.cc:927] Time spent T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
W20260709 12:11:32.685154 14186 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56652 (request call id 1047) took 1267 ms (client timeout 1568 ms). Trace:
W20260709 12:11:32.685683 14186 rpcz_store.cc:269] 0709 12:11:31.417600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:31.417753 (+   153us) service_pool.cc:224] Handling call
0709 12:11:32.684892 (+1267139us) spinlock_profiling.cc:243] Waited 116 ms on lock 0x7b5400422054. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:11:32.685071 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":267120384}
I20260709 12:11:32.686436 14334 raft_consensus.cc:1275] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:11:32.687631 14186 raft_consensus.cc:1275] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:11:32.689626 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:32.670033 18519 consensus_queue.cc:1059] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 12:11:32.690864 18519 raft_consensus.cc:2749] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:32.691089 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:11:32.694499 18704 raft_consensus.cc:3055] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:32.694989 18704 raft_consensus.cc:740] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:32.695864 18704 consensus_queue.cc:260] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:32.696641 18626 leader_election.cc:290] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:32.702126 18737 consensus_queue.cc:260] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:32.702836 18153 raft_consensus.cc:3060] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:32.703635 18737 raft_consensus.cc:3060] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:32.651705 18702 consensus_queue.cc:1048] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 12:11:32.707422 14183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56044 (request call id 2727) took 1667 ms. Trace:
I20260709 12:11:32.707609 18741 raft_consensus.cc:2804] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:32.707950 14183 rpcz_store.cc:276] 0709 12:11:31.039575 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:31.043575 (+  4000us) service_pool.cc:224] Handling call
0709 12:11:32.707140 (+1663565us) spinlock_profiling.cc:243] Waited 474 ms on lock 0x7b540019b4d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:11:32.707334 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1090035072}
I20260709 12:11:32.618000 18653 leader_election.cc:290] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:32.709651 14183 raft_consensus.cc:1240] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:32.691529 18519 raft_consensus.cc:3055] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:32.720871 18519 raft_consensus.cc:740] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:32.721938 18519 consensus_queue.cc:260] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:32.723294 18519 raft_consensus.cc:3060] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:32.710565 18741 raft_consensus.cc:493] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:32.726557 18741 raft_consensus.cc:3060] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:32.711251 14331 raft_consensus.cc:1275] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:11:32.733274 18769 leader_election.cc:290] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:32.671612 18789 raft_consensus.cc:2804] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:32.822126 18789 raft_consensus.cc:493] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:32.822667 18789 raft_consensus.cc:3060] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:11:32.718568 18796 log.cc:927] Time spent T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:11:32.669476 18714 raft_consensus.cc:515] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:32.735328 17848 raft_consensus.cc:515] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:32.709455 14906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53194 (request call id 929) took 2336 ms. Trace:
W20260709 12:11:32.738624 18729 consensus_meta.cc:287] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.833s	user 0.010s	sys 0.003s
I20260709 12:11:32.660442 18643 consensus_queue.cc:1048] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.079s
I20260709 12:11:32.740741 18440 raft_consensus.cc:3055] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:32.741711 14084 catalog_manager.cc:5697] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:32.830302 14906 rpcz_store.cc:276] 0709 12:11:30.372831 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:30.374955 (+  2124us) service_pool.cc:224] Handling call
0709 12:11:31.663152 (+1288197us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:31.663826 (+   674us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:32.709178 (+1045352us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b5400648f50. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713a8ad 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:11:32.709341 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2949598464}
I20260709 12:11:32.830920 18440 raft_consensus.cc:740] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:11:32.743891 14337 raft_consensus.cc:1240] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:32.186785 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:32.715607 18704 raft_consensus.cc:3060] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:32.740953 18609 consensus_meta.cc:287] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.624s	user 0.012s	sys 0.000s
I20260709 12:11:32.791970 14334 raft_consensus.cc:1275] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
I20260709 12:11:32.832332 18609 raft_consensus.cc:515] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:32.831982 18440 consensus_queue.cc:260] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:32.832648 14334 pending_rounds.cc:85] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c: Aborting all ops after (but not including) 10
I20260709 12:11:32.834630 14334 pending_rounds.cc:107] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 12:11:32.834903 14334 raft_consensus.cc:2889] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:32.835124 18609 leader_election.cc:290] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 10 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:32.836009 14339 raft_consensus.cc:1240] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:32.841367 18714 leader_election.cc:290] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:32.843729 17848 leader_election.cc:290] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:11:32.846345 18622 consensus_meta.cc:287] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.800s	user 0.012s	sys 0.000s
I20260709 12:11:32.856673 14185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 2724) took 1818 ms. Trace:
I20260709 12:11:32.864141 14185 rpcz_store.cc:276] 0709 12:11:31.038587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:31.041825 (+  3238us) service_pool.cc:224] Handling call
0709 12:11:31.042106 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:31.351004 (+308898us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:32.856355 (+1505351us) spinlock_profiling.cc:243] Waited 299 ms on lock 0x7b5400420c54. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:11:32.856590 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":688669440}
I20260709 12:11:32.860409 14188 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56652 (request call id 1063) took 1093 ms. Trace:
W20260709 12:11:32.854336 18806 log.cc:927] Time spent T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.189s	user 0.007s	sys 0.001s
W20260709 12:11:32.867166 14154 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.018s	sys 0.022s
I20260709 12:11:32.866698 14188 rpcz_store.cc:276] 0709 12:11:31.766837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:31.802537 (+ 35700us) service_pool.cc:224] Handling call
0709 12:11:31.802850 (+   313us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:31.803229 (+   379us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:31.803257 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:31.803761 (+   504us) log.cc:844] Serialized 26 byte log entry
0709 12:11:32.191269 (+387508us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:32.859786 (+668517us) log.cc:844] Serialized 14 byte log entry
0709 12:11:32.860013 (+   227us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:32.860108 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:32.860153 (+    45us) raft_consensus.cc:1685] finished
0709 12:11:32.860164 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:32.860335 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":668142,"prepare.queue_time_us":671214,"raft.queue_time_us":9511,"raft.run_cpu_time_us":195,"raft.run_wall_time_us":197,"thread_start_us":361268,"threads_started":1,"wal-append.queue_time_us":760258}
W20260709 12:11:32.867605 14154 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.538s	user 0.018s	sys 0.022s
W20260709 12:11:32.863744 18740 consensus_meta.cc:287] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 1.046s	user 0.012s	sys 0.003s
I20260709 12:11:32.862552 18802 raft_consensus.cc:3055] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:32.662087 18786 leader_election.cc:290] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:32.879575 18802 raft_consensus.cc:740] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:32.899463 14333 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50858 (request call id 1893) took 1065 ms. Trace:
I20260709 12:11:32.899930 14333 rpcz_store.cc:276] 0709 12:11:31.833819 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:31.869291 (+ 35472us) service_pool.cc:224] Handling call
0709 12:11:31.879768 (+ 10477us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:32.594280 (+714512us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:32.899117 (+304837us) spinlock_profiling.cc:243] Waited 705 ms on lock 0x7b5400146754. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:11:32.899388 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1621961472}
I20260709 12:11:32.900651 14336 raft_consensus.cc:1275] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 12:11:32.899829 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 430283us
I20260709 12:11:32.847028 18622 raft_consensus.cc:515] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:11:32.911412 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:32.919981 14330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50858 (request call id 1892) took 1093 ms. Trace:
I20260709 12:11:32.920461 14330 rpcz_store.cc:276] 0709 12:11:31.833408 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:31.865546 (+ 32138us) service_pool.cc:224] Handling call
0709 12:11:31.865979 (+   433us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:31.870924 (+  4945us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:31.870964 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:31.885563 (+ 14599us) log.cc:844] Serialized 26 byte log entry
0709 12:11:32.434254 (+548691us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:11:32.434367 (+   113us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:32.434529 (+   162us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:32.853680 (+419151us) spinlock_profiling.cc:243] Waited 6.31 ms on lock 0x7b4400022b4c. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2123f74c85 00007f2123f756a2 00007f2126ce71db 00007f2126ce2aaf 00007f2126cd686e 00007f2126cd5bb6 00007f2126cd57d8 00007f2126cdf221 00007f2126cdf1d9 00007f2126cdf169
0709 12:11:32.911393 (+ 57713us) raft_consensus.cc:1685] finished
0709 12:11:32.911417 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:32.919887 (+  8470us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4459,"raft.queue_time_us":34183,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":11724,"spinlock_wait_cycles":14513024,"thread_start_us":548008,"threads_started":1,"wal-append.queue_time_us":707967}
I20260709 12:11:32.907267 14230 leader_election.cc:304] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:32.879524 18637 raft_consensus.cc:2749] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:32.923615 14332 raft_consensus.cc:2393] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 13: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:11:32.926857 14332 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50858 (request call id 1903) took 1041 ms. Trace:
I20260709 12:11:32.927492 14332 rpcz_store.cc:276] 0709 12:11:31.885561 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:31.885723 (+   162us) service_pool.cc:224] Handling call
0709 12:11:32.926584 (+1040861us) spinlock_profiling.cc:243] Waited 997 ms on lock 0x7b540023a354. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:11:32.926776 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2292956416}
W20260709 12:11:32.927501 14155 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.006s	sys 0.009s
I20260709 12:11:32.930015 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
W20260709 12:11:32.930608 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 326396us
I20260709 12:11:32.933413 14304 leader_election.cc:304] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:11:32.933597 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:11:32.930956 14181 raft_consensus.cc:2410] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:11:32.939824 14181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56044 (request call id 2754) took 1033 ms. Trace:
I20260709 12:11:32.940199 14181 rpcz_store.cc:276] 0709 12:11:31.906282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:32.514808 (+608526us) service_pool.cc:224] Handling call
0709 12:11:32.939757 (+424949us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:32.930995 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
W20260709 12:11:32.936333 14156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:32.938149 14155 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.586s	user 0.006s	sys 0.009s
I20260709 12:11:32.938138 17848 raft_consensus.cc:493] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:32.943055 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 599877us
W20260709 12:11:32.927122 14877 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.003s	sys 0.012s
W20260709 12:11:32.943774 14877 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.611s	user 0.003s	sys 0.012s
I20260709 12:11:32.943899 14155 leader_election.cc:304] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
W20260709 12:11:32.944389 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 882019us
I20260709 12:11:32.950196 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:32.950630 14877 leader_election.cc:304] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 885067a0d31741bfb5c9935788e315bf
W20260709 12:11:32.956575 14228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:32.943228 17848 raft_consensus.cc:515] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:32.964835 14155 leader_election.cc:304] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:32.919633 18802 consensus_queue.cc:260] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:32.972249 18802 raft_consensus.cc:3060] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:32.973906 18741 raft_consensus.cc:515] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:32.976469 18741 leader_election.cc:290] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 8 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:32.976505 18737 raft_consensus.cc:493] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:32.974105 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:32.982606 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:11:32.984470 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 51142.6us
I20260709 12:11:32.965588 14877 leader_election.cc:304] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:32.985893 14304 leader_election.cc:304] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
W20260709 12:11:32.984745 14305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:32.986781 14305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:32.986786 14877 leader_election.cc:304] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:32.990485 17848 leader_election.cc:290] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:32.990816 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:32.991972 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:32.933533 18809 raft_consensus.cc:2749] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:32.995273 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:32.996374 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:32.996253 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:32.938102 18769 raft_consensus.cc:493] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:33.000398 14155 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:33.002242 14155 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:33.002549 14262 raft_consensus.cc:1275] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
W20260709 12:11:33.003361 14155 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:33.003623 14302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:33.004879 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:32.967808 18275 raft_consensus.cc:2764] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:11:33.002271 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:33.005882 14330 raft_consensus.cc:2410] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 12:11:32.998805 18582 raft_consensus.cc:493] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:33.007390 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:33.011350 14333 raft_consensus.cc:3060] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:32.968040 18606 raft_consensus.cc:2749] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:32.994896 18722 raft_consensus.cc:2749] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:33.013716 14259 raft_consensus.cc:1240] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:33.009164 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:33.363088 14262 raft_consensus.cc:3060] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:33.360787 18729 raft_consensus.cc:493] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:33.015017 18740 raft_consensus.cc:493] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:33.365255 18729 raft_consensus.cc:515] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:33.366098 18740 raft_consensus.cc:515] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:33.044763 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:33.367494 14332 raft_consensus.cc:2393] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 14: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:11:33.368367 18740 leader_election.cc:290] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:11:33.089170 14302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:33.014834 18582 raft_consensus.cc:515] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:11:33.369959 18795 log.cc:927] Time spent T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.466s	user 0.001s	sys 0.000s
I20260709 12:11:33.370952 18582 leader_election.cc:290] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:33.371572 18582 raft_consensus.cc:493] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:11:33.371923 18781 raft_consensus.cc:3060] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:32.993697 18737 raft_consensus.cc:515] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:33.007874 18769 raft_consensus.cc:515] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:11:33.126019 18632 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.019s	sys 0.035s
W20260709 12:11:33.199735 18798 log.cc:927] Time spent T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.198s	user 0.000s	sys 0.000s
I20260709 12:11:33.346170 14182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56652 (request call id 1059) took 1624 ms. Trace:
W20260709 12:11:33.347220 14304 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:32.999065 18808 raft_consensus.cc:2804] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:33.003258 18807 raft_consensus.cc:2749] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:11:33.225255 14911 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.021s	sys 0.013s
W20260709 12:11:33.393298 14911 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.715s	user 0.023s	sys 0.016s
I20260709 12:11:32.982437 18583 consensus_queue.cc:1059] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
W20260709 12:11:33.382567 18632 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.923s	user 0.019s	sys 0.035s
I20260709 12:11:32.968866 18785 consensus_queue.cc:1048] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
W20260709 12:11:33.186255 14303 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.015s	sys 0.024s
I20260709 12:11:32.965003 18681 consensus_queue.cc:1048] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 12:11:32.993816 18726 raft_consensus.cc:2804] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:32.993957 18708 raft_consensus.cc:493] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:11:33.011462 18585 raft_consensus.cc:2749] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:33.356644 14904 raft_consensus.cc:2393] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 9: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:11:33.376307 14262 raft_consensus.cc:2468] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 12.
W20260709 12:11:33.352339 18153 consensus_meta.cc:287] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.649s	user 0.019s	sys 0.005s
I20260709 12:11:33.383443 14333 raft_consensus.cc:2468] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 10.
I20260709 12:11:33.349872 18576 raft_consensus.cc:493] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:33.391187 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:33.391981 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:33.372128 18582 raft_consensus.cc:515] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:11:33.431392 14305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:33.433071 14339 raft_consensus.cc:2468] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 12.
I20260709 12:11:33.351131 18606 raft_consensus.cc:493] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:11:33.397961 18782 consensus_queue.cc:1048] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:33.399461 14336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50858 (request call id 1910) took 1456 ms. Trace:
W20260709 12:11:33.399726 18789 consensus_meta.cc:287] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.577s	user 0.018s	sys 0.001s
I20260709 12:11:33.402149 18815 raft_consensus.cc:3055] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:33.392782 18710 raft_consensus.cc:493] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:33.389787 14877 leader_election.cc:304] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:33.390383 18637 consensus_queue.cc:1048] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.039s
I20260709 12:11:33.415520 18808 raft_consensus.cc:697] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 12 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:33.429533 14334 raft_consensus.cc:2468] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 14.
I20260709 12:11:33.438235 14336 rpcz_store.cc:276] 0709 12:11:31.942754 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:32.253726 (+310972us) service_pool.cc:224] Handling call
0709 12:11:32.254106 (+   380us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:32.901172 (+647066us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:33.399192 (+498020us) spinlock_profiling.cc:243] Waited 646 ms on lock 0x7b54002e81d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:11:33.399386 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1485941120}
I20260709 12:11:33.411455 18741 raft_consensus.cc:493] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
W20260709 12:11:33.445989 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 56318.8us
I20260709 12:11:33.446961 14877 leader_election.cc:304] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:33.448271 14877 leader_election.cc:304] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:11:33.428098 18807 raft_consensus.cc:493] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:33.427821 18726 raft_consensus.cc:697] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 11 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:11:33.434832 18817 raft_consensus.cc:493] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:33.442387 18622 leader_election.cc:290] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 13 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:33.443842 18815 raft_consensus.cc:740] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:11:33.449793 14877 leader_election.cc:304] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:33.428613 18708 raft_consensus.cc:515] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:33.460088 18341 raft_consensus.cc:2804] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:33.457098 18585 raft_consensus.cc:2804] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:33.436393 18576 raft_consensus.cc:515] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:33.443688 18789 raft_consensus.cc:515] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:33.483713 18815 consensus_queue.cc:260] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:33.448199 18741 raft_consensus.cc:515] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:33.484090 18632 raft_consensus.cc:3060] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:33.496696 18808 consensus_queue.cc:237] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:33.501327 18708 leader_election.cc:290] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:33.502211 18812 raft_consensus.cc:493] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:33.455945 18710 raft_consensus.cc:515] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:33.464318 18817 raft_consensus.cc:515] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:33.483163 18813 raft_consensus.cc:493] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:11:33.460072 18807 raft_consensus.cc:515] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:11:33.490842 18507 consensus_meta.cc:287] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db: Time spent flushing consensus metadata: real 0.875s	user 0.009s	sys 0.016s
I20260709 12:11:33.443398 18606 raft_consensus.cc:515] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:33.479122 18827 raft_consensus.cc:493] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:33.508140 18802 consensus_meta.cc:287] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.535s	user 0.021s	sys 0.000s
I20260709 12:11:33.506234 18815 raft_consensus.cc:3060] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:33.519721 18807 leader_election.cc:290] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:33.514083 18827 raft_consensus.cc:515] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:33.522665 18653 raft_consensus.cc:3055] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:33.523162 18653 raft_consensus.cc:740] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:11:33.523758 18827 leader_election.cc:290] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:11:33.515821 18822 log.cc:927] Time spent T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:11:33.524262 18600 leader_election.cc:290] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:33.517095 18789 leader_election.cc:290] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 8 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:33.524175 18653 consensus_queue.cc:260] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:33.510017 18726 consensus_queue.cc:237] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:33.517647 18710 leader_election.cc:290] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:33.528931 18817 leader_election.cc:290] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:33.529313 18769 leader_election.cc:290] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:33.509451 18812 raft_consensus.cc:515] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:33.537314 18812 leader_election.cc:290] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:33.510497 18813 raft_consensus.cc:515] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:33.544932 18813 leader_election.cc:290] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:33.537946 18741 leader_election.cc:290] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:33.517442 18729 leader_election.cc:290] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:33.521865 18737 leader_election.cc:290] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:33.529033 18653 raft_consensus.cc:3060] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:11:33.359776 14156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:33.583148 14188 raft_consensus.cc:2468] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 11.
I20260709 12:11:33.358523 14189 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 2741) took 2269 ms. Trace:
I20260709 12:11:33.385694 14182 rpcz_store.cc:276] 0709 12:11:31.721935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:31.746971 (+ 25036us) service_pool.cc:224] Handling call
0709 12:11:31.778770 (+ 31799us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:31.779023 (+   253us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:11:32.859183 (+1080160us) log.cc:844] Serialized 14 byte log entry
0709 12:11:33.225027 (+365844us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:33.345781 (+120754us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:11:33.345849 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:33.345933 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:33.346092 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1097566,"prepare.queue_time_us":1081879,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":8045,"raft.queue_time_us":132520,"raft.run_cpu_time_us":236,"raft.run_wall_time_us":18060,"thread_start_us":365235,"threads_started":1,"wal-append.queue_time_us":506970}
I20260709 12:11:33.586858 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:33.588501 14182 raft_consensus.cc:2468] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 10.
I20260709 12:11:33.591295 14186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 2756) took 1682 ms. Trace:
W20260709 12:11:33.410178 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 412596us
I20260709 12:11:33.594674 14190 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56652 (request call id 1064) took 1820 ms. Trace:
I20260709 12:11:33.595187 14190 rpcz_store.cc:276] 0709 12:11:31.774491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:31.840815 (+ 66324us) service_pool.cc:224] Handling call
0709 12:11:31.841204 (+   389us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:31.841675 (+   471us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:31.841710 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:31.853909 (+ 12199us) log.cc:844] Serialized 26 byte log entry
0709 12:11:31.929835 (+ 75926us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:31.929923 (+    88us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:31.930104 (+   181us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:33.594018 (+1663914us) raft_consensus.cc:1685] finished
0709 12:11:33.594066 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:33.594440 (+   374us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1783,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":18209,"thread_start_us":55401,"threads_started":1,"wal-append.queue_time_us":1055991}
I20260709 12:11:33.598796 14331 raft_consensus.cc:1240] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 7. Current term is 8. Ops: []
W20260709 12:11:33.599234 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 120017us
W20260709 12:11:33.602458 14302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:33.601758 18507 raft_consensus.cc:515] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:11:33.413913 14303 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.809s	user 0.022s	sys 0.024s
W20260709 12:11:33.604825 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 999491us
I20260709 12:11:33.540097 18606 leader_election.cc:290] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:11:33.605976 14228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:33.597393 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:33.591876 14186 rpcz_store.cc:276] 0709 12:11:31.908691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:32.696069 (+787378us) service_pool.cc:224] Handling call
0709 12:11:32.696456 (+   387us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:32.696714 (+   258us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:11:32.860670 (+163956us) log.cc:844] Serialized 14 byte log entry
0709 12:11:33.590339 (+729669us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:33.590472 (+   133us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:33.590641 (+   169us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:33.590759 (+   118us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:33.591008 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":163613,"prepare.queue_time_us":165895,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":78,"raft.queue_time_us":109037,"spinlock_wait_cycles":35372288,"thread_start_us":635069,"threads_started":2,"wal-append.queue_time_us":535766}
I20260709 12:11:33.671994 14906 raft_consensus.cc:1240] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:33.584959 14189 rpcz_store.cc:276] 0709 12:11:31.089346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:31.089461 (+   115us) service_pool.cc:224] Handling call
0709 12:11:31.089800 (+   339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:31.108239 (+ 18439us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:11:31.145995 (+ 37756us) log.cc:844] Serialized 14 byte log entry
0709 12:11:31.158522 (+ 12527us) log.cc:844] Serialized 14 byte log entry
0709 12:11:31.669455 (+510933us) spinlock_profiling.cc:243] Waited 4.17 ms on lock 0x7b18001a69e0. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f212cf16ab1 00007f212cf23281 00007f212404e3f3 00007f21240507c1 00007f2124050779 00007f2124050709 00007f21240506d1 00007f212404f9cd 0000000000388634 0000000000388479 00007f212403183a
0709 12:11:32.857660 (+1188205us) spinlock_profiling.cc:243] Waited 2.48 ms on lock 0x7b18001a69e0. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f212cf16ab1 00007f212cf23281 00007f2123fc8c0a 00007f212d708219 00007f2124050a40 00007f212404b4e4 00007f212404b455 00007f212ab333c7 00007f21271459a7 00007f21271550bf 00007f2127155038
0709 12:11:32.857912 (+   252us) log.cc:844] Serialized 14 byte log entry
0709 12:11:33.357991 (+500079us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:33.358134 (+   143us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:33.358222 (+    88us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:33.358317 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:33.358460 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1781140,"prepare.queue_time_us":3425688,"prepare.run_cpu_time_us":112,"prepare.run_wall_time_us":115,"raft.queue_time_us":148976,"raft.run_cpu_time_us":370,"raft.run_wall_time_us":8740,"spinlock_wait_cycles":15289600,"thread_start_us":404663,"threads_started":1,"wal-append.queue_time_us":506785}
I20260709 12:11:33.675400 18637 consensus_queue.cc:1048] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:33.676620 14230 leader_election.cc:304] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:33.505542 18585 raft_consensus.cc:697] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 8 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:11:33.678375 18637 consensus_queue.cc:1048] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:33.681777 18785 consensus_queue.cc:1048] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:33.687767 18637 raft_consensus.cc:2749] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:33.690375 18576 leader_election.cc:290] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:33.691896 18779 consensus_queue.cc:1048] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 12:11:33.697954 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 81951.3us
I20260709 12:11:33.699445 18582 leader_election.cc:290] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:33.700496 18741 raft_consensus.cc:493] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:33.701323 18741 raft_consensus.cc:515] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:33.704135 18741 leader_election.cc:290] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:33.704754 18741 consensus_queue.cc:1059] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:11:33.706576 18817 raft_consensus.cc:3055] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:33.706970 18817 raft_consensus.cc:740] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:33.708599 18817 consensus_queue.cc:260] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:33.714711 14304 leader_election.cc:304] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:11:33.716598 18802 raft_consensus.cc:2804] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:33.717301 18802 raft_consensus.cc:697] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 12 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:33.718695 18737 raft_consensus.cc:493] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:33.719297 18802 consensus_queue.cc:237] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:33.719616 18737 raft_consensus.cc:515] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:11:33.722812 14305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:33.725375 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 49150.6us
I20260709 12:11:33.727931 14230 leader_election.cc:304] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:11:33.485924 18341 raft_consensus.cc:493] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:11:33.730207 18813 raft_consensus.cc:2804] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:33.730695 18813 raft_consensus.cc:493] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:33.730648 18341 raft_consensus.cc:3060] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:11:33.734088 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 65773.5us
I20260709 12:11:33.736322 14877 leader_election.cc:304] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:11:33.736708 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:33.737668 14259 raft_consensus.cc:2468] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 12.
I20260709 12:11:33.737794 18769 consensus_queue.cc:1048] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:33.607884 18507 leader_election.cc:290] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 13 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:33.741930 18813 raft_consensus.cc:3060] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:33.746440 14190 raft_consensus.cc:2410] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
W20260709 12:11:33.747800 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 85819.6us
I20260709 12:11:33.755983 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:33.759168 18789 raft_consensus.cc:493] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:33.760059 18789 raft_consensus.cc:515] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:33.765894 18807 consensus_queue.cc:1048] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:33.770422 18681 consensus_queue.cc:1048] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:11:33.772604 18681 raft_consensus.cc:2804] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:33.773064 18681 raft_consensus.cc:493] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:11:33.773463 18681 raft_consensus.cc:3060] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:11:33.777122 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 78057.9us
I20260709 12:11:33.769385 18816 consensus_queue.cc:1059] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.010s
I20260709 12:11:33.698022 18729 raft_consensus.cc:493] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:33.770498 18581 consensus_queue.cc:1059] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 12:11:33.800187 14084 catalog_manager.cc:5697] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:33.808854 18581 raft_consensus.cc:3055] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:33.809420 18581 raft_consensus.cc:740] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:11:33.811049 18581 consensus_queue.cc:260] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:33.812933 18581 raft_consensus.cc:3060] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:33.813387 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:33.814464 18507 raft_consensus.cc:3055] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:33.814929 18507 raft_consensus.cc:740] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:11:33.769409 18786 consensus_queue.cc:1059] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 12:11:33.788836 18807 raft_consensus.cc:493] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:33.816200 18781 raft_consensus.cc:493] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:33.812937 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:33.800222 14257 raft_consensus.cc:1275] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:11:33.729571 14230 leader_election.cc:304] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:33.798236 18787 raft_consensus.cc:493] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:33.783097 18582 consensus_queue.cc:1048] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 12:11:33.802048 18737 leader_election.cc:290] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:33.807927 18729 raft_consensus.cc:515] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:33.816277 18507 consensus_queue.cc:260] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:33.859952 18787 raft_consensus.cc:515] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:11:33.860664 14229 connection.cc:256] RPC call timeout handler was delayed by -1.2771379680000337s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1531s for a response
I20260709 12:11:33.861377 18637 raft_consensus.cc:493] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:33.864050 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:33.866029 18781 raft_consensus.cc:515] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:33.873317 14911 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53200 (request call id 619) took 1204 ms. Trace:
I20260709 12:11:33.876623 18729 leader_election.cc:290] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:11:33.878437 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 94183.1us
I20260709 12:11:33.881886 18807 raft_consensus.cc:515] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:33.894281 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:11:33.900321 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 170998us
W20260709 12:11:33.907220 14229 connection.cc:256] RPC call timeout handler was delayed by -1.2042379679999158s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1612s for a response
I20260709 12:11:33.829003 18585 consensus_queue.cc:237] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:11:33.911441 14229 connection.cc:256] RPC call timeout handler was delayed by -1.1880379679998896s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.163s for a response
W20260709 12:11:33.913236 14305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:33.893214 14911 rpcz_store.cc:276] 0709 12:11:32.668537 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:32.668832 (+   295us) service_pool.cc:224] Handling call
0709 12:11:32.677918 (+  9086us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:32.678208 (+   290us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:11:33.395685 (+717477us) log.cc:844] Serialized 14 byte log entry
0709 12:11:33.872601 (+476916us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:33.872705 (+   104us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:33.872839 (+   134us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:33.872932 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:33.873132 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":693423,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":1412,"raft.run_cpu_time_us":192,"raft.run_wall_time_us":193,"thread_start_us":1167030,"threads_started":2}
W20260709 12:11:33.903873 18611 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.768s	user 0.019s	sys 0.026s
W20260709 12:11:33.925217 14229 connection.cc:256] RPC call timeout handler was delayed by -1.1655379680000806s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1655s for a response
I20260709 12:11:33.907471 18789 leader_election.cc:290] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:11:33.931708 14229 connection.cc:256] RPC call timeout handler was delayed by -1.08964241700005s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1527s for a response
I20260709 12:11:33.894524 18637 raft_consensus.cc:515] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:33.894863 18582 consensus_queue.cc:1059] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.026s
W20260709 12:11:33.933425 14304 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:33.935657 14229 connection.cc:256] RPC call timeout handler was delayed by -1.0440379679998841s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17900000000000002s for a response
I20260709 12:11:33.939507 18828 raft_consensus.cc:2749] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:33.940429 18827 raft_consensus.cc:493] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:33.941162 18827 raft_consensus.cc:515] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:33.943989 18827 leader_election.cc:290] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:33.944617 18722 raft_consensus.cc:2749] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:33.946086 18778 consensus_queue.cc:1059] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.047s
I20260709 12:11:33.947798 18440 raft_consensus.cc:3060] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:33.948961 14230 leader_election.cc:304] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:11:33.950125 14230 leader_election.cc:304] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:33.950551 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:33.951434 14258 raft_consensus.cc:3060] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:33.951928 14230 leader_election.cc:304] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:33.953310 18817 raft_consensus.cc:3060] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:33.953863 14263 raft_consensus.cc:3060] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:33.959017 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:33.960003 14256 raft_consensus.cc:2468] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 10.
W20260709 12:11:33.960759 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:33.961035 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:33.961768 14256 raft_consensus.cc:2468] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 12.
I20260709 12:11:33.962740 14877 leader_election.cc:304] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:11:33.962786 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:33.965471 14256 raft_consensus.cc:2468] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 8.
I20260709 12:11:33.965895 18749 raft_consensus.cc:3055] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:33.966410 18749 raft_consensus.cc:740] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:11:33.966702 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:33.913071 18341 raft_consensus.cc:515] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:33.974411 18341 leader_election.cc:290] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 14 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:33.971372 14303 leader_election.cc:304] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:33.970371 14336 raft_consensus.cc:1240] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 12:11:33.960806 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:11:33.937553 18611 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.863s	user 0.019s	sys 0.027s
I20260709 12:11:33.939414 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:33.980031 14257 raft_consensus.cc:2468] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 12.
I20260709 12:11:33.945549 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:33.991792 18779 raft_consensus.cc:2804] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:34.001682 18600 raft_consensus.cc:2764] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:11:34.004410 18708 raft_consensus.cc:3055] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:33.974444 18837 raft_consensus.cc:2804] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:33.989632 18827 raft_consensus.cc:2749] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:34.009168 18779 raft_consensus.cc:493] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:34.032883 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 48149.4us
I20260709 12:11:34.040508 14258 raft_consensus.cc:2468] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 8.
I20260709 12:11:33.989398 18778 consensus_queue.cc:1048] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 6, Time since last communication: 0.037s
W20260709 12:11:34.047734 14304 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:34.013833 18837 raft_consensus.cc:493] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:34.050320 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:34.008750 18708 raft_consensus.cc:740] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:34.044107 18779 raft_consensus.cc:3060] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:34.069113 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 117311us
I20260709 12:11:34.070087 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:34.071389 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:34.072101 14258 raft_consensus.cc:2468] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 11.
I20260709 12:11:34.070540 14230 leader_election.cc:304] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:11:34.081959 18814 raft_consensus.cc:493] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:34.086562 18787 leader_election.cc:290] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:34.094359 18833 raft_consensus.cc:2764] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
W20260709 12:11:34.095767 18632 consensus_meta.cc:287] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db: Time spent flushing consensus metadata: real 0.599s	user 0.013s	sys 0.007s
I20260709 12:11:34.093479 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:34.096431 18632 raft_consensus.cc:2749] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:34.093900 14260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41764 (request call id 2782) took 1072 ms. Trace:
W20260709 12:11:34.077778 14330 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.009s	sys 0.010s
I20260709 12:11:34.097815 18808 raft_consensus.cc:2749] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:34.060616 18837 raft_consensus.cc:3060] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:34.115532 14257 raft_consensus.cc:1275] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 12:11:34.119445 14330 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.708s	user 0.009s	sys 0.011s
I20260709 12:11:34.125880 14263 raft_consensus.cc:2468] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 10.
W20260709 12:11:34.138207 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 125850us
I20260709 12:11:34.052007 18681 raft_consensus.cc:515] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:34.107777 14260 rpcz_store.cc:276] 0709 12:11:32.991482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:32.991654 (+   172us) service_pool.cc:224] Handling call
0709 12:11:33.007449 (+ 15795us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:33.008501 (+  1052us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:33.008535 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:33.009066 (+   531us) log.cc:844] Serialized 26 byte log entry
0709 12:11:33.933164 (+924098us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:33.981262 (+ 48098us) log.cc:844] Serialized 14 byte log entry
0709 12:11:33.987912 (+  6650us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:33.994787 (+  6875us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:33.995000 (+   213us) raft_consensus.cc:1685] finished
0709 12:11:33.995052 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:34.063706 (+ 68654us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":628,"raft.queue_time_us":436402,"raft.run_cpu_time_us":543,"raft.run_wall_time_us":53198,"thread_start_us":513038,"threads_started":2,"wal-append.queue_time_us":909045}
I20260709 12:11:34.082799 18814 raft_consensus.cc:515] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:34.161836 18814 leader_election.cc:290] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:34.162947 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 18 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:34.163993 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:34.164851 14259 raft_consensus.cc:2468] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 14.
I20260709 12:11:34.169471 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:34.170413 14906 raft_consensus.cc:2468] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 13.
I20260709 12:11:34.170686 14911 raft_consensus.cc:1275] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:11:34.171418 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:34.172370 14912 raft_consensus.cc:2393] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 11: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
I20260709 12:11:34.178077 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:34.179143 18782 raft_consensus.cc:493] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:34.179518 18653 consensus_meta.cc:287] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.633s	user 0.006s	sys 0.013s
I20260709 12:11:34.179880 18782 raft_consensus.cc:515] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:11:34.182114 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 246608us
W20260709 12:11:34.156292 18852 log.cc:927] Time spent T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 12:11:34.156064 18778 consensus_queue.cc:1059] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:34.157147 18724 raft_consensus.cc:493] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:11:34.158572 18781 leader_election.cc:290] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:34.158979 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:34.144977 14335 raft_consensus.cc:2468] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 14.
W20260709 12:11:34.187423 14305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:34.187695 14256 raft_consensus.cc:2410] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for term 15 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 12:11:34.178133 14258 raft_consensus.cc:3060] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:34.188841 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:34.205922 14263 raft_consensus.cc:2393] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 10: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:11:34.193892 14304 leader_election.cc:304] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
W20260709 12:11:34.196761 14877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:34.196635 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 190294us
I20260709 12:11:34.147733 18802 raft_consensus.cc:493] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:11:34.210367 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:34.218986 18724 raft_consensus.cc:515] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:34.219645 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:34.220666 14912 raft_consensus.cc:2410] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:11:34.221722 18722 raft_consensus.cc:3055] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:34.222203 18722 raft_consensus.cc:740] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:11:34.227056 18722 consensus_queue.cc:260] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:34.228615 18722 raft_consensus.cc:3060] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:34.235199 18637 leader_election.cc:290] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:34.237998 18802 raft_consensus.cc:515] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:34.238663 14259 raft_consensus.cc:2468] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 11.
I20260709 12:11:34.238842 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:34.239925 14260 raft_consensus.cc:2410] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 12:11:34.207142 18807 leader_election.cc:290] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:34.241689 14259 raft_consensus.cc:1240] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:34.243280 14334 raft_consensus.cc:3060] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:34.242889 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:11:34.249868 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 59386.2us
I20260709 12:11:34.249349 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:34.248260 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:34.262585 14304 leader_election.cc:304] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
W20260709 12:11:34.262806 14228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:34.262456 14338 raft_consensus.cc:2468] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 12.
I20260709 12:11:34.249543 18808 raft_consensus.cc:493] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:34.267549 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:34.266877 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:34.250099 18807 raft_consensus.cc:2804] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:34.219556 18782 leader_election.cc:290] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:34.277982 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:34.280246 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:11:34.351425 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 95812.6us
I20260709 12:11:34.354053 14333 raft_consensus.cc:2468] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 9.
I20260709 12:11:34.246196 18741 consensus_queue.cc:1048] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 12:11:34.358317 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:34.359174 14338 raft_consensus.cc:2468] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 11.
I20260709 12:11:34.178813 18708 consensus_queue.cc:260] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 13.5, Last appended by leader: 5, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:34.282562 18807 raft_consensus.cc:493] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:34.273398 18724 leader_election.cc:290] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:34.282128 18681 leader_election.cc:290] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 15 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:34.362064 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:34.362360 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:34.364017 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
W20260709 12:11:34.376513 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 76304.6us
W20260709 12:11:34.364617 18581 consensus_meta.cc:287] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db: Time spent flushing consensus metadata: real 0.551s	user 0.010s	sys 0.007s
I20260709 12:11:34.391248 18625 consensus_queue.cc:1059] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.108s
I20260709 12:11:34.392026 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:34.392503 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:34.393090 18625 raft_consensus.cc:3055] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:34.393707 14264 raft_consensus.cc:1240] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:34.394294 14260 raft_consensus.cc:1275] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:11:34.384893 14304 leader_election.cc:304] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:11:34.371958 18807 raft_consensus.cc:3060] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:34.393283 14333 raft_consensus.cc:2468] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 11.
I20260709 12:11:34.404373 14263 raft_consensus.cc:2468] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 8.
I20260709 12:11:34.393554 18625 raft_consensus.cc:740] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:11:34.409664 14258 raft_consensus.cc:2468] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 13.
I20260709 12:11:34.245707 18749 consensus_queue.cc:260] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:34.281314 18769 consensus_queue.cc:1048] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.114s
W20260709 12:11:34.412325 14154 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 55968.2us
I20260709 12:11:34.413321 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
W20260709 12:11:34.415228 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 49042.2us
I20260709 12:11:34.421049 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:34.422477 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:34.423959 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:34.424623 14264 raft_consensus.cc:2468] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 10.
W20260709 12:11:34.425129 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:34.408775 18781 raft_consensus.cc:2804] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:11:34.425910 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:34.411051 18813 consensus_meta.cc:287] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.668s	user 0.015s	sys 0.001s
I20260709 12:11:34.422369 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:11:34.411648 14155 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.174.130:36673 timed out after 1.549s (SENT) [suppressed 15 similar messages]
I20260709 12:11:34.425527 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:34.431146 14264 raft_consensus.cc:2468] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 12.
I20260709 12:11:34.370468 18808 raft_consensus.cc:515] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:11:34.433398 18858 log.cc:927] Time spent T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 12:11:34.433728 18782 raft_consensus.cc:493] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:11:34.434244 14332 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 795) took 1014 ms. Trace:
W20260709 12:11:34.438763 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 82924.7us
I20260709 12:11:34.425910 18781 raft_consensus.cc:493] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:34.442723 14263 raft_consensus.cc:1240] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:34.441252 14304 leader_election.cc:304] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
W20260709 12:11:34.444346 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 198432us
I20260709 12:11:34.437678 14876 leader_election.cc:304] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:34.446162 18741 raft_consensus.cc:2804] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:34.449810 14330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 796) took 1073 ms. Trace:
I20260709 12:11:34.451889 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:34.452454 14264 raft_consensus.cc:2468] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 11.
I20260709 12:11:34.453164 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:34.444679 18781 raft_consensus.cc:3060] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:34.454553 18859 log.cc:927] Time spent T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 12:11:34.455241 14303 leader_election.cc:304] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:34.444998 18802 leader_election.cc:290] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:34.455385 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:34.459211 14333 raft_consensus.cc:2468] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 11.
I20260709 12:11:34.461925 14259 raft_consensus.cc:2468] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 13.
I20260709 12:11:34.450670 18741 raft_consensus.cc:493] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:11:34.467691 14304 leader_election.cc:304] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:11:34.436710 18813 raft_consensus.cc:515] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:34.460999 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:34.465009 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:11:34.461670 18440 consensus_meta.cc:287] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.513s	user 0.012s	sys 0.003s
W20260709 12:11:34.472724 14230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:34.471989 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:34.474345 18862 raft_consensus.cc:2749] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:34.475427 14229 leader_election.cc:304] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:34.471973 14263 raft_consensus.cc:2468] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 14.
I20260709 12:11:34.440819 14332 rpcz_store.cc:276] 0709 12:11:33.373276 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:33.374621 (+  1345us) service_pool.cc:224] Handling call
0709 12:11:33.394627 (+ 20006us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:33.394889 (+   262us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:11:33.925762 (+530873us) log.cc:844] Serialized 14 byte log entry
0709 12:11:34.358428 (+432666us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:34.358726 (+   298us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:34.359177 (+   451us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:34.365140 (+  5963us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:34.388006 (+ 22866us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18289,"prepare.queue_time_us":551923,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":71,"raft.queue_time_us":9002,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":29048,"thread_start_us":785236,"threads_started":3,"wal-append.queue_time_us":377257}
I20260709 12:11:34.467381 18802 raft_consensus.cc:2804] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:34.469008 18741 raft_consensus.cc:3060] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:34.450809 14330 rpcz_store.cc:276] 0709 12:11:33.373621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:33.377716 (+  4095us) service_pool.cc:224] Handling call
0709 12:11:33.378141 (+   425us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:33.378397 (+   256us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:11:34.135121 (+756724us) log.cc:844] Serialized 14 byte log entry
0709 12:11:34.387456 (+252335us) log.cc:844] Serialized 14 byte log entry
0709 12:11:34.399619 (+ 12163us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:34.407838 (+  8219us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:11:34.432245 (+ 24407us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:34.439338 (+  7093us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:34.446549 (+  7211us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":64317,"prepare.queue_time_us":577919,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":130,"raft.queue_time_us":86177,"raft.run_cpu_time_us":202,"raft.run_wall_time_us":14723,"spinlock_wait_cycles":49767552,"thread_start_us":818275,"threads_started":2,"wal-append.queue_time_us":260063}
I20260709 12:11:34.450847 18782 raft_consensus.cc:515] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } }
I20260709 12:11:34.485594 14261 raft_consensus.cc:2393] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 13: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:11:34.472846 18749 raft_consensus.cc:3060] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:34.488134 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:34.489162 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:34.489336 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:34.489989 14187 raft_consensus.cc:3060] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:34.491509 18854 log.cc:927] Time spent T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
W20260709 12:11:34.486804 18817 consensus_meta.cc:287] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.518s	user 0.002s	sys 0.013s
W20260709 12:11:34.489372 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 73853.1us
I20260709 12:11:34.494096 14262 raft_consensus.cc:3060] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:34.492879 14337 raft_consensus.cc:2468] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 11.
W20260709 12:11:34.494719 14876 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:34.495723 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:34.482956 18828 raft_consensus.cc:2749] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:34.482574 18802 raft_consensus.cc:493] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:34.501462 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:11:34.501577 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 94514.4us
I20260709 12:11:34.471714 18779 raft_consensus.cc:515] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:34.502180 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:34.505722 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:34.506057 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:34.506870 14183 raft_consensus.cc:1275] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:34.509550 18782 leader_election.cc:290] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:34.514431 14263 raft_consensus.cc:2393] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 11: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:11:34.515235 14331 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 791) took 2074 ms. Trace:
I20260709 12:11:34.498878 18817 raft_consensus.cc:2804] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:34.518841 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:34.464589 18625 consensus_queue.cc:260] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:34.505600 18802 raft_consensus.cc:3060] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:34.515552 14331 rpcz_store.cc:276] 0709 12:11:32.441151 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:32.730671 (+289520us) service_pool.cc:224] Handling call
0709 12:11:32.731007 (+   336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:33.599426 (+868419us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:34.495314 (+895888us) spinlock_profiling.cc:243] Waited 867 ms on lock 0x7b540024fed4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:11:34.515171 (+ 19857us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1993931648}
I20260709 12:11:34.526827 14333 raft_consensus.cc:2393] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db in current term 8: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:11:34.523773 14259 raft_consensus.cc:2393] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 11: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
W20260709 12:11:34.525918 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 50726.1us
I20260709 12:11:34.529146 14185 raft_consensus.cc:1275] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:11:34.529385 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:34.530378 18865 raft_consensus.cc:2749] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:34.530872 14229 leader_election.cc:304] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:34.531255 14263 raft_consensus.cc:1240] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:11:34.532660 14229 leader_election.cc:304] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:34.534401 18637 raft_consensus.cc:2804] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:34.534902 18637 raft_consensus.cc:493] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:34.535292 18637 raft_consensus.cc:3060] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:34.537859 17848 raft_consensus.cc:493] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:34.538059 14335 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50856 (request call id 2233) took 2709 ms (client timeout 1600 ms). Trace:
W20260709 12:11:34.538511 14335 rpcz_store.cc:269] 0709 12:11:31.828857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:31.830588 (+  1731us) service_pool.cc:224] Handling call
0709 12:11:34.523484 (+2692896us) spinlock_profiling.cc:243] Waited 1.75 s on lock 0x7b54000b8954. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:11:34.537924 (+ 14440us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4027217280}
I20260709 12:11:34.538075 18828 raft_consensus.cc:2749] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:34.545928 14330 raft_consensus.cc:3060] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:34.551972 14229 leader_election.cc:304] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:34.553339 18828 raft_consensus.cc:2749] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:34.554394 18625 raft_consensus.cc:3060] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:34.556759 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:34.557938 14183 raft_consensus.cc:2410] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for term 15 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 12:11:34.538570 17848 raft_consensus.cc:515] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:34.561365 18507 raft_consensus.cc:3060] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:34.570434 14229 leader_election.cc:304] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:34.574517 18828 raft_consensus.cc:2804] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:34.575071 18828 raft_consensus.cc:493] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:34.575455 18828 raft_consensus.cc:3060] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:34.576071 14339 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55492 (request call id 797) took 1202 ms. Trace:
I20260709 12:11:34.576503 14339 rpcz_store.cc:276] 0709 12:11:33.373946 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:33.374068 (+   122us) service_pool.cc:224] Handling call
0709 12:11:34.575673 (+1201605us) spinlock_profiling.cc:243] Waited 4 ms on lock 0x7b54000b8e54. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:11:34.575867 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9194752}
I20260709 12:11:34.580684 14187 raft_consensus.cc:2468] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 12.
I20260709 12:11:34.584749 14258 raft_consensus.cc:1275] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:11:34.587387 14877 leader_election.cc:304] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:34.587666 18779 leader_election.cc:290] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 13 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:34.588929 18855 raft_consensus.cc:2804] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:34.589658 18855 raft_consensus.cc:697] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 13 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:11:34.590734 18855 consensus_queue.cc:237] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:34.593446 18817 raft_consensus.cc:697] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 8 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:34.594626 18817 consensus_queue.cc:237] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:11:34.598052 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 74339.3us
I20260709 12:11:34.600842 14155 leader_election.cc:304] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:34.572566 18808 leader_election.cc:290] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:34.613952 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:34.609431 14334 raft_consensus.cc:2468] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 14.
I20260709 12:11:34.621250 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:34.602082 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:34.623059 14262 raft_consensus.cc:2468] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 9.
W20260709 12:11:34.627511 14305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:34.635834 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 170674us
I20260709 12:11:34.640985 14258 raft_consensus.cc:1240] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:34.602005 18710 consensus_queue.cc:1059] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 12:11:34.624610 18769 raft_consensus.cc:2749] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:11:34.652232 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 81962.2us
I20260709 12:11:34.651125 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:34.654501 14187 raft_consensus.cc:1275] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:11:34.655321 14259 raft_consensus.cc:3060] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:34.658936 14258 raft_consensus.cc:1275] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:11:34.666080 14229 leader_election.cc:304] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:34.668092 18708 raft_consensus.cc:3060] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:34.668459 18812 raft_consensus.cc:2804] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:34.668954 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:34.676519 14155 leader_election.cc:304] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:34.649614 18807 raft_consensus.cc:515] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:34.668931 18812 raft_consensus.cc:493] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:34.691421 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:34.692726 14187 raft_consensus.cc:2393] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 10: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:11:34.656780 18637 raft_consensus.cc:515] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:34.700717 14155 leader_election.cc:304] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:34.702098 18769 consensus_queue.cc:1048] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:34.704036 18769 raft_consensus.cc:2804] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:34.704492 18769 raft_consensus.cc:493] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:34.704972 18769 raft_consensus.cc:3060] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:34.708977 14304 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:34.704299 18802 raft_consensus.cc:515] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:34.692122 18812 raft_consensus.cc:3060] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:34.722846 14260 raft_consensus.cc:2393] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 12: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:11:34.697198 18710 raft_consensus.cc:2804] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:34.726315 18710 raft_consensus.cc:697] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 10 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:11:34.727406 18710 consensus_queue.cc:237] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:34.730482 18802 leader_election.cc:290] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 13 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:34.730924 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:34.731678 14339 raft_consensus.cc:2376] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 14. Re-sending same reply.
I20260709 12:11:34.727317 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:34.689718 18781 raft_consensus.cc:515] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:34.733788 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:34.734017 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:34.734663 14187 raft_consensus.cc:3060] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:34.734973 18781 leader_election.cc:290] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 13 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:34.735386 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:34.736128 14331 raft_consensus.cc:2368] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 10. Current term is 11.
I20260709 12:11:34.730373 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:34.738835 14332 raft_consensus.cc:2410] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 12:11:34.739766 18637 leader_election.cc:290] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:34.740132 14332 raft_consensus.cc:1240] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 12:11:34.740542 18637 consensus_queue.cc:1048] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:34.732916 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:34.733819 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:11:34.745973 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 78230.3us
I20260709 12:11:34.734985 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 14 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:34.742401 14154 leader_election.cc:304] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:34.750700 14336 raft_consensus.cc:2393] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db in current term 13: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:11:34.750181 14332 raft_consensus.cc:1240] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 11. Current term is 12. Ops: [11.7-11.7]
W20260709 12:11:34.755694 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 55063.5us
I20260709 12:11:34.746699 14330 raft_consensus.cc:2468] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 15.
I20260709 12:11:34.756867 14339 raft_consensus.cc:2393] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 9: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:11:34.756963 14335 raft_consensus.cc:1240] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 12:11:34.762962 14877 leader_election.cc:304] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:11:34.765182 14906 raft_consensus.cc:1275] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:11:34.767340 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:34.766448 14155 leader_election.cc:304] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:34.770231 14229 leader_election.cc:304] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:34.795547 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:11:34.795877 14187 raft_consensus.cc:2468] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 10.
I20260709 12:11:34.802492 14155 leader_election.cc:304] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:34.804170 14155 leader_election.cc:304] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:34.811784 18881 raft_consensus.cc:2804] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:34.812414 18881 raft_consensus.cc:493] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:34.812863 18881 raft_consensus.cc:3060] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:34.817932 18749 raft_consensus.cc:2804] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:34.818477 18749 raft_consensus.cc:493] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:34.818850 18749 raft_consensus.cc:3060] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:11:34.795288 18837 consensus_meta.cc:287] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.608s	user 0.012s	sys 0.003s
I20260709 12:11:34.825803 14906 raft_consensus.cc:2468] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 10.
I20260709 12:11:34.808022 18785 raft_consensus.cc:2804] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:34.844432 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:11:34.849896 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:34.852290 14228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:34.854313 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:34.864527 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:34.865310 14264 raft_consensus.cc:2468] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 11.
I20260709 12:11:34.934329 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:34.936414 14263 raft_consensus.cc:1240] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 12:11:34.941874 18507 raft_consensus.cc:493] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:34.942802 18507 raft_consensus.cc:515] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:34.943820 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:34.945235 18507 leader_election.cc:290] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:11:34.953891 18870 log.cc:927] Time spent T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.254s	user 0.001s	sys 0.000s
I20260709 12:11:34.962414 18879 raft_consensus.cc:2804] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:34.963038 18879 raft_consensus.cc:493] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:34.963397 18879 raft_consensus.cc:3060] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:34.846136 18807 leader_election.cc:290] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 11 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:11:34.993126 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:34.836022 18837 raft_consensus.cc:515] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:34.987901 18808 raft_consensus.cc:493] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:34.924472 18785 raft_consensus.cc:697] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 15 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:11:35.012512 14258 raft_consensus.cc:1240] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 11. Current term is 12. Ops: [11.7-11.7]
W20260709 12:11:35.011996 18741 consensus_meta.cc:287] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.511s	user 0.012s	sys 0.000s
I20260709 12:11:34.998768 18769 raft_consensus.cc:515] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:35.020538 18741 raft_consensus.cc:515] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:35.021304 18785 consensus_queue.cc:237] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:35.022627 18769 leader_election.cc:290] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 13 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:35.023178 18741 leader_election.cc:290] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 9 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:11:35.020525 14230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:35.020769 18808 raft_consensus.cc:515] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:35.026486 18808 leader_election.cc:290] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:34.995404 18828 raft_consensus.cc:515] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:35.031162 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:35.032490 18828 leader_election.cc:290] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:35.032696 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:35.033414 14333 raft_consensus.cc:2376] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 14. Re-sending same reply.
I20260709 12:11:35.033862 18886 raft_consensus.cc:2804] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:35.034505 18886 raft_consensus.cc:493] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:35.035000 18886 raft_consensus.cc:3060] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:35.023869 18837 leader_election.cc:290] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:35.038462 18812 raft_consensus.cc:515] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:35.041306 18812 leader_election.cc:290] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 11 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:35.032708 14230 leader_election.cc:304] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:35.044246 14230 leader_election.cc:400] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 pre-election: Vote denied by peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957) with higher term. Message: Invalid argument: T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 10. Current term is 11.
I20260709 12:11:35.045090 14230 leader_election.cc:403] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:35.038282 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:35.046283 14330 raft_consensus.cc:2393] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 13: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:11:35.048534 14259 raft_consensus.cc:2468] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 13.
W20260709 12:11:35.046499 14154 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 304164us
I20260709 12:11:35.023379 18769 raft_consensus.cc:2804] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:35.062151 18769 raft_consensus.cc:493] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:35.062674 18769 raft_consensus.cc:3060] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:35.067412 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:35.067586 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:35.067999 18749 raft_consensus.cc:515] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:35.068547 14183 raft_consensus.cc:3060] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:35.068648 14187 raft_consensus.cc:2468] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 13.
I20260709 12:11:35.044770 18837 raft_consensus.cc:2749] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:11:35.070947 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 311042us
I20260709 12:11:35.075769 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
W20260709 12:11:35.080276 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 276323us
I20260709 12:11:35.083328 14155 leader_election.cc:304] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:35.082809 14187 raft_consensus.cc:2393] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 13: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
W20260709 12:11:35.161199 14305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:35.075093 18710 raft_consensus.cc:493] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:35.078851 18812 raft_consensus.cc:3060] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:35.177302 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:11:35.161419 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 117388us
I20260709 12:11:35.191195 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:35.200709 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:11:35.201689 14906 raft_consensus.cc:3060] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:11:35.222620 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 139375us
I20260709 12:11:35.223701 14155 leader_election.cc:304] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:35.231264 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:35.232411 14184 raft_consensus.cc:2410] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for term 15 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 12:11:35.234601 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:11:35.236553 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:35.237586 14910 raft_consensus.cc:2393] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 13: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
I20260709 12:11:35.239113 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:35.239573 14906 raft_consensus.cc:2468] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 8.
I20260709 12:11:35.240000 14909 raft_consensus.cc:2468] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 11.
I20260709 12:11:35.242331 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:35.243338 14903 raft_consensus.cc:2393] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 14: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
I20260709 12:11:35.244519 18892 raft_consensus.cc:493] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:11:35.245288 18892 raft_consensus.cc:515] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:35.247927 18892 leader_election.cc:290] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:35.250494 14911 raft_consensus.cc:2468] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 8.
W20260709 12:11:35.253952 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 90795.9us
I20260709 12:11:35.271436 18749 leader_election.cc:290] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 14 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:11:35.186157 18708 consensus_meta.cc:287] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.511s	user 0.011s	sys 0.001s
I20260709 12:11:35.181664 18888 consensus_queue.cc:1048] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.116s
I20260709 12:11:35.283181 18881 raft_consensus.cc:515] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:35.233560 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:35.325673 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:35.329113 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:11:35.333974 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:35.333945 14184 raft_consensus.cc:2393] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 13: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:11:35.335480 14181 raft_consensus.cc:2468] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 13.
I20260709 12:11:35.335733 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:35.336787 14188 raft_consensus.cc:2410] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
W20260709 12:11:35.339862 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 156265us
I20260709 12:11:35.326275 18892 raft_consensus.cc:2804] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:35.224730 18710 raft_consensus.cc:515] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:35.352675 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:35.362149 18710 leader_election.cc:290] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:11:35.363103 18891 log.cc:927] Time spent T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.277s	user 0.000s	sys 0.001s
I20260709 12:11:35.328603 18749 raft_consensus.cc:2804] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:35.359114 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:35.377321 14181 raft_consensus.cc:2468] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 11.
I20260709 12:11:35.320679 18837 consensus_queue.cc:1048] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 12:11:35.379912 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:35.384068 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:11:35.384925 14904 raft_consensus.cc:3060] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:35.394954 18893 raft_consensus.cc:493] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:35.395718 18893 raft_consensus.cc:515] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:35.376091 18828 raft_consensus.cc:493] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:35.398255 18828 raft_consensus.cc:515] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:35.398811 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 18 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:35.401284 18893 leader_election.cc:290] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:11:35.406096 14304 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:35.409369 14187 raft_consensus.cc:1275] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
W20260709 12:11:35.412307 18865 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.701s	user 0.021s	sys 0.009s
W20260709 12:11:35.414812 18865 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.704s	user 0.022s	sys 0.009s
I20260709 12:11:35.416196 18885 consensus_queue.cc:1059] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:35.417234 18890 raft_consensus.cc:493] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:35.418278 14263 raft_consensus.cc:1240] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:35.338573 18886 raft_consensus.cc:515] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:35.296744 14183 raft_consensus.cc:2468] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 8.
I20260709 12:11:35.376859 18749 raft_consensus.cc:493] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:35.409972 14187 pending_rounds.cc:85] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf: Aborting all ops after (but not including) 6
I20260709 12:11:35.354238 18892 raft_consensus.cc:493] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:11:35.417902 18890 raft_consensus.cc:515] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:35.433645 14257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41764 (request call id 2798) took 1560 ms. Trace:
W20260709 12:11:35.435627 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 47934.4us
I20260709 12:11:35.434351 14257 rpcz_store.cc:276] 0709 12:11:33.872840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:34.002030 (+129190us) service_pool.cc:224] Handling call
0709 12:11:34.002450 (+   420us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:34.122063 (+119613us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:35.433363 (+1311300us) spinlock_profiling.cc:243] Waited 97.9 ms on lock 0x7b54002210d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:11:35.433574 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":225124736}
I20260709 12:11:35.439749 14256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41764 (request call id 2797) took 1559 ms. Trace:
I20260709 12:11:35.391503 18881 leader_election.cc:290] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 14 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:35.432857 18749 raft_consensus.cc:3060] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:35.443315 18886 leader_election.cc:290] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 11 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:35.440378 14256 rpcz_store.cc:276] 0709 12:11:33.872543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:33.966373 (+ 93830us) service_pool.cc:224] Handling call
0709 12:11:35.430784 (+1464411us) spinlock_profiling.cc:243] Waited 214 ms on lock 0x7b5400212354. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:11:35.432156 (+  1372us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":493276032}
W20260709 12:11:35.439726 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 216135us
I20260709 12:11:35.448122 14155 leader_election.cc:304] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:35.436220 14187 pending_rounds.cc:107] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 12:11:35.451671 14187 raft_consensus.cc:2889] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:35.451617 14229 leader_election.cc:304] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:35.445885 14184 raft_consensus.cc:2468] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 11.
I20260709 12:11:35.435029 18892 raft_consensus.cc:3060] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:35.439214 18902 raft_consensus.cc:3055] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:35.460575 18901 raft_consensus.cc:2804] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:35.461169 18893 raft_consensus.cc:2749] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:35.463215 18890 leader_election.cc:290] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:35.464469 18440 raft_consensus.cc:3055] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:35.466107 18681 raft_consensus.cc:493] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:35.382017 18769 raft_consensus.cc:515] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:35.487610 14911 raft_consensus.cc:1275] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:11:35.475917 18902 raft_consensus.cc:740] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
W20260709 12:11:35.502381 14155 connection.cc:256] RPC call timeout handler was delayed by -1.5635745429999588s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2968s for a response
W20260709 12:11:35.504206 14155 connection.cc:256] RPC call timeout handler was delayed by -1.4946937319998597s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2867s for a response
W20260709 12:11:35.484856 18879 consensus_meta.cc:287] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.520s	user 0.007s	sys 0.007s
I20260709 12:11:35.490142 18900 consensus_queue.cc:1048] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 12:11:35.510577 18902 consensus_queue.cc:260] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:35.514200 17848 leader_election.cc:290] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:35.518898 18507 raft_consensus.cc:493] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:35.520555 14330 raft_consensus.cc:1275] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 12:11:35.524298 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 16 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:35.526152 18828 leader_election.cc:290] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:35.528973 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:35.484560 18440 raft_consensus.cc:740] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:11:35.545120 18879 raft_consensus.cc:515] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:35.499971 18901 raft_consensus.cc:697] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 14 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:11:35.505445 18681 raft_consensus.cc:515] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:35.667847 18681 leader_election.cc:290] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:11:35.616881 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 179139us
W20260709 12:11:35.648144 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:35.652787 14904 raft_consensus.cc:2468] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 14.
I20260709 12:11:35.662734 18902 raft_consensus.cc:3060] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:35.663568 14333 raft_consensus.cc:2410] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db for term 16 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 12:11:35.664103 18879 leader_election.cc:290] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 11 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:11:35.678220 14155 leader_election.cc:336] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Timed out: RequestConsensusVote RPC to 127.12.174.130:36673 timed out after 1.836s (SENT)
W20260709 12:11:35.686518 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 240465us
W20260709 12:11:35.686637 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 156184us
I20260709 12:11:35.704749 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 14 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:35.706933 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:35.710163 14229 leader_election.cc:304] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:35.707780 14331 raft_consensus.cc:2468] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 14.
I20260709 12:11:35.659050 18507 raft_consensus.cc:515] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:35.665308 18901 consensus_queue.cc:237] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:35.716013 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:35.718663 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:35.726614 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
W20260709 12:11:35.730082 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 71841.7us
I20260709 12:11:35.719617 18878 raft_consensus.cc:2804] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:35.731666 18769 leader_election.cc:290] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:35.732052 18878 raft_consensus.cc:493] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:35.732474 18878 raft_consensus.cc:3060] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:35.735213 18869 log.cc:927] Time spent T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 1.210s	user 0.025s	sys 0.007s
W20260709 12:11:35.737823 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 46746.8us
I20260709 12:11:35.740365 14230 leader_election.cc:304] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
W20260709 12:11:35.741461 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 50167.8us
W20260709 12:11:35.748637 14156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:35.752337 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:35.753207 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 18 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:35.753925 14187 raft_consensus.cc:2468] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 17.
I20260709 12:11:35.754925 14084 catalog_manager.cc:5697] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 5 to 10, leader changed from 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130) to 73d01e9b1a9d49358da4985b21d681db (127.12.174.132). New cstate: current_term: 10 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:35.752377 18888 raft_consensus.cc:493] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:35.758297 18653 raft_consensus.cc:2804] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:35.758713 18653 raft_consensus.cc:493] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:35.759063 18653 raft_consensus.cc:3060] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:35.762118 18769 raft_consensus.cc:493] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:35.762809 18769 raft_consensus.cc:515] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:35.763132 18888 raft_consensus.cc:515] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:35.765170 18888 leader_election.cc:290] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:35.765425 18769 leader_election.cc:290] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:35.761484 14189 raft_consensus.cc:1275] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 12:11:35.753283 14183 raft_consensus.cc:2393] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db in current term 8: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:11:35.733526 18440 consensus_queue.cc:260] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:35.741833 18828 raft_consensus.cc:493] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:35.757092 14084 catalog_manager.cc:5697] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:11:35.776665 14088 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60420 (request call id 255) took 38564 ms (client timeout 15000 ms). Trace:
W20260709 12:11:35.779560 14334 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55492 (request call id 803) took 1786 ms (client timeout 1744 ms). Trace:
I20260709 12:11:35.780855 14339 raft_consensus.cc:1240] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:35.781665 18749 raft_consensus.cc:515] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:35.785667 14229 leader_election.cc:304] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:35.791395 14332 raft_consensus.cc:2468] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 14.
W20260709 12:11:35.787848 14334 rpcz_store.cc:269] 0709 12:11:34.011406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:34.021602 (+ 10196us) service_pool.cc:224] Handling call
0709 12:11:35.779314 (+1757712us) spinlock_profiling.cc:243] Waited 64.3 ms on lock 0x7b540023c154. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:11:35.779460 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":147954048}
I20260709 12:11:35.793123 18507 leader_election.cc:290] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:35.817979 14230 leader_election.cc:304] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
W20260709 12:11:35.819057 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 48958.1us
W20260709 12:11:35.787403 14088 rpcz_store.cc:269] 0709 12:10:57.217640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:57.220157 (+  2517us) service_pool.cc:224] Handling call
0709 12:11:35.776351 (+38556194us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:11:19.378855 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:11:19.559022 (+180167us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:11:19.559067 (+    45us) write_op.cc:435] Acquired schema lock
0709 12:11:19.559087 (+    20us) tablet.cc:662] Decoding operations
0709 12:11:19.560138 (+  1051us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:11:19.560227 (+    89us) write_op.cc:641] Partition lock acquired for write op
0709 12:11:19.560258 (+    31us) tablet.cc:685] Acquiring locks for 9 operations
0709 12:11:19.560984 (+   726us) tablet.cc:701] Row locks acquired
0709 12:11:19.561004 (+    20us) write_op.cc:260] PREPARE: finished
0709 12:11:19.561219 (+   215us) write_op.cc:270] Start()
0709 12:11:19.561352 (+   133us) write_op.cc:276] Timestamp: P: 1783599079561128 usec, L: 0
0709 12:11:19.561373 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:11:19.731582 (+170209us) log.cc:844] Serialized 3717 byte log entry
0709 12:11:20.595066 (+863484us) op_driver.cc:464] REPLICATION: finished
0709 12:11:21.273393 (+678327us) write_op.cc:301] APPLY: starting
0709 12:11:21.281439 (+  8046us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:21.704284 (+422845us) spinlock_profiling.cc:243] Waited 47.1 ms on lock 0x7b54002e3454. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f2127136e28 00007f212ab71581 00007f212ab70d58 00007f212ab759f1 00007f212ab759a9 00007f212ab75939 00007f212ab75901 00007f212ab74b2d 0000000000388634 0000000000388479
0709 12:11:22.865694 (+1161410us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:22.868331 (+  2637us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:23.576375 (+708044us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:23.670974 (+ 94599us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=18,key_file_lookups=18,delta_file_lookups=18,mrs_lookups=0
0709 12:11:23.674734 (+  3760us) write_op.cc:312] APPLY: finished
0709 12:11:23.856941 (+182207us) log.cc:844] Serialized 89 byte log entry
0709 12:11:24.116939 (+259998us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:24.224195 (+107256us) write_op.cc:454] Released schema lock
0709 12:11:24.232454 (+  8259us) write_op.cc:341] FINISH: Updating metrics
0709 12:11:24.292416 (+ 59962us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:24.292450 (+    34us) write_op.cc:454] Released schema lock
0709 12:11:24.326221 (+ 33771us) spinlock_profiling.cc:243] Waited 1.51 ms on lock 0x7b4400022b4c. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2123f74c85 00007f2123f756a2 00007f2126ce71db 00007f2126ce2aaf 00007f2126cd686e 00007f2126cd5bb6 00007f2126cd57d8 00007f2126cdf221 00007f2126cdf1d9 00007f2126cdf169
Metrics: {"mutex_wait_us":277850,"reported_tablets":49,"spinlock_wait_cycles":7936,"child_traces":[["op",{"apply.queue_time_us":653505,"apply.run_cpu_time_us":47976,"apply.run_wall_time_us":3025125,"cfile_cache_hit":34,"cfile_cache_hit_bytes":35598,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6221,"cfile_init":2,"lbm_read_time_us":292298,"lbm_reads_10-100_ms":4,"lbm_reads_gt_100_ms":1,"lbm_reads_lt_1ms":7,"num_ops":9,"prepare.queue_time_us":337628,"prepare.run_cpu_time_us":21085,"prepare.run_wall_time_us":2340925,"raft.queue_time_us":208729,"raft.run_cpu_time_us":32902,"raft.run_wall_time_us":545137,"replication_time_us":1019965,"spinlock_wait_cycles":111821952,"thread_start_us":1237493,"threads_started":5,"wal-append.queue_time_us":803922,"wal-append.run_cpu_time_us":67810,"wal-append.run_wall_time_us":2460754}]]}
W20260709 12:11:35.829943 14304 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:35.842375 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 70503.8us
I20260709 12:11:35.843493 14304 leader_election.cc:304] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:11:35.833884 18906 raft_consensus.cc:2764] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:11:35.822553 18884 raft_consensus.cc:2804] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:35.794760 18828 raft_consensus.cc:515] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:35.858116 14229 leader_election.cc:304] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:35.858623 18828 leader_election.cc:290] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:11:35.854395 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 112023us
I20260709 12:11:35.837422 18892 raft_consensus.cc:515] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:11:35.872629 14156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:35.847388 18440 raft_consensus.cc:3060] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:35.793212 14084 catalog_manager.cc:5697] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 6 to 9. New cstate: current_term: 9 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:35.887945 14084 catalog_manager.cc:5697] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:35.894601 14084 catalog_manager.cc:5697] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:35.896783 14336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55492 (request call id 808) took 1297 ms. Trace:
I20260709 12:11:35.897276 14336 rpcz_store.cc:276] 0709 12:11:34.599907 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:34.615997 (+ 16090us) service_pool.cc:224] Handling call
0709 12:11:35.896530 (+1280533us) spinlock_profiling.cc:243] Waited 120 ms on lock 0x7b54000b8e54. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:11:35.896706 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":275615616}
I20260709 12:11:35.902027 14263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53050 (request call id 830) took 1391 ms. Trace:
I20260709 12:11:35.897202 14084 catalog_manager.cc:5697] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:35.904655 14084 catalog_manager.cc:5697] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 9 to 11, leader changed from 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) to 65c9c1653b3346b39a0e118540e6080c (127.12.174.131). New cstate: current_term: 11 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
W20260709 12:11:35.908938 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 50959.4us
I20260709 12:11:35.907178 14263 rpcz_store.cc:276] 0709 12:11:34.510813 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:34.937378 (+426565us) service_pool.cc:224] Handling call
0709 12:11:35.418052 (+480674us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:35.420126 (+  2074us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:35.901763 (+481637us) spinlock_profiling.cc:243] Waited 480 ms on lock 0x7b54002215d0. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713a8ad 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:11:35.901938 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1104606976}
I20260709 12:11:35.920953 18637 raft_consensus.cc:493] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:35.921917 18637 raft_consensus.cc:515] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:35.923870 18653 raft_consensus.cc:515] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:35.879994 18884 raft_consensus.cc:697] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 14 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
W20260709 12:11:35.925407 14228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:35.930692 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 18 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:35.927042 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:35.927666 18865 raft_consensus.cc:493] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:35.977948 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 59463.6us
I20260709 12:11:35.978551 14264 raft_consensus.cc:1275] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:11:35.978996 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:35.924561 18637 leader_election.cc:290] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:35.942508 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:35.973658 14256 raft_consensus.cc:1275] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:11:35.984184 14332 raft_consensus.cc:2468] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 9.
I20260709 12:11:35.912292 18832 raft_consensus.cc:2749] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:35.974484 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:35.975142 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:35.912879 18813 leader_election.cc:290] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 13 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:35.976482 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:35.988404 14260 raft_consensus.cc:2393] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 13: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
I20260709 12:11:35.979621 14265 raft_consensus.cc:3060] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:35.978575 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 16 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:35.973697 14336 raft_consensus.cc:1240] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 12:11:35.988318 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:35.985602 14330 raft_consensus.cc:2393] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 13: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:11:35.976121 14337 raft_consensus.cc:1240] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:35.927594 18722 raft_consensus.cc:493] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
W20260709 12:11:35.997452 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 116228us
I20260709 12:11:35.998934 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:36.000658 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:36.001353 14262 raft_consensus.cc:3060] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:35.982822 18923 raft_consensus.cc:493] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:36.006769 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:36.021282 14229 leader_election.cc:304] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:36.023834 14263 raft_consensus.cc:2468] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 15.
I20260709 12:11:36.024441 14258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41768 (request call id 1913) took 1556 ms. Trace:
I20260709 12:11:35.928251 14084 catalog_manager.cc:5697] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 6 to 9. New cstate: current_term: 9 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:36.024864 14258 rpcz_store.cc:276] 0709 12:11:34.467572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:34.676276 (+208704us) service_pool.cc:224] Handling call
0709 12:11:34.691776 (+ 15500us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:35.013060 (+321284us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:36.024156 (+1011096us) spinlock_profiling.cc:243] Waited 320 ms on lock 0x7b5400221fd4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:11:36.024372 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":736930176}
I20260709 12:11:36.047981 14334 raft_consensus.cc:2468] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 11.
I20260709 12:11:35.993084 18865 raft_consensus.cc:515] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:36.050915 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:36.053620 14332 raft_consensus.cc:2468] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 13.
I20260709 12:11:36.055131 14336 raft_consensus.cc:1275] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:11:36.058641 18892 leader_election.cc:290] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:36.060707 18749 leader_election.cc:290] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 11 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:35.999689 18878 raft_consensus.cc:515] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:11:36.066061 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:36.067230 14256 raft_consensus.cc:1240] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 11. Current term is 12. Ops: []
W20260709 12:11:36.042477 18812 consensus_meta.cc:287] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.813s	user 0.014s	sys 0.000s
I20260709 12:11:36.030834 18637 raft_consensus.cc:2804] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:36.004070 18722 raft_consensus.cc:515] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:36.056816 18884 consensus_queue.cc:237] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 13.5, Last appended by leader: 5, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:36.049609 14877 leader_election.cc:304] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:11:36.078927 14877 leader_election.cc:304] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:11:36.079309 18722 leader_election.cc:290] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:11:36.068424 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 45323.6us
I20260709 12:11:36.080220 14257 raft_consensus.cc:1240] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:36.083501 14262 raft_consensus.cc:2468] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 9.
I20260709 12:11:36.078784 14084 catalog_manager.cc:5697] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 4 to 7. New cstate: current_term: 7 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:36.085116 18915 consensus_queue.cc:1059] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:11:36.086549 18915 consensus_queue.cc:1048] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:36.086301 14084 catalog_manager.cc:5697] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:36.087857 18915 raft_consensus.cc:2804] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:36.088225 18915 raft_consensus.cc:493] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:36.088462 18915 raft_consensus.cc:3060] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:36.088536 14084 catalog_manager.cc:5697] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 9 to 11, leader changed from 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130) to 73d01e9b1a9d49358da4985b21d681db (127.12.174.132). New cstate: current_term: 11 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:36.090970 18878 leader_election.cc:290] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 11 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:36.093195 18865 leader_election.cc:290] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:11:36.101578 14155 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:36.102213 14155 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:36.102777 14155 connection.cc:256] RPC call timeout handler was delayed by -1.1162196000000222s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15180000000000002s for a response
W20260709 12:11:36.103145 14155 connection.cc:256] RPC call timeout handler was delayed by -1.0440728799999306s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3247s for a response
I20260709 12:11:36.065683 18907 raft_consensus.cc:493] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:36.015985 18923 raft_consensus.cc:515] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:36.109861 18637 raft_consensus.cc:697] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 15 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:11:36.114372 18637 consensus_queue.cc:237] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:36.074549 18812 raft_consensus.cc:2749] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957) with higher term. Message: Invalid argument: T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 10. Current term is 11.
I20260709 12:11:36.083396 18862 raft_consensus.cc:2804] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:36.126441 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:36.128752 14334 raft_consensus.cc:2468] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 8.
I20260709 12:11:36.131359 14335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50856 (request call id 2245) took 1403 ms. Trace:
I20260709 12:11:36.131852 14335 rpcz_store.cc:276] 0709 12:11:34.727795 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:34.733899 (+  6104us) service_pool.cc:224] Handling call
0709 12:11:34.756708 (+ 22809us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:34.757493 (+   785us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:36.131109 (+1373616us) spinlock_profiling.cc:243] Waited 22.4 ms on lock 0x7b540029f750. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713a8ad 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:11:36.131281 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":51630848}
I20260709 12:11:36.108182 18582 raft_consensus.cc:493] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:36.111315 18918 raft_consensus.cc:3055] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:36.144549 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:36.138005 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:36.146643 14335 raft_consensus.cc:3060] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:36.139596 14336 raft_consensus.cc:1275] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:11:36.126230 18440 raft_consensus.cc:493] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:36.154338 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:36.163331 18440 raft_consensus.cc:515] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:36.165212 14876 leader_election.cc:304] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:36.165949 18785 raft_consensus.cc:493] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:36.139950 18862 raft_consensus.cc:697] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 13 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:11:36.111769 18907 raft_consensus.cc:515] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:36.169636 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:36.171627 18923 leader_election.cc:290] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:36.173614 14184 raft_consensus.cc:1275] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:11:36.145107 18918 raft_consensus.cc:740] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:11:36.174754 18653 leader_election.cc:290] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:36.147575 18582 raft_consensus.cc:515] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:36.178254 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:36.178272 14229 leader_election.cc:304] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
W20260709 12:11:36.187614 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 108770us
I20260709 12:11:36.205070 14264 raft_consensus.cc:2468] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 11.
I20260709 12:11:36.218391 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:36.202472 18440 leader_election.cc:290] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:36.202812 18722 raft_consensus.cc:2804] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:11:36.222496 18722 raft_consensus.cc:493] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:36.222918 18722 raft_consensus.cc:3060] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:11:36.226164 18918 consensus_queue.cc:260] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:36.227713 18918 raft_consensus.cc:3060] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:36.227950 14181 raft_consensus.cc:2468] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 13.
I20260709 12:11:36.202191 18785 raft_consensus.cc:515] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:36.228825 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:36.227713 18582 leader_election.cc:290] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:36.230419 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:36.231194 14334 raft_consensus.cc:2376] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 14. Re-sending same reply.
I20260709 12:11:36.189805 14876 leader_election.cc:304] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:36.194695 14265 raft_consensus.cc:2468] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 13.
W20260709 12:11:36.235262 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 45602.6us
I20260709 12:11:36.221539 14229 leader_election.cc:304] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:36.196317 14185 raft_consensus.cc:2468] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 10.
I20260709 12:11:36.243338 14335 raft_consensus.cc:2468] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 12.
I20260709 12:11:36.206561 18923 raft_consensus.cc:2749] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:11:36.258993 14156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:36.261632 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:36.263818 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
W20260709 12:11:36.266620 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:36.281389 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 59958.4us
I20260709 12:11:36.248704 18912 raft_consensus.cc:2749] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:36.268126 18653 raft_consensus.cc:2749] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:36.318107 14229 leader_election.cc:304] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:36.323009 18907 leader_election.cc:290] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:36.297341 18930 consensus_queue.cc:1048] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.053s
I20260709 12:11:36.326329 18785 leader_election.cc:290] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:36.331766 14334 raft_consensus.cc:2468] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 11.
I20260709 12:11:36.335364 18828 raft_consensus.cc:493] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:36.351171 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 82025.6us
I20260709 12:11:36.355545 14876 leader_election.cc:304] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:11:36.359402 14154 leader_election.cc:304] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:36.352748 14229 leader_election.cc:304] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:36.361131 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:36.363557 18653 raft_consensus.cc:2749] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:36.315780 18862 consensus_queue.cc:237] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:11:36.412247 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 568765us
I20260709 12:11:36.357062 18828 raft_consensus.cc:515] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:36.416694 18708 consensus_queue.cc:1048] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:36.418126 18828 leader_election.cc:290] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:36.376541 18911 raft_consensus.cc:2804] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:36.420250 18911 raft_consensus.cc:493] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:36.420658 18911 raft_consensus.cc:3060] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:36.416741 18868 consensus_queue.cc:1048] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 12:11:36.355682 18915 raft_consensus.cc:515] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:36.418339 18724 consensus_queue.cc:1059] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 12:11:36.422943 18868 raft_consensus.cc:3055] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:36.423312 18868 raft_consensus.cc:740] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:36.383488 18722 raft_consensus.cc:515] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:36.383948 14339 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50856 (request call id 2254) took 1529 ms. Trace:
I20260709 12:11:36.425800 14339 rpcz_store.cc:276] 0709 12:11:34.854762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:34.854897 (+   135us) service_pool.cc:224] Handling call
0709 12:11:35.780640 (+925743us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:35.788511 (+  7871us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:36.383721 (+595210us) spinlock_profiling.cc:243] Waited 857 ms on lock 0x7b540023c150. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713a8ad 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:11:36.383876 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1970533760}
I20260709 12:11:36.424386 18868 consensus_queue.cc:260] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:36.378854 18938 consensus_queue.cc:1048] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.009s
I20260709 12:11:36.387737 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:36.428182 14337 raft_consensus.cc:3060] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Advancing to term 11
W20260709 12:11:36.389864 18909 log.cc:927] Time spent T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.901s	user 0.007s	sys 0.000s
I20260709 12:11:36.379447 18884 raft_consensus.cc:2749] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:36.370628 18440 raft_consensus.cc:2804] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:36.416121 18741 raft_consensus.cc:2804] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:36.419821 18781 raft_consensus.cc:493] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:36.379678 14229 leader_election.cc:304] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
W20260709 12:11:36.434119 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 45244.3us
I20260709 12:11:36.436612 14155 leader_election.cc:304] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:36.440629 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:36.441335 14184 raft_consensus.cc:3060] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:11:36.446820 14156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:36.447795 14876 leader_election.cc:304] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:36.419750 18708 raft_consensus.cc:493] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:11:36.458428 18708 raft_consensus.cc:515] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:36.463105 18708 leader_election.cc:290] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:36.429787 18808 raft_consensus.cc:493] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:36.416126 18930 consensus_queue.cc:1048] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 12:11:36.457158 18722 leader_election.cc:290] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 18 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:36.444409 18741 raft_consensus.cc:493] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:36.423658 18915 leader_election.cc:290] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 16 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:36.459213 18940 raft_consensus.cc:2804] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:36.460601 18637 raft_consensus.cc:2749] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:11:36.460819 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 81261.4us
I20260709 12:11:36.451649 18781 raft_consensus.cc:515] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:11:36.454222 18931 log.cc:927] Time spent T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.117s	user 0.003s	sys 0.000s
I20260709 12:11:36.482056 18741 raft_consensus.cc:3060] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:36.491173 14337 raft_consensus.cc:2468] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 11.
W20260709 12:11:36.483688 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 68144.9us
I20260709 12:11:36.494696 14304 leader_election.cc:304] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
W20260709 12:11:36.483430 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 46951us
I20260709 12:11:36.497177 14155 leader_election.cc:304] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:36.480762 14184 raft_consensus.cc:2468] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 18.
I20260709 12:11:36.504117 14876 leader_election.cc:304] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
W20260709 12:11:36.506786 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:36.507117 14304 leader_election.cc:304] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:11:36.490394 18781 leader_election.cc:290] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:36.508776 18868 raft_consensus.cc:3060] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:36.504194 18892 raft_consensus.cc:2749] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:11:36.480851 18808 raft_consensus.cc:515] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:36.482806 18940 raft_consensus.cc:493] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:36.520780 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:36.520607 18808 leader_election.cc:290] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:36.511008 18708 raft_consensus.cc:2804] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:36.521028 18940 raft_consensus.cc:3060] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:36.506579 18749 raft_consensus.cc:2804] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:36.519740 18862 raft_consensus.cc:2804] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:11:36.510937 18817 raft_consensus.cc:2804] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:36.540740 14304 leader_election.cc:304] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:11:36.540841 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 14 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:36.544200 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
W20260709 12:11:36.541476 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 183390us
I20260709 12:11:36.545231 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:36.541812 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:36.542318 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:36.477666 18911 raft_consensus.cc:515] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:36.553373 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:36.552430 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:36.553800 14186 raft_consensus.cc:1240] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:11:36.555326 14190 raft_consensus.cc:2393] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 13: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:11:36.523197 18708 raft_consensus.cc:697] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 9 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:36.539515 18749 raft_consensus.cc:493] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:36.557828 14304 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:36.562479 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:36.554488 14188 raft_consensus.cc:2393] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 13: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:11:36.555354 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:36.570312 14256 raft_consensus.cc:1240] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:36.572829 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:36.575145 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:36.575740 14334 raft_consensus.cc:3060] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:36.577410 14263 raft_consensus.cc:1275] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:11:36.579984 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:36.582211 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:36.583688 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:36.584517 14262 raft_consensus.cc:2393] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 11: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:11:36.585536 18708 consensus_queue.cc:237] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:36.588011 14303 leader_election.cc:304] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:11:36.589107 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:36.589799 18914 consensus_queue.cc:1048] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.015s
I20260709 12:11:36.590194 18741 raft_consensus.cc:515] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:36.592310 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:36.569167 18749 raft_consensus.cc:3060] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:36.595000 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 14 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:36.595933 14186 raft_consensus.cc:2393] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 14: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:11:36.596791 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:36.597383 14186 raft_consensus.cc:2468] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 15.
I20260709 12:11:36.598214 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:36.578030 14877 leader_election.cc:304] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:11:36.599097 14259 raft_consensus.cc:2393] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 10: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:11:36.571246 14184 raft_consensus.cc:2468] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 14.
I20260709 12:11:36.580021 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:36.600816 14260 raft_consensus.cc:2393] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 13: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:11:36.592167 18892 consensus_queue.cc:1059] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:36.601203 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:36.590126 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:36.585422 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:36.601372 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:36.605918 14262 raft_consensus.cc:2376] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 9. Re-sending same reply.
I20260709 12:11:36.607402 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:36.608189 14187 raft_consensus.cc:1240] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:36.608628 14184 raft_consensus.cc:3060] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:36.608291 14186 raft_consensus.cc:2468] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 10.
I20260709 12:11:36.610054 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:36.610632 14186 raft_consensus.cc:3060] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:11:36.603896 14229 leader_election.cc:304] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:36.605312 14337 raft_consensus.cc:2468] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 10.
I20260709 12:11:36.613070 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:36.615455 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:36.616298 14339 raft_consensus.cc:2393] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 13: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:11:36.562569 18862 raft_consensus.cc:697] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 18 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:11:36.562613 18945 raft_consensus.cc:2804] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:36.625767 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:36.630714 14183 raft_consensus.cc:3060] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:36.559041 18817 raft_consensus.cc:697] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 13 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:36.625810 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:36.626873 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:36.626004 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:36.633044 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:36.633236 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:36.639783 14188 raft_consensus.cc:3060] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:36.635354 14877 leader_election.cc:304] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:36.544011 18808 consensus_queue.cc:1059] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.061s
I20260709 12:11:36.636387 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 16 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:36.640784 14338 raft_consensus.cc:3060] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:36.639887 14335 raft_consensus.cc:2468] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 10.
I20260709 12:11:36.624626 14334 raft_consensus.cc:2468] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 15.
I20260709 12:11:36.643982 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:36.610862 18440 raft_consensus.cc:697] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 14 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:11:36.654054 14256 raft_consensus.cc:2393] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 11: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:11:36.656375 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:36.656976 14184 raft_consensus.cc:2468] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 11.
I20260709 12:11:36.657156 14187 raft_consensus.cc:2468] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 11.
I20260709 12:11:36.659375 14229 leader_election.cc:304] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
W20260709 12:11:36.659837 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 71903.5us
I20260709 12:11:36.666371 18637 raft_consensus.cc:2749] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:36.673153 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:36.674045 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:36.674789 14260 raft_consensus.cc:2393] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 11: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:11:36.673928 14190 raft_consensus.cc:2468] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 11.
I20260709 12:11:36.629617 18865 raft_consensus.cc:2804] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:36.680699 14303 leader_election.cc:304] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:36.682403 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:36.683923 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:36.684854 14256 raft_consensus.cc:2410] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 12:11:36.655570 18942 raft_consensus.cc:2804] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:36.643146 18915 raft_consensus.cc:493] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:36.617331 18582 consensus_queue.cc:1059] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.062s
I20260709 12:11:36.655606 18914 raft_consensus.cc:2749] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:36.697431 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:36.625778 18786 consensus_queue.cc:1048] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.051s
I20260709 12:11:36.702697 14183 raft_consensus.cc:2468] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 11.
I20260709 12:11:36.630993 18724 consensus_queue.cc:1048] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 12:11:36.696771 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:36.700264 14334 raft_consensus.cc:2468] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 11.
I20260709 12:11:36.710038 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:36.710741 14264 raft_consensus.cc:2468] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 12.
I20260709 12:11:36.713798 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:36.714175 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
W20260709 12:11:36.713831 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 65920.6us
I20260709 12:11:36.715350 14229 leader_election.cc:304] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:36.711686 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:36.716814 14264 raft_consensus.cc:2393] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 13: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:11:36.717258 14256 raft_consensus.cc:3060] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:36.720803 14303 leader_election.cc:304] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:36.722745 14229 leader_election.cc:304] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:36.724907 14182 raft_consensus.cc:1240] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:36.726442 14182 raft_consensus.cc:1240] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:36.727793 14182 raft_consensus.cc:1275] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 12:11:36.730037 18837 raft_consensus.cc:2804] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:36.730372 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:36.730589 18837 raft_consensus.cc:493] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:36.662400 18813 consensus_queue.cc:1059] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.039s
I20260709 12:11:36.732556 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:36.740664 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:36.733404 14229 leader_election.cc:304] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:36.686851 18945 raft_consensus.cc:697] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 11 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:36.735827 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:36.685986 18781 consensus_queue.cc:1048] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 12:11:36.668239 18812 consensus_queue.cc:1059] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 12:11:36.702713 18832 raft_consensus.cc:2804] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:36.741359 14263 raft_consensus.cc:2468] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 8.
I20260709 12:11:36.754606 18884 raft_consensus.cc:2749] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:36.759311 18832 raft_consensus.cc:493] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:36.763036 18832 raft_consensus.cc:3060] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:36.758890 14904 raft_consensus.cc:1240] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 15 LEADER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:36.747713 14229 leader_election.cc:304] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:36.751142 14188 raft_consensus.cc:2468] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 12.
I20260709 12:11:36.706140 18865 raft_consensus.cc:697] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 12 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:36.703387 18925 raft_consensus.cc:3060] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:36.718418 18942 raft_consensus.cc:697] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 14 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:11:36.738327 18637 raft_consensus.cc:2749] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:36.747036 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:36.781322 14264 raft_consensus.cc:2468] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 9.
I20260709 12:11:36.758566 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:36.782008 14263 raft_consensus.cc:3060] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:36.758659 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:36.758787 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:36.743219 18837 raft_consensus.cc:3060] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:36.784662 18942 consensus_queue.cc:237] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:36.730113 18881 consensus_queue.cc:1059] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 12:11:36.786556 18881 raft_consensus.cc:3055] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:36.786890 18881 raft_consensus.cc:740] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:11:36.787662 18881 consensus_queue.cc:260] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } }
I20260709 12:11:36.788830 14911 raft_consensus.cc:2468] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 12.
I20260709 12:11:36.757438 14877 leader_election.cc:304] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:36.790781 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:36.791018 18722 raft_consensus.cc:2804] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:36.791422 14903 raft_consensus.cc:2468] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 8.
I20260709 12:11:36.791425 18722 raft_consensus.cc:493] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:11:36.791971 18911 leader_election.cc:290] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 12 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:11:36.792197 18950 log.cc:927] Time spent T 00000000000000000000000000000000 P d07070be2c074f4cb9ad35f1580c4ef7: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:11:36.780194 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:36.793339 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:36.793999 14262 raft_consensus.cc:2468] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 12.
I20260709 12:11:36.794878 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:36.795938 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:36.796437 14262 raft_consensus.cc:3060] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:36.796087 18749 raft_consensus.cc:515] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:36.797353 14181 raft_consensus.cc:2368] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 9. Current term is 10.
I20260709 12:11:36.744010 18862 consensus_queue.cc:237] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:36.793663 14258 raft_consensus.cc:2410] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:11:36.799441 14258 raft_consensus.cc:3055] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:36.799795 14258 raft_consensus.cc:740] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:11:36.800524 14258 consensus_queue.cc:260] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:36.792006 18722 raft_consensus.cc:3060] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:36.769080 14229 leader_election.cc:304] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:36.767505 14334 raft_consensus.cc:1275] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 12:11:36.798523 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
W20260709 12:11:36.762897 18944 log.cc:927] Time spent T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.133s	user 0.001s	sys 0.000s
I20260709 12:11:36.772516 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:36.760690 14303 leader_election.cc:304] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:36.775869 18884 raft_consensus.cc:2804] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:36.815297 14911 raft_consensus.cc:1240] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 10. Current term is 12. Ops: []
W20260709 12:11:36.816099 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 69190.7us
I20260709 12:11:36.778460 18865 consensus_queue.cc:237] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:36.749414 18817 consensus_queue.cc:237] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:36.703995 18915 raft_consensus.cc:515] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:36.804401 14229 leader_election.cc:304] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:36.822507 14229 leader_election.cc:304] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:36.813570 14338 raft_consensus.cc:2410] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db for term 16 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 12:11:36.756083 18789 raft_consensus.cc:2804] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:36.707561 18440 consensus_queue.cc:237] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:36.817020 14186 raft_consensus.cc:2468] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 15.
I20260709 12:11:36.816913 14258 raft_consensus.cc:3060] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:36.816871 14303 leader_election.cc:304] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:36.788846 18881 raft_consensus.cc:3060] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:36.815450 18637 raft_consensus.cc:2804] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:36.867161 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 16 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:36.815346 18884 raft_consensus.cc:493] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:36.815672 18948 raft_consensus.cc:3055] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 10 LEADER]: Stepping down as leader of term 10
W20260709 12:11:36.887424 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 70644.1us
I20260709 12:11:36.889067 14262 raft_consensus.cc:2468] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 11.
I20260709 12:11:36.821609 18802 raft_consensus.cc:2804] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:36.908187 14877 leader_election.cc:304] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
W20260709 12:11:36.931108 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:36.886770 14908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:36.863962 18812 raft_consensus.cc:2804] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:36.848572 18885 raft_consensus.cc:2804] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:11:36.945328 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 94243.8us
I20260709 12:11:36.947393 14909 raft_consensus.cc:1240] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 14 LEADER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:36.848143 18911 raft_consensus.cc:493] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:36.874665 18741 leader_election.cc:290] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 12 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:11:36.955613 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 47540us
W20260709 12:11:36.909456 14228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:36.956866 14338 raft_consensus.cc:1275] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 13 index: 5. Preceding OpId from leader: term: 14 index: 6. (index mismatch)
I20260709 12:11:36.827790 18832 raft_consensus.cc:515] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:36.958714 14263 raft_consensus.cc:2468] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 12.
I20260709 12:11:36.887238 18708 raft_consensus.cc:2749] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:36.912860 18948 raft_consensus.cc:740] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:11:36.962366 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:36.913658 18884 raft_consensus.cc:3060] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:36.967600 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 459795us
I20260709 12:11:36.883908 18789 raft_consensus.cc:697] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 10 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:36.961347 14258 raft_consensus.cc:1275] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:11:36.949158 18885 raft_consensus.cc:493] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:36.978359 14155 leader_election.cc:304] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:36.948745 18802 raft_consensus.cc:493] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:36.991321 14303 leader_election.cc:304] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:36.965426 18938 raft_consensus.cc:2749] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:11:36.969759 18961 raft_consensus.cc:3055] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:37.002015 18961 raft_consensus.cc:740] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:11:37.002882 18961 consensus_queue.cc:260] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:37.013769 18708 raft_consensus.cc:2749] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:37.014259 18749 leader_election.cc:290] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:36.998808 18837 raft_consensus.cc:515] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:37.016790 18837 leader_election.cc:290] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:11:37.000174 18953 log.cc:927] Time spent T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 12:11:37.006032 18963 raft_consensus.cc:2804] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:36.966351 18911 raft_consensus.cc:515] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:37.019160 14908 raft_consensus.cc:2468] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 10.
I20260709 12:11:37.017477 18837 consensus_queue.cc:1059] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 12:11:37.020871 18911 leader_election.cc:290] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:37.005956 18802 raft_consensus.cc:3060] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:37.024819 18722 raft_consensus.cc:515] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:36.991454 14338 raft_consensus.cc:1240] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 15. Current term is 16. Ops: []
I20260709 12:11:36.995333 14155 leader_election.cc:304] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:37.028730 18722 leader_election.cc:290] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 11 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:11:37.033762 18949 log.cc:927] Time spent T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.231s	user 0.001s	sys 0.000s
W20260709 12:11:37.035372 18951 log.cc:927] Time spent T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.279s	user 0.000s	sys 0.001s
W20260709 12:11:37.049077 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 53829.3us
W20260709 12:11:37.060894 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 54537.8us
W20260709 12:11:37.061563 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:36.992004 18885 raft_consensus.cc:3060] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:37.070022 14256 raft_consensus.cc:2468] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 14.
W20260709 12:11:37.091387 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 112358us
I20260709 12:11:37.092453 14303 leader_election.cc:304] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:11:36.991611 18741 consensus_queue.cc:1059] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.074s
I20260709 12:11:37.053716 18963 raft_consensus.cc:697] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 11 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:11:36.949816 18945 consensus_queue.cc:237] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:37.065827 18961 raft_consensus.cc:3060] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:37.093513 18960 raft_consensus.cc:2804] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:37.122973 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:37.124505 14258 raft_consensus.cc:3060] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:37.049973 18907 consensus_queue.cc:1059] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 11.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 12:11:37.096242 18892 consensus_queue.cc:1048] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
W20260709 12:11:37.135597 14154 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 404864us
I20260709 12:11:37.096724 18724 consensus_queue.cc:1048] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
W20260709 12:11:37.145076 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 196916us
I20260709 12:11:37.140471 18637 raft_consensus.cc:697] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 11 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:11:37.123831 18960 raft_consensus.cc:493] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:37.146075 18708 raft_consensus.cc:2804] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:37.181433 14258 raft_consensus.cc:2468] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 12.
I20260709 12:11:37.176798 18812 raft_consensus.cc:697] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 11 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
W20260709 12:11:37.187413 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 206938us
I20260709 12:11:37.165885 18960 raft_consensus.cc:3060] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:37.174121 18708 raft_consensus.cc:493] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:11:37.164986 18915 leader_election.cc:290] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:11:37.182240 18940 consensus_meta.cc:287] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db: Time spent flushing consensus metadata: real 0.642s	user 0.012s	sys 0.000s
W20260709 12:11:37.195988 18962 log.cc:927] Time spent T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
I20260709 12:11:37.206993 14877 leader_election.cc:304] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:37.130812 18948 consensus_queue.cc:260] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:11:37.210706 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 160799us
I20260709 12:11:37.196630 18708 raft_consensus.cc:3060] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:37.151820 18789 consensus_queue.cc:237] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:37.215947 14155 leader_election.cc:304] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
W20260709 12:11:37.208972 14154 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 66952.8us
I20260709 12:11:37.205996 18967 raft_consensus.cc:3055] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:37.204128 18970 raft_consensus.cc:3055] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:37.233018 14155 leader_election.cc:304] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:37.209908 18911 raft_consensus.cc:2749] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:37.245512 18862 consensus_queue.cc:1048] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.017s
I20260709 12:11:37.241211 14230 leader_election.cc:304] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
W20260709 12:11:37.254762 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 162359us
I20260709 12:11:37.266866 14911 raft_consensus.cc:1240] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:37.267457 14303 leader_election.cc:304] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:37.269802 14303 leader_election.cc:304] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:11:37.271111 14303 leader_election.cc:304] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
W20260709 12:11:37.245311 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 159348us
I20260709 12:11:37.202857 18940 raft_consensus.cc:515] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:11:37.265192 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 118022us
I20260709 12:11:37.308898 18865 raft_consensus.cc:2804] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:11:37.309500 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 68563us
I20260709 12:11:37.313324 18961 raft_consensus.cc:2804] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:37.351711 14230 leader_election.cc:304] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:37.197273 18963 consensus_queue.cc:237] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:37.245242 18970 raft_consensus.cc:740] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
W20260709 12:11:37.336555 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 103585us
W20260709 12:11:37.338169 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 67143.1us
I20260709 12:11:37.339516 14304 leader_election.cc:304] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:11:37.269454 18948 raft_consensus.cc:3060] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:37.341183 14258 raft_consensus.cc:1240] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 15. Current term is 16. Ops: []
I20260709 12:11:37.269141 18741 raft_consensus.cc:2749] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:37.247599 18637 consensus_queue.cc:237] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:37.346812 14229 leader_election.cc:304] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:37.346163 18817 raft_consensus.cc:2804] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:37.277434 18440 raft_consensus.cc:2804] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:37.383327 14155 leader_election.cc:304] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:37.238207 18978 raft_consensus.cc:493] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:37.237665 18967 raft_consensus.cc:740] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:11:37.388069 14912 raft_consensus.cc:2393] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 14: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
I20260709 12:11:37.350379 18907 raft_consensus.cc:2804] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:37.238628 18812 consensus_queue.cc:237] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:37.351286 18865 raft_consensus.cc:493] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:11:37.404735 18986 raft_consensus.cc:2804] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:37.405109 18972 consensus_queue.cc:1048] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.193s
W20260709 12:11:37.407995 18881 consensus_meta.cc:287] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.530s	user 0.009s	sys 0.001s
I20260709 12:11:37.399992 18817 raft_consensus.cc:697] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 8 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
W20260709 12:11:37.420938 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 47707.8us
I20260709 12:11:37.432165 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:37.389070 18961 raft_consensus.cc:697] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 11 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:11:37.432732 18884 raft_consensus.cc:515] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:37.433337 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:37.434006 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:37.442874 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:37.443343 14336 raft_consensus.cc:3060] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:37.434333 14337 raft_consensus.cc:1275] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:11:37.443725 14184 raft_consensus.cc:2393] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 11: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:11:37.402622 18907 raft_consensus.cc:493] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:37.443358 14334 raft_consensus.cc:2468] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 13.
I20260709 12:11:37.427145 18865 raft_consensus.cc:3060] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:37.402614 18440 raft_consensus.cc:697] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 12 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:11:37.448880 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
W20260709 12:11:37.450322 14155 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:37.451189 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:37.452334 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
W20260709 12:11:37.460513 14155 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:37.461006 14155 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:37.462045 14228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:37.462941 14188 raft_consensus.cc:1240] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:37.462764 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:37.463534 14187 raft_consensus.cc:2468] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 14.
I20260709 12:11:37.464167 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:37.464359 18974 raft_consensus.cc:2749] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:37.464612 14187 raft_consensus.cc:1240] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:37.465719 18979 consensus_queue.cc:1059] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.083s
I20260709 12:11:37.466120 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
W20260709 12:11:37.466641 18973 log.cc:927] Time spent T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.086s	user 0.002s	sys 0.000s
I20260709 12:11:37.467010 14189 raft_consensus.cc:2393] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 13: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:11:37.465597 18813 raft_consensus.cc:3055] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:37.469610 18813 raft_consensus.cc:740] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:11:37.469758 18440 consensus_queue.cc:237] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:37.470702 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:37.471830 18961 consensus_queue.cc:237] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:37.425702 18741 consensus_queue.cc:1048] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 12:11:37.400919 18978 raft_consensus.cc:515] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:37.473513 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
W20260709 12:11:37.470902 18975 log.cc:927] Time spent T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.151s	user 0.000s	sys 0.001s
I20260709 12:11:37.470631 18813 consensus_queue.cc:260] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:37.452332 18907 raft_consensus.cc:3060] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:37.478305 18817 consensus_queue.cc:237] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:37.479091 18749 raft_consensus.cc:493] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:37.479733 18749 raft_consensus.cc:515] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:37.477612 18813 raft_consensus.cc:3060] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:37.481349 18960 raft_consensus.cc:515] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:37.484659 18960 leader_election.cc:290] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 9 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:37.498925 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:37.501194 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:37.501441 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
W20260709 12:11:37.495929 18982 log.cc:927] Time spent T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 12:11:37.505893 18786 raft_consensus.cc:493] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:37.506139 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:37.506974 14903 raft_consensus.cc:2393] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 16: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
I20260709 12:11:37.509475 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:37.513047 14186 raft_consensus.cc:2468] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 9.
I20260709 12:11:37.444653 18986 raft_consensus.cc:697] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 11 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:11:37.517544 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
W20260709 12:11:37.514650 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 127130us
W20260709 12:11:37.517910 18966 log.cc:927] Time spent T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.416s	user 0.000s	sys 0.007s
I20260709 12:11:37.511265 18960 raft_consensus.cc:493] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:37.514969 18892 raft_consensus.cc:3055] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 10 LEADER]: Stepping down as leader of term 10
W20260709 12:11:37.518976 18980 log.cc:927] Time spent T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:11:37.519328 18989 raft_consensus.cc:2804] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:37.521833 14229 leader_election.cc:304] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:37.524343 14187 raft_consensus.cc:1240] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 17. Current term is 18. Ops: [14.10-17.11]
I20260709 12:11:37.517692 18987 raft_consensus.cc:2804] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:37.531862 18960 raft_consensus.cc:515] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:37.527318 18892 raft_consensus.cc:740] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
W20260709 12:11:37.539505 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 200070us
W20260709 12:11:37.541541 14303 connection.cc:256] RPC call timeout handler was delayed by -1.5034813039999335s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1625s for a response
W20260709 12:11:37.542027 14303 connection.cc:256] RPC call timeout handler was delayed by -1.4440813040000648s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16910000000000003s for a response
W20260709 12:11:37.542328 14303 connection.cc:256] RPC call timeout handler was delayed by -1.2955813040000521s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18560000000000001s for a response
W20260709 12:11:37.542605 14303 connection.cc:256] RPC call timeout handler was delayed by -1.1722813040000801s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19930000000000003s for a response
W20260709 12:11:37.542912 14303 connection.cc:256] RPC call timeout handler was delayed by -1.1461813040000379s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2022s for a response
W20260709 12:11:37.543176 14303 connection.cc:256] RPC call timeout handler was delayed by -1.1299813040000117s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20400000000000001s for a response
W20260709 12:11:37.553834 18976 log.cc:927] Time spent T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.181s	user 0.003s	sys 0.000s
I20260709 12:11:37.554972 18987 raft_consensus.cc:697] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 12 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:11:37.506517 18786 raft_consensus.cc:515] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:37.569682 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:37.571034 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:37.565204 14336 raft_consensus.cc:2468] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 10.
W20260709 12:11:37.567332 14229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:37.523594 18978 leader_election.cc:290] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:37.573473 14303 leader_election.cc:304] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:37.575956 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:37.576267 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:37.577040 14263 raft_consensus.cc:2376] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 11. Re-sending same reply.
W20260709 12:11:37.585973 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 197217us
I20260709 12:11:37.586367 14187 raft_consensus.cc:1275] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 11 index: 4. Preceding OpId from leader: term: 14 index: 6. (index mismatch)
I20260709 12:11:37.529642 18885 raft_consensus.cc:515] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:37.444890 18970 consensus_queue.cc:260] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:37.549971 18808 raft_consensus.cc:493] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:37.592787 14156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:37.593675 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:37.594399 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:11:37.599567 14156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:37.548821 18989 raft_consensus.cc:697] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 12 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:37.598646 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:37.605669 14259 raft_consensus.cc:2376] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 14. Re-sending same reply.
W20260709 12:11:37.606889 14154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:37.596346 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:37.603330 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:37.604206 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:37.608425 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:37.609012 14263 raft_consensus.cc:2393] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 13: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:11:37.608470 14265 raft_consensus.cc:2376] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 9. Re-sending same reply.
I20260709 12:11:37.609097 14186 raft_consensus.cc:2468] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 10.
I20260709 12:11:37.610795 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:37.615485 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:37.615819 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:37.639686 14265 raft_consensus.cc:2368] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 15. Current term is 16.
I20260709 12:11:37.613674 14229 leader_election.cc:304] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:37.637076 14330 raft_consensus.cc:1240] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 11 LEADER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 12:11:37.611438 14261 raft_consensus.cc:2376] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 12. Re-sending same reply.
I20260709 12:11:37.496702 18967 consensus_queue.cc:260] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:37.638224 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:37.671058 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:37.672971 14257 raft_consensus.cc:3060] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Advancing to term 10
W20260709 12:11:37.610297 18828 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 15 current term: 15 is higher.
W20260709 12:11:37.686718 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 46775.2us
W20260709 12:11:37.687608 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 74026us
I20260709 12:11:37.688496 14229 leader_election.cc:304] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:37.670859 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:37.680428 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
W20260709 12:11:37.693153 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 119763us
I20260709 12:11:37.700768 14186 raft_consensus.cc:1275] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:11:37.670874 18995 raft_consensus.cc:2749] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:37.639533 18940 leader_election.cc:290] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 14 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:37.533574 18986 consensus_queue.cc:237] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:37.603982 14337 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064"
dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
mode: GRACEFUL
new_leader_uuid: "885067a0d31741bfb5c9935788e315bf"
 from {username='slave'} at 127.0.0.1:50896
I20260709 12:11:37.605423 18892 consensus_queue.cc:260] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:37.726790 18993 raft_consensus.cc:2804] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader election won for term 15
W20260709 12:11:37.736200 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:37.737083 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:37.741849 14186 raft_consensus.cc:3060] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:11:37.740852 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 143899us
I20260709 12:11:37.681183 18808 raft_consensus.cc:515] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:37.733753 14337 raft_consensus.cc:606] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 12 LEADER]: Received request to transfer leadership to TS 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:37.711226 18828 raft_consensus.cc:2749] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:37.749455 14190 raft_consensus.cc:1240] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 8. Current term is 9. Ops: []
W20260709 12:11:37.747390 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 148309us
I20260709 12:11:37.753293 19000 raft_consensus.cc:2749] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:37.750839 18993 raft_consensus.cc:697] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 15 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:11:37.772899 18993 consensus_queue.cc:237] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:37.777944 18961 consensus_queue.cc:1048] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:11:37.780099 18925 consensus_meta.cc:287] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 1.001s	user 0.014s	sys 0.000s
I20260709 12:11:37.780596 18925 raft_consensus.cc:2749] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:37.781656 18808 leader_election.cc:290] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:37.758562 18885 leader_election.cc:290] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:37.759393 18786 leader_election.cc:290] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:11:37.744752 18802 consensus_meta.cc:287] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.723s	user 0.010s	sys 0.002s
I20260709 12:11:37.762475 18960 leader_election.cc:290] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:37.746452 18749 leader_election.cc:290] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:37.740057 18884 leader_election.cc:290] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:37.771168 14303 leader_election.cc:304] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:37.784384 14257 raft_consensus.cc:2468] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 10.
I20260709 12:11:37.785459 14155 leader_election.cc:304] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
W20260709 12:11:37.788715 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 43937.8us
I20260709 12:11:37.794600 18813 consensus_queue.cc:1048] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:37.796073 14262 raft_consensus.cc:1275] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 12:11:37.800253 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 48261.4us
I20260709 12:11:37.796689 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:37.797344 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:37.684610 18987 consensus_queue.cc:237] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:37.819490 14261 raft_consensus.cc:2468] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 13.
I20260709 12:11:37.782943 18802 raft_consensus.cc:515] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:11:37.846621 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 75566.4us
I20260709 12:11:37.689985 18989 consensus_queue.cc:237] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:37.848469 14303 leader_election.cc:304] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
W20260709 12:11:37.832648 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 47202.2us
I20260709 12:11:37.851500 14186 raft_consensus.cc:2468] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 14.
I20260709 12:11:37.853089 14876 leader_election.cc:304] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:37.857683 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:37.858896 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:37.862432 14332 raft_consensus.cc:3060] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:37.820727 18915 consensus_queue.cc:1059] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 12:11:37.848248 18828 consensus_queue.cc:1059] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 12:11:37.868221 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:37.856577 18749 consensus_queue.cc:1059] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 12:11:37.869849 18749 raft_consensus.cc:3055] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:37.870255 18749 raft_consensus.cc:740] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:11:37.871109 18749 consensus_queue.cc:260] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:37.872313 18749 raft_consensus.cc:3060] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:37.855273 18808 raft_consensus.cc:2804] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:37.874505 18808 raft_consensus.cc:493] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:37.874408 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:37.823500 18884 consensus_queue.cc:1048] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 12:11:37.858408 18925 raft_consensus.cc:2749] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:11:37.829509 18998 log.cc:927] Time spent T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.137s	user 0.000s	sys 0.001s
I20260709 12:11:37.877250 14334 raft_consensus.cc:1240] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:37.877882 14303 leader_election.cc:304] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:37.878575 18942 raft_consensus.cc:2804] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:37.878752 19013 raft_consensus.cc:2749] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:37.880496 14303 leader_election.cc:304] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:37.781458 18983 consensus_queue.cc:1048] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.071s
I20260709 12:11:37.882849 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:37.835058 18868 raft_consensus.cc:3055] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:37.829716 18960 raft_consensus.cc:3060] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:37.865842 14155 leader_election.cc:304] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:37.832965 18832 leader_election.cc:290] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:37.875087 18808 raft_consensus.cc:3060] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:37.890030 14303 leader_election.cc:304] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:37.828464 18997 consensus_queue.cc:1059] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.095s
I20260709 12:11:37.910463 14332 raft_consensus.cc:2468] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 12.
W20260709 12:11:37.896597 18708 consensus_meta.cc:287] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.646s	user 0.013s	sys 0.000s
I20260709 12:11:37.889233 19013 raft_consensus.cc:2749] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:37.922418 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:37.897099 18868 raft_consensus.cc:740] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:37.923151 14912 raft_consensus.cc:2468] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 13.
I20260709 12:11:37.898114 18828 consensus_queue.cc:1243] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer 65c9c1653b3346b39a0e118540e6080c log is divergent from this leader: its last log entry 14.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:11:37.930608 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 15 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:37.917506 18925 raft_consensus.cc:2749] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:37.933456 14186 raft_consensus.cc:2468] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 14.
I20260709 12:11:37.920984 18961 raft_consensus.cc:2749] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:11:37.938143 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 86491.3us
W20260709 12:11:37.939079 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:37.939638 14155 leader_election.cc:304] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:37.944337 14155 leader_election.cc:304] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:37.920601 18708 raft_consensus.cc:515] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:11:37.953713 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 265307us
I20260709 12:11:37.957031 14229 leader_election.cc:304] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:37.963685 14229 leader_election.cc:304] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:37.966144 14229 leader_election.cc:304] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:37.976508 18942 raft_consensus.cc:697] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 14 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:11:37.955050 18992 raft_consensus.cc:2749] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:37.931876 18907 raft_consensus.cc:515] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:11:37.968798 18948 consensus_meta.cc:287] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.582s	user 0.011s	sys 0.002s
I20260709 12:11:37.965487 18828 raft_consensus.cc:2749] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:37.970109 18832 raft_consensus.cc:2804] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:11:37.982005 14228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:37.969944 18961 raft_consensus.cc:2749] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:37.970463 18885 raft_consensus.cc:2804] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:11:37.986742 14303 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:37.991894 14303 leader_election.cc:304] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:37.992585 14264 raft_consensus.cc:1240] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:37.992946 14182 raft_consensus.cc:2410] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:11:37.978040 18936 raft_consensus.cc:493] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:38.006345 14181 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56046 (request call id 2351) took 1475 ms (client timeout 1626 ms). Trace:
W20260709 12:11:38.006902 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 62656.5us
I20260709 12:11:38.009449 14260 raft_consensus.cc:2393] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db in current term 11: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:11:38.009258 14912 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132"
dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
mode: GRACEFUL
new_leader_uuid: "885067a0d31741bfb5c9935788e315bf"
 from {username='slave'} at 127.0.0.1:38628
W20260709 12:11:38.006964 14181 rpcz_store.cc:269] 0709 12:11:36.520325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:36.520464 (+   139us) service_pool.cc:224] Handling call
0709 12:11:37.992170 (+1471706us) spinlock_profiling.cc:243] Waited 276 ms on lock 0x7b54003b1854. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:11:37.995545 (+  3375us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":634075904}
I20260709 12:11:38.010675 14258 raft_consensus.cc:1275] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:11:38.010946 14909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53200 (request call id 635) took 1220 ms. Trace:
I20260709 12:11:37.984524 18963 raft_consensus.cc:493] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:37.984638 18979 raft_consensus.cc:493] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:38.011399 14909 rpcz_store.cc:276] 0709 12:11:36.790698 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:36.790840 (+   142us) service_pool.cc:224] Handling call
0709 12:11:36.791156 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:36.947891 (+156735us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:38.010643 (+1062752us) spinlock_profiling.cc:243] Waited 156 ms on lock 0x7b540039eed4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:11:38.010867 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":358830464}
I20260709 12:11:38.030215 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 15 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:38.034840 14229 leader_election.cc:304] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:37.968614 18868 consensus_queue.cc:260] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:37.993826 18885 raft_consensus.cc:493] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:38.038971 14229 leader_election.cc:304] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
W20260709 12:11:38.056834 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 49011.3us
I20260709 12:11:38.045945 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:38.065863 14155 leader_election.cc:304] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:38.049464 14877 leader_election.cc:304] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:11:38.052156 14229 leader_election.cc:400] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 9 pre-election: Vote denied by peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187) with higher term. Message: Invalid argument: T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 9. Current term is 10.
I20260709 12:11:38.068375 14229 leader_election.cc:403] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:38.069514 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:38.033864 18802 leader_election.cc:290] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:38.036471 18832 raft_consensus.cc:697] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 12 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:11:38.070338 14261 raft_consensus.cc:2468] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 13.
I20260709 12:11:38.040920 18885 raft_consensus.cc:3060] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:38.104979 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 113345us
I20260709 12:11:38.012343 18936 raft_consensus.cc:515] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:11:38.102240 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 50267.4us
W20260709 12:11:38.112167 14156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:38.075088 14155 leader_election.cc:304] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
W20260709 12:11:38.149864 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:38.114733 18813 raft_consensus.cc:2749] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187) with higher term. Message: Invalid argument: T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 9. Current term is 10.
W20260709 12:11:38.155197 19020 log.cc:927] Time spent T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 12:11:38.156010 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 50010.7us
I20260709 12:11:38.157650 19017 raft_consensus.cc:493] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:38.158990 18440 raft_consensus.cc:2749] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:11:38.159531 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 84808.6us
I20260709 12:11:38.158144 14303 leader_election.cc:304] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:11:38.072624 19024 consensus_queue.cc:1048] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.098s
I20260709 12:11:38.162015 14155 leader_election.cc:304] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:38.165261 18440 raft_consensus.cc:2749] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:38.167137 18970 raft_consensus.cc:3060] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:38.061970 18884 consensus_queue.cc:1048] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.096s
I20260709 12:11:38.045542 19019 raft_consensus.cc:493] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:38.155202 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:38.168076 14303 leader_election.cc:304] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:38.041790 18828 raft_consensus.cc:493] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:38.035344 18963 raft_consensus.cc:515] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:38.056521 18812 raft_consensus.cc:2749] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:11:38.020721 18942 consensus_queue.cc:237] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:38.037176 18979 raft_consensus.cc:515] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:38.104792 18983 raft_consensus.cc:2804] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:11:38.202827 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 101668us
I20260709 12:11:38.208389 14912 raft_consensus.cc:606] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Received request to transfer leadership to TS 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:38.100555 18925 raft_consensus.cc:3060] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:38.184144 14303 leader_election.cc:304] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:38.250097 14912 raft_consensus.cc:614] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:11:38.250944 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 66892.6us
I20260709 12:11:38.040414 19009 raft_consensus.cc:2749] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 12:11:38.239687 19010 log.cc:927] Time spent T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.450s	user 0.000s	sys 0.004s
W20260709 12:11:38.240000 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 78447.2us
I20260709 12:11:38.203181 19019 raft_consensus.cc:515] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:38.242357 18967 raft_consensus.cc:3060] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:38.226675 18948 raft_consensus.cc:493] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:38.252290 14908 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53200 (request call id 631) took 1490 ms (client timeout 1983 ms). Trace:
I20260709 12:11:38.226666 19004 raft_consensus.cc:2749] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:38.255497 14155 leader_election.cc:304] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:38.282011 14155 leader_election.cc:304] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:38.158298 19017 raft_consensus.cc:515] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:38.283277 14155 leader_election.cc:304] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:38.284576 14155 leader_election.cc:304] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
W20260709 12:11:38.284848 18977 log.cc:927] Time spent T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.896s	user 0.004s	sys 0.000s
I20260709 12:11:38.285220 19017 leader_election.cc:290] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:11:38.263892 19021 log.cc:927] Time spent T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.125s	user 0.001s	sys 0.001s
I20260709 12:11:38.185623 19013 raft_consensus.cc:2749] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:38.252017 14303 leader_election.cc:304] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:38.264027 19007 consensus_queue.cc:1059] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
W20260709 12:11:38.262703 14908 rpcz_store.cc:269] 0709 12:11:36.736989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:36.744957 (+  7968us) service_pool.cc:224] Handling call
0709 12:11:38.227020 (+1482063us) spinlock_profiling.cc:243] Waited 79.8 ms on lock 0x7b54007bfcd4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:11:38.227184 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":183560576}
W20260709 12:11:38.266417 19014 log.cc:927] Time spent T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.159s	user 0.000s	sys 0.000s
I20260709 12:11:38.268085 18936 leader_election.cc:290] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:38.268782 18832 consensus_queue.cc:237] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:38.270630 18907 leader_election.cc:290] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 11 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:38.270975 18946 raft_consensus.cc:3055] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:38.272559 19019 leader_election.cc:290] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:11:38.277462 14154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:38.278740 14909 raft_consensus.cc:1275] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 12:11:38.420725 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 168785us
I20260709 12:11:38.280026 18979 leader_election.cc:290] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:38.344838 18837 raft_consensus.cc:493] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:38.184190 18802 raft_consensus.cc:2804] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:38.285483 19012 raft_consensus.cc:2749] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:38.252522 18983 raft_consensus.cc:493] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:38.336236 14260 raft_consensus.cc:1275] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
W20260709 12:11:38.338826 18964 log.cc:927] Time spent T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 1.204s	user 0.011s	sys 0.002s
I20260709 12:11:38.252763 18984 raft_consensus.cc:2749] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:38.341636 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:38.342835 14229 leader_election.cc:304] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:38.255177 18708 leader_election.cc:290] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:38.384658 14262 raft_consensus.cc:1240] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:38.410293 14332 raft_consensus.cc:1240] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:38.411773 14336 raft_consensus.cc:1217] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Deduplicated request from leader. Original: 9.8->[11.9-15.10]   Dedup: 11.9->[15.10-15.10]
I20260709 12:11:38.454767 14336 raft_consensus.cc:1240] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 15. Current term is 16. Ops: [11.9-15.10]
I20260709 12:11:38.417852 18946 raft_consensus.cc:740] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:38.413251 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:38.342002 19004 raft_consensus.cc:2749] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:38.204387 18828 raft_consensus.cc:515] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:11:38.462006 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 183904us
W20260709 12:11:38.424343 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 139857us
I20260709 12:11:38.443046 14260 pending_rounds.cc:85] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec: Aborting all ops after (but not including) 6
I20260709 12:11:38.443197 14335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 829) took 1689 ms. Trace:
I20260709 12:11:38.463078 14230 leader_election.cc:304] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:38.463177 14260 pending_rounds.cc:107] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 12:11:38.463927 14155 leader_election.cc:304] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:38.464459 14260 raft_consensus.cc:2889] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:38.436062 18979 raft_consensus.cc:2749] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:11:38.450467 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 107732us
I20260709 12:11:38.463435 14335 rpcz_store.cc:276] 0709 12:11:36.754260 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:36.754805 (+   545us) service_pool.cc:224] Handling call
0709 12:11:36.766202 (+ 11397us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:36.766665 (+   463us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:36.766700 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:36.801929 (+ 35229us) log.cc:844] Serialized 52 byte log entry
0709 12:11:37.184075 (+382146us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:37.184127 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:37.184209 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:38.284035 (+1099826us) spinlock_profiling.cc:243] Waited 3.02 ms on lock 0x7b4400022b4c. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2123f74c85 00007f2123f756a2 00007f2126ce71db 00007f2126ce2aaf 00007f2126cd686e 00007f2126cd5bb6 00007f2126cd57d8 00007f2126cdf221 00007f2126cdf1d9 00007f2126cdf169
0709 12:11:38.421457 (+137422us) raft_consensus.cc:1685] finished
0709 12:11:38.421480 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:38.443120 (+ 21640us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":738,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":31074,"spinlock_wait_cycles":6945664,"thread_start_us":381304,"threads_started":1,"wal-append.queue_time_us":470634}
I20260709 12:11:38.413932 19015 raft_consensus.cc:493] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
W20260709 12:11:38.434239 18993 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.658s	user 0.029s	sys 0.057s
I20260709 12:11:38.457561 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:11:38.444903 19021 log.cc:927] Time spent T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:11:38.435431 18802 raft_consensus.cc:493] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:11:38.329888 18948 raft_consensus.cc:515] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:38.446605 18983 raft_consensus.cc:3060] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:11:38.456346 18865 consensus_meta.cc:287] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.974s	user 0.011s	sys 0.002s
W20260709 12:11:38.473861 18960 consensus_meta.cc:287] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.561s	user 0.009s	sys 0.004s
I20260709 12:11:38.454999 18907 raft_consensus.cc:2749] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:38.483434 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:38.454408 19026 raft_consensus.cc:2749] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:38.491583 14303 leader_election.cc:304] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
W20260709 12:11:38.471156 18993 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.695s	user 0.029s	sys 0.057s
I20260709 12:11:38.451809 18837 raft_consensus.cc:515] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:38.498100 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:38.503675 14155 leader_election.cc:304] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:38.500761 18946 consensus_queue.cc:260] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:38.502075 18997 raft_consensus.cc:2804] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:38.505990 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:38.503086 14182 raft_consensus.cc:2468] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 12.
I20260709 12:11:38.481251 19017 raft_consensus.cc:493] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:38.466877 19007 consensus_queue.cc:1059] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 12:11:38.492237 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
W20260709 12:11:38.507400 19030 log.cc:927] Time spent T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.094s	user 0.001s	sys 0.001s
I20260709 12:11:38.516721 14188 raft_consensus.cc:3060] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:38.522012 14229 leader_election.cc:304] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:38.465888 19034 consensus_queue.cc:1059] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 12:11:38.497846 18960 raft_consensus.cc:2749] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:38.488786 18802 raft_consensus.cc:3060] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:38.534772 14909 raft_consensus.cc:1275] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 12:11:38.535097 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:38.480559 18708 consensus_queue.cc:1048] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 12:11:38.538807 14904 raft_consensus.cc:1240] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 18 LEADER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 17. Current term is 18. Ops: []
I20260709 12:11:38.505967 19004 raft_consensus.cc:2749] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:38.544137 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:38.512194 18997 raft_consensus.cc:493] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
W20260709 12:11:38.536749 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:38.548753 14908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:11:38.531800 18993 raft_consensus.cc:2804] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:38.551172 19046 raft_consensus.cc:493] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:38.548614 19007 raft_consensus.cc:493] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:38.557346 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:38.570466 19046 raft_consensus.cc:515] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:38.572132 14330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50858 (request call id 1943) took 1137 ms. Trace:
W20260709 12:11:38.572383 19033 log.cc:927] Time spent T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.168s	user 0.000s	sys 0.001s
I20260709 12:11:38.554605 19034 raft_consensus.cc:3055] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:38.517614 18907 consensus_queue.cc:1059] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 12:11:38.549791 18997 raft_consensus.cc:3060] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:11:38.558817 14156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:38.477193 19015 raft_consensus.cc:515] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:38.574446 14182 raft_consensus.cc:1275] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:11:38.575018 14186 raft_consensus.cc:1275] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:11:38.568051 19042 consensus_queue.cc:1048] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.020s
W20260709 12:11:38.552954 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 95027.5us
I20260709 12:11:38.524655 19017 raft_consensus.cc:515] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:38.494546 18865 raft_consensus.cc:515] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:38.578176 14330 rpcz_store.cc:276] 0709 12:11:37.434747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:37.434936 (+   189us) service_pool.cc:224] Handling call
0709 12:11:37.435304 (+   368us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:37.640510 (+205206us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:38.571798 (+931288us) spinlock_profiling.cc:243] Waited 201 ms on lock 0x7b54002e81d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:11:38.572055 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":463171328}
I20260709 12:11:38.588752 14188 raft_consensus.cc:2468] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 11.
I20260709 12:11:38.551946 18946 raft_consensus.cc:3060] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:38.599159 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:38.595266 14304 leader_election.cc:304] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:11:38.574229 19012 raft_consensus.cc:2804] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:38.632687 19037 raft_consensus.cc:493] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
W20260709 12:11:38.650542 14302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:38.650369 19037 raft_consensus.cc:515] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:38.651368 18915 raft_consensus.cc:493] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:38.652343 18915 raft_consensus.cc:515] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:38.633807 19046 leader_election.cc:290] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:38.591539 19034 raft_consensus.cc:740] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:38.654353 14188 raft_consensus.cc:1275] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:11:38.599251 19007 raft_consensus.cc:515] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:38.641258 18865 leader_election.cc:290] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 12 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:11:38.642887 19036 log.cc:927] Time spent T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.181s	user 0.000s	sys 0.001s
I20260709 12:11:38.646565 18828 leader_election.cc:290] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:38.650801 19047 raft_consensus.cc:2804] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:38.639566 14338 raft_consensus.cc:1240] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:38.650511 14186 raft_consensus.cc:1275] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 12:11:38.674952 14186 pending_rounds.cc:85] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf: Aborting all ops after (but not including) 6
I20260709 12:11:38.675249 14186 pending_rounds.cc:107] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 12:11:38.675487 14186 raft_consensus.cc:2889] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:38.677052 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:38.657608 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:38.579787 18963 leader_election.cc:290] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:38.662734 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:38.667497 14335 raft_consensus.cc:1275] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:11:38.668756 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:38.653430 19037 leader_election.cc:290] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:11:38.700349 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 196732us
I20260709 12:11:38.701401 14155 leader_election.cc:304] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
W20260709 12:11:38.643433 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 48245.4us
I20260709 12:11:38.596316 18993 raft_consensus.cc:697] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 12 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:11:38.682776 14188 raft_consensus.cc:2410] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 12:11:38.656836 19012 raft_consensus.cc:493] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:38.689046 14336 raft_consensus.cc:3060] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:38.713399 14188 raft_consensus.cc:1240] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 10. Current term is 11. Ops: []
W20260709 12:11:38.693194 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 209892us
I20260709 12:11:38.674520 19047 raft_consensus.cc:493] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:38.719132 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:38.716578 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:38.725437 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:38.723286 14264 raft_consensus.cc:2468] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 11.
I20260709 12:11:38.748415 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:38.698992 18828 raft_consensus.cc:2804] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:38.756918 14260 raft_consensus.cc:1275] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:11:38.771082 14336 raft_consensus.cc:2468] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 11.
I20260709 12:11:38.768620 14264 raft_consensus.cc:1240] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 15. Current term is 16. Ops: []
I20260709 12:11:38.714870 19012 raft_consensus.cc:3060] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:38.754383 18989 consensus_queue.cc:1048] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 12:11:38.795337 14258 raft_consensus.cc:1275] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
W20260709 12:11:38.796030 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 94723us
I20260709 12:11:38.802379 14155 leader_election.cc:304] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:38.718106 18963 raft_consensus.cc:2749] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:11:38.755234 18885 consensus_meta.cc:287] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.634s	user 0.009s	sys 0.008s
I20260709 12:11:38.747754 19047 raft_consensus.cc:3060] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:38.758939 18828 raft_consensus.cc:493] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:38.720582 18865 consensus_queue.cc:1059] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.075s
I20260709 12:11:38.785995 19055 raft_consensus.cc:493] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:11:38.816282 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:38.825399 14331 raft_consensus.cc:3060] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:38.789871 18948 leader_election.cc:290] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:38.826820 14155 leader_election.cc:304] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:38.750777 19046 consensus_queue.cc:1048] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.059s
I20260709 12:11:38.804445 18837 leader_election.cc:290] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:38.698263 19034 consensus_queue.cc:260] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:38.842422 14186 raft_consensus.cc:1240] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 17. Current term is 18. Ops: [14.10-17.11]
I20260709 12:11:38.842955 14304 leader_election.cc:304] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:11:38.821385 18828 raft_consensus.cc:3060] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:38.837867 18967 consensus_meta.cc:287] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.551s	user 0.008s	sys 0.005s
I20260709 12:11:38.853225 14335 raft_consensus.cc:1240] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:38.845765 14183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56046 (request call id 2366) took 2255 ms. Trace:
W20260709 12:11:38.845458 19031 log.cc:927] Time spent T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.177s	user 0.000s	sys 0.001s
I20260709 12:11:38.818374 18885 raft_consensus.cc:515] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:38.839926 18865 consensus_queue.cc:1243] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer 73d01e9b1a9d49358da4985b21d681db log is divergent from this leader: its last log entry 18.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
W20260709 12:11:38.851629 19032 log.cc:927] Time spent T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.598s	user 0.000s	sys 0.001s
W20260709 12:11:38.915609 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 88892.6us
I20260709 12:11:38.843494 18837 raft_consensus.cc:493] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:38.915810 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:38.844581 18993 consensus_queue.cc:237] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:38.929829 19057 raft_consensus.cc:2749] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:38.865911 18817 raft_consensus.cc:2804] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:38.926868 14155 leader_election.cc:304] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:38.919485 18963 raft_consensus.cc:2804] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:38.941543 14265 raft_consensus.cc:1240] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:38.946127 14155 leader_election.cc:304] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:38.860874 18915 leader_election.cc:290] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:38.908988 19034 raft_consensus.cc:3060] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:38.920446 18967 raft_consensus.cc:493] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:38.832074 19055 raft_consensus.cc:515] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:38.929404 19062 raft_consensus.cc:493] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:38.956067 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:38.934300 18817 raft_consensus.cc:493] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:38.911880 19013 consensus_queue.cc:1048] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 12:11:38.961822 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:38.959299 19071 raft_consensus.cc:493] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:38.951865 18948 raft_consensus.cc:2749] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:38.951399 19057 raft_consensus.cc:2749] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:38.949481 18963 raft_consensus.cc:493] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
W20260709 12:11:38.988091 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:38.991428 19043 raft_consensus.cc:493] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:38.991956 14263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53050 (request call id 855) took 1210 ms. Trace:
I20260709 12:11:39.004248 14263 rpcz_store.cc:276] 0709 12:11:37.783885 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:37.798029 (+ 14144us) service_pool.cc:224] Handling call
0709 12:11:37.798456 (+   427us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:37.982438 (+183982us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:37.982472 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:37.988061 (+  5589us) log.cc:844] Serialized 26 byte log entry
0709 12:11:38.014251 (+ 26190us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:38.014302 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:38.014387 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:38.850811 (+836424us) spinlock_profiling.cc:243] Waited 3.52 ms on lock 0x7b4400022b4c. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2123f74c85 00007f2123f756a2 00007f2126ce71db 00007f2126ce2aaf 00007f2126cd686e 00007f2126cd5bb6 00007f2126cd57d8 00007f2126cdf221 00007f2126cdf1d9 00007f2126cdf169
0709 12:11:38.987416 (+136605us) raft_consensus.cc:1685] finished
0709 12:11:38.987447 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:38.991872 (+  4425us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":31607,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":131,"spinlock_wait_cycles":8096640,"thread_start_us":209334,"threads_started":2,"wal-append.queue_time_us":180673}
I20260709 12:11:38.994812 18885 leader_election.cc:290] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 9 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:11:38.995548 18808 consensus_meta.cc:287] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 1.074s	user 0.014s	sys 0.000s
I20260709 12:11:38.954483 19007 leader_election.cc:290] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:38.934104 18837 raft_consensus.cc:515] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } }
W20260709 12:11:39.001986 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:39.001986 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 55951.9us
I20260709 12:11:38.973832 18817 raft_consensus.cc:3060] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:38.973537 19062 raft_consensus.cc:515] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:38.980747 19015 leader_election.cc:290] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:39.012064 19076 consensus_queue.cc:1059] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 12:11:39.014814 18972 consensus_queue.cc:1059] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:39.178952 18972 consensus_queue.cc:1243] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer 65c9c1653b3346b39a0e118540e6080c log is divergent from this leader: its last log entry 14.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:11:39.020567 18812 raft_consensus.cc:493] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:39.179350 19076 raft_consensus.cc:3055] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:39.021723 19068 consensus_queue.cc:1059] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.068s
I20260709 12:11:39.042599 14331 raft_consensus.cc:2468] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 14.
I20260709 12:11:39.179822 19076 raft_consensus.cc:740] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:11:39.010237 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:39.006412 18963 raft_consensus.cc:3060] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:39.180711 19076 consensus_queue.cc:260] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:39.181334 18812 raft_consensus.cc:515] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:39.184204 18812 leader_election.cc:290] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:38.989475 19071 raft_consensus.cc:515] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:11:39.042220 19060 log.cc:927] Time spent T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 12:11:39.187631 19071 leader_election.cc:290] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:39.024026 19043 raft_consensus.cc:515] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:39.044174 18808 raft_consensus.cc:515] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:39.190196 19043 leader_election.cc:290] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:39.062358 14155 leader_election.cc:304] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:39.190513 18808 leader_election.cc:290] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 12 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:39.193358 19057 raft_consensus.cc:2749] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:11:39.087049 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:39.191787 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 129504us
I20260709 12:11:38.964521 18967 raft_consensus.cc:515] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:11:39.021291 19003 log.cc:927] Time spent T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 1.207s	user 0.005s	sys 0.004s
I20260709 12:11:39.204171 18995 raft_consensus.cc:3055] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 15 LEADER]: Stepping down as leader of term 15
W20260709 12:11:39.205248 14156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:39.046643 19077 raft_consensus.cc:493] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:39.192994 18828 raft_consensus.cc:515] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:39.211588 14155 leader_election.cc:304] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:39.169130 19013 raft_consensus.cc:493] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:39.200344 19057 raft_consensus.cc:493] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:39.215499 18948 raft_consensus.cc:2749] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:39.220067 18948 raft_consensus.cc:493] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:39.220584 18948 raft_consensus.cc:515] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:11:39.221333 18925 consensus_meta.cc:287] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.967s	user 0.005s	sys 0.006s
I20260709 12:11:39.204721 18995 raft_consensus.cc:740] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:39.221807 19013 raft_consensus.cc:515] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:39.223132 18948 leader_election.cc:290] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:39.223382 18837 leader_election.cc:290] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187)
I20260709 12:11:39.224083 18892 raft_consensus.cc:3060] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:39.224819 19062 leader_election.cc:290] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:39.224949 14155 leader_election.cc:304] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
W20260709 12:11:39.280828 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 55943.6us
I20260709 12:11:39.282941 14155 leader_election.cc:304] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
W20260709 12:11:39.283215 18997 consensus_meta.cc:287] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.640s	user 0.011s	sys 0.000s
I20260709 12:11:39.212595 19071 raft_consensus.cc:493] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:39.200177 18978 raft_consensus.cc:493] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:39.284061 18978 raft_consensus.cc:515] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:11:39.237270 14302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:39.232681 18983 consensus_meta.cc:287] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db: Time spent flushing consensus metadata: real 0.727s	user 0.007s	sys 0.005s
I20260709 12:11:39.214922 19076 raft_consensus.cc:3060] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:39.291676 18967 leader_election.cc:290] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:39.279410 19013 leader_election.cc:290] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:39.287149 19054 raft_consensus.cc:2749] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:39.287691 18948 raft_consensus.cc:2749] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:39.283914 19071 raft_consensus.cc:515] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:39.300050 18978 leader_election.cc:290] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:39.300601 18828 leader_election.cc:290] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 13 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:39.300845 19071 leader_election.cc:290] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:39.304126 14155 leader_election.cc:400] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 15 pre-election: Vote denied by peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673) with higher term. Message: Invalid argument: T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 15. Current term is 16.
I20260709 12:11:39.304529 14155 leader_election.cc:403] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:39.283687 18997 raft_consensus.cc:515] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:39.307485 18978 raft_consensus.cc:3060] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:39.308501 18997 leader_election.cc:290] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 15 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:39.287467 18995 consensus_queue.cc:260] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:39.288357 18741 raft_consensus.cc:3055] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:11:39.309914 18741 raft_consensus.cc:740] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:39.311383 18741 consensus_queue.cc:260] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:39.312834 18741 raft_consensus.cc:3060] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:11:39.218032 19077 raft_consensus.cc:515] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:39.232913 19057 raft_consensus.cc:515] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:11:39.289913 18802 consensus_meta.cc:287] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.742s	user 0.013s	sys 0.000s
I20260709 12:11:39.249150 18925 raft_consensus.cc:2749] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:11:39.217633 14228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:39.211555 18807 consensus_queue.cc:1048] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 12:11:39.294374 14338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50856 (request call id 2288) took 1436 ms. Trace:
I20260709 12:11:39.319656 14155 leader_election.cc:304] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:39.329265 14262 raft_consensus.cc:1240] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 12:11:39.329414 14338 rpcz_store.cc:276] 0709 12:11:37.857560 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:37.857682 (+   122us) service_pool.cc:224] Handling call
0709 12:11:37.858190 (+   508us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:38.674617 (+816427us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:39.294065 (+619448us) spinlock_profiling.cc:243] Waited 781 ms on lock 0x7b5400145854. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:11:39.294303 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1796493056}
I20260709 12:11:39.349517 14265 raft_consensus.cc:1275] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 12:11:39.328148 14181 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.022s	sys 0.030s
W20260709 12:11:39.352202 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 367374us
I20260709 12:11:39.326608 18914 raft_consensus.cc:493] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:39.367619 19019 raft_consensus.cc:493] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:39.370267 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 50725.3us
I20260709 12:11:39.367353 18914 raft_consensus.cc:515] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:39.371254 14155 leader_election.cc:304] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:39.320904 18963 raft_consensus.cc:515] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:39.367659 14230 leader_election.cc:304] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:39.382113 14906 raft_consensus.cc:1240] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 15. Current term is 16. Ops: []
W20260709 12:11:39.386665 14155 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:39.304541 18817 raft_consensus.cc:515] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:39.326545 18802 raft_consensus.cc:515] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:11:39.349011 19012 consensus_meta.cc:287] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.542s	user 0.008s	sys 0.004s
I20260709 12:11:39.389875 14155 leader_election.cc:304] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:39.380198 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
W20260709 12:11:39.368973 14181 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.582s	user 0.022s	sys 0.030s
I20260709 12:11:39.386302 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:39.404317 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:39.410529 14155 leader_election.cc:304] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 73d01e9b1a9d49358da4985b21d681db
W20260709 12:11:39.408317 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 169722us
I20260709 12:11:39.411165 14335 raft_consensus.cc:2468] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 8.
I20260709 12:11:39.377354 19054 raft_consensus.cc:2804] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:39.405122 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:39.411425 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:39.345654 18925 consensus_queue.cc:1059] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 12:11:39.406188 14333 raft_consensus.cc:1240] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 12:11:39.347327 18997 consensus_queue.cc:1059] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 12:11:39.386624 18974 raft_consensus.cc:2749] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:11:39.389067 19053 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.634s	user 0.013s	sys 0.015s
I20260709 12:11:39.391712 18967 raft_consensus.cc:493] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:39.391940 19071 raft_consensus.cc:493] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:39.412195 18948 raft_consensus.cc:2749] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:39.381493 18946 raft_consensus.cc:493] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:39.387512 18828 raft_consensus.cc:493] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:39.377712 18807 consensus_queue.cc:1048] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 12:11:39.376376 19019 raft_consensus.cc:515] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:39.416205 19004 raft_consensus.cc:2749] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:39.415011 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:11:39.446300 14906 raft_consensus.cc:3060] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:39.347986 19013 consensus_queue.cc:1059] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.030s
W20260709 12:11:39.429683 19053 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.677s	user 0.013s	sys 0.015s
I20260709 12:11:39.296394 18983 raft_consensus.cc:515] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:39.417644 19012 raft_consensus.cc:515] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:39.438153 18967 raft_consensus.cc:515] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:39.475304 14256 raft_consensus.cc:1240] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 11 LEADER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:39.444228 19071 raft_consensus.cc:515] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:39.476841 14906 raft_consensus.cc:2468] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 11.
I20260709 12:11:39.470050 19054 raft_consensus.cc:697] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 10 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:11:39.447399 18946 raft_consensus.cc:515] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:39.463058 18892 raft_consensus.cc:2764] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 12:11:39.448716 18828 raft_consensus.cc:515] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:39.468464 19057 leader_election.cc:290] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:39.491192 14187 raft_consensus.cc:2468] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 11.
W20260709 12:11:39.493151 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 82691.6us
I20260709 12:11:39.496166 14330 raft_consensus.cc:2468] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 12.
I20260709 12:11:39.475972 19077 leader_election.cc:290] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:39.491812 18958 raft_consensus.cc:493] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:39.509375 18946 leader_election.cc:290] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:11:39.514482 19073 log.cc:927] Time spent T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 12:11:39.516033 14181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56046 (request call id 2390) took 1031 ms. Trace:
I20260709 12:11:39.492548 18963 leader_election.cc:290] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:39.516453 14181 rpcz_store.cc:276] 0709 12:11:38.484761 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:38.484879 (+   118us) service_pool.cc:224] Handling call
0709 12:11:38.502843 (+ 17964us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:38.670627 (+167784us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:38.670664 (+    37us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:38.708479 (+ 37815us) log.cc:844] Serialized 52 byte log entry
0709 12:11:39.410774 (+702295us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:11:39.410813 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:39.410887 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:39.515736 (+104849us) raft_consensus.cc:1685] finished
0709 12:11:39.515768 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:39.515957 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":52729,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":19545,"thread_start_us":782534,"threads_started":2,"wal-append.queue_time_us":640030}
I20260709 12:11:39.498733 19088 raft_consensus.cc:493] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:39.500327 18802 leader_election.cc:290] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 15 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:11:39.535534 18999 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.845s	user 0.012s	sys 0.031s
W20260709 12:11:39.548774 19025 log.cc:927] Time spent T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 1.382s	user 0.005s	sys 0.005s
I20260709 12:11:39.552891 18914 leader_election.cc:290] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:39.556165 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:39.556975 14338 raft_consensus.cc:2468] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 10.
I20260709 12:11:39.531693 18958 raft_consensus.cc:515] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:39.560030 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:39.561404 14189 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 2794) took 2052 ms. Trace:
I20260709 12:11:39.561901 14189 rpcz_store.cc:276] 0709 12:11:37.509355 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:37.509848 (+   493us) service_pool.cc:224] Handling call
0709 12:11:37.519146 (+  9298us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:37.846529 (+327383us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:37.846572 (+    43us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:37.885949 (+ 39377us) log.cc:844] Serialized 52 byte log entry
0709 12:11:37.981598 (+ 95649us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:38.239135 (+257537us) log.cc:844] Serialized 14 byte log entry
0709 12:11:38.253788 (+ 14653us) log.cc:844] Serialized 14 byte log entry
0709 12:11:38.254029 (+   241us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:38.254435 (+   406us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:39.548088 (+1293653us) spinlock_profiling.cc:243] Waited 17.8 ms on lock 0x7b4400022b4c. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2123f74c85 00007f2123f756a2 00007f2126ce71db 00007f2126ce2aaf 00007f2126cd686e 00007f2126cd5bb6 00007f2126cd57d8 00007f2126cdf221 00007f2126cdf1d9 00007f2126cdf169
0709 12:11:39.561108 (+ 13020us) raft_consensus.cc:1685] finished
0709 12:11:39.561145 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:39.561330 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":191416,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":66,"raft.queue_time_us":32697,"raft.run_cpu_time_us":56,"raft.run_wall_time_us":57,"spinlock_wait_cycles":66642816,"thread_start_us":603313,"threads_started":3,"wal-append.queue_time_us":257337}
I20260709 12:11:39.566167 19012 leader_election.cc:290] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 13 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:39.566553 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:39.567281 14333 raft_consensus.cc:2468] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 11.
W20260709 12:11:39.567709 14155 leader_election.cc:336] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Timed out: RequestConsensusVote RPC to 127.12.174.130:36673 timed out after 1.863s (SENT)
I20260709 12:11:39.568207 14155 leader_election.cc:304] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:39.568455 18828 leader_election.cc:290] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:39.535636 19054 consensus_queue.cc:237] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:39.571144 18963 raft_consensus.cc:2749] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:39.568248 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:39.572155 14333 raft_consensus.cc:2468] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 11.
W20260709 12:11:39.572777 14229 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.781s	user 0.016s	sys 0.024s
W20260709 12:11:39.573143 14229 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.781s	user 0.016s	sys 0.024s
I20260709 12:11:39.573309 18967 leader_election.cc:290] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:39.573901 18967 raft_consensus.cc:493] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:39.574399 18967 raft_consensus.cc:515] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:39.575095 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:39.576493 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:39.541915 19088 raft_consensus.cc:515] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:39.577821 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:39.576628 18967 leader_election.cc:290] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:39.579326 19088 leader_election.cc:290] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:39.579545 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:39.580749 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:39.582294 14333 raft_consensus.cc:1275] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:11:39.583002 19006 raft_consensus.cc:3055] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:39.644589 19006 raft_consensus.cc:740] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:39.645753 19006 consensus_queue.cc:260] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:39.647264 19006 raft_consensus.cc:3060] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:39.648221 14912 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:38628 (request call id 16) took 1669 ms. Trace:
I20260709 12:11:39.648653 14912 rpcz_store.cc:276] 0709 12:11:37.982380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:37.987685 (+  5305us) service_pool.cc:224] Handling call
0709 12:11:39.647955 (+1660270us) spinlock_profiling.cc:243] Waited 198 ms on lock 0x7b540065f254. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f2127135853 00007f212c10360a 00007f21256897d4 00007f2125689762 00007f2125689691 00007f212568960c 00007f21256888c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:11:39.648100 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":455775488}
I20260709 12:11:39.544286 18817 leader_election.cc:290] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 12 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:39.650424 14333 raft_consensus.cc:1240] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 14. Current term is 15. Ops: []
W20260709 12:11:39.584722 19085 log.cc:927] Time spent T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:11:39.652040 14333 raft_consensus.cc:1240] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:39.585701 18978 raft_consensus.cc:2749] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673) with higher term. Message: Invalid argument: T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 15. Current term is 16.
I20260709 12:11:39.586375 18722 raft_consensus.cc:3055] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:39.588754 19019 leader_election.cc:290] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:39.589965 19071 leader_election.cc:290] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:11:39.590487 19027 log.cc:927] Time spent T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 1.424s	user 0.007s	sys 0.005s
I20260709 12:11:39.590988 18983 leader_election.cc:290] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 14 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:39.668977 14337 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50856 (request call id 2294) took 1777 ms. Trace:
I20260709 12:11:39.669458 14337 rpcz_store.cc:276] 0709 12:11:37.891770 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:37.891893 (+   123us) service_pool.cc:224] Handling call
0709 12:11:37.892305 (+   412us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:37.892779 (+   474us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:11:37.892812 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:37.906840 (+ 14028us) log.cc:844] Serialized 26 byte log entry
0709 12:11:37.976849 (+ 70009us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:11:37.976907 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:37.976989 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:39.589893 (+1612904us) spinlock_profiling.cc:243] Waited 17.5 ms on lock 0x7b4400022b4c. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2123f74c85 00007f2123f756a2 00007f2126ce71db 00007f2126ce2aaf 00007f2126cd686e 00007f2126cd5bb6 00007f2126cd57d8 00007f2126cdf221 00007f2126cdf1d9 00007f2126cdf169
0709 12:11:39.668590 (+ 78697us) raft_consensus.cc:1685] finished
0709 12:11:39.668616 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:39.668895 (+   279us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":103,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":11255,"spinlock_wait_cycles":40244480,"thread_start_us":49725,"threads_started":1,"wal-append.queue_time_us":247973}
I20260709 12:11:39.671651 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:39.584506 19034 raft_consensus.cc:3055] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:39.673061 19034 raft_consensus.cc:740] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:39.593541 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:39.656209 18722 raft_consensus.cc:740] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:11:39.675307 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:39.675947 14257 raft_consensus.cc:3060] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:39.593791 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:39.676082 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:39.676807 14903 raft_consensus.cc:2468] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 14.
I20260709 12:11:39.677189 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:39.677795 14265 raft_consensus.cc:2468] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 9.
W20260709 12:11:39.594251 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:39.678011 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:39.679580 14334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50856 (request call id 2285) took 1824 ms. Trace:
I20260709 12:11:39.679975 14334 rpcz_store.cc:276] 0709 12:11:37.855328 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:37.855474 (+   146us) service_pool.cc:224] Handling call
0709 12:11:37.855830 (+   356us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:37.877609 (+ 21779us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:39.679298 (+1801689us) spinlock_profiling.cc:243] Waited 21.2 ms on lock 0x7b540023c154. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:11:39.679510 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":48825728}
I20260709 12:11:39.681277 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:39.593914 18970 consensus_queue.cc:1059] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:39.674170 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:39.594825 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:39.686468 14262 raft_consensus.cc:2368] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 11. Current term is 12.
I20260709 12:11:39.595913 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:39.596678 14263 raft_consensus.cc:1275] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:11:39.597874 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:39.598624 19017 leader_election.cc:290] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:39.602777 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:39.688752 14189 raft_consensus.cc:2410] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:11:39.604557 14260 raft_consensus.cc:1240] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 12 LEADER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:39.607065 18786 raft_consensus.cc:493] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:39.690480 18786 raft_consensus.cc:515] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:39.690908 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:39.692193 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 17 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:39.609236 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:39.692778 14877 leader_election.cc:304] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:39.597925 14338 raft_consensus.cc:1240] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:39.694648 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:39.695978 19024 consensus_queue.cc:1048] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:11:39.612927 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:39.698858 14185 raft_consensus.cc:2468] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 9.
I20260709 12:11:39.613655 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:11:39.698077 14877 leader_election.cc:304] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
W20260709 12:11:39.595934 19047 consensus_meta.cc:287] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.772s	user 0.007s	sys 0.005s
W20260709 12:11:39.545392 18999 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.902s	user 0.013s	sys 0.032s
I20260709 12:11:39.623039 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:39.653486 14333 raft_consensus.cc:1217] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Deduplicated request from leader. Original: 9.8->[11.9-15.10]   Dedup: 11.9->[15.10-15.10]
I20260709 12:11:39.657332 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:39.662302 14908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:39.666657 14912 raft_consensus.cc:1275] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:11:39.612442 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:39.696820 18915 raft_consensus.cc:2749] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:11:39.655499 18987 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.676s	user 0.007s	sys 0.018s
I20260709 12:11:39.698212 14186 raft_consensus.cc:2468] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 12.
I20260709 12:11:39.615952 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:39.705286 14336 raft_consensus.cc:1275] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:11:39.705631 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:39.711347 14260 raft_consensus.cc:2468] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 11.
I20260709 12:11:39.712529 14265 raft_consensus.cc:1275] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:11:39.699321 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:39.712808 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:39.709606 14182 raft_consensus.cc:2393] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 13: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:11:39.700632 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:39.709959 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:39.699822 14909 raft_consensus.cc:3060] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:39.712395 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:11:39.714543 14302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:39.706363 14333 raft_consensus.cc:1240] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 15. Current term is 16. Ops: [11.9-15.10]
I20260709 12:11:39.714704 14263 raft_consensus.cc:2468] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 12.
I20260709 12:11:39.707023 14908 raft_consensus.cc:2410] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:11:39.714033 14262 raft_consensus.cc:3060] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:39.692790 18786 leader_election.cc:290] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:39.719923 14155 leader_election.cc:400] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 11 pre-election: Vote denied by peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673) with higher term. Message: Invalid argument: T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 11. Current term is 12.
I20260709 12:11:39.720615 14185 raft_consensus.cc:2393] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 10: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:11:39.723639 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:39.724494 14330 raft_consensus.cc:2393] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 14: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:11:39.709640 18983 raft_consensus.cc:2804] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:39.708638 19047 raft_consensus.cc:515] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:39.726101 18999 raft_consensus.cc:493] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:39.726426 14155 leader_election.cc:304] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:39.726893 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:39.727630 19047 leader_election.cc:290] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:11:39.713070 18987 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.740s	user 0.007s	sys 0.019s
I20260709 12:11:39.728024 19012 consensus_queue.cc:1059] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:11:39.728317 18978 consensus_queue.cc:1048] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:11:39.728760 19012 consensus_queue.cc:1243] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer 17aab1bbf5014936aa18cc21818b26ec log is divergent from this leader: its last log entry 12.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:11:39.728566 18999 raft_consensus.cc:515] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:39.729314 19012 raft_consensus.cc:3060] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:39.727794 14333 raft_consensus.cc:2410] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for term 19 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 12:11:39.729174 14332 raft_consensus.cc:2393] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db in current term 14: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:11:39.730967 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:11:39.703697 18789 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.933s	user 0.005s	sys 0.009s
I20260709 12:11:39.727759 14155 leader_election.cc:304] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:39.733706 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:39.734625 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:39.731747 14189 raft_consensus.cc:2468] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 10.
I20260709 12:11:39.735616 14229 leader_election.cc:304] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:11:39.705674 18440 raft_consensus.cc:493] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:39.743790 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:39.750025 14257 raft_consensus.cc:2468] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 10.
I20260709 12:11:39.753216 14155 leader_election.cc:304] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:39.736878 14182 raft_consensus.cc:2468] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 11.
W20260709 12:11:39.761205 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:39.766165 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:39.771786 14262 raft_consensus.cc:2468] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 13.
I20260709 12:11:39.767020 14185 raft_consensus.cc:2468] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 12.
I20260709 12:11:39.774610 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:39.774788 14155 leader_election.cc:304] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:39.775008 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:11:39.741693 18789 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.971s	user 0.005s	sys 0.009s
I20260709 12:11:39.777491 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:39.777979 14185 raft_consensus.cc:2410] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:11:39.777933 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:39.779531 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:39.783509 14186 raft_consensus.cc:3060] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:39.783932 18999 leader_election.cc:290] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:39.765125 18440 raft_consensus.cc:515] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:39.780020 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:39.786425 14182 raft_consensus.cc:2468] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 11.
I20260709 12:11:39.787216 18440 leader_election.cc:290] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:39.787563 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:39.787864 18440 raft_consensus.cc:2749] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:39.789074 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:39.675323 18722 consensus_queue.cc:260] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:39.791801 18722 raft_consensus.cc:3060] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:39.795028 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:39.733063 19042 raft_consensus.cc:3055] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:39.742293 19088 raft_consensus.cc:2804] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:11:39.800539 14302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:39.809369 14302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:39.739863 18958 leader_election.cc:290] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:39.757750 18987 raft_consensus.cc:2804] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:39.741080 18915 consensus_queue.cc:1059] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.057s
I20260709 12:11:39.811136 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:11:39.797749 18914 consensus_queue.cc:1175] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "65c9c1653b3346b39a0e118540e6080c" responder_term: 8 status { last_received { term: 8 index: 10 } last_committed_idx: 8 last_received_current_leader { term: 8 index: 10 } }
W20260709 12:11:39.811746 19090 log.cc:927] Time spent T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 12:11:39.711642 19034 consensus_queue.cc:260] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:39.780831 19004 raft_consensus.cc:2804] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:39.804610 19042 raft_consensus.cc:740] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:11:39.814627 19088 raft_consensus.cc:493] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:39.821506 14189 raft_consensus.cc:1275] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:11:39.814123 18987 raft_consensus.cc:493] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:39.828804 14187 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56652 (request call id 1098) took 2185 ms (client timeout 2202 ms). Trace:
I20260709 12:11:39.829562 14182 raft_consensus.cc:1275] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
W20260709 12:11:39.831549 14187 rpcz_store.cc:269] 0709 12:11:37.637897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:37.638041 (+   144us) service_pool.cc:224] Handling call
0709 12:11:39.822584 (+2184543us) spinlock_profiling.cc:243] Waited 1.77 s on lock 0x7b54003e8354. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:11:39.822726 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4060684032}
I20260709 12:11:39.829442 14186 raft_consensus.cc:2468] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 13.
I20260709 12:11:39.838768 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:39.825755 19004 raft_consensus.cc:493] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:39.839569 14333 raft_consensus.cc:2468] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 11.
W20260709 12:11:39.843307 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 134077us
W20260709 12:11:39.841491 18986 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.074s	user 0.013s	sys 0.013s
I20260709 12:11:39.827507 18789 raft_consensus.cc:493] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:39.830368 19088 raft_consensus.cc:3060] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:39.833418 18987 raft_consensus.cc:3060] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:39.835904 19000 raft_consensus.cc:493] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:39.838073 19034 raft_consensus.cc:3060] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:39.832528 19017 raft_consensus.cc:493] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:39.847903 18983 raft_consensus.cc:697] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 11 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
W20260709 12:11:39.845973 18986 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.078s	user 0.013s	sys 0.013s
I20260709 12:11:39.860962 19017 raft_consensus.cc:515] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:39.846475 19004 raft_consensus.cc:3060] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:39.871677 19093 log.cc:927] Time spent T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:11:39.872097 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:39.873566 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:39.874399 14333 raft_consensus.cc:2468] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 13.
I20260709 12:11:39.875324 19017 leader_election.cc:290] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:11:39.882787 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 108060us
I20260709 12:11:39.883765 14155 leader_election.cc:304] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:39.881927 19000 raft_consensus.cc:515] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:39.884618 18963 raft_consensus.cc:2804] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:39.885061 18963 raft_consensus.cc:493] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:39.885401 18963 raft_consensus.cc:3060] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:39.885838 19007 raft_consensus.cc:3055] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:39.886263 19007 raft_consensus.cc:740] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:39.886538 19000 leader_election.cc:290] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:39.887125 19007 consensus_queue.cc:260] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:39.888473 19007 raft_consensus.cc:3060] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:39.891170 19011 raft_consensus.cc:3055] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:11:39.891656 19011 raft_consensus.cc:740] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:11:39.851579 18789 raft_consensus.cc:515] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:39.892516 19011 consensus_queue.cc:260] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:39.853287 19042 consensus_queue.cc:260] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:39.894182 18789 leader_election.cc:290] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:39.894695 19042 raft_consensus.cc:3060] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:39.899457 18995 raft_consensus.cc:3060] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:39.901458 14155 leader_election.cc:304] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:39.905381 14909 raft_consensus.cc:2468] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 9.
W20260709 12:11:39.903122 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 47789.6us
I20260709 12:11:39.907179 14155 leader_election.cc:304] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:39.908144 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:39.909718 18967 raft_consensus.cc:493] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:39.910351 18967 raft_consensus.cc:515] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:11:39.910820 14877 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.174.131:45957 timed out after 2.412s (SENT) [suppressed 29 similar messages]
I20260709 12:11:39.912739 18967 leader_election.cc:290] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:39.919749 19051 consensus_queue.cc:1048] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:11:39.920158 18983 consensus_queue.cc:237] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:39.922442 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:39.917455 18967 raft_consensus.cc:493] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:39.923290 14181 raft_consensus.cc:2468] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 13.
I20260709 12:11:39.923468 18967 raft_consensus.cc:515] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:39.924371 18978 raft_consensus.cc:493] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:39.924938 18978 raft_consensus.cc:515] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:39.925997 18967 leader_election.cc:290] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:39.927090 18978 leader_election.cc:290] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:39.928584 14155 leader_election.cc:304] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:39.918834 14229 leader_election.cc:304] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:11:39.935242 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:39.936065 14262 raft_consensus.cc:2468] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 9.
I20260709 12:11:39.938434 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:39.938794 14260 raft_consensus.cc:1240] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:39.940948 14155 leader_election.cc:304] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:39.944550 18978 raft_consensus.cc:2749] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:39.914729 19011 raft_consensus.cc:3060] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:39.916200 18961 raft_consensus.cc:2804] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:39.951351 14188 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 2810) took 1198 ms. Trace:
I20260709 12:11:39.952903 14336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 838) took 1156 ms. Trace:
I20260709 12:11:39.957545 14336 rpcz_store.cc:276] 0709 12:11:38.796908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:38.797108 (+   200us) service_pool.cc:224] Handling call
0709 12:11:39.689815 (+892707us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:39.710905 (+ 21090us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:39.952696 (+241791us) spinlock_profiling.cc:243] Waited 891 ms on lock 0x7b540023c150. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713a8ad 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:11:39.952837 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2048576256}
I20260709 12:11:39.964403 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:39.957369 14188 rpcz_store.cc:276] 0709 12:11:38.752983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:38.753141 (+   158us) service_pool.cc:224] Handling call
0709 12:11:38.753428 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:38.824050 (+ 70622us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:38.824088 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:38.824140 (+    52us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:38.824175 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:39.951061 (+1126886us) spinlock_profiling.cc:243] Waited 70.4 ms on lock 0x7b5400110dd4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:11:39.951131 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:39.951283 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":161950976}
I20260709 12:11:39.930512 18986 raft_consensus.cc:2804] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:39.978808 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:39.955077 14155 leader_election.cc:304] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:39.979797 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:39.985364 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:39.987493 14181 raft_consensus.cc:2468] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 13.
I20260709 12:11:39.942744 18967 raft_consensus.cc:2804] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:39.914510 19057 consensus_queue.cc:1048] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.063s
I20260709 12:11:39.950886 18958 raft_consensus.cc:2749] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:40.032958 19100 raft_consensus.cc:2804] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:40.036432 19100 raft_consensus.cc:493] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:40.036850 19100 raft_consensus.cc:3060] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:40.051822 19078 log.cc:927] Time spent T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.840s	user 0.004s	sys 0.000s
I20260709 12:11:40.053011 19088 raft_consensus.cc:515] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:39.991428 18936 consensus_queue.cc:1048] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.064s
I20260709 12:11:40.062198 14334 raft_consensus.cc:2410] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:11:40.025975 19097 raft_consensus.cc:493] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:11:40.095219 19097 raft_consensus.cc:515] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:11:40.063787 14259 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41768 (request call id 1949) took 2457 ms (client timeout 1863 ms). Trace:
W20260709 12:11:40.098048 14259 rpcz_store.cc:269] 0709 12:11:37.607823 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:37.617884 (+ 10061us) service_pool.cc:224] Handling call
0709 12:11:40.063500 (+2445616us) spinlock_profiling.cc:243] Waited 840 ms on lock 0x7b5400212354. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:11:40.063679 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1932033280}
I20260709 12:11:40.067916 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:40.101791 19097 leader_election.cc:290] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:40.077291 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:40.103152 14330 raft_consensus.cc:2468] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 16.
I20260709 12:11:40.107406 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:40.077490 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:11:40.078250 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:40.078382 14188 raft_consensus.cc:1240] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:40.080659 14909 raft_consensus.cc:1240] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:11:40.081670 14911 raft_consensus.cc:1217] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 18 LEADER]: Deduplicated request from leader. Original: 12.9->[14.10-17.11]   Dedup: 17.11->[]
I20260709 12:11:40.082707 18868 raft_consensus.cc:3060] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:40.083590 14186 raft_consensus.cc:3055] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:40.084340 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:40.140182 14186 raft_consensus.cc:740] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:11:39.978614 18440 consensus_queue.cc:1059] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.065s
I20260709 12:11:40.141896 18440 raft_consensus.cc:3055] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:40.141012 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:40.142283 14336 raft_consensus.cc:1275] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
W20260709 12:11:40.140108 14302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:40.141186 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:11:40.090240 14228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:40.092526 19051 raft_consensus.cc:493] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:39.989022 18961 raft_consensus.cc:697] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 10 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:11:40.090301 18971 raft_consensus.cc:493] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:40.145473 14910 raft_consensus.cc:3060] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:40.149271 14303 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:40.141278 14186 consensus_queue.cc:260] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:11:40.160061 14303 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:40.161253 14303 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:40.151856 14911 raft_consensus.cc:1240] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 18 LEADER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 17. Current term is 18. Ops: [14.10-17.11]
I20260709 12:11:40.155929 14262 raft_consensus.cc:1275] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 12:11:40.163638 14302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:40.142230 18832 raft_consensus.cc:493] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:40.168834 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:40.102604 19018 raft_consensus.cc:493] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:40.171703 14262 raft_consensus.cc:1240] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:40.173862 14904 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8"
dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
mode: GRACEFUL
new_leader_uuid: "885067a0d31741bfb5c9935788e315bf"
 from {username='slave'} at 127.0.0.1:38628
I20260709 12:11:40.176153 14904 raft_consensus.cc:606] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 11 LEADER]: Received request to transfer leadership to TS 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:40.174940 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:40.142302 18440 raft_consensus.cc:740] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:11:40.181413 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:40.180635 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:40.070564 19012 raft_consensus.cc:2749] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:40.045544 18967 raft_consensus.cc:697] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 9 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:11:40.184302 14182 raft_consensus.cc:2468] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 8.
I20260709 12:11:40.158177 19019 raft_consensus.cc:493] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:40.158260 19007 raft_consensus.cc:493] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:40.166028 19001 raft_consensus.cc:493] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:40.194893 14189 raft_consensus.cc:1275] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:11:40.180779 19008 raft_consensus.cc:493] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:40.165478 18832 raft_consensus.cc:515] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:40.222739 14876 leader_election.cc:304] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
W20260709 12:11:40.223454 14302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:40.166014 19051 raft_consensus.cc:515] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:11:40.233870 14302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:40.233779 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:40.208847 18749 raft_consensus.cc:2804] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:40.180528 18971 raft_consensus.cc:515] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:40.243808 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 17 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:40.240160 18935 raft_consensus.cc:2804] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:40.182338 19018 raft_consensus.cc:515] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:40.244573 18961 consensus_queue.cc:237] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:40.225991 19008 raft_consensus.cc:515] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:40.263537 19008 leader_election.cc:290] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:11:40.272724 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:40.275166 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:11:40.276175 14305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:40.187306 19004 raft_consensus.cc:515] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:40.199987 19019 raft_consensus.cc:515] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:40.212307 19007 raft_consensus.cc:515] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:40.286037 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:11:40.286724 14302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:40.216389 19001 raft_consensus.cc:515] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:40.295786 19051 leader_election.cc:290] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:40.296563 18862 raft_consensus.cc:993] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db: : Instructing follower 885067a0d31741bfb5c9935788e315bf to start an election
I20260709 12:11:40.308063 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:40.296702 14904 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6"
dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
mode: GRACEFUL
new_leader_uuid: "17aab1bbf5014936aa18cc21818b26ec"
 from {username='slave'} at 127.0.0.1:38628
I20260709 12:11:40.256363 18935 raft_consensus.cc:493] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:40.306301 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:11:40.321058 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 279783us
I20260709 12:11:40.296204 19055 leader_election.cc:290] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:40.311872 14904 raft_consensus.cc:606] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Received request to transfer leadership to TS 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:11:40.314635 14229 leader_election.cc:304] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:40.344089 14904 raft_consensus.cc:614] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:40.315377 14230 leader_election.cc:304] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:11:40.309495 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:40.401129 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:40.403437 14258 raft_consensus.cc:3060] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:40.401105 14229 leader_election.cc:304] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:40.422490 14877 leader_election.cc:304] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:40.426541 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:40.427109 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:40.427685 14182 raft_consensus.cc:2376] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 11. Re-sending same reply.
I20260709 12:11:40.409915 19000 raft_consensus.cc:2804] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:40.430794 14907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:11:40.431708 14907 raft_consensus.cc:2393] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 14: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
I20260709 12:11:40.431937 19018 leader_election.cc:290] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:40.432700 14907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:40.437929 14260 raft_consensus.cc:2410] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db for term 17 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 12:11:40.438401 14256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41764 (request call id 2832) took 3106 ms. Trace:
I20260709 12:11:40.438865 14256 rpcz_store.cc:276] 0709 12:11:37.331859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:37.331994 (+   135us) service_pool.cc:224] Handling call
0709 12:11:37.332374 (+   380us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:39.475831 (+2143457us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:40.438061 (+962230us) spinlock_profiling.cc:243] Waited 2.14 s on lock 0x7b54001b26d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:11:40.438285 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4927862144}
I20260709 12:11:40.440461 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
W20260709 12:11:40.441604 18963 consensus_meta.cc:287] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.556s	user 0.008s	sys 0.003s
I20260709 12:11:40.442378 18993 raft_consensus.cc:2749] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:40.442178 18963 raft_consensus.cc:515] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:40.321445 18935 raft_consensus.cc:3060] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:40.446132 14336 raft_consensus.cc:1275] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:11:40.450810 14187 raft_consensus.cc:2368] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for earlier term 12. Current term is 13.
I20260709 12:11:40.307324 18986 raft_consensus.cc:697] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 13 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:11:40.457365 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:40.458416 14335 raft_consensus.cc:2393] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db in current term 12: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:11:40.459646 18940 raft_consensus.cc:2749] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:11:40.466579 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:40.255551 18440 consensus_queue.cc:260] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:40.453233 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:40.419144 19008 raft_consensus.cc:493] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:40.401883 19012 raft_consensus.cc:493] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:40.429375 18936 consensus_queue.cc:1048] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.077s
I20260709 12:11:40.424708 18862 raft_consensus.cc:1081] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 11 LEADER]: Signalling peer 885067a0d31741bfb5c9935788e315bf to start an election
I20260709 12:11:40.524840 14258 raft_consensus.cc:2468] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 14.
I20260709 12:11:40.283774 18967 consensus_queue.cc:237] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:11:40.487411 18907 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.805s	user 0.066s	sys 0.038s
I20260709 12:11:40.483842 19018 raft_consensus.cc:2804] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:40.292235 18987 raft_consensus.cc:515] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:40.454396 19057 raft_consensus.cc:493] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:40.487809 19042 raft_consensus.cc:493] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:40.475932 19088 leader_election.cc:290] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:40.509477 18786 raft_consensus.cc:493] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:40.322333 19051 consensus_queue.cc:1059] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.165s
I20260709 12:11:40.536413 14908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:40.538122 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:40.540515 14905 raft_consensus.cc:1240] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 10. Current term is 11. Ops: []
W20260709 12:11:40.536114 18907 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.892s	user 0.067s	sys 0.038s
I20260709 12:11:40.553109 14258 raft_consensus.cc:3060] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:40.557655 14302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:40.542644 19018 raft_consensus.cc:493] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:40.535858 18958 raft_consensus.cc:493] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:40.560289 14257 raft_consensus.cc:1240] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 12:11:40.558828 19018 raft_consensus.cc:3060] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:40.568286 14155 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.579s	user 0.093s	sys 0.093s
W20260709 12:11:40.568675 14155 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.579s	user 0.093s	sys 0.093s
W20260709 12:11:40.569343 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 614337us
W20260709 12:11:40.561193 14332 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55492 (request call id 836) took 1884 ms (client timeout 2412 ms). Trace:
I20260709 12:11:40.564107 18653 raft_consensus.cc:3055] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:40.564522 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:38.857537 14183 rpcz_store.cc:276] 0709 12:11:36.586446 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:36.718831 (+132385us) service_pool.cc:224] Handling call
0709 12:11:36.719477 (+   646us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:36.747672 (+ 28195us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:11:36.822913 (+ 75241us) log.cc:844] Serialized 14 byte log entry
0709 12:11:38.653166 (+1830253us) spinlock_profiling.cc:243] Waited 2.11 ms on lock 0x7b180038bae0. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f212cf16ab1 00007f212cf23281 00007f2124030e07 00007f212ce8b9a9 00007f212404d69b 00007f212404b93f 00007f212404dc02 00007f2126cd520b 00007f2126cdad23 00007f2126cdb23a 00007f2127145a2a
0709 12:11:38.841768 (+188602us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:38.841827 (+    59us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:38.841876 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:38.841943 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:38.842070 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":74954,"prepare.run_cpu_time_us":123,"prepare.run_wall_time_us":60,"raft.queue_time_us":74274,"spinlock_wait_cycles":4846848,"thread_start_us":181639,"threads_started":1}
W20260709 12:11:40.570329 14332 rpcz_store.cc:269] 0709 12:11:38.676544 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:38.676765 (+   221us) service_pool.cc:224] Handling call
0709 12:11:40.560969 (+1884204us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b5400019d54. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:11:40.561129 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2417646976}
I20260709 12:11:40.571455 18653 raft_consensus.cc:740] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
W20260709 12:11:40.574373 19107 log.cc:927] Time spent T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 12:11:40.574527 18653 consensus_queue.cc:260] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:40.532807 19012 raft_consensus.cc:515] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:40.533236 19008 raft_consensus.cc:515] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:40.591055 14910 raft_consensus.cc:2410] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 12:11:40.600970 14908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:11:40.568545 18832 leader_election.cc:290] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:40.551939 19042 raft_consensus.cc:515] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:40.556540 19019 leader_election.cc:290] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:40.555513 19057 raft_consensus.cc:515] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:40.607507 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:40.559171 18786 raft_consensus.cc:515] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:40.615880 14908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:40.572701 18958 raft_consensus.cc:515] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:11:40.621014 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 400095us
I20260709 12:11:40.597260 19088 consensus_queue.cc:1059] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 12:11:40.613101 18653 raft_consensus.cc:3060] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:40.629177 14912 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183"
dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
mode: GRACEFUL
new_leader_uuid: "885067a0d31741bfb5c9935788e315bf"
 from {username='slave'} at 127.0.0.1:38628
I20260709 12:11:40.631807 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:40.632483 14912 raft_consensus.cc:606] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 11 LEADER]: Received request to transfer leadership to TS 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:40.613886 19004 leader_election.cc:290] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:40.615113 18963 leader_election.cc:290] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 13 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:40.636605 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:40.636863 14908 raft_consensus.cc:1240] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:40.619029 19007 leader_election.cc:290] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:40.578231 14155 leader_election.cc:304] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:40.639539 14188 raft_consensus.cc:2393] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 9: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:11:40.639925 14303 leader_election.cc:304] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
W20260709 12:11:40.640213 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 236959us
I20260709 12:11:40.643965 14229 leader_election.cc:304] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:40.628516 19001 leader_election.cc:290] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:40.599100 18986 consensus_queue.cc:237] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:40.646505 14258 raft_consensus.cc:2468] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 12.
W20260709 12:11:40.649108 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:40.648084 14229 leader_election.cc:304] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
W20260709 12:11:40.649893 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 334603us
I20260709 12:11:40.653981 14230 leader_election.cc:304] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:11:40.655592 14304 leader_election.cc:304] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
W20260709 12:11:40.651001 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 72877.3us
I20260709 12:11:40.659029 14230 leader_election.cc:304] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:11:40.659554 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:40.660179 14230 leader_election.cc:304] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:40.660987 18708 consensus_queue.cc:1048] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:40.661360 19051 raft_consensus.cc:2804] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:40.634083 19000 raft_consensus.cc:697] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 11 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:11:40.666357 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:40.673305 14262 raft_consensus.cc:2393] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 12: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:11:40.674113 19034 consensus_queue.cc:1048] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:40.675760 12986 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:11:40.679479 19000 consensus_queue.cc:237] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:40.660418 19088 raft_consensus.cc:2749] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:40.649530 19007 raft_consensus.cc:2749] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:40.682224 19012 leader_election.cc:290] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:40.683648 19057 leader_election.cc:290] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:40.662804 18907 raft_consensus.cc:2804] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:40.687528 18907 raft_consensus.cc:493] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:40.687934 18907 raft_consensus.cc:3060] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:40.664772 19011 raft_consensus.cc:2804] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:40.690053 19011 raft_consensus.cc:493] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:40.690418 19011 raft_consensus.cc:3060] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:40.691661 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:40.693130 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:40.694416 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:40.695036 14259 raft_consensus.cc:2468] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 13.
I20260709 12:11:40.695916 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:40.697021 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:40.642055 18945 consensus_queue.cc:1059] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 12:11:40.673854 19006 consensus_queue.cc:1048] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 12:11:40.699256 18945 raft_consensus.cc:3055] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:40.699633 18945 raft_consensus.cc:740] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:40.672209 19055 raft_consensus.cc:2804] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:40.702901 14259 raft_consensus.cc:2410] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 12:11:40.667585 14229 leader_election.cc:304] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
W20260709 12:11:40.704990 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:40.651577 18832 raft_consensus.cc:2804] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:40.667924 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:40.736683 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
W20260709 12:11:40.737452 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 68101.8us
W20260709 12:11:40.738127 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 70619.4us
I20260709 12:11:40.738844 14229 leader_election.cc:304] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:40.737668 14258 raft_consensus.cc:2393] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 14: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
I20260709 12:11:40.739169 14304 leader_election.cc:304] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:11:40.740154 14303 leader_election.cc:304] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
W20260709 12:11:40.709870 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 287468us
I20260709 12:11:40.661103 19113 raft_consensus.cc:2749] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:40.743041 14230 leader_election.cc:304] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:40.778614 14877 leader_election.cc:304] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:40.739455 14155 leader_election.cc:304] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:40.780809 14877 leader_election.cc:304] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:40.744891 14229 leader_election.cc:304] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
W20260709 12:11:40.750382 14228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:40.672276 19104 log.cc:927] Time spent T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 12:11:40.665567 19051 raft_consensus.cc:493] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:40.783375 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:40.757779 18832 raft_consensus.cc:493] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:40.785851 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
W20260709 12:11:40.787038 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 46998us
I20260709 12:11:40.671307 18935 raft_consensus.cc:515] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:11:40.736239 19114 log.cc:927] Time spent T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:11:40.708725 18970 raft_consensus.cc:2749] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:40.708618 19055 raft_consensus.cc:697] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 12 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:40.835004 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:40.797432 14303 leader_election.cc:304] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:40.776222 18724 raft_consensus.cc:2804] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:40.736254 18987 leader_election.cc:290] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:40.700778 18945 consensus_queue.cc:260] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:11:40.846817 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 49469.3us
I20260709 12:11:40.845335 14155 leader_election.cc:304] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:40.866482 14907 raft_consensus.cc:2393] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 9: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
I20260709 12:11:40.866444 14303 leader_election.cc:304] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:40.787698 18940 raft_consensus.cc:2749] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:40.789481 18832 raft_consensus.cc:3060] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:40.792183 19012 raft_consensus.cc:2804] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:40.870196 19055 consensus_queue.cc:237] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:40.870877 19012 raft_consensus.cc:493] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:40.871338 19012 raft_consensus.cc:3060] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:40.874619 14187 raft_consensus.cc:1240] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 13 LEADER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:40.876787 19113 raft_consensus.cc:2804] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:40.877259 19113 raft_consensus.cc:493] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:40.869490 18987 raft_consensus.cc:2749] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:40.878851 18958 leader_election.cc:290] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:40.795585 19117 raft_consensus.cc:2749] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:40.882074 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:40.884670 14335 raft_consensus.cc:2468] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 15.
I20260709 12:11:40.886044 19088 raft_consensus.cc:2804] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:40.886894 19088 raft_consensus.cc:493] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:40.887295 19088 raft_consensus.cc:3060] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:40.886106 19034 raft_consensus.cc:2749] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:11:40.889024 18935 leader_election.cc:290] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 9 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:40.890087 18786 leader_election.cc:290] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:40.892038 19008 leader_election.cc:290] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:40.892765 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:40.896350 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:11:40.899155 14305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:40.877604 19113 raft_consensus.cc:3060] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:40.795135 19006 raft_consensus.cc:2749] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:40.847397 18724 raft_consensus.cc:493] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:40.847654 19007 raft_consensus.cc:2749] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:11:40.915800 18868 consensus_meta.cc:287] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.769s	user 0.013s	sys 0.000s
I20260709 12:11:40.916885 14337 raft_consensus.cc:1275] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:11:40.920133 18832 raft_consensus.cc:515] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:40.917662 18989 raft_consensus.cc:493] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:40.927275 18989 raft_consensus.cc:515] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:11:40.929584 19100 consensus_meta.cc:287] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.892s	user 0.011s	sys 0.002s
I20260709 12:11:40.930161 19100 raft_consensus.cc:515] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:40.931509 18832 leader_election.cc:290] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:40.901553 18808 consensus_queue.cc:1059] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 12:11:40.906309 18724 raft_consensus.cc:3060] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:40.933220 14181 raft_consensus.cc:2393] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 9: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:11:40.796136 19112 consensus_queue.cc:1059] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.117s
W20260709 12:11:40.949084 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 103846us
I20260709 12:11:40.948987 14338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 848) took 1039 ms. Trace:
I20260709 12:11:40.768013 14188 raft_consensus.cc:2468] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 13.
I20260709 12:11:40.951416 14338 rpcz_store.cc:276] 0709 12:11:39.909260 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:39.909383 (+   123us) service_pool.cc:224] Handling call
0709 12:11:39.909663 (+   280us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:39.910050 (+   387us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:39.910076 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:39.910556 (+   480us) log.cc:844] Serialized 26 byte log entry
0709 12:11:40.169126 (+258570us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:40.169169 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:40.169233 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:40.948694 (+779461us) raft_consensus.cc:1685] finished
0709 12:11:40.948720 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:40.948896 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":378,"raft.run_cpu_time_us":57,"raft.run_wall_time_us":57,"thread_start_us":258113,"threads_started":1,"wal-append.queue_time_us":649178}
I20260709 12:11:40.952764 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:40.955595 14188 raft_consensus.cc:3060] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:40.961596 14155 leader_election.cc:304] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
W20260709 12:11:40.819921 14302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:40.971859 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 191121us
W20260709 12:11:40.974635 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 91238.2us
I20260709 12:11:40.980623 14260 raft_consensus.cc:1240] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 15. Current term is 16. Ops: []
I20260709 12:11:40.881080 19012 raft_consensus.cc:515] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:40.982919 14303 leader_election.cc:304] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:40.932585 19100 leader_election.cc:290] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 9 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:11:40.988245 14302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:40.790602 19051 raft_consensus.cc:3060] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:41.002427 14303 leader_election.cc:304] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:40.992141 14877 leader_election.cc:304] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:41.000097 19008 raft_consensus.cc:2749] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:11:41.005458 19100 raft_consensus.cc:2804] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:41.005939 19100 raft_consensus.cc:493] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:41.006335 19100 raft_consensus.cc:3060] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:41.006731 14303 leader_election.cc:400] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 12 pre-election: Vote denied by peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187) with higher term. Message: Invalid argument: T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for earlier term 12. Current term is 13.
I20260709 12:11:41.007072 14303 leader_election.cc:403] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:41.010618 19034 raft_consensus.cc:2749] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:41.011395 19034 raft_consensus.cc:3060] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:11:41.011402 19042 leader_election.cc:290] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:41.011472 19112 raft_consensus.cc:2749] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:11:41.015491 19110 raft_consensus.cc:3055] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:41.017171 19110 raft_consensus.cc:740] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:11:41.017364 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
W20260709 12:11:41.020013 19101 log.cc:927] Time spent T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 1.046s	user 0.002s	sys 0.002s
I20260709 12:11:41.022362 19110 consensus_queue.cc:260] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:41.025408 18786 consensus_queue.cc:1059] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:41.026309 18786 consensus_queue.cc:1243] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer 885067a0d31741bfb5c9935788e315bf log is divergent from this leader: its last log entry 13.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:11:41.026362 19034 raft_consensus.cc:2749] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187) with higher term. Message: Invalid argument: T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for earlier term 12. Current term is 13.
I20260709 12:11:41.026993 18708 raft_consensus.cc:3055] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:41.027382 18708 raft_consensus.cc:740] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:41.028394 18708 consensus_queue.cc:260] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:41.029440 18708 raft_consensus.cc:3060] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:41.032778 14185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56046 (request call id 2407) took 1373 ms. Trace:
I20260709 12:11:41.035357 19011 raft_consensus.cc:515] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:41.031286 19012 leader_election.cc:290] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:41.032078 14261 raft_consensus.cc:1240] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 11 LEADER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 10. Current term is 11. Ops: []
W20260709 12:11:41.043361 19105 log.cc:927] Time spent T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.511s	user 0.000s	sys 0.002s
I20260709 12:11:41.041725 14303 leader_election.cc:304] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
W20260709 12:11:41.045338 19109 log.cc:927] Time spent T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.508s	user 0.002s	sys 0.000s
I20260709 12:11:41.047235 14154 leader_election.cc:304] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:41.049124 14182 raft_consensus.cc:1240] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 11. Current term is 12. Ops: []
W20260709 12:11:41.029028 14330 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50856 (request call id 2321) took 1238 ms (client timeout 1556 ms). Trace:
W20260709 12:11:41.049893 14330 rpcz_store.cc:269] 0709 12:11:39.790738 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:39.794694 (+  3956us) service_pool.cc:224] Handling call
0709 12:11:41.028829 (+1234135us) spinlock_profiling.cc:243] Waited 307 ms on lock 0x7b54000fd7d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:11:41.028955 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":706614016}
I20260709 12:11:41.050930 14303 leader_election.cc:304] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:41.056874 14260 raft_consensus.cc:1240] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 12. Current term is 13. Ops: []
W20260709 12:11:41.057699 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 312884us
I20260709 12:11:40.986039 18936 raft_consensus.cc:2804] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:41.062134 14154 leader_election.cc:304] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:41.063607 19012 raft_consensus.cc:2749] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:11:40.989850 18958 raft_consensus.cc:493] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:41.033202 14185 rpcz_store.cc:276] 0709 12:11:39.659059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:39.805593 (+146534us) service_pool.cc:224] Handling call
0709 12:11:39.805982 (+   389us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:40.193263 (+387281us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:11:40.193299 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:40.193346 (+    47us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:40.193387 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:41.032513 (+839126us) spinlock_profiling.cc:243] Waited 387 ms on lock 0x7b54003b2754. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:11:41.032563 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:41.032713 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1110,"raft.run_cpu_time_us":188,"raft.run_wall_time_us":15875,"spinlock_wait_cycles":889766784}
I20260709 12:11:40.981367 18986 consensus_queue.cc:1059] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.078s
I20260709 12:11:41.070870 14154 leader_election.cc:304] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:41.045956 18981 raft_consensus.cc:2749] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:41.105890 14260 raft_consensus.cc:1275] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:41.107564 14257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41768 (request call id 1970) took 1173 ms. Trace:
I20260709 12:11:41.108168 14257 rpcz_store.cc:276] 0709 12:11:39.934438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:39.934572 (+   134us) service_pool.cc:224] Handling call
0709 12:11:39.934967 (+   395us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:40.566807 (+631840us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:41.107291 (+540484us) spinlock_profiling.cc:243] Waited 625 ms on lock 0x7b54002008d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:11:41.107493 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1437524736}
I20260709 12:11:41.109448 19024 raft_consensus.cc:3055] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:41.109932 19024 raft_consensus.cc:740] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:11:41.110044 14182 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8"
dest_uuid: "885067a0d31741bfb5c9935788e315bf"
 from {username='slave'} at 127.0.0.1:56652
I20260709 12:11:41.110750 14182 raft_consensus.cc:493] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:41.111152 14182 raft_consensus.cc:3060] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:41.110942 19024 consensus_queue.cc:260] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:41.112383 19024 raft_consensus.cc:3060] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:41.059306 19008 raft_consensus.cc:2749] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:41.118175 14154 leader_election.cc:304] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:41.066445 19011 leader_election.cc:290] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 13 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:11:41.110806 19108 log.cc:927] Time spent T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.596s	user 0.000s	sys 0.004s
I20260709 12:11:41.130244 18981 consensus_queue.cc:1059] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:41.131242 18981 consensus_queue.cc:1243] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer 885067a0d31741bfb5c9935788e315bf log is divergent from this leader: its last log entry 10.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:11:41.131814 18981 raft_consensus.cc:3055] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:41.114464 18936 raft_consensus.cc:697] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 14 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
W20260709 12:11:41.084673 19099 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.108s	user 0.014s	sys 0.027s
W20260709 12:11:41.132964 19099 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.157s	user 0.015s	sys 0.027s
W20260709 12:11:41.085126 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 342156us
W20260709 12:11:41.089365 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 127831us
I20260709 12:11:41.133679 18936 consensus_queue.cc:237] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:41.107602 19100 raft_consensus.cc:515] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:41.092505 14188 raft_consensus.cc:2468] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 9.
I20260709 12:11:41.137053 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:41.137881 14876 leader_election.cc:304] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:41.097456 19007 raft_consensus.cc:493] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:11:41.138578 19011 consensus_queue.cc:1048] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:41.139169 19007 raft_consensus.cc:515] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:41.139619 18813 consensus_queue.cc:1059] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:41.140499 19128 raft_consensus.cc:3055] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:41.140902 19128 raft_consensus.cc:740] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:11:40.989814 18868 consensus_queue.cc:1048] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.078s
I20260709 12:11:41.137722 14188 raft_consensus.cc:3060] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:41.142163 18992 raft_consensus.cc:2749] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:41.141829 19128 consensus_queue.cc:260] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:41.143244 19128 raft_consensus.cc:3060] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:41.143747 18722 raft_consensus.cc:2804] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:41.144268 18722 raft_consensus.cc:697] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [term 9 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:11:41.145201 18722 consensus_queue.cc:237] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:41.139297 14230 leader_election.cc:304] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:41.147069 19011 raft_consensus.cc:2749] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:41.148892 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:41.149658 14184 raft_consensus.cc:2468] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 11.
I20260709 12:11:41.150364 14230 leader_election.cc:304] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:41.151355 14184 raft_consensus.cc:1275] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:11:41.151938 19011 raft_consensus.cc:2804] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:41.152458 19011 raft_consensus.cc:493] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:41.152900 19011 raft_consensus.cc:3060] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:41.159065 18907 raft_consensus.cc:515] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:41.163646 19099 consensus_queue.cc:1048] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:11:41.165982 18813 consensus_queue.cc:1048] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:41.166985 18989 leader_election.cc:290] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:11:41.167454 14334 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55492 (request call id 845) took 1493 ms (client timeout 1940 ms). Trace:
W20260709 12:11:41.167899 14334 rpcz_store.cc:269] 0709 12:11:39.673635 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:39.680950 (+  7315us) service_pool.cc:224] Handling call
0709 12:11:41.167254 (+1486304us) spinlock_profiling.cc:243] Waited 360 ms on lock 0x7b540024fed4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:11:41.167388 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":827660160}
W20260709 12:11:41.171110 14305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:41.174269 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:41.174604 14188 raft_consensus.cc:2468] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 14.
I20260709 12:11:41.175300 14187 raft_consensus.cc:1240] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 8. Current term is 9. Ops: []
W20260709 12:11:41.116036 19018 consensus_meta.cc:287] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.531s	user 0.012s	sys 0.000s
I20260709 12:11:41.173822 14230 leader_election.cc:304] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:11:41.181346 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:41.181901 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:41.182093 14330 raft_consensus.cc:2468] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 10.
I20260709 12:11:41.086946 18963 raft_consensus.cc:2749] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:41.083662 19057 raft_consensus.cc:3060] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:41.083431 19034 raft_consensus.cc:493] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:41.167008 14181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56044 (request call id 2812) took 1090 ms. Trace:
W20260709 12:11:41.115656 19109 log.cc:927] Time spent T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:11:41.132135 18749 raft_consensus.cc:493] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:41.182853 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:41.194593 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:41.161521 18907 leader_election.cc:290] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 13 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:41.185117 14230 leader_election.cc:304] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:11:41.189246 14334 raft_consensus.cc:1275] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:11:41.202102 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:41.068503 14229 leader_election.cc:304] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:41.083765 18958 raft_consensus.cc:515] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:41.144351 19049 raft_consensus.cc:3055] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:41.137465 19100 leader_election.cc:290] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 15 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:41.184059 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:41.213640 14330 raft_consensus.cc:3060] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:11:41.196310 14183 raft_consensus.cc:1240] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 10 LEADER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:41.198648 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:11:41.203274 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 134859us
I20260709 12:11:41.216311 14229 leader_election.cc:304] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:41.217494 14229 leader_election.cc:304] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:41.203423 14339 raft_consensus.cc:1240] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:41.204890 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:41.218556 14334 raft_consensus.cc:3060] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:41.207439 14190 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 2798) took 3293 ms. Trace:
I20260709 12:11:41.220541 14332 raft_consensus.cc:2468] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 15.
I20260709 12:11:41.132164 18981 raft_consensus.cc:740] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:41.191879 19128 raft_consensus.cc:493] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:41.197101 18749 raft_consensus.cc:3060] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:41.205493 19136 raft_consensus.cc:493] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:41.207955 19000 raft_consensus.cc:2804] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:41.190917 19041 raft_consensus.cc:2804] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:11:41.219491 14190 rpcz_store.cc:276] 0709 12:11:37.913987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:37.914133 (+   146us) service_pool.cc:224] Handling call
0709 12:11:37.914492 (+   359us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:37.914891 (+   399us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:11:37.977264 (+ 62373us) log.cc:844] Serialized 14 byte log entry
0709 12:11:38.337444 (+360180us) spinlock_profiling.cc:243] Waited 9.58 ms on lock 0x7b18000cfbe0. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f212cf16ab1 00007f212cf23281 00007f212404e522 00007f21240507c1 00007f2124050779 00007f2124050709 00007f21240506d1 00007f212404f9cd 0000000000388634 0000000000388479 00007f212403183a
0709 12:11:39.949940 (+1612496us) spinlock_profiling.cc:243] Waited 3.13 ms on lock 0x7b18000cfbe0. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f212cf16ab1 00007f212cf23281 00007f2126ce34bc 00007f212403148b 00007f212ce8b9a9 00007f212404d69b 00007f212404b93f 00007f212404dc02 00007f2126cd520b 00007f2126cdad23 00007f2126cdb23a
0709 12:11:39.974408 (+ 24468us) log.cc:844] Serialized 14 byte log entry
0709 12:11:40.184900 (+210492us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:40.188853 (+  3953us) log.cc:844] Serialized 26 byte log entry
0709 12:11:40.199082 (+ 10229us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:40.199135 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:40.199273 (+   138us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:41.069341 (+870068us) spinlock_profiling.cc:243] Waited 3.15 ms on lock 0x7b4400022b4c. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2123f74c85 00007f2123f756a2 00007f2126ce71db 00007f2126ce2aaf 00007f2126cd686e 00007f2126cd5bb6 00007f2126cd57d8 00007f2126cdf221 00007f2126cdf1d9 00007f2126cdf169
0709 12:11:41.207180 (+137839us) raft_consensus.cc:1685] finished
0709 12:11:41.207207 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:41.207363 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6005,"prepare.queue_time_us":130281,"prepare.run_cpu_time_us":147,"prepare.run_wall_time_us":3245,"raft.queue_time_us":5706,"raft.run_cpu_time_us":344,"raft.run_wall_time_us":19278,"spinlock_wait_cycles":76546304,"thread_start_us":317918,"threads_started":3,"wal-append.queue_time_us":988075,"wal-append.run_cpu_time_us":3063,"wal-append.run_wall_time_us":1495500}
I20260709 12:11:41.279366 14190 raft_consensus.cc:1240] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:11:41.205547 19080 raft_consensus.cc:2804] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:41.190037 14181 rpcz_store.cc:276] 0709 12:11:40.076824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:40.076969 (+   145us) service_pool.cc:224] Handling call
0709 12:11:41.166768 (+1089799us) spinlock_profiling.cc:243] Waited 830 ms on lock 0x7b540019c3d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:11:41.166939 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1909480832}
I20260709 12:11:41.230120 14155 leader_election.cc:304] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
W20260709 12:11:41.288515 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 58524.1us
I20260709 12:11:41.205470 19008 raft_consensus.cc:493] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:11:41.189108 19018 raft_consensus.cc:515] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:41.233606 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:41.230027 14332 raft_consensus.cc:1275] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:11:41.197659 19034 raft_consensus.cc:515] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:41.235047 14331 raft_consensus.cc:1240] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 12 LEADER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 12:11:41.235704 14229 leader_election.cc:304] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:41.236406 19131 consensus_queue.cc:1048] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:11:41.192803 19113 raft_consensus.cc:515] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:41.208015 19049 raft_consensus.cc:740] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:11:41.213990 18935 raft_consensus.cc:3055] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:11:41.301358 14305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:41.301994 14330 raft_consensus.cc:2468] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 13.
I20260709 12:11:41.225695 18907 raft_consensus.cc:2749] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:11:41.307585 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 72006.2us
I20260709 12:11:41.333945 14229 leader_election.cc:304] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:41.225785 18862 raft_consensus.cc:493] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:41.320112 14334 raft_consensus.cc:2468] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 12.
I20260709 12:11:41.234370 18967 raft_consensus.cc:2749] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:41.287602 19041 raft_consensus.cc:493] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:41.277148 19000 raft_consensus.cc:493] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:41.298362 19080 raft_consensus.cc:493] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:41.335345 14229 leader_election.cc:304] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:41.226019 18892 consensus_queue.cc:1048] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.104s
I20260709 12:11:41.351974 14256 raft_consensus.cc:2393] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 13: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:11:41.303124 18963 raft_consensus.cc:2804] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:41.359705 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:41.225417 18981 consensus_queue.cc:260] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:41.334635 19130 raft_consensus.cc:2804] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:41.281517 19120 consensus_queue.cc:1048] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.065s
I20260709 12:11:41.310554 19008 raft_consensus.cc:515] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:41.327801 18935 raft_consensus.cc:740] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:11:41.229982 19011 raft_consensus.cc:515] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:41.359939 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
W20260709 12:11:41.391463 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 56203.5us
I20260709 12:11:41.377480 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:11:41.401067 14229 leader_election.cc:304] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:41.377787 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:11:41.232947 19128 raft_consensus.cc:515] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:41.400096 14903 raft_consensus.cc:2468] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 9.
I20260709 12:11:41.396548 14182 raft_consensus.cc:515] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:11:41.371201 19127 log.cc:927] Time spent T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.161s	user 0.000s	sys 0.000s
W20260709 12:11:41.405902 14156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:41.413798 14184 raft_consensus.cc:1240] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 11. Current term is 12. Ops: []
W20260709 12:11:41.362269 19132 log.cc:927] Time spent T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.173s	user 0.000s	sys 0.000s
W20260709 12:11:41.370530 19124 log.cc:927] Time spent T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.246s	user 0.000s	sys 0.001s
I20260709 12:11:41.354545 19041 raft_consensus.cc:3060] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:41.358389 19080 raft_consensus.cc:3060] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:41.356791 18832 raft_consensus.cc:2804] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:41.354031 19000 raft_consensus.cc:3060] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:41.414932 18963 raft_consensus.cc:697] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 15 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
W20260709 12:11:41.412635 19125 log.cc:927] Time spent T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.233s	user 0.001s	sys 0.001s
W20260709 12:11:41.437575 19106 log.cc:927] Time spent T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 1.142s	user 0.003s	sys 0.002s
I20260709 12:11:41.436980 19049 consensus_queue.cc:260] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:41.362883 18981 raft_consensus.cc:3060] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:41.550164 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:41.550920 14911 raft_consensus.cc:2468] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 11.
I20260709 12:11:41.405681 14303 leader_election.cc:304] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
W20260709 12:11:41.553261 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 147725us
I20260709 12:11:41.554114 14303 leader_election.cc:304] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:11:41.383708 19034 leader_election.cc:290] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:11:41.412807 19135 log.cc:927] Time spent T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 12:11:41.388692 19113 leader_election.cc:290] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 13 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:41.385264 19008 leader_election.cc:290] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:41.453701 14154 leader_election.cc:304] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:41.506480 18986 consensus_queue.cc:1048] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 12:11:41.286530 19136 raft_consensus.cc:515] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:41.511662 14182 leader_election.cc:290] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:41.386560 19018 leader_election.cc:290] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 11 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:41.387385 18978 raft_consensus.cc:493] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:11:41.407281 19118 raft_consensus.cc:2804] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:41.407424 19130 raft_consensus.cc:697] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 13 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:11:41.559842 19131 raft_consensus.cc:2749] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:41.592985 19055 raft_consensus.cc:2804] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:11:41.547588 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 146654us
I20260709 12:11:41.622437 18936 raft_consensus.cc:493] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:11:41.623054 18936 raft_consensus.cc:515] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:41.624579 14182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:56652 (request call id 1118) took 1081 ms. Trace:
I20260709 12:11:41.625054 14182 rpcz_store.cc:276] 0709 12:11:40.550010 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:41.109851 (+559841us) service_pool.cc:224] Handling call
0709 12:11:41.624445 (+514594us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:11:41.548146 14305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:41.352499 18862 raft_consensus.cc:515] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:41.545449 14907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:41.557667 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:41.558372 14303 leader_election.cc:304] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
W20260709 12:11:41.597043 14230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:41.527968 18958 leader_election.cc:290] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:11:41.598691 14263 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.512s	user 0.076s	sys 0.133s
W20260709 12:11:41.484938 14302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:41.544056 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 539773us
I20260709 12:11:41.596342 19001 raft_consensus.cc:2804] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:41.599882 19049 raft_consensus.cc:3060] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:11:41.628103 14905 raft_consensus.cc:2468] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 16.
I20260709 12:11:41.633981 14909 raft_consensus.cc:1240] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [term 9 LEADER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 8. Current term is 9. Ops: []
W20260709 12:11:41.635594 14305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:41.636731 18724 consensus_meta.cc:287] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.697s	user 0.010s	sys 0.002s
I20260709 12:11:41.637660 14229 leader_election.cc:304] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:41.638235 19113 raft_consensus.cc:493] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:41.621615 19055 raft_consensus.cc:493] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:41.642387 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 84122.8us
I20260709 12:11:41.642982 19034 raft_consensus.cc:3060] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:41.644295 14302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:41.611032 19118 raft_consensus.cc:493] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
W20260709 12:11:41.633158 19088 consensus_meta.cc:287] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.745s	user 0.009s	sys 0.004s
I20260709 12:11:41.712635 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:41.662611 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:41.713186 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:41.718510 14260 raft_consensus.cc:3060] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:41.625631 18936 leader_election.cc:290] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:41.724359 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:41.556278 18935 consensus_queue.cc:260] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:41.664322 14877 leader_election.cc:304] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:41.615126 18978 raft_consensus.cc:515] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:11:41.713613 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:41.725095 14182 raft_consensus.cc:2468] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 11.
W20260709 12:11:41.663486 19134 log.cc:927] Time spent T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 12:11:41.654551 18813 raft_consensus.cc:2749] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:11:41.725988 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 61867.1us
W20260709 12:11:41.740252 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 79856.2us
I20260709 12:11:41.665529 19055 raft_consensus.cc:3060] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:41.663661 19144 raft_consensus.cc:2749] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:41.656163 19001 raft_consensus.cc:697] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 14 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:41.743521 14303 leader_election.cc:304] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:41.744072 14335 raft_consensus.cc:1275] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:11:41.648303 19143 raft_consensus.cc:493] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:11:41.745594 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:41.770138 14257 raft_consensus.cc:2393] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 15: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:11:41.715440 19118 raft_consensus.cc:3060] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:41.663604 19151 raft_consensus.cc:493] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:11:41.756640 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:41.771030 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:41.774204 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: true dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:41.659703 18724 raft_consensus.cc:515] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:41.660301 18722 consensus_queue.cc:1048] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.085s
I20260709 12:11:41.666414 19113 raft_consensus.cc:515] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:41.746066 18936 raft_consensus.cc:2749] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:41.722988 18708 consensus_queue.cc:1059] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 12:11:41.779151 14335 raft_consensus.cc:1240] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 11. Current term is 12. Ops: []
W20260709 12:11:41.769937 19024 consensus_meta.cc:287] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db: Time spent flushing consensus metadata: real 0.657s	user 0.015s	sys 0.001s
W20260709 12:11:41.788830 14154 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 335239us
I20260709 12:11:41.797155 14335 raft_consensus.cc:1240] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:41.725214 19088 raft_consensus.cc:515] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:41.766207 18986 raft_consensus.cc:493] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:11:41.773252 18892 raft_consensus.cc:493] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:41.777063 18813 raft_consensus.cc:493] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:41.658983 18963 consensus_queue.cc:237] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:41.827159 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: true dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:11:41.814471 14333 raft_consensus.cc:2393] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 14: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:11:41.827838 14903 raft_consensus.cc:3055] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:41.828141 14903 raft_consensus.cc:740] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:11:41.840525 14155 leader_election.cc:304] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:41.842196 14155 leader_election.cc:304] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:41.804406 19128 leader_election.cc:290] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:41.805841 19158 raft_consensus.cc:493] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:41.837451 18708 raft_consensus.cc:3055] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:41.835915 14903 consensus_queue.cc:260] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:41.758154 19130 consensus_queue.cc:237] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:41.826792 19024 raft_consensus.cc:493] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:41.776260 19143 raft_consensus.cc:515] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:41.827229 19011 leader_election.cc:290] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 14 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:41.863514 14903 raft_consensus.cc:3060] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:41.784282 19151 raft_consensus.cc:515] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:41.816110 19164 raft_consensus.cc:2804] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:41.850378 19156 raft_consensus.cc:493] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:41.867579 19138 log.cc:927] Time spent T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.304s	user 0.001s	sys 0.000s
I20260709 12:11:41.834616 18813 raft_consensus.cc:515] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:41.855397 18961 consensus_queue.cc:1059] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.007s
I20260709 12:11:41.817118 18986 raft_consensus.cc:515] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:41.863608 19136 leader_election.cc:290] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:41.863266 18708 raft_consensus.cc:740] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:41.883780 14259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41764 (request call id 2857) took 1564 ms. Trace:
I20260709 12:11:41.895365 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:11:41.896315 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
W20260709 12:11:41.873744 19139 log.cc:927] Time spent T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.261s	user 0.001s	sys 0.001s
I20260709 12:11:41.839509 18892 raft_consensus.cc:515] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:11:41.929121 19153 log.cc:927] Time spent T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 12:11:41.899156 14182 raft_consensus.cc:2468] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 12.
I20260709 12:11:41.901754 18978 leader_election.cc:290] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:41.902236 19011 raft_consensus.cc:493] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:41.901641 14908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
W20260709 12:11:41.903491 19051 consensus_meta.cc:287] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.847s	user 0.012s	sys 0.000s
I20260709 12:11:41.858603 19001 consensus_queue.cc:237] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:41.903848 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:11:41.900835 19156 raft_consensus.cc:515] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:41.902170 18862 leader_election.cc:290] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:41.909004 14910 raft_consensus.cc:1240] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 10. Current term is 12. Ops: []
W20260709 12:11:41.895465 19152 log.cc:927] Time spent T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
W20260709 12:11:41.915268 14305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:41.895740 19144 raft_consensus.cc:2804] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:11:41.922083 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:41.926851 18936 consensus_queue.cc:1059] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:41.927759 19136 raft_consensus.cc:493] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:41.866715 19158 raft_consensus.cc:515] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:41.930179 14261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41764 (request call id 2870) took 1365 ms. Trace:
I20260709 12:11:41.984733 14261 rpcz_store.cc:276] 0709 12:11:40.565565 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:41.037791 (+472226us) service_pool.cc:224] Handling call
0709 12:11:41.038195 (+   404us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:41.038867 (+   672us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:41.038898 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:41.039452 (+   554us) log.cc:844] Serialized 26 byte log entry
0709 12:11:41.233521 (+194069us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:41.233564 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:41.233641 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:41.929946 (+696305us) raft_consensus.cc:1685] finished
0709 12:11:41.929968 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:41.930116 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":127,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":97,"thread_start_us":193658,"threads_started":1,"wal-append.queue_time_us":383513}
I20260709 12:11:41.986778 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:41.988212 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:41.988817 14261 raft_consensus.cc:2468] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 14.
W20260709 12:11:41.914525 19147 log.cc:927] Time spent T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.255s	user 0.000s	sys 0.001s
I20260709 12:11:41.896785 19164 raft_consensus.cc:493] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:41.922624 14259 rpcz_store.cc:276] 0709 12:11:40.319343 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:40.918982 (+599639us) service_pool.cc:224] Handling call
0709 12:11:40.919440 (+   458us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:40.926932 (+  7492us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:40.926967 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:40.927594 (+   627us) log.cc:844] Serialized 52 byte log entry
0709 12:11:41.239647 (+312053us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:41.240066 (+   419us) log.cc:844] Serialized 14 byte log entry
0709 12:11:41.240322 (+   256us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:41.240403 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:41.883526 (+643123us) raft_consensus.cc:1685] finished
0709 12:11:41.883549 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:41.883708 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7012,"prepare.queue_time_us":230,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":8460,"raft.run_cpu_time_us":193,"raft.run_wall_time_us":196,"thread_start_us":311523,"threads_started":1,"wal-append.queue_time_us":487756}
I20260709 12:11:41.907611 19166 raft_consensus.cc:2749] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:41.990522 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:41.929095 19168 raft_consensus.cc:493] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:11:41.880903 19024 raft_consensus.cc:515] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:42.004709 19024 leader_election.cc:290] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:11:41.928187 19140 log.cc:927] Time spent T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.140s	user 0.000s	sys 0.001s
I20260709 12:11:42.006125 19143 leader_election.cc:290] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:42.000259 19088 leader_election.cc:290] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:11:41.953956 19141 log.cc:927] Time spent T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.273s	user 0.000s	sys 0.001s
W20260709 12:11:41.981813 19148 log.cc:927] Time spent T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.237s	user 0.005s	sys 0.000s
I20260709 12:11:42.013149 14907 raft_consensus.cc:1275] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:11:41.992398 14155 leader_election.cc:304] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:41.994681 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:41.995740 14259 raft_consensus.cc:2393] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 15: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:11:42.016243 14261 raft_consensus.cc:3060] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:42.016953 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:42.017715 14259 raft_consensus.cc:2393] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 10: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
W20260709 12:11:41.996366 19167 log.cc:927] Time spent T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
W20260709 12:11:41.996934 19154 log.cc:927] Time spent T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.189s	user 0.000s	sys 0.001s
I20260709 12:11:41.997448 18971 leader_election.cc:290] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:42.006836 19143 raft_consensus.cc:493] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:11:41.999357 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:42.000342 18936 raft_consensus.cc:3055] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:42.000710 18813 leader_election.cc:290] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:42.001709 18708 consensus_queue.cc:260] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:11:42.010686 14156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:42.012055 14903 raft_consensus.cc:2468] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 12.
I20260709 12:11:41.990101 19164 raft_consensus.cc:3060] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:42.020619 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:42.027393 14260 raft_consensus.cc:2468] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 12.
I20260709 12:11:41.998895 18986 leader_election.cc:290] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:41.993144 18978 raft_consensus.cc:493] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:11:41.955677 19051 raft_consensus.cc:515] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } }
I20260709 12:11:41.955777 19142 consensus_queue.cc:1048] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.072s
I20260709 12:11:42.117125 14184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56652 (request call id 1120) took 1538 ms. Trace:
I20260709 12:11:42.123140 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:41.955757 19011 raft_consensus.cc:515] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:42.114383 12986 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:42.012843 18724 leader_election.cc:290] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:11:42.155683 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 412321us
W20260709 12:11:42.034557 14256 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41764 (request call id 2859) took 1714 ms (client timeout 1571 ms). Trace:
I20260709 12:11:42.158839 14303 leader_election.cc:304] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:11:42.036540 14264 raft_consensus.cc:1240] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 12:11:42.066465 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:11:42.039312 14305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:42.158488 14256 rpcz_store.cc:269] 0709 12:11:40.319862 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:40.511954 (+192092us) service_pool.cc:224] Handling call
0709 12:11:41.233421 (+721467us) spinlock_profiling.cc:243] Waited 3.28 ms on lock 0x7b5800060c98. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2124016b71 00007f2124016a22 00007f212cf2f8d9 00007f212c089ee0 00007f212c1530ab 00007f212c153131 00007f212c1010a0 00007f212c100984 00007f212567b6d4 00007f212567b662
0709 12:11:42.034277 (+800856us) spinlock_profiling.cc:243] Waited 55.1 ms on lock 0x7b54001b30d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:11:42.034464 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":134216960}
I20260709 12:11:42.110553 14910 raft_consensus.cc:1275] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:11:42.036079 14187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56652 (request call id 1115) took 1849 ms. Trace:
I20260709 12:11:42.052884 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:42.164348 14182 raft_consensus.cc:3060] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:42.044232 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:42.078058 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:42.048835 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:11:42.083447 14907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:42.153977 14184 rpcz_store.cc:276] 0709 12:11:40.578568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:41.162013 (+583445us) service_pool.cc:224] Handling call
0709 12:11:41.162406 (+   393us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:41.421960 (+259554us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:42.116836 (+694876us) spinlock_profiling.cc:243] Waited 248 ms on lock 0x7b540035af54. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:11:42.117051 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":570290944}
W20260709 12:11:42.167665 14303 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:42.167343 14302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:42.165536 14187 rpcz_store.cc:276] 0709 12:11:40.186489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:40.875585 (+689096us) service_pool.cc:224] Handling call
0709 12:11:41.175116 (+299531us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:41.175737 (+   621us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:42.035832 (+860095us) spinlock_profiling.cc:243] Waited 299 ms on lock 0x7b540019c3d0. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713a8ad 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:11:42.035995 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":688059776}
I20260709 12:11:42.163439 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:42.168350 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:42.172087 14184 raft_consensus.cc:2468] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 12.
I20260709 12:11:42.028386 19166 raft_consensus.cc:2804] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:42.177048 14229 leader_election.cc:304] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:41.992619 19136 raft_consensus.cc:515] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:42.167309 14907 raft_consensus.cc:2468] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 11.
I20260709 12:11:42.167029 14912 raft_consensus.cc:2468] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 16.
I20260709 12:11:42.129879 18440 raft_consensus.cc:3060] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:42.152776 18749 consensus_meta.cc:287] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.867s	user 0.007s	sys 0.005s
I20260709 12:11:42.182962 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:11:42.213158 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 293187us
I20260709 12:11:42.031364 19113 leader_election.cc:290] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:42.215994 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:42.217630 14263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41764 (request call id 2853) took 1900 ms. Trace:
I20260709 12:11:42.219211 14183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56652 (request call id 1112) took 2075 ms. Trace:
I20260709 12:11:42.219942 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:42.219606 14183 rpcz_store.cc:276] 0709 12:11:40.144198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:40.600985 (+456787us) service_pool.cc:224] Handling call
0709 12:11:40.601324 (+   339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:41.214674 (+613350us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:42.218965 (+1004291us) spinlock_profiling.cc:243] Waited 595 ms on lock 0x7b54003a48d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:11:42.219147 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1367913344}
I20260709 12:11:42.124518 18832 raft_consensus.cc:493] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:42.219457 14263 rpcz_store.cc:276] 0709 12:11:40.317260 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:40.703050 (+385790us) service_pool.cc:224] Handling call
0709 12:11:40.777302 (+ 74252us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:40.969598 (+192296us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:11:41.002569 (+ 32971us) log.cc:844] Serialized 14 byte log entry
0709 12:11:41.630438 (+627869us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:41.635867 (+  5429us) log.cc:844] Serialized 52 byte log entry
0709 12:11:41.636040 (+   173us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:11:41.636072 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:41.636164 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:42.217355 (+581191us) raft_consensus.cc:1685] finished
0709 12:11:42.217378 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:42.217538 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17409,"prepare.queue_time_us":35932,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":39,"raft.queue_time_us":71321,"raft.run_cpu_time_us":316,"raft.run_wall_time_us":32469,"thread_start_us":719622,"threads_started":2,"wal-append.queue_time_us":658350}
I20260709 12:11:42.075583 18945 raft_consensus.cc:3060] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:42.151403 18936 raft_consensus.cc:740] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:11:42.227078 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:42.045265 19007 leader_election.cc:290] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:42.064798 18892 leader_election.cc:290] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:42.231026 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:11:42.156764 19141 log.cc:927] Time spent T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.133s	user 0.000s	sys 0.000s
I20260709 12:11:42.017985 19168 raft_consensus.cc:515] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:42.212558 19166 raft_consensus.cc:493] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:42.174844 19006 raft_consensus.cc:493] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:42.211670 18708 raft_consensus.cc:3060] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:42.018103 19144 raft_consensus.cc:697] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 12 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:11:42.334796 14182 raft_consensus.cc:2468] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 11.
I20260709 12:11:42.330595 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:42.331907 14876 leader_election.cc:304] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:42.362897 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
W20260709 12:11:42.363531 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 122879us
I20260709 12:11:42.332542 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:42.331473 14332 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50856 (request call id 2338) took 1146 ms. Trace:
I20260709 12:11:42.181501 19026 raft_consensus.cc:2804] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:11:42.220460 19167 log.cc:927] Time spent T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.183s	user 0.000s	sys 0.000s
I20260709 12:11:42.349355 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:42.037202 18808 raft_consensus.cc:493] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:11:42.325750 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:42.152998 19143 raft_consensus.cc:515] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:42.222720 18885 raft_consensus.cc:2749] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:42.363723 14182 raft_consensus.cc:2393] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 10: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
W20260709 12:11:42.360883 18981 consensus_meta.cc:287] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.769s	user 0.010s	sys 0.010s
I20260709 12:11:42.383471 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:42.336977 14256 raft_consensus.cc:1275] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:11:42.231674 18786 raft_consensus.cc:493] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:42.362990 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:42.177299 18978 raft_consensus.cc:515] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:42.372550 14184 raft_consensus.cc:3060] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:42.362105 19113 raft_consensus.cc:493] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:42.325381 18986 raft_consensus.cc:493] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:42.179945 18813 consensus_queue.cc:1048] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.185s
W20260709 12:11:42.371868 19157 log.cc:927] Time spent T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.471s	user 0.001s	sys 0.001s
I20260709 12:11:42.231103 18832 raft_consensus.cc:3060] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:42.356776 19166 raft_consensus.cc:3060] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:42.324888 19146 consensus_queue.cc:1059] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.054s
I20260709 12:11:42.394426 14187 raft_consensus.cc:2468] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 11.
I20260709 12:11:42.365072 14332 rpcz_store.cc:276] 0709 12:11:41.185284 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:41.297232 (+111948us) service_pool.cc:224] Handling call
0709 12:11:41.297629 (+   397us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:41.298038 (+   409us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:41.298071 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:41.298603 (+   532us) log.cc:844] Serialized 26 byte log entry
0709 12:11:41.612133 (+313530us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:41.612183 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:41.612268 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:42.232498 (+620230us) raft_consensus.cc:1685] finished
0709 12:11:42.232522 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:42.331403 (+ 98881us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7881,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":17863,"thread_start_us":234018,"threads_started":1,"wal-append.queue_time_us":400841}
I20260709 12:11:42.231298 18749 raft_consensus.cc:515] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:42.388725 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:42.455119 14183 raft_consensus.cc:3060] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:42.367539 19026 raft_consensus.cc:493] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:11:42.372066 19007 raft_consensus.cc:493] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:42.398903 14336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50856 (request call id 2333) took 1214 ms. Trace:
I20260709 12:11:42.458766 14336 rpcz_store.cc:276] 0709 12:11:41.183994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:41.184137 (+   143us) service_pool.cc:224] Handling call
0709 12:11:41.198559 (+ 14422us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:41.198984 (+   425us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:41.199013 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:41.206830 (+  7817us) log.cc:844] Serialized 52 byte log entry
0709 12:11:41.626729 (+419899us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:41.787461 (+160732us) log.cc:844] Serialized 14 byte log entry
0709 12:11:42.021880 (+234419us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:42.021956 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:42.398627 (+376671us) raft_consensus.cc:1685] finished
0709 12:11:42.398651 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:42.398829 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2023,"prepare.queue_time_us":238520,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":46,"raft.queue_time_us":49701,"raft.run_cpu_time_us":246,"raft.run_wall_time_us":4404,"thread_start_us":756475,"threads_started":3,"wal-append.queue_time_us":418935}
I20260709 12:11:42.458808 14262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41764 (request call id 2856) took 2139 ms. Trace:
I20260709 12:11:42.372324 19006 raft_consensus.cc:515] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:42.403221 19151 leader_election.cc:290] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:42.374845 19023 consensus_queue.cc:1059] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.015s
W20260709 12:11:42.473857 14305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:42.393651 19041 consensus_meta.cc:287] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.858s	user 0.012s	sys 0.000s
I20260709 12:11:42.385985 18786 raft_consensus.cc:515] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:11:42.403652 19055 consensus_meta.cc:287] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.634s	user 0.009s	sys 0.002s
I20260709 12:11:42.511186 19055 raft_consensus.cc:515] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:42.515295 14336 raft_consensus.cc:1275] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 12:11:42.520308 19149 log.cc:927] Time spent T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 12:11:42.522603 19051 leader_election.cc:290] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187)
I20260709 12:11:42.462970 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:42.461477 14262 rpcz_store.cc:276] 0709 12:11:40.319106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:40.786177 (+467071us) service_pool.cc:224] Handling call
0709 12:11:40.845219 (+ 59042us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:40.845642 (+   423us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:11:41.070443 (+224801us) log.cc:844] Serialized 14 byte log entry
0709 12:11:41.319090 (+248647us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:41.349794 (+ 30704us) log.cc:844] Serialized 26 byte log entry
0709 12:11:41.350000 (+   206us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:41.350040 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:41.350119 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:42.458575 (+1108456us) raft_consensus.cc:1685] finished
0709 12:11:42.458596 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:42.458742 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7330,"prepare.queue_time_us":33708,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":53,"raft.queue_time_us":40185,"raft.run_cpu_time_us":269,"raft.run_wall_time_us":10849,"thread_start_us":396146,"threads_started":2,"wal-append.queue_time_us":479450}
I20260709 12:11:42.481767 14184 raft_consensus.cc:2468] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 13.
I20260709 12:11:42.484131 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:42.377331 18808 raft_consensus.cc:515] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:42.485599 19023 consensus_queue.cc:1243] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Peer 885067a0d31741bfb5c9935788e315bf log is divergent from this leader: its last log entry 10.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
W20260709 12:11:42.485872 14878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:42.535120 14878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:42.491163 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:11:42.496068 19000 consensus_meta.cc:287] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.901s	user 0.009s	sys 0.000s
W20260709 12:11:42.500497 19049 consensus_meta.cc:287] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.844s	user 0.010s	sys 0.000s
I20260709 12:11:42.506333 14185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 2832) took 1384 ms. Trace:
I20260709 12:11:42.465822 19026 raft_consensus.cc:3060] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:42.542820 14185 rpcz_store.cc:276] 0709 12:11:41.122233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:41.180313 (+ 58080us) service_pool.cc:224] Handling call
0709 12:11:41.180676 (+   363us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:41.180992 (+   316us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:11:41.629062 (+448070us) log.cc:844] Serialized 14 byte log entry
0709 12:11:41.835011 (+205949us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:41.836586 (+  1575us) log.cc:844] Serialized 26 byte log entry
0709 12:11:41.836745 (+   159us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:41.836784 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:41.836860 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:42.506025 (+669165us) raft_consensus.cc:1685] finished
0709 12:11:42.506052 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:42.506244 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36303,"prepare.queue_time_us":469728,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":69,"raft.queue_time_us":18975,"raft.run_cpu_time_us":211,"raft.run_wall_time_us":6793,"thread_start_us":539309,"threads_started":2,"wal-append.queue_time_us":210502}
I20260709 12:11:42.510133 19007 raft_consensus.cc:515] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:42.484373 14229 leader_election.cc:304] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:42.532644 14183 raft_consensus.cc:2468] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 14.
W20260709 12:11:42.491250 19165 log.cc:927] Time spent T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.138s	user 0.000s	sys 0.000s
I20260709 12:11:42.558841 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:42.559705 14183 raft_consensus.cc:2468] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 11.
I20260709 12:11:42.560799 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:42.551560 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:11:42.540061 14261 consensus_meta.cc:287] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.523s	user 0.010s	sys 0.000s
I20260709 12:11:42.402426 19113 raft_consensus.cc:515] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:11:42.564013 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 79734.4us
I20260709 12:11:42.562243 14261 raft_consensus.cc:2468] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 13.
I20260709 12:11:42.564848 14229 leader_election.cc:304] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:42.513609 19055 leader_election.cc:290] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 13 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:42.382179 18936 consensus_queue.cc:260] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:42.571043 14229 leader_election.cc:304] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:42.573206 14331 raft_consensus.cc:2468] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 12.
W20260709 12:11:42.568317 19075 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.696s	user 0.017s	sys 0.031s
W20260709 12:11:42.551141 19057 consensus_meta.cc:287] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 1.357s	user 0.005s	sys 0.009s
I20260709 12:11:42.584465 14339 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50856 (request call id 2335) took 1399 ms. Trace:
I20260709 12:11:42.584643 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:42.579242 14229 leader_election.cc:304] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:42.588615 14188 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 2830) took 1468 ms. Trace:
I20260709 12:11:42.584944 14339 rpcz_store.cc:276] 0709 12:11:41.184729 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:41.302603 (+117874us) service_pool.cc:224] Handling call
0709 12:11:41.343458 (+ 40855us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:41.348823 (+  5365us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:41.348858 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:41.359109 (+ 10251us) log.cc:844] Serialized 26 byte log entry
0709 12:11:41.799965 (+440856us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:41.800009 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:41.800083 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:42.584233 (+784150us) raft_consensus.cc:1685] finished
0709 12:11:42.584254 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:42.584398 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":365586,"threads_started":1,"wal-append.queue_time_us":459807}
I20260709 12:11:42.589049 14188 rpcz_store.cc:276] 0709 12:11:41.119818 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:41.187501 (+ 67683us) service_pool.cc:224] Handling call
0709 12:11:41.200329 (+ 12828us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:41.211279 (+ 10950us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:41.211313 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:41.211865 (+   552us) log.cc:844] Serialized 26 byte log entry
0709 12:11:41.743087 (+531222us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:41.897895 (+154808us) log.cc:844] Serialized 14 byte log entry
0709 12:11:41.899402 (+  1507us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:41.899483 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:42.588375 (+688892us) raft_consensus.cc:1685] finished
0709 12:11:42.588399 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:42.588546 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10549,"prepare.queue_time_us":57058,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":40819,"raft.run_cpu_time_us":247,"raft.run_wall_time_us":10632,"thread_start_us":535757,"threads_started":2,"wal-append.queue_time_us":1083333}
I20260709 12:11:42.600632 14907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:42.605911 18885 raft_consensus.cc:2804] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:42.606777 18885 raft_consensus.cc:697] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 13 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:11:42.608130 18885 consensus_queue.cc:237] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:11:42.574494 19148 log.cc:927] Time spent T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 12:11:42.612013 18936 raft_consensus.cc:3060] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:42.616880 19136 leader_election.cc:290] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:42.622437 19143 leader_election.cc:290] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:42.573828 19051 raft_consensus.cc:2804] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:42.623965 19051 raft_consensus.cc:697] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 11 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:11:42.627935 19113 leader_election.cc:290] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:42.587062 19130 raft_consensus.cc:2749] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:11:42.631350 19080 consensus_meta.cc:287] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 1.085s	user 0.010s	sys 0.002s
I20260709 12:11:42.631985 19080 raft_consensus.cc:515] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:42.633201 19006 leader_election.cc:290] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:11:42.634316 19177 log.cc:927] Time spent T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
I20260709 12:11:42.653975 14265 raft_consensus.cc:1240] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:42.635582 14263 raft_consensus.cc:2468] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 15.
I20260709 12:11:42.637015 14190 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56652 (request call id 1124) took 1468 ms. Trace:
I20260709 12:11:42.654960 14190 rpcz_store.cc:276] 0709 12:11:41.169054 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:41.294627 (+125573us) service_pool.cc:224] Handling call
0709 12:11:41.294989 (+   362us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:41.300817 (+  5828us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:41.300856 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:41.336026 (+ 35170us) log.cc:844] Serialized 26 byte log entry
0709 12:11:41.880763 (+544737us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:41.880825 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:41.880933 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:42.636752 (+755819us) raft_consensus.cc:1685] finished
0709 12:11:42.636774 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:42.636941 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5383,"raft.queue_time_us":89406,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":109,"thread_start_us":445420,"threads_started":1,"wal-append.queue_time_us":672947}
W20260709 12:11:42.656412 14305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:42.656962 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:42.657670 14190 raft_consensus.cc:2468] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 14.
I20260709 12:11:42.542364 19000 raft_consensus.cc:515] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:42.639132 14229 leader_election.cc:304] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:11:42.573578 19049 raft_consensus.cc:2749] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:42.596216 19057 raft_consensus.cc:2749] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:42.440339 18986 raft_consensus.cc:515] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:42.539419 19041 raft_consensus.cc:515] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:42.646034 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:11:42.594288 19075 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.711s	user 0.017s	sys 0.032s
I20260709 12:11:42.662848 14257 raft_consensus.cc:2393] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 12: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:11:42.641652 14907 raft_consensus.cc:2393] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 12: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
I20260709 12:11:42.569895 19156 leader_election.cc:290] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:42.663380 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:42.676535 14188 raft_consensus.cc:3060] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:42.665199 14878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:42.658823 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:42.601876 19099 raft_consensus.cc:2804] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:42.669019 14184 raft_consensus.cc:2393] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 14: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:11:42.680198 14190 raft_consensus.cc:2468] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 11.
I20260709 12:11:42.681892 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
W20260709 12:11:42.665907 14334 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.646s	user 0.006s	sys 0.015s
I20260709 12:11:42.673478 14339 raft_consensus.cc:1275] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:11:42.652674 19055 raft_consensus.cc:493] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:42.683431 14334 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.663s	user 0.007s	sys 0.015s
I20260709 12:11:42.651803 19158 leader_election.cc:290] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:42.693017 14185 raft_consensus.cc:2468] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 11.
I20260709 12:11:42.696796 14190 raft_consensus.cc:1240] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:11:42.698623 14190 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 2835) took 1305 ms. Trace:
I20260709 12:11:42.699630 14190 rpcz_store.cc:276] 0709 12:11:41.392783 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:42.686996 (+1294213us) service_pool.cc:224] Handling call
0709 12:11:42.696477 (+  9481us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:42.697996 (+  1519us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:42.698471 (+   475us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:42.671958 19130 raft_consensus.cc:2804] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:11:42.625414 19051 consensus_queue.cc:237] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:42.652873 18813 consensus_queue.cc:1048] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 12:11:42.482527 19144 consensus_queue.cc:237] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:42.706965 14184 raft_consensus.cc:1240] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 8. Current term is 9. Ops: [6.7-8.8]
I20260709 12:11:42.717373 14184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 2836) took 1324 ms. Trace:
I20260709 12:11:42.717764 14184 rpcz_store.cc:276] 0709 12:11:41.393121 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:42.693404 (+1300283us) service_pool.cc:224] Handling call
0709 12:11:42.706661 (+ 13257us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:42.717033 (+ 10372us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:42.717308 (+   275us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:42.677659 19018 raft_consensus.cc:493] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:42.700372 14188 raft_consensus.cc:2468] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 12.
I20260709 12:11:42.715222 14337 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50856 (request call id 2316) took 3154 ms. Trace:
I20260709 12:11:42.709276 14190 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 2838) took 1315 ms. Trace:
I20260709 12:11:42.719734 14190 rpcz_store.cc:276] 0709 12:11:41.393667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:42.700480 (+1306813us) service_pool.cc:224] Handling call
0709 12:11:42.708215 (+  7735us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:42.708602 (+   387us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:42.708669 (+    67us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:42.708745 (+    76us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:42.708811 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:42.708927 (+   116us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:42.709190 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:11:42.721971 14304 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:42.686352 19168 leader_election.cc:290] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:42.719625 14337 rpcz_store.cc:276] 0709 12:11:39.555966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:39.703096 (+147130us) service_pool.cc:224] Handling call
0709 12:11:39.703471 (+   375us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:40.917333 (+1213862us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:42.710360 (+1793027us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b540001ac54. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:11:42.710614 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2789540736}
I20260709 12:11:42.729060 19189 raft_consensus.cc:493] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:42.730113 18786 leader_election.cc:290] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:42.730649 18786 raft_consensus.cc:493] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:42.731140 18786 raft_consensus.cc:515] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:11:42.732977 18440 consensus_meta.cc:287] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.510s	user 0.004s	sys 0.004s
I20260709 12:11:42.729087 18981 raft_consensus.cc:493] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:42.733335 18786 leader_election.cc:290] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:42.732800 14304 leader_election.cc:304] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:42.703533 19130 raft_consensus.cc:493] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:42.756946 18981 raft_consensus.cc:515] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:42.759476 18981 leader_election.cc:290] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:11:42.762984 19171 log.cc:927] Time spent T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.799s	user 0.001s	sys 0.000s
I20260709 12:11:42.764736 19080 leader_election.cc:290] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 11 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:11:42.766399 19191 log.cc:927] Time spent T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:11:42.768749 19130 raft_consensus.cc:3060] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:11:42.771122 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 379137us
I20260709 12:11:42.772727 14181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56652 (request call id 1123) took 1643 ms. Trace:
I20260709 12:11:42.721457 19006 raft_consensus.cc:493] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:42.773160 14181 rpcz_store.cc:276] 0709 12:11:41.129275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:41.287131 (+157856us) service_pool.cc:224] Handling call
0709 12:11:41.287488 (+   357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:42.134197 (+846709us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:11:42.134561 (+   364us) log.cc:844] Serialized 14 byte log entry
0709 12:11:42.389042 (+254481us) log.cc:844] Serialized 14 byte log entry
0709 12:11:42.389415 (+   373us) log.cc:844] Serialized 14 byte log entry
0709 12:11:42.770848 (+381433us) spinlock_profiling.cc:243] Waited 1.37 ms on lock 0x7b180043e820. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f212cf16ab1 00007f212cf23281 00007f2123fc8c0a 00007f212d708219 00007f2124050a40 00007f212404b4e4 00007f212404b455 00007f2127133060 00007f2127145716 00007f2127156287 00007f2127156208
0709 12:11:42.771033 (+   185us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:42.771086 (+    53us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:11:42.771160 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:42.772484 (+  1324us) spinlock_profiling.cc:243] Waited 846 ms on lock 0x7b540019c8d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:11:42.772533 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:42.772660 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1171,"prepare.queue_time_us":17223,"prepare.run_cpu_time_us":158,"prepare.run_wall_time_us":6493,"raft.queue_time_us":393835,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":99,"spinlock_wait_cycles":1972174336,"thread_start_us":243378,"threads_started":1}
I20260709 12:11:42.712136 18885 raft_consensus.cc:493] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:42.756057 19179 log.cc:927] Time spent T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.400s	user 0.003s	sys 0.002s
I20260709 12:11:42.750723 14184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56652 (request call id 1126) took 1014 ms. Trace:
W20260709 12:11:42.738564 19034 consensus_meta.cc:287] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 1.024s	user 0.011s	sys 0.003s
I20260709 12:11:42.754333 14189 raft_consensus.cc:2468] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 12.
I20260709 12:11:42.690662 19055 raft_consensus.cc:515] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:42.746560 14339 raft_consensus.cc:3055] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:42.830047 14339 raft_consensus.cc:740] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
W20260709 12:11:42.782725 14302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:42.790390 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:42.773727 18963 consensus_queue.cc:1059] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 12:11:42.794324 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:11:42.798475 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 65746.1us
I20260709 12:11:42.840523 14304 leader_election.cc:304] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
W20260709 12:11:42.776032 19177 log.cc:927] Time spent T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:11:42.808425 18786 raft_consensus.cc:493] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:42.800072 19001 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.788s	user 0.042s	sys 0.029s
I20260709 12:11:42.811065 14184 rpcz_store.cc:276] 0709 12:11:41.736120 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:42.726019 (+989899us) service_pool.cc:224] Handling call
0709 12:11:42.750211 (+ 24192us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:42.750416 (+   205us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:42.750440 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:42.750481 (+    41us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:11:42.750509 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:42.750559 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:42.750663 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:42.832880 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:42.747844 19146 consensus_queue.cc:1048] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.063s
I20260709 12:11:42.738624 19018 raft_consensus.cc:515] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:42.837980 14336 raft_consensus.cc:2468] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 12.
I20260709 12:11:42.756680 18978 leader_election.cc:290] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:42.717453 19049 raft_consensus.cc:493] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:42.729676 19189 raft_consensus.cc:515] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:42.848121 18749 leader_election.cc:290] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 13 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:42.849534 19099 raft_consensus.cc:493] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:11:42.834306 18958 raft_consensus.cc:493] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:42.809715 19197 raft_consensus.cc:493] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:11:42.902451 19011 leader_election.cc:290] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:42.904876 19041 leader_election.cc:290] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:42.825052 18885 raft_consensus.cc:515] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:42.810650 19181 raft_consensus.cc:2749] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:42.851565 18808 leader_election.cc:290] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:42.868954 14339 consensus_queue.cc:260] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:42.868696 18786 raft_consensus.cc:515] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:42.865407 18981 raft_consensus.cc:2749] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 12:11:42.865998 19001 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.856s	user 0.043s	sys 0.029s
I20260709 12:11:42.810360 19007 leader_election.cc:290] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:42.874831 14335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50858 (request call id 1975) took 1025 ms. Trace:
I20260709 12:11:42.798774 18961 consensus_queue.cc:1048] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.066s
I20260709 12:11:42.839512 19034 raft_consensus.cc:2749] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:11:42.875475 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 102443us
I20260709 12:11:42.882764 14154 leader_election.cc:304] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
W20260709 12:11:42.935523 14154 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 52858.4us
I20260709 12:11:42.936420 14154 leader_election.cc:304] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:42.878669 14187 raft_consensus.cc:2393] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 12: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:11:42.938795 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:42.942144 18749 raft_consensus.cc:2804] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:42.942801 18749 raft_consensus.cc:697] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 12 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:11:42.943854 18749 consensus_queue.cc:237] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:42.807672 19006 raft_consensus.cc:515] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:42.885768 19049 raft_consensus.cc:515] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:42.896346 19099 raft_consensus.cc:3060] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:42.875005 18963 consensus_queue.cc:1243] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Peer 65c9c1653b3346b39a0e118540e6080c log is divergent from this leader: its last log entry 12.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:11:42.948477 19186 raft_consensus.cc:2749] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:42.947803 19049 leader_election.cc:290] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:42.875480 19169 raft_consensus.cc:493] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:42.950626 19169 raft_consensus.cc:515] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:42.908442 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:42.952687 14336 raft_consensus.cc:3060] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:42.953190 19169 leader_election.cc:290] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:11:42.908679 18945 consensus_meta.cc:287] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.580s	user 0.009s	sys 0.004s
I20260709 12:11:42.909396 14303 leader_election.cc:304] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:42.910530 14257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41768 (request call id 1985) took 1170 ms. Trace:
I20260709 12:11:42.955828 14257 rpcz_store.cc:276] 0709 12:11:41.739996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:41.773927 (+ 33931us) service_pool.cc:224] Handling call
0709 12:11:42.910261 (+1136334us) spinlock_profiling.cc:243] Waited 884 ms on lock 0x7b54003813d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:11:42.910436 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2034297216}
I20260709 12:11:42.908015 19018 leader_election.cc:290] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:42.912278 18986 leader_election.cc:290] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:42.918177 19011 raft_consensus.cc:493] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
W20260709 12:11:42.873553 19193 log.cc:927] Time spent T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:11:42.911847 18958 raft_consensus.cc:515] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:42.913528 14183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56046 (request call id 2428) took 1081 ms. Trace:
W20260709 12:11:42.853477 19164 consensus_meta.cc:287] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.627s	user 0.011s	sys 0.000s
I20260709 12:11:42.915737 19183 raft_consensus.cc:493] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:42.972883 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:42.916347 14265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41768 (request call id 1972) took 1265 ms. Trace:
I20260709 12:11:42.916778 14185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56046 (request call id 2422) took 1086 ms. Trace:
I20260709 12:11:42.973829 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:42.916986 19055 leader_election.cc:290] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:42.869112 19190 raft_consensus.cc:493] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:42.974035 14185 rpcz_store.cc:276] 0709 12:11:41.830441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:42.551207 (+720766us) service_pool.cc:224] Handling call
0709 12:11:42.916604 (+365397us) spinlock_profiling.cc:243] Waited 131 ms on lock 0x7b54003a34d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:11:42.916712 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":300617984}
I20260709 12:11:42.974653 14912 raft_consensus.cc:2468] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 9.
I20260709 12:11:42.919905 14876 leader_election.cc:304] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:42.921865 14264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41768 (request call id 1973) took 1270 ms. Trace:
I20260709 12:11:42.925206 14339 raft_consensus.cc:3060] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:42.884261 19000 leader_election.cc:290] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:42.928439 14335 rpcz_store.cc:276] 0709 12:11:41.849867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:41.849999 (+   132us) service_pool.cc:224] Handling call
0709 12:11:41.850394 (+   395us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:41.855604 (+  5210us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:41.855635 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:41.856260 (+   625us) log.cc:844] Serialized 52 byte log entry
0709 12:11:42.022028 (+165768us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:42.176478 (+154450us) log.cc:844] Serialized 14 byte log entry
0709 12:11:42.176723 (+   245us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:42.176808 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:42.874564 (+697756us) raft_consensus.cc:1685] finished
0709 12:11:42.874588 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:42.874760 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8710,"prepare.queue_time_us":135368,"prepare.run_wall_time_us":31705,"raft.queue_time_us":195483,"raft.run_cpu_time_us":251,"raft.run_wall_time_us":36219,"spinlock_wait_cycles":37662976,"thread_start_us":141196,"threads_started":1,"wal-append.queue_time_us":533449}
I20260709 12:11:42.947799 19006 leader_election.cc:290] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:42.907891 19017 raft_consensus.cc:493] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:42.965948 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 56648.8us
I20260709 12:11:42.970208 14333 raft_consensus.cc:2410] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 12:11:42.970865 14183 rpcz_store.cc:276] 0709 12:11:41.831670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:42.912263 (+1080593us) service_pool.cc:224] Handling call
0709 12:11:42.912856 (+   593us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:42.913200 (+   344us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:42.913229 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:42.913270 (+    41us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:42.913301 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:42.913359 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:42.913467 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":853,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":98}
I20260709 12:11:42.990458 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:42.991320 14183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56046 (request call id 2434) took 1158 ms. Trace:
I20260709 12:11:42.991711 14183 rpcz_store.cc:276] 0709 12:11:41.832612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:42.990491 (+1157879us) service_pool.cc:224] Handling call
0709 12:11:42.990798 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:42.990988 (+   190us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:42.991012 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:42.991066 (+    54us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:42.991103 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:42.991156 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:42.991262 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:42.993244 14183 pending_rounds.cc:85] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf: Aborting all ops after (but not including) 5
I20260709 12:11:42.993494 14183 pending_rounds.cc:107] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf: Aborting uncommitted NO_OP operation due to leader change: 11.6
I20260709 12:11:42.978904 14330 raft_consensus.cc:1240] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 8. Current term is 9. Ops: []
W20260709 12:11:42.983901 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 64068.2us
I20260709 12:11:42.910015 19197 raft_consensus.cc:515] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:42.973853 14265 rpcz_store.cc:276] 0709 12:11:41.651313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:41.651477 (+   164us) service_pool.cc:224] Handling call
0709 12:11:41.714674 (+ 63197us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:42.654498 (+939824us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:42.904066 (+249568us) spinlock_profiling.cc:243] Waited 939 ms on lock 0x7b54003818d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:11:42.916279 (+ 12213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2159414656}
W20260709 12:11:42.966446 19192 log.cc:927] Time spent T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 12:11:42.988922 19075 raft_consensus.cc:2804] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:42.998237 14183 raft_consensus.cc:2889] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:42.969769 19181 raft_consensus.cc:2804] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:42.998723 14336 raft_consensus.cc:2468] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 11.
I20260709 12:11:43.008225 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:11:42.995584 19166 consensus_meta.cc:287] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.537s	user 0.007s	sys 0.007s
I20260709 12:11:42.999809 14876 leader_election.cc:304] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:43.000187 14334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50858 (request call id 1974) took 1286 ms. Trace:
I20260709 12:11:42.977152 14264 rpcz_store.cc:276] 0709 12:11:41.651875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:41.652002 (+   127us) service_pool.cc:224] Handling call
0709 12:11:42.036240 (+384238us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:42.161565 (+125325us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:42.894850 (+733285us) spinlock_profiling.cc:243] Waited 384 ms on lock 0x7b54001b30d0. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713a8ad 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:11:42.921787 (+ 26937us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":882650880}
I20260709 12:11:43.001086 18868 raft_consensus.cc:493] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:42.997967 19017 raft_consensus.cc:515] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:42.994184 14303 leader_election.cc:304] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:43.007005 19075 raft_consensus.cc:493] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:43.027067 19075 raft_consensus.cc:3060] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:43.028034 19130 raft_consensus.cc:515] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:42.989286 19190 raft_consensus.cc:515] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:43.030850 18786 leader_election.cc:290] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:43.031853 19162 raft_consensus.cc:3055] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:43.032311 19162 raft_consensus.cc:740] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:11:43.032714 19190 leader_election.cc:290] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:11:43.011878 14878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:42.987526 19183 raft_consensus.cc:515] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:43.033923 14190 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56046 (request call id 2420) took 1204 ms. Trace:
W20260709 12:11:43.035249 18708 consensus_meta.cc:287] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.668s	user 0.010s	sys 0.002s
I20260709 12:11:42.981423 19164 raft_consensus.cc:515] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:43.039737 19189 leader_election.cc:290] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:43.039970 19164 leader_election.cc:290] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 9 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:43.010891 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:42.993947 18935 raft_consensus.cc:3060] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:43.037652 14186 raft_consensus.cc:3060] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:43.023788 14303 leader_election.cc:304] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:43.024816 18868 raft_consensus.cc:515] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:43.025954 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:43.054868 14336 raft_consensus.cc:2468] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 16.
W20260709 12:11:43.020239 19118 consensus_meta.cc:287] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 1.235s	user 0.016s	sys 0.000s
I20260709 12:11:43.030236 19055 raft_consensus.cc:2804] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:11:43.018539 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 138986us
I20260709 12:11:43.034318 14190 rpcz_store.cc:276] 0709 12:11:41.829653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:42.742955 (+913302us) service_pool.cc:224] Handling call
0709 12:11:42.743260 (+   305us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:42.743492 (+   232us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:42.743515 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:42.751845 (+  8330us) log.cc:844] Serialized 26 byte log entry
0709 12:11:42.932192 (+180347us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:42.932239 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:42.932325 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:43.033653 (+101328us) raft_consensus.cc:1685] finished
0709 12:11:43.033675 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:43.033851 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":136933,"threads_started":1,"wal-append.queue_time_us":215422}
I20260709 12:11:42.984737 19011 raft_consensus.cc:515] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:43.014760 14334 rpcz_store.cc:276] 0709 12:11:41.713661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:41.714222 (+   561us) service_pool.cc:224] Handling call
0709 12:11:41.742465 (+ 28243us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:41.742851 (+   386us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:41.742883 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:41.743495 (+   612us) log.cc:844] Serialized 52 byte log entry
0709 12:11:41.979542 (+236047us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:42.019726 (+ 40184us) log.cc:844] Serialized 14 byte log entry
0709 12:11:42.597627 (+577901us) spinlock_profiling.cc:243] Waited 3.42 ms on lock 0x7b4400022b4c. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2123f74c85 00007f2123f756a2 00007f2126ce71db 00007f2126ce2aaf 00007f2126cd686e 00007f2126cd5bb6 00007f2126cd57d8 00007f2126cdf221 00007f2126cdf1d9 00007f2126cdf169
0709 12:11:42.683897 (+ 86270us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:42.683986 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:42.987174 (+303188us) raft_consensus.cc:1685] finished
0709 12:11:42.997875 (+ 10701us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:43.000035 (+  2160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16727,"prepare.queue_time_us":38426,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":66762,"raft.run_cpu_time_us":264,"raft.run_wall_time_us":7060,"spinlock_wait_cycles":7956992,"thread_start_us":858625,"threads_started":2,"wal-append.queue_time_us":384887}
I20260709 12:11:43.011718 19181 raft_consensus.cc:493] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:43.026453 19017 leader_election.cc:290] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:43.058732 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:43.059536 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:43.066329 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:43.067749 14260 raft_consensus.cc:2468] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 12.
I20260709 12:11:43.065255 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:43.071779 14186 raft_consensus.cc:1275] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 12:11:43.068970 14190 raft_consensus.cc:2468] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 14.
I20260709 12:11:43.066125 19164 raft_consensus.cc:2804] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:43.074141 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:11:43.021339 19142 raft_consensus.cc:2749] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:43.035395 19183 leader_election.cc:290] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:43.076830 14907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:43.078750 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:43.095564 14907 raft_consensus.cc:2468] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 14.
I20260709 12:11:43.095571 14911 raft_consensus.cc:2468] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 9.
I20260709 12:11:43.080535 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:43.037662 18885 leader_election.cc:290] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:43.083920 14263 raft_consensus.cc:1240] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:43.084646 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:43.103382 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:43.082754 14258 raft_consensus.cc:1240] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:43.087527 14260 raft_consensus.cc:1275] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:11:43.104475 14261 raft_consensus.cc:2393] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 17: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:11:43.053432 18940 raft_consensus.cc:493] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:11:43.072582 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:43.106830 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:43.107724 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:43.020071 19166 raft_consensus.cc:515] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:43.090483 14186 pending_rounds.cc:85] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf: Aborting all ops after (but not including) 6
I20260709 12:11:43.091500 14190 raft_consensus.cc:1240] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:43.109719 14186 pending_rounds.cc:107] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 12:11:43.110000 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:43.110293 14186 raft_consensus.cc:2889] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:43.110710 14262 raft_consensus.cc:2468] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 12.
I20260709 12:11:43.111212 14186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 2815) took 3033 ms. Trace:
I20260709 12:11:43.111841 14186 rpcz_store.cc:276] 0709 12:11:40.078061 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:40.083116 (+  5055us) service_pool.cc:224] Handling call
0709 12:11:40.083458 (+   342us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:43.037177 (+2953719us) spinlock_profiling.cc:243] Waited 2.76 s on lock 0x7b58005d47d0. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f21270970aa 00007f2127119447 00007f2127131fe7 00007f21271337de 00007f212713db49 00007f212713e416 00007f212713ad8f 00007f212713a83e 00007f212c0ff419 00007f2125676bd4
0709 12:11:43.110885 (+ 73708us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:43.111143 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6344057216}
I20260709 12:11:43.115437 14190 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56652 (request call id 1127) took 1194 ms. Trace:
I20260709 12:11:43.115872 14190 rpcz_store.cc:276] 0709 12:11:41.921340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:43.089722 (+1168382us) service_pool.cc:224] Handling call
0709 12:11:43.090097 (+   375us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:43.115151 (+ 25054us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:43.115368 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:43.033274 19162 consensus_queue.cc:260] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:43.066547 19055 raft_consensus.cc:493] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:11:43.072664 19181 raft_consensus.cc:3060] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:43.090152 14876 leader_election.cc:304] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:43.117506 14190 raft_consensus.cc:1275] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:11:43.075187 19118 raft_consensus.cc:515] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:43.117327 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:43.117425 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:43.121966 14190 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56046 (request call id 2437) took 1113 ms. Trace:
W20260709 12:11:43.092810 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 132926us
I20260709 12:11:43.122314 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:43.119351 19001 raft_consensus.cc:493] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:43.123031 19164 raft_consensus.cc:697] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 14 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:43.126744 14155 leader_election.cc:304] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:43.126928 19197 leader_election.cc:290] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:43.127306 19164 consensus_queue.cc:237] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:43.128827 19190 raft_consensus.cc:2749] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:43.123232 19130 leader_election.cc:290] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:43.130466 14155 leader_election.cc:304] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:43.123368 14182 raft_consensus.cc:2393] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 15: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:11:43.131352 19190 raft_consensus.cc:2749] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:43.132694 14155 leader_election.cc:304] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:43.133234 19112 consensus_queue.cc:1059] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:11:43.133518 19204 raft_consensus.cc:2749] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:43.134326 19112 raft_consensus.cc:3055] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:43.134704 19112 raft_consensus.cc:740] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:11:43.134905 14155 leader_election.cc:304] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:43.135214 19166 leader_election.cc:290] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 15 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:43.135593 19112 consensus_queue.cc:260] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:43.136132 14265 raft_consensus.cc:1240] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:43.122814 19055 raft_consensus.cc:3060] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:43.137225 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:43.124962 14190 rpcz_store.cc:276] 0709 12:11:42.008210 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:43.116831 (+1108621us) service_pool.cc:224] Handling call
0709 12:11:43.117170 (+   339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:43.121663 (+  4493us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:43.121902 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:43.111672 19088 raft_consensus.cc:493] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:43.140538 14262 raft_consensus.cc:3060] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:43.125291 14260 raft_consensus.cc:3060] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:43.123973 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:43.141268 14190 raft_consensus.cc:1240] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:43.121059 14261 raft_consensus.cc:1275] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 12:11:43.137328 14155 leader_election.cc:304] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:43.141788 14257 raft_consensus.cc:2393] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 17: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
W20260709 12:11:43.120110 18936 consensus_meta.cc:287] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db: Time spent flushing consensus metadata: real 0.507s	user 0.014s	sys 0.000s
I20260709 12:11:43.164284 14155 leader_election.cc:304] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:43.115302 18808 raft_consensus.cc:493] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:43.115576 19207 raft_consensus.cc:493] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:43.122458 18832 consensus_meta.cc:287] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.669s	user 0.013s	sys 0.001s
I20260709 12:11:43.168102 14190 raft_consensus.cc:1275] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:11:43.139834 19142 raft_consensus.cc:2804] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:43.152408 14910 raft_consensus.cc:2468] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 9.
I20260709 12:11:43.125494 19001 raft_consensus.cc:515] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:43.171936 19054 raft_consensus.cc:2749] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:43.173833 18945 raft_consensus.cc:493] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:43.174608 14187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56046 (request call id 2430) took 1342 ms. Trace:
I20260709 12:11:43.137328 19118 leader_election.cc:290] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 14 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:43.175787 18958 leader_election.cc:290] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:43.213281 14187 rpcz_store.cc:276] 0709 12:11:41.831977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:42.939914 (+1107937us) service_pool.cc:224] Handling call
0709 12:11:42.940311 (+   397us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:42.940728 (+   417us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:42.940764 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:42.941377 (+   613us) log.cc:844] Serialized 26 byte log entry
0709 12:11:43.097647 (+156270us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:43.097700 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:43.097993 (+   293us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:43.174342 (+ 76349us) raft_consensus.cc:1685] finished
0709 12:11:43.174368 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:43.174539 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8044,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":92,"thread_start_us":128299,"threads_started":1,"wal-append.queue_time_us":229856}
I20260709 12:11:43.161747 19088 raft_consensus.cc:515] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:11:43.123458 19026 consensus_meta.cc:287] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.553s	user 0.008s	sys 0.004s
I20260709 12:11:43.180397 14155 leader_election.cc:304] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:43.182399 14303 leader_election.cc:304] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
W20260709 12:11:43.230475 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 48182.3us
W20260709 12:11:43.230835 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 50541.4us
I20260709 12:11:43.231657 14155 leader_election.cc:304] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:43.197942 14262 raft_consensus.cc:2468] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 13.
I20260709 12:11:43.169016 14339 raft_consensus.cc:1275] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 12:11:43.232758 14339 pending_rounds.cc:85] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c: Aborting all ops after (but not including) 7
I20260709 12:11:43.233011 14339 pending_rounds.cc:107] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 12:11:43.233240 14339 raft_consensus.cc:2889] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:43.233999 14339 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 867) took 1017 ms. Trace:
I20260709 12:11:43.234326 14339 rpcz_store.cc:276] 0709 12:11:42.216849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:42.714860 (+498011us) service_pool.cc:224] Handling call
0709 12:11:42.746418 (+ 31558us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:43.233703 (+487285us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:43.233936 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:43.207191 14190 raft_consensus.cc:1275] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:11:43.114634 18940 raft_consensus.cc:515] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:43.144299 18961 raft_consensus.cc:2749] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:43.211333 19142 raft_consensus.cc:493] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:43.210353 19218 raft_consensus.cc:493] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:43.174631 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 95411us
I20260709 12:11:43.227922 14184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56046 (request call id 2425) took 1396 ms. Trace:
I20260709 12:11:43.219115 14338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50856 (request call id 2336) took 2034 ms. Trace:
I20260709 12:11:43.208276 19112 raft_consensus.cc:3060] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:43.198877 19197 raft_consensus.cc:493] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:43.217053 14260 raft_consensus.cc:2468] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 14.
I20260709 12:11:43.198691 19151 consensus_queue.cc:1048] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 12:11:43.242345 14181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56046 (request call id 2423) took 1411 ms. Trace:
I20260709 12:11:43.257267 14181 rpcz_store.cc:276] 0709 12:11:41.830668 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:42.797016 (+966348us) service_pool.cc:224] Handling call
0709 12:11:42.827537 (+ 30521us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:42.827827 (+   290us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:42.827857 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:42.828413 (+   556us) log.cc:844] Serialized 26 byte log entry
0709 12:11:43.018109 (+189696us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:43.018146 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:43.018223 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:43.242061 (+223838us) raft_consensus.cc:1685] finished
0709 12:11:43.242088 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:43.242263 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1307520,"thread_start_us":144002,"threads_started":1,"wal-append.queue_time_us":232467}
I20260709 12:11:43.212677 19166 raft_consensus.cc:2749] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:43.244801 14338 rpcz_store.cc:276] 0709 12:11:41.184916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:41.297163 (+112247us) service_pool.cc:224] Handling call
0709 12:11:41.332716 (+ 35553us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:41.392992 (+ 60276us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:11:41.732222 (+339230us) log.cc:844] Serialized 14 byte log entry
0709 12:11:42.387738 (+655516us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:42.387792 (+    54us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:42.387847 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:43.218774 (+830927us) spinlock_profiling.cc:243] Waited 59.9 ms on lock 0x7b5400145d54. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:11:43.218839 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:43.219015 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1501,"prepare.queue_time_us":466727,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":46,"raft.queue_time_us":31145,"raft.run_cpu_time_us":50,"raft.run_wall_time_us":51,"spinlock_wait_cycles":138910336,"thread_start_us":975580,"threads_started":3,"wal-append.queue_time_us":650307}
I20260709 12:11:43.244570 14184 rpcz_store.cc:276] 0709 12:11:41.831141 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:42.889243 (+1058102us) service_pool.cc:224] Handling call
0709 12:11:42.928733 (+ 39490us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:42.928980 (+   247us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:11:42.980298 (+ 51318us) log.cc:844] Serialized 14 byte log entry
0709 12:11:43.210865 (+230567us) log.cc:844] Serialized 14 byte log entry
0709 12:11:43.227519 (+ 16654us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:43.227589 (+    70us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:43.227647 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:43.227716 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:43.227851 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":47605,"prepare.queue_time_us":53710,"prepare.run_cpu_time_us":94,"prepare.run_wall_time_us":98,"raft.queue_time_us":48807,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":7987,"spinlock_wait_cycles":7580032,"thread_start_us":198345,"threads_started":1,"wal-append.queue_time_us":233124}
I20260709 12:11:43.255661 14186 raft_consensus.cc:1240] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 12 LEADER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:43.180032 19162 raft_consensus.cc:3060] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:11:43.255872 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 107280us
I20260709 12:11:43.239053 19189 raft_consensus.cc:2804] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:11:43.267113 14304 leader_election.cc:304] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:43.240338 19118 raft_consensus.cc:493] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:43.236775 18963 raft_consensus.cc:2749] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:43.200572 18808 raft_consensus.cc:515] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:43.227121 18945 raft_consensus.cc:515] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:43.211138 18832 raft_consensus.cc:515] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:43.209519 19075 raft_consensus.cc:515] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:43.248857 19142 raft_consensus.cc:3060] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:43.207923 19207 raft_consensus.cc:515] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:11:43.266010 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 64257.7us
I20260709 12:11:43.259861 18978 raft_consensus.cc:2804] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:43.288316 14304 leader_election.cc:304] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:43.295660 18786 raft_consensus.cc:3060] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:43.296361 14878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:43.297200 14906 raft_consensus.cc:1275] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:11:43.273720 19018 raft_consensus.cc:493] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:43.254529 19169 consensus_queue.cc:1048] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 12:11:43.239694 19026 raft_consensus.cc:515] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:43.271081 19189 raft_consensus.cc:493] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:43.303966 19049 raft_consensus.cc:493] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:43.229604 19099 raft_consensus.cc:515] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:43.256852 19208 consensus_queue.cc:1059] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 14.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 12:11:43.259387 19197 raft_consensus.cc:515] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } }
I20260709 12:11:43.273487 19000 consensus_queue.cc:1048] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
W20260709 12:11:43.304446 19214 log.cc:927] Time spent T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
I20260709 12:11:43.304315 19146 raft_consensus.cc:493] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:43.278429 19118 raft_consensus.cc:515] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:43.255066 19218 raft_consensus.cc:515] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:43.332486 14336 raft_consensus.cc:1240] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:43.303373 19011 leader_election.cc:290] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:43.325044 19189 raft_consensus.cc:3060] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:43.311203 18978 raft_consensus.cc:697] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 13 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
W20260709 12:11:43.332803 19131 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.267s	user 0.013s	sys 0.017s
I20260709 12:11:43.331333 19183 raft_consensus.cc:2749] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:43.332300 18813 raft_consensus.cc:3055] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:43.351524 14183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56046 (request call id 2436) took 1496 ms. Trace:
I20260709 12:11:43.352002 14183 rpcz_store.cc:276] 0709 12:11:41.854662 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:42.992681 (+1138019us) service_pool.cc:224] Handling call
0709 12:11:42.993051 (+   370us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:43.006146 (+ 13095us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:43.006190 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:43.007299 (+  1109us) log.cc:844] Serialized 26 byte log entry
0709 12:11:43.108755 (+101456us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:43.108792 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:43.108862 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:43.351237 (+242375us) raft_consensus.cc:1685] finished
0709 12:11:43.351263 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:43.351414 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":101110,"threads_started":1,"wal-append.queue_time_us":171089}
I20260709 12:11:43.329309 19049 raft_consensus.cc:515] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:43.312409 19018 raft_consensus.cc:515] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:43.349828 18813 raft_consensus.cc:740] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
W20260709 12:11:43.344388 19131 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.281s	user 0.013s	sys 0.018s
I20260709 12:11:43.330631 18936 consensus_queue.cc:1048] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.016s
I20260709 12:11:43.332108 18935 consensus_queue.cc:1048] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
W20260709 12:11:43.365612 19216 log.cc:927] Time spent T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 12:11:43.372900 19001 leader_election.cc:290] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:43.378635 19227 raft_consensus.cc:493] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:11:43.379935 18813 consensus_queue.cc:260] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.6, Last appended by leader: 6, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:11:43.380851 14189 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56652 (request call id 1117) took 3159 ms (client timeout 1524 ms). Trace:
I20260709 12:11:43.334282 19146 raft_consensus.cc:515] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:43.389701 14186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56652 (request call id 1129) took 1462 ms. Trace:
I20260709 12:11:43.393901 14186 rpcz_store.cc:276] 0709 12:11:41.927284 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:43.113223 (+1185939us) service_pool.cc:224] Handling call
0709 12:11:43.113564 (+   341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:43.265208 (+151644us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:43.389433 (+124225us) spinlock_profiling.cc:243] Waited 142 ms on lock 0x7b54003e8354. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:11:43.389629 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":326229248}
W20260709 12:11:43.390304 14189 rpcz_store.cc:269] 0709 12:11:40.221763 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:40.247563 (+ 25800us) service_pool.cc:224] Handling call
0709 12:11:43.380597 (+3133034us) spinlock_profiling.cc:243] Waited 2.47 s on lock 0x7b5400422054. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:11:43.380752 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5669828480}
I20260709 12:11:43.366380 18940 leader_election.cc:290] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:43.396823 19099 leader_election.cc:290] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 13 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:11:43.397643 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 109428us
W20260709 12:11:43.378623 19217 log.cc:927] Time spent T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 12:11:43.427150 19075 leader_election.cc:290] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 13 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:11:43.399456 19220 log.cc:927] Time spent T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 12:11:43.437992 18813 raft_consensus.cc:3060] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:43.442888 14332 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 863) took 1272 ms. Trace:
I20260709 12:11:43.443346 14332 rpcz_store.cc:276] 0709 12:11:42.170243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:42.552986 (+382743us) service_pool.cc:224] Handling call
0709 12:11:42.553402 (+   416us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:42.553849 (+   447us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:42.553884 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:42.554471 (+   587us) log.cc:844] Serialized 26 byte log entry
0709 12:11:43.228177 (+673706us) spinlock_profiling.cc:243] Waited 4.47 ms on lock 0x7b1800409180. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f212cf16ab1 00007f212cf23281 00007f2124030e07 00007f212ce8b9a9 00007f212404d69b 00007f212404b93f 00007f212404dc02 00007f2126cd520b 00007f2126cdad23 00007f2126cdb0d1 00007f21270f6a0f
0709 12:11:43.279203 (+ 51026us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:11:43.279794 (+   591us) log.cc:844] Serialized 14 byte log entry
0709 12:11:43.348462 (+ 68668us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:43.348569 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:43.442528 (+ 93959us) raft_consensus.cc:1685] finished
0709 12:11:43.442662 (+   134us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:43.442816 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24257,"prepare.queue_time_us":298,"prepare.run_cpu_time_us":102,"prepare.run_wall_time_us":2574,"raft.queue_time_us":24696,"raft.run_cpu_time_us":366,"raft.run_wall_time_us":26794,"spinlock_wait_cycles":10285824,"thread_start_us":109204,"threads_started":2,"wal-append.queue_time_us":774142}
I20260709 12:11:43.446569 14185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56046 (request call id 2431) took 1614 ms. Trace:
I20260709 12:11:43.447084 14185 rpcz_store.cc:276] 0709 12:11:41.832156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:42.975972 (+1143816us) service_pool.cc:224] Handling call
0709 12:11:42.976383 (+   411us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:42.987622 (+ 11239us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:42.987662 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:42.997324 (+  9662us) log.cc:844] Serialized 26 byte log entry
0709 12:11:43.211886 (+214562us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:43.211930 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:43.212007 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:43.446289 (+234282us) raft_consensus.cc:1685] finished
0709 12:11:43.446313 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:43.446487 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10754,"raft.queue_time_us":11470,"raft.run_cpu_time_us":207,"raft.run_wall_time_us":15973,"thread_start_us":149378,"threads_started":1,"wal-append.queue_time_us":226029}
W20260709 12:11:43.437342 19219 log.cc:927] Time spent T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.153s	user 0.001s	sys 0.000s
W20260709 12:11:43.440937 19230 log.cc:927] Time spent T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
W20260709 12:11:43.470849 14154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:43.472651 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:43.443118 19049 leader_election.cc:290] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:43.473366 14183 raft_consensus.cc:2468] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 16.
I20260709 12:11:43.473698 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:43.474830 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:43.475183 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:43.474417 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:43.475867 14181 raft_consensus.cc:2468] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 14.
I20260709 12:11:43.475207 14185 raft_consensus.cc:3060] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:11:43.397923 19227 raft_consensus.cc:515] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:43.477272 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:43.477430 14190 raft_consensus.cc:1240] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 8. Current term is 9. Ops: []
W20260709 12:11:43.456323 19209 log.cc:927] Time spent T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.131s	user 0.001s	sys 0.001s
I20260709 12:11:43.474076 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:43.513047 14264 raft_consensus.cc:2468] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 13.
I20260709 12:11:43.514007 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:43.514636 14264 raft_consensus.cc:2468] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 15.
I20260709 12:11:43.474862 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:43.478946 14154 leader_election.cc:304] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:43.397775 18978 consensus_queue.cc:237] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:11:43.488389 19198 log.cc:927] Time spent T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.483s	user 0.004s	sys 0.004s
W20260709 12:11:43.522509 14154 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 43677.6us
I20260709 12:11:43.491374 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:43.523582 14186 raft_consensus.cc:2393] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 9: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:11:43.494187 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:43.524436 14261 raft_consensus.cc:2468] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 13.
I20260709 12:11:43.497187 19142 raft_consensus.cc:515] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:43.502231 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:43.477870 14256 raft_consensus.cc:1240] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:43.509727 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:43.527918 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:43.511606 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:43.452294 18832 leader_election.cc:290] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 14 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:43.528644 14187 raft_consensus.cc:2468] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 13.
I20260709 12:11:43.490654 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:11:43.527338 14154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:43.530230 14332 raft_consensus.cc:2468] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 14.
I20260709 12:11:43.529675 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:43.532274 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:11:43.531893 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 147176us
W20260709 12:11:43.534111 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 125931us
I20260709 12:11:43.536747 14230 leader_election.cc:304] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:11:43.529775 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:43.537992 14183 raft_consensus.cc:2468] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 14.
I20260709 12:11:43.539166 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:43.539289 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:43.540532 14230 leader_election.cc:304] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:43.541322 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:43.532493 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:43.543979 14263 raft_consensus.cc:2468] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 15.
I20260709 12:11:43.552106 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:43.553263 14304 leader_election.cc:304] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:11:43.556185 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:43.556124 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:43.556980 14332 raft_consensus.cc:3060] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:43.562301 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:43.532231 19190 raft_consensus.cc:2804] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:43.555342 18981 raft_consensus.cc:493] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:11:43.573025 18981 raft_consensus.cc:515] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:43.551110 19017 raft_consensus.cc:2749] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:43.546949 19049 raft_consensus.cc:2804] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:43.574769 19049 raft_consensus.cc:493] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:43.575316 19049 raft_consensus.cc:3060] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:43.575826 18981 leader_election.cc:290] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:43.577919 19055 raft_consensus.cc:515] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:43.581561 19055 leader_election.cc:290] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 13 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:43.582896 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:43.583777 14910 raft_consensus.cc:2468] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 12.
I20260709 12:11:43.587823 14335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 869) took 1126 ms. Trace:
I20260709 12:11:43.588290 14335 rpcz_store.cc:276] 0709 12:11:42.461039 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:43.060617 (+599578us) service_pool.cc:224] Handling call
0709 12:11:43.079192 (+ 18575us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:43.079605 (+   413us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:43.079633 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:43.085418 (+  5785us) log.cc:844] Serialized 26 byte log entry
0709 12:11:43.157202 (+ 71784us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:43.157255 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:43.157343 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:43.587566 (+430223us) raft_consensus.cc:1685] finished
0709 12:11:43.587586 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:43.587752 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":62716,"raft.queue_time_us":13276,"raft.run_cpu_time_us":186,"raft.run_wall_time_us":9127,"thread_start_us":60775,"threads_started":1,"wal-append.queue_time_us":146915}
I20260709 12:11:43.589923 14185 raft_consensus.cc:2468] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 13.
I20260709 12:11:43.590409 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:43.592555 14332 raft_consensus.cc:2468] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 12.
I20260709 12:11:43.594151 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:11:43.596658 14230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:43.597033 19049 raft_consensus.cc:515] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:43.602996 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:43.604707 14332 raft_consensus.cc:2468] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 15.
I20260709 12:11:43.548652 19001 raft_consensus.cc:493] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:43.606911 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:43.597386 19227 leader_election.cc:290] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:43.556130 19118 leader_election.cc:290] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:43.642664 14906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59144 (request call id 510) took 2186 ms. Trace:
I20260709 12:11:43.643085 14906 rpcz_store.cc:276] 0709 12:11:41.456415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:41.526951 (+ 70536us) service_pool.cc:224] Handling call
0709 12:11:41.558104 (+ 31153us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:43.304113 (+1746009us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:43.642359 (+338246us) spinlock_profiling.cc:243] Waited 1.74 s on lock 0x7b54005e0e54. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:11:43.642552 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3998705408}
I20260709 12:11:43.650903 19018 leader_election.cc:290] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:43.603127 19190 raft_consensus.cc:493] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:43.651914 19190 raft_consensus.cc:3060] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:43.656409 19215 log.cc:927] Time spent T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.324s	user 0.000s	sys 0.009s
I20260709 12:11:43.555178 19164 raft_consensus.cc:493] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:43.629036 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:43.609424 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:43.660331 14334 raft_consensus.cc:2468] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 15.
I20260709 12:11:43.661542 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:43.662322 14334 raft_consensus.cc:2393] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 15: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
W20260709 12:11:43.662892 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 109719us
I20260709 12:11:43.610574 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:43.611236 19142 leader_election.cc:290] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 15 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:43.609866 18981 raft_consensus.cc:2804] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:43.637671 19017 raft_consensus.cc:493] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:43.638984 19162 raft_consensus.cc:493] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:43.560608 19218 leader_election.cc:290] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:43.641579 14337 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 868) took 1418 ms. Trace:
I20260709 12:11:43.689666 14258 raft_consensus.cc:2468] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 15.
I20260709 12:11:43.689682 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:43.690011 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:43.692075 14259 raft_consensus.cc:3060] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:43.663117 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:43.665526 14304 leader_election.cc:304] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:11:43.693184 14334 raft_consensus.cc:2468] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 9.
I20260709 12:11:43.694306 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:43.695534 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:43.696110 14334 raft_consensus.cc:3060] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:11:43.606487 19165 log.cc:927] Time spent T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:11:43.701428 14304 leader_election.cc:304] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:11:43.689919 14337 rpcz_store.cc:276] 0709 12:11:42.223058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:42.727078 (+504020us) service_pool.cc:224] Handling call
0709 12:11:42.727419 (+   341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:42.949548 (+222129us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:11:42.949865 (+   317us) log.cc:844] Serialized 14 byte log entry
0709 12:11:43.092419 (+142554us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:43.092477 (+    58us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:11:43.092528 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:43.641256 (+548728us) spinlock_profiling.cc:243] Waited 222 ms on lock 0x7b540023c154. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:11:43.641314 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:43.641494 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1107,"prepare.queue_time_us":143,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":35515,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":4722,"spinlock_wait_cycles":510213888,"thread_start_us":128233,"threads_started":1,"wal-append.queue_time_us":165860}
I20260709 12:11:43.702503 14304 leader_election.cc:304] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:11:43.703181 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:43.704064 14337 raft_consensus.cc:2393] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 12: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:11:43.700724 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:43.698743 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:43.622653 19008 raft_consensus.cc:493] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:43.706822 14263 raft_consensus.cc:2393] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db in current term 15: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:11:43.707989 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:43.611024 19049 leader_election.cc:290] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 13 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:43.625334 18786 raft_consensus.cc:2749] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:43.620977 19146 leader_election.cc:290] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:43.701771 19162 raft_consensus.cc:515] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:43.625438 19006 raft_consensus.cc:493] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:11:43.622797 19055 raft_consensus.cc:493] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:43.724387 14259 raft_consensus.cc:2468] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 13.
W20260709 12:11:43.725008 14878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:43.725522 14334 raft_consensus.cc:2468] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 15.
I20260709 12:11:43.735019 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:43.609056 19232 consensus_queue.cc:1048] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.115s
I20260709 12:11:43.739811 14877 leader_election.cc:304] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:11:43.658442 19001 raft_consensus.cc:515] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:43.706089 18981 raft_consensus.cc:697] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 13 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:43.745079 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:43.722560 19218 raft_consensus.cc:2804] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:43.735713 19040 raft_consensus.cc:2804] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:43.685495 19164 raft_consensus.cc:515] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:11:43.758075 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 54692.3us
I20260709 12:11:43.691377 19017 raft_consensus.cc:515] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:43.763185 14334 raft_consensus.cc:2468] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 12.
I20260709 12:11:43.744853 18786 raft_consensus.cc:2804] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:43.754846 19218 raft_consensus.cc:493] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:43.728904 19008 raft_consensus.cc:515] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:43.753513 19146 raft_consensus.cc:2804] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Leader election won for term 15
W20260709 12:11:43.776134 14331 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50858 (request call id 1978) took 1782 ms (client timeout 1528 ms). Trace:
W20260709 12:11:43.776634 14331 rpcz_store.cc:269] 0709 12:11:41.994102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:42.043894 (+ 49792us) service_pool.cc:224] Handling call
0709 12:11:43.775935 (+1732041us) spinlock_profiling.cc:243] Waited 408 ms on lock 0x7b54000fbed4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:11:43.776050 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":937539968}
I20260709 12:11:43.777446 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:43.778024 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:43.778177 14187 raft_consensus.cc:3060] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:43.779242 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:43.759344 19040 raft_consensus.cc:493] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:43.742053 19055 raft_consensus.cc:515] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:43.828451 14333 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55492 (request call id 866) took 1615 ms. Trace:
I20260709 12:11:43.828876 14333 rpcz_store.cc:276] 0709 12:11:42.212856 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:42.230745 (+ 17889us) service_pool.cc:224] Handling call
0709 12:11:43.828202 (+1597457us) spinlock_profiling.cc:243] Waited 638 ms on lock 0x7b540047de54. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:11:43.828387 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1467353856}
I20260709 12:11:43.829720 19055 leader_election.cc:290] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:43.834270 19146 raft_consensus.cc:697] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 15 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:11:43.829828 19040 raft_consensus.cc:3060] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:43.835357 19146 consensus_queue.cc:237] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:43.836560 18813 raft_consensus.cc:493] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:11:43.837117 18813 raft_consensus.cc:515] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:43.838191 19172 raft_consensus.cc:3055] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:43.838605 19172 raft_consensus.cc:740] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:11:43.839449 19172 consensus_queue.cc:260] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:43.785246 14877 leader_election.cc:304] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:11:43.840579 19172 raft_consensus.cc:3060] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:43.840857 19112 raft_consensus.cc:2804] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:43.841600 19112 raft_consensus.cc:697] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [term 13 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
W20260709 12:11:43.842022 19243 log.cc:927] Time spent T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 12:11:43.842841 19112 consensus_queue.cc:237] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:11:43.846124 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 60946.4us
I20260709 12:11:43.847967 19164 leader_election.cc:290] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:43.852005 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:43.852890 14910 raft_consensus.cc:1240] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:43.854195 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
W20260709 12:11:43.856983 19189 consensus_meta.cc:287] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.512s	user 0.012s	sys 0.000s
I20260709 12:11:43.739908 19006 raft_consensus.cc:515] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:43.822062 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:11:43.822702 19162 leader_election.cc:290] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:43.823123 19017 leader_election.cc:290] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:43.781327 14331 raft_consensus.cc:2468] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 16.
I20260709 12:11:43.827828 19008 leader_election.cc:290] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:43.839465 18813 leader_election.cc:290] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:43.830060 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:43.856674 18981 consensus_queue.cc:237] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:43.859009 19197 leader_election.cc:290] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:43.860708 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:11:43.904109 14906 raft_consensus.cc:3060] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:43.860934 18945 leader_election.cc:290] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:43.907020 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:43.861249 19001 leader_election.cc:290] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:43.862234 19026 leader_election.cc:290] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 12 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:43.862784 14877 leader_election.cc:304] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:43.871953 18868 leader_election.cc:290] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:43.767309 18786 raft_consensus.cc:493] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:43.927856 18786 raft_consensus.cc:3060] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:43.928280 19110 raft_consensus.cc:3060] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:43.874643 19181 consensus_meta.cc:287] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.744s	user 0.006s	sys 0.007s
I20260709 12:11:43.890774 14905 raft_consensus.cc:2393] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 12: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:11:43.769433 19218 raft_consensus.cc:3060] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:43.904573 14337 raft_consensus.cc:2410] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for term 13 because replica has last-logged OpId of term: 12 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 12:11:43.905325 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:11:43.780797 19241 consensus_queue.cc:1059] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.137s
I20260709 12:11:43.912039 19190 raft_consensus.cc:515] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:43.920439 14906 raft_consensus.cc:2468] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 17.
I20260709 12:11:43.924496 19006 leader_election.cc:290] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:43.890769 19189 raft_consensus.cc:515] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:43.928591 19142 raft_consensus.cc:2749] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:43.942700 18868 raft_consensus.cc:3055] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:43.946762 18868 raft_consensus.cc:740] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:43.947660 18868 consensus_queue.cc:260] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:43.949179 18868 raft_consensus.cc:3060] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:43.929261 19181 raft_consensus.cc:515] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:43.942538 19040 raft_consensus.cc:515] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:11:43.945953 19187 log.cc:927] Time spent T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 1.455s	user 0.004s	sys 0.004s
I20260709 12:11:43.947721 19190 leader_election.cc:290] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:11:43.956624 19221 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.624s	user 0.010s	sys 0.013s
W20260709 12:11:43.963234 19221 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.632s	user 0.011s	sys 0.013s
I20260709 12:11:43.782848 14154 leader_election.cc:304] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
W20260709 12:11:43.993556 14154 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 210648us
I20260709 12:11:43.894670 14187 raft_consensus.cc:2468] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 17.
I20260709 12:11:43.805505 14229 leader_election.cc:304] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
W20260709 12:11:43.997300 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 191735us
I20260709 12:11:43.998778 14229 leader_election.cc:304] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:44.000340 14229 leader_election.cc:304] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
W20260709 12:11:44.002396 14154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:43.991358 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 165864us
W20260709 12:11:44.005359 14155 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:44.006608 14155 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:44.015686 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
W20260709 12:11:44.008301 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 234805us
I20260709 12:11:44.017547 14304 leader_election.cc:304] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:11:44.018993 14911 raft_consensus.cc:1275] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 12:11:44.019390 14911 pending_rounds.cc:85] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db: Aborting all ops after (but not including) 9
I20260709 12:11:44.019781 14911 pending_rounds.cc:107] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 12:11:44.019997 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:44.014135 14331 raft_consensus.cc:2393] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 15: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:11:44.020282 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:11:43.927999 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 65366.4us
I20260709 12:11:44.022028 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:44.011334 14335 raft_consensus.cc:2393] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 17: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:11:44.013705 14907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:11:44.022609 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:44.016150 14155 leader_election.cc:304] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:44.023483 14331 raft_consensus.cc:3060] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:44.025763 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:44.003096 14229 leader_election.cc:304] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:44.023185 14907 raft_consensus.cc:3060] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:44.026875 14187 raft_consensus.cc:2393] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 13: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:11:44.022502 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:44.020310 14911 raft_consensus.cc:2889] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:44.042583 14229 leader_election.cc:304] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:44.042788 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:44.084677 14257 raft_consensus.cc:2393] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 11: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:11:44.087941 19181 leader_election.cc:290] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 12 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:44.089891 19113 raft_consensus.cc:2804] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:44.090551 19113 raft_consensus.cc:493] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:44.091055 19113 raft_consensus.cc:3060] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:44.091339 19189 leader_election.cc:290] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 17 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:44.044979 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:44.046021 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:44.094439 14181 raft_consensus.cc:2468] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 12.
I20260709 12:11:44.047765 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:44.096275 14183 raft_consensus.cc:3060] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:11:44.048002 14190 raft_consensus.cc:1275] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 12:11:44.048712 18813 raft_consensus.cc:2749] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:11:44.050300 18986 consensus_queue.cc:1048] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:44.054399 18885 raft_consensus.cc:2804] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:44.054777 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:44.049348 18892 raft_consensus.cc:2804] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:44.055363 18914 raft_consensus.cc:493] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:44.055925 19000 raft_consensus.cc:2749] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:44.056473 19017 raft_consensus.cc:2804] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:44.057238 19042 raft_consensus.cc:2804] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:44.057439 18992 consensus_queue.cc:1059] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:44.059553 19007 raft_consensus.cc:2804] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:44.060710 18935 consensus_queue.cc:1059] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:11:44.062547 14230 leader_election.cc:304] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:44.070101 19087 consensus_queue.cc:1059] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:11:44.070906 14331 raft_consensus.cc:2410] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:11:44.113307 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:44.072592 19040 leader_election.cc:290] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:44.118193 18992 raft_consensus.cc:3055] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 10 LEADER]: Stepping down as leader of term 10
W20260709 12:11:44.118551 14878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:44.119701 19087 raft_consensus.cc:3055] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:44.120231 19087 raft_consensus.cc:740] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:11:44.120577 14330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 857) took 2377 ms. Trace:
I20260709 12:11:44.117343 18935 raft_consensus.cc:3055] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:44.122431 18935 raft_consensus.cc:740] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:11:44.123993 18935 consensus_queue.cc:260] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:44.122099 18914 raft_consensus.cc:515] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:44.121435 19087 consensus_queue.cc:260] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:44.128458 18914 leader_election.cc:290] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:44.078552 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:44.082741 18808 leader_election.cc:290] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:44.044039 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:44.074747 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:44.111016 19007 raft_consensus.cc:493] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:44.121028 14330 rpcz_store.cc:276] 0709 12:11:41.742830 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:41.759044 (+ 16214us) service_pool.cc:224] Handling call
0709 12:11:41.759429 (+   385us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:43.000629 (+1241200us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:44.120040 (+1119411us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b540001a754. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:11:44.120362 (+   322us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2804013312}
I20260709 12:11:44.101581 14907 raft_consensus.cc:2468] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 10.
W20260709 12:11:44.130556 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 68340.7us
I20260709 12:11:44.103281 18892 raft_consensus.cc:493] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:44.101356 18885 raft_consensus.cc:493] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:44.133299 18935 raft_consensus.cc:3060] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:44.108790 19042 raft_consensus.cc:493] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:11:44.132979 18992 raft_consensus.cc:740] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:11:44.133677 19007 raft_consensus.cc:3060] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:44.147413 19099 raft_consensus.cc:493] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:44.147764 19131 raft_consensus.cc:2749] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:44.148226 19099 raft_consensus.cc:515] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:44.148964 14262 raft_consensus.cc:1275] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 14 index: 6. (index mismatch)
I20260709 12:11:44.150136 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:44.151006 14263 raft_consensus.cc:2468] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 9.
I20260709 12:11:44.154770 18992 consensus_queue.cc:260] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:44.156682 18992 raft_consensus.cc:3060] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:44.157938 14334 raft_consensus.cc:3060] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:44.163164 14189 raft_consensus.cc:2393] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 13: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:11:44.137928 18885 raft_consensus.cc:3060] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:44.136214 18892 raft_consensus.cc:3060] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:44.135912 19017 raft_consensus.cc:697] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 12 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:11:44.045502 18786 raft_consensus.cc:515] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:11:44.170630 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 82073.2us
I20260709 12:11:44.172626 19099 leader_election.cc:290] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:44.145560 19042 raft_consensus.cc:3060] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:44.179791 14188 raft_consensus.cc:1275] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 6. (term mismatch)
I20260709 12:11:44.180290 14188 pending_rounds.cc:85] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf: Aborting all ops after (but not including) 5
I20260709 12:11:44.180612 14188 pending_rounds.cc:107] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf: Aborting uncommitted NO_OP operation due to leader change: 11.6
I20260709 12:11:44.180953 14188 raft_consensus.cc:2889] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:44.177575 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:44.183351 14263 raft_consensus.cc:2468] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 12.
I20260709 12:11:44.182579 18961 raft_consensus.cc:493] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:44.189159 14331 raft_consensus.cc:1275] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 12:11:44.194644 14331 pending_rounds.cc:85] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c: Aborting all ops after (but not including) 8
I20260709 12:11:44.192600 18961 raft_consensus.cc:515] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:44.195170 14331 pending_rounds.cc:107] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 12:11:44.196448 14331 raft_consensus.cc:2889] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:44.198632 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:44.183506 18808 raft_consensus.cc:493] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:11:44.199862 18808 raft_consensus.cc:515] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:11:44.219306 14878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:44.219616 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:44.223505 14183 raft_consensus.cc:2468] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 13.
I20260709 12:11:44.225706 14334 raft_consensus.cc:2468] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 17.
I20260709 12:11:44.224954 14230 leader_election.cc:304] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:11:44.228351 14907 raft_consensus.cc:1275] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 12:11:44.233022 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 56618.9us
I20260709 12:11:44.233904 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:44.234282 19131 raft_consensus.cc:2804] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:44.234834 19131 raft_consensus.cc:493] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:44.235247 19131 raft_consensus.cc:3060] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:44.236171 19017 consensus_queue.cc:237] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } }
I20260709 12:11:44.235359 14263 raft_consensus.cc:2468] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 13.
I20260709 12:11:44.241178 19088 leader_election.cc:290] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:11:44.244143 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 201831us
I20260709 12:11:44.245280 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:11:44.246212 14182 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56046 (request call id 2435) took 2395 ms (client timeout 2078 ms). Trace:
I20260709 12:11:44.247378 14184 raft_consensus.cc:1240] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:44.245318 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:44.248939 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:44.249974 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:44.253252 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:44.255386 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:44.256284 14189 raft_consensus.cc:3060] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:11:44.256515 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:44.255570 14185 raft_consensus.cc:3060] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:11:44.250497 14182 rpcz_store.cc:269] 0709 12:11:41.850747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:42.383180 (+532433us) service_pool.cc:224] Handling call
0709 12:11:44.245786 (+1862606us) spinlock_profiling.cc:243] Waited 739 ms on lock 0x7b54003a39d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:11:44.246004 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1699656064}
I20260709 12:11:44.253038 14331 raft_consensus.cc:2376] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 11. Re-sending same reply.
I20260709 12:11:44.265190 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:44.270568 14154 leader_election.cc:304] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:44.272387 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:44.274567 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:44.281124 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:44.288054 14188 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 2841) took 2459 ms. Trace:
I20260709 12:11:44.293975 14334 raft_consensus.cc:3060] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:44.294589 14154 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 53954.9us
I20260709 12:11:44.278036 19087 raft_consensus.cc:3060] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:44.292023 14188 rpcz_store.cc:276] 0709 12:11:41.829117 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:42.742174 (+913057us) service_pool.cc:224] Handling call
0709 12:11:42.743016 (+   842us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:44.182163 (+1439147us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:44.287691 (+105528us) spinlock_profiling.cc:243] Waited 1.44 s on lock 0x7b540028a5d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:11:44.287960 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3302393728}
W20260709 12:11:44.297415 14875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:44.291188 14337 raft_consensus.cc:2468] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 12.
I20260709 12:11:44.300840 14330 raft_consensus.cc:1275] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 7. (term mismatch)
I20260709 12:11:44.290711 18808 leader_election.cc:290] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:44.312618 19166 raft_consensus.cc:493] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:44.313396 19166 raft_consensus.cc:515] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:44.314698 18986 raft_consensus.cc:493] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:44.315574 14262 raft_consensus.cc:1240] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:44.315344 18986 raft_consensus.cc:515] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:44.279237 19190 consensus_queue.cc:1048] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.148s
I20260709 12:11:44.315677 19166 leader_election.cc:290] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:44.303326 14330 pending_rounds.cc:85] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c: Aborting all ops after (but not including) 6
I20260709 12:11:44.320387 14330 pending_rounds.cc:107] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 12:11:44.322530 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:44.320693 14330 raft_consensus.cc:2889] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:44.323436 14183 raft_consensus.cc:2468] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 15.
I20260709 12:11:44.326342 14185 raft_consensus.cc:2468] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 15.
I20260709 12:11:44.327036 19088 raft_consensus.cc:2804] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:44.327257 14155 leader_election.cc:304] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:11:44.332758 19110 raft_consensus.cc:2804] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:44.333236 19110 raft_consensus.cc:493] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:11:44.334444 14155 leader_election.cc:304] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:44.335757 14155 leader_election.cc:304] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:44.333675 19110 raft_consensus.cc:3060] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:44.337848 14877 leader_election.cc:304] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:11:44.338291 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:44.317569 19190 raft_consensus.cc:493] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:44.336356 19166 raft_consensus.cc:2764] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 12:11:44.339581 19190 raft_consensus.cc:515] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } }
I20260709 12:11:44.317662 18986 leader_election.cc:290] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:44.339159 14331 raft_consensus.cc:2468] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 10.
I20260709 12:11:44.346208 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:44.347663 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:44.348644 14265 raft_consensus.cc:2393] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 17: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:11:44.346792 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:44.350524 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:44.351835 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:44.297330 18981 raft_consensus.cc:493] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:44.352810 14331 raft_consensus.cc:2393] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 14: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:11:44.353055 18981 raft_consensus.cc:515] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:44.357852 14303 leader_election.cc:304] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:11:44.360275 18808 raft_consensus.cc:2764] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 12:11:44.363034 19113 raft_consensus.cc:515] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:44.364428 19218 raft_consensus.cc:515] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:44.359805 14303 leader_election.cc:304] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:11:44.365918 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:44.327661 19088 raft_consensus.cc:697] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 10 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:11:44.381340 19190 leader_election.cc:290] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:44.384644 19088 consensus_queue.cc:237] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:11:44.388386 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 82152.7us
I20260709 12:11:44.390254 14877 leader_election.cc:304] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:11:44.391191 19225 raft_consensus.cc:2804] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:44.337862 18786 leader_election.cc:290] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:44.347723 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
W20260709 12:11:44.371815 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 49917.4us
I20260709 12:11:44.379441 14189 raft_consensus.cc:2468] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 13.
I20260709 12:11:44.381273 14303 leader_election.cc:304] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:44.395592 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:44.383096 18808 raft_consensus.cc:2804] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:44.382567 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:44.388803 18892 raft_consensus.cc:515] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:44.391664 19225 raft_consensus.cc:493] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:44.346252 18986 raft_consensus.cc:2749] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:11:44.391360 19218 leader_election.cc:290] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:44.404382 19040 raft_consensus.cc:2749] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:44.402866 18808 raft_consensus.cc:493] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:44.446122 18808 raft_consensus.cc:3060] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:44.449853 19259 log.cc:927] Time spent T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
I20260709 12:11:44.452679 14335 raft_consensus.cc:1240] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 12:11:44.456562 14338 raft_consensus.cc:1240] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 15. Current term is 16. Ops: []
I20260709 12:11:44.456239 19131 raft_consensus.cc:515] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:44.457710 14262 raft_consensus.cc:2393] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 16: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:11:44.458369 18885 raft_consensus.cc:515] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:44.460997 18885 leader_election.cc:290] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:44.411042 14337 raft_consensus.cc:2410] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
W20260709 12:11:44.462123 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 59755.3us
I20260709 12:11:44.463163 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:44.463300 14304 leader_election.cc:304] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:11:44.464071 14337 raft_consensus.cc:2410] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:11:44.464627 19183 raft_consensus.cc:2804] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:44.433580 19007 raft_consensus.cc:515] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:44.465006 19183 raft_consensus.cc:493] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:44.465195 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:44.412598 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:44.465613 14304 leader_election.cc:304] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:11:44.466081 14330 raft_consensus.cc:3060] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:44.466943 19007 leader_election.cc:290] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:44.461328 19207 leader_election.cc:290] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:44.465453 19183 raft_consensus.cc:3060] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:44.444995 19110 raft_consensus.cc:515] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:44.472103 19110 leader_election.cc:290] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 13 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:44.475039 14263 raft_consensus.cc:1240] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:44.477995 19042 raft_consensus.cc:515] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:44.413983 14876 leader_election.cc:304] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:44.416549 14303 leader_election.cc:304] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:11:44.418147 14332 raft_consensus.cc:1240] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 12 LEADER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:44.419004 18981 leader_election.cc:290] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:44.422284 14336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50856 (request call id 2341) took 1691 ms. Trace:
I20260709 12:11:44.415729 18892 leader_election.cc:290] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 13 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:44.433804 19225 raft_consensus.cc:3060] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:44.435801 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 134291us
I20260709 12:11:44.485019 19190 raft_consensus.cc:493] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:44.485985 14230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:44.436779 19041 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.049s	user 0.018s	sys 0.014s
I20260709 12:11:44.436955 14260 raft_consensus.cc:1240] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:44.482086 14336 rpcz_store.cc:276] 0709 12:11:42.730268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:43.065966 (+335698us) service_pool.cc:224] Handling call
0709 12:11:43.086456 (+ 20490us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:43.334243 (+247787us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:44.408320 (+1074077us) spinlock_profiling.cc:243] Waited 246 ms on lock 0x7b540010dbd4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:11:44.422091 (+ 13771us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":565367040}
I20260709 12:11:44.442910 14334 raft_consensus.cc:2468] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 13.
I20260709 12:11:44.443332 14256 raft_consensus.cc:1275] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:11:44.444145 14187 raft_consensus.cc:1275] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:11:44.438485 19113 leader_election.cc:290] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:11:44.488538 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 72207.6us
I20260709 12:11:44.485683 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:44.496068 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:11:44.499022 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 85331.4us
I20260709 12:11:44.499634 19110 raft_consensus.cc:493] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
W20260709 12:11:44.488179 19041 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.147s	user 0.019s	sys 0.014s
I20260709 12:11:44.499161 14336 raft_consensus.cc:2468] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 12.
I20260709 12:11:44.480542 19042 leader_election.cc:290] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 15 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:44.500357 14876 leader_election.cc:304] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:44.505790 14330 raft_consensus.cc:2468] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 10.
I20260709 12:11:44.486349 18914 consensus_queue.cc:1059] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.025s
I20260709 12:11:44.501485 19087 raft_consensus.cc:493] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:44.485816 19190 raft_consensus.cc:515] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:11:44.525640 14154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:44.508131 18981 raft_consensus.cc:2764] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Leader election decision vote started in defunct term 9: won
I20260709 12:11:44.532030 14330 raft_consensus.cc:1240] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 12:11:44.536495 14334 raft_consensus.cc:1275] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 12:11:44.507709 19075 raft_consensus.cc:2749] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:44.543323 19218 consensus_queue.cc:1048] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:44.543885 14332 raft_consensus.cc:1240] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:44.554257 14337 raft_consensus.cc:1275] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:44.556396 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:11:44.557232 14909 raft_consensus.cc:3060] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:44.557860 19131 leader_election.cc:290] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:44.556384 14333 raft_consensus.cc:1275] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:11:44.561918 14337 raft_consensus.cc:1240] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:44.567142 14332 raft_consensus.cc:1275] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:11:44.511574 19007 consensus_queue.cc:1048] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 12:11:44.563282 19017 raft_consensus.cc:493] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:44.576340 19229 raft_consensus.cc:2804] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:44.576987 19229 raft_consensus.cc:493] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:44.576682 19017 raft_consensus.cc:515] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:44.577476 19229 raft_consensus.cc:3060] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:44.578028 14230 leader_election.cc:304] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:44.525020 18986 consensus_queue.cc:1048] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 12:11:44.524107 19110 raft_consensus.cc:515] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:44.577831 19218 consensus_queue.cc:1059] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:44.592013 14303 leader_election.cc:304] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:11:44.534235 19207 consensus_queue.cc:1059] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 12:11:44.577673 19190 leader_election.cc:290] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:44.566118 19087 raft_consensus.cc:515] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:44.572054 19183 raft_consensus.cc:515] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:44.609705 18940 consensus_queue.cc:1048] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 12:11:44.611354 19183 leader_election.cc:290] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 11 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:44.611589 19176 consensus_queue.cc:1059] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 12:11:44.612738 19176 raft_consensus.cc:3055] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:44.613161 19176 raft_consensus.cc:740] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:11:44.613710 19121 raft_consensus.cc:2749] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:42.449159 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:44.615231 14304 leader_election.cc:304] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:11:44.619038 19256 raft_consensus.cc:2804] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:44.619508 19256 raft_consensus.cc:493] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:44.619848 19207 raft_consensus.cc:3055] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:44.620277 19207 raft_consensus.cc:740] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
W20260709 12:11:44.620939 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 68649.5us
I20260709 12:11:44.622040 19164 raft_consensus.cc:2764] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
W20260709 12:11:44.622255 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 122046us
I20260709 12:11:44.605926 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:44.625954 14909 raft_consensus.cc:2468] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 13.
I20260709 12:11:44.623700 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:44.599220 19113 raft_consensus.cc:2749] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:11:44.629920 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 55732.4us
I20260709 12:11:44.630453 14331 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50856 (request call id 2360) took 1079 ms. Trace:
I20260709 12:11:44.624029 14911 raft_consensus.cc:2468] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 9.
I20260709 12:11:44.585798 19131 consensus_queue.cc:1048] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 12:11:44.635025 14154 leader_election.cc:304] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:44.614040 19142 raft_consensus.cc:2804] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:44.637069 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:44.638140 14155 leader_election.cc:304] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:44.642704 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:44.646575 14154 leader_election.cc:304] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:44.649719 18992 raft_consensus.cc:2804] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:44.650230 18992 raft_consensus.cc:493] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:44.650522 14263 raft_consensus.cc:3060] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:44.619851 19256 raft_consensus.cc:3060] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:44.621210 19207 consensus_queue.cc:260] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:44.653548 18892 raft_consensus.cc:2804] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:44.607779 19042 consensus_queue.cc:1059] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 12:11:44.663861 14303 leader_election.cc:304] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
W20260709 12:11:44.668689 19244 log.cc:927] Time spent T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.838s	user 0.005s	sys 0.000s
I20260709 12:11:44.669827 19240 consensus_queue.cc:1059] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.096s
I20260709 12:11:44.650566 18992 raft_consensus.cc:3060] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:44.654289 19190 raft_consensus.cc:2804] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:44.684309 14229 leader_election.cc:304] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:44.685002 19000 consensus_queue.cc:1048] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:44.687063 19040 raft_consensus.cc:3055] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:44.690590 19207 raft_consensus.cc:3060] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:44.694617 19263 log.cc:927] Time spent T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:11:44.719703 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:44.720706 14335 raft_consensus.cc:2393] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 16: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:11:44.671216 18892 raft_consensus.cc:493] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:44.728240 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 84073.2us
I20260709 12:11:44.735769 19225 raft_consensus.cc:515] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:44.745877 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:44.741114 18892 raft_consensus.cc:3060] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:44.726488 14876 leader_election.cc:304] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:44.751560 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:44.761253 14260 raft_consensus.cc:2393] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 16: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:11:44.725248 18981 raft_consensus.cc:2804] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:44.715273 19040 raft_consensus.cc:740] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:44.722731 19190 raft_consensus.cc:697] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 13 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:11:44.764168 14259 raft_consensus.cc:2468] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 12.
W20260709 12:11:44.787243 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 123499us
I20260709 12:11:44.765978 18813 raft_consensus.cc:2804] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:11:44.783440 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:44.770598 18981 raft_consensus.cc:493] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:44.804044 14265 raft_consensus.cc:3060] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:11:44.781131 19121 raft_consensus.cc:493] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:44.799793 14911 raft_consensus.cc:1240] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 12:11:44.805187 14304 leader_election.cc:304] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:11:44.784129 18961 leader_election.cc:290] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:44.792454 18935 raft_consensus.cc:2749] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:44.758848 19075 consensus_queue.cc:1059] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.035s
I20260709 12:11:44.816926 14229 leader_election.cc:304] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:44.822749 14303 leader_election.cc:304] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:44.768666 18808 raft_consensus.cc:515] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:11:44.833894 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 136890us
I20260709 12:11:44.810750 18981 raft_consensus.cc:3060] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:44.805779 19110 leader_election.cc:290] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:44.843912 19169 consensus_queue.cc:1048] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.118s
I20260709 12:11:44.844833 14876 leader_election.cc:304] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:11:44.782961 19000 consensus_queue.cc:1048] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 12:11:44.748458 19176 consensus_queue.cc:260] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:11:44.862140 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 73746.9us
I20260709 12:11:44.823112 18813 raft_consensus.cc:697] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 17 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:11:44.867533 14334 raft_consensus.cc:1240] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:44.870137 19040 consensus_queue.cc:260] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:44.871230 18808 leader_election.cc:290] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 10 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:44.829787 19088 raft_consensus.cc:493] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:44.838970 19189 raft_consensus.cc:2749] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:44.839190 19087 leader_election.cc:290] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:44.874185 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:44.841439 19007 raft_consensus.cc:2804] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:44.879379 14339 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 872) took 1403 ms. Trace:
I20260709 12:11:44.853574 19017 leader_election.cc:290] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:11:44.880244 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 63442.1us
W20260709 12:11:44.888207 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 74781.1us
I20260709 12:11:44.871688 19040 raft_consensus.cc:3060] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:44.890623 19142 raft_consensus.cc:493] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
W20260709 12:11:44.897007 14875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:44.882361 14339 rpcz_store.cc:276] 0709 12:11:43.472029 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:43.474456 (+  2427us) service_pool.cc:224] Handling call
0709 12:11:43.481173 (+  6717us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:43.533286 (+ 52113us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:43.533317 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:43.534226 (+   909us) log.cc:844] Serialized 26 byte log entry
0709 12:11:43.755452 (+221226us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:43.755494 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:43.755565 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:44.496883 (+741318us) spinlock_profiling.cc:243] Waited 25.2 ms on lock 0x7b4400022b4c. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2123f74c85 00007f2123f756a2 00007f2126ce71db 00007f2126ce2aaf 00007f2126cd686e 00007f2126cd5bb6 00007f2126cd57d8 00007f2126cdf221 00007f2126cdf1d9 00007f2126cdf169
0709 12:11:44.865565 (+368682us) raft_consensus.cc:1685] finished
0709 12:11:44.865588 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:44.874992 (+  9404us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":51634,"raft.queue_time_us":60958,"raft.run_cpu_time_us":207,"raft.run_wall_time_us":9194,"spinlock_wait_cycles":58050944,"thread_start_us":150820,"threads_started":1,"wal-append.queue_time_us":225475}
I20260709 12:11:44.901572 19087 raft_consensus.cc:493] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:44.905345 19088 raft_consensus.cc:515] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:44.924443 19087 raft_consensus.cc:515] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:44.926631 14230 leader_election.cc:304] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:11:44.927511 19087 leader_election.cc:290] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:44.841673 19121 raft_consensus.cc:515] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:44.631726 14331 rpcz_store.cc:276] 0709 12:11:43.551886 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:44.353608 (+801722us) service_pool.cc:224] Handling call
0709 12:11:44.354011 (+   403us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:44.354305 (+   294us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:11:44.391848 (+ 37543us) log.cc:844] Serialized 14 byte log entry
0709 12:11:44.630069 (+238221us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:44.630128 (+    59us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:44.630191 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:44.630258 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:44.630385 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25320,"prepare.queue_time_us":92617,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":63,"raft.queue_time_us":25434,"thread_start_us":154935,"threads_started":2}
I20260709 12:11:44.929664 14230 leader_election.cc:304] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:44.954196 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:44.882637 19007 raft_consensus.cc:493] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:44.968075 18940 raft_consensus.cc:3055] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:44.967610 19176 raft_consensus.cc:3060] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:45.071254 14335 raft_consensus.cc:2368] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 15. Current term is 16.
I20260709 12:11:44.949257 18963 raft_consensus.cc:3055] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:11:45.071291 19007 raft_consensus.cc:3060] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:44.962751 14258 raft_consensus.cc:1240] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:45.018203 14265 raft_consensus.cc:2468] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 11.
I20260709 12:11:45.074182 19017 raft_consensus.cc:2764] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:11:45.076375 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:45.077234 14262 raft_consensus.cc:2468] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 10.
I20260709 12:11:44.983755 14303 leader_election.cc:304] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:45.078629 18808 raft_consensus.cc:2749] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:45.069619 18885 raft_consensus.cc:2749] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:44.957053 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:44.890542 19130 raft_consensus.cc:2749] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:44.955921 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:44.992146 14338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 877) took 1129 ms. Trace:
I20260709 12:11:44.942590 19088 leader_election.cc:290] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:45.080236 14304 leader_election.cc:304] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:11:44.973132 14906 raft_consensus.cc:1275] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
W20260709 12:11:44.978593 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 133903us
I20260709 12:11:45.081637 18808 raft_consensus.cc:2804] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:45.082247 18808 raft_consensus.cc:697] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 11 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:44.936653 19131 consensus_queue.cc:1048] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.143s
I20260709 12:11:45.082878 19007 raft_consensus.cc:515] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:44.969681 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:45.083355 18808 consensus_queue.cc:237] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:45.072821 18963 raft_consensus.cc:740] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:11:45.085299 19007 leader_election.cc:290] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 13 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:44.942183 14085 catalog_manager.cc:5697] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:44.972839 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
W20260709 12:11:44.959826 19270 log.cc:927] Time spent T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 12:11:45.086030 18963 consensus_queue.cc:260] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:45.238181 18963 raft_consensus.cc:3060] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:45.238073 19112 consensus_queue.cc:1048] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 12:11:45.235975 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 150207us
I20260709 12:11:45.237483 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:45.242416 14265 raft_consensus.cc:3060] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:45.020891 14084 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44116 (request call id 159) took 26674 ms (client timeout 15000 ms). Trace:
I20260709 12:11:45.080761 14338 rpcz_store.cc:276] 0709 12:11:43.862667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:44.457485 (+594818us) service_pool.cc:224] Handling call
0709 12:11:44.493948 (+ 36463us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:44.510413 (+ 16465us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:44.510452 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:44.511053 (+   601us) log.cc:844] Serialized 26 byte log entry
0709 12:11:44.602765 (+ 91712us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:44.602821 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:44.602897 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:44.991888 (+388991us) raft_consensus.cc:1685] finished
0709 12:11:44.991911 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:44.992078 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1102,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":4851,"thread_start_us":80386,"threads_started":1,"wal-append.queue_time_us":478873}
W20260709 12:11:45.078881 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 95247.4us
W20260709 12:11:45.069139 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 139586us
W20260709 12:11:44.942164 19266 log.cc:927] Time spent T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.222s	user 0.004s	sys 0.000s
I20260709 12:11:45.246462 14187 raft_consensus.cc:1275] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:11:44.963749 14257 raft_consensus.cc:1240] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:44.964535 19237 raft_consensus.cc:3055] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:45.248594 19237 raft_consensus.cc:740] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
W20260709 12:11:44.955411 14155 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:45.251669 14230 leader_election.cc:304] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
W20260709 12:11:45.252803 14155 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:45.253566 18885 consensus_queue.cc:1048] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:11:45.254969 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:45.255281 19017 consensus_queue.cc:1059] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:45.255695 14335 raft_consensus.cc:2468] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 13.
I20260709 12:11:45.256373 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:45.252641 19130 raft_consensus.cc:2804] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:45.256605 19041 consensus_queue.cc:1059] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:11:45.256718 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:45.258425 14333 raft_consensus.cc:1240] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 12:11:45.256307 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:44.954365 19227 raft_consensus.cc:3055] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:44.907980 14263 raft_consensus.cc:2468] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 14.
I20260709 12:11:45.072362 19121 leader_election.cc:290] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:44.904295 19142 raft_consensus.cc:3060] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:45.048951 18992 raft_consensus.cc:515] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:11:45.199249 14302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:44.949873 19190 consensus_queue.cc:237] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:45.080435 14337 raft_consensus.cc:2468] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 9.
I20260709 12:11:45.084496 14334 raft_consensus.cc:3060] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:45.253650 14155 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.174.130:36673 timed out after 1.752s (SENT) [suppressed 8 similar messages]
W20260709 12:11:45.228078 14154 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 258139us
I20260709 12:11:44.986006 14229 leader_election.cc:304] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:44.930401 18813 consensus_queue.cc:237] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:44.956421 14261 raft_consensus.cc:1275] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:11:44.887749 19099 raft_consensus.cc:2804] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:45.304097 19099 raft_consensus.cc:493] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:11:45.304754 19099 raft_consensus.cc:3060] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:45.306725 19225 leader_election.cc:290] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 13 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:11:45.299549 19207 consensus_meta.cc:287] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.579s	user 0.011s	sys 0.000s
I20260709 12:11:45.301841 18986 consensus_queue.cc:1059] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:45.312297 18986 consensus_queue.cc:1048] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:11:45.313171 19110 raft_consensus.cc:493] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:11:45.314006 19088 raft_consensus.cc:3055] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:45.314487 19088 raft_consensus.cc:740] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:11:45.315486 19088 consensus_queue.cc:260] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:45.317109 19088 raft_consensus.cc:3060] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:45.245277 19112 consensus_queue.cc:1059] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.024s
W20260709 12:11:45.324081 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 418936us
I20260709 12:11:45.325103 18992 leader_election.cc:290] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:45.313877 19110 raft_consensus.cc:515] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:45.325044 14229 leader_election.cc:304] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
W20260709 12:11:45.338330 14154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:45.339406 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 85800.8us
W20260709 12:11:45.269822 19229 consensus_meta.cc:287] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.690s	user 0.013s	sys 0.001s
I20260709 12:11:45.244613 14877 leader_election.cc:304] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:11:45.251497 19131 consensus_queue.cc:1059] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:11:45.257869 14303 leader_election.cc:304] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:45.110765 18940 raft_consensus.cc:740] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
W20260709 12:11:45.353399 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 95663.8us
I20260709 12:11:45.359933 19224 raft_consensus.cc:493] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:11:45.360831 19224 raft_consensus.cc:515] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:45.363562 19224 leader_election.cc:290] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:45.367427 19100 raft_consensus.cc:493] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:45.368185 19100 raft_consensus.cc:515] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:45.370066 19186 raft_consensus.cc:493] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:11:45.370711 19186 raft_consensus.cc:515] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:45.373209 19186 leader_election.cc:290] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:45.375000 19112 raft_consensus.cc:2804] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:45.272909 19000 consensus_queue.cc:1048] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:45.383142 18992 consensus_queue.cc:1048] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:45.383632 19000 raft_consensus.cc:2749] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:45.375160 19100 leader_election.cc:290] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:45.384562 19000 raft_consensus.cc:2749] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:45.385308 19000 raft_consensus.cc:3055] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:45.273084 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:45.386085 14184 raft_consensus.cc:2468] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 10.
I20260709 12:11:45.273626 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:45.274721 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:45.387166 14331 raft_consensus.cc:2468] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 11.
I20260709 12:11:45.265858 19227 raft_consensus.cc:740] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:11:45.388401 19112 raft_consensus.cc:493] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:45.388871 19112 raft_consensus.cc:3060] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:45.243175 14084 rpcz_store.cc:269] 0709 12:11:18.346452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:18.346717 (+   265us) service_pool.cc:224] Handling call
0709 12:11:45.020608 (+26673891us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:11:36.365757 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:11:36.400079 (+ 34322us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:11:36.400132 (+    53us) write_op.cc:435] Acquired schema lock
0709 12:11:36.400151 (+    19us) tablet.cc:662] Decoding operations
0709 12:11:36.401543 (+  1392us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:11:36.401642 (+    99us) write_op.cc:641] Partition lock acquired for write op
0709 12:11:36.401674 (+    32us) tablet.cc:685] Acquiring locks for 15 operations
0709 12:11:36.457062 (+ 55388us) tablet.cc:701] Row locks acquired
0709 12:11:36.457118 (+    56us) write_op.cc:260] PREPARE: finished
0709 12:11:36.457309 (+   191us) write_op.cc:270] Start()
0709 12:11:36.457472 (+   163us) write_op.cc:276] Timestamp: P: 1783599096457237 usec, L: 0
0709 12:11:36.457514 (+    42us) op_driver.cc:348] REPLICATION: starting
0709 12:11:36.478186 (+ 20672us) log.cc:844] Serialized 5944 byte log entry
0709 12:11:37.128553 (+650367us) op_driver.cc:464] REPLICATION: finished
0709 12:11:37.471290 (+342737us) write_op.cc:301] APPLY: starting
0709 12:11:37.471410 (+   120us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:37.769542 (+298132us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:37.769683 (+   141us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:38.997154 (+1227471us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:38.997542 (+   388us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=30,key_file_lookups=30,delta_file_lookups=30,mrs_lookups=0
0709 12:11:38.997589 (+    47us) write_op.cc:312] APPLY: finished
0709 12:11:38.998055 (+   466us) log.cc:844] Serialized 139 byte log entry
0709 12:11:39.426017 (+427962us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:39.441607 (+ 15590us) write_op.cc:454] Released schema lock
0709 12:11:39.452257 (+ 10650us) write_op.cc:341] FINISH: Updating metrics
0709 12:11:39.478961 (+ 26704us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:39.484968 (+  6007us) write_op.cc:454] Released schema lock
0709 12:11:40.095971 (+611003us) spinlock_profiling.cc:243] Waited 8.17 ms on lock 0x7b1800365380. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f212cf16ab1 00007f212cf23281 00007f212404e3f3 00007f21240507c1 00007f2124050779 00007f2124050709 00007f21240506d1 00007f212404f9cd 0000000000388634 0000000000388479 00007f212403183a
Metrics: {"mutex_wait_us":9455995,"reported_tablets":27,"child_traces":[["op",{"apply.queue_time_us":308240,"apply.run_cpu_time_us":69875,"apply.run_wall_time_us":1998237,"cfile_cache_hit":62,"cfile_cache_hit_bytes":66947,"num_ops":15,"prepare.queue_time_us":236673,"prepare.run_cpu_time_us":11275,"prepare.run_wall_time_us":266845,"raft.queue_time_us":270958,"raft.run_cpu_time_us":21083,"raft.run_wall_time_us":201335,"replication_time_us":643562,"spinlock_wait_cycles":18779520,"thread_start_us":895008,"threads_started":5,"wal-append.queue_time_us":636934,"wal-append.run_cpu_time_us":31083,"wal-append.run_wall_time_us":2323009}]]}
I20260709 12:11:45.281744 19169 consensus_queue.cc:1048] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:45.040279 18892 raft_consensus.cc:515] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } }
I20260709 12:11:45.349264 14907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:11:45.353946 19040 raft_consensus.cc:2749] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:11:45.376080 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:45.375908 19186 raft_consensus.cc:493] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:45.348686 19229 raft_consensus.cc:515] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:45.348392 18981 raft_consensus.cc:515] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:45.377381 18940 consensus_queue.cc:260] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:45.378685 19142 raft_consensus.cc:515] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:45.441494 18940 raft_consensus.cc:3060] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:45.443065 19142 leader_election.cc:290] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 13 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:45.379410 18986 raft_consensus.cc:493] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:45.448246 18986 raft_consensus.cc:515] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:45.392795 14334 raft_consensus.cc:2468] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 13.
I20260709 12:11:45.450935 19186 raft_consensus.cc:515] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:11:45.350016 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 105502us
I20260709 12:11:45.394841 14907 raft_consensus.cc:3060] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:45.454813 19237 consensus_queue.cc:260] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:45.369599 19110 leader_election.cc:290] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:45.385659 19000 raft_consensus.cc:740] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:11:45.389317 19227 consensus_queue.cc:260] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:45.457969 19227 raft_consensus.cc:3060] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:11:45.462009 19172 consensus_queue.cc:1175] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "17aab1bbf5014936aa18cc21818b26ec" responder_term: 14 status { last_received { term: 13 index: 11 } last_committed_idx: 11 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 13. Current term is 14. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:11:45.463771 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:45.464457 14263 raft_consensus.cc:3060] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:45.466073 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:45.466879 14334 raft_consensus.cc:2393] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db in current term 10: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:11:45.470039 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
W20260709 12:11:45.447988 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 54176.5us
I20260709 12:11:45.433115 18892 leader_election.cc:290] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 13 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:45.436157 19229 leader_election.cc:290] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:45.433666 14085 catalog_manager.cc:5697] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c reported cstate change: term changed from 11 to 12, leader changed from 885067a0d31741bfb5c9935788e315bf (127.12.174.129) to 65c9c1653b3346b39a0e118540e6080c (127.12.174.131). New cstate: current_term: 12 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:45.434653 14332 raft_consensus.cc:1240] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:45.434223 18963 raft_consensus.cc:493] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:11:45.270720 14265 raft_consensus.cc:2468] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 13.
I20260709 12:11:45.397104 14304 leader_election.cc:304] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:11:45.429597 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:45.456806 19000 consensus_queue.cc:260] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:45.484786 14911 raft_consensus.cc:1240] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 12. Current term is 13. Ops: []
W20260709 12:11:45.425904 19256 consensus_meta.cc:287] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.715s	user 0.009s	sys 0.006s
I20260709 12:11:45.490600 14334 raft_consensus.cc:1240] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 13. Current term is 14. Ops: []
W20260709 12:11:45.493239 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:45.495281 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 98343.1us
I20260709 12:11:45.499780 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:45.500631 14331 raft_consensus.cc:3060] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:45.488664 19176 raft_consensus.cc:493] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:45.505026 19207 consensus_queue.cc:1048] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:45.505239 19176 raft_consensus.cc:515] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:45.507544 19176 leader_election.cc:290] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:45.508134 14304 leader_election.cc:304] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:11:45.509248 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:45.531351 14263 raft_consensus.cc:2468] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 13.
I20260709 12:11:45.533921 14085 catalog_manager.cc:5697] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c reported cstate change: term changed from 1 to 5, leader changed from 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130) to 65c9c1653b3346b39a0e118540e6080c (127.12.174.131). New cstate: current_term: 5 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:45.539275 14085 catalog_manager.cc:5697] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c reported cstate change: term changed from 6 to 9, leader changed from 885067a0d31741bfb5c9935788e315bf (127.12.174.129) to 65c9c1653b3346b39a0e118540e6080c (127.12.174.131). New cstate: current_term: 9 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:45.544065 14085 catalog_manager.cc:5697] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:45.542459 14182 raft_consensus.cc:2410] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 12:11:45.519519 18963 raft_consensus.cc:515] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:45.540863 19000 raft_consensus.cc:3060] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:45.533721 19229 raft_consensus.cc:2804] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:45.536238 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:45.554374 14261 raft_consensus.cc:3060] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:45.512986 19040 raft_consensus.cc:2804] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:45.517114 19207 raft_consensus.cc:493] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:45.567009 14331 raft_consensus.cc:2468] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 13.
I20260709 12:11:45.502091 19256 raft_consensus.cc:515] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:45.535570 19237 raft_consensus.cc:3060] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:45.576258 14907 raft_consensus.cc:2468] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 10.
I20260709 12:11:45.579056 18892 raft_consensus.cc:493] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:45.579710 18892 raft_consensus.cc:515] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:45.577693 14154 leader_election.cc:304] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:45.581171 19176 raft_consensus.cc:2804] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:45.581786 19176 raft_consensus.cc:697] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 10 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:11:45.584807 14085 catalog_manager.cc:5697] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c reported cstate change: term changed from 4 to 9, leader changed from 65c9c1653b3346b39a0e118540e6080c (127.12.174.131) to 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130). New cstate: current_term: 9 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } }
I20260709 12:11:45.601279 14877 leader_election.cc:304] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:45.602380 18914 raft_consensus.cc:3060] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:45.614688 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 358050us
I20260709 12:11:45.569252 19229 raft_consensus.cc:697] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 13 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:45.551707 19088 consensus_queue.cc:1059] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 12:11:45.576624 19240 raft_consensus.cc:493] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:11:45.625259 14085 catalog_manager.cc:5697] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c reported cstate change: term changed from 6 to 9, leader changed from 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130) to 65c9c1653b3346b39a0e118540e6080c (127.12.174.131). New cstate: current_term: 9 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:45.584036 18986 leader_election.cc:290] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:45.568727 19189 consensus_queue.cc:1048] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 12:11:45.612836 18914 raft_consensus.cc:2749] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:45.645563 14877 leader_election.cc:304] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:45.575812 19112 raft_consensus.cc:515] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:45.588361 19207 raft_consensus.cc:515] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:45.621515 19130 raft_consensus.cc:697] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 13 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:11:45.635003 18892 leader_election.cc:290] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:45.670708 19225 raft_consensus.cc:493] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:45.674388 19169 raft_consensus.cc:2804] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:45.678452 19099 raft_consensus.cc:515] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:45.680578 14877 leader_election.cc:304] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:11:45.706624 14906 raft_consensus.cc:2393] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 11: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
I20260709 12:11:45.683300 14085 catalog_manager.cc:5697] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c reported cstate change: term changed from 4 to 8, leader changed from 885067a0d31741bfb5c9935788e315bf (127.12.174.129) to 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130). New cstate: current_term: 8 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } }
I20260709 12:11:45.650911 19186 leader_election.cc:290] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:11:45.709926 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 60801us
I20260709 12:11:45.643666 19240 raft_consensus.cc:515] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:45.738008 18963 leader_election.cc:290] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:45.735519 18914 raft_consensus.cc:2804] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:45.780010 18914 raft_consensus.cc:697] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 13 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:11:45.781069 18914 consensus_queue.cc:237] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:45.784762 14085 catalog_manager.cc:5697] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c reported cstate change: term changed from 3 to 8. New cstate: current_term: 8 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:45.787079 14085 catalog_manager.cc:5697] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c reported cstate change: term changed from 6 to 9, leader changed from 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) to 65c9c1653b3346b39a0e118540e6080c (127.12.174.131). New cstate: current_term: 9 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:45.789362 14085 catalog_manager.cc:5697] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c reported cstate change: term changed from 2 to 5, leader changed from 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130) to 65c9c1653b3346b39a0e118540e6080c (127.12.174.131). New cstate: current_term: 5 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:45.791625 14085 catalog_manager.cc:5697] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c reported cstate change: term changed from 6 to 12, leader changed from 65c9c1653b3346b39a0e118540e6080c (127.12.174.131) to 73d01e9b1a9d49358da4985b21d681db (127.12.174.132). New cstate: current_term: 12 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:11:45.793167 14085 catalog_manager.cc:5697] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } }
W20260709 12:11:45.794093 14156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:45.795506 14085 catalog_manager.cc:5697] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c reported cstate change: term changed from 3 to 11. New cstate: current_term: 11 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:45.795787 19229 consensus_queue.cc:237] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:11:45.801854 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:45.797062 14085 catalog_manager.cc:5697] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c reported cstate change: term changed from 5 to 7, leader changed from 65c9c1653b3346b39a0e118540e6080c (127.12.174.131) to 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130). New cstate: current_term: 7 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } }
I20260709 12:11:45.736697 19169 raft_consensus.cc:697] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 13 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:11:45.845844 18963 raft_consensus.cc:3055] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:45.846253 19285 raft_consensus.cc:493] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:45.846572 18963 raft_consensus.cc:740] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:11:45.847538 18963 consensus_queue.cc:260] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:45.850242 19130 consensus_queue.cc:237] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:45.854923 19112 leader_election.cc:290] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 11 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:45.857591 19207 leader_election.cc:290] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:11:45.861539 14154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:45.706458 19225 raft_consensus.cc:515] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:45.804740 18981 leader_election.cc:290] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:45.815577 19017 raft_consensus.cc:493] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:45.685359 19176 consensus_queue.cc:237] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:11:45.869318 14909 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.010s	sys 0.020s
W20260709 12:11:45.883126 14909 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.538s	user 0.011s	sys 0.020s
I20260709 12:11:45.869769 14085 catalog_manager.cc:5697] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } }
W20260709 12:11:45.868803 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 490687us
I20260709 12:11:45.884481 14085 catalog_manager.cc:5697] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c reported cstate change: term changed from 6 to 7, leader changed from 885067a0d31741bfb5c9935788e315bf (127.12.174.129) to 65c9c1653b3346b39a0e118540e6080c (127.12.174.131). New cstate: current_term: 7 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } }
W20260709 12:11:45.902315 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 394271us
I20260709 12:11:45.906783 14085 catalog_manager.cc:5697] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c reported cstate change: term changed from 6 to 9, leader changed from 885067a0d31741bfb5c9935788e315bf (127.12.174.129) to 65c9c1653b3346b39a0e118540e6080c (127.12.174.131). New cstate: current_term: 9 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:45.804085 19041 consensus_queue.cc:1059] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.079s
I20260709 12:11:45.906430 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
W20260709 12:11:45.905359 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 407417us
I20260709 12:11:45.934242 14331 raft_consensus.cc:2393] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 16: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:11:45.937661 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:45.938495 14190 raft_consensus.cc:3060] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:45.942369 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:11:45.938979 14229 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.597s	user 0.022s	sys 0.025s
W20260709 12:11:45.972630 14229 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.630s	user 0.023s	sys 0.026s
I20260709 12:11:45.901803 19040 raft_consensus.cc:697] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 14 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:45.872282 19285 raft_consensus.cc:515] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:45.975888 14155 leader_election.cc:400] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 15 election: Vote denied by peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957) with higher term. Message: Invalid argument: T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 15. Current term is 16.
I20260709 12:11:45.905627 19256 leader_election.cc:290] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:11:45.993396 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 668435us
I20260709 12:11:45.943131 14336 raft_consensus.cc:2468] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 13.
I20260709 12:11:45.990036 14155 leader_election.cc:403] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 12:11:45.976713 14085 catalog_manager.cc:5697] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c reported cstate change: term changed from 6 to 9, leader changed from 885067a0d31741bfb5c9935788e315bf (127.12.174.129) to 65c9c1653b3346b39a0e118540e6080c (127.12.174.131). New cstate: current_term: 9 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:45.993538 14332 raft_consensus.cc:1275] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
W20260709 12:11:46.006109 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 118587us
I20260709 12:11:46.007090 14155 leader_election.cc:304] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:45.974601 19190 raft_consensus.cc:493] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:46.027354 14330 raft_consensus.cc:1240] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 12:11:46.036707 14155 leader_election.cc:304] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:46.038817 14155 leader_election.cc:304] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:45.905257 19017 raft_consensus.cc:515] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:45.995111 18813 raft_consensus.cc:3055] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:45.942572 19007 consensus_queue.cc:1059] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.062s
I20260709 12:11:46.074014 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:11:46.076880 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 81298.7us
I20260709 12:11:46.076812 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:46.028367 19088 raft_consensus.cc:3060] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:11:46.088380 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:46.032706 19087 raft_consensus.cc:2804] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:11:46.090782 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 84143.5us
I20260709 12:11:46.082309 14182 raft_consensus.cc:2468] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 12.
I20260709 12:11:46.074581 19186 raft_consensus.cc:2749] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:46.076534 19110 raft_consensus.cc:2804] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:46.098407 14229 leader_election.cc:304] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:46.098853 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:46.078071 18813 raft_consensus.cc:740] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:11:46.122753 14230 leader_election.cc:304] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:11:45.997726 19169 consensus_queue.cc:237] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:46.105129 19110 raft_consensus.cc:493] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:46.137576 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:11:46.138099 19110 raft_consensus.cc:3060] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:46.138492 14910 raft_consensus.cc:3060] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:46.137576 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:46.142257 19186 consensus_queue.cc:1059] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:46.093540 19087 raft_consensus.cc:493] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:46.143949 19087 raft_consensus.cc:3060] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:46.144474 19299 raft_consensus.cc:493] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:46.144997 19299 raft_consensus.cc:515] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:46.147109 14910 raft_consensus.cc:2468] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 12.
W20260709 12:11:46.150462 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 52181.3us
I20260709 12:11:46.151502 14229 leader_election.cc:304] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:46.152369 19301 raft_consensus.cc:493] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:46.142508 14188 raft_consensus.cc:2468] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 13.
I20260709 12:11:46.153198 19301 raft_consensus.cc:515] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:46.155705 19301 leader_election.cc:290] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:46.153343 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:46.156817 14182 raft_consensus.cc:2368] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for earlier term 12. Current term is 13.
I20260709 12:11:46.127880 14085 catalog_manager.cc:5697] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c reported cstate change: term changed from 5 to 7, leader changed from 65c9c1653b3346b39a0e118540e6080c (127.12.174.131) to 885067a0d31741bfb5c9935788e315bf (127.12.174.129). New cstate: current_term: 7 leader_uuid: "885067a0d31741bfb5c9935788e315bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } }
I20260709 12:11:46.099260 19099 leader_election.cc:290] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 15 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:11:46.116142 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 379013us
W20260709 12:11:46.203173 14261 consensus_meta.cc:287] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.628s	user 0.011s	sys 0.000s
I20260709 12:11:46.203732 14261 raft_consensus.cc:2468] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 14.
W20260709 12:11:46.149633 19000 consensus_meta.cc:287] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.591s	user 0.006s	sys 0.001s
W20260709 12:11:46.206249 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 83554.4us
I20260709 12:11:46.206887 14085 catalog_manager.cc:5697] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:46.152756 19017 leader_election.cc:290] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:46.110972 19303 raft_consensus.cc:493] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:11:46.084549 19190 raft_consensus.cc:515] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:11:46.232496 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 81154.5us
I20260709 12:11:46.240885 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:46.241889 14332 raft_consensus.cc:2393] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 16: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:11:46.244244 19296 raft_consensus.cc:3055] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:46.244786 19296 raft_consensus.cc:740] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:11:46.221097 19130 raft_consensus.cc:2804] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:11:46.241206 19288 log.cc:927] Time spent T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.172s	user 0.001s	sys 0.000s
I20260709 12:11:46.239727 14085 catalog_manager.cc:5697] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:46.220860 19287 raft_consensus.cc:2804] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:46.252710 14229 leader_election.cc:304] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:46.251513 14085 catalog_manager.cc:5697] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c reported cstate change: term changed from 6 to 9, leader changed from 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130) to 65c9c1653b3346b39a0e118540e6080c (127.12.174.131). New cstate: current_term: 9 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:46.218961 19240 leader_election.cc:290] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:46.257036 14085 catalog_manager.cc:5697] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c reported cstate change: term changed from 3 to 9, leader changed from 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130) to 65c9c1653b3346b39a0e118540e6080c (127.12.174.131). New cstate: current_term: 9 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:46.157845 19040 consensus_queue.cc:237] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:46.238921 19225 leader_election.cc:290] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:46.267086 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 13 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:46.236852 19000 consensus_queue.cc:1059] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 12:11:46.232452 19041 consensus_queue.cc:1048] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 12:11:46.256116 19287 raft_consensus.cc:493] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:46.248435 19130 raft_consensus.cc:493] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
W20260709 12:11:46.272194 19227 consensus_meta.cc:287] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db: Time spent flushing consensus metadata: real 0.814s	user 0.015s	sys 0.001s
W20260709 12:11:46.275240 19290 log.cc:927] Time spent T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.197s	user 0.001s	sys 0.000s
W20260709 12:11:46.306738 14155 leader_election.cc:336] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Timed out: RequestConsensusVote RPC to 127.12.174.130:36673 timed out after 1.759s (SENT)
I20260709 12:11:46.292335 19130 raft_consensus.cc:3060] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:46.330562 14155 leader_election.cc:304] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:46.336586 14189 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56652 (request call id 1155) took 1069 ms. Trace:
I20260709 12:11:46.292471 19285 leader_election.cc:290] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:46.245946 19296 consensus_queue.cc:260] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:46.337131 14189 rpcz_store.cc:276] 0709 12:11:45.267041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:45.267186 (+   145us) service_pool.cc:224] Handling call
0709 12:11:45.267512 (+   326us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:45.275405 (+  7893us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:45.275444 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:45.276065 (+   621us) log.cc:844] Serialized 26 byte log entry
0709 12:11:45.681307 (+405242us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:11:45.681354 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:45.681435 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:46.336289 (+654854us) raft_consensus.cc:1685] finished
0709 12:11:46.336318 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:46.336495 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8924,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":109,"thread_start_us":404733,"threads_started":1,"wal-append.queue_time_us":659854}
I20260709 12:11:46.253654 19303 raft_consensus.cc:515] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:46.307631 14184 raft_consensus.cc:2468] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 15.
I20260709 12:11:46.290274 19287 raft_consensus.cc:3060] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:46.332180 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:46.369661 19088 raft_consensus.cc:2749] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957) with higher term. Message: Invalid argument: T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 15. Current term is 16.
W20260709 12:11:46.375201 19297 log.cc:927] Time spent T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 12:11:46.379258 19296 raft_consensus.cc:3060] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:11:46.381769 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:46.385478 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:46.386547 14334 raft_consensus.cc:2468] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 15.
I20260709 12:11:46.388348 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:46.389243 14334 raft_consensus.cc:2393] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 12: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
W20260709 12:11:46.390592 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 86654.1us
I20260709 12:11:46.394136 14334 raft_consensus.cc:1275] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:11:46.290135 18813 consensus_queue.cc:260] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:46.394824 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:46.354323 19291 raft_consensus.cc:2749] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:46.397590 14336 raft_consensus.cc:2468] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 13.
I20260709 12:11:46.399557 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:46.400202 14334 raft_consensus.cc:2468] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 11.
I20260709 12:11:46.400442 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:11:46.397656 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 149057us
I20260709 12:11:46.396831 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:46.402096 14332 raft_consensus.cc:3060] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:46.402863 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:11:46.389386 19237 consensus_meta.cc:287] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db: Time spent flushing consensus metadata: real 0.804s	user 0.010s	sys 0.004s
W20260709 12:11:46.407714 19311 log.cc:927] Time spent T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.138s	user 0.001s	sys 0.000s
I20260709 12:11:46.409145 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 15 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:46.362483 19285 consensus_queue.cc:1048] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 12:11:46.385383 19315 raft_consensus.cc:2749] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:46.401156 14336 raft_consensus.cc:2468] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 14.
I20260709 12:11:46.443019 14190 raft_consensus.cc:2468] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 11.
I20260709 12:11:46.406482 14334 raft_consensus.cc:2393] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 13: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:11:46.404527 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:46.418501 19110 raft_consensus.cc:515] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:46.420315 14229 leader_election.cc:304] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
W20260709 12:11:46.422438 19308 log.cc:927] Time spent T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.109s	user 0.000s	sys 0.001s
W20260709 12:11:46.423615 19300 log.cc:927] Time spent T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:11:46.429811 19319 raft_consensus.cc:3060] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:46.431063 14187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56652 (request call id 1151) took 1165 ms. Trace:
I20260709 12:11:46.435652 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:46.436621 14907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:46.456338 14907 raft_consensus.cc:2393] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 13: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:11:46.437547 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:46.438321 18813 raft_consensus.cc:3060] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:46.410720 19299 leader_election.cc:290] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:46.457278 14912 raft_consensus.cc:2410] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 12:11:46.459169 19190 leader_election.cc:290] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:46.461512 19303 leader_election.cc:290] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:46.471246 19315 raft_consensus.cc:493] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:46.609215 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:46.447412 19110 leader_election.cc:290] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:46.626845 14876 leader_election.cc:304] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:46.477113 19087 raft_consensus.cc:515] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:46.622588 19309 raft_consensus.cc:493] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:46.453946 14187 rpcz_store.cc:276] 0709 12:11:45.265787 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:45.266083 (+   296us) service_pool.cc:224] Handling call
0709 12:11:45.282095 (+ 16012us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:45.282553 (+   458us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:45.282585 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:45.283233 (+   648us) log.cc:844] Serialized 52 byte log entry
0709 12:11:45.705614 (+422381us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:45.738969 (+ 33355us) log.cc:844] Serialized 14 byte log entry
0709 12:11:45.739619 (+   650us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:45.739706 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:46.430773 (+691067us) raft_consensus.cc:1685] finished
0709 12:11:46.430799 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:46.430984 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":34365,"raft.queue_time_us":242,"raft.run_cpu_time_us":260,"raft.run_wall_time_us":18545,"spinlock_wait_cycles":14255360,"thread_start_us":421920,"threads_started":1,"wal-append.queue_time_us":688517}
W20260709 12:11:46.635462 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 217639us
I20260709 12:11:46.640053 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:11:46.487187 19131 raft_consensus.cc:3055] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:46.641659 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:11:46.644124 14876 leader_election.cc:304] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:46.658921 19319 raft_consensus.cc:2749] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:46.662851 14907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:46.663097 14876 leader_election.cc:304] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:46.641469 19000 raft_consensus.cc:3060] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:46.672678 14912 raft_consensus.cc:2393] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 17: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:11:46.674290 14332 raft_consensus.cc:2468] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 10.
W20260709 12:11:46.675455 14155 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:46.644374 19131 raft_consensus.cc:740] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:11:46.645495 19099 raft_consensus.cc:493] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:46.681794 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:11:46.705992 19304 raft_consensus.cc:2804] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:46.676971 19110 raft_consensus.cc:493] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:11:46.647912 19075 raft_consensus.cc:493] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:11:46.676318 19296 raft_consensus.cc:493] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:11:46.709281 19306 raft_consensus.cc:2804] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:11:46.709911 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 289780us
I20260709 12:11:46.638882 19315 raft_consensus.cc:515] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:46.646674 19309 raft_consensus.cc:515] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:46.712019 19287 raft_consensus.cc:515] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:46.715181 19130 raft_consensus.cc:515] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:46.722774 19131 consensus_queue.cc:260] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:46.677057 19236 raft_consensus.cc:2804] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:46.726195 19256 raft_consensus.cc:3055] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:46.727972 19099 raft_consensus.cc:515] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:46.734773 14303 leader_election.cc:304] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
W20260709 12:11:46.718189 14155 leader_election.cc:336] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Timed out: RequestConsensusVote RPC to 127.12.174.130:36673 timed out after 1.664s (SENT)
I20260709 12:11:46.738606 14905 raft_consensus.cc:2410] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
W20260709 12:11:46.740705 14156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:46.746973 19304 raft_consensus.cc:697] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 15 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:11:46.753325 19236 raft_consensus.cc:493] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:46.754822 19306 raft_consensus.cc:697] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 11 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:11:46.755473 19256 raft_consensus.cc:740] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:46.760105 18986 raft_consensus.cc:493] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:46.746563 19075 raft_consensus.cc:515] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:11:46.779340 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 44680.1us
I20260709 12:11:46.778177 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:46.783067 14303 leader_election.cc:304] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:11:46.750705 19110 raft_consensus.cc:515] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:46.762992 19299 raft_consensus.cc:2749] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:46.750531 19296 raft_consensus.cc:515] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:11:46.785786 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 67598.9us
I20260709 12:11:46.775439 19236 raft_consensus.cc:3060] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:46.787186 14261 raft_consensus.cc:1240] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 12:11:46.786311 19131 raft_consensus.cc:3060] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:46.795972 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:46.799466 14911 raft_consensus.cc:2468] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 14.
I20260709 12:11:46.788178 19301 raft_consensus.cc:2804] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:46.800467 19240 raft_consensus.cc:493] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:46.804806 19240 raft_consensus.cc:515] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:46.805027 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:46.806232 19315 leader_election.cc:290] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:46.806862 18963 raft_consensus.cc:3060] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:46.785355 18986 raft_consensus.cc:515] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:11:46.810278 19298 log.cc:927] Time spent T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.727s	user 0.001s	sys 0.017s
I20260709 12:11:46.817214 14303 leader_election.cc:304] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:46.817888 14906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59144 (request call id 537) took 1425 ms. Trace:
I20260709 12:11:46.793614 19087 leader_election.cc:290] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 13 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:46.823910 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:46.822746 14906 rpcz_store.cc:276] 0709 12:11:45.392848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:45.393000 (+   152us) service_pool.cc:224] Handling call
0709 12:11:46.817618 (+1424618us) spinlock_profiling.cc:243] Waited 230 ms on lock 0x7b54007f0154. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:11:46.817797 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":528250752}
I20260709 12:11:46.826074 19299 raft_consensus.cc:493] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:46.826241 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:46.827071 14330 raft_consensus.cc:2393] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 14: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:11:46.826712 19299 raft_consensus.cc:515] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:11:46.827610 19295 log.cc:927] Time spent T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.682s	user 0.006s	sys 0.016s
I20260709 12:11:46.829172 19299 leader_election.cc:290] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:46.829782 19299 raft_consensus.cc:2749] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:46.830572 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:46.830418 19306 consensus_queue.cc:237] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:46.831218 14256 raft_consensus.cc:2468] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 15.
I20260709 12:11:46.832206 19099 leader_election.cc:290] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:46.833688 19075 leader_election.cc:290] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:46.833904 19296 leader_election.cc:290] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:46.803519 19256 consensus_queue.cc:260] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:46.835176 19256 raft_consensus.cc:3060] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:46.826722 19309 leader_election.cc:290] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:46.804993 19130 leader_election.cc:290] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 13 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:46.842026 18885 raft_consensus.cc:3055] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:46.842521 18885 raft_consensus.cc:740] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:11:46.847325 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:46.847930 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:46.848515 14184 raft_consensus.cc:2468] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 11.
W20260709 12:11:46.850917 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:46.858639 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:11:46.859488 14155 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:46.860325 14155 leader_election.cc:304] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:46.862274 14155 leader_election.cc:304] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:46.872522 14155 leader_election.cc:304] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:46.822925 19301 raft_consensus.cc:697] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 12 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:46.876497 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:46.882266 14155 leader_election.cc:304] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:46.885020 19315 raft_consensus.cc:2804] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:46.887355 19087 raft_consensus.cc:2804] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:46.889856 19130 raft_consensus.cc:493] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:46.897122 19309 raft_consensus.cc:493] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:46.908244 14303 leader_election.cc:400] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 12 pre-election: Vote denied by peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187) with higher term. Message: Invalid argument: T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for earlier term 12. Current term is 13.
I20260709 12:11:46.943970 14303 leader_election.cc:403] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:11:46.909363 14154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:46.943748 19087 raft_consensus.cc:493] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:46.945262 19087 raft_consensus.cc:3060] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:46.946702 14303 leader_election.cc:304] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:46.947973 14303 leader_election.cc:304] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:46.948810 19318 raft_consensus.cc:3060] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:46.921712 19017 raft_consensus.cc:493] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:46.950093 19017 raft_consensus.cc:515] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:46.951082 19299 raft_consensus.cc:2749] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:11:46.951864 19299 raft_consensus.cc:2749] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:46.952209 19017 leader_election.cc:290] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:46.957753 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:46.958127 19176 raft_consensus.cc:493] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:46.922188 19113 raft_consensus.cc:493] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:46.943748 19315 raft_consensus.cc:493] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:46.958716 19176 raft_consensus.cc:515] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:46.959287 19315 raft_consensus.cc:3060] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:46.959442 19240 leader_election.cc:290] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:46.944671 19309 raft_consensus.cc:515] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:46.923332 19287 leader_election.cc:290] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 14 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:46.866221 19186 raft_consensus.cc:493] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:46.962200 19296 raft_consensus.cc:493] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:46.931578 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:46.927322 18885 consensus_queue.cc:260] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:46.873838 18892 raft_consensus.cc:2804] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:46.932356 19041 raft_consensus.cc:3055] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:46.935420 14182 raft_consensus.cc:1275] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 10. (term mismatch)
I20260709 12:11:46.964363 14182 pending_rounds.cc:85] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf: Aborting all ops after (but not including) 9
I20260709 12:11:46.964612 14182 pending_rounds.cc:107] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf: Aborting uncommitted NO_OP operation due to leader change: 12.10
I20260709 12:11:46.964826 14182 raft_consensus.cc:2889] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:46.877434 18992 consensus_queue.cc:1048] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.059s
I20260709 12:11:46.877722 19142 raft_consensus.cc:493] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:46.937592 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:46.938337 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:46.972748 14910 raft_consensus.cc:2410] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for term 11 because replica has last-logged OpId of term: 10 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 10.
I20260709 12:11:46.939095 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:46.939436 19000 raft_consensus.cc:2749] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:46.942015 14304 leader_election.cc:304] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:11:46.944692 19130 raft_consensus.cc:515] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:11:46.921262 14228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:46.961761 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:46.931278 19301 consensus_queue.cc:237] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:46.963483 14303 leader_election.cc:304] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:11:46.970475 14261 raft_consensus.cc:2468] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 13.
I20260709 12:11:46.971549 14911 raft_consensus.cc:2393] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 13: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
W20260709 12:11:46.973814 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 91631.8us
I20260709 12:11:46.977337 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:46.980151 14338 raft_consensus.cc:1240] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 12:11:46.981602 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
W20260709 12:11:47.011181 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:47.031199 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:47.031713 19318 raft_consensus.cc:2749] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187) with higher term. Message: Invalid argument: T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for earlier term 12. Current term is 13.
I20260709 12:11:47.031977 14263 raft_consensus.cc:2393] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 12: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:11:47.033229 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:47.033898 19017 raft_consensus.cc:493] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:47.034543 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:47.034430 19017 raft_consensus.cc:515] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:11:47.035837 14302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:47.035912 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:47.036369 19284 raft_consensus.cc:493] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:47.035360 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:47.029877 14337 raft_consensus.cc:3060] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:47.038967 14330 raft_consensus.cc:2468] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 13.
I20260709 12:11:47.035455 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:47.040380 14265 raft_consensus.cc:3060] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:47.034703 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:46.825766 19304 consensus_queue.cc:237] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:46.958827 18986 leader_election.cc:290] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:47.035306 19087 raft_consensus.cc:515] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:46.971360 18940 raft_consensus.cc:493] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:47.053571 18940 raft_consensus.cc:515] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:47.054934 19087 leader_election.cc:290] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:47.055886 18940 leader_election.cc:290] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:47.050014 14185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56652 (request call id 1161) took 1580 ms. Trace:
W20260709 12:11:47.050889 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 87491.2us
I20260709 12:11:47.045181 14257 raft_consensus.cc:2468] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 13.
I20260709 12:11:47.027112 19313 raft_consensus.cc:2804] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:47.026891 19189 raft_consensus.cc:2804] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:46.971489 19041 raft_consensus.cc:740] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:11:47.057533 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:46.971410 18892 raft_consensus.cc:493] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
W20260709 12:11:47.058861 14154 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 84852.9us
I20260709 12:11:46.962369 19186 raft_consensus.cc:515] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:47.060096 14261 raft_consensus.cc:1240] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 15. Current term is 16. Ops: []
I20260709 12:11:47.066864 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:47.067543 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:47.074409 14190 raft_consensus.cc:2368] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for earlier term 11. Current term is 12.
I20260709 12:11:47.028746 19296 raft_consensus.cc:515] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:47.075714 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:47.076313 14187 raft_consensus.cc:3060] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:47.076563 19343 log.cc:927] Time spent T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260709 12:11:47.076779 19296 leader_election.cc:290] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:47.063840 18885 raft_consensus.cc:3060] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:47.068825 18892 raft_consensus.cc:3060] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:47.079804 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 13 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:47.080639 14183 raft_consensus.cc:2410] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:11:47.063827 18935 raft_consensus.cc:493] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:11:47.065596 14182 raft_consensus.cc:2468] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 11.
I20260709 12:11:47.029946 19240 consensus_queue.cc:1048] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 12:11:47.074263 14184 raft_consensus.cc:2468] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 13.
I20260709 12:11:47.058781 14185 rpcz_store.cc:276] 0709 12:11:45.469336 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:45.469509 (+   173us) service_pool.cc:224] Handling call
0709 12:11:45.470061 (+   552us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:45.470538 (+   477us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:45.470570 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:45.471264 (+   694us) log.cc:844] Serialized 26 byte log entry
0709 12:11:45.750193 (+278929us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:46.040584 (+290391us) log.cc:844] Serialized 14 byte log entry
0709 12:11:46.259067 (+218483us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:46.259190 (+   123us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:46.809553 (+550363us) spinlock_profiling.cc:243] Waited 5.66 ms on lock 0x7b4400022b4c. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2123f74c85 00007f2123f756a2 00007f2126ce71db 00007f2126ce2aaf 00007f2126cd686e 00007f2126cd5bb6 00007f2126cd57d8 00007f2126cdf221 00007f2126cdf1d9 00007f2126cdf169
0709 12:11:47.043133 (+233580us) raft_consensus.cc:1685] finished
0709 12:11:47.049798 (+  6665us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:47.049948 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28514,"prepare.queue_time_us":493321,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":50,"raft.queue_time_us":116014,"raft.run_cpu_time_us":256,"raft.run_wall_time_us":7617,"spinlock_wait_cycles":13030528,"thread_start_us":698505,"threads_started":3,"wal-append.queue_time_us":522929}
I20260709 12:11:47.083727 19322 raft_consensus.cc:493] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:47.084295 19322 raft_consensus.cc:515] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:47.086436 19322 leader_election.cc:290] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:47.087798 14876 leader_election.cc:304] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:47.089097 19237 raft_consensus.cc:2804] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:47.089502 19237 raft_consensus.cc:493] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:47.089835 19237 raft_consensus.cc:3060] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:47.090615 19000 consensus_queue.cc:1059] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:47.057651 19284 raft_consensus.cc:515] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:47.061455 19040 raft_consensus.cc:2804] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:47.092399 19040 raft_consensus.cc:697] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 14 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:47.092507 14333 raft_consensus.cc:1240] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:47.093333 19040 consensus_queue.cc:237] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:47.081629 18935 raft_consensus.cc:515] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:47.095935 18935 leader_election.cc:290] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:47.096405 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:47.043525 19287 raft_consensus.cc:493] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:47.098382 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:47.106361 14187 raft_consensus.cc:2468] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 13.
I20260709 12:11:47.097108 14263 raft_consensus.cc:2468] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 14.
I20260709 12:11:47.102975 14265 raft_consensus.cc:2468] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 16.
I20260709 12:11:47.109771 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:47.091820 19176 leader_election.cc:290] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:46.971254 19113 raft_consensus.cc:515] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:47.114660 14265 raft_consensus.cc:1240] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:47.123451 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:46.974272 19236 raft_consensus.cc:515] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:47.135680 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:47.029452 19142 raft_consensus.cc:515] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:47.144775 19142 leader_election.cc:290] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:47.138331 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:47.146090 14184 raft_consensus.cc:2410] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 12:11:47.138417 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:47.147081 14186 raft_consensus.cc:2468] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 10.
I20260709 12:11:47.148875 14335 raft_consensus.cc:1275] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 12:11:47.149435 14155 leader_election.cc:336] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Timed out: RequestConsensusVote RPC to 127.12.174.130:36673 timed out after 1.566s (SENT)
I20260709 12:11:47.149986 14155 leader_election.cc:304] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:47.066618 19299 raft_consensus.cc:493] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:47.061561 19313 raft_consensus.cc:493] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:47.155669 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:47.159377 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:47.160923 14181 raft_consensus.cc:1275] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:11:47.112057 18935 raft_consensus.cc:493] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:47.167829 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:47.168756 14184 raft_consensus.cc:2468] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 12.
I20260709 12:11:47.170390 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:47.169942 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:47.168545 14186 raft_consensus.cc:2468] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 11.
I20260709 12:11:47.176831 14263 raft_consensus.cc:1275] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:11:47.179939 14258 raft_consensus.cc:1275] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:47.181144 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:47.181893 14260 raft_consensus.cc:2468] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 14.
I20260709 12:11:47.160169 19313 raft_consensus.cc:3060] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:47.183256 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:47.183974 14258 raft_consensus.cc:3060] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:47.184300 19130 leader_election.cc:290] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:47.137923 19189 raft_consensus.cc:697] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 14 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:47.187741 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:47.189452 14330 raft_consensus.cc:1275] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:11:47.190012 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:47.190848 14260 raft_consensus.cc:2468] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 12.
W20260709 12:11:47.194053 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 44653.8us
I20260709 12:11:47.195076 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:47.122948 19287 raft_consensus.cc:515] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:47.212345 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:47.212213 14265 raft_consensus.cc:2393] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 14: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:11:47.211930 14877 leader_election.cc:304] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:47.196050 14262 raft_consensus.cc:2393] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db in current term 15: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:11:47.207742 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:47.209619 14261 raft_consensus.cc:2410] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for term 15 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 12:11:47.210538 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:47.220450 14263 raft_consensus.cc:1240] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:47.221458 14333 raft_consensus.cc:2468] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 10.
I20260709 12:11:47.223946 14333 raft_consensus.cc:1275] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:11:47.225765 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:47.226583 14261 raft_consensus.cc:2468] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 9.
I20260709 12:11:47.227792 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:47.228531 14335 raft_consensus.cc:2468] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 13.
I20260709 12:11:47.232481 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:47.233268 14265 raft_consensus.cc:2368] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 12. Current term is 13.
I20260709 12:11:47.234467 14186 raft_consensus.cc:1275] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 14 index: 6. (index mismatch)
I20260709 12:11:47.185951 19347 raft_consensus.cc:2749] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:47.237841 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:47.160096 19299 raft_consensus.cc:515] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:47.238415 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:47.186510 19110 leader_election.cc:290] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:47.238703 14260 raft_consensus.cc:2468] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 13.
I20260709 12:11:47.172405 18935 raft_consensus.cc:515] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:47.240800 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:47.241094 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:47.427780 14265 raft_consensus.cc:2468] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 12.
I20260709 12:11:47.214903 18892 raft_consensus.cc:515] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:47.246006 19309 leader_election.cc:290] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:11:47.246728 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 51612.9us
I20260709 12:11:47.249502 19041 consensus_queue.cc:260] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:47.231002 19225 raft_consensus.cc:2804] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:47.268857 19113 leader_election.cc:290] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:47.269501 19284 leader_election.cc:290] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:11:47.269909 14156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:47.270537 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:47.518283 14184 raft_consensus.cc:2468] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 11.
I20260709 12:11:47.271296 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:47.258172 19189 consensus_queue.cc:237] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:47.272127 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:47.185678 19227 consensus_queue.cc:1048] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.055s
W20260709 12:11:47.298913 14302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:47.299809 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:47.530560 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:47.418938 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 177171us
I20260709 12:11:47.531483 14877 leader_election.cc:304] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:47.424968 14188 raft_consensus.cc:2410] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for term 16 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 12:11:47.427966 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:47.429209 14258 raft_consensus.cc:2468] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 11.
I20260709 12:11:47.427171 14262 raft_consensus.cc:2468] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 14.
I20260709 12:11:47.440807 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:47.534521 14186 raft_consensus.cc:3060] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:47.441942 19186 leader_election.cc:290] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:47.443041 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:47.539924 14183 raft_consensus.cc:3060] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:47.546438 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:47.547102 14182 raft_consensus.cc:2468] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 16.
I20260709 12:11:47.494520 14261 raft_consensus.cc:1240] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 12:11:47.548364 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:11:47.499385 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 56153.6us
I20260709 12:11:47.549639 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:47.550222 19287 leader_election.cc:290] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:47.550863 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:47.551548 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:47.552181 14189 raft_consensus.cc:3060] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:47.412242 19321 raft_consensus.cc:493] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:47.517580 14265 raft_consensus.cc:1240] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:47.527000 14181 raft_consensus.cc:2410] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
W20260709 12:11:47.536016 14302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:47.536496 19121 raft_consensus.cc:2804] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:47.536960 18892 leader_election.cc:290] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 16 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:47.537518 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:47.557924 14188 raft_consensus.cc:3060] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:47.537993 19236 leader_election.cc:290] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 15 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:11:47.538542 19315 consensus_meta.cc:287] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.579s	user 0.015s	sys 0.000s
I20260709 12:11:47.538672 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:47.509045 14337 raft_consensus.cc:2468] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 14.
I20260709 12:11:47.552182 14877 leader_election.cc:304] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:11:47.561290 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:47.574716 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: true dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:47.575484 14261 raft_consensus.cc:2368] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 12. Current term is 13.
I20260709 12:11:47.574077 14910 raft_consensus.cc:2410] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
W20260709 12:11:47.584020 14155 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:47.588632 14155 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:47.522743 19075 raft_consensus.cc:493] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:47.518611 19225 raft_consensus.cc:493] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:11:47.562629 14186 raft_consensus.cc:2410] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 12:11:47.590530 14183 raft_consensus.cc:2468] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 11.
I20260709 12:11:47.603379 18892 consensus_queue.cc:1048] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:47.605352 19347 consensus_queue.cc:1048] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:47.606981 19299 leader_election.cc:290] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:47.555277 19313 raft_consensus.cc:515] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:47.608455 14182 raft_consensus.cc:2468] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 14.
I20260709 12:11:47.610002 19313 leader_election.cc:290] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 14 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:11:47.612877 19131 consensus_meta.cc:287] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.812s	user 0.005s	sys 0.005s
I20260709 12:11:47.613924 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:47.614655 14181 raft_consensus.cc:3060] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Advancing to term 16
I20260709 12:11:47.574378 19321 raft_consensus.cc:515] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:47.620395 19321 leader_election.cc:290] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:47.557444 19121 raft_consensus.cc:493] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:11:47.620715 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:47.622225 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:47.622849 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:47.623589 14265 raft_consensus.cc:2393] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 11: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:11:47.624388 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:47.625094 14265 raft_consensus.cc:2368] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 15. Current term is 16.
W20260709 12:11:47.605477 19349 log.cc:927] Time spent T 00000000000000000000000000000000 P d07070be2c074f4cb9ad35f1580c4ef7: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
I20260709 12:11:47.622380 14256 raft_consensus.cc:1240] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:47.589421 19315 raft_consensus.cc:515] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:47.623612 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:47.629942 14259 raft_consensus.cc:2368] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 13. Current term is 14.
I20260709 12:11:47.630401 19315 leader_election.cc:290] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 14 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:47.563091 19099 consensus_queue.cc:1048] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 7, Time since last communication: 0.075s
I20260709 12:11:47.631093 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:47.633631 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:47.634265 14256 raft_consensus.cc:2376] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 13. Re-sending same reply.
I20260709 12:11:47.638873 19017 leader_election.cc:290] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:47.643489 14187 raft_consensus.cc:2393] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 14: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:11:47.651149 14189 raft_consensus.cc:2468] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 13.
I20260709 12:11:47.655747 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:47.660812 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:47.663115 14265 raft_consensus.cc:1240] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:47.666086 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:47.666874 14183 raft_consensus.cc:2468] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 13.
I20260709 12:11:47.669977 14261 raft_consensus.cc:2393] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 13: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:11:47.671564 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:47.675737 14188 raft_consensus.cc:2468] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 14.
I20260709 12:11:47.677023 14181 raft_consensus.cc:2468] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 16.
I20260709 12:11:47.678254 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:47.600173 19075 raft_consensus.cc:515] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:47.681511 14910 raft_consensus.cc:1275] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:11:47.682706 19075 leader_election.cc:290] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:47.682966 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
W20260709 12:11:47.683676 19355 log.cc:927] Time spent T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.073s	user 0.002s	sys 0.000s
I20260709 12:11:47.685037 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 15 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:47.601470 19236 raft_consensus.cc:2804] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:47.686069 19236 raft_consensus.cc:493] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:47.686468 19236 raft_consensus.cc:3060] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:47.621184 19121 raft_consensus.cc:3060] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:47.688723 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:47.692469 14256 raft_consensus.cc:2468] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 11.
I20260709 12:11:47.622289 18935 leader_election.cc:290] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:47.641790 19225 raft_consensus.cc:3060] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:47.693651 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:47.695425 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:47.724610 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:47.738384 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:47.764019 14256 raft_consensus.cc:2468] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 13.
I20260709 12:11:47.706779 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:47.707206 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:47.765409 14186 raft_consensus.cc:2410] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 12:11:47.725039 14181 raft_consensus.cc:1240] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 12:11:47.703305 14189 raft_consensus.cc:1275] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:47.767220 14262 raft_consensus.cc:2393] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 14: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:11:47.768360 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
W20260709 12:11:47.769065 19350 log.cc:927] Time spent T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.333s	user 0.003s	sys 0.000s
I20260709 12:11:47.769671 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:47.730183 14188 raft_consensus.cc:1275] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 12:11:47.685020 19356 log.cc:927] Time spent T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.129s	user 0.000s	sys 0.002s
I20260709 12:11:47.679831 18992 raft_consensus.cc:493] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:47.770718 14262 raft_consensus.cc:2368] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 13. Current term is 14.
I20260709 12:11:47.771209 14261 raft_consensus.cc:2468] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 12.
I20260709 12:11:47.772240 14265 raft_consensus.cc:2393] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 11: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
W20260709 12:11:47.761404 19237 consensus_meta.cc:287] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db: Time spent flushing consensus metadata: real 0.671s	user 0.006s	sys 0.015s
I20260709 12:11:47.780292 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:47.781677 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:47.782047 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:47.783574 14262 raft_consensus.cc:2468] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 14.
I20260709 12:11:47.784555 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:11:47.777895 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 225829us
I20260709 12:11:47.786233 14256 raft_consensus.cc:2393] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 11: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:11:47.787490 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:47.785709 14261 raft_consensus.cc:2393] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 13: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:11:47.791754 14877 leader_election.cc:304] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:47.793440 14181 raft_consensus.cc:1275] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:11:47.789723 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:47.791934 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:47.795212 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:47.795609 14259 raft_consensus.cc:2393] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 14: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:11:47.795979 14262 raft_consensus.cc:2468] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 13.
I20260709 12:11:47.799242 14265 raft_consensus.cc:2393] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 12: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:11:47.801437 14877 leader_election.cc:304] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:47.792254 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:47.803833 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:47.804337 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:47.815927 14877 leader_election.cc:304] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:47.821564 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
W20260709 12:11:47.823670 19352 log.cc:927] Time spent T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 12:11:47.824378 19240 raft_consensus.cc:2749] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:11:47.827107 14155 leader_election.cc:336] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Timed out: RequestConsensusVote RPC to 127.12.174.130:36673 timed out after 1.752s (SENT)
I20260709 12:11:47.827673 14155 leader_election.cc:304] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:47.829106 19087 raft_consensus.cc:2749] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:47.830197 19087 raft_consensus.cc:493] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:47.830731 19087 raft_consensus.cc:515] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:47.782866 19237 raft_consensus.cc:515] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:47.840755 14877 leader_election.cc:304] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:47.838979 18940 raft_consensus.cc:2804] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:47.843451 14261 raft_consensus.cc:2410] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for term 15 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 12:11:47.851307 19224 raft_consensus.cc:2804] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:47.851902 19224 raft_consensus.cc:493] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:47.852298 19224 raft_consensus.cc:3060] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:47.802423 19169 raft_consensus.cc:2764] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 12:11:47.780766 18992 raft_consensus.cc:515] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:47.878160 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:47.855268 18940 raft_consensus.cc:493] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
W20260709 12:11:47.888366 19351 log.cc:927] Time spent T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.352s	user 0.002s	sys 0.000s
I20260709 12:11:47.882161 18940 raft_consensus.cc:3060] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:47.895045 19237 leader_election.cc:290] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 13 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:47.900735 19225 raft_consensus.cc:515] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:47.902304 14906 raft_consensus.cc:1240] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 12:11:47.902531 19041 raft_consensus.cc:3060] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:47.906736 19225 leader_election.cc:290] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 14 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:47.908008 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:47.926805 14264 raft_consensus.cc:2368] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 15. Current term is 16.
I20260709 12:11:47.927907 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:47.929004 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:47.908743 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:47.930176 14256 raft_consensus.cc:3060] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:47.930804 14262 raft_consensus.cc:2410] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for term 14 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:11:47.932902 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:47.933483 14262 raft_consensus.cc:3060] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:47.929683 14264 raft_consensus.cc:2393] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 14: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:11:47.938700 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:47.940554 14264 raft_consensus.cc:2393] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 14: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:11:47.941498 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:47.942871 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:47.909461 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:47.910049 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:47.910205 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:48.146592 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:48.146799 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:48.147919 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:48.148094 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:47.895649 19121 raft_consensus.cc:515] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:47.911337 18992 leader_election.cc:290] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:11:47.906728 19342 log.cc:927] Time spent T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.461s	user 0.002s	sys 0.005s
I20260709 12:11:47.912793 19190 consensus_queue.cc:1059] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 12:11:47.915889 14154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:48.150067 14261 raft_consensus.cc:2468] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 13.
I20260709 12:11:48.152375 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:47.917621 19075 raft_consensus.cc:493] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:47.921922 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
W20260709 12:11:47.943754 14228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:48.153270 14911 raft_consensus.cc:1240] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:48.153227 19075 raft_consensus.cc:515] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:48.155570 19075 leader_election.cc:290] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:47.944918 14262 raft_consensus.cc:2468] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 14.
I20260709 12:11:47.947607 19318 raft_consensus.cc:493] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:48.158378 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:47.950631 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:11:47.951339 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:47.954157 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:47.954421 19256 raft_consensus.cc:493] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:48.159305 14909 raft_consensus.cc:2368] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 12. Current term is 13.
I20260709 12:11:48.159456 19256 raft_consensus.cc:515] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:48.160101 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:48.160701 14335 raft_consensus.cc:3060] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:47.964099 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:47.964659 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:48.162096 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:48.162396 14331 raft_consensus.cc:2410] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 12:11:48.162600 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:48.163229 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:48.165177 19256 leader_election.cc:290] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:47.964953 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:48.165572 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:48.166057 14339 raft_consensus.cc:2468] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 16.
I20260709 12:11:47.965405 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:48.166673 14334 raft_consensus.cc:3060] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:48.168123 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:47.965651 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:47.965931 19301 raft_consensus.cc:493] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:11:47.974022 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:47.974301 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:48.172588 14190 raft_consensus.cc:2468] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 12.
I20260709 12:11:47.975438 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:47.976720 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:47.977854 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:47.978730 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:48.173923 14188 raft_consensus.cc:3060] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:11:48.174273 14186 raft_consensus.cc:3060] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:11:47.979384 19087 leader_election.cc:290] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:47.980654 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:47.982453 14907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:47.983048 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:48.181641 14336 raft_consensus.cc:3060] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:47.986238 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:47.991034 14189 raft_consensus.cc:1275] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:11:47.995149 14155 leader_election.cc:304] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:47.989508 14187 raft_consensus.cc:1275] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:11:47.980742 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:48.008455 14256 raft_consensus.cc:2468] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 12.
I20260709 12:11:48.185344 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:48.186107 14256 raft_consensus.cc:2468] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 10.
W20260709 12:11:48.008855 19357 log.cc:927] Time spent T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.467s	user 0.000s	sys 0.003s
W20260709 12:11:48.009095 14302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:48.000905 14229 connection.cc:256] RPC call timeout handler was delayed by -3.6111251320000974s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15960000000000002s for a response
W20260709 12:11:48.189828 14229 connection.cc:256] RPC call timeout handler was delayed by -3.4932251320001342s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17270000000000002s for a response
W20260709 12:11:48.190171 14229 connection.cc:256] RPC call timeout handler was delayed by -3.44102513200005s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1785s for a response
W20260709 12:11:48.190420 14229 connection.cc:256] RPC call timeout handler was delayed by -3.24032513200018s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2008s for a response
W20260709 12:11:48.190667 14229 connection.cc:256] RPC call timeout handler was delayed by -2.1306251320002048s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.32410000000000005s for a response
I20260709 12:11:47.908756 19224 raft_consensus.cc:515] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:11:48.026512 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 73698.2us
I20260709 12:11:48.139601 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:48.196074 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:48.196676 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:48.140802 19236 raft_consensus.cc:515] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:48.207850 14905 raft_consensus.cc:2393] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 15: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
I20260709 12:11:48.209123 19236 leader_election.cc:290] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 15 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:48.158190 19318 raft_consensus.cc:515] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:48.218029 19176 raft_consensus.cc:3055] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:48.218532 19176 raft_consensus.cc:740] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:11:48.219774 19318 leader_election.cc:290] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:48.219470 19176 consensus_queue.cc:260] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:11:47.948727 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 767478us
I20260709 12:11:48.158515 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:48.221300 14262 raft_consensus.cc:3060] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:48.166198 14261 raft_consensus.cc:3060] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:48.226464 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:48.227391 14181 raft_consensus.cc:2368] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 10. Current term is 11.
I20260709 12:11:48.228322 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:48.229031 14181 raft_consensus.cc:2393] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 16: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:11:48.172750 14263 raft_consensus.cc:2368] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 13. Current term is 14.
I20260709 12:11:48.229847 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:48.230551 14339 raft_consensus.cc:2468] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 10.
I20260709 12:11:47.975265 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:48.232869 14258 raft_consensus.cc:2368] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 15. Current term is 16.
I20260709 12:11:48.233604 19224 leader_election.cc:290] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 15 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:48.205615 14229 leader_election.cc:304] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:48.220942 14304 leader_election.cc:304] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:11:48.211607 14182 raft_consensus.cc:1240] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:48.240893 14262 raft_consensus.cc:2468] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 13.
I20260709 12:11:48.180572 14876 leader_election.cc:304] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:48.152942 19121 leader_election.cc:290] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 11 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:11:48.265161 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 84697.3us
I20260709 12:11:48.149165 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:48.198266 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:48.188879 19301 raft_consensus.cc:515] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:48.201206 14303 leader_election.cc:400] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 11 pre-election: Vote denied by peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187) with higher term. Message: Invalid argument: T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for earlier term 11. Current term is 12.
I20260709 12:11:48.203088 14257 raft_consensus.cc:1275] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:11:48.203823 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:48.204903 14260 raft_consensus.cc:1275] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:11:48.196594 14264 raft_consensus.cc:2468] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 16.
I20260709 12:11:48.206736 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:48.126627 18940 raft_consensus.cc:515] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:48.210147 19186 consensus_queue.cc:1048] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:11:48.210793 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 215729us
I20260709 12:11:48.210988 14259 raft_consensus.cc:1275] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:11:48.211412 19087 raft_consensus.cc:2749] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:48.182148 18992 raft_consensus.cc:493] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:48.173923 14335 raft_consensus.cc:2468] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 14.
I20260709 12:11:48.243229 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:48.244046 14182 raft_consensus.cc:1240] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 15. Current term is 16. Ops: []
I20260709 12:11:48.246284 14186 raft_consensus.cc:2468] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 15.
I20260709 12:11:48.247853 14304 leader_election.cc:304] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
W20260709 12:11:48.326620 14302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:48.351764 14155 leader_election.cc:304] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
W20260709 12:11:48.337947 19369 log.cc:927] Time spent T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.158s	user 0.001s	sys 0.000s
I20260709 12:11:48.252398 14334 raft_consensus.cc:2468] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 16.
I20260709 12:11:48.252853 19041 raft_consensus.cc:2749] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:11:48.354110 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 107460us
I20260709 12:11:48.355098 19309 raft_consensus.cc:2804] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:11:48.366405 19309 raft_consensus.cc:697] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 16 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:48.367425 19309 consensus_queue.cc:237] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 14.6, Last appended by leader: 6, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:48.257195 14188 raft_consensus.cc:2468] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 13.
I20260709 12:11:48.371843 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:48.372763 14186 raft_consensus.cc:2393] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 16: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:11:48.373688 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:11:48.270027 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 78865.4us
I20260709 12:11:48.374004 19040 consensus_queue.cc:1048] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:48.374976 19041 consensus_queue.cc:1059] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:11:48.360920 14303 leader_election.cc:403] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:48.363425 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:48.220902 19176 raft_consensus.cc:3060] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:48.375857 14186 raft_consensus.cc:2468] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 11.
I20260709 12:11:48.372634 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:48.251452 14261 raft_consensus.cc:2468] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 15.
I20260709 12:11:48.358469 14185 raft_consensus.cc:2410] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for term 16 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 12:11:48.375176 14229 leader_election.cc:304] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:48.266345 14876 leader_election.cc:304] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:48.357903 18992 raft_consensus.cc:515] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:48.381798 14183 raft_consensus.cc:2468] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 13.
I20260709 12:11:48.383373 14182 raft_consensus.cc:2393] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 12: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:11:48.383802 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:11:48.384332 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 118089us
I20260709 12:11:48.259099 14336 raft_consensus.cc:2468] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 12.
I20260709 12:11:48.386626 14876 leader_election.cc:304] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:48.387452 14155 leader_election.cc:304] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:48.384583 14333 raft_consensus.cc:2468] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 14.
I20260709 12:11:48.348529 19315 raft_consensus.cc:493] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
W20260709 12:11:48.392189 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 189376us
I20260709 12:11:48.395393 14877 leader_election.cc:304] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:11:48.352811 19380 raft_consensus.cc:2749] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:48.402760 19380 raft_consensus.cc:2749] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:48.404151 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:48.394099 19362 raft_consensus.cc:2749] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:48.405923 14186 raft_consensus.cc:1240] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:48.406560 19362 consensus_queue.cc:1048] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:11:48.408773 14186 raft_consensus.cc:1240] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 13. Current term is 14. Ops: [13.7-13.7]
W20260709 12:11:48.396750 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 195676us
I20260709 12:11:48.449290 14303 leader_election.cc:304] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:48.450282 14190 raft_consensus.cc:2468] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 14.
I20260709 12:11:48.451112 19189 raft_consensus.cc:2749] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:48.451241 14303 leader_election.cc:304] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:11:48.396962 19040 raft_consensus.cc:2749] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187) with higher term. Message: Invalid argument: T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for earlier term 11. Current term is 12.
I20260709 12:11:48.452749 19189 raft_consensus.cc:2804] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:48.397809 19088 raft_consensus.cc:493] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:48.453329 19189 raft_consensus.cc:493] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:11:48.375895 19041 raft_consensus.cc:3055] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:48.454310 19041 raft_consensus.cc:740] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
W20260709 12:11:48.455096 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 80010.1us
I20260709 12:11:48.390041 19322 raft_consensus.cc:2749] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:48.453759 19088 raft_consensus.cc:515] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:48.396870 19121 raft_consensus.cc:2749] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:48.409971 19172 consensus_queue.cc:1048] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:11:48.457921 14229 leader_election.cc:304] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:48.411284 19075 raft_consensus.cc:2804] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:48.414409 14876 leader_election.cc:304] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:48.415068 19354 consensus_queue.cc:1048] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:11:48.458742 19322 raft_consensus.cc:2749] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:48.459158 14303 leader_election.cc:304] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:11:48.458766 19075 raft_consensus.cc:493] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:48.460214 19075 raft_consensus.cc:3060] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:48.461701 19088 leader_election.cc:290] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:48.415242 19237 consensus_queue.cc:1048] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:11:48.455295 19041 consensus_queue.cc:260] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:48.463752 19041 raft_consensus.cc:3060] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:48.415915 14304 leader_election.cc:304] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db
W20260709 12:11:48.464826 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 49000.3us
I20260709 12:11:48.466141 19256 raft_consensus.cc:2804] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:48.466463 14304 leader_election.cc:304] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:11:48.416301 19303 consensus_queue.cc:1048] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:48.467280 19040 raft_consensus.cc:2804] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:48.467751 19040 raft_consensus.cc:493] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:48.468115 18992 leader_election.cc:290] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:11:48.468824 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 54514.1us
I20260709 12:11:48.469563 14876 leader_election.cc:304] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:48.472671 19121 raft_consensus.cc:2804] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:48.473248 19121 raft_consensus.cc:697] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 15 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:11:48.468111 19040 raft_consensus.cc:3060] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:48.474191 19121 consensus_queue.cc:237] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:48.475306 19236 raft_consensus.cc:2804] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:48.475893 19236 raft_consensus.cc:697] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 13 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:11:48.476821 19236 consensus_queue.cc:237] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:48.419458 14184 raft_consensus.cc:1240] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:48.339788 19358 consensus_queue.cc:1059] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.086s
I20260709 12:11:48.425657 19315 raft_consensus.cc:515] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:48.426133 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:48.431370 18940 leader_election.cc:290] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 10 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:48.492038 14303 leader_election.cc:304] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:11:48.432188 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:48.493319 14188 raft_consensus.cc:2468] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 13.
I20260709 12:11:48.494267 14185 raft_consensus.cc:2393] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 14: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:11:48.439152 19301 leader_election.cc:290] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:48.453840 19189 raft_consensus.cc:3060] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:48.393294 19318 raft_consensus.cc:2804] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:48.466527 14229 leader_election.cc:304] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
W20260709 12:11:48.482389 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 86268.2us
I20260709 12:11:48.497468 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:48.498229 14155 leader_election.cc:304] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:48.499403 19358 raft_consensus.cc:2749] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:48.497807 18992 raft_consensus.cc:3055] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:48.505374 14155 leader_election.cc:304] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:48.505801 18992 raft_consensus.cc:740] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:11:48.506903 18992 consensus_queue.cc:260] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:48.508719 18992 raft_consensus.cc:3060] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:48.484126 14190 raft_consensus.cc:1240] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 12. Current term is 13. Ops: []
W20260709 12:11:48.485522 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 68440.8us
I20260709 12:11:48.279258 19224 raft_consensus.cc:2804] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:48.522047 14155 leader_election.cc:304] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
W20260709 12:11:48.483496 14154 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 188569us
I20260709 12:11:48.524925 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:48.525635 14262 raft_consensus.cc:3060] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:48.527628 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:48.528403 14333 raft_consensus.cc:3060] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:11:48.530231 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:48.530951 14257 raft_consensus.cc:3060] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:11:48.536003 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:48.542553 14186 raft_consensus.cc:1275] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:11:48.547624 14185 raft_consensus.cc:1275] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:11:48.551615 14155 leader_election.cc:304] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
W20260709 12:11:48.552268 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 85866.5us
I20260709 12:11:48.558775 14877 leader_election.cc:304] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:48.517764 19301 raft_consensus.cc:2764] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 12:11:48.564749 14229 leader_election.cc:304] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:48.549538 19338 raft_consensus.cc:2804] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:48.493884 19354 consensus_queue.cc:1059] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.059s
I20260709 12:11:48.572834 14155 leader_election.cc:400] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 13 election: Vote denied by peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673) with higher term. Message: Invalid argument: T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 13. Current term is 14.
I20260709 12:11:48.574638 14262 raft_consensus.cc:2468] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 15.
I20260709 12:11:48.545449 19224 raft_consensus.cc:493] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:48.568593 14333 raft_consensus.cc:2468] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 15.
I20260709 12:11:48.553149 19322 raft_consensus.cc:2749] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:48.552469 19088 raft_consensus.cc:2764] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 12:11:48.596714 14155 leader_election.cc:403] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 12:11:48.548982 18940 consensus_queue.cc:1048] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.048s
I20260709 12:11:48.587740 19358 raft_consensus.cc:2749] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:48.610283 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:48.611038 14183 raft_consensus.cc:2468] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 13.
I20260709 12:11:48.577097 19299 raft_consensus.cc:493] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:11:48.612082 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:48.613044 14189 raft_consensus.cc:3060] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:48.587563 19338 raft_consensus.cc:493] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:11:48.603178 19224 raft_consensus.cc:3060] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:48.596226 18935 raft_consensus.cc:2749] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:11:48.627765 14228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:48.630894 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 58221.7us
I20260709 12:11:48.631795 14155 leader_election.cc:304] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:48.606669 19301 raft_consensus.cc:493] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:11:48.670656 14189 raft_consensus.cc:2468] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 14.
W20260709 12:11:48.659230 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 192845us
I20260709 12:11:48.660492 14155 leader_election.cc:304] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:48.625867 19338 raft_consensus.cc:3060] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:48.693186 14155 leader_election.cc:304] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:48.623528 19256 raft_consensus.cc:697] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 13 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
W20260709 12:11:48.698556 19385 log.cc:927] Time spent T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 12:11:48.698988 19301 raft_consensus.cc:515] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:48.621817 19299 raft_consensus.cc:515] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:48.701546 19176 raft_consensus.cc:2804] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:48.663776 19309 raft_consensus.cc:3055] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:48.703292 19322 raft_consensus.cc:2804] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:11:48.721364 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:48.701593 19088 raft_consensus.cc:3060] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:48.664621 19190 raft_consensus.cc:2749] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:48.685271 19358 raft_consensus.cc:2749] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673) with higher term. Message: Invalid argument: T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 13. Current term is 14.
W20260709 12:11:48.729686 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 138903us
W20260709 12:11:48.734961 14302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:48.742019 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 47330us
I20260709 12:11:48.748432 14155 leader_election.cc:304] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:48.749727 14155 leader_election.cc:304] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:48.751058 14155 leader_election.cc:304] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:48.666162 19383 raft_consensus.cc:2749] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:48.731508 19176 raft_consensus.cc:493] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:48.731397 19309 raft_consensus.cc:740] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
W20260709 12:11:48.764839 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 200155us
W20260709 12:11:48.775928 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 283970us
W20260709 12:11:48.789984 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 184957us
I20260709 12:11:48.753247 19087 raft_consensus.cc:2749] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:48.753480 19380 raft_consensus.cc:2764] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
W20260709 12:11:48.819830 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 88278.9us
I20260709 12:11:48.762611 19176 raft_consensus.cc:3060] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:48.762529 19315 leader_election.cc:290] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:48.825439 14877 leader_election.cc:304] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:11:48.829288 14257 raft_consensus.cc:2468] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 15.
I20260709 12:11:48.833341 14303 leader_election.cc:304] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
W20260709 12:11:48.837240 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 86258.3us
I20260709 12:11:48.838390 14155 leader_election.cc:304] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:48.839223 14877 leader_election.cc:304] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:48.767508 19392 raft_consensus.cc:493] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:48.818760 19322 raft_consensus.cc:697] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 17 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:11:48.844962 19315 raft_consensus.cc:2749] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:48.851218 14877 leader_election.cc:304] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
W20260709 12:11:48.868489 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 47349.2us
W20260709 12:11:48.869899 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 103350us
I20260709 12:11:48.855865 19236 raft_consensus.cc:2749] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:48.852816 19399 raft_consensus.cc:2804] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:48.879184 14229 leader_election.cc:400] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 election: Vote denied by peer 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341) with higher term. Message: Invalid argument: T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 12. Current term is 13.
I20260709 12:11:48.880800 14229 leader_election.cc:403] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 12:11:48.859283 19388 raft_consensus.cc:2749] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:48.865378 19087 raft_consensus.cc:2749] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:48.865242 19240 raft_consensus.cc:2804] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Leader election won for term 15
W20260709 12:11:48.886722 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 48434.9us
I20260709 12:11:48.910418 14155 leader_election.cc:304] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:48.914412 14155 leader_election.cc:304] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:48.911588 14303 leader_election.cc:304] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
W20260709 12:11:48.928704 19397 log.cc:927] Time spent T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 12:11:48.931939 19040 raft_consensus.cc:515] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:48.933205 14338 raft_consensus.cc:1240] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:48.860728 19392 raft_consensus.cc:515] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:48.856756 19309 consensus_queue.cc:260] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:48.950583 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:48.938655 14303 leader_election.cc:304] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:48.859525 19256 consensus_queue.cc:237] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:48.957157 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
W20260709 12:11:48.957235 14154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:48.963346 14260 raft_consensus.cc:1240] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:48.923333 19186 raft_consensus.cc:2749] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:48.927207 19240 raft_consensus.cc:697] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 15 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:11:48.938637 19388 consensus_queue.cc:1048] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 12:11:48.966388 19406 raft_consensus.cc:2749] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:48.985663 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:48.986485 14261 raft_consensus.cc:2468] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 13.
I20260709 12:11:48.921902 19399 raft_consensus.cc:697] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 15 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:11:48.988139 19399 consensus_queue.cc:237] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:48.988684 19318 raft_consensus.cc:493] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:48.989235 19318 raft_consensus.cc:3060] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:48.990703 19408 raft_consensus.cc:493] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:48.991504 19354 raft_consensus.cc:2749] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:11:48.991263 19408 raft_consensus.cc:515] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:48.966955 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:48.993523 14262 raft_consensus.cc:2368] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for earlier term 14. Current term is 15.
I20260709 12:11:48.975649 14263 raft_consensus.cc:1275] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:11:48.978497 14256 raft_consensus.cc:1275] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:11:48.979509 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:48.998541 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:11:49.000406 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 121311us
I20260709 12:11:49.005460 14229 leader_election.cc:304] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
W20260709 12:11:49.012305 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 100593us
I20260709 12:11:49.013229 14155 leader_election.cc:304] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:48.886094 19395 consensus_queue.cc:1059] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.111s
I20260709 12:11:48.992512 19404 raft_consensus.cc:2749] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341) with higher term. Message: Invalid argument: T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 12. Current term is 13.
I20260709 12:11:48.995141 19401 raft_consensus.cc:2804] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:11:48.996776 19041 consensus_meta.cc:287] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.533s	user 0.002s	sys 0.010s
I20260709 12:11:48.982455 19402 raft_consensus.cc:493] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:49.017426 19387 log.cc:927] Time spent T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.190s	user 0.003s	sys 0.000s
W20260709 12:11:49.000191 19371 log.cc:927] Time spent T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 12:11:48.978446 19299 leader_election.cc:290] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:49.036793 19309 raft_consensus.cc:3060] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:49.058082 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 44934.3us
I20260709 12:11:48.998492 19338 raft_consensus.cc:515] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:11:49.063995 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 58617.4us
I20260709 12:11:49.043785 19186 raft_consensus.cc:2749] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:11:49.045336 19401 raft_consensus.cc:493] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:11:48.965831 19322 consensus_queue.cc:237] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:48.976572 19240 consensus_queue.cc:237] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:49.115833 14155 leader_election.cc:304] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:49.115962 14230 leader_election.cc:304] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:11:49.055397 19224 raft_consensus.cc:515] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:49.131255 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:11:49.131925 14229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:49.132769 14229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:49.133152 14229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:49.134332 14229 leader_election.cc:400] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 pre-election: Vote denied by peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187) with higher term. Message: Invalid argument: T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 10. Current term is 11.
I20260709 12:11:49.091809 19401 raft_consensus.cc:3060] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:49.138638 14181 raft_consensus.cc:2468] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 15.
W20260709 12:11:49.167204 14304 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:49.169543 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 53683.1us
I20260709 12:11:49.055773 19402 raft_consensus.cc:515] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:49.097230 19413 raft_consensus.cc:2749] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:49.115149 19041 raft_consensus.cc:3055] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:49.130764 19087 raft_consensus.cc:3060] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:49.135562 19075 consensus_meta.cc:287] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db: Time spent flushing consensus metadata: real 0.675s	user 0.013s	sys 0.001s
I20260709 12:11:49.123843 19408 leader_election.cc:290] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:49.171926 14338 raft_consensus.cc:1240] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 12. Current term is 13. Ops: []
W20260709 12:11:49.171979 18992 consensus_meta.cc:287] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.631s	user 0.012s	sys 0.002s
W20260709 12:11:49.192380 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 76756.7us
I20260709 12:11:49.193326 14155 leader_election.cc:400] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 15 pre-election: Vote denied by peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673) with higher term. Message: Invalid argument: T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 15. Current term is 16.
I20260709 12:11:49.193670 14155 leader_election.cc:403] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:49.174084 14229 leader_election.cc:304] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:49.176293 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:49.177515 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:49.181216 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:49.196617 14335 raft_consensus.cc:2393] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 14: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:11:49.200688 14229 leader_election.cc:304] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:49.186918 14189 raft_consensus.cc:1275] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260709 12:11:49.188539 14302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:49.205482 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:49.206645 14333 raft_consensus.cc:2393] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 12: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:11:49.172065 19388 raft_consensus.cc:493] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:49.176803 19403 raft_consensus.cc:493] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:49.230074 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:49.174976 19041 raft_consensus.cc:740] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
W20260709 12:11:49.249522 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 310956us
I20260709 12:11:49.250720 14303 leader_election.cc:304] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:11:49.251607 19419 raft_consensus.cc:2804] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:11:49.252224 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:11:49.253890 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 60714.1us
I20260709 12:11:49.255390 14155 leader_election.cc:304] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:49.170215 19398 consensus_queue.cc:1059] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.046s
I20260709 12:11:49.258586 14155 leader_election.cc:304] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:49.214716 19408 raft_consensus.cc:2749] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:11:49.213966 19315 raft_consensus.cc:2749] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673) with higher term. Message: Invalid argument: T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 15. Current term is 16.
I20260709 12:11:49.230489 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:11:49.263137 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 62566.2us
I20260709 12:11:49.269500 14155 leader_election.cc:304] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:49.273908 14229 leader_election.cc:304] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:49.275162 14229 leader_election.cc:304] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:49.210891 19420 raft_consensus.cc:2804] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:49.272529 14303 leader_election.cc:304] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:49.283602 14229 leader_election.cc:304] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:49.197570 19075 raft_consensus.cc:515] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:49.287070 14303 leader_election.cc:304] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:49.290238 19430 raft_consensus.cc:2749] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:49.290951 14304 leader_election.cc:304] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:11:49.252246 19419 raft_consensus.cc:697] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 16 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:49.260459 18992 raft_consensus.cc:2749] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:49.260685 19186 raft_consensus.cc:2749] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:49.242480 19388 raft_consensus.cc:515] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:49.302930 14229 leader_election.cc:304] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:49.277977 19392 leader_election.cc:290] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:49.288689 19411 raft_consensus.cc:2749] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:49.330550 19411 raft_consensus.cc:2749] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 12:11:49.315155 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 144777us
I20260709 12:11:49.333001 14229 leader_election.cc:304] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:49.334292 14229 leader_election.cc:304] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
W20260709 12:11:49.316087 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 150988us
I20260709 12:11:49.321481 14303 leader_election.cc:304] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:11:49.339102 14303 leader_election.cc:304] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:11:49.315124 19430 raft_consensus.cc:2749] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:49.328065 19432 raft_consensus.cc:2804] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:49.272830 19414 consensus_queue.cc:1059] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 12:11:49.334991 14230 leader_election.cc:304] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:49.270875 19422 consensus_queue.cc:1059] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.067s
W20260709 12:11:49.434592 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 93661.2us
I20260709 12:11:49.252911 19403 raft_consensus.cc:515] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:49.302093 19315 raft_consensus.cc:2804] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:49.293785 19256 consensus_queue.cc:1059] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.044s
I20260709 12:11:49.335120 19410 raft_consensus.cc:2749] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:49.344194 19354 raft_consensus.cc:2804] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:49.592696 19430 raft_consensus.cc:2804] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:49.585807 19315 raft_consensus.cc:493] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:49.312101 19041 consensus_queue.cc:260] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } }
I20260709 12:11:49.625077 19440 consensus_queue.cc:1059] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:49.626394 19440 raft_consensus.cc:2804] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:49.626754 19440 raft_consensus.cc:493] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:49.627095 19440 raft_consensus.cc:3060] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:11:49.631229 19431 log.cc:927] Time spent T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.136s	user 0.000s	sys 0.000s
I20260709 12:11:49.632647 19402 leader_election.cc:290] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:49.633797 19419 consensus_queue.cc:237] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:49.636003 19410 raft_consensus.cc:2749] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:49.638877 19439 raft_consensus.cc:493] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:11:49.639535 19439 raft_consensus.cc:515] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:49.344420 19411 raft_consensus.cc:2804] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:49.646935 19411 raft_consensus.cc:493] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:49.647310 19411 raft_consensus.cc:3060] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:11:49.648973 19318 consensus_meta.cc:287] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.659s	user 0.008s	sys 0.001s
I20260709 12:11:49.437065 19432 raft_consensus.cc:493] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:49.668432 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 334186us
I20260709 12:11:49.596910 19354 raft_consensus.cc:493] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:49.325922 19408 raft_consensus.cc:2749] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:11:49.478226 19358 raft_consensus.cc:493] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:49.700121 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 430687us
I20260709 12:11:49.649497 19318 raft_consensus.cc:515] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:49.702039 19447 raft_consensus.cc:3055] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:49.702775 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:49.674531 19432 raft_consensus.cc:3060] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:49.750031 19439 leader_election.cc:290] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:49.751430 19318 leader_election.cc:290] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 15 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:49.753530 19403 leader_election.cc:290] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:49.739562 19358 raft_consensus.cc:515] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:49.755604 19402 raft_consensus.cc:3055] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:11:49.756033 19402 raft_consensus.cc:740] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:11:49.756870 19402 consensus_queue.cc:260] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:49.703392 14259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53050 (request call id 955) took 1163 ms. Trace:
I20260709 12:11:49.758178 19402 raft_consensus.cc:3060] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:49.758147 14259 rpcz_store.cc:276] 0709 12:11:48.539964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:48.540106 (+   142us) service_pool.cc:224] Handling call
0709 12:11:48.540454 (+   348us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:48.871494 (+331040us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:48.871527 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:48.884868 (+ 13341us) log.cc:844] Serialized 26 byte log entry
0709 12:11:48.947909 (+ 63041us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:49.262925 (+315016us) log.cc:844] Serialized 14 byte log entry
0709 12:11:49.701554 (+438629us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:49.701635 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:49.701680 (+    45us) raft_consensus.cc:1685] finished
0709 12:11:49.703118 (+  1438us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:49.703298 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4762,"prepare.queue_time_us":325312,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":51,"raft.queue_time_us":155534,"raft.run_cpu_time_us":357,"raft.run_wall_time_us":22303,"thread_start_us":1080109,"threads_started":4,"wal-append.queue_time_us":57597}
W20260709 12:11:49.762907 19400 log.cc:927] Time spent T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.880s	user 0.005s	sys 0.014s
I20260709 12:11:49.764380 14188 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56046 (request call id 2472) took 1522 ms. Trace:
I20260709 12:11:49.703181 19443 consensus_queue.cc:1048] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:49.705359 19446 consensus_queue.cc:1048] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:49.706241 19433 raft_consensus.cc:493] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:11:49.650439 19315 raft_consensus.cc:3060] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:11:49.709697 19401 consensus_meta.cc:287] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.536s	user 0.009s	sys 0.000s
W20260709 12:11:49.709874 19189 consensus_meta.cc:287] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 1.188s	user 0.011s	sys 0.002s
I20260709 12:11:49.786152 19401 raft_consensus.cc:515] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:49.786298 19189 raft_consensus.cc:515] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:49.788363 19401 leader_election.cc:290] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 12 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:49.710703 19388 leader_election.cc:290] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:49.711009 19256 raft_consensus.cc:3055] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:49.611740 19393 raft_consensus.cc:493] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:49.699131 19354 raft_consensus.cc:3060] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:49.788584 19189 leader_election.cc:290] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:49.789383 19411 raft_consensus.cc:515] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:11:49.714252 19418 consensus_queue.cc:1175] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "885067a0d31741bfb5c9935788e315bf" responder_term: 13 status { last_received { term: 10 index: 8 } last_committed_idx: 8 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 12. Current term is 13. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:11:49.789314 19256 raft_consensus.cc:740] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:49.790021 14335 raft_consensus.cc:1240] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 11. Current term is 12. Ops: []
W20260709 12:11:49.718199 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 427341us
I20260709 12:11:49.791394 14304 leader_election.cc:400] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 pre-election: Vote denied by peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673) with higher term. Message: Invalid argument: T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for earlier term 14. Current term is 15.
I20260709 12:11:49.791684 14304 leader_election.cc:403] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:11:49.721414 19088 consensus_meta.cc:287] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.972s	user 0.012s	sys 0.000s
W20260709 12:11:49.709556 19176 consensus_meta.cc:287] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.873s	user 0.008s	sys 0.000s
W20260709 12:11:49.724294 19309 consensus_meta.cc:287] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.658s	user 0.007s	sys 0.002s
W20260709 12:11:49.724998 19087 consensus_meta.cc:287] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.545s	user 0.009s	sys 0.000s
I20260709 12:11:49.733528 14155 leader_election.cc:304] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:49.343019 19338 leader_election.cc:290] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 13 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:49.764739 14188 rpcz_store.cc:276] 0709 12:11:48.241594 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:48.504973 (+263379us) service_pool.cc:224] Handling call
0709 12:11:48.546663 (+ 41690us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:48.564040 (+ 17377us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:48.564071 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:48.577942 (+ 13871us) log.cc:844] Serialized 26 byte log entry
0709 12:11:48.749935 (+171993us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:48.749980 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:48.750051 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:49.757260 (+1007209us) spinlock_profiling.cc:243] Waited 28.3 ms on lock 0x7b4400022b4c. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2123f74c85 00007f2123f756a2 00007f2126ce71db 00007f2126ce2aaf 00007f2126cd686e 00007f2126cd5bb6 00007f2126cd57d8 00007f2126cdf221 00007f2126cdf1d9 00007f2126cdf169
0709 12:11:49.764052 (+  6792us) raft_consensus.cc:1685] finished
0709 12:11:49.764075 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:49.764315 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29695,"raft.queue_time_us":22375,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":12568,"spinlock_wait_cycles":65199488,"thread_start_us":140210,"threads_started":1,"wal-append.queue_time_us":232115}
W20260709 12:11:49.804147 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 312843us
W20260709 12:11:49.805523 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 470585us
W20260709 12:11:49.766700 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 289607us
I20260709 12:11:49.766273 19443 consensus_queue.cc:1243] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer 885067a0d31741bfb5c9935788e315bf log is divergent from this leader: its last log entry 10.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:11:49.739369 19447 raft_consensus.cc:740] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:11:49.779404 19433 raft_consensus.cc:515] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:49.798377 19189 raft_consensus.cc:2749] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673) with higher term. Message: Invalid argument: T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for earlier term 14. Current term is 15.
W20260709 12:11:49.798902 14304 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:49.794592 19420 raft_consensus.cc:697] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 14 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:11:49.756132 19358 leader_election.cc:290] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:11:49.803697 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 70336.5us
I20260709 12:11:49.822134 14155 leader_election.cc:304] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
W20260709 12:11:49.770341 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 68717.7us
I20260709 12:11:49.822419 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:49.822999 14332 raft_consensus.cc:2468] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 11.
I20260709 12:11:49.824141 14155 leader_election.cc:400] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 13 pre-election: Vote denied by peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673) with higher term. Message: Invalid argument: T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 13. Current term is 14.
I20260709 12:11:49.825012 14155 leader_election.cc:400] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 15 election: Vote denied by peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673) with higher term. Message: Invalid argument: T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 15. Current term is 16.
I20260709 12:11:49.825639 14155 leader_election.cc:304] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:49.826700 14155 leader_election.cc:304] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:49.806906 14230 leader_election.cc:304] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:49.803699 19087 raft_consensus.cc:2749] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:49.800709 19176 raft_consensus.cc:515] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:49.789530 19393 raft_consensus.cc:515] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:49.808352 19309 consensus_queue.cc:1048] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:11:49.803998 19088 raft_consensus.cc:2749] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:49.802440 19401 consensus_queue.cc:1048] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.007s
I20260709 12:11:49.813145 19354 raft_consensus.cc:515] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:11:49.815207 14228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:49.856967 14228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:49.858707 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:49.859349 14259 raft_consensus.cc:3060] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:49.818635 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:49.860131 14334 raft_consensus.cc:2468] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 15.
I20260709 12:11:49.860822 14256 raft_consensus.cc:1240] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:49.861505 14257 raft_consensus.cc:1275] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:11:49.862622 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:49.863236 14260 raft_consensus.cc:3060] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:49.866084 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:49.820077 14338 raft_consensus.cc:1240] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:49.820518 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:49.778390 19403 consensus_queue.cc:1048] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 12:11:49.802377 19430 raft_consensus.cc:697] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 14 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:49.833804 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:11:49.837349 14155 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:49.869237 19430 consensus_queue.cc:237] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:49.838634 14230 leader_election.cc:304] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:49.870644 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:49.870803 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:49.871551 14230 leader_election.cc:304] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:49.844867 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:49.870653 14155 leader_election.cc:304] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:49.872236 19403 raft_consensus.cc:2749] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:49.854949 19450 raft_consensus.cc:2749] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:49.873191 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:49.815851 19322 raft_consensus.cc:493] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:49.873529 19450 raft_consensus.cc:2749] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:49.874328 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:49.873975 19322 raft_consensus.cc:515] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:49.873638 14230 leader_election.cc:304] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:49.876796 19322 leader_election.cc:290] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:49.876969 14256 raft_consensus.cc:1275] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:11:49.877349 19322 raft_consensus.cc:2749] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:49.877864 14230 leader_election.cc:304] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:11:49.878566 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:49.878970 19450 raft_consensus.cc:2804] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:49.879424 19450 raft_consensus.cc:493] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:49.879760 19450 raft_consensus.cc:3060] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:49.881268 14336 raft_consensus.cc:1240] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 15. Current term is 16. Ops: []
I20260709 12:11:49.882227 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:49.867530 14259 raft_consensus.cc:2468] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 14.
I20260709 12:11:49.874018 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:49.883641 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:49.884918 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:49.885679 14338 raft_consensus.cc:2393] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 15: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:11:49.881011 19403 consensus_queue.cc:1059] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 13.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:49.888478 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:49.888942 19403 raft_consensus.cc:3055] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:49.889091 14264 raft_consensus.cc:3060] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:49.889326 19403 raft_consensus.cc:740] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:11:49.894224 19403 consensus_queue.cc:260] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:49.895412 19403 raft_consensus.cc:3060] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:49.897346 14264 raft_consensus.cc:2468] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 15.
I20260709 12:11:49.898191 14333 raft_consensus.cc:1240] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:49.899338 19354 leader_election.cc:290] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:49.899547 19088 raft_consensus.cc:2749] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:49.900715 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:49.901183 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:49.904386 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:49.906116 14263 raft_consensus.cc:1275] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:11:49.906291 14265 raft_consensus.cc:1240] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 12:11:49.910089 19121 consensus_queue.cc:1048] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:11:49.911141 14260 raft_consensus.cc:2468] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 11.
I20260709 12:11:49.920714 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:49.914152 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:49.921376 14339 raft_consensus.cc:2468] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 13.
I20260709 12:11:49.830199 19190 raft_consensus.cc:2804] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:49.829876 18992 raft_consensus.cc:2804] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 12:11:50.202852 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 332244us
I20260709 12:11:50.208132 14155 leader_election.cc:304] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:50.212178 14155 leader_election.cc:304] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:49.842034 19358 raft_consensus.cc:2749] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:50.207547 18992 raft_consensus.cc:493] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:50.214141 18992 raft_consensus.cc:3060] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:11:50.208135 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 48171us
W20260709 12:11:50.214675 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 298761us
I20260709 12:11:50.214382 19354 raft_consensus.cc:493] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:50.223532 19437 raft_consensus.cc:2804] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:50.221062 19354 raft_consensus.cc:515] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:50.224239 19456 consensus_queue.cc:1048] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.382s
I20260709 12:11:50.228825 14155 leader_election.cc:304] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:50.223444 19322 raft_consensus.cc:493] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:50.236469 19322 raft_consensus.cc:515] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:50.159071 19087 raft_consensus.cc:493] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:50.160063 19088 raft_consensus.cc:493] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:49.831224 19440 raft_consensus.cc:515] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:49.919373 19189 consensus_queue.cc:1048] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.313s
I20260709 12:11:50.216153 19401 raft_consensus.cc:493] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:50.297233 14907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:50.215274 19190 raft_consensus.cc:697] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 12 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:11:50.233690 19433 leader_election.cc:290] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:50.233376 19383 raft_consensus.cc:2749] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:50.304306 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:50.239559 19237 raft_consensus.cc:3055] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:50.221135 19430 consensus_queue.cc:1059] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 14.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.076s
I20260709 12:11:50.233072 19338 raft_consensus.cc:493] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:50.325896 14907 raft_consensus.cc:2468] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 12.
W20260709 12:11:50.335721 14230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:50.338883 14260 raft_consensus.cc:2468] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 14.
I20260709 12:11:50.253088 19449 raft_consensus.cc:3055] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:50.351610 14257 raft_consensus.cc:1240] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:50.295197 19358 raft_consensus.cc:2749] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:11:50.362294 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:50.296898 19398 raft_consensus.cc:493] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:50.381151 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 152410us
I20260709 12:11:50.324699 19088 raft_consensus.cc:515] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:50.382961 14155 leader_election.cc:304] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:11:50.394160 14155 leader_election.cc:304] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:11:50.379614 19309 raft_consensus.cc:493] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:50.366484 19322 leader_election.cc:290] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:50.351580 19449 raft_consensus.cc:740] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:11:50.340664 19237 raft_consensus.cc:740] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:11:50.403301 14229 leader_election.cc:304] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:50.288827 19087 raft_consensus.cc:515] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:50.352813 19465 raft_consensus.cc:2749] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:50.408195 14907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:50.383538 19301 leader_election.cc:290] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:50.340891 19401 raft_consensus.cc:515] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } }
I20260709 12:11:50.380486 19441 raft_consensus.cc:493] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:50.407298 19309 raft_consensus.cc:515] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:50.405448 19358 raft_consensus.cc:2804] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:11:50.403353 19411 leader_election.cc:290] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:50.376724 19338 raft_consensus.cc:515] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:50.213229 19447 consensus_queue.cc:260] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:50.450281 19448 raft_consensus.cc:493] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:11:50.450300 19441 raft_consensus.cc:515] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:50.481594 19448 raft_consensus.cc:515] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:50.483224 19441 leader_election.cc:290] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:11:50.451289 19464 log.cc:927] Time spent T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
W20260709 12:11:50.452615 19454 log.cc:927] Time spent T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.530s	user 0.001s	sys 0.000s
I20260709 12:11:50.485971 19411 raft_consensus.cc:2804] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:11:50.458083 14228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:50.486446 19411 raft_consensus.cc:493] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:50.486878 19411 raft_consensus.cc:3060] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:50.416687 19190 consensus_queue.cc:237] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:50.458300 19393 leader_election.cc:290] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:50.459309 19449 consensus_queue.cc:260] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:50.461586 19440 leader_election.cc:290] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 14 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:50.462378 19176 leader_election.cc:290] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 15 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:50.493608 19440 raft_consensus.cc:493] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:50.494282 19440 raft_consensus.cc:515] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:50.496778 19440 leader_election.cc:290] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:11:50.500908 19403 consensus_meta.cc:287] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.605s	user 0.012s	sys 0.000s
I20260709 12:11:50.393137 19398 raft_consensus.cc:515] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:50.503463 19398 leader_election.cc:290] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:11:50.465291 19432 consensus_meta.cc:287] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.709s	user 0.010s	sys 0.000s
I20260709 12:11:50.336036 19420 consensus_queue.cc:237] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:50.484083 19448 leader_election.cc:290] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:50.439765 19322 raft_consensus.cc:493] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
W20260709 12:11:50.477895 19315 consensus_meta.cc:287] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.697s	user 0.009s	sys 0.001s
W20260709 12:11:50.514182 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 120108us
I20260709 12:11:50.550239 14155 leader_election.cc:304] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
W20260709 12:11:50.544781 19402 consensus_meta.cc:287] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.786s	user 0.006s	sys 0.005s
I20260709 12:11:50.500741 19470 raft_consensus.cc:493] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:50.485080 19237 consensus_queue.cc:260] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:50.541380 19471 raft_consensus.cc:2804] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:50.557768 14155 leader_election.cc:304] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:50.504546 19338 leader_election.cc:290] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:50.504812 19358 raft_consensus.cc:697] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 16 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:11:50.515859 19403 raft_consensus.cc:493] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:50.551999 19448 raft_consensus.cc:493] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:50.572911 19465 raft_consensus.cc:2804] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:50.572767 19471 raft_consensus.cc:697] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 14 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:11:50.575877 19448 raft_consensus.cc:515] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:50.574700 19309 leader_election.cc:290] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:50.545910 19432 raft_consensus.cc:515] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:50.574615 19358 consensus_queue.cc:237] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:50.578534 19448 leader_election.cc:290] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:50.553707 19315 raft_consensus.cc:515] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:50.573863 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:50.553860 19322 raft_consensus.cc:515] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:50.580758 19315 leader_election.cc:290] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 14 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:11:50.580964 19450 consensus_meta.cc:287] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.701s	user 0.011s	sys 0.003s
I20260709 12:11:50.575865 19465 raft_consensus.cc:493] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:50.581429 19450 raft_consensus.cc:515] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:50.582036 19465 raft_consensus.cc:3060] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:50.576620 19471 consensus_queue.cc:237] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:50.582778 14259 raft_consensus.cc:2393] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 16: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:11:50.577099 19403 raft_consensus.cc:515] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:50.576713 19088 leader_election.cc:290] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:50.581796 19322 leader_election.cc:290] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:50.584157 19450 leader_election.cc:290] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:50.590197 19087 leader_election.cc:290] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:50.572340 14155 leader_election.cc:304] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:50.591619 19087 raft_consensus.cc:2804] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:50.592109 19087 raft_consensus.cc:493] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:50.592481 19087 raft_consensus.cc:3060] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:50.563367 19176 raft_consensus.cc:2749] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:50.598799 14155 leader_election.cc:304] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:50.602656 19401 leader_election.cc:290] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:50.603713 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:50.586766 19403 leader_election.cc:290] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:50.606792 19304 raft_consensus.cc:493] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:50.607580 19478 raft_consensus.cc:493] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:50.627080 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:50.629106 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:50.645272 14261 raft_consensus.cc:3060] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:50.579322 19432 leader_election.cc:290] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:50.569808 19470 raft_consensus.cc:515] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:50.635478 14155 leader_election.cc:304] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:50.637620 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:50.628978 19176 raft_consensus.cc:2749] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:50.662051 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:50.613570 19402 raft_consensus.cc:493] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:50.666260 19402 raft_consensus.cc:515] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:50.667999 19088 raft_consensus.cc:493] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:50.668869 19402 leader_election.cc:290] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:50.668586 19088 raft_consensus.cc:515] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:50.670758 19088 leader_election.cc:290] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:50.591827 19465 raft_consensus.cc:515] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:50.672807 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:50.673926 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:50.674645 14265 raft_consensus.cc:2468] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 14.
I20260709 12:11:50.675019 19465 leader_election.cc:290] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 15 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:50.677168 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:50.677485 14155 leader_election.cc:304] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:50.678026 14338 raft_consensus.cc:3060] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:11:50.678551 19435 raft_consensus.cc:2804] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:50.678933 14155 leader_election.cc:304] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:50.679724 19315 raft_consensus.cc:493] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:50.680392 19315 raft_consensus.cc:515] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:50.680933 14335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50856 (request call id 2404) took 1498 ms. Trace:
I20260709 12:11:50.681373 14335 rpcz_store.cc:276] 0709 12:11:49.203756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:49.203905 (+   149us) service_pool.cc:224] Handling call
0709 12:11:49.204362 (+   457us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:49.790621 (+586259us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:50.680641 (+890020us) spinlock_profiling.cc:243] Waited 585 ms on lock 0x7b54000b8454. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:11:50.680858 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1346435456}
I20260709 12:11:50.683001 19315 leader_election.cc:290] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:50.683652 19088 raft_consensus.cc:2749] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:50.684120 19380 raft_consensus.cc:2804] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:50.696415 19380 raft_consensus.cc:493] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:50.696885 19380 raft_consensus.cc:3060] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:50.686085 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:50.632513 19190 raft_consensus.cc:493] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:50.692117 14338 raft_consensus.cc:2468] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 15.
I20260709 12:11:50.707470 19470 leader_election.cc:290] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:50.707265 19190 raft_consensus.cc:515] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:50.710304 19190 leader_election.cc:290] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:50.715057 19087 raft_consensus.cc:515] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:11:50.718039 19467 log.cc:927] Time spent T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 12:11:50.719324 14181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56046 (request call id 2483) took 1621 ms. Trace:
I20260709 12:11:50.719877 14181 rpcz_store.cc:276] 0709 12:11:49.097566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:49.097806 (+   240us) service_pool.cc:224] Handling call
0709 12:11:50.719130 (+1621324us) spinlock_profiling.cc:243] Waited 6.57 ms on lock 0x7b54003a39d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:11:50.719254 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15108864}
I20260709 12:11:50.722340 18992 raft_consensus.cc:515] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:50.723544 19449 raft_consensus.cc:3060] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:50.651641 19304 raft_consensus.cc:515] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:50.656359 19478 raft_consensus.cc:515] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:50.728157 19478 leader_election.cc:290] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:50.734205 19471 raft_consensus.cc:2749] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 12:11:50.747038 19484 log.cc:927] Time spent T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 12:11:50.749482 19304 leader_election.cc:290] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:50.754747 19040 leader_election.cc:290] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 15 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:50.755514 18992 leader_election.cc:290] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:50.764161 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:50.764426 14264 raft_consensus.cc:2468] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 14.
I20260709 12:11:50.776257 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:50.777014 14335 raft_consensus.cc:3060] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:50.777537 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:50.778158 14260 raft_consensus.cc:3060] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:50.803485 14261 raft_consensus.cc:2468] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 14.
I20260709 12:11:50.812292 14260 raft_consensus.cc:2468] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 15.
W20260709 12:11:50.824844 14230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:50.826787 14907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:50.827692 14907 raft_consensus.cc:2393] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 10: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
I20260709 12:11:50.776510 14155 leader_election.cc:304] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
W20260709 12:11:50.831161 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 54717.4us
I20260709 12:11:50.832157 14155 leader_election.cc:304] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:50.833289 14155 leader_election.cc:304] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:50.841701 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:50.835711 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:50.840051 14907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:50.846096 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:50.854941 14265 raft_consensus.cc:3060] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:50.846349 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:50.852311 14910 raft_consensus.cc:2468] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 14.
I20260709 12:11:50.862152 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
W20260709 12:11:50.863063 14876 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.028s	user 0.025s	sys 0.080s
W20260709 12:11:50.863595 14876 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.034s	user 0.026s	sys 0.080s
I20260709 12:11:50.865989 14909 raft_consensus.cc:1240] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:50.828294 19478 raft_consensus.cc:493] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:50.865800 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
W20260709 12:11:50.863971 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 1.04198e+06us
I20260709 12:11:50.868602 14335 raft_consensus.cc:2468] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 17.
I20260709 12:11:50.839464 18992 raft_consensus.cc:2804] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Leader election won for term 15
W20260709 12:11:50.869802 14876 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:50.878660 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 45446.2us
I20260709 12:11:50.839294 19471 raft_consensus.cc:2804] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:50.873258 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:50.883181 14190 raft_consensus.cc:2468] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 11.
I20260709 12:11:50.879940 14906 raft_consensus.cc:1275] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:11:50.846479 19315 raft_consensus.cc:493] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:50.854045 19088 raft_consensus.cc:493] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:50.861513 19465 raft_consensus.cc:493] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:50.862273 19176 raft_consensus.cc:493] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:50.924280 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:50.928777 14188 raft_consensus.cc:2468] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 14.
I20260709 12:11:50.929167 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:11:50.862766 19190 raft_consensus.cc:493] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:50.937674 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
W20260709 12:11:50.922492 14302 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.665s	user 0.006s	sys 0.018s
W20260709 12:11:50.938403 14302 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.681s	user 0.006s	sys 0.018s
I20260709 12:11:50.940712 14911 raft_consensus.cc:3060] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:11:50.944857 14303 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.634s	user 0.004s	sys 0.015s
I20260709 12:11:50.945070 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:50.918398 19186 raft_consensus.cc:2804] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:50.954452 14265 raft_consensus.cc:2468] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 17.
I20260709 12:11:50.717543 19087 leader_election.cc:290] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 15 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:11:50.921396 19430 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.012s	sys 0.011s
I20260709 12:11:50.921202 19466 raft_consensus.cc:493] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:50.965631 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:50.845726 19411 raft_consensus.cc:515] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:50.967937 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:50.971729 14190 raft_consensus.cc:2468] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 11.
W20260709 12:11:50.972504 14905 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.663s	user 0.014s	sys 0.012s
W20260709 12:11:50.972971 14905 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.678s	user 0.014s	sys 0.013s
W20260709 12:11:50.945268 14303 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.634s	user 0.004s	sys 0.015s
I20260709 12:11:50.977432 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
W20260709 12:11:50.963984 19408 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.578s	user 0.012s	sys 0.034s
I20260709 12:11:50.882135 19478 raft_consensus.cc:515] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:11:50.966480 19430 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.590s	user 0.013s	sys 0.012s
I20260709 12:11:50.994868 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:50.995110 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:50.995532 14189 raft_consensus.cc:3060] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:50.995666 14185 raft_consensus.cc:3060] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:50.927130 19449 consensus_queue.cc:1048] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.049s
I20260709 12:11:51.001699 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:51.002682 14188 raft_consensus.cc:2468] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 12.
I20260709 12:11:51.003187 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:51.003592 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:50.992422 14911 raft_consensus.cc:2468] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 15.
I20260709 12:11:50.998688 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:50.936690 19315 raft_consensus.cc:515] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:51.008607 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:51.009006 14912 raft_consensus.cc:1240] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 15 LEADER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 14. Current term is 15. Ops: []
W20260709 12:11:50.993883 19408 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.615s	user 0.013s	sys 0.035s
I20260709 12:11:51.009656 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:50.982254 19358 raft_consensus.cc:493] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:11:50.945840 19190 raft_consensus.cc:515] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:50.939932 19465 raft_consensus.cc:515] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:50.941474 19176 raft_consensus.cc:515] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:51.011598 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:51.025195 14909 raft_consensus.cc:2468] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 10.
I20260709 12:11:50.939963 19088 raft_consensus.cc:515] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:51.006500 19322 raft_consensus.cc:493] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:51.015702 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:50.991940 19392 raft_consensus.cc:493] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:51.017997 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:51.033578 14186 raft_consensus.cc:2468] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 13.
I20260709 12:11:51.016225 14190 raft_consensus.cc:2468] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 18.
I20260709 12:11:51.005963 19458 raft_consensus.cc:493] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:51.028803 14303 leader_election.cc:304] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:51.013707 19186 raft_consensus.cc:697] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 15 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:11:51.031116 14911 raft_consensus.cc:2468] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 17.
I20260709 12:11:50.998944 19471 raft_consensus.cc:697] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 14 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:11:51.008678 19087 raft_consensus.cc:493] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:51.032451 14189 raft_consensus.cc:2468] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 15.
I20260709 12:11:51.008217 19432 raft_consensus.cc:493] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:51.089443 14185 raft_consensus.cc:2468] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 14.
W20260709 12:11:51.091107 14228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:51.023856 19430 raft_consensus.cc:493] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:11:51.097999 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:51.023294 19453 raft_consensus.cc:493] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:51.100557 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 71854.8us
I20260709 12:11:51.101436 14303 leader_election.cc:304] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:11:50.982577 19466 raft_consensus.cc:515] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:51.098838 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:51.102432 14303 leader_election.cc:304] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:11:51.103209 14185 raft_consensus.cc:2410] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 12:11:51.103960 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:51.104883 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:51.024238 19380 raft_consensus.cc:515] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:51.104691 14186 raft_consensus.cc:2468] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 13.
I20260709 12:11:51.111349 14190 raft_consensus.cc:2393] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 13: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:11:51.038509 19309 raft_consensus.cc:493] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:51.032471 19476 raft_consensus.cc:493] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:51.120231 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:51.124234 14189 raft_consensus.cc:2468] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 14.
I20260709 12:11:51.029484 19358 raft_consensus.cc:515] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:51.128587 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:51.097575 19087 raft_consensus.cc:515] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:51.132407 14186 raft_consensus.cc:2468] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 15.
W20260709 12:11:51.117834 19488 log.cc:927] Time spent T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.111s	user 0.000s	sys 0.001s
I20260709 12:11:51.038455 19322 raft_consensus.cc:515] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:51.113765 19470 raft_consensus.cc:2804] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:11:51.136118 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:51.089977 14336 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "36091607df2f46059df62d677842a031"
dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
mode: GRACEFUL
new_leader_uuid: "885067a0d31741bfb5c9935788e315bf"
 from {username='slave'} at 127.0.0.1:50896
I20260709 12:11:51.051465 19392 raft_consensus.cc:515] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:51.142628 14336 raft_consensus.cc:606] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Received request to transfer leadership to TS 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:51.092382 19458 raft_consensus.cc:515] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:51.144373 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:51.144788 14336 raft_consensus.cc:614] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:51.098860 19432 raft_consensus.cc:515] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:51.147433 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:51.148343 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:51.148557 14190 raft_consensus.cc:3060] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:51.150977 14186 raft_consensus.cc:3060] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:11:51.149933 19479 log.cc:927] Time spent T 00000000000000000000000000000000 P d07070be2c074f4cb9ad35f1580c4ef7: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
I20260709 12:11:51.112859 19430 raft_consensus.cc:515] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:51.153790 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:11:51.157037 19430 leader_election.cc:290] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:51.149974 19429 raft_consensus.cc:493] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:11:51.160213 19466 leader_election.cc:290] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:51.162488 19087 leader_election.cc:290] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:51.163429 14186 raft_consensus.cc:2468] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 16.
I20260709 12:11:51.164287 19380 leader_election.cc:290] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 15 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:51.164500 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:51.165300 14186 raft_consensus.cc:2393] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 16: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:11:51.166172 19088 leader_election.cc:290] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:51.167423 19465 leader_election.cc:290] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:51.168264 19487 raft_consensus.cc:2749] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:51.169361 19315 leader_election.cc:290] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:51.147464 19457 raft_consensus.cc:2804] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:51.170619 19457 raft_consensus.cc:493] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:11:51.170993 19457 raft_consensus.cc:3060] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:51.171715 19322 leader_election.cc:290] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:51.143894 19470 raft_consensus.cc:493] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:51.174204 19470 raft_consensus.cc:3060] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:11:51.116266 19309 raft_consensus.cc:515] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:51.134343 18992 raft_consensus.cc:697] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 15 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:11:51.192942 14186 raft_consensus.cc:1240] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 14. Current term is 15. Ops: [14.6-14.6]
I20260709 12:11:51.148865 14155 leader_election.cc:304] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:51.207669 14186 raft_consensus.cc:1240] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 14. Current term is 15. Ops: []
W20260709 12:11:51.208945 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 60172.4us
I20260709 12:11:51.209125 14186 raft_consensus.cc:1240] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 14. Current term is 15. Ops: []
W20260709 12:11:51.210011 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 107658us
I20260709 12:11:51.167441 19088 raft_consensus.cc:493] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:51.212075 14303 leader_election.cc:304] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:51.214776 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:51.173647 19190 leader_election.cc:290] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:51.220136 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:51.222436 14260 raft_consensus.cc:3060] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:11:51.227092 14229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:51.230602 14265 raft_consensus.cc:1275] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:11:51.237802 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:51.239375 14261 raft_consensus.cc:2468] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 16.
I20260709 12:11:51.244166 14260 raft_consensus.cc:2468] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 15.
I20260709 12:11:51.245512 14190 raft_consensus.cc:2468] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 13.
I20260709 12:11:51.245944 19493 raft_consensus.cc:493] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:51.247277 19494 raft_consensus.cc:493] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:51.217415 19487 raft_consensus.cc:2749] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 12:11:51.250241 19482 log.cc:927] Time spent T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.217s	user 0.001s	sys 0.000s
I20260709 12:11:51.252174 19478 leader_election.cc:290] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:51.213025 19380 raft_consensus.cc:2804] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Leader election won for term 17
W20260709 12:11:51.246142 19485 log.cc:927] Time spent T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.254s	user 0.002s	sys 0.000s
I20260709 12:11:51.255223 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:51.258791 19309 leader_election.cc:290] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:51.261855 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:51.262423 14261 raft_consensus.cc:1275] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:11:51.262769 14265 raft_consensus.cc:2410] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:11:51.263406 14263 raft_consensus.cc:2410] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
W20260709 12:11:51.245864 19483 log.cc:927] Time spent T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.186s	user 0.001s	sys 0.000s
I20260709 12:11:51.247885 19494 raft_consensus.cc:515] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:51.112089 19453 raft_consensus.cc:515] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:51.158517 19429 raft_consensus.cc:515] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:11:51.271770 19423 log.cc:927] Time spent T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 2.011s	user 0.022s	sys 0.041s
I20260709 12:11:51.272832 19429 leader_election.cc:290] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:51.129209 19476 raft_consensus.cc:515] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:51.146914 19186 consensus_queue.cc:237] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:51.275166 19476 leader_election.cc:290] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:51.149240 19471 consensus_queue.cc:237] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:51.277326 19453 leader_election.cc:290] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:51.281503 19411 leader_election.cc:290] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 13 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:51.286146 19176 leader_election.cc:290] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:51.288695 19432 leader_election.cc:290] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:51.290486 19392 leader_election.cc:290] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:51.246588 19493 raft_consensus.cc:515] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } }
I20260709 12:11:51.316992 14262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41764 (request call id 2958) took 2315 ms. Trace:
I20260709 12:11:51.319068 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:51.222074 19088 raft_consensus.cc:515] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:51.317476 14262 rpcz_store.cc:276] 0709 12:11:48.996378 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:48.998627 (+  2249us) service_pool.cc:224] Handling call
0709 12:11:49.010711 (+ 12084us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:49.015461 (+  4750us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:11:49.015501 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:49.039356 (+ 23855us) log.cc:844] Serialized 26 byte log entry
0709 12:11:50.677877 (+1638521us) spinlock_profiling.cc:243] Waited 2.46 ms on lock 0x7b1800247180. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f212cf16ab1 00007f212cf23281 00007f2126ce34bc 00007f212403148b 00007f212ce8b9a9 00007f212404d69b 00007f212404b93f 00007f212404dc02 00007f2126cd520b 00007f2126cdad23 00007f2126cdb0d1
0709 12:11:50.678052 (+   175us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:11:50.678086 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:50.694530 (+ 16444us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:51.271037 (+576507us) spinlock_profiling.cc:243] Waited 5.78 ms on lock 0x7b4400022b4c. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2123f74c85 00007f2123f756a2 00007f2126ce71db 00007f2126ce2aaf 00007f2126cd686e 00007f2126cd5bb6 00007f2126cd57d8 00007f2126cdf221 00007f2126cdf1d9 00007f2126cdf169
0709 12:11:51.311376 (+ 40339us) raft_consensus.cc:1685] finished
0709 12:11:51.311407 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:51.311586 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":49040,"raft.queue_time_us":60986,"raft.run_cpu_time_us":214,"raft.run_wall_time_us":18046,"spinlock_wait_cycles":18971392,"thread_start_us":59380,"threads_started":1,"wal-append.queue_time_us":123063}
I20260709 12:11:51.320739 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:51.322079 14186 raft_consensus.cc:1275] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:11:51.320838 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:51.323343 14904 raft_consensus.cc:2393] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 11: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
I20260709 12:11:51.323882 14339 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da"
dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
mode: GRACEFUL
new_leader_uuid: "885067a0d31741bfb5c9935788e315bf"
 from {username='slave'} at 127.0.0.1:50896
I20260709 12:11:51.291517 19380 raft_consensus.cc:697] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 17 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:11:51.318868 19496 raft_consensus.cc:493] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:51.325268 19432 raft_consensus.cc:493] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
W20260709 12:11:51.331316 19437 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.095s	user 0.084s	sys 0.119s
I20260709 12:11:51.340307 19435 raft_consensus.cc:493] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:51.342414 19088 leader_election.cc:290] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:51.343086 19458 leader_election.cc:290] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:51.343675 19358 leader_election.cc:290] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:51.308561 18992 consensus_queue.cc:237] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:11:51.346006 19437 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.109s	user 0.084s	sys 0.120s
W20260709 12:11:51.351975 14230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:51.353461 19493 leader_election.cc:290] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:51.344758 19432 raft_consensus.cc:515] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:11:51.347749 19407 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.290s	user 0.077s	sys 0.111s
I20260709 12:11:51.346911 19435 raft_consensus.cc:3060] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:51.351226 19437 raft_consensus.cc:697] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 14 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:11:51.363722 19446 raft_consensus.cc:493] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:51.364073 19437 consensus_queue.cc:237] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:51.364358 19446 raft_consensus.cc:515] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:51.366703 19446 leader_election.cc:290] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:11:51.362785 19407 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.309s	user 0.078s	sys 0.111s
I20260709 12:11:51.370937 14154 leader_election.cc:304] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:51.371898 19503 consensus_queue.cc:1059] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:51.373049 14154 leader_election.cc:304] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:51.373386 19495 raft_consensus.cc:3055] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:51.373849 19495 raft_consensus.cc:740] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:11:51.373986 19075 leader_election.cc:290] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 11 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:51.374850 19495 consensus_queue.cc:260] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:51.376181 19495 raft_consensus.cc:3060] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:51.375901 19470 raft_consensus.cc:515] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:11:51.378501 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 1.15509e+06us
I20260709 12:11:51.379401 19432 leader_election.cc:290] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:51.380152 14304 leader_election.cc:304] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:11:51.383452 19476 raft_consensus.cc:2804] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:51.334811 19496 raft_consensus.cc:515] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:51.386380 19496 leader_election.cc:290] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:51.384001 19476 raft_consensus.cc:697] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 15 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:51.388471 19476 consensus_queue.cc:237] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:51.389127 19224 leader_election.cc:290] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 14 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:51.394760 14154 leader_election.cc:304] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:51.395768 19088 raft_consensus.cc:2749] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:51.399691 19496 raft_consensus.cc:2749] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:11:51.400013 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:51.399755 14258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41768 (request call id 2071) took 1095 ms. Trace:
W20260709 12:11:51.401314 14303 leader_election.cc:336] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Timed out: RequestConsensusVote RPC to 127.12.174.129:37187 timed out after 1.540s (SENT)
I20260709 12:11:51.386272 19501 consensus_queue.cc:1048] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
W20260709 12:11:51.402359 14303 leader_election.cc:336] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Timed out: RequestConsensusVote RPC to 127.12.174.129:37187 timed out after 1.549s (SENT)
I20260709 12:11:51.402789 14303 leader_election.cc:304] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:51.402930 19501 consensus_queue.cc:1059] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:11:51.404243 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:51.355636 19380 consensus_queue.cc:237] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:51.408053 19487 raft_consensus.cc:2749] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:11:51.410275 19494 leader_election.cc:290] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:51.410917 19189 raft_consensus.cc:3055] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:51.411381 19189 raft_consensus.cc:740] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:51.380084 19432 consensus_queue.cc:1048] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 12:11:51.412353 19460 consensus_queue.cc:1048] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:11:51.413877 19470 leader_election.cc:290] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:51.362295 19493 raft_consensus.cc:493] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:51.414886 19493 raft_consensus.cc:515] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:51.415477 19445 raft_consensus.cc:493] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:51.416082 19445 raft_consensus.cc:515] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:51.401328 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:51.421959 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:51.373070 19503 raft_consensus.cc:2749] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:51.417557 14877 leader_election.cc:304] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:11:51.400874 14258 rpcz_store.cc:276] 0709 12:11:50.304365 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:50.304552 (+   187us) service_pool.cc:224] Handling call
0709 12:11:50.360545 (+ 55993us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:50.483846 (+123301us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:50.483886 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:50.483934 (+    48us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:50.483979 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:51.399464 (+915485us) spinlock_profiling.cc:243] Waited 123 ms on lock 0x7b540022abd4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:11:51.399519 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:51.399685 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":282907392}
I20260709 12:11:51.425230 14303 leader_election.cc:304] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:51.425915 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:51.425107 14877 leader_election.cc:304] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:11:51.425835 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:51.428526 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:51.429383 14339 raft_consensus.cc:606] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 16 LEADER]: Received request to transfer leadership to TS 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:51.429818 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:51.428828 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:51.430425 14904 raft_consensus.cc:2468] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 11.
I20260709 12:11:51.430585 14182 raft_consensus.cc:3060] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:51.434484 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:11:51.431322 19172 raft_consensus.cc:2804] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:51.433636 19121 raft_consensus.cc:2804] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:51.441043 14154 leader_election.cc:304] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:51.442963 14303 leader_election.cc:304] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:51.444419 14303 leader_election.cc:304] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:51.446270 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:51.447144 14186 raft_consensus.cc:2468] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 9.
I20260709 12:11:51.450278 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:51.451078 14260 raft_consensus.cc:3060] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:51.456223 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:51.456979 14261 raft_consensus.cc:2468] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 16.
I20260709 12:11:51.440163 19172 raft_consensus.cc:697] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [term 14 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:11:51.458129 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:51.458771 14261 raft_consensus.cc:2468] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 12.
I20260709 12:11:51.458649 19172 consensus_queue.cc:237] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:51.459712 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:51.460309 19445 leader_election.cc:290] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:51.460949 19429 raft_consensus.cc:3060] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:51.460330 14261 raft_consensus.cc:2468] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 13.
I20260709 12:11:51.412323 19189 consensus_queue.cc:260] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.6, Last appended by leader: 6, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:51.463243 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:51.474586 14262 raft_consensus.cc:2468] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 14.
I20260709 12:11:51.463846 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:51.465349 14303 leader_election.cc:304] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:51.473677 14260 raft_consensus.cc:2468] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 14.
I20260709 12:11:51.475986 14261 raft_consensus.cc:2468] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 12.
I20260709 12:11:51.454689 19456 raft_consensus.cc:2749] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:51.480968 19493 leader_election.cc:290] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:51.481174 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:51.481900 14261 raft_consensus.cc:2468] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 12.
I20260709 12:11:51.483824 14258 raft_consensus.cc:1240] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 12:11:51.486131 19299 raft_consensus.cc:2804] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:51.486747 19299 raft_consensus.cc:493] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:51.487179 19299 raft_consensus.cc:3060] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:51.490371 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:51.491201 19395 consensus_queue.cc:1059] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:51.491878 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:51.492282 19395 consensus_queue.cc:1059] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:51.494578 14261 raft_consensus.cc:1275] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 7. (term mismatch)
I20260709 12:11:51.492553 14186 raft_consensus.cc:2468] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 14.
I20260709 12:11:51.496670 14261 pending_rounds.cc:85] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec: Aborting all ops after (but not including) 6
I20260709 12:11:51.495325 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:51.496933 14261 pending_rounds.cc:107] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec: Aborting uncommitted NO_OP operation due to leader change: 13.7
I20260709 12:11:51.498871 14261 raft_consensus.cc:2889] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:51.501031 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:51.503217 14303 leader_election.cc:304] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:51.506623 14263 raft_consensus.cc:1240] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 14. Current term is 15. Ops: []
W20260709 12:11:51.508929 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 66007.5us
I20260709 12:11:51.515252 14182 raft_consensus.cc:2468] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 14.
I20260709 12:11:51.478550 19432 raft_consensus.cc:2749] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:11:51.518273 14261 raft_consensus.cc:1240] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 14. Current term is 15. Ops: [11.7-14.8]
I20260709 12:11:51.478529 19380 raft_consensus.cc:2804] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:51.519448 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:11:51.520012 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:51.523183 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:51.521387 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 18 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:51.522383 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:51.524276 14338 raft_consensus.cc:2393] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db in current term 18: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:11:51.524883 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:51.524276 14261 raft_consensus.cc:2393] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db in current term 13: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:11:51.524242 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:51.523811 14182 raft_consensus.cc:3060] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:51.525842 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:51.526508 14331 raft_consensus.cc:2468] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 12.
I20260709 12:11:51.529323 14303 leader_election.cc:304] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:51.530131 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:51.530131 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:51.531352 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 18 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:51.503585 19413 raft_consensus.cc:3055] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:51.529448 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:51.532294 14332 raft_consensus.cc:2393] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db in current term 15: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:11:51.534905 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:51.532330 14303 leader_election.cc:304] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:51.532624 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:51.531622 14333 raft_consensus.cc:3060] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:51.537811 19430 raft_consensus.cc:2804] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:51.534701 19413 raft_consensus.cc:740] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:11:51.538326 19430 raft_consensus.cc:493] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:51.538777 19430 raft_consensus.cc:3060] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:51.539049 14264 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41764 (request call id 2969) took 1636 ms (client timeout 2155 ms). Trace:
W20260709 12:11:51.539475 14264 rpcz_store.cc:269] 0709 12:11:49.903013 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:49.904163 (+  1150us) service_pool.cc:224] Handling call
0709 12:11:51.538840 (+1634677us) spinlock_profiling.cc:243] Waited 597 ms on lock 0x7b54002652d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:11:51.538958 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1372344704}
I20260709 12:11:51.509760 19309 consensus_queue.cc:1059] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 12:11:51.537923 19441 raft_consensus.cc:2749] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:51.541277 19309 consensus_queue.cc:1243] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer 885067a0d31741bfb5c9935788e315bf log is divergent from this leader: its last log entry 13.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:11:51.542538 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:51.542474 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:51.537003 14303 leader_election.cc:304] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:51.542842 19501 consensus_queue.cc:1048] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 12:11:51.548820 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:51.514585 19469 consensus_queue.cc:1059] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 12:11:51.549698 14186 raft_consensus.cc:2393] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 12: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
W20260709 12:11:51.557778 14228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:51.557142 14265 raft_consensus.cc:1275] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:11:51.562530 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:51.563320 14332 raft_consensus.cc:3060] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:51.558470 14303 leader_election.cc:304] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:51.521404 19487 raft_consensus.cc:2804] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:51.523054 19380 raft_consensus.cc:493] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:51.532038 19189 raft_consensus.cc:3060] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:51.519603 19437 raft_consensus.cc:493] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:51.576120 14303 leader_election.cc:304] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:51.577843 14877 leader_election.cc:304] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:51.583382 14265 raft_consensus.cc:1275] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:11:51.583835 14182 raft_consensus.cc:2468] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 14.
I20260709 12:11:51.584758 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:51.595893 14330 raft_consensus.cc:2393] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 15: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:11:51.586015 14336 raft_consensus.cc:1275] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:11:51.599370 14333 raft_consensus.cc:2468] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 11.
I20260709 12:11:51.601147 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:51.601922 14182 raft_consensus.cc:2468] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 13.
I20260709 12:11:51.637357 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:51.638306 14877 leader_election.cc:304] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:51.639101 14182 raft_consensus.cc:2468] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 13.
I20260709 12:11:51.572332 19501 raft_consensus.cc:2804] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:51.602764 14303 leader_election.cc:304] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:51.643728 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:51.644095 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:51.644294 14303 leader_election.cc:304] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:51.576680 19487 raft_consensus.cc:493] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:51.552408 19435 raft_consensus.cc:515] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:51.644603 14186 raft_consensus.cc:2468] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 13.
I20260709 12:11:51.651363 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:51.585521 19380 raft_consensus.cc:3060] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:51.655313 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:51.595388 19456 raft_consensus.cc:2804] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:51.641177 19441 raft_consensus.cc:2749] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:51.662323 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:51.659651 14332 raft_consensus.cc:2468] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 16.
I20260709 12:11:51.641992 19501 raft_consensus.cc:493] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:51.649103 19469 raft_consensus.cc:2804] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:51.646620 19401 raft_consensus.cc:493] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:51.539249 19413 consensus_queue.cc:260] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:51.650771 19487 raft_consensus.cc:3060] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:51.646905 19121 raft_consensus.cc:697] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 11 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
W20260709 12:11:51.692427 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 48229.1us
I20260709 12:11:51.604547 19437 raft_consensus.cc:515] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:51.686123 19501 raft_consensus.cc:3060] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:51.701092 19435 leader_election.cc:290] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:51.686484 19439 raft_consensus.cc:3060] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:11:51.702792 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:51.663961 19476 raft_consensus.cc:2804] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:11:51.702584 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 64361us
I20260709 12:11:51.713002 14303 leader_election.cc:304] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:51.716903 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:51.658959 19172 raft_consensus.cc:3060] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:51.685272 19456 raft_consensus.cc:697] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 14 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:51.771975 19441 raft_consensus.cc:2804] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:51.774945 19441 raft_consensus.cc:493] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:51.775316 19441 raft_consensus.cc:3060] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:51.701886 19401 raft_consensus.cc:515] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:51.777522 19401 leader_election.cc:290] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:51.778573 19121 consensus_queue.cc:237] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:51.779422 19456 consensus_queue.cc:237] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:51.703953 19469 raft_consensus.cc:697] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 14 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:51.691218 19322 raft_consensus.cc:493] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
W20260709 12:11:51.771442 14876 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:51.770610 14303 leader_election.cc:304] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:51.772637 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:51.774098 14336 raft_consensus.cc:2468] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 16.
W20260709 12:11:51.792040 14230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:51.800547 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 73398us
W20260709 12:11:51.804011 14303 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.174.129:37187 timed out after 1.873s (SENT) [suppressed 23 similar messages]
I20260709 12:11:51.773746 19413 raft_consensus.cc:3060] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:51.726917 19476 raft_consensus.cc:493] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:51.791865 19515 consensus_queue.cc:1048] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.068s
I20260709 12:11:51.847102 14334 raft_consensus.cc:2468] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 15.
I20260709 12:11:51.858439 19309 raft_consensus.cc:3055] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:51.858958 19309 raft_consensus.cc:740] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:51.859767 19309 consensus_queue.cc:260] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:51.861025 19309 raft_consensus.cc:3060] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:51.864439 19437 leader_election.cc:290] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:51.870743 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:51.872532 14189 raft_consensus.cc:1240] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 12:11:51.839437 19476 raft_consensus.cc:3060] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:51.845945 19240 consensus_queue.cc:1048] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.040s
I20260709 12:11:51.832924 19189 raft_consensus.cc:2804] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:51.883711 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:11:51.899233 19299 raft_consensus.cc:515] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:51.901801 18992 raft_consensus.cc:493] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:51.895035 19408 raft_consensus.cc:493] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:51.903112 19495 consensus_meta.cc:287] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.526s	user 0.012s	sys 0.001s
I20260709 12:11:51.902773 19408 raft_consensus.cc:515] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:51.806507 19322 raft_consensus.cc:515] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:51.904125 19429 raft_consensus.cc:2749] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:51.904898 19441 raft_consensus.cc:515] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } }
I20260709 12:11:51.906705 14230 leader_election.cc:304] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:11:51.907157 19441 leader_election.cc:290] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:51.907997 19322 leader_election.cc:290] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:51.893996 19189 raft_consensus.cc:493] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:51.909039 19189 raft_consensus.cc:3060] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:51.910202 19408 leader_election.cc:290] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:51.910688 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:51.913044 14338 raft_consensus.cc:1240] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 15. Current term is 16. Ops: []
I20260709 12:11:51.913044 14337 raft_consensus.cc:1240] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:51.915740 14155 leader_election.cc:304] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:51.917506 14155 leader_election.cc:304] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:51.920634 19439 raft_consensus.cc:2749] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:11:51.922250 14330 raft_consensus.cc:1240] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 17. Current term is 18. Ops: []
I20260709 12:11:51.923790 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:51.928581 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:51.929788 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:51.929877 14230 leader_election.cc:304] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:51.913165 19176 raft_consensus.cc:493] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:51.936892 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:51.955911 14304 leader_election.cc:304] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:51.957213 14304 leader_election.cc:304] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:51.930470 14229 leader_election.cc:304] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:51.922132 19088 consensus_queue.cc:1048] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 12:11:51.957336 14230 leader_election.cc:304] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:11:51.933492 19410 raft_consensus.cc:493] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:51.905081 19430 raft_consensus.cc:515] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:51.929319 19495 raft_consensus.cc:2804] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:11:51.904134 19172 raft_consensus.cc:2749] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:51.974593 14912 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53194 (request call id 997) took 2106 ms. Trace:
W20260709 12:11:51.982372 14878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:51.980552 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:51.995241 14912 rpcz_store.cc:276] 0709 12:11:49.867923 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:49.868079 (+   156us) service_pool.cc:224] Handling call
0709 12:11:49.868388 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:51.012943 (+1144555us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:51.974303 (+961360us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b5400748e54. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:11:51.974493 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2622724480}
I20260709 12:11:51.928148 19470 raft_consensus.cc:3055] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:51.936091 19503 raft_consensus.cc:2804] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:51.936484 19395 raft_consensus.cc:493] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:51.936655 19418 raft_consensus.cc:2804] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:51.962072 19299 leader_election.cc:290] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:51.958154 19176 raft_consensus.cc:515] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:51.964480 19408 raft_consensus.cc:2804] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:52.008395 14332 raft_consensus.cc:1240] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:51.962512 19445 raft_consensus.cc:2749] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:51.961199 14229 leader_election.cc:304] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:51.969336 19390 raft_consensus.cc:2804] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:51.966591 19401 raft_consensus.cc:2804] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:11:51.968338 19447 raft_consensus.cc:3060] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:51.966285 19322 raft_consensus.cc:2804] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader election won for term 16
W20260709 12:11:51.997725 19457 consensus_meta.cc:287] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.826s	user 0.010s	sys 0.004s
I20260709 12:11:52.011096 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:52.049839 14189 raft_consensus.cc:2468] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 15.
I20260709 12:11:51.936357 19435 raft_consensus.cc:493] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:11:51.926349 18992 raft_consensus.cc:515] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:51.997258 19410 raft_consensus.cc:515] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:52.005411 19189 raft_consensus.cc:515] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:51.977664 19487 raft_consensus.cc:515] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:52.038851 19441 raft_consensus.cc:493] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:52.021206 19176 leader_election.cc:290] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:52.024363 19256 consensus_queue.cc:260] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:52.026291 19041 raft_consensus.cc:3060] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:52.027231 19430 leader_election.cc:290] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 10 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:51.954802 19469 consensus_queue.cc:237] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:51.958459 19415 consensus_queue.cc:1048] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 12:11:51.998509 19495 raft_consensus.cc:493] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:52.013339 19408 raft_consensus.cc:493] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:51.962450 19501 raft_consensus.cc:515] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:11:52.034489 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 73391.1us
I20260709 12:11:52.004344 19470 raft_consensus.cc:740] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:52.040041 19445 raft_consensus.cc:2804] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:52.062827 19322 raft_consensus.cc:697] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 16 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:11:52.012626 19418 raft_consensus.cc:493] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:52.052301 14257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41764 (request call id 2963) took 2179 ms. Trace:
I20260709 12:11:52.052917 14181 raft_consensus.cc:1240] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:52.029405 19503 raft_consensus.cc:697] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 15 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:11:51.980778 19380 raft_consensus.cc:515] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:52.040262 19401 raft_consensus.cc:493] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:52.039314 19390 raft_consensus.cc:493] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:11:52.039932 19409 raft_consensus.cc:493] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:52.063762 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:52.077723 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:52.133394 14336 raft_consensus.cc:2468] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 10.
I20260709 12:11:52.014179 19395 raft_consensus.cc:515] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:52.086898 14331 raft_consensus.cc:1240] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:52.088380 14229 leader_election.cc:304] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:52.093065 14903 raft_consensus.cc:2468] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 13.
I20260709 12:11:52.097003 19445 raft_consensus.cc:493] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:52.099773 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 295779us
W20260709 12:11:52.102296 14259 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41764 (request call id 2966) took 2218 ms (client timeout 1734 ms). Trace:
W20260709 12:11:52.137243 14259 rpcz_store.cc:269] 0709 12:11:49.887722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:49.900803 (+ 13081us) service_pool.cc:224] Handling call
0709 12:11:52.097231 (+2196428us) spinlock_profiling.cc:243] Waited 681 ms on lock 0x7b54002fc954. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:11:52.097424 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1565394688}
I20260709 12:11:52.104900 14181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56046 (request call id 2485) took 1230 ms. Trace:
I20260709 12:11:52.138294 14181 rpcz_store.cc:276] 0709 12:11:50.874202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:50.874349 (+   147us) service_pool.cc:224] Handling call
0709 12:11:52.052450 (+1178101us) spinlock_profiling.cc:243] Waited 1.99 ms on lock 0x7b5800001298. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2124016b71 00007f2124016a22 00007f212cf2f8d9 00007f212c089ee0 00007f212c1530ab 00007f212c153131 00007f212c114fc0 00007f212c0ff929 00007f212c0ff3d2 00007f2125676bd4
0709 12:11:52.052719 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:52.104568 (+ 51849us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:52.104821 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4583296}
I20260709 12:11:52.079895 19476 raft_consensus.cc:515] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:52.088940 19408 raft_consensus.cc:3060] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:52.119179 19322 consensus_queue.cc:237] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:52.121049 19410 leader_election.cc:290] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:52.058902 19435 raft_consensus.cc:515] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:52.078322 19441 raft_consensus.cc:515] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:52.123198 18992 leader_election.cc:290] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:52.086372 19495 raft_consensus.cc:3060] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:52.056520 19457 raft_consensus.cc:515] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:52.155966 19457 leader_election.cc:290] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 11 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:52.124109 14333 raft_consensus.cc:1240] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:52.105726 14257 rpcz_store.cc:276] 0709 12:11:49.873329 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:49.875229 (+  1900us) service_pool.cc:224] Handling call
0709 12:11:49.875503 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:50.352449 (+476946us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:52.051978 (+1699529us) spinlock_profiling.cc:243] Waited 476 ms on lock 0x7b54002210d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:11:52.052218 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1094384384}
I20260709 12:11:52.133576 14189 raft_consensus.cc:2468] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 13.
I20260709 12:11:52.158151 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:11:52.158564 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:52.159475 14189 raft_consensus.cc:2393] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 15: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:11:52.134824 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:52.041865 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:52.136439 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:11:52.138866 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 50606.6us
I20260709 12:11:52.105422 19418 raft_consensus.cc:3060] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:52.143153 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:11:52.145094 19189 leader_election.cc:290] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:52.131822 19390 raft_consensus.cc:3060] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:52.166458 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:52.166813 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:52.167477 14189 raft_consensus.cc:2393] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 14: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:11:52.168124 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:52.169373 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:52.147581 14186 raft_consensus.cc:2368] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for earlier term 11. Current term is 12.
I20260709 12:11:52.130828 19401 raft_consensus.cc:3060] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:52.172147 14189 raft_consensus.cc:1275] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:11:52.172775 14182 raft_consensus.cc:1275] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 14 index: 6. Preceding OpId from leader: term: 16 index: 7. (index mismatch)
I20260709 12:11:52.173573 14189 raft_consensus.cc:1275] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 12:11:52.174255 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
W20260709 12:11:52.145349 19498 log.cc:927] Time spent T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.929s	user 0.000s	sys 0.005s
W20260709 12:11:52.148954 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 191813us
I20260709 12:11:52.176546 14304 leader_election.cc:304] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:52.150238 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:52.161338 14229 leader_election.cc:304] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:52.177570 14181 raft_consensus.cc:2468] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 13.
I20260709 12:11:52.177992 14155 leader_election.cc:304] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:52.142129 19445 raft_consensus.cc:3060] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:52.180670 14229 leader_election.cc:304] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:52.181552 14304 leader_election.cc:304] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db
W20260709 12:11:52.184005 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 219588us
I20260709 12:11:52.185552 14304 leader_election.cc:304] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:52.186645 14229 leader_election.cc:304] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:52.191450 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:52.191249 14229 leader_election.cc:304] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:52.193413 14229 leader_election.cc:304] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:52.146642 19430 consensus_queue.cc:1059] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 12:11:52.185029 14230 leader_election.cc:304] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:11:52.187674 19429 raft_consensus.cc:2804] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:52.200248 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:52.188351 19402 raft_consensus.cc:3060] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:52.186719 19410 raft_consensus.cc:2749] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:52.188243 19189 raft_consensus.cc:2804] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:52.184147 19534 raft_consensus.cc:2749] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:52.188540 19414 raft_consensus.cc:2804] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:52.148811 19409 raft_consensus.cc:515] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:52.215970 14304 leader_election.cc:304] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:52.194767 19413 raft_consensus.cc:2804] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:52.221977 19413 raft_consensus.cc:493] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:52.222486 19413 raft_consensus.cc:3060] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:52.223899 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:11:52.224655 19395 leader_election.cc:290] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:52.225289 19395 raft_consensus.cc:2804] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:52.197029 19456 consensus_queue.cc:1059] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.029s
I20260709 12:11:52.225932 14184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56046 (request call id 2488) took 1349 ms. Trace:
I20260709 12:11:52.196851 19457 raft_consensus.cc:2804] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:52.235037 19457 raft_consensus.cc:493] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:52.235482 19457 raft_consensus.cc:3060] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:52.235940 19501 leader_election.cc:290] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 15 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:52.239365 19487 leader_election.cc:290] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 15 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:52.240159 19435 leader_election.cc:290] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:52.244513 19413 raft_consensus.cc:515] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:52.147156 19503 consensus_queue.cc:237] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:52.221153 19430 raft_consensus.cc:3055] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:52.226353 14184 rpcz_store.cc:276] 0709 12:11:50.876823 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:50.876929 (+   106us) service_pool.cc:224] Handling call
0709 12:11:50.877280 (+   351us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:50.993672 (+116392us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:50.993726 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:50.998814 (+  5088us) log.cc:844] Serialized 26 byte log entry
0709 12:11:51.098501 (+ 99687us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:51.098540 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:51.098612 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:52.144761 (+1046149us) spinlock_profiling.cc:243] Waited 4.14 ms on lock 0x7b4400022b4c. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2123f74c85 00007f2123f756a2 00007f2126ce71db 00007f2126ce2aaf 00007f2126cd686e 00007f2126cd5bb6 00007f2126cd57d8 00007f2126cdf221 00007f2126cdf1d9 00007f2126cdf169
0709 12:11:52.220164 (+ 75403us) raft_consensus.cc:1685] finished
0709 12:11:52.220188 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:52.225847 (+  5659us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":51326,"raft.queue_time_us":219934,"raft.run_cpu_time_us":205,"raft.run_wall_time_us":12950,"spinlock_wait_cycles":9510656,"thread_start_us":135104,"threads_started":2,"wal-append.queue_time_us":189196}
I20260709 12:11:52.229575 19441 leader_election.cc:290] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:52.199014 19299 consensus_queue.cc:1048] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 12:11:52.232519 14912 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d"
dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
mode: GRACEFUL
new_leader_uuid: "17aab1bbf5014936aa18cc21818b26ec"
 from {username='slave'} at 127.0.0.1:38628
I20260709 12:11:52.280824 14912 raft_consensus.cc:606] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 11 LEADER]: Received request to transfer leadership to TS 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:11:52.225776 19395 raft_consensus.cc:697] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 14 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:11:52.234213 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:52.234562 19410 raft_consensus.cc:2804] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:11:52.221866 19476 leader_election.cc:290] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:52.284615 19476 raft_consensus.cc:2749] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:11:52.246645 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:11:52.287287 19413 leader_election.cc:290] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 14 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:52.234212 19380 leader_election.cc:290] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:52.263588 19430 raft_consensus.cc:740] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:52.294796 19430 consensus_queue.cc:260] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:52.296119 19430 raft_consensus.cc:3060] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:52.247390 19409 leader_election.cc:290] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:52.204639 19403 raft_consensus.cc:2804] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:52.315641 19403 raft_consensus.cc:697] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 15 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:11:52.315919 19395 consensus_queue.cc:237] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:52.209255 19189 raft_consensus.cc:493] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:52.317070 19189 raft_consensus.cc:3060] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:52.206357 19429 raft_consensus.cc:493] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:52.293515 19390 raft_consensus.cc:515] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:52.322247 19429 raft_consensus.cc:3060] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:52.324819 19390 leader_election.cc:290] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 12 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:52.247582 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:11:52.234442 19532 log.cc:927] Time spent T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 12:11:52.298990 19455 consensus_queue.cc:1059] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 12:11:52.326728 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:52.326897 19455 raft_consensus.cc:3055] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:52.150207 19470 consensus_queue.cc:260] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:52.255839 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:52.327312 19455 raft_consensus.cc:740] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:52.254293 14262 raft_consensus.cc:2468] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 13.
I20260709 12:11:52.328272 19455 consensus_queue.cc:260] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:52.328711 19448 raft_consensus.cc:493] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:52.329231 19448 raft_consensus.cc:515] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } }
I20260709 12:11:52.330470 19515 consensus_queue.cc:1048] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 12:11:52.266870 19527 log.cc:927] Time spent T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 12:11:52.283624 19388 raft_consensus.cc:3055] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 12 LEADER]: Stepping down as leader of term 12
W20260709 12:11:52.301141 14228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:52.338465 14261 raft_consensus.cc:1240] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:52.329555 19455 raft_consensus.cc:3060] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:52.309571 19401 raft_consensus.cc:515] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:52.310102 19237 raft_consensus.cc:3060] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:52.302695 19410 raft_consensus.cc:493] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:52.311223 19414 raft_consensus.cc:493] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:52.313170 14906 raft_consensus.cc:1240] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:52.220279 14229 leader_election.cc:304] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
W20260709 12:11:52.300976 14876 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:52.305709 19413 raft_consensus.cc:493] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:52.334645 14334 raft_consensus.cc:2468] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 15.
I20260709 12:11:52.362578 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:52.253439 19408 raft_consensus.cc:515] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:52.341851 14259 raft_consensus.cc:1240] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:52.316762 19403 consensus_queue.cc:237] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.6, Last appended by leader: 6, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:52.350953 14261 raft_consensus.cc:1275] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:11:52.354480 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:52.369094 14257 raft_consensus.cc:2468] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 14.
I20260709 12:11:52.360222 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:52.327328 14339 raft_consensus.cc:3060] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Advancing to term 12
W20260709 12:11:52.363157 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 142967us
I20260709 12:11:52.373378 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:52.374276 14334 raft_consensus.cc:2393] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 13: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:11:52.375133 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:52.375820 14334 raft_consensus.cc:2393] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 14: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:11:52.361511 19414 raft_consensus.cc:3060] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:52.378859 19408 leader_election.cc:290] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:52.368685 19322 raft_consensus.cc:2804] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:52.379803 19322 raft_consensus.cc:493] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:52.380213 19322 raft_consensus.cc:3060] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:52.382659 19227 consensus_queue.cc:1059] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:11:52.383386 19450 raft_consensus.cc:3055] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:52.383622 19227 raft_consensus.cc:3055] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:52.384032 19227 raft_consensus.cc:740] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:11:52.351274 19388 raft_consensus.cc:740] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:52.386812 19388 consensus_queue.cc:260] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:52.390826 14229 leader_election.cc:304] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:52.350404 19470 raft_consensus.cc:3060] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:52.415079 14339 raft_consensus.cc:2468] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 12.
I20260709 12:11:52.360145 19410 raft_consensus.cc:3060] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:52.313645 19495 raft_consensus.cc:515] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:52.419178 14339 raft_consensus.cc:1240] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 16. Current term is 17. Ops: []
I20260709 12:11:52.385183 19227 consensus_queue.cc:260] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:52.427219 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:52.391950 19388 raft_consensus.cc:3060] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:52.388792 19450 raft_consensus.cc:740] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
W20260709 12:11:52.415575 19543 log.cc:927] Time spent T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:11:52.394311 19471 raft_consensus.cc:493] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:11:52.452564 14339 raft_consensus.cc:1240] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 15 LEADER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:52.454814 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
W20260709 12:11:52.456655 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 240760us
I20260709 12:11:52.457177 19471 raft_consensus.cc:515] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:52.419142 19418 raft_consensus.cc:515] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:52.461858 19471 leader_election.cc:290] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:52.368534 19413 raft_consensus.cc:515] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:52.461565 19418 leader_election.cc:290] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 13 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:52.490222 19408 raft_consensus.cc:493] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:52.495157 19402 raft_consensus.cc:2749] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:52.496160 19408 raft_consensus.cc:515] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:52.490507 19445 raft_consensus.cc:515] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:52.495209 14903 raft_consensus.cc:1240] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 17. Current term is 18. Ops: []
I20260709 12:11:52.470834 14905 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f52421be255e4fab824173d17981b5bb"
dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
mode: GRACEFUL
new_leader_uuid: "17aab1bbf5014936aa18cc21818b26ec"
 from {username='slave'} at 127.0.0.1:38628
I20260709 12:11:52.483276 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:52.499402 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:52.481026 14339 raft_consensus.cc:1275] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:11:52.479322 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:52.498556 14905 raft_consensus.cc:606] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 15 LEADER]: Received request to transfer leadership to TS 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:11:52.500097 14338 raft_consensus.cc:2393] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 12: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:11:52.503806 14339 raft_consensus.cc:1275] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:11:52.504284 14338 raft_consensus.cc:1240] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:52.502316 14912 raft_consensus.cc:2468] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 10.
I20260709 12:11:52.507737 14339 raft_consensus.cc:1275] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:11:52.444595 19189 raft_consensus.cc:515] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:52.498720 19227 raft_consensus.cc:3060] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:52.452621 19549 raft_consensus.cc:2804] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:52.522140 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:52.522469 14229 leader_election.cc:304] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
W20260709 12:11:52.527302 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 162551us
I20260709 12:11:52.525856 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:52.531430 14337 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50856 (request call id 2417) took 1007 ms. Trace:
I20260709 12:11:52.531967 14339 raft_consensus.cc:1240] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 12:11:52.532636 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:52.533542 14264 raft_consensus.cc:2393] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 14: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
W20260709 12:11:52.540047 14190 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56044 (request call id 2908) took 1421 ms (client timeout 1873 ms). Trace:
W20260709 12:11:52.540529 14190 rpcz_store.cc:269] 0709 12:11:51.118518 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:51.119442 (+   924us) service_pool.cc:224] Handling call
0709 12:11:52.539852 (+1420410us) spinlock_profiling.cc:243] Waited 6.16 ms on lock 0x7b54003b2754. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:11:52.539975 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14179200}
W20260709 12:11:52.544195 14364 heartbeater.cc:646] Failed to heartbeat to 127.12.174.190:39655 (1 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.12.174.190:39655 timed out after 15.000s (SENT)
I20260709 12:11:52.546159 19403 raft_consensus.cc:2804] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:52.546687 19403 raft_consensus.cc:493] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:11:52.547086 19403 raft_consensus.cc:3060] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:52.548394 19348 raft_consensus.cc:993] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db: : Instructing follower 17aab1bbf5014936aa18cc21818b26ec to start an election
I20260709 12:11:52.548982 19348 raft_consensus.cc:1081] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 11 LEADER]: Signalling peer 17aab1bbf5014936aa18cc21818b26ec to start an election
I20260709 12:11:52.549885 19549 raft_consensus.cc:697] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 13 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:11:52.550549 19495 leader_election.cc:290] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:52.550933 19549 consensus_queue.cc:237] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:52.554525 19189 leader_election.cc:290] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 13 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:52.558825 19429 raft_consensus.cc:515] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:52.524197 19040 consensus_queue.cc:1059] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 12:11:52.569363 19433 raft_consensus.cc:3055] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:52.569908 19433 raft_consensus.cc:740] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:52.570501 19401 leader_election.cc:290] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 17 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:52.573557 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:52.574446 14184 raft_consensus.cc:2468] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 11.
I20260709 12:11:52.575263 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:52.575592 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:11:52.531948 14337 rpcz_store.cc:276] 0709 12:11:51.524159 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:51.524467 (+   308us) service_pool.cc:224] Handling call
0709 12:11:51.524748 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:51.914410 (+389662us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:52.531186 (+616776us) spinlock_profiling.cc:243] Waited 388 ms on lock 0x7b54000fbed4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:11:52.531363 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":892478208}
I20260709 12:11:52.576961 19322 raft_consensus.cc:515] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:52.575954 14182 raft_consensus.cc:3060] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:52.582717 14186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56044 (request call id 2927) took 1161 ms. Trace:
I20260709 12:11:52.582892 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:52.583261 14186 rpcz_store.cc:276] 0709 12:11:51.368417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:51.651044 (+282627us) service_pool.cc:224] Handling call
0709 12:11:52.529347 (+878303us) spinlock_profiling.cc:243] Waited 490 ms on lock 0x7b54003b2254. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:11:52.529488 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1126262528}
W20260709 12:11:52.587090 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 64775us
I20260709 12:11:52.605150 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:52.606391 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:52.617141 14264 raft_consensus.cc:2468] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 12.
I20260709 12:11:52.599695 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:52.561544 19429 leader_election.cc:290] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 15 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:52.489758 19450 consensus_queue.cc:260] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:52.622823 14339 raft_consensus.cc:1275] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 12:11:52.624441 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:52.624631 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:11:52.625922 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:52.626305 14189 raft_consensus.cc:1275] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 12:11:52.628410 14188 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56044 (request call id 2896) took 1628 ms (client timeout 1540 ms). Trace:
W20260709 12:11:52.634456 14188 rpcz_store.cc:269] 0709 12:11:51.000078 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:51.003356 (+  3278us) service_pool.cc:224] Handling call
0709 12:11:52.628200 (+1624844us) spinlock_profiling.cc:243] Waited 506 ms on lock 0x7b54001121d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:11:52.628334 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1163806464}
I20260709 12:11:52.629076 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:52.635869 14337 raft_consensus.cc:3060] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:52.630015 14339 pending_rounds.cc:85] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c: Aborting all ops after (but not including) 7
I20260709 12:11:52.639632 14339 pending_rounds.cc:107] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c: Aborting uncommitted NO_OP operation due to leader change: 14.8
I20260709 12:11:52.640004 14339 raft_consensus.cc:2889] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:52.633419 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:52.642031 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:52.643078 14264 raft_consensus.cc:2468] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 13.
I20260709 12:11:52.644244 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:52.644979 14333 raft_consensus.cc:2468] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 11.
I20260709 12:11:52.646552 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:52.647274 14263 raft_consensus.cc:2468] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 16.
I20260709 12:11:52.647359 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:52.648149 14264 raft_consensus.cc:2393] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 14: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:11:52.671229 14337 raft_consensus.cc:2468] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 13.
I20260709 12:11:52.645812 14182 raft_consensus.cc:2468] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 14.
I20260709 12:11:52.674024 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:52.573127 19403 raft_consensus.cc:515] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:52.676683 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:52.680790 14337 raft_consensus.cc:2393] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 14: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:11:52.680732 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:52.676904 14230 leader_election.cc:304] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:52.607465 19418 consensus_queue.cc:1059] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 12:11:52.676571 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:52.648634 19450 raft_consensus.cc:3060] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:52.686281 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:52.681504 14182 raft_consensus.cc:2468] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 10.
I20260709 12:11:52.570809 19433 consensus_queue.cc:260] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:52.717080 14907 raft_consensus.cc:2468] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 15.
I20260709 12:11:52.717878 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:52.718786 14264 raft_consensus.cc:2410] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for term 14 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
W20260709 12:11:52.678911 19447 consensus_meta.cc:287] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.624s	user 0.007s	sys 0.005s
I20260709 12:11:52.696434 19540 consensus_queue.cc:1059] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:52.698393 14230 leader_election.cc:304] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:52.705793 19041 consensus_queue.cc:1059] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 12:11:52.706496 14262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41764 (request call id 2981) took 1256 ms. Trace:
I20260709 12:11:52.708271 14261 raft_consensus.cc:1240] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:52.694378 19437 raft_consensus.cc:493] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:52.722887 14334 raft_consensus.cc:1240] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:52.727924 14186 raft_consensus.cc:1275] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:11:52.728770 14259 raft_consensus.cc:1240] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:52.732570 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:52.731622 14262 rpcz_store.cc:276] 0709 12:11:51.450066 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:51.478393 (+ 28327us) service_pool.cc:224] Handling call
0709 12:11:52.706264 (+1227871us) spinlock_profiling.cc:243] Waited 757 ms on lock 0x7b5400100c54. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:11:52.706413 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1740553472}
I20260709 12:11:52.736344 14304 leader_election.cc:304] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:52.732453 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:52.689965 19420 raft_consensus.cc:2749] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:52.738972 19432 raft_consensus.cc:2804] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:52.717317 19418 consensus_queue.cc:1243] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer 65c9c1653b3346b39a0e118540e6080c log is divergent from this leader: its last log entry 14.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
W20260709 12:11:52.742385 19457 consensus_meta.cc:287] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.506s	user 0.006s	sys 0.006s
I20260709 12:11:52.744581 19403 leader_election.cc:290] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 11 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:11:52.747277 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 48988.1us
I20260709 12:11:52.754246 14256 raft_consensus.cc:2468] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 13.
I20260709 12:11:52.717820 19520 raft_consensus.cc:493] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:52.708175 19414 raft_consensus.cc:515] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:52.784104 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:52.784802 14181 raft_consensus.cc:2468] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 16.
I20260709 12:11:52.765635 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:52.772642 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:52.786159 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:52.786841 14182 raft_consensus.cc:2468] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 14.
I20260709 12:11:52.774077 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:52.775414 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:52.778631 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:52.788363 14303 leader_election.cc:400] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 11 pre-election: Vote denied by peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187) with higher term. Message: Invalid argument: T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for earlier term 11. Current term is 12.
I20260709 12:11:52.788776 14303 leader_election.cc:403] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:52.790786 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:52.786598 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:52.792007 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:52.793195 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:52.781270 19237 consensus_queue.cc:1059] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.013s
I20260709 12:11:52.800796 14909 raft_consensus.cc:1275] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:11:52.783838 19392 raft_consensus.cc:493] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:52.777693 19435 raft_consensus.cc:2749] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:52.801856 19520 raft_consensus.cc:515] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:52.802310 19392 raft_consensus.cc:515] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:52.802693 19227 consensus_queue.cc:1059] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.012s
I20260709 12:11:52.803649 19322 leader_election.cc:290] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 14 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:52.758337 19432 raft_consensus.cc:493] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:52.805279 19432 raft_consensus.cc:3060] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:52.745167 19437 raft_consensus.cc:515] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:52.807848 19437 leader_election.cc:290] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:52.808334 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:52.809026 19410 raft_consensus.cc:515] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:52.810066 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:52.810714 14334 raft_consensus.cc:2376] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 15. Re-sending same reply.
I20260709 12:11:52.811301 19410 leader_election.cc:290] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:52.812454 14337 raft_consensus.cc:1240] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:52.812902 19542 raft_consensus.cc:2749] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187) with higher term. Message: Invalid argument: T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for earlier term 11. Current term is 12.
I20260709 12:11:52.814129 19237 raft_consensus.cc:3055] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:11:52.814571 19237 raft_consensus.cc:740] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:11:52.815649 19237 consensus_queue.cc:260] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:52.816358 19414 leader_election.cc:290] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:52.816975 19237 raft_consensus.cc:3060] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:52.819394 19445 leader_election.cc:290] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:52.819409 19227 raft_consensus.cc:3055] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:52.807981 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
W20260709 12:11:52.822623 14907 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53200 (request call id 684) took 1985 ms (client timeout 1876 ms). Trace:
I20260709 12:11:52.822973 14304 leader_election.cc:304] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:52.823151 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:52.828054 14188 raft_consensus.cc:3060] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:52.809551 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:52.825239 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:52.783332 19041 raft_consensus.cc:3055] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:52.784665 14230 leader_election.cc:304] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:11:52.828511 14189 raft_consensus.cc:3060] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:52.836246 14304 leader_election.cc:304] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:52.830224 14182 raft_consensus.cc:3060] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:52.837502 14304 leader_election.cc:304] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:52.838691 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:52.834069 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
W20260709 12:11:52.828071 14907 rpcz_store.cc:269] 0709 12:11:50.837171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:50.837315 (+   144us) service_pool.cc:224] Handling call
0709 12:11:52.822402 (+1985087us) spinlock_profiling.cc:243] Waited 1.86 s on lock 0x7b540039eed4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:11:52.822523 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4282369280}
I20260709 12:11:52.840610 14263 raft_consensus.cc:3060] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:52.851498 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:52.852065 14304 leader_election.cc:304] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:52.857508 14189 raft_consensus.cc:2468] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 13.
I20260709 12:11:52.746136 19463 consensus_queue.cc:1048] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.090s
I20260709 12:11:52.827564 19227 raft_consensus.cc:740] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
W20260709 12:11:52.841490 19546 log.cc:927] Time spent T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.383s	user 0.002s	sys 0.002s
W20260709 12:11:52.854085 19556 log.cc:927] Time spent T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:11:52.863395 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:52.811497 19224 consensus_queue.cc:1048] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.048s
I20260709 12:11:52.835311 19041 raft_consensus.cc:740] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
W20260709 12:11:52.834728 19538 log.cc:927] Time spent T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.546s	user 0.004s	sys 0.000s
I20260709 12:11:52.867332 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:11:52.858753 19470 raft_consensus.cc:2749] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:52.869277 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:52.876821 14188 raft_consensus.cc:2468] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 14.
I20260709 12:11:52.879384 14181 raft_consensus.cc:1240] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 12:11:52.835369 19240 consensus_queue.cc:1059] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.050s
I20260709 12:11:52.884030 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:52.900434 14184 raft_consensus.cc:3060] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:52.842936 19388 raft_consensus.cc:2749] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:52.859731 19401 raft_consensus.cc:2749] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:11:52.841562 19493 raft_consensus.cc:493] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:11:52.850791 19542 raft_consensus.cc:2749] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:52.782230 19457 raft_consensus.cc:515] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:52.887390 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:52.887715 14304 leader_election.cc:304] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:52.824034 19487 consensus_queue.cc:1048] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 12:11:52.905851 14334 raft_consensus.cc:1240] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:52.909340 14258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53050 (request call id 974) took 1348 ms. Trace:
I20260709 12:11:52.824342 19456 consensus_queue.cc:1048] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
W20260709 12:11:52.911279 19555 log.cc:927] Time spent T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 12:11:52.888840 14909 raft_consensus.cc:3060] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:52.909761 14258 rpcz_store.cc:276] 0709 12:11:51.560723 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:51.898343 (+337620us) service_pool.cc:224] Handling call
0709 12:11:51.898796 (+   453us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:51.913672 (+ 14876us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:51.913709 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:51.913772 (+    63us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:11:51.913817 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:52.909075 (+995258us) spinlock_profiling.cc:243] Waited 14.6 ms on lock 0x7b54001c3254. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:11:52.909124 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:52.909271 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":33671552}
W20260709 12:11:52.868623 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 84034.8us
I20260709 12:11:52.914899 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:52.882743 19435 raft_consensus.cc:2804] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:52.916972 14260 raft_consensus.cc:3060] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:52.915004 14230 leader_election.cc:304] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:11:52.915321 14264 raft_consensus.cc:2393] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 17: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:11:52.862313 14187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56046 (request call id 2489) took 1984 ms. Trace:
I20260709 12:11:52.927474 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:52.926581 14187 rpcz_store.cc:276] 0709 12:11:50.877903 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:50.964160 (+ 86257us) service_pool.cc:224] Handling call
0709 12:11:50.964592 (+   432us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:51.049481 (+ 84889us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:51.049516 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:51.094166 (+ 44650us) log.cc:844] Serialized 26 byte log entry
0709 12:11:52.396287 (+1302121us) spinlock_profiling.cc:243] Waited 3.14 ms on lock 0x7b180030c040. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f212cf16ab1 00007f212cf23281 00007f2124030e07 00007f212ce8b9a9 00007f212404d69b 00007f212404b93f 00007f212404dc02 00007f2126cd520b 00007f2126cdad23 00007f2126cdb0d1 00007f21270f6a0f
0709 12:11:52.667191 (+270904us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:11:52.835977 (+168786us) log.cc:844] Serialized 14 byte log entry
0709 12:11:52.836665 (+   688us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:52.836748 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:52.836787 (+    39us) raft_consensus.cc:1685] finished
0709 12:11:52.862069 (+ 25282us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:52.862239 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5271,"prepare.queue_time_us":29979,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":42,"raft.queue_time_us":161868,"raft.run_cpu_time_us":305,"raft.run_wall_time_us":25531,"spinlock_wait_cycles":7228800,"thread_start_us":469366,"threads_started":3,"wal-append.queue_time_us":1585795}
W20260709 12:11:52.925432 14304 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:52.928252 14262 raft_consensus.cc:2468] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 12.
W20260709 12:11:52.928846 14304 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:52.930718 14337 raft_consensus.cc:1275] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:11:52.912382 19227 consensus_queue.cc:260] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:52.933338 14187 raft_consensus.cc:1240] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 16. Current term is 17. Ops: []
I20260709 12:11:52.936594 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:52.944432 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:52.939765 14335 raft_consensus.cc:1240] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 12. Current term is 13. Ops: []
W20260709 12:11:52.947768 14876 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:52.928709 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:52.958746 14188 raft_consensus.cc:2376] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 13. Re-sending same reply.
I20260709 12:11:52.959661 14876 leader_election.cc:304] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:11:52.941809 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:52.937691 19447 consensus_queue.cc:1048] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 12:11:52.934621 19429 raft_consensus.cc:2749] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:52.917294 19435 raft_consensus.cc:493] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:52.965695 19435 raft_consensus.cc:3060] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:52.967191 19522 raft_consensus.cc:2804] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:52.967654 19522 raft_consensus.cc:493] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:11:52.968647 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:52.968936 14258 raft_consensus.cc:1275] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:11:52.969486 14188 raft_consensus.cc:3060] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:52.973400 14332 raft_consensus.cc:1240] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:52.974231 14338 raft_consensus.cc:1275] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 14 index: 6. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
I20260709 12:11:52.976367 14339 raft_consensus.cc:2393] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 17: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:11:52.976397 19522 raft_consensus.cc:3060] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:52.931437 19420 raft_consensus.cc:2804] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:52.923295 19354 leader_election.cc:290] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:52.984931 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:52.988651 14187 raft_consensus.cc:3060] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:52.984431 19447 consensus_queue.cc:1059] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 12:11:52.990530 14185 raft_consensus.cc:1240] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 15 LEADER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 14. Current term is 15. Ops: []
W20260709 12:11:52.991854 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 162626us
I20260709 12:11:52.913920 19121 consensus_queue.cc:1059] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.063s
I20260709 12:11:52.917551 19493 raft_consensus.cc:515] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:53.005290 19420 raft_consensus.cc:697] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 13 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:11:53.022560 19420 consensus_queue.cc:237] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:11:53.007391 19560 log.cc:927] Time spent T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:11:53.045431 14331 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 961) took 1204 ms. Trace:
I20260709 12:11:53.008142 14338 raft_consensus.cc:1275] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:11:52.984174 19540 consensus_queue.cc:1048] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 12:11:53.009940 19402 raft_consensus.cc:3055] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:53.009936 19224 raft_consensus.cc:3055] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:52.910265 19041 consensus_queue.cc:260] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:53.060648 19413 leader_election.cc:290] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:53.064852 19224 raft_consensus.cc:740] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
W20260709 12:11:53.086087 14228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:53.063009 19402 raft_consensus.cc:740] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:11:53.118320 14338 raft_consensus.cc:1275] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:11:53.153258 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:53.120213 19041 raft_consensus.cc:3060] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:53.183533 14184 raft_consensus.cc:2468] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 14.
I20260709 12:11:52.943694 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
W20260709 12:11:53.186506 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 226950us
I20260709 12:11:53.046038 14331 rpcz_store.cc:276] 0709 12:11:51.841065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:51.842803 (+  1738us) service_pool.cc:224] Handling call
0709 12:11:51.843078 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:52.135519 (+292441us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:53.018464 (+882945us) spinlock_profiling.cc:243] Waited 244 ms on lock 0x7b54002819d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:11:53.045287 (+ 26823us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":560157056}
I20260709 12:11:52.860941 14182 raft_consensus.cc:2468] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 12.
I20260709 12:11:53.194732 14188 raft_consensus.cc:2468] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 15.
I20260709 12:11:53.195798 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:53.197103 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:53.197177 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:53.155143 19354 raft_consensus.cc:493] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:53.216868 14876 leader_election.cc:304] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:53.206130 14184 pending_rounds.cc:85] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf: Aborting all ops after (but not including) 6
I20260709 12:11:53.217612 14184 pending_rounds.cc:107] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 12:11:53.219532 14181 raft_consensus.cc:1275] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:11:53.215246 14262 raft_consensus.cc:1240] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 12:11:53.224184 14260 raft_consensus.cc:2468] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 14.
I20260709 12:11:53.228842 14909 raft_consensus.cc:2468] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 12.
I20260709 12:11:53.219481 14184 raft_consensus.cc:2889] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:53.218111 14187 raft_consensus.cc:2468] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 14.
I20260709 12:11:53.218863 14303 leader_election.cc:304] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:53.207458 14182 raft_consensus.cc:2393] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 12: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:11:53.208802 14188 raft_consensus.cc:1240] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 11. Current term is 12. Ops: []
W20260709 12:11:53.206146 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 319564us
I20260709 12:11:53.189323 19380 raft_consensus.cc:493] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:53.255235 14154 leader_election.cc:304] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:53.231608 14303 leader_election.cc:304] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:53.251292 14260 raft_consensus.cc:1275] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:11:53.257162 14262 raft_consensus.cc:1275] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 14 index: 6. Preceding OpId from leader: term: 16 index: 7. (index mismatch)
I20260709 12:11:53.260517 14260 raft_consensus.cc:1240] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:53.200413 19227 raft_consensus.cc:3060] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:53.266017 14181 raft_consensus.cc:3055] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:53.200099 19448 leader_election.cc:290] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187)
I20260709 12:11:53.266499 14181 raft_consensus.cc:740] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:11:53.263343 14261 raft_consensus.cc:1275] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 12:11:53.257172 14303 leader_election.cc:304] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:53.263410 14260 raft_consensus.cc:1240] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:53.268131 14261 raft_consensus.cc:1240] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:53.265401 14262 raft_consensus.cc:1240] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 14. Current term is 15. Ops: [14.7-14.7]
I20260709 12:11:53.273226 14303 leader_election.cc:304] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:53.134868 19224 consensus_queue.cc:260] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:53.279670 14303 leader_election.cc:304] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:11:53.278236 14260 raft_consensus.cc:1275] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:11:53.245972 19121 raft_consensus.cc:2749] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:53.244697 19186 raft_consensus.cc:493] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:53.245400 19441 raft_consensus.cc:493] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:53.246459 19419 raft_consensus.cc:2749] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:11:53.265983 19542 raft_consensus.cc:2804] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:53.286605 14181 consensus_queue.cc:260] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:53.244834 19236 consensus_queue.cc:1048] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.064s
I20260709 12:11:53.285233 14303 leader_election.cc:304] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:53.174448 19402 consensus_queue.cc:260] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:53.277913 14263 raft_consensus.cc:2468] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 14.
I20260709 12:11:53.291729 14181 raft_consensus.cc:3060] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:53.283356 14260 raft_consensus.cc:1275] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:11:53.280318 14261 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d"
dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
 from {username='slave'} at 127.0.0.1:53050
I20260709 12:11:53.280824 19401 raft_consensus.cc:2749] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:53.309031 14303 leader_election.cc:304] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:53.310001 14261 raft_consensus.cc:493] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:53.310501 14261 raft_consensus.cc:3060] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:53.246208 19354 raft_consensus.cc:515] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:53.258147 19495 consensus_queue.cc:1048] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 12:11:53.281145 19470 raft_consensus.cc:2749] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:53.262131 19380 raft_consensus.cc:515] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:53.317075 14190 raft_consensus.cc:1240] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 14 LEADER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:53.285498 19456 raft_consensus.cc:2804] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:11:53.320863 14228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:53.322220 14183 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56046 (request call id 2498) took 2318 ms (client timeout 1825 ms). Trace:
I20260709 12:11:53.313359 19388 raft_consensus.cc:2749] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 12:11:53.322700 14183 rpcz_store.cc:269] 0709 12:11:50.998181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:50.998329 (+   148us) service_pool.cc:224] Handling call
0709 12:11:53.316779 (+2318450us) spinlock_profiling.cc:243] Waited 1.36 s on lock 0x7b540035af54. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:11:53.316931 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3138484992}
I20260709 12:11:53.285544 19430 consensus_queue.cc:1059] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 12:11:53.316809 19503 raft_consensus.cc:2804] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:53.319818 19224 raft_consensus.cc:3060] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:53.328807 19419 raft_consensus.cc:2804] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:53.338116 19309 raft_consensus.cc:493] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:53.292171 19441 raft_consensus.cc:515] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:53.290396 19186 raft_consensus.cc:515] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:53.318615 19564 consensus_queue.cc:1059] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 12:11:53.338969 19402 raft_consensus.cc:3060] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:53.335675 19456 raft_consensus.cc:697] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 13 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:53.356379 19401 raft_consensus.cc:493] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
W20260709 12:11:53.357100 19571 log.cc:927] Time spent T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:11:53.348187 19503 raft_consensus.cc:697] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 12 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:11:53.322495 19240 consensus_queue.cc:1059] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.037s
W20260709 12:11:53.358625 19570 log.cc:927] Time spent T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 12:11:53.416141 19503 consensus_queue.cc:237] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:11:53.421023 19432 consensus_meta.cc:287] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.615s	user 0.006s	sys 0.002s
I20260709 12:11:53.422521 19380 leader_election.cc:290] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:53.423066 19441 leader_election.cc:290] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:11:53.423956 19573 log.cc:927] Time spent T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 12:11:53.354898 19309 raft_consensus.cc:515] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:53.368482 19419 raft_consensus.cc:697] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 14 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:53.355093 19392 leader_election.cc:290] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:53.352763 19388 raft_consensus.cc:3055] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:11:53.446218 14155 leader_election.cc:304] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
W20260709 12:11:53.398804 19450 consensus_meta.cc:287] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.682s	user 0.011s	sys 0.017s
I20260709 12:11:53.441800 14261 raft_consensus.cc:515] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:11:53.485023 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:53.507296 14257 raft_consensus.cc:1240] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 11. Current term is 13. Ops: []
I20260709 12:11:53.508139 14181 raft_consensus.cc:1275] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 8. (term mismatch)
I20260709 12:11:53.508688 14181 pending_rounds.cc:85] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf: Aborting all ops after (but not including) 7
I20260709 12:11:53.508975 14181 pending_rounds.cc:107] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf: Aborting uncommitted NO_OP operation due to leader change: 14.8
I20260709 12:11:53.509271 14181 raft_consensus.cc:2889] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:11:53.496485 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 50366.8us
W20260709 12:11:53.432137 14154 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 177004us
I20260709 12:11:53.430859 19448 raft_consensus.cc:493] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:53.522197 14305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:53.463693 19432 raft_consensus.cc:515] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:11:53.527545 14305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:53.549961 14261 leader_election.cc:290] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 13 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:53.551328 14155 leader_election.cc:304] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:53.552268 19471 raft_consensus.cc:2749] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:53.398200 19401 raft_consensus.cc:515] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:53.525460 19493 leader_election.cc:290] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:53.505990 19380 raft_consensus.cc:2749] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:53.569555 19432 leader_election.cc:290] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 15 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:53.554563 19471 consensus_queue.cc:1059] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
W20260709 12:11:53.571523 14154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:53.572415 19435 consensus_meta.cc:287] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.606s	user 0.021s	sys 0.013s
I20260709 12:11:53.572912 19435 raft_consensus.cc:515] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:53.560168 14155 leader_election.cc:304] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:53.505442 19388 raft_consensus.cc:740] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
W20260709 12:11:53.585834 14305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:53.622264 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 334698us
I20260709 12:11:53.631625 14260 raft_consensus.cc:1240] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 11. Current term is 12. Ops: []
W20260709 12:11:53.632864 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 383497us
W20260709 12:11:53.642094 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 333142us
I20260709 12:11:53.652456 14303 leader_election.cc:304] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:11:53.654311 14876 leader_election.cc:304] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:11:53.554765 19448 raft_consensus.cc:515] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:53.562757 19495 consensus_queue.cc:1048] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.075s
I20260709 12:11:53.574044 19380 consensus_queue.cc:1048] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.069s
I20260709 12:11:53.659823 14303 leader_election.cc:304] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:53.634248 19354 leader_election.cc:290] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:53.618065 19493 consensus_queue.cc:1048] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 12:11:53.672639 14335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50858 (request call id 2058) took 1636 ms. Trace:
I20260709 12:11:53.678690 14303 leader_election.cc:304] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:53.677754 14335 rpcz_store.cc:276] 0709 12:11:52.036676 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:52.385222 (+348546us) service_pool.cc:224] Handling call
0709 12:11:52.385525 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:52.957836 (+572311us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:53.672376 (+714540us) spinlock_profiling.cc:243] Waited 554 ms on lock 0x7b5400338e54. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:11:53.672554 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1274072320}
I20260709 12:11:53.686422 14304 leader_election.cc:304] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
W20260709 12:11:53.700762 14228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:53.675423 19564 raft_consensus.cc:2804] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:53.670886 19256 raft_consensus.cc:3060] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:53.669545 19430 raft_consensus.cc:2749] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:11:53.655541 19471 consensus_queue.cc:1048] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 12:11:53.753625 19471 raft_consensus.cc:493] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:53.673820 19435 leader_election.cc:290] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:53.754212 19471 raft_consensus.cc:515] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:53.755224 19380 raft_consensus.cc:493] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:53.755774 19380 raft_consensus.cc:515] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:53.693030 19441 consensus_queue.cc:1048] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.071s
I20260709 12:11:53.760277 19348 raft_consensus.cc:3055] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:53.760767 19348 raft_consensus.cc:740] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:11:53.761165 19441 consensus_queue.cc:1048] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:53.712298 19236 raft_consensus.cc:3055] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:53.771960 19236 raft_consensus.cc:740] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:11:53.772930 19236 consensus_queue.cc:260] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:53.774283 19236 raft_consensus.cc:3060] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:53.714222 19463 raft_consensus.cc:3055] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:53.775630 19463 raft_consensus.cc:740] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:11:53.776614 19433 raft_consensus.cc:3060] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:53.776495 19463 consensus_queue.cc:260] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:53.718772 19455 raft_consensus.cc:2804] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:53.778059 19455 raft_consensus.cc:697] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 12 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:53.719182 19577 consensus_queue.cc:1048] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:53.719939 19303 consensus_queue.cc:1048] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:11:53.720952 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:53.787874 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:53.788499 14263 raft_consensus.cc:3060] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:53.723137 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:53.790267 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:53.790894 14260 raft_consensus.cc:3060] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:53.724789 14259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41768 (request call id 2093) took 1301 ms. Trace:
I20260709 12:11:53.791698 14259 rpcz_store.cc:276] 0709 12:11:52.423766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:52.709201 (+285435us) service_pool.cc:224] Handling call
0709 12:11:52.709571 (+   370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:52.735598 (+ 26027us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:53.724480 (+988882us) spinlock_profiling.cc:243] Waited 19 ms on lock 0x7b54002c0e54. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:11:53.724725 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":43729792}
I20260709 12:11:53.725675 14265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53050 (request call id 981) took 1384 ms. Trace:
W20260709 12:11:53.726811 14256 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41764 (request call id 2965) took 3848 ms (client timeout 1873 ms). Trace:
I20260709 12:11:53.728883 19457 leader_election.cc:290] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 13 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:53.731119 14185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 2901) took 2721 ms. Trace:
I20260709 12:11:53.732110 14190 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56652 (request call id 1219) took 1088 ms. Trace:
I20260709 12:11:53.656049 19575 consensus_queue.cc:1059] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.057s
I20260709 12:11:53.751500 19408 leader_election.cc:290] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:53.761796 19348 consensus_queue.cc:260] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:53.734859 19564 raft_consensus.cc:493] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:53.764873 19429 consensus_queue.cc:1048] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:53.699692 19186 leader_election.cc:290] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:53.721053 19493 raft_consensus.cc:3055] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:11:53.704427 19354 raft_consensus.cc:493] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:53.699141 19388 consensus_queue.cc:260] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:53.692817 19227 consensus_queue.cc:1048] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.076s
I20260709 12:11:53.709471 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:53.858395 14261 raft_consensus.cc:2468] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 12.
I20260709 12:11:53.771301 19495 raft_consensus.cc:493] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:53.574108 19456 consensus_queue.cc:237] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:53.783396 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
W20260709 12:11:53.785099 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 78919.9us
I20260709 12:11:53.795912 14190 rpcz_store.cc:276] 0709 12:11:52.644164 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:52.644419 (+   255us) service_pool.cc:224] Handling call
0709 12:11:53.316891 (+672472us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:53.320203 (+  3312us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:53.731866 (+411663us) spinlock_profiling.cc:243] Waited 640 ms on lock 0x7b540035af50. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713a8ad 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:11:53.732028 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1471096064}
I20260709 12:11:53.795506 14185 rpcz_store.cc:276] 0709 12:11:51.009527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:51.146511 (+136984us) service_pool.cc:224] Handling call
0709 12:11:51.146843 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:52.991028 (+1844185us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:53.730817 (+739789us) spinlock_profiling.cc:243] Waited 1.84 s on lock 0x7b540028aad4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:11:53.731019 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4239671552}
W20260709 12:11:53.802635 14228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:53.784729 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 92617.8us
I20260709 12:11:53.632056 19419 consensus_queue.cc:237] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:53.803563 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:11:53.793383 14265 rpcz_store.cc:276] 0709 12:11:52.341013 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:52.419116 (+ 78103us) service_pool.cc:224] Handling call
0709 12:11:52.454083 (+ 34967us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:52.535786 (+ 81703us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:52.535828 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:52.536754 (+   926us) log.cc:844] Serialized 26 byte log entry
0709 12:11:52.792615 (+255861us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:11:52.792659 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:53.725275 (+932616us) spinlock_profiling.cc:243] Waited 61.7 ms on lock 0x7b5400211e54. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:11:53.725324 (+    49us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:53.725371 (+    47us) raft_consensus.cc:1685] finished
0709 12:11:53.725384 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:53.725600 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":29690,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":100,"spinlock_wait_cycles":141864832,"thread_start_us":139110,"threads_started":1,"wal-append.queue_time_us":264365}
I20260709 12:11:53.806147 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:11:53.868324 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
W20260709 12:11:53.795289 14256 rpcz_store.cc:269] 0709 12:11:49.877956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:49.878347 (+   391us) service_pool.cc:224] Handling call
0709 12:11:53.726588 (+3848241us) spinlock_profiling.cc:243] Waited 2.85 s on lock 0x7b54002c0954. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:11:53.726726 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6553242880}
W20260709 12:11:53.729297 19041 consensus_meta.cc:287] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.562s	user 0.008s	sys 0.000s
I20260709 12:11:53.811902 14259 raft_consensus.cc:1275] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:11:53.832449 19224 raft_consensus.cc:493] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:53.823065 14263 raft_consensus.cc:2468] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 15.
I20260709 12:11:53.836055 14907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: true dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:11:53.880414 14907 raft_consensus.cc:3055] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:53.880761 14907 raft_consensus.cc:740] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
W20260709 12:11:53.815584 19237 consensus_meta.cc:287] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db: Time spent flushing consensus metadata: real 0.995s	user 0.019s	sys 0.016s
I20260709 12:11:53.884585 14264 raft_consensus.cc:2410] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 12:11:53.846540 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:53.811592 19463 raft_consensus.cc:3060] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:53.862113 14910 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183"
dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
mode: GRACEFUL
new_leader_uuid: "885067a0d31741bfb5c9935788e315bf"
 from {username='slave'} at 127.0.0.1:38628
I20260709 12:11:53.889896 14910 raft_consensus.cc:606] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Received request to transfer leadership to TS 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:53.813537 19309 leader_election.cc:290] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:11:53.842711 19542 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.019s	sys 0.028s
I20260709 12:11:53.829386 19564 raft_consensus.cc:3060] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:53.665941 19469 raft_consensus.cc:2804] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:53.831362 19380 leader_election.cc:290] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:53.877609 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:53.938974 14259 raft_consensus.cc:2393] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 12: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:11:53.844754 19471 leader_election.cc:290] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:53.853356 14260 raft_consensus.cc:2468] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 17.
I20260709 12:11:53.881824 14185 raft_consensus.cc:1240] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 13. Current term is 14. Ops: []
W20260709 12:11:53.885540 14877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:53.890650 14910 raft_consensus.cc:614] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:53.900018 19448 leader_election.cc:290] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:53.876767 19455 consensus_queue.cc:237] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:53.871161 19354 raft_consensus.cc:515] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:53.903012 19535 raft_consensus.cc:3055] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:11:53.903601 19121 consensus_queue.cc:1059] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:11:53.904699 19579 log.cc:927] Time spent T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 12:11:53.847749 19584 raft_consensus.cc:2804] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:53.847347 19493 raft_consensus.cc:740] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:11:53.938428 19401 leader_election.cc:290] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:53.884105 14907 consensus_queue.cc:260] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:11:53.934237 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 46253.6us
W20260709 12:11:53.934461 19542 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.616s	user 0.020s	sys 0.029s
I20260709 12:11:53.948051 19534 raft_consensus.cc:2749] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:53.942193 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:53.943017 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
W20260709 12:11:53.936015 19580 log.cc:927] Time spent T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
I20260709 12:11:53.879863 19495 raft_consensus.cc:515] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:53.955750 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:53.952944 19469 raft_consensus.cc:697] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 15 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
W20260709 12:11:53.952278 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 273677us
I20260709 12:11:53.908808 14261 raft_consensus.cc:1240] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:53.969548 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:53.979975 14185 raft_consensus.cc:2468] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 13.
W20260709 12:11:53.936977 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 231420us
I20260709 12:11:53.956322 19535 raft_consensus.cc:740] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:11:53.975255 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:53.950070 19576 raft_consensus.cc:493] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:53.976356 14190 raft_consensus.cc:2393] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 14: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:11:53.885068 19224 raft_consensus.cc:515] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:53.953233 19041 raft_consensus.cc:493] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:53.973210 14907 raft_consensus.cc:3060] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:11:53.985105 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:53.983084 12986 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:11:53.973665 19542 raft_consensus.cc:697] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 14 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:54.003552 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: true dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:54.004345 14188 raft_consensus.cc:3060] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:11:54.009068 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:54.016602 14186 raft_consensus.cc:1275] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:11:53.979182 19584 raft_consensus.cc:697] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 14 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:54.029098 14186 raft_consensus.cc:1275] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
I20260709 12:11:53.988111 19441 consensus_queue.cc:1059] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 12:11:54.037154 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:54.039366 14907 raft_consensus.cc:2468] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 13.
I20260709 12:11:54.037891 14910 raft_consensus.cc:2468] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 15.
I20260709 12:11:53.992287 19592 raft_consensus.cc:493] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:54.045704 14188 raft_consensus.cc:2468] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 13.
I20260709 12:11:53.987061 19309 consensus_queue.cc:1059] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 12:11:54.064754 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:54.065503 14188 raft_consensus.cc:2468] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 15.
W20260709 12:11:54.092808 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 77192.3us
I20260709 12:11:54.077198 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:54.094656 14258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41768 (request call id 2097) took 1669 ms. Trace:
I20260709 12:11:54.094844 14188 raft_consensus.cc:2468] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 17.
I20260709 12:11:54.000306 19041 raft_consensus.cc:515] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:54.030130 19503 raft_consensus.cc:493] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:11:54.122381 14304 leader_election.cc:304] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:54.095110 14258 rpcz_store.cc:276] 0709 12:11:52.425058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:53.011874 (+586816us) service_pool.cc:224] Handling call
0709 12:11:53.012437 (+   563us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:53.186291 (+173854us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:53.186329 (+    38us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:53.186987 (+   658us) log.cc:844] Serialized 52 byte log entry
0709 12:11:53.636099 (+449112us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:53.636147 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:53.636217 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:54.094402 (+458185us) raft_consensus.cc:1685] finished
0709 12:11:54.094426 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:54.094586 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9934,"raft.queue_time_us":3407,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":8064,"thread_start_us":360045,"threads_started":1,"wal-append.queue_time_us":451895}
I20260709 12:11:53.990845 19576 raft_consensus.cc:515] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:54.127245 14335 raft_consensus.cc:1217] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Deduplicated request from leader. Original: 9.8->[11.9-17.11]   Dedup: 11.9->[15.10-17.11]
I20260709 12:11:54.132917 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:54.133656 14335 raft_consensus.cc:1240] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 17. Current term is 18. Ops: [11.9-17.11]
W20260709 12:11:54.137320 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 156977us
I20260709 12:11:54.135891 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:54.138450 14188 raft_consensus.cc:2468] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 11.
I20260709 12:11:54.010910 19493 consensus_queue.cc:260] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:54.141625 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:54.061064 19457 consensus_queue.cc:1048] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.077s
I20260709 12:11:54.142567 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:54.124959 19419 raft_consensus.cc:3055] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:54.146893 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:54.092865 19380 raft_consensus.cc:493] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:54.060390 19590 raft_consensus.cc:493] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:54.123947 19469 consensus_queue.cc:237] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:11:54.161767 19402 consensus_meta.cc:287] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.792s	user 0.010s	sys 0.000s
W20260709 12:11:54.162802 19589 log.cc:927] Time spent T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.181s	user 0.000s	sys 0.001s
I20260709 12:11:54.138042 19441 raft_consensus.cc:2749] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:54.061820 19596 consensus_queue.cc:1059] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.107s
W20260709 12:11:54.165663 14154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:54.164199 19584 consensus_queue.cc:237] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:54.146996 19597 consensus_queue.cc:1059] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 12:11:54.182778 19576 leader_election.cc:290] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:54.131410 19309 consensus_queue.cc:1048] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 12:11:54.131819 19542 consensus_queue.cc:237] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } }
I20260709 12:11:54.136369 19432 consensus_queue.cc:1059] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 12:11:54.065163 19592 raft_consensus.cc:515] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:54.061942 19535 consensus_queue.cc:260] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:54.152072 19419 raft_consensus.cc:740] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:54.136134 19503 raft_consensus.cc:515] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:54.197961 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:11:54.262409 19602 log.cc:927] Time spent T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
W20260709 12:11:54.264086 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 461349us
W20260709 12:11:54.251893 14305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:54.192021 19598 log.cc:927] Time spent T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.158s	user 0.000s	sys 0.001s
W20260709 12:11:54.288769 14229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:54.187101 19041 leader_election.cc:290] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:11:54.289423 14229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:54.205997 19610 raft_consensus.cc:493] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:54.236148 14876 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:54.177100 19380 raft_consensus.cc:515] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:54.207257 19354 leader_election.cc:290] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:54.177920 19493 raft_consensus.cc:3060] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:54.286651 19495 leader_election.cc:290] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:54.206318 19448 consensus_queue.cc:1059] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.096s
W20260709 12:11:54.304214 14303 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:54.192699 19607 raft_consensus.cc:493] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:54.295290 14339 raft_consensus.cc:2468] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 15.
I20260709 12:11:54.176865 19590 raft_consensus.cc:515] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:54.320796 14303 leader_election.cc:304] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec
W20260709 12:11:54.300978 19522 consensus_meta.cc:287] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db: Time spent flushing consensus metadata: real 1.312s	user 0.014s	sys 0.005s
I20260709 12:11:54.301107 19606 raft_consensus.cc:493] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:54.318815 19448 consensus_queue.cc:1243] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Peer 65c9c1653b3346b39a0e118540e6080c log is divergent from this leader: its last log entry 14.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:11:54.322008 19607 raft_consensus.cc:515] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:54.328480 19522 raft_consensus.cc:515] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:11:54.401532 19600 log.cc:927] Time spent T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.260s	user 0.001s	sys 0.000s
I20260709 12:11:54.402551 19041 raft_consensus.cc:493] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:54.403317 19520 leader_election.cc:290] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:54.298138 19610 raft_consensus.cc:515] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:54.311743 19419 consensus_queue.cc:260] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:54.399307 19380 leader_election.cc:290] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:11:54.408293 19595 log.cc:927] Time spent T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.314s	user 0.000s	sys 0.001s
W20260709 12:11:54.331233 19599 log.cc:927] Time spent T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.207s	user 0.000s	sys 0.001s
W20260709 12:11:54.409788 19256 consensus_meta.cc:287] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.644s	user 0.011s	sys 0.004s
I20260709 12:11:54.429571 19592 leader_election.cc:290] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:54.327669 19469 raft_consensus.cc:2804] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:54.333670 19606 raft_consensus.cc:515] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:54.432119 19469 raft_consensus.cc:493] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:54.432569 19469 raft_consensus.cc:3060] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:54.433825 19606 leader_election.cc:290] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:54.311616 19463 raft_consensus.cc:493] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:54.321718 19455 raft_consensus.cc:493] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:54.412101 19590 leader_election.cc:290] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:54.434662 19455 raft_consensus.cc:515] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:54.436863 19455 leader_election.cc:290] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:54.427313 19041 raft_consensus.cc:515] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:54.428931 19419 raft_consensus.cc:3060] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:11:54.410851 19612 log.cc:927] Time spent T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 12:11:54.437599 19463 raft_consensus.cc:515] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:54.441102 19463 leader_election.cc:290] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:54.429872 19338 raft_consensus.cc:493] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:54.429940 19610 leader_election.cc:290] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:11:54.422972 19603 log.cc:927] Time spent T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.259s	user 0.001s	sys 0.006s
I20260709 12:11:54.430363 19503 leader_election.cc:290] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:54.442813 19564 raft_consensus.cc:515] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:54.443953 19041 leader_election.cc:290] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:54.444794 19564 leader_election.cc:290] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 11 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:54.442106 19338 raft_consensus.cc:515] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:54.441354 19607 leader_election.cc:290] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:54.446341 19522 leader_election.cc:290] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 12 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:54.450560 19469 raft_consensus.cc:515] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:54.452304 19469 leader_election.cc:290] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:11:54.483080 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:54.484551 14330 raft_consensus.cc:1275] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 12. (term mismatch)
I20260709 12:11:54.485388 14330 pending_rounds.cc:85] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c: Aborting all ops after (but not including) 11
I20260709 12:11:54.486495 14184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 2945) took 1518 ms. Trace:
I20260709 12:11:54.487191 14184 rpcz_store.cc:276] 0709 12:11:53.192719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:53.205448 (+ 12729us) service_pool.cc:224] Handling call
0709 12:11:53.205891 (+   443us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:53.658900 (+453009us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:53.658938 (+    38us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:53.660260 (+  1322us) log.cc:844] Serialized 52 byte log entry
0709 12:11:53.947495 (+287235us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:53.947536 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:53.947622 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:54.485630 (+538008us) raft_consensus.cc:1685] finished
0709 12:11:54.485680 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:54.486169 (+   489us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6164,"raft.queue_time_us":63715,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":6120,"thread_start_us":562149,"threads_started":2,"wal-append.queue_time_us":368518}
I20260709 12:11:54.490729 14187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 2951) took 1296 ms. Trace:
I20260709 12:11:54.425187 14903 raft_consensus.cc:1240] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:54.491274 14187 rpcz_store.cc:276] 0709 12:11:53.194490 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:53.252540 (+ 58050us) service_pool.cc:224] Handling call
0709 12:11:53.253215 (+   675us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:53.634170 (+380955us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:53.634208 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:53.634784 (+   576us) log.cc:844] Serialized 26 byte log entry
0709 12:11:53.939792 (+305008us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:53.939838 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:53.939913 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:54.490019 (+550106us) raft_consensus.cc:1685] finished
0709 12:11:54.490084 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:54.490487 (+   403us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6869,"raft.queue_time_us":78868,"raft.run_cpu_time_us":211,"raft.run_wall_time_us":9474,"thread_start_us":619193,"threads_started":2,"wal-append.queue_time_us":358304}
I20260709 12:11:54.495682 14257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53050 (request call id 987) took 1252 ms. Trace:
I20260709 12:11:54.495771 19380 raft_consensus.cc:493] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:54.496206 14257 rpcz_store.cc:276] 0709 12:11:53.242785 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:53.317661 (+ 74876us) service_pool.cc:224] Handling call
0709 12:11:53.323541 (+  5880us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:53.507824 (+184283us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:54.494941 (+987117us) spinlock_profiling.cc:243] Waited 183 ms on lock 0x7b54003151d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:11:54.495389 (+   448us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":422044032}
I20260709 12:11:54.496985 19380 raft_consensus.cc:515] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:54.501410 19380 leader_election.cc:290] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:54.502383 19380 raft_consensus.cc:493] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:54.503443 19380 raft_consensus.cc:515] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:54.505386 19503 raft_consensus.cc:493] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
W20260709 12:11:54.506661 14264 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41764 (request call id 3015) took 1580 ms (client timeout 1849 ms). Trace:
I20260709 12:11:54.506414 19503 raft_consensus.cc:515] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:11:54.507207 14264 rpcz_store.cc:269] 0709 12:11:52.926219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:52.936336 (+ 10117us) service_pool.cc:224] Handling call
0709 12:11:54.505977 (+1569641us) spinlock_profiling.cc:243] Waited 930 ms on lock 0x7b54003822d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:11:54.506323 (+   346us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2139624192}
I20260709 12:11:54.507781 19577 raft_consensus.cc:493] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:11:54.507962 19587 raft_consensus.cc:3055] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:54.508620 19587 raft_consensus.cc:740] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:11:54.509001 19577 raft_consensus.cc:515] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:54.517027 19495 raft_consensus.cc:493] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:54.510718 19587 consensus_queue.cc:260] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:54.518203 19495 raft_consensus.cc:515] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:54.520309 19587 raft_consensus.cc:3060] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:54.490908 14181 raft_consensus.cc:2410] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for term 17 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 8.
I20260709 12:11:54.524749 19503 leader_election.cc:290] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:54.528817 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:54.530254 14182 raft_consensus.cc:2468] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 15.
I20260709 12:11:54.530794 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:54.531970 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:54.533015 14185 raft_consensus.cc:2468] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 15.
I20260709 12:11:54.507148 14230 leader_election.cc:304] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:11:54.533826 14330 pending_rounds.cc:107] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c: Aborting uncommitted NO_OP operation due to leader change: 14.12
I20260709 12:11:54.534174 19303 raft_consensus.cc:3055] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:54.521421 19495 leader_election.cc:290] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:54.535027 14330 raft_consensus.cc:2889] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:54.545419 19469 raft_consensus.cc:493] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:54.546784 19433 raft_consensus.cc:3055] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:54.546591 19469 raft_consensus.cc:515] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:54.547362 19433 raft_consensus.cc:740] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:54.534731 19303 raft_consensus.cc:740] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:11:54.551728 19620 raft_consensus.cc:493] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:54.554206 19620 raft_consensus.cc:515] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:54.557036 19448 raft_consensus.cc:2804] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:54.552420 19469 leader_election.cc:290] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:54.557467 19620 leader_election.cc:290] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:54.516120 19348 raft_consensus.cc:3060] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:54.554972 19303 consensus_queue.cc:260] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:54.524814 19408 raft_consensus.cc:493] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:54.547325 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:54.578819 14187 raft_consensus.cc:3060] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:54.578970 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:54.581529 14182 raft_consensus.cc:3060] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:54.557526 19448 raft_consensus.cc:493] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:54.589485 19121 raft_consensus.cc:493] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:54.579856 19469 raft_consensus.cc:493] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:54.590996 19469 raft_consensus.cc:515] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:54.594830 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:11:54.549362 19433 consensus_queue.cc:260] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:54.590435 19121 raft_consensus.cc:515] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:54.596851 19433 raft_consensus.cc:3060] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:54.598802 19121 leader_election.cc:290] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:11:54.600319 14155 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.963s	user 0.007s	sys 0.010s
W20260709 12:11:54.600764 14155 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.964s	user 0.008s	sys 0.011s
I20260709 12:11:54.595788 14912 raft_consensus.cc:3060] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:54.578186 19408 raft_consensus.cc:515] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:54.606297 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:54.601955 19448 raft_consensus.cc:3060] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:54.598018 19224 leader_election.cc:290] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:54.610288 19430 raft_consensus.cc:493] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:54.615872 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 1.05571e+06us
W20260709 12:11:54.618558 19611 log.cc:927] Time spent T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.225s	user 0.004s	sys 0.000s
I20260709 12:11:54.622848 19577 leader_election.cc:290] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:54.622012 14082 catalog_manager.cc:5697] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:54.624584 19380 leader_election.cc:290] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:54.629663 19309 raft_consensus.cc:3055] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:54.630611 19309 raft_consensus.cc:740] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:54.632136 19309 consensus_queue.cc:260] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:54.632751 19441 raft_consensus.cc:3055] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:54.633281 19441 raft_consensus.cc:740] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:54.634771 19441 consensus_queue.cc:260] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:54.636792 19441 raft_consensus.cc:3060] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:54.638427 19303 raft_consensus.cc:3060] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:54.630030 12986 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:54.616451 19430 raft_consensus.cc:515] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:54.644889 19460 raft_consensus.cc:993] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db: : Instructing follower 17aab1bbf5014936aa18cc21818b26ec to start an election
I20260709 12:11:54.645383 19338 leader_election.cc:290] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:54.646136 19430 leader_election.cc:290] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:54.625240 14082 catalog_manager.cc:5697] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:54.652789 19522 raft_consensus.cc:493] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:54.653065 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:54.653805 14333 raft_consensus.cc:2468] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 13.
I20260709 12:11:54.653605 14337 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 975) took 1014 ms. Trace:
I20260709 12:11:54.658255 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:54.655535 14337 rpcz_store.cc:276] 0709 12:11:53.638941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:53.639173 (+   232us) service_pool.cc:224] Handling call
0709 12:11:53.639550 (+   377us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:53.639803 (+   253us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:11:53.852082 (+212279us) log.cc:844] Serialized 14 byte log entry
0709 12:11:54.631706 (+779624us) spinlock_profiling.cc:243] Waited 5.02 ms on lock 0x7b180046a8c0. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f212cf16ab1 00007f212cf23281 00007f2126ce34bc 00007f212403148b 00007f212ce8b9a9 00007f212404d69b 00007f212404b93f 00007f212404dc02 00007f2126cd520b 00007f2126cdad23 00007f2126cdb23a
0709 12:11:54.652925 (+ 21219us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:54.653012 (+    87us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:11:54.653091 (+    79us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:54.653197 (+   106us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:54.653387 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20682,"prepare.queue_time_us":327847,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":22768,"raft.run_cpu_time_us":302,"raft.run_wall_time_us":301,"spinlock_wait_cycles":11548032,"thread_start_us":322973,"threads_started":2,"wal-append.queue_time_us":271469}
I20260709 12:11:54.655939 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:54.661311 19620 raft_consensus.cc:493] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:54.665113 19620 raft_consensus.cc:515] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:54.668188 19620 leader_election.cc:290] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:54.668181 14303 leader_election.cc:304] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:54.669994 19430 raft_consensus.cc:493] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:54.670010 14304 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:54.670451 14303 leader_election.cc:304] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:54.670931 19430 raft_consensus.cc:515] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:54.672077 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:54.671898 19622 raft_consensus.cc:2804] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:11:54.673182 19622 raft_consensus.cc:493] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:11:54.678177 19622 raft_consensus.cc:3060] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:11:54.662392 19588 log.cc:927] Time spent T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.630s	user 0.001s	sys 0.007s
I20260709 12:11:54.684604 19413 raft_consensus.cc:493] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:54.623216 19408 leader_election.cc:290] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:54.690639 19413 raft_consensus.cc:515] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:54.682271 19625 raft_consensus.cc:493] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:54.696141 19388 raft_consensus.cc:3060] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:54.697984 14303 leader_election.cc:304] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:54.670609 19487 raft_consensus.cc:2804] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:11:54.699061 14876 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:54.700809 14330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 962) took 2768 ms. Trace:
I20260709 12:11:54.703089 19620 raft_consensus.cc:493] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:54.728801 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:11:54.729314 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 44267.1us
I20260709 12:11:54.703675 14229 leader_election.cc:304] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:54.679098 19469 leader_election.cc:290] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:54.653726 19522 raft_consensus.cc:515] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:54.728655 14330 rpcz_store.cc:276] 0709 12:11:51.932205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:51.932876 (+   671us) service_pool.cc:224] Handling call
0709 12:11:51.933232 (+   356us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:54.554218 (+2620986us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:54.700489 (+146271us) spinlock_profiling.cc:243] Waited 2.55 s on lock 0x7b5400145354. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:11:54.700714 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5864237440}
I20260709 12:11:54.708761 19429 raft_consensus.cc:493] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:54.689615 19121 raft_consensus.cc:1081] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 15 LEADER]: Signalling peer 17aab1bbf5014936aa18cc21818b26ec to start an election
W20260709 12:11:54.738921 14303 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:54.744954 14155 leader_election.cc:304] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:54.746439 19534 raft_consensus.cc:2804] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:54.746992 19534 raft_consensus.cc:493] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:11:54.747438 19534 raft_consensus.cc:3060] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:54.747283 14155 leader_election.cc:304] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:54.748808 19503 raft_consensus.cc:2804] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:11:54.749253 19503 raft_consensus.cc:493] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:54.749716 19503 raft_consensus.cc:3060] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:54.749774 14155 leader_election.cc:304] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:54.750883 19576 raft_consensus.cc:2749] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:54.751636 14155 leader_election.cc:304] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:54.752671 19576 raft_consensus.cc:2749] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:54.753504 14155 leader_election.cc:304] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
W20260709 12:11:54.754143 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 73713.9us
I20260709 12:11:54.727998 19487 raft_consensus.cc:493] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:54.762310 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:54.763425 14335 raft_consensus.cc:2468] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 17.
I20260709 12:11:54.766018 19224 raft_consensus.cc:493] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:11:54.766911 19224 raft_consensus.cc:515] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:54.769301 19224 leader_election.cc:290] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:54.770218 19487 raft_consensus.cc:3060] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:54.774008 19429 raft_consensus.cc:515] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:54.774742 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:54.775756 14331 raft_consensus.cc:2393] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db in current term 16: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:11:54.783118 14876 leader_election.cc:304] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:54.784758 19075 raft_consensus.cc:2804] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:11:54.785226 19075 raft_consensus.cc:493] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:54.786625 19075 raft_consensus.cc:3060] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:54.790833 14332 raft_consensus.cc:1275] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
I20260709 12:11:54.791270 14332 pending_rounds.cc:85] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c: Aborting all ops after (but not including) 10
I20260709 12:11:54.791496 14332 pending_rounds.cc:107] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 12:11:54.791711 14332 raft_consensus.cc:2889] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:54.793213 19628 raft_consensus.cc:2749] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:11:54.794633 14228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:54.794832 19408 raft_consensus.cc:493] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:54.795500 19535 raft_consensus.cc:3060] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:11:54.795691 19408 raft_consensus.cc:515] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:54.797829 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:11:54.793407 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 90093.9us
I20260709 12:11:54.804453 14187 raft_consensus.cc:2468] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 12.
I20260709 12:11:54.804504 14912 raft_consensus.cc:2468] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 16.
I20260709 12:11:54.729200 19620 raft_consensus.cc:515] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:54.754586 19576 raft_consensus.cc:2749] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:11:54.819219 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 65905.3us
I20260709 12:11:54.763195 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:54.798935 19441 raft_consensus.cc:2804] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:54.813690 19408 leader_election.cc:290] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:54.829905 19441 raft_consensus.cc:493] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:54.831696 19522 leader_election.cc:290] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:54.834203 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:54.834326 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:54.834273 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:54.835680 14185 raft_consensus.cc:2468] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 11.
I20260709 12:11:54.836508 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:54.842948 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:54.845151 14339 raft_consensus.cc:1275] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:11:54.858912 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:54.859942 14181 raft_consensus.cc:2468] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 11.
I20260709 12:11:54.860997 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:54.862687 19413 leader_election.cc:290] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:54.862963 14338 raft_consensus.cc:2468] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 16.
I20260709 12:11:54.865975 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:54.867539 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:54.868264 14190 raft_consensus.cc:2468] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 16.
I20260709 12:11:54.869186 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:54.870414 14906 raft_consensus.cc:1275] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:11:54.871892 14155 leader_election.cc:304] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:54.872040 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:54.872995 14260 raft_consensus.cc:2468] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 15.
I20260709 12:11:54.839200 19441 raft_consensus.cc:3060] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:54.865839 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:54.859393 14876 leader_election.cc:304] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:54.873706 14155 leader_election.cc:304] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:54.878669 14263 raft_consensus.cc:2468] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 14.
I20260709 12:11:54.843104 19429 leader_election.cc:290] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:54.873579 19535 raft_consensus.cc:493] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:54.879786 14264 raft_consensus.cc:1275] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 12:11:54.887307 14182 raft_consensus.cc:2468] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 11.
I20260709 12:11:54.820879 19628 raft_consensus.cc:493] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:11:54.913095 14190 raft_consensus.cc:2468] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 13.
I20260709 12:11:54.804767 19625 raft_consensus.cc:515] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:54.865841 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
W20260709 12:11:54.912949 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 72314.3us
I20260709 12:11:54.921476 19620 leader_election.cc:290] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:54.922178 14187 raft_consensus.cc:2410] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for term 15 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
W20260709 12:11:54.928375 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 138753us
I20260709 12:11:54.935366 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:54.952473 14230 leader_election.cc:304] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:11:54.954304 14184 raft_consensus.cc:1275] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:11:54.918090 19522 raft_consensus.cc:2804] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:11:54.960052 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 48894us
I20260709 12:11:54.914392 19576 raft_consensus.cc:2749] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:54.961866 14905 raft_consensus.cc:2468] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 13.
I20260709 12:11:54.972710 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:54.970840 14304 leader_election.cc:304] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:54.935741 19587 raft_consensus.cc:2749] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:54.978204 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:54.974867 14876 leader_election.cc:304] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:54.982652 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:54.993752 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:54.987017 14260 raft_consensus.cc:2468] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 12.
I20260709 12:11:54.970935 19522 raft_consensus.cc:493] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:11:54.931336 19622 raft_consensus.cc:515] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:54.995066 14335 raft_consensus.cc:2468] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 18.
W20260709 12:11:54.999861 14877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:55.000231 19637 raft_consensus.cc:2804] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:11:54.957158 19535 raft_consensus.cc:515] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:55.001911 14259 raft_consensus.cc:1240] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 11. Current term is 12. Ops: []
W20260709 12:11:55.002477 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 65141.7us
I20260709 12:11:55.003089 19224 raft_consensus.cc:2804] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:55.004205 19430 leader_election.cc:290] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:11:55.005100 14875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:55.008333 19448 raft_consensus.cc:515] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:54.988003 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:54.980131 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:55.000612 19240 consensus_queue.cc:1048] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.059s
I20260709 12:11:55.021610 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:11:55.025601 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:55.002094 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:55.032663 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:55.033888 19625 leader_election.cc:290] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:55.034356 19448 leader_election.cc:290] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:55.035774 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:55.036478 14265 raft_consensus.cc:3060] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Advancing to term 16
I20260709 12:11:55.037846 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:55.031256 14331 raft_consensus.cc:2468] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 12.
I20260709 12:11:55.039317 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:11:55.041766 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 168201us
I20260709 12:11:55.032776 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:55.037873 14229 leader_election.cc:304] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:55.019297 19522 raft_consensus.cc:3060] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:54.644241 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:55.018738 19637 raft_consensus.cc:493] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:55.045964 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:55.040109 14256 raft_consensus.cc:2410] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for term 15 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 12:11:55.032697 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:54.985864 19628 raft_consensus.cc:515] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:55.063478 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 16 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:55.065562 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:55.066284 14263 raft_consensus.cc:2468] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 18.
I20260709 12:11:55.068065 14303 leader_election.cc:304] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:55.051594 19637 raft_consensus.cc:3060] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:11:55.076172 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:11:55.078524 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 48968.3us
I20260709 12:11:55.078676 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:55.077412 14260 raft_consensus.cc:2468] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 13.
I20260709 12:11:55.086809 14338 raft_consensus.cc:1240] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 12:11:55.091452 14186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 2960) took 1017 ms. Trace:
I20260709 12:11:55.091873 14186 rpcz_store.cc:276] 0709 12:11:54.039552 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:54.181901 (+142349us) service_pool.cc:224] Handling call
0709 12:11:54.182279 (+   378us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:54.182655 (+   376us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:11:54.604428 (+421773us) log.cc:844] Serialized 14 byte log entry
0709 12:11:54.746246 (+141818us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:54.747212 (+   966us) log.cc:844] Serialized 26 byte log entry
0709 12:11:54.747420 (+   208us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:54.747454 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:54.747587 (+   133us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:55.047749 (+300162us) raft_consensus.cc:1685] finished
0709 12:11:55.047777 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:55.057135 (+  9358us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8584,"prepare.queue_time_us":249321,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":27,"raft.queue_time_us":981,"raft.run_cpu_time_us":190,"raft.run_wall_time_us":190,"thread_start_us":414577,"threads_started":2,"wal-append.queue_time_us":140357}
W20260709 12:11:55.093899 19629 log.cc:927] Time spent T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.166s	user 0.002s	sys 0.000s
I20260709 12:11:55.096433 14907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:55.097244 14907 raft_consensus.cc:2468] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 10.
I20260709 12:11:55.097332 19522 raft_consensus.cc:515] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:55.099915 19522 leader_election.cc:290] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 11 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:11:55.101693 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 141553us
W20260709 12:11:55.102162 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 114313us
I20260709 12:11:55.102533 19429 raft_consensus.cc:2804] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:55.103137 19429 raft_consensus.cc:697] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 15 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:55.104106 19429 consensus_queue.cc:237] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:55.107501 19535 leader_election.cc:290] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:55.108076 14336 raft_consensus.cc:2410] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for term 17 because replica has last-logged OpId of term: 16 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 7.
I20260709 12:11:55.108708 19448 consensus_queue.cc:1048] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:11:55.110165 19535 consensus_queue.cc:1048] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:11:55.111523 19628 leader_election.cc:290] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:11:55.109380 14304 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:55.057301 19224 raft_consensus.cc:697] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 11 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:11:55.085669 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:55.113561 14335 raft_consensus.cc:2393] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db in current term 11: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:11:55.083448 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:55.112614 14910 raft_consensus.cc:2393] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 12: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
W20260709 12:11:55.121481 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 76597.3us
W20260709 12:11:55.125830 14875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:55.143675 19041 raft_consensus.cc:493] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:55.144430 19041 raft_consensus.cc:515] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:55.145823 14903 raft_consensus.cc:1275] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:11:55.145934 19419 raft_consensus.cc:2804] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:55.146412 19419 raft_consensus.cc:493] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:11:55.146608 19041 leader_election.cc:290] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:55.146943 14339 raft_consensus.cc:2468] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 15.
I20260709 12:11:55.148811 19401 raft_consensus.cc:493] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:55.149566 19401 raft_consensus.cc:515] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:55.150439 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:55.151099 14330 raft_consensus.cc:2468] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 13.
I20260709 12:11:55.151913 19401 leader_election.cc:290] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:55.152151 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:55.152899 19224 consensus_queue.cc:237] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:55.154440 19622 leader_election.cc:290] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:55.156556 14259 raft_consensus.cc:1275] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:11:55.157672 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:55.157845 19436 raft_consensus.cc:493] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:55.158416 19436 raft_consensus.cc:515] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:55.158865 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:55.159546 14338 raft_consensus.cc:2468] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 14.
I20260709 12:11:55.160315 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:55.160502 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:55.161343 14338 raft_consensus.cc:2410] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for term 17 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
W20260709 12:11:55.161880 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 95747.5us
I20260709 12:11:55.162755 14155 leader_election.cc:304] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:55.158880 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:55.161065 14335 raft_consensus.cc:2393] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 16: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:11:55.153352 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:55.120652 14877 leader_election.cc:304] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:11:55.101212 19503 raft_consensus.cc:515] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:55.166694 14259 raft_consensus.cc:2468] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 14.
W20260709 12:11:55.179320 14228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:55.186009 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:55.162684 14264 raft_consensus.cc:2468] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 15.
W20260709 12:11:55.187098 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 66533.6us
I20260709 12:11:55.113969 19413 raft_consensus.cc:2749] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:11:55.192075 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 67007.9us
I20260709 12:11:55.192479 14265 raft_consensus.cc:2468] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 16.
I20260709 12:11:55.173620 19419 raft_consensus.cc:3060] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:55.203338 14336 raft_consensus.cc:1240] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:55.204597 14877 leader_election.cc:304] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:55.205299 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:55.206095 14877 leader_election.cc:304] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:11:55.206820 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:55.207348 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:55.208244 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:55.208274 14330 raft_consensus.cc:2393] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 14: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:11:55.208928 14265 raft_consensus.cc:3060] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:55.198587 14259 raft_consensus.cc:2468] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 14.
I20260709 12:11:55.199468 14303 leader_election.cc:304] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:55.210799 19522 raft_consensus.cc:2749] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:11:55.219022 14305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:55.172919 14082 catalog_manager.cc:5697] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 10 to 11, leader changed from 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) to 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130). New cstate: current_term: 11 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:11:55.191548 19075 raft_consensus.cc:515] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:55.225346 19075 leader_election.cc:290] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 17 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:55.230819 19582 raft_consensus.cc:2804] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:11:55.231333 19582 raft_consensus.cc:493] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:55.231695 19582 raft_consensus.cc:3060] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:11:55.213631 19460 raft_consensus.cc:2804] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:55.232244 19530 raft_consensus.cc:493] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:55.232798 19530 raft_consensus.cc:515] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:55.233387 14912 raft_consensus.cc:2368] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 16. Current term is 17.
I20260709 12:11:55.232251 19460 raft_consensus.cc:493] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:55.234360 19460 raft_consensus.cc:3060] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:55.235229 14229 leader_election.cc:304] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
W20260709 12:11:55.235952 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 48882.1us
I20260709 12:11:55.215694 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:55.217051 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:11:55.218433 14154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:55.242544 14256 raft_consensus.cc:1275] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:11:55.244278 14877 leader_election.cc:304] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:55.246073 14229 leader_election.cc:304] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:55.201956 19587 raft_consensus.cc:2749] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:55.249642 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:11:55.213666 19303 consensus_meta.cc:287] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db: Time spent flushing consensus metadata: real 0.574s	user 0.013s	sys 0.001s
I20260709 12:11:55.213140 19380 consensus_queue.cc:1059] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.039s
I20260709 12:11:55.252763 19587 consensus_queue.cc:1059] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:55.253171 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:11:55.254115 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 56618.7us
I20260709 12:11:55.255018 14303 leader_election.cc:304] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:55.256078 14303 leader_election.cc:304] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:55.256884 19401 raft_consensus.cc:2804] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:55.257207 19530 leader_election.cc:290] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:55.257685 19436 leader_election.cc:290] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:55.258173 19413 raft_consensus.cc:2804] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:55.199749 19576 consensus_queue.cc:1048] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.059s
I20260709 12:11:55.258982 19642 consensus_queue.cc:1059] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:55.262817 14303 leader_election.cc:304] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:55.270740 14330 raft_consensus.cc:2393] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 10: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:11:55.257252 19401 raft_consensus.cc:493] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:55.210282 19534 raft_consensus.cc:515] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:55.258435 19622 raft_consensus.cc:2804] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:11:55.280277 14877 leader_election.cc:304] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:55.265472 19240 raft_consensus.cc:2804] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:55.266147 19413 raft_consensus.cc:697] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 13 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:11:55.241019 19487 raft_consensus.cc:515] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:55.283320 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:55.275794 19401 raft_consensus.cc:3060] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:55.282265 19622 raft_consensus.cc:493] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:55.317866 19432 raft_consensus.cc:493] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:55.345944 19622 raft_consensus.cc:3060] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:55.346186 19432 raft_consensus.cc:515] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:55.348480 19432 leader_election.cc:290] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:55.348076 19413 consensus_queue.cc:237] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:55.306222 19448 raft_consensus.cc:2749] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:11:55.350062 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 113007us
I20260709 12:11:55.350899 14229 leader_election.cc:304] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:55.351895 19460 raft_consensus.cc:515] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:55.352852 14229 leader_election.cc:304] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:55.321517 19441 raft_consensus.cc:515] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:55.357121 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:11:55.329886 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 67139.9us
I20260709 12:11:55.359066 14303 leader_election.cc:304] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:55.333577 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:55.335042 19503 leader_election.cc:290] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:55.337131 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:55.292071 19628 raft_consensus.cc:3055] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:55.337991 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:55.338645 14230 leader_election.cc:304] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:11:55.338987 14337 raft_consensus.cc:2393] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 16: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:11:55.340026 19487 leader_election.cc:290] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:11:55.341271 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 61072.4us
I20260709 12:11:55.307190 19530 raft_consensus.cc:2749] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:55.343410 19534 leader_election.cc:290] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:55.295974 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:55.363026 14339 raft_consensus.cc:2393] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 15: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:11:55.363125 19432 raft_consensus.cc:2804] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:55.354086 19460 leader_election.cc:290] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 16 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:55.288054 19240 raft_consensus.cc:493] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:55.367409 14265 raft_consensus.cc:2468] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 11.
I20260709 12:11:55.355849 19441 leader_election.cc:290] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 13 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:55.372215 14230 leader_election.cc:304] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:11:55.376529 14304 leader_election.cc:304] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:11:55.364787 19628 raft_consensus.cc:740] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:11:55.385152 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:55.390225 14265 raft_consensus.cc:3060] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Advancing to term 16
W20260709 12:11:55.385643 14154 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 134038us
I20260709 12:11:55.380230 19240 raft_consensus.cc:3060] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:55.388049 14330 raft_consensus.cc:2393] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 13: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:11:55.374786 19642 raft_consensus.cc:2804] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:55.394730 14333 raft_consensus.cc:1240] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 17. Current term is 18. Ops: []
I20260709 12:11:55.377996 19432 raft_consensus.cc:493] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:55.404277 14258 raft_consensus.cc:2468] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 12.
I20260709 12:11:55.391690 19625 raft_consensus.cc:2804] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:55.393143 19448 raft_consensus.cc:2804] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:11:55.425987 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 260464us
I20260709 12:11:55.392387 19487 raft_consensus.cc:2804] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:55.439740 19630 raft_consensus.cc:493] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:55.402395 19642 raft_consensus.cc:493] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:55.378185 19469 consensus_queue.cc:1048] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 12:11:55.408596 19432 raft_consensus.cc:3060] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:55.455247 19630 raft_consensus.cc:515] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:11:55.480353 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 65174.9us
I20260709 12:11:55.467015 19576 consensus_queue.cc:1048] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.012s
I20260709 12:11:55.445187 19642 raft_consensus.cc:3060] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:11:55.479679 19645 log.cc:927] Time spent T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.158s	user 0.002s	sys 0.000s
I20260709 12:11:55.476425 19402 raft_consensus.cc:493] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:55.482209 19628 consensus_queue.cc:260] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:55.486382 19656 raft_consensus.cc:493] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:55.444067 14155 leader_election.cc:304] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:55.384354 19419 raft_consensus.cc:515] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:11:55.476467 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 123759us
I20260709 12:11:55.488200 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:11:55.489195 14303 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:55.436918 19625 raft_consensus.cc:493] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:55.446980 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 64376.3us
I20260709 12:11:55.505843 19625 raft_consensus.cc:3060] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:55.506351 19402 raft_consensus.cc:515] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:55.509575 19402 leader_election.cc:290] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:55.444106 19597 raft_consensus.cc:2749] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:11:55.510643 19656 raft_consensus.cc:515] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:55.505347 14877 leader_election.cc:304] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:11:55.513437 19656 leader_election.cc:290] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:11:55.515748 14085 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60436 (request call id 286) took 43765 ms (client timeout 15000 ms). Trace:
W20260709 12:11:55.518134 19646 log.cc:927] Time spent T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.212s	user 0.002s	sys 0.000s
I20260709 12:11:55.526988 19380 raft_consensus.cc:493] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
W20260709 12:11:55.527755 19643 log.cc:927] Time spent T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.205s	user 0.000s	sys 0.002s
W20260709 12:11:55.528652 14228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:55.529160 14228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:55.530470 19625 raft_consensus.cc:515] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:55.464130 19471 raft_consensus.cc:3055] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:55.534296 19471 raft_consensus.cc:740] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:11:55.535338 19471 consensus_queue.cc:260] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:55.536476 19471 raft_consensus.cc:3060] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:55.538913 14909 raft_consensus.cc:1275] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:11:55.539626 19419 leader_election.cc:290] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:55.540742 19534 raft_consensus.cc:3055] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:55.541172 19534 raft_consensus.cc:740] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:11:55.541355 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:55.503795 14263 raft_consensus.cc:2468] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 12.
I20260709 12:11:55.543915 14263 raft_consensus.cc:1240] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 12:11:55.546331 14339 raft_consensus.cc:1240] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 15. Current term is 16. Ops: []
I20260709 12:11:55.527786 19380 raft_consensus.cc:515] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:55.550709 19380 leader_election.cc:290] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:55.552055 14304 leader_election.cc:304] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:55.553872 14229 leader_election.cc:304] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:55.555558 14229 leader_election.cc:304] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:55.556509 19402 raft_consensus.cc:3060] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:55.497196 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:55.486961 19338 raft_consensus.cc:2749] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:55.531464 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:55.532960 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:55.533130 19628 raft_consensus.cc:3060] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:55.533535 19436 raft_consensus.cc:2804] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:55.440928 19448 raft_consensus.cc:493] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:55.570785 14183 raft_consensus.cc:3060] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Advancing to term 17
I20260709 12:11:55.410770 19441 consensus_queue.cc:1048] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.082s
I20260709 12:11:55.524714 14082 catalog_manager.cc:5697] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:55.573882 19436 raft_consensus.cc:493] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:55.574450 19436 raft_consensus.cc:3060] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:55.571929 14265 raft_consensus.cc:2468] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 16.
I20260709 12:11:55.552508 19625 leader_election.cc:290] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:55.469480 19309 raft_consensus.cc:3060] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:55.576376 14154 leader_election.cc:304] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:55.442678 19487 raft_consensus.cc:493] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
W20260709 12:11:55.583904 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 146035us
I20260709 12:11:55.587832 19471 raft_consensus.cc:2804] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:55.587929 19460 raft_consensus.cc:493] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:55.594362 19460 raft_consensus.cc:515] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:55.591001 19597 raft_consensus.cc:493] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:55.595741 19597 raft_consensus.cc:515] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:55.596917 19460 leader_election.cc:290] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:55.593664 19471 raft_consensus.cc:493] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:55.573899 19641 raft_consensus.cc:2749] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:11:55.620234 14305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:55.622962 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:55.620884 14155 leader_election.cc:304] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:55.575253 19448 raft_consensus.cc:3060] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:55.599331 19471 raft_consensus.cc:3060] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:55.591711 19487 raft_consensus.cc:3060] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:55.658474 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:11:55.658434 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 106452us
I20260709 12:11:55.570339 19637 raft_consensus.cc:515] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:55.581310 14258 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f52421be255e4fab824173d17981b5bb"
dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
 from {username='slave'} at 127.0.0.1:53050
I20260709 12:11:55.667119 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:55.667598 14258 raft_consensus.cc:493] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:55.656927 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:55.668237 14258 raft_consensus.cc:3060] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:55.669595 19430 raft_consensus.cc:2749] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:55.621654 19380 consensus_queue.cc:1048] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.049s
I20260709 12:11:55.670071 19534 consensus_queue.cc:260] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:55.668136 14154 leader_election.cc:400] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 16 pre-election: Vote denied by peer 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341) with higher term. Message: Invalid argument: T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 16. Current term is 17.
I20260709 12:11:55.671854 14154 leader_election.cc:403] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:55.674813 19515 raft_consensus.cc:493] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:55.667809 14338 raft_consensus.cc:3060] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:55.675621 14332 raft_consensus.cc:2393] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db in current term 11: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:11:55.616204 19587 raft_consensus.cc:2804] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:55.574558 14082 catalog_manager.cc:5697] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:11:55.680112 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 124715us
I20260709 12:11:55.680915 19471 raft_consensus.cc:515] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:55.681597 14229 leader_election.cc:304] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:55.683727 14229 leader_election.cc:304] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:55.683807 19471 leader_election.cc:290] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 14 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:55.689888 14877 leader_election.cc:304] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:11:55.692385 14338 raft_consensus.cc:2468] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 17.
W20260709 12:11:55.694024 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 103515us
I20260709 12:11:55.698268 14187 raft_consensus.cc:2468] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 14.
I20260709 12:11:55.688354 19515 raft_consensus.cc:515] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:55.700413 19530 raft_consensus.cc:2804] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:11:55.700851 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:55.700975 19530 raft_consensus.cc:697] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 16 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:11:55.701541 14331 raft_consensus.cc:3060] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:55.702432 19515 leader_election.cc:290] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:55.702150 19530 consensus_queue.cc:237] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:55.704310 19658 raft_consensus.cc:2804] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:55.704800 19658 raft_consensus.cc:493] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:55.705194 19658 raft_consensus.cc:3060] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:55.707747 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:55.708344 14183 raft_consensus.cc:2468] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 17.
I20260709 12:11:55.715711 14259 raft_consensus.cc:1275] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:11:55.656616 19655 raft_consensus.cc:493] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:55.715816 14154 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 102799us
I20260709 12:11:55.722090 14877 leader_election.cc:304] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:11:55.722254 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:55.723184 14183 raft_consensus.cc:2410] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for term 14 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 12:11:55.671718 19534 raft_consensus.cc:3060] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:55.679857 19587 raft_consensus.cc:493] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:55.727998 14261 raft_consensus.cc:2393] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 18: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:11:55.698173 19535 raft_consensus.cc:2804] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:11:55.627290 19622 raft_consensus.cc:515] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:55.699391 19597 leader_election.cc:290] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:55.731065 14304 leader_election.cc:304] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:11:55.695650 19338 raft_consensus.cc:493] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:55.516266 14085 rpcz_store.cc:269] 0709 12:11:11.752692 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:11.765633 (+ 12941us) service_pool.cc:224] Handling call
0709 12:11:55.515444 (+43749811us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:11:46.764250 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:11:46.782049 (+ 17799us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:11:46.786657 (+  4608us) write_op.cc:435] Acquired schema lock
0709 12:11:46.787342 (+   685us) tablet.cc:662] Decoding operations
0709 12:11:46.818282 (+ 30940us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:11:46.818400 (+   118us) write_op.cc:641] Partition lock acquired for write op
0709 12:11:46.818428 (+    28us) tablet.cc:685] Acquiring locks for 24 operations
0709 12:11:46.820471 (+  2043us) tablet.cc:701] Row locks acquired
0709 12:11:46.820522 (+    51us) write_op.cc:260] PREPARE: finished
0709 12:11:46.820717 (+   195us) write_op.cc:270] Start()
0709 12:11:46.820874 (+   157us) write_op.cc:276] Timestamp: P: 1783599106820639 usec, L: 0
0709 12:11:46.820911 (+    37us) op_driver.cc:348] REPLICATION: starting
0709 12:11:46.960021 (+139110us) log.cc:844] Serialized 9524 byte log entry
0709 12:11:47.896785 (+936764us) op_driver.cc:464] REPLICATION: finished
0709 12:11:48.214760 (+317975us) write_op.cc:301] APPLY: starting
0709 12:11:48.214879 (+   119us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:48.448543 (+233664us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:48.448717 (+   174us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:49.842569 (+1393852us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:50.401662 (+559093us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=48,key_file_lookups=48,delta_file_lookups=48,mrs_lookups=0
0709 12:11:50.412768 (+ 11106us) write_op.cc:312] APPLY: finished
0709 12:11:50.453635 (+ 40867us) log.cc:844] Serialized 212 byte log entry
0709 12:11:50.850132 (+396497us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:50.850408 (+   276us) write_op.cc:454] Released schema lock
0709 12:11:50.850505 (+    97us) write_op.cc:341] FINISH: Updating metrics
0709 12:11:50.921591 (+ 71086us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:50.925875 (+  4284us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":480149,"reported_tablets":43,"spinlock_wait_cycles":9088,"child_traces":[["op",{"apply.queue_time_us":317653,"apply.run_cpu_time_us":258541,"apply.run_wall_time_us":2650787,"cfile_cache_hit":98,"cfile_cache_hit_bytes":104639,"num_ops":24,"prepare.queue_time_us":324150,"prepare.run_cpu_time_us":79011,"prepare.run_wall_time_us":471763,"raft.queue_time_us":237993,"raft.run_cpu_time_us":57938,"raft.run_wall_time_us":228762,"replication_time_us":1075666,"spinlock_wait_cycles":25856,"thread_start_us":1263136,"threads_started":5,"wal-append.queue_time_us":805191,"wal-append.run_cpu_time_us":56879,"wal-append.run_wall_time_us":2817623}]]}
I20260709 12:11:55.742161 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:55.666452 19432 raft_consensus.cc:515] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:55.719553 19576 raft_consensus.cc:2749] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341) with higher term. Message: Invalid argument: T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 16. Current term is 17.
I20260709 12:11:55.751242 14338 raft_consensus.cc:2468] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 15.
I20260709 12:11:55.623205 19240 raft_consensus.cc:515] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:55.741381 19655 raft_consensus.cc:515] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:55.755895 19630 leader_election.cc:290] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:55.756415 19338 raft_consensus.cc:515] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:55.737360 19535 raft_consensus.cc:493] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:55.757824 14187 raft_consensus.cc:1275] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:11:55.758172 19456 raft_consensus.cc:493] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:55.731339 19121 raft_consensus.cc:2804] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:11:55.680917 14082 catalog_manager.cc:5697] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:55.755059 14331 raft_consensus.cc:2468] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 16.
I20260709 12:11:55.731190 19041 raft_consensus.cc:2804] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:55.764057 14186 raft_consensus.cc:2468] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 11.
I20260709 12:11:55.731644 19587 raft_consensus.cc:3060] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:55.765082 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:55.766244 14336 raft_consensus.cc:1240] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 16. Current term is 17. Ops: []
W20260709 12:11:55.766252 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 49246.1us
I20260709 12:11:55.792511 14304 leader_election.cc:304] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:55.772835 19597 raft_consensus.cc:2804] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:11:55.737234 19582 raft_consensus.cc:515] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:55.770696 14183 raft_consensus.cc:1240] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 16. Current term is 17. Ops: []
I20260709 12:11:55.757531 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:55.716229 19401 raft_consensus.cc:515] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:55.747104 19469 raft_consensus.cc:493] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:55.775491 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 91881us
I20260709 12:11:55.719265 19429 consensus_queue.cc:1048] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 12:11:55.784618 14188 raft_consensus.cc:1275] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:11:55.822211 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:55.788820 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:55.806907 14334 raft_consensus.cc:2468] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 13.
I20260709 12:11:55.810118 14189 raft_consensus.cc:1275] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:11:55.781390 19535 raft_consensus.cc:3060] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:55.785068 14260 raft_consensus.cc:1275] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 12:11:55.848539 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 53073.4us
I20260709 12:11:55.849799 14155 leader_election.cc:304] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:55.854861 14262 raft_consensus.cc:1275] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 8. (term mismatch)
W20260709 12:11:55.849479 19433 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.014s	sys 0.019s
I20260709 12:11:55.794751 19121 raft_consensus.cc:697] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 17 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:11:55.868461 19121 consensus_queue.cc:237] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:55.870537 19637 leader_election.cc:290] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:55.874235 14261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41764 (request call id 3027) took 1005 ms. Trace:
I20260709 12:11:55.874758 14261 rpcz_store.cc:276] 0709 12:11:54.869223 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:54.931018 (+ 61795us) service_pool.cc:224] Handling call
0709 12:11:55.873939 (+942921us) spinlock_profiling.cc:243] Waited 686 ms on lock 0x7b5400100254. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:11:55.874124 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1578321152}
I20260709 12:11:55.878616 19041 raft_consensus.cc:493] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:55.879225 19041 raft_consensus.cc:3060] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:55.882493 19642 raft_consensus.cc:515] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:55.883340 19240 leader_election.cc:290] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 15 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:55.884136 19240 raft_consensus.cc:493] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:55.890913 19582 leader_election.cc:290] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 19 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:55.891135 19432 leader_election.cc:290] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:55.893102 19401 leader_election.cc:290] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 13 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:55.895605 19622 leader_election.cc:290] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 17 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:55.859910 14155 leader_election.cc:304] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:55.855912 19597 raft_consensus.cc:697] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 16 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:55.899127 19656 raft_consensus.cc:2749] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:55.901657 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:55.902675 14182 raft_consensus.cc:2410] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for term 18 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 8.
I20260709 12:11:55.861307 14181 raft_consensus.cc:2468] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 14.
I20260709 12:11:55.901657 14189 raft_consensus.cc:1275] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:11:55.863025 19576 raft_consensus.cc:2749] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:55.866454 19338 leader_election.cc:290] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:55.862273 19542 consensus_queue.cc:1048] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 12:11:55.884656 19240 raft_consensus.cc:515] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:55.913401 14187 raft_consensus.cc:3060] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:11:55.921082 14229 leader_election.cc:304] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:55.855388 14262 pending_rounds.cc:85] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec: Aborting all ops after (but not including) 7
I20260709 12:11:55.914144 14258 raft_consensus.cc:515] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:55.915866 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:55.922117 14262 pending_rounds.cc:107] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec: Aborting uncommitted NO_OP operation due to leader change: 14.8
I20260709 12:11:55.922587 14262 raft_consensus.cc:2889] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:55.799634 19380 consensus_queue.cc:1059] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.115s
I20260709 12:11:55.899272 19597 consensus_queue.cc:237] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:55.938298 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:55.947170 14184 raft_consensus.cc:3060] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:55.943687 14304 leader_election.cc:304] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:11:55.938753 14258 leader_election.cc:290] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:55.939371 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:55.879093 19655 leader_election.cc:290] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:55.967108 14183 raft_consensus.cc:2468] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 13.
W20260709 12:11:55.912566 19433 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.595s	user 0.015s	sys 0.019s
I20260709 12:11:55.800343 19456 raft_consensus.cc:515] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:55.987974 19456 leader_election.cc:290] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:11:55.973707 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 52749.4us
I20260709 12:11:55.989908 14229 leader_election.cc:304] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:55.848569 19469 raft_consensus.cc:515] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:55.966432 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:55.991984 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:55.992523 19469 leader_election.cc:290] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:55.992790 14262 raft_consensus.cc:2393] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 14: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:11:55.867374 14082 catalog_manager.cc:5697] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:55.993717 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:55.994292 19413 raft_consensus.cc:2749] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:55.995750 14262 raft_consensus.cc:3060] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:55.946131 19637 raft_consensus.cc:2804] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:55.998446 14229 leader_election.cc:304] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:55.983218 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:55.994869 14082 catalog_manager.cc:5697] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 7 to 13, leader changed from 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130) to 73d01e9b1a9d49358da4985b21d681db (127.12.174.132). New cstate: current_term: 13 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:55.993917 14185 raft_consensus.cc:3060] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:56.013190 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:56.030347 14259 raft_consensus.cc:3060] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:55.982380 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:56.024791 14184 raft_consensus.cc:2468] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 13.
I20260709 12:11:56.028352 14187 raft_consensus.cc:2468] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 18.
I20260709 12:11:56.034399 14262 raft_consensus.cc:2468] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 13.
W20260709 12:11:56.038189 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 69805.8us
I20260709 12:11:56.033100 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:56.041294 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:56.044953 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
W20260709 12:11:56.045288 14305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:56.045579 14304 leader_election.cc:304] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:56.045686 14336 raft_consensus.cc:3060] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:55.965267 19388 raft_consensus.cc:2804] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:56.049049 14263 raft_consensus.cc:1275] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:11:56.050293 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:56.051283 14330 raft_consensus.cc:2393] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 13: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:11:56.051635 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:11:56.054661 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 205544us
I20260709 12:11:56.054625 14256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53050 (request call id 994) took 1119 ms. Trace:
I20260709 12:11:55.998600 19637 raft_consensus.cc:493] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:56.107152 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:56.056911 14256 rpcz_store.cc:276] 0709 12:11:54.955203 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:55.274862 (+319659us) service_pool.cc:224] Handling call
0709 12:11:55.292342 (+ 17480us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:55.346096 (+ 53754us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:11:55.636922 (+290826us) log.cc:844] Serialized 14 byte log entry
0709 12:11:56.054233 (+417311us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:56.054296 (+    63us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:11:56.054344 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:56.054423 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:56.054555 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":56655,"prepare.queue_time_us":110282,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":48,"thread_start_us":537348,"threads_started":2}
I20260709 12:11:55.966284 19401 consensus_queue.cc:1048] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.087s
I20260709 12:11:56.037802 19456 raft_consensus.cc:493] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:56.061059 14876 leader_election.cc:304] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
W20260709 12:11:56.125221 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 64272.9us
I20260709 12:11:56.118089 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:56.127763 14876 leader_election.cc:304] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
W20260709 12:11:56.120780 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 372328us
I20260709 12:11:56.129124 14876 leader_election.cc:304] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:56.061452 19432 raft_consensus.cc:493] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:56.134897 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 89410.8us
I20260709 12:11:56.136623 14876 leader_election.cc:304] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:56.137545 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:56.138267 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:56.050490 19388 raft_consensus.cc:493] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:56.060386 19413 raft_consensus.cc:2804] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:56.058734 19625 raft_consensus.cc:2804] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:56.117956 14257 raft_consensus.cc:2468] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 17.
I20260709 12:11:56.139806 14331 raft_consensus.cc:2368] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 12. Current term is 13.
I20260709 12:11:56.140337 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:56.140542 14304 leader_election.cc:304] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:11:56.149439 14335 raft_consensus.cc:2468] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 15.
I20260709 12:11:56.141790 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:56.142555 14265 raft_consensus.cc:2468] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 17.
I20260709 12:11:56.142033 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:56.151144 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:56.144346 14332 raft_consensus.cc:1240] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 12:11:56.117650 19433 raft_consensus.cc:3060] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:11:56.139810 14303 leader_election.cc:304] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:11:56.152017 14337 raft_consensus.cc:2393] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 14: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:11:56.161216 19503 raft_consensus.cc:493] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:56.162127 19503 raft_consensus.cc:515] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:56.165174 19503 leader_election.cc:290] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:56.130084 19430 raft_consensus.cc:2804] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:56.126583 19637 raft_consensus.cc:3060] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:56.061486 19630 consensus_queue.cc:1059] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.079s
I20260709 12:11:56.139153 19460 raft_consensus.cc:2804] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:11:56.196236 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 197915us
I20260709 12:11:56.134122 19530 raft_consensus.cc:2804] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:56.187911 19309 raft_consensus.cc:2804] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:56.142571 19388 raft_consensus.cc:3060] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:56.203528 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:11:56.199827 19402 consensus_meta.cc:287] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.640s	user 0.011s	sys 0.002s
I20260709 12:11:56.202546 19582 raft_consensus.cc:2804] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:56.213312 19530 raft_consensus.cc:493] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:56.199779 19413 raft_consensus.cc:697] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 12 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:11:56.189669 19432 raft_consensus.cc:515] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:56.202400 19303 raft_consensus.cc:2804] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:56.148445 19456 raft_consensus.cc:515] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:11:56.238323 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 183839us
W20260709 12:11:56.256474 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:56.196223 19441 consensus_queue.cc:1048] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 12:11:56.145251 19469 consensus_queue.cc:1048] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.069s
W20260709 12:11:56.214066 19658 consensus_meta.cc:287] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.508s	user 0.011s	sys 0.002s
I20260709 12:11:56.231423 19582 raft_consensus.cc:493] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:56.266635 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 150394us
I20260709 12:11:56.213176 19460 raft_consensus.cc:697] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 11 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:11:56.213474 19642 leader_election.cc:290] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 14 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:56.220307 19576 raft_consensus.cc:493] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:56.222532 19668 raft_consensus.cc:2804] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:56.196816 19641 consensus_queue.cc:1059] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 15.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.029s
W20260709 12:11:56.278113 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 122066us
I20260709 12:11:56.257388 19530 raft_consensus.cc:3060] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:11:56.257625 19607 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.004s	sys 0.020s
I20260709 12:11:56.255285 19309 raft_consensus.cc:697] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 13 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:56.303181 14229 leader_election.cc:304] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:56.255939 19402 raft_consensus.cc:2749] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:56.269946 19303 raft_consensus.cc:493] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:56.278734 19628 consensus_meta.cc:287] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.704s	user 0.010s	sys 0.002s
I20260709 12:11:56.279188 19630 raft_consensus.cc:3055] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:11:56.302325 19582 raft_consensus.cc:3060] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:56.301230 19240 leader_election.cc:290] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:11:56.340652 14156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:56.311335 19668 raft_consensus.cc:493] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
W20260709 12:11:56.322460 19436 consensus_meta.cc:287] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db: Time spent flushing consensus metadata: real 0.736s	user 0.011s	sys 0.001s
W20260709 12:11:56.319096 19607 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.829s	user 0.005s	sys 0.020s
I20260709 12:11:56.348086 14260 raft_consensus.cc:3060] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:56.301188 19658 raft_consensus.cc:515] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:56.329572 19630 raft_consensus.cc:740] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:11:56.322149 19535 raft_consensus.cc:515] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:56.329382 19587 raft_consensus.cc:515] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:56.349502 19668 raft_consensus.cc:3060] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:56.319268 19576 raft_consensus.cc:515] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:56.330408 19303 raft_consensus.cc:3060] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:56.364283 19628 raft_consensus.cc:3055] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 15 LEADER]: Stepping down as leader of term 15
W20260709 12:11:56.373315 19662 log.cc:927] Time spent T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.253s	user 0.001s	sys 0.000s
I20260709 12:11:56.362845 19654 raft_consensus.cc:493] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:56.417838 19641 raft_consensus.cc:493] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:56.418007 19432 leader_election.cc:290] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:56.289254 14082 catalog_manager.cc:5697] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 9 to 14. New cstate: current_term: 14 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:11:56.438056 19673 log.cc:927] Time spent T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.087s	user 0.001s	sys 0.001s
W20260709 12:11:56.441488 19041 consensus_meta.cc:287] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.562s	user 0.010s	sys 0.002s
I20260709 12:11:56.440925 14082 catalog_manager.cc:5697] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 7 to 13. New cstate: current_term: 13 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:56.441962 19041 raft_consensus.cc:515] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:56.407863 19642 raft_consensus.cc:2749] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:11:56.408669 19460 consensus_queue.cc:237] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:11:56.419085 19661 log.cc:927] Time spent T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.266s	user 0.001s	sys 0.000s
W20260709 12:11:56.439743 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 164750us
I20260709 12:11:56.352385 19436 raft_consensus.cc:515] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:56.474920 14259 raft_consensus.cc:2468] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 13.
I20260709 12:11:56.476665 14336 raft_consensus.cc:2468] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 15.
W20260709 12:11:56.477677 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 160233us
I20260709 12:11:56.486239 14185 raft_consensus.cc:2468] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 16.
I20260709 12:11:56.402638 19628 raft_consensus.cc:740] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:11:56.468454 14229 leader_election.cc:304] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
W20260709 12:11:56.484025 19666 log.cc:927] Time spent T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.228s	user 0.000s	sys 0.001s
W20260709 12:11:56.442358 19534 consensus_meta.cc:287] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.710s	user 0.010s	sys 0.001s
I20260709 12:11:56.350174 19681 consensus_queue.cc:1059] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.105s
I20260709 12:11:56.520982 14909 raft_consensus.cc:2393] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 14: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
W20260709 12:11:56.469511 19487 consensus_meta.cc:287] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.773s	user 0.011s	sys 0.000s
I20260709 12:11:56.440169 19691 raft_consensus.cc:493] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
W20260709 12:11:56.445331 19670 log.cc:927] Time spent T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.241s	user 0.001s	sys 0.000s
W20260709 12:11:56.528622 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 60310.1us
I20260709 12:11:56.467422 19535 leader_election.cc:290] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:56.444303 19041 leader_election.cc:290] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:56.465531 19625 raft_consensus.cc:493] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:56.549365 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:11:56.524291 19448 consensus_meta.cc:287] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.835s	user 0.006s	sys 0.006s
I20260709 12:11:56.549286 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:56.387187 19413 consensus_queue.cc:237] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:11:56.586937 19672 log.cc:927] Time spent T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
I20260709 12:11:56.538203 19682 raft_consensus.cc:2749] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:11:56.587989 19661 log.cc:927] Time spent T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:11:56.588317 19691 raft_consensus.cc:515] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:56.589092 19693 consensus_queue.cc:1048] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.187s
I20260709 12:11:56.590366 19430 raft_consensus.cc:493] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:56.591711 14155 leader_election.cc:400] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 election: Vote denied by peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957) with higher term. Message: Invalid argument: T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 12. Current term is 13.
I20260709 12:11:56.449947 19641 raft_consensus.cc:515] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:56.447959 19309 consensus_queue.cc:237] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:56.608465 14229 leader_election.cc:304] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:56.613233 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:56.714939 14265 raft_consensus.cc:3060] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:11:56.633296 14336 raft_consensus.cc:3060] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:11:56.636803 14260 raft_consensus.cc:2468] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 16.
I20260709 12:11:56.659152 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:56.662015 14257 raft_consensus.cc:1240] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 15. Current term is 16. Ops: []
W20260709 12:11:56.665346 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 321630us
I20260709 12:11:56.716522 14259 raft_consensus.cc:3060] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:56.671346 14263 raft_consensus.cc:1275] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:11:56.618001 19625 raft_consensus.cc:3060] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:56.667884 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:56.720667 14262 raft_consensus.cc:2468] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 12.
I20260709 12:11:56.597678 19433 raft_consensus.cc:2749] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:11:56.709532 14155 leader_election.cc:403] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 12:11:56.454943 19630 consensus_queue.cc:260] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:11:56.721930 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 130385us
I20260709 12:11:56.605980 19456 leader_election.cc:290] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:56.617111 19587 leader_election.cc:290] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:56.741907 19682 raft_consensus.cc:2804] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:56.611075 19658 leader_election.cc:290] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:56.487517 19654 raft_consensus.cc:515] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:56.742394 19682 raft_consensus.cc:493] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:56.742789 19682 raft_consensus.cc:3060] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:56.744330 19654 leader_election.cc:290] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:56.718499 14339 raft_consensus.cc:2468] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 11.
I20260709 12:11:56.722661 14155 leader_election.cc:304] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:56.749656 19654 raft_consensus.cc:2804] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:56.750124 19654 raft_consensus.cc:493] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:56.750530 19654 raft_consensus.cc:3060] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:11:56.755332 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 146998us
I20260709 12:11:56.756264 14229 leader_election.cc:304] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:56.758317 19535 raft_consensus.cc:2749] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:11:56.710013 14303 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.042s	sys 0.055s
W20260709 12:11:56.758981 14303 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.567s	user 0.043s	sys 0.055s
W20260709 12:11:56.759593 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 619831us
W20260709 12:11:56.758646 14155 leader_election.cc:336] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Timed out: RequestConsensusVote RPC to 127.12.174.130:36673 timed out after 1.949s (SENT)
I20260709 12:11:56.760895 14155 leader_election.cc:304] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:56.761751 19658 raft_consensus.cc:2749] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:56.443041 14082 catalog_manager.cc:5697] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 11 to 13, leader changed from 65c9c1653b3346b39a0e118540e6080c (127.12.174.131) to 73d01e9b1a9d49358da4985b21d681db (127.12.174.132). New cstate: current_term: 13 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:56.763701 14082 catalog_manager.cc:5697] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 9 to 14, leader changed from 65c9c1653b3346b39a0e118540e6080c (127.12.174.131) to 73d01e9b1a9d49358da4985b21d681db (127.12.174.132). New cstate: current_term: 14 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:56.766381 14909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53194 (request call id 1027) took 1226 ms. Trace:
I20260709 12:11:56.766790 14909 rpcz_store.cc:276] 0709 12:11:55.540458 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:55.541022 (+   564us) service_pool.cc:224] Handling call
0709 12:11:56.766156 (+1225134us) spinlock_profiling.cc:243] Waited 979 ms on lock 0x7b54007e0254. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:11:56.766289 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2250801536}
I20260709 12:11:56.768648 19596 consensus_queue.cc:1048] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:11:56.712453 19430 raft_consensus.cc:3060] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:11:56.776000 14305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:56.711737 19441 raft_consensus.cc:493] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:11:56.780938 14229 leader_election.cc:304] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:56.619164 19576 leader_election.cc:290] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:56.534729 19487 raft_consensus.cc:515] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:56.730615 19692 raft_consensus.cc:2749] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957) with higher term. Message: Invalid argument: T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 12. Current term is 13.
I20260709 12:11:56.798135 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:56.731526 19641 leader_election.cc:290] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:56.735387 14333 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50856 (request call id 2482) took 1465 ms. Trace:
I20260709 12:11:56.736229 14185 raft_consensus.cc:1275] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
W20260709 12:11:56.738193 19676 log.cc:927] Time spent T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.460s	user 0.003s	sys 0.000s
I20260709 12:11:57.311669 19655 raft_consensus.cc:3055] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:57.312227 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:57.312929 14189 raft_consensus.cc:3060] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:56.784765 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
W20260709 12:11:56.831754 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:56.832338 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:11:57.320335 19641 raft_consensus.cc:493] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:57.321198 14903 raft_consensus.cc:1240] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 12:11:57.325222 19630 raft_consensus.cc:3060] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:11:57.312142 19655 raft_consensus.cc:740] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:11:57.328433 19655 consensus_queue.cc:260] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:57.332767 19655 raft_consensus.cc:3060] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:56.907781 19671 raft_consensus.cc:493] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:11:56.902043 19656 raft_consensus.cc:493] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:56.901269 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:57.346879 14181 raft_consensus.cc:2393] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 14: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:11:57.346083 19656 raft_consensus.cc:515] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:11:57.349648 14230 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.174.131:45957 timed out after 1.552s (SENT) [suppressed 19 similar messages]
I20260709 12:11:57.350232 19656 leader_election.cc:290] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:56.906639 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:11:57.167469 19681 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.006s	sys 0.004s
I20260709 12:11:56.765642 14082 catalog_manager.cc:5697] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 9 to 15. New cstate: current_term: 15 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:57.301622 14337 raft_consensus.cc:1240] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 15. Current term is 16. Ops: []
W20260709 12:11:57.351830 19681 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.726s	user 0.006s	sys 0.014s
I20260709 12:11:57.354068 14082 catalog_manager.cc:5697] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 9 to 14. New cstate: current_term: 14 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:57.359995 14082 catalog_manager.cc:5697] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:57.371675 19309 raft_consensus.cc:493] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:57.372491 19309 raft_consensus.cc:515] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:57.375226 19309 leader_election.cc:290] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:57.365196 14183 raft_consensus.cc:1275] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
W20260709 12:11:57.306586 14265 consensus_meta.cc:287] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.591s	user 0.012s	sys 0.002s
I20260709 12:11:56.791602 19582 raft_consensus.cc:515] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:56.788757 19628 consensus_queue.cc:260] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:56.863415 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:57.403371 14331 raft_consensus.cc:2468] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 14.
I20260709 12:11:56.902642 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:57.404932 14184 raft_consensus.cc:2468] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 11.
I20260709 12:11:56.778132 19441 raft_consensus.cc:515] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:56.880229 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:57.406352 14182 raft_consensus.cc:3060] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:56.833118 14333 rpcz_store.cc:276] 0709 12:11:55.270185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:55.404158 (+133973us) service_pool.cc:224] Handling call
0709 12:11:55.407745 (+  3587us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:55.408173 (+   428us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:55.408200 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:55.444977 (+ 36777us) log.cc:844] Serialized 52 byte log entry
0709 12:11:55.819763 (+374786us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:55.858145 (+ 38382us) log.cc:844] Serialized 14 byte log entry
0709 12:11:55.858439 (+   294us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:55.858534 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:56.010324 (+151790us) spinlock_profiling.cc:243] Waited 3.68 ms on lock 0x7b180015e860. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f212cf16ab1 00007f212cf23281 00007f212404e3f3 00007f21240507c1 00007f2124050779 00007f2124050709 00007f21240506d1 00007f212404f9cd 0000000000388634 0000000000388479 00007f212403183a
0709 12:11:56.722851 (+712527us) raft_consensus.cc:1685] finished
0709 12:11:56.735115 (+ 12264us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:56.735289 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33953,"prepare.queue_time_us":38149,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"raft.queue_time_us":3525,"raft.run_cpu_time_us":256,"raft.run_wall_time_us":4900,"spinlock_wait_cycles":8456448,"thread_start_us":350852,"threads_started":1,"wal-append.queue_time_us":595841}
I20260709 12:11:56.901507 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:56.881477 19658 raft_consensus.cc:493] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
W20260709 12:11:57.209847 19689 log.cc:927] Time spent T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.493s	user 0.001s	sys 0.000s
W20260709 12:11:56.906091 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:57.092694 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 311824us
I20260709 12:11:56.907320 19660 raft_consensus.cc:2749] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 13 LEADER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:56.638711 19448 raft_consensus.cc:515] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:57.301919 14332 raft_consensus.cc:1275] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
W20260709 12:11:57.460273 14339 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.682s	user 0.000s	sys 0.036s
W20260709 12:11:57.460758 14339 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.683s	user 0.000s	sys 0.036s
I20260709 12:11:57.310441 14338 raft_consensus.cc:1240] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 15 LEADER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 14. Current term is 15. Ops: [14.8-14.8]
W20260709 12:11:56.739693 19690 log.cc:927] Time spent T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.320s	user 0.001s	sys 0.000s
I20260709 12:11:57.321133 19641 raft_consensus.cc:515] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:57.388784 14265 raft_consensus.cc:2468] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 19.
W20260709 12:11:57.390528 14154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:57.392645 14336 consensus_meta.cc:287] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.669s	user 0.010s	sys 0.007s
I20260709 12:11:57.477550 14336 raft_consensus.cc:2468] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 19.
I20260709 12:11:57.394708 14303 leader_election.cc:304] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:57.411290 14257 raft_consensus.cc:1240] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 16. Current term is 17. Ops: []
I20260709 12:11:57.346127 19671 raft_consensus.cc:515] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:57.423247 14330 raft_consensus.cc:1240] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 17. Current term is 18. Ops: []
W20260709 12:11:57.309546 14259 consensus_meta.cc:287] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.592s	user 0.008s	sys 0.002s
I20260709 12:11:57.466068 14189 raft_consensus.cc:2468] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 13.
I20260709 12:11:57.494702 14259 raft_consensus.cc:2468] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 15.
I20260709 12:11:57.483810 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:57.495805 14333 raft_consensus.cc:2393] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 10: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
W20260709 12:11:57.424341 19530 consensus_meta.cc:287] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db: Time spent flushing consensus metadata: real 1.092s	user 0.010s	sys 0.007s
W20260709 12:11:57.439510 19637 consensus_meta.cc:287] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 1.233s	user 0.018s	sys 0.000s
I20260709 12:11:57.431008 19656 raft_consensus.cc:493] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:57.506336 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:57.392376 14082 catalog_manager.cc:5697] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 6 to 9, leader changed from 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) to 885067a0d31741bfb5c9935788e315bf (127.12.174.129). New cstate: current_term: 9 leader_uuid: "885067a0d31741bfb5c9935788e315bf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:11:57.499085 19701 raft_consensus.cc:493] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:57.504181 19436 leader_election.cc:290] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 14 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:57.442063 19681 raft_consensus.cc:493] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:57.442086 19692 raft_consensus.cc:493] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:57.532951 14182 raft_consensus.cc:2468] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 16.
I20260709 12:11:57.541050 14229 leader_election.cc:304] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:57.541545 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:57.521938 14264 raft_consensus.cc:1240] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:57.549209 14335 raft_consensus.cc:2468] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 17.
W20260709 12:11:57.555965 14334 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.777s	user 0.015s	sys 0.029s
W20260709 12:11:57.558226 14334 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.780s	user 0.015s	sys 0.029s
I20260709 12:11:57.565091 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
W20260709 12:11:57.559083 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 251497us
I20260709 12:11:57.566512 14909 raft_consensus.cc:2468] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 10.
I20260709 12:11:57.449572 19658 raft_consensus.cc:515] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:11:57.541957 19625 consensus_meta.cc:287] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.810s	user 0.008s	sys 0.004s
I20260709 12:11:57.527742 19309 raft_consensus.cc:493] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:57.533704 19503 raft_consensus.cc:493] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:57.603453 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:57.604359 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:57.519253 19691 leader_election.cc:290] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:57.620441 14189 raft_consensus.cc:2468] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 17.
I20260709 12:11:57.621047 14182 raft_consensus.cc:3060] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:11:57.619675 14877 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.709s	user 0.017s	sys 0.033s
W20260709 12:11:57.626982 14877 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.716s	user 0.017s	sys 0.033s
I20260709 12:11:57.623327 14154 leader_election.cc:304] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
W20260709 12:11:57.586396 19703 log.cc:927] Time spent T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.788s	user 0.003s	sys 0.000s
W20260709 12:11:57.625865 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 276242us
I20260709 12:11:57.627758 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:57.573529 19460 raft_consensus.cc:493] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:57.527652 19637 raft_consensus.cc:515] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:57.645268 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:57.575134 19515 raft_consensus.cc:493] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:57.645663 14877 leader_election.cc:304] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:11:57.650113 14304 leader_election.cc:304] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:11:57.654428 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:57.517802 19530 raft_consensus.cc:515] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:57.656828 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:57.657279 14877 leader_election.cc:304] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:11:57.657445 14262 raft_consensus.cc:2468] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 14.
I20260709 12:11:57.663319 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:57.664373 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:57.662709 14181 raft_consensus.cc:2468] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 13.
I20260709 12:11:57.669446 14331 raft_consensus.cc:1240] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 17. Current term is 18. Ops: []
I20260709 12:11:57.540745 19656 raft_consensus.cc:515] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:57.672995 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:57.633225 19441 leader_election.cc:290] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:57.675980 14335 raft_consensus.cc:2393] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 14: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:11:57.690795 14182 raft_consensus.cc:2468] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 17.
I20260709 12:11:57.527000 19701 raft_consensus.cc:515] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:57.650995 19487 leader_election.cc:290] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:57.656126 19630 raft_consensus.cc:2749] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:57.629081 19655 consensus_queue.cc:1059] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.045s
I20260709 12:11:57.668735 19515 raft_consensus.cc:515] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:57.721611 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:57.722414 19705 raft_consensus.cc:2804] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:57.669147 19697 raft_consensus.cc:2804] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:57.572165 19681 raft_consensus.cc:515] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:57.586493 19692 raft_consensus.cc:515] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:57.626438 19625 raft_consensus.cc:515] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:57.629380 19309 raft_consensus.cc:515] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:57.722721 19687 raft_consensus.cc:2804] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Leader election won for term 19
W20260709 12:11:57.697751 19682 consensus_meta.cc:287] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.954s	user 0.006s	sys 0.007s
I20260709 12:11:57.729997 19224 consensus_queue.cc:1059] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:11:57.650638 19503 raft_consensus.cc:515] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:57.785173 14256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53050 (request call id 1017) took 1153 ms. Trace:
I20260709 12:11:57.524104 14082 catalog_manager.cc:5697] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 12 to 18. New cstate: current_term: 18 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:57.700883 19441 raft_consensus.cc:493] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:11:57.702224 14333 raft_consensus.cc:1275] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:11:57.658702 19460 raft_consensus.cc:515] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:57.720361 14909 raft_consensus.cc:1240] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 12:11:57.796890 14331 raft_consensus.cc:2410] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for term 13 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
W20260709 12:11:57.800102 19707 log.cc:927] Time spent T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 12:11:57.799998 19674 consensus_queue.cc:1048] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 12:11:57.797413 19668 consensus_meta.cc:287] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 1.388s	user 0.014s	sys 0.006s
W20260709 12:11:57.795274 19388 consensus_meta.cc:287] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 1.513s	user 0.007s	sys 0.013s
I20260709 12:11:57.800629 19702 raft_consensus.cc:2749] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:11:57.801275 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 151239us
I20260709 12:11:57.809664 14262 raft_consensus.cc:2468] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 14.
W20260709 12:11:57.795691 19303 consensus_meta.cc:287] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db: Time spent flushing consensus metadata: real 1.363s	user 0.019s	sys 0.000s
I20260709 12:11:57.812830 14256 rpcz_store.cc:276] 0709 12:11:56.631438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:56.631586 (+   148us) service_pool.cc:224] Handling call
0709 12:11:56.710911 (+ 79325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:56.711151 (+   240us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:11:56.782663 (+ 71512us) log.cc:844] Serialized 14 byte log entry
0709 12:11:57.524340 (+741677us) spinlock_profiling.cc:243] Waited 5.2 ms on lock 0x7b18004861c0. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f212cf16ab1 00007f212cf23281 00007f2124030e07 00007f212ce8b9a9 00007f212404d69b 00007f212404b93f 00007f212404dc02 00007f2126cd520b 00007f2126cdad23 00007f2126cdb23a 00007f2127145a2a
0709 12:11:57.784770 (+260430us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:57.784831 (+    61us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:11:57.784891 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:57.784961 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:57.785106 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":71268,"prepare.run_cpu_time_us":10870,"prepare.run_wall_time_us":589899,"raft.queue_time_us":27719,"spinlock_wait_cycles":11957504,"thread_start_us":260160,"threads_started":1,"wal-append.queue_time_us":1002093}
W20260709 12:11:57.823740 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:57.810847 19697 raft_consensus.cc:493] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:57.823042 19687 raft_consensus.cc:697] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 19 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
W20260709 12:11:57.836263 19430 consensus_meta.cc:287] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 1.064s	user 0.009s	sys 0.003s
I20260709 12:11:57.816876 19448 leader_election.cc:290] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 14 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:57.836719 19430 raft_consensus.cc:515] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:57.838625 19715 raft_consensus.cc:493] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:57.809795 19705 raft_consensus.cc:697] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 10 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:11:57.831955 14304 leader_election.cc:304] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
W20260709 12:11:57.849184 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:57.857285 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:57.818710 19487 raft_consensus.cc:493] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:57.913576 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 518941us
I20260709 12:11:57.842500 19697 raft_consensus.cc:3060] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:57.926105 14305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:57.815785 19682 raft_consensus.cc:515] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:57.845633 19582 leader_election.cc:290] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 16 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:57.852180 19224 raft_consensus.cc:3055] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:11:57.823127 19441 raft_consensus.cc:515] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:57.856262 19655 raft_consensus.cc:493] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:57.834071 19388 raft_consensus.cc:515] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:57.843186 19303 raft_consensus.cc:515] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:57.829964 19668 raft_consensus.cc:515] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:11:57.984776 14263 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.509s	user 0.001s	sys 0.036s
I20260709 12:11:57.962651 19658 leader_election.cc:290] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:57.951268 19487 raft_consensus.cc:515] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:57.847111 14304 leader_election.cc:304] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
W20260709 12:11:58.039338 14155 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.623s	user 0.002s	sys 0.034s
I20260709 12:11:57.965989 19720 raft_consensus.cc:2804] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:11:57.973392 19637 leader_election.cc:290] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:58.084326 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:57.982803 19671 leader_election.cc:290] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:57.981333 19717 raft_consensus.cc:493] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:11:58.044514 19656 leader_election.cc:290] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:58.228605 19625 leader_election.cc:290] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 14 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:11:58.190841 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 691192us
W20260709 12:11:58.230144 14155 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.814s	user 0.002s	sys 0.034s
I20260709 12:11:58.230886 14257 raft_consensus.cc:1240] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 12:11:58.231877 14256 raft_consensus.cc:3060] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Advancing to term 14
W20260709 12:11:58.228797 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:58.135560 19630 raft_consensus.cc:493] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:58.284065 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:58.284194 19630 raft_consensus.cc:515] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:58.146377 19702 raft_consensus.cc:2804] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:11:58.285540 19702 raft_consensus.cc:493] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:58.285800 19709 log.cc:927] Time spent T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.327s	user 0.001s	sys 0.001s
I20260709 12:11:58.286090 19702 raft_consensus.cc:3060] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:11:58.272472 14330 raft_consensus.cc:1240] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:58.087459 19224 raft_consensus.cc:740] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:11:58.276949 14259 raft_consensus.cc:1240] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 15. Current term is 16. Ops: []
W20260709 12:11:58.294507 14877 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.026s	sys 0.032s
W20260709 12:11:58.312424 14877 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.590s	user 0.026s	sys 0.032s
I20260709 12:11:58.314018 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:11:58.313038 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 591070us
I20260709 12:11:58.231473 19720 raft_consensus.cc:493] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:58.318763 14877 leader_election.cc:304] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:58.231281 19737 raft_consensus.cc:493] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:58.326586 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:58.285514 19669 log.cc:927] Time spent T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 2.003s	user 0.013s	sys 0.000s
W20260709 12:11:58.317600 14258 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.027s	sys 0.061s
I20260709 12:11:58.252568 19701 leader_election.cc:290] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:11:58.330929 14258 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.534s	user 0.027s	sys 0.061s
I20260709 12:11:58.253499 19641 leader_election.cc:290] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:58.147027 19655 raft_consensus.cc:515] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:58.335647 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:58.338466 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:58.338935 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:11:58.312027 19654 consensus_meta.cc:287] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 1.561s	user 0.014s	sys 0.001s
I20260709 12:11:58.276814 19515 leader_election.cc:290] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:58.273386 19430 leader_election.cc:290] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:58.338653 14333 raft_consensus.cc:2468] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 17.
I20260709 12:11:58.343994 14334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50858 (request call id 2110) took 1566 ms. Trace:
I20260709 12:11:58.344408 14334 rpcz_store.cc:276] 0709 12:11:56.777662 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:56.777820 (+   158us) service_pool.cc:224] Handling call
0709 12:11:56.778159 (+   339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:56.778380 (+   221us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:11:57.571978 (+793598us) log.cc:844] Serialized 14 byte log entry
0709 12:11:58.343599 (+771621us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:58.343689 (+    90us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:58.343746 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:58.343822 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:58.343937 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":941459,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"thread_start_us":1549074,"threads_started":3,"wal-append.queue_time_us":657988}
I20260709 12:11:58.345764 14186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 2987) took 1554 ms. Trace:
I20260709 12:11:58.347203 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:58.347980 14335 raft_consensus.cc:2468] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 18.
W20260709 12:11:58.347990 14339 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.879s	user 0.000s	sys 0.026s
W20260709 12:11:58.348659 14339 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.887s	user 0.000s	sys 0.028s
I20260709 12:11:58.349583 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:58.350278 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:57.839226 19715 raft_consensus.cc:515] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:58.353286 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:58.355824 14258 raft_consensus.cc:2393] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db in current term 11: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
W20260709 12:11:58.355717 14302 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.638s	user 0.012s	sys 0.011s
W20260709 12:11:58.356803 14302 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.683s	user 0.012s	sys 0.011s
I20260709 12:11:58.330780 19309 leader_election.cc:290] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:58.326042 19720 raft_consensus.cc:3060] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:11:57.836040 19687 consensus_queue.cc:237] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:11:58.361948 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 514969us
I20260709 12:11:57.990098 14082 catalog_manager.cc:5697] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 4 to 9. New cstate: current_term: 9 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:58.341120 19692 leader_election.cc:290] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:58.365038 14259 raft_consensus.cc:1240] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:58.339094 19681 leader_election.cc:290] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:58.044190 19705 consensus_queue.cc:237] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:58.366133 14258 raft_consensus.cc:1240] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:58.346374 14186 rpcz_store.cc:276] 0709 12:11:56.791297 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:56.793479 (+  2182us) service_pool.cc:224] Handling call
0709 12:11:57.303034 (+509555us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:57.303339 (+   305us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:11:57.853877 (+550538us) log.cc:844] Serialized 14 byte log entry
0709 12:11:58.343574 (+489697us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:58.343931 (+   357us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:58.344193 (+   262us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:58.344681 (+   488us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:58.345360 (+   679us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":90271,"prepare.queue_time_us":181439,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":18307,"raft.queue_time_us":572,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":7372,"thread_start_us":863988,"threads_started":2}
W20260709 12:11:58.370194 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 310146us
W20260709 12:11:58.374254 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:58.390313 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:58.390013 14304 leader_election.cc:304] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:11:58.394943 14336 raft_consensus.cc:2393] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db in current term 14: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:11:58.395110 19750 raft_consensus.cc:493] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:58.395757 19750 raft_consensus.cc:515] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:58.354285 19515 raft_consensus.cc:2804] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:58.397102 19515 raft_consensus.cc:697] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 15 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:11:58.351877 19503 leader_election.cc:290] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:58.398094 19750 leader_election.cc:290] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:58.399143 19741 raft_consensus.cc:2804] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:58.399717 19741 raft_consensus.cc:697] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 13 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:58.398664 19750 consensus_queue.cc:1048] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 12:11:58.400768 19741 consensus_queue.cc:237] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:58.392974 14259 raft_consensus.cc:1240] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 15. Current term is 16. Ops: []
I20260709 12:11:58.403020 19750 raft_consensus.cc:2804] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:11:58.408444 19224 consensus_queue.cc:260] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:58.409606 19224 raft_consensus.cc:3060] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:58.413547 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:58.347507 19654 raft_consensus.cc:515] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:58.361809 19303 leader_election.cc:290] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 14 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:58.324393 19717 raft_consensus.cc:515] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:58.333546 19737 raft_consensus.cc:515] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:58.406582 19750 raft_consensus.cc:697] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 16 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:58.359776 19733 consensus_queue.cc:1048] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.068s
I20260709 12:11:58.393582 19637 consensus_queue.cc:1048] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 12:11:58.416492 19698 raft_consensus.cc:493] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:11:58.437546 14263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41764 (request call id 3057) took 1027 ms. Trace:
I20260709 12:11:58.438625 14336 raft_consensus.cc:1275] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:11:58.442242 14229 leader_election.cc:304] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:58.439054 14263 rpcz_store.cc:276] 0709 12:11:57.410019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:57.410194 (+   175us) service_pool.cc:224] Handling call
0709 12:11:57.454739 (+ 44545us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:58.228204 (+773465us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:58.228235 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:58.228854 (+   619us) log.cc:844] Serialized 26 byte log entry
0709 12:11:58.371248 (+142394us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:58.371291 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:58.371374 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:58.437306 (+ 65932us) raft_consensus.cc:1685] finished
0709 12:11:58.437325 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:58.437479 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":88986,"spinlock_wait_cycles":43027712,"thread_start_us":812929,"threads_started":2,"wal-append.queue_time_us":199935}
I20260709 12:11:58.530813 19714 consensus_queue.cc:1059] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.142s
I20260709 12:11:58.398119 19515 consensus_queue.cc:237] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:58.532137 19714 raft_consensus.cc:3055] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:11:58.560813 14257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41764 (request call id 3062) took 1051 ms. Trace:
I20260709 12:11:58.443048 19692 raft_consensus.cc:493] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:58.441977 19388 leader_election.cc:290] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:58.468791 19441 leader_election.cc:290] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:58.430127 19303 consensus_queue.cc:1048] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.104s
W20260709 12:11:58.565011 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 138104us
I20260709 12:11:58.568235 14190 raft_consensus.cc:1275] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:11:58.432145 19309 consensus_queue.cc:1048] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.130s
I20260709 12:11:58.562065 14257 rpcz_store.cc:276] 0709 12:11:57.510339 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:57.510639 (+   300us) service_pool.cc:224] Handling call
0709 12:11:57.511031 (+   392us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:58.290772 (+779741us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:58.549568 (+258796us) spinlock_profiling.cc:243] Waited 681 ms on lock 0x7b54002c0954. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:11:58.560731 (+ 11163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1565354880}
I20260709 12:11:58.553536 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:58.580298 14330 raft_consensus.cc:3060] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:58.570670 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:58.581526 14335 raft_consensus.cc:2393] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db in current term 14: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:11:58.467644 19503 raft_consensus.cc:493] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:58.431277 19430 consensus_queue.cc:1059] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 16.7, Next index: 8, Last known committed idx: 4, Time since last communication: 0.117s
I20260709 12:11:58.579469 14304 leader_election.cc:304] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:11:58.443503 19727 raft_consensus.cc:493] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:58.582015 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:58.615126 14181 raft_consensus.cc:3060] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:58.582194 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:11:58.568562 19736 log.cc:927] Time spent T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.149s	user 0.001s	sys 0.000s
I20260709 12:11:58.582911 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:58.550012 19630 leader_election.cc:290] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:58.592595 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:58.616146 14189 raft_consensus.cc:2468] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 11.
I20260709 12:11:58.561028 19713 consensus_queue.cc:1059] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.169s
I20260709 12:11:58.617789 14186 raft_consensus.cc:3060] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:58.564702 19668 leader_election.cc:290] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:58.561960 19714 raft_consensus.cc:740] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:11:58.643661 19714 consensus_queue.cc:260] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:58.471298 19698 raft_consensus.cc:515] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:58.572702 19637 raft_consensus.cc:2749] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:11:58.572929 19682 leader_election.cc:290] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 14 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:58.631042 19655 leader_election.cc:290] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:58.617725 19503 raft_consensus.cc:515] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:58.581025 19441 raft_consensus.cc:493] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:58.662648 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 252133us
I20260709 12:11:58.663218 14256 raft_consensus.cc:2468] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 14.
W20260709 12:11:58.654369 19734 log.cc:927] Time spent T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.228s	user 0.000s	sys 0.001s
I20260709 12:11:58.592660 19721 raft_consensus.cc:493] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:58.665081 14186 raft_consensus.cc:2468] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 15.
I20260709 12:11:58.663606 14330 raft_consensus.cc:2468] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 16.
I20260709 12:11:58.691313 14256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53050 (request call id 1020) took 1012 ms. Trace:
I20260709 12:11:58.614498 19413 raft_consensus.cc:493] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:58.592832 19681 raft_consensus.cc:493] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:58.716315 14335 raft_consensus.cc:1275] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:11:58.716851 14256 rpcz_store.cc:276] 0709 12:11:57.678447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:57.852760 (+174313us) service_pool.cc:224] Handling call
0709 12:11:58.691252 (+838492us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:11:58.660730 19719 log.cc:927] Time spent T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.383s	user 0.000s	sys 0.001s
I20260709 12:11:58.693141 14339 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50858 (request call id 2108) took 1916 ms. Trace:
I20260709 12:11:58.718263 14330 raft_consensus.cc:1240] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 15. Current term is 16. Ops: []
I20260709 12:11:58.573127 19692 raft_consensus.cc:515] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:58.646006 19752 raft_consensus.cc:2804] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:11:58.720150 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 304426us
W20260709 12:11:58.720559 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 278534us
I20260709 12:11:58.632267 19749 consensus_queue.cc:1048] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.123s
W20260709 12:11:58.721817 19736 log.cc:927] Time spent T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 12:11:58.732031 14877 leader_election.cc:304] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:58.729036 19737 leader_election.cc:290] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:58.696084 19441 raft_consensus.cc:515] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:58.727399 19654 leader_election.cc:290] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 15 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:58.721987 14339 rpcz_store.cc:276] 0709 12:11:56.777005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:56.777184 (+   179us) service_pool.cc:224] Handling call
0709 12:11:56.777579 (+   395us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:56.777834 (+   255us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:11:57.461120 (+683286us) log.cc:844] Serialized 14 byte log entry
0709 12:11:58.663753 (+1202633us) log.cc:844] Serialized 14 byte log entry
0709 12:11:58.692781 (+ 29028us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:58.692842 (+    61us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:11:58.692892 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:58.692970 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:58.693083 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33086,"prepare.queue_time_us":868202,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":10333,"raft.queue_time_us":52983,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":108,"thread_start_us":1880260,"threads_started":4,"wal-append.queue_time_us":939268}
I20260709 12:11:58.730726 19715 leader_election.cc:290] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:11:58.729959 14878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:58.728673 19697 consensus_meta.cc:287] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db: Time spent flushing consensus metadata: real 0.591s	user 0.010s	sys 0.000s
W20260709 12:11:58.728754 19696 log.cc:927] Time spent T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 2.088s	user 0.000s	sys 0.025s
I20260709 12:11:58.733482 19717 leader_election.cc:290] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:58.720820 19713 raft_consensus.cc:3055] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:58.744436 19713 raft_consensus.cc:740] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:11:58.745437 19713 consensus_queue.cc:260] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:58.746701 19713 raft_consensus.cc:3060] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:58.726461 19752 raft_consensus.cc:493] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:58.661118 19742 consensus_queue.cc:1059] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.310s
W20260709 12:11:58.741575 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:58.742949 14877 leader_election.cc:304] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:11:58.688905 19727 raft_consensus.cc:515] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:58.754143 19430 consensus_queue.cc:1048] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:58.721891 19681 raft_consensus.cc:515] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:58.762794 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:58.765305 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:58.766139 19681 leader_election.cc:290] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:58.766719 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:58.767539 14186 raft_consensus.cc:2393] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 17: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:11:58.660912 19746 consensus_queue.cc:1059] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 16.7, Next index: 8, Last known committed idx: 4, Time since last communication: 0.101s
I20260709 12:11:58.770756 14186 raft_consensus.cc:1240] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:58.757575 14337 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50858 (request call id 2107) took 2565 ms. Trace:
I20260709 12:11:58.772512 14337 rpcz_store.cc:276] 0709 12:11:56.192143 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:56.195704 (+  3561us) service_pool.cc:224] Handling call
0709 12:11:56.209476 (+ 13772us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:57.352130 (+1142654us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:58.757261 (+1405131us) spinlock_profiling.cc:243] Waited 741 ms on lock 0x7b5400146254. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:11:58.757488 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1704124160}
I20260709 12:11:58.760603 19503 leader_election.cc:290] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:58.720158 19413 raft_consensus.cc:515] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:58.762042 14911 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59144 (request call id 591) took 2341 ms. Trace:
I20260709 12:11:58.751034 19752 raft_consensus.cc:3060] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:58.744266 19753 consensus_queue.cc:1048] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 12:11:58.763266 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:58.760726 19388 raft_consensus.cc:3055] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:11:58.767911 19441 leader_election.cc:290] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:58.747594 19715 raft_consensus.cc:3060] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:58.766146 14189 raft_consensus.cc:2410] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for term 15 because replica has last-logged OpId of term: 14 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 6.
I20260709 12:11:58.722649 19721 raft_consensus.cc:515] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:11:58.788534 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 45661.4us
I20260709 12:11:58.664718 19750 consensus_queue.cc:237] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:58.803793 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:11:58.809875 14156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:58.812623 14261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41764 (request call id 3050) took 2835 ms. Trace:
W20260709 12:11:58.815845 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:58.818295 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:58.822168 14903 raft_consensus.cc:2368] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 15. Current term is 16.
I20260709 12:11:58.822494 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:11:58.826145 14877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:58.826422 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:58.827747 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:58.774797 14911 rpcz_store.cc:276] 0709 12:11:56.420939 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:56.430978 (+ 10039us) service_pool.cc:224] Handling call
0709 12:11:56.741858 (+310880us) spinlock_profiling.cc:243] Waited 1.97 ms on lock 0x7b5800096698. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2124016b71 00007f2124016a22 00007f212cf2f8d9 00007f212c089ee0 00007f212c1530ab 00007f212c153131 00007f212c114fc0 00007f212c0ff929 00007f212c0ff3d2 00007f2125676bd4
0709 12:11:56.742122 (+   264us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:57.302114 (+559992us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:11:57.624335 (+322221us) log.cc:844] Serialized 14 byte log entry
0709 12:11:57.985372 (+361037us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:58.079909 (+ 94537us) log.cc:844] Serialized 26 byte log entry
0709 12:11:58.080101 (+   192us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:11:58.080138 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:58.080233 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:58.761582 (+681349us) raft_consensus.cc:1685] finished
0709 12:11:58.761705 (+   123us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:58.761857 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":48825,"prepare.queue_time_us":521182,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":4109,"raft.queue_time_us":166292,"raft.run_cpu_time_us":291,"raft.run_wall_time_us":55010,"spinlock_wait_cycles":4531968,"thread_start_us":663928,"threads_started":2,"wal-append.queue_time_us":714953}
I20260709 12:11:58.828508 14333 raft_consensus.cc:2468] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 11.
I20260709 12:11:58.830916 14186 raft_consensus.cc:1240] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 16. Current term is 17. Ops: []
I20260709 12:11:58.747984 19697 raft_consensus.cc:515] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:58.834623 14907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:58.835431 14190 raft_consensus.cc:1275] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:11:58.836165 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:58.819909 19678 raft_consensus.cc:2804] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:11:58.816314 14261 rpcz_store.cc:276] 0709 12:11:55.957917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:56.006337 (+ 48420us) service_pool.cc:224] Handling call
0709 12:11:56.031731 (+ 25394us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:56.236191 (+204460us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:56.236238 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:56.270560 (+ 34322us) log.cc:844] Serialized 26 byte log entry
0709 12:11:56.486375 (+215815us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:56.486419 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:56.486500 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:58.691500 (+2205000us) spinlock_profiling.cc:243] Waited 20 ms on lock 0x7b4400022b4c. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2123f74c85 00007f2123f756a2 00007f2126ce71db 00007f2126ce2aaf 00007f2126cd686e 00007f2126cd5bb6 00007f2126cd57d8 00007f2126cdf221 00007f2126cdf1d9 00007f2126cdf169
0709 12:11:58.772319 (+ 80819us) raft_consensus.cc:1685] finished
0709 12:11:58.772339 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:58.793575 (+ 21236us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1614,"raft.queue_time_us":81935,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":10156,"spinlock_wait_cycles":46075776,"thread_start_us":334750,"threads_started":2,"wal-append.queue_time_us":207054}
I20260709 12:11:58.809334 19388 raft_consensus.cc:740] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:58.839494 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:58.840708 14189 raft_consensus.cc:2468] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 13.
I20260709 12:11:58.840840 14877 leader_election.cc:304] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:58.839461 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:58.840559 14263 raft_consensus.cc:2468] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 12.
I20260709 12:11:58.845841 14337 raft_consensus.cc:2468] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 15.
W20260709 12:11:58.845929 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 196024us
I20260709 12:11:58.847774 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: true dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:11:58.849900 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:58.851003 14187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 2989) took 2059 ms. Trace:
I20260709 12:11:58.853639 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:58.854288 14186 raft_consensus.cc:2468] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 15.
I20260709 12:11:58.854511 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:58.851405 14187 rpcz_store.cc:276] 0709 12:11:56.791915 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:56.829627 (+ 37712us) service_pool.cc:224] Handling call
0709 12:11:57.306952 (+477325us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:57.307469 (+   517us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:57.307503 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:57.376337 (+ 68834us) log.cc:844] Serialized 26 byte log entry
0709 12:11:57.814909 (+438572us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:57.814964 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:57.815237 (+   273us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:58.850790 (+1035553us) raft_consensus.cc:1685] finished
0709 12:11:58.850812 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:58.850941 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":72492,"raft.run_cpu_time_us":318,"raft.run_wall_time_us":48845,"thread_start_us":420921,"threads_started":1,"wal-append.queue_time_us":612467}
I20260709 12:11:58.853513 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:58.856269 14258 raft_consensus.cc:3060] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:58.857434 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:58.857714 14189 raft_consensus.cc:2393] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 14: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:11:58.858134 14333 raft_consensus.cc:2468] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 11.
I20260709 12:11:58.859115 14259 raft_consensus.cc:1275] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:11:58.861851 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:58.862876 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:58.863739 14187 raft_consensus.cc:2410] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for term 16 because replica has last-logged OpId of term: 15 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 12:11:58.865705 14190 raft_consensus.cc:2393] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 11: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
I20260709 12:11:58.865621 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:58.867179 14187 raft_consensus.cc:2468] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 12.
I20260709 12:11:58.868526 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:58.846370 19121 raft_consensus.cc:2804] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:58.827180 19240 consensus_queue.cc:1048] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 12:11:58.873404 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:58.874097 14265 raft_consensus.cc:2468] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 12.
I20260709 12:11:58.832351 19742 consensus_queue.cc:1059] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.025s
I20260709 12:11:58.874424 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:58.878209 19681 consensus_queue.cc:1059] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:11:58.879019 19681 raft_consensus.cc:3055] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:58.879338 19681 raft_consensus.cc:740] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:11:58.880124 19681 consensus_queue.cc:260] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:58.880772 19697 leader_election.cc:290] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 13 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:58.883127 19681 raft_consensus.cc:3060] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:58.883448 19721 leader_election.cc:290] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:58.884886 19742 raft_consensus.cc:3055] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:11:58.885320 19742 raft_consensus.cc:740] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:11:58.859652 19746 consensus_queue.cc:1059] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 12:11:58.886345 14905 raft_consensus.cc:1240] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:58.887656 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:58.890861 19720 raft_consensus.cc:515] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:58.886240 19742 consensus_queue.cc:260] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:11:58.877669 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 312411us
I20260709 12:11:58.896865 14908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:58.897560 14908 raft_consensus.cc:2468] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 12.
W20260709 12:11:58.898794 19702 consensus_meta.cc:287] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.573s	user 0.008s	sys 0.001s
I20260709 12:11:58.899155 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:11:58.899250 19702 raft_consensus.cc:515] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:58.900027 19746 raft_consensus.cc:3055] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:58.900408 19746 raft_consensus.cc:740] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:58.901386 19746 consensus_queue.cc:260] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:58.900501 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:11:58.902663 19746 raft_consensus.cc:3060] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:58.901522 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:11:58.904220 19699 consensus_queue.cc:1048] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:58.903456 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:11:58.906024 14876 leader_election.cc:304] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:11:58.847460 19678 raft_consensus.cc:697] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 16 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
W20260709 12:11:58.897116 14878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:58.909971 14876 leader_election.cc:304] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:58.915310 14906 raft_consensus.cc:2468] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 16.
I20260709 12:11:58.893348 19742 raft_consensus.cc:3060] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:58.918717 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:58.920903 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:58.921132 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:58.921440 14265 raft_consensus.cc:2393] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 14: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
I20260709 12:11:58.921572 14187 raft_consensus.cc:2468] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 12.
I20260709 12:11:58.923316 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:58.923928 14187 raft_consensus.cc:3060] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:11:58.921823 14190 raft_consensus.cc:2468] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 13.
I20260709 12:11:58.924772 14258 raft_consensus.cc:2468] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 16.
I20260709 12:11:58.926832 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:58.926870 14907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:58.927640 14186 raft_consensus.cc:2393] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 13: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:11:58.929685 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:58.909286 19720 leader_election.cc:290] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:58.933264 14907 raft_consensus.cc:2393] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 13: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
I20260709 12:11:58.925634 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:11:58.934530 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:58.918387 19699 raft_consensus.cc:2804] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:58.917083 19121 raft_consensus.cc:697] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 14 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:11:58.937306 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:58.937551 14265 raft_consensus.cc:1275] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:11:58.923358 19697 raft_consensus.cc:2804] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Leader election won for term 15
W20260709 12:11:58.941900 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 243616us
I20260709 12:11:58.939234 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:58.944476 14258 raft_consensus.cc:2468] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 18.
I20260709 12:11:58.934356 19702 leader_election.cc:290] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:58.945884 19697 raft_consensus.cc:697] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 15 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:11:58.946897 19697 consensus_queue.cc:237] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:58.948902 19727 leader_election.cc:290] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:58.950006 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: true dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:58.950575 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:58.951164 14258 raft_consensus.cc:3060] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:11:58.944994 14303 leader_election.cc:304] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:11:58.931793 14876 leader_election.cc:304] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:58.941643 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:58.950596 14189 raft_consensus.cc:3060] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:58.956471 14187 raft_consensus.cc:2468] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 15.
I20260709 12:11:58.961608 14181 raft_consensus.cc:2468] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 14.
I20260709 12:11:58.978829 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:58.979605 14258 raft_consensus.cc:2468] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 18.
I20260709 12:11:58.979931 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:58.983074 14183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 2991) took 2190 ms. Trace:
W20260709 12:11:58.983989 19706 log.cc:927] Time spent T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 1.351s	user 0.002s	sys 0.009s
I20260709 12:11:58.983503 14183 rpcz_store.cc:276] 0709 12:11:56.792530 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:56.792690 (+   160us) service_pool.cc:224] Handling call
0709 12:11:57.308332 (+515642us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:57.377215 (+ 68883us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:58.982808 (+1605593us) spinlock_profiling.cc:243] Waited 56.4 ms on lock 0x7b54003b2754. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:11:58.982987 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":129685760}
I20260709 12:11:58.977329 19681 raft_consensus.cc:493] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:58.984851 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:58.985553 14183 raft_consensus.cc:2468] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 12.
I20260709 12:11:58.986428 19717 raft_consensus.cc:3055] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:58.986474 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:58.987552 14183 raft_consensus.cc:2393] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 17: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:11:58.990027 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:58.990783 14187 raft_consensus.cc:2393] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 14: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:11:58.936278 19699 raft_consensus.cc:493] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:11:59.038033 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:59.045596 14187 raft_consensus.cc:2410] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
W20260709 12:11:59.046787 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 101847us
I20260709 12:11:59.048446 14303 leader_election.cc:304] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:58.986941 19717 raft_consensus.cc:740] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:11:59.003312 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:59.057834 14265 raft_consensus.cc:2368] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 14. Current term is 15.
I20260709 12:11:59.072263 14303 leader_election.cc:304] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:59.077704 14261 raft_consensus.cc:2468] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 14.
I20260709 12:11:59.088760 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
W20260709 12:11:59.113006 14154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:58.984823 19681 raft_consensus.cc:515] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:59.036516 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:59.145501 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
W20260709 12:11:59.147316 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 215611us
I20260709 12:11:59.035138 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:58.943982 19712 raft_consensus.cc:493] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
W20260709 12:11:59.147943 14876 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:58.918862 19388 consensus_queue.cc:260] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.7, Last appended by leader: 7, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:59.149154 14258 raft_consensus.cc:2368] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 14. Current term is 15.
W20260709 12:11:59.150056 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 77916.4us
I20260709 12:11:59.155027 14303 leader_election.cc:304] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:11:59.150352 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:59.151154 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:59.156394 14265 raft_consensus.cc:2393] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 16: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:11:58.943475 19692 leader_election.cc:290] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:59.159765 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:59.160403 14265 raft_consensus.cc:2468] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 12.
I20260709 12:11:59.161176 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:59.161842 14265 raft_consensus.cc:2393] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 15: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:11:59.162441 14303 leader_election.cc:304] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:59.146019 19699 raft_consensus.cc:3060] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:59.168449 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:59.170856 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:59.172188 14261 raft_consensus.cc:3060] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:59.170612 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:59.173715 14181 raft_consensus.cc:2410] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for term 16 because replica has last-logged OpId of term: 14 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:11:59.174086 14265 raft_consensus.cc:2393] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 14: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:11:59.168495 19121 consensus_queue.cc:237] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:59.177086 14907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:59.177115 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:59.153329 19759 raft_consensus.cc:2804] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader election won for term 18
W20260709 12:11:59.171655 19760 log.cc:927] Time spent T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.216s	user 0.000s	sys 0.000s
I20260709 12:11:59.178283 14189 raft_consensus.cc:2468] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 16.
I20260709 12:11:59.185271 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:59.194088 14261 raft_consensus.cc:2468] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 13.
I20260709 12:11:59.195263 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:59.186309 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:59.196367 14258 raft_consensus.cc:3060] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:11:59.166751 19763 raft_consensus.cc:2749] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:59.202941 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:59.174636 19413 leader_election.cc:290] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:59.206177 14911 raft_consensus.cc:2393] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 14: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
I20260709 12:11:59.169101 19764 raft_consensus.cc:2804] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:59.196853 14261 raft_consensus.cc:2468] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 18.
I20260709 12:11:59.207320 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:59.207710 14907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:59.209345 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:59.234131 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:11:59.210163 19680 log.cc:927] Time spent T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 2.464s	user 0.016s	sys 0.008s
I20260709 12:11:59.214318 19720 raft_consensus.cc:2804] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:59.202216 19388 raft_consensus.cc:3060] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:59.202589 19717 consensus_queue.cc:260] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:59.159581 19678 consensus_queue.cc:237] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:11:59.221145 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:59.214521 19763 raft_consensus.cc:2804] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:11:59.226867 19681 leader_election.cc:290] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:59.231344 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:59.167340 19712 raft_consensus.cc:515] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:59.234320 14183 raft_consensus.cc:3060] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:59.221462 19715 raft_consensus.cc:2749] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:59.230372 19764 raft_consensus.cc:493] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:59.242115 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:59.248193 14265 raft_consensus.cc:2368] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 12. Current term is 13.
I20260709 12:11:59.250985 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:59.237814 19720 raft_consensus.cc:493] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:59.252624 14261 raft_consensus.cc:2368] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 14. Current term is 15.
I20260709 12:11:59.257464 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:59.243714 19702 raft_consensus.cc:2804] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:59.247033 19717 raft_consensus.cc:3060] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:59.259595 14907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:59.261379 14912 raft_consensus.cc:1240] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:59.249214 19763 raft_consensus.cc:697] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 16 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:59.249687 19764 raft_consensus.cc:3060] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:59.257673 19720 raft_consensus.cc:3060] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:59.295238 14229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:59.282466 14261 raft_consensus.cc:2393] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 16: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:11:59.288338 14183 raft_consensus.cc:2468] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 14.
I20260709 12:11:59.290112 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:59.296851 14189 raft_consensus.cc:2468] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 11.
W20260709 12:11:59.291880 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 231098us
I20260709 12:11:59.288311 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:59.297044 19681 raft_consensus.cc:493] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:59.302239 19681 raft_consensus.cc:515] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:59.302686 14909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53194 (request call id 1032) took 1727 ms. Trace:
I20260709 12:11:59.303078 14909 rpcz_store.cc:276] 0709 12:11:57.574924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:57.618558 (+ 43634us) service_pool.cc:224] Handling call
0709 12:11:57.646817 (+ 28259us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:57.815472 (+168655us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:59.302394 (+1486922us) spinlock_profiling.cc:243] Waited 73.2 ms on lock 0x7b5400393354. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:11:59.302601 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":168460160}
I20260709 12:11:59.304458 19681 leader_election.cc:290] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:59.310895 19712 leader_election.cc:290] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:59.315302 14265 raft_consensus.cc:2368] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 12. Current term is 13.
W20260709 12:11:59.317477 14229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:59.321991 14258 raft_consensus.cc:2468] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 18.
I20260709 12:11:59.322921 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:59.323907 14258 raft_consensus.cc:2393] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 17: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:11:59.292503 19750 raft_consensus.cc:493] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:59.268543 19702 raft_consensus.cc:493] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:59.336948 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 174553us
I20260709 12:11:59.326824 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:59.338680 14261 raft_consensus.cc:2468] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 12.
I20260709 12:11:59.328161 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:59.339736 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:59.340065 14258 raft_consensus.cc:2468] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 12.
I20260709 12:11:59.340360 19637 raft_consensus.cc:493] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:59.340987 19637 raft_consensus.cc:515] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:59.341773 14229 leader_election.cc:304] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:59.326181 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:59.343292 14265 raft_consensus.cc:2468] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 15.
I20260709 12:11:59.343626 14229 leader_election.cc:304] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:59.344254 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:59.345062 14265 raft_consensus.cc:2393] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 14: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:11:59.345510 19682 raft_consensus.cc:2749] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:11:59.346267 19682 raft_consensus.cc:2749] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:59.340600 14261 raft_consensus.cc:2410] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 12:11:59.347054 19699 raft_consensus.cc:515] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:59.340966 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:59.348155 14907 raft_consensus.cc:2468] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 11.
I20260709 12:11:59.344956 14229 leader_election.cc:304] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:59.349208 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:59.350391 19702 raft_consensus.cc:3060] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:59.351318 19682 raft_consensus.cc:2749] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:59.347652 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:59.354466 19682 consensus_queue.cc:1059] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 12:11:59.356040 14262 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41764 (request call id 3065) took 1783 ms (client timeout 2093 ms). Trace:
W20260709 12:11:59.356525 14262 rpcz_store.cc:269] 0709 12:11:57.572437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:57.672701 (+100264us) service_pool.cc:224] Handling call
0709 12:11:59.355854 (+1683153us) spinlock_profiling.cc:243] Waited 134 ms on lock 0x7b54002012d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:11:59.355973 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":307869952}
I20260709 12:11:59.358011 19413 consensus_queue.cc:1048] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:11:59.359980 14229 leader_election.cc:304] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:59.360765 19681 raft_consensus.cc:2804] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:11:59.361174 19681 raft_consensus.cc:493] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:59.361562 19681 raft_consensus.cc:3060] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:59.362291 14184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 2997) took 1758 ms. Trace:
I20260709 12:11:59.320849 19759 raft_consensus.cc:697] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 18 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
W20260709 12:11:59.364080 19713 consensus_meta.cc:287] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db: Time spent flushing consensus metadata: real 0.617s	user 0.006s	sys 0.006s
I20260709 12:11:59.301357 19763 consensus_queue.cc:237] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 15.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:59.365187 19698 leader_election.cc:290] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:59.367103 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:59.367841 14185 raft_consensus.cc:3060] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Advancing to term 16
W20260709 12:11:59.369980 19768 log.cc:927] Time spent T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 12:11:59.370371 19681 raft_consensus.cc:515] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:59.358341 14264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53050 (request call id 998) took 4283 ms. Trace:
I20260709 12:11:59.371829 14264 rpcz_store.cc:276] 0709 12:11:55.074937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:55.523425 (+448488us) service_pool.cc:224] Handling call
0709 12:11:55.523751 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:57.553767 (+2030016us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:59.358075 (+1804308us) spinlock_profiling.cc:243] Waited 1.98 s on lock 0x7b54001c2854. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:11:59.358273 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4557658880}
I20260709 12:11:59.372783 19460 leader_election.cc:290] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:59.372984 19681 leader_election.cc:290] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:59.374322 14229 leader_election.cc:304] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:59.375155 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:59.376127 14258 raft_consensus.cc:2393] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 14: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:11:59.377068 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:59.377858 14258 raft_consensus.cc:2368] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 12. Current term is 13.
I20260709 12:11:59.363957 19759 consensus_queue.cc:237] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:59.378916 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:59.379685 14258 raft_consensus.cc:2468] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 18.
I20260709 12:11:59.381335 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:59.362695 14184 rpcz_store.cc:276] 0709 12:11:57.603579 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:57.603709 (+   130us) service_pool.cc:224] Handling call
0709 12:11:57.632441 (+ 28732us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:57.635511 (+  3070us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:57.635547 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:57.635603 (+    56us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:57.635641 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:59.362057 (+1726416us) spinlock_profiling.cc:243] Waited 2.84 ms on lock 0x7b540028a5d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:11:59.362106 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:59.362227 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6536448}
I20260709 12:11:59.383271 14229 leader_election.cc:304] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:59.384191 14258 raft_consensus.cc:2368] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 12. Current term is 13.
I20260709 12:11:59.386226 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:59.387250 14903 raft_consensus.cc:2468] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 15.
I20260709 12:11:59.389276 19413 raft_consensus.cc:2804] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:11:59.390895 19752 consensus_meta.cc:287] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.569s	user 0.010s	sys 0.000s
I20260709 12:11:59.391342 19413 raft_consensus.cc:493] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:59.388098 19712 raft_consensus.cc:2749] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:59.340931 19750 raft_consensus.cc:515] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:59.391826 19413 raft_consensus.cc:3060] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:59.391510 19752 raft_consensus.cc:515] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:59.393821 19750 leader_election.cc:290] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:59.394287 19752 leader_election.cc:290] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 15 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:59.388947 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:59.407931 14258 raft_consensus.cc:2393] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 16: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:11:59.388199 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:59.349303 19699 leader_election.cc:290] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 11 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:59.409422 19683 raft_consensus.cc:3055] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:11:59.358436 14303 leader_election.cc:304] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:11:59.423900 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:59.425297 14265 raft_consensus.cc:2368] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for earlier term 12. Current term is 13.
I20260709 12:11:59.419667 14185 raft_consensus.cc:2468] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 16.
I20260709 12:11:59.419786 14229 leader_election.cc:304] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
W20260709 12:11:59.420336 14875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:59.430431 14229 leader_election.cc:304] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:59.432585 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:59.423250 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:59.434172 14229 leader_election.cc:304] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:59.434235 14258 raft_consensus.cc:2393] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db in current term 11: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:11:59.436655 14229 leader_election.cc:304] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
W20260709 12:11:59.442118 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 83762.8us
I20260709 12:11:59.440069 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:59.441296 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:59.421026 19683 raft_consensus.cc:740] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:11:59.440025 19729 raft_consensus.cc:2749] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:59.438890 19681 raft_consensus.cc:2749] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 12:11:59.458791 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:59.452875 19727 raft_consensus.cc:2804] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:11:59.462249 19727 raft_consensus.cc:697] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 17 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:59.462361 19683 consensus_queue.cc:260] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:59.463181 19727 consensus_queue.cc:237] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:59.463724 19683 raft_consensus.cc:3060] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:11:59.438098 19712 raft_consensus.cc:2804] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:59.452400 14265 raft_consensus.cc:3060] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:59.452867 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:59.467614 14258 raft_consensus.cc:2368] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 17. Current term is 18.
W20260709 12:11:59.468726 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 697479us
I20260709 12:11:59.465965 19712 raft_consensus.cc:493] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:11:59.470077 14155 leader_election.cc:304] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:59.451864 19682 raft_consensus.cc:2804] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:59.440809 14229 leader_election.cc:304] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:59.478845 14229 leader_election.cc:304] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:59.480434 14229 leader_election.cc:304] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:59.468547 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:59.482728 19729 raft_consensus.cc:2749] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:59.474344 19712 raft_consensus.cc:3060] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:59.483635 14155 leader_election.cc:304] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:59.475414 19576 raft_consensus.cc:2804] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:59.476862 19660 raft_consensus.cc:2804] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:59.461522 19764 raft_consensus.cc:515] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:59.484678 14258 raft_consensus.cc:2393] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 14: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:11:59.478638 19682 raft_consensus.cc:697] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 15 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:11:59.490332 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:59.484517 19681 raft_consensus.cc:2749] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:11:59.504750 19413 raft_consensus.cc:515] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:59.477105 19721 consensus_queue.cc:1048] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.012s
I20260709 12:11:59.497097 14229 leader_election.cc:304] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:59.498502 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:11:59.499229 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:59.517261 19487 leader_election.cc:290] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:11:59.502244 14303 connection.cc:256] RPC call timeout handler was delayed by -2.0247703550001006s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21920000000000003s for a response
I20260709 12:11:59.502009 19682 consensus_queue.cc:237] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:11:59.519510 14303 connection.cc:256] RPC call timeout handler was delayed by -1.1767926890001945s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1706s for a response
W20260709 12:11:59.519934 14303 connection.cc:256] RPC call timeout handler was delayed by -1.0957926890000635s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1796s for a response
I20260709 12:11:59.488554 19576 raft_consensus.cc:493] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:11:59.521981 19487 raft_consensus.cc:493] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:59.522629 14338 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064"
dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
mode: GRACEFUL
new_leader_uuid: "885067a0d31741bfb5c9935788e315bf"
 from {username='slave'} at 127.0.0.1:50896
I20260709 12:11:59.522754 19487 raft_consensus.cc:515] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:59.523342 14338 raft_consensus.cc:606] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 14 LEADER]: Received request to transfer leadership to TS 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:59.523706 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:11:59.524685 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:59.525282 14332 raft_consensus.cc:2376] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 15. Re-sending same reply.
I20260709 12:11:59.476868 19692 consensus_queue.cc:1059] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 12:11:59.521633 14303 leader_election.cc:304] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:59.528113 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:59.542834 14262 raft_consensus.cc:2393] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 14: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:11:59.544003 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:59.545317 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:59.551366 14262 raft_consensus.cc:2393] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 16: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:11:59.499138 14908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:11:59.492352 14911 raft_consensus.cc:1275] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:11:59.526885 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:59.562858 14334 raft_consensus.cc:2410] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for term 16 because replica has last-logged OpId of term: 14 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:11:59.507673 14265 raft_consensus.cc:2468] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 15.
I20260709 12:11:59.527411 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:59.566638 14333 raft_consensus.cc:2410] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for term 14 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 6.
I20260709 12:11:59.566728 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 16 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:59.519591 19628 raft_consensus.cc:3060] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:59.529178 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:59.574378 14338 raft_consensus.cc:2393] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 16: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:11:59.526427 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:59.522120 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:59.582366 14903 raft_consensus.cc:2368] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for earlier term 12. Current term is 13.
I20260709 12:11:59.526971 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:59.489285 19660 raft_consensus.cc:493] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:59.503337 19725 raft_consensus.cc:493] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:59.595148 14910 raft_consensus.cc:2368] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for earlier term 12. Current term is 13.
I20260709 12:11:59.527791 19487 leader_election.cc:290] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:11:59.595410 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 79691.9us
I20260709 12:11:59.595239 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:11:59.597220 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 75683.1us
I20260709 12:11:59.629985 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:59.628443 14303 leader_election.cc:304] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:59.630905 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:59.632982 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:11:59.633951 19691 raft_consensus.cc:3055] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:59.634220 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
W20260709 12:11:59.634663 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 151099us
I20260709 12:11:59.635192 14912 raft_consensus.cc:2468] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 14.
I20260709 12:11:59.636608 14262 raft_consensus.cc:2393] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 14: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:11:59.522220 19576 raft_consensus.cc:3060] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:59.640264 14909 raft_consensus.cc:2468] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 16.
W20260709 12:11:59.599316 19786 log.cc:927] Time spent T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 12:11:59.600498 19660 raft_consensus.cc:3060] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:59.599370 19763 raft_consensus.cc:2749] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:59.642383 14155 leader_election.cc:304] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:59.634393 19691 raft_consensus.cc:740] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:11:59.599846 19681 raft_consensus.cc:2804] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:11:59.648900 14229 leader_election.cc:400] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 pre-election: Vote denied by peer 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341) with higher term. Message: Invalid argument: T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 15. Current term is 16.
I20260709 12:11:59.649286 14229 leader_election.cc:403] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:59.651630 19714 raft_consensus.cc:3060] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:59.651379 19691 consensus_queue.cc:260] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:59.652675 19691 raft_consensus.cc:3060] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:59.637856 19487 raft_consensus.cc:2749] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:11:59.658834 14188 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56044 (request call id 2998) took 2052 ms (client timeout 2208 ms). Trace:
I20260709 12:11:59.661087 14339 raft_consensus.cc:1240] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 17 LEADER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 16. Current term is 17. Ops: [16.11-16.11]
W20260709 12:11:59.659354 14188 rpcz_store.cc:269] 0709 12:11:57.603888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:57.604848 (+   960us) service_pool.cc:224] Handling call
0709 12:11:59.654103 (+2049255us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b54003f25d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:11:59.655965 (+  1862us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2936822656}
I20260709 12:11:59.662307 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:59.644536 19791 raft_consensus.cc:476] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 13 LEADER]: Not starting pre-election -- already a leader
I20260709 12:11:59.647831 19637 leader_election.cc:290] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:59.635912 19725 raft_consensus.cc:515] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:59.643450 19727 consensus_queue.cc:1059] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.019s
I20260709 12:11:59.664531 19792 raft_consensus.cc:2804] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:11:59.679257 19792 raft_consensus.cc:493] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:59.679692 19792 raft_consensus.cc:3060] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:11:59.665047 19721 raft_consensus.cc:3055] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:11:59.683190 19721 raft_consensus.cc:740] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:11:59.684216 19721 consensus_queue.cc:260] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:11:59.674525 19783 log.cc:927] Time spent T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.192s	user 0.001s	sys 0.000s
I20260709 12:11:59.667701 19681 raft_consensus.cc:697] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 16 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:11:59.686584 19721 raft_consensus.cc:3060] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:11:59.718595 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:59.719560 14337 raft_consensus.cc:2393] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 14: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:11:59.687347 19692 raft_consensus.cc:2804] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 12:11:59.717626 19788 log.cc:927] Time spent T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
W20260709 12:11:59.724884 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 85217.4us
I20260709 12:11:59.728221 14229 leader_election.cc:304] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:59.730867 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:59.733603 19693 raft_consensus.cc:493] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:59.734266 19693 raft_consensus.cc:515] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:59.736565 19693 leader_election.cc:290] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:59.742161 19413 leader_election.cc:290] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 13 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:59.742940 19413 raft_consensus.cc:2749] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:59.744550 19764 leader_election.cc:290] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 13 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:59.748907 19702 raft_consensus.cc:515] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:59.723495 19692 raft_consensus.cc:493] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:59.738783 14230 leader_election.cc:304] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:59.752739 14339 raft_consensus.cc:2468] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 17.
I20260709 12:11:59.727463 19759 raft_consensus.cc:3055] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:59.754801 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:59.768234 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:11:59.752768 19692 raft_consensus.cc:3060] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:11:59.761981 19683 raft_consensus.cc:2749] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:59.772938 19530 leader_election.cc:290] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 15 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:11:59.786860 14154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:59.787607 14154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:59.789172 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:59.789440 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:59.789934 14181 raft_consensus.cc:2468] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 13.
I20260709 12:11:59.791662 14181 raft_consensus.cc:1275] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 8. (term mismatch)
I20260709 12:11:59.791994 14181 pending_rounds.cc:85] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf: Aborting all ops after (but not including) 7
I20260709 12:11:59.792213 14181 pending_rounds.cc:107] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf: Aborting uncommitted NO_OP operation due to leader change: 14.8
I20260709 12:11:59.792425 14181 raft_consensus.cc:2889] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:59.794003 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:59.794565 14188 raft_consensus.cc:1275] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:11:59.794768 14181 raft_consensus.cc:2393] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 12: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
I20260709 12:11:59.797109 14265 raft_consensus.cc:2410] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for term 16 because replica has last-logged OpId of term: 15 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 5.
I20260709 12:11:59.764477 19759 raft_consensus.cc:740] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:11:59.796501 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:59.799508 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:59.769325 19720 raft_consensus.cc:515] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:59.802031 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:59.801425 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:59.802330 19660 raft_consensus.cc:515] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:59.802824 14183 raft_consensus.cc:1240] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 12:11:59.802937 14182 raft_consensus.cc:3060] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:11:59.804466 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:59.804602 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:11:59.806463 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 164161us
I20260709 12:11:59.806800 14259 raft_consensus.cc:2393] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db in current term 13: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:11:59.807709 14155 leader_election.cc:304] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:59.808681 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:59.809363 14188 raft_consensus.cc:2468] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 14.
W20260709 12:11:59.810967 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 76239.5us
I20260709 12:11:59.813623 14258 raft_consensus.cc:1240] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 15. Current term is 16. Ops: []
I20260709 12:11:59.822564 14336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 1004) took 1464 ms. Trace:
I20260709 12:11:59.823313 14182 raft_consensus.cc:2468] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 18.
I20260709 12:11:59.834566 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:59.847386 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:59.829641 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:59.848548 14229 leader_election.cc:304] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:59.848969 14333 raft_consensus.cc:3060] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:11:59.814603 19798 raft_consensus.cc:2804] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:11:59.852449 14336 rpcz_store.cc:276] 0709 12:11:58.358060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:58.395672 (+ 37612us) service_pool.cc:224] Handling call
0709 12:11:58.395981 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:58.439735 (+ 43754us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:59.822288 (+1382553us) spinlock_profiling.cc:243] Waited 37.1 ms on lock 0x7b5400019d54. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:11:59.822492 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":85225344}
I20260709 12:11:59.850234 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:59.851948 14258 raft_consensus.cc:1240] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 15. Current term is 16. Ops: []
I20260709 12:11:59.856877 14335 raft_consensus.cc:2468] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 10.
I20260709 12:11:59.852252 14229 leader_election.cc:304] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:59.853082 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:11:59.859970 14338 raft_consensus.cc:3060] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:11:59.778205 19681 consensus_queue.cc:237] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:59.850811 19413 raft_consensus.cc:2749] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:59.859416 14337 raft_consensus.cc:1240] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 12:11:59.863065 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:59.862957 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:11:59.874403 14332 raft_consensus.cc:2468] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 12.
I20260709 12:11:59.875542 14229 leader_election.cc:304] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
W20260709 12:11:59.862239 19795 log.cc:927] Time spent T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.173s	user 0.002s	sys 0.000s
I20260709 12:11:59.878849 14303 leader_election.cc:304] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:59.874617 14189 raft_consensus.cc:3060] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:11:59.825065 19792 raft_consensus.cc:515] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:59.882083 14229 leader_election.cc:304] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:11:59.886878 14258 raft_consensus.cc:1240] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 17. Current term is 18. Ops: [15.10-17.11]
I20260709 12:11:59.891062 14229 leader_election.cc:304] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:59.892556 14229 leader_election.cc:304] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:59.873394 19702 leader_election.cc:290] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 15 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:11:59.859876 19798 raft_consensus.cc:493] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:59.873024 19628 raft_consensus.cc:2749] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:11:59.910331 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 100460us
I20260709 12:11:59.897789 14303 leader_election.cc:304] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:11:59.902133 14338 raft_consensus.cc:2468] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 13.
I20260709 12:11:59.902654 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:59.912312 14188 raft_consensus.cc:2410] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for term 16 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 12:11:59.912748 14190 raft_consensus.cc:2393] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 18: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:11:59.913942 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:59.914811 14338 raft_consensus.cc:2368] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 14. Current term is 15.
I20260709 12:11:59.876911 19801 consensus_queue.cc:1059] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 12:11:59.916539 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
W20260709 12:11:59.919061 14155 connection.cc:256] RPC call timeout handler was delayed by -1.6288307259999328s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.191s for a response
W20260709 12:11:59.919642 14155 connection.cc:256] RPC call timeout handler was delayed by -1.6244030279999606s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2472s for a response
W20260709 12:11:59.920014 14155 connection.cc:256] RPC call timeout handler was delayed by -1.5626848519998475s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1769s for a response
W20260709 12:11:59.920372 14155 connection.cc:256] RPC call timeout handler was delayed by -1.55192317299975s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1787s for a response
W20260709 12:11:59.920812 14155 connection.cc:256] RPC call timeout handler was delayed by -1.4852848519999498s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1855s for a response
W20260709 12:11:59.921396 14155 leader_election.cc:336] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Timed out: RequestConsensusVote RPC to 127.12.174.130:36673 timed out after 1.507s (SENT)
I20260709 12:11:59.921900 14155 leader_election.cc:304] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:11:59.888453 19683 raft_consensus.cc:2749] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:59.886577 19799 raft_consensus.cc:2749] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:59.880241 19388 consensus_queue.cc:1048] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 12:11:59.876616 19729 consensus_queue.cc:1059] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.034s
I20260709 12:11:59.932633 14331 raft_consensus.cc:1275] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:11:59.929642 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:59.939330 14335 raft_consensus.cc:2468] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 13.
I20260709 12:11:59.912111 19798 raft_consensus.cc:3060] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:11:59.876976 19759 consensus_queue.cc:260] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:59.935181 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:11:59.886366 19780 consensus_queue.cc:1048] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 12:11:59.910908 19487 raft_consensus.cc:2804] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:59.940492 19800 raft_consensus.cc:2749] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:59.941186 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:59.897766 19413 raft_consensus.cc:2749] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:59.958119 14184 raft_consensus.cc:2468] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 18.
I20260709 12:11:59.937343 19731 raft_consensus.cc:2804] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:11:59.928941 19796 raft_consensus.cc:2749] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:59.928519 19725 leader_election.cc:290] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:11:59.967694 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 46347.5us
W20260709 12:11:59.970940 14155 leader_election.cc:336] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Timed out: RequestConsensusVote RPC to 127.12.174.130:36673 timed out after 1.562s (SENT)
I20260709 12:11:59.939399 19660 leader_election.cc:290] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 13 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:59.968322 14338 raft_consensus.cc:2468] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 15.
I20260709 12:11:59.968317 14258 raft_consensus.cc:1240] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 12:11:59.974402 14258 raft_consensus.cc:1240] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:59.964422 19628 raft_consensus.cc:3055] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:59.974814 19628 raft_consensus.cc:740] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:11:59.975849 14258 raft_consensus.cc:1275] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:11:59.975653 19628 consensus_queue.cc:260] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:59.976922 19628 raft_consensus.cc:3060] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:59.978305 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:59.971556 14155 leader_election.cc:304] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:11:59.938185 19801 raft_consensus.cc:3055] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:11:59.978952 14188 raft_consensus.cc:2468] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 13.
I20260709 12:11:59.979204 19801 raft_consensus.cc:740] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:11:59.980230 19801 consensus_queue.cc:260] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:59.962677 19487 raft_consensus.cc:493] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:11:59.982028 19487 raft_consensus.cc:3060] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:59.982801 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:11:59.983625 14264 raft_consensus.cc:2393] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 14: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:11:59.984068 14264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41768 (request call id 2120) took 1031 ms. Trace:
I20260709 12:11:59.984371 14264 rpcz_store.cc:276] 0709 12:11:58.952852 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:59.982463 (+1029611us) service_pool.cc:224] Handling call
0709 12:11:59.983990 (+  1527us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:59.981561 19801 raft_consensus.cc:3060] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:11:59.987398 19794 log.cc:927] Time spent T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.318s	user 0.002s	sys 0.000s
I20260709 12:11:59.989547 14263 raft_consensus.cc:1240] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:59.990638 19720 leader_election.cc:290] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 12 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:11:59.991698 19712 raft_consensus.cc:515] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:11:59.992146 19798 raft_consensus.cc:515] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:11:59.994570 19792 leader_election.cc:290] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 18 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:11:59.923323 14189 raft_consensus.cc:2468] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 15.
I20260709 12:11:59.979220 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:00.000795 14333 raft_consensus.cc:2468] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 13.
I20260709 12:11:59.986505 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:11:59.991834 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:00.002931 14257 raft_consensus.cc:2468] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 14.
I20260709 12:12:00.006668 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:00.007254 14261 raft_consensus.cc:3060] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:00.008436 14905 raft_consensus.cc:2468] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 16.
I20260709 12:11:59.956220 19750 consensus_queue.cc:1059] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.049s
W20260709 12:12:00.015064 14155 leader_election.cc:336] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Timed out: RequestConsensusVote RPC to 127.12.174.130:36673 timed out after 1.595s (SENT)
I20260709 12:12:00.017269 14155 leader_election.cc:304] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:00.017649 14304 leader_election.cc:304] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
W20260709 12:12:00.018857 14155 connection.cc:256] RPC call timeout handler was delayed by -1.4447519469999861s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1898s for a response
W20260709 12:12:00.019989 14155 leader_election.cc:336] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Timed out: RequestConsensusVote RPC to 127.12.174.130:36673 timed out after 2.248s (SENT)
I20260709 12:12:00.020689 14155 leader_election.cc:304] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
W20260709 12:12:00.012065 19797 log.cc:927] Time spent T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.231s	user 0.000s	sys 0.002s
I20260709 12:12:00.014343 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:00.026134 14189 raft_consensus.cc:2410] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 12:11:59.998261 19731 raft_consensus.cc:697] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 18 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:00.028980 14304 leader_election.cc:304] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:00.022143 19792 raft_consensus.cc:2749] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:00.040202 14304 leader_election.cc:304] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:00.023952 19721 raft_consensus.cc:2749] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:12:00.053910 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 156255us
I20260709 12:12:00.026095 19796 raft_consensus.cc:2749] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:00.051133 14261 raft_consensus.cc:2468] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 15.
I20260709 12:12:00.024629 19712 leader_election.cc:290] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 13 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:00.056321 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:00.058923 14261 raft_consensus.cc:2410] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 12:12:00.057572 14303 leader_election.cc:304] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:00.031548 19720 raft_consensus.cc:2749] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:12:00.062855 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 170370us
I20260709 12:12:00.065387 14304 leader_election.cc:304] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:12:00.067312 14230 leader_election.cc:304] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:00.066721 14229 leader_election.cc:304] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:00.068831 19413 raft_consensus.cc:2749] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:12:00.069567 19413 raft_consensus.cc:2804] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:00.070065 19413 raft_consensus.cc:697] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 15 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:00.070319 14229 leader_election.cc:304] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:12:00.071373 19413 consensus_queue.cc:237] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:00.073953 19660 raft_consensus.cc:2804] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:12:00.074437 19660 raft_consensus.cc:493] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:00.074782 19660 raft_consensus.cc:3060] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:00.068535 14230 leader_election.cc:304] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:00.078073 19791 raft_consensus.cc:2804] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:00.078655 19791 raft_consensus.cc:697] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 17 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:00.079612 19791 consensus_queue.cc:237] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 16.7, Last appended by leader: 7, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:00.081627 14908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:00.082479 14908 raft_consensus.cc:2468] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 16.
I20260709 12:12:00.086236 14908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:00.086810 19637 raft_consensus.cc:493] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:00.087167 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:00.086534 19799 raft_consensus.cc:493] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:00.087466 19800 raft_consensus.cc:493] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:00.087934 19799 raft_consensus.cc:515] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:00.088294 19800 raft_consensus.cc:515] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:00.089548 14229 leader_election.cc:304] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:00.090235 19799 leader_election.cc:290] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:00.090636 19800 leader_election.cc:290] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:00.090823 19799 raft_consensus.cc:2749] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:00.091385 14229 leader_election.cc:304] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:00.087383 19637 raft_consensus.cc:515] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:00.093111 14229 leader_election.cc:304] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:00.093482 19800 raft_consensus.cc:2804] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:12:00.087066 14908 raft_consensus.cc:2393] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 13: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
I20260709 12:12:00.095165 19799 raft_consensus.cc:2804] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:00.095345 19800 raft_consensus.cc:697] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 14 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:00.093861 19637 leader_election.cc:290] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:00.095808 19799 raft_consensus.cc:493] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:00.096956 19799 raft_consensus.cc:3060] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:00.096927 19800 consensus_queue.cc:237] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:00.106283 14904 raft_consensus.cc:1240] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 15 LEADER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 14. Current term is 15. Ops: [14.11-14.11]
W20260709 12:12:00.108188 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 50684.5us
I20260709 12:12:00.109138 14303 leader_election.cc:304] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
W20260709 12:12:00.116706 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 96726.8us
I20260709 12:12:00.025765 19430 consensus_queue.cc:1048] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 12:12:00.050962 19752 raft_consensus.cc:2804] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Leader election won for term 16
W20260709 12:12:00.117400 14155 connection.cc:256] RPC call timeout handler was delayed by -1.3896408069999779s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.4338s for a response
I20260709 12:12:00.119297 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:12:00.123229 14875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:00.158651 14155 connection.cc:256] RPC call timeout handler was delayed by -1.3725132330000633s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.197s for a response
W20260709 12:12:00.159262 14155 connection.cc:256] RPC call timeout handler was delayed by -1.3689132330000575s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19740000000000002s for a response
W20260709 12:12:00.159667 14155 connection.cc:256] RPC call timeout handler was delayed by -1.3381307259999176s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22330000000000003s for a response
I20260709 12:12:00.159421 14187 raft_consensus.cc:1275] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
W20260709 12:12:00.179677 14155 connection.cc:256] RPC call timeout handler was delayed by -1.2402071459998751s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2106s for a response
I20260709 12:12:00.180805 19752 raft_consensus.cc:697] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 16 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:00.125878 19725 raft_consensus.cc:2749] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:12:00.189056 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:00.189908 14183 raft_consensus.cc:2468] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 14.
I20260709 12:12:00.163021 19727 raft_consensus.cc:2804] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:00.158217 19388 raft_consensus.cc:2804] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader election won for term 15
W20260709 12:12:00.178505 19576 consensus_meta.cc:287] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.524s	user 0.012s	sys 0.000s
W20260709 12:12:00.223105 14154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:00.162191 19682 raft_consensus.cc:2749] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341) with higher term. Message: Invalid argument: T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 15. Current term is 16.
I20260709 12:12:00.172122 14303 leader_election.cc:400] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 12 pre-election: Vote denied by peer 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341) with higher term. Message: Invalid argument: T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for earlier term 12. Current term is 13.
W20260709 12:12:00.130510 14156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:00.126332 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 61017.2us
I20260709 12:12:00.126156 19780 consensus_queue.cc:1048] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.067s
I20260709 12:12:00.225494 14877 leader_election.cc:304] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
W20260709 12:12:00.261328 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 43578.8us
I20260709 12:12:00.272996 14260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41768 (request call id 2145) took 1045 ms. Trace:
I20260709 12:12:00.274673 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:00.274895 14304 leader_election.cc:304] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:12:00.275552 14303 leader_election.cc:403] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:12:00.118148 19763 raft_consensus.cc:2749] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:12:00.217057 14876 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:00.282579 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:00.301530 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:00.303037 14256 raft_consensus.cc:2393] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 15: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:12:00.198231 19727 raft_consensus.cc:493] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:00.308198 14876 leader_election.cc:304] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:12:00.315246 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:00.316077 14183 raft_consensus.cc:2468] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 12.
I20260709 12:12:00.315270 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:00.317560 14304 leader_election.cc:304] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:12:00.319296 14155 leader_election.cc:304] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:00.340900 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
W20260709 12:12:00.300920 19789 log.cc:927] Time spent T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.623s	user 0.006s	sys 0.000s
I20260709 12:12:00.168169 19796 raft_consensus.cc:493] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:00.106092 19731 consensus_queue.cc:237] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 16.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:00.309937 14908 raft_consensus.cc:1275] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:12:00.180517 19720 consensus_queue.cc:1048] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.053s
I20260709 12:12:00.344044 14155 leader_election.cc:304] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:00.345150 14907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:00.259590 19388 raft_consensus.cc:697] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 15 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:00.375464 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:00.314694 19802 raft_consensus.cc:493] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:00.302284 19748 raft_consensus.cc:2804] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:12:00.362550 19767 raft_consensus.cc:2749] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341) with higher term. Message: Invalid argument: T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for earlier term 12. Current term is 13.
I20260709 12:12:00.310817 19727 raft_consensus.cc:3060] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:00.366910 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:00.212527 19752 consensus_queue.cc:237] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:00.314707 19721 raft_consensus.cc:493] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:00.376245 14183 raft_consensus.cc:3060] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:12:00.311712 19790 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.633s	user 0.010s	sys 0.013s
W20260709 12:12:00.366657 19743 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.571s	user 0.000s	sys 0.026s
W20260709 12:12:00.384395 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 76279.5us
W20260709 12:12:00.385972 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 75550.9us
I20260709 12:12:00.388072 14256 raft_consensus.cc:2468] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 13.
I20260709 12:12:00.228669 19576 raft_consensus.cc:515] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:00.359748 19792 raft_consensus.cc:2804] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:12:00.273749 14260 rpcz_store.cc:276] 0709 12:11:59.227575 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:00.118959 (+891384us) service_pool.cc:224] Handling call
0709 12:12:00.272895 (+153936us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:00.300280 19660 raft_consensus.cc:515] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:12:00.394423 19806 log.cc:927] Time spent T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
W20260709 12:12:00.395360 19808 log.cc:927] Time spent T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 12:12:00.395700 19388 consensus_queue.cc:237] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:00.346472 19671 consensus_queue.cc:1059] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.067s
I20260709 12:12:00.377568 19799 raft_consensus.cc:515] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:00.385514 19764 raft_consensus.cc:2804] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:12:00.380383 19763 raft_consensus.cc:2804] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Leader election won for term 14
W20260709 12:12:00.401484 19790 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.723s	user 0.011s	sys 0.013s
I20260709 12:12:00.415350 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:12:00.404922 19743 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.610s	user 0.000s	sys 0.026s
W20260709 12:12:00.406288 19741 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.627s	user 0.014s	sys 0.052s
I20260709 12:12:00.419520 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:00.446496 14256 raft_consensus.cc:2393] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 16: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:12:00.419402 14260 raft_consensus.cc:1275] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:12:00.411329 19748 raft_consensus.cc:697] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 13 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:12:00.424440 14190 raft_consensus.cc:2468] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 13.
I20260709 12:12:00.426072 19576 leader_election.cc:290] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 14 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:12:00.426947 19804 log.cc:927] Time spent T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.229s	user 0.001s	sys 0.000s
I20260709 12:12:00.389562 19802 raft_consensus.cc:515] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:00.428779 19660 leader_election.cc:290] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:12:00.448772 19741 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.672s	user 0.015s	sys 0.052s
I20260709 12:12:00.367372 19796 raft_consensus.cc:515] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:00.438814 14904 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3"
dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
mode: GRACEFUL
new_leader_uuid: "885067a0d31741bfb5c9935788e315bf"
 from {username='slave'} at 127.0.0.1:38628
I20260709 12:12:00.473227 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:00.474680 14258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41764 (request call id 3084) took 1174 ms. Trace:
I20260709 12:12:00.449813 19763 raft_consensus.cc:697] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 14 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:00.475143 14258 rpcz_store.cc:276] 0709 12:11:59.300059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:59.976624 (+676565us) service_pool.cc:224] Handling call
0709 12:11:59.976932 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:59.977167 (+   235us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:12:00.226788 (+249621us) log.cc:844] Serialized 14 byte log entry
0709 12:12:00.474204 (+247416us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:00.474296 (+    92us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:12:00.474364 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:00.474442 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:00.474596 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":389294,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":48,"thread_start_us":494492,"threads_started":2}
I20260709 12:12:00.473114 14904 raft_consensus.cc:606] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 14 LEADER]: Received request to transfer leadership to TS 885067a0d31741bfb5c9935788e315bf
W20260709 12:12:00.482446 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 310512us
I20260709 12:12:00.484915 14303 leader_election.cc:304] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:00.481244 14264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41764 (request call id 3086) took 1143 ms. Trace:
W20260709 12:12:00.487960 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 144001us
W20260709 12:12:00.439333 14302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:00.408088 19430 raft_consensus.cc:2804] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader election won for term 18
W20260709 12:12:00.417601 19691 consensus_meta.cc:287] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.765s	user 0.014s	sys 0.000s
I20260709 12:12:00.410202 19792 raft_consensus.cc:493] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:00.447805 14263 raft_consensus.cc:2393] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 16: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
W20260709 12:12:00.424361 19809 log.cc:927] Time spent T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.197s	user 0.000s	sys 0.001s
W20260709 12:12:00.450455 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 357410us
I20260709 12:12:00.451378 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:00.408362 19721 raft_consensus.cc:515] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:00.467820 14183 raft_consensus.cc:2468] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 13.
W20260709 12:12:00.528805 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 211327us
I20260709 12:12:00.530540 14304 leader_election.cc:400] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 12 pre-election: Vote denied by peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673) with higher term. Message: Invalid argument: T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for earlier term 12. Current term is 13.
I20260709 12:12:00.429282 14182 raft_consensus.cc:3060] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:00.486845 14264 rpcz_store.cc:276] 0709 12:11:59.383514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:59.985221 (+601707us) service_pool.cc:224] Handling call
0709 12:11:59.985565 (+   344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:59.996918 (+ 11353us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:12:00.276768 (+279850us) log.cc:844] Serialized 14 byte log entry
0709 12:12:00.480758 (+203990us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:00.480829 (+    71us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:12:00.480890 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:00.480976 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:00.481158 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2116,"prepare.queue_time_us":390091,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"raft.queue_time_us":2254,"thread_start_us":455176,"threads_started":2}
I20260709 12:12:00.510221 14155 leader_election.cc:304] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:00.533720 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:00.535043 19802 leader_election.cc:290] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:00.535192 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:00.535867 14183 raft_consensus.cc:2468] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 16.
I20260709 12:12:00.530718 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:00.540006 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:00.512995 14335 raft_consensus.cc:1275] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 12:12:00.558251 14905 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53200 (request call id 712) took 1664 ms (client timeout 2043 ms). Trace:
I20260709 12:12:00.560810 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:00.568456 14190 raft_consensus.cc:2393] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db in current term 13: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:12:00.522300 19430 raft_consensus.cc:697] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 18 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:00.528405 14184 raft_consensus.cc:2468] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 11.
I20260709 12:12:00.523262 19792 raft_consensus.cc:3060] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:00.534152 14155 leader_election.cc:304] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
W20260709 12:12:00.567660 14905 rpcz_store.cc:269] 0709 12:11:58.893972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:58.894599 (+   627us) service_pool.cc:224] Handling call
0709 12:12:00.558061 (+1663462us) spinlock_profiling.cc:243] Waited 892 ms on lock 0x7b54007481d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:12:00.558187 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2052204416}
I20260709 12:12:00.532478 14304 leader_election.cc:304] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
W20260709 12:12:00.569921 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 164391us
I20260709 12:12:00.572796 14182 raft_consensus.cc:2468] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 15.
W20260709 12:12:00.575840 14154 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 229465us
I20260709 12:12:00.578100 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
W20260709 12:12:00.559660 19803 log.cc:927] Time spent T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.301s	user 0.001s	sys 0.001s
W20260709 12:12:00.581565 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 47486.7us
I20260709 12:12:00.584072 14155 leader_election.cc:304] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:00.545135 19802 raft_consensus.cc:2804] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:00.535625 19796 leader_election.cc:290] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:00.556766 19798 leader_election.cc:290] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:12:00.590581 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 105779us
I20260709 12:12:00.548951 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:00.592118 14303 leader_election.cc:304] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:00.562789 14909 raft_consensus.cc:3060] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:00.592993 14190 raft_consensus.cc:1240] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 13. Current term is 14. Ops: []
W20260709 12:12:00.595528 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 63130.7us
I20260709 12:12:00.598645 14303 leader_election.cc:304] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:00.588891 14877 leader_election.cc:304] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:00.599813 14303 leader_election.cc:304] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:12:00.601039 14303 leader_election.cc:400] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 12 pre-election: Vote denied by peer 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341) with higher term. Message: Invalid argument: T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for earlier term 12. Current term is 13.
I20260709 12:12:00.601320 14303 leader_election.cc:403] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:12:00.597275 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:00.603004 14185 raft_consensus.cc:2468] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 16.
I20260709 12:12:00.604130 19121 consensus_queue.cc:1048] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 12:12:00.604743 19819 log.cc:927] Time spent T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 12:12:00.604511 19436 consensus_queue.cc:1048] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:12:00.606508 19436 raft_consensus.cc:2804] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:00.606889 19436 raft_consensus.cc:493] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:12:00.607281 19436 raft_consensus.cc:3060] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:00.610558 14265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41768 (request call id 2111) took 1660 ms. Trace:
I20260709 12:12:00.610989 14265 rpcz_store.cc:276] 0709 12:11:58.950548 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:59.566395 (+615847us) service_pool.cc:224] Handling call
0709 12:12:00.610321 (+1043926us) spinlock_profiling.cc:243] Waited 229 ms on lock 0x7b5400210a54. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:12:00.610491 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":527348992}
I20260709 12:12:00.623003 14155 leader_election.cc:400] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 pre-election: Vote denied by peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673) with higher term. Message: Invalid argument: T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 12. Current term is 13.
I20260709 12:12:00.623240 14257 raft_consensus.cc:1275] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
W20260709 12:12:00.565495 19692 consensus_meta.cc:287] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.786s	user 0.010s	sys 0.001s
I20260709 12:12:00.616407 14877 leader_election.cc:304] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:00.585297 19802 raft_consensus.cc:493] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:00.631083 19802 raft_consensus.cc:3060] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:00.631809 14155 leader_election.cc:304] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:00.633021 14155 leader_election.cc:304] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
W20260709 12:12:00.633725 14336 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.637s	user 0.002s	sys 0.015s
I20260709 12:12:00.634363 14155 leader_election.cc:400] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 election: Vote denied by peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673) with higher term. Message: Invalid argument: T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 17. Current term is 18.
I20260709 12:12:00.635025 14155 leader_election.cc:403] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 12:12:00.636171 14155 leader_election.cc:304] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:00.638441 14155 leader_election.cc:304] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:00.639642 19802 raft_consensus.cc:515] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:00.640470 14909 raft_consensus.cc:2468] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 12.
W20260709 12:12:00.641780 14336 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.645s	user 0.003s	sys 0.015s
W20260709 12:12:00.597002 19801 consensus_meta.cc:287] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.610s	user 0.012s	sys 0.000s
I20260709 12:12:00.644943 14877 leader_election.cc:304] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:12:00.565151 19759 raft_consensus.cc:3060] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:00.646351 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:00.590737 19743 raft_consensus.cc:2749] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:12:00.591322 19725 raft_consensus.cc:2749] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:00.565666 19691 raft_consensus.cc:493] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:00.547261 19748 consensus_queue.cc:237] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:00.654309 14185 raft_consensus.cc:2468] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 16.
I20260709 12:12:00.618539 19741 raft_consensus.cc:2749] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:00.618394 19807 raft_consensus.cc:2749] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:12:00.659263 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 62938.5us
I20260709 12:12:00.627156 19798 raft_consensus.cc:2764] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 12:12:00.658449 14335 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95"
dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
mode: GRACEFUL
new_leader_uuid: "17aab1bbf5014936aa18cc21818b26ec"
 from {username='slave'} at 127.0.0.1:50896
I20260709 12:12:00.621976 19796 raft_consensus.cc:2749] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:12:00.668430 19816 log.cc:927] Time spent T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:12:00.669116 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:00.680387 14185 raft_consensus.cc:3060] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:00.622083 19826 raft_consensus.cc:2804] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:00.624091 19827 raft_consensus.cc:2749] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341) with higher term. Message: Invalid argument: T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for earlier term 12. Current term is 13.
I20260709 12:12:00.673399 14304 leader_election.cc:304] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:12:00.676703 14335 raft_consensus.cc:606] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Received request to transfer leadership to TS 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:12:00.666034 19671 consensus_queue.cc:1048] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.004s
I20260709 12:12:00.589635 19763 consensus_queue.cc:237] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:00.645961 19802 leader_election.cc:290] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 16 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:00.646982 19692 raft_consensus.cc:515] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:00.685999 14304 leader_election.cc:304] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:00.713868 14190 raft_consensus.cc:1275] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:12:00.685002 14335 raft_consensus.cc:614] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:00.663009 19799 leader_election.cc:290] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 14 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:00.647603 19705 consensus_queue.cc:1048] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 12:12:00.662019 19832 raft_consensus.cc:493] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:12:00.672699 19691 raft_consensus.cc:515] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:00.679003 19121 raft_consensus.cc:2804] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:12:00.688563 19764 raft_consensus.cc:697] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 14 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
W20260709 12:12:00.700943 19817 log.cc:927] Time spent T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
I20260709 12:12:00.672290 19720 consensus_queue.cc:1059] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 12:12:00.693202 14876 leader_election.cc:304] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:00.699807 19309 raft_consensus.cc:2804] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:00.677425 19702 consensus_queue.cc:1059] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 12:12:00.735071 14188 raft_consensus.cc:2393] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 18: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:12:00.698524 19834 raft_consensus.cc:2749] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:00.710474 19826 raft_consensus.cc:697] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 16 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
W20260709 12:12:00.790066 14154 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 55286.8us
I20260709 12:12:00.719890 19798 raft_consensus.cc:3060] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:00.837597 14186 raft_consensus.cc:3060] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:00.690052 19430 consensus_queue.cc:237] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:00.719381 19833 raft_consensus.cc:2749] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673) with higher term. Message: Invalid argument: T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 17. Current term is 18.
W20260709 12:12:00.827616 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 173938us
W20260709 12:12:00.859848 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 166710us
W20260709 12:12:00.836311 19830 log.cc:927] Time spent T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.263s	user 0.001s	sys 0.000s
I20260709 12:12:00.728117 19751 raft_consensus.cc:2749] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:00.807809 14185 raft_consensus.cc:2468] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 12.
I20260709 12:12:00.735004 19832 raft_consensus.cc:515] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:12:00.790999 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 55371.7us
W20260709 12:12:00.846678 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 208304us
I20260709 12:12:00.872514 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:00.872673 14155 leader_election.cc:304] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:00.873291 14338 raft_consensus.cc:2468] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 19.
W20260709 12:12:00.735991 19668 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.948s	user 0.013s	sys 0.014s
I20260709 12:12:00.800036 19801 raft_consensus.cc:2749] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:12:00.860409 14877 leader_election.cc:304] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:00.860620 14876 leader_election.cc:304] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:12:01.031893 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
W20260709 12:12:01.032451 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 171910us
I20260709 12:12:01.031613 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:00.721844 19796 raft_consensus.cc:2749] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:12:01.036175 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:00.866087 19671 raft_consensus.cc:2749] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:12:00.737519 19121 raft_consensus.cc:493] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:00.875465 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:12:00.879776 19668 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.089s	user 0.013s	sys 0.014s
I20260709 12:12:01.012334 14185 raft_consensus.cc:1275] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 11. (term mismatch)
I20260709 12:12:00.847748 19309 raft_consensus.cc:697] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 15 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:01.011435 14155 leader_election.cc:304] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:00.961241 19826 consensus_queue.cc:237] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:12:01.008831 14302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:01.008074 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:00.910579 19705 raft_consensus.cc:2749] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:12:00.871971 19487 consensus_meta.cc:287] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.889s	user 0.012s	sys 0.001s
I20260709 12:12:00.877635 19807 consensus_queue.cc:1048] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.116s
I20260709 12:12:01.055959 14264 raft_consensus.cc:1275] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
W20260709 12:12:01.059104 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 47772.9us
I20260709 12:12:01.059937 14155 leader_election.cc:304] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:01.062997 14155 leader_election.cc:304] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
W20260709 12:12:01.040859 19837 log.cc:927] Time spent T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.177s	user 0.000s	sys 0.004s
I20260709 12:12:01.034528 14186 raft_consensus.cc:2410] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 12:12:01.007525 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:01.032485 14332 raft_consensus.cc:2393] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 13: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:12:00.789534 19836 raft_consensus.cc:493] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:01.040547 14330 raft_consensus.cc:1275] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 7. (term mismatch)
I20260709 12:12:01.090618 14330 pending_rounds.cc:85] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c: Aborting all ops after (but not including) 6
I20260709 12:12:01.090878 14330 pending_rounds.cc:107] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c: Aborting uncommitted NO_OP operation due to leader change: 13.7
I20260709 12:12:01.091127 14330 raft_consensus.cc:2889] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:01.091418 14155 leader_election.cc:304] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:01.041342 14257 raft_consensus.cc:1275] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:12:01.043172 14339 raft_consensus.cc:1275] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
W20260709 12:12:01.051204 19847 log.cc:927] Time spent T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.171s	user 0.002s	sys 0.001s
I20260709 12:12:01.042157 14230 leader_election.cc:304] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
W20260709 12:12:01.099617 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 57557.9us
I20260709 12:12:01.053406 14263 raft_consensus.cc:1240] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 12:12:01.054338 14334 raft_consensus.cc:2393] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 13: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
W20260709 12:12:01.041204 19825 log.cc:927] Time spent T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.355s	user 0.000s	sys 0.004s
I20260709 12:12:01.043905 19121 raft_consensus.cc:3060] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:12:01.114161 19705 raft_consensus.cc:2749] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:01.062443 19487 raft_consensus.cc:515] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:01.115319 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:01.116540 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:01.117357 19487 leader_election.cc:290] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 15 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:01.117797 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:01.118945 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:01.120857 14259 raft_consensus.cc:1275] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 11. (term mismatch)
I20260709 12:12:01.121227 14259 pending_rounds.cc:85] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec: Aborting all ops after (but not including) 10
I20260709 12:12:01.121460 14259 pending_rounds.cc:107] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec: Aborting uncommitted NO_OP operation due to leader change: 16.11
I20260709 12:12:01.121697 14259 raft_consensus.cc:2889] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:01.033196 19829 raft_consensus.cc:2749] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:12:00.980801 19831 log.cc:927] Time spent T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.153s	user 0.000s	sys 0.000s
W20260709 12:12:01.087663 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 227332us
I20260709 12:12:01.128533 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:01.129423 14263 raft_consensus.cc:1275] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 12:12:01.089557 19671 raft_consensus.cc:2804] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:12:01.048033 14185 pending_rounds.cc:85] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf: Aborting all ops after (but not including) 10
I20260709 12:12:01.132010 14185 pending_rounds.cc:107] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf: Aborting uncommitted NO_OP operation due to leader change: 14.11
I20260709 12:12:01.043707 19842 raft_consensus.cc:2764] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Leader election decision vote started in defunct term 11: won
I20260709 12:12:01.065233 19764 consensus_queue.cc:237] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:01.102700 19836 raft_consensus.cc:515] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:12:01.108385 19436 consensus_meta.cc:287] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db: Time spent flushing consensus metadata: real 0.501s	user 0.015s	sys 0.002s
I20260709 12:12:01.095300 19833 raft_consensus.cc:2749] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:01.109652 19691 leader_election.cc:290] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:01.035003 19835 consensus_queue.cc:1059] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.087s
I20260709 12:12:01.109969 19818 raft_consensus.cc:2804] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 12:12:01.112572 19628 consensus_meta.cc:287] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 1.135s	user 0.019s	sys 0.006s
I20260709 12:12:01.112313 19309 consensus_queue.cc:237] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:01.123834 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:01.132339 14185 raft_consensus.cc:2889] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:01.070061 19796 raft_consensus.cc:2749] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:12:01.140192 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:01.131719 19705 raft_consensus.cc:493] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:01.093189 19849 raft_consensus.cc:2804] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:01.091959 19720 raft_consensus.cc:493] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:01.105458 19759 raft_consensus.cc:493] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:12:01.158114 14259 raft_consensus.cc:1275] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:12:01.135293 14331 raft_consensus.cc:2393] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 12: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:12:01.173346 14261 raft_consensus.cc:2410] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for term 14 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 12:12:01.128621 19681 raft_consensus.cc:493] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:01.164098 19655 raft_consensus.cc:2749] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:01.176743 14256 raft_consensus.cc:1275] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:12:01.160828 19436 raft_consensus.cc:515] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:01.178000 14185 raft_consensus.cc:1240] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:01.179852 19121 raft_consensus.cc:515] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:01.136014 19752 raft_consensus.cc:493] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:01.135154 19671 raft_consensus.cc:493] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:12:01.147393 19692 leader_election.cc:290] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 18 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:01.234194 19671 raft_consensus.cc:3060] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:01.225273 19759 raft_consensus.cc:515] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:01.236716 19759 leader_election.cc:290] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:01.155934 19731 consensus_queue.cc:1048] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.072s
I20260709 12:12:01.161140 19850 raft_consensus.cc:993] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db: : Instructing follower 885067a0d31741bfb5c9935788e315bf to start an election
W20260709 12:12:01.226419 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 156051us
I20260709 12:12:01.155331 19487 consensus_queue.cc:1048] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.074s
I20260709 12:12:01.174059 19842 consensus_queue.cc:1059] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.059s
I20260709 12:12:01.232666 19752 raft_consensus.cc:515] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:01.224328 19681 raft_consensus.cc:515] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:01.238446 14184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56046 (request call id 2567) took 1155 ms. Trace:
I20260709 12:12:01.190869 19849 raft_consensus.cc:493] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:12:01.193195 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 92903.8us
I20260709 12:12:01.155164 19702 consensus_queue.cc:1059] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 4, Time since last communication: 0.068s
I20260709 12:12:01.222730 19628 raft_consensus.cc:493] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:01.164019 19818 raft_consensus.cc:493] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:01.154757 19725 consensus_queue.cc:1048] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.068s
I20260709 12:12:01.253280 14184 rpcz_store.cc:276] 0709 12:12:00.082524 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:00.579328 (+496804us) service_pool.cc:224] Handling call
0709 12:12:00.579689 (+   361us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:00.579913 (+   224us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:00.579935 (+    22us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:00.585301 (+  5366us) log.cc:844] Serialized 26 byte log entry
0709 12:12:00.799664 (+214363us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:12:00.799709 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:00.799795 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:01.238195 (+438400us) raft_consensus.cc:1685] finished
0709 12:12:01.238217 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:01.238367 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":170346,"threads_started":1,"wal-append.queue_time_us":272625}
I20260709 12:12:01.159781 19767 consensus_queue.cc:1048] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.068s
I20260709 12:12:01.255904 14185 raft_consensus.cc:1275] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:12:01.217053 19720 raft_consensus.cc:515] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:01.257706 19759 raft_consensus.cc:493] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:01.191710 19705 raft_consensus.cc:515] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:01.266037 19818 raft_consensus.cc:3060] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:01.266286 19849 raft_consensus.cc:3060] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:12:01.306252 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 124911us
W20260709 12:12:01.313542 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 183399us
I20260709 12:12:01.323279 14337 raft_consensus.cc:1275] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:12:01.328588 14337 raft_consensus.cc:1275] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 12. (term mismatch)
I20260709 12:12:01.329198 14337 pending_rounds.cc:85] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c: Aborting all ops after (but not including) 11
I20260709 12:12:01.329494 14337 pending_rounds.cc:107] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c: Aborting uncommitted NO_OP operation due to leader change: 14.12
I20260709 12:12:01.329840 14337 raft_consensus.cc:2889] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:12:01.335826 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 217257us
W20260709 12:12:01.317852 19727 consensus_meta.cc:287] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.908s	user 0.007s	sys 0.007s
I20260709 12:12:01.342468 14334 raft_consensus.cc:1275] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:12:01.268848 19628 raft_consensus.cc:515] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:01.295357 19721 leader_election.cc:290] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:12:01.320838 19792 consensus_meta.cc:287] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.736s	user 0.006s	sys 0.006s
I20260709 12:12:01.305465 19842 consensus_queue.cc:1048] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.046s
I20260709 12:12:01.344569 19807 raft_consensus.cc:3055] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 12 LEADER]: Stepping down as leader of term 12
W20260709 12:12:01.352887 19798 consensus_meta.cc:287] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.507s	user 0.012s	sys 0.000s
I20260709 12:12:01.300966 19759 raft_consensus.cc:515] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:01.356213 19862 raft_consensus.cc:1081] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 14 LEADER]: Signalling peer 885067a0d31741bfb5c9935788e315bf to start an election
I20260709 12:12:01.361557 19792 raft_consensus.cc:515] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:01.347673 19727 raft_consensus.cc:515] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:01.397418 19727 leader_election.cc:290] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:01.392807 19121 leader_election.cc:290] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 11 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:01.348085 19860 consensus_queue.cc:1048] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 12:12:01.393817 19869 consensus_queue.cc:1048] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 12:12:01.394345 19681 leader_election.cc:290] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:01.394929 19436 leader_election.cc:290] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 16 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:01.382495 19798 raft_consensus.cc:2749] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:12:01.392514 19852 log.cc:927] Time spent T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.277s	user 0.000s	sys 0.000s
I20260709 12:12:01.372004 19807 raft_consensus.cc:740] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:01.367108 19764 consensus_queue.cc:1048] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.029s
W20260709 12:12:01.414213 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 154085us
I20260709 12:12:01.446962 14183 raft_consensus.cc:1240] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 12. Current term is 13. Ops: []
W20260709 12:12:01.415449 19846 log.cc:927] Time spent T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.113s	user 0.001s	sys 0.001s
I20260709 12:12:01.448449 19869 consensus_queue.cc:1243] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer 65c9c1653b3346b39a0e118540e6080c log is divergent from this leader: its last log entry 14.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:12:01.455885 14182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 3030) took 1329 ms. Trace:
W20260709 12:12:01.415380 19845 log.cc:927] Time spent T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
W20260709 12:12:01.403004 19844 log.cc:927] Time spent T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.333s	user 0.002s	sys 0.000s
W20260709 12:12:01.472805 19858 log.cc:927] Time spent T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 12:12:01.455416 19807 consensus_queue.cc:260] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:01.474076 19807 raft_consensus.cc:3060] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:12:01.465396 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 123332us
I20260709 12:12:01.379428 19853 consensus_queue.cc:1059] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.036s
I20260709 12:12:01.476552 19853 raft_consensus.cc:3055] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:01.476933 19853 raft_consensus.cc:740] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:12:01.467934 14182 rpcz_store.cc:276] 0709 12:12:00.126315 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:00.702724 (+576409us) service_pool.cc:224] Handling call
0709 12:12:00.703117 (+   393us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:00.712634 (+  9517us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:12:00.712671 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:00.713195 (+   524us) log.cc:844] Serialized 26 byte log entry
0709 12:12:01.020222 (+307027us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:12:01.020268 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:01.020342 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:01.455593 (+435251us) raft_consensus.cc:1685] finished
0709 12:12:01.455620 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:01.455799 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":61758,"raft.queue_time_us":14905,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":6510,"thread_start_us":232367,"threads_started":1,"wal-append.queue_time_us":386782}
I20260709 12:12:01.478989 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:01.479624 14182 raft_consensus.cc:2468] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 13.
I20260709 12:12:01.480646 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:01.406850 19836 leader_election.cc:290] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:01.468799 19860 consensus_queue.cc:1048] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 12:12:01.483156 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:01.487948 14181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56046 (request call id 2562) took 1412 ms. Trace:
I20260709 12:12:01.477852 19853 consensus_queue.cc:260] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:01.500010 19853 raft_consensus.cc:3060] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:01.532370 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
W20260709 12:12:01.535022 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 52864.2us
I20260709 12:12:01.467873 19681 raft_consensus.cc:493] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:01.488519 14181 rpcz_store.cc:276] 0709 12:12:00.076009 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:00.562256 (+486247us) service_pool.cc:224] Handling call
0709 12:12:00.562660 (+   404us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:00.570611 (+  7951us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:12:00.596178 (+ 25567us) log.cc:844] Serialized 14 byte log entry
0709 12:12:00.669171 (+ 72993us) spinlock_profiling.cc:243] Waited 3.33 ms on lock 0x7b180032fec0. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f212cf16ab1 00007f212cf23281 00007f212404e3f3 00007f21240507c1 00007f2124050779 00007f2124050709 00007f21240506d1 00007f212404f9cd 0000000000388634 0000000000388479 00007f212403183a
0709 12:12:01.134742 (+465571us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:01.152563 (+ 17821us) log.cc:844] Serialized 26 byte log entry
0709 12:12:01.152754 (+   191us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:12:01.158577 (+  5823us) log.cc:844] Serialized 14 byte log entry
0709 12:12:01.162854 (+  4277us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:01.162956 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:01.487674 (+324718us) raft_consensus.cc:1685] finished
0709 12:12:01.487704 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:01.487864 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22201,"prepare.queue_time_us":16623,"prepare.run_cpu_time_us":153,"prepare.run_wall_time_us":6038,"raft.queue_time_us":34121,"raft.run_cpu_time_us":335,"raft.run_wall_time_us":50056,"spinlock_wait_cycles":164269312,"thread_start_us":479193,"threads_started":1,"wal-append.queue_time_us":641613}
I20260709 12:12:01.546429 14182 raft_consensus.cc:1275] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:12:01.547359 14182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56652 (request call id 1284) took 1169 ms. Trace:
I20260709 12:12:01.547705 14182 rpcz_store.cc:276] 0709 12:12:00.377656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:01.545497 (+1167841us) service_pool.cc:224] Handling call
0709 12:12:01.545962 (+   465us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:01.547029 (+  1067us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:01.547281 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:01.548293 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:01.549055 14333 raft_consensus.cc:3060] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:01.551985 14335 raft_consensus.cc:1217] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Deduplicated request from leader. Original: 9.8->[11.9-19.12]   Dedup: 11.9->[15.10-19.12]
I20260709 12:12:01.552505 14335 pending_rounds.cc:85] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c: Aborting all ops after (but not including) 9
I20260709 12:12:01.552763 14335 pending_rounds.cc:107] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c: Aborting uncommitted NO_OP operation due to leader change: 14.10
I20260709 12:12:01.553009 14335 raft_consensus.cc:2889] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:01.486145 19752 leader_election.cc:290] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:01.557407 14182 raft_consensus.cc:1275] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:12:01.559278 14182 raft_consensus.cc:1275] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 12:12:01.534384 19702 raft_consensus.cc:493] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:01.562587 14181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56652 (request call id 1285) took 1184 ms. Trace:
I20260709 12:12:01.563324 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:01.564193 14334 raft_consensus.cc:3060] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:12:01.563086 14181 rpcz_store.cc:276] 0709 12:12:00.378004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:01.546729 (+1168725us) service_pool.cc:224] Handling call
0709 12:12:01.562012 (+ 15283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:01.562219 (+   207us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:01.562245 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:01.562287 (+    42us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:12:01.562319 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:01.562414 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:01.562522 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:01.551178 19860 raft_consensus.cc:493] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:01.545348 19681 raft_consensus.cc:515] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:01.574391 14333 raft_consensus.cc:2468] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 16.
I20260709 12:12:01.579566 14877 leader_election.cc:304] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:12:01.567404 19869 consensus_queue.cc:1048] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.020s
I20260709 12:12:01.603152 19876 raft_consensus.cc:493] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:01.570300 19702 raft_consensus.cc:515] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:01.602681 19697 raft_consensus.cc:3055] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:12:01.603791 19876 raft_consensus.cc:515] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:01.615780 19697 raft_consensus.cc:740] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:12:01.617163 19697 consensus_queue.cc:260] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:01.617708 19876 leader_election.cc:290] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:01.618423 19876 raft_consensus.cc:493] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:01.618914 19876 raft_consensus.cc:515] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:01.621877 19876 leader_election.cc:290] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:01.627231 19681 leader_election.cc:290] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:12:01.628856 19874 log.cc:927] Time spent T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 12:12:01.633985 19759 leader_election.cc:290] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:01.636089 19792 leader_election.cc:290] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 13 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:01.636531 19764 raft_consensus.cc:493] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:01.637125 19764 raft_consensus.cc:515] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:01.569034 19868 consensus_queue.cc:1048] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.034s
W20260709 12:12:01.641332 19848 log.cc:927] Time spent T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.500s	user 0.000s	sys 0.002s
I20260709 12:12:01.595165 19842 raft_consensus.cc:2804] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:01.594933 19705 leader_election.cc:290] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:01.643198 19842 raft_consensus.cc:697] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [term 16 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
W20260709 12:12:01.644739 19823 log.cc:927] Time spent T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.961s	user 0.000s	sys 0.002s
I20260709 12:12:01.644418 19842 consensus_queue.cc:237] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:01.583652 19860 raft_consensus.cc:515] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:01.647810 19860 leader_election.cc:290] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:01.595639 19671 raft_consensus.cc:515] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:01.643149 19764 leader_election.cc:290] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:01.651357 19868 raft_consensus.cc:493] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:01.660352 19430 raft_consensus.cc:493] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:01.683334 14334 raft_consensus.cc:2468] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 11.
I20260709 12:12:01.685925 14877 leader_election.cc:304] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:12:01.691588 19764 raft_consensus.cc:2804] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:12:01.694531 19764 raft_consensus.cc:697] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [term 11 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:12:01.694756 14908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:01.695361 19388 consensus_queue.cc:1048] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:12:01.696031 19388 consensus_queue.cc:1243] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer 885067a0d31741bfb5c9935788e315bf log is divergent from this leader: its last log entry 13.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:12:01.702322 14185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56652 (request call id 1278) took 1388 ms. Trace:
I20260709 12:12:01.702800 14185 rpcz_store.cc:276] 0709 12:12:00.314157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:01.223505 (+909348us) service_pool.cc:224] Handling call
0709 12:12:01.223845 (+   340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:01.264525 (+ 40680us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:01.702028 (+437503us) spinlock_profiling.cc:243] Waited 31.6 ms on lock 0x7b5400321ed4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:12:01.702238 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":72583040}
I20260709 12:12:01.707418 14907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:01.708308 19780 raft_consensus.cc:3055] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:01.708770 19780 raft_consensus.cc:740] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:01.709307 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:01.710378 14903 raft_consensus.cc:1240] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 12. Current term is 13. Ops: []
W20260709 12:12:01.710738 14229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:01.710872 19860 raft_consensus.cc:493] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:01.711508 14229 leader_election.cc:304] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:12:01.711364 19860 raft_consensus.cc:515] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:01.712477 14229 leader_election.cc:304] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:01.713394 14229 leader_election.cc:304] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:01.715072 19681 raft_consensus.cc:2749] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:12:01.715793 19681 raft_consensus.cc:493] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:01.716257 19681 raft_consensus.cc:515] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:01.718139 19791 raft_consensus.cc:2804] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:01.718789 19791 raft_consensus.cc:697] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 16 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:01.719808 19791 consensus_queue.cc:237] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:01.713581 19860 leader_election.cc:290] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:01.723253 19750 consensus_queue.cc:1048] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:12:01.726058 14188 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56044 (request call id 3019) took 1880 ms. Trace:
I20260709 12:12:01.726557 14188 rpcz_store.cc:276] 0709 12:11:59.845682 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:59.986219 (+140537us) service_pool.cc:224] Handling call
0709 12:12:01.725835 (+1739616us) spinlock_profiling.cc:243] Waited 732 ms on lock 0x7b540035b454. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:12:01.725991 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1683463552}
I20260709 12:12:01.728091 14184 raft_consensus.cc:1240] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 12:12:01.675490 19873 raft_consensus.cc:493] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:01.739018 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:12:01.720304 19810 log.cc:927] Time spent T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 1.285s	user 0.001s	sys 0.003s
I20260709 12:12:01.770264 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:01.718845 19702 leader_election.cc:290] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:01.718931 19832 leader_election.cc:290] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:01.779036 14263 raft_consensus.cc:1275] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 12:12:01.775476 19840 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.503s	user 0.005s	sys 0.016s
I20260709 12:12:01.674242 19868 raft_consensus.cc:515] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:01.687377 19430 raft_consensus.cc:515] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:12:01.784895 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 71576us
I20260709 12:12:01.770246 19720 leader_election.cc:290] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:01.786963 14229 leader_election.cc:304] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:12:01.806946 19860 raft_consensus.cc:493] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:01.807523 19849 raft_consensus.cc:515] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:01.807689 19860 raft_consensus.cc:515] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:01.768213 19873 raft_consensus.cc:515] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:01.809832 19849 leader_election.cc:290] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 14 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:01.810606 19671 leader_election.cc:290] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 13 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:01.780771 19388 consensus_queue.cc:1048] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 12:12:01.810972 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:01.811673 14905 raft_consensus.cc:2468] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 14.
I20260709 12:12:01.812896 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:01.810473 14904 raft_consensus.cc:1275] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:12:01.742137 19859 consensus_queue.cc:1048] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 12:12:01.795928 19876 raft_consensus.cc:2804] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:12:01.826444 14903 raft_consensus.cc:1275] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:12:01.830184 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:01.831296 14334 raft_consensus.cc:2410] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for term 16 because replica has last-logged OpId of term: 14 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:12:01.709673 19780 consensus_queue.cc:260] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:01.813271 19430 leader_election.cc:290] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:01.832314 14262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41764 (request call id 3078) took 2900 ms. Trace:
I20260709 12:12:01.835065 14262 rpcz_store.cc:276] 0709 12:11:58.931811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:59.640072 (+708261us) service_pool.cc:224] Handling call
0709 12:11:59.640458 (+   386us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:59.640715 (+   257us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:59.640870 (+   155us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:59.643978 (+  3108us) log.cc:844] Serialized 26 byte log entry
0709 12:12:00.158784 (+514806us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:12:00.158825 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:00.158902 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:01.719689 (+1560787us) spinlock_profiling.cc:243] Waited 5.88 ms on lock 0x7b4400022b4c. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2123f74c85 00007f2123f756a2 00007f2126ce71db 00007f2126ce2aaf 00007f2126cd686e 00007f2126cd5bb6 00007f2126cd57d8 00007f2126cdf221 00007f2126cdf1d9 00007f2126cdf169
0709 12:12:01.824248 (+104559us) raft_consensus.cc:1685] finished
0709 12:12:01.824271 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:01.832222 (+  7951us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13524352,"thread_start_us":493220,"threads_started":1,"wal-append.queue_time_us":752203}
I20260709 12:12:01.809954 19873 leader_election.cc:290] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:01.816435 19681 leader_election.cc:290] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:01.836870 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:01.831790 19682 raft_consensus.cc:493] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:01.840618 14262 raft_consensus.cc:2468] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 14.
I20260709 12:12:01.841322 19886 raft_consensus.cc:493] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:01.841857 19886 raft_consensus.cc:515] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:01.809894 19764 consensus_queue.cc:237] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:01.822481 19860 leader_election.cc:290] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:01.847527 14336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50858 (request call id 2128) took 1917 ms. Trace:
I20260709 12:12:01.841094 19885 raft_consensus.cc:493] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:01.846668 14877 leader_election.cc:304] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:12:01.857035 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:01.844509 19886 leader_election.cc:290] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:01.853919 14336 rpcz_store.cc:276] 0709 12:11:59.930529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:59.930789 (+   260us) service_pool.cc:224] Handling call
0709 12:11:59.931164 (+   375us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:59.971410 (+ 40246us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:59.971441 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:59.996061 (+ 24620us) log.cc:844] Serialized 26 byte log entry
0709 12:12:00.642437 (+646376us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:01.155138 (+512701us) log.cc:844] Serialized 14 byte log entry
0709 12:12:01.846912 (+691774us) spinlock_profiling.cc:243] Waited 32 ms on lock 0x7b54001eb7a0. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f21270b6733 00007f212713bdbf 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c
0709 12:12:01.846984 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:01.847096 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:01.847154 (+    58us) raft_consensus.cc:1685] finished
0709 12:12:01.847237 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:01.847439 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":54865,"prepare.queue_time_us":640805,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":52,"raft.queue_time_us":49726,"raft.run_cpu_time_us":311,"raft.run_wall_time_us":49850,"spinlock_wait_cycles":73639296,"thread_start_us":1128407,"threads_started":2,"wal-append.queue_time_us":791768}
I20260709 12:12:01.821487 19853 consensus_queue.cc:1048] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.018s
I20260709 12:12:01.811803 19861 consensus_queue.cc:1048] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.113s
I20260709 12:12:01.865029 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:01.865556 14262 raft_consensus.cc:1275] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:12:01.860469 19870 raft_consensus.cc:2804] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:01.870620 19870 raft_consensus.cc:493] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:01.871029 19870 raft_consensus.cc:3060] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:01.871982 14333 raft_consensus.cc:1240] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:01.857769 19873 raft_consensus.cc:493] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:01.873703 19840 consensus_queue.cc:1059] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:12:01.848501 19763 raft_consensus.cc:493] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:12:01.840993 19682 raft_consensus.cc:515] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:01.870374 19879 raft_consensus.cc:493] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:01.901970 19818 consensus_meta.cc:287] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.576s	user 0.013s	sys 0.000s
I20260709 12:12:01.882011 19780 raft_consensus.cc:3060] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:01.907984 14229 leader_election.cc:304] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:01.914409 14229 leader_election.cc:304] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:01.874291 19873 raft_consensus.cc:515] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:01.900666 19868 leader_election.cc:290] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:01.861847 19885 raft_consensus.cc:515] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:01.921754 14229 leader_election.cc:304] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:01.902256 19671 consensus_queue.cc:1048] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 12:12:01.921449 19886 raft_consensus.cc:2804] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:01.917887 19681 raft_consensus.cc:2749] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:12:01.901715 19763 raft_consensus.cc:515] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:01.915973 19876 raft_consensus.cc:697] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 12 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:01.937781 14229 leader_election.cc:304] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:01.951107 19791 raft_consensus.cc:2804] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:12:01.951735 19791 raft_consensus.cc:697] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 13 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:01.952698 19791 consensus_queue.cc:237] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:01.956888 14229 leader_election.cc:304] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:01.957980 19891 raft_consensus.cc:2749] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:12:01.960795 14229 leader_election.cc:304] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:01.947548 19892 raft_consensus.cc:2804] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:12:01.962167 19892 raft_consensus.cc:493] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:01.962661 19892 raft_consensus.cc:3060] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:01.962467 19876 consensus_queue.cc:237] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:12:01.963989 19887 log.cc:927] Time spent T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 12:12:01.918998 19818 raft_consensus.cc:515] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:01.945400 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:12:02.007917 19889 log.cc:927] Time spent T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:12:02.047313 19892 raft_consensus.cc:515] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:02.064291 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:02.655350 14260 raft_consensus.cc:2468] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 15.
I20260709 12:12:02.178260 14258 raft_consensus.cc:1240] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:02.303929 14339 raft_consensus.cc:1240] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 12:12:02.328833 14264 raft_consensus.cc:1240] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 12. Current term is 13. Ops: []
W20260709 12:12:02.351783 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 391067us
I20260709 12:12:02.657692 14229 leader_election.cc:304] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:02.352420 19891 raft_consensus.cc:2804] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:02.659034 19891 raft_consensus.cc:493] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:02.659513 19891 raft_consensus.cc:3060] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:02.368940 14334 raft_consensus.cc:3060] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:12:02.374553 14261 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41768 (request call id 2149) took 2287 ms (client timeout 1997 ms). Trace:
W20260709 12:12:02.665989 14261 rpcz_store.cc:269] 0709 12:12:00.086799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:00.086927 (+   128us) service_pool.cc:224] Handling call
0709 12:12:02.374247 (+2287320us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b54003151d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:12:02.374449 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2495712512}
I20260709 12:12:02.375559 14262 raft_consensus.cc:1275] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 12. (term mismatch)
I20260709 12:12:02.667315 14262 pending_rounds.cc:85] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec: Aborting all ops after (but not including) 11
I20260709 12:12:02.667587 14262 pending_rounds.cc:107] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec: Aborting uncommitted NO_OP operation due to leader change: 13.12
I20260709 12:12:02.667841 14262 raft_consensus.cc:2889] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:02.387929 14183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 3029) took 2271 ms. Trace:
I20260709 12:12:02.668669 14183 rpcz_store.cc:276] 0709 12:12:00.116270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:00.701007 (+584737us) service_pool.cc:224] Handling call
0709 12:12:00.705383 (+  4376us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:01.458208 (+752825us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:02.387618 (+929410us) spinlock_profiling.cc:243] Waited 713 ms on lock 0x7b540028a5d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:12:02.387851 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1640634112}
I20260709 12:12:02.207597 19628 leader_election.cc:290] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:02.043210 14908 raft_consensus.cc:1240] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [term 11 LEADER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 10. Current term is 11. Ops: [10.9-10.9]
W20260709 12:12:02.287490 14877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:02.147745 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:02.152432 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:02.151721 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:01.999724 19682 leader_election.cc:290] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:02.315567 19697 raft_consensus.cc:3060] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:03.102300 14182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56652 (request call id 1286) took 2408 ms. Trace:
I20260709 12:12:02.236016 19749 raft_consensus.cc:3055] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:12:03.105127 19749 raft_consensus.cc:740] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:12:02.187186 19751 raft_consensus.cc:3055] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:12:02.233923 19731 raft_consensus.cc:493] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:03.150671 19731 raft_consensus.cc:515] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:03.153182 19731 leader_election.cc:290] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:02.004448 19818 leader_election.cc:290] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:12:02.321488 19822 log.cc:927] Time spent T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 1.638s	user 0.005s	sys 0.000s
I20260709 12:12:02.357008 19799 raft_consensus.cc:493] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:03.159198 19799 raft_consensus.cc:515] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:03.160234 19818 raft_consensus.cc:493] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:03.160844 19818 raft_consensus.cc:515] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:12:02.237414 19839 log.cc:927] Time spent T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 1.164s	user 0.006s	sys 0.005s
W20260709 12:12:02.271255 19854 log.cc:927] Time spent T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 1.093s	user 0.004s	sys 0.003s
I20260709 12:12:03.163031 19818 leader_election.cc:290] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:02.061156 19870 raft_consensus.cc:515] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:03.166211 19870 leader_election.cc:290] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 15 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:12:02.311004 19871 log.cc:927] Time spent T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.742s	user 0.003s	sys 0.007s
I20260709 12:12:02.050269 19873 leader_election.cc:290] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:01.915709 19879 raft_consensus.cc:515] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:03.177150 19879 leader_election.cc:290] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:12:02.340624 19880 log.cc:927] Time spent T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.553s	user 0.005s	sys 0.000s
I20260709 12:12:02.322969 19883 raft_consensus.cc:3055] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:03.181994 19883 raft_consensus.cc:740] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:12:03.182982 19883 consensus_queue.cc:260] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:03.184032 19883 raft_consensus.cc:3060] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:03.186226 14335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 1033) took 1638 ms. Trace:
I20260709 12:12:03.186646 14335 rpcz_store.cc:276] 0709 12:12:01.547727 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:01.550115 (+  2388us) service_pool.cc:224] Handling call
0709 12:12:01.551735 (+  1620us) raft_consensus.cc:1471] Updating replica for 4 ops
0709 12:12:01.566409 (+ 14674us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:12:01.582531 (+ 16122us) log.cc:844] Serialized 14 byte log entry
0709 12:12:01.661714 (+ 79183us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:12:01.675052 (+ 13338us) log.cc:844] Serialized 78 byte log entry
0709 12:12:01.675273 (+   221us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:12:01.675317 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:01.675401 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:02.340151 (+664750us) spinlock_profiling.cc:243] Waited 16.5 ms on lock 0x7b24001f7288. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2123ed49c4 00007f2123ed2acb 00007f212408ddc9 00007f212408da55 00007f212408d09d 00007f2126cbf10e 00007f2126cd688c 00007f2126cd5bb6 00007f2126cd57d8 00007f2126cdf221
0709 12:12:03.185835 (+845684us) raft_consensus.cc:1685] finished
0709 12:12:03.185946 (+   111us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:03.186153 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":15357,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":2497,"raft.queue_time_us":10502,"raft.run_cpu_time_us":319,"raft.run_wall_time_us":6311,"spinlock_wait_cycles":37955840,"thread_start_us":64728,"threads_started":1,"wal-append.queue_time_us":152138}
I20260709 12:12:03.189016 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:01.941385 19886 raft_consensus.cc:493] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:03.190716 19886 raft_consensus.cc:3060] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:02.016413 19885 leader_election.cc:290] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:02.656762 19892 leader_election.cc:290] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 13 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:02.655401 14257 raft_consensus.cc:1240] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 12. Current term is 13. Ops: []
I20260709 12:12:03.197115 14257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41764 (request call id 3111) took 1407 ms. Trace:
W20260709 12:12:02.689218 14303 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.174.129:37187 timed out after 2.577s (SENT) [suppressed 16 similar messages]
I20260709 12:12:02.712822 14334 raft_consensus.cc:2468] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 13.
I20260709 12:12:03.199719 14334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55492 (request call id 1039) took 1378 ms. Trace:
I20260709 12:12:03.200073 14334 rpcz_store.cc:276] 0709 12:12:01.821371 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:01.836123 (+ 14752us) service_pool.cc:224] Handling call
0709 12:12:03.199488 (+1363365us) spinlock_profiling.cc:243] Waited 503 ms on lock 0x7b54002800d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:12:03.199624 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1157008128}
W20260709 12:12:02.720712 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 63149.4us
I20260709 12:12:02.730589 14263 raft_consensus.cc:1240] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 19. Current term is 20. Ops: [19.12-19.12]
I20260709 12:12:02.740764 19891 raft_consensus.cc:515] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:02.753677 19912 raft_consensus.cc:493] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:03.206346 19912 raft_consensus.cc:515] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:03.206878 14263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53050 (request call id 1044) took 1425 ms. Trace:
I20260709 12:12:03.207679 19891 leader_election.cc:290] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:03.208856 19912 leader_election.cc:290] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:02.759708 19309 raft_consensus.cc:493] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:02.766556 19913 raft_consensus.cc:493] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:02.784219 19914 raft_consensus.cc:493] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:02.790246 19750 raft_consensus.cc:493] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
W20260709 12:12:02.804456 19851 log.cc:927] Time spent T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 1.492s	user 0.009s	sys 0.003s
I20260709 12:12:03.209781 19309 raft_consensus.cc:515] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:02.811690 19628 raft_consensus.cc:493] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:02.815140 14190 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 3026) took 2701 ms. Trace:
I20260709 12:12:03.211068 19628 raft_consensus.cc:515] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } }
I20260709 12:12:02.816223 14333 raft_consensus.cc:1240] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:03.211722 19913 raft_consensus.cc:515] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:03.213239 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:02.819571 14339 raft_consensus.cc:1275] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:12:03.226626 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:03.227877 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:03.229033 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:02.827236 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:03.230041 14261 raft_consensus.cc:3060] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:02.829787 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:03.234148 14258 raft_consensus.cc:2468] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 14.
I20260709 12:12:03.235239 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:03.236424 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:03.237102 14258 raft_consensus.cc:2393] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 18: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
W20260709 12:12:02.830431 14186 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56044 (request call id 3027) took 2716 ms (client timeout 2577 ms). Trace:
W20260709 12:12:03.237908 14186 rpcz_store.cc:269] 0709 12:12:00.113659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:00.548839 (+435180us) service_pool.cc:224] Handling call
0709 12:12:02.830135 (+2281296us) spinlock_profiling.cc:243] Waited 259 ms on lock 0x7b540019c3d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:12:02.830315 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":595093376}
I20260709 12:12:02.831741 14256 raft_consensus.cc:1240] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 12:12:02.833076 14181 raft_consensus.cc:1240] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 11. Current term is 12. Ops: []
I20260709 12:12:03.240749 14181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56652 (request call id 1287) took 2547 ms. Trace:
I20260709 12:12:02.841003 19763 leader_election.cc:290] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:12:02.844828 14305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:02.905578 19121 raft_consensus.cc:493] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:03.244223 19121 raft_consensus.cc:515] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:03.246496 19121 leader_election.cc:290] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:02.914727 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:02.901891 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:03.248023 14264 raft_consensus.cc:2393] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 16: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:12:02.913028 19671 raft_consensus.cc:493] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:03.248929 19671 raft_consensus.cc:515] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:03.251170 19671 leader_election.cc:290] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:02.926093 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:03.252525 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:03.253908 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:03.254967 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:03.256054 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:03.257071 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:02.927309 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:03.258675 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:03.260236 14337 raft_consensus.cc:1275] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:12:02.928797 14338 raft_consensus.cc:1275] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 16 index: 7. Preceding OpId from leader: term: 17 index: 8. (index mismatch)
I20260709 12:12:02.929811 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:12:02.952795 19862 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.005s	sys 0.005s
W20260709 12:12:03.263168 19862 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.835s	user 0.005s	sys 0.005s
I20260709 12:12:03.266237 19767 raft_consensus.cc:493] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:03.266889 19767 raft_consensus.cc:515] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:03.269191 19767 leader_election.cc:290] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:02.971381 14184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56652 (request call id 1283) took 2597 ms. Trace:
I20260709 12:12:03.269968 14184 rpcz_store.cc:276] 0709 12:12:00.373802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:01.265025 (+891223us) service_pool.cc:224] Handling call
0709 12:12:01.727822 (+462797us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:01.728590 (+   768us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:02.971136 (+1242546us) spinlock_profiling.cc:243] Waited 462 ms on lock 0x7b540035b450. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713a8ad 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:12:02.971300 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1063222656}
I20260709 12:12:02.976522 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:02.976845 19911 raft_consensus.cc:493] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:03.273871 19911 raft_consensus.cc:515] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:03.276718 14330 raft_consensus.cc:1275] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:12:02.991144 14908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59144 (request call id 606) took 1286 ms. Trace:
I20260709 12:12:03.277442 14908 rpcz_store.cc:276] 0709 12:12:01.704747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:01.704938 (+   191us) service_pool.cc:224] Handling call
0709 12:12:01.705315 (+   377us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:02.962321 (+1257006us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:02.990833 (+ 28512us) spinlock_profiling.cc:243] Waited 338 ms on lock 0x7b540065f254. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:12:02.991066 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":776312704}
I20260709 12:12:02.997772 14265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41764 (request call id 3098) took 1946 ms. Trace:
I20260709 12:12:03.241086 14181 rpcz_store.cc:276] 0709 12:12:00.693516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:01.566945 (+873429us) service_pool.cc:224] Handling call
0709 12:12:02.832861 (+1265916us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:03.239656 (+406795us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:03.240559 (+   903us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b540019c3d0. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713a8ad 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:12:03.240682 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2906338688}
I20260709 12:12:03.002739 19843 raft_consensus.cc:3055] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 15 LEADER]: Stepping down as leader of term 15
W20260709 12:12:03.027707 14877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:03.028579 19865 raft_consensus.cc:493] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:03.090516 14155 leader_election.cc:400] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 14 pre-election: Vote denied by peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957) with higher term. Message: Invalid argument: T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 14. Current term is 15.
I20260709 12:12:03.281546 14155 leader_election.cc:403] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:12:03.090945 14154 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 728574us
W20260709 12:12:02.345122 19748 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.235s	user 0.003s	sys 0.002s
W20260709 12:12:03.112725 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 54247.9us
I20260709 12:12:03.121904 19749 consensus_queue.cc:260] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:03.106396 14182 rpcz_store.cc:276] 0709 12:12:00.693228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:01.560167 (+866939us) service_pool.cc:224] Handling call
0709 12:12:01.560470 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:03.091481 (+1531011us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:03.091519 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:03.091608 (+    89us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:12:03.091649 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:03.091723 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:03.101662 (+  9939us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1500662,"thread_start_us":28067,"threads_started":1}
I20260709 12:12:03.125984 14907 raft_consensus.cc:2468] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 12.
I20260709 12:12:03.129360 19697 raft_consensus.cc:493] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:03.143046 19655 raft_consensus.cc:493] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:03.143201 19751 raft_consensus.cc:740] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:02.754288 19791 raft_consensus.cc:2804] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:03.213579 19628 leader_election.cc:290] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187)
I20260709 12:12:03.214007 19913 leader_election.cc:290] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:03.211494 19750 raft_consensus.cc:515] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:03.213413 14911 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53194 (request call id 1044) took 2591 ms. Trace:
I20260709 12:12:03.369010 14261 raft_consensus.cc:2468] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 19.
I20260709 12:12:03.214787 19309 leader_election.cc:290] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:03.370850 14911 rpcz_store.cc:276] 0709 12:12:00.621560 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:00.621965 (+   405us) service_pool.cc:224] Handling call
0709 12:12:00.652129 (+ 30164us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:00.652484 (+   355us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:00.653317 (+   833us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:00.661034 (+  7717us) log.cc:844] Serialized 26 byte log entry
0709 12:12:01.018836 (+357802us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:12:01.018886 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:01.018965 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:02.803849 (+1784884us) spinlock_profiling.cc:243] Waited 6.2 ms on lock 0x7b4400022b4c. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2123f74c85 00007f2123f756a2 00007f2126ce71db 00007f2126ce2aaf 00007f2126cd686e 00007f2126cd5bb6 00007f2126cd57d8 00007f2126cdf221 00007f2126cdf1d9 00007f2126cdf169
0709 12:12:03.213086 (+409237us) raft_consensus.cc:1685] finished
0709 12:12:03.213111 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:03.213346 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8,"raft.queue_time_us":14998,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":5673,"spinlock_wait_cycles":14248704,"thread_start_us":317828,"threads_started":1,"wal-append.queue_time_us":554509}
I20260709 12:12:03.215219 14333 raft_consensus.cc:2410] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for term 15 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 12:12:03.211056 14190 rpcz_store.cc:276] 0709 12:12:00.113405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:00.593841 (+480436us) service_pool.cc:224] Handling call
0709 12:12:00.627799 (+ 33958us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:00.714350 (+ 86551us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:02.814868 (+2100518us) spinlock_profiling.cc:243] Waited 82.1 ms on lock 0x7b540028b4d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:12:02.815055 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":188938112}
I20260709 12:12:03.374222 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:03.375128 14264 raft_consensus.cc:2393] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 15: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:12:03.222743 14331 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 1029) took 1882 ms. Trace:
I20260709 12:12:03.207361 14263 rpcz_store.cc:276] 0709 12:12:01.781554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:01.781662 (+   108us) service_pool.cc:224] Handling call
0709 12:12:01.782039 (+   377us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:03.206003 (+1423964us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:03.206590 (+   587us) spinlock_profiling.cc:243] Waited 948 ms on lock 0x7b5400101b54. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:12:03.206803 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2180755712}
I20260709 12:12:03.197495 14257 rpcz_store.cc:276] 0709 12:12:01.789677 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:02.349097 (+559420us) service_pool.cc:224] Handling call
0709 12:12:02.349342 (+   245us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:03.195267 (+845925us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:03.196829 (+  1562us) spinlock_profiling.cc:243] Waited 306 ms on lock 0x7b54001c2354. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:12:03.197038 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":703425408}
I20260709 12:12:02.967878 19727 raft_consensus.cc:493] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:03.201458 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:03.293200 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:03.295482 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:03.378984 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:03.379096 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:03.278911 14265 rpcz_store.cc:276] 0709 12:12:01.051846 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:01.062283 (+ 10437us) service_pool.cc:224] Handling call
0709 12:12:01.062686 (+   403us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:12:01.063119 (+   433us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:12:01.120428 (+ 57309us) log.cc:844] Serialized 14 byte log entry
0709 12:12:02.814195 (+1693767us) spinlock_profiling.cc:243] Waited 5.28 ms on lock 0x7b18003372a0. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f212cf16ab1 00007f212cf23281 00007f2124030e07 00007f212ce8b9a9 00007f212404d69b 00007f212404b93f 00007f212404dc02 00007f2126cd520b 00007f2126cdad23 00007f2126cdb23a 00007f2127145a2a
0709 12:12:02.914531 (+100336us) log.cc:844] Serialized 14 byte log entry
0709 12:12:02.967128 (+ 52597us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:12:02.969171 (+  2043us) log.cc:844] Serialized 52 byte log entry
0709 12:12:02.969368 (+   197us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:12:02.969936 (+   568us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:02.970020 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:02.997367 (+ 27347us) raft_consensus.cc:1685] finished
0709 12:12:02.997410 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:02.997653 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8414,"prepare.queue_time_us":58537,"prepare.run_cpu_time_us":139,"prepare.run_wall_time_us":4681,"raft.queue_time_us":9839,"raft.run_cpu_time_us":300,"raft.run_wall_time_us":27337,"spinlock_wait_cycles":12144896,"thread_start_us":152211,"threads_started":2,"wal-append.queue_time_us":1768207}
I20260709 12:12:03.321907 19911 leader_election.cc:290] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:03.322176 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
W20260709 12:12:03.356384 19748 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.246s	user 0.011s	sys 0.011s
I20260709 12:12:03.322963 19865 raft_consensus.cc:515] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:03.323982 14908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:03.324421 19843 raft_consensus.cc:740] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:12:03.330688 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:03.403978 14260 raft_consensus.cc:2468] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 15.
I20260709 12:12:03.405040 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:03.405805 14260 raft_consensus.cc:2368] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 12. Current term is 13.
I20260709 12:12:03.329272 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:03.406746 14256 raft_consensus.cc:2393] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 18: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
W20260709 12:12:03.408496 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 719291us
I20260709 12:12:03.331919 19879 raft_consensus.cc:493] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:03.307085 14336 raft_consensus.cc:2410] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for term 17 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
W20260709 12:12:03.363149 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 81289.1us
I20260709 12:12:03.372155 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:03.373658 14904 raft_consensus.cc:1240] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [term 16 LEADER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:03.211242 19914 raft_consensus.cc:515] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:03.379954 14261 raft_consensus.cc:2410] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for term 16 because replica has last-logged OpId of term: 15 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 12:12:03.379655 14905 raft_consensus.cc:2393] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 16: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
W20260709 12:12:03.418133 14907 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59144 (request call id 608) took 1711 ms (client timeout 1891 ms). Trace:
I20260709 12:12:03.425644 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:03.379690 14257 raft_consensus.cc:2468] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 13.
I20260709 12:12:03.320629 14304 leader_election.cc:304] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:12:03.377880 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:03.427255 14263 raft_consensus.cc:3060] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:03.161635 19799 leader_election.cc:290] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:03.371524 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:03.364102 19853 raft_consensus.cc:493] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:03.364367 19741 raft_consensus.cc:493] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:03.387935 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:03.400235 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:03.410635 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:03.411904 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:03.367336 19791 raft_consensus.cc:493] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:03.422847 14229 leader_election.cc:304] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:12:03.375572 14331 rpcz_store.cc:276] 0709 12:12:01.340499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:01.340690 (+   191us) service_pool.cc:224] Handling call
0709 12:12:01.349418 (+  8728us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:01.350099 (+   681us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:01.350134 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:01.350733 (+   599us) log.cc:844] Serialized 26 byte log entry
0709 12:12:01.402550 (+ 51817us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:01.446388 (+ 43838us) log.cc:844] Serialized 14 byte log entry
0709 12:12:01.448250 (+  1862us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:01.448333 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:02.310438 (+862105us) spinlock_profiling.cc:243] Waited 4.35 ms on lock 0x7b4400022b4c. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2123f74c85 00007f2123f756a2 00007f2126ce71db 00007f2126ce2aaf 00007f2126cd686e 00007f2126cd5bb6 00007f2126cd57d8 00007f2126cdf221 00007f2126cdf1d9 00007f2126cdf169
0709 12:12:03.222394 (+911956us) raft_consensus.cc:1685] finished
0709 12:12:03.222508 (+   114us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:03.222668 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19478,"prepare.queue_time_us":43744,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":3689,"raft.run_cpu_time_us":329,"raft.run_wall_time_us":21067,"spinlock_wait_cycles":10007424,"thread_start_us":29826,"threads_started":1,"wal-append.queue_time_us":209607}
W20260709 12:12:03.427204 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 106722us
I20260709 12:12:03.282848 19767 raft_consensus.cc:493] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:03.463869 14876 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:03.429138 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:03.430064 14264 raft_consensus.cc:2393] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 14: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
W20260709 12:12:03.426105 14907 rpcz_store.cc:269] 0709 12:12:01.706993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:01.707160 (+   167us) service_pool.cc:224] Handling call
0709 12:12:03.417869 (+1710709us) spinlock_profiling.cc:243] Waited 1.42 s on lock 0x7b54007760d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:12:03.418039 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3260634880}
I20260709 12:12:03.464386 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:03.434275 14258 raft_consensus.cc:2368] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 12. Current term is 14.
I20260709 12:12:03.466321 14261 raft_consensus.cc:2468] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 13.
I20260709 12:12:03.466817 14260 raft_consensus.cc:2368] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 14. Current term is 15.
I20260709 12:12:03.469451 19750 leader_election.cc:290] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:03.470579 19917 consensus_queue.cc:1048] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:12:03.471572 19843 consensus_queue.cc:260] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:03.472685 19843 raft_consensus.cc:3060] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:03.470084 19750 raft_consensus.cc:493] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:03.370236 19655 raft_consensus.cc:515] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:03.370049 19697 raft_consensus.cc:515] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:03.475790 19655 leader_election.cc:290] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:03.476016 19697 leader_election.cc:290] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:03.473354 19750 raft_consensus.cc:515] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:03.477972 14336 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807"
dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
mode: GRACEFUL
new_leader_uuid: "885067a0d31741bfb5c9935788e315bf"
 from {username='slave'} at 127.0.0.1:50896
I20260709 12:12:03.478560 14336 raft_consensus.cc:606] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 14 LEADER]: Received request to transfer leadership to TS 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:03.461848 14256 raft_consensus.cc:2468] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 13.
I20260709 12:12:03.401708 19749 raft_consensus.cc:3060] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:03.390439 19727 raft_consensus.cc:515] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:03.464668 19741 raft_consensus.cc:515] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:03.437793 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:03.480772 19912 raft_consensus.cc:2804] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:03.499034 14907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:03.499415 14904 raft_consensus.cc:1275] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:12:03.501298 14907 raft_consensus.cc:2393] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 13: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
I20260709 12:12:03.502542 14905 raft_consensus.cc:1275] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:12:03.436794 19763 raft_consensus.cc:2804] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:03.493420 19914 leader_election.cc:290] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:12:03.532598 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 47716.3us
I20260709 12:12:03.533825 14304 leader_election.cc:304] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:12:03.538874 14905 raft_consensus.cc:1275] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
W20260709 12:12:03.538930 14878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:03.543692 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 14 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:03.546619 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:03.540759 14907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:03.550762 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:03.547327 14911 raft_consensus.cc:2468] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 13.
W20260709 12:12:03.544206 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 217067us
I20260709 12:12:03.551890 14910 raft_consensus.cc:1275] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:12:03.553018 14904 raft_consensus.cc:2468] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 19.
I20260709 12:12:03.502030 19912 raft_consensus.cc:493] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:03.477720 19791 raft_consensus.cc:3060] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:03.533895 19763 raft_consensus.cc:493] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:03.464639 19853 raft_consensus.cc:515] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:03.432371 19879 raft_consensus.cc:515] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:03.563396 19912 raft_consensus.cc:3060] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:03.565004 14877 leader_election.cc:304] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:12:03.502777 19309 consensus_queue.cc:1059] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 12:12:03.503372 19917 raft_consensus.cc:493] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:03.494958 19767 raft_consensus.cc:515] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:03.573139 14264 raft_consensus.cc:1275] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:12:03.505942 19799 consensus_queue.cc:1048] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.065s
I20260709 12:12:03.570324 19763 raft_consensus.cc:3060] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:03.641691 14257 raft_consensus.cc:1275] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 12:12:03.464207 19751 consensus_queue.cc:260] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:03.648767 14257 raft_consensus.cc:1240] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:03.572288 19121 consensus_queue.cc:1048] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.039s
W20260709 12:12:03.612946 14360 debug-util.cc:398] Leaking SignalData structure 0x7b08000ab120 after lost signal to thread 12989
W20260709 12:12:03.656862 14360 debug-util.cc:398] Leaking SignalData structure 0x7b08002799c0 after lost signal to thread 14122
W20260709 12:12:03.658413 14360 debug-util.cc:398] Leaking SignalData structure 0x7b08002994c0 after lost signal to thread 14214
W20260709 12:12:03.659667 14360 debug-util.cc:398] Leaking SignalData structure 0x7b0800167aa0 after lost signal to thread 14289
W20260709 12:12:03.659936 14360 debug-util.cc:398] Leaking SignalData structure 0x7b0800167a80 after lost signal to thread 14290
W20260709 12:12:03.661072 14360 debug-util.cc:398] Leaking SignalData structure 0x7b080036f640 after lost signal to thread 14363
W20260709 12:12:03.665958 14360 debug-util.cc:398] Leaking SignalData structure 0x7b08000a4aa0 after lost signal to thread 14936
W20260709 12:12:03.674680 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 106162us
I20260709 12:12:03.675174 14264 raft_consensus.cc:1275] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:12:03.579728 19913 consensus_queue.cc:1048] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.070s
I20260709 12:12:03.607796 19914 consensus_queue.cc:1048] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
W20260709 12:12:03.652127 19937 log.cc:927] Time spent T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
W20260709 12:12:03.688076 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 106425us
I20260709 12:12:03.676774 19935 raft_consensus.cc:2804] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:12:03.680033 19945 consensus_queue.cc:1048] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.035s
I20260709 12:12:03.651374 19702 consensus_queue.cc:1059] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 4, Time since last communication: 0.060s
I20260709 12:12:03.694342 19727 leader_election.cc:290] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:12:03.746683 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 259131us
W20260709 12:12:03.747556 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 71867.4us
I20260709 12:12:03.735580 19911 raft_consensus.cc:493] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:03.736910 19948 raft_consensus.cc:2804] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:03.756521 14338 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6"
dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
mode: GRACEFUL
new_leader_uuid: "885067a0d31741bfb5c9935788e315bf"
 from {username='slave'} at 127.0.0.1:50896
I20260709 12:12:03.759030 14338 raft_consensus.cc:606] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Received request to transfer leadership to TS 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:03.759425 14338 raft_consensus.cc:614] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:12:03.747219 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 213409us
I20260709 12:12:03.769970 14304 leader_election.cc:304] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:12:03.739526 19949 consensus_queue.cc:1048] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 12:12:03.751236 19865 leader_election.cc:290] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:03.581067 19917 raft_consensus.cc:515] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:03.777097 14304 leader_election.cc:304] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:12:03.796463 14263 raft_consensus.cc:2468] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 16.
I20260709 12:12:03.801311 14258 raft_consensus.cc:1240] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:03.760597 19911 raft_consensus.cc:515] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:03.776546 19948 raft_consensus.cc:697] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 19 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:03.767331 19950 consensus_queue.cc:1048] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.047s
W20260709 12:12:03.812259 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 108302us
I20260709 12:12:03.811415 19879 leader_election.cc:290] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:03.818101 19935 raft_consensus.cc:697] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 13 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:12:03.767443 19955 consensus_queue.cc:1048] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 12:12:03.823235 19309 raft_consensus.cc:2804] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:03.812005 19743 consensus_queue.cc:1059] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 12:12:03.824618 19767 leader_election.cc:290] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:12:03.830881 19946 log.cc:927] Time spent T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.180s	user 0.000s	sys 0.001s
W20260709 12:12:03.887030 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 61555us
W20260709 12:12:03.899848 19951 log.cc:927] Time spent T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.151s	user 0.000s	sys 0.001s
W20260709 12:12:03.886406 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 109386us
W20260709 12:12:03.906235 19961 log.cc:927] Time spent T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 12:12:03.823962 19697 consensus_queue.cc:1048] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.064s
W20260709 12:12:03.908644 14303 leader_election.cc:336] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Timed out: RequestConsensusVote RPC to 127.12.174.129:37187 timed out after 1.585s (SENT)
I20260709 12:12:03.914749 14304 leader_election.cc:304] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
W20260709 12:12:03.955163 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 46240.9us
I20260709 12:12:03.923247 19767 raft_consensus.cc:493] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:03.962153 19767 raft_consensus.cc:515] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:03.962939 14258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41764 (request call id 3121) took 1129 ms. Trace:
I20260709 12:12:03.963387 14258 rpcz_store.cc:276] 0709 12:12:02.833281 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:03.467050 (+633769us) service_pool.cc:224] Handling call
0709 12:12:03.801069 (+334019us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:03.803173 (+  2104us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:03.962707 (+159534us) spinlock_profiling.cc:243] Waited 308 ms on lock 0x7b54002fce50. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713a8ad 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:12:03.962865 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":709127040}
I20260709 12:12:03.964502 14256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41764 (request call id 3127) took 1060 ms. Trace:
I20260709 12:12:03.964937 14256 rpcz_store.cc:276] 0709 12:12:02.903823 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:03.501839 (+598016us) service_pool.cc:224] Handling call
0709 12:12:03.503612 (+  1773us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:03.505349 (+  1737us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:03.505384 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:03.505935 (+   551us) log.cc:844] Serialized 26 byte log entry
0709 12:12:03.621474 (+115539us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:12:03.621522 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:03.621605 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:03.964260 (+342655us) raft_consensus.cc:1685] finished
0709 12:12:03.964283 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:03.964440 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1313,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":7077,"thread_start_us":62202,"threads_started":1,"wal-append.queue_time_us":158938}
I20260709 12:12:03.967222 19948 consensus_queue.cc:237] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:03.907068 19949 raft_consensus.cc:2804] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:03.970791 19949 raft_consensus.cc:493] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:03.971199 19949 raft_consensus.cc:3060] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:03.991626 19691 raft_consensus.cc:493] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:03.992313 19691 raft_consensus.cc:515] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:12:03.993916 14360 debug-util.cc:398] Leaking SignalData structure 0x7b0800166cc0 after lost signal to thread 19721
I20260709 12:12:03.993727 19705 consensus_queue.cc:1059] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 12:12:03.994546 14360 debug-util.cc:398] Leaking SignalData structure 0x7b08003669c0 after lost signal to thread 19792
W20260709 12:12:03.994859 14360 debug-util.cc:398] Leaking SignalData structure 0x7b08002a40c0 after lost signal to thread 19796
W20260709 12:12:03.995155 14360 debug-util.cc:398] Leaking SignalData structure 0x7b0800333e40 after lost signal to thread 19798
W20260709 12:12:03.995396 14360 debug-util.cc:398] Leaking SignalData structure 0x7b08003c6fe0 after lost signal to thread 19801
W20260709 12:12:03.995611 14360 debug-util.cc:398] Leaking SignalData structure 0x7b0800318260 after lost signal to thread 19802
W20260709 12:12:03.996037 14360 debug-util.cc:398] Leaking SignalData structure 0x7b08003fed60 after lost signal to thread 19833
I20260709 12:12:03.994752 19705 raft_consensus.cc:3055] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 12 LEADER]: Stepping down as leader of term 12
W20260709 12:12:03.998776 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 84433.2us
I20260709 12:12:04.001806 19969 raft_consensus.cc:2804] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:04.002314 19969 raft_consensus.cc:493] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:04.002638 19969 raft_consensus.cc:3060] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:04.005422 14083 catalog_manager.cc:5697] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } }
I20260709 12:12:04.017185 19935 consensus_queue.cc:237] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:04.019748 19751 raft_consensus.cc:3060] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:12:04.025034 19942 log.cc:927] Time spent T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.663s	user 0.005s	sys 0.000s
I20260709 12:12:03.858312 14257 raft_consensus.cc:3060] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:04.051448 14877 leader_election.cc:304] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:04.057546 14229 leader_election.cc:304] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:04.089587 19914 raft_consensus.cc:2749] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:04.077108 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:12:04.090521 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 337914us
I20260709 12:12:04.092159 14332 raft_consensus.cc:2468] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 18.
I20260709 12:12:04.095526 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:04.092550 14229 leader_election.cc:304] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:04.100790 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:04.000135 19705 raft_consensus.cc:740] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:12:03.933151 19309 raft_consensus.cc:493] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:04.110729 14877 leader_election.cc:304] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
W20260709 12:12:04.118424 14082 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44116 (request call id 160) took 23028 ms (client timeout 15000 ms). Trace:
I20260709 12:12:04.090389 19914 raft_consensus.cc:493] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:04.127211 19750 leader_election.cc:290] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:04.129848 19741 leader_election.cc:290] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:12:04.130453 14360 debug-util.cc:398] Leaking SignalData structure 0x7b0800317ba0 after lost signal to thread 19849
I20260709 12:12:04.092159 19965 raft_consensus.cc:2804] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:04.136968 14186 raft_consensus.cc:1275] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:12:04.137655 19936 raft_consensus.cc:493] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:04.138285 14182 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3"
dest_uuid: "885067a0d31741bfb5c9935788e315bf"
 from {username='slave'} at 127.0.0.1:56652
I20260709 12:12:04.258759 19914 raft_consensus.cc:515] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:04.139541 19834 raft_consensus.cc:493] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:04.139451 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:04.456802 14185 raft_consensus.cc:2468] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 13.
I20260709 12:12:04.458045 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:04.140237 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:04.458918 14187 raft_consensus.cc:3060] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:12:04.140781 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:04.140990 19932 raft_consensus.cc:493] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:04.141674 14188 raft_consensus.cc:3055] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:04.143829 19796 raft_consensus.cc:493] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:04.144304 19802 raft_consensus.cc:2749] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957) with higher term. Message: Invalid argument: T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 14. Current term is 15.
I20260709 12:12:04.137514 19576 raft_consensus.cc:493] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:04.144812 19655 raft_consensus.cc:493] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:04.145139 19835 raft_consensus.cc:493] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:04.145447 19801 raft_consensus.cc:493] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:04.145879 19798 raft_consensus.cc:493] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:04.146332 19792 raft_consensus.cc:493] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
W20260709 12:12:04.185712 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 75196.5us
I20260709 12:12:04.112902 19731 consensus_queue.cc:1048] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.220s
I20260709 12:12:04.060899 19967 consensus_queue.cc:1048] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.194s
I20260709 12:12:04.115573 19799 consensus_queue.cc:1048] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.213s
I20260709 12:12:04.179318 19913 consensus_queue.cc:1048] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.203s
I20260709 12:12:04.096725 19865 consensus_queue.cc:1059] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.092s
I20260709 12:12:04.066335 19962 consensus_queue.cc:1048] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 5, Time since last communication: 0.098s
I20260709 12:12:04.140805 19692 raft_consensus.cc:493] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:04.018354 14083 catalog_manager.cc:5697] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf reported cstate change: term changed from 9 to 12, leader changed from 65c9c1653b3346b39a0e118540e6080c (127.12.174.131) to 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130). New cstate: current_term: 12 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } }
I20260709 12:12:04.116050 19309 raft_consensus.cc:3060] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:04.439919 19121 raft_consensus.cc:2804] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 12:12:04.335860 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 224139us
I20260709 12:12:04.451751 14182 raft_consensus.cc:493] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:04.557827 14182 raft_consensus.cc:3060] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:12:04.139058 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 1.04865e+06us
I20260709 12:12:04.493950 19917 leader_election.cc:290] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:12:04.478966 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 453511us
I20260709 12:12:04.484640 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:04.445339 19965 raft_consensus.cc:493] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:04.469237 19628 raft_consensus.cc:493] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:04.490286 14189 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 3028) took 4374 ms. Trace:
W20260709 12:12:04.582422 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 134262us
I20260709 12:12:04.497911 14265 raft_consensus.cc:3060] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:04.452807 19853 leader_election.cc:290] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:04.522588 14181 raft_consensus.cc:1275] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
W20260709 12:12:04.532414 14877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:04.535445 14187 raft_consensus.cc:2468] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 15.
W20260709 12:12:04.550199 19843 consensus_meta.cc:287] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 1.077s	user 0.009s	sys 0.012s
I20260709 12:12:04.485610 19702 raft_consensus.cc:493] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:04.486146 19691 leader_election.cc:290] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:04.397419 19705 consensus_queue.cc:260] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:04.558333 14229 leader_election.cc:304] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
W20260709 12:12:04.538403 19883 consensus_meta.cc:287] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db: Time spent flushing consensus metadata: real 1.354s	user 0.019s	sys 0.003s
I20260709 12:12:04.465304 14188 raft_consensus.cc:740] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:12:04.559976 14155 leader_election.cc:304] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:04.574945 14186 raft_consensus.cc:2468] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 17.
W20260709 12:12:04.547505 19886 consensus_meta.cc:287] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 1.356s	user 0.006s	sys 0.017s
I20260709 12:12:04.478392 19834 raft_consensus.cc:515] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:04.481686 19767 leader_election.cc:290] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:12:04.585062 14876 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:04.571743 19121 raft_consensus.cc:493] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:04.479396 19932 raft_consensus.cc:515] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:04.493755 19655 raft_consensus.cc:515] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:04.489682 19576 raft_consensus.cc:515] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:04.499083 19835 raft_consensus.cc:515] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:04.464489 19936 raft_consensus.cc:515] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:04.583217 19917 raft_consensus.cc:493] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:04.485402 19796 raft_consensus.cc:515] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:04.513936 19801 raft_consensus.cc:515] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:04.514503 19798 raft_consensus.cc:515] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:04.520794 19792 raft_consensus.cc:515] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:04.623875 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
W20260709 12:12:04.586028 19751 consensus_meta.cc:287] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.566s	user 0.016s	sys 0.000s
I20260709 12:12:04.581787 19802 consensus_queue.cc:1048] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.075s
I20260709 12:12:04.597662 19948 consensus_queue.cc:1059] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 16.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.067s
I20260709 12:12:04.635264 19121 raft_consensus.cc:3060] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:04.653594 19886 raft_consensus.cc:515] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:04.669327 19948 raft_consensus.cc:3055] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:04.669803 19948 raft_consensus.cc:740] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:04.670794 19948 consensus_queue.cc:260] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:04.671432 19798 leader_election.cc:290] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:04.671806 14256 raft_consensus.cc:1240] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:04.672133 19948 raft_consensus.cc:3060] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:04.673022 19576 leader_election.cc:290] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:04.673544 19792 leader_election.cc:290] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:04.674150 14256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41764 (request call id 3139) took 1374 ms. Trace:
I20260709 12:12:04.674500 14256 rpcz_store.cc:276] 0709 12:12:03.299476 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:03.966427 (+666951us) service_pool.cc:224] Handling call
0709 12:12:03.966752 (+   325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:04.672255 (+705503us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:04.673912 (+  1657us) spinlock_profiling.cc:243] Waited 705 ms on lock 0x7b5400031e54. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:12:04.674085 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1621025536}
I20260709 12:12:04.635771 14261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41764 (request call id 3124) took 1748 ms. Trace:
I20260709 12:12:04.636747 19834 leader_election.cc:290] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:04.637018 19932 leader_election.cc:290] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:04.637985 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:04.660619 19705 raft_consensus.cc:3060] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:04.676347 14187 raft_consensus.cc:2468] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 14.
I20260709 12:12:04.675891 19835 leader_election.cc:290] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:04.677392 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:04.678054 14187 raft_consensus.cc:2376] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 15. Re-sending same reply.
I20260709 12:12:04.678980 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:04.679365 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:04.679647 14187 raft_consensus.cc:2468] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 16.
I20260709 12:12:04.680045 14186 raft_consensus.cc:2468] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 19.
I20260709 12:12:04.583506 14189 rpcz_store.cc:276] 0709 12:12:00.115988 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:00.700661 (+584673us) service_pool.cc:224] Handling call
0709 12:12:00.705162 (+  4501us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:00.713425 (+  8263us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:12:00.721206 (+  7781us) log.cc:844] Serialized 14 byte log entry
0709 12:12:01.707103 (+985897us) spinlock_profiling.cc:243] Waited 7.09 ms on lock 0x7b18001c9ba0. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f212cf16ab1 00007f212cf23281 00007f2124030e07 00007f212ce8b9a9 00007f212404d69b 00007f212404b93f 00007f212404dc02 00007f2126cd520b 00007f2126cdad23 00007f2126cdb23a 00007f2127145a2a
0709 12:12:03.129057 (+1421954us) log.cc:844] Serialized 14 byte log entry
0709 12:12:04.146232 (+1017175us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:04.146736 (+   504us) log.cc:844] Serialized 26 byte log entry
0709 12:12:04.146907 (+   171us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:12:04.146943 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:04.147021 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:04.489983 (+342962us) raft_consensus.cc:1685] finished
0709 12:12:04.490015 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:04.490205 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3009671,"prepare.queue_time_us":80860,"prepare.run_cpu_time_us":334,"prepare.run_wall_time_us":846,"raft.queue_time_us":2142189,"raft.run_cpu_time_us":488,"raft.run_wall_time_us":43292,"spinlock_wait_cycles":16306944,"thread_start_us":451530,"threads_started":3,"wal-append.queue_time_us":1574588,"wal-append.run_cpu_time_us":5112,"wal-append.run_wall_time_us":1033556}
I20260709 12:12:04.630640 14188 consensus_queue.cc:260] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:04.680893 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:04.681355 14188 raft_consensus.cc:3060] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:12:04.682631 19980 log.cc:927] Time spent T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 12:12:04.585165 19965 raft_consensus.cc:3060] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:04.675101 14185 raft_consensus.cc:2468] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 18.
I20260709 12:12:04.685375 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:04.674515 19655 leader_election.cc:290] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:04.686203 14339 raft_consensus.cc:2468] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 12.
I20260709 12:12:04.656945 19917 raft_consensus.cc:515] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:04.687474 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:04.688120 14185 raft_consensus.cc:2468] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 15.
I20260709 12:12:04.689047 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:04.595038 14258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41764 (request call id 3137) took 1383 ms. Trace:
I20260709 12:12:04.693095 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:04.681625 14186 raft_consensus.cc:2393] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 18: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
W20260709 12:12:04.549288 19749 consensus_meta.cc:287] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db: Time spent flushing consensus metadata: real 1.047s	user 0.008s	sys 0.010s
W20260709 12:12:04.658526 14303 leader_election.cc:336] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Timed out: RequestConsensusVote RPC to 127.12.174.129:37187 timed out after 1.763s (SENT)
W20260709 12:12:04.709649 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 51164.6us
I20260709 12:12:04.675800 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
W20260709 12:12:04.626135 19970 log.cc:927] Time spent T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.372s	user 0.001s	sys 0.000s
W20260709 12:12:04.606856 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 46971.1us
I20260709 12:12:04.706766 14877 leader_election.cc:304] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:12:04.719702 14184 raft_consensus.cc:2468] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 14.
I20260709 12:12:04.618731 14182 raft_consensus.cc:515] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:12:04.710593 14303 leader_election.cc:336] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Timed out: RequestConsensusVote RPC to 127.12.174.129:37187 timed out after 1.876s (SENT)
I20260709 12:12:04.723086 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:04.723759 14186 raft_consensus.cc:2468] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 16.
I20260709 12:12:04.675611 14261 rpcz_store.cc:276] 0709 12:12:02.887195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:03.467466 (+580271us) service_pool.cc:224] Handling call
0709 12:12:03.524323 (+ 56857us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:03.533676 (+  9353us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:12:03.741819 (+208143us) log.cc:844] Serialized 14 byte log entry
0709 12:12:04.102957 (+361138us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:04.150992 (+ 48035us) log.cc:844] Serialized 26 byte log entry
0709 12:12:04.432769 (+281777us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:12:04.432809 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:04.432885 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:04.624984 (+192099us) spinlock_profiling.cc:243] Waited 25.7 ms on lock 0x7b180041a3a0. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f212cf16ab1 00007f212cf23281 00007f212404e3f3 00007f21240507c1 00007f2124050779 00007f2124050709 00007f21240506d1 00007f212404f9cd 0000000000388634 0000000000388479 00007f212403183a
0709 12:12:04.634003 (+  9019us) raft_consensus.cc:1685] finished
0709 12:12:04.635548 (+  1545us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:04.635702 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15061,"prepare.queue_time_us":283063,"prepare.run_cpu_time_us":81,"prepare.run_wall_time_us":2646,"raft.queue_time_us":10703,"raft.run_cpu_time_us":303,"raft.run_wall_time_us":26253,"spinlock_wait_cycles":59788928,"thread_start_us":508709,"threads_started":2,"wal-append.queue_time_us":359957}
I20260709 12:12:04.725929 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:04.719967 14155 leader_election.cc:304] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:12:04.727959 14155 leader_election.cc:304] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:04.728153 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:04.728910 14189 raft_consensus.cc:2468] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 12.
I20260709 12:12:04.693605 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
W20260709 12:12:04.731437 14257 consensus_meta.cc:287] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.681s	user 0.011s	sys 0.001s
I20260709 12:12:04.732187 14257 raft_consensus.cc:1275] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:12:04.732841 14257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41764 (request call id 3136) took 1521 ms. Trace:
I20260709 12:12:04.721577 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:04.692623 14258 rpcz_store.cc:276] 0709 12:12:03.211935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:03.964305 (+752370us) service_pool.cc:224] Handling call
0709 12:12:03.964674 (+   369us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:03.964915 (+   241us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:12:03.974863 (+  9948us) log.cc:844] Serialized 14 byte log entry
0709 12:12:04.594476 (+619613us) log.cc:844] Serialized 14 byte log entry
0709 12:12:04.594663 (+   187us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:04.594711 (+    48us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:12:04.594767 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:04.594843 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:04.594973 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15523,"prepare.queue_time_us":4227,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":69,"raft.queue_time_us":106855,"raft.run_cpu_time_us":68,"raft.run_wall_time_us":80,"thread_start_us":566686,"threads_started":2,"wal-append.queue_time_us":686362}
I20260709 12:12:04.733170 14257 rpcz_store.cc:276] 0709 12:12:03.211612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:03.857832 (+646220us) service_pool.cc:224] Handling call
0709 12:12:03.858180 (+   348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:04.732550 (+874370us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:04.732775 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:04.556672 19692 raft_consensus.cc:515] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:04.738052 14907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:04.741402 14182 leader_election.cc:290] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 15 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:04.643169 19865 raft_consensus.cc:493] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:04.593786 19628 raft_consensus.cc:515] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:04.723361 19691 raft_consensus.cc:2749] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:04.745234 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:04.746469 14331 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da"
dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
mode: GRACEFUL
new_leader_uuid: "885067a0d31741bfb5c9935788e315bf"
 from {username='slave'} at 127.0.0.1:50896
I20260709 12:12:04.760717 14331 raft_consensus.cc:606] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 18 LEADER]: Received request to transfer leadership to TS 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:04.599499 19960 consensus_queue.cc:1048] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.149s
I20260709 12:12:04.661821 19883 consensus_queue.cc:1059] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.098s
I20260709 12:12:04.726996 19955 raft_consensus.cc:493] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:04.735626 19885 raft_consensus.cc:2749] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:04.741178 19932 raft_consensus.cc:2804] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:04.743057 19655 raft_consensus.cc:2749] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:12:04.748636 19749 raft_consensus.cc:2804] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:12:04.601102 19702 raft_consensus.cc:515] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:04.791393 19749 raft_consensus.cc:493] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:04.791985 19749 raft_consensus.cc:3060] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:04.743588 19799 raft_consensus.cc:493] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:04.792682 19799 raft_consensus.cc:515] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:04.798972 19936 leader_election.cc:290] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:04.772323 19952 raft_consensus.cc:3055] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:12:04.799983 19952 raft_consensus.cc:740] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:04.800474 19796 leader_election.cc:290] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:04.801038 19952 consensus_queue.cc:260] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:04.801833 19749 raft_consensus.cc:515] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:04.804934 19702 leader_election.cc:290] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:04.806219 19749 leader_election.cc:290] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 13 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:04.806862 19952 raft_consensus.cc:3060] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:12:04.764014 19791 consensus_meta.cc:287] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 1.192s	user 0.017s	sys 0.008s
I20260709 12:12:04.809118 19791 raft_consensus.cc:515] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:04.762900 19883 raft_consensus.cc:3055] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:04.810221 19883 raft_consensus.cc:740] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:12:04.810339 14259 raft_consensus.cc:1240] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 12:12:04.811408 19791 leader_election.cc:290] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:04.811110 19883 consensus_queue.cc:260] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:04.764987 19692 leader_election.cc:290] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:04.769014 19917 leader_election.cc:290] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:04.775947 19950 raft_consensus.cc:493] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
W20260709 12:12:04.765542 19990 log.cc:927] Time spent T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 12:12:04.812175 14259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41764 (request call id 3113) took 2021 ms. Trace:
W20260709 12:12:04.766409 19971 log.cc:927] Time spent T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.213s	user 0.001s	sys 0.000s
I20260709 12:12:04.812620 14259 rpcz_store.cc:276] 0709 12:12:02.791209 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:02.797641 (+  6432us) service_pool.cc:224] Handling call
0709 12:12:02.798027 (+   386us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:04.810829 (+2012802us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:04.811876 (+  1047us) spinlock_profiling.cc:243] Waited 2.01 s on lock 0x7b54002229d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:12:04.812095 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4627234048}
I20260709 12:12:04.813994 14263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53050 (request call id 1055) took 1782 ms. Trace:
W20260709 12:12:04.815095 19983 log.cc:927] Time spent T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.212s	user 0.001s	sys 0.000s
I20260709 12:12:04.763231 19955 raft_consensus.cc:515] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:04.808321 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:04.814363 14263 rpcz_store.cc:276] 0709 12:12:03.032119 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:03.799967 (+767848us) service_pool.cc:224] Handling call
0709 12:12:03.800379 (+   412us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:12:03.800856 (+   477us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:12:03.800891 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:12:03.804836 (+  3945us) log.cc:844] Serialized 52 byte log entry
0709 12:12:04.088899 (+284063us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:12:04.088950 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:04.089036 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:04.813758 (+724722us) raft_consensus.cc:1685] finished
0709 12:12:04.813785 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:04.813929 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2151,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":1516,"thread_start_us":259042,"threads_started":1,"wal-append.queue_time_us":646293}
I20260709 12:12:04.795127 19799 leader_election.cc:290] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:12:04.767673 19969 consensus_meta.cc:287] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.765s	user 0.010s	sys 0.007s
W20260709 12:12:04.802613 19981 log.cc:927] Time spent T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.211s	user 0.000s	sys 0.001s
I20260709 12:12:04.812544 19883 raft_consensus.cc:3060] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:12:04.762881 19763 consensus_meta.cc:287] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 1.116s	user 0.025s	sys 0.029s
I20260709 12:12:04.817924 19932 raft_consensus.cc:697] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 15 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
W20260709 12:12:04.839188 19912 consensus_meta.cc:287] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 1.233s	user 0.011s	sys 0.013s
W20260709 12:12:04.118919 14082 rpcz_store.cc:269] 0709 12:11:41.089617 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:41.089944 (+   327us) service_pool.cc:224] Handling call
0709 12:12:04.118303 (+23028359us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:11:58.985193 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:11:58.985856 (+   663us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:11:58.985910 (+    54us) write_op.cc:435] Acquired schema lock
0709 12:11:58.985929 (+    19us) tablet.cc:662] Decoding operations
0709 12:11:59.206700 (+220771us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:11:59.242762 (+ 36062us) write_op.cc:641] Partition lock acquired for write op
0709 12:11:59.244557 (+  1795us) tablet.cc:685] Acquiring locks for 18 operations
0709 12:11:59.255136 (+ 10579us) tablet.cc:701] Row locks acquired
0709 12:11:59.255186 (+    50us) write_op.cc:260] PREPARE: finished
0709 12:11:59.255373 (+   187us) write_op.cc:270] Start()
0709 12:11:59.255533 (+   160us) write_op.cc:276] Timestamp: P: 1783599119255307 usec, L: 0
0709 12:11:59.255569 (+    36us) op_driver.cc:348] REPLICATION: starting
0709 12:11:59.256361 (+   792us) log.cc:844] Serialized 7098 byte log entry
0709 12:11:59.665518 (+409157us) op_driver.cc:464] REPLICATION: finished
0709 12:11:59.995544 (+330026us) spinlock_profiling.cc:243] Waited 16 ms on lock 0x7b4400022b4c. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2123f74c85 00007f2123f756a2 00007f2126ce71db 00007f2126ce2aaf 00007f21240310ac 00007f212ce8b9a9 00007f212404d69b 00007f212404b93f 00007f212404dc02 00007f212ab71ef0
0709 12:12:01.232932 (+1237388us) spinlock_profiling.cc:243] Waited 2.33 ms on lock 0x7b1800426400. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f212cf16ab1 00007f212cf23281 00007f212404e3f3 00007f21240507c1 00007f2124050779 00007f2124050709 00007f21240506d1 00007f212404f9cd 0000000000388634 0000000000388479 00007f212403183a
0709 12:12:01.233127 (+   195us) write_op.cc:301] APPLY: starting
0709 12:12:01.233235 (+   108us) tablet.cc:1367] starting BulkCheckPresence
0709 12:12:01.719480 (+486245us) tablet.cc:1370] finished BulkCheckPresence
0709 12:12:01.719526 (+    46us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:12:01.993376 (+273850us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:12:02.013021 (+ 19645us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=36,key_file_lookups=36,delta_file_lookups=36,mrs_lookups=0
0709 12:12:02.039687 (+ 26666us) write_op.cc:312] APPLY: finished
0709 12:12:02.049848 (+ 10161us) log.cc:844] Serialized 164 byte log entry
0709 12:12:02.062351 (+ 12503us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:02.062567 (+   216us) write_op.cc:454] Released schema lock
0709 12:12:02.062649 (+    82us) write_op.cc:341] FINISH: Updating metrics
0709 12:12:02.063221 (+   572us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:02.063250 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2326623,"reported_tablets":28,"child_traces":[["op",{"apply.queue_time_us":783900,"apply.run_cpu_time_us":44220,"apply.run_wall_time_us":830051,"cfile_cache_hit":74,"cfile_cache_hit_bytes":79511,"num_ops":18,"prepare.queue_time_us":169856,"prepare.run_cpu_time_us":13351,"prepare.run_wall_time_us":369393,"raft.queue_time_us":171929,"raft.run_cpu_time_us":25834,"raft.run_wall_time_us":808967,"replication_time_us":398702,"spinlock_wait_cycles":42249216,"thread_start_us":908307,"threads_started":5,"wal-append.queue_time_us":170149,"wal-append.run_cpu_time_us":10795,"wal-append.run_wall_time_us":2094258}]]}
I20260709 12:12:04.745394 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:04.822392 19969 raft_consensus.cc:515] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:04.738131 14155 leader_election.cc:304] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:04.747018 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:05.021461 14187 raft_consensus.cc:2468] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 15.
I20260709 12:12:04.910471 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:04.912878 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:04.739872 14265 raft_consensus.cc:2468] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 15.
I20260709 12:12:04.920995 14262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41764 (request call id 3114) took 2129 ms. Trace:
I20260709 12:12:04.923792 14303 leader_election.cc:304] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:12:04.924162 14260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41764 (request call id 3128) took 2019 ms. Trace:
W20260709 12:12:04.926388 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 350935us
W20260709 12:12:04.930533 14230 leader_election.cc:336] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957): Timed out: RequestConsensusVote RPC to 127.12.174.131:45957 timed out after 1.508s (SENT)
I20260709 12:12:04.945873 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:04.947245 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:04.950544 14908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:04.956096 14188 raft_consensus.cc:1275] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:12:04.755122 19865 raft_consensus.cc:515] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:04.817764 19950 raft_consensus.cc:515] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:05.044983 14262 rpcz_store.cc:276] 0709 12:12:02.791520 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:02.796984 (+  5464us) service_pool.cc:224] Handling call
0709 12:12:02.797327 (+   343us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:03.180275 (+382948us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:03.180310 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:03.180786 (+   476us) log.cc:844] Serialized 26 byte log entry
0709 12:12:03.412444 (+231658us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:12:03.412487 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:03.480594 (+ 68107us) spinlock_profiling.cc:243] Waited 382 ms on lock 0x7b54002017d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:12:03.480649 (+    55us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:04.774464 (+1293815us) spinlock_profiling.cc:243] Waited 13.6 ms on lock 0x7b24001634a8. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2123ed49c4 00007f2123ed2acb 00007f212408ddc9 00007f212408da55 00007f212408cfb0 00007f2126d03488 00007f2126d03be8 00007f2126cdb398 00007f2126cd676a 00007f2126cd5bb6
0709 12:12:04.920126 (+145662us) raft_consensus.cc:1685] finished
0709 12:12:04.920172 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:04.920624 (+   452us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":14467,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":99,"spinlock_wait_cycles":910972544,"thread_start_us":231247,"threads_started":1,"wal-append.queue_time_us":354733}
I20260709 12:12:05.067552 19950 leader_election.cc:290] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:04.899173 12986 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
W20260709 12:12:05.069665 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 146404us
I20260709 12:12:05.072700 19886 leader_election.cc:290] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:04.901655 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:05.074579 14182 raft_consensus.cc:2468] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 17.
I20260709 12:12:04.860737 19965 raft_consensus.cc:515] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:04.891857 14083 catalog_manager.cc:5697] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } }
I20260709 12:12:05.087811 19865 leader_election.cc:290] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:12:05.088280 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 437929us
I20260709 12:12:04.964758 19879 raft_consensus.cc:2749] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:05.011348 19969 leader_election.cc:290] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:05.014576 19791 raft_consensus.cc:493] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:04.970849 14186 raft_consensus.cc:2468] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 12.
I20260709 12:12:04.961645 19801 leader_election.cc:290] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:04.959962 19628 leader_election.cc:290] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:04.969363 19912 raft_consensus.cc:515] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:05.101943 19791 raft_consensus.cc:515] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:05.103425 19962 consensus_queue.cc:1059] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:12:05.104550 19912 leader_election.cc:290] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:05.104964 19791 leader_election.cc:290] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:05.105365 19911 leader_election.cc:290] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:05.106102 19702 raft_consensus.cc:3055] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:05.106635 19702 raft_consensus.cc:740] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:05.107067 14264 raft_consensus.cc:1240] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 12:12:05.108106 19702 consensus_queue.cc:260] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:05.092907 19750 consensus_queue.cc:1059] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.017s
I20260709 12:12:05.110530 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:05.111480 14912 raft_consensus.cc:3060] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:04.967123 19121 raft_consensus.cc:515] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:05.075474 14190 raft_consensus.cc:2468] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 16.
I20260709 12:12:05.112324 19973 raft_consensus.cc:3055] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:05.112887 19973 raft_consensus.cc:740] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:05.113493 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:05.114497 14190 raft_consensus.cc:2468] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 16.
I20260709 12:12:05.114207 19973 consensus_queue.cc:260] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:05.115893 19973 raft_consensus.cc:3060] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:04.966660 19763 raft_consensus.cc:515] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:05.117823 19999 raft_consensus.cc:3055] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:05.118274 19999 raft_consensus.cc:740] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:12:05.108006 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:05.121281 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:12:05.053820 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 123556us
I20260709 12:12:05.122185 14186 raft_consensus.cc:2468] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 12.
I20260709 12:12:05.119524 19999 consensus_queue.cc:260] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:05.123310 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:05.124001 14186 raft_consensus.cc:3060] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:04.969511 19932 consensus_queue.cc:237] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:05.121898 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:05.125155 14190 raft_consensus.cc:2468] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 17.
I20260709 12:12:05.125806 19999 raft_consensus.cc:3060] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:05.087970 14910 raft_consensus.cc:1240] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 12:12:05.127203 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:05.109396 14264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41764 (request call id 3135) took 2109 ms. Trace:
I20260709 12:12:05.129853 19692 raft_consensus.cc:2749] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:12:05.130322 14264 rpcz_store.cc:276] 0709 12:12:03.000166 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:03.678238 (+678072us) service_pool.cc:224] Handling call
0709 12:12:03.698712 (+ 20474us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:05.107600 (+1408888us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:05.109030 (+  1430us) spinlock_profiling.cc:243] Waited 1.41 s on lock 0x7b5400072954. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:12:05.109299 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3237695744}
I20260709 12:12:05.045198 14260 rpcz_store.cc:276] 0709 12:12:02.904101 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:04.129277 (+1225176us) service_pool.cc:224] Handling call
0709 12:12:04.129651 (+   374us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:04.129892 (+   241us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:12:04.130216 (+   324us) log.cc:844] Serialized 14 byte log entry
0709 12:12:04.922994 (+792778us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:04.923172 (+   178us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:04.923398 (+   226us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:04.923573 (+   175us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:04.923876 (+   303us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":71243,"prepare.queue_time_us":3810,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":51,"raft.queue_time_us":78100,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":152,"thread_start_us":720707,"threads_started":2,"wal-append.queue_time_us":417937}
I20260709 12:12:05.131508 14259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53050 (request call id 1061) took 1035 ms. Trace:
I20260709 12:12:05.079685 14909 raft_consensus.cc:2468] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 14.
I20260709 12:12:05.131879 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:05.131806 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:05.134274 14264 raft_consensus.cc:3060] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:12:05.135151 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:05.136332 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:05.136478 14330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 1052) took 1060 ms. Trace:
I20260709 12:12:05.087996 19965 leader_election.cc:290] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 17 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:05.075960 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:05.143239 19965 consensus_queue.cc:1048] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:12:05.143719 14187 raft_consensus.cc:2468] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 13.
I20260709 12:12:05.146374 14190 raft_consensus.cc:2410] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for term 19 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 8.
I20260709 12:12:05.108717 19914 leader_election.cc:290] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:05.142431 14184 raft_consensus.cc:2393] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 19: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:12:05.168670 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:05.172271 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:05.170168 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:05.176290 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:05.182935 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:05.142099 14330 rpcz_store.cc:276] 0709 12:12:04.076298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:04.076452 (+   154us) service_pool.cc:224] Handling call
0709 12:12:04.643232 (+566780us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:04.643673 (+   441us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:04.643702 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:04.644231 (+   529us) log.cc:844] Serialized 26 byte log entry
0709 12:12:04.927469 (+283238us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:12:04.927587 (+   118us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:04.927762 (+   175us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:05.135966 (+208204us) raft_consensus.cc:1685] finished
0709 12:12:05.135989 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:05.136216 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1512,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":11754,"thread_start_us":282553,"threads_started":1,"wal-append.queue_time_us":414715}
I20260709 12:12:05.131948 14259 rpcz_store.cc:276] 0709 12:12:04.096162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:04.813725 (+717563us) service_pool.cc:224] Handling call
0709 12:12:04.814127 (+   402us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:04.814360 (+   233us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:12:04.814987 (+   627us) log.cc:844] Serialized 14 byte log entry
0709 12:12:05.130742 (+315755us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:05.130857 (+   115us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:12:05.130954 (+    97us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:05.131083 (+   129us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:05.131323 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16065,"prepare.queue_time_us":186,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"raft.queue_time_us":20317,"raft.run_cpu_time_us":211,"raft.run_wall_time_us":216,"thread_start_us":249886,"threads_started":1}
I20260709 12:12:05.188474 14190 raft_consensus.cc:2468] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 15.
I20260709 12:12:05.183274 19121 leader_election.cc:290] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 20 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:05.190119 14262 raft_consensus.cc:1240] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 19. Current term is 20. Ops: [19.12-19.12]
I20260709 12:12:05.190717 14181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 3033) took 1040 ms. Trace:
I20260709 12:12:05.191205 14181 rpcz_store.cc:276] 0709 12:12:04.141447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:04.148604 (+  7157us) service_pool.cc:224] Handling call
0709 12:12:04.447098 (+298494us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:04.587128 (+140030us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:05.119587 (+532459us) spinlock_profiling.cc:243] Waited 44 ms on lock 0x7b5400421654. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:12:05.182232 (+ 62645us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":101264128}
I20260709 12:12:05.192901 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:05.185840 19950 raft_consensus.cc:2804] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:05.194303 19950 raft_consensus.cc:493] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:05.194823 19950 raft_consensus.cc:3060] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:12:05.195367 19705 consensus_meta.cc:287] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.519s	user 0.008s	sys 0.011s
W20260709 12:12:05.195701 19949 consensus_meta.cc:287] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 1.224s	user 0.014s	sys 0.014s
I20260709 12:12:05.181054 19763 leader_election.cc:290] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 15 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:12:05.205874 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 77228.4us
I20260709 12:12:05.190250 14188 raft_consensus.cc:2468] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 14.
I20260709 12:12:05.188822 14189 raft_consensus.cc:2468] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 14.
I20260709 12:12:05.093366 14083 catalog_manager.cc:5697] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf reported cstate change: term changed from 9 to 11, leader changed from 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) to 885067a0d31741bfb5c9935788e315bf (127.12.174.129). New cstate: current_term: 11 leader_uuid: "885067a0d31741bfb5c9935788e315bf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:05.220515 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:05.223510 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:05.223707 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:05.224469 14188 raft_consensus.cc:2468] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 17.
I20260709 12:12:05.225755 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:05.227375 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:05.209551 19702 raft_consensus.cc:3060] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:05.231947 14190 raft_consensus.cc:2468] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 13.
I20260709 12:12:05.235072 12986 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:05.236547 14876 leader_election.cc:304] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:05.241863 14181 raft_consensus.cc:3060] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:05.220268 19949 raft_consensus.cc:515] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:05.243831 14083 catalog_manager.cc:5697] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } }
W20260709 12:12:05.227972 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 126575us
I20260709 12:12:05.246608 19955 leader_election.cc:290] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:05.247697 14909 raft_consensus.cc:2393] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 15: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
I20260709 12:12:05.248255 14182 raft_consensus.cc:2468] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 13.
I20260709 12:12:05.252852 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:05.262614 14187 raft_consensus.cc:2393] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 13: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:12:05.263329 14912 raft_consensus.cc:2468] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 14.
I20260709 12:12:05.265259 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:12:05.267573 14154 service_pool.cc:136] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:56652 dropped due to backpressure: service queue is full with 50 items
I20260709 12:12:05.270848 14184 raft_consensus.cc:2468] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 14.
I20260709 12:12:05.271553 14184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56044 (request call id 3044) took 1127 ms. Trace:
I20260709 12:12:05.271934 14184 rpcz_store.cc:276] 0709 12:12:04.144407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:05.180938 (+1036531us) service_pool.cc:224] Handling call
0709 12:12:05.271481 (+ 90543us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":27008}
I20260709 12:12:05.272397 19949 leader_election.cc:290] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:12:05.272716 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 438999us
I20260709 12:12:05.274780 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:05.275810 14083 catalog_manager.cc:5697] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf reported cstate change: term changed from 11 to 13, leader changed from 65c9c1653b3346b39a0e118540e6080c (127.12.174.131) to 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130). New cstate: current_term: 13 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } }
I20260709 12:12:05.277922 19955 raft_consensus.cc:2804] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:05.284974 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:05.285845 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:05.286059 14262 raft_consensus.cc:2468] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 14.
W20260709 12:12:05.287438 14230 leader_election.cc:336] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957): Timed out: RequestConsensusVote RPC to 127.12.174.131:45957 timed out after 1.603s (SENT)
I20260709 12:12:05.288148 14330 raft_consensus.cc:1240] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 15. Current term is 16. Ops: []
W20260709 12:12:05.288334 14230 leader_election.cc:336] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957): Timed out: RequestConsensusVote RPC to 127.12.174.131:45957 timed out after 1.624s (SENT)
I20260709 12:12:05.289012 14230 leader_election.cc:304] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:05.297248 14186 raft_consensus.cc:2468] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 17.
I20260709 12:12:05.288004 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:05.298864 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:05.298462 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:05.301857 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:05.303766 14876 leader_election.cc:304] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:12:05.312626 20000 raft_consensus.cc:2749] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 12:12:05.313855 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 51694.6us
I20260709 12:12:05.314375 14190 raft_consensus.cc:2393] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 15: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
I20260709 12:12:05.313897 14189 raft_consensus.cc:2468] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 14.
I20260709 12:12:05.316534 14229 leader_election.cc:304] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:12:05.317158 14187 raft_consensus.cc:2468] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 12.
I20260709 12:12:05.318516 19914 raft_consensus.cc:2804] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:05.319023 19914 raft_consensus.cc:493] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:12:05.319597 20010 log.cc:927] Time spent T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:12:05.323873 14188 raft_consensus.cc:2468] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 18.
I20260709 12:12:05.295178 19955 raft_consensus.cc:697] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 15 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:12:05.326711 19955 consensus_queue.cc:237] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:05.330494 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:05.332077 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:05.334226 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:05.335089 14259 raft_consensus.cc:2468] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 16.
I20260709 12:12:05.318754 14182 raft_consensus.cc:2468] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 14.
I20260709 12:12:05.333366 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:12:05.333570 14304 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:05.319504 19914 raft_consensus.cc:3060] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:05.336069 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:05.267941 14154 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:56652 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56046 (request call id 2607)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56046 (request call id 2608)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56046 (request call id 2595)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56046 (request call id 2613)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56044 (request call id 3061)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56046 (request call id 2610)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56046 (request call id 2599)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56046 (request call id 2585)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56044 (request call id 3066)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56046 (request call id 2612)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56046 (request call id 2592)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56046 (request call id 2579)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56046 (request call id 2598)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56046 (request call id 2578)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56044 (request call id 3068)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56046 (request call id 2611)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56046 (request call id 2575)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56046 (request call id 2606)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56046 (request call id 2586)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 3034)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 3036)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 3037)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 3039)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 3046)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 3047)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56652 (request call id 1304)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 3051)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 3053)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 3054)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 3055)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 3056)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 3057)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 3059)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 3062)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 3072)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56046 (request call id 2574)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56046 (request call id 2576)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56046 (request call id 2582)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56046 (request call id 2583)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56046 (request call id 2584)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56046 (request call id 2591)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56046 (request call id 2596)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56046 (request call id 2600)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56046 (request call id 2601)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56046 (request call id 2602)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56046 (request call id 2604)
W20260709 12:12:05.334259 19952 consensus_meta.cc:287] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.516s	user 0.009s	sys 0.006s
W20260709 12:12:05.350440 14304 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:05.362885 19121 raft_consensus.cc:2804] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:05.363528 19121 raft_consensus.cc:493] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:05.363945 19121 raft_consensus.cc:3060] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:05.366541 14264 raft_consensus.cc:2468] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 17.
W20260709 12:12:05.368340 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 85438.6us
I20260709 12:12:05.368381 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
W20260709 12:12:05.374081 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 85835.5us
I20260709 12:12:05.371968 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:05.378333 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:05.381245 14331 raft_consensus.cc:3060] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:05.385066 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:05.394296 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:05.396997 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:05.399730 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:05.410089 14184 raft_consensus.cc:2468] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 15.
W20260709 12:12:05.408419 14302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:05.416422 14259 raft_consensus.cc:1275] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
W20260709 12:12:05.418802 14878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:05.421809 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:05.422628 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
W20260709 12:12:05.429090 19883 consensus_meta.cc:287] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db: Time spent flushing consensus metadata: real 0.601s	user 0.007s	sys 0.010s
I20260709 12:12:05.430789 14876 leader_election.cc:304] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:05.369270 14083 catalog_manager.cc:5697] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } }
W20260709 12:12:05.395015 19309 consensus_meta.cc:287] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.717s	user 0.012s	sys 0.012s
I20260709 12:12:05.442178 19309 raft_consensus.cc:515] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:05.444716 19309 leader_election.cc:290] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:05.452876 14331 raft_consensus.cc:2468] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 14.
W20260709 12:12:05.475180 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 59953.2us
W20260709 12:12:05.476650 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 63244.6us
I20260709 12:12:05.478556 14262 raft_consensus.cc:3060] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:05.481093 14181 raft_consensus.cc:2468] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 19.
I20260709 12:12:05.481191 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:05.490545 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:05.484452 14181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56044 (request call id 3041) took 1340 ms. Trace:
I20260709 12:12:05.491529 14184 raft_consensus.cc:2468] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 13.
I20260709 12:12:05.491756 14181 rpcz_store.cc:276] 0709 12:12:04.143606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:05.192336 (+1048730us) service_pool.cc:224] Handling call
0709 12:12:05.484380 (+292044us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:05.493326 14876 leader_election.cc:304] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:05.489764 14330 raft_consensus.cc:2468] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 13.
I20260709 12:12:05.432904 14083 catalog_manager.cc:5697] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf reported cstate change: term changed from 9 to 11, leader changed from 65c9c1653b3346b39a0e118540e6080c (127.12.174.131) to 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130). New cstate: current_term: 11 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } }
I20260709 12:12:05.497915 19967 raft_consensus.cc:2804] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:05.498481 19967 raft_consensus.cc:493] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:05.498705 14258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53050 (request call id 1060) took 1402 ms. Trace:
I20260709 12:12:05.499311 14258 rpcz_store.cc:276] 0709 12:12:04.096008 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:04.755939 (+659931us) service_pool.cc:224] Handling call
0709 12:12:04.763777 (+  7838us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:04.803347 (+ 39570us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:12:04.803805 (+   458us) log.cc:844] Serialized 14 byte log entry
0709 12:12:05.179274 (+375469us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:05.206738 (+ 27464us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:12:05.224298 (+ 17560us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:05.498253 (+273955us) spinlock_profiling.cc:243] Waited 39.2 ms on lock 0x7b54003813d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:12:05.498301 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:05.498473 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":272,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":5213,"raft.run_cpu_time_us":258,"raft.run_wall_time_us":18779,"spinlock_wait_cycles":90220800,"thread_start_us":279266,"threads_started":1,"wal-append.queue_time_us":261721}
I20260709 12:12:05.501771 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:05.503188 19932 raft_consensus.cc:493] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:05.504222 19932 raft_consensus.cc:515] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:05.504837 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:05.505666 14258 raft_consensus.cc:3060] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:05.507475 19932 leader_election.cc:290] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:05.501703 19121 raft_consensus.cc:515] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:05.502930 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:05.509488 14184 raft_consensus.cc:2468] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 14.
I20260709 12:12:05.510471 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:05.510469 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
W20260709 12:12:05.495234 20011 log.cc:927] Time spent T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.225s	user 0.000s	sys 0.002s
W20260709 12:12:05.515470 14302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:05.515769 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:05.516266 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:12:05.516767 14302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:05.516938 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:12:05.518107 14230 leader_election.cc:336] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957): Timed out: RequestConsensusVote RPC to 127.12.174.131:45957 timed out after 1.685s (SENT)
I20260709 12:12:05.517141 14185 raft_consensus.cc:2410] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for term 19 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 8.
I20260709 12:12:05.498950 19967 raft_consensus.cc:3060] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:05.511868 14184 raft_consensus.cc:2376] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 17. Re-sending same reply.
I20260709 12:12:05.522624 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:12:05.503113 14155 connection.cc:256] RPC call timeout handler was delayed by -3.5846815300001253s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19770000000000001s for a response
W20260709 12:12:05.523764 14155 connection.cc:256] RPC call timeout handler was delayed by -3.5666815300000962s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19970000000000002s for a response
I20260709 12:12:05.527748 14258 raft_consensus.cc:2468] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 15.
I20260709 12:12:05.528184 14230 leader_election.cc:304] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:05.532400 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:05.534340 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:05.514439 19883 raft_consensus.cc:2804] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:12:05.536484 14911 raft_consensus.cc:2393] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 17: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
I20260709 12:12:05.493937 19309 raft_consensus.cc:493] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:05.542804 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:05.538164 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:05.545969 14181 raft_consensus.cc:2468] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 12.
I20260709 12:12:05.543511 14184 raft_consensus.cc:2468] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 14.
I20260709 12:12:05.550275 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:05.552078 14187 raft_consensus.cc:2393] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 16: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:12:05.552858 14185 raft_consensus.cc:2410] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
W20260709 12:12:05.553458 14155 connection.cc:256] RPC call timeout handler was delayed by -2.7500952830000642s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1572s for a response
W20260709 12:12:05.553964 14155 connection.cc:256] RPC call timeout handler was delayed by -2.7203952830000162s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1605s for a response
W20260709 12:12:05.554342 14155 connection.cc:256] RPC call timeout handler was delayed by -2.5664952829999947s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1776s for a response
W20260709 12:12:05.554700 14155 connection.cc:256] RPC call timeout handler was delayed by -2.5502952829999685s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1794s for a response
I20260709 12:12:05.507601 19965 consensus_queue.cc:1048] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.038s
W20260709 12:12:05.556072 14155 connection.cc:256] RPC call timeout handler was delayed by -2.4773952830000781s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1875s for a response
W20260709 12:12:05.561589 14155 connection.cc:256] RPC call timeout handler was delayed by -2.3963952830001745s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1965s for a response
I20260709 12:12:05.556006 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: true dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:05.558496 14186 raft_consensus.cc:2468] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 14.
W20260709 12:12:05.562027 14155 connection.cc:256] RPC call timeout handler was delayed by -2.3504952830001002s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2016s for a response
I20260709 12:12:05.561956 14332 raft_consensus.cc:1217] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Deduplicated request from leader. Original: 9.8->[10.9-10.9]   Dedup: 10.9->[]
W20260709 12:12:05.562582 14155 connection.cc:256] RPC call timeout handler was delayed by -2.3153952830000435s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20550000000000002s for a response
W20260709 12:12:05.563083 14155 connection.cc:256] RPC call timeout handler was delayed by -2.1974952830000802s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21860000000000002s for a response
I20260709 12:12:05.563983 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:05.558027 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:05.541700 19912 raft_consensus.cc:2749] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:05.564790 14332 raft_consensus.cc:1240] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 12:12:05.580366 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:05.565217 14181 raft_consensus.cc:2468] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 16.
I20260709 12:12:05.566278 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:05.566951 19121 leader_election.cc:290] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 17 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:05.551928 19932 raft_consensus.cc:493] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:05.567966 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:05.584769 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:05.570030 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:05.570986 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:05.571511 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:05.572958 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:05.574074 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:05.575098 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:05.536571 19883 raft_consensus.cc:493] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:05.587836 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: true dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
W20260709 12:12:05.581512 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 71865.4us
W20260709 12:12:05.563452 14155 connection.cc:256] RPC call timeout handler was delayed by -1.9319952830001057s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2481s for a response
I20260709 12:12:05.595399 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:05.587541 14333 raft_consensus.cc:2468] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 15.
W20260709 12:12:05.599510 14155 connection.cc:256] RPC call timeout handler was delayed by -1.7852952830000959s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2644s for a response
W20260709 12:12:05.600582 14155 connection.cc:256] RPC call timeout handler was delayed by -1.4234952829999656s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3046s for a response
I20260709 12:12:05.588431 14336 raft_consensus.cc:2468] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 16.
I20260709 12:12:05.603746 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:05.608371 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:12:05.610026 14265 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53050 (request call id 1056) took 1501 ms (client timeout 1888 ms). Trace:
I20260709 12:12:05.610155 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:05.611038 14256 raft_consensus.cc:2393] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 19: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:12:05.611436 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:05.611969 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:12:05.610517 14265 rpcz_store.cc:269] 0709 12:12:04.095124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:04.095269 (+   145us) service_pool.cc:224] Handling call
0709 12:12:05.559217 (+1463948us) spinlock_profiling.cc:243] Waited 399 ms on lock 0x7b54001c1e54. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:12:05.596064 (+ 36847us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":918598016}
I20260709 12:12:05.612118 14339 raft_consensus.cc:3060] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:05.613224 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:05.613149 14337 raft_consensus.cc:2410] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for term 16 because replica has last-logged OpId of term: 15 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 12:12:05.613499 14303 leader_election.cc:304] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:12:05.617074 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:05.618793 14338 raft_consensus.cc:2393] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 15: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:12:05.600086 19952 consensus_queue.cc:1048] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.020s
I20260709 12:12:05.588099 19932 raft_consensus.cc:515] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:05.621186 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:05.623842 14188 raft_consensus.cc:2468] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 13.
I20260709 12:12:05.623906 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:05.619763 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:05.601446 19883 raft_consensus.cc:3060] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:05.621169 14190 raft_consensus.cc:3060] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:05.629258 14183 raft_consensus.cc:2468] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 13.
I20260709 12:12:05.627348 14187 raft_consensus.cc:2468] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 15.
I20260709 12:12:05.640595 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:05.643088 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:05.643766 14181 raft_consensus.cc:2393] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 18: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:12:05.585414 19309 raft_consensus.cc:515] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:05.644447 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:05.645627 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:05.638823 14155 leader_election.cc:304] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:05.650935 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:05.651934 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:05.653059 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:12:05.654289 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 141473us
I20260709 12:12:05.650233 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:05.663509 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
W20260709 12:12:05.659746 14154 connection.cc:256] RPC call timeout handler was delayed by -2.0282735880000473s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18910000000000002s for a response
I20260709 12:12:05.667623 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:12:05.648434 19999 consensus_meta.cc:287] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db: Time spent flushing consensus metadata: real 0.518s	user 0.012s	sys 0.004s
I20260709 12:12:05.679193 14186 raft_consensus.cc:2468] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 11.
I20260709 12:12:05.669314 14185 raft_consensus.cc:3060] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:05.671504 14907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:05.671841 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:05.680416 14187 raft_consensus.cc:3060] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:05.672112 19977 raft_consensus.cc:2804] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:05.671394 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:05.681212 14263 raft_consensus.cc:2468] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 16.
I20260709 12:12:05.664985 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:05.678496 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:05.682665 19950 raft_consensus.cc:515] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:05.685142 19950 leader_election.cc:290] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:05.686578 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:05.687958 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 14 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:05.688925 14335 raft_consensus.cc:2410] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for term 14 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260709 12:12:05.693846 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:05.693279 14337 raft_consensus.cc:3060] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:05.698693 19705 raft_consensus.cc:3060] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:05.702155 14261 raft_consensus.cc:2393] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 15: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:12:05.703020 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:05.699872 14338 raft_consensus.cc:2468] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 12.
I20260709 12:12:05.718735 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:05.720963 14256 raft_consensus.cc:2393] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 17: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:12:05.693418 19977 raft_consensus.cc:493] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:05.724871 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:05.725598 14188 raft_consensus.cc:2468] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 18.
I20260709 12:12:05.724483 19977 raft_consensus.cc:3060] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:05.614259 14083 catalog_manager.cc:5697] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf reported cstate change: term changed from 8 to 10, leader changed from 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) to 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130). New cstate: current_term: 10 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:12:05.738590 14186 raft_consensus.cc:2410] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for term 17 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
W20260709 12:12:05.748519 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:05.748636 14181 raft_consensus.cc:1240] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 15. Current term is 16. Ops: []
W20260709 12:12:05.751536 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 138112us
W20260709 12:12:05.739761 20017 log.cc:927] Time spent T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.250s	user 0.002s	sys 0.000s
W20260709 12:12:05.756850 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 137097us
I20260709 12:12:05.758100 14181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 3034) took 1607 ms. Trace:
I20260709 12:12:05.758461 14181 rpcz_store.cc:276] 0709 12:12:04.141807 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:05.718937 (+1577130us) service_pool.cc:224] Handling call
0709 12:12:05.748448 (+ 29511us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:05.749327 (+   879us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:05.749559 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:05.762277 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:05.776408 14188 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 3036) took 1634 ms. Trace:
I20260709 12:12:05.770218 14303 leader_election.cc:304] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:05.777115 14188 rpcz_store.cc:276] 0709 12:12:04.142358 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:05.734973 (+1592615us) service_pool.cc:224] Handling call
0709 12:12:05.763904 (+ 28931us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:05.768780 (+  4876us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:05.768815 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:05.776048 (+  7233us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:12:05.776103 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:05.776180 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:05.776327 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:05.789206 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 16 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:05.790335 14257 raft_consensus.cc:2368] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 16. Current term is 17.
I20260709 12:12:05.803854 14339 raft_consensus.cc:2468] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 13.
I20260709 12:12:05.804998 14229 leader_election.cc:304] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:05.806617 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:05.807294 14186 raft_consensus.cc:2468] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 14.
I20260709 12:12:05.812175 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:05.813587 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:05.851665 14188 raft_consensus.cc:3060] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:05.852078 14303 leader_election.cc:304] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:05.823395 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:05.851774 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:05.827702 19885 raft_consensus.cc:2804] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:05.826916 14229 leader_election.cc:304] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:05.828438 14155 leader_election.cc:304] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:05.852893 14189 raft_consensus.cc:2468] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 15.
W20260709 12:12:05.839329 14154 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 138656us
I20260709 12:12:05.842698 14185 raft_consensus.cc:2468] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 17.
I20260709 12:12:05.834710 19952 raft_consensus.cc:2804] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:05.852450 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:05.848855 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:05.858237 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:05.863637 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:05.863806 14185 raft_consensus.cc:3060] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:05.867767 14184 raft_consensus.cc:2410] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for term 17 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 12:12:05.840118 19932 leader_election.cc:290] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:05.871731 14186 raft_consensus.cc:3060] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:05.875321 14339 raft_consensus.cc:1240] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 13. Current term is 14. Ops: [12.8-13.9]
I20260709 12:12:05.879458 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:05.851018 19309 leader_election.cc:290] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:05.878989 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:12:05.885691 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 58876.5us
I20260709 12:12:05.880226 14189 raft_consensus.cc:2468] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 13.
I20260709 12:12:05.859320 19885 raft_consensus.cc:493] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:05.862461 19952 raft_consensus.cc:493] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:05.896906 14181 raft_consensus.cc:1275] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:12:05.900475 14303 leader_election.cc:304] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:05.902477 14181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 3037) took 1756 ms. Trace:
I20260709 12:12:05.909410 14181 rpcz_store.cc:276] 0709 12:12:04.142605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:05.797865 (+1655260us) service_pool.cc:224] Handling call
0709 12:12:05.878954 (+ 81089us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:05.899170 (+ 20216us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:05.899454 (+   284us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:05.909945 14229 leader_election.cc:304] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:05.910348 14190 raft_consensus.cc:2468] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 15.
I20260709 12:12:05.876646 19628 raft_consensus.cc:2749] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:05.904929 14877 leader_election.cc:304] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:05.898727 19885 raft_consensus.cc:3060] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:12:05.915333 14878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:05.900722 19952 raft_consensus.cc:3060] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:05.920349 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
W20260709 12:12:05.912308 19914 consensus_meta.cc:287] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.557s	user 0.010s	sys 0.003s
W20260709 12:12:05.920284 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 149348us
I20260709 12:12:05.922133 14184 raft_consensus.cc:1275] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 12:12:05.926069 14184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 3039) took 1783 ms. Trace:
I20260709 12:12:05.926287 14154 leader_election.cc:304] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:05.928068 14184 rpcz_store.cc:276] 0709 12:12:04.143112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:05.892141 (+1749029us) service_pool.cc:224] Handling call
0709 12:12:05.921777 (+ 29636us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:05.923927 (+  2150us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:05.925996 (+  2069us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:05.925206 14189 raft_consensus.cc:1240] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 16. Current term is 17. Ops: [14.9-16.10]
I20260709 12:12:05.924575 14876 leader_election.cc:304] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:12:05.897986 19932 consensus_queue.cc:1059] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 12:12:05.932947 14877 leader_election.cc:304] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:12:05.934221 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:05.935596 14907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
W20260709 12:12:05.935897 19984 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.186s	user 0.007s	sys 0.011s
I20260709 12:12:05.936318 19960 consensus_queue.cc:1048] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.102s
I20260709 12:12:05.936988 20027 raft_consensus.cc:2749] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:05.937445 20001 raft_consensus.cc:2804] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:05.937794 19702 consensus_queue.cc:1059] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:12:05.938082 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:05.939435 14184 raft_consensus.cc:1275] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 9. (term mismatch)
I20260709 12:12:05.942021 19999 raft_consensus.cc:2804] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:05.943982 14332 raft_consensus.cc:2468] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 15.
I20260709 12:12:05.948015 14189 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 3046) took 1785 ms. Trace:
I20260709 12:12:05.924351 19309 raft_consensus.cc:2804] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:12:05.954886 14907 raft_consensus.cc:2368] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for earlier term 19. Current term is 20.
I20260709 12:12:06.010573 14189 rpcz_store.cc:276] 0709 12:12:04.144926 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:05.901627 (+1756701us) service_pool.cc:224] Handling call
0709 12:12:05.924868 (+ 23241us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:12:05.930467 (+  5599us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:05.930718 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:06.008018 14184 pending_rounds.cc:85] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf: Aborting all ops after (but not including) 8
I20260709 12:12:05.924985 20016 raft_consensus.cc:2749] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:05.932018 19879 raft_consensus.cc:2804] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:05.927268 19914 raft_consensus.cc:515] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:05.977630 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:05.979130 14230 leader_election.cc:304] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:05.980607 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
W20260709 12:12:05.957872 19984 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.227s	user 0.007s	sys 0.011s
I20260709 12:12:05.984618 14903 raft_consensus.cc:2468] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 15.
I20260709 12:12:05.968631 19705 raft_consensus.cc:2749] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:05.995900 19977 raft_consensus.cc:515] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:06.014564 14184 pending_rounds.cc:107] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf: Aborting uncommitted NO_OP operation due to leader change: 16.9
W20260709 12:12:06.008599 14154 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 82443.9us
I20260709 12:12:06.040339 14184 raft_consensus.cc:2889] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:12:06.007941 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 111519us
I20260709 12:12:05.961169 14186 raft_consensus.cc:2468] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 20.
I20260709 12:12:06.010191 14877 leader_election.cc:304] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:12:06.038975 14256 raft_consensus.cc:3060] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:12:06.001605 14262 consensus_meta.cc:287] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.505s	user 0.007s	sys 0.002s
I20260709 12:12:06.042198 14262 raft_consensus.cc:2468] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 14.
I20260709 12:12:06.043103 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:06.044559 14332 raft_consensus.cc:2393] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 14: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:12:06.006037 20001 raft_consensus.cc:493] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:06.042429 14185 raft_consensus.cc:2468] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 17.
I20260709 12:12:06.015571 19309 raft_consensus.cc:493] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:06.054858 14261 raft_consensus.cc:3060] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:06.058526 14188 raft_consensus.cc:2468] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 13.
W20260709 12:12:06.059468 14302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:06.060017 14335 raft_consensus.cc:1240] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 17. Current term is 18. Ops: [17.8-17.8]
I20260709 12:12:06.060755 19974 raft_consensus.cc:2804] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:06.061234 19974 raft_consensus.cc:493] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:06.057150 19309 raft_consensus.cc:3060] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:12:06.061782 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 145296us
I20260709 12:12:06.064955 14876 leader_election.cc:304] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:06.010191 19999 raft_consensus.cc:493] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:06.070259 14876 leader_election.cc:304] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:06.044348 19932 consensus_queue.cc:1243] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer 73d01e9b1a9d49358da4985b21d681db log is divergent from this leader: its last log entry 11.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:12:06.052098 20001 raft_consensus.cc:3060] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:06.075588 14184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 3051) took 1405 ms. Trace:
I20260709 12:12:06.078173 14188 raft_consensus.cc:1240] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 16. Current term is 17. Ops: [14.6-16.8]
I20260709 12:12:06.077986 14184 rpcz_store.cc:276] 0709 12:12:04.661372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:05.933421 (+1272049us) service_pool.cc:224] Handling call
0709 12:12:05.939100 (+  5679us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:06.066418 (+127318us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:06.066647 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:06.079161 14188 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 3056) took 1189 ms. Trace:
I20260709 12:12:06.017832 19879 raft_consensus.cc:493] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:06.066329 14303 leader_election.cc:400] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 election: Vote denied by peer 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341) with higher term. Message: Invalid argument: T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for earlier term 19. Current term is 20.
I20260709 12:12:06.083858 14303 leader_election.cc:403] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 12:12:06.079640 14188 rpcz_store.cc:276] 0709 12:12:04.890280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:06.059483 (+1169203us) service_pool.cc:224] Handling call
0709 12:12:06.077887 (+ 18404us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:12:06.078857 (+   970us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:06.079109 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:06.061645 19974 raft_consensus.cc:3060] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:06.087940 14258 raft_consensus.cc:2393] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 13: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:12:06.063875 20027 raft_consensus.cc:2764] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 12:12:06.072937 14185 raft_consensus.cc:1275] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:12:06.091090 14185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 3055) took 1201 ms. Trace:
I20260709 12:12:06.071102 19997 raft_consensus.cc:2804] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:06.095765 14184 raft_consensus.cc:1240] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:06.091450 14185 rpcz_store.cc:276] 0709 12:12:04.889613 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:06.047839 (+1158226us) service_pool.cc:224] Handling call
0709 12:12:06.064449 (+ 16610us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:06.090835 (+ 26386us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:06.091020 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:06.073223 19999 raft_consensus.cc:3060] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:06.074548 19705 raft_consensus.cc:493] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:06.100098 14184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 3057) took 1209 ms. Trace:
I20260709 12:12:06.102259 14184 rpcz_store.cc:276] 0709 12:12:04.890732 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:06.079158 (+1188426us) service_pool.cc:224] Handling call
0709 12:12:06.091799 (+ 12641us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:06.099855 (+  8056us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:06.100045 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:06.083891 19879 raft_consensus.cc:3060] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:06.076741 20016 raft_consensus.cc:2804] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:06.056964 19702 consensus_queue.cc:1048] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.032s
I20260709 12:12:06.081687 19963 raft_consensus.cc:2804] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:06.108047 14185 raft_consensus.cc:1275] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:12:06.115880 14185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 3062) took 1222 ms. Trace:
I20260709 12:12:06.116496 14185 rpcz_store.cc:276] 0709 12:12:04.893354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:06.097542 (+1204188us) service_pool.cc:224] Handling call
0709 12:12:06.107727 (+ 10185us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:06.115558 (+  7831us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:06.115807 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:06.117501 14188 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 3059) took 1225 ms. Trace:
I20260709 12:12:06.119460 14188 rpcz_store.cc:276] 0709 12:12:04.891824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:06.084961 (+1193137us) service_pool.cc:224] Handling call
0709 12:12:06.098555 (+ 13594us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:06.098833 (+   278us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:06.098852 (+    19us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:06.098885 (+    33us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:12:06.114931 (+ 16046us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:06.117296 (+  2365us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:06.117438 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:06.120349 14256 raft_consensus.cc:2468] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 14.
I20260709 12:12:06.129494 14184 raft_consensus.cc:1240] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 12. Current term is 13. Ops: []
I20260709 12:12:06.130477 14184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 3072) took 1232 ms. Trace:
I20260709 12:12:06.130846 14184 rpcz_store.cc:276] 0709 12:12:04.897837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:06.103647 (+1205810us) service_pool.cc:224] Handling call
0709 12:12:06.129270 (+ 25623us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:06.130167 (+   897us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:06.130403 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:06.133581 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:12:06.134394 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 155457us
I20260709 12:12:06.134514 14182 raft_consensus.cc:2468] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 15.
I20260709 12:12:06.140731 14185 raft_consensus.cc:1275] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:12:06.041576 14083 catalog_manager.cc:5697] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } }
I20260709 12:12:06.141538 14185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56046 (request call id 2574) took 1243 ms. Trace:
I20260709 12:12:06.147354 14185 rpcz_store.cc:276] 0709 12:12:04.898419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:06.118977 (+1220558us) service_pool.cc:224] Handling call
0709 12:12:06.140387 (+ 21410us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:06.141251 (+   864us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:06.141477 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:06.140803 14154 leader_election.cc:304] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:06.149175 14184 raft_consensus.cc:1240] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:06.145758 14188 raft_consensus.cc:1275] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 16 index: 7. Preceding OpId from leader: term: 17 index: 8. (index mismatch)
I20260709 12:12:06.150372 14184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56046 (request call id 2582) took 1208 ms. Trace:
I20260709 12:12:06.150580 14188 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56046 (request call id 2576) took 1210 ms. Trace:
I20260709 12:12:06.150889 14184 rpcz_store.cc:276] 0709 12:12:04.941805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:06.131695 (+1189890us) service_pool.cc:224] Handling call
0709 12:12:06.149019 (+ 17324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:06.149916 (+   897us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:06.150303 (+   387us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:06.151114 14188 rpcz_store.cc:276] 0709 12:12:04.939728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:06.120385 (+1180657us) service_pool.cc:224] Handling call
0709 12:12:06.145321 (+ 24936us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:06.150290 (+  4969us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:06.150513 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:06.157058 14185 raft_consensus.cc:1275] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 12:12:06.157888 14185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56046 (request call id 2584) took 1215 ms. Trace:
I20260709 12:12:06.158200 14185 rpcz_store.cc:276] 0709 12:12:04.942394 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:06.148253 (+1205859us) service_pool.cc:224] Handling call
0709 12:12:06.156694 (+  8441us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:06.157537 (+   843us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:06.157793 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:06.162319 14182 raft_consensus.cc:3060] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:06.166098 14230 leader_election.cc:304] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:06.098227 19960 consensus_queue.cc:1059] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.055s
I20260709 12:12:06.106868 19705 raft_consensus.cc:515] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:06.172084 14184 raft_consensus.cc:1240] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 13. Current term is 14. Ops: []
W20260709 12:12:06.170192 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 126575us
I20260709 12:12:06.181900 14184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56046 (request call id 2591) took 1237 ms. Trace:
I20260709 12:12:06.168138 19932 raft_consensus.cc:2804] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:06.183804 14184 rpcz_store.cc:276] 0709 12:12:04.944507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:06.152106 (+1207599us) service_pool.cc:224] Handling call
0709 12:12:06.167699 (+ 15593us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:06.179359 (+ 11660us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:06.181834 (+  2475us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:06.184537 14905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53194 (request call id 1055) took 1444 ms. Trace:
I20260709 12:12:06.184942 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:06.185701 14184 raft_consensus.cc:2468] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 15.
I20260709 12:12:06.186728 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:06.187274 14184 raft_consensus.cc:2468] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 14.
I20260709 12:12:06.188113 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
W20260709 12:12:06.188560 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 390096us
I20260709 12:12:06.192873 19885 raft_consensus.cc:515] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:06.193881 14264 raft_consensus.cc:1240] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:06.194190 19977 leader_election.cc:290] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:06.199524 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:12:06.200596 19967 consensus_meta.cc:287] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db: Time spent flushing consensus metadata: real 0.664s	user 0.009s	sys 0.001s
I20260709 12:12:06.201033 19967 raft_consensus.cc:515] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:12:06.206594 14183 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56652 (request call id 1296) took 2070 ms (client timeout 2206 ms). Trace:
W20260709 12:12:06.207086 14183 rpcz_store.cc:269] 0709 12:12:04.136425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:04.139117 (+  2692us) service_pool.cc:224] Handling call
0709 12:12:06.206321 (+2067204us) spinlock_profiling.cc:243] Waited 511 ms on lock 0x7b54003b2254. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:12:06.206493 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1176326016}
W20260709 12:12:06.208357 19883 consensus_meta.cc:287] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db: Time spent flushing consensus metadata: real 0.559s	user 0.009s	sys 0.002s
I20260709 12:12:06.208787 19883 raft_consensus.cc:515] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:06.210000 14190 raft_consensus.cc:3055] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:12:06.210392 14190 raft_consensus.cc:740] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:12:06.209936 14903 raft_consensus.cc:1240] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 12. Current term is 13. Ops: []
I20260709 12:12:06.208252 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:06.213389 14187 raft_consensus.cc:2410] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 12:12:06.214087 14183 raft_consensus.cc:3060] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:06.215626 19705 leader_election.cc:290] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:06.216143 14083 catalog_manager.cc:5697] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf reported cstate change: term changed from 5 to 8, leader changed from 65c9c1653b3346b39a0e118540e6080c (127.12.174.131) to 885067a0d31741bfb5c9935788e315bf (127.12.174.129). New cstate: current_term: 8 leader_uuid: "885067a0d31741bfb5c9935788e315bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:06.230724 14187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56046 (request call id 2575) took 1291 ms. Trace:
I20260709 12:12:06.231384 14187 rpcz_store.cc:276] 0709 12:12:04.939312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:05.640226 (+700914us) service_pool.cc:224] Handling call
0709 12:12:06.230636 (+590410us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:06.244287 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:06.245132 14187 raft_consensus.cc:3060] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:12:06.249476 14185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56046 (request call id 2600) took 1053 ms. Trace:
I20260709 12:12:06.249994 14185 rpcz_store.cc:276] 0709 12:12:05.195883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:06.167226 (+971343us) service_pool.cc:224] Handling call
0709 12:12:06.176428 (+  9202us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:06.230714 (+ 54286us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:06.230744 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:06.249161 (+ 18417us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:12:06.249209 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:06.249277 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:06.249409 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:06.258767 14910 raft_consensus.cc:1240] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 16. Current term is 17. Ops: []
W20260709 12:12:06.261224 14337 consensus_meta.cc:287] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.559s	user 0.011s	sys 0.000s
I20260709 12:12:06.261710 14337 raft_consensus.cc:2468] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 20.
I20260709 12:12:06.262936 14261 raft_consensus.cc:2468] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 16.
I20260709 12:12:06.272444 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:06.273177 14185 raft_consensus.cc:2468] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 16.
W20260709 12:12:06.273999 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 203836us
I20260709 12:12:06.231093 19932 raft_consensus.cc:697] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 15 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:12:06.184969 14905 rpcz_store.cc:276] 0709 12:12:04.729998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:04.730135 (+   137us) service_pool.cc:224] Handling call
0709 12:12:04.730442 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:05.086285 (+355843us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:12:05.086801 (+   516us) log.cc:844] Serialized 14 byte log entry
0709 12:12:05.181286 (+ 94485us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:05.181405 (+   119us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:05.181489 (+    84us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:05.836972 (+655483us) spinlock_profiling.cc:243] Waited 21.2 ms on lock 0x7b1800397420. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f212cf16ab1 00007f212cf23281 00007f212401c2a6 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419
0709 12:12:06.165094 (+328122us) spinlock_profiling.cc:243] Waited 355 ms on lock 0x7b540039eed4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:12:06.165159 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:06.174784 (+  9625us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":246,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":62,"raft.queue_time_us":5192,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":116,"spinlock_wait_cycles":865936512,"thread_start_us":88142,"threads_started":1,"wal-append.queue_time_us":339051}
W20260709 12:12:06.279417 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 89982.3us
I20260709 12:12:06.270437 14190 consensus_queue.cc:260] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:06.218043 19702 consensus_queue.cc:1059] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.059s
I20260709 12:12:06.262971 19973 raft_consensus.cc:2749] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341) with higher term. Message: Invalid argument: T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for earlier term 19. Current term is 20.
I20260709 12:12:06.262646 20027 raft_consensus.cc:493] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:06.298501 14183 raft_consensus.cc:2468] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 15.
I20260709 12:12:06.303354 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:06.286980 14876 leader_election.cc:304] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:06.300625 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:06.305889 14185 raft_consensus.cc:3060] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:06.290002 19932 consensus_queue.cc:237] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:06.307436 19914 leader_election.cc:290] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:06.308061 19702 raft_consensus.cc:493] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:06.315452 20016 raft_consensus.cc:697] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 20 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
W20260709 12:12:06.326794 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 47697.9us
I20260709 12:12:06.330497 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:06.315711 19997 raft_consensus.cc:697] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 17 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
W20260709 12:12:06.338959 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 274869us
W20260709 12:12:06.343649 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 173445us
I20260709 12:12:06.349371 14185 raft_consensus.cc:2468] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 14.
I20260709 12:12:06.358548 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:06.359771 14190 raft_consensus.cc:3060] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:12:06.359305 14185 raft_consensus.cc:2468] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 15.
I20260709 12:12:06.308190 20027 raft_consensus.cc:515] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:06.363936 14304 leader_election.cc:304] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:06.365375 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:06.341619 19963 raft_consensus.cc:697] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 17 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:12:06.377919 14183 raft_consensus.cc:2393] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 13: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
I20260709 12:12:06.386745 14155 leader_election.cc:304] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:06.389009 14190 raft_consensus.cc:1275] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 12:12:06.387639 14187 raft_consensus.cc:2468] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 14.
I20260709 12:12:06.341187 19702 raft_consensus.cc:515] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:06.395532 19702 leader_election.cc:290] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:06.407158 20041 raft_consensus.cc:2804] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:12:06.407940 20041 raft_consensus.cc:697] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 13 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:12:06.410588 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:06.410796 14303 leader_election.cc:304] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:06.411537 19950 raft_consensus.cc:3055] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:06.411937 19950 raft_consensus.cc:740] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:06.412976 19950 consensus_queue.cc:260] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:06.414415 19950 raft_consensus.cc:3060] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:12:06.418951 20036 log.cc:927] Time spent T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.168s	user 0.001s	sys 0.000s
I20260709 12:12:06.389513 14190 pending_rounds.cc:85] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf: Aborting all ops after (but not including) 8
I20260709 12:12:06.421607 19997 consensus_queue.cc:237] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:06.320902 14083 catalog_manager.cc:5697] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } }
I20260709 12:12:06.433950 19885 leader_election.cc:290] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:06.429365 20016 consensus_queue.cc:237] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:06.427779 19309 raft_consensus.cc:515] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:06.436448 19967 leader_election.cc:290] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 17 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:06.437220 19999 raft_consensus.cc:515] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:06.434736 19963 consensus_queue.cc:237] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:06.439141 20027 leader_election.cc:290] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:06.463248 20048 raft_consensus.cc:2749] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:12:06.409037 20041 consensus_queue.cc:237] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:06.486871 19977 raft_consensus.cc:3055] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:06.487367 19977 raft_consensus.cc:740] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:06.433437 19974 raft_consensus.cc:515] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:06.488276 19977 consensus_queue.cc:260] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:12:06.447302 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 291861us
W20260709 12:12:06.449128 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 85413.3us
W20260709 12:12:06.450294 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 86363.8us
W20260709 12:12:06.452071 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 59122.5us
I20260709 12:12:06.452574 14181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 3047) took 2307 ms. Trace:
I20260709 12:12:06.450987 14189 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 3053) took 1716 ms. Trace:
W20260709 12:12:06.453420 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 87400.4us
W20260709 12:12:06.449877 20040 log.cc:927] Time spent T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:12:06.393488 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:06.445415 14190 pending_rounds.cc:107] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 12:12:06.450464 19705 raft_consensus.cc:2749] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:12:06.420596 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:06.498283 14183 raft_consensus.cc:2468] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 16.
I20260709 12:12:06.449698 20000 raft_consensus.cc:2749] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:06.449536 20049 raft_consensus.cc:2749] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:06.377122 19952 raft_consensus.cc:515] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:06.453646 19879 raft_consensus.cc:515] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:06.461902 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:06.515574 14910 raft_consensus.cc:2393] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 14: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:12:06.462050 14083 catalog_manager.cc:5697] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf reported cstate change: term changed from 7 to 12, leader changed from 885067a0d31741bfb5c9935788e315bf (127.12.174.129) to 65c9c1653b3346b39a0e118540e6080c (127.12.174.131). New cstate: current_term: 12 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } }
W20260709 12:12:06.463078 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 52418.4us
I20260709 12:12:06.464625 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
W20260709 12:12:06.466521 14302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:06.524375 14302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:06.458155 14182 raft_consensus.cc:1275] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:12:06.528113 14182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56046 (request call id 2583) took 1586 ms. Trace:
I20260709 12:12:06.527969 14905 raft_consensus.cc:2393] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 15: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
I20260709 12:12:06.459702 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:06.531785 14187 raft_consensus.cc:2368] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for earlier term 19. Current term is 20.
I20260709 12:12:06.447077 19883 leader_election.cc:290] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 13 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:06.536415 14339 raft_consensus.cc:2393] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 17: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:12:06.486943 19999 leader_election.cc:290] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 16 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:06.453176 20001 raft_consensus.cc:515] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:06.487134 14903 raft_consensus.cc:1240] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:06.494542 14185 raft_consensus.cc:2376] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 14. Re-sending same reply.
I20260709 12:12:06.491914 14181 rpcz_store.cc:276] 0709 12:12:04.145187 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:05.910783 (+1765596us) service_pool.cc:224] Handling call
0709 12:12:05.931316 (+ 20533us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:05.934165 (+  2849us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:12:06.008794 (+ 74629us) log.cc:844] Serialized 14 byte log entry
0709 12:12:06.439983 (+431189us) spinlock_profiling.cc:243] Waited 1.76 ms on lock 0x7b180038c260. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f212cf16ab1 00007f212cf23281 00007f2123fc8c0a 00007f212d708219 00007f2124050a40 00007f212404b4e4 00007f212404b455 00007f212ab333c7 00007f21271459a7 00007f21271550bf 00007f2127155038
0709 12:12:06.440236 (+   253us) log.cc:844] Serialized 14 byte log entry
0709 12:12:06.452214 (+ 11978us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:06.452263 (+    49us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:12:06.452342 (+    79us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:06.452407 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:06.452516 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37600,"prepare.queue_time_us":425798,"prepare.run_cpu_time_us":97,"prepare.run_wall_time_us":100,"raft.queue_time_us":47822,"raft.run_cpu_time_us":233,"raft.run_wall_time_us":14066,"spinlock_wait_cycles":4057344,"thread_start_us":112030,"threads_started":2,"wal-append.queue_time_us":124286}
I20260709 12:12:06.494926 14190 raft_consensus.cc:2889] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:06.489601 19977 raft_consensus.cc:3060] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:06.546241 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:06.514392 14332 raft_consensus.cc:1240] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 12. Current term is 13. Ops: []
I20260709 12:12:06.492633 14189 rpcz_store.cc:276] 0709 12:12:04.734750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:06.014383 (+1279633us) service_pool.cc:224] Handling call
0709 12:12:06.050970 (+ 36587us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:06.066659 (+ 15689us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:12:06.086281 (+ 19622us) log.cc:844] Serialized 14 byte log entry
0709 12:12:06.443443 (+357162us) log.cc:844] Serialized 14 byte log entry
0709 12:12:06.450630 (+  7187us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:06.450680 (+    50us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:12:06.450727 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:06.450795 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:06.450902 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":228597,"prepare.queue_time_us":251301,"prepare.run_cpu_time_us":86,"prepare.run_wall_time_us":90,"raft.queue_time_us":8655,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":119,"thread_start_us":97395,"threads_started":1,"wal-append.queue_time_us":228203}
I20260709 12:12:06.447697 20045 raft_consensus.cc:2749] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:06.528518 14182 rpcz_store.cc:276] 0709 12:12:04.942103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:06.136147 (+1194044us) service_pool.cc:224] Handling call
0709 12:12:06.162132 (+ 25985us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:06.527815 (+365683us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:06.528045 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:12:06.534636 14154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:06.552350 14257 raft_consensus.cc:1240] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:06.553020 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:06.534435 14907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
W20260709 12:12:06.547942 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 56693.7us
I20260709 12:12:06.548413 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:06.549216 14260 raft_consensus.cc:1275] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:12:06.547515 14155 leader_election.cc:400] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 election: Vote denied by peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673) with higher term. Message: Invalid argument: T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 12. Current term is 13.
I20260709 12:12:06.553960 14182 raft_consensus.cc:2468] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 16.
I20260709 12:12:06.552286 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:06.559185 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:06.560086 14333 raft_consensus.cc:1275] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 12:12:06.561306 14190 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56652 (request call id 1304) took 2059 ms. Trace:
I20260709 12:12:06.564483 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:06.560909 14189 raft_consensus.cc:3060] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:06.565119 14187 raft_consensus.cc:3060] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:12:06.567724 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:06.568356 14183 raft_consensus.cc:2468] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 17.
I20260709 12:12:06.563804 14190 rpcz_store.cc:276] 0709 12:12:04.501839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:05.920649 (+1418810us) service_pool.cc:224] Handling call
0709 12:12:06.005416 (+ 84767us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:06.209892 (+204476us) spinlock_profiling.cc:243] Waited 63.8 ms on lock 0x7b54000d0fa0. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f21270b2dc0 00007f212713d1c0 00007f212713e231 00007f212713ad8f 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c
0709 12:12:06.560986 (+351094us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:06.561221 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":146639744}
I20260709 12:12:06.571317 14229 leader_election.cc:304] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:06.572819 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:06.573424 14185 raft_consensus.cc:3060] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:06.576473 19912 raft_consensus.cc:493] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:06.577067 19912 raft_consensus.cc:515] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:06.578117 14303 leader_election.cc:304] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:06.579231 19912 leader_election.cc:290] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:06.560751 19885 consensus_queue.cc:1059] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.016s
I20260709 12:12:06.580497 19885 raft_consensus.cc:3055] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:12:06.580862 19885 raft_consensus.cc:740] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:06.582036 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:06.582938 20030 consensus_queue.cc:1059] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.023s
I20260709 12:12:06.583897 19912 raft_consensus.cc:3055] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:06.584290 19912 raft_consensus.cc:740] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
W20260709 12:12:06.584590 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 57510.2us
I20260709 12:12:06.585160 19912 consensus_queue.cc:260] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:06.586449 19912 raft_consensus.cc:3060] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:06.594587 19952 leader_election.cc:290] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 17 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:06.554720 19974 leader_election.cc:290] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 15 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:06.595806 19974 consensus_queue.cc:1048] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:12:06.598572 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:06.599196 14181 raft_consensus.cc:3060] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:06.605916 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:06.607357 14155 leader_election.cc:304] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:06.607585 14190 raft_consensus.cc:2393] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 13: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:12:06.617074 14189 raft_consensus.cc:2468] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 17.
W20260709 12:12:06.599720 20040 log.cc:927] Time spent T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 12:12:06.619656 14876 leader_election.cc:304] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:06.620827 19967 raft_consensus.cc:2804] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:06.621420 19967 raft_consensus.cc:697] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 17 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:12:06.622925 19879 leader_election.cc:290] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:06.622563 19967 consensus_queue.cc:237] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:06.623627 20030 consensus_queue.cc:1059] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:12:06.624524 19879 raft_consensus.cc:3055] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:12:06.624876 19879 raft_consensus.cc:740] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
W20260709 12:12:06.603901 20035 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 11 current term: 11 is higher.
I20260709 12:12:06.630769 14155 leader_election.cc:304] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:06.631819 19763 raft_consensus.cc:3055] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:06.632366 14155 leader_election.cc:400] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 election: Vote denied by peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673) with higher term. Message: Invalid argument: T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 12. Current term is 14.
W20260709 12:12:06.632766 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 60782.2us
I20260709 12:12:06.609552 20045 raft_consensus.cc:2804] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:06.633785 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:06.624087 14083 catalog_manager.cc:5697] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf reported cstate change: term changed from 9 to 10, leader changed from 65c9c1653b3346b39a0e118540e6080c (127.12.174.131) to 885067a0d31741bfb5c9935788e315bf (127.12.174.129). New cstate: current_term: 10 leader_uuid: "885067a0d31741bfb5c9935788e315bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:06.654083 14186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 3054) took 1766 ms. Trace:
I20260709 12:12:06.654579 14186 rpcz_store.cc:276] 0709 12:12:04.888743 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:06.041593 (+1152850us) service_pool.cc:224] Handling call
0709 12:12:06.064572 (+ 22979us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:12:06.099124 (+ 34552us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:06.099147 (+    23us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:12:06.111846 (+ 12699us) log.cc:844] Serialized 52 byte log entry
0709 12:12:06.371565 (+259719us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:12:06.514635 (+143070us) log.cc:844] Serialized 14 byte log entry
0709 12:12:06.517374 (+  2739us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:06.517497 (+   123us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:06.653818 (+136321us) raft_consensus.cc:1685] finished
0709 12:12:06.653843 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:06.654010 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":82946,"prepare.queue_time_us":71338,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"raft.queue_time_us":26775,"raft.run_cpu_time_us":363,"raft.run_wall_time_us":7561,"thread_start_us":278985,"threads_started":2,"wal-append.queue_time_us":408576}
I20260709 12:12:06.655797 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:06.656709 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:06.657473 14186 raft_consensus.cc:2393] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 16: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:12:06.656631 14184 raft_consensus.cc:2368] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for earlier term 19. Current term is 20.
I20260709 12:12:06.658541 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:06.659071 14184 raft_consensus.cc:2376] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 13. Re-sending same reply.
I20260709 12:12:06.659708 19885 consensus_queue.cc:260] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:06.660807 19885 raft_consensus.cc:3060] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:12:06.665144 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 101395us
I20260709 12:12:06.666278 14229 leader_election.cc:304] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:06.640671 14185 raft_consensus.cc:2468] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 18.
W20260709 12:12:06.641646 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 83985.1us
I20260709 12:12:06.609622 19952 raft_consensus.cc:3060] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:06.641567 19879 consensus_queue.cc:260] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:06.635057 14155 leader_election.cc:403] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 12:12:06.667743 14304 leader_election.cc:304] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:06.669210 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:06.671203 14187 raft_consensus.cc:2468] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 15.
W20260709 12:12:06.672884 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 94880.3us
I20260709 12:12:06.675280 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:06.676635 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:06.631161 20001 leader_election.cc:290] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 15 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:06.677263 14183 raft_consensus.cc:2468] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 18.
I20260709 12:12:06.679625 14188 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56046 (request call id 2596) took 1485 ms. Trace:
I20260709 12:12:06.680646 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:06.680029 14188 rpcz_store.cc:276] 0709 12:12:05.194095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:06.162958 (+968863us) service_pool.cc:224] Handling call
0709 12:12:06.175285 (+ 12327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:06.181599 (+  6314us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:12:06.546895 (+365296us) log.cc:844] Serialized 14 byte log entry
0709 12:12:06.679173 (+132278us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:06.679236 (+    63us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:12:06.679299 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:06.679396 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:06.679549 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":260165,"prepare.queue_time_us":261100,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":38,"raft.queue_time_us":142,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":106,"spinlock_wait_cycles":42752,"thread_start_us":149583,"threads_started":2,"wal-append.queue_time_us":106829}
I20260709 12:12:06.682303 14905 raft_consensus.cc:1240] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 17 LEADER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:06.681711 14185 raft_consensus.cc:2376] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 15. Re-sending same reply.
I20260709 12:12:06.682941 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:06.683679 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:06.683956 14188 raft_consensus.cc:2410] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for term 17 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 12:12:06.684827 14185 raft_consensus.cc:2376] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 19. Re-sending same reply.
I20260709 12:12:06.686537 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:06.688431 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:06.688635 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:06.689322 14186 raft_consensus.cc:2376] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 14. Re-sending same reply.
I20260709 12:12:06.696326 14181 raft_consensus.cc:2468] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 16.
I20260709 12:12:06.634488 19763 raft_consensus.cc:740] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:06.685871 14189 raft_consensus.cc:3060] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:06.642179 20045 raft_consensus.cc:493] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:06.701843 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:06.703243 14183 raft_consensus.cc:2468] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 14.
I20260709 12:12:06.704566 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:06.705070 14185 raft_consensus.cc:2468] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 15.
I20260709 12:12:06.706126 19879 raft_consensus.cc:3060] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:12:06.706218 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 73993.5us
I20260709 12:12:06.707181 14155 leader_election.cc:304] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:06.708643 14155 leader_election.cc:304] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:06.709556 20031 raft_consensus.cc:2804] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:06.673919 20034 raft_consensus.cc:2749] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:06.672608 19705 raft_consensus.cc:2749] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:12:06.723443 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:06.724366 14265 raft_consensus.cc:2393] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db in current term 15: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:12:06.712565 14229 leader_election.cc:304] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:06.725775 19702 consensus_queue.cc:1048] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:12:06.687219 19932 raft_consensus.cc:2749] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673) with higher term. Message: Invalid argument: T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 12. Current term is 14.
I20260709 12:12:06.694594 19960 raft_consensus.cc:2749] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:06.710717 20045 raft_consensus.cc:3060] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:06.701242 19309 leader_election.cc:290] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 13 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:06.728135 19763 consensus_queue.cc:260] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:06.729233 19763 raft_consensus.cc:3060] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:06.725812 14229 leader_election.cc:304] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:06.736078 19952 raft_consensus.cc:2749] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:06.736331 19791 raft_consensus.cc:2749] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:06.698618 19911 raft_consensus.cc:2804] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:06.738025 19911 raft_consensus.cc:493] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:06.738447 19911 raft_consensus.cc:3060] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:06.736047 14229 leader_election.cc:304] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:06.726027 19912 raft_consensus.cc:2804] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Leader election won for term 17
W20260709 12:12:06.741822 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 74195.6us
I20260709 12:12:06.742381 19912 raft_consensus.cc:697] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 17 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:06.651115 14083 catalog_manager.cc:5697] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf reported cstate change: term changed from 4 to 10, leader changed from 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130) to 65c9c1653b3346b39a0e118540e6080c (127.12.174.131). New cstate: current_term: 10 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } }
I20260709 12:12:06.742095 20000 raft_consensus.cc:2764] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 12:12:06.743355 19912 consensus_queue.cc:237] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:06.744115 14083 catalog_manager.cc:5697] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf reported cstate change: term changed from 8 to 11, leader changed from 65c9c1653b3346b39a0e118540e6080c (127.12.174.131) to 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130). New cstate: current_term: 11 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } }
I20260709 12:12:06.745590 20045 raft_consensus.cc:515] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:12:06.718004 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 54790.1us
I20260709 12:12:06.742630 14229 leader_election.cc:304] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:06.756235 14187 raft_consensus.cc:2393] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 15: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
I20260709 12:12:06.761034 14189 raft_consensus.cc:2468] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 13.
I20260709 12:12:06.770107 14188 raft_consensus.cc:1240] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 12. Current term is 13. Ops: []
I20260709 12:12:06.770792 14188 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56046 (request call id 2604) took 1573 ms. Trace:
I20260709 12:12:06.771093 14188 rpcz_store.cc:276] 0709 12:12:05.197313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:06.697684 (+1500371us) service_pool.cc:224] Handling call
0709 12:12:06.769922 (+ 72238us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:06.770548 (+   626us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:06.770736 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:06.750813 14876 leader_election.cc:304] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:06.772257 14186 raft_consensus.cc:1240] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:06.773010 14186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56046 (request call id 2601) took 1576 ms. Trace:
I20260709 12:12:06.754773 14184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56652 (request call id 1309) took 1014 ms. Trace:
I20260709 12:12:06.773325 14186 rpcz_store.cc:276] 0709 12:12:05.196278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:06.689991 (+1493713us) service_pool.cc:224] Handling call
0709 12:12:06.713462 (+ 23471us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:06.772751 (+ 59289us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:06.772955 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:06.777011 14876 leader_election.cc:304] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:12:06.780488 14876 leader_election.cc:304] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:12:06.774490 14184 rpcz_store.cc:276] 0709 12:12:05.740186 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:06.702940 (+962754us) service_pool.cc:224] Handling call
0709 12:12:06.754101 (+ 51161us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:06.754431 (+   330us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:06.754461 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:06.754505 (+    44us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:06.754546 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:06.754607 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:06.754715 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":414,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":101}
W20260709 12:12:06.750458 20060 log.cc:927] Time spent T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
W20260709 12:12:06.791054 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 48532.8us
I20260709 12:12:06.792789 14229 leader_election.cc:304] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:06.709988 20031 raft_consensus.cc:493] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:06.787907 19967 raft_consensus.cc:2804] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:06.746479 20027 raft_consensus.cc:2749] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:06.810711 14155 leader_election.cc:304] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
W20260709 12:12:06.800474 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 57932.8us
I20260709 12:12:06.773770 20045 leader_election.cc:290] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 14 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:06.813890 14229 leader_election.cc:304] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:06.787751 19791 raft_consensus.cc:2804] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:06.788667 19883 raft_consensus.cc:2804] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:06.797127 20016 raft_consensus.cc:493] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:06.755242 20042 consensus_queue.cc:1048] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.061s
I20260709 12:12:06.800009 19974 raft_consensus.cc:2804] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:12:06.799980 20031 raft_consensus.cc:3060] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:06.745698 14083 catalog_manager.cc:5697] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf reported cstate change: term changed from 8 to 11, leader changed from 65c9c1653b3346b39a0e118540e6080c (127.12.174.131) to 885067a0d31741bfb5c9935788e315bf (127.12.174.129). New cstate: current_term: 11 leader_uuid: "885067a0d31741bfb5c9935788e315bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:06.791445 19960 consensus_queue.cc:1048] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 12:12:06.786010 20037 consensus_queue.cc:1048] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.047s
W20260709 12:12:06.872391 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 116159us
W20260709 12:12:06.869906 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 47641.6us
W20260709 12:12:06.869532 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 69601us
I20260709 12:12:06.779263 19702 consensus_queue.cc:1048] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 12:12:06.820367 19967 raft_consensus.cc:697] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [term 16 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:12:06.873322 14303 leader_election.cc:304] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
W20260709 12:12:06.900521 14302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:06.814249 20000 raft_consensus.cc:2804] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:06.823478 19791 raft_consensus.cc:493] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:06.870503 20030 raft_consensus.cc:2749] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:06.907114 14229 leader_election.cc:304] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:06.908555 14229 leader_election.cc:304] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:06.909052 20030 raft_consensus.cc:2749] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:12:06.909330 20045 raft_consensus.cc:2749] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:12:06.909904 14229 leader_election.cc:304] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:06.909109 19791 raft_consensus.cc:3060] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:06.911310 19967 consensus_queue.cc:237] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:06.910195 20000 raft_consensus.cc:493] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:06.913630 20030 raft_consensus.cc:2804] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:06.914119 20030 raft_consensus.cc:493] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:06.914587 20030 raft_consensus.cc:3060] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:12:06.918051 14305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:06.791599 20049 consensus_queue.cc:1048] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.105s
I20260709 12:12:06.821995 20035 raft_consensus.cc:2749] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:06.925773 14304 leader_election.cc:304] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:12:06.932644 14181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56046 (request call id 2602) took 1736 ms. Trace:
I20260709 12:12:06.933125 14181 rpcz_store.cc:276] 0709 12:12:05.196622 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:06.697152 (+1500530us) service_pool.cc:224] Handling call
0709 12:12:06.712006 (+ 14854us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:06.894622 (+182616us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:06.894684 (+    62us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:06.894764 (+    80us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:12:06.894806 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:06.932366 (+ 37560us) spinlock_profiling.cc:243] Waited 176 ms on lock 0x7b54003a2fd4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:12:06.932413 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:06.932576 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":404817792}
W20260709 12:12:06.938107 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 64884.7us
I20260709 12:12:06.873456 19952 consensus_queue.cc:1048] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.058s
I20260709 12:12:06.892717 20016 raft_consensus.cc:515] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:06.944622 19911 raft_consensus.cc:515] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:06.898077 19883 raft_consensus.cc:697] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [term 15 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:12:06.946120 20016 leader_election.cc:290] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:06.946622 19883 consensus_queue.cc:237] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:06.952502 14188 raft_consensus.cc:1275] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:12:06.955240 14304 leader_election.cc:304] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:12:06.958293 14185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56652 (request call id 1314) took 1128 ms. Trace:
W20260709 12:12:06.962543 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 178817us
I20260709 12:12:06.898604 19974 raft_consensus.cc:697] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 13 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:12:06.955324 19960 raft_consensus.cc:2804] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:06.958624 14185 rpcz_store.cc:276] 0709 12:12:05.830389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:06.705567 (+875178us) service_pool.cc:224] Handling call
0709 12:12:06.790363 (+ 84796us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:06.793124 (+  2761us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:06.793156 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:06.821419 (+ 28263us) log.cc:844] Serialized 26 byte log entry
0709 12:12:06.957968 (+136549us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:12:06.958001 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:06.958079 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:06.958124 (+    45us) raft_consensus.cc:1685] finished
0709 12:12:06.958134 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:06.958240 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2320,"raft.queue_time_us":6325,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":10163,"thread_start_us":53424,"threads_started":1,"wal-append.queue_time_us":41714}
I20260709 12:12:06.970167 14182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56652 (request call id 1316) took 1116 ms. Trace:
I20260709 12:12:06.970572 14182 rpcz_store.cc:276] 0709 12:12:05.853826 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:06.773629 (+919803us) service_pool.cc:224] Handling call
0709 12:12:06.779240 (+  5611us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:06.779438 (+   198us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:12:06.790980 (+ 11542us) log.cc:844] Serialized 14 byte log entry
0709 12:12:06.969786 (+178806us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:06.969843 (+    57us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:12:06.969892 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:06.969961 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:06.970090 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":9113,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"thread_start_us":138302,"threads_started":1}
I20260709 12:12:06.973547 19911 leader_election.cc:290] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:06.975865 19955 consensus_queue.cc:1048] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:12:06.978977 14304 leader_election.cc:304] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:12:06.979513 20031 raft_consensus.cc:515] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:06.979972 19952 raft_consensus.cc:2804] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:12:06.980278 14304 leader_election.cc:304] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:06.982838 14304 leader_election.cc:304] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:12:06.983412 14303 leader_election.cc:304] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:12:06.988091 14185 raft_consensus.cc:1275] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:12:06.990847 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:06.991603 14181 raft_consensus.cc:2468] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 18.
I20260709 12:12:06.993549 14155 leader_election.cc:400] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 14 election: Vote denied by peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673) with higher term. Message: Invalid argument: T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 14. Current term is 15.
I20260709 12:12:06.993938 14155 leader_election.cc:403] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 12:12:06.914142 20000 raft_consensus.cc:3060] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:06.963431 20041 raft_consensus.cc:493] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:06.968286 20051 raft_consensus.cc:2804] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:06.979017 19763 raft_consensus.cc:2804] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Leader election won for term 14
W20260709 12:12:07.001221 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 91453.5us
I20260709 12:12:06.995227 19911 raft_consensus.cc:493] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:06.995446 20045 raft_consensus.cc:493] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:06.996831 20049 raft_consensus.cc:2749] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:07.003206 20001 raft_consensus.cc:2804] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Leader election won for term 16
W20260709 12:12:07.032928 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 70846.4us
W20260709 12:12:07.034106 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 102718us
I20260709 12:12:07.030558 14229 leader_election.cc:304] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:07.063344 19911 raft_consensus.cc:515] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:06.984551 19309 consensus_queue.cc:1059] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.044s
I20260709 12:12:07.004444 20051 raft_consensus.cc:493] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:07.005604 19705 raft_consensus.cc:2749] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673) with higher term. Message: Invalid argument: T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 14. Current term is 15.
I20260709 12:12:07.030340 20048 raft_consensus.cc:2804] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:07.026154 19960 raft_consensus.cc:697] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 15 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:07.078685 14303 leader_election.cc:304] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 73d01e9b1a9d49358da4985b21d681db
W20260709 12:12:07.081794 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 101131us
I20260709 12:12:07.084533 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:07.085413 14333 raft_consensus.cc:2468] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 18.
I20260709 12:12:07.076298 20051 raft_consensus.cc:3060] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:12:07.089533 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:07.090024 14230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:07.002663 20041 raft_consensus.cc:515] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:07.070189 19973 consensus_queue.cc:1059] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 12:12:07.079430 20048 raft_consensus.cc:493] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:07.065877 20045 raft_consensus.cc:515] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:07.118150 19309 raft_consensus.cc:3055] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:07.132819 14155 leader_election.cc:304] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:07.138707 19763 raft_consensus.cc:697] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 14 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:07.140383 19763 consensus_queue.cc:237] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:07.144464 19977 raft_consensus.cc:3055] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:07.144953 19977 raft_consensus.cc:740] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:07.145893 19977 consensus_queue.cc:260] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:07.139039 20083 raft_consensus.cc:2764] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 12:12:07.073827 19974 consensus_queue.cc:237] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:07.099570 20048 raft_consensus.cc:3060] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:07.119266 19885 raft_consensus.cc:2749] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:07.118839 19309 raft_consensus.cc:740] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:07.160845 20031 leader_election.cc:290] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 14 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:12:07.161432 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 63116.7us
I20260709 12:12:07.162915 20041 leader_election.cc:290] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:07.158185 19932 raft_consensus.cc:2804] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader election won for term 16
W20260709 12:12:07.166412 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 132634us
I20260709 12:12:07.180548 14877 leader_election.cc:304] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:12:07.129696 19911 leader_election.cc:290] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:12:07.180433 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 149967us
W20260709 12:12:07.191061 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 198086us
I20260709 12:12:07.197023 14264 raft_consensus.cc:1240] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 12:12:07.196801 14229 leader_election.cc:304] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:07.166754 20045 leader_election.cc:290] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:07.218775 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:07.219725 14333 raft_consensus.cc:2468] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 19.
I20260709 12:12:07.222224 14260 raft_consensus.cc:1275] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:12:07.222488 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:07.222285 14303 leader_election.cc:304] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:07.223179 14258 raft_consensus.cc:2468] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 20.
I20260709 12:12:07.183143 19999 raft_consensus.cc:493] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:07.225529 14257 raft_consensus.cc:3055] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:07.227993 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:07.227362 14257 raft_consensus.cc:740] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:07.188046 20078 raft_consensus.cc:493] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:07.233201 14331 raft_consensus.cc:1275] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:12:07.231964 14155 leader_election.cc:304] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
W20260709 12:12:07.237928 14304 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:07.220580 20041 raft_consensus.cc:2804] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:07.234125 14877 leader_election.cc:304] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:12:07.239418 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
W20260709 12:12:07.244271 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 53267us
I20260709 12:12:07.223634 19932 raft_consensus.cc:697] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 16 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:12:07.245169 14263 raft_consensus.cc:1240] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 12:12:07.249285 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:07.251708 14257 consensus_queue.cc:260] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:07.252924 14257 raft_consensus.cc:3060] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:07.239332 20037 raft_consensus.cc:2749] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:07.255431 14339 raft_consensus.cc:1240] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:07.240808 20041 raft_consensus.cc:493] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:07.255815 14303 leader_election.cc:304] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:07.261207 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:07.262158 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:07.194337 19960 consensus_queue.cc:237] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:12:07.267081 20069 log.cc:927] Time spent T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.177s	user 0.001s	sys 0.000s
I20260709 12:12:07.231171 19999 raft_consensus.cc:515] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:07.269161 14190 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56652 (request call id 1315) took 1421 ms. Trace:
I20260709 12:12:07.269531 14190 rpcz_store.cc:276] 0709 12:12:05.847341 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:06.756113 (+908772us) service_pool.cc:224] Handling call
0709 12:12:06.789706 (+ 33593us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:06.798096 (+  8390us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:06.798138 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:06.818515 (+ 20377us) log.cc:844] Serialized 26 byte log entry
0709 12:12:06.982545 (+164030us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:06.999075 (+ 16530us) log.cc:844] Serialized 14 byte log entry
0709 12:12:07.027801 (+ 28726us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:07.027895 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:07.268902 (+241007us) raft_consensus.cc:1685] finished
0709 12:12:07.268926 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:07.269084 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5554,"prepare.queue_time_us":89259,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":28627,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":4065,"spinlock_wait_cycles":66688,"thread_start_us":79270,"threads_started":1,"wal-append.queue_time_us":136127}
I20260709 12:12:07.257858 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:07.259069 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:07.259670 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:07.273010 14155 leader_election.cc:304] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:07.273872 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:07.271776 19999 leader_election.cc:290] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:07.259179 14229 leader_election.cc:304] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:07.275489 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:07.277454 14336 raft_consensus.cc:2410] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for term 15 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 12:12:07.275226 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:07.275280 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:07.278193 14189 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56652 (request call id 1318) took 1399 ms. Trace:
I20260709 12:12:07.274878 14190 raft_consensus.cc:1275] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:12:07.278579 14189 rpcz_store.cc:276] 0709 12:12:05.878682 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:06.762271 (+883589us) service_pool.cc:224] Handling call
0709 12:12:06.789711 (+ 27440us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:06.792582 (+  2871us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:06.792611 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:06.816944 (+ 24333us) log.cc:844] Serialized 26 byte log entry
0709 12:12:06.991902 (+174958us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:07.070936 (+ 79034us) log.cc:844] Serialized 14 byte log entry
0709 12:12:07.071168 (+   232us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:07.071262 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:07.277924 (+206662us) raft_consensus.cc:1685] finished
0709 12:12:07.277948 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:07.278109 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8478,"prepare.queue_time_us":88017,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":48,"raft.queue_time_us":3748,"raft.run_cpu_time_us":277,"raft.run_wall_time_us":19436,"spinlock_wait_cycles":56960,"thread_start_us":85021,"threads_started":1,"wal-append.queue_time_us":260459}
W20260709 12:12:07.280073 20061 log.cc:927] Time spent T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.455s	user 0.000s	sys 0.001s
I20260709 12:12:07.280604 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:07.281667 14303 leader_election.cc:304] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:07.282614 14229 leader_election.cc:304] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:07.283046 20077 raft_consensus.cc:2804] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:07.283509 20077 raft_consensus.cc:493] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:07.283901 20077 raft_consensus.cc:3060] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:07.285015 19879 raft_consensus.cc:2804] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:07.285949 19885 raft_consensus.cc:2804] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:07.286362 19885 raft_consensus.cc:493] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:07.286738 19885 raft_consensus.cc:3060] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:07.287039 20090 raft_consensus.cc:2749] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:07.288578 20045 consensus_queue.cc:1048] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:12:07.289330 14303 leader_election.cc:304] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:07.290194 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:07.246289 19967 raft_consensus.cc:2804] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:07.235745 19952 raft_consensus.cc:697] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 14 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:07.249667 20027 raft_consensus.cc:2749] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:07.246232 20081 raft_consensus.cc:2804] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Leader election won for term 17
W20260709 12:12:07.299752 20068 log.cc:927] Time spent T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260709 12:12:07.304843 14257 raft_consensus.cc:1275] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 12:12:07.250142 20049 raft_consensus.cc:493] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:07.308243 14303 leader_election.cc:400] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 pre-election: Vote denied by peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187) with higher term. Message: Invalid argument: T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for earlier term 19. Current term is 20.
I20260709 12:12:07.290227 20045 consensus_queue.cc:1048] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 12:12:07.274016 20041 raft_consensus.cc:3060] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:07.320894 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:07.321844 14339 raft_consensus.cc:2376] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 15. Re-sending same reply.
I20260709 12:12:07.306216 19911 consensus_queue.cc:1048] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 12:12:07.308921 19121 consensus_queue.cc:1048] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.017s
I20260709 12:12:07.294131 19967 raft_consensus.cc:493] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:12:07.329813 14305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:07.242098 20078 raft_consensus.cc:515] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:07.309047 19763 raft_consensus.cc:2804] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:07.347347 19763 raft_consensus.cc:493] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:07.347860 19763 raft_consensus.cc:3060] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:07.363000 19977 raft_consensus.cc:3060] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:07.365875 19932 consensus_queue.cc:237] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:07.366662 19911 consensus_queue.cc:1048] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:07.369191 20078 leader_election.cc:290] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:07.343796 19967 raft_consensus.cc:3060] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:07.253995 19309 consensus_queue.cc:260] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:07.379638 14183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56652 (request call id 1311) took 1596 ms. Trace:
I20260709 12:12:07.316336 20049 raft_consensus.cc:515] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:07.315052 20030 raft_consensus.cc:515] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:07.381508 14183 rpcz_store.cc:276] 0709 12:12:05.783616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:06.703856 (+920240us) service_pool.cc:224] Handling call
0709 12:12:06.777747 (+ 73891us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:06.792514 (+ 14767us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:06.792545 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:06.816380 (+ 23835us) log.cc:844] Serialized 26 byte log entry
0709 12:12:06.993907 (+177527us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:12:07.135130 (+141223us) log.cc:844] Serialized 14 byte log entry
0709 12:12:07.154985 (+ 19855us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:07.155074 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:07.369007 (+213933us) spinlock_profiling.cc:243] Waited 9.57 ms on lock 0x7b4800270558. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f212c064aa1 00007f212c05bb37 00007f212c05b9ca 00007f212c15326f 00007f212c152f37 00007f212c16755c 00007f212c167508 00007f212c167488 00007f212c167443 00007f212c1666ec 00007f212b090a96
0709 12:12:07.371453 (+  2446us) raft_consensus.cc:1685] finished
0709 12:12:07.379337 (+  7884us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:07.379545 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":97474,"prepare.queue_time_us":97827,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":50,"raft.queue_time_us":25715,"raft.run_cpu_time_us":3608,"raft.run_wall_time_us":573236,"spinlock_wait_cycles":22000000,"thread_start_us":147617,"threads_started":2,"wal-append.queue_time_us":207542}
I20260709 12:12:07.357125 20081 raft_consensus.cc:697] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 17 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
W20260709 12:12:07.394817 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 45803.6us
I20260709 12:12:07.341192 19791 raft_consensus.cc:515] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } }
I20260709 12:12:07.345636 19879 raft_consensus.cc:697] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 15 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:07.408699 19952 consensus_queue.cc:237] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:12:07.455495 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 153682us
I20260709 12:12:07.461529 14303 leader_election.cc:304] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:12:07.466236 14262 raft_consensus.cc:1240] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 18. Current term is 19. Ops: []
W20260709 12:12:07.465386 19912 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.582s	user 0.012s	sys 0.001s
W20260709 12:12:07.468611 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 168482us
I20260709 12:12:07.472077 14229 leader_election.cc:304] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
W20260709 12:12:07.471289 19912 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.588s	user 0.012s	sys 0.001s
I20260709 12:12:07.471232 19973 raft_consensus.cc:2804] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:07.469269 19999 consensus_queue.cc:1048] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.014s
I20260709 12:12:07.484980 14303 leader_election.cc:304] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:12:07.485926 19702 raft_consensus.cc:2804] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:07.486379 19702 raft_consensus.cc:493] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:07.486717 19702 raft_consensus.cc:3060] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:07.486997 14303 leader_election.cc:304] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:07.495968 19702 raft_consensus.cc:515] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:07.497154 19960 raft_consensus.cc:2749] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:12:07.497768 19791 leader_election.cc:290] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187)
I20260709 12:12:07.499756 19702 leader_election.cc:290] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:07.500114 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:07.503738 20000 raft_consensus.cc:515] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:07.504317 20081 consensus_queue.cc:237] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:07.505707 14258 raft_consensus.cc:2393] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 17: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:12:07.506951 14303 leader_election.cc:400] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 election: Vote denied by peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187) with higher term. Message: Invalid argument: T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for earlier term 19. Current term is 20.
I20260709 12:12:07.507910 14303 leader_election.cc:304] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:12:07.480631 19309 raft_consensus.cc:3060] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:07.522974 19879 consensus_queue.cc:237] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:07.524379 20077 raft_consensus.cc:515] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:07.482332 19973 raft_consensus.cc:493] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:12:07.526093 19973 raft_consensus.cc:3060] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:07.527047 20077 leader_election.cc:290] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:07.521874 19791 raft_consensus.cc:2749] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:12:07.531294 20051 raft_consensus.cc:515] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:07.536510 20049 leader_election.cc:290] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:07.537771 19885 raft_consensus.cc:515] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:07.538486 20030 leader_election.cc:290] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:12:07.547521 20105 log.cc:927] Time spent T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 12:12:07.515374 19702 raft_consensus.cc:2804] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:07.554247 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
W20260709 12:12:07.557124 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 85129.2us
I20260709 12:12:07.558243 14229 leader_election.cc:304] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:07.561671 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:07.562189 14330 raft_consensus.cc:2468] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 16.
I20260709 12:12:07.565864 14260 raft_consensus.cc:1240] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:07.567350 14264 raft_consensus.cc:1240] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:07.571923 14257 raft_consensus.cc:1240] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:07.565852 19702 raft_consensus.cc:697] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 18 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:07.576555 19702 consensus_queue.cc:237] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.7, Last appended by leader: 7, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:07.578500 19977 raft_consensus.cc:493] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:07.585304 19977 raft_consensus.cc:515] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:07.588080 20083 raft_consensus.cc:493] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:07.588716 20083 raft_consensus.cc:515] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:07.590378 19977 leader_election.cc:290] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:07.590997 20083 leader_election.cc:290] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:07.593220 20048 raft_consensus.cc:515] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:12:07.594154 14154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:07.596174 20048 leader_election.cc:290] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 15 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:07.598546 14229 leader_election.cc:304] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:07.602512 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:07.611176 14903 raft_consensus.cc:1275] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:12:07.619277 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
W20260709 12:12:07.620923 20001 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.007s	sys 0.013s
I20260709 12:12:07.628278 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:07.629113 14184 raft_consensus.cc:3060] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:07.633410 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:07.634078 14183 raft_consensus.cc:1240] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 12:12:07.612269 20030 raft_consensus.cc:2749] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:12:07.623546 20001 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.534s	user 0.007s	sys 0.013s
I20260709 12:12:07.618008 20045 raft_consensus.cc:2804] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:07.565775 19763 raft_consensus.cc:515] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:07.618386 20077 consensus_queue.cc:1048] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.024s
I20260709 12:12:07.577961 19967 raft_consensus.cc:515] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:12:07.650700 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 53006.7us
I20260709 12:12:07.651803 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:07.652506 14181 raft_consensus.cc:3060] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:07.654435 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:07.658896 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:07.665915 19885 leader_election.cc:290] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:07.641543 20001 raft_consensus.cc:697] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 16 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:07.670735 20001 consensus_queue.cc:237] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:07.647228 20051 leader_election.cc:290] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:07.641862 20045 raft_consensus.cc:493] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:07.659524 14183 raft_consensus.cc:2468] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 14.
I20260709 12:12:07.684617 14229 leader_election.cc:304] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:07.652160 20000 leader_election.cc:290] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:07.696010 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:07.696317 14181 raft_consensus.cc:2468] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 18.
I20260709 12:12:07.644438 20041 raft_consensus.cc:515] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:07.697033 14183 raft_consensus.cc:3060] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:07.697971 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:07.684420 20045 raft_consensus.cc:3060] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:07.703047 14181 raft_consensus.cc:2468] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 14.
I20260709 12:12:07.692939 14331 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c"
dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
mode: GRACEFUL
new_leader_uuid: "17aab1bbf5014936aa18cc21818b26ec"
 from {username='slave'} at 127.0.0.1:50896
I20260709 12:12:07.713101 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:07.720750 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:07.721343 14338 raft_consensus.cc:1240] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:07.721503 14331 raft_consensus.cc:606] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 14 LEADER]: Received request to transfer leadership to TS 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:12:07.714733 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:07.729902 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:07.730676 14264 raft_consensus.cc:2468] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 14.
I20260709 12:12:07.726816 14229 leader_election.cc:304] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:07.714217 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:07.724701 14183 raft_consensus.cc:2468] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 16.
I20260709 12:12:07.739141 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:07.742077 14265 raft_consensus.cc:2468] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 13.
I20260709 12:12:07.743068 19967 leader_election.cc:290] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 21 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:07.707015 19973 raft_consensus.cc:515] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:07.744289 14337 raft_consensus.cc:1275] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:12:07.728281 20000 raft_consensus.cc:2749] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:07.754865 14229 leader_election.cc:304] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:07.756543 14229 leader_election.cc:304] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:07.759557 20041 leader_election.cc:290] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 19 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:07.760658 14332 raft_consensus.cc:2468] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 18.
I20260709 12:12:07.741770 14183 raft_consensus.cc:1275] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:12:07.759788 20045 raft_consensus.cc:515] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:07.764825 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:07.765933 20016 consensus_queue.cc:1048] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:12:07.766829 20045 leader_election.cc:290] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:07.769134 14263 raft_consensus.cc:1240] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:07.775899 14257 raft_consensus.cc:1275] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:12:07.780941 14338 raft_consensus.cc:1275] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 13. (term mismatch)
I20260709 12:12:07.781518 14338 pending_rounds.cc:85] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c: Aborting all ops after (but not including) 12
I20260709 12:12:07.781806 14338 pending_rounds.cc:107] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c: Aborting uncommitted NO_OP operation due to leader change: 16.13
I20260709 12:12:07.782055 14338 raft_consensus.cc:2889] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:07.786093 14903 raft_consensus.cc:1275] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:12:07.786118 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:07.741350 20048 raft_consensus.cc:493] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:07.788800 20048 raft_consensus.cc:515] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:07.789237 14260 raft_consensus.cc:2468] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 14.
I20260709 12:12:07.788193 14188 raft_consensus.cc:3060] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:07.791050 20051 consensus_queue.cc:1048] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:12:07.800961 14303 leader_election.cc:304] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:07.803042 14303 leader_election.cc:304] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:07.777539 14257 raft_consensus.cc:1275] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:12:07.812929 14188 raft_consensus.cc:2468] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 19.
I20260709 12:12:07.814826 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:07.815634 14188 raft_consensus.cc:2468] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 13.
I20260709 12:12:07.816666 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:07.820320 14184 raft_consensus.cc:2468] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 17.
I20260709 12:12:07.825657 14303 leader_election.cc:304] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:07.831055 14303 leader_election.cc:304] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
W20260709 12:12:07.832317 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 75855.8us
I20260709 12:12:07.824584 19702 raft_consensus.cc:2749] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:12:07.822063 20097 raft_consensus.cc:2749] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:07.828117 20051 raft_consensus.cc:2749] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:12:07.838873 20110 raft_consensus.cc:2749] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:12:07.841711 20016 consensus_queue.cc:1048] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.003s
I20260709 12:12:07.823916 20099 raft_consensus.cc:2804] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:07.846379 20048 leader_election.cc:290] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:07.824412 20030 raft_consensus.cc:2804] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:12:07.846729 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 573775us
I20260709 12:12:07.867048 14188 raft_consensus.cc:2468] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 16.
I20260709 12:12:07.867543 14155 leader_election.cc:304] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:07.847405 20034 raft_consensus.cc:2749] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:07.823930 14338 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2"
dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
mode: GRACEFUL
new_leader_uuid: "885067a0d31741bfb5c9935788e315bf"
 from {username='slave'} at 127.0.0.1:50896
I20260709 12:12:07.870890 14265 raft_consensus.cc:1275] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:12:07.871203 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:07.831866 19952 consensus_queue.cc:1059] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 12:12:07.857465 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:07.849929 14303 leader_election.cc:304] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:07.872020 14259 raft_consensus.cc:2468] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 16.
I20260709 12:12:07.875420 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:07.865327 14263 raft_consensus.cc:1275] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:12:07.822108 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:07.878083 14184 raft_consensus.cc:3060] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:07.882273 14181 raft_consensus.cc:1275] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 12:12:07.873979 14257 raft_consensus.cc:3060] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:07.890974 14184 raft_consensus.cc:2468] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 15.
I20260709 12:12:07.862998 19309 raft_consensus.cc:2804] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:07.944545 19309 raft_consensus.cc:493] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:07.945079 19309 raft_consensus.cc:3060] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:07.955587 14188 raft_consensus.cc:1275] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:12:07.955569 14184 raft_consensus.cc:1275] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
W20260709 12:12:07.970734 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 120918us
I20260709 12:12:07.869664 20099 raft_consensus.cc:493] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:07.849887 19967 consensus_queue.cc:1048] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.024s
I20260709 12:12:07.868042 20030 raft_consensus.cc:493] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:07.976539 14303 leader_election.cc:304] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:07.977689 14303 leader_election.cc:304] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:07.990764 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:07.992969 14910 raft_consensus.cc:1240] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 13 LEADER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 12. Current term is 13. Ops: []
W20260709 12:12:07.996078 14229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:07.863286 20053 consensus_queue.cc:1059] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.105s
I20260709 12:12:07.951404 20097 raft_consensus.cc:493] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:07.871160 20041 consensus_queue.cc:1048] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.119s
I20260709 12:12:08.015197 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 21 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:08.026546 14910 raft_consensus.cc:2393] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 21: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
I20260709 12:12:07.989229 20083 raft_consensus.cc:3055] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:12:08.024616 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:07.988957 20030 raft_consensus.cc:3060] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:08.024899 14257 raft_consensus.cc:2468] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 21.
I20260709 12:12:07.999665 14907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
W20260709 12:12:08.027856 14154 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 227346us
I20260709 12:12:07.997366 20048 raft_consensus.cc:2804] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:07.989472 20099 raft_consensus.cc:3060] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:08.030162 14229 leader_election.cc:304] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:07.996833 19702 raft_consensus.cc:2804] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:08.006678 19952 raft_consensus.cc:2749] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:12:07.953275 19883 consensus_queue.cc:1048] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.071s
I20260709 12:12:08.028622 20083 raft_consensus.cc:740] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
W20260709 12:12:08.055097 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 200479us
I20260709 12:12:08.057600 20042 raft_consensus.cc:3055] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:08.058161 20042 raft_consensus.cc:740] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:12:08.059175 20042 consensus_queue.cc:260] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:08.060312 20042 raft_consensus.cc:3060] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:08.037505 19911 raft_consensus.cc:2749] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:12:08.044287 19702 raft_consensus.cc:697] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 18 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
W20260709 12:12:08.091400 14154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:08.040575 19885 consensus_queue.cc:1059] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.043s
I20260709 12:12:08.026590 20097 raft_consensus.cc:515] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:08.141134 14877 leader_election.cc:304] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:12:08.140383 19911 raft_consensus.cc:3055] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:08.146102 19911 raft_consensus.cc:740] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:08.147337 19911 consensus_queue.cc:260] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:08.148833 19911 raft_consensus.cc:3060] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:08.143638 20043 raft_consensus.cc:493] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:08.154060 20048 raft_consensus.cc:697] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 16 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:08.171762 20048 consensus_queue.cc:237] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:08.175616 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
W20260709 12:12:08.182857 20118 log.cc:927] Time spent T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 12:12:08.157670 20073 raft_consensus.cc:2804] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 21 FOLLOWER]: Leader election won for term 21
W20260709 12:12:08.184984 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 128950us
W20260709 12:12:08.193928 20115 log.cc:927] Time spent T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.196s	user 0.000s	sys 0.004s
I20260709 12:12:08.170719 20097 leader_election.cc:290] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:08.184592 20041 raft_consensus.cc:493] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:08.198637 14304 leader_election.cc:304] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:12:08.166282 20043 raft_consensus.cc:515] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:08.215797 20043 leader_election.cc:290] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:08.216470 20051 raft_consensus.cc:2804] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:08.216979 20051 raft_consensus.cc:493] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:08.217334 20051 raft_consensus.cc:3060] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:08.222347 19309 raft_consensus.cc:515] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:08.223515 14338 raft_consensus.cc:606] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Received request to transfer leadership to TS 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:08.188395 20077 consensus_queue.cc:1059] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 12:12:08.223913 14338 raft_consensus.cc:614] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:08.194537 20073 raft_consensus.cc:697] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 21 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:12:08.224416 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:08.224996 20073 consensus_queue.cc:237] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:08.225762 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:08.226922 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:08.228083 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:08.229133 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:08.231240 19309 leader_election.cc:290] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 15 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:08.232950 19952 raft_consensus.cc:493] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:08.233513 19952 raft_consensus.cc:515] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:12:08.234401 20122 log.cc:927] Time spent T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260709 12:12:08.235443 20053 consensus_queue.cc:1059] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 12:12:08.236089 14230 connection.cc:256] RPC call timeout handler was delayed by -1.0176609029999781s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.23260000000000003s for a response
I20260709 12:12:08.236848 20053 consensus_queue.cc:1048] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:12:08.238735 20085 raft_consensus.cc:3055] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:08.239353 20085 raft_consensus.cc:740] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:12:08.239795 19952 leader_election.cc:290] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:08.240298 20085 consensus_queue.cc:260] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:08.240800 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:08.241464 14331 raft_consensus.cc:3060] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:08.238601 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:08.243000 14332 raft_consensus.cc:3060] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Advancing to term 21
I20260709 12:12:08.164392 20083 consensus_queue.cc:260] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:08.241334 19952 consensus_queue.cc:1059] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 12:12:08.236248 19997 consensus_queue.cc:1048] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.009s
I20260709 12:12:08.245262 20083 raft_consensus.cc:3060] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:08.248085 20051 raft_consensus.cc:515] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:08.229048 20130 raft_consensus.cc:3055] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:08.250248 14304 leader_election.cc:304] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:12:08.250082 20129 consensus_queue.cc:1059] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 18.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:12:08.256134 14330 raft_consensus.cc:1240] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:08.258697 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:08.266004 19763 leader_election.cc:290] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 17 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:08.270939 19960 raft_consensus.cc:3055] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:08.272410 19791 consensus_queue.cc:1059] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:12:08.272807 14230 leader_election.cc:304] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:08.273651 19791 consensus_queue.cc:1059] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:12:08.274133 20045 raft_consensus.cc:3055] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:12:08.274391 19912 raft_consensus.cc:2749] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:12:08.275254 19885 consensus_queue.cc:1059] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 16.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:12:08.276175 19885 raft_consensus.cc:3055] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:08.276492 19952 consensus_queue.cc:1048] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:12:08.271529 20042 consensus_queue.cc:1059] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.006s
I20260709 12:12:08.278067 20042 raft_consensus.cc:3055] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:08.278402 20042 raft_consensus.cc:740] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:12:08.275444 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:08.279758 14187 raft_consensus.cc:2393] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 14: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:12:08.279249 20042 consensus_queue.cc:260] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:08.279235 20081 raft_consensus.cc:493] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:08.280684 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:08.281235 20081 raft_consensus.cc:515] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:08.271474 19960 raft_consensus.cc:740] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
W20260709 12:12:08.281978 20128 log.cc:927] Time spent T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.100s	user 0.002s	sys 0.000s
W20260709 12:12:08.281453 20127 consensus_queue.cc:1175] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "17aab1bbf5014936aa18cc21818b26ec" responder_term: 14 status { last_received { term: 13 index: 7 } last_committed_idx: 7 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 13. Current term is 14. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:12:08.291298 19960 consensus_queue.cc:260] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:08.288412 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:08.276005 19763 raft_consensus.cc:2804] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:08.288880 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:08.274430 14230 leader_election.cc:304] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:08.296057 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:08.288687 14303 leader_election.cc:304] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:12:08.241715 20085 raft_consensus.cc:3060] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:08.308903 19763 raft_consensus.cc:493] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:08.313921 19763 raft_consensus.cc:3060] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:08.314352 19791 raft_consensus.cc:3055] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:08.314765 19791 raft_consensus.cc:740] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:08.280696 20042 raft_consensus.cc:3060] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:08.316265 14187 raft_consensus.cc:2393] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 17: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:12:08.317059 14303 leader_election.cc:304] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:08.318125 14303 leader_election.cc:304] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:12:08.322844 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:08.326648 14332 raft_consensus.cc:2468] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 21.
I20260709 12:12:08.331094 14331 raft_consensus.cc:2468] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 19.
I20260709 12:12:08.254120 20130 raft_consensus.cc:740] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:08.332525 14877 leader_election.cc:304] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:12:08.196156 19702 consensus_queue.cc:237] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:12:08.337719 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 63358.7us
I20260709 12:12:08.276557 19885 raft_consensus.cc:740] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:08.338733 14187 raft_consensus.cc:1240] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 12:12:08.294305 20045 raft_consensus.cc:740] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:08.243115 20041 raft_consensus.cc:515] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:08.361490 14230 leader_election.cc:304] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:08.363891 14187 raft_consensus.cc:1240] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 14. Current term is 15. Ops: [14.7-14.7]
I20260709 12:12:08.293574 20077 consensus_queue.cc:1048] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.078s
I20260709 12:12:08.333010 20083 raft_consensus.cc:2804] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:08.374194 14187 raft_consensus.cc:1240] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 17. Current term is 18. Ops: [17.8-17.8]
I20260709 12:12:08.361291 19912 raft_consensus.cc:2749] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:08.346016 19997 raft_consensus.cc:2804] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:08.372140 20051 leader_election.cc:290] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:08.381937 14187 raft_consensus.cc:1240] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 12:12:08.384130 14187 raft_consensus.cc:1275] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:12:08.373028 20110 raft_consensus.cc:2804] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:08.378474 19960 raft_consensus.cc:3060] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:12:08.397291 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 124611us
I20260709 12:12:08.375581 19309 raft_consensus.cc:2804] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:08.315605 19791 consensus_queue.cc:260] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:12:08.405236 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 80856.3us
I20260709 12:12:08.413100 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:08.413944 14264 raft_consensus.cc:3060] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:08.416383 14262 raft_consensus.cc:1240] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:08.386780 20083 raft_consensus.cc:697] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 17 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
W20260709 12:12:08.432399 14875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:08.433247 14263 raft_consensus.cc:1275] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:12:08.430270 19912 raft_consensus.cc:2749] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:08.395634 19997 raft_consensus.cc:697] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 19 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:12:08.407472 20110 raft_consensus.cc:697] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 16 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:08.440546 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:08.453681 14258 raft_consensus.cc:3060] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:12:08.458081 14229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:08.405416 20030 raft_consensus.cc:515] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:08.462231 19309 raft_consensus.cc:697] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 15 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:08.407248 20045 consensus_queue.cc:260] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:08.432271 19885 consensus_queue.cc:260] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 17.8, Last appended by leader: 8, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:08.496318 14257 raft_consensus.cc:1240] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 14. Current term is 15. Ops: []
W20260709 12:12:08.487768 20131 log.cc:927] Time spent T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:12:08.465765 20140 raft_consensus.cc:493] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:08.482690 20119 log.cc:927] Time spent T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.476s	user 0.003s	sys 0.000s
I20260709 12:12:08.489991 19705 raft_consensus.cc:493] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:08.496393 20051 raft_consensus.cc:493] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:08.490741 20034 raft_consensus.cc:2749] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:08.548286 14264 raft_consensus.cc:2468] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 15.
I20260709 12:12:08.530153 20140 raft_consensus.cc:515] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:12:08.560710 14304 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:08.558082 20110 consensus_queue.cc:237] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:08.486896 19932 consensus_queue.cc:1048] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.048s
I20260709 12:12:08.537768 19705 raft_consensus.cc:515] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:08.483840 19997 consensus_queue.cc:237] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:08.572607 19705 leader_election.cc:290] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:08.576334 20041 leader_election.cc:290] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:08.577189 20030 leader_election.cc:290] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:08.577919 20081 leader_election.cc:290] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:12:08.578694 20134 log.cc:927] Time spent T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
I20260709 12:12:08.562397 20045 raft_consensus.cc:3060] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:08.581938 20124 raft_consensus.cc:493] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:08.582343 20107 log.cc:927] Time spent T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:12:08.587438 20143 raft_consensus.cc:493] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:08.528784 20083 consensus_queue.cc:237] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:08.616544 14190 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 3104) took 1015 ms. Trace:
W20260709 12:12:08.647452 14878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:08.649039 14258 raft_consensus.cc:2468] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 14.
I20260709 12:12:08.562469 20077 raft_consensus.cc:493] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:08.615149 14907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:08.646353 14190 rpcz_store.cc:276] 0709 12:12:07.601109 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:07.618305 (+ 17196us) service_pool.cc:224] Handling call
0709 12:12:07.630477 (+ 12172us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:12:07.871389 (+240912us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:07.871421 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:12:07.872003 (+   582us) log.cc:844] Serialized 52 byte log entry
0709 12:12:08.046099 (+174096us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:12:08.314537 (+268438us) spinlock_profiling.cc:243] Waited 3.78 ms on lock 0x7b4800270558. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f212c064aa1 00007f212c05bb37 00007f212c05b9ca 00007f212c15326f 00007f212c152f37 00007f212c16755c 00007f212c167508 00007f212c167488 00007f212c167443 00007f212c1666ec 00007f212b090a96
0709 12:12:08.435731 (+121194us) log.cc:844] Serialized 14 byte log entry
0709 12:12:08.562923 (+127192us) log.cc:844] Serialized 14 byte log entry
0709 12:12:08.563129 (+   206us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:08.563229 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:08.616226 (+ 52997us) raft_consensus.cc:1685] finished
0709 12:12:08.616260 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:08.616457 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":955342,"prepare.queue_time_us":418281,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":42,"raft.queue_time_us":530927,"raft.run_cpu_time_us":3749,"raft.run_wall_time_us":443624,"spinlock_wait_cycles":8689408,"thread_start_us":146891,"threads_started":2,"wal-append.queue_time_us":201062}
I20260709 12:12:08.679203 14909 raft_consensus.cc:2468] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 17.
I20260709 12:12:08.588071 20143 raft_consensus.cc:515] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:08.673326 20144 raft_consensus.cc:493] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:08.717350 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:08.674006 19932 raft_consensus.cc:493] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:08.719237 14907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:08.562101 20051 raft_consensus.cc:515] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:12:08.747813 14877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:08.586550 19309 consensus_queue.cc:237] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:08.703294 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:08.705046 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:08.708967 14262 raft_consensus.cc:1275] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:12:08.764629 14256 raft_consensus.cc:2393] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db in current term 15: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
W20260709 12:12:08.722157 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 854667us
I20260709 12:12:08.722972 14229 leader_election.cc:304] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:08.758716 14186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56652 (request call id 1319) took 2835 ms. Trace:
I20260709 12:12:08.718299 14336 raft_consensus.cc:2468] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 15.
I20260709 12:12:08.651746 20077 raft_consensus.cc:515] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:08.713871 14264 raft_consensus.cc:1275] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:12:08.765270 14186 rpcz_store.cc:276] 0709 12:12:05.900560 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:06.798590 (+898030us) service_pool.cc:224] Handling call
0709 12:12:06.820458 (+ 21868us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:06.913824 (+ 93366us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:06.913860 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:06.914439 (+   579us) log.cc:844] Serialized 26 byte log entry
0709 12:12:07.710345 (+795906us) spinlock_profiling.cc:243] Waited 5.09 ms on lock 0x7b1800338740. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f212cf16ab1 00007f212cf23281 00007f2124030e07 00007f212ce8b9a9 00007f212404d69b 00007f212404b93f 00007f212404dc02 00007f2126cd520b 00007f2126cdad23 00007f2126cdb0d1 00007f21270f6a0f
0709 12:12:07.841057 (+130712us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:07.841484 (+   427us) log.cc:844] Serialized 14 byte log entry
0709 12:12:08.471972 (+630488us) spinlock_profiling.cc:243] Waited 3.48 ms on lock 0x7b1800338740. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f212cf16ab1 00007f212cf23281 00007f2123fc8c0a 00007f212d708219 00007f2124050a40 00007f212404b4e4 00007f212404b455 00007f2127133060 00007f2127145716 00007f2127156287 00007f2127156208
0709 12:12:08.735278 (+263306us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:08.735381 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:08.735437 (+    56us) raft_consensus.cc:1685] finished
0709 12:12:08.735452 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:08.735645 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":96291,"prepare.queue_time_us":254,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"raft.queue_time_us":721467,"raft.run_cpu_time_us":201,"raft.run_wall_time_us":204,"spinlock_wait_cycles":19731712,"thread_start_us":393430,"threads_started":2,"wal-append.queue_time_us":957563}
W20260709 12:12:08.764467 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 404096us
W20260709 12:12:08.768402 14877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:08.673662 14259 raft_consensus.cc:1240] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:08.721611 20141 raft_consensus.cc:493] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:08.588900 19885 raft_consensus.cc:3060] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:08.772153 20141 raft_consensus.cc:515] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:08.773434 14181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56652 (request call id 1335) took 1095 ms. Trace:
I20260709 12:12:08.779031 20143 leader_election.cc:290] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:08.779282 14230 leader_election.cc:304] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
W20260709 12:12:08.771966 20126 log.cc:927] Time spent T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.076s	user 0.004s	sys 0.001s
I20260709 12:12:08.781385 14155 leader_election.cc:304] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:08.646842 20124 raft_consensus.cc:515] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:08.719081 19973 leader_election.cc:290] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:08.786321 20147 raft_consensus.cc:2749] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:12:08.785166 14181 rpcz_store.cc:276] 0709 12:12:07.678501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:07.883447 (+204946us) service_pool.cc:224] Handling call
0709 12:12:07.883904 (+   457us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:08.487214 (+603310us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:08.487263 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:08.487846 (+   583us) log.cc:844] Serialized 26 byte log entry
0709 12:12:08.653622 (+165776us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:08.653679 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:08.653777 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:08.773201 (+119424us) raft_consensus.cc:1685] finished
0709 12:12:08.773224 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:08.773364 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":602863,"raft.queue_time_us":634182,"raft.run_cpu_time_us":208,"raft.run_wall_time_us":5649,"thread_start_us":164466,"threads_started":1,"wal-append.queue_time_us":232155}
W20260709 12:12:08.785522 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 62637us
I20260709 12:12:08.766026 19932 raft_consensus.cc:515] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:08.793494 14331 raft_consensus.cc:2468] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 15.
I20260709 12:12:08.794318 14155 leader_election.cc:304] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:08.803004 14229 leader_election.cc:304] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:08.808728 20124 leader_election.cc:290] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:08.722002 20144 raft_consensus.cc:515] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:08.810102 14338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:50896 (request call id 47) took 1007 ms. Trace:
I20260709 12:12:08.811194 20140 leader_election.cc:290] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:08.820119 14229 leader_election.cc:304] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:08.809440 14189 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 3103) took 1208 ms. Trace:
I20260709 12:12:08.835594 14189 rpcz_store.cc:276] 0709 12:12:07.600822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:07.618241 (+ 17419us) service_pool.cc:224] Handling call
0709 12:12:07.625670 (+  7429us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:07.853039 (+227369us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:12:07.871789 (+ 18750us) log.cc:844] Serialized 14 byte log entry
0709 12:12:08.051717 (+179928us) spinlock_profiling.cc:243] Waited 6.49 ms on lock 0x7b4800270558. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f212c064aa1 00007f212c05bb37 00007f212c05b9ca 00007f212c15326f 00007f212c152f37 00007f212c16755c 00007f212c167508 00007f212c167488 00007f212c167443 00007f212c1666ec 00007f212b090a96
0709 12:12:08.530469 (+478752us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:08.531958 (+  1489us) log.cc:844] Serialized 26 byte log entry
0709 12:12:08.532171 (+   213us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:12:08.532208 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:08.532291 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:08.809113 (+276822us) raft_consensus.cc:1685] finished
0709 12:12:08.809221 (+   108us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:08.809366 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1207104,"prepare.queue_time_us":431465,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":50,"raft.queue_time_us":754296,"raft.run_cpu_time_us":2287,"raft.run_wall_time_us":182568,"spinlock_wait_cycles":14926720,"thread_start_us":38079,"threads_started":1,"wal-append.queue_time_us":173168}
I20260709 12:12:08.832499 14338 rpcz_store.cc:276] 0709 12:12:07.790808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:07.823789 (+ 32981us) service_pool.cc:224] Handling call
0709 12:12:08.797500 (+973711us) spinlock_profiling.cc:243] Waited 353 ms on lock 0x7b54000fd2d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f2127135853 00007f212c10360a 00007f21256897d4 00007f2125689762 00007f2125689691 00007f212568960c 00007f21256888c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:12:08.797629 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":811079936}
I20260709 12:12:08.804689 20016 consensus_queue.cc:1048] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.036s
I20260709 12:12:08.841958 20124 raft_consensus.cc:2749] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:12:08.842510 20144 leader_election.cc:290] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:08.832098 20030 raft_consensus.cc:2749] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:12:08.822355 20143 raft_consensus.cc:2749] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:08.841346 20044 consensus_queue.cc:1048] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.003s
I20260709 12:12:08.806236 20031 raft_consensus.cc:2764] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
W20260709 12:12:08.830253 20099 consensus_meta.cc:287] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.791s	user 0.010s	sys 0.003s
I20260709 12:12:08.845438 20099 raft_consensus.cc:515] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:08.846100 20143 raft_consensus.cc:2749] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:12:08.847520 14877 leader_election.cc:304] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:12:08.851503 19997 raft_consensus.cc:2804] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:08.851927 19997 raft_consensus.cc:493] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:12:08.852102 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:08.854815 20051 leader_election.cc:290] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:08.848336 20143 consensus_queue.cc:1059] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:12:08.848960 20141 leader_election.cc:290] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:08.849345 20030 consensus_queue.cc:1059] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:12:08.864267 14154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:08.850387 20077 leader_election.cc:290] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:12:08.841352 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 47125.2us
I20260709 12:12:08.867501 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:08.875150 14183 raft_consensus.cc:3060] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:08.869122 14185 raft_consensus.cc:1275] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:12:08.870832 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:12:08.892304 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 113088us
I20260709 12:12:08.893913 14230 leader_election.cc:304] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:08.903280 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:08.904028 14185 raft_consensus.cc:3060] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:08.906590 14181 raft_consensus.cc:1275] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:12:08.859655 19997 raft_consensus.cc:3060] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:08.918299 14183 raft_consensus.cc:2468] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 15.
I20260709 12:12:08.924314 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:08.920063 14190 raft_consensus.cc:3055] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:08.925037 14190 raft_consensus.cc:740] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:12:08.925009 14189 raft_consensus.cc:1275] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:12:08.930066 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:08.933440 14907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:08.936435 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 21 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:08.864085 19932 leader_election.cc:290] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:08.895051 20129 raft_consensus.cc:493] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
W20260709 12:12:08.944257 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 50444.9us
I20260709 12:12:08.945187 14230 leader_election.cc:304] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:08.946718 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:08.949446 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:08.953749 14338 raft_consensus.cc:2393] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 21: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
I20260709 12:12:08.955191 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:08.956014 14181 raft_consensus.cc:2468] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 14.
I20260709 12:12:08.925755 20124 raft_consensus.cc:493] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:08.961560 14337 raft_consensus.cc:1275] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:12:08.963932 14259 raft_consensus.cc:1275] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 12:12:08.920477 20153 raft_consensus.cc:493] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:08.973694 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:09.007215 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:09.006983 14185 raft_consensus.cc:2468] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 14.
I20260709 12:12:09.008239 14155 leader_election.cc:400] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 16 pre-election: Vote denied by peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673) with higher term. Message: Invalid argument: T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 16. Current term is 17.
I20260709 12:12:09.010208 14155 leader_election.cc:403] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:12:09.007400 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:09.006740 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:08.991674 14230 leader_election.cc:304] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:09.007822 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:09.012696 14339 raft_consensus.cc:2468] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 14.
I20260709 12:12:09.014952 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:08.975718 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:09.016516 14186 raft_consensus.cc:2468] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 13.
I20260709 12:12:09.016988 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
W20260709 12:12:08.942394 19763 consensus_meta.cc:287] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.628s	user 0.010s	sys 0.002s
W20260709 12:12:09.013365 14303 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:09.021626 14230 leader_election.cc:304] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:09.010656 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:09.023518 14185 raft_consensus.cc:2468] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 15.
I20260709 12:12:09.024865 14185 raft_consensus.cc:1275] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:12:09.026343 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:09.027395 14259 raft_consensus.cc:2393] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 16: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:12:09.028343 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:09.030640 14333 raft_consensus.cc:1275] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 10. (term mismatch)
I20260709 12:12:09.031100 14333 pending_rounds.cc:85] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c: Aborting all ops after (but not including) 9
I20260709 12:12:09.031327 14333 pending_rounds.cc:107] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c: Aborting uncommitted NO_OP operation due to leader change: 16.10
I20260709 12:12:09.031448 14184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 3117) took 1244 ms. Trace:
I20260709 12:12:09.031826 14330 raft_consensus.cc:1240] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 18 LEADER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:09.031562 14333 raft_consensus.cc:2889] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:09.032361 14184 rpcz_store.cc:276] 0709 12:12:07.786789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:07.958344 (+171555us) service_pool.cc:224] Handling call
0709 12:12:07.958639 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:07.958836 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:12:08.715259 (+756423us) log.cc:844] Serialized 14 byte log entry
0709 12:12:09.031047 (+315788us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:09.031125 (+    78us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:09.031175 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:09.031248 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:09.031378 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":349797,"prepare.queue_time_us":445946,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":42,"thread_start_us":706032,"threads_started":2}
I20260709 12:12:08.960158 20030 raft_consensus.cc:2804] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:09.036664 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:09.037390 14259 raft_consensus.cc:2468] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 15.
I20260709 12:12:09.043076 14186 raft_consensus.cc:1275] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 16 index: 7. Preceding OpId from leader: term: 18 index: 8. (index mismatch)
I20260709 12:12:09.047564 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:09.018132 20147 raft_consensus.cc:2749] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:09.052712 14259 raft_consensus.cc:1240] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:09.052599 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:09.059442 14304 leader_election.cc:304] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:12:09.060554 14304 leader_election.cc:304] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:12:09.063017 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:09.063831 14903 raft_consensus.cc:2468] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 14.
I20260709 12:12:09.067512 14304 leader_election.cc:304] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:12:09.074070 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:08.970682 20129 raft_consensus.cc:515] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:09.007269 20124 raft_consensus.cc:515] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:09.084282 14186 raft_consensus.cc:1275] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:12:09.085829 20127 consensus_queue.cc:1048] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:12:09.090191 20161 log.cc:927] Time spent T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
I20260709 12:12:09.092790 20158 raft_consensus.cc:2804] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:09.093313 20158 raft_consensus.cc:493] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:09.095395 20124 leader_election.cc:290] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:09.095945 20077 raft_consensus.cc:2804] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:12:09.096516 20077 raft_consensus.cc:697] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 14 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:09.099143 20123 raft_consensus.cc:2749] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673) with higher term. Message: Invalid argument: T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 16. Current term is 17.
I20260709 12:12:09.100083 20155 raft_consensus.cc:2804] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:09.100754 20155 raft_consensus.cc:697] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 18 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:09.101840 20155 consensus_queue.cc:237] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:12:09.104939 20150 log.cc:927] Time spent T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 12:12:09.105896 20152 raft_consensus.cc:493] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:09.106588 20152 raft_consensus.cc:515] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:09.109036 20143 raft_consensus.cc:493] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:09.110761 14181 raft_consensus.cc:1240] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:09.044195 20030 raft_consensus.cc:697] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 16 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:09.024348 20153 raft_consensus.cc:515] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:12:09.122218 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 167475us
I20260709 12:12:09.178534 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:09.179414 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:09.178892 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:09.180599 20153 leader_election.cc:290] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:09.178539 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:09.124419 20054 raft_consensus.cc:493] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:09.186208 20054 raft_consensus.cc:515] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:09.188552 20054 leader_election.cc:290] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:12:09.125524 20163 log.cc:927] Time spent T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
W20260709 12:12:09.126610 20151 log.cc:927] Time spent T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.165s	user 0.001s	sys 0.000s
I20260709 12:12:09.127280 14188 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 3118) took 1340 ms. Trace:
I20260709 12:12:09.191128 14188 rpcz_store.cc:276] 0709 12:12:07.787035 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:07.959329 (+172294us) service_pool.cc:224] Handling call
0709 12:12:07.973922 (+ 14593us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:08.516536 (+542614us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:08.516572 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:08.560204 (+ 43632us) log.cc:844] Serialized 26 byte log entry
0709 12:12:09.027839 (+467635us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:12:09.027883 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:09.027955 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:09.127018 (+ 99063us) raft_consensus.cc:1685] finished
0709 12:12:09.127040 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:09.127210 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":494338,"raft.queue_time_us":561045,"raft.run_cpu_time_us":344,"raft.run_wall_time_us":344,"thread_start_us":439362,"threads_started":1,"wal-append.queue_time_us":537138}
I20260709 12:12:09.113978 20143 raft_consensus.cc:515] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:09.193881 20030 consensus_queue.cc:237] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:09.194996 20143 leader_election.cc:290] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:09.142896 20141 raft_consensus.cc:3055] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:09.196724 20141 raft_consensus.cc:740] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:09.197116 14332 raft_consensus.cc:1240] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 16 LEADER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:09.143615 20001 raft_consensus.cc:3055] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:09.197877 20001 raft_consensus.cc:740] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:09.198544 14333 raft_consensus.cc:1275] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260709 12:12:09.198982 14155 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:09.198830 20001 consensus_queue.cc:260] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:09.199811 19705 raft_consensus.cc:493] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:09.200251 20001 raft_consensus.cc:3060] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:09.200353 19705 raft_consensus.cc:515] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:09.200696 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:09.143759 20099 leader_election.cc:290] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:09.147140 14265 raft_consensus.cc:1240] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:09.046818 19702 consensus_queue.cc:1048] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 12:12:09.154620 14182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 3102) took 1554 ms. Trace:
I20260709 12:12:09.212754 14182 rpcz_store.cc:276] 0709 12:12:07.600510 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:07.618173 (+ 17663us) service_pool.cc:224] Handling call
0709 12:12:07.631063 (+ 12890us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:07.861037 (+229974us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:12:08.292114 (+431077us) spinlock_profiling.cc:243] Waited 2.63 ms on lock 0x7b180039c3a0. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f212cf16ab1 00007f212cf23281 00007f2123fc8c0a 00007f212d708219 00007f2124050a40 00007f212404b4e4 00007f212404b455 00007f212ab333c7 00007f21271459a7 00007f21271550bf 00007f2127155038
0709 12:12:08.383204 (+ 91090us) log.cc:844] Serialized 14 byte log entry
0709 12:12:08.710270 (+327066us) log.cc:844] Serialized 14 byte log entry
0709 12:12:08.712385 (+  2115us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:08.717302 (+  4917us) log.cc:844] Serialized 26 byte log entry
0709 12:12:08.717455 (+   153us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:12:08.717488 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:08.717563 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:09.154341 (+436778us) raft_consensus.cc:1685] finished
0709 12:12:09.154369 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:09.154536 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":831841,"prepare.queue_time_us":507971,"prepare.run_cpu_time_us":117,"prepare.run_wall_time_us":3721,"raft.queue_time_us":235999,"raft.run_cpu_time_us":244,"raft.run_wall_time_us":13625,"spinlock_wait_cycles":78339200,"thread_start_us":368426,"threads_started":2,"wal-append.queue_time_us":449920}
I20260709 12:12:09.097455 20077 consensus_queue.cc:237] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:09.071620 20045 raft_consensus.cc:2749] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:09.081357 19309 raft_consensus.cc:2804] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:09.160838 14260 raft_consensus.cc:3055] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:09.093649 20158 raft_consensus.cc:3060] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:09.165226 20129 leader_election.cc:290] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:12:09.165942 14878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:09.168484 20123 raft_consensus.cc:493] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:09.170691 14257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53050 (request call id 1103) took 1038 ms. Trace:
I20260709 12:12:09.029400 19763 raft_consensus.cc:515] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:09.192625 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:09.197654 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:09.276714 14330 raft_consensus.cc:2410] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for term 14 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
W20260709 12:12:09.178817 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:09.202092 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:12:09.277509 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:09.231499 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:09.216447 20153 raft_consensus.cc:493] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:09.269114 14257 rpcz_store.cc:276] 0709 12:12:08.132681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:08.132823 (+   142us) service_pool.cc:224] Handling call
0709 12:12:08.133168 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:08.503806 (+370638us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:09.170447 (+666641us) spinlock_profiling.cc:243] Waited 363 ms on lock 0x7b54003151d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:12:09.170622 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":834610944}
I20260709 12:12:09.261647 14260 raft_consensus.cc:740] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:09.109086 20152 leader_election.cc:290] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:12:09.199759 14155 connection.cc:256] RPC call timeout handler was delayed by -2.3852134860001115s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1684s for a response
I20260709 12:12:09.279289 14259 raft_consensus.cc:2393] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 14: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
W20260709 12:12:09.279197 14155 connection.cc:256] RPC call timeout handler was delayed by -2.3555134860000635s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17170000000000002s for a response
I20260709 12:12:09.278451 14265 raft_consensus.cc:2393] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 19: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
W20260709 12:12:09.279991 14155 connection.cc:256] RPC call timeout handler was delayed by -2.2889134859999558s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1791s for a response
I20260709 12:12:09.212040 20124 raft_consensus.cc:493] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
W20260709 12:12:09.280354 14155 connection.cc:256] RPC call timeout handler was delayed by -2.28081348600017s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18000000000000002s for a response
W20260709 12:12:09.280789 14155 connection.cc:256] RPC call timeout handler was delayed by -2.2133134860000609s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1875s for a response
W20260709 12:12:09.281092 14155 connection.cc:256] RPC call timeout handler was delayed by -2.1863134860000173s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1905s for a response
W20260709 12:12:09.281399 14155 connection.cc:256] RPC call timeout handler was delayed by -2.162013485999978s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1932s for a response
W20260709 12:12:09.281689 14155 connection.cc:256] RPC call timeout handler was delayed by -1.9343134860000646s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21850000000000003s for a response
W20260709 12:12:09.282006 14155 connection.cc:256] RPC call timeout handler was delayed by -1.8821134859999802s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2243s for a response
W20260709 12:12:09.282307 14155 connection.cc:256] RPC call timeout handler was delayed by -1.7138134860001628s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24300000000000002s for a response
W20260709 12:12:09.282608 14155 connection.cc:256] RPC call timeout handler was delayed by -1.3493134860000282s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.28350000000000003s for a response
W20260709 12:12:09.282894 14155 connection.cc:256] RPC call timeout handler was delayed by -1.2962134860001697s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.28940000000000005s for a response
I20260709 12:12:09.283562 14155 leader_election.cc:304] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:09.279186 14260 consensus_queue.cc:260] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:09.285513 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:09.291882 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:09.290907 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:09.284404 20153 raft_consensus.cc:515] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:09.298278 14333 raft_consensus.cc:1240] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:09.279874 19309 raft_consensus.cc:697] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 15 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:09.284636 20045 raft_consensus.cc:493] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:09.299346 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:09.310737 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:09.377985 14257 raft_consensus.cc:2393] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 14: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:12:09.298208 14259 raft_consensus.cc:2468] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 16.
I20260709 12:12:09.366384 14260 raft_consensus.cc:3060] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:09.197697 20141 consensus_queue.cc:260] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:12:09.369256 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 301806us
W20260709 12:12:09.372803 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 89368.5us
I20260709 12:12:09.383695 14265 raft_consensus.cc:1275] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:12:09.354532 20034 raft_consensus.cc:2749] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:12:09.385355 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 363823us
W20260709 12:12:09.402516 14230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:09.290232 20124 raft_consensus.cc:515] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:09.359025 20152 raft_consensus.cc:493] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:09.359800 20031 raft_consensus.cc:493] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
W20260709 12:12:09.408931 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 352602us
I20260709 12:12:09.433368 14876 leader_election.cc:304] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:09.433769 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:09.434988 14259 raft_consensus.cc:1240] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:09.436846 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:09.438120 20098 raft_consensus.cc:2804] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:09.438573 20098 raft_consensus.cc:493] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:09.438725 20016 consensus_queue.cc:1048] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:12:09.440727 20098 raft_consensus.cc:3060] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:09.440661 20016 consensus_queue.cc:1048] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 12:12:09.441876 20110 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.624s	user 0.004s	sys 0.030s
I20260709 12:12:09.417680 14230 leader_election.cc:304] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:09.368468 20166 raft_consensus.cc:493] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:09.441921 19974 consensus_queue.cc:1048] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 12:12:09.442391 20110 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.625s	user 0.004s	sys 0.030s
I20260709 12:12:09.442970 20166 raft_consensus.cc:515] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:09.444298 19974 consensus_queue.cc:1048] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:12:09.445590 20166 leader_election.cc:290] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:09.446772 20099 raft_consensus.cc:2749] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:12:09.447834 14332 raft_consensus.cc:1240] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 15 LEADER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:09.449211 14230 leader_election.cc:304] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:09.450453 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:09.453455 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:09.456053 20099 raft_consensus.cc:2749] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:09.461643 20099 consensus_queue.cc:1048] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:12:09.464478 14230 leader_election.cc:304] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
W20260709 12:12:09.466763 20168 log.cc:927] Time spent T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 12:12:09.467500 19309 consensus_queue.cc:237] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:09.381090 20127 raft_consensus.cc:493] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:09.280397 20123 raft_consensus.cc:515] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:09.473376 14230 leader_election.cc:304] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
W20260709 12:12:09.484629 14229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:09.486243 14155 leader_election.cc:304] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:09.398399 19705 leader_election.cc:290] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:09.494752 14155 leader_election.cc:304] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:09.492654 20048 raft_consensus.cc:493] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:09.493515 14230 leader_election.cc:304] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:12:09.472076 20141 raft_consensus.cc:3060] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:09.503968 20147 raft_consensus.cc:2804] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:09.498667 20048 raft_consensus.cc:515] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:09.384493 20045 raft_consensus.cc:515] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:09.506217 14230 leader_election.cc:304] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
W20260709 12:12:09.493857 19885 consensus_meta.cc:287] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.703s	user 0.006s	sys 0.006s
I20260709 12:12:09.504823 19705 raft_consensus.cc:2749] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:09.487233 20099 raft_consensus.cc:2749] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:12:09.511615 14155 leader_election.cc:304] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:09.498498 20166 raft_consensus.cc:493] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:09.499148 20143 raft_consensus.cc:2749] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:12:09.496793 20034 raft_consensus.cc:2749] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:09.517896 14230 leader_election.cc:304] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:09.508862 20147 raft_consensus.cc:493] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:09.421698 19702 consensus_queue.cc:1059] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.081s
W20260709 12:12:09.526630 20167 log.cc:927] Time spent T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 12:12:09.491186 20152 raft_consensus.cc:515] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:09.494021 20127 raft_consensus.cc:515] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:09.564129 20146 raft_consensus.cc:493] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:09.595451 14909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53194 (request call id 1070) took 1302 ms. Trace:
I20260709 12:12:09.560284 14261 raft_consensus.cc:1275] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 17 index: 8. Preceding OpId from leader: term: 18 index: 8. (term mismatch)
I20260709 12:12:09.489681 20031 raft_consensus.cc:515] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:09.598363 14261 pending_rounds.cc:85] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec: Aborting all ops after (but not including) 7
I20260709 12:12:09.598968 14261 pending_rounds.cc:107] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec: Aborting uncommitted NO_OP operation due to leader change: 17.8
I20260709 12:12:09.599220 14261 raft_consensus.cc:2889] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:09.600081 20031 leader_election.cc:290] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:12:09.567520 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 497395us
I20260709 12:12:09.523121 20130 consensus_queue.cc:260] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } }
I20260709 12:12:09.602392 20130 raft_consensus.cc:3060] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:09.602649 20140 consensus_queue.cc:1048] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:12:09.604247 20140 consensus_queue.cc:1048] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 12:12:09.572129 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 54405.9us
I20260709 12:12:09.516698 20085 raft_consensus.cc:493] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:09.607673 20085 raft_consensus.cc:515] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:09.592077 14260 raft_consensus.cc:1275] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:12:09.610754 20097 consensus_queue.cc:1059] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:12:09.612238 14303 leader_election.cc:304] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:09.613126 20140 raft_consensus.cc:2749] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:09.614441 20140 consensus_queue.cc:1048] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:12:09.616945 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:09.618046 20085 leader_election.cc:290] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:09.617293 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
W20260709 12:12:09.623845 14303 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:09.595906 14909 rpcz_store.cc:276] 0709 12:12:08.287949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:08.288613 (+   664us) service_pool.cc:224] Handling call
0709 12:12:09.590207 (+1301594us) spinlock_profiling.cc:243] Waited 269 ms on lock 0x7b540020c454. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:12:09.590335 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":618346240}
I20260709 12:12:09.567464 20181 raft_consensus.cc:493] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:09.635604 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 124076us
I20260709 12:12:09.571606 20147 raft_consensus.cc:3060] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:12:09.636905 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 198782us
I20260709 12:12:09.641256 14303 leader_election.cc:304] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:09.574730 19912 raft_consensus.cc:2749] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:12:09.589771 19932 raft_consensus.cc:2749] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:09.646060 14155 leader_election.cc:304] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:12:09.568041 20166 raft_consensus.cc:515] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:09.633330 20138 raft_consensus.cc:3055] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 15 LEADER]: Stepping down as leader of term 15
W20260709 12:12:09.698673 19997 consensus_meta.cc:287] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db: Time spent flushing consensus metadata: real 0.760s	user 0.017s	sys 0.002s
W20260709 12:12:09.699043 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 53101us
W20260709 12:12:09.727501 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 48969.2us
I20260709 12:12:09.704264 19932 raft_consensus.cc:2804] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:12:09.738286 14155 leader_election.cc:304] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:12:09.652343 19702 raft_consensus.cc:2804] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:09.654456 19763 leader_election.cc:290] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 17 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:09.635149 19879 consensus_queue.cc:1048] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
W20260709 12:12:09.694670 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:09.633703 20146 raft_consensus.cc:515] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:09.742973 20191 raft_consensus.cc:493] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:09.750324 20187 log.cc:927] Time spent T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.177s	user 0.000s	sys 0.001s
W20260709 12:12:09.737406 20001 consensus_meta.cc:287] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.537s	user 0.020s	sys 0.000s
I20260709 12:12:09.717518 20153 leader_election.cc:290] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:09.648574 20181 raft_consensus.cc:515] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:12:09.736667 20030 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.018s	sys 0.013s
I20260709 12:12:09.733430 20138 raft_consensus.cc:740] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:09.739936 20097 consensus_queue.cc:1243] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer 65c9c1653b3346b39a0e118540e6080c log is divergent from this leader: its last log entry 18.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:12:09.771347 20153 raft_consensus.cc:2764] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader election decision vote started in defunct term 13: won
I20260709 12:12:09.764885 19702 raft_consensus.cc:697] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 17 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:09.783061 19702 consensus_queue.cc:237] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:09.741318 20110 raft_consensus.cc:493] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:09.763221 20124 leader_election.cc:290] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:09.763203 19932 raft_consensus.cc:697] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 14 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
W20260709 12:12:09.794150 20170 log.cc:927] Time spent T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.435s	user 0.004s	sys 0.000s
W20260709 12:12:09.773023 20030 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.571s	user 0.018s	sys 0.013s
I20260709 12:12:09.796170 20152 leader_election.cc:290] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:09.796499 14190 consensus_queue.cc:260] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:12:09.797197 20177 log.cc:927] Time spent T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.231s	user 0.000s	sys 0.000s
I20260709 12:12:09.739162 20180 consensus_queue.cc:1048] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.065s
I20260709 12:12:09.799676 20146 leader_election.cc:290] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:09.794209 19932 consensus_queue.cc:237] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:12:09.805068 20149 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 16 current term: 16 is higher.
I20260709 12:12:09.801458 14190 raft_consensus.cc:3060] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:09.807636 20045 leader_election.cc:290] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:09.809124 14335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 1102) took 1133 ms. Trace:
I20260709 12:12:09.810563 20123 leader_election.cc:290] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:09.809541 14335 rpcz_store.cc:276] 0709 12:12:08.675770 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:08.676673 (+   903us) service_pool.cc:224] Handling call
0709 12:12:08.709603 (+ 32930us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:12:08.782587 (+ 72984us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:08.782622 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:12:08.792156 (+  9534us) log.cc:844] Serialized 52 byte log entry
0709 12:12:09.032151 (+239995us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:12:09.359718 (+327567us) log.cc:844] Serialized 14 byte log entry
0709 12:12:09.369133 (+  9415us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:09.808646 (+439513us) spinlock_profiling.cc:243] Waited 72.6 ms on lock 0x7b540001a754. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:12:09.808696 (+    50us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:09.808743 (+    47us) raft_consensus.cc:1685] finished
0709 12:12:09.808856 (+   113us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:09.809058 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31373,"prepare.queue_time_us":602688,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":69576,"raft.run_cpu_time_us":397,"raft.run_wall_time_us":30938,"spinlock_wait_cycles":166931200,"thread_start_us":530205,"threads_started":2,"wal-append.queue_time_us":360140}
I20260709 12:12:09.812243 20166 leader_election.cc:290] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:09.801862 20110 raft_consensus.cc:515] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:12:09.794516 20194 log.cc:927] Time spent T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 12:12:09.816057 20110 leader_election.cc:290] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:12:09.816764 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:09.764562 20191 raft_consensus.cc:515] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:09.740254 19997 raft_consensus.cc:515] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:09.823761 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:09.842697 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:09.826123 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:09.832127 19791 raft_consensus.cc:3060] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:12:09.838878 14154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:09.834120 14907 raft_consensus.cc:1240] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:09.853155 14183 raft_consensus.cc:1240] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 14. Current term is 15. Ops: [14.7-14.7]
I20260709 12:12:09.854704 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:09.855481 14188 raft_consensus.cc:2468] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 15.
I20260709 12:12:09.856582 14185 raft_consensus.cc:1275] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 12:12:09.834504 14190 raft_consensus.cc:1275] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 8. (term mismatch)
I20260709 12:12:09.859273 14185 raft_consensus.cc:1275] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:12:09.862702 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:09.865697 14190 pending_rounds.cc:85] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf: Aborting all ops after (but not including) 7
I20260709 12:12:09.866160 14190 pending_rounds.cc:107] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf: Aborting uncommitted NO_OP operation due to leader change: 15.8
I20260709 12:12:09.867116 14190 raft_consensus.cc:2889] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:09.868398 14190 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 3125) took 1001 ms. Trace:
W20260709 12:12:09.920737 14230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:09.935154 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:09.935534 14187 raft_consensus.cc:1275] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:12:09.936695 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:09.937341 14187 raft_consensus.cc:2468] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 14.
I20260709 12:12:09.938542 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:09.936327 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:09.939298 14183 raft_consensus.cc:2468] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 16.
I20260709 12:12:09.940188 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:09.940739 14183 raft_consensus.cc:2468] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 15.
I20260709 12:12:09.941520 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:09.941843 14190 rpcz_store.cc:276] 0709 12:12:08.866720 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:08.869914 (+  3194us) service_pool.cc:224] Handling call
0709 12:12:08.919930 (+ 50016us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:09.212837 (+292907us) spinlock_profiling.cc:243] Waited 8.31 ms on lock 0x7b4c00311180. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2125407a20 00007f2125418a29 00007f21253de644 00007f2125405f2d 00007f2125405b93 00007f212713618b 00007f2127136cb5 00007f2127131f30 00007f21271337de 00007f212713db49 00007f212713e416
0709 12:12:09.796122 (+583285us) spinlock_profiling.cc:243] Waited 44.1 ms on lock 0x7b5400318e20. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f21270b906f 00007f2127131f60 00007f21271337de 00007f212713db49 00007f212713e416 00007f212713ad8f 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62
0709 12:12:09.868130 (+ 72008us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:09.868337 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":120528128}
I20260709 12:12:09.942346 14183 raft_consensus.cc:2468] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 14.
I20260709 12:12:09.944389 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:12:09.898638 14305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:09.945014 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:09.945753 14182 raft_consensus.cc:2468] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 18.
I20260709 12:12:09.945027 14181 raft_consensus.cc:2468] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 17.
I20260709 12:12:09.947973 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:09.948899 14186 raft_consensus.cc:2410] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for term 14 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
W20260709 12:12:09.822506 20185 log.cc:927] Time spent T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.125s	user 0.000s	sys 0.001s
W20260709 12:12:09.821703 20158 consensus_meta.cc:287] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.543s	user 0.007s	sys 0.000s
I20260709 12:12:09.951470 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:09.832312 14155 leader_election.cc:304] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:12:09.954345 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:09.955035 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:09.960858 14189 raft_consensus.cc:3060] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:09.957399 19309 consensus_queue.cc:1048] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:12:09.956743 14305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:09.960994 14188 raft_consensus.cc:2468] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 14.
I20260709 12:12:09.839421 20045 raft_consensus.cc:493] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:09.969333 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 231121us
I20260709 12:12:09.970048 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:09.970748 14182 raft_consensus.cc:2468] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 15.
I20260709 12:12:09.973209 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:09.839270 20027 raft_consensus.cc:493] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:09.841701 20048 leader_election.cc:290] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:09.835336 19997 leader_election.cc:290] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 16 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:09.833215 20191 leader_election.cc:290] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:09.999967 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:10.003338 14259 raft_consensus.cc:2468] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 16.
I20260709 12:12:09.826263 20098 raft_consensus.cc:515] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:10.002986 14303 leader_election.cc:304] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:10.006603 19309 raft_consensus.cc:2804] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:10.006757 14303 leader_election.cc:304] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:10.007143 19309 raft_consensus.cc:493] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:10.007560 19309 raft_consensus.cc:3060] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:10.007799 14303 leader_election.cc:304] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:10.008751 20184 raft_consensus.cc:2804] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:10.009163 20184 raft_consensus.cc:493] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:10.009508 20184 raft_consensus.cc:3060] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:10.013969 19702 raft_consensus.cc:2804] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:10.014537 19702 raft_consensus.cc:493] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:10.014901 19702 raft_consensus.cc:3060] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:10.019587 20184 raft_consensus.cc:515] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:09.937940 20110 consensus_queue.cc:1048] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.053s
I20260709 12:12:10.025041 19309 raft_consensus.cc:515] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:12:10.030409 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 198174us
I20260709 12:12:10.032593 14155 leader_election.cc:304] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:10.034296 14333 raft_consensus.cc:1275] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:12:09.977231 20180 raft_consensus.cc:493] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:10.022256 20184 leader_election.cc:290] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 17 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:10.038461 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:10.041468 14189 raft_consensus.cc:2468] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 16.
I20260709 12:12:09.830835 20138 consensus_queue.cc:260] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:10.070644 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
W20260709 12:12:10.071308 20179 log.cc:927] Time spent T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.372s	user 0.002s	sys 0.000s
I20260709 12:12:10.072014 20099 raft_consensus.cc:3055] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:10.072461 20099 raft_consensus.cc:740] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:10.073297 20099 consensus_queue.cc:260] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:10.074635 20099 raft_consensus.cc:3060] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:10.068928 14903 raft_consensus.cc:1240] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:10.074676 14264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41764 (request call id 3201) took 1113 ms. Trace:
I20260709 12:12:10.076027 14264 rpcz_store.cc:276] 0709 12:12:08.961327 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:08.961503 (+   176us) service_pool.cc:224] Handling call
0709 12:12:08.961890 (+   387us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:08.962296 (+   406us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:08.962328 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:09.012573 (+ 50245us) log.cc:844] Serialized 26 byte log entry
0709 12:12:09.369505 (+356932us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:12:09.369547 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:09.369632 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:10.038003 (+668371us) spinlock_profiling.cc:243] Waited 5.2 ms on lock 0x7b4400022b4c. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2123f74c85 00007f2123f756a2 00007f2126ce71db 00007f2126ce2aaf 00007f2126cd686e 00007f2126cd5bb6 00007f2126cd57d8 00007f2126cdf221 00007f2126cdf1d9 00007f2126cdf169
0709 12:12:10.074354 (+ 36351us) raft_consensus.cc:1685] finished
0709 12:12:10.074380 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:10.074605 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7079,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":36767,"spinlock_wait_cycles":11952000,"thread_start_us":319138,"threads_started":1,"wal-append.queue_time_us":563566}
I20260709 12:12:10.003679 19885 raft_consensus.cc:2749] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:10.050942 19763 raft_consensus.cc:493] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:10.083731 19763 raft_consensus.cc:515] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:10.089972 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:10.023890 20152 raft_consensus.cc:2764] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 12:12:10.093282 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:10.099491 14333 raft_consensus.cc:3060] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:10.102056 19309 leader_election.cc:290] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 15 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:10.101517 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:10.103118 14264 raft_consensus.cc:2468] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 15.
I20260709 12:12:10.049542 14155 leader_election.cc:304] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:10.094197 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:10.105187 14256 raft_consensus.cc:2468] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 13.
I20260709 12:12:09.978312 20045 raft_consensus.cc:515] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:10.165439 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:12:10.314370 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 264911us
W20260709 12:12:10.192480 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 186028us
I20260709 12:12:10.316545 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:10.230772 19763 leader_election.cc:290] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:09.976528 20158 raft_consensus.cc:515] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:10.002388 20027 raft_consensus.cc:515] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:10.069916 20180 raft_consensus.cc:515] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:10.135520 20124 consensus_queue.cc:1059] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.125s
I20260709 12:12:10.071125 20157 consensus_queue.cc:1048] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.165s
I20260709 12:12:10.331732 14259 raft_consensus.cc:1275] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:12:10.070024 14877 leader_election.cc:304] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:12:10.311659 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:10.332998 14256 raft_consensus.cc:2468] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 14.
W20260709 12:12:10.333165 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 263239us
W20260709 12:12:10.187996 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 179143us
I20260709 12:12:10.336134 14330 raft_consensus.cc:1240] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 18 LEADER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 17. Current term is 18. Ops: [17.9-17.9]
I20260709 12:12:10.317958 14333 raft_consensus.cc:2468] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 16.
I20260709 12:12:10.320081 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:12:10.313221 20147 consensus_meta.cc:287] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.658s	user 0.012s	sys 0.006s
I20260709 12:12:10.330905 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:10.302541 20123 raft_consensus.cc:2749] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:10.331723 14155 leader_election.cc:304] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:10.039777 19932 raft_consensus.cc:2749] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:10.034124 20191 consensus_queue.cc:1048] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.286s
I20260709 12:12:10.343459 14265 raft_consensus.cc:3060] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:10.335352 14303 leader_election.cc:304] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
W20260709 12:12:10.322654 20141 consensus_meta.cc:287] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.813s	user 0.020s	sys 0.008s
I20260709 12:12:10.350005 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:10.318684 20200 raft_consensus.cc:493] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:10.352325 14188 raft_consensus.cc:2468] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 15.
I20260709 12:12:10.318979 20149 raft_consensus.cc:493] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
W20260709 12:12:10.338420 20205 log.cc:927] Time spent T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.332s	user 0.003s	sys 0.000s
I20260709 12:12:10.301469 20073 consensus_queue.cc:1048] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 12:12:10.357251 14256 raft_consensus.cc:3060] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:10.372390 14907 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "afce5304599246a580d798fc0c843964"
dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
mode: GRACEFUL
new_leader_uuid: "17aab1bbf5014936aa18cc21818b26ec"
 from {username='slave'} at 127.0.0.1:38628
I20260709 12:12:10.370209 14303 leader_election.cc:304] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:12:10.373019 14907 raft_consensus.cc:606] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 15 LEADER]: Received request to transfer leadership to TS 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:12:10.342293 20085 raft_consensus.cc:2804] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:10.336068 20152 raft_consensus.cc:493] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:10.402222 14259 raft_consensus.cc:1275] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:12:10.358847 20110 raft_consensus.cc:493] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:10.327453 19702 raft_consensus.cc:515] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:12:10.444852 14230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:10.460916 14256 raft_consensus.cc:2468] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 15.
I20260709 12:12:10.403102 20085 raft_consensus.cc:493] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:10.494256 20085 raft_consensus.cc:3060] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:10.402030 20141 raft_consensus.cc:493] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:10.498081 20141 raft_consensus.cc:515] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:10.500819 20141 leader_election.cc:290] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:10.377701 20200 raft_consensus.cc:515] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:10.465432 20211 raft_consensus.cc:493] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:10.466996 14260 raft_consensus.cc:1275] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 9. (term mismatch)
I20260709 12:12:10.506381 20200 leader_election.cc:290] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:10.468523 14261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41764 (request call id 3195) took 2058 ms. Trace:
I20260709 12:12:10.470472 20143 raft_consensus.cc:493] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:10.514660 14258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53050 (request call id 1104) took 1844 ms. Trace:
I20260709 12:12:10.471189 19702 leader_election.cc:290] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 17 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:10.472159 20123 raft_consensus.cc:2749] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:10.476881 20081 raft_consensus.cc:493] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:10.524271 20180 leader_election.cc:290] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:10.471189 14264 raft_consensus.cc:1275] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 12:12:10.460903 20110 raft_consensus.cc:515] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:12:10.480551 20214 log.cc:927] Time spent T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
W20260709 12:12:10.477757 14230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:10.528411 14185 raft_consensus.cc:1275] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:12:10.492341 20027 leader_election.cc:290] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:10.506881 14260 pending_rounds.cc:85] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec: Aborting all ops after (but not including) 8
W20260709 12:12:10.478621 14229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:10.530416 14229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:10.530055 14260 pending_rounds.cc:107] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec: Aborting uncommitted NO_OP operation due to leader change: 17.9
I20260709 12:12:10.531018 14260 raft_consensus.cc:2889] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:10.532122 14229 leader_election.cc:304] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:10.351858 20147 raft_consensus.cc:515] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:10.515661 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:10.533025 14188 raft_consensus.cc:2468] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 16.
I20260709 12:12:10.507200 14261 rpcz_store.cc:276] 0709 12:12:08.410196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:08.430136 (+ 19940us) service_pool.cc:224] Handling call
0709 12:12:08.441556 (+ 11420us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:09.599720 (+1158164us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:10.468257 (+868537us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b54001b1cd4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:12:10.468455 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2484887296}
I20260709 12:12:10.535145 20138 raft_consensus.cc:3060] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:10.515100 14258 rpcz_store.cc:276] 0709 12:12:08.670155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:08.708710 (+ 38555us) service_pool.cc:224] Handling call
0709 12:12:08.709033 (+   323us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:08.794348 (+ 85315us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:08.794381 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:08.806863 (+ 12482us) log.cc:844] Serialized 26 byte log entry
0709 12:12:09.813758 (+1006895us) spinlock_profiling.cc:243] Waited 10.9 ms on lock 0x7b18002e20a0. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f212cf16ab1 00007f212cf23281 00007f2124030e07 00007f212ce8b9a9 00007f212404d69b 00007f212404b93f 00007f212404dc02 00007f2126cd520b 00007f2126cdad23 00007f2126cdb0d1 00007f21270f6a0f
0709 12:12:09.999705 (+185947us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:09.999747 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:10.074415 (+ 74668us) spinlock_profiling.cc:243] Waited 61.7 ms on lock 0x7b54002003d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:12:10.074463 (+    48us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:10.514420 (+439957us) raft_consensus.cc:1685] finished
0709 12:12:10.514443 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:10.514586 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20070,"raft.queue_time_us":20350,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":3657,"spinlock_wait_cycles":166978688,"thread_start_us":185766,"threads_started":1,"wal-append.queue_time_us":1198682}
I20260709 12:12:10.506889 20211 raft_consensus.cc:515] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:10.523881 20081 raft_consensus.cc:515] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:12:10.532346 20206 log.cc:927] Time spent T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.219s	user 0.005s	sys 0.000s
I20260709 12:12:10.389281 20149 raft_consensus.cc:515] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:10.510905 14876 leader_election.cc:304] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
W20260709 12:12:10.539269 14305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:10.600138 14305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:10.547233 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:10.601102 20231 raft_consensus.cc:2804] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:10.532023 14265 raft_consensus.cc:2468] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 17.
I20260709 12:12:10.602689 20083 raft_consensus.cc:2804] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 12:12:10.556819 14154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:10.557683 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 187705us
I20260709 12:12:10.606449 14303 leader_election.cc:304] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:10.608114 14303 leader_election.cc:304] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:12:10.610363 14188 raft_consensus.cc:3060] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:10.613971 19702 raft_consensus.cc:2749] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:10.614842 19702 raft_consensus.cc:2804] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:10.615192 19702 raft_consensus.cc:493] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:10.615576 19702 raft_consensus.cc:3060] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:10.513825 20146 raft_consensus.cc:2804] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:10.646590 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:10.649988 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:12:10.593029 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 261639us
I20260709 12:12:10.414981 20152 raft_consensus.cc:515] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:10.539839 14229 leader_election.cc:304] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:10.601634 20231 raft_consensus.cc:493] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:12:10.600131 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 89325.1us
W20260709 12:12:10.656689 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 116966us
I20260709 12:12:10.658046 14229 leader_election.cc:304] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:10.649993 20146 raft_consensus.cc:493] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:10.597913 20215 raft_consensus.cc:2804] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:10.609407 14303 leader_election.cc:304] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:10.660420 14876 leader_election.cc:304] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:10.522120 20143 raft_consensus.cc:515] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:10.652935 20140 raft_consensus.cc:493] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:10.654273 20001 raft_consensus.cc:493] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:10.663040 19791 consensus_meta.cc:287] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.819s	user 0.010s	sys 0.005s
W20260709 12:12:10.674222 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 64871us
I20260709 12:12:10.659909 20141 raft_consensus.cc:2804] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:10.675259 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:10.676362 14303 leader_election.cc:304] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:10.679961 14262 raft_consensus.cc:2468] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 15.
I20260709 12:12:10.657605 20231 raft_consensus.cc:3060] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:10.665952 20146 raft_consensus.cc:3060] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:10.680444 14187 raft_consensus.cc:2468] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 15.
I20260709 12:12:10.689545 20048 raft_consensus.cc:2804] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:10.690058 20048 raft_consensus.cc:493] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:10.690448 20048 raft_consensus.cc:3060] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:10.692423 20181 leader_election.cc:290] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:10.693886 20221 raft_consensus.cc:2804] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:10.694360 20221 raft_consensus.cc:493] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:10.694695 20221 raft_consensus.cc:3060] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:10.698770 20110 leader_election.cc:290] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:10.698935 20152 leader_election.cc:290] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:10.664450 20215 raft_consensus.cc:493] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:10.671516 20016 raft_consensus.cc:2804] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:10.664789 20045 leader_election.cc:290] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:10.681123 19912 raft_consensus.cc:493] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:10.655162 14155 leader_election.cc:304] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:10.678038 20158 leader_election.cc:290] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:10.686177 20141 raft_consensus.cc:493] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:10.726255 20141 raft_consensus.cc:3060] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:10.723479 14264 raft_consensus.cc:1240] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:10.664007 20201 consensus_queue.cc:1048] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.038s
W20260709 12:12:10.714002 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 378664us
I20260709 12:12:10.676438 20140 raft_consensus.cc:515] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } }
I20260709 12:12:10.677564 20001 raft_consensus.cc:515] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:10.704650 20215 raft_consensus.cc:3060] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:10.707017 20016 raft_consensus.cc:493] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:10.702132 19791 consensus_queue.cc:1048] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 12:12:10.727721 20045 raft_consensus.cc:2749] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 12:12:10.764554 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 83688.6us
I20260709 12:12:10.757433 14876 leader_election.cc:304] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:10.765385 14229 leader_election.cc:304] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:10.767138 14907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:10.770308 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:10.768683 14185 raft_consensus.cc:1275] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 12:12:10.771590 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:10.772174 14185 raft_consensus.cc:2468] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 11.
I20260709 12:12:10.772979 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:10.773476 14185 raft_consensus.cc:3060] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:10.778120 20219 raft_consensus.cc:2749] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:12:10.779253 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 124198us
I20260709 12:12:10.779992 14155 leader_election.cc:304] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:12:10.780838 20226 raft_consensus.cc:2804] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:12:10.781265 20226 raft_consensus.cc:493] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:10.781637 20226 raft_consensus.cc:3060] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:10.783360 20083 raft_consensus.cc:493] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:10.783841 20083 raft_consensus.cc:3060] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:10.708921 19912 raft_consensus.cc:515] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:10.786625 20211 leader_election.cc:290] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:10.786839 14155 leader_election.cc:304] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:10.789122 20149 leader_election.cc:290] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:10.790014 20223 raft_consensus.cc:2749] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:10.791004 14155 leader_election.cc:304] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:10.769213 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:10.793170 20152 raft_consensus.cc:2749] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:10.793373 20218 consensus_queue.cc:1048] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:12:10.768394 14187 raft_consensus.cc:1275] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:12:10.800414 14155 leader_election.cc:304] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:10.804525 14185 raft_consensus.cc:2468] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 15.
W20260709 12:12:10.805565 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 48573.6us
I20260709 12:12:10.806922 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:10.807552 14910 raft_consensus.cc:3060] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:10.808842 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:10.809201 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:10.818487 14907 raft_consensus.cc:1240] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 15. Current term is 16. Ops: []
W20260709 12:12:10.820531 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 55226.3us
I20260709 12:12:10.821604 14229 leader_election.cc:304] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:10.781558 20081 leader_election.cc:290] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:10.789000 19912 leader_election.cc:290] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:10.824290 14155 leader_election.cc:304] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:10.798882 19791 consensus_queue.cc:1243] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer 885067a0d31741bfb5c9935788e315bf log is divergent from this leader: its last log entry 13.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
W20260709 12:12:10.824358 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 67335.6us
W20260709 12:12:10.824952 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 67610.8us
I20260709 12:12:10.813537 20016 raft_consensus.cc:3060] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:10.842411 19309 consensus_queue.cc:1059] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:12:10.851550 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:10.852212 14187 raft_consensus.cc:3060] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Advancing to term 17
I20260709 12:12:10.814746 20149 raft_consensus.cc:493] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:10.861716 20218 raft_consensus.cc:2749] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:10.861522 20217 consensus_queue.cc:1059] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:12:10.862308 20159 raft_consensus.cc:493] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:10.866024 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:10.827689 20124 raft_consensus.cc:2749] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:10.913727 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:10.872493 14910 raft_consensus.cc:2468] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 17.
I20260709 12:12:10.814069 20045 consensus_queue.cc:1048] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.061s
I20260709 12:12:10.913728 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:10.872987 14877 leader_election.cc:304] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:10.875696 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:10.876291 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:10.876541 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:10.917768 14337 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6"
dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
mode: GRACEFUL
new_leader_uuid: "885067a0d31741bfb5c9935788e315bf"
 from {username='slave'} at 127.0.0.1:50896
I20260709 12:12:10.861436 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:12:10.878520 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 57005.7us
I20260709 12:12:10.919667 14229 leader_election.cc:304] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:10.869190 20226 raft_consensus.cc:515] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:10.883915 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:10.885831 14339 raft_consensus.cc:1275] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:12:10.923786 14333 raft_consensus.cc:2393] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 17: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
W20260709 12:12:10.902427 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 54440.5us
I20260709 12:12:10.924225 14337 raft_consensus.cc:606] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Received request to transfer leadership to TS 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:10.924608 14337 raft_consensus.cc:614] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:10.848755 19960 raft_consensus.cc:493] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:10.828806 20143 leader_election.cc:290] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:10.848501 20191 raft_consensus.cc:493] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:10.918675 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:10.924970 14304 leader_election.cc:304] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:10.911145 14155 leader_election.cc:304] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:10.940869 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:10.912701 20099 raft_consensus.cc:2804] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:10.945894 14155 leader_election.cc:304] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:10.946020 14304 leader_election.cc:304] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:10.935626 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:10.937440 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:10.937901 14338 raft_consensus.cc:1240] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 15. Current term is 16. Ops: [15.12-15.12]
W20260709 12:12:10.941807 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 68887us
I20260709 12:12:10.934618 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:10.909102 19912 raft_consensus.cc:493] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:10.943240 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 66840.4us
I20260709 12:12:10.947657 14265 raft_consensus.cc:2468] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 18.
I20260709 12:12:10.950384 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:10.950284 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:10.952670 14155 leader_election.cc:304] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:10.953553 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:10.970710 14155 leader_election.cc:304] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:10.954428 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:10.973851 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:10.955825 14264 raft_consensus.cc:1240] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:10.956137 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:10.956938 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:10.999066 14263 raft_consensus.cc:2410] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for term 16 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
W20260709 12:12:10.997164 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 45351.9us
I20260709 12:12:11.000342 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:11.001112 14265 raft_consensus.cc:2393] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 16: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:12:10.942404 20140 leader_election.cc:290] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:10.950384 20143 raft_consensus.cc:2749] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:10.920085 20166 raft_consensus.cc:493] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:10.963579 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:10.898869 20152 consensus_queue.cc:1059] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
W20260709 12:12:11.053429 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 83328.8us
I20260709 12:12:11.056193 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:10.958554 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:10.918185 20044 raft_consensus.cc:2764] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 12:12:10.997502 14155 leader_election.cc:304] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:10.951593 20130 raft_consensus.cc:2749] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:10.955001 20218 raft_consensus.cc:3060] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:10.912400 20149 raft_consensus.cc:515] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:11.013949 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:11.050539 14187 raft_consensus.cc:2468] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 17.
I20260709 12:12:10.960775 20129 consensus_queue.cc:1048] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.098s
I20260709 12:12:11.127067 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:10.962838 20200 raft_consensus.cc:2804] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:10.960947 20099 raft_consensus.cc:697] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 16 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:10.960309 20158 raft_consensus.cc:2749] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:10.940908 19960 raft_consensus.cc:515] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:10.944572 20191 raft_consensus.cc:515] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:11.108325 20045 raft_consensus.cc:493] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:11.001112 20231 raft_consensus.cc:515] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:11.006327 20223 raft_consensus.cc:2749] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:12:11.110637 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 55986.6us
I20260709 12:12:11.160033 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:10.938964 20159 raft_consensus.cc:515] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:11.161768 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:11.162896 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:11.057767 20054 consensus_queue.cc:1059] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.105s
W20260709 12:12:11.115969 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 103833us
I20260709 12:12:11.163949 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:11.164093 14877 leader_election.cc:304] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:11.164569 14187 raft_consensus.cc:2468] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 14.
I20260709 12:12:11.119089 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:11.136925 14257 raft_consensus.cc:2393] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 15: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:12:10.963297 20215 raft_consensus.cc:515] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:11.167438 20215 leader_election.cc:290] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 14 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:11.013485 20222 raft_consensus.cc:2749] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:11.121297 20124 raft_consensus.cc:2749] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:10.953841 19912 raft_consensus.cc:515] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:11.172192 14304 leader_election.cc:304] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
W20260709 12:12:11.150462 20203 log.cc:927] Time spent T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.774s	user 0.003s	sys 0.000s
I20260709 12:12:11.163239 20159 leader_election.cc:290] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:11.147579 20152 raft_consensus.cc:2804] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 12:12:11.182163 20240 log.cc:927] Time spent T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
W20260709 12:12:11.182723 20237 log.cc:927] Time spent T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.232s	user 0.001s	sys 0.000s
I20260709 12:12:11.183135 20227 raft_consensus.cc:493] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:11.190250 20110 raft_consensus.cc:2804] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:11.192308 20191 leader_election.cc:290] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:11.194195 19960 leader_election.cc:290] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:12:11.194455 20234 log.cc:927] Time spent T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.252s	user 0.000s	sys 0.000s
W20260709 12:12:11.195523 20245 log.cc:927] Time spent T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.140s	user 0.000s	sys 0.000s
I20260709 12:12:11.195822 20226 leader_election.cc:290] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 13 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:12:11.196558 20246 log.cc:927] Time spent T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:12:11.198922 20147 leader_election.cc:290] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:11.147621 20001 leader_election.cc:290] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:11.171582 20045 raft_consensus.cc:515] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:11.276648 20231 leader_election.cc:290] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 17 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:11.180878 14304 leader_election.cc:304] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
W20260709 12:12:11.278043 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 97265.2us
I20260709 12:12:11.279690 20035 raft_consensus.cc:3055] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:11.280185 20035 raft_consensus.cc:740] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:12:11.212865 14903 raft_consensus.cc:2368] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 16. Current term is 17.
I20260709 12:12:11.282423 14190 raft_consensus.cc:1275] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:12:11.170512 20099 consensus_queue.cc:237] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:12:11.208779 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 245768us
I20260709 12:12:11.142849 20209 consensus_queue.cc:1048] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.261s
I20260709 12:12:11.284004 20001 consensus_queue.cc:1048] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:12:11.285861 20127 leader_election.cc:290] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:11.287266 19912 leader_election.cc:290] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:11.108237 20166 raft_consensus.cc:515] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:11.176430 20241 raft_consensus.cc:493] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:11.249431 20110 raft_consensus.cc:493] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:11.288321 20110 raft_consensus.cc:3060] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:11.288340 20241 raft_consensus.cc:515] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:11.291766 14262 raft_consensus.cc:2410] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for term 17 because replica has last-logged OpId of term: 16 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 7.
I20260709 12:12:11.292690 20241 leader_election.cc:290] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:11.293418 20254 raft_consensus.cc:2749] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:11.176893 20239 raft_consensus.cc:2804] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:11.294440 20239 raft_consensus.cc:493] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:11.294869 20239 raft_consensus.cc:3060] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:11.282521 14189 raft_consensus.cc:3060] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:11.283602 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:11.298344 14190 raft_consensus.cc:3060] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Advancing to term 17
W20260709 12:12:11.249032 20141 consensus_meta.cc:287] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.522s	user 0.009s	sys 0.002s
I20260709 12:12:11.243211 20215 raft_consensus.cc:493] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:11.182089 20130 consensus_queue.cc:1048] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.068s
I20260709 12:12:11.281364 20129 raft_consensus.cc:2804] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:11.254865 20083 raft_consensus.cc:515] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:11.207628 20152 raft_consensus.cc:493] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:11.312959 20152 raft_consensus.cc:3060] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:12:11.315546 20221 consensus_meta.cc:287] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.620s	user 0.008s	sys 0.003s
I20260709 12:12:11.317365 20221 raft_consensus.cc:515] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:11.272724 20227 raft_consensus.cc:515] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:11.319746 20221 leader_election.cc:290] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:12:11.271073 19702 consensus_meta.cc:287] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.655s	user 0.011s	sys 0.002s
I20260709 12:12:11.320683 20227 leader_election.cc:290] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:11.321156 19702 raft_consensus.cc:515] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:11.322265 14334 raft_consensus.cc:1240] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:11.323417 19702 leader_election.cc:290] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:11.324333 14182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56652 (request call id 1347) took 1005 ms. Trace:
I20260709 12:12:11.254685 20098 leader_election.cc:290] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 15 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:11.324748 14182 rpcz_store.cc:276] 0709 12:12:10.318891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:10.320538 (+  1647us) service_pool.cc:224] Handling call
0709 12:12:10.336149 (+ 15611us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:12:10.755288 (+419139us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:10.755413 (+   125us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:12:10.763185 (+  7772us) log.cc:844] Serialized 52 byte log entry
0709 12:12:11.118066 (+354881us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:12:11.118485 (+   419us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:11.118585 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:11.324102 (+205517us) raft_consensus.cc:1685] finished
0709 12:12:11.324125 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:11.324266 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30048,"raft.queue_time_us":83739,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":113,"thread_start_us":696501,"threads_started":2,"wal-append.queue_time_us":491190}
I20260709 12:12:11.289534 20166 leader_election.cc:290] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:11.332777 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:11.332965 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:11.336800 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:11.337157 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:11.277212 20045 leader_election.cc:290] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:12:11.305210 20237 log.cc:927] Time spent T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 12:12:11.287523 20149 leader_election.cc:290] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:11.361826 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:11.361920 14334 raft_consensus.cc:3060] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:11.347667 20147 raft_consensus.cc:493] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:11.286720 20127 consensus_queue.cc:1059] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.039s
W20260709 12:12:11.343544 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 346095us
I20260709 12:12:11.285894 20001 consensus_queue.cc:1048] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.069s
I20260709 12:12:11.377710 14190 raft_consensus.cc:2468] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 17.
I20260709 12:12:11.305644 20035 consensus_queue.cc:260] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:11.395121 14155 leader_election.cc:304] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:11.377070 14189 raft_consensus.cc:1275] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:12:11.348555 20129 raft_consensus.cc:697] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 15 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:11.306599 20141 raft_consensus.cc:515] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:11.426400 14155 leader_election.cc:304] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
W20260709 12:12:11.418332 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 254308us
I20260709 12:12:11.308497 20215 raft_consensus.cc:515] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:11.437688 14155 leader_election.cc:304] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
W20260709 12:12:11.415742 20085 consensus_meta.cc:287] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db: Time spent flushing consensus metadata: real 0.921s	user 0.013s	sys 0.000s
W20260709 12:12:11.461133 14183 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.010s	sys 0.013s
I20260709 12:12:11.400077 20045 raft_consensus.cc:493] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:11.363902 20241 consensus_queue.cc:1059] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.065s
W20260709 12:12:11.475158 14183 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.592s	user 0.012s	sys 0.013s
I20260709 12:12:11.476408 14184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56652 (request call id 1345) took 1160 ms. Trace:
W20260709 12:12:11.433131 20252 log.cc:927] Time spent T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
I20260709 12:12:11.425194 20259 raft_consensus.cc:493] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:11.439234 20138 consensus_meta.cc:287] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.901s	user 0.003s	sys 0.010s
I20260709 12:12:11.432435 20035 raft_consensus.cc:3060] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:11.477274 14184 rpcz_store.cc:276] 0709 12:12:10.316169 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:10.322499 (+  6330us) service_pool.cc:224] Handling call
0709 12:12:10.322835 (+   336us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:10.607729 (+284894us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:12:10.617420 (+  9691us) log.cc:844] Serialized 14 byte log entry
0709 12:12:10.815528 (+198108us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:10.829603 (+ 14075us) log.cc:844] Serialized 26 byte log entry
0709 12:12:10.829794 (+   191us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:12:10.829829 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:10.829896 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:11.476111 (+646215us) raft_consensus.cc:1685] finished
0709 12:12:11.476152 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:11.476329 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":62271,"prepare.queue_time_us":2391,"prepare.run_cpu_time_us":10137,"prepare.run_wall_time_us":16779,"raft.queue_time_us":148798,"raft.run_cpu_time_us":302,"raft.run_wall_time_us":70727,"thread_start_us":419671,"threads_started":2,"wal-append.queue_time_us":265924}
I20260709 12:12:11.397063 20147 raft_consensus.cc:515] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:11.440598 20227 raft_consensus.cc:2804] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:11.429607 20226 raft_consensus.cc:2749] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:12:11.478009 20258 raft_consensus.cc:493] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:11.494298 20127 raft_consensus.cc:493] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:11.555960 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:11.557811 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:11.483748 20217 raft_consensus.cc:2749] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:11.435283 20124 consensus_queue.cc:1048] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.082s
W20260709 12:12:11.611802 14228 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.012s	sys 0.016s
I20260709 12:12:11.618886 14339 raft_consensus.cc:2393] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db in current term 17: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:12:11.620108 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:11.464839 20085 raft_consensus.cc:515] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:11.576965 20227 raft_consensus.cc:493] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
W20260709 12:12:11.626653 14228 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.821s	user 0.013s	sys 0.017s
I20260709 12:12:11.634112 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:11.580725 19702 raft_consensus.cc:493] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:11.639077 14260 raft_consensus.cc:1275] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:12:11.512787 20259 raft_consensus.cc:515] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:11.668937 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:11.669868 14262 raft_consensus.cc:3060] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:11.620941 20258 raft_consensus.cc:515] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:11.672745 14181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56652 (request call id 1353) took 1344 ms. Trace:
I20260709 12:12:11.673183 20184 raft_consensus.cc:3055] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:11.673923 20184 raft_consensus.cc:740] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:11.624051 20127 raft_consensus.cc:515] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:11.675323 20184 consensus_queue.cc:260] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:11.677094 20184 raft_consensus.cc:3060] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:12:11.674456 20248 log.cc:927] Time spent T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.280s	user 0.000s	sys 0.001s
I20260709 12:12:11.673233 14181 rpcz_store.cc:276] 0709 12:12:10.327994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:10.345682 (+ 17688us) service_pool.cc:224] Handling call
0709 12:12:10.346119 (+   437us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:12:10.652003 (+305884us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:10.652033 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:12:10.716113 (+ 64080us) log.cc:844] Serialized 52 byte log entry
0709 12:12:10.948426 (+232313us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:12:10.975496 (+ 27070us) log.cc:844] Serialized 14 byte log entry
0709 12:12:11.004296 (+ 28800us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:11.004378 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:11.672478 (+668100us) raft_consensus.cc:1685] finished
0709 12:12:11.672500 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:11.672674 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":66956,"prepare.queue_time_us":20635,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":38,"raft.queue_time_us":131883,"raft.run_cpu_time_us":230,"raft.run_wall_time_us":9248,"thread_start_us":491569,"threads_started":2,"wal-append.queue_time_us":544357}
I20260709 12:12:11.483629 20045 raft_consensus.cc:515] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:11.432004 20200 raft_consensus.cc:697] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 16 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:12:11.700598 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:11.761341 14265 raft_consensus.cc:2468] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 21.
I20260709 12:12:11.762456 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:11.763075 14265 raft_consensus.cc:3060] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:11.702128 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:11.486552 14331 raft_consensus.cc:1275] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 12:12:11.734805 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:11.610582 20099 raft_consensus.cc:493] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:11.749694 14261 raft_consensus.cc:1240] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:11.789798 14256 raft_consensus.cc:2468] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 15.
I20260709 12:12:11.587813 20129 consensus_queue.cc:237] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:11.781158 14909 raft_consensus.cc:3060] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:11.782347 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:11.793557 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:11.794744 14263 raft_consensus.cc:2468] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 15.
I20260709 12:12:11.794796 14261 raft_consensus.cc:2468] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 14.
I20260709 12:12:11.648126 20227 raft_consensus.cc:3060] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:11.676945 20127 leader_election.cc:290] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:11.669376 20083 leader_election.cc:290] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:11.676772 20147 leader_election.cc:290] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:12:11.793154 20146 consensus_meta.cc:287] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 1.087s	user 0.008s	sys 0.006s
I20260709 12:12:11.841001 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:12:11.820174 20110 consensus_meta.cc:287] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.531s	user 0.012s	sys 0.001s
I20260709 12:12:11.673259 20258 leader_election.cc:290] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:11.859804 14909 raft_consensus.cc:2468] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 16.
W20260709 12:12:11.862036 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 424398us
I20260709 12:12:11.874697 14155 leader_election.cc:304] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:11.877640 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:12:11.879431 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:11.893187 14262 raft_consensus.cc:2468] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 16.
I20260709 12:12:11.893373 14155 leader_election.cc:304] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:11.650911 19702 raft_consensus.cc:515] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:11.899845 14155 leader_election.cc:304] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:11.877467 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:11.908787 14265 raft_consensus.cc:2468] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 16.
I20260709 12:12:11.913939 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
W20260709 12:12:11.929070 14302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:11.824057 20099 raft_consensus.cc:515] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:11.897294 20217 raft_consensus.cc:3060] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:11.962464 20209 raft_consensus.cc:993] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db: : Instructing follower 17aab1bbf5014936aa18cc21818b26ec to start an election
W20260709 12:12:11.963347 20218 consensus_meta.cc:287] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.843s	user 0.010s	sys 0.001s
I20260709 12:12:11.963891 20218 raft_consensus.cc:2749] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:12:11.941535 20236 log.cc:927] Time spent T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 1.059s	user 0.000s	sys 0.028s
I20260709 12:12:11.946446 20222 consensus_queue.cc:1048] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 12:12:11.965874 19912 raft_consensus.cc:493] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:11.966262 20085 leader_election.cc:290] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 15 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:11.966632 19912 raft_consensus.cc:515] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:11.915531 20223 raft_consensus.cc:2749] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:11.946571 14189 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 3167) took 1138 ms. Trace:
I20260709 12:12:11.947271 20219 raft_consensus.cc:3055] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:11.950963 20200 consensus_queue.cc:237] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:11.935635 20141 leader_election.cc:290] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:12:11.959110 14156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:11.961400 20269 log.cc:927] Time spent T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
W20260709 12:12:11.924887 20048 consensus_meta.cc:287] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 1.234s	user 0.014s	sys 0.000s
I20260709 12:12:11.925993 20124 raft_consensus.cc:2749] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:11.977015 14189 rpcz_store.cc:276] 0709 12:12:10.807994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:11.433761 (+625767us) service_pool.cc:224] Handling call
0709 12:12:11.434132 (+   371us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:11.448305 (+ 14173us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:12:11.448348 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:11.448946 (+   598us) log.cc:844] Serialized 26 byte log entry
0709 12:12:11.599320 (+150374us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:12:11.599370 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:11.599456 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:11.946051 (+346595us) spinlock_profiling.cc:243] Waited 8.85 ms on lock 0x7b4800270558. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f212c064aa1 00007f212c05bb37 00007f212c05b9ca 00007f212c15326f 00007f212c152f37 00007f212c16755c 00007f212c167508 00007f212c167488 00007f212c167443 00007f212c1666ec 00007f212b090a96
0709 12:12:11.946190 (+   139us) raft_consensus.cc:1685] finished
0709 12:12:11.946215 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:11.946498 (+   283us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":25010,"raft.run_cpu_time_us":11524,"raft.run_wall_time_us":480642,"spinlock_wait_cycles":20351232,"thread_start_us":149969,"threads_started":1,"wal-append.queue_time_us":493302}
I20260709 12:12:11.877831 20146 raft_consensus.cc:515] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:11.895735 20110 raft_consensus.cc:515] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:12:11.989282 14334 consensus_meta.cc:287] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.625s	user 0.007s	sys 0.001s
I20260709 12:12:11.990005 14260 raft_consensus.cc:2468] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 19.
I20260709 12:12:12.005184 14334 raft_consensus.cc:2468] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 15.
I20260709 12:12:11.936707 20215 leader_election.cc:290] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:12:12.010315 14302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:11.983050 20147 raft_consensus.cc:493] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:11.979404 20219 raft_consensus.cc:740] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:12:12.042233 14335 raft_consensus.cc:2393] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 16: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:12:12.043082 14339 raft_consensus.cc:2368] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 13. Current term is 14.
I20260709 12:12:12.007719 20241 raft_consensus.cc:493] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:12.043771 20147 raft_consensus.cc:515] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:12.045923 20241 raft_consensus.cc:515] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:12.047055 20146 leader_election.cc:290] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:12.047658 20147 leader_election.cc:290] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:12.048195 20147 raft_consensus.cc:493] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:12.048664 20259 leader_election.cc:290] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:12:12.038774 20152 consensus_meta.cc:287] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.725s	user 0.013s	sys 0.000s
I20260709 12:12:12.050841 20227 raft_consensus.cc:515] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:12.038503 20223 raft_consensus.cc:493] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:12.051949 20223 raft_consensus.cc:515] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:12.053025 20227 leader_election.cc:290] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:12.009728 20141 raft_consensus.cc:493] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:12.050964 20152 raft_consensus.cc:515] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:12.054036 14187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 3157) took 1250 ms. Trace:
I20260709 12:12:12.055016 20223 leader_election.cc:290] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:12.055632 20152 leader_election.cc:290] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:12.056730 19999 raft_consensus.cc:3055] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:12.057125 19999 raft_consensus.cc:740] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
W20260709 12:12:12.057614 20273 log.cc:927] Time spent T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:12:12.058107 19999 consensus_queue.cc:260] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:12:12.058923 20274 log.cc:927] Time spent T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.219s	user 0.000s	sys 0.001s
I20260709 12:12:12.053982 20141 raft_consensus.cc:515] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:12:12.061067 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 100671us
W20260709 12:12:12.061928 14875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:12.062351 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 86569.9us
I20260709 12:12:12.062922 20141 leader_election.cc:290] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:12.063457 20241 leader_election.cc:290] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:12.054459 14187 rpcz_store.cc:276] 0709 12:12:10.803729 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:11.165242 (+361513us) service_pool.cc:224] Handling call
0709 12:12:11.165568 (+   326us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:11.169397 (+  3829us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:12:11.169806 (+   409us) log.cc:844] Serialized 14 byte log entry
0709 12:12:11.399830 (+230024us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:11.416262 (+ 16432us) log.cc:844] Serialized 26 byte log entry
0709 12:12:11.416452 (+   190us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:12:11.416489 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:11.416563 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:12.053806 (+637243us) raft_consensus.cc:1685] finished
0709 12:12:12.053830 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:12.053971 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4283,"prepare.queue_time_us":204,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":42,"raft.queue_time_us":543,"raft.run_cpu_time_us":311,"raft.run_wall_time_us":14642,"thread_start_us":226554,"threads_started":1,"wal-append.queue_time_us":459946}
I20260709 12:12:12.061875 14876 leader_election.cc:304] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:12.066109 14154 leader_election.cc:400] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 16 pre-election: Vote denied by peer 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341) with higher term. Message: Invalid argument: T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 16. Current term is 17.
I20260709 12:12:12.060539 20081 raft_consensus.cc:3055] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:12.066655 20223 raft_consensus.cc:493] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:12.066437 14911 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53200 (request call id 762) took 1132 ms. Trace:
I20260709 12:12:12.067662 20223 raft_consensus.cc:515] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:12.067987 14911 rpcz_store.cc:276] 0709 12:12:10.934104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:10.934248 (+   144us) service_pool.cc:224] Handling call
0709 12:12:12.066080 (+1131832us) spinlock_profiling.cc:243] Waited 8.74 ms on lock 0x7b5400748028. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f212cf16ab1 00007f212cf185f4 00007f212c101227 00007f212c100ab8 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6
0709 12:12:12.066373 (+   293us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":20103424}
I20260709 12:12:12.068449 20209 raft_consensus.cc:1081] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 15 LEADER]: Signalling peer 17aab1bbf5014936aa18cc21818b26ec to start an election
I20260709 12:12:12.066705 20241 raft_consensus.cc:493] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:12.070389 19997 raft_consensus.cc:2804] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:12.066671 20081 raft_consensus.cc:740] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:12.070930 19997 raft_consensus.cc:697] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 17 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:12:12.071504 20081 consensus_queue.cc:260] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:12.071815 19997 consensus_queue.cc:237] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:12.072533 20081 raft_consensus.cc:3060] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:12.073921 14182 raft_consensus.cc:1240] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:12.069839 20241 raft_consensus.cc:515] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:12.048614 20147 raft_consensus.cc:515] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:12.076997 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:12.086182 14905 raft_consensus.cc:2393] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 15: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
I20260709 12:12:12.004427 19912 leader_election.cc:290] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:12.067312 20152 raft_consensus.cc:493] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:12.081775 20301 raft_consensus.cc:493] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:12.004045 20048 raft_consensus.cc:515] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:12.087651 20152 raft_consensus.cc:515] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:12.087810 20301 raft_consensus.cc:515] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:12.089327 20048 leader_election.cc:290] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 17 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:12.036535 20242 raft_consensus.cc:493] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:12.090173 20301 leader_election.cc:290] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:12.090298 20242 raft_consensus.cc:515] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:12.063906 14877 leader_election.cc:304] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:12.066431 14154 leader_election.cc:403] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:12:12.092761 20266 raft_consensus.cc:2749] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:12:12.094477 20266 consensus_queue.cc:1048] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:12:12.094808 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:12.096046 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:12.097110 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:12.097693 14189 raft_consensus.cc:2468] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 15.
W20260709 12:12:12.097687 20035 consensus_meta.cc:287] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.547s	user 0.009s	sys 0.000s
I20260709 12:12:12.098594 20152 leader_election.cc:290] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:12.098831 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:12.100100 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:12.076602 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:12.094377 14187 raft_consensus.cc:3060] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:12.104125 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:12.104456 20110 leader_election.cc:290] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:12.104933 14336 raft_consensus.cc:2368] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db for earlier term 15. Current term is 16.
I20260709 12:12:12.105583 20137 raft_consensus.cc:3055] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:12.105990 20137 raft_consensus.cc:740] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:12.111855 14187 raft_consensus.cc:1275] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:12:12.076413 14182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 3163) took 1269 ms. Trace:
I20260709 12:12:12.112874 14182 rpcz_store.cc:276] 0709 12:12:10.806856 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:11.393098 (+586242us) service_pool.cc:224] Handling call
0709 12:12:11.412238 (+ 19140us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:12.074321 (+662083us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:12.076165 (+  1844us) spinlock_profiling.cc:243] Waited 661 ms on lock 0x7b54003f2fd4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:12:12.076350 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1520976256}
I20260709 12:12:12.084807 20223 leader_election.cc:290] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:12.123404 14877 leader_election.cc:400] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 15 election: Vote denied by peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957) with higher term. Message: Invalid argument: T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db for earlier term 15. Current term is 16.
I20260709 12:12:12.123780 14334 raft_consensus.cc:1240] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:12.123761 14877 leader_election.cc:403] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 12:12:12.125962 14181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56652 (request call id 1363) took 1069 ms. Trace:
I20260709 12:12:12.143424 14181 rpcz_store.cc:276] 0709 12:12:11.056625 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:11.752525 (+695900us) service_pool.cc:224] Handling call
0709 12:12:11.752852 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:11.753063 (+   211us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:12:11.823394 (+ 70331us) log.cc:844] Serialized 14 byte log entry
0709 12:12:12.125590 (+302196us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:12.125644 (+    54us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:12.125692 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:12.125779 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:12.125900 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12532,"prepare.queue_time_us":122260,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":12793,"thread_start_us":289032,"threads_started":1,"wal-append.queue_time_us":260962}
I20260709 12:12:12.041124 20215 raft_consensus.cc:493] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:12.092522 20242 leader_election.cc:290] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:12:12.119472 20279 log.cc:927] Time spent T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.198s	user 0.000s	sys 0.001s
W20260709 12:12:12.125451 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 219724us
I20260709 12:12:12.110267 20227 raft_consensus.cc:2749] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341) with higher term. Message: Invalid argument: T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 16. Current term is 17.
W20260709 12:12:12.169155 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:12.117782 20099 leader_election.cc:290] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:12.180111 14155 leader_election.cc:304] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:12.124644 20217 raft_consensus.cc:2749] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:12.186662 14155 leader_election.cc:304] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:12.086825 20219 consensus_queue.cc:260] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:12:12.203866 20250 log.cc:927] Time spent T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 12:12:12.213411 14186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 3170) took 1332 ms. Trace:
I20260709 12:12:12.149569 20261 raft_consensus.cc:2749] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957) with higher term. Message: Invalid argument: T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db for earlier term 15. Current term is 16.
I20260709 12:12:12.202260 20223 raft_consensus.cc:2749] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:12.218662 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:12.216313 14186 rpcz_store.cc:276] 0709 12:12:10.881135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:11.746162 (+865027us) service_pool.cc:224] Handling call
0709 12:12:11.768867 (+ 22705us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:11.769110 (+   243us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:12:12.032606 (+263496us) log.cc:844] Serialized 14 byte log entry
0709 12:12:12.213024 (+180418us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:12.213080 (+    56us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:12:12.213138 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:12.213218 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:12.213343 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":54061,"prepare.queue_time_us":163974,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":60,"raft.queue_time_us":2891,"thread_start_us":343173,"threads_started":2}
I20260709 12:12:12.223747 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:12.216882 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:12.221705 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:12.177479 20229 consensus_queue.cc:1059] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.053s
I20260709 12:12:12.225245 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:12.226085 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:12.232667 14911 raft_consensus.cc:1240] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 16 LEADER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:12.232870 14265 raft_consensus.cc:1240] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:12.214329 20227 raft_consensus.cc:2749] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:12:12.180637 20215 raft_consensus.cc:515] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:12:12.217015 20239 consensus_meta.cc:287] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.922s	user 0.010s	sys 0.004s
W20260709 12:12:12.218430 20016 consensus_meta.cc:287] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db: Time spent flushing consensus metadata: real 1.319s	user 0.011s	sys 0.003s
I20260709 12:12:12.229113 14259 raft_consensus.cc:1275] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 12:12:12.243615 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:12.248584 14264 raft_consensus.cc:3060] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:12.272853 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:12.275162 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 18 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:12.276084 14336 raft_consensus.cc:2393] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 18: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:12:12.260289 20016 raft_consensus.cc:515] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:12.280478 14907 raft_consensus.cc:1240] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:12.285434 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
W20260709 12:12:12.281970 20284 log.cc:927] Time spent T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 12:12:12.322471 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:12.251921 20239 raft_consensus.cc:515] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:12.279255 20215 leader_election.cc:290] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:12.280263 20016 leader_election.cc:290] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 18 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:12.323868 14265 raft_consensus.cc:2368] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db for earlier term 15. Current term is 16.
I20260709 12:12:12.379551 14264 raft_consensus.cc:2468] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 17.
I20260709 12:12:12.380815 14230 leader_election.cc:304] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
W20260709 12:12:12.362705 20270 log.cc:927] Time spent T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 12:12:12.374357 14303 leader_election.cc:304] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:12.385277 14303 leader_election.cc:304] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:12.385885 14304 leader_election.cc:304] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:12.387434 14335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50856 (request call id 2609) took 1528 ms. Trace:
I20260709 12:12:12.387881 14335 rpcz_store.cc:276] 0709 12:12:10.846855 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:10.846980 (+   125us) service_pool.cc:224] Handling call
0709 12:12:12.374810 (+1527830us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b54000b7a54. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:12:12.374966 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2574605568}
I20260709 12:12:12.322139 20042 consensus_queue.cc:1048] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.083s
I20260709 12:12:12.388960 14258 raft_consensus.cc:2393] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 19: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:12:12.306174 20267 consensus_queue.cc:1059] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 10, Time since last communication: 0.083s
I20260709 12:12:12.398639 20110 raft_consensus.cc:2749] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:12:12.399890 20184 raft_consensus.cc:2804] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:12.401870 14190 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 3166) took 1594 ms. Trace:
I20260709 12:12:12.402361 14190 rpcz_store.cc:276] 0709 12:12:10.807754 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:11.427658 (+619904us) service_pool.cc:224] Handling call
0709 12:12:11.436404 (+  8746us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:12:11.459945 (+ 23541us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:12:11.495144 (+ 35199us) log.cc:844] Serialized 14 byte log entry
0709 12:12:11.979751 (+484607us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:12:11.980389 (+   638us) log.cc:844] Serialized 52 byte log entry
0709 12:12:11.980539 (+   150us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:12:11.985845 (+  5306us) log.cc:844] Serialized 14 byte log entry
0709 12:12:12.034224 (+ 48379us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:12.034631 (+   407us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:12.401530 (+366899us) raft_consensus.cc:1685] finished
0709 12:12:12.401561 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:12.401784 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":76145,"prepare.queue_time_us":109298,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":70,"raft.queue_time_us":107368,"raft.run_cpu_time_us":455,"raft.run_wall_time_us":97201,"thread_start_us":404455,"threads_started":2,"wal-append.queue_time_us":526143}
I20260709 12:12:12.407934 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:12.412227 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:12.390049 20048 raft_consensus.cc:2804] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:12:12.410305 14303 leader_election.cc:304] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:12.414783 20184 raft_consensus.cc:697] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 17 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:12.415304 20110 consensus_queue.cc:1048] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 12:12:12.444403 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:12.388230 20129 consensus_queue.cc:1048] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 12:12:12.417666 20048 raft_consensus.cc:493] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:12.388367 20296 raft_consensus.cc:2804] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:12.570058 20048 raft_consensus.cc:3060] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:12.451313 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:12.476156 14183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 3150) took 1709 ms. Trace:
I20260709 12:12:12.574041 14183 rpcz_store.cc:276] 0709 12:12:10.766288 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:10.766812 (+   524us) service_pool.cc:224] Handling call
0709 12:12:10.767198 (+   386us) raft_consensus.cc:1471] Updating replica for 4 ops
0709 12:12:10.794123 (+ 26925us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:10.794169 (+    46us) raft_consensus.cc:1539] Triggering prepare for 4 ops
0709 12:12:10.813074 (+ 18905us) log.cc:844] Serialized 104 byte log entry
0709 12:12:11.477379 (+664305us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:12:11.610365 (+132986us) log.cc:844] Serialized 14 byte log entry
0709 12:12:11.651110 (+ 40745us) log.cc:844] Serialized 14 byte log entry
0709 12:12:11.651538 (+   428us) log.cc:844] Serialized 14 byte log entry
0709 12:12:11.682940 (+ 31402us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:11.683038 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:12.420045 (+737007us) raft_consensus.cc:1685] finished
0709 12:12:12.420073 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:12.476050 (+ 55977us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":121508,"prepare.queue_time_us":173355,"raft.queue_time_us":79906,"raft.run_cpu_time_us":629,"raft.run_wall_time_us":47771,"spinlock_wait_cycles":63962368,"thread_start_us":594403,"threads_started":1,"wal-append.queue_time_us":1147650}
I20260709 12:12:12.570283 20296 raft_consensus.cc:697] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 15 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:12.574061 14263 raft_consensus.cc:3060] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:12.490420 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:12.495213 20239 leader_election.cc:290] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:12.506323 20215 raft_consensus.cc:493] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:12.515201 20200 raft_consensus.cc:3055] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:12.521380 14261 raft_consensus.cc:1240] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:12.530623 14907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53194 (request call id 1085) took 1649 ms. Trace:
W20260709 12:12:12.536443 14875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:12.555533 14877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:12.567029 14331 raft_consensus.cc:1240] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:12.615741 14907 rpcz_store.cc:276] 0709 12:12:10.880875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:10.881023 (+   148us) service_pool.cc:224] Handling call
0709 12:12:10.918679 (+ 37656us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:12.286820 (+1368141us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:12.530279 (+243459us) spinlock_profiling.cc:243] Waited 1.36 s on lock 0x7b540020c454. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:12:12.530526 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3131388160}
W20260709 12:12:12.612967 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 215415us
I20260709 12:12:12.576694 20184 consensus_queue.cc:237] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:12.576967 20296 consensus_queue.cc:237] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:12.619375 20110 raft_consensus.cc:2804] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:12.633034 14304 leader_election.cc:304] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:12.614500 20200 raft_consensus.cc:740] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:12:12.614645 20211 consensus_queue.cc:1048] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 12:12:12.644381 14304 leader_election.cc:304] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:12:12.617110 20215 raft_consensus.cc:515] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:12.646114 20146 raft_consensus.cc:2749] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:12.645298 20110 raft_consensus.cc:697] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 17 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
W20260709 12:12:12.659003 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:12.665095 14256 raft_consensus.cc:3060] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:12.643241 20129 consensus_queue.cc:1048] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 12:12:12.633929 20144 consensus_queue.cc:1048] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 12:12:12.657716 14261 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "afce5304599246a580d798fc0c843964"
dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
 from {username='slave'} at 127.0.0.1:53050
I20260709 12:12:12.679447 14261 raft_consensus.cc:493] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:12.679913 14261 raft_consensus.cc:3060] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:12.682768 20146 raft_consensus.cc:2804] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:12:12.683251 20146 raft_consensus.cc:493] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:12.683638 20146 raft_consensus.cc:3060] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:12:12.685283 20318 log.cc:927] Time spent T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.285s	user 0.006s	sys 0.004s
I20260709 12:12:12.691473 20016 raft_consensus.cc:3055] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:12:12.692027 20016 raft_consensus.cc:740] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:12:12.692958 20016 consensus_queue.cc:260] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:12.700131 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:12.697044 20048 raft_consensus.cc:515] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:12.707974 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:12.708758 14904 raft_consensus.cc:2468] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 16.
I20260709 12:12:12.716960 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:12.713990 14907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:12.701164 20309 raft_consensus.cc:493] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:12.731503 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:12.733351 14338 raft_consensus.cc:1240] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 11. Current term is 12. Ops: []
I20260709 12:12:12.732339 14256 raft_consensus.cc:2468] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 14.
W20260709 12:12:12.734109 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 323849us
W20260709 12:12:12.738099 14875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:12.722286 20275 log.cc:927] Time spent T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.775s	user 0.018s	sys 0.015s
I20260709 12:12:12.746639 20110 consensus_queue.cc:237] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:12.749625 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:12.742947 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:12.756753 14263 raft_consensus.cc:2468] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 16.
I20260709 12:12:12.714071 20016 raft_consensus.cc:3060] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:12.743904 20309 raft_consensus.cc:515] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:12.744213 20211 consensus_queue.cc:1048] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 12:12:12.764575 20309 leader_election.cc:290] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:12.765134 20048 leader_election.cc:290] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 12 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:12.773376 14261 raft_consensus.cc:515] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:12.670856 20200 consensus_queue.cc:260] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:12.758515 20216 consensus_queue.cc:1048] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.023s
I20260709 12:12:12.784632 14261 leader_election.cc:290] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:12.782343 14303 leader_election.cc:304] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:12.795805 20215 leader_election.cc:290] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:12.780194 20200 raft_consensus.cc:3060] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:12:12.798498 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 154179us
I20260709 12:12:12.780332 20211 consensus_queue.cc:1059] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 12:12:12.822968 14259 raft_consensus.cc:1240] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:12.806624 20228 raft_consensus.cc:2749] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:12:12.842774 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 60513us
I20260709 12:12:12.825058 20211 consensus_queue.cc:1059] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 12:12:12.836141 20228 raft_consensus.cc:3055] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 16 LEADER]: Stepping down as leader of term 16
W20260709 12:12:12.844951 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 44000.1us
I20260709 12:12:12.847918 20228 raft_consensus.cc:740] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:12.853256 20335 raft_consensus.cc:3055] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:12.854278 20335 raft_consensus.cc:740] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:12.855189 20335 consensus_queue.cc:260] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:12.856519 20335 raft_consensus.cc:3060] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:12.848196 14304 leader_election.cc:304] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:12:12.874197 14304 leader_election.cc:304] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:12.874575 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:12.876971 14304 leader_election.cc:304] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:12:12.879266 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:12.879374 14304 leader_election.cc:304] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:12:12.877701 20331 raft_consensus.cc:2804] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:12.882061 20048 raft_consensus.cc:2804] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:12.882895 20184 raft_consensus.cc:2804] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:12.883384 20184 raft_consensus.cc:493] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:12.883801 20184 raft_consensus.cc:3060] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:12.880336 20211 raft_consensus.cc:2804] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:12.884797 20211 raft_consensus.cc:493] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:12.885221 20211 raft_consensus.cc:3060] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:12.889029 20241 leader_election.cc:290] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:12.882200 20331 raft_consensus.cc:493] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:12.890251 20331 raft_consensus.cc:3060] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:12.902941 20211 raft_consensus.cc:515] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } }
I20260709 12:12:12.903826 14304 leader_election.cc:304] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:12:12.907912 19702 leader_election.cc:290] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:12.908509 19702 raft_consensus.cc:2804] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:12.909000 19702 raft_consensus.cc:697] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 16 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:12.910554 20228 consensus_queue.cc:260] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:12.911109 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:12.911880 20228 raft_consensus.cc:3060] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:12.912801 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:12.906031 20331 raft_consensus.cc:515] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:12.915079 14331 raft_consensus.cc:1240] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:12.923718 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
W20260709 12:12:12.915100 14303 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:12.901474 14909 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53194 (request call id 1082) took 2092 ms (client timeout 1827 ms). Trace:
I20260709 12:12:12.924407 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:12.916662 14335 raft_consensus.cc:1275] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
W20260709 12:12:12.924830 14909 rpcz_store.cc:269] 0709 12:12:10.808761 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:10.808966 (+   205us) service_pool.cc:224] Handling call
0709 12:12:12.901190 (+2092224us) spinlock_profiling.cc:243] Waited 971 ms on lock 0x7b540010f754. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:12:12.901369 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2233961344}
I20260709 12:12:12.921260 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:12.921663 14339 raft_consensus.cc:1275] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:12:12.922540 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:12.922425 19702 consensus_queue.cc:237] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:12.922654 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:12.928696 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:12.929375 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:12.930061 14335 raft_consensus.cc:2468] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 19.
I20260709 12:12:12.873562 20324 consensus_queue.cc:1059] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.065s
I20260709 12:12:12.940347 20219 raft_consensus.cc:3060] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:12.941171 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:12.922106 20146 raft_consensus.cc:515] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:12.942119 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:12.943961 20146 leader_election.cc:290] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 22 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:12.944888 20143 raft_consensus.cc:493] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:12.945436 20143 raft_consensus.cc:515] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:12:12.940610 14875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:12.947490 14229 leader_election.cc:304] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:12.949116 14229 leader_election.cc:304] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:12.951568 14909 raft_consensus.cc:1240] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:12.962021 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:12.954111 14229 leader_election.cc:304] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:12:12.965688 14229 leader_election.cc:304] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:12.967690 14230 leader_election.cc:304] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:12.969424 14229 leader_election.cc:304] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:12.970235 14335 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c"
dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
mode: GRACEFUL
new_leader_uuid: "885067a0d31741bfb5c9935788e315bf"
 from {username='slave'} at 127.0.0.1:50896
I20260709 12:12:12.970903 14335 raft_consensus.cc:606] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 18 LEADER]: Received request to transfer leadership to TS 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:12.972204 14230 leader_election.cc:304] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:12.973769 14263 raft_consensus.cc:1240] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:12.951020 20224 raft_consensus.cc:493] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:12.959821 20296 raft_consensus.cc:3060] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:12.961236 20241 raft_consensus.cc:2749] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:13.027659 20304 raft_consensus.cc:2749] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:13.030974 14230 leader_election.cc:304] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:12:12.977526 19912 raft_consensus.cc:2749] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:12.973006 20239 raft_consensus.cc:2749] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:12.972105 20048 raft_consensus.cc:697] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 16 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:12.975190 20138 raft_consensus.cc:3055] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:13.047845 14335 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d"
dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
mode: GRACEFUL
new_leader_uuid: "885067a0d31741bfb5c9935788e315bf"
 from {username='slave'} at 127.0.0.1:50896
I20260709 12:12:13.048311 20241 raft_consensus.cc:2749] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:13.048818 20304 raft_consensus.cc:2804] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:12.970883 20215 raft_consensus.cc:2804] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:13.046268 14911 raft_consensus.cc:2468] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 17.
W20260709 12:12:13.058996 14877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:13.062089 14877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:13.068406 14875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:13.053989 20138 raft_consensus.cc:740] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:13.060175 20304 raft_consensus.cc:493] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:13.072855 20211 leader_election.cc:290] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:13.037390 20224 raft_consensus.cc:515] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:13.076267 14339 raft_consensus.cc:1275] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:12:13.045554 20309 consensus_queue.cc:1048] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 12:12:13.045221 19885 consensus_queue.cc:1048] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.022s
W20260709 12:12:13.085273 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 54389us
W20260709 12:12:13.079593 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 110271us
I20260709 12:12:13.061100 20215 raft_consensus.cc:493] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
W20260709 12:12:13.077387 20312 log.cc:927] Time spent T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.678s	user 0.009s	sys 0.006s
I20260709 12:12:13.090440 14229 leader_election.cc:304] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:13.073428 20143 leader_election.cc:290] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:13.092157 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
W20260709 12:12:13.092882 14875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:13.100596 14330 raft_consensus.cc:2468] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 16.
I20260709 12:12:13.100843 14229 leader_election.cc:304] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:13.102938 14229 leader_election.cc:304] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:13.104367 14229 leader_election.cc:304] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:13.111478 14229 leader_election.cc:304] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:13.114384 14229 leader_election.cc:304] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:13.089389 20215 raft_consensus.cc:3060] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:12:13.150166 14875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:13.082804 20304 raft_consensus.cc:3060] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:13.114230 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:13.110662 19912 raft_consensus.cc:2764] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 12:12:13.111099 20241 raft_consensus.cc:2749] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:13.161492 20239 raft_consensus.cc:2804] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:12:13.162544 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 48246.2us
I20260709 12:12:13.192224 14229 leader_election.cc:304] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
W20260709 12:12:13.181107 20312 log.cc:927] Time spent T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:12:13.112898 20143 raft_consensus.cc:2749] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:13.146837 19791 raft_consensus.cc:2749] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:13.147189 20258 raft_consensus.cc:2749] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:12:13.196586 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:13.191280 20200 raft_consensus.cc:493] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:13.191354 20239 raft_consensus.cc:493] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:13.197403 20331 leader_election.cc:290] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:13.159411 20138 consensus_queue.cc:260] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:13.224630 20224 leader_election.cc:290] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:13.225703 20304 raft_consensus.cc:515] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:13.228089 20304 leader_election.cc:290] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:12:13.229349 14305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:13.230150 19999 raft_consensus.cc:3060] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:13.233280 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:13.234804 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:13.202495 19885 raft_consensus.cc:2749] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:13.237711 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:13.239071 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: true dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:13.239702 14904 raft_consensus.cc:3055] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:13.202270 19912 raft_consensus.cc:493] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:13.242807 19912 raft_consensus.cc:515] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:13.241634 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:13.239984 14904 raft_consensus.cc:740] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:12:13.243366 14189 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56046 (request call id 2669) took 1148 ms. Trace:
I20260709 12:12:13.244619 14189 rpcz_store.cc:276] 0709 12:12:12.095018 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:12.100897 (+  5879us) service_pool.cc:224] Handling call
0709 12:12:12.102197 (+  1300us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:12.102438 (+   241us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:12.102463 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:12.111495 (+  9032us) log.cc:844] Serialized 26 byte log entry
0709 12:12:12.111683 (+   188us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:12:12.111722 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:12.111788 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:13.243139 (+1131351us) raft_consensus.cc:1685] finished
0709 12:12:13.243166 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:13.243298 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:13.207898 20239 raft_consensus.cc:3060] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:13.247563 20138 raft_consensus.cc:3060] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:13.111328 20048 consensus_queue.cc:237] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:13.245961 14904 consensus_queue.cc:260] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:13.254894 14904 raft_consensus.cc:3060] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:13.206278 20200 raft_consensus.cc:515] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:13.210458 20258 consensus_queue.cc:1048] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 12:12:13.261066 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:13.264855 14185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56652 (request call id 1365) took 2207 ms. Trace:
I20260709 12:12:13.268409 14339 raft_consensus.cc:1240] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 14. Current term is 15. Ops: [12.8-14.9]
I20260709 12:12:13.265331 14185 rpcz_store.cc:276] 0709 12:12:11.057269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:11.954386 (+897117us) service_pool.cc:224] Handling call
0709 12:12:11.954727 (+   341us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:12:11.955090 (+   363us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:11.955117 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:12:11.955787 (+   670us) log.cc:844] Serialized 52 byte log entry
0709 12:12:12.033030 (+ 77243us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:12:12.219414 (+186384us) log.cc:844] Serialized 14 byte log entry
0709 12:12:13.264493 (+1045079us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:13.264576 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:13.264619 (+    43us) raft_consensus.cc:1685] finished
0709 12:12:13.264631 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:13.264774 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1044723,"prepare.queue_time_us":14378,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":30,"raft.queue_time_us":9711,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":125,"thread_start_us":262827,"threads_started":2,"wal-append.queue_time_us":126069}
I20260709 12:12:13.274085 14187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56652 (request call id 1375) took 1071 ms. Trace:
I20260709 12:12:13.246345 20304 raft_consensus.cc:493] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:13.275758 14187 rpcz_store.cc:276] 0709 12:12:12.202990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:12.204759 (+  1769us) service_pool.cc:224] Handling call
0709 12:12:12.205077 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:12.205285 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 12:12:12.220063 (+ 14778us) log.cc:844] Serialized 14 byte log entry
0709 12:12:13.273491 (+1053428us) log.cc:844] Serialized 14 byte log entry
0709 12:12:13.273693 (+   202us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:13.273767 (+    74us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:12:13.273819 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:13.273890 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:13.274020 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":902735,"prepare.queue_time_us":41228,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":47,"thread_start_us":149703,"threads_started":1,"wal-append.queue_time_us":314073}
I20260709 12:12:13.277066 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:13.277318 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:13.277873 14183 raft_consensus.cc:2468] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 19.
I20260709 12:12:13.278323 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:13.278635 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:13.279844 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:13.280478 14183 raft_consensus.cc:3060] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:13.269487 20300 raft_consensus.cc:493] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:13.282531 20300 raft_consensus.cc:515] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:12:13.283842 20321 log.cc:927] Time spent T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.488s	user 0.003s	sys 0.000s
I20260709 12:12:13.284389 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:13.274677 20124 raft_consensus.cc:493] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:13.285049 14186 raft_consensus.cc:3060] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:13.285180 20300 leader_election.cc:290] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:13.285600 14188 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56046 (request call id 2666) took 1191 ms. Trace:
I20260709 12:12:13.286029 14188 rpcz_store.cc:276] 0709 12:12:12.094139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:12.114231 (+ 20092us) service_pool.cc:224] Handling call
0709 12:12:12.114632 (+   401us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:12.145213 (+ 30581us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:12.145247 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:12.145850 (+   603us) log.cc:844] Serialized 26 byte log entry
0709 12:12:12.301819 (+155969us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:12:12.354953 (+ 53134us) log.cc:844] Serialized 14 byte log entry
0709 12:12:13.076756 (+721803us) spinlock_profiling.cc:243] Waited 11.4 ms on lock 0x7b4400022b4c. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2123f74c85 00007f2123f756a2 00007f2126ce71db 00007f2126ce2aaf 00007f2126cd686e 00007f2126cd5bb6 00007f2126cd57d8 00007f2126cdf221 00007f2126cdf1d9 00007f2126cdf169
0709 12:12:13.273213 (+196457us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:13.273302 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:13.273351 (+    49us) raft_consensus.cc:1685] finished
0709 12:12:13.285377 (+ 12026us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:13.285534 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":944376,"prepare.queue_time_us":54876,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":57,"raft.queue_time_us":925463,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":113,"spinlock_wait_cycles":59405824,"thread_start_us":93023,"threads_started":1,"wal-append.queue_time_us":213375}
I20260709 12:12:13.288255 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:13.289443 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:13.291236 14188 raft_consensus.cc:3060] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Advancing to term 16
I20260709 12:12:13.298760 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:13.299551 14184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 3169) took 2490 ms. Trace:
I20260709 12:12:13.299464 14181 raft_consensus.cc:3060] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:13.300123 14184 rpcz_store.cc:276] 0709 12:12:10.808619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:11.497218 (+688599us) service_pool.cc:224] Handling call
0709 12:12:11.497632 (+   414us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:11.498121 (+   489us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:12:11.829415 (+331294us) log.cc:844] Serialized 14 byte log entry
0709 12:12:12.886641 (+1057226us) spinlock_profiling.cc:243] Waited 45.6 ms on lock 0x7b18004615c0. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f212cf16ab1 00007f212cf23281 00007f2124030e07 00007f212ce8b9a9 00007f212404d69b 00007f212404b93f 00007f212404dc02 00007f2126cd520b 00007f2126cdad23 00007f2126cdb23a 00007f2127145a2a
0709 12:12:13.299181 (+412540us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:13.299237 (+    56us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:12:13.299288 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:13.299353 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:13.299490 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":352410,"prepare.queue_time_us":181339,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":54,"spinlock_wait_cycles":104856960,"thread_start_us":360004,"threads_started":2,"wal-append.queue_time_us":1358312}
I20260709 12:12:13.302757 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:13.303475 14189 raft_consensus.cc:3060] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Advancing to term 16
I20260709 12:12:13.266714 20200 leader_election.cc:290] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:13.273114 20045 leader_election.cc:290] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:12:13.313472 20346 log.cc:927] Time spent T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:12:13.315364 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:13.316630 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:13.317348 20184 raft_consensus.cc:515] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:13.317780 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:13.318949 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:13.319782 20184 leader_election.cc:290] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 15 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:13.299466 20124 raft_consensus.cc:515] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:13.322075 20147 leader_election.cc:290] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:13.322955 20124 leader_election.cc:290] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:13.323439 20301 raft_consensus.cc:493] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:13.324028 20301 raft_consensus.cc:515] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:13.320035 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:13.326577 14259 raft_consensus.cc:2468] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 15.
I20260709 12:12:13.327503 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:13.306263 14188 raft_consensus.cc:2468] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 16.
I20260709 12:12:13.268769 20223 raft_consensus.cc:493] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:13.306991 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:13.331624 14184 raft_consensus.cc:2468] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 11.
I20260709 12:12:13.309885 14183 raft_consensus.cc:2468] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 18.
I20260709 12:12:13.311808 14186 raft_consensus.cc:2468] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 17.
I20260709 12:12:13.329206 14187 raft_consensus.cc:3060] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Advancing to term 16
I20260709 12:12:13.329957 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:12:13.335217 14303 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:13.336815 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:13.348239 14183 raft_consensus.cc:2468] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 14.
I20260709 12:12:13.343636 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:13.345887 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:13.344491 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:13.349814 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 18 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:13.350050 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:12:13.348325 14305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:13.350378 14188 raft_consensus.cc:3060] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:13.339718 14181 raft_consensus.cc:2468] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 14.
I20260709 12:12:13.346971 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:13.352111 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:13.352507 14186 raft_consensus.cc:2468] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 15.
I20260709 12:12:13.353104 14181 raft_consensus.cc:2468] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 16.
I20260709 12:12:13.351052 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:13.305846 20282 raft_consensus.cc:493] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:13.369854 14259 raft_consensus.cc:1275] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:12:13.370500 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:13.371251 14184 raft_consensus.cc:3060] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:13.374989 14188 raft_consensus.cc:2468] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 16.
I20260709 12:12:13.365645 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:13.385124 14186 raft_consensus.cc:2468] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 19.
I20260709 12:12:13.393241 14904 raft_consensus.cc:2468] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 16.
W20260709 12:12:13.398947 14878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:13.364851 14187 raft_consensus.cc:2468] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 16.
I20260709 12:12:13.375392 14189 raft_consensus.cc:2468] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 16.
W20260709 12:12:13.376767 14230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:13.340451 20293 raft_consensus.cc:493] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:13.297948 20304 raft_consensus.cc:515] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:13.343370 20223 raft_consensus.cc:515] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:13.412889 14184 raft_consensus.cc:2468] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 19.
I20260709 12:12:13.414158 14182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56652 (request call id 1372) took 1222 ms. Trace:
I20260709 12:12:13.415978 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:13.421180 14189 raft_consensus.cc:2468] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 18.
I20260709 12:12:13.373850 20282 raft_consensus.cc:515] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:13.422926 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: true dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:13.418807 20241 raft_consensus.cc:493] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:13.423740 14189 raft_consensus.cc:3060] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:13.423911 20241 raft_consensus.cc:515] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:12:13.428136 20278 log.cc:927] Time spent T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 1.470s	user 0.006s	sys 0.000s
I20260709 12:12:13.418572 19912 leader_election.cc:290] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:13.435570 14265 raft_consensus.cc:1240] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 12:12:13.422359 14182 rpcz_store.cc:276] 0709 12:12:12.192246 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:12.195161 (+  2915us) service_pool.cc:224] Handling call
0709 12:12:12.212135 (+ 16974us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:12.212392 (+   257us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 12:12:12.605465 (+393073us) log.cc:844] Serialized 14 byte log entry
0709 12:12:13.293451 (+687986us) log.cc:844] Serialized 14 byte log entry
0709 12:12:13.386904 (+ 93453us) spinlock_profiling.cc:243] Waited 5.63 ms on lock 0x7b18003b7520. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f212cf16ab1 00007f212cf23281 00007f2124030e07 00007f212ce8b9a9 00007f212404d69b 00007f212404b93f 00007f212404b455 00007f2127133060 00007f2127145716 00007f2127156287 00007f2127156208
0709 12:12:13.413782 (+ 26878us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:13.413840 (+    58us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:12:13.413889 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:13.413959 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:13.414091 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":610473,"prepare.queue_time_us":48866,"prepare.run_cpu_time_us":110,"prepare.run_wall_time_us":100,"raft.queue_time_us":600489,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":89,"spinlock_wait_cycles":16620288,"thread_start_us":489663,"threads_started":3,"wal-append.queue_time_us":196810}
I20260709 12:12:13.438469 14189 raft_consensus.cc:2468] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 16.
I20260709 12:12:13.439848 14189 raft_consensus.cc:1240] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:13.441001 14190 raft_consensus.cc:2468] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 13.
W20260709 12:12:13.445528 14877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:13.447341 14265 raft_consensus.cc:1240] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 15 LEADER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:13.433405 20296 raft_consensus.cc:2749] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:13.439393 20304 leader_election.cc:290] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:13.451159 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:12:13.447569 14877 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.174.130:36673 timed out after 1.965s (SENT) [suppressed 48 similar messages]
I20260709 12:12:13.453562 14187 raft_consensus.cc:2468] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 15.
I20260709 12:12:13.419277 20293 raft_consensus.cc:515] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:13.486021 20239 raft_consensus.cc:515] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:13.487534 14262 raft_consensus.cc:1240] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 12:12:13.490310 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:13.491312 14905 raft_consensus.cc:2393] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 15: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
W20260709 12:12:13.490127 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 60596.9us
I20260709 12:12:13.458875 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:13.454734 20241 leader_election.cc:290] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:13.475346 20223 leader_election.cc:290] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:13.478211 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:13.497602 14904 raft_consensus.cc:2393] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 18: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
I20260709 12:12:13.495700 14182 raft_consensus.cc:2393] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 14: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:12:13.489632 20239 leader_election.cc:290] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:13.480000 20301 leader_election.cc:290] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:12:13.501454 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 53917.8us
I20260709 12:12:13.530077 20293 leader_election.cc:290] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:13.538323 14265 raft_consensus.cc:1275] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:12:13.542052 14229 leader_election.cc:304] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:12:13.544027 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:13.544934 14182 raft_consensus.cc:2468] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 15.
I20260709 12:12:13.544935 14229 leader_election.cc:304] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:13.551134 20296 raft_consensus.cc:2804] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:12:13.551745 20296 raft_consensus.cc:493] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:13.552412 20296 raft_consensus.cc:3060] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:13.555222 20282 leader_election.cc:290] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:13.536460 20215 raft_consensus.cc:515] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:13.557989 20215 leader_election.cc:290] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:13.560711 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:13.563720 14229 leader_election.cc:304] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:13.561609 14265 raft_consensus.cc:2376] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 17. Re-sending same reply.
I20260709 12:12:13.567669 14229 leader_election.cc:304] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:13.561122 20241 raft_consensus.cc:2804] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:13.571925 14229 leader_election.cc:304] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:13.572600 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:13.573870 14909 raft_consensus.cc:2468] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 15.
I20260709 12:12:13.568578 20215 raft_consensus.cc:2749] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:13.571493 20304 raft_consensus.cc:2749] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:13.577060 14229 leader_election.cc:304] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:13.575269 20342 raft_consensus.cc:2804] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:13.582149 20342 raft_consensus.cc:493] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:13.582548 20342 raft_consensus.cc:3060] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:13.586113 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:13.586829 14182 raft_consensus.cc:3060] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:13.575232 20241 raft_consensus.cc:697] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 16 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:13.581477 14229 leader_election.cc:304] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:13.589766 14229 leader_election.cc:304] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:13.596432 14229 leader_election.cc:304] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:13.599110 20258 raft_consensus.cc:2804] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:13.590258 20304 raft_consensus.cc:2804] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader election won for term 16
W20260709 12:12:13.596674 20323 log.cc:927] Time spent T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.783s	user 0.004s	sys 0.000s
I20260709 12:12:13.601686 20309 raft_consensus.cc:2804] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:13.618392 20309 raft_consensus.cc:493] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:13.618803 20309 raft_consensus.cc:3060] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:13.606140 20241 consensus_queue.cc:237] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:13.623864 20035 raft_consensus.cc:493] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:13.624451 20035 raft_consensus.cc:515] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } }
I20260709 12:12:13.628361 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:13.628805 20227 raft_consensus.cc:493] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:13.629393 20227 raft_consensus.cc:515] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:13.631546 20227 leader_election.cc:290] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:13.601092 14229 leader_election.cc:304] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
W20260709 12:12:13.635038 14156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:13.608037 14182 raft_consensus.cc:2468] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 20.
I20260709 12:12:13.610854 14877 leader_election.cc:400] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 15 election: Vote denied by peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673) with higher term. Message: Invalid argument: T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db for earlier term 15. Current term is 16.
I20260709 12:12:13.629653 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
W20260709 12:12:13.652199 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 51181.6us
W20260709 12:12:13.655282 14875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:13.661055 14229 leader_election.cc:304] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:13.654886 20045 raft_consensus.cc:2804] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:13.661839 20045 raft_consensus.cc:493] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:13.662200 20045 raft_consensus.cc:3060] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:13.662559 14229 leader_election.cc:304] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:13.651877 20137 consensus_queue.cc:260] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:13.664534 20137 raft_consensus.cc:3060] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:13.665421 20259 raft_consensus.cc:493] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:13.665994 20259 raft_consensus.cc:515] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:13.668268 20259 leader_election.cc:290] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:13.669450 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:13.670143 14182 raft_consensus.cc:2468] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 19.
I20260709 12:12:13.670676 14155 leader_election.cc:304] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:13.672331 14182 raft_consensus.cc:1275] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 9. (term mismatch)
I20260709 12:12:13.672726 14182 pending_rounds.cc:85] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf: Aborting all ops after (but not including) 8
I20260709 12:12:13.672962 14182 pending_rounds.cc:107] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf: Aborting uncommitted NO_OP operation due to leader change: 16.9
I20260709 12:12:13.673194 14182 raft_consensus.cc:2889] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:13.655120 20239 raft_consensus.cc:493] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:13.673993 20348 raft_consensus.cc:493] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:13.674237 20239 raft_consensus.cc:515] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } }
I20260709 12:12:13.674563 20348 raft_consensus.cc:515] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:13.676578 20239 leader_election.cc:290] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187)
I20260709 12:12:13.676839 20348 leader_election.cc:290] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:13.677423 20348 raft_consensus.cc:493] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:13.619887 20296 raft_consensus.cc:515] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:13.677968 20351 raft_consensus.cc:493] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:13.678463 20124 raft_consensus.cc:2749] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:13.680044 20223 raft_consensus.cc:493] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:13.680670 14187 raft_consensus.cc:1275] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:12:13.681079 20282 raft_consensus.cc:493] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:13.683482 14184 raft_consensus.cc:1275] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:12:13.685356 20299 raft_consensus.cc:493] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:13.669341 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:13.690034 20215 raft_consensus.cc:2764] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 16 LEADER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 12:12:13.690689 20048 raft_consensus.cc:493] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:13.707433 20282 raft_consensus.cc:515] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:13.708276 20048 raft_consensus.cc:515] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:13.702658 20147 raft_consensus.cc:2804] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:13.689915 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
W20260709 12:12:13.693905 14305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:13.681139 14190 raft_consensus.cc:1240] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 17. Current term is 18. Ops: [14.9-17.10]
I20260709 12:12:13.694869 14303 leader_election.cc:304] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:13.712381 14185 raft_consensus.cc:1240] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 12:12:13.713608 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:13.714555 14184 raft_consensus.cc:2393] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 16: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:12:13.612025 20304 raft_consensus.cc:697] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 16 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:13.697711 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
W20260709 12:12:13.685635 20316 log.cc:927] Time spent T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 1.286s	user 0.004s	sys 0.000s
I20260709 12:12:13.703516 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:12:13.696319 20333 log.cc:927] Time spent T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 12:12:13.702343 20149 raft_consensus.cc:2804] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:13.660208 20218 raft_consensus.cc:493] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:13.611491 20258 raft_consensus.cc:697] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 19 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:13.696064 20226 raft_consensus.cc:493] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:13.717231 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:13.706823 14229 leader_election.cc:304] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:13.722474 14184 raft_consensus.cc:1240] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:13.722770 14303 leader_election.cc:304] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:13.710366 20147 raft_consensus.cc:697] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 20 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:13.672605 14155 leader_election.cc:304] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
W20260709 12:12:13.764729 14305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:13.767479 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 94951.2us
I20260709 12:12:13.739367 14230 leader_election.cc:304] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:13.740752 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:13.739895 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:13.769096 14263 raft_consensus.cc:3060] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:12:13.773905 14302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:13.612488 20342 raft_consensus.cc:515] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:13.724896 20259 raft_consensus.cc:493] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:13.728572 20149 raft_consensus.cc:493] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:12:13.777962 14304 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:13.767706 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 60955.9us
I20260709 12:12:13.710541 20048 leader_election.cc:290] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:13.738698 20124 raft_consensus.cc:493] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:13.784077 14262 raft_consensus.cc:1275] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:12:13.705168 20223 raft_consensus.cc:515] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:13.786044 14256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41764 (request call id 3261) took 1395 ms. Trace:
I20260709 12:12:13.713117 20241 raft_consensus.cc:493] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:13.721203 20282 leader_election.cc:290] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:13.775918 14155 leader_election.cc:304] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
W20260709 12:12:13.777637 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 54991.3us
I20260709 12:12:13.730854 20138 raft_consensus.cc:2804] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:13.788955 14264 raft_consensus.cc:1275] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
W20260709 12:12:13.794191 14258 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41768 (request call id 2193) took 2848 ms (client timeout 1870 ms). Trace:
W20260709 12:12:13.807228 14258 rpcz_store.cc:269] 0709 12:12:10.937082 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:10.937185 (+   103us) service_pool.cc:224] Handling call
0709 12:12:13.785391 (+2848206us) spinlock_profiling.cc:243] Waited 1.44 s on lock 0x7b5400212354. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:12:13.785541 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3314111872}
I20260709 12:12:13.802923 14256 rpcz_store.cc:276] 0709 12:12:12.390503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:12.444066 (+ 53563us) service_pool.cc:224] Handling call
0709 12:12:13.785870 (+1341804us) spinlock_profiling.cc:243] Waited 96.1 ms on lock 0x7b5400200dd4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:12:13.785982 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":220999936}
W20260709 12:12:13.788081 14260 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41764 (request call id 3241) took 2088 ms (client timeout 2013 ms). Trace:
I20260709 12:12:13.781373 14338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 1141) took 1225 ms. Trace:
I20260709 12:12:13.785027 20228 raft_consensus.cc:2749] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:12:13.810597 14263 raft_consensus.cc:2468] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 16.
I20260709 12:12:13.779038 20143 raft_consensus.cc:2804] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:13.805053 14303 leader_election.cc:304] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:13.805486 14155 leader_election.cc:304] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:13.808862 14338 rpcz_store.cc:276] 0709 12:12:12.555781 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:12.557190 (+  1409us) service_pool.cc:224] Handling call
0709 12:12:12.557471 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:12.741462 (+183991us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:13.781085 (+1039623us) spinlock_profiling.cc:243] Waited 176 ms on lock 0x7b54002a6054. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:12:13.781304 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":403947776}
W20260709 12:12:13.809723 14260 rpcz_store.cc:269] 0709 12:12:11.699820 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:11.701847 (+  2027us) service_pool.cc:224] Handling call
0709 12:12:13.787880 (+2086033us) spinlock_profiling.cc:243] Waited 201 ms on lock 0x7b54002fd354. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:12:13.788001 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":461536640}
I20260709 12:12:13.785933 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:13.702052 20348 raft_consensus.cc:515] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:13.722014 20299 raft_consensus.cc:515] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:13.778892 20184 raft_consensus.cc:493] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:13.797541 20149 raft_consensus.cc:3060] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:13.702943 20351 raft_consensus.cc:515] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:13.814455 20152 raft_consensus.cc:2749] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:13.778782 20218 raft_consensus.cc:515] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:13.779206 20227 raft_consensus.cc:2804] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:13.834856 14303 leader_election.cc:304] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:13.806476 20138 raft_consensus.cc:493] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:13.774125 20226 raft_consensus.cc:515] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:13.789113 20300 consensus_queue.cc:1059] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 12:12:13.787956 20073 consensus_queue.cc:1048] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.044s
I20260709 12:12:13.828289 14155 leader_election.cc:304] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:13.823457 20143 raft_consensus.cc:493] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:13.851240 14303 leader_election.cc:304] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:13.829815 20035 leader_election.cc:290] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:13.808768 20124 raft_consensus.cc:515] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:13.797339 20259 raft_consensus.cc:515] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:13.846385 14182 raft_consensus.cc:2468] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 17.
I20260709 12:12:13.859791 14155 leader_election.cc:304] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:13.880350 14155 leader_election.cc:304] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:13.856971 14303 leader_election.cc:304] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:13.822237 20239 consensus_queue.cc:1048] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 12:12:13.836757 20282 raft_consensus.cc:2749] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:12:13.843012 20184 raft_consensus.cc:515] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:13.855105 20138 raft_consensus.cc:3060] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:13.849051 20227 raft_consensus.cc:493] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:13.870011 20211 raft_consensus.cc:2804] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:13.871613 20226 leader_election.cc:290] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:13.875123 20299 leader_election.cc:290] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:13.888195 14303 leader_election.cc:304] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:13.840808 20077 raft_consensus.cc:2749] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:12:13.974468 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 241951us
I20260709 12:12:13.889343 14181 raft_consensus.cc:1275] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:12:13.882776 20217 raft_consensus.cc:2749] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:12:13.890874 20293 raft_consensus.cc:2749] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:12:13.892356 20360 log.cc:927] Time spent T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 12:12:13.811975 20241 raft_consensus.cc:515] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:14.017114 14261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41764 (request call id 3256) took 1636 ms. Trace:
I20260709 12:12:13.949260 14155 leader_election.cc:304] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:13.854737 20144 raft_consensus.cc:2804] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Leader election won for term 16
W20260709 12:12:13.958199 14305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:13.860877 20143 raft_consensus.cc:3060] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:13.977483 14184 raft_consensus.cc:1275] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
W20260709 12:12:13.977948 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 89847.1us
W20260709 12:12:14.025563 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 76433.8us
I20260709 12:12:14.026295 14303 leader_election.cc:304] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:13.861443 20219 raft_consensus.cc:2749] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:13.878001 20300 consensus_queue.cc:1243] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer 17aab1bbf5014936aa18cc21818b26ec log is divergent from this leader: its last log entry 15.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
W20260709 12:12:13.985728 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 246445us
I20260709 12:12:13.856005 19912 consensus_queue.cc:1059] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.117s
I20260709 12:12:14.017515 14261 rpcz_store.cc:276] 0709 12:12:12.380932 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:12.789918 (+408986us) service_pool.cc:224] Handling call
0709 12:12:12.790303 (+   385us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:12:12.791868 (+  1565us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:12.791900 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:12:12.792515 (+   615us) log.cc:844] Serialized 52 byte log entry
0709 12:12:12.928186 (+135671us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:12:12.967640 (+ 39454us) log.cc:844] Serialized 14 byte log entry
0709 12:12:12.967912 (+   272us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:12.967990 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:13.632886 (+664896us) spinlock_profiling.cc:243] Waited 27.3 ms on lock 0x7b180044abe0. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f212cf16ab1 00007f212cf23281 00007f212404e3f3 00007f21240507c1 00007f2124050779 00007f2124050709 00007f21240506d1 00007f212404f9cd 0000000000388634 0000000000388479 00007f212403183a
0709 12:12:13.984927 (+352041us) raft_consensus.cc:1685] finished
0709 12:12:14.016849 (+ 31922us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:14.017040 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":22787,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":1653,"raft.queue_time_us":8189,"raft.run_cpu_time_us":250,"raft.run_wall_time_us":5579,"spinlock_wait_cycles":62864768,"thread_start_us":135260,"threads_started":1,"wal-append.queue_time_us":209251}
I20260709 12:12:13.944813 20228 raft_consensus.cc:2804] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:13.943069 20222 raft_consensus.cc:493] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:14.013887 20211 raft_consensus.cc:697] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 17 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:13.974560 20301 raft_consensus.cc:493] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:14.032419 14303 leader_election.cc:304] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:14.011842 20048 raft_consensus.cc:2804] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:12:14.045948 14155 leader_election.cc:400] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 13 election: Vote denied by peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957) with higher term. Message: Invalid argument: T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 13. Current term is 14.
I20260709 12:12:14.058498 14155 leader_election.cc:403] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 12:12:14.028280 20342 leader_election.cc:290] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:12:14.048874 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 64271.1us
I20260709 12:12:13.974220 20227 raft_consensus.cc:3060] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:14.016239 20226 raft_consensus.cc:493] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:14.065491 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:14.065960 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:14.066267 14334 raft_consensus.cc:2468] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 13.
I20260709 12:12:13.842832 20304 consensus_queue.cc:237] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:13.855536 20147 consensus_queue.cc:237] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:14.053864 20282 raft_consensus.cc:2749] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:13.846889 20258 consensus_queue.cc:237] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:14.071182 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:14.048431 20144 raft_consensus.cc:697] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 16 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:14.069449 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:12:14.058846 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 251888us
I20260709 12:12:14.064374 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:14.039816 20296 leader_election.cc:290] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:14.075241 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:14.077768 14338 raft_consensus.cc:2410] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for term 18 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 12.
I20260709 12:12:14.076634 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:14.078018 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:14.083724 14339 raft_consensus.cc:2468] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 16.
I20260709 12:12:14.084209 14330 raft_consensus.cc:2468] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 16.
I20260709 12:12:14.079283 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:14.086217 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:14.085302 14334 raft_consensus.cc:2468] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 19.
I20260709 12:12:14.087608 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:14.087517 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:14.088375 14258 raft_consensus.cc:2468] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 16.
I20260709 12:12:14.090235 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:14.090613 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:14.100876 14334 raft_consensus.cc:2468] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 13.
I20260709 12:12:14.086910 14332 raft_consensus.cc:2468] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 15.
I20260709 12:12:14.090946 14258 raft_consensus.cc:2468] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 16.
I20260709 12:12:14.088865 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:14.067782 20219 raft_consensus.cc:2749] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957) with higher term. Message: Invalid argument: T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 13. Current term is 14.
I20260709 12:12:14.107070 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:14.108417 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:14.108747 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:14.108981 20351 leader_election.cc:290] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:14.109843 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:14.110984 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:12:14.113272 20363 log.cc:927] Time spent T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
I20260709 12:12:14.060133 20222 raft_consensus.cc:515] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:14.114296 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:14.114941 14185 raft_consensus.cc:3060] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:14.115176 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:14.115706 20222 leader_election.cc:290] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:14.116546 20144 consensus_queue.cc:237] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } }
I20260709 12:12:14.117022 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:14.117803 14261 raft_consensus.cc:2368] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 15. Current term is 16.
I20260709 12:12:14.123471 20271 consensus_queue.cc:1048] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:12:14.109515 14264 raft_consensus.cc:2468] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 15.
I20260709 12:12:14.125618 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:14.129380 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:14.068682 20370 raft_consensus.cc:2804] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:14.073679 20371 raft_consensus.cc:2749] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:14.080591 20373 raft_consensus.cc:493] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:14.157648 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:14.158432 14911 raft_consensus.cc:2468] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 14.
I20260709 12:12:14.069013 20300 consensus_queue.cc:1059] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.035s
W20260709 12:12:14.154805 14305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:14.162514 14907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:14.067960 20301 raft_consensus.cc:515] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:14.189985 20254 raft_consensus.cc:493] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:14.190677 20254 raft_consensus.cc:515] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:14.194996 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
W20260709 12:12:14.196861 20364 log.cc:927] Time spent T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.184s	user 0.003s	sys 0.000s
I20260709 12:12:14.072546 20226 raft_consensus.cc:515] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:14.204667 14154 leader_election.cc:304] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:14.166182 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:14.215226 14909 raft_consensus.cc:2468] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 17.
I20260709 12:12:14.162261 20129 raft_consensus.cc:2804] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:14.217236 14185 raft_consensus.cc:2468] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 12.
I20260709 12:12:14.221622 14184 raft_consensus.cc:1240] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 11. Current term is 12. Ops: []
I20260709 12:12:14.107199 20261 consensus_queue.cc:1048] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.077s
I20260709 12:12:14.193524 20124 leader_election.cc:290] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:14.183142 20342 consensus_queue.cc:1059] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
W20260709 12:12:14.159469 20362 log.cc:927] Time spent T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.174s	user 0.001s	sys 0.003s
I20260709 12:12:14.180752 20223 leader_election.cc:290] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:14.151304 20370 raft_consensus.cc:493] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:14.245179 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:14.256866 14909 raft_consensus.cc:2468] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 17.
I20260709 12:12:14.214557 20222 raft_consensus.cc:2804] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:12:14.258980 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 226649us
I20260709 12:12:14.180508 20373 raft_consensus.cc:515] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:14.289817 20373 leader_election.cc:290] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:14.258661 20370 raft_consensus.cc:3060] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:14.292017 20077 consensus_queue.cc:1059] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 18.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:12:14.294762 20149 raft_consensus.cc:515] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:14.298892 20149 leader_election.cc:290] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:14.244284 20048 raft_consensus.cc:697] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 14 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:14.300509 20048 consensus_queue.cc:237] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:14.294584 20077 raft_consensus.cc:3055] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:14.162948 20211 consensus_queue.cc:237] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:14.301967 20077 raft_consensus.cc:740] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:14.303408 20077 consensus_queue.cc:260] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 18.8, Last appended by leader: 8, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:14.304080 20218 leader_election.cc:290] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:14.304868 20077 raft_consensus.cc:3060] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:14.311559 14181 raft_consensus.cc:3055] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:14.311410 14154 leader_election.cc:304] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:14.315868 20184 leader_election.cc:290] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:14.317911 20226 leader_election.cc:290] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:14.317593 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:14.243181 20263 raft_consensus.cc:493] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:14.321202 14184 raft_consensus.cc:2393] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 19: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
W20260709 12:12:14.251188 20309 consensus_meta.cc:287] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.632s	user 0.016s	sys 0.004s
I20260709 12:12:14.318385 20370 raft_consensus.cc:515] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:14.259284 20259 leader_election.cc:290] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:14.318466 14181 raft_consensus.cc:740] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:12:14.247952 20348 leader_election.cc:290] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:14.283165 19912 consensus_queue.cc:1243] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer 885067a0d31741bfb5c9935788e315bf log is divergent from this leader: its last log entry 13.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:12:14.327916 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:14.367182 14184 raft_consensus.cc:3060] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:14.333039 14303 leader_election.cc:304] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:12:14.318876 20254 leader_election.cc:290] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:14.334357 14154 leader_election.cc:304] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:14.331753 14304 leader_election.cc:304] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:14.248818 20129 raft_consensus.cc:697] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 16 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:14.268350 20222 raft_consensus.cc:493] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:14.370230 14183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 3185) took 1089 ms. Trace:
I20260709 12:12:14.370882 14905 raft_consensus.cc:1275] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:12:14.374944 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:14.305303 20138 raft_consensus.cc:515] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:12:14.399762 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 68089.3us
W20260709 12:12:14.399623 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 66684.8us
I20260709 12:12:14.365674 20226 raft_consensus.cc:2804] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:14.404771 14909 raft_consensus.cc:3060] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:14.421468 14876 leader_election.cc:304] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:14.328087 20365 consensus_queue.cc:1059] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.070s
I20260709 12:12:14.367612 20149 raft_consensus.cc:493] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:14.397840 14907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:14.399466 14183 rpcz_store.cc:276] 0709 12:12:13.280849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:13.354355 (+ 73506us) service_pool.cc:224] Handling call
0709 12:12:13.354661 (+   306us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:13.667416 (+312755us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:13.667453 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:13.667936 (+   483us) log.cc:844] Serialized 26 byte log entry
0709 12:12:13.717098 (+ 49162us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:12:13.717144 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:13.717219 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:14.369936 (+652717us) raft_consensus.cc:1685] finished
0709 12:12:14.369963 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:14.370149 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":293777,"raft.queue_time_us":295573,"raft.run_cpu_time_us":54,"raft.run_wall_time_us":54,"thread_start_us":48757,"threads_started":1,"wal-append.queue_time_us":177643}
I20260709 12:12:14.453131 14184 raft_consensus.cc:2468] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 16.
W20260709 12:12:14.380908 14305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:14.368602 20241 leader_election.cc:290] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:14.331362 20309 raft_consensus.cc:515] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:14.366119 20371 raft_consensus.cc:493] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:14.454571 14188 raft_consensus.cc:1275] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:12:14.366360 20342 raft_consensus.cc:493] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:14.398335 20348 raft_consensus.cc:2804] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:14.367235 20227 raft_consensus.cc:515] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:14.458876 14187 raft_consensus.cc:1275] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:12:14.406148 20144 raft_consensus.cc:2804] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:14.407196 20370 leader_election.cc:290] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 17 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:14.407730 20222 raft_consensus.cc:3060] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:14.503012 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:14.436290 20226 raft_consensus.cc:493] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:14.454391 20380 consensus_queue.cc:1048] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.028s
I20260709 12:12:14.470394 20366 raft_consensus.cc:3055] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:14.471179 20301 leader_election.cc:290] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:14.474030 20138 leader_election.cc:290] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 20 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:14.474488 20309 leader_election.cc:290] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:14.459210 20384 raft_consensus.cc:2749] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:14.478902 20227 leader_election.cc:290] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 16 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:14.479588 20143 raft_consensus.cc:515] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:12:14.480831 20137 consensus_meta.cc:287] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.816s	user 0.011s	sys 0.003s
I20260709 12:12:14.372150 20378 raft_consensus.cc:493] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:14.456563 20149 raft_consensus.cc:515] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:14.450165 20254 raft_consensus.cc:2804] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:14.462226 20371 raft_consensus.cc:515] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:14.330294 20263 raft_consensus.cc:515] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:14.484411 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
W20260709 12:12:14.484840 20045 consensus_meta.cc:287] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.822s	user 0.012s	sys 0.000s
I20260709 12:12:14.491079 14229 leader_election.cc:304] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:14.519706 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:14.541642 14907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:14.490244 20348 raft_consensus.cc:493] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:14.459213 20228 raft_consensus.cc:697] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 18 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:14.502447 20144 raft_consensus.cc:493] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:14.526455 14335 raft_consensus.cc:606] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Received request to transfer leadership to TS 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:14.544953 14335 raft_consensus.cc:614] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:12:14.545208 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 54223.8us
W20260709 12:12:14.527658 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 221077us
I20260709 12:12:14.528318 14257 raft_consensus.cc:1240] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 19 LEADER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:14.546442 14229 leader_election.cc:304] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:14.405366 20129 consensus_queue.cc:237] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:14.529801 14256 raft_consensus.cc:2393] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 20: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:12:14.511973 20366 raft_consensus.cc:740] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:14.519120 14909 raft_consensus.cc:2468] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 16.
I20260709 12:12:14.527704 20254 raft_consensus.cc:493] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:14.459858 20342 raft_consensus.cc:515] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:14.542410 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:14.512676 20226 raft_consensus.cc:3060] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:14.566874 20241 consensus_queue.cc:1048] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.007s
I20260709 12:12:14.575033 20149 leader_election.cc:290] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:14.575773 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:14.576803 14155 leader_election.cc:304] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:14.578913 14339 raft_consensus.cc:1240] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 14. Current term is 15. Ops: [12.8-14.9]
I20260709 12:12:14.524646 14181 consensus_queue.cc:260] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:14.548638 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:14.579150 14155 leader_election.cc:304] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:14.580469 14181 raft_consensus.cc:3060] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:14.582032 20259 raft_consensus.cc:493] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:14.582679 20259 raft_consensus.cc:515] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:14.544247 20348 raft_consensus.cc:3060] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:14.558277 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:14.561345 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:14.584931 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:14.556921 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:14.570464 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:14.587440 14263 raft_consensus.cc:2393] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 14: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:12:14.577534 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:14.587992 14259 raft_consensus.cc:2468] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 17.
I20260709 12:12:14.572818 20215 raft_consensus.cc:493] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:14.529074 20378 raft_consensus.cc:515] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:14.580506 14334 raft_consensus.cc:2393] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 17: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:12:14.572067 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
W20260709 12:12:14.597172 14877 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.010s	sys 0.019s
I20260709 12:12:14.595682 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:14.598753 14265 raft_consensus.cc:2468] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 17.
I20260709 12:12:14.599509 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:14.599879 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:14.600358 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:14.547175 20144 raft_consensus.cc:3060] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:14.569559 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:14.602607 14155 leader_election.cc:400] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 15 pre-election: Vote denied by peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673) with higher term. Message: Invalid argument: T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 15. Current term is 16.
I20260709 12:12:14.603148 14261 raft_consensus.cc:2468] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 17.
I20260709 12:12:14.577900 20137 raft_consensus.cc:493] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:14.604413 14305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:14.605072 14155 leader_election.cc:403] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:12:14.604807 14338 raft_consensus.cc:2393] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 12: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:12:14.553517 20309 raft_consensus.cc:2804] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:12:14.567451 20254 raft_consensus.cc:3060] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:14.565757 19912 raft_consensus.cc:2804] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:14.553946 20227 raft_consensus.cc:493] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:14.563637 20258 raft_consensus.cc:493] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:14.608685 20373 raft_consensus.cc:2804] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:14.634255 20309 raft_consensus.cc:697] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 12 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:14.634024 20351 raft_consensus.cc:2749] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673) with higher term. Message: Invalid argument: T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 15. Current term is 16.
I20260709 12:12:14.636322 14155 leader_election.cc:304] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:12:14.636922 20259 leader_election.cc:290] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:14.638832 20378 leader_election.cc:290] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:14.573307 20366 consensus_queue.cc:260] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 8, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:14.640645 20371 leader_election.cc:290] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:14.603921 20301 raft_consensus.cc:2804] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:14.642673 20143 leader_election.cc:290] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:14.643131 20228 consensus_queue.cc:237] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:14.547626 20045 raft_consensus.cc:515] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:14.603838 20382 raft_consensus.cc:493] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:14.662017 20373 raft_consensus.cc:493] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:14.651629 20263 leader_election.cc:290] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:14.653311 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:12:14.607141 14877 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.521s	user 0.011s	sys 0.019s
W20260709 12:12:14.662242 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 225168us
I20260709 12:12:14.697486 14186 raft_consensus.cc:2468] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 14.
W20260709 12:12:14.698803 14877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:14.663734 20258 raft_consensus.cc:515] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:14.599637 20215 raft_consensus.cc:515] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:14.668040 14155 leader_election.cc:304] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:14.649353 14185 raft_consensus.cc:1240] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 11. Current term is 12. Ops: []
I20260709 12:12:14.704456 14181 raft_consensus.cc:1275] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:12:14.662528 19912 raft_consensus.cc:697] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 16 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:14.714067 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:14.707906 14304 leader_election.cc:304] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:14.717495 14187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 3200) took 1024 ms. Trace:
I20260709 12:12:14.718097 14187 rpcz_store.cc:276] 0709 12:12:13.693533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:13.979493 (+285960us) service_pool.cc:224] Handling call
0709 12:12:14.417853 (+438360us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:14.461508 (+ 43655us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:14.503260 (+ 41752us) spinlock_profiling.cc:243] Waited 40.7 ms on lock 0x7b54003e8354. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:12:14.717201 (+213941us) spinlock_profiling.cc:243] Waited 438 ms on lock 0x7b54003e8350. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713a8ad 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:12:14.717400 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1100941056}
W20260709 12:12:14.722247 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 54269.5us
I20260709 12:12:14.690485 20375 raft_consensus.cc:2804] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:14.723495 14155 leader_election.cc:304] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:12:14.629411 20137 raft_consensus.cc:515] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:14.692970 20301 raft_consensus.cc:493] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:14.700356 20373 raft_consensus.cc:3060] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:14.513432 14081 catalog_manager.cc:5697] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:12:14.722064 20152 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 15 current term: 15 is higher.
I20260709 12:12:14.761909 14257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41764 (request call id 3273) took 1025 ms. Trace:
I20260709 12:12:14.762337 14257 rpcz_store.cc:276] 0709 12:12:13.736788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:13.740046 (+  3258us) service_pool.cc:224] Handling call
0709 12:12:13.787024 (+ 46978us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:14.546709 (+759685us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:14.709172 (+162463us) spinlock_profiling.cc:243] Waited 739 ms on lock 0x7b5400212354. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:12:14.761617 (+ 52445us) spinlock_profiling.cc:243] Waited 46.6 ms on lock 0x7b5400212350. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713a8ad 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:12:14.761837 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1807797888}
I20260709 12:12:14.754732 20309 consensus_queue.cc:237] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:14.755970 20342 leader_election.cc:290] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:14.659160 20227 raft_consensus.cc:515] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:14.772431 20227 leader_election.cc:290] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:14.761111 14155 leader_election.cc:304] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:14.776369 14155 leader_election.cc:304] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:14.737547 20375 raft_consensus.cc:493] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:14.778012 20375 raft_consensus.cc:3060] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:14.777637 14155 leader_election.cc:304] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:14.779117 20218 raft_consensus.cc:3060] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:14.733677 20259 raft_consensus.cc:2749] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:14.783108 14907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:14.783109 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:14.768049 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:14.785075 20258 leader_election.cc:290] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:14.770133 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:14.741961 20376 consensus_queue.cc:1059] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.049s
I20260709 12:12:14.785959 14181 raft_consensus.cc:3060] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:14.787645 20215 leader_election.cc:290] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:14.788584 14155 leader_election.cc:304] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:14.789481 20259 raft_consensus.cc:2804] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:14.789880 20259 raft_consensus.cc:493] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:14.790253 20259 raft_consensus.cc:3060] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:14.794740 14155 leader_election.cc:304] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:14.742878 20351 raft_consensus.cc:2804] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:14.796849 20229 raft_consensus.cc:3055] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:12:14.799034 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:14.778218 20227 raft_consensus.cc:2804] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:14.801608 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:14.810425 14187 raft_consensus.cc:3060] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:14.811249 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:14.813868 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:14.773461 20045 leader_election.cc:290] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:14.807899 14188 raft_consensus.cc:1240] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 17. Current term is 18. Ops: [14.9-17.10]
I20260709 12:12:14.751235 20301 raft_consensus.cc:3060] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:14.806063 14181 raft_consensus.cc:2468] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 20.
W20260709 12:12:14.817353 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 382093us
I20260709 12:12:14.700809 20382 raft_consensus.cc:515] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:12:14.817050 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 51420.9us
I20260709 12:12:14.824743 14877 leader_election.cc:304] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:14.809070 20351 raft_consensus.cc:493] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:14.826913 14229 leader_election.cc:304] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:14.768128 20395 raft_consensus.cc:2749] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:12:14.809309 20229 raft_consensus.cc:740] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:12:14.815351 20227 raft_consensus.cc:493] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:14.820994 20342 raft_consensus.cc:493] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:14.831434 20351 raft_consensus.cc:3060] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:14.832973 20369 raft_consensus.cc:2749] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:12:14.847923 20184 consensus_queue.cc:1048] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 12:12:14.867093 14335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:50896 (request call id 50) took 1819 ms. Trace:
I20260709 12:12:14.881495 14335 rpcz_store.cc:276] 0709 12:12:13.047517 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:13.047686 (+   169us) service_pool.cc:224] Handling call
0709 12:12:14.866849 (+1819163us) spinlock_profiling.cc:243] Waited 1.47 s on lock 0x7b54000fd7d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f2127135853 00007f212c10360a 00007f21256897d4 00007f2125689762 00007f2125689691 00007f212568960c 00007f21256888c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:12:14.866983 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3385450368}
I20260709 12:12:14.842044 20138 consensus_queue.cc:1048] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.055s
I20260709 12:12:14.875891 20152 raft_consensus.cc:2804] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:14.874747 20296 raft_consensus.cc:3055] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:14.858577 20366 raft_consensus.cc:3060] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:12:14.889564 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 63038.9us
I20260709 12:12:14.827878 20258 consensus_queue.cc:1048] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 12:12:14.844765 20227 raft_consensus.cc:3060] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:14.928026 14229 leader_election.cc:304] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
W20260709 12:12:14.931793 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:14.928068 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 190315us
I20260709 12:12:14.944979 14187 raft_consensus.cc:2468] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 16.
I20260709 12:12:14.897128 20380 raft_consensus.cc:2749] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:14.835587 20259 raft_consensus.cc:515] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:14.896979 20402 raft_consensus.cc:493] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:14.856140 20226 raft_consensus.cc:515] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:14.923897 20045 raft_consensus.cc:493] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:14.923517 20152 raft_consensus.cc:493] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:14.935127 20258 consensus_queue.cc:1243] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer 885067a0d31741bfb5c9935788e315bf log is divergent from this leader: its last log entry 14.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:12:14.926486 20296 raft_consensus.cc:740] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:14.855515 20342 raft_consensus.cc:515] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:12:14.960844 14305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:14.867377 20375 raft_consensus.cc:515] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:12:14.961234 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 118359us
I20260709 12:12:14.869350 20348 raft_consensus.cc:515] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:14.946382 20377 raft_consensus.cc:2804] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:14.967638 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:14.929915 19912 consensus_queue.cc:237] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:15.002940 14263 raft_consensus.cc:2468] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 16.
I20260709 12:12:14.963583 14229 leader_election.cc:304] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
W20260709 12:12:14.955894 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 161281us
I20260709 12:12:14.973410 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:14.946533 20241 consensus_queue.cc:1059] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 12:12:14.949043 20390 consensus_queue.cc:1048] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.021s
I20260709 12:12:15.001266 14304 leader_election.cc:304] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:15.004534 14258 raft_consensus.cc:2468] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 15.
W20260709 12:12:15.006168 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 153896us
I20260709 12:12:14.988067 20152 raft_consensus.cc:3060] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:14.964736 20271 consensus_queue.cc:1059] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 12:12:15.021255 14334 raft_consensus.cc:1240] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 21. Current term is 22. Ops: []
I20260709 12:12:15.021610 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:15.021641 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:15.021354 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:15.036671 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:15.039674 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:15.041020 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:14.967885 20395 consensus_queue.cc:1048] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 12:12:15.053601 14907 raft_consensus.cc:1275] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:12:15.033937 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:14.962229 20254 raft_consensus.cc:515] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:15.035946 14338 raft_consensus.cc:2468] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 15.
I20260709 12:12:15.005388 14155 leader_election.cc:304] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:15.049309 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:15.062201 14904 raft_consensus.cc:2468] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 18.
I20260709 12:12:14.964728 20222 raft_consensus.cc:515] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:14.951689 20229 consensus_queue.cc:260] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:15.058293 14186 raft_consensus.cc:1240] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:15.059103 12986 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:12:15.052290 20129 raft_consensus.cc:2749] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 12:12:15.066038 20400 log.cc:927] Time spent T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 12:12:15.067711 20399 consensus_queue.cc:1059] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:12:15.068754 19702 consensus_queue.cc:1048] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:12:15.069653 14304 leader_election.cc:304] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:15.070349 20406 consensus_queue.cc:1048] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:12:15.068754 20401 log.cc:927] Time spent T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 12:12:15.052909 20241 consensus_queue.cc:1243] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer 885067a0d31741bfb5c9935788e315bf log is divergent from this leader: its last log entry 13.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:12:15.078804 20375 leader_election.cc:290] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 14 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:15.082783 20382 leader_election.cc:290] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:14.984863 20402 raft_consensus.cc:515] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:15.012245 20380 raft_consensus.cc:2804] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:15.016335 20137 leader_election.cc:290] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:14.988525 20045 raft_consensus.cc:515] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:15.086591 20377 raft_consensus.cc:697] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 20 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:15.052517 20138 consensus_queue.cc:1048] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.064s
I20260709 12:12:15.047863 14188 raft_consensus.cc:2393] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 20: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
W20260709 12:12:15.104197 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:15.077157 20342 leader_election.cc:290] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:15.045050 20184 raft_consensus.cc:493] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:15.106101 14909 raft_consensus.cc:1240] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:15.028286 14187 raft_consensus.cc:1275] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:12:15.113214 14184 raft_consensus.cc:1275] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:12:15.115450 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:15.115890 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:15.116688 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:15.131496 14334 raft_consensus.cc:2468] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 17.
I20260709 12:12:15.132454 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:15.133021 14187 raft_consensus.cc:1240] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:15.133122 14334 raft_consensus.cc:2468] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 16.
I20260709 12:12:15.116628 14335 raft_consensus.cc:1240] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 17 LEADER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 12:12:15.043274 20228 raft_consensus.cc:493] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:15.092943 20143 raft_consensus.cc:493] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:15.119055 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:15.083897 20229 raft_consensus.cc:3060] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:15.123428 14330 raft_consensus.cc:1240] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 18 LEADER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:15.136404 14187 raft_consensus.cc:1240] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 15. Current term is 16. Ops: [13.7-15.8]
I20260709 12:12:15.059844 20218 raft_consensus.cc:2749] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:15.111311 20035 raft_consensus.cc:2804] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:15.142608 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:15.143347 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:15.144285 14877 leader_election.cc:304] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:15.146224 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:15.153539 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:15.117084 20381 raft_consensus.cc:2749] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:12:15.171658 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:15.167558 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:15.176090 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:15.189177 14335 raft_consensus.cc:2393] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 20: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:12:15.185554 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:15.186367 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:15.196494 14184 raft_consensus.cc:2468] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 18.
I20260709 12:12:15.124322 20348 leader_election.cc:290] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 18 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:15.202751 20016 raft_consensus.cc:493] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:15.173811 20228 raft_consensus.cc:515] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:15.203065 20390 raft_consensus.cc:2804] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:15.181859 20143 raft_consensus.cc:515] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:15.186178 20137 raft_consensus.cc:493] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:15.151036 20375 raft_consensus.cc:493] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:15.182224 20216 raft_consensus.cc:493] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:15.128793 20380 raft_consensus.cc:697] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 16 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:15.221623 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:15.223500 14338 raft_consensus.cc:1240] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 12:12:15.228111 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:15.259871 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
W20260709 12:12:15.262117 20409 log.cc:927] Time spent T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 12:12:15.170557 20379 consensus_queue.cc:1059] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.095s
I20260709 12:12:15.280948 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:12:15.231355 20144 consensus_meta.cc:287] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.600s	user 0.012s	sys 0.000s
I20260709 12:12:15.267542 20228 leader_election.cc:290] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:15.267935 20016 raft_consensus.cc:515] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:15.271087 14331 raft_consensus.cc:2468] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 19.
I20260709 12:12:15.186937 20414 raft_consensus.cc:2749] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:15.164959 20184 raft_consensus.cc:515] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:15.295194 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:15.272719 20390 raft_consensus.cc:493] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:15.128165 20407 consensus_queue.cc:1059] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 18.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.167s
I20260709 12:12:15.345111 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:15.347287 14330 raft_consensus.cc:1275] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:12:15.352087 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:15.352873 14332 raft_consensus.cc:2468] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 19.
W20260709 12:12:15.301517 20373 consensus_meta.cc:287] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.534s	user 0.008s	sys 0.003s
I20260709 12:12:15.281980 20137 raft_consensus.cc:515] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:15.291139 20375 raft_consensus.cc:515] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:15.408174 20375 leader_election.cc:290] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:15.291379 20216 raft_consensus.cc:515] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:15.410959 20216 leader_election.cc:290] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:15.412063 20403 raft_consensus.cc:3055] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:15.412436 20403 raft_consensus.cc:740] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:15.413295 20403 consensus_queue.cc:260] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:15.408198 20137 leader_election.cc:290] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:15.373397 20407 consensus_queue.cc:1243] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer 17aab1bbf5014936aa18cc21818b26ec log is divergent from this leader: its last log entry 19.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:12:15.415417 20402 leader_election.cc:290] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:12:15.420899 20301 consensus_meta.cc:287] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.593s	user 0.007s	sys 0.004s
I20260709 12:12:15.421573 20301 raft_consensus.cc:515] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:12:15.423568 20351 consensus_meta.cc:287] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.541s	user 0.011s	sys 0.000s
I20260709 12:12:15.424350 20403 raft_consensus.cc:3060] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:15.345233 20379 raft_consensus.cc:3055] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:12:15.379812 20045 leader_election.cc:290] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:15.296458 20144 raft_consensus.cc:515] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:12:15.381356 20408 log.cc:927] Time spent T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 12:12:15.382381 20016 leader_election.cc:290] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:15.348119 20226 leader_election.cc:290] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:15.388540 20254 leader_election.cc:290] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 18 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:15.389987 20380 consensus_queue.cc:237] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:15.429001 20144 leader_election.cc:290] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:15.430503 20379 raft_consensus.cc:740] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:12:15.394140 20184 leader_election.cc:290] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:15.343694 20377 consensus_queue.cc:237] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:15.432336 20227 raft_consensus.cc:515] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:15.398155 20222 leader_election.cc:290] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 14 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:15.399868 20143 leader_election.cc:290] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:15.367326 20373 raft_consensus.cc:515] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } }
I20260709 12:12:15.434303 20379 consensus_queue.cc:260] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:15.436333 20373 leader_election.cc:290] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:15.436980 20152 raft_consensus.cc:515] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:15.424088 20351 raft_consensus.cc:515] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:15.441035 20351 leader_election.cc:290] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:15.349210 20390 raft_consensus.cc:3060] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:15.392302 20259 leader_election.cc:290] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 15 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:15.446877 20379 raft_consensus.cc:3060] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:15.424105 20301 leader_election.cc:290] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:15.467700 20152 leader_election.cc:290] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 14 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:15.469064 20227 leader_election.cc:290] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 20 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:15.479594 20390 raft_consensus.cc:515] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:15.266299 14081 catalog_manager.cc:5697] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 11 to 16, leader changed from 885067a0d31741bfb5c9935788e315bf (127.12.174.129) to 73d01e9b1a9d49358da4985b21d681db (127.12.174.132). New cstate: current_term: 16 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:12:15.519572 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:15.523886 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 518326us
I20260709 12:12:15.524438 14181 raft_consensus.cc:1240] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:15.526172 14185 raft_consensus.cc:1240] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:15.526255 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:15.529534 14188 raft_consensus.cc:1217] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Deduplicated request from leader. Original: 8.6->[10.7-15.10]   Dedup: 12.8->[13.9-15.10]
I20260709 12:12:15.530505 14188 pending_rounds.cc:85] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf: Aborting all ops after (but not including) 8
I20260709 12:12:15.530882 14188 pending_rounds.cc:107] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 12:12:15.531314 14188 raft_consensus.cc:2889] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:15.531865 14184 raft_consensus.cc:1240] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 19. Current term is 20. Ops: []
W20260709 12:12:15.542200 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:15.547804 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:15.549296 14332 raft_consensus.cc:2393] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 15: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
W20260709 12:12:15.559571 14877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:15.571312 14305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:15.576726 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:15.578873 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:15.580416 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:15.578907 14336 raft_consensus.cc:1240] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:15.586511 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:15.587961 14334 raft_consensus.cc:2393] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 16: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:12:15.590068 20380 raft_consensus.cc:493] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:15.591907 14260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41768 (request call id 2220) took 1036 ms. Trace:
I20260709 12:12:15.594880 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:15.591336 20380 raft_consensus.cc:515] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:15.598446 20143 raft_consensus.cc:493] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:15.599907 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:15.589677 14334 raft_consensus.cc:3055] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:15.597101 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:15.605656 14259 raft_consensus.cc:1240] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 12 LEADER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 11. Current term is 12. Ops: []
I20260709 12:12:15.607930 20143 raft_consensus.cc:515] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:15.613299 14265 raft_consensus.cc:1275] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:12:15.592528 14260 rpcz_store.cc:276] 0709 12:12:14.555740 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:14.556586 (+   846us) service_pool.cc:224] Handling call
0709 12:12:15.591303 (+1034717us) spinlock_profiling.cc:243] Waited 704 ms on lock 0x7b540022abd4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:12:15.591614 (+   311us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1619888000}
I20260709 12:12:15.616760 20035 raft_consensus.cc:493] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:15.619736 14338 raft_consensus.cc:2468] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 13.
I20260709 12:12:15.620519 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:15.488963 20390 leader_election.cc:290] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 16 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:15.621487 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:15.603587 14334 raft_consensus.cc:740] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:15.628928 20035 raft_consensus.cc:3060] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:15.638126 20045 raft_consensus.cc:476] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 16 LEADER]: Not starting pre-election -- already a leader
I20260709 12:12:15.616786 20380 leader_election.cc:290] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:15.644783 20143 leader_election.cc:290] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:15.647948 20374 raft_consensus.cc:3055] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:12:15.648644 20374 raft_consensus.cc:740] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
W20260709 12:12:15.650574 14878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:15.650818 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:15.655087 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
W20260709 12:12:15.656177 20410 log.cc:927] Time spent T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.508s	user 0.000s	sys 0.001s
I20260709 12:12:15.660369 14155 leader_election.cc:304] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:15.662113 12986 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:15.663468 14334 consensus_queue.cc:260] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:15.667244 14330 raft_consensus.cc:1240] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:15.667944 20152 raft_consensus.cc:2749] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:12:15.669229 20416 log.cc:927] Time spent T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.326s	user 0.035s	sys 0.041s
I20260709 12:12:15.676699 14081 catalog_manager.cc:5697] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 8 to 13. New cstate: current_term: 13 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:15.670719 20374 consensus_queue.cc:260] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:15.664155 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:15.695881 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:15.704468 14258 raft_consensus.cc:1275] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:12:15.679325 14081 catalog_manager.cc:5697] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 11 to 14, leader changed from 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130) to 65c9c1653b3346b39a0e118540e6080c (127.12.174.131). New cstate: current_term: 14 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:12:15.707250 14081 catalog_manager.cc:5697] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 10 to 16. New cstate: current_term: 16 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:15.710374 14183 raft_consensus.cc:1240] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:15.711593 14182 raft_consensus.cc:1275] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 12:12:15.713040 14189 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56652 (request call id 1389) took 1196 ms. Trace:
I20260709 12:12:15.713627 14189 rpcz_store.cc:276] 0709 12:12:14.492865 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:14.493406 (+   541us) service_pool.cc:224] Handling call
0709 12:12:14.493805 (+   399us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:14.494236 (+   431us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:14.494267 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:14.505804 (+ 11537us) log.cc:844] Serialized 26 byte log entry
0709 12:12:14.884728 (+378924us) spinlock_profiling.cc:243] Waited 5.41 ms on lock 0x7b180038c740. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f212cf16ab1 00007f212cf23281 00007f2124030e07 00007f212ce8b9a9 00007f212404d69b 00007f212404b93f 00007f212404dc02 00007f2126cd520b 00007f2126cdad23 00007f2126cdb0d1 00007f21270f6a0f
0709 12:12:15.106812 (+222084us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:12:15.106857 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:15.106940 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:15.660019 (+553079us) spinlock_profiling.cc:243] Waited 6.95 ms on lock 0x7b4400022b4c. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2123f74c85 00007f2123f756a2 00007f2126ce71db 00007f2126ce2aaf 00007f2126cd686e 00007f2126cd5bb6 00007f2126cd57d8 00007f2126cdf221 00007f2126cdf1d9 00007f2126cdf169
0709 12:12:15.680052 (+ 20033us) raft_consensus.cc:1685] finished
0709 12:12:15.680078 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:15.689201 (+  9123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":165,"raft.queue_time_us":8569,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":1515,"spinlock_wait_cycles":28429568,"thread_start_us":221860,"threads_started":1,"wal-append.queue_time_us":763075}
I20260709 12:12:15.714882 14081 catalog_manager.cc:5697] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 7 to 13. New cstate: current_term: 13 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:15.710150 14334 raft_consensus.cc:3060] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:15.699458 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:15.724116 14338 raft_consensus.cc:1240] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:15.700875 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:15.732400 20227 raft_consensus.cc:493] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:15.732736 20218 raft_consensus.cc:493] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:15.745321 14336 raft_consensus.cc:3060] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:15.749935 20227 raft_consensus.cc:515] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:15.750263 20218 raft_consensus.cc:515] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:15.752202 14262 raft_consensus.cc:1240] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 20 LEADER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:15.753080 20227 leader_election.cc:290] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:12:15.754189 14302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:15.754472 20394 log.cc:927] Time spent T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 1.002s	user 0.011s	sys 0.017s
I20260709 12:12:15.760609 14265 raft_consensus.cc:3060] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:12:15.762765 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 93240us
I20260709 12:12:15.764168 14155 leader_election.cc:304] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:15.766076 20152 raft_consensus.cc:3060] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:15.774550 20374 raft_consensus.cc:3060] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:12:15.775429 20261 consensus_queue.cc:1059] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:12:15.776130 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:15.777266 14333 raft_consensus.cc:2393] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 16: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:12:15.777935 14261 raft_consensus.cc:2393] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db in current term 17: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:12:15.779659 14261 raft_consensus.cc:1240] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:15.782599 20035 raft_consensus.cc:515] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:15.781486 14261 raft_consensus.cc:1275] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:12:15.798257 14189 raft_consensus.cc:1275] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
I20260709 12:12:15.805352 20035 leader_election.cc:290] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:15.805967 20227 raft_consensus.cc:493] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:15.806772 20227 raft_consensus.cc:515] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:15.811888 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:15.812851 14909 raft_consensus.cc:2468] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 22.
I20260709 12:12:15.819484 20309 raft_consensus.cc:493] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:15.820538 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:15.820711 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:15.821616 14183 raft_consensus.cc:2393] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 17: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:12:15.821491 20390 consensus_queue.cc:1059] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:15.822760 20390 raft_consensus.cc:3055] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:15.823239 20390 raft_consensus.cc:740] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:12:15.824620 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:15.824394 20390 consensus_queue.cc:260] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:15.825660 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:15.826177 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:15.827262 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:15.826185 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:15.828524 14330 raft_consensus.cc:2393] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 17: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:12:15.828760 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:15.829412 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:15.831236 14187 raft_consensus.cc:1240] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 17. Current term is 18. Ops: [14.9-17.10]
I20260709 12:12:15.824991 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:15.822795 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:15.835691 14877 leader_election.cc:304] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:15.837204 20044 raft_consensus.cc:2804] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:15.837796 20044 raft_consensus.cc:493] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:15.838155 20044 raft_consensus.cc:3060] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:15.838418 20263 raft_consensus.cc:3055] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:15.838860 20263 raft_consensus.cc:740] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
W20260709 12:12:15.839649 20441 log.cc:927] Time spent T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 12:12:15.840247 20263 consensus_queue.cc:260] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:15.835856 14186 raft_consensus.cc:2468] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 16.
I20260709 12:12:15.847891 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:15.820399 20309 raft_consensus.cc:515] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:15.854818 20218 leader_election.cc:290] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:15.831403 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:15.858263 14333 raft_consensus.cc:2393] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 14: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:12:15.809408 20227 leader_election.cc:290] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:15.853506 20309 leader_election.cc:290] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:15.906405 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:15.913166 20218 raft_consensus.cc:493] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:15.914184 20218 raft_consensus.cc:515] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:15.916725 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:15.917560 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:15.925454 14336 raft_consensus.cc:2468] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 16.
I20260709 12:12:15.922024 20035 raft_consensus.cc:493] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:15.927093 20035 raft_consensus.cc:515] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:15.929922 20263 raft_consensus.cc:3060] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:15.935570 20152 raft_consensus.cc:2749] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:12:15.937047 20218 leader_election.cc:290] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:15.902964 20390 raft_consensus.cc:3060] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:12:15.945770 14305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:15.913175 14229 leader_election.cc:304] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:12:15.897588 20227 raft_consensus.cc:493] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:15.958541 20227 raft_consensus.cc:515] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:15.959578 20296 consensus_queue.cc:260] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:15.961223 20227 leader_election.cc:290] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:12:15.964685 20438 log.cc:927] Time spent T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.152s	user 0.002s	sys 0.002s
W20260709 12:12:15.979954 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 66933.9us
I20260709 12:12:15.984038 14265 raft_consensus.cc:2468] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 16.
I20260709 12:12:15.938805 20035 leader_election.cc:290] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:12:16.024442 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:16.010099 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:16.034394 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:16.002720 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:16.000671 14155 leader_election.cc:304] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:15.990383 14334 raft_consensus.cc:1275] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 12:12:16.058104 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:16.059129 14189 raft_consensus.cc:2393] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db in current term 18: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:12:16.010124 20378 raft_consensus.cc:2804] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:12:16.060036 20149 consensus_queue.cc:1048] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.011s
I20260709 12:12:16.060711 20378 raft_consensus.cc:493] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:16.061173 20378 raft_consensus.cc:3060] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:16.063932 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
W20260709 12:12:16.065590 14878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:16.066128 20227 raft_consensus.cc:493] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:16.066891 20227 raft_consensus.cc:515] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:16.069376 20227 leader_election.cc:290] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:16.041116 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:16.069939 20239 consensus_queue.cc:1059] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 12:12:16.071475 20239 raft_consensus.cc:3055] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:12:16.071920 20239 raft_consensus.cc:740] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:16.073827 20296 raft_consensus.cc:3060] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:16.075038 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:16.076570 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:16.077221 14258 raft_consensus.cc:3060] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:16.040627 20271 raft_consensus.cc:493] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:16.078462 20271 raft_consensus.cc:515] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:16.081265 20271 leader_election.cc:290] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:16.009938 14333 raft_consensus.cc:3060] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:16.082419 14907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
W20260709 12:12:16.083858 20406 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 19 current term: 19 is higher.
I20260709 12:12:16.084926 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:16.086022 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:12:16.090121 20438 log.cc:927] Time spent T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
W20260709 12:12:16.057499 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 171669us
I20260709 12:12:16.095178 14877 leader_election.cc:304] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:16.097420 20430 raft_consensus.cc:3060] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:16.003748 20044 raft_consensus.cc:515] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:16.099006 14264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53050 (request call id 1159) took 1138 ms. Trace:
I20260709 12:12:16.100241 20044 leader_election.cc:290] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 17 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:16.099463 14264 rpcz_store.cc:276] 0709 12:12:14.960871 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:14.961630 (+   759us) service_pool.cc:224] Handling call
0709 12:12:14.983416 (+ 21786us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:15.172822 (+189406us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 12:12:15.362095 (+189273us) log.cc:844] Serialized 14 byte log entry
0709 12:12:15.756519 (+394424us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:15.784168 (+ 27649us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:12:15.831666 (+ 47498us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:16.098616 (+266950us) spinlock_profiling.cc:243] Waited 189 ms on lock 0x7b5400101b54. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:12:16.098665 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:16.098818 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":282420,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":66,"raft.queue_time_us":3332,"raft.run_cpu_time_us":316,"raft.run_wall_time_us":2202,"spinlock_wait_cycles":444135552,"thread_start_us":554745,"threads_started":2,"wal-append.queue_time_us":391649}
I20260709 12:12:16.093292 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:16.044667 14259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53050 (request call id 1162) took 1075 ms. Trace:
I20260709 12:12:16.071384 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:16.094952 14263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53050 (request call id 1168) took 1119 ms. Trace:
I20260709 12:12:16.103246 14259 rpcz_store.cc:276] 0709 12:12:14.968843 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:14.969074 (+   231us) service_pool.cc:224] Handling call
0709 12:12:15.604986 (+635912us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:15.606668 (+  1682us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:16.044322 (+437654us) spinlock_profiling.cc:243] Waited 610 ms on lock 0x7b540022abd0. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713a8ad 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:12:16.044540 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1402208512}
I20260709 12:12:16.105104 14263 rpcz_store.cc:276] 0709 12:12:14.975601 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:15.599055 (+623454us) service_pool.cc:224] Handling call
0709 12:12:16.093761 (+494706us) spinlock_profiling.cc:243] Waited 2.08 ms on lock 0x7b5800060c98. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2124016b71 00007f2124016a22 00007f212cf2f8d9 00007f212c089ee0 00007f212c1530ab 00007f212c153131 00007f212c114fc0 00007f212c0ff929 00007f212c0ff3d2 00007f2125676bd4
0709 12:12:16.094040 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:16.094433 (+   393us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:16.094459 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:16.094522 (+    63us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:12:16.094561 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:16.094633 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:16.094754 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4778880}
W20260709 12:12:16.114665 14305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:16.127990 14904 raft_consensus.cc:2368] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 15. Current term is 16.
I20260709 12:12:16.073194 20239 consensus_queue.cc:260] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:12:16.136410 14302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:16.138692 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
W20260709 12:12:16.151738 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 164753us
I20260709 12:12:16.153890 14256 raft_consensus.cc:2393] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 20: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:12:16.147159 14261 raft_consensus.cc:2468] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 16.
I20260709 12:12:16.133925 20035 raft_consensus.cc:493] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:16.131979 20227 raft_consensus.cc:2749] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:12:16.150506 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:12:16.163190 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 68128.8us
W20260709 12:12:16.167620 14877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:16.171700 14189 raft_consensus.cc:3060] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:16.174167 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
W20260709 12:12:16.179950 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 256227us
I20260709 12:12:16.186741 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:16.192764 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:16.199401 14261 raft_consensus.cc:2368] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 15. Current term is 16.
I20260709 12:12:16.209975 20048 raft_consensus.cc:493] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:16.210878 20048 raft_consensus.cc:515] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:16.211126 14258 raft_consensus.cc:2468] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 17.
I20260709 12:12:16.213799 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
W20260709 12:12:16.216905 14878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:16.218614 14188 raft_consensus.cc:1240] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:16.218655 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:16.223304 14258 raft_consensus.cc:2393] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 14: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:12:16.226126 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:16.226872 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:16.228084 14259 raft_consensus.cc:1240] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:16.230154 14155 leader_election.cc:304] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:16.231432 20218 raft_consensus.cc:2804] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:16.231902 20218 raft_consensus.cc:493] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:16.232321 20218 raft_consensus.cc:3060] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:12:16.238267 14876 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:16.192016 20152 raft_consensus.cc:493] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:16.244321 20152 raft_consensus.cc:515] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:16.244702 20239 raft_consensus.cc:3060] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:16.246325 20227 raft_consensus.cc:493] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:16.247146 20227 raft_consensus.cc:515] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:16.247236 20369 consensus_queue.cc:1059] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:12:16.248737 20369 raft_consensus.cc:3055] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:16.249135 20369 raft_consensus.cc:740] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:12:16.250231 20369 consensus_queue.cc:260] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:12:16.214733 20404 log.cc:927] Time spent T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 1.264s	user 0.005s	sys 0.005s
I20260709 12:12:16.251864 20369 raft_consensus.cc:3060] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:16.253273 14190 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56046 (request call id 2708) took 1676 ms. Trace:
I20260709 12:12:16.254985 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:12:16.251070 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 52219.8us
I20260709 12:12:16.259334 14909 raft_consensus.cc:2468] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 17.
W20260709 12:12:16.260447 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 256056us
I20260709 12:12:16.264443 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:16.233424 14155 leader_election.cc:304] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:16.213529 20048 leader_election.cc:290] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:16.253667 14190 rpcz_store.cc:276] 0709 12:12:14.577037 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:14.586412 (+  9375us) service_pool.cc:224] Handling call
0709 12:12:14.586791 (+   379us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:14.601228 (+ 14437us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:14.601262 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:14.601836 (+   574us) log.cc:844] Serialized 26 byte log entry
0709 12:12:14.736591 (+134755us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:14.736639 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:14.736722 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:16.197169 (+1460447us) spinlock_profiling.cc:243] Waited 2.5 ms on lock 0x7b4400022b4c. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2123f74c85 00007f2123f756a2 00007f2126ce71db 00007f2126ce2aaf 00007f2126cd686e 00007f2126cd5bb6 00007f2126cd57d8 00007f2126cdf221 00007f2126cdf1d9 00007f2126cdf169
0709 12:12:16.252813 (+ 55644us) raft_consensus.cc:1685] finished
0709 12:12:16.252833 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:16.253102 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19044,"raft.queue_time_us":15960,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":22362,"spinlock_wait_cycles":5758336,"thread_start_us":134412,"threads_started":1,"wal-append.queue_time_us":295429}
I20260709 12:12:16.249570 20227 leader_election.cc:290] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:16.182675 20035 raft_consensus.cc:515] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:16.276495 14265 raft_consensus.cc:3060] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:12:16.251019 14083 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60410 (request call id 259) took 35709 ms (client timeout 15000 ms). Trace:
I20260709 12:12:16.276587 14876 leader_election.cc:304] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:16.300498 14911 raft_consensus.cc:2468] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 14.
I20260709 12:12:16.132982 14081 catalog_manager.cc:5697] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 11 to 15. New cstate: current_term: 15 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:16.291105 14229 leader_election.cc:304] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:16.317353 20434 raft_consensus.cc:2749] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:12:16.322281 14189 raft_consensus.cc:2468] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 16.
I20260709 12:12:16.289872 20227 raft_consensus.cc:2749] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:16.301815 20044 raft_consensus.cc:493] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:16.334077 14154 leader_election.cc:400] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 15 election: Vote denied by peer 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341) with higher term. Message: Invalid argument: T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 15. Current term is 16.
I20260709 12:12:16.334685 14154 leader_election.cc:403] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
W20260709 12:12:16.335269 14154 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 140322us
I20260709 12:12:16.336854 14154 leader_election.cc:304] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:16.317888 19912 raft_consensus.cc:493] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:16.356957 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 123692us
I20260709 12:12:16.357824 14258 raft_consensus.cc:1240] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 12:12:16.342582 19912 raft_consensus.cc:515] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:16.358137 14155 leader_election.cc:304] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:16.372340 20377 raft_consensus.cc:2749] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:16.372916 19912 leader_election.cc:290] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:16.373445 14229 leader_election.cc:304] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:16.339530 20380 raft_consensus.cc:493] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:16.364586 20227 raft_consensus.cc:2749] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341) with higher term. Message: Invalid argument: T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 15. Current term is 16.
I20260709 12:12:16.410959 20227 raft_consensus.cc:2804] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:16.411542 20227 raft_consensus.cc:697] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 17 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:12:16.412681 20227 consensus_queue.cc:237] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:16.375003 20045 consensus_queue.cc:1059] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 12:12:16.390741 20218 raft_consensus.cc:515] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:16.429905 20406 raft_consensus.cc:493] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:16.414629 20296 raft_consensus.cc:3055] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:16.430632 20296 raft_consensus.cc:740] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:16.431845 20296 consensus_queue.cc:260] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:16.433313 20296 raft_consensus.cc:3060] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:16.435497 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:16.431772 20218 leader_election.cc:290] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 18 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:16.396054 20378 raft_consensus.cc:515] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:16.441576 20218 raft_consensus.cc:2804] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:16.442176 20218 raft_consensus.cc:493] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:16.442636 20218 raft_consensus.cc:3060] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:16.443545 20378 leader_election.cc:290] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:16.430557 20406 raft_consensus.cc:515] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:16.445042 14265 raft_consensus.cc:2468] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 17.
I20260709 12:12:16.401885 20454 consensus_queue.cc:1048] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.014s
I20260709 12:12:16.407831 20380 raft_consensus.cc:515] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:16.383801 14230 leader_election.cc:304] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:16.427786 14260 raft_consensus.cc:1240] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 16 LEADER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 12:12:16.398757 14257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53050 (request call id 1155) took 1418 ms. Trace:
W20260709 12:12:16.449747 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 91754.8us
I20260709 12:12:16.348582 20044 raft_consensus.cc:515] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:16.385002 20263 raft_consensus.cc:493] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:16.457877 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:16.461086 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:16.462103 14336 raft_consensus.cc:2393] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 22: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:12:16.464736 20380 leader_election.cc:290] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:12:16.285060 14083 rpcz_store.cc:269] 0709 12:11:40.541252 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:40.541580 (+   328us) service_pool.cc:224] Handling call
0709 12:11:41.112033 (+570453us) spinlock_profiling.cc:243] Waited 13 ms on lock 0x7b54002e3454. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a5090 00007f2127143f3a 00007f212cef9e9c 00007f212cff804e 00007f212b4b92a4 00007f212b4b9232 00007f212b4b9161 00007f212b4b90dc 00007f212b4b8392 00007f212547648c 00007f21254758c6
0709 12:12:16.250721 (+35138688us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:12:07.265986 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:12:07.266727 (+   741us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:12:07.266791 (+    64us) write_op.cc:435] Acquired schema lock
0709 12:12:07.266825 (+    34us) tablet.cc:662] Decoding operations
0709 12:12:07.268433 (+  1608us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:12:07.268526 (+    93us) write_op.cc:641] Partition lock acquired for write op
0709 12:12:07.268558 (+    32us) tablet.cc:685] Acquiring locks for 17 operations
0709 12:12:07.270095 (+  1537us) tablet.cc:701] Row locks acquired
0709 12:12:07.270146 (+    51us) write_op.cc:260] PREPARE: finished
0709 12:12:07.270348 (+   202us) write_op.cc:270] Start()
0709 12:12:07.270518 (+   170us) write_op.cc:276] Timestamp: P: 1783599127270273 usec, L: 0
0709 12:12:07.270554 (+    36us) op_driver.cc:348] REPLICATION: starting
0709 12:12:07.271407 (+   853us) log.cc:844] Serialized 6791 byte log entry
0709 12:12:07.718767 (+447360us) op_driver.cc:464] REPLICATION: finished
0709 12:12:08.035628 (+316861us) write_op.cc:301] APPLY: starting
0709 12:12:08.043193 (+  7565us) tablet.cc:1367] starting BulkCheckPresence
0709 12:12:08.483668 (+440475us) tablet.cc:1370] finished BulkCheckPresence
0709 12:12:08.483794 (+   126us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:12:09.056642 (+572848us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:12:09.134342 (+ 77700us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=34,key_file_lookups=34,delta_file_lookups=34,mrs_lookups=0
0709 12:12:09.134417 (+    75us) write_op.cc:312] APPLY: finished
0709 12:12:09.134918 (+   501us) log.cc:844] Serialized 156 byte log entry
0709 12:12:09.597633 (+462715us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:09.597855 (+   222us) write_op.cc:454] Released schema lock
0709 12:12:09.597943 (+    88us) write_op.cc:341] FINISH: Updating metrics
0709 12:12:09.600874 (+  2931us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:09.600906 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1924298,"reported_tablets":50,"spinlock_wait_cycles":29819648,"child_traces":[["op",{"apply.queue_time_us":254160,"apply.run_cpu_time_us":61264,"apply.run_wall_time_us":1582216,"cfile_cache_hit":70,"cfile_cache_hit_bytes":75323,"num_ops":17,"prepare.queue_time_us":181158,"prepare.run_cpu_time_us":65125,"prepare.run_wall_time_us":186596,"raft.queue_time_us":159678,"raft.run_cpu_time_us":26547,"raft.run_wall_time_us":106089,"replication_time_us":448023,"thread_start_us":677050,"threads_started":5,"wal-append.queue_time_us":839321,"wal-append.run_cpu_time_us":18802,"wal-append.run_wall_time_us":2336949}]]}
I20260709 12:12:16.477660 14334 raft_consensus.cc:1275] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
I20260709 12:12:16.455391 20239 raft_consensus.cc:493] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:16.485219 14911 raft_consensus.cc:1275] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:12:16.448700 14257 rpcz_store.cc:276] 0709 12:12:14.959562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:14.959716 (+   154us) service_pool.cc:224] Handling call
0709 12:12:14.960108 (+   392us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:14.988917 (+ 28809us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:14.988953 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:14.996874 (+  7921us) log.cc:844] Serialized 26 byte log entry
0709 12:12:15.288824 (+291950us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:12:15.288878 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:16.328045 (+1039167us) spinlock_profiling.cc:243] Waited 19.9 ms on lock 0x7b54003813d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:12:16.338227 (+ 10182us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:16.343315 (+  5088us) raft_consensus.cc:1685] finished
0709 12:12:16.343338 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:16.377387 (+ 34049us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10369,"raft.queue_time_us":9149,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":7782,"spinlock_wait_cycles":45803904,"thread_start_us":291534,"threads_started":1,"wal-append.queue_time_us":479068}
I20260709 12:12:16.486102 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:12:16.490770 14305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:16.492491 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:16.499048 14155 leader_election.cc:304] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:16.509131 20383 raft_consensus.cc:493] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:16.509881 20383 raft_consensus.cc:515] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:16.512310 20383 leader_election.cc:290] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:16.512924 20044 leader_election.cc:290] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:16.477413 14081 catalog_manager.cc:5697] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 9 to 14. New cstate: current_term: 14 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:16.509162 14155 leader_election.cc:304] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:16.507809 20035 leader_election.cc:290] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:16.517693 20035 raft_consensus.cc:2804] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:16.518216 20035 raft_consensus.cc:493] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:16.518693 20035 raft_consensus.cc:3060] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:16.500757 20152 leader_election.cc:290] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:16.518890 20048 consensus_queue.cc:1048] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:12:16.519776 14335 raft_consensus.cc:2468] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 19.
I20260709 12:12:16.519800 20152 raft_consensus.cc:2749] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:16.530587 14333 raft_consensus.cc:2468] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 17.
I20260709 12:12:16.515727 14081 catalog_manager.cc:5697] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 8 to 13. New cstate: current_term: 13 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:16.532263 20309 raft_consensus.cc:493] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:16.484900 20430 raft_consensus.cc:2749] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:16.486754 20380 raft_consensus.cc:2804] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 12:12:16.538684 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 197411us
I20260709 12:12:16.551614 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:16.552723 14911 raft_consensus.cc:2468] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 14.
I20260709 12:12:16.537774 14256 raft_consensus.cc:2468] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 14.
I20260709 12:12:16.557878 20152 raft_consensus.cc:493] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:16.558565 20152 raft_consensus.cc:515] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:16.559707 14303 leader_election.cc:304] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:16.560719 20383 raft_consensus.cc:2749] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:16.560989 20152 leader_election.cc:290] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:16.561699 20383 consensus_queue.cc:1048] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 12:12:16.577046 14154 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 240308us
I20260709 12:12:16.507486 20406 leader_election.cc:290] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:16.558476 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:16.538089 20380 raft_consensus.cc:493] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:16.498399 20239 raft_consensus.cc:515] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:12:16.585021 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:16.520922 20048 consensus_queue.cc:1048] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.058s
I20260709 12:12:16.587031 14229 leader_election.cc:304] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:12:16.503890 20263 raft_consensus.cc:515] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:16.593956 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:16.590907 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:16.590370 14337 raft_consensus.cc:2468] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 17.
I20260709 12:12:16.596766 19912 raft_consensus.cc:2804] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:16.599331 14187 raft_consensus.cc:1240] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:16.598479 20357 consensus_queue.cc:1059] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 13.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:12:16.600519 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:16.601233 14876 leader_election.cc:304] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:16.584379 20380 raft_consensus.cc:3060] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:16.600483 20390 raft_consensus.cc:3055] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:12:16.605211 20390 raft_consensus.cc:740] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:12:16.596205 14154 leader_election.cc:304] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:16.606117 14186 raft_consensus.cc:2468] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 12.
I20260709 12:12:16.609783 14303 leader_election.cc:304] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:12:16.595928 20152 raft_consensus.cc:493] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:16.622260 14909 raft_consensus.cc:1275] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:12:16.623097 14189 raft_consensus.cc:2468] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 14.
I20260709 12:12:16.602059 19912 raft_consensus.cc:493] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:12:16.638403 14302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:16.641636 14230 leader_election.cc:304] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:16.592695 20378 consensus_queue.cc:1048] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 12:12:16.648670 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:16.621371 20261 raft_consensus.cc:2804] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:16.636323 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:16.594470 20309 raft_consensus.cc:515] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:16.632625 19912 raft_consensus.cc:3060] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:16.635843 20383 raft_consensus.cc:2804] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:16.670504 14187 raft_consensus.cc:1275] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:12:16.672026 14186 raft_consensus.cc:2393] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 16: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:12:16.632395 20044 consensus_queue.cc:1059] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 11, Time since last communication: 0.037s
I20260709 12:12:16.683746 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:16.632791 20152 raft_consensus.cc:515] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:16.621493 20390 consensus_queue.cc:260] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:16.665263 20045 raft_consensus.cc:2749] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:12:16.689519 14878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:16.673290 20383 raft_consensus.cc:493] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:12:16.702260 14305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:16.705569 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 81985.3us
I20260709 12:12:16.706054 14187 raft_consensus.cc:1275] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:12:16.706689 14230 leader_election.cc:304] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:16.708305 20390 raft_consensus.cc:3060] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:16.707732 14081 catalog_manager.cc:5697] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:16.710384 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:16.712543 14265 raft_consensus.cc:2468] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 16.
I20260709 12:12:16.681546 20261 raft_consensus.cc:697] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 16 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:12:16.696476 20377 raft_consensus.cc:2804] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:16.696803 20383 raft_consensus.cc:3060] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:16.739372 14911 raft_consensus.cc:2468] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 22.
I20260709 12:12:16.740731 20458 raft_consensus.cc:493] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:16.741430 20458 raft_consensus.cc:515] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:16.743605 20458 leader_election.cc:290] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:16.740752 14229 leader_election.cc:304] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:12:16.714937 20454 raft_consensus.cc:2749] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:12:16.765021 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 255996us
W20260709 12:12:16.766191 14877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:16.768699 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 154510us
I20260709 12:12:16.767870 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:16.791474 14184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56046 (request call id 2720) took 1081 ms. Trace:
I20260709 12:12:16.751695 20458 raft_consensus.cc:493] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
W20260709 12:12:16.796106 14229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:16.797621 14229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:16.794574 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:16.803426 14155 leader_election.cc:304] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:16.794886 14184 rpcz_store.cc:276] 0709 12:12:15.709694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:16.461641 (+751947us) service_pool.cc:224] Handling call
0709 12:12:16.462052 (+   411us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:16.462346 (+   294us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:12:16.674299 (+211953us) log.cc:844] Serialized 14 byte log entry
0709 12:12:16.791028 (+116729us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:16.791088 (+    60us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:12:16.791140 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:16.791215 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:16.791387 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":12360,"thread_start_us":288658,"threads_started":2}
I20260709 12:12:16.806224 14262 raft_consensus.cc:2393] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 14: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:12:16.791452 20406 consensus_queue.cc:1059] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.002s
I20260709 12:12:16.759377 20378 consensus_queue.cc:1048] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.037s
W20260709 12:12:16.842051 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 135531us
I20260709 12:12:16.832682 20463 raft_consensus.cc:493] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:16.832973 20227 raft_consensus.cc:2749] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:12:16.834350 14876 leader_election.cc:304] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:16.806979 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:16.789705 20263 leader_election.cc:290] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:12:16.859308 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 242847us
W20260709 12:12:16.861478 20440 log.cc:927] Time spent T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.962s	user 0.009s	sys 0.000s
I20260709 12:12:16.862618 20459 raft_consensus.cc:2804] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:12:16.863880 20459 raft_consensus.cc:697] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 22 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:16.870546 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:16.845124 20456 raft_consensus.cc:2804] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:12:16.875829 20152 leader_election.cc:290] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:16.876929 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
W20260709 12:12:16.876235 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 79900.8us
I20260709 12:12:16.865294 20459 consensus_queue.cc:237] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:16.865398 20458 raft_consensus.cc:515] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:16.896649 14155 leader_election.cc:304] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
W20260709 12:12:16.906379 14305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:16.888592 14230 leader_election.cc:304] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:16.875774 20456 raft_consensus.cc:697] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 14 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:12:16.916445 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:16.918198 20376 raft_consensus.cc:2804] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:12:16.918517 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:16.919196 14190 raft_consensus.cc:2468] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 16.
W20260709 12:12:16.919363 20460 log.cc:927] Time spent T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 12:12:16.920279 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:16.921589 20215 raft_consensus.cc:493] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:16.922061 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:16.922297 20215 raft_consensus.cc:515] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:16.922758 14183 raft_consensus.cc:2468] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 18.
I20260709 12:12:16.923282 20143 raft_consensus.cc:2804] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:16.921516 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:16.924299 14190 raft_consensus.cc:2468] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 18.
I20260709 12:12:16.923723 20143 raft_consensus.cc:493] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:16.925261 20143 raft_consensus.cc:3060] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:16.895648 20261 consensus_queue.cc:237] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:16.922832 14182 raft_consensus.cc:1275] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 12:12:16.887547 20406 raft_consensus.cc:3055] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:16.935566 14877 leader_election.cc:304] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 65c9c1653b3346b39a0e118540e6080c
W20260709 12:12:16.921519 20473 log.cc:927] Time spent T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.088s	user 0.002s	sys 0.003s
I20260709 12:12:16.941766 14190 raft_consensus.cc:1240] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:16.916239 20227 raft_consensus.cc:2749] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:16.944599 20383 raft_consensus.cc:515] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:16.945336 19912 raft_consensus.cc:515] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:16.930974 20376 raft_consensus.cc:493] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:16.932107 20406 raft_consensus.cc:740] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
W20260709 12:12:16.957924 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 61360us
W20260709 12:12:16.962725 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 82982.8us
W20260709 12:12:16.963799 20462 log.cc:927] Time spent T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 12:12:16.969275 20406 consensus_queue.cc:260] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:16.969894 20477 raft_consensus.cc:2804] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:16.970515 20477 raft_consensus.cc:697] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 17 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:12:16.957890 20476 consensus_queue.cc:1059] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.014s
I20260709 12:12:16.971503 20477 consensus_queue.cc:237] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:12:16.973002 20218 consensus_meta.cc:287] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.530s	user 0.009s	sys 0.001s
I20260709 12:12:16.910483 20463 raft_consensus.cc:515] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:16.976584 20463 leader_election.cc:290] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:16.977167 20463 consensus_queue.cc:1059] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:12:16.953966 20376 raft_consensus.cc:3060] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:16.980677 14155 leader_election.cc:304] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:16.953579 20309 leader_election.cc:290] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:16.985651 20377 raft_consensus.cc:493] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:16.937299 20045 consensus_queue.cc:1048] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 12:12:16.831655 14081 catalog_manager.cc:5697] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 14 to 16, leader changed from 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) to 65c9c1653b3346b39a0e118540e6080c (127.12.174.131). New cstate: current_term: 16 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:12:16.981844 20227 raft_consensus.cc:2804] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:16.981875 14155 leader_election.cc:304] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:16.965394 14230 leader_election.cc:304] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:16.987664 20456 consensus_queue.cc:237] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:16.989913 20469 raft_consensus.cc:493] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:16.939790 20296 consensus_queue.cc:1048] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.049s
W20260709 12:12:17.026463 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 85209.8us
W20260709 12:12:17.029560 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 195273us
I20260709 12:12:16.992046 19912 leader_election.cc:290] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:16.973466 20218 raft_consensus.cc:515] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:16.992180 20380 raft_consensus.cc:515] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:17.027406 20377 raft_consensus.cc:3060] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:17.040444 14876 leader_election.cc:304] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:12:17.042824 14229 leader_election.cc:304] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:17.032078 20227 raft_consensus.cc:493] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:17.038599 20309 raft_consensus.cc:2749] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:12:17.047196 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 65479.4us
I20260709 12:12:17.047646 14182 raft_consensus.cc:1240] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 12:12:17.048372 20467 raft_consensus.cc:2749] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:17.043553 20215 leader_election.cc:290] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:17.049957 14081 catalog_manager.cc:5697] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:17.032744 20476 consensus_queue.cc:1243] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer 17aab1bbf5014936aa18cc21818b26ec log is divergent from this leader: its last log entry 20.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 12:12:17.051759 20239 leader_election.cc:290] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:17.081179 14155 leader_election.cc:304] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:17.053896 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:12:17.054145 20466 log.cc:927] Time spent T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.132s	user 0.003s	sys 0.000s
I20260709 12:12:17.054988 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
W20260709 12:12:17.057670 20440 log.cc:927] Time spent T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.081s	user 0.003s	sys 0.000s
I20260709 12:12:17.050295 20271 raft_consensus.cc:3055] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:17.058287 20458 leader_election.cc:290] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:17.070868 20390 raft_consensus.cc:2804] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:17.060650 20383 leader_election.cc:290] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:17.063186 14876 leader_election.cc:304] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
W20260709 12:12:17.045617 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 113983us
I20260709 12:12:17.067281 14229 leader_election.cc:304] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:17.072232 14189 raft_consensus.cc:1240] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:17.078773 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:17.066115 20227 raft_consensus.cc:3060] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:17.085029 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:17.109655 14911 raft_consensus.cc:2468] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 12.
I20260709 12:12:17.097465 14904 raft_consensus.cc:1240] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 17 LEADER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 16. Current term is 17. Ops: [16.13-16.13]
W20260709 12:12:17.110028 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 46925.6us
I20260709 12:12:17.067924 20296 raft_consensus.cc:2804] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:17.104308 14903 raft_consensus.cc:1240] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:17.107753 14905 raft_consensus.cc:2468] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 17.
I20260709 12:12:17.059273 20406 raft_consensus.cc:3060] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:17.110468 14265 raft_consensus.cc:1240] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 17. Current term is 18. Ops: []
W20260709 12:12:17.116732 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 151446us
I20260709 12:12:17.115262 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:17.117532 14183 raft_consensus.cc:2468] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 17.
I20260709 12:12:17.112718 20296 raft_consensus.cc:493] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:17.118997 20296 raft_consensus.cc:3060] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:17.122103 14081 catalog_manager.cc:5697] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 11 to 15. New cstate: current_term: 15 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:17.123910 20380 leader_election.cc:290] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:17.124284 14081 catalog_manager.cc:5697] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 9 to 11, leader changed from 885067a0d31741bfb5c9935788e315bf (127.12.174.129) to 73d01e9b1a9d49358da4985b21d681db (127.12.174.132). New cstate: current_term: 11 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:17.127214 14155 leader_election.cc:400] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 15 election: Vote denied by peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673) with higher term. Message: Invalid argument: T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 15. Current term is 16.
I20260709 12:12:17.094746 20271 raft_consensus.cc:740] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:12:17.131385 20271 consensus_queue.cc:260] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:17.132421 20271 raft_consensus.cc:3060] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:17.133898 20474 raft_consensus.cc:2749] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:17.105841 20390 raft_consensus.cc:493] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:17.134660 20390 raft_consensus.cc:3060] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:17.050467 20469 raft_consensus.cc:515] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:17.134105 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:17.106406 20456 raft_consensus.cc:2804] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:17.145383 14184 raft_consensus.cc:2393] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 14: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:12:17.146921 14155 leader_election.cc:304] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:17.113036 20309 raft_consensus.cc:2804] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:17.168746 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:17.174602 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:17.175830 20377 raft_consensus.cc:515] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:17.129192 20376 raft_consensus.cc:515] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:17.179467 20376 leader_election.cc:290] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 13 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:17.180284 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:17.182355 14081 catalog_manager.cc:5697] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 7 to 15. New cstate: current_term: 15 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:17.184525 14081 catalog_manager.cc:5697] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 11 to 15, leader changed from 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) to 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130). New cstate: current_term: 15 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:12:17.186100 20456 raft_consensus.cc:697] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 17 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:12:17.186620 20218 leader_election.cc:290] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 18 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:17.187319 20218 raft_consensus.cc:2804] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:12:17.187207 20456 consensus_queue.cc:237] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } }
I20260709 12:12:17.187891 20218 raft_consensus.cc:697] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 14 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:12:17.188840 20218 consensus_queue.cc:237] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:17.189190 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:17.174453 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:17.195762 14189 raft_consensus.cc:2468] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 12.
I20260709 12:12:17.197337 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:17.195142 14190 raft_consensus.cc:2468] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 17.
I20260709 12:12:17.185441 14182 raft_consensus.cc:1240] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:17.176151 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:17.203860 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:17.201370 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:17.152510 20261 consensus_queue.cc:1059] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.054s
I20260709 12:12:17.167970 20383 raft_consensus.cc:493] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:17.218443 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:17.207172 14230 leader_election.cc:304] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:17.207002 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:12:17.211855 14878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:17.213055 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:17.116091 20215 consensus_queue.cc:1048] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 12:12:17.158583 20309 raft_consensus.cc:493] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:17.214828 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:17.215667 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:17.216720 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:17.222026 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:17.218062 14262 raft_consensus.cc:2468] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 14.
I20260709 12:12:17.220894 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:17.221230 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:17.222409 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 20 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:17.220757 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:17.227864 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:17.239264 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 20 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:17.228852 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:17.237562 14336 raft_consensus.cc:2468] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 16.
I20260709 12:12:17.245556 14258 raft_consensus.cc:2410] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for term 18 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 12:12:17.247444 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:17.249766 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:12:17.251511 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 46713.9us
I20260709 12:12:17.249843 14257 raft_consensus.cc:2393] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 16: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:12:17.254114 14263 raft_consensus.cc:2368] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 19. Current term is 20.
I20260709 12:12:17.255076 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:17.258492 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:17.190310 20476 consensus_queue.cc:1048] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 12:12:17.264523 14261 raft_consensus.cc:2393] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 15: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:12:17.267316 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:17.255167 14339 raft_consensus.cc:2468] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 19.
I20260709 12:12:17.254573 14182 raft_consensus.cc:3060] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:17.316207 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:17.275484 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
W20260709 12:12:17.278551 20489 log.cc:927] Time spent T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
W20260709 12:12:17.251755 20035 consensus_meta.cc:287] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.693s	user 0.017s	sys 0.002s
I20260709 12:12:17.269541 20239 raft_consensus.cc:2749] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:12:17.273391 14260 raft_consensus.cc:2468] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 18.
I20260709 12:12:17.274428 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:17.299335 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:17.278707 20048 raft_consensus.cc:3055] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:17.240747 20309 raft_consensus.cc:3060] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:17.283643 20227 raft_consensus.cc:515] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:17.280347 20143 raft_consensus.cc:515] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:17.244457 20383 raft_consensus.cc:515] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:17.273694 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:17.281227 14334 raft_consensus.cc:2468] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 19.
I20260709 12:12:17.342046 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:17.345254 14155 leader_election.cc:304] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:17.407720 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:12:17.389573 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 217859us
W20260709 12:12:17.379283 14302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:17.399992 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:17.356869 14303 leader_election.cc:304] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:17.446802 14336 raft_consensus.cc:2468] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 20.
W20260709 12:12:17.347155 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 76040.4us
I20260709 12:12:17.446770 14182 raft_consensus.cc:2468] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 17.
I20260709 12:12:17.448630 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:17.395887 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:17.487430 14229 leader_election.cc:304] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:17.447846 14262 raft_consensus.cc:2468] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 16.
W20260709 12:12:17.453712 14305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:17.493526 14305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:17.397147 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:17.374281 14304 leader_election.cc:304] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:12:17.358867 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:17.445634 14263 raft_consensus.cc:2410] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for term 18 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 12:12:17.365598 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:12:17.459105 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 103504us
I20260709 12:12:17.489764 14229 leader_election.cc:304] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:17.500386 14339 raft_consensus.cc:2410] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for term 18 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
W20260709 12:12:17.389479 20488 log.cc:927] Time spent T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.138s	user 0.001s	sys 0.000s
I20260709 12:12:17.386010 14081 catalog_manager.cc:5697] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 4 to 11. New cstate: current_term: 11 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:17.395076 20469 leader_election.cc:290] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:17.445292 20048 raft_consensus.cc:740] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:17.458706 20485 raft_consensus.cc:2749] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:17.504194 14303 leader_election.cc:304] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:17.294322 20377 leader_election.cc:290] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:17.485468 20152 raft_consensus.cc:2749] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:12:17.499164 20215 raft_consensus.cc:2804] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:17.517378 14229 leader_election.cc:304] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:17.371829 20296 raft_consensus.cc:515] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:12:17.526435 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 232480us
I20260709 12:12:17.374708 20492 consensus_queue.cc:1059] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.147s
I20260709 12:12:17.516342 20459 raft_consensus.cc:2804] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:17.389040 20486 consensus_queue.cc:1059] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.177s
W20260709 12:12:17.531212 14229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:17.496676 20035 raft_consensus.cc:515] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:17.342185 20487 consensus_queue.cc:1059] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.257s
I20260709 12:12:17.519963 20476 raft_consensus.cc:2804] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:17.523783 20045 consensus_queue.cc:1059] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.011s
I20260709 12:12:17.541214 14911 raft_consensus.cc:1240] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 12. Current term is 13. Ops: []
I20260709 12:12:17.543654 14256 raft_consensus.cc:2393] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 17: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:12:17.525630 20215 raft_consensus.cc:493] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:17.547104 20215 raft_consensus.cc:3060] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:17.527267 20482 raft_consensus.cc:2749] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:17.561443 14188 raft_consensus.cc:1240] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 17. Current term is 18. Ops: []
W20260709 12:12:17.562142 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 66071.9us
I20260709 12:12:17.563086 14230 leader_election.cc:304] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:17.545789 20476 raft_consensus.cc:493] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:17.564265 20476 raft_consensus.cc:3060] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:17.564594 20227 leader_election.cc:290] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 16 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:17.564940 20045 raft_consensus.cc:3055] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 16 LEADER]: Stepping down as leader of term 16
W20260709 12:12:17.565284 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 61220.6us
I20260709 12:12:17.568121 20048 consensus_queue.cc:260] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:17.569239 20048 raft_consensus.cc:3060] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:17.543159 20459 raft_consensus.cc:697] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 17 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:17.556105 20492 consensus_queue.cc:1243] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer 17aab1bbf5014936aa18cc21818b26ec log is divergent from this leader: its last log entry 16.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:12:17.570740 20459 consensus_queue.cc:237] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:17.538954 20383 leader_election.cc:290] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:17.572022 20493 raft_consensus.cc:3055] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:17.572453 20493 raft_consensus.cc:740] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:17.573376 20493 consensus_queue.cc:260] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:17.574631 20493 raft_consensus.cc:3060] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:17.574458 20486 consensus_queue.cc:1048] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:12:17.545095 20485 raft_consensus.cc:2749] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:12:17.579535 20296 leader_election.cc:290] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:17.581236 20035 leader_election.cc:290] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 18 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:17.583473 14184 raft_consensus.cc:1240] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:17.583963 20390 raft_consensus.cc:515] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:17.585125 14909 raft_consensus.cc:2393] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 15: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
I20260709 12:12:17.585573 20430 consensus_queue.cc:1059] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:12:17.565323 20045 raft_consensus.cc:740] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:17.586755 20045 consensus_queue.cc:260] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:17.587920 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:17.588179 20045 raft_consensus.cc:3060] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:17.591722 14155 leader_election.cc:304] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:17.592897 20390 leader_election.cc:290] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 15 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:17.593804 20035 raft_consensus.cc:2749] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:17.596228 20476 raft_consensus.cc:515] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:17.593451 14155 leader_election.cc:304] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:17.608958 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:17.609834 14184 raft_consensus.cc:3060] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:17.620083 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:17.621266 20035 raft_consensus.cc:2749] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:12:17.622014 14155 leader_election.cc:304] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:17.624027 14155 leader_election.cc:304] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:17.629456 14905 raft_consensus.cc:1275] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 12:12:17.632302 14155 leader_election.cc:304] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
W20260709 12:12:17.633803 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 259625us
I20260709 12:12:17.619099 20296 raft_consensus.cc:493] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:17.636193 14155 leader_election.cc:304] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:12:17.638077 20476 leader_election.cc:290] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:17.623986 20309 raft_consensus.cc:515] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:17.626148 20035 raft_consensus.cc:2749] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 12:12:17.640663 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 67575.5us
I20260709 12:12:17.635753 20458 raft_consensus.cc:2749] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:17.647596 14155 leader_election.cc:304] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:17.650058 20464 raft_consensus.cc:2749] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:12:17.652508 14303 leader_election.cc:304] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:17.653302 20476 raft_consensus.cc:2749] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 12:12:17.653846 20498 log.cc:927] Time spent T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.058s	user 0.000s	sys 0.003s
I20260709 12:12:17.654881 20476 consensus_queue.cc:1059] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:12:17.655488 20504 consensus_queue.cc:1059] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.011s
I20260709 12:12:17.656437 20504 raft_consensus.cc:3055] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:12:17.656767 20504 raft_consensus.cc:740] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
W20260709 12:12:17.658198 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 95262.4us
I20260709 12:12:17.658313 20503 raft_consensus.cc:2749] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:17.664181 14188 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56652 (request call id 1409) took 1070 ms. Trace:
I20260709 12:12:17.664536 14188 rpcz_store.cc:276] 0709 12:12:16.596546 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:16.598296 (+  1750us) service_pool.cc:224] Handling call
0709 12:12:16.598696 (+   400us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:17.561979 (+963283us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:17.663942 (+101963us) spinlock_profiling.cc:243] Waited 962 ms on lock 0x7b540035af54. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:12:17.664109 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2213574528}
I20260709 12:12:17.665583 20227 raft_consensus.cc:2749] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:12:17.666983 20430 raft_consensus.cc:493] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:17.667469 20430 raft_consensus.cc:515] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:17.668974 14262 raft_consensus.cc:1275] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:12:17.669595 20470 raft_consensus.cc:3055] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:17.669847 20390 raft_consensus.cc:493] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:17.670254 20470 raft_consensus.cc:740] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:17.671176 20470 consensus_queue.cc:260] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:17.672158 20470 raft_consensus.cc:3060] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:17.641914 20296 raft_consensus.cc:515] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:17.670315 20390 raft_consensus.cc:515] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:12:17.677347 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 87688.4us
I20260709 12:12:17.643846 20152 raft_consensus.cc:2804] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:17.675868 14877 leader_election.cc:304] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:17.660415 14155 leader_election.cc:304] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:17.675107 20309 leader_election.cc:290] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:17.684257 14155 leader_election.cc:304] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:17.648487 19912 consensus_queue.cc:1048] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.046s
I20260709 12:12:17.689641 20458 raft_consensus.cc:2804] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:17.693565 14905 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d"
dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
mode: GRACEFUL
new_leader_uuid: "17aab1bbf5014936aa18cc21818b26ec"
 from {username='slave'} at 127.0.0.1:38628
I20260709 12:12:17.694169 20458 raft_consensus.cc:493] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:17.694357 14905 raft_consensus.cc:606] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Received request to transfer leadership to TS 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:12:17.694729 14905 raft_consensus.cc:614] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:17.697342 14188 raft_consensus.cc:1275] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:12:17.697917 20152 raft_consensus.cc:697] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 17 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:12:17.657651 20504 consensus_queue.cc:260] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:17.698455 14339 raft_consensus.cc:1275] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:12:17.698913 20504 raft_consensus.cc:3060] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:17.699592 20458 raft_consensus.cc:3060] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:17.700030 20464 raft_consensus.cc:2804] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:17.700431 20464 raft_consensus.cc:493] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:17.700755 20464 raft_consensus.cc:3060] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:17.675747 20296 leader_election.cc:290] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:17.703202 20390 leader_election.cc:290] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:17.706585 20463 raft_consensus.cc:3055] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:17.706977 20463 raft_consensus.cc:740] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:17.692698 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:17.708196 14258 raft_consensus.cc:2393] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db in current term 15: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:12:17.698101 14331 raft_consensus.cc:3055] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:17.691581 14155 leader_election.cc:304] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:17.669507 20430 leader_election.cc:290] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:17.709144 14331 raft_consensus.cc:740] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:17.712218 14155 leader_election.cc:304] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:17.715601 14265 raft_consensus.cc:1240] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 12:12:17.717231 14260 raft_consensus.cc:1240] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:17.723476 14155 leader_election.cc:304] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:17.725040 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:17.727358 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:17.728192 14262 raft_consensus.cc:1240] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 16. Current term is 17. Ops: [14.12-16.13]
I20260709 12:12:17.724289 20261 consensus_queue.cc:1048] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.005s
I20260709 12:12:17.729146 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:17.730010 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:17.730314 20261 consensus_queue.cc:1048] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:12:17.731256 14331 consensus_queue.cc:260] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:17.732235 14331 raft_consensus.cc:3060] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:17.730528 20218 raft_consensus.cc:2804] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:17.733547 14264 raft_consensus.cc:1240] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:17.710280 20474 raft_consensus.cc:2749] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:12:17.725660 14257 raft_consensus.cc:2468] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 16.
I20260709 12:12:17.739444 14338 raft_consensus.cc:2393] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 16: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:12:17.708400 20143 leader_election.cc:290] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:17.715171 20296 raft_consensus.cc:493] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:17.746907 14337 raft_consensus.cc:1275] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:12:17.741508 14155 leader_election.cc:304] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:17.719899 20469 raft_consensus.cc:2804] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:17.761547 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:17.762333 14258 raft_consensus.cc:2368] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 16. Current term is 17.
I20260709 12:12:17.762234 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:17.763685 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:17.717638 20227 raft_consensus.cc:2804] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:17.739239 20218 raft_consensus.cc:493] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:17.764350 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:17.772893 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:17.784771 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:17.785379 14182 raft_consensus.cc:3060] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:17.784773 14257 raft_consensus.cc:2468] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 18.
W20260709 12:12:17.796116 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 81159.7us
I20260709 12:12:17.719014 20502 consensus_queue.cc:1048] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 12:12:17.798192 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:17.805302 20511 raft_consensus.cc:2749] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:17.806984 14258 raft_consensus.cc:1240] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:17.796241 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:17.774375 20218 raft_consensus.cc:3060] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:17.768333 20227 raft_consensus.cc:493] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:17.810354 14257 raft_consensus.cc:1240] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:17.807555 14185 raft_consensus.cc:3060] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:17.810870 14230 leader_election.cc:304] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:17.812175 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:17.812836 14261 raft_consensus.cc:3060] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Advancing to term 18
I20260709 12:12:17.759522 20296 raft_consensus.cc:515] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:17.762997 20390 consensus_queue.cc:1059] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.040s
I20260709 12:12:17.749919 20215 raft_consensus.cc:515] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:17.761013 20469 raft_consensus.cc:493] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:17.822685 14182 raft_consensus.cc:2468] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 17.
I20260709 12:12:17.842576 14904 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8"
dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
mode: GRACEFUL
new_leader_uuid: "885067a0d31741bfb5c9935788e315bf"
 from {username='slave'} at 127.0.0.1:38628
I20260709 12:12:17.843297 14904 raft_consensus.cc:606] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 17 LEADER]: Received request to transfer leadership to TS 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:17.748772 20463 consensus_queue.cc:260] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:17.816905 20227 raft_consensus.cc:3060] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:17.844916 20469 raft_consensus.cc:3060] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:17.825673 20376 raft_consensus.cc:493] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:17.848531 14305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:17.851069 14305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:17.851212 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 109789us
I20260709 12:12:17.852495 14259 raft_consensus.cc:1240] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:17.853404 20376 raft_consensus.cc:515] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:17.855296 20514 raft_consensus.cc:493] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:17.855799 20514 raft_consensus.cc:515] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:17.856933 20376 leader_election.cc:290] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:17.807986 20152 consensus_queue.cc:237] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:17.858161 14262 raft_consensus.cc:1240] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:17.860280 14262 raft_consensus.cc:1240] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 20 LEADER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:17.854970 20477 raft_consensus.cc:3055] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 17 LEADER]: Stepping down as leader of term 17
W20260709 12:12:17.860888 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 57644.3us
I20260709 12:12:17.848184 20459 raft_consensus.cc:2749] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:12:17.864037 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:17.863081 14155 leader_election.cc:400] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 pre-election: Vote denied by peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673) with higher term. Message: Invalid argument: T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 19. Current term is 20.
W20260709 12:12:17.859954 20490 log.cc:927] Time spent T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.367s	user 0.005s	sys 0.000s
I20260709 12:12:17.866050 14182 raft_consensus.cc:2468] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 20.
W20260709 12:12:17.864138 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 73811.8us
I20260709 12:12:17.871071 14155 leader_election.cc:304] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:17.886452 20044 raft_consensus.cc:493] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:17.887353 14911 raft_consensus.cc:1240] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:17.862403 20477 raft_consensus.cc:740] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:12:17.890836 20215 leader_election.cc:290] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:17.892239 20296 leader_election.cc:290] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:17.899025 20463 raft_consensus.cc:3060] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:17.911079 20514 leader_election.cc:290] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:17.852283 20493 consensus_queue.cc:1059] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.047s
I20260709 12:12:17.957779 20459 consensus_queue.cc:1048] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:12:17.959193 14230 leader_election.cc:304] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:17.971839 14181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56046 (request call id 2737) took 1062 ms. Trace:
I20260709 12:12:17.973968 20464 raft_consensus.cc:515] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:17.945495 14261 raft_consensus.cc:2468] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 18.
I20260709 12:12:17.954345 14184 raft_consensus.cc:2468] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 17.
I20260709 12:12:17.993485 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:18.035518 14190 raft_consensus.cc:3060] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:17.991998 14304 leader_election.cc:304] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:12:18.002696 14331 raft_consensus.cc:1275] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 13. (term mismatch)
I20260709 12:12:18.015363 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:12:18.011924 14302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:18.020005 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 148924us
I20260709 12:12:18.062552 14155 leader_election.cc:304] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
W20260709 12:12:18.024516 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 306260us
W20260709 12:12:18.005892 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 232359us
I20260709 12:12:18.029520 14185 raft_consensus.cc:2468] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 19.
I20260709 12:12:18.030529 14229 leader_election.cc:304] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:18.006207 20486 consensus_queue.cc:1059] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.026s
I20260709 12:12:18.045078 20493 raft_consensus.cc:3055] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 16 LEADER]: Stepping down as leader of term 16
W20260709 12:12:18.046144 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 54354.7us
I20260709 12:12:18.034137 14181 rpcz_store.cc:276] 0709 12:12:16.908927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:16.911197 (+  2270us) service_pool.cc:224] Handling call
0709 12:12:16.917116 (+  5919us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:16.917563 (+   447us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:16.917600 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:16.947654 (+ 30054us) log.cc:844] Serialized 26 byte log entry
0709 12:12:17.117570 (+169916us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:12:17.117602 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:17.117649 (+    47us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:17.705337 (+587688us) spinlock_profiling.cc:243] Waited 1.57 ms on lock 0x7b4400022b4c. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2123f74c85 00007f2123f756a2 00007f2126ce71db 00007f2126ce2aaf 00007f2126cd686e 00007f2126cd5bb6 00007f2126cd57d8 00007f2126cdf221 00007f2126cdf1d9 00007f2126cdf169
0709 12:12:17.971045 (+265708us) raft_consensus.cc:1685] finished
0709 12:12:17.971091 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:17.971624 (+   533us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":19052,"raft.run_cpu_time_us":183,"raft.run_wall_time_us":11918,"spinlock_wait_cycles":3605248,"thread_start_us":125171,"threads_started":1,"wal-append.queue_time_us":280843}
I20260709 12:12:18.028316 20044 raft_consensus.cc:515] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:18.058068 20514 raft_consensus.cc:2804] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:18.064215 14331 pending_rounds.cc:85] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c: Aborting all ops after (but not including) 12
I20260709 12:12:18.082141 14303 leader_election.cc:304] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
W20260709 12:12:18.071518 14302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:18.070827 14155 leader_election.cc:304] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:18.082775 14331 pending_rounds.cc:107] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c: Aborting uncommitted NO_OP operation due to leader change: 16.13
I20260709 12:12:18.084226 14331 raft_consensus.cc:2889] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:12:18.082563 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 52142.6us
I20260709 12:12:18.061728 20215 raft_consensus.cc:2804] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:18.093180 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:18.093509 20215 raft_consensus.cc:493] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:18.094202 14337 raft_consensus.cc:2468] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 16.
I20260709 12:12:18.095551 20474 raft_consensus.cc:493] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:18.094113 20215 raft_consensus.cc:3060] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:18.096114 20474 raft_consensus.cc:515] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:18.098039 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:18.098759 14339 raft_consensus.cc:2468] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 19.
I20260709 12:12:18.100034 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:18.100780 14338 raft_consensus.cc:2468] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 15.
W20260709 12:12:18.093081 14305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:18.102381 14258 raft_consensus.cc:1275] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:12:18.104673 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:18.105351 14256 raft_consensus.cc:2468] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 14.
I20260709 12:12:18.108445 20469 raft_consensus.cc:515] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:18.086800 20143 raft_consensus.cc:2749] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:12:18.092854 20512 raft_consensus.cc:2749] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:12:18.162297 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 203234us
I20260709 12:12:18.160399 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:18.163847 14876 leader_election.cc:304] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:18.062958 20477 consensus_queue.cc:260] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:18.160463 14155 leader_election.cc:304] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:18.159833 14877 leader_election.cc:304] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:18.085112 20514 raft_consensus.cc:493] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:12:18.194846 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 82079us
W20260709 12:12:18.194729 14154 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 74815.1us
I20260709 12:12:18.064807 20493 raft_consensus.cc:740] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:18.081459 20516 raft_consensus.cc:3060] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:18.166826 20152 raft_consensus.cc:493] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:18.199906 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 117853us
I20260709 12:12:18.200882 14230 leader_election.cc:304] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
W20260709 12:12:18.180205 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 94185.3us
W20260709 12:12:18.185377 14229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:18.183034 20476 consensus_queue.cc:1059] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:12:18.162338 20456 raft_consensus.cc:2749] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:12:18.205199 14229 leader_election.cc:304] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:18.192842 14265 raft_consensus.cc:2468] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 15.
W20260709 12:12:18.197500 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 84985.4us
I20260709 12:12:18.112525 20465 consensus_queue.cc:1048] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.109s
I20260709 12:12:18.159704 20406 consensus_queue.cc:1059] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 12:12:18.198532 20263 raft_consensus.cc:3055] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:18.196712 20390 raft_consensus.cc:2749] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:12:18.195247 20369 raft_consensus.cc:3055] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:18.196766 20514 raft_consensus.cc:3060] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:18.200747 20521 raft_consensus.cc:2804] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:18.200040 20383 raft_consensus.cc:2804] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:18.239876 14905 raft_consensus.cc:1275] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:12:18.235749 20477 raft_consensus.cc:3060] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:18.198968 20035 consensus_queue.cc:1059] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.049s
I20260709 12:12:18.240690 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:18.225016 20511 raft_consensus.cc:2749] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:18.247468 20263 raft_consensus.cc:740] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:12:18.248338 20369 raft_consensus.cc:740] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:12:18.243502 20380 raft_consensus.cc:2804] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Leader election won for term 17
W20260709 12:12:18.258157 20458 consensus_meta.cc:287] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.555s	user 0.011s	sys 0.005s
I20260709 12:12:18.233177 20152 raft_consensus.cc:515] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:18.256784 20521 raft_consensus.cc:493] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:18.271037 14186 raft_consensus.cc:2468] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 14.
W20260709 12:12:18.267884 14305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:18.255852 20309 raft_consensus.cc:2749] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:12:18.256801 20383 raft_consensus.cc:493] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:12:18.268318 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 107949us
I20260709 12:12:18.255610 20520 raft_consensus.cc:493] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:18.255766 20474 leader_election.cc:290] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:12:18.284796 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 92148.7us
I20260709 12:12:18.241608 20480 consensus_queue.cc:1048] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 12:12:18.251120 20048 consensus_queue.cc:1059] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 12:12:18.291994 14181 raft_consensus.cc:1240] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 17. Current term is 18. Ops: []
W20260709 12:12:18.295559 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 90451.7us
I20260709 12:12:18.285257 20035 consensus_queue.cc:1048] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.011s
I20260709 12:12:18.289593 20383 raft_consensus.cc:3060] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:18.286166 20521 raft_consensus.cc:3060] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:18.281216 20456 raft_consensus.cc:3055] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:18.300334 14229 leader_election.cc:304] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:18.296679 14155 leader_election.cc:304] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:18.280423 20380 raft_consensus.cc:697] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 17 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:18.285719 20464 leader_election.cc:290] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 20 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:18.298323 14304 leader_election.cc:304] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
W20260709 12:12:18.309696 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 74228.2us
I20260709 12:12:18.306900 14229 leader_election.cc:304] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:18.306290 14155 leader_election.cc:304] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:18.279281 20458 raft_consensus.cc:515] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:18.294281 20520 raft_consensus.cc:515] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:18.327170 14155 leader_election.cc:304] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:18.310953 20296 raft_consensus.cc:2804] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:18.305938 20456 raft_consensus.cc:740] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:12:18.313977 14877 leader_election.cc:304] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:12:18.318214 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:18.318849 14262 raft_consensus.cc:1240] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 17 LEADER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:18.280587 20263 consensus_queue.cc:260] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:18.335549 14185 raft_consensus.cc:1275] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:12:18.338605 20520 leader_election.cc:290] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:18.339322 20520 consensus_queue.cc:1059] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:12:18.340065 20520 consensus_queue.cc:1243] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer 17aab1bbf5014936aa18cc21818b26ec log is divergent from this leader: its last log entry 16.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:12:18.341835 20502 raft_consensus.cc:2804] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:18.342607 20152 leader_election.cc:290] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:18.335160 20271 raft_consensus.cc:2804] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:18.343255 20271 raft_consensus.cc:493] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:18.343695 20271 raft_consensus.cc:3060] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:18.344059 20456 consensus_queue.cc:260] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:18.345296 20456 raft_consensus.cc:3060] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:18.342386 20380 consensus_queue.cc:237] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:18.343353 14230 leader_election.cc:304] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:18.314108 20527 raft_consensus.cc:2804] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:18.350001 20527 raft_consensus.cc:493] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:18.350517 20527 raft_consensus.cc:3060] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:18.350879 14230 leader_election.cc:304] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:18.352365 14230 leader_election.cc:304] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
W20260709 12:12:18.359668 14305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:18.334875 14877 leader_election.cc:304] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:12:18.367482 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:18.323928 20530 raft_consensus.cc:2804] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:18.385637 20529 consensus_queue.cc:1048] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:12:18.376359 14876 leader_election.cc:304] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:18.326272 20464 raft_consensus.cc:2749] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:18.342449 20502 raft_consensus.cc:697] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 18 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:18.391070 20531 raft_consensus.cc:2804] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:18.391590 20531 raft_consensus.cc:493] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:18.391954 20531 raft_consensus.cc:3060] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:18.373052 20309 raft_consensus.cc:2749] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:18.355274 20520 raft_consensus.cc:3055] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:18.394095 20458 leader_election.cc:290] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 16 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:18.394356 20520 raft_consensus.cc:740] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:18.395175 20502 consensus_queue.cc:237] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:18.383351 20512 raft_consensus.cc:2749] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:18.380486 20487 raft_consensus.cc:2804] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:18.399387 20487 raft_consensus.cc:493] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:18.399799 20487 raft_consensus.cc:3060] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:12:18.404922 14305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:18.391229 20523 log.cc:927] Time spent T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.192s	user 0.001s	sys 0.000s
I20260709 12:12:18.395377 20520 consensus_queue.cc:260] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:18.380934 14331 raft_consensus.cc:2468] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 13.
I20260709 12:12:18.382468 14190 raft_consensus.cc:2468] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 18.
I20260709 12:12:18.333791 20469 leader_election.cc:290] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 21 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:12:18.413116 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 86057.3us
I20260709 12:12:18.426185 14155 leader_election.cc:400] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 16 election: Vote denied by peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673) with higher term. Message: Invalid argument: T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 16. Current term is 17.
I20260709 12:12:18.426689 14155 leader_election.cc:403] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
W20260709 12:12:18.427004 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 108199us
I20260709 12:12:18.429363 14190 raft_consensus.cc:1240] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 20. Current term is 21. Ops: []
I20260709 12:12:18.456967 14155 leader_election.cc:304] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:18.424412 20309 raft_consensus.cc:2749] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:18.417625 20512 raft_consensus.cc:493] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
W20260709 12:12:18.458089 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 230559us
W20260709 12:12:18.466058 14304 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:18.480213 14155 leader_election.cc:304] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
W20260709 12:12:18.482764 14305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:18.449272 20469 raft_consensus.cc:2749] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673) with higher term. Message: Invalid argument: T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 16. Current term is 17.
I20260709 12:12:18.488830 20512 raft_consensus.cc:515] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:18.484715 14303 leader_election.cc:304] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:18.451552 20263 raft_consensus.cc:3060] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:18.485481 14155 leader_election.cc:304] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:18.486259 20296 raft_consensus.cc:697] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 17 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:18.460402 20520 raft_consensus.cc:3060] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:18.503614 14155 leader_election.cc:304] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:18.506503 14259 raft_consensus.cc:1240] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 12:12:18.511035 14256 raft_consensus.cc:1275] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:12:18.512264 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 20 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:18.485747 20458 raft_consensus.cc:2749] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:18.488127 20464 raft_consensus.cc:2749] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:12:18.520253 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 20 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:18.520816 14331 raft_consensus.cc:3060] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:18.512233 20511 raft_consensus.cc:2749] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 12:12:18.512351 20227 consensus_meta.cc:287] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.650s	user 0.010s	sys 0.003s
I20260709 12:12:18.526279 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:18.527617 14337 raft_consensus.cc:3060] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:18.527521 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:18.531143 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:18.531236 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:18.532651 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:18.514178 20152 raft_consensus.cc:2804] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:18.529465 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
W20260709 12:12:18.534631 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 182376us
I20260709 12:12:18.538375 14263 raft_consensus.cc:2393] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 16: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:12:18.521063 20530 raft_consensus.cc:697] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 19 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:18.539450 20511 raft_consensus.cc:493] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:18.516521 20215 raft_consensus.cc:515] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:18.558363 20511 raft_consensus.cc:515] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:18.559983 20215 leader_election.cc:290] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:18.560608 20511 leader_election.cc:290] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:18.531785 20227 raft_consensus.cc:515] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:18.562047 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:18.562799 14190 raft_consensus.cc:2368] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 19. Current term is 20.
I20260709 12:12:18.563536 20227 leader_election.cc:290] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:18.568749 14337 raft_consensus.cc:2468] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 21.
I20260709 12:12:18.554267 20474 raft_consensus.cc:493] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:18.574298 20474 raft_consensus.cc:515] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:18.576570 20474 leader_election.cc:290] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:18.556866 20271 raft_consensus.cc:515] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:18.580622 14261 raft_consensus.cc:3060] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:18.546212 20517 raft_consensus.cc:3055] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 18 LEADER]: Stepping down as leader of term 18
W20260709 12:12:18.546685 20534 log.cc:927] Time spent T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 12:12:18.549930 20543 consensus_queue.cc:1048] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 12:12:18.600003 20492 raft_consensus.cc:3055] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:18.600427 20492 raft_consensus.cc:740] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:18.600620 20527 raft_consensus.cc:515] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:18.550674 20296 consensus_queue.cc:237] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:18.602990 20527 leader_election.cc:290] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:18.551429 20481 raft_consensus.cc:3060] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:18.553519 20516 raft_consensus.cc:2749] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:18.534446 20469 raft_consensus.cc:493] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
W20260709 12:12:18.537004 20218 consensus_meta.cc:287] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.695s	user 0.010s	sys 0.004s
I20260709 12:12:18.537807 20152 raft_consensus.cc:493] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:18.540683 20535 raft_consensus.cc:493] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:18.578678 20383 raft_consensus.cc:515] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:18.583748 20517 raft_consensus.cc:740] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:18.607467 14331 raft_consensus.cc:2468] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 20.
I20260709 12:12:18.605029 14230 leader_election.cc:304] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
W20260709 12:12:18.624451 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 130373us
I20260709 12:12:18.649055 14261 raft_consensus.cc:2468] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 20.
I20260709 12:12:18.627225 20152 raft_consensus.cc:3060] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:18.651796 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:18.540242 20476 consensus_queue.cc:1059] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.094s
I20260709 12:12:18.583945 20463 raft_consensus.cc:2749] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:18.650529 20239 raft_consensus.cc:3060] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:18.626969 20218 raft_consensus.cc:515] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:18.599663 20531 raft_consensus.cc:515] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:18.631697 20469 raft_consensus.cc:515] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:12:18.685012 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 200376us
I20260709 12:12:18.673369 20271 leader_election.cc:290] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 16 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:18.634029 20535 raft_consensus.cc:515] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:18.680004 20476 consensus_queue.cc:1243] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer 17aab1bbf5014936aa18cc21818b26ec log is divergent from this leader: its last log entry 17.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
W20260709 12:12:18.701226 14229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:18.650326 20406 consensus_queue.cc:1059] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 12:12:18.675796 20530 consensus_queue.cc:237] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:18.659937 20492 consensus_queue.cc:260] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:18.690280 20548 raft_consensus.cc:493] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:18.795428 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 190479us
I20260709 12:12:18.972662 14186 raft_consensus.cc:1240] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:18.634050 20521 raft_consensus.cc:515] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:12:18.848116 14305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:18.919435 20512 leader_election.cc:290] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:18.934067 20517 consensus_queue.cc:260] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:18.943794 14303 leader_election.cc:304] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:18.975996 20550 raft_consensus.cc:493] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:18.978256 20486 raft_consensus.cc:3055] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 16 LEADER]: Stepping down as leader of term 16
W20260709 12:12:18.976449 14305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:18.978643 20550 raft_consensus.cc:515] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:12:18.979696 14305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:18.979934 14303 leader_election.cc:304] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
W20260709 12:12:18.944461 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 109605us
I20260709 12:12:18.805878 20527 raft_consensus.cc:493] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:18.980816 20541 raft_consensus.cc:2749] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 12:12:18.873502 20477 consensus_meta.cc:287] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db: Time spent flushing consensus metadata: real 0.608s	user 0.009s	sys 0.015s
I20260709 12:12:18.981110 20550 leader_election.cc:290] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:18.981173 20527 raft_consensus.cc:515] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:18.983946 20527 leader_election.cc:290] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:18.984102 20271 raft_consensus.cc:493] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:18.984676 20271 raft_consensus.cc:515] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:18.985773 20548 raft_consensus.cc:515] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:18.986891 20271 leader_election.cc:290] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:18.988122 20548 leader_election.cc:290] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:12:18.968573 14304 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:18.691124 20546 raft_consensus.cc:493] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:18.989748 20546 raft_consensus.cc:515] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:18.992019 20546 leader_election.cc:290] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:18.988235 20517 raft_consensus.cc:3060] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:18.974875 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:18.974749 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:19.041203 14185 raft_consensus.cc:2410] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db for term 19 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 12.
I20260709 12:12:18.975551 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:18.978715 20486 raft_consensus.cc:740] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:19.005216 20533 raft_consensus.cc:493] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:19.005460 14230 leader_election.cc:304] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:19.005748 20535 leader_election.cc:290] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:19.006059 20485 raft_consensus.cc:3055] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:18.981884 20469 leader_election.cc:290] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:19.007499 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:19.065722 20477 raft_consensus.cc:493] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:19.013648 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:19.066344 20477 raft_consensus.cc:515] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:19.066423 14331 raft_consensus.cc:2410] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db for term 19 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 12:12:19.066946 14338 raft_consensus.cc:2468] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 17.
I20260709 12:12:19.066357 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:19.069628 14335 raft_consensus.cc:2393] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db in current term 19: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:12:19.069929 14877 leader_election.cc:304] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
W20260709 12:12:19.070638 20549 log.cc:927] Time spent T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 12:12:18.993889 20456 consensus_queue.cc:1048] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:18.968984 20476 raft_consensus.cc:493] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:19.072743 20548 raft_consensus.cc:2804] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:19.073453 20548 raft_consensus.cc:493] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:19.073974 20548 raft_consensus.cc:3060] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:19.010190 20550 raft_consensus.cc:2804] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:12:19.042164 14336 raft_consensus.cc:2468] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 16.
I20260709 12:12:19.041502 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:19.040068 14155 leader_election.cc:304] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:19.078069 14181 raft_consensus.cc:2468] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 17.
I20260709 12:12:19.044502 14333 raft_consensus.cc:3060] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:19.046912 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:19.050099 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:12:19.058399 20524 log.cc:927] Time spent T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.788s	user 0.002s	sys 0.004s
I20260709 12:12:19.058794 20486 consensus_queue.cc:260] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:19.080686 20516 raft_consensus.cc:2804] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:12:19.078460 14155 leader_election.cc:304] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:19.050655 20533 raft_consensus.cc:515] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:19.091125 14229 leader_election.cc:304] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:19.093129 14155 leader_election.cc:304] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:19.073063 20476 raft_consensus.cc:515] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:19.062546 20044 leader_election.cc:290] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:19.063804 20383 leader_election.cc:290] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 20 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:19.064174 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:12:19.064651 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 59388.6us
I20260709 12:12:19.064929 20045 raft_consensus.cc:2804] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:19.049952 20485 raft_consensus.cc:740] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:19.114039 14181 raft_consensus.cc:1275] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:12:19.058672 20218 leader_election.cc:290] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 15 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:19.065443 20521 leader_election.cc:290] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 21 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:19.065769 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:19.080478 14264 raft_consensus.cc:2468] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 17.
I20260709 12:12:19.081492 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:19.079559 14186 raft_consensus.cc:2468] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 18.
I20260709 12:12:19.086997 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:19.130422 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:19.095059 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:19.095628 20469 consensus_queue.cc:1048] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:12:19.091383 20458 raft_consensus.cc:493] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:19.138913 20458 raft_consensus.cc:515] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:19.141008 14230 leader_election.cc:304] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:19.097421 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:19.095002 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:19.141983 20542 consensus_queue.cc:1048] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:12:19.142745 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:19.143217 14259 raft_consensus.cc:1275] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:12:19.091472 20456 raft_consensus.cc:2804] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:19.097461 20516 raft_consensus.cc:697] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 21 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:12:19.147055 20516 consensus_queue.cc:237] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 20.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:19.099112 20143 raft_consensus.cc:2804] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:19.112866 20035 raft_consensus.cc:2749] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:19.100741 20546 consensus_queue.cc:1059] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 20.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:12:19.068657 20477 leader_election.cc:290] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:19.098037 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:19.113770 20464 raft_consensus.cc:493] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:19.151757 20369 consensus_queue.cc:260] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:19.153697 20476 leader_election.cc:290] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:19.141553 20458 leader_election.cc:290] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:19.153555 20296 raft_consensus.cc:2749] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:19.155880 20485 consensus_queue.cc:260] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:19.157325 20485 raft_consensus.cc:3060] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:19.131341 20486 raft_consensus.cc:3060] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:19.166098 20469 raft_consensus.cc:493] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:19.166877 20469 raft_consensus.cc:515] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:12:19.060460 20487 consensus_meta.cc:287] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db: Time spent flushing consensus metadata: real 0.660s	user 0.004s	sys 0.012s
I20260709 12:12:19.102367 14229 leader_election.cc:400] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 election: Vote denied by peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187) with higher term. Message: Invalid argument: T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 19. Current term is 20.
I20260709 12:12:19.173607 14229 leader_election.cc:403] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 12:12:19.096809 20481 raft_consensus.cc:2749] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:19.098634 14877 leader_election.cc:304] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
W20260709 12:12:19.176020 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 77479.6us
I20260709 12:12:19.081583 20550 raft_consensus.cc:493] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:19.133630 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:19.110360 20045 raft_consensus.cc:493] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:19.134714 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:19.135947 14262 raft_consensus.cc:2368] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 19. Current term is 20.
I20260709 12:12:19.131780 14904 raft_consensus.cc:2468] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 18.
I20260709 12:12:19.150876 14260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53050 (request call id 1200) took 1059 ms. Trace:
W20260709 12:12:19.175384 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 73208.8us
I20260709 12:12:19.183130 14260 rpcz_store.cc:276] 0709 12:12:18.090934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:18.091153 (+   219us) service_pool.cc:224] Handling call
0709 12:12:18.098125 (+  6972us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:12:18.098558 (+   433us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:18.098587 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:12:18.099259 (+   672us) log.cc:844] Serialized 52 byte log entry
0709 12:12:18.165900 (+ 66641us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:18.454996 (+289096us) log.cc:844] Serialized 14 byte log entry
0709 12:12:18.455230 (+   234us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:18.455311 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:18.821491 (+366180us) spinlock_profiling.cc:243] Waited 7.89 ms on lock 0x7b4400022b4c. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2123f74c85 00007f2123f756a2 00007f2126ce71db 00007f2126ce2aaf 00007f2126cd686e 00007f2126cd5bb6 00007f2126cd57d8 00007f2126cdf221 00007f2126cdf1d9 00007f2126cdf169
0709 12:12:19.150503 (+329012us) raft_consensus.cc:1685] finished
0709 12:12:19.150616 (+   113us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:19.150796 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43942,"prepare.queue_time_us":83131,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":47,"raft.queue_time_us":84936,"raft.run_cpu_time_us":240,"raft.run_wall_time_us":5699,"spinlock_wait_cycles":18142592,"thread_start_us":290030,"threads_started":2,"wal-append.queue_time_us":135091}
I20260709 12:12:19.154716 20547 consensus_queue.cc:1059] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.031s
I20260709 12:12:19.155123 20533 leader_election.cc:290] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:19.186816 14155 leader_election.cc:304] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
W20260709 12:12:19.186818 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 45899.7us
I20260709 12:12:19.188393 20458 consensus_queue.cc:1048] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:12:19.188752 14230 leader_election.cc:304] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:19.189975 20458 raft_consensus.cc:2749] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:19.191206 20481 raft_consensus.cc:2749] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:19.191629 14230 leader_election.cc:304] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:19.191916 20045 raft_consensus.cc:3060] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:12:19.192224 20514 consensus_meta.cc:287] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.921s	user 0.005s	sys 0.017s
I20260709 12:12:19.179014 20487 raft_consensus.cc:515] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:19.192713 20514 raft_consensus.cc:515] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:19.193846 14334 raft_consensus.cc:2368] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 16. Current term is 17.
I20260709 12:12:19.194191 20521 raft_consensus.cc:2804] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:19.194542 20487 leader_election.cc:290] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 17 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:19.194691 20521 raft_consensus.cc:493] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:19.195092 20521 raft_consensus.cc:3060] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:19.195451 20481 raft_consensus.cc:2764] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 12:12:19.197602 20517 raft_consensus.cc:493] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:19.174213 20456 raft_consensus.cc:697] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 20 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:12:19.198163 20517 raft_consensus.cc:515] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:19.199312 20456 consensus_queue.cc:237] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 18.8, Last appended by leader: 8, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:19.200330 20517 leader_election.cc:290] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:19.198179 14154 leader_election.cc:304] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:19.201634 20035 raft_consensus.cc:493] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:19.202044 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:19.202152 20035 raft_consensus.cc:515] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:19.204340 20035 leader_election.cc:290] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:19.204916 20035 raft_consensus.cc:2804] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:19.205181 14334 raft_consensus.cc:1240] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:19.205271 20035 raft_consensus.cc:493] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:19.182236 20550 raft_consensus.cc:3060] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:19.207659 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:19.151787 20464 raft_consensus.cc:515] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:19.132488 20239 raft_consensus.cc:2749] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:19.213536 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:19.214519 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:19.215355 14331 raft_consensus.cc:2393] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 22: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
W20260709 12:12:19.174851 20152 consensus_meta.cc:287] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.503s	user 0.006s	sys 0.005s
I20260709 12:12:19.214464 14335 raft_consensus.cc:2368] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 20. Current term is 21.
I20260709 12:12:19.207549 20531 leader_election.cc:290] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 15 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:19.222332 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:19.235685 14335 raft_consensus.cc:1275] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:12:19.236016 14336 raft_consensus.cc:3060] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:12:19.236956 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:19.237944 14335 raft_consensus.cc:2410] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for term 18 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 12:12:19.223011 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:19.223809 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:12:19.228358 14230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:19.239014 14331 raft_consensus.cc:3060] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Advancing to term 21
I20260709 12:12:19.239461 14339 raft_consensus.cc:2410] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for term 19 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 12:12:19.239765 14230 leader_election.cc:304] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:19.228833 14333 raft_consensus.cc:2468] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 16.
I20260709 12:12:19.246068 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:19.247192 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:19.248901 14256 raft_consensus.cc:3060] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:19.249667 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:19.252554 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:19.220489 20035 raft_consensus.cc:3060] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:19.254776 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:19.256973 14230 leader_election.cc:400] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 election: Vote denied by peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957) with higher term. Message: Invalid argument: T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 20. Current term is 21.
I20260709 12:12:19.255952 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:19.257457 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:19.258275 14339 raft_consensus.cc:2410] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for term 19 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 12:12:19.258244 14265 raft_consensus.cc:2468] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 17.
I20260709 12:12:19.263429 20545 raft_consensus.cc:2749] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187) with higher term. Message: Invalid argument: T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 19. Current term is 20.
I20260709 12:12:19.267107 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:19.267828 14339 raft_consensus.cc:2468] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 17.
I20260709 12:12:19.270351 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:19.269490 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:19.276890 14331 raft_consensus.cc:2468] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 21.
I20260709 12:12:19.307029 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:19.308023 14331 raft_consensus.cc:2410] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for term 18 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
W20260709 12:12:19.266103 20554 log.cc:927] Time spent T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.305s	user 0.002s	sys 0.000s
I20260709 12:12:19.264547 20481 raft_consensus.cc:3060] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:19.288532 14256 raft_consensus.cc:2468] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 16.
I20260709 12:12:19.265913 20545 consensus_queue.cc:1048] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
W20260709 12:12:19.297868 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 317987us
I20260709 12:12:19.303431 14334 raft_consensus.cc:2468] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 17.
I20260709 12:12:19.278771 14339 raft_consensus.cc:2368] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 19. Current term is 20.
W20260709 12:12:19.334167 14302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:19.341432 14303 leader_election.cc:304] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:19.343281 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:19.343959 14339 raft_consensus.cc:3060] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:19.244724 20152 raft_consensus.cc:515] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:19.335443 14877 leader_election.cc:304] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:12:19.346022 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:19.346778 14331 raft_consensus.cc:3060] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:19.347019 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:19.347734 14332 raft_consensus.cc:2468] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 14.
I20260709 12:12:19.360852 14336 raft_consensus.cc:2468] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 15.
W20260709 12:12:19.377271 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 121604us
I20260709 12:12:19.379778 14186 raft_consensus.cc:1240] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:19.379797 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:19.362870 14877 leader_election.cc:304] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:12:19.422390 14907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
W20260709 12:12:19.423161 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 60389.3us
I20260709 12:12:19.425523 14230 leader_election.cc:304] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
W20260709 12:12:19.386934 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 299724us
I20260709 12:12:19.332353 20218 raft_consensus.cc:493] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:19.390702 14184 raft_consensus.cc:1240] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 15. Current term is 16. Ops: []
W20260709 12:12:19.420552 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 174188us
I20260709 12:12:19.393546 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:19.429032 14182 raft_consensus.cc:1217] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Deduplicated request from leader. Original: 11.6->[13.7-15.8]   Dedup: 15.8->[]
I20260709 12:12:19.395889 14331 raft_consensus.cc:2468] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 17.
I20260709 12:12:19.346460 20504 raft_consensus.cc:493] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:19.435746 14184 raft_consensus.cc:1240] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:19.397688 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:19.398497 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:19.349838 20469 leader_election.cc:290] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:19.399998 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:19.400195 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:19.406728 14185 raft_consensus.cc:1240] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:19.447841 14189 raft_consensus.cc:3060] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:19.362884 20517 raft_consensus.cc:2749] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:19.409072 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:19.448774 14911 raft_consensus.cc:3060] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:19.436928 14183 raft_consensus.cc:2468] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 16.
I20260709 12:12:19.386104 20374 raft_consensus.cc:2804] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Leader election won for term 16
W20260709 12:12:19.408947 20557 log.cc:927] Time spent T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
I20260709 12:12:19.430924 14188 raft_consensus.cc:1240] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:19.429567 14182 raft_consensus.cc:1240] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 15. Current term is 16. Ops: [13.7-15.8]
I20260709 12:12:19.423066 14907 raft_consensus.cc:2468] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 18.
I20260709 12:12:19.433553 14186 raft_consensus.cc:1240] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:19.429564 14877 leader_election.cc:304] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:12:19.434242 14904 raft_consensus.cc:2393] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 13: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
I20260709 12:12:19.434577 14155 leader_election.cc:400] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 election: Vote denied by peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673) with higher term. Message: Invalid argument: T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 19. Current term is 20.
W20260709 12:12:19.411053 14303 connection.cc:256] RPC call timeout handler was delayed by -1.0882523430000219s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1688s for a response
I20260709 12:12:19.438138 14331 raft_consensus.cc:1275] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 8. (term mismatch)
I20260709 12:12:19.438217 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:19.454268 14155 leader_election.cc:403] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 12:12:19.454670 14187 raft_consensus.cc:2393] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 17: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:12:19.441594 14184 raft_consensus.cc:1240] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260709 12:12:19.421089 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:19.454005 14331 pending_rounds.cc:85] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c: Aborting all ops after (but not including) 7
I20260709 12:12:19.457614 14334 raft_consensus.cc:1275] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 12:12:19.457841 14331 pending_rounds.cc:107] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c: Aborting uncommitted NO_OP operation due to leader change: 15.8
I20260709 12:12:19.458141 14331 raft_consensus.cc:2889] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:19.459283 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:19.459507 14331 raft_consensus.cc:1275] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:12:19.460307 14184 raft_consensus.cc:2410] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for term 20 because replica has last-logged OpId of term: 19 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 9.
I20260709 12:12:19.411008 20530 raft_consensus.cc:493] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:19.466049 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:19.466734 14258 raft_consensus.cc:3060] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:19.464083 14155 leader_election.cc:304] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:19.474684 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:19.434753 20531 raft_consensus.cc:2804] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:12:19.475478 14183 raft_consensus.cc:2468] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 18.
I20260709 12:12:19.438884 20514 leader_election.cc:290] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 17 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:19.479754 14303 leader_election.cc:304] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:19.483651 14331 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b"
dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
mode: GRACEFUL
new_leader_uuid: "885067a0d31741bfb5c9935788e315bf"
 from {username='slave'} at 127.0.0.1:50896
I20260709 12:12:19.484383 14331 raft_consensus.cc:606] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Received request to transfer leadership to TS 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:19.485051 14331 raft_consensus.cc:614] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:19.486480 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:19.490414 14189 raft_consensus.cc:2468] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 18.
I20260709 12:12:19.411324 20143 raft_consensus.cc:697] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 18 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:19.494863 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:12:19.492466 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 62950.1us
I20260709 12:12:19.507297 14189 raft_consensus.cc:1275] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:12:19.512605 14911 raft_consensus.cc:2468] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 19.
I20260709 12:12:19.474193 20469 raft_consensus.cc:3060] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:19.518605 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:19.479110 20456 raft_consensus.cc:2804] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:19.448868 20504 raft_consensus.cc:515] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:19.521631 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:19.452507 20218 raft_consensus.cc:515] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:19.527457 20531 raft_consensus.cc:697] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 21 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:12:19.484316 20567 raft_consensus.cc:493] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
W20260709 12:12:19.528517 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 103073us
W20260709 12:12:19.541940 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 103862us
I20260709 12:12:19.506333 20572 raft_consensus.cc:493] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:19.478377 20530 raft_consensus.cc:515] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } }
W20260709 12:12:19.547539 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 67894.3us
I20260709 12:12:19.555169 14876 leader_election.cc:304] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:19.517997 20517 raft_consensus.cc:2749] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:19.560843 14258 raft_consensus.cc:2468] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 17.
I20260709 12:12:19.550315 20504 leader_election.cc:290] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:19.551035 20531 consensus_queue.cc:237] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:19.553094 14264 raft_consensus.cc:3060] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:19.555629 14303 leader_election.cc:304] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
W20260709 12:12:19.549873 20560 log.cc:927] Time spent T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 12:12:19.548517 14230 leader_election.cc:304] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:19.566911 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:19.574476 14189 raft_consensus.cc:2410] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for term 21 because replica has last-logged OpId of term: 20 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 12.
I20260709 12:12:19.525411 20456 raft_consensus.cc:493] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:19.582515 14876 leader_election.cc:304] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:19.597704 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:12:19.598013 14304 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:19.601446 14303 leader_election.cc:304] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:19.579044 20456 raft_consensus.cc:3060] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:19.604853 20582 raft_consensus.cc:493] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:19.605629 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:19.597276 20578 raft_consensus.cc:2804] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:19.610212 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:19.588574 20517 raft_consensus.cc:2749] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:19.585281 20152 leader_election.cc:290] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:19.554701 20567 raft_consensus.cc:515] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:19.616340 14303 leader_election.cc:304] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
W20260709 12:12:19.629174 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 46748.7us
I20260709 12:12:19.577488 20504 consensus_queue.cc:1048] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.022s
I20260709 12:12:19.638763 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:19.639647 14189 raft_consensus.cc:3060] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:12:19.638126 20548 consensus_meta.cc:287] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db: Time spent flushing consensus metadata: real 0.564s	user 0.007s	sys 0.006s
I20260709 12:12:19.567862 20572 raft_consensus.cc:515] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:19.642846 14877 leader_election.cc:304] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:12:19.605509 20218 leader_election.cc:290] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:19.616068 20558 raft_consensus.cc:493] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:19.644356 14303 leader_election.cc:304] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:12:19.647306 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:19.650126 14188 raft_consensus.cc:3060] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:19.615345 20048 raft_consensus.cc:2804] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:19.614365 20578 raft_consensus.cc:697] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 15 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:12:19.652005 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:19.630678 20458 raft_consensus.cc:493] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:19.608589 20374 raft_consensus.cc:697] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 16 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:12:19.648516 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:19.653786 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:19.637379 20477 raft_consensus.cc:2749] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:19.656862 14187 raft_consensus.cc:2468] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 12.
I20260709 12:12:19.652446 14303 leader_election.cc:304] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:12:19.596519 20143 consensus_queue.cc:237] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:19.605520 20582 raft_consensus.cc:515] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:19.665318 14339 raft_consensus.cc:2468] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 17.
I20260709 12:12:19.710455 14264 raft_consensus.cc:2468] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 17.
I20260709 12:12:19.729722 14189 raft_consensus.cc:2468] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 17.
I20260709 12:12:19.647260 20476 raft_consensus.cc:2749] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 12:12:19.661329 20568 log.cc:927] Time spent T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 12:12:19.653293 20048 raft_consensus.cc:493] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:19.658495 20575 raft_consensus.cc:493] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:19.649400 20152 raft_consensus.cc:493] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:19.656859 20517 raft_consensus.cc:2804] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 12:12:19.661173 20570 log.cc:927] Time spent T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
W20260709 12:12:19.736649 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 221238us
W20260709 12:12:19.670017 20561 log.cc:927] Time spent T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.204s	user 0.001s	sys 0.000s
W20260709 12:12:19.732590 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 80973.4us
W20260709 12:12:19.734153 20563 log.cc:927] Time spent T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.225s	user 0.001s	sys 0.000s
I20260709 12:12:19.714149 20514 raft_consensus.cc:493] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:19.666468 20530 leader_election.cc:290] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187)
I20260709 12:12:19.673544 20565 raft_consensus.cc:2804] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:19.667173 20580 raft_consensus.cc:2749] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:19.734251 20470 raft_consensus.cc:2804] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:19.763233 20530 raft_consensus.cc:2749] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:12:19.744828 20048 raft_consensus.cc:3060] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:19.764573 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:19.778959 14338 raft_consensus.cc:2468] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 15.
I20260709 12:12:19.765066 20470 raft_consensus.cc:697] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 19 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:19.780815 20470 consensus_queue.cc:237] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:19.782946 20567 leader_election.cc:290] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:19.648452 20548 raft_consensus.cc:515] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:12:19.754715 14303 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:19.664397 20458 raft_consensus.cc:515] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:12:19.791940 14303 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:19.793556 14303 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:19.793978 14303 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:19.750072 20517 raft_consensus.cc:493] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:12:19.791390 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 144933us
W20260709 12:12:19.795682 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 140118us
I20260709 12:12:19.766921 20565 raft_consensus.cc:493] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:12:19.765192 20550 consensus_meta.cc:287] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.558s	user 0.012s	sys 0.000s
I20260709 12:12:19.748167 20585 raft_consensus.cc:2804] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:19.658885 20558 raft_consensus.cc:515] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:12:19.769928 20485 consensus_meta.cc:287] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.595s	user 0.008s	sys 0.004s
I20260709 12:12:19.806967 14876 leader_election.cc:304] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:19.766639 20580 raft_consensus.cc:493] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:19.823778 14910 raft_consensus.cc:2393] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 18: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
W20260709 12:12:19.804035 20035 consensus_meta.cc:287] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.509s	user 0.009s	sys 0.003s
I20260709 12:12:19.752156 20152 raft_consensus.cc:515] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:19.774130 20582 leader_election.cc:290] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:19.836257 14182 raft_consensus.cc:3060] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:19.838006 20492 raft_consensus.cc:3060] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:12:19.839969 20045 consensus_meta.cc:287] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.647s	user 0.011s	sys 0.002s
I20260709 12:12:19.810954 20565 raft_consensus.cc:3060] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:19.831216 14185 raft_consensus.cc:1217] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Deduplicated request from leader. Original: 14.8->[16.9-16.9]   Dedup: 16.9->[]
I20260709 12:12:19.851399 14185 raft_consensus.cc:1240] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 12:12:19.749215 20575 raft_consensus.cc:515] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:19.840432 20045 raft_consensus.cc:515] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:19.767023 20587 raft_consensus.cc:493] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:19.841727 14190 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56046 (request call id 2767) took 1237 ms. Trace:
I20260709 12:12:19.857656 14190 rpcz_store.cc:276] 0709 12:12:18.604657 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:18.604854 (+   197us) service_pool.cc:224] Handling call
0709 12:12:18.605228 (+   374us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:12:18.628598 (+ 23370us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:18.628632 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:12:19.007673 (+379041us) spinlock_profiling.cc:243] Waited 1.76 ms on lock 0x7b2c0006d948. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2125a34a11 00007f2125a44372 00007f2127176a01 00007f212713b43a 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2
0709 12:12:19.046861 (+ 39188us) log.cc:844] Serialized 52 byte log entry
0709 12:12:19.332012 (+285151us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:12:19.332068 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:19.332152 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:19.830481 (+498329us) raft_consensus.cc:1685] finished
0709 12:12:19.830505 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:19.841642 (+ 11137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18239,"raft.queue_time_us":36189,"raft.run_cpu_time_us":186,"raft.run_wall_time_us":19255,"spinlock_wait_cycles":4052352,"thread_start_us":240922,"threads_started":1,"wal-append.queue_time_us":362576}
I20260709 12:12:19.858075 14905 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "afce5304599246a580d798fc0c843964"
dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
mode: GRACEFUL
new_leader_uuid: "885067a0d31741bfb5c9935788e315bf"
 from {username='slave'} at 127.0.0.1:38628
I20260709 12:12:19.860083 14905 raft_consensus.cc:606] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Received request to transfer leadership to TS 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:19.860463 14905 raft_consensus.cc:614] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:19.824407 20550 raft_consensus.cc:515] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:12:19.851874 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 303430us
I20260709 12:12:19.870766 14230 leader_election.cc:304] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:19.847498 14335 raft_consensus.cc:2468] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 17.
I20260709 12:12:19.829820 20572 leader_election.cc:290] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:19.760921 20374 consensus_queue.cc:237] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:19.844890 20569 raft_consensus.cc:2804] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:12:19.806571 20514 raft_consensus.cc:515] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:12:19.836239 20486 consensus_meta.cc:287] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.671s	user 0.013s	sys 0.000s
I20260709 12:12:19.770336 20578 consensus_queue.cc:237] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:19.807659 20517 raft_consensus.cc:3060] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:19.874375 14262 raft_consensus.cc:1240] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 13. Current term is 14. Ops: []
W20260709 12:12:19.866665 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 115069us
I20260709 12:12:19.856418 20585 raft_consensus.cc:697] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 17 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
W20260709 12:12:19.864913 20480 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.713s	user 0.011s	sys 0.007s
I20260709 12:12:19.869764 14182 raft_consensus.cc:2468] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 21.
I20260709 12:12:19.867933 20469 raft_consensus.cc:2749] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673) with higher term. Message: Invalid argument: T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 19. Current term is 20.
I20260709 12:12:19.887971 14333 raft_consensus.cc:2393] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db in current term 13: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:12:19.833137 20035 raft_consensus.cc:515] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:19.893424 14330 raft_consensus.cc:2410] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for term 17 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 12:12:19.894150 14230 leader_election.cc:400] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 election: Vote denied by peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957) with higher term. Message: Invalid argument: T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 19. Current term is 20.
I20260709 12:12:19.898746 14230 leader_election.cc:304] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:19.875720 20569 raft_consensus.cc:493] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:19.855212 20580 raft_consensus.cc:515] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:19.935680 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:12:19.894471 20480 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.743s	user 0.011s	sys 0.007s
I20260709 12:12:19.939256 14263 raft_consensus.cc:2468] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 16.
W20260709 12:12:19.940582 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 104068us
I20260709 12:12:19.886412 20594 raft_consensus.cc:493] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:19.900252 20481 consensus_meta.cc:287] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.554s	user 0.012s	sys 0.000s
I20260709 12:12:19.892854 20572 raft_consensus.cc:2804] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:19.950567 14155 leader_election.cc:304] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:19.865834 20587 raft_consensus.cc:515] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:12:19.962333 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 63622.7us
I20260709 12:12:19.963043 14181 raft_consensus.cc:2393] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 19: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:12:19.895643 20486 raft_consensus.cc:493] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:19.969509 14230 leader_election.cc:304] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:19.935649 20558 leader_election.cc:290] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:19.969645 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:19.904646 20569 raft_consensus.cc:3060] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:19.974790 14263 raft_consensus.cc:2468] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 13.
I20260709 12:12:19.902743 20590 raft_consensus.cc:2804] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:19.979604 14188 raft_consensus.cc:2468] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 15.
I20260709 12:12:19.983271 20035 leader_election.cc:290] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:19.985888 20550 leader_election.cc:290] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 13 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:19.986796 20550 consensus_queue.cc:1059] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:12:19.966727 20588 raft_consensus.cc:493] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:19.988193 20548 leader_election.cc:290] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 18 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:19.991600 14155 leader_election.cc:304] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:19.994987 14230 leader_election.cc:304] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
W20260709 12:12:19.967419 20521 consensus_meta.cc:287] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db: Time spent flushing consensus metadata: real 0.772s	user 0.015s	sys 0.000s
I20260709 12:12:19.958945 20481 raft_consensus.cc:2749] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:19.997654 20588 raft_consensus.cc:515] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:19.964469 20458 leader_election.cc:290] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:20.006408 20589 raft_consensus.cc:2804] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:20.005066 20585 consensus_queue.cc:237] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:19.935487 20537 consensus_queue.cc:1059] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.073s
I20260709 12:12:20.010280 14332 raft_consensus.cc:1275] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:12:20.020927 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:20.024823 14338 raft_consensus.cc:3060] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:20.026841 14184 raft_consensus.cc:2468] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 20.
I20260709 12:12:19.968457 20572 raft_consensus.cc:493] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:19.977370 20464 leader_election.cc:290] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:19.964990 20553 consensus_queue.cc:1059] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 12:12:20.011998 20567 raft_consensus.cc:2749] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:20.042925 20598 consensus_queue.cc:1048] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:12:20.041960 20571 consensus_queue.cc:1048] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:19.989530 20558 raft_consensus.cc:493] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:20.020539 20477 raft_consensus.cc:493] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:20.054718 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 112843us
I20260709 12:12:20.019979 20590 raft_consensus.cc:697] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 17 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:20.022732 20589 raft_consensus.cc:493] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:12:20.020470 20597 raft_consensus.cc:2804] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:20.025789 20035 raft_consensus.cc:2804] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:12:19.965298 20594 raft_consensus.cc:515] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:20.044193 20572 raft_consensus.cc:3060] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:20.000030 20486 raft_consensus.cc:515] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:20.013958 20521 raft_consensus.cc:515] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:20.061311 20597 raft_consensus.cc:493] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:20.079355 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:20.079970 14303 leader_election.cc:304] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:20.076476 20521 leader_election.cc:290] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 18 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:20.062002 20589 raft_consensus.cc:3060] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:20.089064 20587 leader_election.cc:290] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:20.091996 20486 leader_election.cc:290] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:20.066888 20464 raft_consensus.cc:493] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:20.092788 20464 raft_consensus.cc:515] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:20.056726 20493 consensus_queue.cc:260] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } }
I20260709 12:12:20.094278 20493 raft_consensus.cc:3060] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:20.099395 20588 leader_election.cc:290] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:20.099956 20485 consensus_queue.cc:1059] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.014s
I20260709 12:12:20.101131 20485 raft_consensus.cc:3055] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 16 LEADER]: Stepping down as leader of term 16
W20260709 12:12:20.102504 20552 log.cc:927] Time spent T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 1.039s	user 0.002s	sys 0.004s
I20260709 12:12:20.104113 20580 leader_election.cc:290] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:20.104983 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:20.108896 20590 consensus_queue.cc:237] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:20.110580 20470 raft_consensus.cc:3055] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:20.111186 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:20.111373 20048 raft_consensus.cc:515] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:20.111868 14905 raft_consensus.cc:2468] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 18.
I20260709 12:12:20.062719 20558 raft_consensus.cc:515] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:20.114142 14155 leader_election.cc:400] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 16 election: Vote denied by peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957) with higher term. Message: Invalid argument: T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 16. Current term is 17.
I20260709 12:12:20.114457 14155 leader_election.cc:403] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 12:12:20.110710 14907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:20.105654 14264 raft_consensus.cc:2468] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 13.
I20260709 12:12:20.117257 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:20.118149 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:20.080127 14335 raft_consensus.cc:3060] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Advancing to term 18
I20260709 12:12:20.075182 20596 consensus_queue.cc:1048] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 12:12:20.064678 20035 raft_consensus.cc:493] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:20.063396 20152 leader_election.cc:290] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:20.085373 14303 leader_election.cc:304] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:20.119441 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:20.101516 20485 raft_consensus.cc:740] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:20.120564 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:20.121618 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:20.122284 14334 raft_consensus.cc:1275] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 11. (term mismatch)
I20260709 12:12:20.124156 20594 leader_election.cc:290] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:20.111054 20470 raft_consensus.cc:740] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:20.175665 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:20.176527 14332 raft_consensus.cc:2393] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 17: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:12:20.060274 20477 raft_consensus.cc:515] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:20.120323 14229 leader_election.cc:304] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
W20260709 12:12:20.177875 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 92606.1us
I20260709 12:12:20.173645 14334 pending_rounds.cc:85] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c: Aborting all ops after (but not including) 10
I20260709 12:12:20.179343 14334 pending_rounds.cc:107] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c: Aborting uncommitted NO_OP operation due to leader change: 18.11
I20260709 12:12:20.179713 14334 raft_consensus.cc:2889] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:20.174675 14337 raft_consensus.cc:2468] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 17.
W20260709 12:12:20.182031 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 61824.3us
I20260709 12:12:20.088043 20537 raft_consensus.cc:2749] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:20.189487 14335 raft_consensus.cc:2468] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 18.
I20260709 12:12:20.134704 20035 raft_consensus.cc:3060] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:20.093552 20569 raft_consensus.cc:515] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:12:20.093875 20555 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.996s	user 0.002s	sys 0.010s
I20260709 12:12:20.205485 14264 raft_consensus.cc:1275] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:12:20.084419 20597 raft_consensus.cc:3060] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:20.196467 20567 raft_consensus.cc:2804] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:20.118623 20469 raft_consensus.cc:2749] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957) with higher term. Message: Invalid argument: T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 16. Current term is 17.
I20260709 12:12:20.202013 20048 leader_election.cc:290] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:20.218919 14303 leader_election.cc:304] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:20.219072 14338 raft_consensus.cc:2468] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 18.
W20260709 12:12:20.214326 20592 log.cc:927] Time spent T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
W20260709 12:12:20.207191 20555 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 1.144s	user 0.007s	sys 0.013s
I20260709 12:12:20.220659 14303 leader_election.cc:304] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:20.220923 14264 raft_consensus.cc:1240] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:20.188611 20565 raft_consensus.cc:515] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:20.225543 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:20.224963 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:20.230417 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:20.230618 14334 raft_consensus.cc:1275] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 12:12:20.225282 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:20.232162 14335 raft_consensus.cc:2368] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 19. Current term is 20.
I20260709 12:12:20.234328 14303 leader_election.cc:304] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:20.235957 14303 leader_election.cc:304] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:20.236195 14335 raft_consensus.cc:1240] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 12:12:20.212275 20567 raft_consensus.cc:493] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:20.263043 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:12:20.237957 20579 log.cc:927] Time spent T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.632s	user 0.000s	sys 0.003s
I20260709 12:12:20.238230 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:20.238409 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:20.265614 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:20.240996 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:20.241267 20464 leader_election.cc:290] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:20.241753 20575 leader_election.cc:290] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:12:20.278451 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 156472us
I20260709 12:12:20.244900 14155 leader_election.cc:400] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 election: Vote denied by peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957) with higher term. Message: Invalid argument: T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 19. Current term is 20.
I20260709 12:12:20.244724 20227 consensus_queue.cc:1048] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:12:20.249246 20477 leader_election.cc:290] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:20.217971 20470 consensus_queue.cc:260] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:20.252213 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:20.252786 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:20.252965 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:20.291177 14911 raft_consensus.cc:2393] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 13: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
I20260709 12:12:20.253580 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:20.254408 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:20.253794 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:20.256174 20152 raft_consensus.cc:493] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:20.235314 20048 raft_consensus.cc:2749] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:20.256946 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:20.237498 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:20.257834 20587 raft_consensus.cc:493] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:20.258708 14256 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53050 (request call id 1212) took 1629 ms (client timeout 2117 ms). Trace:
I20260709 12:12:20.206467 20537 consensus_queue.cc:1048] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.018s
I20260709 12:12:20.260699 20565 leader_election.cc:290] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 19 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:20.260965 20559 raft_consensus.cc:2749] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:20.265846 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:20.302834 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:20.302984 20585 raft_consensus.cc:493] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:20.262873 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:20.304205 14181 raft_consensus.cc:2393] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 17: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
W20260709 12:12:20.298321 14256 rpcz_store.cc:269] 0709 12:12:18.629816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:18.629958 (+   142us) service_pool.cc:224] Handling call
0709 12:12:20.258494 (+1628536us) spinlock_profiling.cc:243] Waited 592 ms on lock 0x7b54004088d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:12:20.258608 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1362544896}
W20260709 12:12:20.239571 20551 log.cc:927] Time spent T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 1.176s	user 0.009s	sys 0.003s
I20260709 12:12:20.267014 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:20.307725 20569 leader_election.cc:290] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 13 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:20.267311 14331 raft_consensus.cc:2393] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 17: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:12:20.267935 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:20.300072 20605 raft_consensus.cc:2749] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:20.310374 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:20.311239 14332 raft_consensus.cc:2393] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 21: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
I20260709 12:12:20.311456 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:20.312062 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:20.312466 14256 raft_consensus.cc:2410] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for term 18 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 12:12:20.312932 20470 raft_consensus.cc:3060] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:20.272420 14190 raft_consensus.cc:1275] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:12:20.303555 14259 raft_consensus.cc:2468] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 17.
I20260709 12:12:20.272727 14189 raft_consensus.cc:1275] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:12:20.274633 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:20.317222 14188 raft_consensus.cc:2393] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 18: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:12:20.279747 20572 raft_consensus.cc:515] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:20.275306 14260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41768 (request call id 2269) took 1090 ms. Trace:
I20260709 12:12:20.318277 14264 raft_consensus.cc:1240] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:20.266340 20567 raft_consensus.cc:3060] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:20.275790 20589 raft_consensus.cc:515] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:20.314851 20587 raft_consensus.cc:515] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:20.276108 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:20.305791 20152 raft_consensus.cc:515] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:20.322199 14338 raft_consensus.cc:2393] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 13: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:12:20.322785 20587 leader_election.cc:290] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:20.323175 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:12:20.323866 20456 consensus_meta.cc:287] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.719s	user 0.013s	sys 0.000s
I20260709 12:12:20.324361 20456 raft_consensus.cc:515] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:20.326164 20591 raft_consensus.cc:493] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:20.326768 20591 raft_consensus.cc:515] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:20.257758 20599 raft_consensus.cc:2749] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:20.282044 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:20.212555 20143 consensus_queue.cc:1048] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 12:12:20.262291 20492 raft_consensus.cc:2804] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Leader election won for term 17
W20260709 12:12:20.285125 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 48972us
I20260709 12:12:20.331838 14332 raft_consensus.cc:2468] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 20.
I20260709 12:12:20.330665 14184 raft_consensus.cc:2393] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 18: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
W20260709 12:12:20.332701 14302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:20.333231 14302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:20.291131 14335 raft_consensus.cc:1275] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:12:20.255472 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:20.292842 14904 raft_consensus.cc:2393] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 19: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:12:20.292111 14906 raft_consensus.cc:2468] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 13.
W20260709 12:12:20.300465 20607 log.cc:927] Time spent T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 12:12:20.338205 14183 raft_consensus.cc:1240] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:20.300307 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:20.317937 14260 rpcz_store.cc:276] 0709 12:12:19.185251 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:19.215178 (+ 29927us) service_pool.cc:224] Handling call
0709 12:12:19.241357 (+ 26179us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:19.400771 (+159414us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:19.400806 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:19.410834 (+ 10028us) log.cc:844] Serialized 26 byte log entry
0709 12:12:19.516547 (+105713us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:12:19.516766 (+   219us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:19.517215 (+   449us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:20.226841 (+709626us) spinlock_profiling.cc:243] Waited 1.29 ms on lock 0x7b4400022b4c. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2123f74c85 00007f2123f756a2 00007f2126ce71db 00007f2126ce2aaf 00007f2126cd686e 00007f2126cd5bb6 00007f2126cd57d8 00007f2126cdf221 00007f2126cdf1d9 00007f2126cdf169
0709 12:12:20.275024 (+ 48183us) raft_consensus.cc:1685] finished
0709 12:12:20.275044 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:20.275241 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5048,"raft.queue_time_us":47657,"raft.run_cpu_time_us":179,"raft.run_wall_time_us":41961,"spinlock_wait_cycles":2969856,"thread_start_us":219036,"threads_started":2,"wal-append.queue_time_us":151784}
I20260709 12:12:20.303630 20585 raft_consensus.cc:515] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:20.266637 14334 raft_consensus.cc:2468] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 17.
I20260709 12:12:20.324596 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:20.334709 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:20.337534 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:20.343205 14189 raft_consensus.cc:3060] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:12:20.280644 14155 leader_election.cc:304] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:20.346237 20227 raft_consensus.cc:2749] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:12:20.346432 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 65886.2us
I20260709 12:12:20.340453 14261 raft_consensus.cc:2393] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 18: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:12:20.340875 14303 leader_election.cc:304] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:12:20.347731 14155 leader_election.cc:304] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:20.339730 14256 raft_consensus.cc:1275] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 18 index: 8. Preceding OpId from leader: term: 20 index: 9. (index mismatch)
I20260709 12:12:20.350155 20464 consensus_queue.cc:1059] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:20.350620 14155 leader_election.cc:304] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:20.351240 20458 raft_consensus.cc:2749] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:12:20.352136 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:20.352655 14188 raft_consensus.cc:1240] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 17 LEADER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 12:12:20.353367 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:20.354045 14905 raft_consensus.cc:2468] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 18.
I20260709 12:12:20.355785 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:20.357257 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:20.324039 20152 leader_election.cc:290] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:20.362959 14335 raft_consensus.cc:1275] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 18 index: 8. Preceding OpId from leader: term: 20 index: 9. (index mismatch)
I20260709 12:12:20.315392 20533 raft_consensus.cc:493] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:20.364508 20533 raft_consensus.cc:515] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } }
I20260709 12:12:20.366113 14333 raft_consensus.cc:2410] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for term 18 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 12:12:20.369401 14155 leader_election.cc:304] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:20.370091 14335 raft_consensus.cc:1275] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 10. (term mismatch)
I20260709 12:12:20.370468 14335 pending_rounds.cc:85] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c: Aborting all ops after (but not including) 9
I20260709 12:12:20.370483 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:20.370875 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:20.371160 14263 raft_consensus.cc:1240] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 12:12:20.371615 14182 raft_consensus.cc:2410] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for term 18 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 12:12:20.370862 14335 pending_rounds.cc:107] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c: Aborting uncommitted NO_OP operation due to leader change: 16.10
I20260709 12:12:20.370432 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:20.372562 14335 raft_consensus.cc:2889] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:20.379181 14189 raft_consensus.cc:2468] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 13.
I20260709 12:12:20.381124 20605 raft_consensus.cc:2804] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:20.364936 20614 raft_consensus.cc:493] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:20.382157 20517 raft_consensus.cc:515] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:20.382984 20456 leader_election.cc:290] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:20.383841 14330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50856 (request call id 2671) took 1169 ms. Trace:
I20260709 12:12:20.385982 20591 leader_election.cc:290] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:20.387425 14912 raft_consensus.cc:2393] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 13: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
I20260709 12:12:20.392199 14330 rpcz_store.cc:276] 0709 12:12:19.214811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:19.214949 (+   138us) service_pool.cc:224] Handling call
0709 12:12:20.362582 (+1147633us) spinlock_profiling.cc:243] Waited 645 ms on lock 0x7b54000b7a54. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:12:20.383717 (+ 21135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1483966720}
I20260709 12:12:20.395071 14155 leader_election.cc:304] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:20.371913 20227 raft_consensus.cc:2749] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:20.391870 20492 raft_consensus.cc:697] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 17 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
W20260709 12:12:20.408231 20574 log.cc:927] Time spent T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.672s	user 0.006s	sys 0.000s
I20260709 12:12:20.396270 20469 raft_consensus.cc:2749] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:20.389653 20559 consensus_queue.cc:1048] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.031s
W20260709 12:12:20.418442 20543 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.273s	user 0.022s	sys 0.020s
I20260709 12:12:20.427294 14303 leader_election.cc:304] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
W20260709 12:12:20.483280 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 56036.9us
I20260709 12:12:20.418677 20456 raft_consensus.cc:2749] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:12:20.418399 20605 raft_consensus.cc:697] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 20 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:20.431320 20514 leader_election.cc:290] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:20.431521 14910 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53194 (request call id 1111) took 1023 ms. Trace:
I20260709 12:12:20.401952 20614 raft_consensus.cc:515] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:20.438606 20492 consensus_queue.cc:237] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:20.430313 20537 consensus_queue.cc:1059] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 18.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.012s
I20260709 12:12:20.459654 20600 raft_consensus.cc:3055] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:20.444304 20035 raft_consensus.cc:515] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:20.401713 20485 consensus_queue.cc:260] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:20.445715 14230 leader_election.cc:304] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:20.460655 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:20.484055 14303 leader_election.cc:304] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:20.486171 20227 raft_consensus.cc:493] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
W20260709 12:12:20.486397 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 91415.6us
I20260709 12:12:20.488797 14910 rpcz_store.cc:276] 0709 12:12:19.408075 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:19.408237 (+   162us) service_pool.cc:224] Handling call
0709 12:12:20.431322 (+1023085us) spinlock_profiling.cc:243] Waited 359 ms on lock 0x7b540039eed4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:12:20.431457 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":825693056}
I20260709 12:12:20.448283 20493 raft_consensus.cc:493] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:20.461351 20143 raft_consensus.cc:493] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:20.445019 20591 raft_consensus.cc:493] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
W20260709 12:12:20.484725 20543 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.337s	user 0.022s	sys 0.021s
I20260709 12:12:20.482172 20218 raft_consensus.cc:493] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:20.532049 20456 raft_consensus.cc:493] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:20.455896 20517 leader_election.cc:290] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:20.465857 20567 raft_consensus.cc:515] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:20.536536 20589 leader_election.cc:290] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:20.537117 20537 raft_consensus.cc:3055] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:20.488628 20469 raft_consensus.cc:493] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:20.537036 20605 consensus_queue.cc:237] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:20.542294 20616 raft_consensus.cc:2749] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:20.461824 20572 leader_election.cc:290] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:12:20.551548 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 105898us
I20260709 12:12:20.455746 20585 leader_election.cc:290] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:20.485224 20152 raft_consensus.cc:493] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:20.563894 14155 leader_election.cc:304] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
W20260709 12:12:20.565830 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 81800.6us
I20260709 12:12:20.566279 14185 raft_consensus.cc:2468] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 13.
I20260709 12:12:20.533854 20600 raft_consensus.cc:740] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:20.554781 20610 raft_consensus.cc:2749] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:12:20.567625 20591 raft_consensus.cc:515] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:20.574594 20485 raft_consensus.cc:3060] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:20.574966 20615 raft_consensus.cc:2804] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:12:20.633311 14305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:20.562498 20227 raft_consensus.cc:515] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:20.564483 20493 raft_consensus.cc:515] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:20.691169 20493 leader_election.cc:290] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:20.692703 20533 leader_election.cc:290] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:20.593792 20537 raft_consensus.cc:740] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:20.694245 20591 leader_election.cc:290] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:20.694521 20537 consensus_queue.cc:260] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:20.696053 20537 raft_consensus.cc:3060] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:20.644985 20152 raft_consensus.cc:515] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:20.579341 20048 raft_consensus.cc:493] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:20.698124 20048 raft_consensus.cc:515] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:20.655156 20543 consensus_queue.cc:1048] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.048s
W20260709 12:12:20.703249 20629 log.cc:927] Time spent T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:12:20.704588 20567 leader_election.cc:290] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:20.706072 20406 raft_consensus.cc:3055] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:20.706631 20406 raft_consensus.cc:740] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:20.683135 20550 raft_consensus.cc:493] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:20.707921 20406 consensus_queue.cc:260] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:20.708839 20550 raft_consensus.cc:515] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:20.710418 20614 leader_election.cc:290] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:20.711494 20045 leader_election.cc:290] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 14 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:20.706555 20597 raft_consensus.cc:515] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:20.722875 14338 raft_consensus.cc:1275] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:12:20.723343 14186 raft_consensus.cc:2368] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 17. Current term is 18.
I20260709 12:12:20.638010 20469 raft_consensus.cc:515] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:20.698959 20152 leader_election.cc:290] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:20.726552 14339 raft_consensus.cc:1275] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 11. (term mismatch)
I20260709 12:12:20.726960 14339 pending_rounds.cc:85] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c: Aborting all ops after (but not including) 10
I20260709 12:12:20.727174 14339 pending_rounds.cc:107] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c: Aborting uncommitted NO_OP operation due to leader change: 16.11
I20260709 12:12:20.727414 14339 raft_consensus.cc:2889] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:20.728688 20469 leader_election.cc:290] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:20.730209 20615 raft_consensus.cc:697] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 13 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:20.731644 20615 consensus_queue.cc:237] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:20.707849 20035 leader_election.cc:290] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 13 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:20.744251 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:20.744650 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:20.745293 14183 raft_consensus.cc:2468] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 13.
I20260709 12:12:20.743037 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:20.743795 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:20.725083 20597 leader_election.cc:290] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 18 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:20.754338 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:20.758693 14186 raft_consensus.cc:3060] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:20.759497 14183 raft_consensus.cc:1275] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:12:20.653311 14303 leader_election.cc:304] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:20.653671 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:20.760713 14910 raft_consensus.cc:2393] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 19: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
I20260709 12:12:20.654167 14904 raft_consensus.cc:1275] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
W20260709 12:12:20.760815 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 107598us
I20260709 12:12:20.655803 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:20.762322 14190 raft_consensus.cc:2468] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 18.
I20260709 12:12:20.574139 20143 raft_consensus.cc:515] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:20.578871 20456 raft_consensus.cc:515] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:20.576709 20218 raft_consensus.cc:515] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:20.682647 14189 raft_consensus.cc:1275] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:12:20.647060 20516 raft_consensus.cc:493] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:20.684015 14182 raft_consensus.cc:1240] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:20.674453 20630 raft_consensus.cc:2749] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:20.686458 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:20.689325 20227 leader_election.cc:290] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:20.722213 20369 raft_consensus.cc:3060] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:20.710369 20600 consensus_queue.cc:260] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:12:20.649161 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 46525.8us
W20260709 12:12:20.651615 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 87836.5us
I20260709 12:12:20.766139 14303 leader_election.cc:304] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:12:20.790144 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:20.773926 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:20.786916 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:20.701503 20048 leader_election.cc:290] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:20.774977 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:20.798780 14185 raft_consensus.cc:2410] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db for term 16 because replica has last-logged OpId of term: 14 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 12.
I20260709 12:12:20.775650 14229 leader_election.cc:304] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:12:20.777714 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:20.781471 14188 raft_consensus.cc:3060] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:20.736122 20558 leader_election.cc:290] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:20.795753 14190 raft_consensus.cc:2468] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 18.
I20260709 12:12:20.815567 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:20.777777 20493 raft_consensus.cc:2749] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:12:20.816517 14912 raft_consensus.cc:2393] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 13: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
I20260709 12:12:20.795949 14155 leader_election.cc:304] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:20.795984 14303 leader_election.cc:304] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:20.796823 14230 leader_election.cc:304] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:20.812399 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:12:20.814874 14305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:20.818264 14230 leader_election.cc:304] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:12:20.818236 14264 raft_consensus.cc:2468] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 18.
I20260709 12:12:20.819722 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:20.821256 14230 leader_election.cc:304] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:20.823814 14229 leader_election.cc:400] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 pre-election: Vote denied by peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187) with higher term. Message: Invalid argument: T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 17. Current term is 18.
I20260709 12:12:20.827600 14182 raft_consensus.cc:1275] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 12:12:20.777874 20542 raft_consensus.cc:493] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:20.829852 14230 leader_election.cc:304] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:20.783056 20406 raft_consensus.cc:3060] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:20.836897 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:20.835206 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:20.801685 20533 raft_consensus.cc:2804] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:20.824700 14229 leader_election.cc:304] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:20.784307 20550 leader_election.cc:290] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:20.857249 14188 raft_consensus.cc:2468] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 19.
I20260709 12:12:20.852869 14877 leader_election.cc:304] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:12:20.858531 14877 leader_election.cc:304] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
W20260709 12:12:20.859422 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 63539.2us
I20260709 12:12:20.843912 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:20.860491 14258 raft_consensus.cc:2468] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 18.
I20260709 12:12:20.842545 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:12:20.833464 14303 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:20.846926 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:20.866621 14333 raft_consensus.cc:2393] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db in current term 19: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:12:20.841192 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:20.844060 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:20.853983 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:20.853117 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:20.868112 14260 raft_consensus.cc:2468] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 15.
I20260709 12:12:20.843847 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 21 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:20.815232 20239 raft_consensus.cc:493] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:20.868351 14182 raft_consensus.cc:2393] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db in current term 19: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:12:20.828827 20610 raft_consensus.cc:2749] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:20.870888 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:20.875661 14188 raft_consensus.cc:2393] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db in current term 13: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:12:20.815982 20048 raft_consensus.cc:493] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:20.784072 20516 raft_consensus.cc:515] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:20.831723 20572 raft_consensus.cc:2804] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:20.854784 20596 raft_consensus.cc:2749] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:20.873839 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:20.874168 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:20.832304 20589 raft_consensus.cc:2749] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:20.829109 20621 raft_consensus.cc:2804] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:20.871762 14333 raft_consensus.cc:1275] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:12:20.872970 14155 leader_election.cc:304] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:20.883478 14303 leader_election.cc:304] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:12:20.883492 14186 raft_consensus.cc:2468] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 18.
I20260709 12:12:20.854017 20600 raft_consensus.cc:3060] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:20.887425 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:20.850031 20514 raft_consensus.cc:2749] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:20.869829 20567 raft_consensus.cc:3060] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:20.907994 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:20.801896 20227 consensus_queue.cc:1048] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.072s
I20260709 12:12:20.829236 20543 consensus_queue.cc:1048] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.051s
I20260709 12:12:20.828991 20591 consensus_queue.cc:1048] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.054s
I20260709 12:12:20.856985 20533 raft_consensus.cc:493] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:20.933794 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:20.849304 20530 consensus_queue.cc:1048] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.053s
I20260709 12:12:20.914734 14186 raft_consensus.cc:1275] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 12:12:20.944249 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:20.945032 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:20.945655 14186 raft_consensus.cc:2468] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 19.
I20260709 12:12:20.938539 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 21 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:20.835476 20542 raft_consensus.cc:515] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:20.957425 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:20.958202 14182 raft_consensus.cc:2393] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 18: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:12:20.890933 20605 raft_consensus.cc:493] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:20.920447 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:20.962530 14187 raft_consensus.cc:2393] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 18: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
W20260709 12:12:20.893194 20546 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.742s	user 0.010s	sys 0.012s
I20260709 12:12:20.927966 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:20.883518 20604 raft_consensus.cc:2749] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:12:20.937366 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:20.940491 14877 leader_election.cc:304] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:12:20.949892 14338 raft_consensus.cc:2393] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 17: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:12:20.925083 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:20.904920 20035 raft_consensus.cc:2804] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:20.933437 20591 consensus_queue.cc:1243] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer 885067a0d31741bfb5c9935788e315bf log is divergent from this leader: its last log entry 13.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:12:20.904716 20621 raft_consensus.cc:493] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:20.876355 20558 consensus_queue.cc:1048] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 12:12:20.907711 20487 raft_consensus.cc:2804] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:20.907968 20531 raft_consensus.cc:2804] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:20.966485 14189 raft_consensus.cc:2468] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 17.
I20260709 12:12:20.949551 20533 raft_consensus.cc:3060] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:20.894223 20048 raft_consensus.cc:515] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:20.876586 20239 raft_consensus.cc:515] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:20.958882 20530 consensus_queue.cc:1243] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer 65c9c1653b3346b39a0e118540e6080c log is divergent from this leader: its last log entry 17.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:12:20.982399 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:20.966928 20458 raft_consensus.cc:493] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:20.984884 14876 leader_election.cc:304] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:20.988795 14256 raft_consensus.cc:2468] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 20.
I20260709 12:12:20.981766 20263 raft_consensus.cc:2804] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:20.981905 20045 consensus_queue.cc:1048] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.008s
I20260709 12:12:20.961848 20599 raft_consensus.cc:2804] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 12:12:20.976405 20546 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.815s	user 0.011s	sys 0.012s
I20260709 12:12:20.892310 20572 raft_consensus.cc:493] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
W20260709 12:12:20.964716 20633 log.cc:927] Time spent T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:12:20.910077 20597 consensus_queue.cc:1048] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.062s
I20260709 12:12:21.003552 14905 raft_consensus.cc:2468] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 18.
I20260709 12:12:20.979605 20227 raft_consensus.cc:493] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:20.979344 20035 raft_consensus.cc:493] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:20.986917 20621 raft_consensus.cc:3060] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:21.015563 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:21.010915 20380 consensus_queue.cc:1048] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 12:12:21.031031 20578 consensus_queue.cc:1048] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:12:21.011997 20610 consensus_queue.cc:1048] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 12:12:21.035113 20239 leader_election.cc:290] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:21.015115 20585 raft_consensus.cc:2804] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 12:12:21.040894 20632 log.cc:927] Time spent T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.171s	user 0.000s	sys 0.000s
I20260709 12:12:21.041221 20516 leader_election.cc:290] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:21.003270 20458 raft_consensus.cc:515] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:20.979247 20605 raft_consensus.cc:515] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:21.043459 20458 leader_election.cc:290] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:21.044541 20605 leader_election.cc:290] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:20.999521 20263 raft_consensus.cc:493] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:21.050132 20263 raft_consensus.cc:3060] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:21.002918 20599 raft_consensus.cc:493] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:21.054054 20599 raft_consensus.cc:3060] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:21.000680 20531 raft_consensus.cc:697] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 18 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:12:21.059039 20531 consensus_queue.cc:237] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:21.012234 20572 raft_consensus.cc:3060] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:21.007295 20487 raft_consensus.cc:697] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 18 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:12:21.067235 20487 consensus_queue.cc:237] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:21.069950 20586 consensus_queue.cc:1048] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:12:21.071195 20542 leader_election.cc:290] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:21.074043 20143 leader_election.cc:290] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:21.077044 20048 leader_election.cc:290] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:21.078516 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:21.079224 14338 raft_consensus.cc:3060] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:21.087064 20218 leader_election.cc:290] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:21.025461 20227 raft_consensus.cc:515] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:21.101131 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:21.102095 14905 raft_consensus.cc:2468] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 15.
I20260709 12:12:21.026454 20035 raft_consensus.cc:3060] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:21.190038 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
W20260709 12:12:21.223904 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 340489us
I20260709 12:12:21.225566 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:21.226577 14264 raft_consensus.cc:2468] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 16.
I20260709 12:12:21.227596 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
W20260709 12:12:21.242345 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 390524us
I20260709 12:12:21.245484 14338 raft_consensus.cc:2468] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 18.
I20260709 12:12:21.246708 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:21.247360 14338 raft_consensus.cc:3060] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:21.255509 14303 leader_election.cc:304] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:21.274585 14303 leader_election.cc:304] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:12:21.278636 20553 raft_consensus.cc:2804] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:21.275295 20605 raft_consensus.cc:2804] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:21.277459 20567 raft_consensus.cc:2749] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:21.290024 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:12:21.307111 14263 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.008s	sys 0.008s
I20260709 12:12:21.307706 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:12:21.308032 14263 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.557s	user 0.008s	sys 0.008s
I20260709 12:12:21.267382 20620 consensus_queue.cc:1048] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.019s
I20260709 12:12:21.280004 20553 raft_consensus.cc:493] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:21.309839 14338 raft_consensus.cc:2468] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 18.
I20260709 12:12:21.308408 14332 raft_consensus.cc:2468] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 17.
I20260709 12:12:21.318498 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:21.319181 14332 raft_consensus.cc:3060] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:21.322537 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:12:21.325330 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 325714us
I20260709 12:12:21.318979 20553 raft_consensus.cc:3060] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:21.332309 14303 leader_election.cc:304] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:21.324318 20605 raft_consensus.cc:697] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 19 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
W20260709 12:12:21.388643 20369 consensus_meta.cc:287] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db: Time spent flushing consensus metadata: real 0.598s	user 0.008s	sys 0.000s
I20260709 12:12:21.451093 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:21.556285 14904 raft_consensus.cc:2468] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 18.
I20260709 12:12:21.557256 20271 raft_consensus.cc:493] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:21.393584 14154 leader_election.cc:304] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:21.557878 20271 raft_consensus.cc:515] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:21.558620 20652 raft_consensus.cc:2749] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:21.473590 20585 raft_consensus.cc:493] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:21.559352 20585 raft_consensus.cc:3060] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:12:21.559983 14154 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 166487us
I20260709 12:12:21.561168 14154 leader_election.cc:304] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:21.478884 14230 leader_election.cc:304] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:12:21.561972 20652 raft_consensus.cc:2804] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:21.562386 20652 raft_consensus.cc:493] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:21.562794 20652 raft_consensus.cc:3060] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:21.515722 14257 raft_consensus.cc:1275] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 12:12:21.563407 20271 leader_election.cc:290] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:12:21.375593 20485 consensus_meta.cc:287] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.679s	user 0.012s	sys 0.000s
I20260709 12:12:21.516839 14304 leader_election.cc:304] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:21.565542 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:21.468880 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:21.566322 14184 raft_consensus.cc:2468] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 18.
I20260709 12:12:21.566524 14260 raft_consensus.cc:2468] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 16.
I20260709 12:12:21.529394 14261 raft_consensus.cc:1275] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:12:21.567828 14876 leader_election.cc:304] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:21.506552 14330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50856 (request call id 2701) took 1223 ms. Trace:
I20260709 12:12:21.570393 20637 raft_consensus.cc:2804] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:21.571223 20637 raft_consensus.cc:493] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:21.381323 20572 raft_consensus.cc:515] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:21.571636 20637 raft_consensus.cc:3060] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:21.333617 14877 leader_election.cc:304] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:12:21.573500 20586 raft_consensus.cc:2804] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:21.573935 20586 raft_consensus.cc:493] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:21.325121 20645 raft_consensus.cc:493] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:21.576992 20647 raft_consensus.cc:493] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:21.459697 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
W20260709 12:12:21.420877 20640 log.cc:927] Time spent T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.147s	user 0.002s	sys 0.000s
I20260709 12:12:21.394497 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:21.580471 20647 raft_consensus.cc:515] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:12:21.509066 14229 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.012s	sys 0.004s
W20260709 12:12:21.582062 14229 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.655s	user 0.012s	sys 0.012s
I20260709 12:12:21.334404 20470 raft_consensus.cc:493] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:21.582818 20470 raft_consensus.cc:515] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:21.583326 20647 leader_election.cc:290] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:21.574295 20586 raft_consensus.cc:3060] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:12:21.583621 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 657115us
I20260709 12:12:21.585275 20470 leader_election.cc:290] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:12:21.417106 20636 log.cc:927] Time spent T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.402s	user 0.000s	sys 0.002s
I20260709 12:12:21.454988 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:21.433348 14332 raft_consensus.cc:2468] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 15.
I20260709 12:12:21.357548 20227 leader_election.cc:290] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:21.478884 20296 raft_consensus.cc:3055] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:12:21.491206 20543 raft_consensus.cc:493] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:21.489369 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:21.587710 14904 raft_consensus.cc:1240] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 18 LEADER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:21.427012 14334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50856 (request call id 2700) took 1144 ms. Trace:
I20260709 12:12:21.589953 20543 raft_consensus.cc:515] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:21.349709 14335 raft_consensus.cc:2468] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 18.
I20260709 12:12:21.574625 20271 raft_consensus.cc:2804] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:21.446703 14336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50856 (request call id 2686) took 2184 ms. Trace:
I20260709 12:12:21.381323 20035 raft_consensus.cc:515] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:21.592267 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:21.592476 14190 raft_consensus.cc:1240] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 20. Current term is 21. Ops: []
W20260709 12:12:21.415949 20638 log.cc:927] Time spent T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.395s	user 0.001s	sys 0.000s
I20260709 12:12:21.593612 14264 raft_consensus.cc:3060] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:21.594410 20605 consensus_queue.cc:237] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:21.595372 20035 leader_election.cc:290] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 21 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:21.538177 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 21 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:21.596910 14333 raft_consensus.cc:2468] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 20.
I20260709 12:12:21.333808 20581 consensus_queue.cc:1059] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.265s
I20260709 12:12:21.598321 14333 raft_consensus.cc:1240] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 12:12:21.600176 14333 raft_consensus.cc:1275] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
I20260709 12:12:21.385098 20263 raft_consensus.cc:515] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:21.383944 20533 raft_consensus.cc:515] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:21.607738 20263 leader_election.cc:290] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 14 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:21.375356 20599 raft_consensus.cc:515] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:21.608032 14339 raft_consensus.cc:2468] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 18.
I20260709 12:12:21.608475 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:21.609119 14190 raft_consensus.cc:3060] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:21.574272 14337 raft_consensus.cc:2468] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 17.
I20260709 12:12:21.610010 20599 leader_election.cc:290] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:21.610272 14339 raft_consensus.cc:1275] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
W20260709 12:12:21.611130 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 278886us
W20260709 12:12:21.611443 14337 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50858 (request call id 2237) took 1386 ms (client timeout 1786 ms). Trace:
I20260709 12:12:21.611776 20485 raft_consensus.cc:2749] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:21.447139 14155 leader_election.cc:304] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:21.613240 14339 raft_consensus.cc:1275] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
W20260709 12:12:21.372748 20406 consensus_meta.cc:287] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.531s	user 0.007s	sys 0.004s
I20260709 12:12:21.591312 20271 raft_consensus.cc:493] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:21.614707 20271 raft_consensus.cc:3060] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:21.586764 20645 raft_consensus.cc:515] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:12:21.605252 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 88527.3us
I20260709 12:12:21.483752 20630 raft_consensus.cc:3055] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:21.615912 20630 raft_consensus.cc:740] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
W20260709 12:12:21.602087 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 123293us
I20260709 12:12:21.616762 20645 leader_election.cc:290] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:21.617483 14230 leader_election.cc:304] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
W20260709 12:12:21.617807 14337 rpcz_store.cc:269] 0709 12:12:20.225183 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:20.225305 (+   122us) service_pool.cc:224] Handling call
0709 12:12:21.611216 (+1385911us) spinlock_profiling.cc:243] Waited 1.34 s on lock 0x7b5400146254. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:12:21.611383 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3072346880}
I20260709 12:12:21.618527 20048 consensus_queue.cc:1048] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:12:21.619720 20575 raft_consensus.cc:493] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:21.619645 20610 raft_consensus.cc:2804] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:21.619872 20406 consensus_queue.cc:1048] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:21.620649 20143 raft_consensus.cc:493] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:21.620394 20575 raft_consensus.cc:515] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:21.621361 14337 raft_consensus.cc:1240] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:21.621287 20143 raft_consensus.cc:515] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:21.622184 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:21.390969 20621 raft_consensus.cc:515] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:21.622874 20575 leader_election.cc:290] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:21.623409 14262 raft_consensus.cc:2368] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 13. Current term is 14.
I20260709 12:12:21.624025 20143 leader_election.cc:290] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:21.590299 14334 rpcz_store.cc:276] 0709 12:12:20.282412 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:20.389513 (+107101us) service_pool.cc:224] Handling call
0709 12:12:20.389888 (+   375us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:20.407705 (+ 17817us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:20.407747 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:20.408354 (+   607us) log.cc:844] Serialized 26 byte log entry
0709 12:12:20.551147 (+142793us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:12:21.423690 (+872543us) spinlock_profiling.cc:243] Waited 1.29 ms on lock 0x7b180043a2c0. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f212cf16ab1 00007f212cf23281 00007f2126ce34bc 00007f212403148b 00007f212ce8b9a9 00007f212404d69b 00007f212404b93f 00007f212404b455 00007f212ab333c7 00007f21271459a7 00007f21271550bf
0709 12:12:21.424844 (+  1154us) log.cc:844] Serialized 14 byte log entry
0709 12:12:21.425164 (+   320us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:21.425257 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:21.425307 (+    50us) raft_consensus.cc:1685] finished
0709 12:12:21.426732 (+  1425us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:21.426927 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":292491,"prepare.queue_time_us":17658,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":3367,"raft.queue_time_us":17624,"raft.run_cpu_time_us":316,"raft.run_wall_time_us":2232,"spinlock_wait_cycles":2969344,"thread_start_us":173312,"threads_started":2,"wal-append.queue_time_us":191763}
W20260709 12:12:21.348009 20639 log.cc:927] Time spent T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 12:12:21.604558 20537 raft_consensus.cc:2804] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:21.569954 14330 rpcz_store.cc:276] 0709 12:12:20.282655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:20.398732 (+116077us) service_pool.cc:224] Handling call
0709 12:12:20.463889 (+ 65157us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:20.482236 (+ 18347us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:20.482274 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:20.489433 (+  7159us) log.cc:844] Serialized 26 byte log entry
0709 12:12:20.574775 (+ 85342us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:12:20.876952 (+302177us) log.cc:844] Serialized 14 byte log entry
0709 12:12:20.883073 (+  6121us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:20.883148 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:20.883201 (+    53us) raft_consensus.cc:1685] finished
0709 12:12:20.883211 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:21.506272 (+623061us) spinlock_profiling.cc:243] Waited 64.7 ms on lock 0x7b540023a850. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713a8ad 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:12:21.506460 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":327133,"prepare.queue_time_us":301137,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"raft.queue_time_us":31580,"raft.run_cpu_time_us":304,"raft.run_wall_time_us":56808,"spinlock_wait_cycles":148840192,"thread_start_us":34478,"threads_started":1,"wal-append.queue_time_us":143810}
W20260709 12:12:21.378427 20635 log.cc:927] Time spent T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.475s	user 0.003s	sys 0.000s
I20260709 12:12:21.411520 20456 leader_election.cc:290] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:21.605592 20546 raft_consensus.cc:493] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:21.616864 20630 consensus_queue.cc:260] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:21.613672 14338 raft_consensus.cc:2393] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 19: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:12:21.602775 20578 raft_consensus.cc:3055] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:12:21.620471 20610 raft_consensus.cc:697] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 18 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:21.602370 14264 raft_consensus.cc:2468] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 18.
I20260709 12:12:21.624356 20035 raft_consensus.cc:2749] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:21.625711 14190 raft_consensus.cc:2468] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 14.
I20260709 12:12:21.629077 20546 raft_consensus.cc:515] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:21.593067 14335 raft_consensus.cc:1240] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 17. Current term is 18. Ops: [17.9-17.9]
I20260709 12:12:21.600618 20637 raft_consensus.cc:515] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:21.593032 14332 raft_consensus.cc:2468] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 15.
I20260709 12:12:21.631172 14337 raft_consensus.cc:1240] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 20. Current term is 21. Ops: [20.10-20.10]
I20260709 12:12:21.661751 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:21.631598 14303 leader_election.cc:304] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:12:21.604807 20572 leader_election.cc:290] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:12:21.613584 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 166527us
W20260709 12:12:21.634814 14154 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 73757.6us
I20260709 12:12:21.663496 14155 leader_election.cc:304] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:21.665903 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:21.666555 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:21.666765 14190 raft_consensus.cc:2468] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 15.
I20260709 12:12:21.667275 14184 raft_consensus.cc:2468] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 17.
I20260709 12:12:21.669191 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:21.670125 14332 raft_consensus.cc:2368] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 17. Current term is 18.
I20260709 12:12:21.672220 14190 pending_rounds.cc:85] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf: Aborting all ops after (but not including) 8
I20260709 12:12:21.672655 14190 pending_rounds.cc:107] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf: Aborting uncommitted NO_OP operation due to leader change: 13.9
I20260709 12:12:21.672909 14190 raft_consensus.cc:2889] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:21.673241 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 21 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:21.640012 14230 leader_election.cc:304] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:21.628309 14331 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50856 (request call id 2704) took 1179 ms. Trace:
W20260709 12:12:21.574330 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 239767us
I20260709 12:12:21.643461 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:21.589604 20296 raft_consensus.cc:740] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:21.591483 14336 rpcz_store.cc:276] 0709 12:12:19.262154 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:19.437421 (+175267us) service_pool.cc:224] Handling call
0709 12:12:19.465209 (+ 27788us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:12:19.510285 (+ 45076us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:12:20.452237 (+941952us) spinlock_profiling.cc:243] Waited 17.1 ms on lock 0x7b1800316ea0. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f212cf16ab1 00007f212cf23281 00007f2124030e07 00007f212ce8b9a9 00007f212404d69b 00007f212404b93f 00007f212404b455 00007f212ab333c7 00007f21271459a7 00007f21271550bf 00007f2127155038
0709 12:12:20.495944 (+ 43707us) log.cc:844] Serialized 14 byte log entry
0709 12:12:20.650686 (+154742us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:12:20.751710 (+101024us) log.cc:844] Serialized 78 byte log entry
0709 12:12:20.751891 (+   181us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:12:20.891051 (+139160us) log.cc:844] Serialized 14 byte log entry
0709 12:12:20.891419 (+   368us) log.cc:844] Serialized 14 byte log entry
0709 12:12:20.891705 (+   286us) log.cc:844] Serialized 14 byte log entry
0709 12:12:21.196922 (+305217us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:21.379580 (+182658us) spinlock_profiling.cc:243] Waited 2.42 ms on lock 0x7b1800316ea0. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f212cf16ab1 00007f212cf23281 00007f212404e557 00007f21240507c1 00007f2124050779 00007f2124050709 00007f21240506d1 00007f212404f9cd 0000000000388634 0000000000388479 00007f212403183a
0709 12:12:21.443794 (+ 64214us) spinlock_profiling.cc:243] Waited 10.1 ms on lock 0x7b1800316ea0. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f212cf16ab1 00007f212cf23281 00007f212404e3f3 00007f21240507c1 00007f2124050779 00007f2124050709 00007f21240506d1 00007f212404f9cd 0000000000388634 0000000000388479 00007f212403183a
0709 12:12:21.446315 (+  2521us) spinlock_profiling.cc:243] Waited 17.4 ms on lock 0x7b5400338e54. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:12:21.446370 (+    55us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:21.446417 (+    47us) raft_consensus.cc:1685] finished
0709 12:12:21.446429 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:21.446589 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":162379,"prepare.queue_time_us":373889,"prepare.run_cpu_time_us":167,"prepare.run_wall_time_us":18643,"raft.queue_time_us":98969,"raft.run_cpu_time_us":739,"raft.run_wall_time_us":62754,"spinlock_wait_cycles":108237184,"thread_start_us":449122,"threads_started":3,"wal-append.queue_time_us":260011}
W20260709 12:12:21.686256 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 46347.7us
I20260709 12:12:21.687300 14230 leader_election.cc:304] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
W20260709 12:12:21.655237 20615 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.003s	sys 0.013s
I20260709 12:12:21.648171 14876 leader_election.cc:304] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:21.658488 14229 leader_election.cc:304] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:12:21.660187 14334 raft_consensus.cc:1240] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 18. Current term is 19. Ops: [16.10-18.11]
I20260709 12:12:21.610088 20533 leader_election.cc:290] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:21.681560 14331 rpcz_store.cc:276] 0709 12:12:20.449174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:20.567742 (+118568us) service_pool.cc:224] Handling call
0709 12:12:20.590529 (+ 22787us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:20.590945 (+   416us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:20.590977 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:20.591537 (+   560us) log.cc:844] Serialized 26 byte log entry
0709 12:12:20.888614 (+297077us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:12:20.907686 (+ 19072us) log.cc:844] Serialized 14 byte log entry
0709 12:12:21.241905 (+334219us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:21.241999 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:21.377762 (+135763us) spinlock_profiling.cc:243] Waited 3.43 ms on lock 0x7b4400022b4c. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2123f74c85 00007f2123f756a2 00007f2126ce71db 00007f2126ce2aaf 00007f2126cd686e 00007f2126cd5bb6 00007f2126cd57d8 00007f2126cdf221 00007f2126cdf1d9 00007f2126cdf169
0709 12:12:21.627972 (+250210us) raft_consensus.cc:1685] finished
0709 12:12:21.628092 (+   120us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:21.628242 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23455,"prepare.queue_time_us":19110,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":11166,"raft.queue_time_us":74720,"raft.run_cpu_time_us":352,"raft.run_wall_time_us":19372,"spinlock_wait_cycles":7896960,"thread_start_us":615511,"threads_started":2,"wal-append.queue_time_us":311248}
I20260709 12:12:21.688525 14260 raft_consensus.cc:2393] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 18: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:12:21.683566 14877 leader_election.cc:304] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:21.692951 14155 leader_election.cc:304] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:21.626346 20537 raft_consensus.cc:493] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:21.697764 14229 leader_election.cc:304] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:12:21.626004 20621 leader_election.cc:290] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 14 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:21.699158 14257 raft_consensus.cc:2468] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 17.
W20260709 12:12:21.703233 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 71743.7us
I20260709 12:12:21.707679 14182 raft_consensus.cc:1240] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 21 LEADER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 20. Current term is 21. Ops: []
I20260709 12:12:21.644902 20578 raft_consensus.cc:740] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:12:21.713948 14263 raft_consensus.cc:2368] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 17. Current term is 18.
I20260709 12:12:21.661417 20630 raft_consensus.cc:3060] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:12:21.690420 20615 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.604s	user 0.004s	sys 0.014s
I20260709 12:12:21.699494 20035 raft_consensus.cc:2804] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:21.694938 20596 raft_consensus.cc:2804] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:21.658401 20575 raft_consensus.cc:493] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:21.702137 20470 raft_consensus.cc:493] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:21.706801 20537 raft_consensus.cc:3060] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:21.709988 20547 raft_consensus.cc:2804] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:12:21.702788 20485 raft_consensus.cc:493] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:21.700400 20530 raft_consensus.cc:2804] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:21.718582 20487 raft_consensus.cc:2804] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:21.714022 20589 raft_consensus.cc:2804] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:21.755605 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:21.759176 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:21.762724 14186 raft_consensus.cc:1275] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 12:12:21.718219 20572 raft_consensus.cc:2804] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:21.799587 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:21.722004 20647 raft_consensus.cc:2749] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:21.781172 20605 consensus_queue.cc:1048] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:21.781344 20615 raft_consensus.cc:493] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:21.780908 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 64858.9us
I20260709 12:12:21.784770 14331 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c"
dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
mode: GRACEFUL
new_leader_uuid: "885067a0d31741bfb5c9935788e315bf"
 from {username='slave'} at 127.0.0.1:50896
I20260709 12:12:21.726863 20645 raft_consensus.cc:2804] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:21.796084 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:21.796918 20586 raft_consensus.cc:515] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:21.798233 20637 leader_election.cc:290] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:21.800539 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:21.808564 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:21.742046 20035 raft_consensus.cc:493] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:21.854410 14331 raft_consensus.cc:606] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Received request to transfer leadership to TS 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:21.875224 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:21.875700 14331 raft_consensus.cc:614] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:21.864607 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:21.730680 20567 consensus_queue.cc:1059] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.070s
I20260709 12:12:21.877570 14257 raft_consensus.cc:1275] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
W20260709 12:12:21.879096 14154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:21.884749 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 68837.2us
I20260709 12:12:21.874037 20547 raft_consensus.cc:697] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 14 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:12:21.880164 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:21.880465 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:21.791570 20530 raft_consensus.cc:493] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:21.751468 20458 consensus_queue.cc:1048] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.074s
I20260709 12:12:21.795323 20487 raft_consensus.cc:493] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:21.776964 20575 raft_consensus.cc:515] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:21.883868 20035 raft_consensus.cc:3060] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:21.892416 14258 raft_consensus.cc:2393] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db in current term 14: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
W20260709 12:12:21.816438 20654 log.cc:927] Time spent T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:12:21.896303 14877 leader_election.cc:304] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:21.808077 20533 raft_consensus.cc:493] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:21.800799 20542 consensus_queue.cc:1059] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.096s
I20260709 12:12:21.799667 20572 raft_consensus.cc:493] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:21.787287 20470 raft_consensus.cc:515] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:21.885470 20227 raft_consensus.cc:493] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:21.918282 14877 leader_election.cc:304] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:21.921331 14877 leader_election.cc:304] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:21.903576 20599 raft_consensus.cc:493] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:21.884692 20589 raft_consensus.cc:697] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 18 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:21.892396 20530 raft_consensus.cc:3060] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:21.777163 20296 consensus_queue.cc:260] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 10, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:21.891991 20596 raft_consensus.cc:697] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 15 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:21.896152 20476 raft_consensus.cc:493] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:21.900684 20487 raft_consensus.cc:3060] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:21.903277 20545 raft_consensus.cc:493] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
W20260709 12:12:21.892325 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 156418us
I20260709 12:12:21.902384 14304 leader_election.cc:304] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:12:21.807863 20485 raft_consensus.cc:515] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:21.775115 20610 consensus_queue.cc:237] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:21.955492 14229 leader_election.cc:304] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:21.923259 20263 raft_consensus.cc:2749] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:12:21.940644 14335 raft_consensus.cc:1275] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
W20260709 12:12:21.940655 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 239230us
I20260709 12:12:21.918797 20572 raft_consensus.cc:3060] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:21.876673 20615 raft_consensus.cc:515] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:21.916414 20567 consensus_queue.cc:1243] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer 73d01e9b1a9d49358da4985b21d681db log is divergent from this leader: its last log entry 18.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 12:12:21.918856 20369 raft_consensus.cc:2749] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:12:21.944725 20044 raft_consensus.cc:2749] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 12:12:21.896871 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 172972us
I20260709 12:12:21.968905 14230 leader_election.cc:400] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 election: Vote denied by peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957) with higher term. Message: Invalid argument: T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 17. Current term is 18.
W20260709 12:12:21.950103 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 48027.2us
I20260709 12:12:21.974547 14155 leader_election.cc:304] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
W20260709 12:12:21.974999 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 72692.6us
I20260709 12:12:21.916376 20533 raft_consensus.cc:515] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:21.974972 14230 leader_election.cc:403] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 12:12:21.923105 20581 consensus_queue.cc:1048] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.044s
I20260709 12:12:21.958478 20296 raft_consensus.cc:3060] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:21.981185 20575 leader_election.cc:290] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:21.983829 20533 leader_election.cc:290] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:21.984577 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:21.985176 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:21.985920 14186 raft_consensus.cc:2368] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 17. Current term is 18.
I20260709 12:12:21.986668 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:21.987777 20677 raft_consensus.cc:2749] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957) with higher term. Message: Invalid argument: T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 17. Current term is 18.
I20260709 12:12:21.989136 20481 consensus_queue.cc:1059] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:12:21.924113 20227 raft_consensus.cc:515] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:21.985944 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:21.958719 20616 consensus_queue.cc:1048] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 12:12:21.996366 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:21.932508 20599 raft_consensus.cc:515] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:12:22.007937 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 80418us
I20260709 12:12:22.004793 14229 leader_election.cc:400] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 election: Vote denied by peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187) with higher term. Message: Invalid argument: T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 17. Current term is 18.
I20260709 12:12:22.011020 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:22.017468 14333 raft_consensus.cc:3060] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:22.007508 14303 leader_election.cc:304] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:22.011672 14186 raft_consensus.cc:3060] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:21.955463 20652 raft_consensus.cc:515] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:21.966914 20650 consensus_queue.cc:1048] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.041s
I20260709 12:12:21.978989 20406 raft_consensus.cc:2804] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:22.012297 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:21.974355 20637 raft_consensus.cc:2804] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:22.012543 14183 raft_consensus.cc:2393] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 14: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
I20260709 12:12:21.964416 20543 leader_election.cc:290] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:22.031738 14338 raft_consensus.cc:1275] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:12:21.991179 20481 consensus_queue.cc:1243] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer 65c9c1653b3346b39a0e118540e6080c log is divergent from this leader: its last log entry 17.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:12:21.956676 20476 raft_consensus.cc:515] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:22.035607 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:21.963302 20545 raft_consensus.cc:515] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:12:22.033401 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 83854.7us
I20260709 12:12:21.975999 20045 consensus_queue.cc:1059] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.047s
I20260709 12:12:21.979002 20546 leader_election.cc:290] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:22.039929 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:22.043337 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:22.040143 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:22.059257 14187 raft_consensus.cc:2393] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 17: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:12:22.060007 14186 raft_consensus.cc:2468] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 18.
I20260709 12:12:22.061228 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:22.108346 14187 raft_consensus.cc:3060] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:22.056308 14333 raft_consensus.cc:2468] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 18.
I20260709 12:12:22.065124 14330 raft_consensus.cc:2393] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 17: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:12:22.038993 20670 raft_consensus.cc:2749] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:12:22.034878 20637 raft_consensus.cc:493] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:22.016891 20605 raft_consensus.cc:493] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:22.009279 20517 raft_consensus.cc:493] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:22.027935 20143 raft_consensus.cc:493] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:22.037006 20406 raft_consensus.cc:493] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
W20260709 12:12:22.106629 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 47888.9us
I20260709 12:12:22.040426 20569 consensus_queue.cc:1048] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.076s
W20260709 12:12:22.111402 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 103969us
I20260709 12:12:22.057935 14183 raft_consensus.cc:2468] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 20.
I20260709 12:12:21.969250 20547 consensus_queue.cc:237] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:22.110880 14229 leader_election.cc:304] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:22.104267 20586 leader_election.cc:290] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 19 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:22.134193 20637 raft_consensus.cc:3060] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:22.152251 14229 leader_election.cc:304] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:22.136670 20533 raft_consensus.cc:2749] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:12:22.163431 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 187160us
I20260709 12:12:22.143954 20605 raft_consensus.cc:515] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:22.147675 20406 raft_consensus.cc:3060] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:12:22.156525 20553 consensus_meta.cc:287] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.591s	user 0.010s	sys 0.001s
I20260709 12:12:22.164773 20492 raft_consensus.cc:493] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:22.150414 20143 raft_consensus.cc:515] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:22.167429 20679 raft_consensus.cc:493] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:22.190727 20679 raft_consensus.cc:515] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:22.192996 20679 leader_election.cc:290] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:22.167490 20481 raft_consensus.cc:2804] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:22.044878 20589 consensus_queue.cc:237] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:22.194651 20481 raft_consensus.cc:493] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:22.195137 20481 raft_consensus.cc:3060] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:22.036229 20596 consensus_queue.cc:237] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:22.184937 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:22.199891 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:22.204012 14189 raft_consensus.cc:2393] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 15: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:12:22.200326 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:22.205278 14186 raft_consensus.cc:2468] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 16.
W20260709 12:12:22.201574 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 55862.6us
I20260709 12:12:22.207028 14229 leader_election.cc:304] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
W20260709 12:12:22.169929 20672 log.cc:927] Time spent T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.131s	user 0.000s	sys 0.001s
W20260709 12:12:22.186798 20667 log.cc:927] Time spent T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.227s	user 0.001s	sys 0.000s
I20260709 12:12:22.165648 20546 raft_consensus.cc:2804] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader election won for term 18
W20260709 12:12:22.186450 20678 log.cc:927] Time spent T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
W20260709 12:12:22.194293 20676 log.cc:927] Time spent T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
W20260709 12:12:22.173360 20271 consensus_meta.cc:287] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db: Time spent flushing consensus metadata: real 0.551s	user 0.010s	sys 0.000s
W20260709 12:12:22.220732 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 53266.1us
W20260709 12:12:22.226542 20648 log.cc:927] Time spent T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:12:22.220407 14187 raft_consensus.cc:2468] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 19.
I20260709 12:12:22.194262 20227 leader_election.cc:290] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:22.148890 20517 raft_consensus.cc:515] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:22.182664 20652 leader_election.cc:290] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 16 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:22.178828 20545 leader_election.cc:290] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:22.187260 20143 leader_election.cc:290] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:22.187485 20470 leader_election.cc:290] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:22.238891 14155 leader_election.cc:304] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:22.224404 14303 leader_election.cc:304] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:22.183233 20492 raft_consensus.cc:515] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:22.174125 20553 raft_consensus.cc:515] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:22.184149 20637 raft_consensus.cc:515] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:22.252404 14155 leader_election.cc:400] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 13 election: Vote denied by peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673) with higher term. Message: Invalid argument: T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 13. Current term is 14.
I20260709 12:12:22.253377 14155 leader_election.cc:403] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 12:12:22.235939 20679 raft_consensus.cc:2804] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 12:12:22.255693 14337 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.001s	sys 0.016s
W20260709 12:12:22.256064 14337 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.558s	user 0.001s	sys 0.016s
I20260709 12:12:22.256623 14155 leader_election.cc:304] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:22.238404 20546 raft_consensus.cc:697] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 18 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:22.244055 20485 leader_election.cc:290] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:12:22.262648 14878 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.006s	sys 0.002s
I20260709 12:12:22.272780 14339 raft_consensus.cc:1240] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 19. Current term is 20. Ops: [19.11-19.11]
I20260709 12:12:22.274567 20553 leader_election.cc:290] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 20 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:22.280367 20517 leader_election.cc:290] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:22.263116 20227 raft_consensus.cc:2749] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673) with higher term. Message: Invalid argument: T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 13. Current term is 14.
I20260709 12:12:22.242481 20218 consensus_queue.cc:1059] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 12:12:22.243031 20271 raft_consensus.cc:515] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:22.285979 14155 leader_election.cc:400] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 election: Vote denied by peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673) with higher term. Message: Invalid argument: T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 17. Current term is 18.
W20260709 12:12:22.286062 14878 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.552s	user 0.006s	sys 0.002s
I20260709 12:12:22.301090 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:22.255486 20679 raft_consensus.cc:493] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:22.311510 14181 raft_consensus.cc:1275] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:12:22.255419 20652 raft_consensus.cc:2749] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:22.312857 14155 leader_election.cc:403] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 12:12:22.315419 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:22.332984 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:22.264967 20615 leader_election.cc:290] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:22.339928 14905 raft_consensus.cc:2368] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for earlier term 18. Current term is 19.
I20260709 12:12:22.340153 20271 leader_election.cc:290] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 19 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:22.340811 20546 consensus_queue.cc:237] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:22.345043 14186 raft_consensus.cc:1275] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:12:22.264766 20605 leader_election.cc:290] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:22.346235 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:22.346940 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:22.347360 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:22.348132 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:22.349464 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 22 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:22.350724 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:22.351431 14183 raft_consensus.cc:2468] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 16.
W20260709 12:12:22.351805 20666 log.cc:927] Time spent T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.234s	user 0.000s	sys 0.002s
I20260709 12:12:22.354671 20693 raft_consensus.cc:493] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:22.355244 20637 leader_election.cc:290] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:22.355682 20693 raft_consensus.cc:515] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:22.357758 20645 raft_consensus.cc:493] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:22.360651 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:22.360664 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:22.359303 14303 leader_election.cc:304] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:22.361631 14183 raft_consensus.cc:2393] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 21: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
W20260709 12:12:22.302429 20456 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.014s	sys 0.004s
I20260709 12:12:22.369799 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:22.285193 20470 raft_consensus.cc:2749] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:12:22.371964 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:22.381861 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:22.296403 20685 raft_consensus.cc:2804] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:22.331570 20679 raft_consensus.cc:3060] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:22.358428 20645 raft_consensus.cc:3060] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:22.362689 20650 raft_consensus.cc:493] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:22.372849 20456 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.574s	user 0.014s	sys 0.005s
I20260709 12:12:22.372002 20218 consensus_queue.cc:1243] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer 17aab1bbf5014936aa18cc21818b26ec log is divergent from this leader: its last log entry 16.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:12:22.393884 14303 leader_election.cc:304] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:22.394975 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:22.407586 20578 consensus_queue.cc:260] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:22.433172 20578 raft_consensus.cc:3060] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:22.377756 20517 raft_consensus.cc:493] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:22.434566 20517 raft_consensus.cc:515] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:22.416900 20476 leader_election.cc:290] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:22.385601 20682 raft_consensus.cc:2749] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673) with higher term. Message: Invalid argument: T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 17. Current term is 18.
I20260709 12:12:22.438743 20517 leader_election.cc:290] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:22.439836 20476 raft_consensus.cc:493] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:22.440653 20476 raft_consensus.cc:515] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:12:22.446143 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 52405.4us
I20260709 12:12:22.410054 20691 raft_consensus.cc:2749] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:12:22.443574 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 181105us
I20260709 12:12:22.451967 14230 leader_election.cc:304] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:22.457911 20682 raft_consensus.cc:493] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:22.458807 20682 raft_consensus.cc:515] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:22.462203 20682 leader_election.cc:290] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:22.422961 20530 raft_consensus.cc:515] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:12:22.425587 14154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:22.400844 20685 raft_consensus.cc:697] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 18 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
W20260709 12:12:22.427608 20537 consensus_meta.cc:287] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.621s	user 0.011s	sys 0.000s
I20260709 12:12:22.428745 20693 leader_election.cc:290] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:22.430207 14876 leader_election.cc:304] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
W20260709 12:12:22.398461 20585 consensus_meta.cc:287] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db: Time spent flushing consensus metadata: real 0.832s	user 0.014s	sys 0.000s
I20260709 12:12:22.411146 20689 raft_consensus.cc:493] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
W20260709 12:12:22.464897 20035 consensus_meta.cc:287] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.532s	user 0.013s	sys 0.000s
I20260709 12:12:22.467408 14303 leader_election.cc:304] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:22.480805 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:22.481963 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:12:22.464643 20630 consensus_meta.cc:287] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.728s	user 0.013s	sys 0.000s
W20260709 12:12:22.474536 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 44429.2us
I20260709 12:12:22.478621 20585 raft_consensus.cc:515] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:22.483987 20605 raft_consensus.cc:2804] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:22.463977 20517 raft_consensus.cc:2749] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:22.483807 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:22.495115 12986 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:12:22.500176 20476 leader_election.cc:290] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:22.510923 14188 raft_consensus.cc:2468] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 19.
I20260709 12:12:22.503993 20689 raft_consensus.cc:515] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:22.517568 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:22.474133 20615 consensus_queue.cc:1048] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.014s
I20260709 12:12:22.505630 20642 raft_consensus.cc:3055] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:22.483196 20697 raft_consensus.cc:2804] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:22.509722 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:22.447688 20650 raft_consensus.cc:515] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:22.515272 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:22.516995 14906 raft_consensus.cc:1275] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:12:22.472414 20682 raft_consensus.cc:493] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:22.435426 20572 raft_consensus.cc:515] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:22.568092 20689 leader_election.cc:290] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:22.579267 14189 raft_consensus.cc:3060] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:22.464790 14911 raft_consensus.cc:1240] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 18 LEADER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 12:12:22.507548 20585 leader_election.cc:290] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 19 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:22.479439 20035 raft_consensus.cc:515] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:22.612906 14262 raft_consensus.cc:2468] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 18.
I20260709 12:12:22.520594 20605 raft_consensus.cc:493] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:22.477386 20537 raft_consensus.cc:515] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:22.525040 20642 raft_consensus.cc:740] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:22.620579 20642 consensus_queue.cc:260] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:22.622313 20642 raft_consensus.cc:3060] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:22.474375 20692 consensus_queue.cc:1048] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.115s
I20260709 12:12:22.626211 20605 raft_consensus.cc:3060] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:22.628212 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:22.590332 20470 raft_consensus.cc:493] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:22.609850 20492 leader_election.cc:290] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:22.597573 20517 raft_consensus.cc:493] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:22.607306 14903 raft_consensus.cc:1275] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:12:22.618152 20685 consensus_queue.cc:237] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:22.646917 12986 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:22.650429 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:12:22.652153 20487 consensus_meta.cc:287] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db: Time spent flushing consensus metadata: real 0.687s	user 0.011s	sys 0.003s
I20260709 12:12:22.652750 20487 raft_consensus.cc:515] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:22.597389 20697 raft_consensus.cc:697] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 19 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
W20260709 12:12:22.598001 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 312172us
I20260709 12:12:22.656333 14184 raft_consensus.cc:1240] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:22.604485 20682 raft_consensus.cc:515] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:22.648777 20406 raft_consensus.cc:515] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:22.664076 14189 raft_consensus.cc:2468] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 19.
I20260709 12:12:22.670948 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:22.672427 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:22.673022 14330 raft_consensus.cc:3060] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:22.672665 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:22.674510 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:22.668110 14334 raft_consensus.cc:1240] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 20. Current term is 21. Ops: [20.9-20.9]
I20260709 12:12:22.673245 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:22.680095 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:12:22.672923 14155 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.174.131:45957 timed out after 1.786s (SENT) [suppressed 6 similar messages]
I20260709 12:12:22.682821 20035 leader_election.cc:290] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 18 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:22.685724 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:22.686256 20711 raft_consensus.cc:493] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:22.687651 20645 raft_consensus.cc:515] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:22.689069 14331 raft_consensus.cc:1240] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 12:12:22.677948 14909 raft_consensus.cc:2393] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 16: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
I20260709 12:12:22.693665 14336 raft_consensus.cc:2468] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 15.
I20260709 12:12:22.680958 14334 raft_consensus.cc:2468] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 15.
I20260709 12:12:22.643754 20470 raft_consensus.cc:515] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:22.706336 20711 raft_consensus.cc:515] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:22.657924 20517 raft_consensus.cc:515] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:22.689699 20679 raft_consensus.cc:515] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:12:22.742717 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 69822.3us
I20260709 12:12:22.743830 20035 raft_consensus.cc:493] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:22.744431 20035 raft_consensus.cc:515] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:22.747992 14155 leader_election.cc:304] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:22.751370 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 20 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:22.755251 20711 leader_election.cc:290] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:22.756773 20487 leader_election.cc:290] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 16 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:22.758244 20650 leader_election.cc:290] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:22.731029 20697 consensus_queue.cc:237] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:22.734710 20530 leader_election.cc:290] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 21 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:22.763824 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:22.764349 20406 leader_election.cc:290] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:22.764788 14181 raft_consensus.cc:2393] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db in current term 16: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
W20260709 12:12:22.750250 20481 consensus_meta.cc:287] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.555s	user 0.006s	sys 0.008s
I20260709 12:12:22.766165 20470 leader_election.cc:290] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:22.766378 20682 leader_election.cc:290] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:22.766949 20572 leader_election.cc:290] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:22.769479 20679 leader_election.cc:290] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:22.766186 20481 raft_consensus.cc:515] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:22.771236 20537 leader_election.cc:290] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 21 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:12:22.770043 14878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:22.777135 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:22.778434 14330 raft_consensus.cc:2468] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 21.
I20260709 12:12:22.782064 14155 leader_election.cc:304] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:22.785020 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:22.786554 20035 leader_election.cc:290] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:22.764694 20517 leader_election.cc:290] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:22.789978 14155 leader_election.cc:304] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:12:22.779490 20578 raft_consensus.cc:493] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:12:22.781170 20711 raft_consensus.cc:2749] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:22.793936 20711 raft_consensus.cc:2804] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:22.790369 20035 raft_consensus.cc:2749] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:22.796757 20682 consensus_queue.cc:1059] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 12:12:22.796880 14155 leader_election.cc:304] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:22.796973 20711 raft_consensus.cc:493] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:22.842065 20711 raft_consensus.cc:3060] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:22.825935 20567 raft_consensus.cc:3055] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:22.791399 20578 raft_consensus.cc:515] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:22.797119 20685 consensus_queue.cc:1048] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.054s
I20260709 12:12:22.813659 20599 leader_election.cc:290] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:22.831708 14190 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56046 (request call id 2801) took 1160 ms. Trace:
I20260709 12:12:22.834139 20481 leader_election.cc:290] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 21 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:22.838418 20645 leader_election.cc:290] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:22.820106 20035 raft_consensus.cc:3060] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:22.839911 14303 leader_election.cc:304] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:22.840457 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:22.841236 20647 consensus_queue.cc:1059] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 18.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:12:22.854197 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:22.853894 14190 rpcz_store.cc:276] 0709 12:12:21.671340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:21.671497 (+   157us) service_pool.cc:224] Handling call
0709 12:12:21.671929 (+   432us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:12:21.703045 (+ 31116us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:21.703079 (+    34us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:12:21.703842 (+   763us) log.cc:844] Serialized 78 byte log entry
0709 12:12:21.897820 (+193978us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:12:21.916857 (+ 19037us) log.cc:844] Serialized 14 byte log entry
0709 12:12:21.917481 (+   624us) log.cc:844] Serialized 14 byte log entry
0709 12:12:21.917649 (+   168us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:21.917724 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:22.196307 (+278583us) spinlock_profiling.cc:243] Waited 7.24 ms on lock 0x7b4800270558. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f212c064aa1 00007f212c05bb37 00007f212c05b9ca 00007f212c15326f 00007f212c152f37 00007f212c16755c 00007f212c167508 00007f212c167488 00007f212c167443 00007f212c1666ec 00007f212b090a96
0709 12:12:22.660447 (+464140us) spinlock_profiling.cc:243] Waited 3.06 ms on lock 0x7b18004633c0. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f212cf16ab1 00007f212cf23281 00007f212401c2a6 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f212cf16ab1 00007f212cf23281 00007f212404e522 00007f21240507c1
0709 12:12:22.661038 (+   591us) spinlock_profiling.cc:243] Waited 10 ms on lock 0x7b18004633c0. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f212cf16ab1 00007f212cf23281 00007f212404e522 00007f21240507c1 00007f2124050779 00007f2124050709 00007f21240506d1 00007f212404f9cd 0000000000388634 0000000000388479 00007f212403183a
0709 12:12:22.802324 (+141286us) spinlock_profiling.cc:243] Waited 2.36 ms on lock 0x7b18004633c0. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f212cf16ab1 00007f212cf23281 00007f212404e3f3 00007f21240507c1 00007f2124050779 00007f2124050709 00007f21240506d1 00007f212404f9cd 0000000000388634 0000000000388479 00007f212403183a
0709 12:12:22.831445 (+ 29121us) raft_consensus.cc:1685] finished
0709 12:12:22.831471 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:22.831642 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39635,"prepare.queue_time_us":760487,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":82,"raft.queue_time_us":22517,"raft.run_cpu_time_us":12604,"raft.run_wall_time_us":496237,"spinlock_wait_cycles":52154496,"thread_start_us":120622,"threads_started":1,"wal-append.queue_time_us":218671}
I20260709 12:12:22.858465 14303 leader_election.cc:304] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:22.859442 14187 raft_consensus.cc:2468] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 18.
I20260709 12:12:22.853428 20567 raft_consensus.cc:740] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:22.801434 20605 raft_consensus.cc:515] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:22.852522 20578 leader_election.cc:290] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:22.862483 14303 leader_election.cc:304] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:22.864218 14303 leader_election.cc:304] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:22.864511 20567 consensus_queue.cc:260] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:22.858964 20599 raft_consensus.cc:2749] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:22.863590 20645 raft_consensus.cc:2749] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:22.881394 20537 raft_consensus.cc:2749] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:22.882311 20517 raft_consensus.cc:2749] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:22.881091 14338 raft_consensus.cc:2393] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 17: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:12:22.886237 20517 consensus_queue.cc:1048] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 12:12:22.885895 20645 consensus_queue.cc:1048] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.004s
I20260709 12:12:22.903739 20652 raft_consensus.cc:3055] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:22.904278 20652 raft_consensus.cc:740] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:12:22.907183 14335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 1225) took 1205 ms. Trace:
I20260709 12:12:22.907629 14335 rpcz_store.cc:276] 0709 12:12:21.701689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:21.702186 (+   497us) service_pool.cc:224] Handling call
0709 12:12:21.726048 (+ 23862us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:21.962561 (+236513us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:22.906907 (+944346us) spinlock_profiling.cc:243] Waited 206 ms on lock 0x7b540029e854. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:12:22.907112 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":473279360}
I20260709 12:12:22.916986 14876 leader_election.cc:304] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:22.905155 20652 consensus_queue.cc:260] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:22.919134 14876 leader_election.cc:304] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:22.919958 20578 raft_consensus.cc:2804] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:22.920540 20578 raft_consensus.cc:697] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 19 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:12:22.920789 20650 raft_consensus.cc:2804] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:22.919229 20652 raft_consensus.cc:3060] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:22.921236 20650 raft_consensus.cc:493] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:12:22.923909 20650 raft_consensus.cc:3060] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:22.924310 20239 raft_consensus.cc:3055] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:12:22.924748 20239 raft_consensus.cc:740] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:22.926117 20605 leader_election.cc:290] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 17 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:22.926716 20239 consensus_queue.cc:260] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:22.944656 14905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53194 (request call id 1120) took 1179 ms. Trace:
I20260709 12:12:22.934476 20239 raft_consensus.cc:3060] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:22.924808 20578 consensus_queue.cc:237] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:22.976409 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:22.977276 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:22.970043 14905 rpcz_store.cc:276] 0709 12:12:21.756316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:21.756737 (+   421us) service_pool.cc:224] Handling call
0709 12:12:22.936000 (+1179263us) spinlock_profiling.cc:243] Waited 486 ms on lock 0x7b5400748e54. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:12:22.936123 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1117117568}
I20260709 12:12:22.981173 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:22.990474 14185 raft_consensus.cc:3060] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:22.988020 14303 leader_election.cc:304] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:22.992462 20605 raft_consensus.cc:493] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:22.995477 20605 raft_consensus.cc:515] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:22.997690 20605 leader_election.cc:290] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:12:22.999338 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 702187us
W20260709 12:12:23.019785 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:23.021468 14339 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50856 (request call id 2710) took 1776 ms. Trace:
I20260709 12:12:23.021937 14339 rpcz_store.cc:276] 0709 12:12:21.245005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:21.615239 (+370234us) service_pool.cc:224] Handling call
0709 12:12:21.615586 (+   347us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:22.286367 (+670781us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:23.021130 (+734763us) spinlock_profiling.cc:243] Waited 657 ms on lock 0x7b54002823d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:12:23.021396 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1510733056}
I20260709 12:12:23.026961 14185 raft_consensus.cc:2468] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 17.
I20260709 12:12:23.027405 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:22.994087 20645 raft_consensus.cc:2804] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:23.029958 14303 leader_election.cc:304] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:23.032403 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 21 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:23.033401 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:23.034250 14186 raft_consensus.cc:2368] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 18. Current term is 19.
I20260709 12:12:23.034978 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:23.035245 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:23.036526 14186 raft_consensus.cc:2393] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 17: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:12:23.039553 14184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 3282) took 1281 ms. Trace:
I20260709 12:12:23.039577 14155 leader_election.cc:304] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:23.042183 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:23.042500 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:23.043135 14338 raft_consensus.cc:2376] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 17. Re-sending same reply.
I20260709 12:12:23.033897 20567 raft_consensus.cc:3060] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:23.040007 14184 rpcz_store.cc:276] 0709 12:12:21.757999 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:21.760852 (+  2853us) service_pool.cc:224] Handling call
0709 12:12:21.761146 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:22.662572 (+901426us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:23.039303 (+376731us) spinlock_profiling.cc:243] Waited 895 ms on lock 0x7b54002d1254. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:12:23.039483 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2058275072}
I20260709 12:12:23.047456 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:23.047948 14155 leader_election.cc:304] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:23.048557 14339 raft_consensus.cc:1240] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 20. Current term is 21. Ops: [20.9-20.9]
I20260709 12:12:23.050824 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:23.048758 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:23.051484 14185 raft_consensus.cc:3060] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:23.051846 14336 raft_consensus.cc:2468] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 16.
I20260709 12:12:23.034343 20645 raft_consensus.cc:493] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:23.045210 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 20 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:23.059639 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:23.060487 14333 raft_consensus.cc:3060] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:23.037504 20605 raft_consensus.cc:2804] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:23.051635 14155 leader_election.cc:304] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:23.057538 14339 raft_consensus.cc:1275] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:12:23.038060 20616 raft_consensus.cc:493] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:23.067651 14339 raft_consensus.cc:1240] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:23.070791 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 20 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:23.052153 20647 raft_consensus.cc:2804] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:23.083060 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:23.061276 20645 raft_consensus.cc:3060] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:23.089427 14331 raft_consensus.cc:2393] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db in current term 18: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:12:23.089835 14262 raft_consensus.cc:1275] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 12:12:23.052938 20720 consensus_queue.cc:1059] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 12:12:23.097545 14335 raft_consensus.cc:1240] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:23.098007 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:23.098801 14265 raft_consensus.cc:2468] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 15.
I20260709 12:12:23.099815 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:23.100083 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:23.100586 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:23.100682 14229 leader_election.cc:304] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:23.101018 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:23.101840 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:23.102295 14263 raft_consensus.cc:1240] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 15 LEADER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:23.089051 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:23.091655 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:23.052083 20711 raft_consensus.cc:515] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:23.111291 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:23.111963 14256 raft_consensus.cc:2468] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 15.
I20260709 12:12:23.094028 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:23.094406 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:23.103264 14257 raft_consensus.cc:2468] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 18.
I20260709 12:12:23.115742 14264 raft_consensus.cc:1240] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 20. Current term is 21. Ops: [20.9-20.9]
I20260709 12:12:23.098814 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:23.118505 20044 consensus_queue.cc:1048] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:23.119091 20143 raft_consensus.cc:493] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:23.119762 20143 raft_consensus.cc:515] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:23.120525 20685 raft_consensus.cc:3055] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:12:23.120911 20685 raft_consensus.cc:740] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:12:23.121830 20685 consensus_queue.cc:260] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 20.9, Last appended by leader: 9, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:23.122778 20685 raft_consensus.cc:3060] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:23.122936 20035 raft_consensus.cc:2749] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:12:23.125607 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 673670us
I20260709 12:12:23.127184 20546 raft_consensus.cc:493] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:23.127749 20546 raft_consensus.cc:515] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:23.129635 20596 raft_consensus.cc:3060] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:23.130260 20637 raft_consensus.cc:2749] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:23.131619 14229 leader_election.cc:304] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:23.062601 20537 consensus_queue.cc:1059] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 12:12:23.064844 20369 consensus_queue.cc:1048] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.031s
I20260709 12:12:23.132800 14229 leader_election.cc:304] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:23.133769 20591 raft_consensus.cc:2749] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:12:23.069308 20487 consensus_queue.cc:1048] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.038s
I20260709 12:12:23.069676 20682 raft_consensus.cc:2804] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:12:23.135766 20481 raft_consensus.cc:493] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:23.136313 20481 raft_consensus.cc:515] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:23.110783 20380 raft_consensus.cc:493] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:23.138487 20481 leader_election.cc:290] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:23.138355 20380 raft_consensus.cc:515] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:23.140719 20380 leader_election.cc:290] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:23.143194 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 21 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:23.103762 14258 raft_consensus.cc:2393] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 16: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:12:23.102403 14261 raft_consensus.cc:3060] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:23.104683 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:23.101686 14330 raft_consensus.cc:2468] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 15.
I20260709 12:12:23.110587 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:23.133951 14229 leader_election.cc:304] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:23.147097 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:23.147114 14262 raft_consensus.cc:3060] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:23.147635 14260 raft_consensus.cc:2393] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 17: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:12:23.088914 20647 raft_consensus.cc:493] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:23.088886 20605 raft_consensus.cc:697] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 17 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:23.149973 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:23.151942 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:23.162182 14330 raft_consensus.cc:3060] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:23.162742 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:12:23.163166 14230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:23.163403 14188 raft_consensus.cc:2468] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 15.
I20260709 12:12:23.151137 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:23.155025 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:23.165946 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:23.166440 14260 raft_consensus.cc:3060] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:23.166894 14264 raft_consensus.cc:3060] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:23.095736 14333 raft_consensus.cc:2468] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 19.
I20260709 12:12:23.167361 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 21 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:23.090236 20692 raft_consensus.cc:493] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:23.167449 14303 leader_election.cc:304] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:23.168154 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:23.168421 14335 raft_consensus.cc:2393] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 21: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:12:23.168423 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:23.159993 14185 raft_consensus.cc:2468] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 16.
I20260709 12:12:23.174376 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:23.161824 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:23.137557 20537 raft_consensus.cc:3055] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:23.082208 20616 raft_consensus.cc:515] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:23.178723 14258 raft_consensus.cc:1275] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 13. (term mismatch)
I20260709 12:12:23.135962 20682 raft_consensus.cc:697] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 21 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:12:23.134459 20591 raft_consensus.cc:2749] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:23.087805 20577 consensus_queue.cc:1048] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.073s
I20260709 12:12:23.161427 20647 raft_consensus.cc:3060] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:23.210347 14265 raft_consensus.cc:1240] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:23.194788 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:23.171973 20637 raft_consensus.cc:2749] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:23.195699 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 22 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:23.214705 14263 raft_consensus.cc:2410] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for term 22 because replica has last-logged OpId of term: 20 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 9.
I20260709 12:12:23.198958 14264 raft_consensus.cc:2468] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 19.
I20260709 12:12:23.201771 14229 leader_election.cc:400] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 election: Vote denied by peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187) with higher term. Message: Invalid argument: T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 18. Current term is 19.
I20260709 12:12:23.113814 20533 raft_consensus.cc:493] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:23.215885 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:23.197759 14330 raft_consensus.cc:2468] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 16.
I20260709 12:12:23.216466 20533 raft_consensus.cc:515] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:23.195179 14258 pending_rounds.cc:85] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec: Aborting all ops after (but not including) 12
I20260709 12:12:23.217507 14258 pending_rounds.cc:107] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec: Aborting uncommitted NO_OP operation due to leader change: 17.13
I20260709 12:12:23.217849 14258 raft_consensus.cc:2889] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:23.153532 20703 raft_consensus.cc:493] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:23.218852 20533 leader_election.cc:290] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:23.218595 20703 raft_consensus.cc:515] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:23.217593 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:23.221221 20703 leader_election.cc:290] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:23.214588 14334 raft_consensus.cc:1275] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:12:23.216218 14229 leader_election.cc:403] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
W20260709 12:12:23.208181 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 112954us
W20260709 12:12:23.213873 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 149342us
I20260709 12:12:23.223495 14155 leader_election.cc:304] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:12:23.224154 20727 raft_consensus.cc:2804] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:23.224696 20727 raft_consensus.cc:697] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 17 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:12:23.177487 20630 raft_consensus.cc:2764] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 12:12:23.231154 14877 leader_election.cc:304] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:23.234138 14230 leader_election.cc:304] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:23.235097 14261 raft_consensus.cc:2468] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 18.
I20260709 12:12:23.235204 14230 leader_election.cc:304] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:23.235914 14264 raft_consensus.cc:1240] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:23.224582 14155 leader_election.cc:304] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:23.191701 20530 raft_consensus.cc:493] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:23.178076 20705 raft_consensus.cc:493] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:23.193336 20537 raft_consensus.cc:740] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:23.240079 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:23.199837 20476 raft_consensus.cc:2804] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:23.249014 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:23.253794 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:23.254271 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:23.254637 14261 raft_consensus.cc:2393] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 17: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:12:23.196048 20546 leader_election.cc:290] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:23.202482 20492 raft_consensus.cc:493] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:23.248265 20271 raft_consensus.cc:493] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:23.293653 14907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:23.266537 20705 raft_consensus.cc:515] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:12:23.269395 20722 log.cc:927] Time spent T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:12:23.239285 20704 raft_consensus.cc:493] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:23.250705 20621 raft_consensus.cc:2749] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:23.213485 20143 leader_election.cc:290] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:12:23.284157 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 49033.6us
I20260709 12:12:23.239533 20487 raft_consensus.cc:2749] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:23.311702 14230 leader_election.cc:304] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:23.226999 20650 raft_consensus.cc:515] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:23.314716 20650 leader_election.cc:290] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 18 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:23.294219 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:23.294866 14907 raft_consensus.cc:2393] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 19: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
I20260709 12:12:23.298439 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:12:23.306854 14878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:23.210220 20481 raft_consensus.cc:493] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:23.319519 20481 raft_consensus.cc:515] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:23.304215 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:23.322899 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:23.323668 14264 raft_consensus.cc:2468] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 16.
I20260709 12:12:23.324867 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:23.308040 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:23.330168 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:23.330484 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:23.331158 14904 raft_consensus.cc:2468] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 14.
I20260709 12:12:23.330224 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:23.337366 20546 raft_consensus.cc:493] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:23.242172 20380 consensus_queue.cc:1059] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.066s
I20260709 12:12:23.202845 20692 raft_consensus.cc:515] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:23.338582 20380 raft_consensus.cc:3055] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:23.339097 20380 raft_consensus.cc:740] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:23.340555 20692 leader_election.cc:290] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:23.273623 20476 raft_consensus.cc:493] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:23.341507 14258 raft_consensus.cc:2468] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 18.
I20260709 12:12:23.343189 14332 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 1228) took 1311 ms. Trace:
I20260709 12:12:23.343860 14230 leader_election.cc:304] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:23.347064 14303 leader_election.cc:400] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 election: Vote denied by peer 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341) with higher term. Message: Invalid argument: T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for earlier term 18. Current term is 19.
I20260709 12:12:23.355799 14303 leader_election.cc:403] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
I20260709 12:12:23.355682 14877 leader_election.cc:304] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:23.356859 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 21 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:23.354456 14332 rpcz_store.cc:276] 0709 12:12:22.032018 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:22.032188 (+   170us) service_pool.cc:224] Handling call
0709 12:12:22.032558 (+   370us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:22.939207 (+906649us) spinlock_profiling.cc:243] Waited 19 ms on lock 0x7b180034f1e0. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f212cf16ab1 00007f212cf23281 00007f2126ce34bc 00007f212403148b 00007f212ce8b9a9 00007f212404d69b 00007f212404b93f 00007f212404b455 00007f2127133060 00007f2127133bfb 00007f212713e64b
0709 12:12:22.939359 (+   152us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:22.939386 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:22.940351 (+   965us) log.cc:844] Serialized 26 byte log entry
0709 12:12:23.037601 (+ 97250us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:23.037643 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:23.037756 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:23.342823 (+305067us) raft_consensus.cc:1685] finished
0709 12:12:23.342850 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:23.343110 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1861,"raft.queue_time_us":82091,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":6110,"spinlock_wait_cycles":43674880,"thread_start_us":170494,"threads_started":2,"wal-append.queue_time_us":167084}
I20260709 12:12:23.357998 14261 raft_consensus.cc:2468] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 15.
I20260709 12:12:23.364823 14907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:23.340107 20380 consensus_queue.cc:260] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:23.300077 20504 raft_consensus.cc:2804] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:23.369107 14907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:23.381505 14907 raft_consensus.cc:2468] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 14.
I20260709 12:12:23.373853 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:23.387192 14303 leader_election.cc:304] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:12:23.378360 14265 raft_consensus.cc:2393] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 21: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:12:23.238878 20673 consensus_queue.cc:1059] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.094s
I20260709 12:12:23.344101 20706 raft_consensus.cc:2749] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:12:23.392912 14262 raft_consensus.cc:2468] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 16.
I20260709 12:12:23.400018 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:23.401244 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:23.252835 20530 raft_consensus.cc:515] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:23.385269 14304 leader_election.cc:304] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:23.395291 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 20 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:23.298485 20296 consensus_queue.cc:1059] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.089s
W20260709 12:12:23.398015 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 54251.1us
I20260709 12:12:23.357883 20476 raft_consensus.cc:3060] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:23.418843 14304 leader_election.cc:304] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:23.301086 20492 raft_consensus.cc:515] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:23.434911 14304 leader_election.cc:304] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:23.380789 20692 raft_consensus.cc:2749] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341) with higher term. Message: Invalid argument: T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for earlier term 18. Current term is 19.
W20260709 12:12:23.383535 20723 log.cc:927] Time spent T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 12:12:23.392866 20646 raft_consensus.cc:493] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:23.430377 14230 leader_election.cc:304] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:23.454284 14230 leader_election.cc:304] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:12:23.376807 20693 raft_consensus.cc:493] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:23.306087 20271 raft_consensus.cc:515] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:23.338006 20546 raft_consensus.cc:515] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:12:23.413264 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 188713us
I20260709 12:12:23.383966 20504 raft_consensus.cc:493] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:23.449991 14256 raft_consensus.cc:1275] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:12:23.337931 20537 consensus_queue.cc:260] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:23.411401 20533 raft_consensus.cc:2804] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:23.413090 20720 raft_consensus.cc:2804] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:23.421713 20567 raft_consensus.cc:2749] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:12:23.405637 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:23.451098 20642 raft_consensus.cc:493] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:23.499994 14265 raft_consensus.cc:2393] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 14: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:12:23.428622 20596 raft_consensus.cc:2749] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:23.422009 20610 raft_consensus.cc:493] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:23.430954 20380 raft_consensus.cc:3060] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:12:23.465410 14154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:23.299715 20605 consensus_queue.cc:237] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:23.473111 20504 raft_consensus.cc:3060] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:23.334249 20704 raft_consensus.cc:515] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:23.428907 20406 raft_consensus.cc:2749] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:23.452962 20585 raft_consensus.cc:2749] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:12:23.376952 20682 consensus_queue.cc:237] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:23.459403 20621 raft_consensus.cc:2749] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
W20260709 12:12:23.504042 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 148441us
W20260709 12:12:23.397547 20703 consensus_queue.cc:1175] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "885067a0d31741bfb5c9935788e315bf" responder_term: 17 status { last_received { term: 17 index: 10 } last_committed_idx: 10 last_received_current_leader { term: 17 index: 10 } }
I20260709 12:12:23.501123 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:23.516633 14877 leader_election.cc:304] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:12:23.509670 14155 leader_election.cc:304] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:23.436286 20517 raft_consensus.cc:2749] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:12:23.518440 20547 raft_consensus.cc:2804] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:23.496040 20720 raft_consensus.cc:493] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:23.464736 20692 raft_consensus.cc:2749] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:23.511973 20537 raft_consensus.cc:3060] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:23.472143 20693 raft_consensus.cc:515] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:12:23.522135 20726 log.cc:927] Time spent T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.145s	user 0.000s	sys 0.001s
I20260709 12:12:23.522899 20739 raft_consensus.cc:493] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:23.527303 14154 leader_election.cc:304] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
W20260709 12:12:23.576014 14154 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 48844.3us
I20260709 12:12:23.528025 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:23.578110 14265 raft_consensus.cc:2393] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 17: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:12:23.502943 20589 raft_consensus.cc:2804] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:23.499807 20711 leader_election.cc:290] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:23.480144 20533 raft_consensus.cc:493] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
W20260709 12:12:23.537878 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 83689.9us
I20260709 12:12:23.504377 20642 raft_consensus.cc:515] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:23.462210 20646 raft_consensus.cc:515] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:23.510789 20610 raft_consensus.cc:515] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:23.442023 20727 consensus_queue.cc:237] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:23.537420 20720 raft_consensus.cc:3060] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:23.559197 20530 leader_election.cc:290] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:12:23.554860 14081 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44116 (request call id 161) took 15876 ms (client timeout 15000 ms). Trace:
I20260709 12:12:23.591738 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
W20260709 12:12:23.572431 20736 log.cc:927] Time spent T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 12:12:23.610075 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:12:23.573057 20652 consensus_meta.cc:287] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.646s	user 0.012s	sys 0.000s
I20260709 12:12:23.608908 20533 raft_consensus.cc:3060] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:23.549787 14087 catalog_manager.cc:5697] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf reported cstate change: term changed from 5 to 11. New cstate: current_term: 11 leader_uuid: "885067a0d31741bfb5c9935788e315bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:23.541395 14155 leader_election.cc:304] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:23.539534 20702 raft_consensus.cc:493] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
W20260709 12:12:23.639662 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:23.564572 20743 raft_consensus.cc:493] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:23.667773 14189 raft_consensus.cc:2410] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for term 19 because replica has last-logged OpId of term: 17 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 8.
I20260709 12:12:23.614940 20589 raft_consensus.cc:697] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 16 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:23.539963 20737 raft_consensus.cc:493] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:23.554195 20546 leader_election.cc:290] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:23.606751 20683 raft_consensus.cc:3055] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:23.532240 20585 consensus_queue.cc:1048] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.088s
W20260709 12:12:23.656519 14305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:23.658322 14332 raft_consensus.cc:2393] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db in current term 18: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:12:23.615283 20547 raft_consensus.cc:697] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 19 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:12:23.619823 20711 raft_consensus.cc:2804] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:23.684721 20738 raft_consensus.cc:493] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:23.699714 14087 catalog_manager.cc:5697] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf reported cstate change: term changed from 7 to 8, leader changed from 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130) to 885067a0d31741bfb5c9935788e315bf (127.12.174.129). New cstate: current_term: 8 leader_uuid: "885067a0d31741bfb5c9935788e315bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } }
W20260709 12:12:23.700191 20685 consensus_meta.cc:287] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.577s	user 0.013s	sys 0.002s
I20260709 12:12:23.610188 20645 raft_consensus.cc:515] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:23.757104 20645 leader_election.cc:290] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 20 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:23.619026 20621 consensus_queue.cc:1048] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.056s
W20260709 12:12:23.679330 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 244508us
I20260709 12:12:23.760166 14304 leader_election.cc:304] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:23.699302 20589 consensus_queue.cc:237] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:23.606292 20739 raft_consensus.cc:515] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:23.724153 14259 raft_consensus.cc:2468] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 21.
I20260709 12:12:23.678359 20744 raft_consensus.cc:2749] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:23.815125 20739 leader_election.cc:290] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:23.538713 14260 raft_consensus.cc:2468] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 19.
I20260709 12:12:23.694393 20734 raft_consensus.cc:493] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:23.760723 14183 raft_consensus.cc:2410] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for term 21 because replica has last-logged OpId of term: 20 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 8.
I20260709 12:12:23.753600 20652 raft_consensus.cc:2749] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:12:23.818207 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 99528.3us
I20260709 12:12:23.806947 20693 leader_election.cc:290] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:12:23.808163 20742 log.cc:927] Time spent T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 12:12:23.808434 20547 consensus_queue.cc:237] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:23.809458 20271 leader_election.cc:290] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:12:23.653483 14081 rpcz_store.cc:269] 0709 12:12:07.678153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:07.678456 (+   303us) service_pool.cc:224] Handling call
0709 12:12:07.847562 (+169106us) spinlock_profiling.cc:243] Waited 83.7 ms on lock 0x7b54002e3454. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a5090 00007f2127143f3a 00007f212cef9e9c 00007f212cff804e 00007f212b4b92a4 00007f212b4b9232 00007f212b4b9161 00007f212b4b90dc 00007f212b4b8392 00007f212547648c 00007f21254758c6
0709 12:12:23.554701 (+15707139us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:12:17.817480 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:12:17.841011 (+ 23531us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:12:17.841063 (+    52us) write_op.cc:435] Acquired schema lock
0709 12:12:17.841082 (+    19us) tablet.cc:662] Decoding operations
0709 12:12:17.909716 (+ 68634us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:12:17.982458 (+ 72742us) write_op.cc:641] Partition lock acquired for write op
0709 12:12:17.982546 (+    88us) tablet.cc:685] Acquiring locks for 17 operations
0709 12:12:18.038974 (+ 56428us) tablet.cc:701] Row locks acquired
0709 12:12:18.039026 (+    52us) write_op.cc:260] PREPARE: finished
0709 12:12:18.081080 (+ 42054us) write_op.cc:270] Start()
0709 12:12:18.159295 (+ 78215us) write_op.cc:276] Timestamp: P: 1783599138063755 usec, L: 0
0709 12:12:18.159373 (+    78us) op_driver.cc:348] REPLICATION: starting
0709 12:12:18.182851 (+ 23478us) log.cc:844] Serialized 6712 byte log entry
0709 12:12:19.061714 (+878863us) op_driver.cc:464] REPLICATION: finished
0709 12:12:19.840900 (+779186us) spinlock_profiling.cc:243] Waited 18.3 ms on lock 0x7b4400022b4c. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2123f74c85 00007f2123f756a2 00007f2126ce71db 00007f2126ce2aaf 00007f21240310ac 00007f212ce8b9a9 00007f212404d69b 00007f212404b93f 00007f212404dc02 00007f212ab71ef0
0709 12:12:20.186773 (+345873us) write_op.cc:301] APPLY: starting
0709 12:12:20.194677 (+  7904us) tablet.cc:1367] starting BulkCheckPresence
0709 12:12:20.460840 (+266163us) tablet.cc:1370] finished BulkCheckPresence
0709 12:12:20.460911 (+    71us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:12:20.727857 (+266946us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:12:20.728643 (+   786us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=34,key_file_lookups=34,delta_file_lookups=34,mrs_lookups=0
0709 12:12:20.728750 (+   107us) write_op.cc:312] APPLY: finished
0709 12:12:20.729622 (+   872us) log.cc:844] Serialized 156 byte log entry
0709 12:12:20.964324 (+234702us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:20.967279 (+  2955us) write_op.cc:454] Released schema lock
0709 12:12:20.967351 (+    72us) write_op.cc:341] FINISH: Updating metrics
0709 12:12:20.967827 (+   476us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:20.967855 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1104509,"reported_tablets":28,"spinlock_wait_cycles":192603392,"child_traces":[["op",{"apply.queue_time_us":1054416,"apply.run_cpu_time_us":42157,"apply.run_wall_time_us":830780,"cfile_cache_hit":70,"cfile_cache_hit_bytes":75323,"num_ops":17,"prepare.queue_time_us":123842,"prepare.run_cpu_time_us":25474,"prepare.run_wall_time_us":717925,"raft.queue_time_us":408740,"raft.run_cpu_time_us":23091,"raft.run_wall_time_us":1294513,"replication_time_us":884625,"spinlock_wait_cycles":42103680,"thread_start_us":1789224,"threads_started":5,"wal-append.queue_time_us":606165,"wal-append.run_cpu_time_us":43428,"wal-append.run_wall_time_us":2261360}]]}
I20260709 12:12:23.722424 20683 raft_consensus.cc:740] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:12:23.820462 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
W20260709 12:12:23.820724 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 60663.6us
I20260709 12:12:23.675917 20743 raft_consensus.cc:515] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:23.828177 14186 raft_consensus.cc:3060] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:23.673171 20702 raft_consensus.cc:515] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } }
W20260709 12:12:23.824185 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 193246us
I20260709 12:12:23.759359 20752 raft_consensus.cc:493] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:23.741469 20711 raft_consensus.cc:493] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:23.828558 14304 leader_election.cc:304] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:23.833756 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:23.836001 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:23.816475 20545 raft_consensus.cc:2749] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187) with higher term. Message: Invalid argument: T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 18. Current term is 19.
I20260709 12:12:23.707511 20737 raft_consensus.cc:515] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:12:23.841553 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 300261us
I20260709 12:12:23.845920 14087 catalog_manager.cc:5697] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf reported cstate change: term changed from 8 to 11, leader changed from 885067a0d31741bfb5c9935788e315bf (127.12.174.129) to 65c9c1653b3346b39a0e118540e6080c (127.12.174.131). New cstate: current_term: 11 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } }
W20260709 12:12:23.834513 20745 log.cc:927] Time spent T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.140s	user 0.000s	sys 0.001s
I20260709 12:12:23.860724 20652 consensus_queue.cc:1048] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:12:23.861521 14155 leader_election.cc:304] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:23.862533 20630 raft_consensus.cc:2749] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:23.839993 20751 raft_consensus.cc:493] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:23.843914 20711 raft_consensus.cc:3060] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:23.883694 14265 raft_consensus.cc:1275] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:12:23.863344 14155 leader_election.cc:304] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:23.886286 14087 catalog_manager.cc:5697] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } }
I20260709 12:12:23.760193 20738 raft_consensus.cc:515] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:23.877890 20754 raft_consensus.cc:493] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:23.890182 20727 raft_consensus.cc:2764] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260709 12:12:23.888211 14304 leader_election.cc:304] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:23.893079 14155 leader_election.cc:304] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:23.894205 14304 leader_election.cc:304] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:23.879732 20720 raft_consensus.cc:515] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:23.855931 20605 raft_consensus.cc:2749] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:12:23.877342 20647 consensus_meta.cc:287] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.648s	user 0.012s	sys 0.002s
I20260709 12:12:23.897282 14304 leader_election.cc:304] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:23.890116 20754 raft_consensus.cc:515] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:23.902020 14304 leader_election.cc:304] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:23.905314 14155 leader_election.cc:304] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:23.913429 14186 raft_consensus.cc:2468] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 20.
I20260709 12:12:23.917228 14304 leader_election.cc:304] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
W20260709 12:12:23.961704 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 44568.2us
I20260709 12:12:23.962538 14304 leader_election.cc:304] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:23.963855 20406 raft_consensus.cc:2749] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:23.964656 20406 raft_consensus.cc:2804] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:23.965035 20406 raft_consensus.cc:493] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:23.965420 20406 raft_consensus.cc:3060] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:23.966526 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:23.966607 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:23.826565 20734 raft_consensus.cc:515] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:23.977639 20642 leader_election.cc:290] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:23.866942 20683 consensus_queue.cc:260] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:23.899412 20610 leader_election.cc:290] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:23.881520 20737 leader_election.cc:290] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:23.927181 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:23.933212 20650 raft_consensus.cc:3055] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:23.933703 14303 leader_election.cc:304] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:23.924139 20739 raft_consensus.cc:493] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:24.024478 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:23.943522 20754 leader_election.cc:290] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:23.944658 20720 leader_election.cc:290] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:23.925150 20605 raft_consensus.cc:2749] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:24.026964 20605 raft_consensus.cc:493] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:24.027474 20605 raft_consensus.cc:515] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:23.920305 20647 raft_consensus.cc:515] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:23.914788 20727 raft_consensus.cc:2749] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:23.952450 20743 leader_election.cc:290] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:23.843384 20752 raft_consensus.cc:515] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:12:23.922164 20755 log.cc:927] Time spent T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.136s	user 0.001s	sys 0.001s
I20260709 12:12:23.953982 20646 leader_election.cc:290] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:23.958760 20705 leader_election.cc:290] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:23.959728 20738 leader_election.cc:290] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:23.900879 20693 raft_consensus.cc:2749] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:23.895803 20761 raft_consensus.cc:2749] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:12:23.921038 14155 leader_election.cc:304] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:23.915357 20517 raft_consensus.cc:2749] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:12:23.978583 20760 raft_consensus.cc:493] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:23.921203 20645 raft_consensus.cc:2804] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:23.987183 14186 raft_consensus.cc:1240] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 18. Current term is 19. Ops: []
W20260709 12:12:23.980213 14230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:23.922914 20630 raft_consensus.cc:2749] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:23.882018 20751 raft_consensus.cc:515] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:23.984057 20545 raft_consensus.cc:493] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:23.993324 20476 consensus_meta.cc:287] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.550s	user 0.012s	sys 0.000s
I20260709 12:12:23.993022 20652 consensus_queue.cc:1059] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:12:23.998579 20704 leader_election.cc:290] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:23.999455 20504 raft_consensus.cc:515] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:24.009931 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:24.010804 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:24.010985 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:24.014680 14257 raft_consensus.cc:1240] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 20. Current term is 21. Ops: []
I20260709 12:12:24.018510 14262 raft_consensus.cc:2468] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 18.
I20260709 12:12:24.024979 20739 raft_consensus.cc:515] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:24.030684 14909 raft_consensus.cc:1240] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 19 LEADER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:24.031244 14181 raft_consensus.cc:1275] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:12:24.032683 14229 leader_election.cc:304] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:24.036849 14188 raft_consensus.cc:1275] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:12:24.029553 20605 leader_election.cc:290] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:24.051924 20693 raft_consensus.cc:493] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:24.023731 20650 raft_consensus.cc:740] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:12:24.053372 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:24.097817 14184 raft_consensus.cc:2393] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 19: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:12:24.054330 14185 raft_consensus.cc:1240] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 15. Current term is 16. Ops: []
W20260709 12:12:24.059357 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 138414us
I20260709 12:12:24.070410 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:24.102005 14264 raft_consensus.cc:2468] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 15.
I20260709 12:12:24.043497 20711 raft_consensus.cc:515] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:24.034415 20758 raft_consensus.cc:493] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:24.073096 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:24.103327 14187 raft_consensus.cc:2468] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 14.
W20260709 12:12:24.085170 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 52566.9us
I20260709 12:12:24.105374 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:24.078591 14190 raft_consensus.cc:2368] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 19. Current term is 20.
I20260709 12:12:24.106177 14336 raft_consensus.cc:3060] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:24.068882 20727 raft_consensus.cc:2804] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:24.055537 20645 raft_consensus.cc:493] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:24.062415 20738 raft_consensus.cc:493] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:24.077404 20705 raft_consensus.cc:493] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:24.078518 20761 raft_consensus.cc:2749] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:24.105072 14229 leader_election.cc:304] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:12:24.090785 20652 consensus_queue.cc:1243] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Peer 17aab1bbf5014936aa18cc21818b26ec log is divergent from this leader: its last log entry 15.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:12:24.116583 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:24.119200 14337 raft_consensus.cc:1275] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:12:24.115571 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:24.121958 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:24.123811 14186 raft_consensus.cc:1240] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:24.077111 20476 raft_consensus.cc:515] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:24.115355 14338 raft_consensus.cc:1240] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 12:12:24.090587 20704 raft_consensus.cc:2749] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:24.076727 20545 raft_consensus.cc:515] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:24.110905 14155 leader_election.cc:304] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:24.127923 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:12:24.128401 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 201975us
I20260709 12:12:24.133045 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:24.069278 20760 raft_consensus.cc:515] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:24.112149 20645 raft_consensus.cc:3060] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:24.143867 14336 raft_consensus.cc:2468] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 19.
W20260709 12:12:24.126562 20537 consensus_meta.cc:287] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.552s	user 0.013s	sys 0.000s
I20260709 12:12:24.145720 14261 raft_consensus.cc:2468] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 18.
I20260709 12:12:24.144519 14155 leader_election.cc:304] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:24.149042 20545 leader_election.cc:290] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:24.145490 20748 consensus_queue.cc:1048] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 12:12:24.149784 20748 consensus_queue.cc:1243] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer 885067a0d31741bfb5c9935788e315bf log is divergent from this leader: its last log entry 17.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:12:24.145426 20706 consensus_queue.cc:1048] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.007s
I20260709 12:12:24.145642 20720 raft_consensus.cc:2804] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:24.145236 14229 leader_election.cc:304] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:24.155021 20739 leader_election.cc:290] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:24.157467 20711 leader_election.cc:290] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 16 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:24.127122 20610 raft_consensus.cc:2804] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:24.115031 20727 raft_consensus.cc:697] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 18 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:12:24.125708 20616 leader_election.cc:290] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:24.163703 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:24.148795 20504 leader_election.cc:290] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:24.100867 20693 raft_consensus.cc:515] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:12:24.166932 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 233335us
I20260709 12:12:24.173122 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:24.176591 14260 raft_consensus.cc:3060] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Advancing to term 20
I20260709 12:12:24.182166 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:24.180285 14303 leader_election.cc:304] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:24.127280 20642 consensus_queue.cc:1059] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.041s
I20260709 12:12:24.192266 14155 leader_election.cc:304] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:24.186430 14260 raft_consensus.cc:2468] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 20.
I20260709 12:12:24.118038 20705 raft_consensus.cc:515] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:24.196985 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:24.189348 14181 raft_consensus.cc:2393] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 19: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:12:24.117841 20738 raft_consensus.cc:515] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:24.169037 20610 raft_consensus.cc:493] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:12:24.208333 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 63216.3us
I20260709 12:12:24.173908 20711 raft_consensus.cc:2749] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:24.203043 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:24.205474 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:24.206892 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:24.213611 14332 raft_consensus.cc:2393] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 20: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:12:24.110795 20758 raft_consensus.cc:515] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:24.209578 14229 leader_election.cc:400] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 pre-election: Vote denied by peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187) with higher term. Message: Invalid argument: T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 19. Current term is 20.
I20260709 12:12:24.189086 20720 raft_consensus.cc:697] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 16 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:12:24.225327 14229 leader_election.cc:403] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:12:24.185446 20406 raft_consensus.cc:515] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:24.202872 20517 raft_consensus.cc:2804] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:24.237247 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:24.236964 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:24.170324 20533 raft_consensus.cc:515] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:24.244117 20533 leader_election.cc:290] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:24.244781 20406 leader_election.cc:290] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:24.238839 20748 raft_consensus.cc:2749] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: Vote denied by peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187) with higher term. Message: Invalid argument: T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 19. Current term is 20.
I20260709 12:12:24.215420 20743 raft_consensus.cc:2804] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Leader election won for term 19
W20260709 12:12:24.213861 20777 log.cc:927] Time spent T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.054s	user 0.002s	sys 0.000s
I20260709 12:12:24.247179 14186 pending_rounds.cc:85] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf: Aborting all ops after (but not including) 8
I20260709 12:12:24.259696 14186 pending_rounds.cc:107] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf: Aborting uncommitted NO_OP operation due to leader change: 17.9
I20260709 12:12:24.260095 14186 raft_consensus.cc:2889] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:24.212478 20610 raft_consensus.cc:3060] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:24.248386 14181 raft_consensus.cc:2393] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 15: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:12:24.184258 20744 consensus_queue.cc:1048] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.053s
I20260709 12:12:24.203977 20642 consensus_queue.cc:1243] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer 73d01e9b1a9d49358da4985b21d681db log is divergent from this leader: its last log entry 19.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 12:12:24.225275 20737 raft_consensus.cc:493] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
W20260709 12:12:24.240818 20765 log.cc:927] Time spent T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 12:12:24.180150 20650 consensus_queue.cc:260] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:24.214758 20296 raft_consensus.cc:2804] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:24.269870 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:24.231582 20647 leader_election.cc:290] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 16 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:24.249042 20743 raft_consensus.cc:697] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 19 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:12:24.333636 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:24.321163 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:24.318934 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:24.319871 14155 leader_election.cc:304] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
W20260709 12:12:24.315649 20740 log.cc:927] Time spent T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.619s	user 0.005s	sys 0.000s
I20260709 12:12:24.311074 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:24.403419 14332 raft_consensus.cc:3060] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:24.403672 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:24.405385 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
W20260709 12:12:24.333565 14876 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:24.406973 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:12:24.407958 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 88201.4us
I20260709 12:12:24.410029 14155 leader_election.cc:304] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:24.411566 14155 leader_election.cc:304] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:24.413419 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:12:24.328440 20741 log.cc:927] Time spent T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.774s	user 0.000s	sys 0.002s
I20260709 12:12:24.419502 14155 leader_election.cc:304] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:24.246232 20545 consensus_queue.cc:1059] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 16.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.092s
I20260709 12:12:24.430066 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:24.430814 14260 raft_consensus.cc:3060] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:24.311765 20685 raft_consensus.cc:493] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:24.328877 20296 raft_consensus.cc:493] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:24.319801 20517 raft_consensus.cc:697] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 20 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:24.300348 20679 consensus_queue.cc:1059] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.129s
I20260709 12:12:24.442152 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:24.431962 20685 raft_consensus.cc:515] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:24.443424 14337 raft_consensus.cc:1275] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:12:24.443871 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:24.412176 20630 raft_consensus.cc:2749] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:24.445217 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:24.414819 20749 raft_consensus.cc:2749] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:24.443509 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:24.458658 14330 raft_consensus.cc:2468] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 14.
I20260709 12:12:24.422497 20650 raft_consensus.cc:3060] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:24.416306 20711 raft_consensus.cc:493] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:24.260317 20727 consensus_queue.cc:237] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:24.427778 20647 raft_consensus.cc:2749] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:12:24.451229 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:24.332341 20737 raft_consensus.cc:515] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:24.455353 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:24.433919 20760 leader_election.cc:290] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:24.442134 20296 raft_consensus.cc:3060] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:12:24.461473 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 53515.7us
I20260709 12:12:24.431385 14332 raft_consensus.cc:2468] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 16.
W20260709 12:12:24.497871 20778 log.cc:927] Time spent T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
I20260709 12:12:24.467519 14260 raft_consensus.cc:2468] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 19.
I20260709 12:12:24.500581 14260 raft_consensus.cc:1275] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:12:24.501353 20705 leader_election.cc:290] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:12:24.471443 14230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:24.447893 20476 leader_election.cc:290] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:24.477029 14334 raft_consensus.cc:2393] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 19: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
I20260709 12:12:24.478390 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:24.504743 14338 raft_consensus.cc:2393] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 19: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:12:24.472759 20693 leader_election.cc:290] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:24.482385 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:24.417867 20720 consensus_queue.cc:237] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:24.488224 14258 raft_consensus.cc:3055] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:24.506430 14258 raft_consensus.cc:740] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:24.507445 14258 consensus_queue.cc:260] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:24.511273 20737 leader_election.cc:290] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:24.473912 20711 raft_consensus.cc:515] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:24.513952 14258 raft_consensus.cc:3060] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:24.515693 20711 leader_election.cc:290] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:24.464038 20744 raft_consensus.cc:493] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:24.521279 14336 raft_consensus.cc:1240] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:24.528694 20744 raft_consensus.cc:515] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:24.531538 14263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41764 (request call id 3374) took 1406 ms. Trace:
I20260709 12:12:24.532018 14263 rpcz_store.cc:276] 0709 12:12:23.125349 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:23.220807 (+ 95458us) service_pool.cc:224] Handling call
0709 12:12:23.220998 (+   191us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:23.327644 (+106646us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:23.327684 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:23.327733 (+    49us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:12:23.327771 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:24.531252 (+1203481us) spinlock_profiling.cc:243] Waited 106 ms on lock 0x7b54003a0a54. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:12:24.531312 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:24.531473 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":244663552}
I20260709 12:12:24.533546 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:24.529049 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:24.535125 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:24.542549 14906 raft_consensus.cc:1240] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 19 LEADER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 18. Current term is 19. Ops: [18.15-18.15]
I20260709 12:12:24.546003 14258 raft_consensus.cc:1275] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 15. (term mismatch)
I20260709 12:12:24.548240 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:24.548741 14258 pending_rounds.cc:85] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec: Aborting all ops after (but not including) 14
I20260709 12:12:24.550592 14258 pending_rounds.cc:107] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec: Aborting uncommitted NO_OP operation due to leader change: 18.15
I20260709 12:12:24.553365 14258 raft_consensus.cc:2889] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:24.560315 14182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 3309) took 1621 ms. Trace:
I20260709 12:12:24.560786 14182 rpcz_store.cc:276] 0709 12:12:22.938705 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:22.987353 (+ 48648us) service_pool.cc:224] Handling call
0709 12:12:23.012913 (+ 25560us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:12:23.013488 (+   575us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:23.013520 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:12:23.014279 (+   759us) log.cc:844] Serialized 52 byte log entry
0709 12:12:23.301500 (+287221us) spinlock_profiling.cc:243] Waited 6.86 ms on lock 0x7b18000394c0. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f212cf16ab1 00007f212cf23281 00007f2124030e07 00007f212ce8b9a9 00007f212404d69b 00007f212404b93f 00007f212404dc02 00007f2126cd520b 00007f2126cdad23 00007f2126cdb0d1 00007f21270f6a0f
0709 12:12:23.480937 (+179437us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:23.480978 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:23.481649 (+   671us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:24.314632 (+832983us) spinlock_profiling.cc:243] Waited 4.36 ms on lock 0x7b4400022b4c. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2123f74c85 00007f2123f756a2 00007f2126ce71db 00007f2126ce2aaf 00007f2126cd686e 00007f2126cd5bb6 00007f2126cd57d8 00007f2126cdf221 00007f2126cdf1d9 00007f2126cdf169
0709 12:12:24.560054 (+245422us) raft_consensus.cc:1685] finished
0709 12:12:24.560078 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:24.560245 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2520,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":4385,"spinlock_wait_cycles":25821824,"thread_start_us":179151,"threads_started":1,"wal-append.queue_time_us":590654}
W20260709 12:12:24.563184 14183 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56044 (request call id 3312) took 1623 ms (client timeout 1778 ms). Trace:
W20260709 12:12:24.563763 14183 rpcz_store.cc:269] 0709 12:12:22.939538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:22.970102 (+ 30564us) service_pool.cc:224] Handling call
0709 12:12:23.143014 (+172912us) spinlock_profiling.cc:243] Waited 4.26 ms on lock 0x7b5800001298. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2124016b71 00007f2124016a22 00007f212cf2f8d9 00007f212c089ee0 00007f212c1530ab 00007f212c153131 00007f212c1010a0 00007f212c100984 00007f212567b6d4 00007f212567b662
0709 12:12:24.562902 (+1419888us) spinlock_profiling.cc:243] Waited 616 ms on lock 0x7b5400420c54. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:12:24.563076 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1427648512}
I20260709 12:12:24.503043 20758 leader_election.cc:290] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:24.565152 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:12:24.566697 20776 log.cc:927] Time spent T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.325s	user 0.001s	sys 0.000s
I20260709 12:12:24.567612 14265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53050 (request call id 1251) took 1035 ms. Trace:
I20260709 12:12:24.568608 20476 raft_consensus.cc:493] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:24.569394 20476 raft_consensus.cc:515] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:24.571467 20751 leader_election.cc:290] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:24.554728 20738 leader_election.cc:290] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:24.477003 20630 raft_consensus.cc:493] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:24.480404 20749 raft_consensus.cc:2749] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:12:24.558398 20517 consensus_queue.cc:237] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:24.563247 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:24.568071 14265 rpcz_store.cc:276] 0709 12:12:23.531732 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:23.607201 (+ 75469us) service_pool.cc:224] Handling call
0709 12:12:23.817842 (+210641us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:23.888498 (+ 70656us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:24.566273 (+677775us) spinlock_profiling.cc:243] Waited 65.4 ms on lock 0x7b54003813d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:12:24.567343 (+  1070us) spinlock_profiling.cc:243] Waited 210 ms on lock 0x7b54003813d0. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713a8ad 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:12:24.567517 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":633640192}
I20260709 12:12:24.605895 14183 raft_consensus.cc:1275] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 12:12:24.638733 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 220016us
I20260709 12:12:24.641930 14155 leader_election.cc:304] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:24.605521 20615 raft_consensus.cc:493] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:24.645792 14182 raft_consensus.cc:1275] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:12:24.646209 14155 leader_election.cc:304] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:24.637283 14181 raft_consensus.cc:2468] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 18.
I20260709 12:12:24.627864 20545 raft_consensus.cc:493] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:24.655085 20545 raft_consensus.cc:515] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:24.655687 20476 leader_election.cc:290] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:24.656883 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:24.594210 20630 raft_consensus.cc:515] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:24.659795 20545 leader_election.cc:290] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:24.660818 20683 raft_consensus.cc:3060] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:24.669549 20744 leader_election.cc:290] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:24.670948 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:24.671830 14338 raft_consensus.cc:2468] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 18.
I20260709 12:12:24.672181 20615 raft_consensus.cc:515] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:24.536664 20743 consensus_queue.cc:237] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:24.673064 14331 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 1244) took 1082 ms. Trace:
I20260709 12:12:24.678331 14876 leader_election.cc:304] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:24.680574 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:24.683562 14331 rpcz_store.cc:276] 0709 12:12:23.591137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:23.591873 (+   736us) service_pool.cc:224] Handling call
0709 12:12:23.625052 (+ 33179us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:23.625671 (+   619us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:23.625837 (+   166us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:23.641642 (+ 15805us) log.cc:844] Serialized 26 byte log entry
0709 12:12:24.511009 (+869367us) spinlock_profiling.cc:243] Waited 40.4 ms on lock 0x7b1800363580. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f212cf16ab1 00007f212cf23281 00007f2124030e07 00007f212ce8b9a9 00007f212404d69b 00007f212404b93f 00007f212404dc02 00007f2126cd520b 00007f2126cdad23 00007f2126cdb0d1 00007f21270f6a0f
0709 12:12:24.649253 (+138244us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:24.649297 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:24.649369 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:24.672692 (+ 23323us) raft_consensus.cc:1685] finished
0709 12:12:24.672717 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:24.672987 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6439,"raft.queue_time_us":21031,"raft.run_cpu_time_us":183,"raft.run_wall_time_us":9994,"spinlock_wait_cycles":92921600,"thread_start_us":138043,"threads_started":1,"wal-append.queue_time_us":953094}
I20260709 12:12:24.687224 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:24.683220 14904 raft_consensus.cc:2468] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 14.
I20260709 12:12:24.689556 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:24.690429 14332 raft_consensus.cc:2368] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 15. Current term is 16.
I20260709 12:12:24.695302 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:24.695662 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:24.660939 20630 leader_election.cc:290] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:24.653561 20749 raft_consensus.cc:3060] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:24.710021 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:24.736979 14182 raft_consensus.cc:1275] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 12:12:24.738188 14183 raft_consensus.cc:2468] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 19.
I20260709 12:12:24.696221 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:12:24.702318 20755 log.cc:927] Time spent T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:12:24.749965 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:24.720243 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 22 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:12:24.736948 14154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:24.679898 20738 raft_consensus.cc:2749] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:24.717056 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:24.748027 14334 raft_consensus.cc:1275] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:12:24.752456 14330 raft_consensus.cc:2468] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 21.
I20260709 12:12:24.770149 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:24.756973 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:24.693044 20739 raft_consensus.cc:493] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:24.740679 20711 raft_consensus.cc:493] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:24.768635 14876 leader_election.cc:304] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:24.705852 20581 raft_consensus.cc:2749] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:24.772920 14330 raft_consensus.cc:2468] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 13.
I20260709 12:12:24.711377 20758 raft_consensus.cc:493] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
W20260709 12:12:24.773460 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 172782us
I20260709 12:12:24.776911 14334 raft_consensus.cc:1275] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
W20260709 12:12:24.781464 14230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:24.767377 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:24.779577 14330 raft_consensus.cc:1240] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 19. Current term is 20. Ops: [19.11-19.11]
I20260709 12:12:24.796130 14304 leader_election.cc:304] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
W20260709 12:12:24.802307 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 88322.5us
I20260709 12:12:24.803373 14155 leader_election.cc:304] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:12:24.805658 20485 raft_consensus.cc:2749] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:12:24.806470 20645 consensus_meta.cc:287] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.647s	user 0.015s	sys 0.001s
I20260709 12:12:24.807142 20645 raft_consensus.cc:515] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:12:24.806721 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 114197us
I20260709 12:12:24.810837 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:24.807442 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:24.812521 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 22 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:24.812784 20645 leader_election.cc:290] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 17 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:24.811076 14183 raft_consensus.cc:1240] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:24.815740 14330 raft_consensus.cc:2468] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 19.
I20260709 12:12:24.813342 14265 raft_consensus.cc:2468] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 21.
I20260709 12:12:24.782047 20786 raft_consensus.cc:2804] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:24.821661 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:24.775417 20746 consensus_queue.cc:1048] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.043s
I20260709 12:12:24.794672 20599 raft_consensus.cc:493] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:24.785233 20758 raft_consensus.cc:515] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:24.778589 20739 raft_consensus.cc:515] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:24.782809 20711 raft_consensus.cc:515] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:24.822891 20720 raft_consensus.cc:2804] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:24.885807 20720 raft_consensus.cc:697] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 16 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:12:24.886993 20720 consensus_queue.cc:237] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:24.801664 20785 consensus_queue.cc:1048] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.101s
I20260709 12:12:24.820629 20751 raft_consensus.cc:493] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:24.803962 20767 consensus_queue.cc:1059] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.077s
I20260709 12:12:24.890899 20767 raft_consensus.cc:3055] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:12:24.891508 20767 raft_consensus.cc:740] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:24.877496 14230 leader_election.cc:304] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:24.897861 20751 raft_consensus.cc:515] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:12:24.914534 20784 log.cc:927] Time spent T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
W20260709 12:12:24.881393 20790 log.cc:927] Time spent T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
I20260709 12:12:24.884150 20739 leader_election.cc:290] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:24.835697 20599 raft_consensus.cc:515] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:12:24.937608 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 102447us
I20260709 12:12:24.834244 20615 leader_election.cc:290] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:24.830840 20786 raft_consensus.cc:697] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [term 18 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:12:24.908039 20711 leader_election.cc:290] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:24.892891 20767 consensus_queue.cc:260] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:12:24.970890 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 159222us
I20260709 12:12:24.972074 14229 leader_election.cc:304] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
W20260709 12:12:24.970080 20792 log.cc:927] Time spent T 00000000000000000000000000000000 P d07070be2c074f4cb9ad35f1580c4ef7: Append to log took a long time: real 0.189s	user 0.000s	sys 0.003s
I20260709 12:12:24.977136 20767 raft_consensus.cc:3060] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:25.019855 14256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53050 (request call id 1239) took 1896 ms. Trace:
I20260709 12:12:25.020473 14256 rpcz_store.cc:276] 0709 12:12:23.123241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:23.180613 (+ 57372us) service_pool.cc:224] Handling call
0709 12:12:23.210829 (+ 30216us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:23.469013 (+258184us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:25.019494 (+1550481us) spinlock_profiling.cc:243] Waited 239 ms on lock 0x7b5400211e54. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:12:25.019774 (+   280us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":549065472}
I20260709 12:12:24.990785 20296 raft_consensus.cc:515] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:25.028934 20296 leader_election.cc:290] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:25.030093 20802 consensus_queue.cc:1048] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:12:24.976293 20786 consensus_queue.cc:237] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:25.031447 20749 raft_consensus.cc:2749] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:25.031402 20296 raft_consensus.cc:2804] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:25.033124 20296 raft_consensus.cc:493] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:25.033612 20296 raft_consensus.cc:3060] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:25.031543 20688 raft_consensus.cc:2749] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:12:25.036756 20796 log.cc:927] Time spent T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.159s	user 0.001s	sys 0.000s
W20260709 12:12:25.032671 20797 log.cc:927] Time spent T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 12:12:25.040434 20702 leader_election.cc:290] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187)
W20260709 12:12:25.047628 20800 log.cc:927] Time spent T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.102s	user 0.000s	sys 0.001s
W20260709 12:12:25.048195 20794 log.cc:927] Time spent T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
W20260709 12:12:25.048674 20610 consensus_meta.cc:287] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.751s	user 0.010s	sys 0.006s
W20260709 12:12:25.084406 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 112450us
I20260709 12:12:25.092018 14155 leader_election.cc:304] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:25.079890 20599 leader_election.cc:290] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:25.103479 14155 leader_election.cc:304] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:25.086454 20751 leader_election.cc:290] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:25.143965 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:25.144718 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:25.101651 20727 raft_consensus.cc:2804] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:12:25.090248 20688 consensus_queue.cc:1048] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 12:12:25.087293 20610 raft_consensus.cc:515] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:25.157052 14263 raft_consensus.cc:1275] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
W20260709 12:12:25.154510 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 143570us
I20260709 12:12:25.162740 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:25.157222 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:25.107014 20744 raft_consensus.cc:2749] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:25.164966 14903 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53194 (request call id 1133) took 1792 ms. Trace:
I20260709 12:12:25.163483 14263 raft_consensus.cc:2468] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 19.
I20260709 12:12:25.166033 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:25.167016 14905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53200 (request call id 833) took 1863 ms. Trace:
I20260709 12:12:25.170061 14905 rpcz_store.cc:276] 0709 12:12:23.292584 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:23.292744 (+   160us) service_pool.cc:224] Handling call
0709 12:12:23.293153 (+   409us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:23.500720 (+207567us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:23.500753 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:23.500804 (+    51us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:12:23.500837 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:25.155727 (+1654890us) spinlock_profiling.cc:243] Waited 207 ms on lock 0x7b5400040954. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:12:25.155777 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:25.155913 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":476753152}
I20260709 12:12:25.169860 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:25.172464 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:25.173144 14256 raft_consensus.cc:2468] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 14.
I20260709 12:12:25.175346 14155 leader_election.cc:304] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:25.176491 14155 leader_election.cc:304] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:25.176932 20789 raft_consensus.cc:2804] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:25.177423 20789 raft_consensus.cc:493] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:25.177724 20744 raft_consensus.cc:2804] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:25.178496 20744 raft_consensus.cc:493] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:25.178921 20744 raft_consensus.cc:3060] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:25.179265 20481 leader_election.cc:290] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:25.179949 20787 consensus_queue.cc:1048] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.008s
I20260709 12:12:25.155418 20727 raft_consensus.cc:493] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:25.144541 20758 leader_election.cc:290] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:12:25.190412 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 274936us
I20260709 12:12:25.177791 20789 raft_consensus.cc:3060] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:12:25.179104 20801 log.cc:927] Time spent T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
I20260709 12:12:25.168486 14903 rpcz_store.cc:276] 0709 12:12:23.363741 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:23.366269 (+  2528us) service_pool.cc:224] Handling call
0709 12:12:23.366664 (+   395us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:23.386176 (+ 19512us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:23.386207 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:24.564233 (+1178026us) spinlock_profiling.cc:243] Waited 8.61 ms on lock 0x7b2c00125df8. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2125a34a11 00007f2125a44372 00007f2127176a01 00007f212713b43a 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2
0709 12:12:24.564740 (+   507us) log.cc:844] Serialized 26 byte log entry
0709 12:12:24.781437 (+216697us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:12:24.781481 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:24.781548 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:25.148686 (+367138us) raft_consensus.cc:1685] finished
0709 12:12:25.148710 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:25.155902 (+  7192us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23101,"raft.queue_time_us":29890,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":10582,"spinlock_wait_cycles":19792128,"thread_start_us":216165,"threads_started":1,"wal-append.queue_time_us":268145}
I20260709 12:12:25.159614 20545 raft_consensus.cc:493] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
W20260709 12:12:25.203564 14339 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50856 (request call id 2728) took 2102 ms (client timeout 2339 ms). Trace:
W20260709 12:12:25.204103 14339 rpcz_store.cc:269] 0709 12:12:23.096589 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:23.099871 (+  3282us) service_pool.cc:224] Handling call
0709 12:12:25.199038 (+2099167us) spinlock_profiling.cc:243] Waited 729 ms on lock 0x7b540001b154. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:12:25.199230 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1675595136}
I20260709 12:12:25.191318 14230 leader_election.cc:304] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:25.143332 20813 consensus_queue.cc:1059] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 16.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.084s
I20260709 12:12:25.212518 14230 leader_election.cc:304] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:25.194378 20727 raft_consensus.cc:3060] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:25.217681 20805 raft_consensus.cc:2749] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:25.220961 20702 raft_consensus.cc:2749] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:25.210019 20545 raft_consensus.cc:515] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:25.224682 20545 leader_election.cc:290] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:12:25.225373 14262 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41764 (request call id 3391) took 1879 ms (client timeout 1906 ms). Trace:
I20260709 12:12:25.226419 14185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56046 (request call id 2828) took 1948 ms. Trace:
I20260709 12:12:25.229588 14185 rpcz_store.cc:276] 0709 12:12:23.278131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:23.278964 (+   833us) service_pool.cc:224] Handling call
0709 12:12:23.279270 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:24.098822 (+819552us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:25.226148 (+1127326us) spinlock_profiling.cc:243] Waited 775 ms on lock 0x7b54003b1854. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:12:25.226345 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1781836544}
W20260709 12:12:25.229494 14262 rpcz_store.cc:269] 0709 12:12:23.346056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:23.400999 (+ 54943us) service_pool.cc:224] Handling call
0709 12:12:25.225176 (+1824177us) spinlock_profiling.cc:243] Waited 598 ms on lock 0x7b54002210d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:12:25.225304 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1375843712}
I20260709 12:12:25.233863 14257 raft_consensus.cc:1275] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 12:12:25.235409 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:25.236084 14903 raft_consensus.cc:3060] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:25.237104 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:25.232646 14230 leader_election.cc:304] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:25.244946 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:25.246914 14230 leader_election.cc:304] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:25.222240 20610 leader_election.cc:290] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:25.256306 14230 leader_election.cc:304] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:25.255692 20813 raft_consensus.cc:2749] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:25.244158 20787 consensus_queue.cc:1048] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
W20260709 12:12:25.260326 20810 log.cc:927] Time spent T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
I20260709 12:12:25.248345 20688 raft_consensus.cc:2749] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:25.258078 20788 raft_consensus.cc:493] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:25.227331 20744 raft_consensus.cc:515] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:12:25.271303 20683 consensus_meta.cc:287] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.603s	user 0.015s	sys 0.001s
I20260709 12:12:25.276360 14903 raft_consensus.cc:2468] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 15.
I20260709 12:12:25.284235 14184 raft_consensus.cc:2410] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 12:12:25.290743 14230 leader_election.cc:304] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
W20260709 12:12:25.291046 14154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:25.291831 20688 raft_consensus.cc:2804] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:25.292115 14230 leader_election.cc:400] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 election: Vote denied by peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957) with higher term. Message: Invalid argument: T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 15. Current term is 16.
W20260709 12:12:25.277729 20637 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.709s	user 0.015s	sys 0.027s
W20260709 12:12:25.279311 20650 consensus_meta.cc:287] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db: Time spent flushing consensus metadata: real 0.811s	user 0.017s	sys 0.000s
I20260709 12:12:25.293613 14230 leader_election.cc:403] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 12:12:25.292918 20545 raft_consensus.cc:2749] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:25.292356 20688 raft_consensus.cc:493] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:25.288445 20711 raft_consensus.cc:493] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:25.307142 14230 leader_election.cc:304] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
W20260709 12:12:25.295037 20637 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.726s	user 0.016s	sys 0.027s
I20260709 12:12:25.310456 14230 leader_election.cc:304] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:25.321854 20546 raft_consensus.cc:2749] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:25.316782 20572 raft_consensus.cc:2749] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:25.308950 20545 raft_consensus.cc:3060] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:25.309652 20688 raft_consensus.cc:3060] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:25.330085 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:25.330438 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:25.331353 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:25.334015 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
W20260709 12:12:25.336073 14264 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41764 (request call id 3389) took 2026 ms (client timeout 2202 ms). Trace:
W20260709 12:12:25.336548 14264 rpcz_store.cc:269] 0709 12:12:23.309641 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:23.324524 (+ 14883us) service_pool.cc:224] Handling call
0709 12:12:25.335895 (+2011371us) spinlock_profiling.cc:243] Waited 776 ms on lock 0x7b5400200dd4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:12:25.336003 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1785545600}
I20260709 12:12:25.324038 20711 raft_consensus.cc:515] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:25.326961 20813 consensus_queue.cc:1059] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.012s
I20260709 12:12:25.327751 20239 consensus_queue.cc:1059] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.012s
I20260709 12:12:25.340641 20805 raft_consensus.cc:3055] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:25.341039 20805 raft_consensus.cc:740] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:25.342113 20734 leader_election.cc:290] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:25.341948 20805 consensus_queue.cc:260] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:25.330801 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
W20260709 12:12:25.343072 14261 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41764 (request call id 3401) took 1329 ms (client timeout 1712 ms). Trace:
W20260709 12:12:25.343511 14261 rpcz_store.cc:269] 0709 12:12:24.013503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:24.097092 (+ 83589us) service_pool.cc:224] Handling call
0709 12:12:25.342876 (+1245784us) spinlock_profiling.cc:243] Waited 25.3 ms on lock 0x7b54001b21d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:12:25.343002 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":58102528}
I20260709 12:12:25.328970 20296 raft_consensus.cc:515] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:25.345922 20752 leader_election.cc:290] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:25.346765 14265 raft_consensus.cc:2393] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 20: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:12:25.347090 14260 raft_consensus.cc:1275] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:12:25.347838 20296 leader_election.cc:290] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:25.349248 14260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41768 (request call id 2307) took 1116 ms. Trace:
W20260709 12:12:25.350386 20572 consensus_queue.cc:1175] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "885067a0d31741bfb5c9935788e315bf" responder_term: 16 status { last_received { term: 15 index: 10 } last_committed_idx: 10 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 15. Current term is 16. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 12:12:25.324875 20682 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.754s	user 0.024s	sys 0.008s
I20260709 12:12:25.326906 20546 consensus_queue.cc:1048] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 12:12:25.356999 20805 raft_consensus.cc:3060] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:12:25.332093 14230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:25.358232 14187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56046 (request call id 2844) took 1238 ms. Trace:
I20260709 12:12:25.359197 14229 leader_election.cc:304] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:25.360711 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:25.343104 14330 raft_consensus.cc:3060] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:25.361569 14336 raft_consensus.cc:3060] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:25.289489 20788 raft_consensus.cc:515] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:25.349670 14260 rpcz_store.cc:276] 0709 12:12:24.233135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:24.518295 (+285160us) service_pool.cc:224] Handling call
0709 12:12:25.346721 (+828426us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:25.347449 (+   728us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:25.349007 (+  1558us) spinlock_profiling.cc:243] Waited 828 ms on lock 0x7b54001b21d0. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713a8ad 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:12:25.349165 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1904431360}
I20260709 12:12:25.363355 14187 rpcz_store.cc:276] 0709 12:12:24.119703 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:24.122726 (+  3023us) service_pool.cc:224] Handling call
0709 12:12:24.123040 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:24.229035 (+105995us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:24.229069 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:24.229111 (+    42us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:12:24.229146 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:25.357954 (+1128808us) spinlock_profiling.cc:243] Waited 106 ms on lock 0x7b5400421154. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:12:25.358006 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:25.358149 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":243278592}
I20260709 12:12:25.369127 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:25.369895 14187 raft_consensus.cc:3060] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:25.345391 20642 raft_consensus.cc:3055] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:25.371106 20642 raft_consensus.cc:740] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:25.371294 14339 raft_consensus.cc:1275] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:12:25.372107 20652 raft_consensus.cc:493] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:25.372686 20652 raft_consensus.cc:515] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:25.374542 20688 raft_consensus.cc:515] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:25.376654 14230 leader_election.cc:304] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:25.374930 20652 leader_election.cc:290] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:25.306463 20789 raft_consensus.cc:515] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:12:25.357517 20682 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.786s	user 0.024s	sys 0.008s
I20260709 12:12:25.394188 20239 raft_consensus.cc:2749] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:25.399364 20688 leader_election.cc:290] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:25.365882 20492 leader_election.cc:290] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:25.402680 20788 leader_election.cc:290] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:25.403926 20642 consensus_queue.cc:260] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:25.402570 20767 raft_consensus.cc:493] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:25.406301 20767 raft_consensus.cc:515] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:25.407795 14230 leader_election.cc:304] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:25.409225 14230 leader_election.cc:304] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:25.410497 14336 raft_consensus.cc:2468] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 20.
I20260709 12:12:25.411616 14330 raft_consensus.cc:2468] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 15.
I20260709 12:12:25.415308 20610 raft_consensus.cc:2749] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:25.406805 20380 raft_consensus.cc:493] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:25.416472 20380 raft_consensus.cc:515] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:12:25.417781 20504 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 19 current term: 19 is higher.
I20260709 12:12:25.419217 20380 leader_election.cc:290] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:25.415851 20767 leader_election.cc:290] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:25.420542 20685 leader_election.cc:290] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:25.424680 20546 raft_consensus.cc:2749] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:25.394757 20808 raft_consensus.cc:493] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:25.427699 20808 raft_consensus.cc:515] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:25.405519 20642 raft_consensus.cc:3060] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:25.433550 14181 raft_consensus.cc:1240] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:25.436568 14229 leader_election.cc:304] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:25.414142 20744 leader_election.cc:290] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 15 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:25.437940 20239 raft_consensus.cc:2749] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:12:25.408836 20652 consensus_queue.cc:1048] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 12:12:25.465562 14304 leader_election.cc:304] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:25.456588 14230 leader_election.cc:304] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:12:25.472707 20481 consensus_queue.cc:1048] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 12:12:25.450654 20673 raft_consensus.cc:493] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:25.473856 20504 raft_consensus.cc:493] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:25.474268 20767 raft_consensus.cc:2804] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:25.474171 20673 raft_consensus.cc:515] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:25.474848 20767 raft_consensus.cc:493] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:12:25.475324 20767 raft_consensus.cc:3060] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:12:25.473001 14259 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41768 (request call id 2296) took 2371 ms (client timeout 1868 ms). Trace:
W20260709 12:12:25.476217 14259 rpcz_store.cc:269] 0709 12:12:23.092090 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:23.092229 (+   139us) service_pool.cc:224] Handling call
0709 12:12:25.463498 (+2371269us) spinlock_profiling.cc:243] Waited 240 ms on lock 0x7b5400100254. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:12:25.463681 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":551515008}
I20260709 12:12:25.478965 14229 leader_election.cc:304] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:12:25.447058 20476 raft_consensus.cc:493] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:25.486227 20673 leader_election.cc:290] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:25.486992 20677 raft_consensus.cc:2749] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:25.487854 20677 raft_consensus.cc:493] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:25.488444 20476 raft_consensus.cc:515] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:25.487044 20816 raft_consensus.cc:2804] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:25.489456 20816 raft_consensus.cc:697] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 15 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:25.490445 20816 consensus_queue.cc:237] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:25.490950 20476 leader_election.cc:290] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:25.492637 20789 leader_election.cc:290] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 20 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:25.496275 20572 raft_consensus.cc:2804] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:25.496968 20572 raft_consensus.cc:697] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 20 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:25.497869 20572 consensus_queue.cc:237] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:12:25.498646 20825 log.cc:927] Time spent T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 12:12:25.500896 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:25.502256 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:25.502902 14185 raft_consensus.cc:2468] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 20.
I20260709 12:12:25.503232 14186 raft_consensus.cc:1240] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 12:12:25.474416 20504 raft_consensus.cc:515] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:25.507051 20504 leader_election.cc:290] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:25.507823 20547 raft_consensus.cc:493] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:25.508443 20547 raft_consensus.cc:515] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:25.508944 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:25.509486 20669 raft_consensus.cc:493] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:25.510099 20669 raft_consensus.cc:515] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:25.510838 20547 leader_election.cc:290] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:25.513303 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:25.514631 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:25.519800 20808 leader_election.cc:290] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:25.522636 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:25.523429 14333 raft_consensus.cc:3060] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:25.525003 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 17 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:25.527626 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:25.528429 14336 raft_consensus.cc:2468] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 21.
I20260709 12:12:25.534147 14229 leader_election.cc:304] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:25.539158 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:25.539949 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:25.540771 14187 raft_consensus.cc:2468] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 20.
I20260709 12:12:25.544312 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:25.539211 14186 raft_consensus.cc:1240] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:25.543416 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:25.545341 14903 raft_consensus.cc:2468] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 18.
I20260709 12:12:25.546387 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:25.547359 14331 raft_consensus.cc:2393] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 18: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:12:25.546399 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:25.551350 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:25.553033 14185 raft_consensus.cc:2393] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 16: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:12:25.554225 14339 raft_consensus.cc:1240] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 19. Current term is 20. Ops: [19.11-19.11]
I20260709 12:12:25.474766 20688 raft_consensus.cc:493] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:25.558921 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:25.556118 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:25.570734 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:25.572081 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:25.573091 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:25.574120 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:25.573688 14257 raft_consensus.cc:1240] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:25.575101 14260 raft_consensus.cc:1275] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 12:12:25.575928 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:25.576130 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:25.574281 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:25.576820 14260 raft_consensus.cc:2376] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 18. Re-sending same reply.
I20260709 12:12:25.577373 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:25.578389 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:25.579859 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:25.578429 14265 raft_consensus.cc:2393] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 19: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:12:25.577716 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:25.580322 14229 leader_election.cc:304] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:12:25.583981 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:25.584705 14259 raft_consensus.cc:2468] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 17.
I20260709 12:12:25.586117 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:25.586817 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:25.586493 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:25.588773 14904 raft_consensus.cc:2468] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 19.
I20260709 12:12:25.590301 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:25.590837 14333 raft_consensus.cc:2468] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 19.
I20260709 12:12:25.590855 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:25.592685 20637 raft_consensus.cc:3055] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:25.593143 20637 raft_consensus.cc:740] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:25.594098 20637 consensus_queue.cc:260] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:25.595263 20637 raft_consensus.cc:3060] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:25.597921 20747 consensus_queue.cc:1059] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.076s
I20260709 12:12:25.598997 20369 raft_consensus.cc:3055] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:25.599426 20369 raft_consensus.cc:740] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:12:25.600436 20369 consensus_queue.cc:260] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:25.601866 20369 raft_consensus.cc:3060] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:25.603829 20682 raft_consensus.cc:493] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:25.604429 20682 raft_consensus.cc:515] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:25.607599 20682 leader_election.cc:290] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:25.621110 20143 raft_consensus.cc:2804] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:25.545578 20542 raft_consensus.cc:2804] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:12:25.630185 14154 leader_election.cc:304] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:25.632580 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:25.488415 20677 raft_consensus.cc:515] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:25.556833 20669 leader_election.cc:290] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:25.649012 14154 leader_election.cc:304] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:25.655351 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:25.657236 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:25.661008 14154 leader_election.cc:304] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:25.679754 20652 raft_consensus.cc:2804] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:25.680226 20652 raft_consensus.cc:493] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:25.680590 20652 raft_consensus.cc:3060] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:25.622606 20143 raft_consensus.cc:493] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:25.626362 20542 raft_consensus.cc:493] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:25.627738 20239 raft_consensus.cc:493] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:25.638196 20682 raft_consensus.cc:2749] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:25.687152 20743 raft_consensus.cc:493] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:25.737008 20743 raft_consensus.cc:515] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:25.740295 20743 leader_election.cc:290] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:25.741528 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:25.741994 20476 raft_consensus.cc:493] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:25.743566 14337 raft_consensus.cc:1240] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:25.698365 20239 raft_consensus.cc:515] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:25.696192 20542 raft_consensus.cc:3060] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:25.693123 20143 raft_consensus.cc:3060] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:12:25.708606 20819 log.cc:927] Time spent T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.418s	user 0.003s	sys 0.000s
I20260709 12:12:25.709133 20545 raft_consensus.cc:2749] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957) with higher term. Message: Invalid argument: T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 15. Current term is 16.
I20260709 12:12:25.713662 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:25.754477 14265 raft_consensus.cc:3060] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:25.714411 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:25.755458 14264 raft_consensus.cc:3060] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:25.715821 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:25.672533 20786 raft_consensus.cc:493] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:25.673399 20751 raft_consensus.cc:2749] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:25.723076 20727 raft_consensus.cc:515] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:25.689639 20677 leader_election.cc:290] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:25.668393 20768 raft_consensus.cc:493] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:25.727698 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:25.585501 20688 raft_consensus.cc:515] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:25.728523 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:25.729403 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:25.733333 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:25.780043 14265 raft_consensus.cc:2468] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 15.
I20260709 12:12:25.742868 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:25.748345 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:25.749850 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:25.781857 14337 raft_consensus.cc:2393] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 20: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:12:25.743281 20476 raft_consensus.cc:515] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:25.782128 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 17 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:25.783093 14265 raft_consensus.cc:2468] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 16.
I20260709 12:12:25.785244 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:25.787060 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:25.788044 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:25.793763 14337 raft_consensus.cc:1240] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:25.796497 14337 raft_consensus.cc:1240] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:25.775774 20768 raft_consensus.cc:515] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:25.862123 20711 leader_election.cc:290] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:25.863175 20768 leader_election.cc:290] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:25.894052 20727 leader_election.cc:290] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 22 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:25.904045 20688 leader_election.cc:290] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:12:25.906908 20828 log.cc:927] Time spent T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.109s	user 0.000s	sys 0.001s
I20260709 12:12:25.761327 20786 raft_consensus.cc:515] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:12:25.906622 20827 log.cc:927] Time spent T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
W20260709 12:12:25.913815 20829 log.cc:927] Time spent T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 12:12:25.915211 20786 leader_election.cc:290] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:12:25.918349 20832 log.cc:927] Time spent T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
I20260709 12:12:25.924460 20767 raft_consensus.cc:515] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:25.927197 20767 leader_election.cc:290] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:26.021965 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:26.024813 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:26.026041 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:12:25.732689 14190 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56046 (request call id 2843) took 1613 ms (client timeout 2135 ms). Trace:
W20260709 12:12:26.027925 14190 rpcz_store.cc:269] 0709 12:12:24.119170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:24.121661 (+  2491us) service_pool.cc:224] Handling call
0709 12:12:25.732389 (+1610728us) spinlock_profiling.cc:243] Waited 681 ms on lock 0x7b54002d1254. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:12:25.732609 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1567410048}
I20260709 12:12:26.021956 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:26.030675 14185 raft_consensus.cc:3060] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:26.035101 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:26.038079 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:12:26.043533 14228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:26.038450 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:26.039423 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:26.054955 14183 raft_consensus.cc:2410] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for term 19 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 12.
W20260709 12:12:26.057343 14230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:26.060032 14183 raft_consensus.cc:1240] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:25.760437 14256 raft_consensus.cc:1275] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:12:26.062858 14257 raft_consensus.cc:2468] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 18.
I20260709 12:12:25.756552 14259 raft_consensus.cc:2468] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 17.
I20260709 12:12:25.780177 14262 raft_consensus.cc:2468] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 16.
W20260709 12:12:25.725589 14303 connection.cc:256] RPC call timeout handler was delayed by -1.3721905889999562s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1778s for a response
I20260709 12:12:25.759820 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:25.757437 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:26.087847 14339 raft_consensus.cc:2468] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 21.
I20260709 12:12:26.088838 14334 raft_consensus.cc:2393] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 18: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:12:26.085474 14264 raft_consensus.cc:2468] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 20.
I20260709 12:12:26.109583 14183 raft_consensus.cc:1275] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 12:12:25.758205 14877 leader_election.cc:304] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
W20260709 12:12:26.149082 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 390747us
I20260709 12:12:26.164301 14229 leader_election.cc:304] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:25.760008 20577 consensus_queue.cc:1048] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:25.757853 20578 consensus_queue.cc:1048] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:12:26.253144 20768 raft_consensus.cc:493] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
W20260709 12:12:26.253901 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 61748.4us
I20260709 12:12:26.254381 20768 raft_consensus.cc:515] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:26.255825 20476 leader_election.cc:290] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:25.758754 20669 consensus_queue.cc:1048] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:12:26.257965 14182 raft_consensus.cc:1275] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:12:26.261240 20646 raft_consensus.cc:493] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:26.262061 20646 raft_consensus.cc:515] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:26.179467 14185 raft_consensus.cc:2468] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 16.
W20260709 12:12:26.212302 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 61378.1us
I20260709 12:12:26.221540 20547 raft_consensus.cc:2749] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:26.223814 20743 raft_consensus.cc:493] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:26.226046 20546 raft_consensus.cc:493] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:26.229017 20543 raft_consensus.cc:493] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:26.238404 20685 raft_consensus.cc:493] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:26.239893 20589 raft_consensus.cc:493] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:26.240777 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:26.242113 20239 leader_election.cc:290] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:26.244745 20610 raft_consensus.cc:493] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:26.267009 20677 raft_consensus.cc:2749] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:26.281375 14188 raft_consensus.cc:2468] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 17.
I20260709 12:12:26.242831 20692 raft_consensus.cc:493] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:26.293300 20692 raft_consensus.cc:515] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:26.296578 20692 leader_election.cc:290] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:26.286509 20689 raft_consensus.cc:493] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:12:26.299077 20689 raft_consensus.cc:515] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:26.300755 14183 raft_consensus.cc:1275] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:12:26.302778 20567 consensus_queue.cc:1048] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:12:26.287432 20743 raft_consensus.cc:515] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:26.288424 20546 raft_consensus.cc:515] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:26.289713 20610 raft_consensus.cc:515] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:26.290722 20685 raft_consensus.cc:515] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:26.282598 20543 raft_consensus.cc:515] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:26.311480 20743 leader_election.cc:290] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:26.292060 20677 raft_consensus.cc:493] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:26.312626 20677 raft_consensus.cc:515] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:26.315304 20677 leader_election.cc:290] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:26.309340 20646 leader_election.cc:290] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:26.318269 20546 leader_election.cc:290] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:26.274627 20589 raft_consensus.cc:515] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:26.284204 20768 leader_election.cc:290] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:26.313719 20543 leader_election.cc:290] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:26.327771 20610 leader_election.cc:290] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:26.336681 20589 leader_election.cc:290] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:26.342489 14877 leader_election.cc:304] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:26.345610 20685 leader_election.cc:290] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:12:26.352918 20642 consensus_meta.cc:287] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.915s	user 0.017s	sys 0.005s
I20260709 12:12:26.354888 20650 consensus_queue.cc:1048] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:12:26.357378 20692 raft_consensus.cc:493] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:26.365401 20692 raft_consensus.cc:515] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:26.368093 20692 leader_election.cc:290] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:26.357620 20689 leader_election.cc:290] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:12:26.378542 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 46959.4us
I20260709 12:12:26.380282 20577 raft_consensus.cc:2749] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:26.382529 14906 raft_consensus.cc:1275] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:12:26.382560 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
W20260709 12:12:26.385841 20542 consensus_meta.cc:287] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.588s	user 0.009s	sys 0.010s
W20260709 12:12:26.375478 20652 consensus_meta.cc:287] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.694s	user 0.015s	sys 0.005s
W20260709 12:12:26.390868 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 67574.2us
I20260709 12:12:26.391263 14331 raft_consensus.cc:1275] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:12:26.392630 14230 leader_election.cc:304] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:26.394884 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:26.395498 14334 raft_consensus.cc:1275] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 12:12:26.396215 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:26.401379 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:26.402323 14264 raft_consensus.cc:2468] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 19.
I20260709 12:12:26.401428 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:26.404038 14265 raft_consensus.cc:2468] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 16.
I20260709 12:12:26.406500 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:26.407167 14336 raft_consensus.cc:1275] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:12:26.391098 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:26.408257 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:26.410509 20767 raft_consensus.cc:493] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:26.411387 20767 raft_consensus.cc:515] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:26.414716 20669 consensus_queue.cc:1059] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:12:26.415244 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:26.415902 14877 leader_election.cc:304] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:26.416118 20669 consensus_queue.cc:1059] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:12:26.417445 20844 raft_consensus.cc:3055] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:26.417948 20844 raft_consensus.cc:740] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:12:26.420385 20045 raft_consensus.cc:3060] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:26.422001 14230 leader_election.cc:304] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:26.424587 20567 raft_consensus.cc:2804] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:26.425208 20567 raft_consensus.cc:697] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 19 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:26.426640 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:26.427320 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:26.419139 20844 consensus_queue.cc:260] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:26.438112 20567 consensus_queue.cc:237] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:26.438851 20767 leader_election.cc:290] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:26.449903 20846 raft_consensus.cc:493] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:26.450949 20846 raft_consensus.cc:515] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:26.453866 20846 leader_election.cc:290] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:26.440086 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:26.440820 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 22 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:26.438084 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:26.463457 14337 raft_consensus.cc:1275] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:12:26.459908 14334 raft_consensus.cc:2468] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 18.
I20260709 12:12:26.433162 20689 raft_consensus.cc:493] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:26.469843 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:26.473330 14339 raft_consensus.cc:3060] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:26.474864 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:26.471124 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:26.463390 20578 raft_consensus.cc:2749] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:26.481094 20720 raft_consensus.cc:493] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:26.481586 14258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41768 (request call id 2316) took 2245 ms. Trace:
I20260709 12:12:26.484813 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:26.482040 14258 rpcz_store.cc:276] 0709 12:12:24.235658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:24.563930 (+328272us) service_pool.cc:224] Handling call
0709 12:12:25.463690 (+899760us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:25.477727 (+ 14037us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:25.477795 (+    68us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:25.477852 (+    57us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:12:25.477896 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:25.477976 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:26.481171 (+1003195us) spinlock_profiling.cc:243] Waited 897 ms on lock 0x7b5400100250. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713a8ad 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:12:26.481399 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13612,"raft.queue_time_us":22737,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":120,"spinlock_wait_cycles":2063072640}
I20260709 12:12:26.488490 20720 raft_consensus.cc:515] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:26.488946 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 22 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:26.431794 20542 raft_consensus.cc:515] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:26.491859 20380 raft_consensus.cc:493] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:26.493691 14338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50856 (request call id 2768) took 1032 ms. Trace:
I20260709 12:12:26.494060 20380 raft_consensus.cc:515] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:26.494343 20044 consensus_queue.cc:1059] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.029s
I20260709 12:12:26.494767 20720 leader_election.cc:290] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:26.495728 20044 raft_consensus.cc:3055] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:26.496101 20044 raft_consensus.cc:740] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:12:26.496783 14258 raft_consensus.cc:3060] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:26.497910 14262 raft_consensus.cc:2468] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 16.
I20260709 12:12:26.500775 14338 rpcz_store.cc:276] 0709 12:12:25.330520 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:25.330674 (+   154us) service_pool.cc:224] Handling call
0709 12:12:25.374107 (+ 43433us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:12:25.374554 (+   447us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:25.374590 (+    36us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:12:25.375247 (+   657us) log.cc:844] Serialized 52 byte log entry
0709 12:12:25.755785 (+380538us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:12:26.210896 (+455111us) log.cc:844] Serialized 14 byte log entry
0709 12:12:26.305475 (+ 94579us) log.cc:844] Serialized 14 byte log entry
0709 12:12:26.324929 (+ 19454us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:26.330594 (+  5665us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:26.357668 (+ 27074us) raft_consensus.cc:1685] finished
0709 12:12:26.357685 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:26.363192 (+  5507us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":92913,"prepare.queue_time_us":454996,"prepare.run_cpu_time_us":102,"prepare.run_wall_time_us":105,"raft.queue_time_us":98936,"raft.run_cpu_time_us":474,"raft.run_wall_time_us":22191,"thread_start_us":831405,"threads_started":2,"wal-append.queue_time_us":451096}
I20260709 12:12:26.503520 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:26.504524 14335 raft_consensus.cc:1275] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:12:26.502599 14257 raft_consensus.cc:1275] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:12:26.506035 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:26.506978 14877 leader_election.cc:304] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:26.508774 20669 raft_consensus.cc:2804] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:26.509223 20669 raft_consensus.cc:493] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:26.509552 20669 raft_consensus.cc:3060] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:26.508281 20689 raft_consensus.cc:515] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:26.512437 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:26.435786 20652 raft_consensus.cc:515] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:26.497494 14155 leader_election.cc:304] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:26.521442 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:26.521483 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:12:26.521445 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 46043.2us
I20260709 12:12:26.552772 14258 raft_consensus.cc:2468] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 22.
I20260709 12:12:26.553835 14187 raft_consensus.cc:1240] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:26.556413 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:26.497237 20044 consensus_queue.cc:260] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:12:26.564916 14230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:26.562959 14877 leader_election.cc:304] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:26.572115 14338 raft_consensus.cc:1275] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
W20260709 12:12:26.578552 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 81400.4us
I20260709 12:12:26.575028 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:26.580811 20788 raft_consensus.cc:2804] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:26.581414 14261 raft_consensus.cc:2368] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 21. Current term is 22.
W20260709 12:12:26.585337 20143 consensus_meta.cc:287] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.820s	user 0.008s	sys 0.008s
I20260709 12:12:26.581522 20788 raft_consensus.cc:697] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 15 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:12:26.585825 20045 raft_consensus.cc:2749] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:26.586375 14337 raft_consensus.cc:2468] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 18.
I20260709 12:12:26.588011 20652 leader_election.cc:290] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 20 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:26.590719 20542 leader_election.cc:290] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:26.591706 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:26.594295 14303 leader_election.cc:304] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:26.596014 20689 leader_election.cc:290] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:26.581106 14189 raft_consensus.cc:1275] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:12:26.596935 14258 raft_consensus.cc:1240] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 19. Current term is 20. Ops: [19.15-19.15]
I20260709 12:12:26.601432 14155 leader_election.cc:304] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:26.598716 14339 raft_consensus.cc:2468] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 22.
W20260709 12:12:26.603556 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 47339.5us
I20260709 12:12:26.606575 20754 consensus_queue.cc:1059] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 12:12:26.603497 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:26.611496 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:26.586274 14260 raft_consensus.cc:1240] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 19 LEADER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:26.631740 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:26.637221 14155 leader_election.cc:304] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:26.562996 20748 consensus_queue.cc:1048] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.060s
I20260709 12:12:26.641711 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:26.641861 14334 raft_consensus.cc:3060] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:12:26.643498 14184 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56044 (request call id 3329) took 2455 ms (client timeout 1862 ms). Trace:
W20260709 12:12:26.644021 14184 rpcz_store.cc:269] 0709 12:12:24.177577 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:24.181826 (+  4249us) service_pool.cc:224] Handling call
0709 12:12:26.572833 (+2391007us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b54003d0254. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:12:26.632506 (+ 59673us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2497874176}
I20260709 12:12:26.644425 20711 raft_consensus.cc:2804] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:26.644941 20380 leader_election.cc:290] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:26.645583 20754 raft_consensus.cc:3055] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:26.646085 20754 raft_consensus.cc:740] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:26.646813 20754 consensus_queue.cc:260] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:26.647892 20754 raft_consensus.cc:3060] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:26.650141 20749 raft_consensus.cc:2804] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Leader election won for term 20
W20260709 12:12:26.650717 20637 consensus_meta.cc:287] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 1.055s	user 0.009s	sys 0.012s
I20260709 12:12:26.636415 20846 consensus_queue.cc:1048] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.015s
I20260709 12:12:26.652048 20044 raft_consensus.cc:3060] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:26.653163 20846 raft_consensus.cc:2749] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:12:26.630100 20650 raft_consensus.cc:2749] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:12:26.650872 20749 raft_consensus.cc:697] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 20 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
W20260709 12:12:26.651003 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 86362.8us
I20260709 12:12:26.653070 14155 leader_election.cc:304] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:26.663437 14336 raft_consensus.cc:2393] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 16: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:12:26.668228 20747 raft_consensus.cc:3055] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:26.651080 20788 consensus_queue.cc:237] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:26.644944 20711 raft_consensus.cc:493] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:26.669175 20711 raft_consensus.cc:3060] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:26.616731 20143 raft_consensus.cc:515] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:26.671096 20652 raft_consensus.cc:2804] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:26.673305 14155 leader_election.cc:304] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:26.673982 14261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41768 (request call id 2333) took 1020 ms. Trace:
I20260709 12:12:26.671639 20652 raft_consensus.cc:493] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:26.674949 14259 raft_consensus.cc:2468] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 18.
I20260709 12:12:26.665338 20749 consensus_queue.cc:237] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:26.677870 20650 consensus_queue.cc:1048] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:12:26.678580 20652 raft_consensus.cc:3060] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:26.674453 14261 rpcz_store.cc:276] 0709 12:12:25.653866 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:25.654981 (+  1115us) service_pool.cc:224] Handling call
0709 12:12:26.673689 (+1018708us) spinlock_profiling.cc:243] Waited 863 ms on lock 0x7b54002017d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:12:26.673889 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1985302912}
I20260709 12:12:26.675191 14303 leader_election.cc:304] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:26.668735 20747 raft_consensus.cc:740] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:12:26.687860 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:26.688135 20727 consensus_queue.cc:1048] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 10, Time since last communication: 0.007s
I20260709 12:12:26.688596 20747 consensus_queue.cc:260] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:26.689574 20685 raft_consensus.cc:2804] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:12:26.690207 20685 raft_consensus.cc:697] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 22 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:12:26.691270 20685 consensus_queue.cc:237] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 20.9, Last appended by leader: 9, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:26.693475 20691 raft_consensus.cc:2749] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:26.674590 20143 leader_election.cc:290] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:26.704771 14334 raft_consensus.cc:2468] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 22.
I20260709 12:12:26.690430 20747 raft_consensus.cc:3060] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:26.729319 14155 leader_election.cc:304] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
W20260709 12:12:26.733500 14878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:26.731949 20748 raft_consensus.cc:493] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:26.739534 20748 raft_consensus.cc:515] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:26.744954 20691 consensus_queue.cc:1059] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:12:26.745626 14303 leader_election.cc:304] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:26.766777 14304 leader_election.cc:304] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:26.768275 20669 raft_consensus.cc:515] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:26.746865 20691 raft_consensus.cc:3055] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:26.806537 20691 raft_consensus.cc:740] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:26.807660 20691 consensus_queue.cc:260] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:26.809273 20691 raft_consensus.cc:3060] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:12:26.790444 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 131465us
I20260709 12:12:26.793216 20599 raft_consensus.cc:2749] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:26.811281 14304 leader_election.cc:304] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:26.812391 20599 raft_consensus.cc:2804] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:26.813129 20599 raft_consensus.cc:697] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 18 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:26.814265 20599 consensus_queue.cc:237] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:12:26.790540 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 67834us
I20260709 12:12:26.749665 20786 consensus_queue.cc:1048] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.083s
I20260709 12:12:26.745968 20689 consensus_queue.cc:1048] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 12:12:26.813499 14304 leader_election.cc:304] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:26.781071 20846 raft_consensus.cc:2804] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:26.839632 14304 leader_election.cc:304] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:26.842724 20692 raft_consensus.cc:2749] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:26.843582 20692 raft_consensus.cc:2804] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:26.843940 20692 raft_consensus.cc:493] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:26.844291 20692 raft_consensus.cc:3060] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:26.852581 14303 leader_election.cc:304] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:12:26.852459 20744 raft_consensus.cc:2749] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:26.854514 14303 leader_election.cc:304] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:26.856424 14155 leader_election.cc:304] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:26.857539 20743 consensus_queue.cc:1048] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:12:26.859254 20743 raft_consensus.cc:2749] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:26.865270 20768 raft_consensus.cc:2764] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader election decision vote started in defunct term 14: won
I20260709 12:12:26.872798 20767 raft_consensus.cc:2749] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:12:26.982403 20669 leader_election.cc:290] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 17 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:26.983484 20798 raft_consensus.cc:493] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:26.984120 20798 raft_consensus.cc:515] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:26.832207 20748 leader_election.cc:290] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:26.984678 20692 raft_consensus.cc:515] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:12:26.989985 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 135552us
I20260709 12:12:26.990528 20692 leader_election.cc:290] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:26.991222 14303 leader_election.cc:304] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:26.992635 14303 leader_election.cc:304] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:26.993403 20754 raft_consensus.cc:2749] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:26.998463 20637 raft_consensus.cc:493] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:12:26.999060 20637 raft_consensus.cc:515] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:27.001258 20637 leader_election.cc:290] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:27.003850 14155 leader_election.cc:304] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:27.006372 20844 raft_consensus.cc:3060] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:27.007862 20652 raft_consensus.cc:515] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:27.011365 20711 raft_consensus.cc:515] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:26.934321 20744 raft_consensus.cc:493] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:27.014503 20744 raft_consensus.cc:515] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:27.016716 20744 leader_election.cc:290] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:27.024060 14903 raft_consensus.cc:2468] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 18.
I20260709 12:12:27.013420 20711 leader_election.cc:290] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 18 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:27.071969 14256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41768 (request call id 2335) took 1383 ms. Trace:
I20260709 12:12:27.072513 14256 rpcz_store.cc:276] 0709 12:12:25.688227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:25.688392 (+   165us) service_pool.cc:224] Handling call
0709 12:12:25.688766 (+   374us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:26.084387 (+395621us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:27.071451 (+987064us) spinlock_profiling.cc:243] Waited 71.3 ms on lock 0x7b54003818d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:12:27.071763 (+   312us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":163987328}
I20260709 12:12:27.050092 20744 raft_consensus.cc:2804] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:27.087164 20744 raft_consensus.cc:493] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:27.087581 20744 raft_consensus.cc:3060] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:27.050438 20692 raft_consensus.cc:2749] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:27.087424 14189 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56046 (request call id 2866) took 1748 ms. Trace:
I20260709 12:12:27.092142 14189 rpcz_store.cc:276] 0709 12:12:25.338759 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:25.343191 (+  4432us) service_pool.cc:224] Handling call
0709 12:12:26.580507 (+1237316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:26.633974 (+ 53467us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:27.087116 (+453142us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b54003d0250. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713a8ad 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:12:27.087324 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2833516928}
I20260709 12:12:27.089826 14259 raft_consensus.cc:1275] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:12:27.101943 20610 raft_consensus.cc:493] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:27.102591 20610 raft_consensus.cc:515] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:12:27.130474 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 126755us
I20260709 12:12:27.124361 20652 leader_election.cc:290] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:12:27.156559 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 164002us
I20260709 12:12:27.126103 20637 raft_consensus.cc:493] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:27.154304 20798 leader_election.cc:290] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:27.179781 14155 leader_election.cc:304] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:27.178097 20798 raft_consensus.cc:493] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
W20260709 12:12:27.194619 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 355055us
W20260709 12:12:27.218324 14878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:27.181237 20637 raft_consensus.cc:515] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:27.247406 14334 raft_consensus.cc:1240] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:27.256479 14304 leader_election.cc:304] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:27.261552 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 17 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:27.265874 14259 raft_consensus.cc:3060] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:27.242877 20749 raft_consensus.cc:493] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:27.279891 20637 leader_election.cc:290] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:27.283034 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:27.283918 14188 raft_consensus.cc:2468] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 17.
I20260709 12:12:27.285243 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:27.287025 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:27.288154 14304 leader_election.cc:304] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:27.288411 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
W20260709 12:12:27.288969 14303 connection.cc:256] RPC call timeout handler was delayed by -1.3388007489998017s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18620000000000003s for a response
I20260709 12:12:27.289868 20691 raft_consensus.cc:2749] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:12:27.291813 14903 raft_consensus.cc:1240] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:27.291747 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:27.293144 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:27.293435 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:27.294256 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:27.294828 20697 raft_consensus.cc:493] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:27.295018 14904 raft_consensus.cc:2468] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 19.
I20260709 12:12:27.294843 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:27.294615 14907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:27.297302 14907 raft_consensus.cc:2468] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 18.
I20260709 12:12:27.298045 20767 raft_consensus.cc:493] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:27.298586 20767 raft_consensus.cc:515] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:27.298851 20691 raft_consensus.cc:493] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:27.299494 20691 raft_consensus.cc:515] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:27.300719 20767 leader_election.cc:290] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:27.301277 20767 raft_consensus.cc:493] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:27.301587 20691 leader_election.cc:290] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:27.305909 20749 raft_consensus.cc:515] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:27.307183 14188 raft_consensus.cc:2468] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 20.
W20260709 12:12:27.307837 20860 log.cc:927] Time spent T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.466s	user 0.000s	sys 0.007s
I20260709 12:12:27.308435 20749 leader_election.cc:290] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:27.312136 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:27.289634 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:27.290135 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:27.317214 14304 leader_election.cc:304] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:27.314525 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 17 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:27.319701 14303 leader_election.cc:304] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:12:27.294561 20789 raft_consensus.cc:2749] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:27.324152 20692 raft_consensus.cc:2749] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:27.330292 20768 raft_consensus.cc:2804] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 12:12:27.325455 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 158406us
I20260709 12:12:27.295400 20697 raft_consensus.cc:515] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:27.323366 20767 raft_consensus.cc:515] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:12:27.350412 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 60810us
I20260709 12:12:27.344777 20768 raft_consensus.cc:493] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:27.359586 14303 leader_election.cc:304] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:27.360333 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:27.334087 20798 raft_consensus.cc:515] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:27.332991 20744 raft_consensus.cc:515] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:27.349416 20868 raft_consensus.cc:2749] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:27.368546 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:27.363689 20768 raft_consensus.cc:3060] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:27.382649 14304 leader_election.cc:304] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:27.357008 20789 raft_consensus.cc:493] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:27.389918 20844 consensus_queue.cc:1059] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:12:27.390669 14304 leader_election.cc:304] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:27.391994 20844 raft_consensus.cc:3055] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:27.392436 20844 raft_consensus.cc:740] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:12:27.393435 14155 leader_election.cc:304] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:27.386656 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:27.393402 20844 consensus_queue.cc:260] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:27.395481 20844 raft_consensus.cc:3060] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:27.396026 14155 leader_election.cc:304] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:27.397166 20858 raft_consensus.cc:2749] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:27.397624 20798 leader_election.cc:290] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:27.349396 20841 consensus_queue.cc:1048] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.046s
I20260709 12:12:27.400982 20744 leader_election.cc:290] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 14 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:27.401851 20789 raft_consensus.cc:515] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:27.403153 20697 leader_election.cc:290] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:27.404162 20789 leader_election.cc:290] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:27.404776 20789 consensus_queue.cc:1059] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:12:27.405385 20767 leader_election.cc:290] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:27.406025 20767 raft_consensus.cc:2804] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:27.406436 20767 raft_consensus.cc:493] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:27.406807 20767 raft_consensus.cc:3060] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:27.407037 14154 leader_election.cc:304] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:27.383919 20637 raft_consensus.cc:493] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:27.408303 20637 raft_consensus.cc:515] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:27.410063 20789 consensus_queue.cc:1059] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:12:27.410812 20637 leader_election.cc:290] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:27.405915 20858 raft_consensus.cc:3055] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:27.411504 20858 raft_consensus.cc:740] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:12:27.412269 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:27.411049 20789 raft_consensus.cc:3055] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:27.413160 20789 raft_consensus.cc:740] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:12:27.404119 14155 leader_election.cc:304] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:27.415102 20789 consensus_queue.cc:260] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:27.416131 20788 raft_consensus.cc:2804] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:27.412683 20858 consensus_queue.cc:260] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:27.410851 20720 raft_consensus.cc:2804] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:27.417462 20689 raft_consensus.cc:2804] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 12:12:27.395912 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 49373us
I20260709 12:12:27.393935 14186 raft_consensus.cc:1240] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:27.421718 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:27.423729 20788 raft_consensus.cc:493] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:27.431453 20788 raft_consensus.cc:3060] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:27.429535 20858 raft_consensus.cc:3060] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:27.393636 14304 leader_election.cc:304] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:27.369691 20692 raft_consensus.cc:2749] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:27.425431 14155 leader_election.cc:304] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:27.395427 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:27.426944 20720 raft_consensus.cc:493] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:27.445544 20720 raft_consensus.cc:3060] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:27.444092 14259 raft_consensus.cc:2468] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 17.
I20260709 12:12:27.446377 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:27.447781 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:27.444052 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:27.441582 14909 pending_rounds.cc:85] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db: Aborting all ops after (but not including) 14
I20260709 12:12:27.435698 20652 raft_consensus.cc:2749] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:27.439186 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:27.435005 20689 raft_consensus.cc:493] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:27.454298 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:27.457429 14303 leader_election.cc:304] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:27.412760 20610 leader_election.cc:290] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:12:27.460525 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 66978.7us
I20260709 12:12:27.453881 20685 raft_consensus.cc:3060] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:27.461344 14256 raft_consensus.cc:2468] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 15.
I20260709 12:12:27.459342 20689 raft_consensus.cc:3060] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:27.462363 14263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53050 (request call id 1262) took 1887 ms. Trace:
I20260709 12:12:27.464910 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:27.453119 14909 pending_rounds.cc:107] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db: Aborting uncommitted NO_OP operation due to leader change: 19.15
I20260709 12:12:27.467149 14909 raft_consensus.cc:2889] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:27.450990 20789 raft_consensus.cc:3060] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:27.450800 20868 raft_consensus.cc:2804] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:27.463105 14263 rpcz_store.cc:276] 0709 12:12:25.575248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:25.582423 (+  7175us) service_pool.cc:224] Handling call
0709 12:12:26.504704 (+922281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:26.505061 (+   357us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 12:12:26.564879 (+ 59818us) log.cc:844] Serialized 14 byte log entry
0709 12:12:26.722384 (+157505us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:26.722441 (+    57us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:12:26.722492 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:26.724583 (+  2091us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:27.462009 (+737426us) spinlock_profiling.cc:243] Waited 922 ms on lock 0x7b54002fdd50. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713a8ad 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:12:27.462165 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14257,"prepare.queue_time_us":84904,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":49,"raft.queue_time_us":21328,"raft.run_cpu_time_us":203,"raft.run_wall_time_us":4575,"spinlock_wait_cycles":2140994176,"thread_start_us":178362,"threads_started":2,"wal-append.queue_time_us":208794}
I20260709 12:12:27.494390 14303 leader_election.cc:304] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:27.085961 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:27.499652 14303 leader_election.cc:304] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:27.479259 20599 consensus_queue.cc:1059] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.034s
I20260709 12:12:27.477895 20692 raft_consensus.cc:2749] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:12:27.476506 20868 raft_consensus.cc:493] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:27.519572 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:27.522307 14334 raft_consensus.cc:2468] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 21.
I20260709 12:12:27.523053 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:27.523996 14183 raft_consensus.cc:2410] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for term 21 because replica has last-logged OpId of term: 19 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 12:12:27.519469 14333 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 1252) took 1731 ms. Trace:
I20260709 12:12:27.526765 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:27.519821 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
W20260709 12:12:27.513139 20856 log.cc:927] Time spent T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.672s	user 0.011s	sys 0.000s
I20260709 12:12:27.524935 14333 rpcz_store.cc:276] 0709 12:12:25.734159 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:25.734980 (+   821us) service_pool.cc:224] Handling call
0709 12:12:25.735303 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:26.079826 (+344523us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:26.079878 (+    52us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:26.079946 (+    68us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:26.079971 (+    25us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:27.451697 (+1371726us) spinlock_profiling.cc:243] Waited 344 ms on lock 0x7b5400019d54. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:12:27.451744 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:27.465897 (+ 14153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":790691584}
I20260709 12:12:27.527510 14904 raft_consensus.cc:2468] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 17.
I20260709 12:12:27.504626 20691 raft_consensus.cc:2749] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:27.531397 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:27.536562 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:12:27.538774 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 120784us
I20260709 12:12:27.543201 14335 raft_consensus.cc:2393] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 17: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:12:27.544186 14339 raft_consensus.cc:1275] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 12:12:27.544636 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:27.545317 14334 raft_consensus.cc:2468] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 16.
I20260709 12:12:27.518132 20754 raft_consensus.cc:2749] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:27.525977 20868 raft_consensus.cc:3060] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:27.552371 14230 leader_election.cc:304] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:27.574882 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:27.524883 20143 consensus_queue.cc:1048] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.030s
I20260709 12:12:27.575677 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:27.579066 14259 raft_consensus.cc:2410] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for term 21 because replica has last-logged OpId of term: 19 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 12:12:27.575671 14183 raft_consensus.cc:2468] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 17.
W20260709 12:12:27.595029 14156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:27.594833 20751 consensus_queue.cc:1048] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.015s
I20260709 12:12:27.597002 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:27.598382 14155 leader_election.cc:304] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:27.601518 14264 raft_consensus.cc:1275] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
I20260709 12:12:27.575116 20744 raft_consensus.cc:493] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:27.559404 20642 consensus_queue.cc:1048] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 12:12:27.569916 20691 consensus_queue.cc:1059] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 12:12:27.609529 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:12:27.617475 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 107505us
I20260709 12:12:27.619616 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:27.620797 14183 raft_consensus.cc:2468] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 14.
I20260709 12:12:27.611554 20789 raft_consensus.cc:2749] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:27.619635 14303 leader_election.cc:304] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:27.639604 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:27.618012 20621 raft_consensus.cc:2804] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:27.644243 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:27.611492 20642 consensus_queue.cc:1243] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer 65c9c1653b3346b39a0e118540e6080c log is divergent from this leader: its last log entry 17.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:12:27.655251 20737 consensus_queue.cc:1048] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.081s
I20260709 12:12:27.660970 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:12:27.662153 14154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:27.662774 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 64489us
I20260709 12:12:27.663648 14155 leader_election.cc:304] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:27.664875 14155 leader_election.cc:304] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:27.665275 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:27.666033 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:27.666716 14334 raft_consensus.cc:2468] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 21.
I20260709 12:12:27.668339 20749 raft_consensus.cc:2749] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:27.669175 20749 raft_consensus.cc:2749] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:27.666044 14335 raft_consensus.cc:2468] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 15.
I20260709 12:12:27.671700 14904 raft_consensus.cc:1275] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 12. (term mismatch)
I20260709 12:12:27.672108 14904 pending_rounds.cc:85] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db: Aborting all ops after (but not including) 11
I20260709 12:12:27.672389 14904 pending_rounds.cc:107] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db: Aborting uncommitted NO_OP operation due to leader change: 14.12
I20260709 12:12:27.672621 14904 raft_consensus.cc:2889] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:27.638549 20751 raft_consensus.cc:493] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:27.673318 20751 raft_consensus.cc:515] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:27.675611 20751 leader_election.cc:290] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:12:27.636760 20870 log.cc:927] Time spent T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.185s	user 0.000s	sys 0.001s
I20260709 12:12:27.665683 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:27.645771 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:27.645912 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:27.672691 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:27.641028 20711 raft_consensus.cc:493] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:27.645792 20744 raft_consensus.cc:515] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:27.690622 14339 raft_consensus.cc:2468] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 20.
I20260709 12:12:27.682906 14189 raft_consensus.cc:2410] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for term 20 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 9.
I20260709 12:12:27.678236 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:27.688938 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:27.640343 14264 raft_consensus.cc:2468] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 16.
I20260709 12:12:27.647902 14190 raft_consensus.cc:2468] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 20.
I20260709 12:12:27.677683 20877 raft_consensus.cc:3055] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:27.681885 20691 raft_consensus.cc:2749] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:27.692849 20621 raft_consensus.cc:493] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:27.719148 20621 raft_consensus.cc:3060] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:27.690816 20789 consensus_queue.cc:1048] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 12:12:27.679219 20754 raft_consensus.cc:3055] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:27.692377 20711 raft_consensus.cc:515] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:27.721947 20754 raft_consensus.cc:740] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
W20260709 12:12:27.722182 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 120626us
I20260709 12:12:27.722268 14083 catalog_manager.cc:5697] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:27.724128 14186 raft_consensus.cc:2468] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 14.
I20260709 12:12:27.704412 20798 raft_consensus.cc:493] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:27.725950 14230 leader_election.cc:304] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:12:27.727756 14185 raft_consensus.cc:1240] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:27.683946 20767 raft_consensus.cc:515] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:27.714160 20877 raft_consensus.cc:740] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
W20260709 12:12:27.751873 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 116175us
I20260709 12:12:27.769527 20610 raft_consensus.cc:493] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:27.770208 14264 raft_consensus.cc:1275] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:12:27.773891 20621 raft_consensus.cc:515] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:27.776427 20621 leader_election.cc:290] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:27.770212 20610 raft_consensus.cc:515] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:27.777871 20621 raft_consensus.cc:2804] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:27.779886 20621 raft_consensus.cc:493] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:27.780261 20621 raft_consensus.cc:3060] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:12:27.783232 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 118435us
I20260709 12:12:27.754688 20711 leader_election.cc:290] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:27.786113 20685 raft_consensus.cc:2749] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:27.787496 20610 leader_election.cc:290] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:27.753429 20798 raft_consensus.cc:515] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:27.803920 14181 raft_consensus.cc:1275] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
W20260709 12:12:27.817427 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 91572.5us
I20260709 12:12:27.807142 14229 leader_election.cc:304] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:27.880112 14230 leader_election.cc:304] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:27.883147 14230 leader_election.cc:304] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
W20260709 12:12:27.886246 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 98319.1us
I20260709 12:12:27.887152 14230 leader_election.cc:304] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:27.891664 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:27.804024 20883 raft_consensus.cc:493] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:12:27.787006 20868 raft_consensus.cc:515] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:27.900879 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:27.796952 20789 raft_consensus.cc:493] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:27.899009 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:27.904441 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:27.904239 14336 raft_consensus.cc:2468] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 20.
I20260709 12:12:27.908978 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:27.795116 20754 consensus_queue.cc:260] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:27.902293 20143 raft_consensus.cc:3060] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:27.898039 20652 raft_consensus.cc:493] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:27.914806 14230 leader_election.cc:304] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:12:27.916746 14339 raft_consensus.cc:1240] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 18. Current term is 19. Ops: []
W20260709 12:12:27.894423 20846 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.053s	user 0.021s	sys 0.035s
I20260709 12:12:27.926656 14155 leader_election.cc:400] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 21 pre-election: Vote denied by peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673) with higher term. Message: Invalid argument: T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 21. Current term is 22.
I20260709 12:12:27.891863 20788 raft_consensus.cc:515] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:27.931125 20504 raft_consensus.cc:2749] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:27.946134 20652 raft_consensus.cc:515] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:12:27.942437 20846 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.101s	user 0.021s	sys 0.035s
I20260709 12:12:27.948803 20886 consensus_queue.cc:1048] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:12:27.954157 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:27.915373 20720 raft_consensus.cc:515] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:27.955689 14333 raft_consensus.cc:1240] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:27.956276 20884 raft_consensus.cc:493] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:12:27.954267 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
W20260709 12:12:27.955581 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 148560us
I20260709 12:12:27.987027 20846 raft_consensus.cc:697] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 16 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:27.908856 20789 raft_consensus.cc:515] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:27.942723 20892 raft_consensus.cc:2749] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:27.989997 20890 consensus_queue.cc:1059] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 16.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.008s
W20260709 12:12:28.002704 20881 log.cc:927] Time spent T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:12:28.003198 20846 consensus_queue.cc:237] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:28.004317 20685 raft_consensus.cc:493] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:27.970196 20744 leader_election.cc:290] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:27.982807 20610 raft_consensus.cc:2804] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:28.033785 20610 raft_consensus.cc:493] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:28.034328 20610 raft_consensus.cc:3060] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:28.035774 20652 leader_election.cc:290] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:28.035971 20691 raft_consensus.cc:493] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:28.027864 20685 raft_consensus.cc:515] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:28.018128 14182 raft_consensus.cc:1240] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:28.037621 20890 raft_consensus.cc:3055] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:28.038110 20890 raft_consensus.cc:740] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:28.038893 20685 leader_election.cc:290] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:28.039054 20890 consensus_queue.cc:260] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:28.040542 20890 raft_consensus.cc:3060] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:27.912603 20883 raft_consensus.cc:515] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:28.043295 20883 leader_election.cc:290] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:28.044920 20610 raft_consensus.cc:515] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:28.068750 20798 leader_election.cc:290] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:28.071398 20610 leader_election.cc:290] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:28.020256 20767 leader_election.cc:290] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 17 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:28.036540 20691 raft_consensus.cc:515] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:28.085377 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:28.086220 14333 raft_consensus.cc:2468] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 16.
I20260709 12:12:28.087410 20691 leader_election.cc:290] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:28.050287 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:28.051326 20720 leader_election.cc:290] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 20 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:12:28.053346 20689 consensus_meta.cc:287] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.590s	user 0.008s	sys 0.005s
I20260709 12:12:28.089514 20689 raft_consensus.cc:515] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:28.090710 14334 raft_consensus.cc:1240] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:28.093168 14334 raft_consensus.cc:1275] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 18 index: 8. Preceding OpId from leader: term: 22 index: 10. (index mismatch)
I20260709 12:12:28.053815 14185 raft_consensus.cc:1275] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 10. (term mismatch)
I20260709 12:12:28.093907 14185 pending_rounds.cc:85] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf: Aborting all ops after (but not including) 9
I20260709 12:12:28.094165 14185 pending_rounds.cc:107] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf: Aborting uncommitted NO_OP operation due to leader change: 18.10
I20260709 12:12:28.094411 14185 raft_consensus.cc:2889] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:28.097015 20689 leader_election.cc:290] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 20 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:28.054539 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:28.047297 20789 leader_election.cc:290] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:28.053822 20892 raft_consensus.cc:2804] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:12:28.062142 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:28.122228 14904 raft_consensus.cc:3060] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:28.122165 20892 raft_consensus.cc:697] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 22 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:28.124303 20892 consensus_queue.cc:237] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:28.062286 20788 leader_election.cc:290] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 21 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:28.034021 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:28.126566 14335 raft_consensus.cc:2468] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 15.
W20260709 12:12:28.071919 20879 log.cc:927] Time spent T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.299s	user 0.006s	sys 0.003s
I20260709 12:12:28.134577 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:28.098506 14877 leader_election.cc:304] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:12:28.021020 20884 raft_consensus.cc:515] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:12:28.136874 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 138428us
I20260709 12:12:28.120420 14083 catalog_manager.cc:5697] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 16 to 17, leader changed from 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) to 885067a0d31741bfb5c9935788e315bf (127.12.174.129). New cstate: current_term: 17 leader_uuid: "885067a0d31741bfb5c9935788e315bf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:12:28.119481 20868 leader_election.cc:290] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:28.142278 14877 leader_election.cc:304] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:12:28.160454 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:28.165566 14229 leader_election.cc:304] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:28.167534 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
W20260709 12:12:28.171214 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 257117us
I20260709 12:12:28.174495 20689 raft_consensus.cc:493] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:28.175354 14182 raft_consensus.cc:1240] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:28.175204 20689 raft_consensus.cc:515] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:28.177989 20689 leader_election.cc:290] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:28.179627 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:28.180080 14182 raft_consensus.cc:1275] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:12:28.180616 14264 raft_consensus.cc:2393] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 19: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:12:28.186474 14229 leader_election.cc:304] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:28.145812 20867 raft_consensus.cc:2804] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:28.175216 14304 leader_election.cc:304] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:28.148454 20692 raft_consensus.cc:493] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:28.160140 20577 raft_consensus.cc:493] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:28.140914 20621 raft_consensus.cc:515] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:28.211516 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:28.187886 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:28.189101 14182 raft_consensus.cc:1240] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:28.192351 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:28.219028 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:28.198335 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:12:28.220242 14156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:28.200788 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 286066us
I20260709 12:12:28.196617 14904 raft_consensus.cc:2468] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 20.
I20260709 12:12:28.189534 14229 leader_election.cc:304] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:28.227638 14911 raft_consensus.cc:1240] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:28.187933 20547 raft_consensus.cc:2804] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:28.228603 14230 leader_election.cc:304] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:12:28.224224 14189 raft_consensus.cc:2468] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 18.
I20260709 12:12:28.247653 14304 leader_election.cc:304] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
W20260709 12:12:28.194350 20768 consensus_meta.cc:287] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.769s	user 0.008s	sys 0.007s
I20260709 12:12:28.199687 20504 raft_consensus.cc:2749] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:28.220866 20767 raft_consensus.cc:2749] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:28.188483 20642 raft_consensus.cc:2749] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:28.266248 20642 raft_consensus.cc:2804] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:28.266683 20642 raft_consensus.cc:493] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:28.266993 20642 raft_consensus.cc:3060] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:28.269095 20143 raft_consensus.cc:2749] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:28.270794 20798 raft_consensus.cc:493] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:28.271464 20798 raft_consensus.cc:515] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:28.247539 20891 raft_consensus.cc:493] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:12:28.258875 20897 raft_consensus.cc:2804] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:12:28.272460 20891 raft_consensus.cc:515] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } }
I20260709 12:12:28.273125 20897 raft_consensus.cc:493] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
W20260709 12:12:28.274510 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 76656.6us
I20260709 12:12:28.247298 20547 raft_consensus.cc:493] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:12:28.260264 20884 leader_election.cc:290] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:28.224567 20692 raft_consensus.cc:515] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:28.280704 20893 consensus_queue.cc:1048] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:12:28.281250 20692 leader_election.cc:290] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:28.224961 20577 raft_consensus.cc:515] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:28.283491 20577 leader_election.cc:290] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:28.284246 20898 raft_consensus.cc:2749] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:28.263084 20844 raft_consensus.cc:493] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:28.259194 20504 consensus_queue.cc:1048] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:12:28.188624 20637 consensus_queue.cc:1048] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.086s
W20260709 12:12:28.285768 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 118865us
I20260709 12:12:28.275676 14304 leader_election.cc:304] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:28.273541 20897 raft_consensus.cc:3060] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:28.276634 20547 raft_consensus.cc:3060] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:28.271412 20621 leader_election.cc:290] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:28.293515 14303 leader_election.cc:304] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:28.254832 20768 raft_consensus.cc:515] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:28.294507 20846 raft_consensus.cc:2749] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:12:28.320950 14304 leader_election.cc:304] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:28.321853 14181 raft_consensus.cc:1240] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 13. Current term is 14. Ops: []
I20260709 12:12:28.288946 20844 raft_consensus.cc:515] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:28.322573 14304 leader_election.cc:304] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:28.336843 14338 raft_consensus.cc:2368] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 18. Current term is 19.
W20260709 12:12:28.338265 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 148804us
I20260709 12:12:28.338577 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:28.339111 14229 leader_election.cc:304] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
W20260709 12:12:28.331451 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 143356us
I20260709 12:12:28.295537 20691 consensus_queue.cc:1059] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.022s
I20260709 12:12:28.306394 20867 raft_consensus.cc:697] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 17 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
W20260709 12:12:28.349689 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 110353us
I20260709 12:12:28.349895 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:28.295667 20880 consensus_queue.cc:1059] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 12, Time since last communication: 0.022s
I20260709 12:12:28.339763 20689 raft_consensus.cc:2804] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:28.340626 20692 raft_consensus.cc:2749] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:28.319257 20767 consensus_queue.cc:1059] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 12:12:28.340445 20898 consensus_queue.cc:1048] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
W20260709 12:12:28.404464 20899 log.cc:927] Time spent T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.114s	user 0.001s	sys 0.001s
I20260709 12:12:28.406347 20577 consensus_queue.cc:1059] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 12:12:28.402453 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 43897.7us
I20260709 12:12:28.397958 20637 raft_consensus.cc:2804] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:28.387022 20689 raft_consensus.cc:493] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:28.398423 20891 leader_election.cc:290] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187)
I20260709 12:12:28.357724 14230 leader_election.cc:304] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:12:28.428896 20798 leader_election.cc:290] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:12:28.437829 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 80176us
W20260709 12:12:28.426690 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 104109us
I20260709 12:12:28.440863 14304 leader_election.cc:304] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:28.343286 20903 consensus_queue.cc:1048] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.108s
I20260709 12:12:28.438721 14230 leader_election.cc:304] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:12:28.426347 20637 raft_consensus.cc:493] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:28.453275 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:28.432407 20689 raft_consensus.cc:3060] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:28.460971 20637 raft_consensus.cc:3060] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:28.461676 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:28.461876 14339 raft_consensus.cc:1240] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:28.462277 20911 consensus_queue.cc:1059] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:12:28.462951 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:28.464687 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:28.469775 20789 raft_consensus.cc:493] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:28.446346 20774 raft_consensus.cc:3055] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:12:28.449494 14230 leader_election.cc:304] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:12:28.475849 14262 raft_consensus.cc:2468] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 16.
I20260709 12:12:28.478667 14335 raft_consensus.cc:2468] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 15.
I20260709 12:12:28.477990 14336 raft_consensus.cc:2468] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 16.
I20260709 12:12:28.446152 20748 raft_consensus.cc:2804] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:12:28.455358 20893 raft_consensus.cc:2749] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:28.453418 20844 leader_election.cc:290] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:28.471309 20891 raft_consensus.cc:2804] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:28.484851 14910 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53194 (request call id 1151) took 1002 ms. Trace:
W20260709 12:12:28.486238 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 45435.3us
I20260709 12:12:28.489375 14304 leader_election.cc:304] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:28.455094 20890 raft_consensus.cc:493] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:28.501952 20885 raft_consensus.cc:493] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:28.502631 20885 raft_consensus.cc:515] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:28.504910 20885 leader_election.cc:290] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:28.481928 20774 raft_consensus.cc:740] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:12:28.487391 20692 raft_consensus.cc:2749] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:28.483796 20789 raft_consensus.cc:515] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:28.482232 20748 raft_consensus.cc:493] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:12:28.510074 20748 raft_consensus.cc:3060] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:28.510422 20789 leader_election.cc:290] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:28.511557 20915 raft_consensus.cc:2804] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:28.512073 20915 raft_consensus.cc:493] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:28.512420 20915 raft_consensus.cc:3060] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:28.488456 14910 rpcz_store.cc:276] 0709 12:12:27.292668 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:27.294148 (+  1480us) service_pool.cc:224] Handling call
0709 12:12:27.779680 (+485532us) spinlock_profiling.cc:243] Waited 20.1 ms on lock 0x7b5800096698. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2124016b71 00007f2124016eee 000000000036eb39 00007f212c08a1e0 00007f212c1530c4 00007f212c153131 00007f212c114fc0 00007f212c0ff929 00007f212c0ff3d2 00007f2125676bd4
0709 12:12:27.779864 (+   184us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:27.780132 (+   268us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:12:27.906111 (+125979us) log.cc:844] Serialized 14 byte log entry
0709 12:12:28.291583 (+385472us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:28.291636 (+    53us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:12:28.291690 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:28.291771 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:28.295096 (+  3325us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9543,"prepare.queue_time_us":111188,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":2581,"raft.queue_time_us":78916,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":3499,"spinlock_wait_cycles":46131584,"thread_start_us":458865,"threads_started":3,"wal-append.queue_time_us":335637}
I20260709 12:12:28.521248 20884 raft_consensus.cc:493] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:12:28.529271 20884 raft_consensus.cc:515] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:28.529978 20920 raft_consensus.cc:493] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:28.530694 20920 raft_consensus.cc:515] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:28.545652 20885 raft_consensus.cc:493] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:28.546411 20885 raft_consensus.cc:515] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:28.528913 20774 consensus_queue.cc:260] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:28.549907 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:28.550756 14335 raft_consensus.cc:2393] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 19: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:12:28.551221 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:28.551424 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:28.551666 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:28.552444 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:28.552649 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:28.552826 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:12:28.533187 20888 log.cc:927] Time spent T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.767s	user 0.000s	sys 0.012s
I20260709 12:12:28.533797 20768 leader_election.cc:290] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:28.495874 20891 raft_consensus.cc:493] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:28.482311 20914 consensus_queue.cc:1059] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.050s
W20260709 12:12:28.536684 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 150053us
I20260709 12:12:28.522308 20877 consensus_queue.cc:260] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:28.540571 20884 leader_election.cc:290] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:28.553648 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:28.530301 20692 raft_consensus.cc:2804] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:28.546696 20920 leader_election.cc:290] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:28.562104 20692 raft_consensus.cc:493] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:12:28.554090 20774 raft_consensus.cc:3060] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:28.563593 14257 raft_consensus.cc:1240] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:28.565148 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:28.555023 20891 raft_consensus.cc:3060] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:28.555764 20914 raft_consensus.cc:3055] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:28.562590 20692 raft_consensus.cc:3060] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:28.567986 14229 leader_election.cc:304] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:28.559412 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:28.569667 14259 raft_consensus.cc:2468] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 16.
I20260709 12:12:28.558560 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:28.558194 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:28.562296 14330 raft_consensus.cc:2393] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 18: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:12:28.531445 20898 consensus_queue.cc:1048] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:12:28.476984 20867 consensus_queue.cc:237] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:28.553483 14335 raft_consensus.cc:2468] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 17.
I20260709 12:12:28.577394 14229 leader_election.cc:304] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:12:28.594365 14304 leader_election.cc:304] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:12:28.595477 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:28.548872 20885 leader_election.cc:290] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:28.567031 20914 raft_consensus.cc:740] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:12:28.610252 14155 leader_election.cc:304] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:28.615351 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:28.615862 14229 leader_election.cc:304] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:28.616590 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:28.618580 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:28.560595 20877 raft_consensus.cc:3060] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:28.631371 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:28.632730 20652 consensus_queue.cc:1059] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:12:28.633777 20871 raft_consensus.cc:3055] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:28.627208 20893 raft_consensus.cc:2804] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:28.634729 20893 raft_consensus.cc:493] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:28.635149 20893 raft_consensus.cc:3060] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:28.627242 20610 raft_consensus.cc:493] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:28.636795 20610 raft_consensus.cc:515] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:28.606860 20920 consensus_queue.cc:1059] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 12:12:28.628767 20143 raft_consensus.cc:2804] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:28.628108 14155 leader_election.cc:304] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:28.524338 20890 raft_consensus.cc:515] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:28.644619 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:28.650451 14334 raft_consensus.cc:2368] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 21. Current term is 22.
I20260709 12:12:28.652855 14338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50856 (request call id 2799) took 1126 ms. Trace:
I20260709 12:12:28.653335 14338 rpcz_store.cc:276] 0709 12:12:27.517227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:27.517613 (+   386us) service_pool.cc:224] Handling call
0709 12:12:28.643782 (+1126169us) spinlock_profiling.cc:243] Waited 804 ms on lock 0x7b540010dbd4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:12:28.643930 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1849635200}
I20260709 12:12:28.525470 20642 raft_consensus.cc:515] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:28.656023 14154 leader_election.cc:304] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:28.634845 20691 raft_consensus.cc:3055] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:28.662555 20652 raft_consensus.cc:3055] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:28.671970 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:28.634210 20871 raft_consensus.cc:740] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:12:28.629987 20789 raft_consensus.cc:2804] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:28.678042 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:28.685051 14333 raft_consensus.cc:2393] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 19: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
W20260709 12:12:28.679121 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 71119us
I20260709 12:12:28.606820 20897 raft_consensus.cc:515] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:28.639175 20610 leader_election.cc:290] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:28.678779 14336 pending_rounds.cc:85] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c: Aborting all ops after (but not including) 9
I20260709 12:12:28.691722 14336 pending_rounds.cc:107] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c: Aborting uncommitted NO_OP operation due to leader change: 17.10
I20260709 12:12:28.692082 14336 raft_consensus.cc:2889] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:28.675715 20921 raft_consensus.cc:493] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:28.697362 14230 leader_election.cc:304] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:12:28.674103 20691 raft_consensus.cc:740] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:28.675474 20652 raft_consensus.cc:740] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:12:28.710081 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:28.633648 20547 raft_consensus.cc:515] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:28.630224 20902 consensus_queue.cc:1048] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.066s
I20260709 12:12:28.680826 20599 raft_consensus.cc:3055] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:28.684032 20789 raft_consensus.cc:493] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:28.687271 20901 raft_consensus.cc:2804] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 12:12:28.725939 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 97657.6us
I20260709 12:12:28.667913 20915 raft_consensus.cc:515] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:28.706813 20884 raft_consensus.cc:2804] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:28.708127 20788 raft_consensus.cc:2749] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 12:12:28.743928 14154 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 74963.6us
I20260709 12:12:28.734082 20789 raft_consensus.cc:3060] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:28.737767 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:28.726981 20599 raft_consensus.cc:740] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:28.732884 20685 raft_consensus.cc:2804] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Leader election won for term 20
W20260709 12:12:28.753948 14156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:28.757858 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:28.736259 20901 raft_consensus.cc:493] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
W20260709 12:12:28.757601 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 129578us
W20260709 12:12:28.750321 14230 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.174.131:45957 timed out after 1.859s (SENT) [suppressed 4 similar messages]
I20260709 12:12:28.763486 14155 leader_election.cc:304] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:28.713951 20921 raft_consensus.cc:515] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:28.756876 20913 raft_consensus.cc:493] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:28.762532 20901 raft_consensus.cc:3060] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:28.761917 20685 raft_consensus.cc:697] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 20 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:12:28.703949 20914 consensus_queue.cc:260] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:28.777057 14155 leader_election.cc:304] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:28.786499 20930 raft_consensus.cc:2804] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:28.787002 20930 raft_consensus.cc:493] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:28.787344 20930 raft_consensus.cc:3060] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:28.794164 20933 consensus_queue.cc:1048] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:12:28.795928 20933 raft_consensus.cc:493] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:28.796496 20933 raft_consensus.cc:515] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:28.796783 20930 raft_consensus.cc:515] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:28.744727 20871 consensus_queue.cc:260] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:28.799255 20871 raft_consensus.cc:3060] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:28.800210 20689 raft_consensus.cc:515] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:28.802448 20890 leader_election.cc:290] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:28.812230 14337 raft_consensus.cc:1240] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:28.816982 14910 raft_consensus.cc:1240] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 15. Current term is 16. Ops: []
W20260709 12:12:28.833703 14305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:28.835763 20642 leader_election.cc:290] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:28.766547 20652 consensus_queue.cc:260] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:28.843786 20929 raft_consensus.cc:2804] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:28.784828 20846 raft_consensus.cc:493] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:28.754956 20691 consensus_queue.cc:260] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:28.818579 20143 raft_consensus.cc:697] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 18 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
W20260709 12:12:28.846966 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 96686.7us
W20260709 12:12:28.857903 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 124617us
W20260709 12:12:28.850462 20925 log.cc:927] Time spent T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 12:12:28.865381 14262 raft_consensus.cc:1275] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:12:28.866919 20754 raft_consensus.cc:3060] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:28.844432 20929 raft_consensus.cc:493] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:12:28.870941 20929 raft_consensus.cc:3060] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:28.871604 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:28.872222 14337 raft_consensus.cc:3060] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Advancing to term 18
I20260709 12:12:28.872485 20767 consensus_queue.cc:1048] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:12:28.874729 20933 leader_election.cc:290] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:28.875742 20933 consensus_queue.cc:1059] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:12:28.876768 20897 leader_election.cc:290] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:28.776324 20913 raft_consensus.cc:515] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:28.878597 20915 leader_election.cc:290] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 21 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:28.851480 20846 raft_consensus.cc:515] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:28.879521 20913 leader_election.cc:290] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:28.843991 20685 consensus_queue.cc:237] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:28.881928 20930 leader_election.cc:290] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 18 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:28.882632 20930 raft_consensus.cc:493] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:28.883126 20930 raft_consensus.cc:515] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:28.816704 20637 raft_consensus.cc:515] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:28.886426 14264 raft_consensus.cc:1240] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 12:12:28.870338 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:28.893666 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
W20260709 12:12:28.852598 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 184344us
I20260709 12:12:28.853031 20652 raft_consensus.cc:3060] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:28.897651 14904 raft_consensus.cc:2468] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 18.
I20260709 12:12:28.904567 14259 raft_consensus.cc:1240] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 18. Current term is 19. Ops: []
W20260709 12:12:28.970100 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 76987.4us
I20260709 12:12:28.897962 14877 leader_election.cc:304] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:12:28.863142 20691 raft_consensus.cc:3060] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:28.970242 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 21 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:28.969820 14337 raft_consensus.cc:2468] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 18.
I20260709 12:12:28.975167 14264 raft_consensus.cc:1240] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 16. Current term is 17. Ops: [14.13-16.14]
I20260709 12:12:28.978745 14258 raft_consensus.cc:1240] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 21. Current term is 22. Ops: [21.14-21.14]
I20260709 12:12:28.891891 20931 raft_consensus.cc:493] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:28.984062 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 86200.6us
I20260709 12:12:28.984603 20913 raft_consensus.cc:2804] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 12:12:28.985030 20923 log.cc:927] Time spent T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.254s	user 0.000s	sys 0.000s
I20260709 12:12:28.819511 20599 consensus_queue.cc:260] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:28.969866 20897 raft_consensus.cc:493] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:28.977299 20898 raft_consensus.cc:493] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:29.033466 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
W20260709 12:12:29.031222 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 254234us
I20260709 12:12:28.979815 20689 leader_election.cc:290] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:29.034802 14877 leader_election.cc:304] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:12:29.036393 14264 raft_consensus.cc:3060] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:28.972667 20767 consensus_queue.cc:1059] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.056s
I20260709 12:12:28.997987 20944 raft_consensus.cc:2804] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:29.047948 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:29.029594 20913 raft_consensus.cc:493] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:29.033027 20930 leader_election.cc:290] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:12:29.043825 20748 consensus_meta.cc:287] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.533s	user 0.011s	sys 0.001s
I20260709 12:12:29.071529 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:29.073424 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:29.048502 20599 raft_consensus.cc:3060] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:29.076519 14260 raft_consensus.cc:2393] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 21: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:12:29.046140 20944 raft_consensus.cc:493] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:29.064057 20913 raft_consensus.cc:3060] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:29.046032 20788 raft_consensus.cc:493] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:29.044361 20692 raft_consensus.cc:515] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:29.074164 20547 leader_election.cc:290] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 16 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:29.031069 20931 raft_consensus.cc:515] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:29.043933 20897 raft_consensus.cc:515] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:12:29.105954 20927 log.cc:927] Time spent T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.301s	user 0.000s	sys 0.001s
I20260709 12:12:29.075984 20748 raft_consensus.cc:515] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:29.041687 20898 raft_consensus.cc:515] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:29.093892 14258 raft_consensus.cc:1275] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 18 index: 8. Preceding OpId from leader: term: 20 index: 9. (index mismatch)
I20260709 12:12:29.116958 20637 leader_election.cc:290] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:29.117813 14260 raft_consensus.cc:1275] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:12:29.118717 20846 leader_election.cc:290] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:29.121654 20897 leader_election.cc:290] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:29.042165 20893 raft_consensus.cc:515] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:29.071184 20891 raft_consensus.cc:515] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:12:29.112839 20774 consensus_meta.cc:287] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db: Time spent flushing consensus metadata: real 0.550s	user 0.008s	sys 0.004s
W20260709 12:12:29.155275 14156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:29.150238 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 86779.6us
I20260709 12:12:29.117630 20912 raft_consensus.cc:493] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:29.045918 20143 consensus_queue.cc:237] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:29.088363 20921 leader_election.cc:290] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:29.090081 20944 raft_consensus.cc:3060] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:29.102219 20843 consensus_queue.cc:1059] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.056s
I20260709 12:12:29.117005 20945 raft_consensus.cc:3055] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:29.166257 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:29.173252 14303 leader_election.cc:304] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:29.175469 14303 leader_election.cc:304] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
W20260709 12:12:29.176644 14154 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 331012us
I20260709 12:12:29.178990 14331 raft_consensus.cc:2468] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 18.
I20260709 12:12:29.184983 14260 raft_consensus.cc:1275] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:12:29.144228 20788 raft_consensus.cc:515] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:29.194053 14303 leader_election.cc:304] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
W20260709 12:12:29.194726 14305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:29.167860 20945 raft_consensus.cc:740] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:12:29.199717 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:29.204625 14904 raft_consensus.cc:3060] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:12:29.195469 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 152138us
W20260709 12:12:29.206365 14878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:29.201328 14303 leader_election.cc:304] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:29.207937 14303 leader_election.cc:304] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:29.209295 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:29.217706 14260 raft_consensus.cc:2393] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 18: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:12:29.153606 20901 raft_consensus.cc:515] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:12:29.256167 14156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:29.192533 20846 raft_consensus.cc:2749] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:29.260881 20963 raft_consensus.cc:2749] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:12:29.263891 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:29.262975 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:29.182688 20958 raft_consensus.cc:493] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:29.265524 14912 raft_consensus.cc:2468] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 22.
I20260709 12:12:29.266711 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:29.267599 14260 raft_consensus.cc:2393] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 15: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:12:29.270462 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:12:29.209201 20916 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.007s	sys 0.017s
I20260709 12:12:29.210307 20877 raft_consensus.cc:2749] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 12:12:29.279944 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 73375.6us
I20260709 12:12:29.217316 20890 raft_consensus.cc:2749] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:12:29.277951 20896 raft_consensus.cc:2749] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:29.283715 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:12:29.279300 20916 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.808s	user 0.008s	sys 0.017s
I20260709 12:12:29.214710 20789 raft_consensus.cc:515] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:29.295347 14260 raft_consensus.cc:2368] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 15. Current term is 16.
I20260709 12:12:29.282711 20547 raft_consensus.cc:493] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:29.283839 20867 raft_consensus.cc:493] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:29.167495 20912 raft_consensus.cc:515] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:29.265669 20958 raft_consensus.cc:515] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:29.305768 20958 leader_election.cc:290] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:29.306509 20955 raft_consensus.cc:493] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:29.307159 20955 raft_consensus.cc:515] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:29.307859 20912 leader_election.cc:290] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:29.311575 20891 leader_election.cc:290] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:29.302394 20929 raft_consensus.cc:515] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } }
I20260709 12:12:29.319094 14258 raft_consensus.cc:1240] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:29.320152 20929 leader_election.cc:290] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187)
I20260709 12:12:29.297420 20945 consensus_queue.cc:260] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:29.322427 20945 raft_consensus.cc:3060] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:29.323068 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:29.324420 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:29.325634 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:29.326486 14261 raft_consensus.cc:2410] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for term 17 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 12:12:29.327131 20893 leader_election.cc:290] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 17 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:29.322578 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:29.327592 20955 leader_election.cc:290] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:29.326896 14912 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af"
dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
mode: GRACEFUL
new_leader_uuid: "885067a0d31741bfb5c9935788e315bf"
 from {username='slave'} at 127.0.0.1:38628
I20260709 12:12:29.326534 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:29.264920 14264 raft_consensus.cc:2468] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 17.
W20260709 12:12:29.335510 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 127675us
I20260709 12:12:29.328601 14912 raft_consensus.cc:606] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 21 LEADER]: Received request to transfer leadership to TS 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:29.329447 20931 leader_election.cc:290] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:29.328111 20901 leader_election.cc:290] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:29.326841 20692 leader_election.cc:290] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 17 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:29.326514 20748 leader_election.cc:290] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:29.325879 20867 raft_consensus.cc:515] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:29.351310 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 21 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:12:29.371352 20942 log.cc:927] Time spent T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.291s	user 0.004s	sys 0.000s
I20260709 12:12:29.373064 20788 leader_election.cc:290] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:29.374569 20789 leader_election.cc:290] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 21 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:29.371181 14229 leader_election.cc:304] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:29.376327 20929 raft_consensus.cc:2804] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:29.376777 20929 raft_consensus.cc:493] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:29.377153 20929 raft_consensus.cc:3060] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:29.351963 20898 leader_election.cc:290] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:29.330688 20547 raft_consensus.cc:515] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:29.386157 14083 catalog_manager.cc:5697] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 14 to 17, leader changed from 65c9c1653b3346b39a0e118540e6080c (127.12.174.131) to 73d01e9b1a9d49358da4985b21d681db (127.12.174.132). New cstate: current_term: 17 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:29.390750 20689 raft_consensus.cc:3055] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:29.391265 20689 raft_consensus.cc:740] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:29.392180 20689 consensus_queue.cc:260] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:29.394716 20774 raft_consensus.cc:3055] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:29.395185 20774 raft_consensus.cc:740] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:12:29.396198 20774 consensus_queue.cc:260] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:29.398357 14331 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50858 (request call id 2320) took 1501 ms. Trace:
I20260709 12:12:29.398823 14331 rpcz_store.cc:276] 0709 12:12:27.897028 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:27.897176 (+   148us) service_pool.cc:224] Handling call
0709 12:12:29.398109 (+1500933us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b540010d6d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:12:29.398277 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2500088576}
I20260709 12:12:29.400427 20958 raft_consensus.cc:493] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:29.400815 20748 raft_consensus.cc:493] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:29.401481 20748 raft_consensus.cc:515] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:29.403705 20901 raft_consensus.cc:493] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:29.404270 20901 raft_consensus.cc:515] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:29.406227 20898 raft_consensus.cc:493] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:12:29.406934 20898 raft_consensus.cc:515] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:29.401098 20958 raft_consensus.cc:515] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:29.416168 20884 raft_consensus.cc:493] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:29.416760 20884 raft_consensus.cc:3060] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:29.393545 20689 raft_consensus.cc:3060] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:29.429044 20914 raft_consensus.cc:3060] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:12:29.468072 14878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:29.472822 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:29.352162 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:29.353976 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:29.473034 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:29.474108 14335 raft_consensus.cc:3060] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:29.476081 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:29.476986 14336 raft_consensus.cc:2368] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 18. Current term is 19.
I20260709 12:12:29.478387 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:29.351969 14155 leader_election.cc:400] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 21 election: Vote denied by peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957) with higher term. Message: Invalid argument: T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 21. Current term is 22.
I20260709 12:12:29.496855 14155 leader_election.cc:403] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 21 election: Cancelling election due to peer responding with higher term
I20260709 12:12:29.508527 20720 raft_consensus.cc:3060] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:29.509246 14338 raft_consensus.cc:1275] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
W20260709 12:12:29.512754 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 160934us
I20260709 12:12:29.533958 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:29.535001 14334 raft_consensus.cc:2393] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 20: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:12:29.535961 14155 leader_election.cc:304] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:29.550518 14904 raft_consensus.cc:2468] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 19.
I20260709 12:12:29.568400 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:29.569309 14337 raft_consensus.cc:3060] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:12:29.566357 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 161619us
I20260709 12:12:29.554821 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:12:29.566330 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 195275us
I20260709 12:12:29.388759 14083 catalog_manager.cc:5697] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 15 to 16, leader changed from 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) to 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130). New cstate: current_term: 16 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:12:29.572098 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:29.573369 14336 raft_consensus.cc:3060] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:12:29.566452 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 213197us
I20260709 12:12:29.574323 14303 leader_election.cc:304] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:12:29.602378 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:12:29.600085 14877 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.002s	sys 0.022s
W20260709 12:12:29.607544 14877 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.560s	user 0.002s	sys 0.022s
W20260709 12:12:29.607954 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 562901us
I20260709 12:12:29.607453 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:29.575855 14303 leader_election.cc:304] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:12:29.610414 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:29.611872 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:29.613817 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:29.618847 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:29.619819 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:29.613161 14083 catalog_manager.cc:5697] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 14 to 16, leader changed from 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) to 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130). New cstate: current_term: 16 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:12:29.607010 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:29.622203 14182 raft_consensus.cc:3060] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:29.630327 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:29.630995 14338 raft_consensus.cc:3060] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:29.632206 14337 raft_consensus.cc:2468] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 16.
I20260709 12:12:29.635550 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:29.635875 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:29.636657 14184 raft_consensus.cc:2468] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 16.
I20260709 12:12:29.629968 14230 leader_election.cc:304] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:12:29.578634 20930 raft_consensus.cc:2804] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:29.647266 14265 raft_consensus.cc:1240] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:29.647810 14083 catalog_manager.cc:5697] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 13 to 21. New cstate: current_term: 21 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:29.649011 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:29.649653 14264 raft_consensus.cc:3060] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:29.635854 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 23 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:29.647322 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:29.636401 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:29.569389 20843 raft_consensus.cc:493] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:29.602322 20774 raft_consensus.cc:3060] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:12:29.646113 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 70341.4us
I20260709 12:12:29.651814 14331 raft_consensus.cc:2393] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 17: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:12:29.601445 20890 raft_consensus.cc:2804] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:12:29.652591 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:29.636798 14261 raft_consensus.cc:2468] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 17.
I20260709 12:12:29.651203 14260 raft_consensus.cc:2468] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 22.
I20260709 12:12:29.601137 20896 raft_consensus.cc:493] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
W20260709 12:12:29.657094 14259 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.031s	sys 0.022s
W20260709 12:12:29.659582 14259 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.505s	user 0.031s	sys 0.022s
I20260709 12:12:29.660792 14333 raft_consensus.cc:2393] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 18: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:12:29.663542 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:29.667088 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:29.635336 20487 raft_consensus.cc:2804] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:29.668538 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:29.667004 14083 catalog_manager.cc:5697] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:29.621112 20891 consensus_queue.cc:1059] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.026s
I20260709 12:12:29.670024 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:29.628758 20691 raft_consensus.cc:493] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:12:29.674116 14260 raft_consensus.cc:2468] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 17.
I20260709 12:12:29.671268 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:29.675135 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:29.675837 14260 raft_consensus.cc:2393] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 18: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:12:29.654414 20767 raft_consensus.cc:2804] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:29.677454 14264 raft_consensus.cc:2468] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 17.
I20260709 12:12:29.679883 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:29.679949 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:29.682745 14258 raft_consensus.cc:2468] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 17.
I20260709 12:12:29.684736 14083 catalog_manager.cc:5697] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 14 to 18. New cstate: current_term: 18 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:29.660022 20890 raft_consensus.cc:493] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:29.687465 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:29.663915 20933 raft_consensus.cc:493] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:29.662729 20599 raft_consensus.cc:493] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:29.691565 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:29.688268 14083 catalog_manager.cc:5697] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 10 to 15, leader changed from 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130) to 73d01e9b1a9d49358da4985b21d681db (127.12.174.132). New cstate: current_term: 15 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:12:29.689987 14878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:29.664170 20930 raft_consensus.cc:697] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 18 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:12:29.687597 20685 raft_consensus.cc:493] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:29.697710 20685 raft_consensus.cc:515] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:29.698029 20930 consensus_queue.cc:237] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:29.700225 20685 leader_election.cc:290] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:12:29.700982 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:29.692164 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:29.704491 14331 raft_consensus.cc:2468] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 18.
I20260709 12:12:29.692765 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:29.694133 14261 raft_consensus.cc:1240] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 21. Current term is 22. Ops: []
I20260709 12:12:29.708222 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:29.671181 20967 raft_consensus.cc:493] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:29.708904 14187 raft_consensus.cc:2468] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 19.
I20260709 12:12:29.684986 20918 raft_consensus.cc:493] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:29.664508 20843 raft_consensus.cc:515] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:29.692883 20915 raft_consensus.cc:2804] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:29.721988 20642 raft_consensus.cc:493] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:29.766943 20915 raft_consensus.cc:697] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 18 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:29.768095 20915 consensus_queue.cc:237] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:29.735469 14339 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c"
dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
mode: GRACEFUL
new_leader_uuid: "885067a0d31741bfb5c9935788e315bf"
 from {username='slave'} at 127.0.0.1:50896
I20260709 12:12:29.721496 20599 raft_consensus.cc:515] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:29.770159 14339 raft_consensus.cc:606] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Received request to transfer leadership to TS 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:29.770592 14339 raft_consensus.cc:614] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:29.772153 20599 leader_election.cc:290] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:29.774708 14263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41764 (request call id 3447) took 1216 ms. Trace:
I20260709 12:12:29.775197 14263 rpcz_store.cc:276] 0709 12:12:28.558695 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:28.596392 (+ 37697us) service_pool.cc:224] Handling call
0709 12:12:29.774430 (+1178038us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b5400072954. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:12:29.774602 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2420198272}
W20260709 12:12:29.777149 14305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:29.779479 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:29.783448 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:29.783622 14083 catalog_manager.cc:5697] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:29.784454 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:29.784674 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:29.785281 14189 raft_consensus.cc:2393] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 18: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:12:29.785849 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:29.786052 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:29.787652 14331 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95"
dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
mode: GRACEFUL
new_leader_uuid: "17aab1bbf5014936aa18cc21818b26ec"
 from {username='slave'} at 127.0.0.1:50896
I20260709 12:12:29.789098 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:29.766965 20642 raft_consensus.cc:515] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:29.790388 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:29.791148 14186 raft_consensus.cc:2393] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 21: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:12:29.766233 20748 leader_election.cc:290] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:29.794592 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:29.795360 14184 raft_consensus.cc:2468] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 16.
W20260709 12:12:29.796232 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 77001.9us
I20260709 12:12:29.797488 14155 leader_election.cc:304] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
W20260709 12:12:29.798431 20966 log.cc:927] Time spent T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:12:29.694239 20867 leader_election.cc:290] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:29.798964 20961 raft_consensus.cc:2749] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:29.799969 20599 raft_consensus.cc:493] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:29.703768 20898 leader_election.cc:290] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:29.706754 20685 raft_consensus.cc:493] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:29.800515 20599 raft_consensus.cc:515] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:29.801607 20642 leader_election.cc:290] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:29.738969 20487 raft_consensus.cc:493] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:29.802168 20958 leader_election.cc:290] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:29.798635 20964 consensus_queue.cc:1048] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 12:12:29.731681 20967 raft_consensus.cc:515] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:29.803936 20599 leader_election.cc:290] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:29.805094 20967 leader_election.cc:290] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:29.692137 20890 raft_consensus.cc:3060] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:29.805688 14155 leader_election.cc:304] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:29.733639 14877 leader_election.cc:304] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
W20260709 12:12:29.807049 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 73531.6us
I20260709 12:12:29.809787 20867 raft_consensus.cc:2804] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:29.810230 20867 raft_consensus.cc:493] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:29.810575 20867 raft_consensus.cc:3060] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:29.706935 20933 raft_consensus.cc:515] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:29.785482 14083 catalog_manager.cc:5697] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 5 to 16, leader changed from 65c9c1653b3346b39a0e118540e6080c (127.12.174.131) to 73d01e9b1a9d49358da4985b21d681db (127.12.174.132). New cstate: current_term: 16 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:29.802386 20487 raft_consensus.cc:3060] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:29.747035 20547 leader_election.cc:290] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:29.729839 20652 consensus_queue.cc:1059] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.026s
W20260709 12:12:29.756285 14087 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60410 (request call id 258) took 75174 ms (client timeout 15000 ms). Trace:
I20260709 12:12:29.798458 20948 consensus_queue.cc:1048] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.021s
I20260709 12:12:29.693837 20788 raft_consensus.cc:493] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
W20260709 12:12:29.758019 20871 consensus_meta.cc:287] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db: Time spent flushing consensus metadata: real 0.958s	user 0.017s	sys 0.019s
I20260709 12:12:29.666638 20896 raft_consensus.cc:515] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:29.692229 20767 raft_consensus.cc:697] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 19 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:29.703567 20901 leader_election.cc:290] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:12:29.765072 20944 consensus_meta.cc:287] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.591s	user 0.023s	sys 0.000s
I20260709 12:12:29.765535 20918 raft_consensus.cc:515] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:29.682854 20691 raft_consensus.cc:515] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:29.743640 14333 raft_consensus.cc:1240] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 16. Current term is 17. Ops: []
W20260709 12:12:29.846233 20965 log.cc:927] Time spent T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 12:12:29.835530 14155 leader_election.cc:304] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:29.844231 14335 raft_consensus.cc:2468] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 21.
I20260709 12:12:29.801111 20685 raft_consensus.cc:515] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:12:29.801936 20913 consensus_meta.cc:287] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db: Time spent flushing consensus metadata: real 0.690s	user 0.019s	sys 0.015s
I20260709 12:12:29.845894 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:29.849932 14906 raft_consensus.cc:2468] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 20.
W20260709 12:12:29.860685 14332 consensus_meta.cc:287] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.504s	user 0.006s	sys 0.012s
I20260709 12:12:29.897531 14332 raft_consensus.cc:2468] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 20.
I20260709 12:12:29.872051 14336 raft_consensus.cc:2468] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 18.
I20260709 12:12:29.834283 14338 raft_consensus.cc:2468] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 22.
I20260709 12:12:29.899343 20877 raft_consensus.cc:493] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:29.899889 20877 raft_consensus.cc:515] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:29.900641 20720 raft_consensus.cc:2749] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Leader election lost for term 21. Reason: Vote denied by peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957) with higher term. Message: Invalid argument: T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 21. Current term is 22.
I20260709 12:12:29.899431 14337 raft_consensus.cc:1240] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 21. Current term is 22. Ops: []
I20260709 12:12:29.877343 14904 raft_consensus.cc:2468] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 17.
I20260709 12:12:29.901691 14181 raft_consensus.cc:1275] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 12:12:29.826735 14083 catalog_manager.cc:5697] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 16 to 18, leader changed from 65c9c1653b3346b39a0e118540e6080c (127.12.174.131) to 73d01e9b1a9d49358da4985b21d681db (127.12.174.132). New cstate: current_term: 18 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:29.876382 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:29.902629 20933 leader_election.cc:290] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:29.846542 20964 raft_consensus.cc:3060] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:29.846117 20652 raft_consensus.cc:3055] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:12:29.904698 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:29.905194 20652 raft_consensus.cc:740] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:12:29.905644 14190 raft_consensus.cc:2393] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db in current term 20: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:12:29.906167 20652 consensus_queue.cc:260] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:29.907465 20652 raft_consensus.cc:3060] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:29.910244 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:29.912648 14876 leader_election.cc:304] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:29.912189 14182 raft_consensus.cc:2468] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 19.
I20260709 12:12:29.913534 20934 raft_consensus.cc:2804] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:29.913980 20967 raft_consensus.cc:993] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db: : Instructing follower 885067a0d31741bfb5c9935788e315bf to start an election
I20260709 12:12:29.914260 20767 consensus_queue.cc:237] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:29.924178 14334 raft_consensus.cc:1240] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 17. Current term is 18. Ops: []
W20260709 12:12:29.931114 14156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:29.924592 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 89153.6us
I20260709 12:12:29.934276 14155 leader_election.cc:304] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:29.912983 14083 catalog_manager.cc:5697] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 16 to 19, leader changed from 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) to 65c9c1653b3346b39a0e118540e6080c (127.12.174.131). New cstate: current_term: 19 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:12:29.938203 14083 catalog_manager.cc:5697] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 15 to 19. New cstate: current_term: 19 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:29.932117 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:29.946074 14337 raft_consensus.cc:2468] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 17.
I20260709 12:12:29.947256 14877 leader_election.cc:304] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:12:29.903263 20843 leader_election.cc:290] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:29.951424 14184 raft_consensus.cc:2468] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 13.
I20260709 12:12:29.950274 14155 leader_election.cc:304] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:29.932962 14876 leader_election.cc:304] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:29.952658 14083 catalog_manager.cc:5697] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 7 to 22, leader changed from 65c9c1653b3346b39a0e118540e6080c (127.12.174.131) to 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130). New cstate: current_term: 22 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:12:29.846756 20788 raft_consensus.cc:515] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:29.955089 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:29.960279 14907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:29.960494 14155 leader_election.cc:304] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:29.922194 20934 raft_consensus.cc:493] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:29.874753 20944 raft_consensus.cc:515] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:30.024322 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:30.053669 14263 raft_consensus.cc:3060] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:12:30.030666 14303 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:30.053530 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 93139.3us
W20260709 12:12:29.958369 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 324967us
I20260709 12:12:29.964223 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:30.055261 14155 leader_election.cc:400] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 15 pre-election: Vote denied by peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673) with higher term. Message: Invalid argument: T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 15. Current term is 16.
W20260709 12:12:30.053352 14154 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 91323.8us
I20260709 12:12:30.056914 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:30.011652 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:30.059755 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:29.979655 14083 catalog_manager.cc:5697] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 11 to 14. New cstate: current_term: 14 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:29.927246 20962 raft_consensus.cc:2749] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:29.922456 20913 raft_consensus.cc:515] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:30.056200 14155 leader_election.cc:304] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:30.058495 14181 raft_consensus.cc:2468] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 16.
I20260709 12:12:30.066665 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:30.068559 14184 raft_consensus.cc:1240] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 12:12:30.082644 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:29.964386 20953 raft_consensus.cc:2749] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:30.082993 14083 catalog_manager.cc:5697] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 15 to 16, leader changed from 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130) to 73d01e9b1a9d49358da4985b21d681db (127.12.174.132). New cstate: current_term: 16 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:30.092216 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:29.964775 20843 raft_consensus.cc:1081] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 21 LEADER]: Signalling peer 885067a0d31741bfb5c9935788e315bf to start an election
I20260709 12:12:30.097077 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 23 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:30.083376 14184 raft_consensus.cc:2468] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 22.
I20260709 12:12:29.962170 20930 raft_consensus.cc:2749] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:12:30.094065 14332 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50858 (request call id 2318) took 2174 ms (client timeout 1996 ms). Trace:
I20260709 12:12:30.094619 14188 raft_consensus.cc:3060] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:12:30.061709 20929 consensus_meta.cc:287] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.675s	user 0.010s	sys 0.021s
I20260709 12:12:30.094336 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:30.053231 20934 raft_consensus.cc:3060] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:30.099663 14229 leader_election.cc:304] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:30.100281 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:30.100420 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:29.964488 20692 raft_consensus.cc:493] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:30.010097 20599 raft_consensus.cc:493] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:30.110507 14229 leader_election.cc:304] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
W20260709 12:12:30.098851 14332 rpcz_store.cc:269] 0709 12:12:27.888532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:27.888653 (+   121us) service_pool.cc:224] Handling call
0709 12:12:30.063081 (+2174428us) spinlock_profiling.cc:243] Waited 1.45 s on lock 0x7b54002819d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:12:30.063192 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3341713792}
I20260709 12:12:30.103205 14083 catalog_manager.cc:5697] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 11 to 17. New cstate: current_term: 17 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:30.104310 14184 raft_consensus.cc:1240] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 20 LEADER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:30.069475 20789 raft_consensus.cc:2749] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:29.964246 20958 raft_consensus.cc:493] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:30.119630 20958 raft_consensus.cc:515] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:30.084322 20691 leader_election.cc:290] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:30.121558 20896 leader_election.cc:290] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:30.104872 20929 raft_consensus.cc:515] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:30.122740 14260 raft_consensus.cc:2468] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 18.
I20260709 12:12:30.123842 20929 leader_election.cc:290] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:30.118188 20930 raft_consensus.cc:2749] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:12:30.118497 20945 consensus_meta.cc:287] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.785s	user 0.014s	sys 0.014s
W20260709 12:12:30.130261 20689 consensus_meta.cc:287] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.711s	user 0.010s	sys 0.010s
I20260709 12:12:30.129408 20934 raft_consensus.cc:515] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:12:29.819988 14087 rpcz_store.cc:269] 0709 12:11:14.597300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:14.597586 (+   286us) service_pool.cc:224] Handling call
0709 12:12:29.720682 (+75123096us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:12:24.282065 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:12:24.313648 (+ 31583us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:12:24.313717 (+    69us) write_op.cc:435] Acquired schema lock
0709 12:12:24.313771 (+    54us) tablet.cc:662] Decoding operations
0709 12:12:24.314752 (+   981us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:12:24.314902 (+   150us) write_op.cc:641] Partition lock acquired for write op
0709 12:12:24.314953 (+    51us) tablet.cc:685] Acquiring locks for 4 operations
0709 12:12:24.315660 (+   707us) tablet.cc:701] Row locks acquired
0709 12:12:24.315713 (+    53us) write_op.cc:260] PREPARE: finished
0709 12:12:24.315955 (+   242us) write_op.cc:270] Start()
0709 12:12:24.316135 (+   180us) write_op.cc:276] Timestamp: P: 1783599144315893 usec, L: 0
0709 12:12:24.316172 (+    37us) op_driver.cc:348] REPLICATION: starting
0709 12:12:24.449216 (+133044us) log.cc:844] Serialized 1718 byte log entry
0709 12:12:25.199701 (+750485us) op_driver.cc:464] REPLICATION: finished
0709 12:12:25.320705 (+121004us) write_op.cc:301] APPLY: starting
0709 12:12:25.320819 (+   114us) tablet.cc:1367] starting BulkCheckPresence
0709 12:12:25.467421 (+146602us) tablet.cc:1370] finished BulkCheckPresence
0709 12:12:25.467578 (+   157us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:12:25.487654 (+ 20076us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:12:25.487885 (+   231us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=8,key_file_lookups=8,delta_file_lookups=8,mrs_lookups=0
0709 12:12:25.487928 (+    43us) write_op.cc:312] APPLY: finished
0709 12:12:25.488187 (+   259us) log.cc:844] Serialized 49 byte log entry
0709 12:12:25.501694 (+ 13507us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:25.501832 (+   138us) write_op.cc:454] Released schema lock
0709 12:12:25.501879 (+    47us) write_op.cc:341] FINISH: Updating metrics
0709 12:12:25.502367 (+   488us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:25.502398 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":713204,"reported_tablets":48,"child_traces":[["op",{"apply.queue_time_us":116723,"apply.run_cpu_time_us":10760,"apply.run_wall_time_us":181656,"cfile_cache_hit":18,"cfile_cache_hit_bytes":20879,"num_ops":4,"prepare.queue_time_us":282596,"prepare.run_cpu_time_us":20026,"prepare.run_wall_time_us":505368,"raft.queue_time_us":130476,"raft.run_cpu_time_us":22532,"raft.run_wall_time_us":121674,"replication_time_us":855929,"thread_start_us":575882,"threads_started":4,"wal-append.queue_time_us":329094,"wal-append.run_cpu_time_us":34447,"wal-append.run_wall_time_us":1708284}]]}
I20260709 12:12:30.131538 14189 raft_consensus.cc:1275] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:12:30.141628 14229 leader_election.cc:304] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
W20260709 12:12:30.146811 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 516890us
I20260709 12:12:30.095670 20939 raft_consensus.cc:3060] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:30.152917 14083 catalog_manager.cc:5697] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:30.092989 20844 raft_consensus.cc:2804] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:30.156366 14229 leader_election.cc:304] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:30.161100 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:30.161911 14184 raft_consensus.cc:3060] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:30.160326 14263 raft_consensus.cc:2468] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 16.
W20260709 12:12:30.175973 14183 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.505s	user 0.016s	sys 0.035s
I20260709 12:12:30.183418 14229 leader_election.cc:304] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
W20260709 12:12:30.148749 20884 consensus_meta.cc:287] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.731s	user 0.016s	sys 0.003s
W20260709 12:12:30.187913 14262 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.009s	sys 0.032s
W20260709 12:12:30.188586 14262 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.531s	user 0.009s	sys 0.032s
I20260709 12:12:30.150473 20929 raft_consensus.cc:2749] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:12:30.209453 14330 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.015s	sys 0.043s
W20260709 12:12:30.172523 20916 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.505s	user 0.013s	sys 0.027s
I20260709 12:12:30.158398 20844 raft_consensus.cc:493] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:30.158710 20891 raft_consensus.cc:2749] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:30.222209 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:30.222689 14230 leader_election.cc:400] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 election: Vote denied by peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957) with higher term. Message: Invalid argument: T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 18. Current term is 19.
I20260709 12:12:30.173277 20487 raft_consensus.cc:515] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:30.231411 20487 leader_election.cc:290] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 16 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:30.185439 20642 raft_consensus.cc:2749] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:30.184952 20928 raft_consensus.cc:2749] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:30.147410 20692 raft_consensus.cc:515] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:30.206960 20897 raft_consensus.cc:2749] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:12:30.241211 14229 leader_election.cc:304] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:30.148222 20599 raft_consensus.cc:515] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:30.242259 14230 leader_election.cc:304] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:12:30.252615 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:12:30.247118 14231 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.018s	sys 0.031s
W20260709 12:12:30.258505 14231 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.586s	user 0.020s	sys 0.032s
I20260709 12:12:30.256675 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:30.221804 20844 raft_consensus.cc:3060] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:30.209300 20637 consensus_queue.cc:1048] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.037s
W20260709 12:12:30.213776 14330 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.525s	user 0.015s	sys 0.043s
I20260709 12:12:30.265527 14259 raft_consensus.cc:2468] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 17.
I20260709 12:12:30.209510 20884 raft_consensus.cc:515] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:12:30.276659 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 308199us
I20260709 12:12:30.285295 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:30.292550 14876 leader_election.cc:304] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:30.275208 20934 leader_election.cc:290] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 17 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:30.272365 20685 leader_election.cc:290] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:30.298782 14230 leader_election.cc:304] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:12:30.300917 20928 raft_consensus.cc:2804] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:30.281085 20891 raft_consensus.cc:2804] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:30.292424 20964 raft_consensus.cc:2749] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:12:30.297663 14186 raft_consensus.cc:2468] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 17.
I20260709 12:12:30.315178 14229 leader_election.cc:304] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
W20260709 12:12:30.332115 14305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:30.332794 14230 leader_election.cc:304] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
W20260709 12:12:30.333683 14878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:30.334347 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:30.337540 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:30.316184 20898 raft_consensus.cc:493] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:30.334515 14303 leader_election.cc:304] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:30.319522 20487 raft_consensus.cc:2804] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:30.338874 14181 raft_consensus.cc:1240] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 14. Current term is 15. Ops: []
I20260709 12:12:30.323081 20928 raft_consensus.cc:493] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
W20260709 12:12:30.343194 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 287049us
I20260709 12:12:30.345264 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:30.329238 20944 leader_election.cc:290] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 15 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:30.343475 14303 leader_election.cc:304] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
W20260709 12:12:30.383646 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 50933.7us
W20260709 12:12:30.386171 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 438988us
I20260709 12:12:30.386343 14230 leader_election.cc:304] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:30.384539 14182 raft_consensus.cc:2468] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 19.
I20260709 12:12:30.332753 20913 leader_election.cc:290] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 17 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:30.387636 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:30.385701 14155 leader_election.cc:304] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:30.394538 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:30.395248 14337 raft_consensus.cc:2468] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 13.
W20260709 12:12:30.390529 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 47128.8us
I20260709 12:12:30.391665 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:30.397989 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:30.396682 14186 raft_consensus.cc:2468] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 22.
I20260709 12:12:30.403523 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:30.404807 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
W20260709 12:12:30.405846 20984 log.cc:927] Time spent T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 12:12:30.406705 20979 raft_consensus.cc:2804] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:30.407326 20979 raft_consensus.cc:697] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 18 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
W20260709 12:12:30.407652 20987 log.cc:927] Time spent T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:12:30.408285 20979 consensus_queue.cc:237] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } }
I20260709 12:12:30.402176 20948 raft_consensus.cc:2804] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:30.410008 20897 raft_consensus.cc:493] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:30.410777 20897 raft_consensus.cc:515] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:12:30.412698 20867 consensus_meta.cc:287] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db: Time spent flushing consensus metadata: real 0.602s	user 0.006s	sys 0.006s
I20260709 12:12:30.412992 20897 leader_election.cc:290] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:30.382977 20928 raft_consensus.cc:3060] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:30.355768 20898 raft_consensus.cc:515] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:30.415863 20898 leader_election.cc:290] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:30.387012 20891 raft_consensus.cc:697] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 16 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
W20260709 12:12:30.398241 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 46290.2us
I20260709 12:12:30.425421 14229 leader_election.cc:304] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:30.427794 14229 leader_election.cc:304] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:30.428058 14184 raft_consensus.cc:2468] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 17.
I20260709 12:12:30.388147 20896 raft_consensus.cc:2749] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:30.388541 20929 raft_consensus.cc:2804] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:12:30.390969 20986 raft_consensus.cc:2749] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:12:30.400959 14303 leader_election.cc:304] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:30.356252 20976 raft_consensus.cc:2804] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:12:30.457522 20976 raft_consensus.cc:697] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 21 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:30.458645 20976 consensus_queue.cc:237] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:30.413200 20867 raft_consensus.cc:515] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:30.462642 20867 leader_election.cc:290] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 19 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:30.434834 14229 leader_election.cc:304] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:30.464089 20915 raft_consensus.cc:2804] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:30.464617 20915 raft_consensus.cc:697] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 19 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:30.465534 20915 consensus_queue.cc:237] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:30.471881 20637 consensus_queue.cc:1048] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:12:30.475587 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:30.477332 20689 raft_consensus.cc:2804] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:12:30.477910 20689 raft_consensus.cc:493] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:30.478262 20689 raft_consensus.cc:3060] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:30.432929 20977 raft_consensus.cc:2749] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
W20260709 12:12:30.406939 20980 log.cc:927] Time spent T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:12:30.438328 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:30.440987 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:30.481348 14332 raft_consensus.cc:3060] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:30.482952 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:30.483711 14185 raft_consensus.cc:2468] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 14.
I20260709 12:12:30.483479 20891 consensus_queue.cc:237] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:12:30.405194 20983 log.cc:927] Time spent T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 12:12:30.450656 20962 consensus_queue.cc:1059] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:12:30.451763 14155 leader_election.cc:304] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 73d01e9b1a9d49358da4985b21d681db
W20260709 12:12:30.486917 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 86072.5us
I20260709 12:12:30.487313 14876 leader_election.cc:304] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:30.487694 14229 leader_election.cc:304] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:30.450547 20577 raft_consensus.cc:493] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:30.491310 14332 raft_consensus.cc:2468] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 17.
I20260709 12:12:30.497815 14188 raft_consensus.cc:2468] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 16.
I20260709 12:12:30.396646 20767 raft_consensus.cc:2749] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:12:30.450312 20994 raft_consensus.cc:493] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:30.433310 20914 consensus_meta.cc:287] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db: Time spent flushing consensus metadata: real 1.001s	user 0.020s	sys 0.011s
I20260709 12:12:30.503338 14303 leader_election.cc:304] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:30.512849 14303 leader_election.cc:304] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:30.507432 14229 leader_election.cc:304] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:30.482988 20884 leader_election.cc:290] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 21 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:30.430058 20948 raft_consensus.cc:697] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 17 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
W20260709 12:12:30.509316 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 57649.6us
I20260709 12:12:30.485652 14185 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af"
dest_uuid: "885067a0d31741bfb5c9935788e315bf"
 from {username='slave'} at 127.0.0.1:56652
I20260709 12:12:30.519906 14185 raft_consensus.cc:493] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:30.520365 14155 leader_election.cc:304] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:30.520315 14185 raft_consensus.cc:3060] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:30.522764 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:30.522213 14155 leader_election.cc:304] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:30.504410 20929 raft_consensus.cc:697] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 22 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:30.504487 20981 raft_consensus.cc:2804] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:30.535378 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:30.507550 20990 raft_consensus.cc:2804] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:30.544255 14906 raft_consensus.cc:1240] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:30.516562 20961 raft_consensus.cc:2804] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:30.546756 14907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:30.550873 14907 raft_consensus.cc:2468] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 17.
I20260709 12:12:30.517343 20692 leader_election.cc:290] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:12:30.549247 14156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:30.519407 20977 raft_consensus.cc:2804] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:30.552217 14260 raft_consensus.cc:1240] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 20. Current term is 21. Ops: []
I20260709 12:12:30.525578 20599 leader_election.cc:290] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:30.573961 14911 raft_consensus.cc:2368] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 18. Current term is 19.
I20260709 12:12:30.524796 20652 raft_consensus.cc:2749] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:30.576010 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:30.576306 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:30.578090 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:30.530766 20975 raft_consensus.cc:2804] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:30.529644 20964 raft_consensus.cc:2804] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:30.710139 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:30.510358 20577 raft_consensus.cc:515] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:30.587494 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:30.718302 14335 raft_consensus.cc:1275] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:12:30.718922 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:30.588524 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:30.589344 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:30.720139 14265 raft_consensus.cc:2468] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 19.
I20260709 12:12:30.594246 20958 leader_election.cc:290] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:30.598486 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:30.603582 14185 raft_consensus.cc:515] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:30.604220 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:30.722898 14262 raft_consensus.cc:3060] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:30.606166 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:30.516480 20994 raft_consensus.cc:515] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:30.533968 20691 raft_consensus.cc:2749] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:30.621840 20948 consensus_queue.cc:237] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:30.623204 20929 consensus_queue.cc:237] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:30.537390 20898 raft_consensus.cc:2804] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:30.554591 20990 raft_consensus.cc:493] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:30.573410 20930 consensus_queue.cc:1059] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 21.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.063s
W20260709 12:12:30.636866 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 55759.7us
I20260709 12:12:30.716677 20964 raft_consensus.cc:493] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:30.647068 20788 leader_election.cc:290] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:30.654327 14907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:30.655697 20487 raft_consensus.cc:493] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:30.651974 20689 raft_consensus.cc:515] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:30.662139 20844 raft_consensus.cc:515] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:30.670966 20918 leader_election.cc:290] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:30.673905 20877 leader_election.cc:290] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:30.677006 20928 raft_consensus.cc:515] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:30.684059 14910 raft_consensus.cc:2468] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 19.
I20260709 12:12:30.555691 14186 raft_consensus.cc:1275] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 13. (term mismatch)
I20260709 12:12:30.754492 14186 pending_rounds.cc:85] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf: Aborting all ops after (but not including) 12
W20260709 12:12:30.681823 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 235750us
W20260709 12:12:30.755453 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 71536.9us
I20260709 12:12:30.756613 14877 leader_election.cc:304] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:30.740831 20990 raft_consensus.cc:3060] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:12:30.685547 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 163614us
I20260709 12:12:30.757889 20871 raft_consensus.cc:493] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:30.758262 14303 leader_election.cc:304] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:30.694474 14263 raft_consensus.cc:2468] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 17.
I20260709 12:12:30.701175 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:30.747239 20487 raft_consensus.cc:3060] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:30.708340 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:30.574762 14229 leader_election.cc:304] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
W20260709 12:12:30.685912 20939 consensus_meta.cc:287] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db: Time spent flushing consensus metadata: real 0.528s	user 0.012s	sys 0.000s
I20260709 12:12:30.711233 14336 raft_consensus.cc:1275] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:12:30.588316 14912 raft_consensus.cc:1240] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:30.721496 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:30.685513 20896 raft_consensus.cc:493] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:30.726611 14258 raft_consensus.cc:2393] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 22: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:12:30.732156 14185 leader_election.cc:290] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 22 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:30.707782 20975 raft_consensus.cc:493] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
W20260709 12:12:30.637646 20890 consensus_meta.cc:287] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.831s	user 0.011s	sys 0.002s
I20260709 12:12:30.716316 20977 raft_consensus.cc:697] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 17 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:30.744642 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: true dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:30.771451 14911 raft_consensus.cc:3055] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:12:30.740696 20898 raft_consensus.cc:493] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:30.773113 20898 raft_consensus.cc:3060] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:30.773813 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:30.774621 14336 raft_consensus.cc:2393] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 18: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:12:30.775456 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:30.776166 14336 raft_consensus.cc:2393] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 18: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:12:30.778427 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:30.783033 20689 leader_election.cc:290] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 23 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:30.762986 20897 raft_consensus.cc:2804] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:30.783962 20897 raft_consensus.cc:493] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:30.784420 20897 raft_consensus.cc:3060] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:30.770716 21008 raft_consensus.cc:493] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:30.750098 14334 raft_consensus.cc:2468] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 20.
I20260709 12:12:30.744247 20964 raft_consensus.cc:3060] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:12:30.704962 14155 connection.cc:256] RPC call timeout handler was delayed by -1.0114900160001525s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1996s for a response
W20260709 12:12:30.791766 14155 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:30.792917 14155 leader_election.cc:304] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:30.754781 14186 pending_rounds.cc:107] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf: Aborting uncommitted NO_OP operation due to leader change: 14.13
I20260709 12:12:30.759464 14332 raft_consensus.cc:2468] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 17.
I20260709 12:12:30.758424 20871 raft_consensus.cc:515] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:12:30.761535 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 206289us
I20260709 12:12:30.763497 14338 raft_consensus.cc:2368] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 15. Current term is 16.
I20260709 12:12:30.764149 14303 leader_election.cc:304] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:30.796574 14155 leader_election.cc:304] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:30.762914 14877 leader_election.cc:304] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:30.765617 14261 raft_consensus.cc:2468] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 19.
I20260709 12:12:30.767588 20890 raft_consensus.cc:515] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:30.768435 20691 raft_consensus.cc:2804] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:30.768841 20599 raft_consensus.cc:493] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:30.769433 14335 raft_consensus.cc:1240] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 19 LEADER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:30.771807 14911 raft_consensus.cc:740] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:12:30.773264 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:30.763053 20918 raft_consensus.cc:2804] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:30.793705 14186 raft_consensus.cc:2889] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:30.824297 14186 pending_rounds.cc:107] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf: Aborting uncommitted NO_OP operation due to leader change: 16.14
I20260709 12:12:30.824677 14186 raft_consensus.cc:2889] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:30.763584 20877 raft_consensus.cc:493] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:30.765756 20939 raft_consensus.cc:2749] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:30.796880 14303 leader_election.cc:304] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:30.799482 14187 raft_consensus.cc:1275] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 12:12:30.785223 21008 raft_consensus.cc:515] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:30.806818 14155 leader_election.cc:304] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:30.771586 20975 raft_consensus.cc:3060] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:30.770346 20896 raft_consensus.cc:515] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:30.827947 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:30.867885 14335 raft_consensus.cc:2393] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 17: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:12:30.833408 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:30.810446 20933 raft_consensus.cc:2749] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:30.773849 20994 leader_election.cc:290] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:30.847373 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:30.848073 14331 raft_consensus.cc:606] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Received request to transfer leadership to TS 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:12:30.871305 14331 raft_consensus.cc:614] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:30.850121 14304 leader_election.cc:304] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:30.812695 14877 leader_election.cc:304] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:30.810103 20995 raft_consensus.cc:2749] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:30.814903 20689 raft_consensus.cc:2804] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 12:12:30.874179 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 61553.6us
I20260709 12:12:30.820268 14911 consensus_queue.cc:260] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:30.811334 20691 raft_consensus.cc:493] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:12:30.874719 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 68021.3us
I20260709 12:12:30.877206 14264 raft_consensus.cc:1275] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:12:30.878722 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:30.884765 14258 raft_consensus.cc:3060] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:30.886061 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:30.880795 14877 leader_election.cc:304] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:30.884359 14155 leader_election.cc:304] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:30.828840 20961 raft_consensus.cc:493] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:30.873471 20953 raft_consensus.cc:2749] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:12:30.809208 20979 consensus_queue.cc:1059] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.063s
I20260709 12:12:30.847527 20945 raft_consensus.cc:2749] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:12:30.895000 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:30.828397 20599 raft_consensus.cc:515] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:30.921013 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:30.906319 14338 raft_consensus.cc:1240] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 22. Current term is 23. Ops: [22.14-22.14]
I20260709 12:12:30.886971 21006 raft_consensus.cc:2749] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:12:30.848500 20918 raft_consensus.cc:697] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 16 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:12:30.904676 14155 leader_election.cc:304] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:30.891278 20961 raft_consensus.cc:3060] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:30.920061 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:30.874634 20689 raft_consensus.cc:493] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:12:30.885943 20691 raft_consensus.cc:3060] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:12:30.906551 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 109750us
I20260709 12:12:30.923467 14338 raft_consensus.cc:1240] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:30.847388 20877 raft_consensus.cc:515] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:30.931353 20896 leader_election.cc:290] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:30.908041 20692 raft_consensus.cc:2804] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Leader election won for term 17
W20260709 12:12:30.932765 20985 log.cc:927] Time spent T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.536s	user 0.001s	sys 0.000s
I20260709 12:12:30.970844 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:30.932780 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:30.934621 20928 leader_election.cc:290] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:30.935959 14257 raft_consensus.cc:3060] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:30.923019 20991 consensus_queue.cc:1048] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.020s
I20260709 12:12:30.942992 20976 raft_consensus.cc:3055] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:30.943970 20918 consensus_queue.cc:237] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:30.908141 20967 raft_consensus.cc:2749] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:12:30.984293 20981 raft_consensus.cc:493] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:30.984869 20981 raft_consensus.cc:3060] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:30.985052 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:30.951032 20577 leader_election.cc:290] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:30.951812 20844 leader_election.cc:290] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 18 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:30.907605 20948 raft_consensus.cc:2749] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:30.986002 14188 raft_consensus.cc:2393] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 14: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
W20260709 12:12:30.961179 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 56632us
I20260709 12:12:30.987946 20930 consensus_queue.cc:1059] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:12:30.988883 20930 consensus_queue.cc:1059] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 21.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:12:30.963181 14338 raft_consensus.cc:1240] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 22. Current term is 23. Ops: []
I20260709 12:12:30.989938 20994 consensus_queue.cc:1059] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:12:30.990592 20944 raft_consensus.cc:3055] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:30.990989 20944 raft_consensus.cc:740] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:12:30.991874 20487 raft_consensus.cc:515] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:30.994395 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:30.991847 20944 consensus_queue.cc:260] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:30.996137 20944 raft_consensus.cc:3060] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:30.996894 14907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:30.997545 14907 raft_consensus.cc:2468] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 20.
W20260709 12:12:30.993530 21012 log.cc:927] Time spent T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.238s	user 0.001s	sys 0.001s
I20260709 12:12:30.996766 14330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50858 (request call id 2341) took 1387 ms. Trace:
I20260709 12:12:30.963925 20953 raft_consensus.cc:2749] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:30.978314 14229 leader_election.cc:304] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:30.988200 14331 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:50896 (request call id 54) took 1201 ms. Trace:
I20260709 12:12:30.988044 14155 leader_election.cc:304] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:30.961834 14262 raft_consensus.cc:2468] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 17.
I20260709 12:12:30.972994 14258 raft_consensus.cc:2468] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 19.
I20260709 12:12:30.960475 20689 raft_consensus.cc:3060] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:31.002168 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:31.012030 14190 raft_consensus.cc:2468] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 20.
I20260709 12:12:31.013670 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
W20260709 12:12:31.001144 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 151109us
I20260709 12:12:31.008431 14331 rpcz_store.cc:276] 0709 12:12:29.787297 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:29.787466 (+   169us) service_pool.cc:224] Handling call
0709 12:12:30.987989 (+1200523us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b54002a6a54. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f2127135853 00007f212c10360a 00007f21256897d4 00007f2125689762 00007f2125689691 00007f212568960c 00007f21256888c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:12:30.988105 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2437310336}
I20260709 12:12:31.009477 14907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:31.010118 14877 leader_election.cc:304] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:12:31.015168 14304 leader_election.cc:304] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:31.015975 14877 leader_election.cc:304] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:12:31.018064 14183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56046 (request call id 2914) took 1394 ms. Trace:
I20260709 12:12:30.973642 20896 raft_consensus.cc:2749] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:12:31.020401 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:31.021386 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:31.022993 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:31.023705 14906 raft_consensus.cc:2468] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 20.
W20260709 12:12:31.031476 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 43524.5us
I20260709 12:12:31.031595 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:30.999128 14330 rpcz_store.cc:276] 0709 12:12:29.609262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:29.614484 (+  5222us) service_pool.cc:224] Handling call
0709 12:12:29.614817 (+   333us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:12:29.650098 (+ 35281us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:29.650149 (+    51us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:12:29.661981 (+ 11832us) log.cc:844] Serialized 52 byte log entry
0709 12:12:30.267831 (+605850us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:12:30.267994 (+   163us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:30.268245 (+   251us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:30.932131 (+663886us) spinlock_profiling.cc:243] Waited 2.3 ms on lock 0x7b4400022b4c. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2123f74c85 00007f2123f756a2 00007f2126ce71db 00007f2126ce2aaf 00007f2126cd686e 00007f2126cd5bb6 00007f2126cd57d8 00007f2126cdf221 00007f2126cdf1d9 00007f2126cdf169
0709 12:12:30.996425 (+ 64294us) raft_consensus.cc:1685] finished
0709 12:12:30.996452 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:30.996697 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8899,"raft.queue_time_us":9036,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":16872,"spinlock_wait_cycles":5287808,"thread_start_us":578674,"threads_started":1,"wal-append.queue_time_us":627480}
I20260709 12:12:30.979446 20976 raft_consensus.cc:740] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:31.045670 14155 leader_election.cc:304] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:31.032011 20914 raft_consensus.cc:2804] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:31.018585 14183 rpcz_store.cc:276] 0709 12:12:29.623531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:29.623706 (+   175us) service_pool.cc:224] Handling call
0709 12:12:29.652520 (+ 28814us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:29.652756 (+   236us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:12:29.670662 (+ 17906us) log.cc:844] Serialized 14 byte log entry
0709 12:12:30.420417 (+749755us) spinlock_profiling.cc:243] Waited 2.78 ms on lock 0x7b4800270558. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f212c064aa1 00007f212c05bb37 00007f212c05b9ca 00007f212c15326f 00007f212c152f37 00007f212c16755c 00007f212c167508 00007f212c167488 00007f212c167443 00007f212c1666ec 00007f212b090a96
0709 12:12:30.867963 (+447546us) spinlock_profiling.cc:243] Waited 4.7 ms on lock 0x7b1800446b00. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f212cf16ab1 00007f212cf23281 00007f2126ce34bc 00007f212403148b 00007f212ce8b9a9 00007f212404d69b 00007f212404b93f 00007f212404b455 00007f212ab333c7 00007f21271459a7 00007f21271550bf
0709 12:12:30.880418 (+ 12455us) log.cc:844] Serialized 14 byte log entry
0709 12:12:30.880873 (+   455us) log.cc:844] Serialized 14 byte log entry
0709 12:12:31.017646 (+136773us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:31.017712 (+    66us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:31.017803 (+    91us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:31.017879 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:31.017999 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18109,"prepare.queue_time_us":321794,"prepare.run_cpu_time_us":184,"prepare.run_wall_time_us":8562,"raft.queue_time_us":50838,"raft.run_cpu_time_us":3123,"raft.run_wall_time_us":221381,"spinlock_wait_cycles":27529088,"thread_start_us":866066,"threads_started":3,"wal-append.queue_time_us":609496}
I20260709 12:12:31.035444 20692 raft_consensus.cc:697] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 17 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:31.030982 20844 raft_consensus.cc:2804] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:30.921911 20977 consensus_queue.cc:237] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:31.041388 20948 raft_consensus.cc:2804] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:31.072268 14181 raft_consensus.cc:1275] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:12:31.075419 14184 raft_consensus.cc:1275] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:12:31.084764 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:31.076531 20896 raft_consensus.cc:2804] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:31.085647 20896 raft_consensus.cc:493] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:31.086206 20978 raft_consensus.cc:2749] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:31.086038 20896 raft_consensus.cc:3060] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:31.063619 20487 leader_election.cc:290] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 14 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:31.061574 20914 raft_consensus.cc:697] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 19 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:12:31.069114 21008 leader_election.cc:290] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:31.077409 20844 raft_consensus.cc:697] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 17 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
W20260709 12:12:31.097589 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 82534us
I20260709 12:12:31.112063 14304 leader_election.cc:304] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:31.050858 20953 consensus_queue.cc:1048] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.030s
I20260709 12:12:31.076792 20890 leader_election.cc:290] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 23 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:31.118242 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:31.118767 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:31.118983 14330 raft_consensus.cc:3060] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:31.119879 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:31.120478 14332 raft_consensus.cc:2468] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 20.
I20260709 12:12:31.121408 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:31.121501 14877 leader_election.cc:304] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:12:31.082183 20898 raft_consensus.cc:515] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:31.132346 20898 leader_election.cc:290] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:31.079025 20901 consensus_queue.cc:1048] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 12:12:31.060297 21020 consensus_queue.cc:1048] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.065s
I20260709 12:12:31.141685 20914 consensus_queue.cc:237] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:31.115057 20976 consensus_queue.cc:260] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:31.143395 20976 raft_consensus.cc:3060] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:12:31.146123 21017 log.cc:927] Time spent T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
I20260709 12:12:31.148926 20844 consensus_queue.cc:237] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:31.094919 20930 consensus_queue.cc:1048] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.054s
I20260709 12:12:31.154171 20993 raft_consensus.cc:2804] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:31.091801 21022 raft_consensus.cc:2749] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:12:31.154732 20993 raft_consensus.cc:493] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:31.155228 21024 consensus_queue.cc:1059] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.138s
I20260709 12:12:31.156486 21024 raft_consensus.cc:3055] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:12:31.156333 20990 raft_consensus.cc:515] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:31.156915 21024 raft_consensus.cc:740] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
W20260709 12:12:31.149861 14910 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53200 (request call id 864) took 2288 ms (client timeout 1817 ms). Trace:
W20260709 12:12:31.164290 14910 rpcz_store.cc:269] 0709 12:12:28.861704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:28.869996 (+  8292us) service_pool.cc:224] Handling call
0709 12:12:31.149597 (+2279601us) spinlock_profiling.cc:243] Waited 1.62 s on lock 0x7b540039eed4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:12:31.149727 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3733420928}
I20260709 12:12:31.170569 14907 raft_consensus.cc:2368] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for earlier term 14. Current term is 15.
I20260709 12:12:31.170851 14906 raft_consensus.cc:1240] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:31.085907 20964 raft_consensus.cc:515] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:31.170953 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:31.130154 20610 raft_consensus.cc:3055] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:31.155169 20993 raft_consensus.cc:3060] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:31.173761 14909 raft_consensus.cc:2376] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 19. Re-sending same reply.
W20260709 12:12:31.193604 14229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:31.174978 14304 leader_election.cc:304] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:31.220607 14182 raft_consensus.cc:1240] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:31.227752 21025 consensus_queue.cc:1059] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 20.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 12:12:31.230567 14339 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50858 (request call id 2349) took 1533 ms. Trace:
I20260709 12:12:31.161795 21008 raft_consensus.cc:2804] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 12:12:31.232550 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 183488us
I20260709 12:12:31.193183 20577 raft_consensus.cc:493] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:31.217535 20877 leader_election.cc:290] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:31.198730 20599 leader_election.cc:290] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:31.168258 20897 raft_consensus.cc:515] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:31.139408 20692 consensus_queue.cc:237] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:31.245990 20767 raft_consensus.cc:493] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:31.193689 20610 raft_consensus.cc:740] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:31.241503 14155 leader_election.cc:304] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
W20260709 12:12:31.233947 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 59070.5us
I20260709 12:12:31.235569 14339 rpcz_store.cc:276] 0709 12:12:29.697268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:29.771605 (+ 74337us) service_pool.cc:224] Handling call
0709 12:12:29.771928 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:29.898307 (+126379us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 12:12:29.931333 (+ 33026us) log.cc:844] Serialized 14 byte log entry
0709 12:12:30.311984 (+380651us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:30.312043 (+    59us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:12:30.312103 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:30.926719 (+614616us) spinlock_profiling.cc:243] Waited 4.32 ms on lock 0x7b1800382a80. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f212cf16ab1 00007f212cf23281 00007f212401c2a6 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419
0709 12:12:31.230289 (+303570us) spinlock_profiling.cc:243] Waited 126 ms on lock 0x7b540023a854. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:12:31.230363 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:31.230499 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":34453,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":6143,"raft.queue_time_us":8215,"raft.run_cpu_time_us":196,"raft.run_wall_time_us":14623,"spinlock_wait_cycles":299891200,"thread_start_us":371877,"threads_started":1,"wal-append.queue_time_us":596416}
W20260709 12:12:31.251083 14877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:31.269987 14229 leader_election.cc:400] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 election: Vote denied by peer 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341) with higher term. Message: Invalid argument: T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 18. Current term is 19.
I20260709 12:12:31.270462 14229 leader_election.cc:403] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
I20260709 12:12:31.251390 21033 raft_consensus.cc:493] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:31.252794 20990 leader_election.cc:290] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 15 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:31.276358 14257 raft_consensus.cc:1275] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
W20260709 12:12:31.257441 21029 log.cc:927] Time spent T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:12:31.286010 20720 raft_consensus.cc:2804] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:31.260030 20993 raft_consensus.cc:515] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:31.245908 21030 raft_consensus.cc:2749] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:31.261925 20577 raft_consensus.cc:515] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:31.279138 14190 raft_consensus.cc:1275] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 12:12:31.280107 14304 leader_election.cc:304] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:31.258304 20691 raft_consensus.cc:515] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:31.312563 21025 raft_consensus.cc:2804] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:31.312983 21025 raft_consensus.cc:493] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:12:31.313365 21025 raft_consensus.cc:3060] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:31.313951 20691 leader_election.cc:290] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 20 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:31.227455 20975 raft_consensus.cc:515] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:31.316231 20975 leader_election.cc:290] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:31.317934 14229 leader_election.cc:304] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:31.240988 21008 raft_consensus.cc:493] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:12:31.307287 14330 raft_consensus.cc:2468] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 19.
I20260709 12:12:31.307351 14155 leader_election.cc:304] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:31.181823 21024 consensus_queue.cc:260] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:31.321233 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:31.327150 14155 leader_election.cc:304] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:31.321348 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:31.319667 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:31.328675 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:31.329370 14258 raft_consensus.cc:3060] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:31.329319 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:31.330338 14259 raft_consensus.cc:2468] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 18.
I20260709 12:12:31.328751 14339 raft_consensus.cc:3060] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:12:31.331734 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:31.291038 20720 raft_consensus.cc:493] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:31.333140 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:31.331284 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:31.338815 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:31.339214 14155 leader_election.cc:304] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:31.309244 20916 raft_consensus.cc:2749] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341) with higher term. Message: Invalid argument: T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 18. Current term is 19.
I20260709 12:12:31.345571 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:31.338419 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:31.341926 20685 raft_consensus.cc:2749] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:31.326220 20748 consensus_queue.cc:1059] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.018s
I20260709 12:12:31.291136 21033 raft_consensus.cc:515] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:31.329542 21008 raft_consensus.cc:3060] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:31.346403 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:31.289467 20896 raft_consensus.cc:515] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:31.354964 14258 raft_consensus.cc:2468] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 18.
W20260709 12:12:31.371119 21027 log.cc:927] Time spent T 00000000000000000000000000000000 P d07070be2c074f4cb9ad35f1580c4ef7: Append to log took a long time: real 0.124s	user 0.002s	sys 0.000s
I20260709 12:12:31.342615 20930 consensus_queue.cc:1048] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:12:31.317246 20948 raft_consensus.cc:697] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 20 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:12:31.306949 21022 raft_consensus.cc:493] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:31.275066 20961 raft_consensus.cc:515] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:31.355487 14263 raft_consensus.cc:2468] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 16.
I20260709 12:12:31.428953 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:31.400950 20896 leader_election.cc:290] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:31.431792 20992 consensus_queue.cc:1048] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.037s
I20260709 12:12:31.278378 20767 raft_consensus.cc:515] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:31.438326 20767 leader_election.cc:290] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:31.438865 20948 consensus_queue.cc:237] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:31.439563 20897 leader_election.cc:290] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:12:31.357896 14875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:31.358031 21037 raft_consensus.cc:493] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:31.441990 21037 raft_consensus.cc:515] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:31.429677 21022 raft_consensus.cc:515] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:31.446098 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:31.360639 21021 raft_consensus.cc:493] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:31.448308 21021 raft_consensus.cc:515] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:31.450574 21021 leader_election.cc:290] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:31.450699 20997 raft_consensus.cc:3055] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:31.361186 21034 raft_consensus.cc:2749] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:31.451121 20997 raft_consensus.cc:740] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:12:31.335826 20915 raft_consensus.cc:2804] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:31.452045 20997 consensus_queue.cc:260] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } }
I20260709 12:12:31.338250 20720 raft_consensus.cc:3060] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:31.365958 21039 raft_consensus.cc:493] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:31.454056 21039 raft_consensus.cc:515] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:31.335289 20610 consensus_queue.cc:260] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:31.456331 20610 raft_consensus.cc:3060] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:31.368474 21033 leader_election.cc:290] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:31.452833 14257 raft_consensus.cc:2410] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for term 19 because replica has last-logged OpId of term: 18 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 13.
I20260709 12:12:31.460054 20871 leader_election.cc:290] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:31.369905 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:31.370893 20958 raft_consensus.cc:493] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:31.373011 21025 raft_consensus.cc:515] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:31.452826 20915 raft_consensus.cc:697] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 19 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:31.463012 20915 consensus_queue.cc:237] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:31.374779 14338 raft_consensus.cc:2393] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db in current term 18: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:12:31.455574 21036 raft_consensus.cc:493] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:31.465495 21036 raft_consensus.cc:515] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:31.461973 20958 raft_consensus.cc:515] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:31.467340 14263 raft_consensus.cc:1240] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 18 LEADER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:31.468760 20958 leader_election.cc:290] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:31.378471 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:31.379081 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:31.470220 20993 leader_election.cc:290] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 21 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:31.470885 20997 raft_consensus.cc:3060] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:31.380970 14335 raft_consensus.cc:1275] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 11. (term mismatch)
I20260709 12:12:31.485669 14335 pending_rounds.cc:85] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c: Aborting all ops after (but not including) 10
I20260709 12:12:31.485965 14335 pending_rounds.cc:107] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c: Aborting uncommitted NO_OP operation due to leader change: 18.11
I20260709 12:12:31.486343 14335 raft_consensus.cc:2889] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:31.382671 14332 raft_consensus.cc:1275] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 12:12:31.383330 14304 leader_election.cc:304] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:12:31.399718 20689 raft_consensus.cc:515] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:31.325479 20975 consensus_queue.cc:1059] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.032s
I20260709 12:12:31.505765 20986 consensus_queue.cc:1048] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:12:31.506361 20975 raft_consensus.cc:3055] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:31.506678 20599 raft_consensus.cc:493] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:31.506814 20975 raft_consensus.cc:740] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:31.507241 20689 leader_election.cc:290] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 22 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:31.507789 20975 consensus_queue.cc:260] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:31.345484 20953 raft_consensus.cc:2749] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:31.401022 20577 leader_election.cc:290] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:31.508865 14334 raft_consensus.cc:1240] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:31.396106 14330 raft_consensus.cc:1275] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 12:12:31.337800 20877 raft_consensus.cc:493] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:31.335217 21030 raft_consensus.cc:493] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:31.332628 20898 consensus_queue.cc:1059] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 12:12:31.422029 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:31.353978 14910 raft_consensus.cc:2468] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 20.
I20260709 12:12:31.424093 14339 raft_consensus.cc:2468] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 15.
I20260709 12:12:31.429227 14155 leader_election.cc:304] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:31.355335 14183 raft_consensus.cc:2468] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 19.
W20260709 12:12:31.512709 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 83566.4us
I20260709 12:12:31.513420 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
W20260709 12:12:31.513909 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 130715us
I20260709 12:12:31.465225 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: true dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:31.514180 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:31.514667 14338 raft_consensus.cc:3060] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:31.476588 14906 raft_consensus.cc:1240] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 21 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 20. Current term is 21. Ops: []
I20260709 12:12:31.514849 14183 raft_consensus.cc:2468] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 16.
I20260709 12:12:31.477430 14876 leader_election.cc:304] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:31.490549 21036 leader_election.cc:290] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:31.517938 14304 leader_election.cc:304] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:12:31.491837 14263 raft_consensus.cc:1240] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 22 LEADER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 21. Current term is 22. Ops: []
I20260709 12:12:31.493257 21039 leader_election.cc:290] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:31.496274 20637 consensus_queue.cc:1048] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:12:31.520587 20896 raft_consensus.cc:2804] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:31.521013 20896 raft_consensus.cc:493] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:31.497891 21031 consensus_queue.cc:1048] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:12:31.521373 20896 raft_consensus.cc:3060] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:31.504766 21021 raft_consensus.cc:493] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:31.507264 20599 raft_consensus.cc:515] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:31.470498 14333 raft_consensus.cc:2368] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 19. Current term is 20.
I20260709 12:12:31.379447 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:31.510375 14330 raft_consensus.cc:1240] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:31.484295 14181 raft_consensus.cc:3055] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:12:31.516215 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:31.517252 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:31.519224 14155 leader_election.cc:400] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 15 election: Vote denied by peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957) with higher term. Message: Invalid argument: T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 15. Current term is 16.
I20260709 12:12:31.561304 14155 leader_election.cc:403] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 12:12:31.452128 21037 leader_election.cc:290] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:31.519902 20976 raft_consensus.cc:493] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:31.519987 20953 raft_consensus.cc:2804] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:31.498633 20961 leader_election.cc:290] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 18 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:31.537097 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:31.537979 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:31.539778 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:31.540591 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
W20260709 12:12:31.555702 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 220632us
W20260709 12:12:31.562844 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 46587.1us
I20260709 12:12:31.568714 14261 raft_consensus.cc:2393] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 22: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:12:31.558385 14187 raft_consensus.cc:3060] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:31.564497 21048 raft_consensus.cc:493] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:31.569335 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:31.565011 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:31.565451 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:31.510473 20720 raft_consensus.cc:515] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:31.570636 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:31.559540 14181 raft_consensus.cc:740] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:12:31.571864 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:31.572470 14262 raft_consensus.cc:2468] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 18.
I20260709 12:12:31.463724 21025 leader_election.cc:290] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 20 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:12:31.574957 14228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:31.485165 20964 leader_election.cc:290] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 18 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:31.575474 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:31.578821 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:31.572721 14181 consensus_queue.cc:260] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:31.567344 14229 leader_election.cc:304] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:12:31.580626 14877 leader_election.cc:304] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:31.576977 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:31.535282 20992 raft_consensus.cc:2749] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:12:31.580691 14333 raft_consensus.cc:2393] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db in current term 23: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:12:31.581701 14229 leader_election.cc:304] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:31.583186 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:31.582243 14877 leader_election.cc:304] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:12:31.584534 14155 leader_election.cc:304] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:12:31.590384 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:31.585994 14339 raft_consensus.cc:2468] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 19.
I20260709 12:12:31.591562 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:31.566239 20689 raft_consensus.cc:2804] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:31.587023 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:31.566818 20930 raft_consensus.cc:2749] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957) with higher term. Message: Invalid argument: T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 15. Current term is 16.
I20260709 12:12:31.576949 14338 raft_consensus.cc:2468] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 22.
I20260709 12:12:31.568734 20953 raft_consensus.cc:493] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:31.589809 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:31.586956 14190 raft_consensus.cc:2468] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 17.
I20260709 12:12:31.599931 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:31.597414 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:31.523387 20877 raft_consensus.cc:515] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:31.578088 20975 raft_consensus.cc:3060] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:31.602772 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:31.599835 14189 raft_consensus.cc:2468] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 15.
I20260709 12:12:31.607617 14188 raft_consensus.cc:3060] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:31.606125 14877 leader_election.cc:304] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:12:31.563071 21021 raft_consensus.cc:515] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:31.605225 14262 raft_consensus.cc:2393] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 18: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:12:31.523211 21030 raft_consensus.cc:515] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:31.609128 21039 raft_consensus.cc:2804] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:31.592474 21025 raft_consensus.cc:493] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:31.637030 20577 raft_consensus.cc:2804] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:31.638020 21041 raft_consensus.cc:2749] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:12:31.638474 21032 raft_consensus.cc:493] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:31.640148 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:31.636364 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:31.574131 20976 raft_consensus.cc:515] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:31.598927 20961 raft_consensus.cc:2804] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:31.682442 14331 raft_consensus.cc:1275] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 12:12:31.598945 20637 raft_consensus.cc:2804] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:31.648803 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 18 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:31.691421 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:31.692111 14262 raft_consensus.cc:2468] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 16.
I20260709 12:12:31.603044 20953 raft_consensus.cc:3060] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:31.650767 14909 raft_consensus.cc:2468] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 17.
W20260709 12:12:31.657449 21009 log.cc:927] Time spent T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.699s	user 0.002s	sys 0.000s
I20260709 12:12:31.643854 21036 raft_consensus.cc:493] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
W20260709 12:12:31.665768 20981 consensus_meta.cc:287] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.680s	user 0.004s	sys 0.008s
I20260709 12:12:31.718715 20599 leader_election.cc:290] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:31.660663 14188 raft_consensus.cc:2468] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 20.
I20260709 12:12:31.663501 21039 raft_consensus.cc:697] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 15 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
W20260709 12:12:31.722254 14877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:31.668639 20652 consensus_queue.cc:1059] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:12:31.722640 21039 consensus_queue.cc:237] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:31.723543 20652 raft_consensus.cc:3055] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:31.723915 20652 raft_consensus.cc:740] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:12:31.724788 20652 consensus_queue.cc:260] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:31.669286 20964 consensus_queue.cc:1059] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:12:31.726341 20964 raft_consensus.cc:3055] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:31.726666 20964 raft_consensus.cc:740] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:12:31.727419 20964 consensus_queue.cc:260] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:31.727785 21036 raft_consensus.cc:515] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:31.728731 20964 raft_consensus.cc:3060] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:31.669608 14155 leader_election.cc:304] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
W20260709 12:12:31.730157 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 60628.4us
I20260709 12:12:31.657670 21025 raft_consensus.cc:515] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:31.732371 14155 leader_election.cc:304] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:31.607566 14303 leader_election.cc:304] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
W20260709 12:12:31.733224 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 125733us
I20260709 12:12:31.734134 14303 leader_election.cc:304] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:12:31.736025 20692 raft_consensus.cc:2804] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:31.680117 21032 raft_consensus.cc:515] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:31.738489 21032 leader_election.cc:290] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:31.739069 21032 raft_consensus.cc:2804] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:12:31.739542 21032 raft_consensus.cc:697] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 22 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:12:31.740495 21032 consensus_queue.cc:237] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:31.742045 20994 consensus_queue.cc:1059] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 21.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:12:31.742820 20994 consensus_queue.cc:1243] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Peer 17aab1bbf5014936aa18cc21818b26ec log is divergent from this leader: its last log entry 22.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 12:12:31.743386 21020 raft_consensus.cc:2804] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:31.743789 21020 raft_consensus.cc:493] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:31.744107 21020 raft_consensus.cc:3060] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:31.745637 14182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56652 (request call id 1570) took 1257 ms. Trace:
I20260709 12:12:31.746104 14182 rpcz_store.cc:276] 0709 12:12:30.488407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:30.530768 (+ 42361us) service_pool.cc:224] Handling call
0709 12:12:30.534336 (+  3568us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:31.233775 (+699439us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:31.745359 (+511584us) spinlock_profiling.cc:243] Waited 684 ms on lock 0x7b540028e6d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:12:31.745569 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1573338368}
I20260709 12:12:31.702111 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:31.750504 20768 raft_consensus.cc:3055] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:12:31.750993 20768 raft_consensus.cc:740] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:31.751991 20768 consensus_queue.cc:260] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 10, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:31.706676 20877 leader_election.cc:290] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:31.707367 21021 leader_election.cc:290] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:31.709050 21030 leader_election.cc:290] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:31.710793 20976 leader_election.cc:290] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:31.681910 20961 raft_consensus.cc:493] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:31.754796 20720 leader_election.cc:290] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 18 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:31.754957 20961 raft_consensus.cc:3060] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:31.718456 20981 raft_consensus.cc:515] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:31.759568 20981 leader_election.cc:290] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:31.760255 14260 raft_consensus.cc:1240] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:31.730082 21036 leader_election.cc:290] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:31.648545 20577 raft_consensus.cc:493] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:31.736474 20692 raft_consensus.cc:493] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
W20260709 12:12:31.762179 14304 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:31.762043 20692 raft_consensus.cc:3060] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:31.763123 14304 leader_election.cc:304] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:12:31.591354 20915 raft_consensus.cc:2804] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:31.761960 20577 raft_consensus.cc:3060] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:31.703382 14187 raft_consensus.cc:2468] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 15.
I20260709 12:12:31.769181 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:31.608798 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:31.732419 21025 leader_election.cc:290] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:31.592849 21048 raft_consensus.cc:515] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:31.766526 14877 leader_election.cc:304] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:31.762441 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:31.736519 14303 leader_election.cc:304] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
W20260709 12:12:31.782827 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 50529.4us
W20260709 12:12:31.782857 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 46403.4us
I20260709 12:12:31.784225 14303 leader_election.cc:304] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:31.789987 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:31.790372 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:31.791064 14339 raft_consensus.cc:2468] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 19.
I20260709 12:12:31.794405 21022 leader_election.cc:290] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:31.790941 20939 raft_consensus.cc:3060] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:31.775130 21041 consensus_queue.cc:1059] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 17.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.022s
I20260709 12:12:31.799517 14230 leader_election.cc:304] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:31.794220 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:31.797552 21041 raft_consensus.cc:3055] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:31.813227 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:31.813941 14330 raft_consensus.cc:1275] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:12:31.814131 14333 raft_consensus.cc:2393] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 20: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:12:31.815133 14338 raft_consensus.cc:1240] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 21. Current term is 22. Ops: []
I20260709 12:12:31.816009 14303 leader_election.cc:304] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:31.753648 20768 raft_consensus.cc:3060] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:31.767396 20637 raft_consensus.cc:697] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 19 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:31.819402 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:31.819213 14155 leader_election.cc:304] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:31.823755 14303 leader_election.cc:304] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:31.789886 21025 raft_consensus.cc:2749] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:31.829929 14186 raft_consensus.cc:2468] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 22.
I20260709 12:12:31.832248 14184 raft_consensus.cc:1240] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 12:12:31.831238 14303 leader_election.cc:304] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:31.791766 20915 raft_consensus.cc:697] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 20 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:31.833722 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:31.850535 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:31.833783 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:31.811074 20997 raft_consensus.cc:2749] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:31.825325 14230 leader_election.cc:304] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:31.822218 20652 raft_consensus.cc:3060] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:31.817764 20599 raft_consensus.cc:2749] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:12:31.817052 20689 raft_consensus.cc:697] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 18 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:31.817906 20877 raft_consensus.cc:493] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:31.857161 20976 raft_consensus.cc:2749] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:31.859488 14230 leader_election.cc:304] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:31.861927 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:31.864380 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:31.866367 14910 raft_consensus.cc:1240] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:31.873070 14229 leader_election.cc:304] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:12:31.812072 21041 raft_consensus.cc:740] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:12:31.790766 21021 consensus_queue.cc:1059] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.045s
I20260709 12:12:31.883741 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:31.884598 14258 raft_consensus.cc:1275] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 14. (term mismatch)
I20260709 12:12:31.881001 14182 raft_consensus.cc:2468] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 17.
I20260709 12:12:31.899245 14258 pending_rounds.cc:85] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec: Aborting all ops after (but not including) 13
I20260709 12:12:31.899582 14258 pending_rounds.cc:107] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec: Aborting uncommitted NO_OP operation due to leader change: 18.14
I20260709 12:12:31.900064 14258 raft_consensus.cc:2889] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:12:31.904340 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 73189.4us
I20260709 12:12:31.905864 14303 leader_election.cc:304] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:12:31.906976 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:31.908171 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:31.910220 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:31.910992 14330 raft_consensus.cc:2393] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 17: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:12:31.916160 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:31.909552 14229 leader_election.cc:304] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:31.877856 21030 raft_consensus.cc:2804] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:31.932885 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:31.903456 21004 raft_consensus.cc:2804] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:31.905570 21025 raft_consensus.cc:2749] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:31.891077 20929 raft_consensus.cc:2749] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:12:31.923614 21021 raft_consensus.cc:2749] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:12:31.925398 20890 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.503s	user 0.000s	sys 0.014s
I20260709 12:12:31.887499 21008 raft_consensus.cc:515] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:31.930557 20599 raft_consensus.cc:2749] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:31.881837 20877 raft_consensus.cc:515] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } }
W20260709 12:12:31.978153 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 72356.4us
I20260709 12:12:31.978730 21056 consensus_queue.cc:1059] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.049s
W20260709 12:12:31.980638 21051 log.cc:927] Time spent T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
I20260709 12:12:31.992714 21041 consensus_queue.cc:260] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:31.990365 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:32.031817 21041 raft_consensus.cc:3060] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:31.937857 20637 consensus_queue.cc:237] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:32.037874 14334 raft_consensus.cc:1240] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 22. Current term is 23. Ops: []
I20260709 12:12:32.041031 20877 leader_election.cc:290] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:31.955616 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:31.945870 20976 consensus_queue.cc:1059] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.041s
I20260709 12:12:31.975167 21004 raft_consensus.cc:697] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 17 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:31.986701 21025 raft_consensus.cc:2804] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:32.011725 14303 leader_election.cc:304] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:31.981899 20689 consensus_queue.cc:237] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:31.997931 20896 raft_consensus.cc:515] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:32.006558 21031 raft_consensus.cc:2804] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:31.981642 20915 consensus_queue.cc:237] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:32.026295 21048 leader_election.cc:290] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:12:32.078226 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 130599us
W20260709 12:12:32.090816 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 181366us
W20260709 12:12:32.092340 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 83188.4us
I20260709 12:12:32.097188 14333 raft_consensus.cc:2368] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 18. Current term is 19.
I20260709 12:12:32.102273 14303 leader_election.cc:304] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:12:32.104353 14303 leader_election.cc:304] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:12:32.045449 20890 raft_consensus.cc:3055] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:32.076838 21025 raft_consensus.cc:493] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:32.106284 14259 raft_consensus.cc:2468] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 16.
I20260709 12:12:32.078146 21031 raft_consensus.cc:493] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:12:32.135095 14228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:32.069378 20577 raft_consensus.cc:515] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:32.093060 20981 raft_consensus.cc:2749] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:12:32.153630 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 57731.2us
I20260709 12:12:32.159502 14910 raft_consensus.cc:1240] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:32.093631 20948 raft_consensus.cc:2804] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:32.157845 14155 leader_election.cc:304] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:32.088310 20977 raft_consensus.cc:3055] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:32.154223 21025 raft_consensus.cc:3060] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:32.152799 20768 raft_consensus.cc:2804] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:12:32.130905 21055 raft_consensus.cc:2804] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:32.173173 14330 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d"
dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
mode: GRACEFUL
new_leader_uuid: "885067a0d31741bfb5c9935788e315bf"
 from {username='slave'} at 127.0.0.1:50896
I20260709 12:12:32.160883 21031 raft_consensus.cc:3060] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:32.178640 14330 raft_consensus.cc:606] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Received request to transfer leadership to TS 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:32.107808 20890 raft_consensus.cc:740] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:32.180285 20896 leader_election.cc:290] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:32.180480 21063 raft_consensus.cc:2749] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:12:32.180956 20768 raft_consensus.cc:697] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 22 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
W20260709 12:12:32.173910 21065 log.cc:927] Time spent T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260709 12:12:32.180109 20975 raft_consensus.cc:493] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:32.184746 14330 raft_consensus.cc:614] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:32.180047 20577 leader_election.cc:290] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 20 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:32.188052 20929 consensus_queue.cc:1059] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:12:32.236986 21068 raft_consensus.cc:493] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:32.237761 21068 raft_consensus.cc:515] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:32.238577 21020 raft_consensus.cc:515] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:32.240175 21068 leader_election.cc:290] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:32.194406 21055 raft_consensus.cc:697] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 20 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:32.242532 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:32.243233 14904 raft_consensus.cc:2468] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 19.
I20260709 12:12:32.244930 14229 leader_election.cc:304] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
W20260709 12:12:32.245422 14304 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:32.245620 14155 leader_election.cc:400] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 18 pre-election: Vote denied by peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957) with higher term. Message: Invalid argument: T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 18. Current term is 19.
I20260709 12:12:32.246021 14155 leader_election.cc:403] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:12:32.248312 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 66871.4us
I20260709 12:12:32.168358 20977 raft_consensus.cc:740] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:32.159337 20976 consensus_queue.cc:1059] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 22.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.033s
I20260709 12:12:32.176565 20964 raft_consensus.cc:2749] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:12:32.222601 20961 raft_consensus.cc:515] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:32.223002 20768 consensus_queue.cc:237] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:32.223974 21008 leader_election.cc:290] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 23 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:32.183347 21004 consensus_queue.cc:237] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:32.226413 20953 raft_consensus.cc:515] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:32.228139 14910 raft_consensus.cc:1240] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:32.230048 20975 raft_consensus.cc:515] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:32.257781 14230 leader_election.cc:400] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 election: Vote denied by peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957) with higher term. Message: Invalid argument: T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 19. Current term is 20.
I20260709 12:12:32.266631 20977 consensus_queue.cc:260] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:32.249167 20933 raft_consensus.cc:3060] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Advancing to term 19
I20260709 12:12:32.251597 21063 raft_consensus.cc:493] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:32.269137 14182 raft_consensus.cc:1240] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 20. Current term is 21. Ops: []
I20260709 12:12:32.256162 20929 consensus_queue.cc:1048] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.014s
I20260709 12:12:32.271293 20961 leader_election.cc:290] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 21 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:32.274811 20975 leader_election.cc:290] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:32.287075 14230 leader_election.cc:304] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:32.278230 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:32.243431 21055 consensus_queue.cc:237] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:32.245954 21074 raft_consensus.cc:2804] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:32.275193 20948 raft_consensus.cc:493] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:32.255021 21068 consensus_queue.cc:1048] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 12:12:32.292032 20748 consensus_queue.cc:1048] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:12:32.293506 21081 raft_consensus.cc:2749] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:32.292302 20948 raft_consensus.cc:3060] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:32.296663 14333 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d"
dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
mode: GRACEFUL
new_leader_uuid: "885067a0d31741bfb5c9935788e315bf"
 from {username='slave'} at 127.0.0.1:50896
I20260709 12:12:32.257522 20692 raft_consensus.cc:515] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:32.297315 14333 raft_consensus.cc:606] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Received request to transfer leadership to TS 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:32.297676 14333 raft_consensus.cc:614] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:32.265806 20890 consensus_queue.cc:260] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:32.291409 21074 raft_consensus.cc:493] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:32.307643 21008 raft_consensus.cc:493] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:32.310137 20890 raft_consensus.cc:3060] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:32.310170 21074 raft_consensus.cc:3060] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:32.292514 20975 consensus_queue.cc:1059] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.019s
I20260709 12:12:32.315532 20692 leader_election.cc:290] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 21 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:32.316515 14335 raft_consensus.cc:1240] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 20. Current term is 21. Ops: []
W20260709 12:12:32.317123 20939 consensus_meta.cc:287] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db: Time spent flushing consensus metadata: real 0.518s	user 0.011s	sys 0.001s
I20260709 12:12:32.317582 20939 raft_consensus.cc:2749] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:12:32.318048 21008 raft_consensus.cc:515] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:32.318428 14909 raft_consensus.cc:1240] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 23 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 22. Current term is 23. Ops: []
I20260709 12:12:32.320441 21008 leader_election.cc:290] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:32.286518 21063 raft_consensus.cc:515] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:32.276274 20915 consensus_queue.cc:1048] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 12:12:32.275739 21031 raft_consensus.cc:515] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:32.299538 20977 raft_consensus.cc:3060] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:32.334424 21081 raft_consensus.cc:3055] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 19 LEADER]: Stepping down as leader of term 19
W20260709 12:12:32.350011 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 69798.2us
I20260709 12:12:32.351367 21081 raft_consensus.cc:740] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:32.365760 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:32.366556 14261 raft_consensus.cc:3060] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:32.352123 20953 leader_election.cc:290] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:32.374099 21063 leader_election.cc:290] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:32.375757 21081 consensus_queue.cc:260] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:32.376986 21081 raft_consensus.cc:3060] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:32.380717 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:32.380863 21031 leader_election.cc:290] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:12:32.389649 14302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:32.391888 20933 raft_consensus.cc:2749] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957) with higher term. Message: Invalid argument: T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 18. Current term is 19.
I20260709 12:12:32.387193 21063 consensus_queue.cc:1048] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.007s
I20260709 12:12:32.400095 20916 raft_consensus.cc:3055] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:32.400497 20916 raft_consensus.cc:740] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
W20260709 12:12:32.405941 21047 log.cc:927] Time spent T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.840s	user 0.001s	sys 0.002s
I20260709 12:12:32.406886 20948 raft_consensus.cc:515] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:32.401396 20916 consensus_queue.cc:260] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:32.411244 20948 leader_election.cc:290] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 20 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:32.411829 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:32.412468 14339 raft_consensus.cc:3060] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:32.412561 14907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53194 (request call id 1164) took 1412 ms. Trace:
I20260709 12:12:32.396652 21025 raft_consensus.cc:515] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:32.412947 14907 rpcz_store.cc:276] 0709 12:12:31.000437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:31.000604 (+   167us) service_pool.cc:224] Handling call
0709 12:12:32.412325 (+1411721us) spinlock_profiling.cc:243] Waited 147 ms on lock 0x7b54007760d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:12:32.412465 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":337935616}
W20260709 12:12:32.398525 14156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:32.420034 14261 raft_consensus.cc:2468] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 19.
I20260709 12:12:32.421056 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:32.421674 14261 raft_consensus.cc:3060] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:32.374989 20768 raft_consensus.cc:493] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:32.422217 20867 raft_consensus.cc:493] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:32.423168 14304 leader_election.cc:304] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:12:32.425092 14190 raft_consensus.cc:1275] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:12:32.430052 14339 raft_consensus.cc:2468] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 20.
I20260709 12:12:32.435644 14155 leader_election.cc:304] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:32.423342 20948 raft_consensus.cc:493] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:32.436317 14261 raft_consensus.cc:2468] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 17.
I20260709 12:12:32.439059 14155 leader_election.cc:304] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:32.439071 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:32.430095 21063 raft_consensus.cc:2804] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:32.440819 14261 raft_consensus.cc:2468] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 19.
W20260709 12:12:32.440776 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 159972us
I20260709 12:12:32.442983 14304 leader_election.cc:304] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:12:32.445000 14339 raft_consensus.cc:1240] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:32.446502 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:32.441797 20944 raft_consensus.cc:2804] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:32.429579 20867 raft_consensus.cc:515] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:32.457628 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:32.458369 20944 raft_consensus.cc:697] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 17 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:12:32.474083 21063 raft_consensus.cc:697] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 19 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:32.437325 21074 raft_consensus.cc:515] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:32.475440 21063 consensus_queue.cc:237] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:12:32.476823 14912 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59144 (request call id 716) took 1698 ms (client timeout 2158 ms). Trace:
I20260709 12:12:32.477027 21074 leader_election.cc:290] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:32.438325 20933 raft_consensus.cc:2804] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:32.460163 20867 leader_election.cc:290] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:32.477852 20944 consensus_queue.cc:237] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:32.478621 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:32.479323 14190 raft_consensus.cc:2468] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 16.
W20260709 12:12:32.479602 21013 log.cc:927] Time spent T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 1.722s	user 0.009s	sys 0.002s
I20260709 12:12:32.482209 14907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:32.482854 14907 raft_consensus.cc:3060] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:32.426573 21085 consensus_queue.cc:1059] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 22.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.062s
I20260709 12:12:32.475178 14911 raft_consensus.cc:3060] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:32.487629 21085 raft_consensus.cc:3055] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:12:32.488222 21085 raft_consensus.cc:740] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:32.488054 21076 raft_consensus.cc:3055] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:12:32.489871 21076 raft_consensus.cc:740] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:32.490481 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:32.491470 20933 raft_consensus.cc:697] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 20 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:12:32.494590 14334 raft_consensus.cc:1240] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 19. Current term is 20. Ops: [19.11-19.11]
I20260709 12:12:32.491153 21076 consensus_queue.cc:260] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:32.498428 21076 raft_consensus.cc:3060] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:12:32.477295 14912 rpcz_store.cc:269] 0709 12:12:30.777976 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:30.778154 (+   178us) service_pool.cc:224] Handling call
0709 12:12:32.476599 (+1698445us) spinlock_profiling.cc:243] Waited 859 ms on lock 0x7b540020b7d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:12:32.476761 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1975074560}
I20260709 12:12:32.492955 20933 consensus_queue.cc:237] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:32.529793 20953 consensus_queue.cc:1059] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 22.10, Next index: 11, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:12:32.531394 20953 raft_consensus.cc:3055] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:12:32.534642 14331 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50856 (request call id 2865) took 1153 ms. Trace:
I20260709 12:12:32.535959 14331 rpcz_store.cc:276] 0709 12:12:31.381215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:31.381839 (+   624us) service_pool.cc:224] Handling call
0709 12:12:31.420674 (+ 38835us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:31.682903 (+262229us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:32.534364 (+851461us) spinlock_profiling.cc:243] Waited 261 ms on lock 0x7b54000b8454. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:12:32.534567 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":600998656}
I20260709 12:12:32.531901 20953 raft_consensus.cc:740] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:12:32.428732 20768 raft_consensus.cc:515] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:32.534039 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:32.529253 21055 raft_consensus.cc:2804] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:32.533591 21084 raft_consensus.cc:493] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:32.543305 14155 leader_election.cc:304] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:32.544318 20610 consensus_queue.cc:1048] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:12:32.545020 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:32.546991 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:32.548385 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:32.442420 20948 raft_consensus.cc:515] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:32.541857 21055 raft_consensus.cc:493] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:32.557044 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:32.555347 20962 raft_consensus.cc:493] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:32.565225 14331 raft_consensus.cc:1275] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:12:32.551698 20933 raft_consensus.cc:2749] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:12:32.554435 21055 raft_consensus.cc:3060] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:32.543587 21085 consensus_queue.cc:260] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:32.573266 21085 raft_consensus.cc:3060] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:32.545922 20978 consensus_queue.cc:1059] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 12:12:32.582603 14911 raft_consensus.cc:2468] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 22.
I20260709 12:12:32.550173 21084 raft_consensus.cc:515] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:12:32.583802 14911 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59144 (request call id 715) took 1850 ms (client timeout 1639 ms). Trace:
W20260709 12:12:32.584522 14911 rpcz_store.cc:269] 0709 12:12:30.733685 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:30.733884 (+   199us) service_pool.cc:224] Handling call
0709 12:12:32.474445 (+1740561us) spinlock_profiling.cc:243] Waited 126 ms on lock 0x7b58008939d0. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f21270970aa 00007f2127119447 00007f2127131fe7 00007f21271337de 00007f212713f27c 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c
0709 12:12:32.583721 (+109276us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":289099520}
I20260709 12:12:32.586107 21084 leader_election.cc:290] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:32.588160 14183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56046 (request call id 2961) took 1024 ms. Trace:
W20260709 12:12:32.573882 21086 log.cc:927] Time spent T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.139s	user 0.001s	sys 0.000s
I20260709 12:12:32.564224 20953 consensus_queue.cc:260] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 22.10, Last appended by leader: 10, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:32.591809 20953 raft_consensus.cc:3060] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:32.585902 14259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41764 (request call id 3484) took 1049 ms. Trace:
I20260709 12:12:32.593247 14259 rpcz_store.cc:276] 0709 12:12:31.536387 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:31.536801 (+   414us) service_pool.cc:224] Handling call
0709 12:12:32.585682 (+1048881us) spinlock_profiling.cc:243] Waited 538 ms on lock 0x7b5400221ad4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:12:32.585830 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1238144896}
I20260709 12:12:32.594694 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:32.597811 14304 leader_election.cc:304] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:12:32.588601 14183 rpcz_store.cc:276] 0709 12:12:31.563910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:31.564084 (+   174us) service_pool.cc:224] Handling call
0709 12:12:31.564476 (+   392us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:31.643048 (+ 78572us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:31.643082 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:31.650807 (+  7725us) log.cc:844] Serialized 26 byte log entry
0709 12:12:31.867091 (+216284us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:12:31.867147 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:32.587681 (+720534us) spinlock_profiling.cc:243] Waited 75.5 ms on lock 0x7b540019bed4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:12:32.587741 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:32.587798 (+    57us) raft_consensus.cc:1685] finished
0709 12:12:32.587812 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:32.588085 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2614,"raft.queue_time_us":3353,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":11273,"spinlock_wait_cycles":173675776,"thread_start_us":141045,"threads_started":1,"wal-append.queue_time_us":239264}
I20260709 12:12:32.572151 20962 raft_consensus.cc:515] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:32.600244 20948 leader_election.cc:290] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:32.602577 20962 leader_election.cc:290] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:32.603511 20767 raft_consensus.cc:2804] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:32.584923 21058 consensus_queue.cc:1048] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.019s
W20260709 12:12:32.603415 21038 log.cc:927] Time spent T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 1.250s	user 0.004s	sys 0.000s
I20260709 12:12:32.608466 14907 raft_consensus.cc:2468] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 20.
W20260709 12:12:32.602494 21054 log.cc:927] Time spent T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.630s	user 0.003s	sys 0.000s
I20260709 12:12:32.613513 14258 raft_consensus.cc:2410] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db for term 20 because replica has last-logged OpId of term: 19 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 13.
I20260709 12:12:32.614871 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:32.616595 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:32.617318 14186 raft_consensus.cc:2468] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 15.
I20260709 12:12:32.617487 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:32.618270 14190 raft_consensus.cc:3060] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:32.613168 20962 raft_consensus.cc:493] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:32.622355 14183 raft_consensus.cc:1240] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:32.623786 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:32.618816 20979 raft_consensus.cc:3055] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:32.633602 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:32.633903 20979 raft_consensus.cc:740] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:32.634929 20979 consensus_queue.cc:260] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:32.636234 20979 raft_consensus.cc:3060] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:32.608942 20767 raft_consensus.cc:493] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:32.639966 20767 raft_consensus.cc:3060] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:32.641839 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:32.643692 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:32.647084 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:32.649271 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:32.650633 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:32.652861 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:32.639308 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:32.625522 21052 raft_consensus.cc:493] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:32.632426 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 23 candidate_status { last_received { term: 22 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:32.618990 21036 raft_consensus.cc:493] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:12:32.638367 14876 leader_election.cc:304] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:32.661592 21036 raft_consensus.cc:515] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:32.658604 14336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50856 (request call id 2849) took 1889 ms. Trace:
I20260709 12:12:32.658818 14331 raft_consensus.cc:2468] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 21.
I20260709 12:12:32.660267 14190 raft_consensus.cc:2468] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 18.
I20260709 12:12:32.665338 14187 raft_consensus.cc:1240] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:32.659632 21052 raft_consensus.cc:515] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:32.662195 20547 raft_consensus.cc:2749] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:12:32.626935 20768 leader_election.cc:290] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:32.663909 20487 consensus_queue.cc:1059] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:32.670684 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:32.672482 20843 consensus_queue.cc:1048] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:12:32.675122 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 23 candidate_status { last_received { term: 22 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:32.664287 14876 leader_election.cc:304] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:32.675277 14155 leader_election.cc:304] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:32.676069 14303 leader_election.cc:304] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:32.677202 14189 raft_consensus.cc:2468] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 19.
I20260709 12:12:32.664896 14336 rpcz_store.cc:276] 0709 12:12:30.769411 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:30.776662 (+  7251us) service_pool.cc:224] Handling call
0709 12:12:31.510735 (+734073us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:31.510959 (+   224us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:12:31.511279 (+   320us) log.cc:844] Serialized 14 byte log entry
0709 12:12:31.593430 (+ 82151us) log.cc:844] Serialized 14 byte log entry
0709 12:12:31.682659 (+ 89229us) log.cc:844] Serialized 14 byte log entry
0709 12:12:31.683050 (+   391us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:31.683098 (+    48us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:31.683145 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:31.683212 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:32.191393 (+508181us) spinlock_profiling.cc:243] Waited 1.18 ms on lock 0x7b18001a67a0. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f212cf16ab1 00007f212cf23281 00007f212404e3f3 00007f21240507c1 00007f2124050779 00007f2124050709 00007f21240506d1 00007f212404f9cd 0000000000388634 0000000000388479 00007f212403183a
0709 12:12:32.657807 (+466414us) spinlock_profiling.cc:243] Waited 5.64 ms on lock 0x7b18001a67a0. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f212cf16ab1 00007f212cf23281 00007f212401c2a6 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713a8ad 00007f212c0ff419 00007f2125676bd4
0709 12:12:32.658432 (+   625us) spinlock_profiling.cc:243] Waited 734 ms on lock 0x7b5400145d50. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713a8ad 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:12:32.658534 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6177,"prepare.queue_time_us":5880,"prepare.run_cpu_time_us":172,"prepare.run_wall_time_us":3053,"raft.queue_time_us":89454,"raft.run_cpu_time_us":241,"raft.run_wall_time_us":243,"spinlock_wait_cycles":1726019840,"thread_start_us":164028,"threads_started":2,"wal-append.queue_time_us":123819}
I20260709 12:12:32.684237 14303 leader_election.cc:304] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:32.685180 20547 raft_consensus.cc:2804] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:32.685664 20547 raft_consensus.cc:493] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:32.686079 20547 raft_consensus.cc:3060] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:32.679363 20871 raft_consensus.cc:3055] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:32.687038 20871 raft_consensus.cc:740] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:12:32.687971 20871 consensus_queue.cc:260] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:32.625797 20962 raft_consensus.cc:515] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:32.691793 14303 leader_election.cc:304] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
W20260709 12:12:32.692332 14302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:32.694132 14336 raft_consensus.cc:1275] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 12:12:32.695495 14303 leader_election.cc:304] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:32.678879 21055 raft_consensus.cc:515] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:32.698964 21066 raft_consensus.cc:493] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:32.689451 21020 leader_election.cc:290] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 21 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:32.700495 20958 consensus_queue.cc:1048] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:12:32.702039 14336 raft_consensus.cc:1240] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 22. Current term is 23. Ops: [22.14-22.14]
I20260709 12:12:32.697266 20898 raft_consensus.cc:2749] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:32.703318 14259 raft_consensus.cc:1240] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:32.705443 21036 leader_election.cc:290] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:32.690414 20768 raft_consensus.cc:2749] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:32.697106 20890 raft_consensus.cc:2749] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:32.691021 20871 raft_consensus.cc:3060] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:32.684580 20953 raft_consensus.cc:2804] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:32.709326 14303 leader_election.cc:304] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:32.676175 20767 raft_consensus.cc:515] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:32.710345 20896 raft_consensus.cc:2749] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:12:32.723032 21020 raft_consensus.cc:2749] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:32.724901 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:32.725382 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:32.726040 14183 raft_consensus.cc:2468] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 18.
I20260709 12:12:32.726300 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:32.726671 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:32.726858 14182 raft_consensus.cc:3060] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:32.727061 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:12:32.728987 21050 log.cc:927] Time spent T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.751s	user 0.001s	sys 0.002s
I20260709 12:12:32.729879 14262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41768 (request call id 2397) took 1168 ms. Trace:
I20260709 12:12:32.730990 14263 raft_consensus.cc:1240] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 19. Current term is 20. Ops: [19.14-19.14]
I20260709 12:12:32.730274 14262 rpcz_store.cc:276] 0709 12:12:31.561378 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:31.692780 (+131402us) service_pool.cc:224] Handling call
0709 12:12:31.693133 (+   353us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:31.947902 (+254769us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:31.947937 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:31.948615 (+   678us) log.cc:844] Serialized 26 byte log entry
0709 12:12:32.089656 (+141041us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:12:32.089698 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:32.089811 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:32.725547 (+635736us) spinlock_profiling.cc:243] Waited 2.12 ms on lock 0x7b24001634a8. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2123ed49c4 00007f2123ed2acb 00007f212408ddc9 00007f212408da55 00007f212408cfb0 00007f2126d03488 00007f2126d03be8 00007f2126cdb398 00007f2126cd676a 00007f2126cd5bb6
0709 12:12:32.729529 (+  3982us) raft_consensus.cc:1685] finished
0709 12:12:32.729550 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:32.729812 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":21698,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":109,"spinlock_wait_cycles":4882816,"thread_start_us":392949,"threads_started":2,"wal-append.queue_time_us":225674}
I20260709 12:12:32.729799 20916 raft_consensus.cc:3060] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:32.733580 14183 raft_consensus.cc:1275] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 9. (term mismatch)
I20260709 12:12:32.733979 21025 leader_election.cc:290] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:32.712993 21066 raft_consensus.cc:515] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:32.723522 14339 raft_consensus.cc:2368] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 19. Current term is 20.
I20260709 12:12:32.738555 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:32.738828 14155 leader_election.cc:400] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 pre-election: Vote denied by peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957) with higher term. Message: Invalid argument: T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 19. Current term is 20.
I20260709 12:12:32.739113 14155 leader_election.cc:403] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:12:32.739226 14339 raft_consensus.cc:2468] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 18.
I20260709 12:12:32.741428 14155 leader_election.cc:304] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:32.741959 20958 raft_consensus.cc:3060] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Advancing to term 20
W20260709 12:12:32.743386 14228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:32.740530 14339 raft_consensus.cc:1240] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 20 LEADER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:32.721782 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:32.745833 14332 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50858 (request call id 2361) took 1281 ms. Trace:
I20260709 12:12:32.745967 21032 raft_consensus.cc:2804] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:32.751463 21032 raft_consensus.cc:493] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:32.752015 21032 raft_consensus.cc:3060] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:32.748137 20767 leader_election.cc:290] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:32.748545 21052 leader_election.cc:290] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:32.751336 14332 rpcz_store.cc:276] 0709 12:12:31.464083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:31.488373 (+ 24290us) service_pool.cc:224] Handling call
0709 12:12:31.488668 (+   295us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:31.512008 (+ 23340us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:31.512039 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:31.521974 (+  9935us) log.cc:844] Serialized 26 byte log entry
0709 12:12:31.866877 (+344903us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:12:31.866918 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:31.866994 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:32.728404 (+861410us) spinlock_profiling.cc:243] Waited 6.52 ms on lock 0x7b4400022b4c. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2123f74c85 00007f2123f756a2 00007f2126ce71db 00007f2126ce2aaf 00007f2126cd686e 00007f2126cd5bb6 00007f2126cd57d8 00007f2126cdf221 00007f2126cdf1d9 00007f2126cdf169
0709 12:12:32.745487 (+ 17083us) raft_consensus.cc:1685] finished
0709 12:12:32.745510 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:32.745766 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22937,"raft.queue_time_us":24386,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":3305,"spinlock_wait_cycles":14999808,"thread_start_us":286709,"threads_started":1,"wal-append.queue_time_us":370128}
I20260709 12:12:32.757098 20958 raft_consensus.cc:2749] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: Vote denied by peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957) with higher term. Message: Invalid argument: T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 19. Current term is 20.
I20260709 12:12:32.759610 21024 raft_consensus.cc:3060] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:32.734014 14183 pending_rounds.cc:85] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf: Aborting all ops after (but not including) 8
I20260709 12:12:32.763365 20964 consensus_queue.cc:1059] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:32.767892 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:32.771760 14183 pending_rounds.cc:107] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf: Aborting uncommitted NO_OP operation due to leader change: 17.9
I20260709 12:12:32.772161 14183 raft_consensus.cc:2889] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:32.768517 14259 raft_consensus.cc:1240] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:32.769522 14229 leader_election.cc:304] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:32.751560 14189 raft_consensus.cc:1275] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 12:12:32.718109 14190 raft_consensus.cc:2468] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 23.
I20260709 12:12:32.774006 14229 leader_election.cc:304] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:32.737416 21066 leader_election.cc:290] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:32.774798 14332 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca"
dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
mode: GRACEFUL
new_leader_uuid: "885067a0d31741bfb5c9935788e315bf"
 from {username='slave'} at 127.0.0.1:50896
I20260709 12:12:32.775297 14229 leader_election.cc:304] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:32.776979 20897 raft_consensus.cc:2804] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:32.776971 20981 raft_consensus.cc:2749] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:12:32.783748 21055 leader_election.cc:290] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 20 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:32.784264 20143 raft_consensus.cc:2749] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:32.785274 14337 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50856 (request call id 2863) took 1404 ms. Trace:
W20260709 12:12:32.778740 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:32.785655 14337 rpcz_store.cc:276] 0709 12:12:31.380566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:31.381368 (+   802us) service_pool.cc:224] Handling call
0709 12:12:31.381647 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:31.442292 (+ 60645us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:31.442332 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:31.442376 (+    44us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:12:31.442410 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:32.785021 (+1342611us) spinlock_profiling.cc:243] Waited 60.4 ms on lock 0x7b540024fed4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:12:32.785065 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:32.785212 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":138950528}
I20260709 12:12:32.787173 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:32.789119 20897 raft_consensus.cc:697] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 20 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:32.790019 14907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:32.790503 20897 consensus_queue.cc:237] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:32.781205 14332 raft_consensus.cc:606] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 18 LEADER]: Received request to transfer leadership to TS 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:32.735165 20962 leader_election.cc:290] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:32.778426 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:32.799458 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:32.806059 14911 raft_consensus.cc:2393] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 18: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
I20260709 12:12:32.805198 14907 raft_consensus.cc:1240] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 13. Current term is 14. Ops: []
W20260709 12:12:32.770059 21089 log.cc:927] Time spent T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 12:12:32.809852 14182 raft_consensus.cc:2468] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 16.
I20260709 12:12:32.810971 14182 raft_consensus.cc:1240] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:32.805855 14183 raft_consensus.cc:2468] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 17.
I20260709 12:12:32.812898 14183 raft_consensus.cc:1240] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 17 LEADER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:32.814085 14303 leader_election.cc:304] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:32.815505 14907 raft_consensus.cc:1240] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:32.718711 20953 raft_consensus.cc:493] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:32.820864 14303 leader_election.cc:400] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 pre-election: Vote denied by peer 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341) with higher term. Message: Invalid argument: T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for earlier term 14. Current term is 15.
I20260709 12:12:32.821291 14303 leader_election.cc:403] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:12:32.824954 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:32.830111 14911 raft_consensus.cc:2393] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 16: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
I20260709 12:12:32.791755 21084 raft_consensus.cc:493] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:32.834102 14256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53050 (request call id 1316) took 1075 ms. Trace:
I20260709 12:12:32.831122 12986 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:12:32.837153 14907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:32.837841 14907 raft_consensus.cc:2468] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 20.
I20260709 12:12:32.823145 20953 raft_consensus.cc:3060] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:32.852463 14229 leader_election.cc:304] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:32.832047 21025 raft_consensus.cc:2804] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:12:32.833004 21033 raft_consensus.cc:2749] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341) with higher term. Message: Invalid argument: T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for earlier term 14. Current term is 15.
I20260709 12:12:32.855132 14907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:32.857810 14907 raft_consensus.cc:2393] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 21: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
I20260709 12:12:32.861032 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:32.861265 20916 consensus_queue.cc:1059] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:12:32.861801 14912 raft_consensus.cc:3060] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:32.862035 21056 raft_consensus.cc:2804] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:32.862720 21056 raft_consensus.cc:493] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:32.827688 20786 consensus_queue.cc:1059] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.029s
I20260709 12:12:32.814882 20768 consensus_queue.cc:1059] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 12:12:32.867547 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:32.868664 21025 raft_consensus.cc:697] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 23 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:32.863096 21085 raft_consensus.cc:3055] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:32.869694 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 18 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:32.870040 21085 raft_consensus.cc:740] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:32.870164 21025 consensus_queue.cc:237] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 22.10, Last appended by leader: 10, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:32.870944 21085 consensus_queue.cc:260] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:32.872298 21085 raft_consensus.cc:3060] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:32.873436 14908 raft_consensus.cc:1275] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
W20260709 12:12:32.876832 14228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:32.869072 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:32.871291 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:32.822942 21055 consensus_queue.cc:1048] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.030s
I20260709 12:12:32.879817 14910 raft_consensus.cc:2393] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 16: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
I20260709 12:12:32.878417 14229 leader_election.cc:304] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:32.882190 14337 raft_consensus.cc:1240] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 20. Current term is 21. Ops: []
I20260709 12:12:32.823292 21066 consensus_queue.cc:1048] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 12:12:32.881491 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:32.885237 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:32.885564 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:32.886436 14911 raft_consensus.cc:2468] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 17.
I20260709 12:12:32.886457 14264 raft_consensus.cc:2468] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 19.
I20260709 12:12:32.887836 14303 leader_election.cc:304] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:32.888717 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:32.890995 20786 consensus_queue.cc:1243] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer 885067a0d31741bfb5c9935788e315bf log is divergent from this leader: its last log entry 17.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 12:12:32.891742 20786 raft_consensus.cc:3055] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:32.885913 21056 raft_consensus.cc:3060] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:32.885818 20890 raft_consensus.cc:493] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:32.893410 20890 raft_consensus.cc:515] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:32.896679 20890 leader_election.cc:290] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:32.839407 21084 raft_consensus.cc:515] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:32.898954 20642 raft_consensus.cc:493] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:32.899514 20642 raft_consensus.cc:515] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:32.900951 21084 leader_election.cc:290] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:32.902092 14904 raft_consensus.cc:2410] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for term 18 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 12.
I20260709 12:12:32.877924 20928 raft_consensus.cc:493] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:12:32.913537 14303 leader_election.cc:304] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:32.915400 14332 raft_consensus.cc:1240] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 20. Current term is 21. Ops: []
I20260709 12:12:32.836333 21036 consensus_queue.cc:1059] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.026s
I20260709 12:12:32.919487 14185 raft_consensus.cc:1275] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:12:32.922987 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:32.925397 14264 raft_consensus.cc:2468] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 17.
I20260709 12:12:32.923590 14259 raft_consensus.cc:2393] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 21: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:12:32.892529 21076 raft_consensus.cc:2804] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:32.934331 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:32.892215 20786 raft_consensus.cc:740] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:12:32.952124 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:32.901723 20642 leader_election.cc:290] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:32.974201 14332 raft_consensus.cc:1275] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
W20260709 12:12:32.965207 14228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:32.937903 14877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:32.923290 20843 raft_consensus.cc:493] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:32.933936 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:32.920019 21033 raft_consensus.cc:2749] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:12:32.997725 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:32.991604 14265 raft_consensus.cc:1240] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:32.931746 20898 raft_consensus.cc:2749] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:12:32.926152 21030 raft_consensus.cc:493] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:12:32.942871 14155 leader_election.cc:304] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:32.993860 14181 raft_consensus.cc:3060] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:32.995141 14337 raft_consensus.cc:3060] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:32.984236 12986 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:32.903733 20767 raft_consensus.cc:493] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:32.934935 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:32.969177 14264 raft_consensus.cc:1275] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
W20260709 12:12:32.991729 14228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:32.998867 14877 leader_election.cc:304] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:32.925943 20928 raft_consensus.cc:515] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:33.001405 14338 raft_consensus.cc:1275] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
W20260709 12:12:33.002580 21049 log.cc:927] Time spent T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 1.367s	user 0.008s	sys 0.000s
I20260709 12:12:33.002331 20786 consensus_queue.cc:260] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:32.999692 20843 raft_consensus.cc:515] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:33.002360 14330 raft_consensus.cc:1240] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:32.954088 20981 raft_consensus.cc:493] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
W20260709 12:12:33.006733 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 63986.9us
I20260709 12:12:32.987205 21076 raft_consensus.cc:697] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 18 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:33.008530 14331 raft_consensus.cc:1275] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:12:32.928243 21032 raft_consensus.cc:515] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:32.926131 21084 consensus_queue.cc:1059] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 12, Time since last communication: 0.074s
I20260709 12:12:33.005702 14259 raft_consensus.cc:1275] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:12:32.953754 20964 consensus_queue.cc:1059] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.069s
W20260709 12:12:33.019876 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 95256.4us
I20260709 12:12:33.024008 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:33.024762 14304 leader_election.cc:304] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:33.006358 21030 raft_consensus.cc:3060] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:33.008074 20958 raft_consensus.cc:2804] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:32.935529 20890 consensus_queue.cc:1059] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.080s
I20260709 12:12:33.047813 14303 leader_election.cc:304] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:12:33.035218 20934 raft_consensus.cc:493] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:33.056480 14184 raft_consensus.cc:1240] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:33.037048 20871 raft_consensus.cc:2749] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:33.067345 14337 raft_consensus.cc:2468] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 20.
W20260709 12:12:33.076992 14305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:33.017112 20767 raft_consensus.cc:515] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:33.053647 20786 raft_consensus.cc:3060] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:33.025657 21033 consensus_queue.cc:1059] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.034s
I20260709 12:12:33.037688 20981 raft_consensus.cc:515] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:33.036980 20929 consensus_queue.cc:1059] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 12:12:33.052206 20958 raft_consensus.cc:493] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:33.081297 20898 raft_consensus.cc:2749] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:33.090583 20692 raft_consensus.cc:493] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:33.107211 20652 raft_consensus.cc:3055] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:12:33.107892 20929 consensus_queue.cc:1243] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer 65c9c1653b3346b39a0e118540e6080c log is divergent from this leader: its last log entry 20.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:12:33.129839 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:33.118233 21076 consensus_queue.cc:237] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:33.119297 20981 leader_election.cc:290] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:33.123035 20928 leader_election.cc:290] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:33.126441 14332 raft_consensus.cc:2393] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 17: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:12:33.130524 14337 raft_consensus.cc:3060] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:33.125165 21032 leader_election.cc:290] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:33.097211 20890 raft_consensus.cc:2804] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:33.080901 20768 consensus_queue.cc:1059] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 12:12:33.102697 20958 raft_consensus.cc:3060] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:33.095978 21081 consensus_queue.cc:1059] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 12:12:33.074740 20934 raft_consensus.cc:515] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:33.156292 20934 leader_election.cc:290] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:33.091889 21005 consensus_queue.cc:1048] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.040s
I20260709 12:12:33.146462 20767 leader_election.cc:290] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:33.129711 21020 consensus_queue.cc:1059] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.028s
I20260709 12:12:33.162550 14912 raft_consensus.cc:2468] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 21.
I20260709 12:12:33.170208 14905 raft_consensus.cc:1240] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 21 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 20. Current term is 21. Ops: []
I20260709 12:12:33.171080 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:33.172653 14337 raft_consensus.cc:2468] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 19.
I20260709 12:12:33.173379 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:33.173923 14155 leader_election.cc:304] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:33.175678 20953 raft_consensus.cc:515] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:33.178131 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:33.132200 20692 raft_consensus.cc:515] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:33.172820 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:33.143126 20547 raft_consensus.cc:515] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:33.143782 20890 raft_consensus.cc:493] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:33.188581 20890 raft_consensus.cc:3060] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:33.189229 20958 raft_consensus.cc:515] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:33.192750 21074 raft_consensus.cc:3055] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:12:33.154261 20843 leader_election.cc:290] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:33.130605 20652 raft_consensus.cc:740] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:12:33.101027 21087 consensus_queue.cc:1048] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.043s
I20260709 12:12:33.159910 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:33.161535 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:33.197480 14264 raft_consensus.cc:2468] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 18.
I20260709 12:12:33.182159 14265 raft_consensus.cc:3060] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:33.192656 20958 leader_election.cc:290] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:33.193346 21074 raft_consensus.cc:740] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
W20260709 12:12:33.140870 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 93384.7us
W20260709 12:12:33.202682 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 154939us
W20260709 12:12:33.194932 21091 log.cc:927] Time spent T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.491s	user 0.002s	sys 0.000s
I20260709 12:12:33.201567 14262 raft_consensus.cc:2468] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 16.
I20260709 12:12:33.197675 14181 raft_consensus.cc:1275] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 12:12:33.125433 21056 raft_consensus.cc:515] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:33.210444 14906 raft_consensus.cc:1240] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:33.211380 14181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56046 (request call id 2957) took 1765 ms. Trace:
W20260709 12:12:33.212852 20788 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 22 current term: 22 is higher.
I20260709 12:12:33.214684 20692 leader_election.cc:290] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:33.217435 20547 leader_election.cc:290] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 17 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:33.219062 21074 consensus_queue.cc:260] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:33.220095 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:33.222189 21063 raft_consensus.cc:3055] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:12:33.222743 21063 raft_consensus.cc:740] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:33.195000 20652 consensus_queue.cc:260] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:33.210551 14303 leader_election.cc:304] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:33.207795 21034 raft_consensus.cc:2804] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:33.226356 14877 leader_election.cc:304] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:12:33.225955 14333 raft_consensus.cc:2468] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 15.
I20260709 12:12:33.228288 14261 raft_consensus.cc:2393] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 16: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:12:33.220718 20933 raft_consensus.cc:493] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:33.246552 14331 raft_consensus.cc:1275] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:12:33.246176 20933 raft_consensus.cc:515] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:33.247823 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:33.248531 14338 raft_consensus.cc:2468] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 16.
W20260709 12:12:33.251919 14154 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 458794us
I20260709 12:12:33.214591 20953 leader_election.cc:290] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 21 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:12:33.255244 21088 log.cc:927] Time spent T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.561s	user 0.003s	sys 0.000s
I20260709 12:12:33.257015 20990 raft_consensus.cc:2804] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:33.257800 20990 raft_consensus.cc:697] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 20 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:12:33.259140 20990 consensus_queue.cc:237] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:33.261507 20953 raft_consensus.cc:493] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:33.262259 20953 raft_consensus.cc:515] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:33.266660 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:33.248603 21074 raft_consensus.cc:3060] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:33.267407 14335 raft_consensus.cc:2468] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 20.
I20260709 12:12:33.233055 20896 raft_consensus.cc:3055] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:33.233809 20691 raft_consensus.cc:493] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:33.234364 21081 raft_consensus.cc:493] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:33.268494 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:33.269340 14912 raft_consensus.cc:2393] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 17: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
I20260709 12:12:33.268976 20691 raft_consensus.cc:515] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:33.237057 21056 leader_election.cc:290] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:33.237938 14257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41764 (request call id 3489) took 1477 ms. Trace:
I20260709 12:12:33.270695 14257 rpcz_store.cc:276] 0709 12:12:31.760951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:31.907926 (+146975us) service_pool.cc:224] Handling call
0709 12:12:33.237654 (+1329728us) spinlock_profiling.cc:243] Waited 441 ms on lock 0x7b5400031954. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:12:33.237866 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1013485952}
I20260709 12:12:33.237632 20843 consensus_queue.cc:1048] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:33.239323 21034 raft_consensus.cc:697] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 19 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:12:33.273506 14155 leader_election.cc:304] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:33.226984 20652 raft_consensus.cc:3060] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:33.212251 14181 rpcz_store.cc:276] 0709 12:12:31.446245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:31.483806 (+ 37561us) service_pool.cc:224] Handling call
0709 12:12:31.484158 (+   352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:32.984799 (+1500641us) spinlock_profiling.cc:243] Waited 11.6 ms on lock 0x7b5800549ed0. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f21270970aa 00007f2127119447 00007f2127131fe7 00007f21271337de 00007f212713db49 00007f212713e416 00007f212713ad8f 00007f212713a83e 00007f212c0ff419 00007f2125676bd4
0709 12:12:33.209729 (+224930us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:33.211300 (+  1571us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":26597760}
I20260709 12:12:33.266817 14258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53050 (request call id 1314) took 1508 ms. Trace:
I20260709 12:12:33.269038 21081 raft_consensus.cc:515] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:12:33.283078 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 72605.1us
I20260709 12:12:33.265373 20953 leader_election.cc:290] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:33.275277 14907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:33.268419 20896 raft_consensus.cc:740] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:33.306545 21084 raft_consensus.cc:3055] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:12:33.307071 20720 raft_consensus.cc:493] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:33.306785 20896 consensus_queue.cc:260] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:33.307852 21084 raft_consensus.cc:740] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:12:33.308892 20896 raft_consensus.cc:3060] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:33.243304 14337 raft_consensus.cc:2468] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 21.
I20260709 12:12:33.309201 21084 consensus_queue.cc:260] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:33.310945 21084 raft_consensus.cc:3060] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:33.288406 21107 consensus_queue.cc:1048] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.029s
I20260709 12:12:33.245386 14336 raft_consensus.cc:1275] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:12:33.318107 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:33.318871 14910 raft_consensus.cc:2468] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 18.
I20260709 12:12:33.319904 14908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:33.278121 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:33.323830 14335 raft_consensus.cc:1240] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:33.324345 14257 raft_consensus.cc:2468] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 16.
I20260709 12:12:33.277534 14877 leader_election.cc:304] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:12:33.278362 14258 rpcz_store.cc:276] 0709 12:12:31.758019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:32.380406 (+622387us) service_pool.cc:224] Handling call
0709 12:12:33.266505 (+886099us) spinlock_profiling.cc:243] Waited 232 ms on lock 0x7b54002fdd54. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:12:33.266662 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":532994944}
W20260709 12:12:33.325109 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 47662.9us
I20260709 12:12:33.280526 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:33.224006 21063 consensus_queue.cc:260] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:33.285419 14907 raft_consensus.cc:2393] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 17: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
I20260709 12:12:33.284039 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:33.285907 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: true dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:33.328692 14911 raft_consensus.cc:2376] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 22. Re-sending same reply.
I20260709 12:12:33.275672 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:33.329809 14262 raft_consensus.cc:2468] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 17.
I20260709 12:12:33.286372 14186 raft_consensus.cc:1240] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:33.284320 20958 raft_consensus.cc:493] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:33.287757 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:33.288443 21024 raft_consensus.cc:493] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:12:33.284305 20964 raft_consensus.cc:2804] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:33.285269 20547 consensus_queue.cc:1048] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.005s
I20260709 12:12:33.287230 14154 leader_election.cc:304] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:33.289129 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:33.290652 21081 leader_election.cc:290] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:33.291689 21006 consensus_queue.cc:1048] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.006s
I20260709 12:12:33.293211 14912 raft_consensus.cc:1275] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 13. (term mismatch)
I20260709 12:12:33.371974 14912 pending_rounds.cc:85] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db: Aborting all ops after (but not including) 12
I20260709 12:12:33.372267 14912 pending_rounds.cc:107] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db: Aborting uncommitted NO_OP operation due to leader change: 16.13
I20260709 12:12:33.372501 14912 raft_consensus.cc:2889] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:33.284603 21061 raft_consensus.cc:2749] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:12:33.298650 21034 consensus_queue.cc:237] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:33.299883 14331 raft_consensus.cc:1275] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:12:33.307758 20720 raft_consensus.cc:515] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } }
W20260709 12:12:33.316443 14229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:33.279824 14265 raft_consensus.cc:2468] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 20.
I20260709 12:12:33.210139 21030 raft_consensus.cc:515] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:33.284284 14303 leader_election.cc:304] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:12:33.396570 14229 leader_election.cc:304] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:33.332573 14181 raft_consensus.cc:2410] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for term 23 because replica has last-logged OpId of term: 21 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 13.
W20260709 12:12:33.341140 14154 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 54012.3us
I20260709 12:12:33.400864 14154 leader_election.cc:304] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:33.402338 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:33.403053 14265 raft_consensus.cc:2468] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 16.
W20260709 12:12:33.341130 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:33.343189 21032 raft_consensus.cc:2749] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:33.350342 21052 raft_consensus.cc:3055] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:33.351945 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:33.357515 14188 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56046 (request call id 2962) took 1701 ms. Trace:
I20260709 12:12:33.365931 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:33.367314 14877 leader_election.cc:304] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:12:33.386437 20788 raft_consensus.cc:493] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:33.340703 21024 raft_consensus.cc:515] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:33.331069 21107 raft_consensus.cc:2804] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:33.327021 14155 leader_election.cc:304] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:33.337949 20964 raft_consensus.cc:493] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:33.406735 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:33.393226 20890 raft_consensus.cc:515] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:33.454885 14336 raft_consensus.cc:3060] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:33.428664 14188 rpcz_store.cc:276] 0709 12:12:31.656264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:31.721097 (+ 64833us) service_pool.cc:224] Handling call
0709 12:12:31.721457 (+   360us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:31.763036 (+ 41579us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:31.763069 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:31.763627 (+   558us) log.cc:844] Serialized 26 byte log entry
0709 12:12:32.087495 (+323868us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:12:32.087543 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:33.356998 (+1269455us) spinlock_profiling.cc:243] Waited 41.1 ms on lock 0x7b54003a2fd4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:12:33.357058 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:33.357107 (+    49us) raft_consensus.cc:1685] finished
0709 12:12:33.357121 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:33.357439 (+   318us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12063,"raft.queue_time_us":1309,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":13596,"spinlock_wait_cycles":94623616,"thread_start_us":323459,"threads_started":1,"wal-append.queue_time_us":491156}
I20260709 12:12:33.466585 14339 raft_consensus.cc:1240] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:32.834751 14256 rpcz_store.cc:276] 0709 12:12:31.758538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:32.683101 (+924563us) service_pool.cc:224] Handling call
0709 12:12:32.685514 (+  2413us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:32.685845 (+   331us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 12:12:32.686116 (+   271us) log.cc:844] Serialized 14 byte log entry
0709 12:12:32.833701 (+147585us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:32.833778 (+    77us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:12:32.833831 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:32.833907 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:32.834032 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6500,"prepare.queue_time_us":605,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":8666,"thread_start_us":140681,"threads_started":1}
I20260709 12:12:33.458148 14184 raft_consensus.cc:2468] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 20.
W20260709 12:12:33.459115 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 91897.5us
I20260709 12:12:33.473011 14183 raft_consensus.cc:1240] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 20. Current term is 21. Ops: []
I20260709 12:12:33.474400 14258 raft_consensus.cc:1275] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 12:12:33.475863 14304 leader_election.cc:304] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:33.338201 20958 raft_consensus.cc:515] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:33.426390 14185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56046 (request call id 2959) took 1943 ms. Trace:
W20260709 12:12:33.486424 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 202458us
I20260709 12:12:33.487207 14303 leader_election.cc:304] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:33.428498 21036 raft_consensus.cc:3055] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:33.401082 21109 raft_consensus.cc:493] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:33.410480 20962 raft_consensus.cc:2749] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:12:33.488600 14338 raft_consensus.cc:2468] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 17.
I20260709 12:12:33.420082 21031 consensus_queue.cc:1059] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.089s
I20260709 12:12:33.427837 20997 consensus_queue.cc:1048] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.101s
I20260709 12:12:33.466399 20964 raft_consensus.cc:3060] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:33.490533 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:33.474041 20961 raft_consensus.cc:493] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:33.494305 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:33.454648 21107 raft_consensus.cc:493] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:33.474099 20948 raft_consensus.cc:493] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:33.667968 14182 raft_consensus.cc:2393] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 18: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:12:33.488600 14304 leader_election.cc:304] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:33.526162 14334 raft_consensus.cc:1240] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 20. Current term is 21. Ops: [20.15-20.15]
I20260709 12:12:33.585995 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:33.662796 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:33.618868 21036 raft_consensus.cc:740] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:33.669495 14904 raft_consensus.cc:2468] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 17.
I20260709 12:12:33.669064 14188 raft_consensus.cc:3060] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:33.670354 21036 consensus_queue.cc:260] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:33.671749 21036 raft_consensus.cc:3060] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:33.477046 20843 raft_consensus.cc:2804] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:33.624532 14336 raft_consensus.cc:2468] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 16.
W20260709 12:12:33.567816 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 80718.9us
W20260709 12:12:33.486307 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 58801.8us
W20260709 12:12:33.666333 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 78624.1us
I20260709 12:12:33.455482 21052 raft_consensus.cc:740] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:33.488631 14185 rpcz_store.cc:276] 0709 12:12:31.483136 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:31.512777 (+ 29641us) service_pool.cc:224] Handling call
0709 12:12:31.558472 (+ 45695us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:32.919145 (+1360673us) spinlock_profiling.cc:243] Waited 11.3 ms on lock 0x7b540003c3a0. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f21270b2dc0 00007f212713dd87 00007f212713e470 00007f212713ad8f 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c
0709 12:12:32.925145 (+  6000us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:33.426040 (+500895us) spinlock_profiling.cc:243] Waited 195 ms on lock 0x7b5400289bd4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:12:33.426300 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":474706560}
I20260709 12:12:33.692164 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
W20260709 12:12:33.692451 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 132647us
I20260709 12:12:33.467064 21008 raft_consensus.cc:493] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:33.467356 21037 raft_consensus.cc:493] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:33.483572 21032 raft_consensus.cc:2804] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:12:33.722795 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:33.491624 21061 raft_consensus.cc:2749] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:33.602511 20953 raft_consensus.cc:493] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:33.599224 20768 raft_consensus.cc:2804] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:12:33.663123 21033 raft_consensus.cc:493] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:33.566951 20720 leader_election.cc:290] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:33.718786 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:33.732489 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:33.466792 20788 raft_consensus.cc:515] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:33.757273 14262 raft_consensus.cc:2393] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 21: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
W20260709 12:12:33.770517 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 281962us
I20260709 12:12:33.771723 14304 leader_election.cc:304] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:33.410710 21056 raft_consensus.cc:2804] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:33.795076 14188 raft_consensus.cc:2468] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 16.
I20260709 12:12:33.686432 20767 raft_consensus.cc:2804] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:33.859910 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:33.680677 20843 raft_consensus.cc:493] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:33.584302 21030 leader_election.cc:290] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:12:33.860246 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 88647.8us
I20260709 12:12:33.879164 14905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59144 (request call id 722) took 1012 ms. Trace:
I20260709 12:12:33.529131 20977 consensus_queue.cc:1059] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.197s
I20260709 12:12:33.685705 20962 raft_consensus.cc:493] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:33.887248 14258 raft_consensus.cc:1275] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
W20260709 12:12:33.885777 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 159304us
I20260709 12:12:33.679970 21107 raft_consensus.cc:3060] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:33.900578 14905 rpcz_store.cc:276] 0709 12:12:32.866251 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:32.870437 (+  4186us) service_pool.cc:224] Handling call
0709 12:12:33.170029 (+299592us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:33.174861 (+  4832us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:33.878924 (+704063us) spinlock_profiling.cc:243] Waited 299 ms on lock 0x7b540020c450. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713a8ad 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:12:33.879088 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":687977728}
I20260709 12:12:33.901005 14262 raft_consensus.cc:1275] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
W20260709 12:12:33.889909 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 562928us
I20260709 12:12:33.902354 14304 leader_election.cc:304] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:33.876757 21085 raft_consensus.cc:3055] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:33.907183 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:33.490335 20867 consensus_queue.cc:1048] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.370s
I20260709 12:12:33.685992 20961 raft_consensus.cc:515] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:33.885772 20720 raft_consensus.cc:493] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:33.953150 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:33.882373 20953 raft_consensus.cc:515] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:33.884725 21108 raft_consensus.cc:2749] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:33.701902 20948 raft_consensus.cc:515] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:33.666145 21109 raft_consensus.cc:515] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:33.860698 21032 raft_consensus.cc:697] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 21 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
W20260709 12:12:33.962687 21112 log.cc:927] Time spent T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.295s	user 0.000s	sys 0.000s
I20260709 12:12:33.858520 21056 raft_consensus.cc:493] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:12:33.965582 14262 raft_consensus.cc:2468] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 19.
I20260709 12:12:33.906697 20843 raft_consensus.cc:3060] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:33.883240 21033 raft_consensus.cc:515] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:33.977502 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:12:33.974927 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 70489.4us
I20260709 12:12:33.910658 21085 raft_consensus.cc:740] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:33.730159 21037 raft_consensus.cc:515] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:12:33.991906 14230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:33.993178 14904 raft_consensus.cc:1275] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 12:12:33.860819 21008 raft_consensus.cc:515] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:12:33.974895 21113 log.cc:927] Time spent T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.488s	user 0.000s	sys 0.002s
I20260709 12:12:33.963039 20997 raft_consensus.cc:493] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:33.998265 14303 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:34.000205 14911 raft_consensus.cc:1275] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:12:33.998157 14333 raft_consensus.cc:2468] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 19.
I20260709 12:12:34.026083 14336 raft_consensus.cc:1275] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 12:12:33.911643 20962 raft_consensus.cc:515] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:33.986025 21056 raft_consensus.cc:3060] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:34.032946 14905 raft_consensus.cc:1275] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:12:34.043006 14256 raft_consensus.cc:2468] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 17.
I20260709 12:12:33.995711 21121 raft_consensus.cc:2804] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:34.055841 21121 raft_consensus.cc:493] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:34.056311 21121 raft_consensus.cc:3060] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:34.057381 20962 leader_election.cc:290] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:34.058933 20962 consensus_queue.cc:1048] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 12:12:34.061020 20652 consensus_meta.cc:287] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.776s	user 0.010s	sys 0.000s
I20260709 12:12:34.048782 20890 leader_election.cc:290] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 21 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:34.062529 20788 leader_election.cc:290] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:34.019882 20975 consensus_queue.cc:1059] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.059s
I20260709 12:12:34.039076 21108 raft_consensus.cc:2804] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:34.064438 21108 raft_consensus.cc:697] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 16 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
W20260709 12:12:34.065299 20896 consensus_meta.cc:287] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.756s	user 0.009s	sys 0.003s
I20260709 12:12:34.054023 21032 consensus_queue.cc:237] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:33.913341 21052 consensus_queue.cc:260] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:34.081667 21052 raft_consensus.cc:3060] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:33.997629 20976 raft_consensus.cc:493] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:34.020258 20979 raft_consensus.cc:493] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:34.024592 21024 leader_election.cc:290] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:33.972589 20720 raft_consensus.cc:515] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:34.067291 20961 leader_election.cc:290] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:34.045372 20958 leader_election.cc:290] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:34.065371 21108 consensus_queue.cc:237] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:34.070971 20767 raft_consensus.cc:493] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:34.020042 21081 raft_consensus.cc:493] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:34.055099 21033 leader_election.cc:290] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:34.061381 20953 leader_election.cc:290] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:34.039522 20997 raft_consensus.cc:515] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:34.102202 14876 leader_election.cc:304] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:34.108431 21118 raft_consensus.cc:493] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:34.111161 21107 raft_consensus.cc:515] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:34.117707 20767 raft_consensus.cc:3060] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:34.095400 20976 raft_consensus.cc:515] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:34.123286 21063 raft_consensus.cc:3060] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:34.095809 20979 raft_consensus.cc:515] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:34.094185 21085 consensus_queue.cc:260] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:34.129216 21123 raft_consensus.cc:2749] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:12:34.121012 21081 raft_consensus.cc:515] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:12:34.159730 14154 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.689s	user 0.004s	sys 0.019s
W20260709 12:12:34.163028 14154 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.692s	user 0.004s	sys 0.019s
W20260709 12:12:34.172991 14154 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.174.132:37341 timed out after 2.059s (SENT) [suppressed 4 similar messages]
I20260709 12:12:34.132514 21118 raft_consensus.cc:515] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:34.165793 21085 raft_consensus.cc:3060] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:34.133229 20768 raft_consensus.cc:697] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 21 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
W20260709 12:12:34.307135 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 397012us
W20260709 12:12:34.308913 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:34.340121 14155 leader_election.cc:304] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:34.226840 20948 leader_election.cc:290] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:34.225376 20916 raft_consensus.cc:493] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:34.234364 21120 raft_consensus.cc:493] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:34.235566 21109 leader_election.cc:290] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:34.303380 20871 raft_consensus.cc:493] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:34.253543 21008 leader_election.cc:290] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:34.368431 14303 leader_election.cc:304] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:12:34.385850 14303 leader_election.cc:304] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:34.361555 21076 raft_consensus.cc:493] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:34.357024 21022 raft_consensus.cc:493] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:34.368703 20953 raft_consensus.cc:2749] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:34.397778 21008 raft_consensus.cc:2804] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:34.400928 21008 raft_consensus.cc:697] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 20 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:34.402006 21008 consensus_queue.cc:237] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:34.410836 21081 leader_election.cc:290] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:34.414433 20691 leader_election.cc:290] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:34.387301 20871 raft_consensus.cc:515] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:34.417040 20871 leader_election.cc:290] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:12:34.394752 21116 log.cc:927] Time spent T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.297s	user 0.000s	sys 0.001s
I20260709 12:12:34.422031 20997 leader_election.cc:290] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:34.398057 20768 consensus_queue.cc:237] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:12:34.428925 21074 consensus_meta.cc:287] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 1.161s	user 0.010s	sys 0.001s
I20260709 12:12:34.429711 14265 raft_consensus.cc:2468] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 21.
I20260709 12:12:34.430662 20871 raft_consensus.cc:493] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:12:34.431291 20871 raft_consensus.cc:515] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:34.431823 14335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50856 (request call id 2900) took 1103 ms. Trace:
I20260709 12:12:34.432233 14335 rpcz_store.cc:276] 0709 12:12:33.328810 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:33.329022 (+   212us) service_pool.cc:224] Handling call
0709 12:12:33.329326 (+   304us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:33.329692 (+   366us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:33.329719 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:33.333092 (+  3373us) log.cc:844] Serialized 26 byte log entry
0709 12:12:33.668005 (+334913us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:33.668050 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:33.668141 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:34.431569 (+763428us) raft_consensus.cc:1685] finished
0709 12:12:34.431593 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:34.431756 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":69862,"raft.queue_time_us":1006,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":5339,"thread_start_us":271836,"threads_started":1,"wal-append.queue_time_us":644160}
W20260709 12:12:34.395815 21115 log.cc:927] Time spent T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.281s	user 0.000s	sys 0.001s
I20260709 12:12:34.433696 20871 leader_election.cc:290] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:34.435067 14257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53050 (request call id 1331) took 1108 ms. Trace:
I20260709 12:12:34.436432 14257 rpcz_store.cc:276] 0709 12:12:33.327030 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:33.327147 (+   117us) service_pool.cc:224] Handling call
0709 12:12:33.327482 (+   335us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:33.327820 (+   338us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:33.327849 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:33.332454 (+  4605us) log.cc:844] Serialized 26 byte log entry
0709 12:12:33.665592 (+333138us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:33.665638 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:33.665709 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:34.434826 (+769117us) raft_consensus.cc:1685] finished
0709 12:12:34.434849 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:34.434999 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3255,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":2149,"thread_start_us":314178,"threads_started":1,"wal-append.queue_time_us":669998}
I20260709 12:12:34.435331 14334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50856 (request call id 2901) took 1104 ms. Trace:
I20260709 12:12:34.435612 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:34.389869 20979 leader_election.cc:290] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:12:34.431370 14228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:34.438504 14334 rpcz_store.cc:276] 0709 12:12:33.331442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:33.331603 (+   161us) service_pool.cc:224] Handling call
0709 12:12:33.345156 (+ 13553us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:33.668663 (+323507us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:34.435066 (+766403us) spinlock_profiling.cc:243] Waited 181 ms on lock 0x7b5400145354. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:12:34.435265 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":415521024}
I20260709 12:12:34.372642 20948 consensus_queue.cc:1048] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.027s
I20260709 12:12:34.367949 20916 raft_consensus.cc:515] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:12:34.448726 14304 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.005s	sys 0.061s
I20260709 12:12:34.397118 21109 raft_consensus.cc:2804] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Leader election won for term 16
W20260709 12:12:34.455503 14304 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.547s	user 0.005s	sys 0.061s
I20260709 12:12:34.449991 21074 raft_consensus.cc:493] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
W20260709 12:12:34.461223 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 558929us
I20260709 12:12:34.389072 20720 leader_election.cc:290] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:34.433643 21056 raft_consensus.cc:515] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:34.441952 21081 raft_consensus.cc:493] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:34.465696 14228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:34.381242 21120 raft_consensus.cc:515] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:34.466189 14304 leader_election.cc:304] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
W20260709 12:12:34.425642 21084 consensus_meta.cc:287] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 1.114s	user 0.010s	sys 0.001s
I20260709 12:12:34.435922 21118 leader_election.cc:290] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:34.396201 21076 raft_consensus.cc:515] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:34.440299 21022 raft_consensus.cc:515] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:34.460551 21107 leader_election.cc:290] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 17 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:34.468118 20979 raft_consensus.cc:493] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:34.449782 21121 raft_consensus.cc:515] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:34.490880 14335 raft_consensus.cc:1275] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 14. (term mismatch)
I20260709 12:12:34.473018 21109 raft_consensus.cc:697] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 16 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:34.475220 20720 raft_consensus.cc:493] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:34.463871 20990 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.008s	sys 0.020s
I20260709 12:12:34.500982 14331 raft_consensus.cc:1275] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 10. (term mismatch)
I20260709 12:12:34.514585 14331 pending_rounds.cc:85] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c: Aborting all ops after (but not including) 9
I20260709 12:12:34.494980 21052 raft_consensus.cc:2804] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:34.472577 21074 raft_consensus.cc:515] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:34.515113 14331 pending_rounds.cc:107] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c: Aborting uncommitted NO_OP operation due to leader change: 17.10
I20260709 12:12:34.519387 14331 raft_consensus.cc:2889] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:34.489759 20976 leader_election.cc:290] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:34.506742 14335 pending_rounds.cc:85] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c: Aborting all ops after (but not including) 13
I20260709 12:12:34.520852 14335 pending_rounds.cc:107] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c: Aborting uncommitted NO_OP operation due to leader change: 19.14
I20260709 12:12:34.521162 14335 raft_consensus.cc:2889] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:34.476905 20997 consensus_queue.cc:1048] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.022s
W20260709 12:12:34.516940 14337 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.579s	user 0.010s	sys 0.012s
W20260709 12:12:34.517309 14154 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 344353us
I20260709 12:12:34.475878 21081 raft_consensus.cc:515] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:12:34.522500 14337 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.585s	user 0.010s	sys 0.012s
I20260709 12:12:34.542236 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:34.543111 14331 raft_consensus.cc:2468] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 18.
W20260709 12:12:34.516419 20990 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.628s	user 0.008s	sys 0.025s
I20260709 12:12:34.501227 21132 raft_consensus.cc:493] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:34.552984 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:34.524152 21052 raft_consensus.cc:493] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:34.555284 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:34.556731 14256 raft_consensus.cc:1275] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 14. (term mismatch)
I20260709 12:12:34.561523 21134 consensus_queue.cc:1048] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:12:34.577548 14185 raft_consensus.cc:1275] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 12:12:34.550077 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:34.579555 14331 raft_consensus.cc:2468] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 23.
I20260709 12:12:34.565963 20944 raft_consensus.cc:493] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:34.575374 14256 pending_rounds.cc:85] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec: Aborting all ops after (but not including) 13
I20260709 12:12:34.576424 14184 raft_consensus.cc:1275] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 12:12:34.585556 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:34.593775 14256 pending_rounds.cc:107] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec: Aborting uncommitted NO_OP operation due to leader change: 19.14
I20260709 12:12:34.594188 14256 raft_consensus.cc:2889] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:34.588963 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:34.590139 14263 raft_consensus.cc:1275] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 11. (term mismatch)
I20260709 12:12:34.511150 21137 consensus_queue.cc:1048] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.073s
I20260709 12:12:34.588290 14264 raft_consensus.cc:1275] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 12:12:34.595639 14263 pending_rounds.cc:85] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec: Aborting all ops after (but not including) 10
I20260709 12:12:34.595945 14263 pending_rounds.cc:107] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec: Aborting uncommitted NO_OP operation due to leader change: 19.11
I20260709 12:12:34.596211 14263 raft_consensus.cc:2889] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:34.537770 20953 raft_consensus.cc:493] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:34.512645 20979 raft_consensus.cc:515] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:12:34.555337 21138 log.cc:927] Time spent T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 12:12:34.605551 14230 leader_election.cc:304] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:12:34.625408 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:34.626123 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:34.630555 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:12:34.591667 20964 consensus_meta.cc:287] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.905s	user 0.010s	sys 0.003s
I20260709 12:12:34.578588 21052 raft_consensus.cc:3060] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:34.519209 20720 raft_consensus.cc:515] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:34.634150 14263 raft_consensus.cc:1275] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 12:12:34.635080 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:34.650162 14181 raft_consensus.cc:2468] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 16.
I20260709 12:12:34.547039 21084 raft_consensus.cc:493] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:34.574100 20642 raft_consensus.cc:493] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:12:34.632881 14303 leader_election.cc:304] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:34.644958 14257 raft_consensus.cc:2468] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 17.
I20260709 12:12:34.645916 14187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56652 (request call id 1606) took 1084 ms. Trace:
I20260709 12:12:34.574566 21132 raft_consensus.cc:515] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:34.655701 14187 rpcz_store.cc:276] 0709 12:12:33.561532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:34.044780 (+483248us) service_pool.cc:224] Handling call
0709 12:12:34.066078 (+ 21298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:34.066302 (+   224us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:12:34.467282 (+400980us) log.cc:844] Serialized 14 byte log entry
0709 12:12:34.645464 (+178182us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:34.645529 (+    65us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:34.645587 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:34.645659 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:34.645833 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":352703,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":33,"raft.queue_time_us":82,"thread_start_us":571262,"threads_started":2}
I20260709 12:12:34.637440 21055 raft_consensus.cc:493] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
W20260709 12:12:34.658506 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 52067.4us
I20260709 12:12:34.608692 20944 raft_consensus.cc:515] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:12:34.657159 14304 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:34.641467 21136 raft_consensus.cc:2804] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:34.665205 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:34.663021 21118 raft_consensus.cc:493] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:34.698446 21118 raft_consensus.cc:515] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:34.697597 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:34.699905 14187 raft_consensus.cc:2393] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 16: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:12:34.700862 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:34.701032 21118 leader_election.cc:290] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:34.708714 20143 raft_consensus.cc:3055] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:34.709338 20143 raft_consensus.cc:740] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:34.710878 14187 raft_consensus.cc:2393] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 21: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:12:34.711735 14265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41764 (request call id 3511) took 1305 ms. Trace:
I20260709 12:12:34.712193 14265 rpcz_store.cc:276] 0709 12:12:33.406230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:33.406419 (+   189us) service_pool.cc:224] Handling call
0709 12:12:34.711485 (+1305066us) spinlock_profiling.cc:243] Waited 973 ms on lock 0x7b5400211454. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:12:34.711641 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2239034112}
I20260709 12:12:34.712582 21134 raft_consensus.cc:493] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:34.713143 21134 raft_consensus.cc:515] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:34.715346 21134 leader_election.cc:290] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:34.716593 21136 raft_consensus.cc:697] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 16 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
W20260709 12:12:34.720669 20767 consensus_meta.cc:287] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.574s	user 0.009s	sys 0.001s
I20260709 12:12:34.638389 20953 raft_consensus.cc:515] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:34.720386 21136 consensus_queue.cc:237] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:34.725800 20953 leader_election.cc:290] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:34.729800 20933 leader_election.cc:290] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:34.639294 21109 consensus_queue.cc:237] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:34.756111 14188 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56652 (request call id 1597) took 1277 ms. Trace:
I20260709 12:12:34.721267 20767 raft_consensus.cc:515] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:34.742193 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
W20260709 12:12:34.762427 14338 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50856 (request call id 2897) took 1475 ms (client timeout 1795 ms). Trace:
W20260709 12:12:34.757448 14229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:34.738255 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:34.769985 14188 rpcz_store.cc:276] 0709 12:12:33.479248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:33.798101 (+318853us) service_pool.cc:224] Handling call
0709 12:12:33.905242 (+107141us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:34.040073 (+134831us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:34.040113 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:34.040160 (+    47us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:12:34.040203 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:34.755810 (+715607us) spinlock_profiling.cc:243] Waited 135 ms on lock 0x7b54001108d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:12:34.755873 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:34.756036 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":309507840}
I20260709 12:12:34.774940 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:34.807412 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:34.808214 14262 raft_consensus.cc:2468] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 23.
I20260709 12:12:34.805423 14265 raft_consensus.cc:3060] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:34.807045 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:34.808334 14229 leader_election.cc:304] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
W20260709 12:12:34.806717 14338 rpcz_store.cc:269] 0709 12:12:33.287363 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:33.287497 (+   134us) service_pool.cc:224] Handling call
0709 12:12:34.762210 (+1474713us) spinlock_profiling.cc:243] Waited 156 ms on lock 0x7b5400146254. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:12:34.762353 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":357701888}
I20260709 12:12:34.813174 14181 raft_consensus.cc:2393] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 18: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:12:34.813301 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:12:34.747042 21146 log.cc:927] Time spent T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.106s	user 0.000s	sys 0.001s
W20260709 12:12:34.754266 21063 consensus_meta.cc:287] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.605s	user 0.011s	sys 0.000s
I20260709 12:12:34.734210 21076 leader_election.cc:290] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:34.659137 21008 raft_consensus.cc:493] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:34.659461 20642 raft_consensus.cc:515] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:34.811872 21122 raft_consensus.cc:493] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:34.805990 21107 raft_consensus.cc:493] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:34.866691 21107 raft_consensus.cc:515] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:34.869066 21107 leader_election.cc:290] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:34.822278 20986 consensus_queue.cc:1059] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:12:34.862787 20691 raft_consensus.cc:493] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:34.870342 20691 raft_consensus.cc:515] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:34.871459 20986 raft_consensus.cc:3055] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:34.871902 20986 raft_consensus.cc:740] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:34.872728 20986 consensus_queue.cc:260] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:34.817801 20976 raft_consensus.cc:2804] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:34.856297 20143 consensus_queue.cc:260] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:34.874869 14264 raft_consensus.cc:3060] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:34.876078 20642 leader_election.cc:290] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:34.825700 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:34.825989 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:34.877767 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:34.878461 14331 raft_consensus.cc:2468] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 18.
I20260709 12:12:34.879460 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:34.826413 20934 raft_consensus.cc:493] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:34.826640 21004 consensus_queue.cc:1048] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:12:34.667174 21055 raft_consensus.cc:515] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:12:34.829315 21085 consensus_meta.cc:287] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.600s	user 0.005s	sys 0.007s
I20260709 12:12:34.830483 21121 leader_election.cc:290] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:34.889503 21055 leader_election.cc:290] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:34.889662 14155 leader_election.cc:304] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:34.831315 21006 raft_consensus.cc:493] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:34.862223 21034 raft_consensus.cc:493] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:34.658574 20916 leader_election.cc:290] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:34.657752 21036 consensus_queue.cc:1059] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.174s
I20260709 12:12:34.659025 21084 raft_consensus.cc:515] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:34.733574 21022 leader_election.cc:290] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:34.666033 21144 raft_consensus.cc:2749] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:34.759423 20720 leader_election.cc:290] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:34.720857 21037 leader_election.cc:290] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:34.697706 21108 consensus_queue.cc:1048] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.135s
I20260709 12:12:34.744249 21056 leader_election.cc:290] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:34.834669 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:34.816717 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:34.926226 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:34.927968 14181 raft_consensus.cc:1275] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 22 index: 10. Preceding OpId from leader: term: 23 index: 11. (index mismatch)
I20260709 12:12:34.836370 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:34.712025 21132 leader_election.cc:290] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:34.844561 14339 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50858 (request call id 2383) took 1721 ms. Trace:
W20260709 12:12:34.846020 14302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:34.849143 20768 raft_consensus.cc:493] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:34.850947 21081 leader_election.cc:290] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:34.935750 20898 raft_consensus.cc:493] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:34.939344 20898 raft_consensus.cc:515] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:34.851306 14333 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50856 (request call id 2905) took 1486 ms. Trace:
I20260709 12:12:34.921931 20975 consensus_queue.cc:1048] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.020s
I20260709 12:12:34.942085 14333 rpcz_store.cc:276] 0709 12:12:33.365459 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:33.365604 (+   145us) service_pool.cc:224] Handling call
0709 12:12:34.851096 (+1485492us) spinlock_profiling.cc:243] Waited 568 ms on lock 0x7b54000b8e54. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:12:34.851235 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1306171776}
I20260709 12:12:34.853009 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:34.942806 20768 raft_consensus.cc:515] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:34.854238 20692 raft_consensus.cc:493] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:34.855684 20944 leader_election.cc:290] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:34.856371 14190 raft_consensus.cc:1240] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260709 12:12:34.944072 20692 raft_consensus.cc:515] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:12:34.858458 20843 consensus_meta.cc:287] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db: Time spent flushing consensus metadata: real 0.852s	user 0.011s	sys 0.002s
I20260709 12:12:34.945183 20768 leader_election.cc:290] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:34.945062 20843 raft_consensus.cc:515] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:34.902926 21034 raft_consensus.cc:515] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:34.946324 20692 leader_election.cc:290] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:34.947013 14338 raft_consensus.cc:2468] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 16.
I20260709 12:12:34.947306 20843 leader_election.cc:290] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 18 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:34.655000 20964 raft_consensus.cc:515] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:34.947997 21034 leader_election.cc:290] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:34.881524 21122 raft_consensus.cc:515] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:34.949388 20964 leader_election.cc:290] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 21 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:34.753356 21120 leader_election.cc:290] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:34.874022 20976 raft_consensus.cc:493] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:34.825393 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:34.960150 14334 raft_consensus.cc:2468] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 17.
I20260709 12:12:34.880645 14188 raft_consensus.cc:2468] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 17.
I20260709 12:12:34.883220 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:34.874933 20143 raft_consensus.cc:3060] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:34.884383 20547 consensus_queue.cc:1048] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:12:34.760926 21052 raft_consensus.cc:515] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:12:34.963704 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 318751us
I20260709 12:12:34.907593 14265 raft_consensus.cc:2468] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 17.
W20260709 12:12:34.909425 14228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:34.965174 14228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:34.892529 20986 raft_consensus.cc:3060] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:34.901787 20953 raft_consensus.cc:2804] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:34.864934 21076 consensus_queue.cc:1048] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.043s
I20260709 12:12:34.931936 14339 rpcz_store.cc:276] 0709 12:12:33.122693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:33.122850 (+   157us) service_pool.cc:224] Handling call
0709 12:12:33.123180 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:33.475227 (+352047us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:34.844269 (+1369042us) spinlock_profiling.cc:243] Waited 343 ms on lock 0x7b540010d6d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:12:34.844483 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":789296896}
I20260709 12:12:34.970158 14230 leader_election.cc:304] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:12:34.865705 21008 raft_consensus.cc:515] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:34.932178 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:34.943569 14333 raft_consensus.cc:1275] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:12:34.973412 20953 raft_consensus.cc:493] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:34.891172 21006 raft_consensus.cc:515] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:34.976500 20953 raft_consensus.cc:3060] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:34.952682 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:34.978878 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:34.979575 14190 raft_consensus.cc:3060] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:34.952939 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:34.981662 14187 raft_consensus.cc:2468] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 22.
I20260709 12:12:34.958809 21084 leader_election.cc:290] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:34.913499 20767 leader_election.cc:290] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:34.904642 14264 raft_consensus.cc:1275] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 22 index: 10. Preceding OpId from leader: term: 23 index: 11. (index mismatch)
I20260709 12:12:34.891567 20934 raft_consensus.cc:515] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:34.972396 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:34.973076 14230 leader_election.cc:304] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:12:34.973332 20975 consensus_queue.cc:1048] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 12:12:34.976408 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:34.941769 20898 leader_election.cc:290] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:35.013824 14190 raft_consensus.cc:2468] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 18.
I20260709 12:12:35.007642 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:35.010628 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:34.962591 20976 raft_consensus.cc:3060] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:35.014735 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:35.015648 14335 raft_consensus.cc:2468] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 20.
W20260709 12:12:35.017418 14230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:35.019167 14230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:34.982574 21056 raft_consensus.cc:2804] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:34.992005 21120 raft_consensus.cc:493] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:34.971589 21081 consensus_queue.cc:1048] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.027s
I20260709 12:12:35.015437 14333 raft_consensus.cc:2468] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 14.
I20260709 12:12:35.028666 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 24 candidate_status { last_received { term: 22 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:35.022104 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:34.991715 20964 raft_consensus.cc:493] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:35.043848 20964 raft_consensus.cc:515] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:34.991372 20944 raft_consensus.cc:493] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:35.046191 20964 leader_election.cc:290] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:35.045990 20944 raft_consensus.cc:515] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:35.048225 20944 leader_election.cc:290] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:35.048746 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 24 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:35.049713 14188 raft_consensus.cc:2410] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for term 24 because replica has last-logged OpId of term: 22 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 13.
I20260709 12:12:35.050156 20934 leader_election.cc:290] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:35.051143 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:35.051805 14188 raft_consensus.cc:3060] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:35.033169 21036 raft_consensus.cc:493] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:35.034137 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:35.056048 14335 raft_consensus.cc:2393] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 23: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:12:35.020026 21122 leader_election.cc:290] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:35.039007 21006 leader_election.cc:290] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:35.040876 21008 leader_election.cc:290] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:35.058310 14332 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 1336) took 1094 ms. Trace:
I20260709 12:12:35.042443 21052 leader_election.cc:290] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:35.043118 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:35.057312 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:35.055653 21036 raft_consensus.cc:515] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:35.059757 14335 raft_consensus.cc:2393] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 18: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:12:35.060830 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:35.062104 14334 raft_consensus.cc:3060] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:35.068045 21074 leader_election.cc:290] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:35.073868 14335 raft_consensus.cc:2410] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for term 23 because replica has last-logged OpId of term: 22 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 11.
I20260709 12:12:35.074066 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:35.058768 14332 rpcz_store.cc:276] 0709 12:12:33.963840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:33.964001 (+   161us) service_pool.cc:224] Handling call
0709 12:12:33.964362 (+   361us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:34.084170 (+119808us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:34.084208 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:34.084256 (+    48us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:12:34.084289 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:35.058018 (+973729us) spinlock_profiling.cc:243] Waited 120 ms on lock 0x7b540047de54. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:12:35.058080 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:35.058243 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":274939776}
I20260709 12:12:35.088130 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:35.088841 14332 raft_consensus.cc:2468] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 21.
I20260709 12:12:35.090991 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:35.091794 14332 raft_consensus.cc:2468] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 23.
I20260709 12:12:35.093271 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:35.094758 14188 raft_consensus.cc:2468] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 18.
I20260709 12:12:35.100183 14333 raft_consensus.cc:1275] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 12:12:35.079607 14334 raft_consensus.cc:2468] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 21.
I20260709 12:12:35.023259 21056 raft_consensus.cc:493] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:33.058847 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:35.023723 21085 raft_consensus.cc:2804] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:12:35.109184 14155 leader_election.cc:304] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
W20260709 12:12:35.119302 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 271274us
I20260709 12:12:35.120985 14155 leader_election.cc:304] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:35.069182 20976 raft_consensus.cc:515] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:35.123335 14877 leader_election.cc:304] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:12:35.123728 14155 leader_election.cc:304] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:35.071190 21036 leader_election.cc:290] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:35.089944 20990 raft_consensus.cc:493] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:35.132148 14155 leader_election.cc:304] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:35.132054 14304 leader_election.cc:304] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:12:35.137779 14304 leader_election.cc:304] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:12:35.023448 21120 raft_consensus.cc:515] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:35.139926 14155 leader_election.cc:304] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:35.116145 21056 raft_consensus.cc:3060] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:35.147408 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:35.159970 21137 raft_consensus.cc:2804] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:35.126863 20962 raft_consensus.cc:2804] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:35.149914 14259 raft_consensus.cc:1240] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:35.151229 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:35.163443 14257 raft_consensus.cc:2410] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for term 21 because replica has last-logged OpId of term: 19 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 12:12:35.152108 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:35.116045 21085 raft_consensus.cc:493] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:35.144320 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:35.155987 14230 leader_election.cc:304] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:12:35.166287 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:35.166941 14257 raft_consensus.cc:3060] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:35.167222 14230 leader_election.cc:304] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db
W20260709 12:12:35.159025 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 331715us
I20260709 12:12:35.168720 20143 consensus_queue.cc:1048] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:12:35.164605 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:35.174875 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:35.134698 21034 raft_consensus.cc:2804] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:12:35.176121 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:35.175653 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:35.178457 21037 raft_consensus.cc:493] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:35.179001 21037 raft_consensus.cc:515] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:35.181399 21037 leader_election.cc:290] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:35.182291 21031 raft_consensus.cc:2804] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:35.133651 20964 consensus_queue.cc:1048] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.050s
I20260709 12:12:35.187161 21055 raft_consensus.cc:493] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:35.141438 20898 consensus_queue.cc:1048] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.042s
I20260709 12:12:35.188011 14876 leader_election.cc:304] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:35.229655 14186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56046 (request call id 2993) took 1759 ms. Trace:
I20260709 12:12:35.189105 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:35.230530 14263 raft_consensus.cc:3060] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:35.165369 20933 raft_consensus.cc:2804] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:12:35.190274 20691 leader_election.cc:290] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:35.165257 20997 consensus_queue.cc:1048] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 12:12:35.160861 21137 raft_consensus.cc:493] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:35.254084 21137 raft_consensus.cc:3060] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:35.192327 21081 raft_consensus.cc:493] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:12:35.255914 21081 raft_consensus.cc:515] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:35.192376 20774 raft_consensus.cc:493] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:35.141724 20843 raft_consensus.cc:2804] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:12:35.194877 21120 leader_election.cc:290] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:35.159610 20767 raft_consensus.cc:2804] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:35.137713 20948 raft_consensus.cc:2804] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:12:35.142218 20990 raft_consensus.cc:515] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:35.174696 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:35.194904 14337 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 1335) took 1258 ms. Trace:
I20260709 12:12:35.156395 21132 raft_consensus.cc:2804] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:12:35.270218 20948 raft_consensus.cc:493] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:35.271663 20948 raft_consensus.cc:3060] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:12:35.258538 20774 raft_consensus.cc:515] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:35.270035 21132 raft_consensus.cc:493] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:35.240216 20547 raft_consensus.cc:493] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:35.179437 20916 raft_consensus.cc:3055] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:12:35.184727 14229 leader_election.cc:304] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:35.141595 21108 consensus_queue.cc:1048] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.059s
I20260709 12:12:35.176493 21085 raft_consensus.cc:3060] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:35.133985 21052 consensus_queue.cc:1048] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.063s
I20260709 12:12:35.210669 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:35.189965 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:35.130162 20944 consensus_queue.cc:1059] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 12:12:35.166646 20962 raft_consensus.cc:493] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
W20260709 12:12:35.238668 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 50740.6us
I20260709 12:12:35.240464 21144 consensus_queue.cc:1048] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.052s
I20260709 12:12:35.275672 21132 raft_consensus.cc:3060] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:35.187356 20979 leader_election.cc:290] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:35.261591 20143 raft_consensus.cc:493] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:35.311151 20143 raft_consensus.cc:515] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:35.311611 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:35.266739 14337 rpcz_store.cc:276] 0709 12:12:33.936677 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:33.937035 (+   358us) service_pool.cc:224] Handling call
0709 12:12:33.937404 (+   369us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:34.525974 (+588570us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:34.526006 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:34.546432 (+ 20426us) log.cc:844] Serialized 26 byte log entry
0709 12:12:34.892141 (+345709us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:12:34.892181 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:34.892268 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:35.194654 (+302386us) raft_consensus.cc:1685] finished
0709 12:12:35.194677 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:35.194833 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":107382,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":29198,"thread_start_us":874671,"threads_started":2,"wal-append.queue_time_us":514889}
I20260709 12:12:35.258999 20767 raft_consensus.cc:493] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:35.258551 20843 raft_consensus.cc:493] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:35.270413 21006 raft_consensus.cc:2804] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:35.266768 20933 raft_consensus.cc:697] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 21 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:12:35.197578 21034 raft_consensus.cc:493] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:35.203629 14265 raft_consensus.cc:2468] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 18.
I20260709 12:12:35.204309 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 24 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:35.371239 14262 raft_consensus.cc:2410] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for term 24 because replica has last-logged OpId of term: 22 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 13.
I20260709 12:12:35.230105 14186 rpcz_store.cc:276] 0709 12:12:33.470438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:33.733140 (+262702us) service_pool.cc:224] Handling call
0709 12:12:33.733484 (+   344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:33.987871 (+254387us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:12:34.448294 (+460423us) log.cc:844] Serialized 14 byte log entry
0709 12:12:34.769957 (+321663us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:34.770555 (+   598us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:34.770607 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:35.228881 (+458274us) spinlock_profiling.cc:243] Waited 19 ms on lock 0x7b1800389aa0. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f212cf16ab1 00007f212cf23281 00007f212401c2a6 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419
0709 12:12:35.229391 (+   510us) spinlock_profiling.cc:243] Waited 254 ms on lock 0x7b5400422554. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:12:35.229441 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:35.229580 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":430935,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":40,"raft.queue_time_us":105,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":29276,"spinlock_wait_cycles":628079360,"thread_start_us":781276,"threads_started":2,"wal-append.queue_time_us":466091}
W20260709 12:12:35.309509 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 124897us
I20260709 12:12:35.209128 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:35.312827 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:35.373610 14337 raft_consensus.cc:2368] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 17. Current term is 18.
I20260709 12:12:35.206228 21031 raft_consensus.cc:493] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
W20260709 12:12:35.311750 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 101325us
I20260709 12:12:35.314764 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:35.318410 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:35.322302 14155 leader_election.cc:304] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:35.399173 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:12:35.400667 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 78503.8us
W20260709 12:12:35.342392 14302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:35.361063 20767 raft_consensus.cc:3060] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:35.285300 20916 raft_consensus.cc:740] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:35.287416 21154 raft_consensus.cc:2749] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:12:35.369411 20143 leader_election.cc:290] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:35.297303 20962 raft_consensus.cc:3060] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:35.387329 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 23 candidate_status { last_received { term: 22 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:35.228381 21055 raft_consensus.cc:515] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:35.399258 14339 raft_consensus.cc:2468] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 21.
I20260709 12:12:35.397609 21031 raft_consensus.cc:3060] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:35.398037 14303 leader_election.cc:304] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:35.312428 14331 raft_consensus.cc:2468] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 18.
I20260709 12:12:35.406265 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:35.290658 20547 raft_consensus.cc:515] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:35.371026 20843 raft_consensus.cc:3060] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:35.327942 20944 raft_consensus.cc:493] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:35.345108 14257 raft_consensus.cc:2468] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 18.
I20260709 12:12:35.375085 21034 raft_consensus.cc:3060] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:35.418427 21037 raft_consensus.cc:493] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:35.449524 14906 raft_consensus.cc:1275] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 21 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 12:12:35.402915 21006 raft_consensus.cc:697] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 18 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:12:35.424276 20143 consensus_queue.cc:1048] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:12:35.421844 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:35.426707 14263 raft_consensus.cc:2468] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 18.
I20260709 12:12:35.398737 14338 raft_consensus.cc:2468] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 20.
I20260709 12:12:35.468509 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:35.469705 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:35.430836 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:35.470530 14337 raft_consensus.cc:2468] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 23.
I20260709 12:12:35.471913 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:35.431887 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:35.437444 14155 leader_election.cc:304] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:35.444738 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:35.447647 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:35.451364 14907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:35.416522 20997 raft_consensus.cc:2804] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 12:12:35.455971 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 58094.9us
I20260709 12:12:35.459164 14182 raft_consensus.cc:1240] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 19 LEADER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:35.459860 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:35.464625 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:35.456075 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:35.529652 14303 leader_election.cc:304] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:35.530750 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:12:35.531482 14229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:35.531893 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 23 candidate_status { last_received { term: 22 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:35.442085 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:35.488862 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:35.533701 14303 leader_election.cc:304] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:35.534314 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:35.534754 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:35.534977 14182 raft_consensus.cc:2468] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 22.
I20260709 12:12:35.535904 14183 raft_consensus.cc:2393] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 23: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:12:35.536725 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:35.537566 14183 raft_consensus.cc:2410] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db for term 22 because replica has last-logged OpId of term: 20 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 14.
I20260709 12:12:35.529762 14188 raft_consensus.cc:2368] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 17. Current term is 18.
I20260709 12:12:35.455133 20944 raft_consensus.cc:515] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:35.493608 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:35.488166 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:35.480593 14338 raft_consensus.cc:2468] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 14.
I20260709 12:12:35.555760 14338 raft_consensus.cc:1240] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 20. Current term is 21. Ops: [20.15-20.15]
I20260709 12:12:35.439810 21036 raft_consensus.cc:2804] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:35.510329 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:35.569214 14912 raft_consensus.cc:3060] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:35.510322 14910 raft_consensus.cc:2468] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 18.
I20260709 12:12:35.511917 14184 raft_consensus.cc:1275] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:12:35.492766 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:35.486959 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:35.502656 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:35.468627 21162 raft_consensus.cc:493] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:35.512687 20143 raft_consensus.cc:493] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:35.524991 20990 leader_election.cc:290] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:35.447274 20976 leader_election.cc:290] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:35.500628 21081 leader_election.cc:290] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:35.470152 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:35.600075 14336 raft_consensus.cc:2468] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 18.
W20260709 12:12:35.526072 14304 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:35.601701 14304 leader_election.cc:304] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:35.526883 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:35.528291 14907 raft_consensus.cc:2468] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 14.
I20260709 12:12:35.540774 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:35.542327 20768 raft_consensus.cc:2749] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:12:35.604815 14334 raft_consensus.cc:1240] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:35.607273 14904 raft_consensus.cc:2393] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 17: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
W20260709 12:12:35.576434 20953 consensus_meta.cc:287] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.599s	user 0.015s	sys 0.004s
I20260709 12:12:35.612658 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:35.546212 14230 leader_election.cc:400] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 election: Vote denied by peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957) with higher term. Message: Invalid argument: T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 17. Current term is 18.
I20260709 12:12:35.613551 14230 leader_election.cc:403] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 12:12:35.465662 21129 consensus_queue.cc:1059] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.067s
I20260709 12:12:35.557430 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:35.562152 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:35.617594 14331 raft_consensus.cc:2393] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 19: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:12:35.562738 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
W20260709 12:12:35.518905 14228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:35.573312 20143 raft_consensus.cc:515] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:35.576606 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:35.613396 14260 raft_consensus.cc:2468] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 20.
I20260709 12:12:35.620187 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:35.620869 14257 raft_consensus.cc:2468] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 18.
I20260709 12:12:35.566923 21052 raft_consensus.cc:493] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
W20260709 12:12:35.628010 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 84842.9us
I20260709 12:12:35.577978 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:35.578748 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:35.630210 14264 raft_consensus.cc:2393] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 17: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:12:35.579515 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:35.537382 20891 raft_consensus.cc:493] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:35.593974 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:35.545034 21144 consensus_queue.cc:1048] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.068s
I20260709 12:12:35.532846 20997 raft_consensus.cc:493] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:35.469213 21037 raft_consensus.cc:515] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:35.541415 14303 leader_election.cc:304] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:35.547972 20774 leader_election.cc:290] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:35.561982 21109 raft_consensus.cc:2749] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:35.567533 20995 raft_consensus.cc:493] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:35.615536 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 18 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:35.615658 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:35.562189 21154 raft_consensus.cc:493] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:12:35.523144 20691 raft_consensus.cc:2749] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:35.622274 14257 raft_consensus.cc:1275] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:12:35.577492 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:35.627065 14182 raft_consensus.cc:2393] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 18: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:12:35.513840 20933 consensus_queue.cc:237] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:35.595995 14877 leader_election.cc:304] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:35.628916 14230 leader_election.cc:304] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:12:35.522845 20916 consensus_queue.cc:260] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:35.636397 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:35.633077 14262 raft_consensus.cc:2468] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 18.
I20260709 12:12:35.678035 14904 raft_consensus.cc:2393] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 14: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
W20260709 12:12:35.637179 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 199840us
I20260709 12:12:35.643723 20143 leader_election.cc:290] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:35.644289 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 24 candidate_status { last_received { term: 22 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:35.679767 14264 raft_consensus.cc:2468] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 23.
I20260709 12:12:35.681183 14264 raft_consensus.cc:1275] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:12:35.650425 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:12:35.647069 21163 log.cc:927] Time spent T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.126s	user 0.000s	sys 0.001s
I20260709 12:12:35.688190 20143 raft_consensus.cc:493] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:35.688421 14190 raft_consensus.cc:2468] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 20.
I20260709 12:12:35.666467 14907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:35.629339 21084 raft_consensus.cc:2804] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:35.674786 14903 raft_consensus.cc:2410] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for term 18 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 12.
I20260709 12:12:35.683903 14912 raft_consensus.cc:2468] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 18.
I20260709 12:12:35.665366 14258 raft_consensus.cc:2468] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 22.
I20260709 12:12:35.684837 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:35.599736 21162 raft_consensus.cc:515] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:35.689988 14907 raft_consensus.cc:2468] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 21.
W20260709 12:12:35.694159 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 98209.4us
I20260709 12:12:35.635679 21081 raft_consensus.cc:2749] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957) with higher term. Message: Invalid argument: T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 17. Current term is 18.
I20260709 12:12:35.645629 20997 raft_consensus.cc:3060] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:35.688818 20143 raft_consensus.cc:515] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:35.696631 14335 raft_consensus.cc:1275] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 12:12:35.698486 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:35.622154 20953 raft_consensus.cc:515] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:35.756829 21084 raft_consensus.cc:493] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:35.769407 21084 raft_consensus.cc:3060] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:12:35.759523 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 157903us
W20260709 12:12:35.773439 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 81006.7us
I20260709 12:12:35.774711 14155 leader_election.cc:304] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:35.664891 20547 leader_election.cc:290] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:35.776561 14260 raft_consensus.cc:1275] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:12:35.777822 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:35.783087 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:35.783792 14903 raft_consensus.cc:2468] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 21.
I20260709 12:12:35.687650 20964 raft_consensus.cc:493] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:35.637296 21052 raft_consensus.cc:515] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:35.757074 21076 raft_consensus.cc:2804] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:12:35.755384 20916 raft_consensus.cc:3060] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:35.795657 14905 raft_consensus.cc:3060] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:35.791710 14877 leader_election.cc:304] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:35.643355 20891 raft_consensus.cc:515] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:35.766196 20871 raft_consensus.cc:2749] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:12:35.859504 21164 log.cc:927] Time spent T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.247s	user 0.000s	sys 0.001s
I20260709 12:12:35.683780 21154 raft_consensus.cc:515] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:35.782941 20934 raft_consensus.cc:493] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:35.878968 14262 raft_consensus.cc:2393] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 18: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:12:35.880736 14189 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 3440) took 1340 ms. Trace:
I20260709 12:12:35.897571 14189 rpcz_store.cc:276] 0709 12:12:34.539969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:34.540113 (+   144us) service_pool.cc:224] Handling call
0709 12:12:34.575668 (+ 35555us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:34.592394 (+ 16726us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:34.592435 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:34.592984 (+   549us) log.cc:844] Serialized 26 byte log entry
0709 12:12:34.858715 (+265731us) spinlock_profiling.cc:243] Waited 10.1 ms on lock 0x7b1800448d20. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f212cf16ab1 00007f212cf23281 00007f2124030e07 00007f212ce8b9a9 00007f212404d69b 00007f212404b93f 00007f212404dc02 00007f2126cd520b 00007f2126cdad23 00007f2126cdb0d1 00007f21270f6a0f
0709 12:12:35.134636 (+275921us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:12:35.134682 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:35.135027 (+   345us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:35.880365 (+745338us) raft_consensus.cc:1685] finished
0709 12:12:35.880395 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:35.880660 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8544,"raft.queue_time_us":857,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":22087,"spinlock_wait_cycles":23131520,"thread_start_us":275691,"threads_started":1,"wal-append.queue_time_us":842623}
I20260709 12:12:35.882073 14330 raft_consensus.cc:1240] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 16 LEADER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:35.865131 20767 raft_consensus.cc:515] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:35.806954 20143 leader_election.cc:290] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:35.644073 21006 consensus_queue.cc:237] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:12:35.891070 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 99484.9us
I20260709 12:12:35.893040 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
W20260709 12:12:35.894582 21167 log.cc:927] Time spent T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.268s	user 0.000s	sys 0.000s
I20260709 12:12:35.802322 21076 raft_consensus.cc:493] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:35.683100 20995 raft_consensus.cc:515] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:35.866741 21055 leader_election.cc:290] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:35.866485 21176 raft_consensus.cc:493] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:35.896008 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:35.925840 14260 raft_consensus.cc:2468] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 17.
I20260709 12:12:35.916396 14261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53050 (request call id 1333) took 1446 ms. Trace:
I20260709 12:12:35.926934 14261 rpcz_store.cc:276] 0709 12:12:34.469679 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:34.469843 (+   164us) service_pool.cc:224] Handling call
0709 12:12:34.470409 (+   566us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:34.487916 (+ 17507us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:34.487951 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:34.488481 (+   530us) log.cc:844] Serialized 26 byte log entry
0709 12:12:34.942101 (+453620us) spinlock_profiling.cc:243] Waited 2.22 ms on lock 0x7b1800409d20. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f212cf16ab1 00007f212cf23281 00007f2124030e07 00007f212ce8b9a9 00007f212404d69b 00007f212404b93f 00007f212404dc02 00007f2126cd520b 00007f2126cdad23 00007f2126cdb0d1 00007f21270f6a0f
0709 12:12:35.433470 (+491369us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:12:35.433517 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:35.433598 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:35.908496 (+474898us) raft_consensus.cc:1685] finished
0709 12:12:35.908522 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:35.916303 (+  7781us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7916,"raft.queue_time_us":16411,"raft.run_cpu_time_us":222,"raft.run_wall_time_us":10033,"spinlock_wait_cycles":5100928,"thread_start_us":491153,"threads_started":1,"wal-append.queue_time_us":1058826}
I20260709 12:12:35.929301 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:35.938853 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:35.906564 20990 raft_consensus.cc:2804] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:35.939649 14261 raft_consensus.cc:2468] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 16.
I20260709 12:12:35.941238 14877 leader_election.cc:304] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:35.867805 21122 consensus_queue.cc:1048] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.114s
I20260709 12:12:35.914234 21076 raft_consensus.cc:3060] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:35.946117 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:35.959059 20891 leader_election.cc:290] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:35.962340 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:35.963138 14261 raft_consensus.cc:3060] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Advancing to term 21
I20260709 12:12:35.867743 20964 raft_consensus.cc:515] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:35.975718 14877 leader_election.cc:304] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:35.943392 21175 raft_consensus.cc:2749] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:35.910404 20934 raft_consensus.cc:515] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:35.989563 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:12:35.991755 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 192651us
I20260709 12:12:35.946985 20944 leader_election.cc:290] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:35.972922 14912 raft_consensus.cc:2468] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 18.
I20260709 12:12:35.990375 14260 raft_consensus.cc:2468] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 23.
I20260709 12:12:35.969352 21168 raft_consensus.cc:2749] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 12:12:36.006448 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 377597us
I20260709 12:12:35.969233 20990 raft_consensus.cc:697] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 17 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
W20260709 12:12:35.988863 20948 consensus_meta.cc:287] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.717s	user 0.009s	sys 0.012s
I20260709 12:12:36.019160 14230 leader_election.cc:304] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:12:36.023509 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:36.025898 14155 leader_election.cc:304] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:35.941308 21176 raft_consensus.cc:515] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:12:36.020354 21170 log.cc:927] Time spent T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.338s	user 0.000s	sys 0.001s
I20260709 12:12:36.037676 20143 raft_consensus.cc:493] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:36.023864 21136 raft_consensus.cc:493] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:36.029769 14261 raft_consensus.cc:2468] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 21.
I20260709 12:12:36.038327 20143 raft_consensus.cc:515] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:36.042860 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:36.028978 14155 leader_election.cc:304] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:36.043181 14230 leader_election.cc:304] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:36.044198 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:36.005056 20547 raft_consensus.cc:2804] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:36.025714 20891 raft_consensus.cc:2804] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 12:12:36.045961 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:36.040940 14229 leader_election.cc:304] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:36.046706 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:36.050822 14229 leader_election.cc:304] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:36.052358 21175 raft_consensus.cc:2749] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:36.031486 21180 raft_consensus.cc:2804] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:36.055514 14155 leader_election.cc:304] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:36.050596 14260 raft_consensus.cc:2468] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 20.
I20260709 12:12:36.057694 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:36.063308 14261 raft_consensus.cc:2368] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 17. Current term is 18.
I20260709 12:12:36.049484 20891 raft_consensus.cc:493] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:36.064297 20891 raft_consensus.cc:3060] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:36.065284 21176 leader_election.cc:290] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:36.070080 14333 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 1340) took 1109 ms. Trace:
I20260709 12:12:36.070513 14333 rpcz_store.cc:276] 0709 12:12:34.960354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:35.101100 (+140746us) service_pool.cc:224] Handling call
0709 12:12:35.101402 (+   302us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:35.108192 (+  6790us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:35.108231 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:35.108778 (+   547us) log.cc:844] Serialized 26 byte log entry
0709 12:12:35.536797 (+428019us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:12:35.536838 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:35.536903 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:36.069827 (+532924us) raft_consensus.cc:1685] finished
0709 12:12:36.069851 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:36.070010 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1621,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":10998,"thread_start_us":374580,"threads_started":1,"wal-append.queue_time_us":478716}
W20260709 12:12:36.072718 21174 log.cc:927] Time spent T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.177s	user 0.001s	sys 0.000s
I20260709 12:12:36.074025 21154 leader_election.cc:290] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:36.074303 21187 consensus_queue.cc:1048] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.013s
W20260709 12:12:36.075886 21172 log.cc:927] Time spent T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.273s	user 0.001s	sys 0.000s
W20260709 12:12:36.076614 21173 log.cc:927] Time spent T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.187s	user 0.001s	sys 0.000s
I20260709 12:12:36.060334 20975 raft_consensus.cc:2804] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:12:36.078265 20975 raft_consensus.cc:493] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:36.078692 20975 raft_consensus.cc:3060] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Advancing to term 24
W20260709 12:12:36.081060 21056 consensus_meta.cc:287] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.905s	user 0.006s	sys 0.011s
I20260709 12:12:36.054668 21081 raft_consensus.cc:2749] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:36.059837 21180 raft_consensus.cc:493] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:36.083567 21180 raft_consensus.cc:3060] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:36.085227 20767 leader_election.cc:290] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 21 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:36.087442 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:36.047222 20547 raft_consensus.cc:493] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:36.090423 20547 raft_consensus.cc:3060] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:36.061694 21162 leader_election.cc:290] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:36.054207 20986 raft_consensus.cc:2749] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:12:36.024528 20948 raft_consensus.cc:515] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:36.094588 20953 leader_election.cc:290] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:36.095127 20948 leader_election.cc:290] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 14 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:36.097525 21052 leader_election.cc:290] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:36.088768 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:36.104460 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:36.105170 14261 raft_consensus.cc:2376] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 21. Re-sending same reply.
I20260709 12:12:36.106920 20143 leader_election.cc:290] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:36.060858 14229 leader_election.cc:400] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 election: Vote denied by peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187) with higher term. Message: Invalid argument: T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 17. Current term is 18.
I20260709 12:12:36.040190 21037 leader_election.cc:290] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:12:36.108889 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 56893.1us
I20260709 12:12:36.111184 20143 consensus_queue.cc:1048] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:12:36.111366 14229 leader_election.cc:304] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:36.049227 21136 raft_consensus.cc:515] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:12:36.124135 21034 consensus_meta.cc:287] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.655s	user 0.007s	sys 0.004s
W20260709 12:12:36.119710 20962 consensus_meta.cc:287] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.680s	user 0.011s	sys 0.000s
I20260709 12:12:36.133018 20962 raft_consensus.cc:515] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:36.135232 20962 leader_election.cc:290] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:12:36.137302 20843 consensus_meta.cc:287] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db: Time spent flushing consensus metadata: real 0.629s	user 0.011s	sys 0.000s
I20260709 12:12:36.137786 20843 raft_consensus.cc:515] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:36.139155 14906 raft_consensus.cc:2393] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 24: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
I20260709 12:12:36.139889 20843 leader_election.cc:290] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 24 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:12:36.143697 21137 consensus_meta.cc:287] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.889s	user 0.008s	sys 0.012s
I20260709 12:12:36.144199 21137 raft_consensus.cc:515] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:36.125519 21036 raft_consensus.cc:493] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:36.127596 20975 raft_consensus.cc:515] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:36.114863 21154 raft_consensus.cc:2749] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:36.081583 21056 raft_consensus.cc:515] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:12:36.155930 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 100490us
I20260709 12:12:36.158820 14155 leader_election.cc:304] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:36.160635 21137 leader_election.cc:290] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:36.148744 21036 raft_consensus.cc:3060] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:36.149111 21037 raft_consensus.cc:2804] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:36.113931 20990 consensus_queue.cc:237] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:36.169232 20975 leader_election.cc:290] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 24 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:36.124146 21084 raft_consensus.cc:515] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:36.173648 14155 leader_election.cc:304] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:36.174449 20948 raft_consensus.cc:2804] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:12:36.175078 21120 raft_consensus.cc:3055] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 18 LEADER]: Stepping down as leader of term 18
W20260709 12:12:36.179677 21132 consensus_meta.cc:287] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.816s	user 0.007s	sys 0.004s
I20260709 12:12:36.147799 21034 raft_consensus.cc:515] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:36.186940 14155 leader_election.cc:304] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
W20260709 12:12:36.197609 14228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:36.161651 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 50368us
I20260709 12:12:36.173673 21037 raft_consensus.cc:493] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
W20260709 12:12:36.197949 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 656657us
I20260709 12:12:36.222818 14303 leader_election.cc:304] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:12:36.229004 20953 raft_consensus.cc:2804] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:12:36.229560 20953 raft_consensus.cc:493] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:36.229980 20953 raft_consensus.cc:3060] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:36.232664 20964 leader_election.cc:290] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:36.235431 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:36.236318 14257 raft_consensus.cc:2468] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 21.
I20260709 12:12:36.218298 21034 leader_election.cc:290] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 22 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:36.222244 14155 leader_election.cc:304] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:36.238248 14155 leader_election.cc:304] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:36.239522 20964 raft_consensus.cc:2804] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:36.239992 20964 raft_consensus.cc:493] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:36.240370 20964 raft_consensus.cc:3060] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:12:36.241482 21155 log.cc:927] Time spent T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.824s	user 0.000s	sys 0.005s
I20260709 12:12:36.243932 14330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50856 (request call id 2914) took 1747 ms. Trace:
I20260709 12:12:36.244344 14330 rpcz_store.cc:276] 0709 12:12:34.496430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:34.520360 (+ 23930us) service_pool.cc:224] Handling call
0709 12:12:34.551783 (+ 31423us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:35.881873 (+1330090us) spinlock_profiling.cc:243] Waited 8.92 ms on lock 0x7b5400356ea0. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f21270b2dc0 00007f212713d1c0 00007f212713e231 00007f212713ad8f 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c
0709 12:12:35.907872 (+ 25999us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:36.243643 (+335771us) spinlock_profiling.cc:243] Waited 808 ms on lock 0x7b540001ac54. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:12:36.243856 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1878399104}
I20260709 12:12:36.239537 14155 leader_election.cc:304] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
W20260709 12:12:36.199234 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 223619us
I20260709 12:12:36.248680 20944 raft_consensus.cc:2804] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:36.248837 14877 leader_election.cc:304] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:36.249135 20944 raft_consensus.cc:493] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:36.195374 21120 raft_consensus.cc:740] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
W20260709 12:12:36.206240 21165 log.cc:927] Time spent T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.658s	user 0.000s	sys 0.007s
I20260709 12:12:36.208295 21076 raft_consensus.cc:515] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:36.210318 21084 leader_election.cc:290] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:36.211258 21008 raft_consensus.cc:2749] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:12:36.213937 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 439339us
I20260709 12:12:36.292774 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:36.185660 20768 raft_consensus.cc:2749] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:36.172403 20891 raft_consensus.cc:515] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:36.216187 20547 raft_consensus.cc:515] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:36.218043 21144 raft_consensus.cc:493] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:36.218966 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:36.359241 14337 raft_consensus.cc:2468] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 19.
I20260709 12:12:36.360340 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 21 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:36.220072 20767 raft_consensus.cc:493] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:36.220479 21109 raft_consensus.cc:3055] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 16 LEADER]: Stepping down as leader of term 16
W20260709 12:12:36.247918 21177 log.cc:927] Time spent T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.336s	user 0.001s	sys 0.000s
I20260709 12:12:36.202539 14229 leader_election.cc:304] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:36.249186 14155 leader_election.cc:304] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:36.253008 14303 leader_election.cc:304] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:36.202730 14905 raft_consensus.cc:2468] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 21.
I20260709 12:12:36.255522 14339 raft_consensus.cc:1240] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:36.257974 14259 raft_consensus.cc:2393] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db in current term 19: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:12:36.195322 20962 raft_consensus.cc:2749] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:36.293227 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:36.323192 14304 leader_election.cc:304] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:36.214588 21178 consensus_queue.cc:1048] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:12:36.324057 14261 raft_consensus.cc:2468] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 17.
I20260709 12:12:36.290334 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:36.293399 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:36.419521 14338 raft_consensus.cc:2410] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db for term 22 because replica has last-logged OpId of term: 20 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 14.
I20260709 12:12:36.293820 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 21 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:36.198172 20948 raft_consensus.cc:493] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:36.254588 20944 raft_consensus.cc:3060] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:12:36.260269 21161 log.cc:927] Time spent T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.731s	user 0.003s	sys 0.000s
W20260709 12:12:36.259452 21185 log.cc:927] Time spent T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.141s	user 0.001s	sys 0.000s
I20260709 12:12:36.262503 20691 raft_consensus.cc:2804] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 12:12:36.393992 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 54737.9us
I20260709 12:12:36.395727 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:36.253875 21037 raft_consensus.cc:3060] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:36.396766 14258 raft_consensus.cc:1240] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 21. Current term is 22. Ops: []
I20260709 12:12:36.405171 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:36.445428 14183 raft_consensus.cc:2468] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 18.
W20260709 12:12:36.406986 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 204563us
I20260709 12:12:36.404984 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:36.410043 14260 raft_consensus.cc:2410] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db for term 21 because replica has last-logged OpId of term: 20 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 14.
W20260709 12:12:36.412034 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 159123us
I20260709 12:12:36.447667 14229 leader_election.cc:304] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:36.449410 14303 leader_election.cc:304] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
W20260709 12:12:36.413185 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 164088us
I20260709 12:12:36.452056 14155 leader_election.cc:304] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:36.456106 21195 raft_consensus.cc:2804] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:36.456744 21195 raft_consensus.cc:697] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 18 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:36.405483 21144 raft_consensus.cc:515] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:36.325475 21189 raft_consensus.cc:2749] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:36.415877 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:36.441116 20691 raft_consensus.cc:493] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:36.447583 14337 raft_consensus.cc:3060] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:36.199322 21132 raft_consensus.cc:515] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:36.422214 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:36.410670 14332 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50858 (request call id 2405) took 1451 ms. Trace:
I20260709 12:12:36.347227 21084 raft_consensus.cc:493] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:36.424645 14333 raft_consensus.cc:2393] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db in current term 21: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:12:36.424014 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
W20260709 12:12:36.427165 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 104065us
I20260709 12:12:36.422089 21074 raft_consensus.cc:2749] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:36.397351 21109 raft_consensus.cc:740] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:36.420921 20692 raft_consensus.cc:2749] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:36.467078 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:36.421415 21175 raft_consensus.cc:2749] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:36.426453 20948 raft_consensus.cc:3060] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:36.441478 14188 raft_consensus.cc:2468] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 18.
I20260709 12:12:36.498939 14186 raft_consensus.cc:2393] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db in current term 22: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:12:36.440028 14187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 3458) took 1486 ms. Trace:
W20260709 12:12:36.462242 21085 consensus_meta.cc:287] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 1.145s	user 0.013s	sys 0.000s
I20260709 12:12:36.406064 20767 raft_consensus.cc:515] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:36.465080 14261 raft_consensus.cc:2468] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 18.
I20260709 12:12:36.460551 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:36.466182 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 21 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:36.463099 14260 raft_consensus.cc:1240] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 20. Current term is 21. Ops: [20.14-20.14]
I20260709 12:12:36.475174 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:36.478922 14304 leader_election.cc:304] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:36.511264 14183 raft_consensus.cc:3060] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:12:36.512795 20997 consensus_meta.cc:287] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.730s	user 0.006s	sys 0.006s
I20260709 12:12:36.423733 21120 consensus_queue.cc:260] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:36.513317 20997 raft_consensus.cc:515] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:36.478873 14303 leader_election.cc:304] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:36.476476 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:36.465224 14332 rpcz_store.cc:276] 0709 12:12:34.958934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:35.097590 (+138656us) service_pool.cc:224] Handling call
0709 12:12:35.098001 (+   411us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:12:35.098490 (+   489us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:12:35.435959 (+337469us) log.cc:844] Serialized 14 byte log entry
0709 12:12:36.179519 (+743560us) spinlock_profiling.cc:243] Waited 1.59 ms on lock 0x7b1800390a00. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f212cf16ab1 00007f212cf23281 00007f2123fc8c0a 00007f212d708219 00007f2124050a40 00007f212404b4e4 00007f212404b455 00007f2127133060 00007f2127145716 00007f2127156287 00007f2127156208
0709 12:12:36.179701 (+   182us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:12:36.180383 (+   682us) log.cc:844] Serialized 52 byte log entry
0709 12:12:36.180589 (+   206us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:12:36.180628 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:36.180711 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:36.399685 (+218974us) raft_consensus.cc:1685] finished
0709 12:12:36.410387 (+ 10702us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:36.410589 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4747,"prepare.queue_time_us":466770,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":587610,"raft.run_cpu_time_us":296,"raft.run_wall_time_us":27587,"spinlock_wait_cycles":3662592,"thread_start_us":468478,"threads_started":2,"wal-append.queue_time_us":337722}
W20260709 12:12:36.493893 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 52494us
W20260709 12:12:36.461421 21031 consensus_meta.cc:287] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 1.008s	user 0.011s	sys 0.001s
I20260709 12:12:36.499696 14187 rpcz_store.cc:276] 0709 12:12:34.953141 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:34.982496 (+ 29355us) service_pool.cc:224] Handling call
0709 12:12:34.982907 (+   411us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:34.987366 (+  4459us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:34.987405 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:34.988038 (+   633us) log.cc:844] Serialized 26 byte log entry
0709 12:12:35.309616 (+321578us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:12:35.309664 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:35.309776 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:36.205512 (+895736us) spinlock_profiling.cc:243] Waited 18.9 ms on lock 0x7b4400022b4c. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2123f74c85 00007f2123f756a2 00007f2126ce71db 00007f2126ce2aaf 00007f2126cd686e 00007f2126cd5bb6 00007f2126cd57d8 00007f2126cdf221 00007f2126cdf1d9 00007f2126cdf169
0709 12:12:36.433981 (+228469us) raft_consensus.cc:1685] finished
0709 12:12:36.434008 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:36.439943 (+  5935us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3957,"raft.queue_time_us":5500,"raft.run_cpu_time_us":188,"raft.run_wall_time_us":14834,"spinlock_wait_cycles":43457792,"thread_start_us":321195,"threads_started":1,"wal-append.queue_time_us":520814}
I20260709 12:12:36.433991 20768 raft_consensus.cc:2804] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:36.506284 14337 raft_consensus.cc:2468] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 24.
W20260709 12:12:36.541591 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 62813.1us
I20260709 12:12:36.543107 14303 leader_election.cc:304] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:36.543331 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:36.544077 14337 raft_consensus.cc:3060] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:36.545205 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
W20260709 12:12:36.490041 21177 log.cc:927] Time spent T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:12:36.458598 21076 leader_election.cc:290] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:36.516770 20547 leader_election.cc:290] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 15 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:36.475633 20979 raft_consensus.cc:2749] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:12:36.519663 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 471798us
I20260709 12:12:36.461419 20691 raft_consensus.cc:3060] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:36.548084 21180 raft_consensus.cc:515] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:36.459462 21187 raft_consensus.cc:2804] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:12:36.513919 20692 consensus_queue.cc:1048] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:12:36.518298 21055 consensus_queue.cc:1048] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:12:36.530706 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:36.536582 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 21 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:36.533475 14877 leader_election.cc:304] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:12:36.587610 14906 raft_consensus.cc:2368] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 14. Current term is 15.
I20260709 12:12:36.460435 21144 leader_election.cc:290] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:36.546411 21120 raft_consensus.cc:3060] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:36.457930 21136 leader_election.cc:290] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:36.532308 21085 raft_consensus.cc:515] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:36.489630 21084 raft_consensus.cc:515] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:36.513408 21008 raft_consensus.cc:2749] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:12:36.600349 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:36.493034 21129 consensus_queue.cc:1048] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.054s
I20260709 12:12:36.556913 14337 raft_consensus.cc:2468] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 19.
I20260709 12:12:36.564913 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:36.556494 21182 raft_consensus.cc:493] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:36.541617 21056 leader_election.cc:290] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:36.542403 21052 raft_consensus.cc:493] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
W20260709 12:12:36.589181 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 55805.5us
I20260709 12:12:36.590638 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
W20260709 12:12:36.592788 21198 log.cc:927] Time spent T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 12:12:36.457703 21195 consensus_queue.cc:237] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:36.549228 21178 raft_consensus.cc:2749] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:36.545841 14911 raft_consensus.cc:2468] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 18.
I20260709 12:12:36.577031 20997 leader_election.cc:290] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:36.596279 14912 raft_consensus.cc:1240] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 12:12:36.542889 21031 raft_consensus.cc:515] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:36.583037 21187 raft_consensus.cc:493] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:36.591802 21108 raft_consensus.cc:2749] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:36.593848 20774 raft_consensus.cc:2804] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:36.585975 20768 raft_consensus.cc:697] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 18 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:36.614095 20891 leader_election.cc:290] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 21 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:36.614830 21180 leader_election.cc:290] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 21 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:36.622637 21187 raft_consensus.cc:3060] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:12:36.625121 21171 log.cc:927] Time spent T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.848s	user 0.005s	sys 0.001s
I20260709 12:12:36.634063 21085 leader_election.cc:290] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 24 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:36.636425 21132 leader_election.cc:290] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 22 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:36.639210 21031 leader_election.cc:290] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:36.640848 20964 raft_consensus.cc:515] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:36.615448 21052 raft_consensus.cc:515] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } }
I20260709 12:12:36.643769 21052 leader_election.cc:290] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:36.615265 21182 raft_consensus.cc:515] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:36.646983 21182 leader_election.cc:290] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:36.629827 21084 leader_election.cc:290] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:36.658761 21036 raft_consensus.cc:515] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:36.661424 21036 leader_election.cc:290] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:36.512030 14155 leader_election.cc:304] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
W20260709 12:12:36.767377 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 255281us
I20260709 12:12:36.716194 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:36.714135 14189 raft_consensus.cc:1275] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 15. (term mismatch)
I20260709 12:12:36.721125 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:36.769971 14189 pending_rounds.cc:85] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf: Aborting all ops after (but not including) 14
I20260709 12:12:36.769809 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:36.770350 14189 pending_rounds.cc:107] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf: Aborting uncommitted NO_OP operation due to leader change: 20.15
I20260709 12:12:36.770776 14189 raft_consensus.cc:2889] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:36.771497 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:36.771960 14257 raft_consensus.cc:2393] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db in current term 24: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:12:36.772379 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:36.732133 14186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56652 (request call id 1622) took 1300 ms. Trace:
W20260709 12:12:36.474470 14229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:36.729482 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
W20260709 12:12:36.524745 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:36.774001 14185 raft_consensus.cc:2368] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for earlier term 21. Current term is 22.
I20260709 12:12:36.774997 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:36.775679 21036 raft_consensus.cc:493] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:36.776292 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:36.594869 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:36.586783 14334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50856 (request call id 2933) took 1183 ms. Trace:
I20260709 12:12:36.554708 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
W20260709 12:12:36.779842 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 236708us
I20260709 12:12:36.781066 14303 leader_election.cc:304] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:36.603176 14335 raft_consensus.cc:3060] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:36.604235 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:36.787075 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:36.788242 14189 raft_consensus.cc:3060] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:36.558619 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:36.599126 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 18 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:36.790489 14336 raft_consensus.cc:2368] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 17. Current term is 18.
I20260709 12:12:36.598016 14908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59144 (request call id 731) took 1141 ms. Trace:
I20260709 12:12:36.611775 14877 leader_election.cc:304] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:12:36.607514 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:36.746989 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:36.794421 20871 raft_consensus.cc:2804] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:36.795034 20871 raft_consensus.cc:493] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:36.795469 20871 raft_consensus.cc:3060] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:36.791646 14908 rpcz_store.cc:276] 0709 12:12:35.452082 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:35.452210 (+   128us) service_pool.cc:224] Handling call
0709 12:12:35.452553 (+   343us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:35.452912 (+   359us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:35.452943 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:35.468423 (+ 15480us) log.cc:844] Serialized 26 byte log entry
0709 12:12:35.641223 (+172800us) raft_consensus.cc:1645] Marking committed up to 16
0709 12:12:35.641649 (+   426us) log.cc:844] Serialized 14 byte log entry
0709 12:12:35.693927 (+ 52278us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:35.694007 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:36.247291 (+553284us) spinlock_profiling.cc:243] Waited 7.11 ms on lock 0x7b4400022b4c. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2123f74c85 00007f2123f756a2 00007f2126ce71db 00007f2126ce2aaf 00007f2126cd686e 00007f2126cd5bb6 00007f2126cd57d8 00007f2126cdf221 00007f2126cdf1d9 00007f2126cdf169
0709 12:12:36.586776 (+339485us) raft_consensus.cc:1685] finished
0709 12:12:36.593299 (+  6523us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:36.593476 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":51875,"prepare.queue_time_us":197,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":62,"raft.queue_time_us":165234,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":8384,"spinlock_wait_cycles":34998272,"thread_start_us":101461,"threads_started":1,"wal-append.queue_time_us":280453}
I20260709 12:12:36.777467 14334 rpcz_store.cc:276] 0709 12:12:35.403457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:35.605817 (+202360us) service_pool.cc:224] Handling call
0709 12:12:35.627242 (+ 21425us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:36.239888 (+612646us) spinlock_profiling.cc:243] Waited 11.4 ms on lock 0x7b4800100bd8. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f212c064aa1 00007f212c05bb37 00007f212c05b9ca 00007f212c15326f 00007f212c152f37 00007f212c16755c 00007f212c167508 00007f212c167488 00007f212c167443 00007f212c1666ec 00007f212b090a96
0709 12:12:36.361512 (+121624us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:36.361547 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:36.362110 (+   563us) log.cc:844] Serialized 26 byte log entry
0709 12:12:36.435397 (+ 73287us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:12:36.435435 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:36.437314 (+  1879us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:36.577402 (+140088us) raft_consensus.cc:1685] finished
0709 12:12:36.577425 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:36.586683 (+  9258us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":568949,"raft.queue_time_us":582279,"raft.run_cpu_time_us":2383,"raft.run_wall_time_us":30096,"spinlock_wait_cycles":26322688,"thread_start_us":236830,"threads_started":2,"wal-append.queue_time_us":132433}
I20260709 12:12:36.754678 14256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41764 (request call id 3525) took 1609 ms. Trace:
W20260709 12:12:36.755955 14228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:36.626029 20774 raft_consensus.cc:493] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:36.805050 20774 raft_consensus.cc:3060] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:36.808722 21207 raft_consensus.cc:493] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
W20260709 12:12:36.792552 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 180722us
I20260709 12:12:36.772964 14186 rpcz_store.cc:276] 0709 12:12:35.431373 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:35.431552 (+   179us) service_pool.cc:224] Handling call
0709 12:12:36.731580 (+1300028us) spinlock_profiling.cc:243] Waited 986 ms on lock 0x7b54003e8354. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:12:36.731899 (+   319us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2268072704}
W20260709 12:12:36.757098 20953 consensus_meta.cc:287] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.526s	user 0.009s	sys 0.004s
I20260709 12:12:36.810961 20953 raft_consensus.cc:515] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:36.811474 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 18 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:36.767516 21132 raft_consensus.cc:2804] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:36.813999 21132 raft_consensus.cc:493] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:36.814532 21132 raft_consensus.cc:3060] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:36.719389 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:36.819036 20964 leader_election.cc:290] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:12:36.820782 21211 log.cc:927] Time spent T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.150s	user 0.000s	sys 0.001s
I20260709 12:12:36.825568 20767 leader_election.cc:290] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:36.826210 21189 consensus_queue.cc:1059] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:12:36.828183 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:36.809614 21207 raft_consensus.cc:515] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:36.800236 14256 rpcz_store.cc:276] 0709 12:12:35.145346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:35.145511 (+   165us) service_pool.cc:224] Handling call
0709 12:12:35.145916 (+   405us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:35.158925 (+ 13009us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:12:35.181960 (+ 23035us) log.cc:844] Serialized 14 byte log entry
0709 12:12:35.234711 (+ 52751us) spinlock_profiling.cc:243] Waited 20.3 ms on lock 0x7b180028d9e0. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f212cf16ab1 00007f212cf23281 00007f2124030e07 00007f212ce8b9a9 00007f212404d69b 00007f212404b93f 00007f212404dc02 00007f2126cd520b 00007f2126cdad23 00007f2126cdb23a 00007f2127145a2a
0709 12:12:35.491571 (+256860us) spinlock_profiling.cc:243] Waited 20.7 ms on lock 0x7b180028d9e0. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f212cf16ab1 00007f212cf23281 00007f212404e3f3 00007f21240507c1 00007f2124050779 00007f2124050709 00007f21240506d1 00007f212404f9cd 0000000000388634 0000000000388479 00007f212403183a
0709 12:12:35.566706 (+ 75135us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:35.572899 (+  6193us) log.cc:844] Serialized 26 byte log entry
0709 12:12:35.573113 (+   214us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:12:35.573149 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:35.573224 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:36.553220 (+979996us) spinlock_profiling.cc:243] Waited 5.92 ms on lock 0x7b4400022b4c. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2123f74c85 00007f2123f756a2 00007f2126ce71db 00007f2126ce2aaf 00007f2126cd686e 00007f2126cd5bb6 00007f2126cd57d8 00007f2126cdf221 00007f2126cdf1d9 00007f2126cdf169
0709 12:12:36.753957 (+200737us) raft_consensus.cc:1685] finished
0709 12:12:36.754006 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:36.754378 (+   372us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43305,"prepare.queue_time_us":26051,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":21326,"raft.queue_time_us":26903,"raft.run_cpu_time_us":295,"raft.run_wall_time_us":35009,"spinlock_wait_cycles":108034432,"thread_start_us":297358,"threads_started":1,"wal-append.queue_time_us":470677}
I20260709 12:12:36.792421 20768 consensus_queue.cc:237] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:36.752202 20944 raft_consensus.cc:515] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:36.776468 21036 raft_consensus.cc:515] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:36.777557 14265 raft_consensus.cc:3060] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:36.772619 14188 raft_consensus.cc:2393] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 18: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:12:36.836951 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:36.836190 21207 leader_election.cc:290] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:36.854117 14908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
W20260709 12:12:36.826238 14083 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44116 (request call id 162) took 13910 ms (client timeout 15000 ms). Trace:
I20260709 12:12:36.833719 14183 raft_consensus.cc:2468] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 15.
I20260709 12:12:36.867780 21187 raft_consensus.cc:515] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:36.870227 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:36.871284 14906 raft_consensus.cc:2393] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 24: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
I20260709 12:12:36.872575 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:36.872915 21187 leader_election.cc:290] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 23 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:36.882372 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:36.891652 21036 leader_election.cc:290] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:36.895948 14154 leader_election.cc:304] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:36.892189 14190 raft_consensus.cc:3060] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Advancing to term 24
W20260709 12:12:36.904773 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 123935us
I20260709 12:12:36.870390 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:36.869449 14188 raft_consensus.cc:1240] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:36.918059 14185 raft_consensus.cc:2393] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 17: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:12:36.877590 20774 raft_consensus.cc:515] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:36.890403 21031 raft_consensus.cc:493] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
W20260709 12:12:36.935161 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 44816.9us
I20260709 12:12:36.935725 21031 raft_consensus.cc:515] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:36.936261 14339 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50858 (request call id 2422) took 1244 ms. Trace:
I20260709 12:12:36.936700 21036 raft_consensus.cc:493] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:36.937605 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:36.928309 14910 raft_consensus.cc:3060] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:36.927320 14264 raft_consensus.cc:2468] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 21.
I20260709 12:12:36.934800 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:36.935725 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:36.951133 14339 rpcz_store.cc:276] 0709 12:12:35.691732 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:36.016459 (+324727us) service_pool.cc:224] Handling call
0709 12:12:36.249937 (+233478us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:36.407069 (+157132us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:36.935826 (+528757us) spinlock_profiling.cc:243] Waited 233 ms on lock 0x7b540010d6d0. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713a8ad 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:12:36.936054 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":536179200}
I20260709 12:12:36.953877 14256 raft_consensus.cc:3060] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:36.953603 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:36.969156 14188 raft_consensus.cc:1275] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 12:12:36.930313 21175 raft_consensus.cc:2749] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:36.951198 20953 leader_election.cc:290] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 23 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:36.987731 14303 leader_election.cc:304] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:12:36.967140 21132 raft_consensus.cc:515] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:36.990159 14229 leader_election.cc:304] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:12:36.991281 20948 raft_consensus.cc:515] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:36.992431 21031 leader_election.cc:290] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:36.994318 14182 raft_consensus.cc:1240] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 24 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 23. Current term is 24. Ops: [23.11-23.11]
I20260709 12:12:36.997911 21036 raft_consensus.cc:515] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:37.001355 21036 leader_election.cc:290] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:37.007555 14256 raft_consensus.cc:2468] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 22.
I20260709 12:12:36.990573 14335 raft_consensus.cc:2468] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 22.
I20260709 12:12:37.024956 14154 leader_election.cc:304] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:37.028750 14304 leader_election.cc:304] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:12:37.029076 20774 leader_election.cc:290] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 19 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:37.029883 14904 raft_consensus.cc:2368] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 18. Current term is 19.
I20260709 12:12:37.038971 14337 raft_consensus.cc:2468] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 14.
W20260709 12:12:37.044497 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 60865.3us
I20260709 12:12:37.045953 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:37.046262 21182 raft_consensus.cc:2764] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Leader election decision vote started in defunct term 21: won
W20260709 12:12:37.046710 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 46196.8us
I20260709 12:12:37.051252 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:37.023640 20871 raft_consensus.cc:515] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:37.052708 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:37.053453 14260 raft_consensus.cc:2468] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 18.
I20260709 12:12:37.021867 20948 leader_election.cc:290] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 24 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:37.054533 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:37.055461 14260 raft_consensus.cc:3060] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:37.058079 14336 raft_consensus.cc:3060] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:37.062945 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:37.043716 20767 raft_consensus.cc:2804] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:12:37.046311 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:37.068136 14339 raft_consensus.cc:2410] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for term 19 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 12:12:37.072315 14260 raft_consensus.cc:2468] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 19.
I20260709 12:12:37.073137 14265 raft_consensus.cc:2468] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 18.
W20260709 12:12:37.046452 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 64859.4us
I20260709 12:12:37.086575 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:37.088585 14256 raft_consensus.cc:1240] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 17. Current term is 18. Ops: []
W20260709 12:12:37.090412 14154 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 119284us
I20260709 12:12:37.091912 20979 consensus_queue.cc:1059] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:37.092672 14154 leader_election.cc:304] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
W20260709 12:12:36.862540 14083 rpcz_store.cc:269] 0709 12:12:22.915517 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:22.915720 (+   203us) service_pool.cc:224] Handling call
0709 12:12:23.144778 (+229058us) spinlock_profiling.cc:243] Waited 2.56 ms on lock 0x7b54002e3454. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a5090 00007f2127143f3a 00007f212cef9e9c 00007f212cff804e 00007f212b4b92a4 00007f212b4b9232 00007f212b4b9161 00007f212b4b90dc 00007f212b4b8392 00007f212547648c 00007f21254758c6
0709 12:12:36.789622 (+13644844us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:12:30.786440 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:12:30.787161 (+   721us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:12:30.787218 (+    57us) write_op.cc:435] Acquired schema lock
0709 12:12:30.787238 (+    20us) tablet.cc:662] Decoding operations
0709 12:12:30.950744 (+163506us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:12:30.950873 (+   129us) write_op.cc:641] Partition lock acquired for write op
0709 12:12:30.950903 (+    30us) tablet.cc:685] Acquiring locks for 19 operations
0709 12:12:30.952411 (+  1508us) tablet.cc:701] Row locks acquired
0709 12:12:30.952460 (+    49us) write_op.cc:260] PREPARE: finished
0709 12:12:30.952659 (+   199us) write_op.cc:270] Start()
0709 12:12:30.952819 (+   160us) write_op.cc:276] Timestamp: P: 1783599150952574 usec, L: 0
0709 12:12:30.952851 (+    32us) op_driver.cc:348] REPLICATION: starting
0709 12:12:30.982823 (+ 29972us) log.cc:844] Serialized 7548 byte log entry
0709 12:12:31.994907 (+1012084us) op_driver.cc:464] REPLICATION: finished
0709 12:12:32.175578 (+180671us) write_op.cc:301] APPLY: starting
0709 12:12:32.175689 (+   111us) tablet.cc:1367] starting BulkCheckPresence
0709 12:12:32.314032 (+138343us) tablet.cc:1370] finished BulkCheckPresence
0709 12:12:32.314202 (+   170us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:12:32.383167 (+ 68965us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:12:32.436889 (+ 53722us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=38,key_file_lookups=38,delta_file_lookups=38,mrs_lookups=0
0709 12:12:32.439413 (+  2524us) write_op.cc:312] APPLY: finished
0709 12:12:32.539242 (+ 99829us) log.cc:844] Serialized 172 byte log entry
0709 12:12:32.545661 (+  6419us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:32.556775 (+ 11114us) write_op.cc:454] Released schema lock
0709 12:12:32.571728 (+ 14953us) write_op.cc:341] FINISH: Updating metrics
0709 12:12:32.587307 (+ 15579us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:32.587348 (+    41us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1732296,"reported_tablets":28,"spinlock_wait_cycles":5882752,"child_traces":[["op",{"apply.queue_time_us":180357,"apply.run_cpu_time_us":29068,"apply.run_wall_time_us":411687,"cfile_cache_hit":78,"cfile_cache_hit_bytes":83699,"num_ops":19,"prepare.queue_time_us":183769,"prepare.run_cpu_time_us":68239,"prepare.run_wall_time_us":355099,"raft.queue_time_us":561909,"raft.run_cpu_time_us":23844,"raft.run_wall_time_us":173987,"replication_time_us":1041870,"spinlock_wait_cycles":64384,"thread_start_us":819947,"threads_started":4,"wal-append.queue_time_us":237214,"wal-append.run_cpu_time_us":22420,"wal-append.run_wall_time_us":2331567}]]}
I20260709 12:12:37.092025 14260 raft_consensus.cc:1275] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 12:12:37.076268 20944 leader_election.cc:290] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:37.063434 21031 raft_consensus.cc:2804] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader election won for term 18
W20260709 12:12:37.082003 14156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:37.082470 14331 raft_consensus.cc:1275] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 12:12:37.039376 21189 raft_consensus.cc:3055] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:12:37.083281 14188 raft_consensus.cc:1240] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:37.084110 21175 raft_consensus.cc:2749] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 12:12:37.074546 21037 consensus_meta.cc:287] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.598s	user 0.010s	sys 0.007s
I20260709 12:12:37.098071 14189 raft_consensus.cc:2468] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 18.
I20260709 12:12:37.075230 14876 leader_election.cc:304] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
W20260709 12:12:37.129124 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 99250.7us
I20260709 12:12:37.102736 14190 raft_consensus.cc:2468] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 24.
I20260709 12:12:37.131395 14189 raft_consensus.cc:1240] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:37.115541 20948 raft_consensus.cc:2749] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:37.133303 14256 raft_consensus.cc:1240] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 16. Current term is 17. Ops: [16.14-16.14]
I20260709 12:12:37.082208 20995 leader_election.cc:290] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:37.129812 21037 raft_consensus.cc:515] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:37.141096 14256 raft_consensus.cc:1240] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:37.142541 21037 leader_election.cc:290] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:37.125439 21189 raft_consensus.cc:740] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
W20260709 12:12:37.159454 21184 log.cc:927] Time spent T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
W20260709 12:12:37.160404 20691 consensus_meta.cc:287] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.585s	user 0.005s	sys 0.014s
I20260709 12:12:37.160962 20691 raft_consensus.cc:515] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:37.161484 21109 consensus_queue.cc:260] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:37.162891 21109 raft_consensus.cc:3060] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:37.163784 20691 leader_election.cc:290] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 23 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:37.134270 20871 leader_election.cc:290] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 19 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:12:37.185317 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 110229us
I20260709 12:12:37.197118 14189 raft_consensus.cc:1275] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:12:37.157598 21031 raft_consensus.cc:697] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 18 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:37.219344 21207 raft_consensus.cc:2804] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:37.221578 20871 raft_consensus.cc:493] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:37.217334 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
W20260709 12:12:37.221943 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 253885us
I20260709 12:12:37.229508 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:37.229470 14331 raft_consensus.cc:1240] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:37.240361 14188 raft_consensus.cc:3060] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:37.246752 14336 raft_consensus.cc:2468] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 22.
I20260709 12:12:37.222138 14877 leader_election.cc:304] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:12:37.245139 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:37.222350 20871 raft_consensus.cc:515] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:37.250444 14910 raft_consensus.cc:2468] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 19.
W20260709 12:12:37.251418 14154 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 158905us
I20260709 12:12:37.272254 20871 leader_election.cc:290] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:37.222591 21034 raft_consensus.cc:2749] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:12:37.273921 21168 raft_consensus.cc:2804] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:12:37.274732 21168 raft_consensus.cc:697] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [term 15 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:12:37.275326 20871 consensus_queue.cc:1048] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:12:37.276048 21168 consensus_queue.cc:237] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:37.221701 21207 raft_consensus.cc:697] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 18 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:37.274312 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:37.278057 21207 consensus_queue.cc:237] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:12:37.282409 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 66568.1us
I20260709 12:12:37.282574 21169 raft_consensus.cc:2764] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260709 12:12:37.284399 14877 leader_election.cc:304] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:37.285964 14230 leader_election.cc:304] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:37.286217 21162 raft_consensus.cc:2749] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:37.287360 20916 raft_consensus.cc:3060] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:12:37.287534 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 67792.1us
I20260709 12:12:37.290153 20975 consensus_queue.cc:1048] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:12:37.291570 20934 leader_election.cc:290] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:37.294358 14181 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56046 (request call id 3007) took 1828 ms. Trace:
I20260709 12:12:37.294776 14905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53194 (request call id 1178) took 1848 ms. Trace:
I20260709 12:12:37.295221 14905 rpcz_store.cc:276] 0709 12:12:35.446345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:35.446485 (+   140us) service_pool.cc:224] Handling call
0709 12:12:37.294335 (+1847850us) spinlock_profiling.cc:243] Waited 245 ms on lock 0x7b5400748e54. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:12:37.294545 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":563914112}
I20260709 12:12:37.293772 21031 consensus_queue.cc:237] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:37.294816 14181 rpcz_store.cc:276] 0709 12:12:35.467919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:35.598878 (+130959us) service_pool.cc:224] Handling call
0709 12:12:35.613234 (+ 14356us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:36.729376 (+1116142us) spinlock_profiling.cc:243] Waited 4.48 ms on lock 0x7b18003b5c60. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f212cf16ab1 00007f212cf23281 00007f2126ce34bc 00007f212403148b 00007f212ce8b9a9 00007f212404d69b 00007f212404b93f 00007f212404b455 00007f2127133060 00007f2127133bfb 00007f212713e64b
0709 12:12:36.729683 (+   307us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:36.729712 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:36.850432 (+120720us) log.cc:844] Serialized 26 byte log entry
0709 12:12:37.173791 (+323359us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:37.213287 (+ 39496us) log.cc:844] Serialized 14 byte log entry
0709 12:12:37.219458 (+  6171us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:37.219558 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:37.293824 (+ 74266us) raft_consensus.cc:1685] finished
0709 12:12:37.293963 (+   139us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:37.294141 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2406,"prepare.queue_time_us":35941,"raft.queue_time_us":280072,"raft.run_cpu_time_us":342,"raft.run_wall_time_us":18519,"spinlock_wait_cycles":22345344,"thread_start_us":547856,"threads_started":2,"wal-append.queue_time_us":321318}
I20260709 12:12:37.304327 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:37.305130 14181 raft_consensus.cc:2468] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 17.
I20260709 12:12:37.305528 14909 raft_consensus.cc:1240] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 21 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 20. Current term is 21. Ops: [20.15-20.15]
I20260709 12:12:37.306141 14229 leader_election.cc:304] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:12:37.307529 14909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53200 (request call id 900) took 1433 ms. Trace:
I20260709 12:12:37.307996 14909 rpcz_store.cc:276] 0709 12:12:35.874122 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:35.874638 (+   516us) service_pool.cc:224] Handling call
0709 12:12:37.304943 (+1430305us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:37.306111 (+  1168us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:37.307242 (+  1131us) spinlock_profiling.cc:243] Waited 1.42 s on lock 0x7b5400748e50. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713a8ad 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:12:37.307429 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3271182720}
I20260709 12:12:37.310019 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:37.308040 14229 leader_election.cc:304] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:37.319181 14189 raft_consensus.cc:3060] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:12:37.323544 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:37.325028 14876 leader_election.cc:304] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:37.330083 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:37.330933 14877 leader_election.cc:304] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:37.339359 14263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41768 (request call id 2435) took 1699 ms. Trace:
I20260709 12:12:37.345722 21085 consensus_queue.cc:1059] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.021s
I20260709 12:12:37.347910 14154 leader_election.cc:304] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:37.351194 20767 raft_consensus.cc:493] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:37.351743 20767 raft_consensus.cc:3060] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:12:37.354113 20962 raft_consensus.cc:2804] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:12:37.354674 20962 raft_consensus.cc:493] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:37.355067 20962 raft_consensus.cc:3060] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:37.356775 14258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41768 (request call id 2439) took 1688 ms. Trace:
I20260709 12:12:37.357232 14258 rpcz_store.cc:276] 0709 12:12:35.669351 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:35.784453 (+115102us) service_pool.cc:224] Handling call
0709 12:12:35.784776 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:36.444966 (+660190us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:37.356275 (+911309us) spinlock_profiling.cc:243] Waited 575 ms on lock 0x7b5400210a54. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:12:37.356590 (+   315us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1323645312}
I20260709 12:12:37.358397 14259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53050 (request call id 1344) took 2176 ms. Trace:
I20260709 12:12:37.358804 14259 rpcz_store.cc:276] 0709 12:12:35.181824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:35.189657 (+  7833us) service_pool.cc:224] Handling call
0709 12:12:37.357943 (+2168286us) spinlock_profiling.cc:243] Waited 968 ms on lock 0x7b54004088d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:12:37.358184 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2227196160}
I20260709 12:12:37.363770 14187 raft_consensus.cc:1275] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
W20260709 12:12:37.365971 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 180564us
I20260709 12:12:37.366565 20979 raft_consensus.cc:2804] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:37.367991 14155 leader_election.cc:304] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:37.369899 21176 raft_consensus.cc:2749] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:37.371003 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:37.371599 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:37.372329 14331 raft_consensus.cc:3060] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:37.372749 14257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53050 (request call id 1352) took 1080 ms. Trace:
I20260709 12:12:37.372969 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:37.373601 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:37.372514 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:37.374689 14330 raft_consensus.cc:2393] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 24: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
I20260709 12:12:37.374866 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:37.375846 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:12:37.379143 21203 log.cc:927] Time spent T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.775s	user 0.003s	sys 0.000s
I20260709 12:12:37.382827 14331 raft_consensus.cc:2468] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 19.
I20260709 12:12:37.386119 14186 raft_consensus.cc:1240] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:37.373049 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:37.369668 14155 leader_election.cc:304] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
W20260709 12:12:37.407008 14262 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41768 (request call id 2440) took 1729 ms (client timeout 2212 ms). Trace:
I20260709 12:12:37.391700 14257 rpcz_store.cc:276] 0709 12:12:36.292771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:36.423763 (+130992us) service_pool.cc:224] Handling call
0709 12:12:37.372481 (+948718us) spinlock_profiling.cc:243] Waited 270 ms on lock 0x7b5400101b54. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:12:37.372656 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":620121344}
I20260709 12:12:37.294967 21189 consensus_queue.cc:260] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:37.336441 20975 raft_consensus.cc:2804] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:37.333710 21169 raft_consensus.cc:2804] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 12:12:37.407601 14262 rpcz_store.cc:269] 0709 12:12:35.677190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:35.678601 (+  1411us) service_pool.cc:224] Handling call
0709 12:12:37.321526 (+1642925us) spinlock_profiling.cc:243] Waited 176 ms on lock 0x7b54003818d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:12:37.406772 (+ 85246us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":404041088}
I20260709 12:12:37.421011 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:37.422091 14339 raft_consensus.cc:3060] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:37.404884 14188 raft_consensus.cc:2468] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 19.
I20260709 12:12:37.430620 14334 raft_consensus.cc:2468] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 21.
I20260709 12:12:37.432278 21036 raft_consensus.cc:3055] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:37.432794 21036 raft_consensus.cc:740] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
W20260709 12:12:37.435374 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 65865.3us
I20260709 12:12:37.434022 20962 raft_consensus.cc:515] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:37.482023 21036 consensus_queue.cc:260] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:37.339903 14263 rpcz_store.cc:276] 0709 12:12:35.618456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:35.631092 (+ 12636us) service_pool.cc:224] Handling call
0709 12:12:35.631476 (+   384us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:12:35.905380 (+273904us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:35.905412 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:12:35.912842 (+  7430us) log.cc:844] Serialized 52 byte log entry
0709 12:12:36.060446 (+147604us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:36.322498 (+262052us) log.cc:844] Serialized 14 byte log entry
0709 12:12:36.322910 (+   412us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:36.784655 (+461745us) spinlock_profiling.cc:243] Waited 10.8 ms on lock 0x7b1800493180. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f212cf16ab1 00007f212cf23281 00007f212401c2a6 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419
0709 12:12:37.220359 (+435704us) spinlock_profiling.cc:243] Waited 273 ms on lock 0x7b540022abd4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:12:37.220435 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:37.238164 (+ 17729us) raft_consensus.cc:1685] finished
0709 12:12:37.244421 (+  6257us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:37.317836 (+ 73415us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":369635,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":3186,"raft.queue_time_us":712,"raft.run_cpu_time_us":303,"raft.run_wall_time_us":20946,"spinlock_wait_cycles":653838080,"thread_start_us":300178,"threads_started":2,"wal-append.queue_time_us":218887}
I20260709 12:12:37.484278 21036 raft_consensus.cc:3060] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:37.486503 14155 leader_election.cc:400] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 election: Vote denied by peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673) with higher term. Message: Invalid argument: T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 17. Current term is 18.
I20260709 12:12:37.486949 14155 leader_election.cc:403] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 12:12:37.481392 20962 leader_election.cc:290] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 22 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:37.423875 21169 raft_consensus.cc:493] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:37.482033 21122 raft_consensus.cc:3060] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:12:37.506035 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 183963us
I20260709 12:12:37.490638 21187 raft_consensus.cc:2804] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:37.505697 14876 leader_election.cc:304] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:37.425100 20691 raft_consensus.cc:493] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:37.520699 21201 raft_consensus.cc:493] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:12:37.521479 21201 raft_consensus.cc:515] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:37.524478 21201 leader_election.cc:290] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:37.524724 14155 leader_election.cc:304] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:37.506234 21169 raft_consensus.cc:3060] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:37.504617 20944 raft_consensus.cc:2749] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673) with higher term. Message: Invalid argument: T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 17. Current term is 18.
I20260709 12:12:37.519737 14339 raft_consensus.cc:2468] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 24.
I20260709 12:12:37.509332 20979 raft_consensus.cc:493] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
W20260709 12:12:37.538493 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 230557us
I20260709 12:12:37.516834 20953 raft_consensus.cc:493] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:37.537619 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:37.515039 21187 raft_consensus.cc:493] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:37.540792 21037 raft_consensus.cc:2749] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:37.544546 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:37.544054 14181 raft_consensus.cc:1240] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:37.543926 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:37.547678 14230 leader_election.cc:304] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:37.549304 14186 raft_consensus.cc:2468] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 21.
W20260709 12:12:37.555433 21229 log.cc:927] Time spent T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.223s	user 0.000s	sys 0.002s
I20260709 12:12:37.539625 21201 raft_consensus.cc:2804] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:37.560776 14304 leader_election.cc:304] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:12:37.544073 21187 raft_consensus.cc:3060] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:37.563073 21031 consensus_queue.cc:1059] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 18.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:12:37.564101 21031 raft_consensus.cc:2749] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:37.564473 21182 raft_consensus.cc:2804] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:37.564821 21031 raft_consensus.cc:3055] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:37.541654 20979 raft_consensus.cc:3060] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:37.520815 20691 raft_consensus.cc:515] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:37.570552 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:37.572016 14189 raft_consensus.cc:2468] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 19.
I20260709 12:12:37.575361 14338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 1357) took 1275 ms. Trace:
I20260709 12:12:37.575866 14338 rpcz_store.cc:276] 0709 12:12:36.300120 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:36.425510 (+125390us) service_pool.cc:224] Handling call
0709 12:12:36.425904 (+   394us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:36.462271 (+ 36367us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:12:36.556631 (+ 94360us) log.cc:844] Serialized 14 byte log entry
0709 12:12:36.755787 (+199156us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:36.755911 (+   124us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:36.756031 (+   120us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:37.574891 (+818860us) spinlock_profiling.cc:243] Waited 36.1 ms on lock 0x7b540001a754. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:12:37.574949 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:37.575135 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":699,"prepare.queue_time_us":50527,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":54,"raft.queue_time_us":4437,"raft.run_cpu_time_us":193,"raft.run_wall_time_us":716,"spinlock_wait_cycles":83017088,"thread_start_us":262261,"threads_started":2,"wal-append.queue_time_us":76270}
I20260709 12:12:37.586006 21129 raft_consensus.cc:493] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:37.586850 21129 raft_consensus.cc:515] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:37.565599 14303 leader_election.cc:304] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:37.520747 20767 raft_consensus.cc:515] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:37.604949 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:37.606019 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:37.600140 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:37.599967 14877 leader_election.cc:304] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:37.570942 20975 raft_consensus.cc:697] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 19 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:37.565232 21031 raft_consensus.cc:740] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:37.552482 20953 raft_consensus.cc:515] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:12:37.623540 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 58037.3us
W20260709 12:12:37.624177 21234 log.cc:927] Time spent T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 12:12:37.638582 14904 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53200 (request call id 904) took 1048 ms. Trace:
I20260709 12:12:37.623967 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:37.639129 14904 rpcz_store.cc:276] 0709 12:12:36.590098 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:36.590287 (+   189us) service_pool.cc:224] Handling call
0709 12:12:37.638333 (+1048046us) spinlock_profiling.cc:243] Waited 357 ms on lock 0x7b54005e0e54. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:12:37.638492 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":822015744}
I20260709 12:12:37.631740 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:37.610188 21201 raft_consensus.cc:697] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 19 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:12:37.641860 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:37.649255 14154 leader_election.cc:400] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 14 election: Vote denied by peer 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341) with higher term. Message: Invalid argument: T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 14. Current term is 15.
W20260709 12:12:37.649442 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 124862us
I20260709 12:12:37.651548 14154 leader_election.cc:403] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 12:12:37.654736 14909 raft_consensus.cc:2468] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 21.
I20260709 12:12:37.655167 21168 raft_consensus.cc:2749] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:37.681195 14154 leader_election.cc:304] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:37.689936 20962 raft_consensus.cc:2764] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260709 12:12:37.693668 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:37.695927 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:37.698732 21129 leader_election.cc:290] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:37.701299 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:12:37.702935 21221 log.cc:927] Time spent T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.152s	user 0.001s	sys 0.000s
I20260709 12:12:37.703284 14229 leader_election.cc:400] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 pre-election: Vote denied by peer 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341) with higher term. Message: Invalid argument: T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 18. Current term is 19.
I20260709 12:12:37.703672 14229 leader_election.cc:403] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:12:37.704396 21085 raft_consensus.cc:3060] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Advancing to term 19
W20260709 12:12:37.704555 21233 log.cc:927] Time spent T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.059s	user 0.000s	sys 0.002s
I20260709 12:12:37.710731 14229 leader_election.cc:304] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:12:37.711062 20953 leader_election.cc:290] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:37.712230 14229 leader_election.cc:304] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:37.680882 21109 raft_consensus.cc:2749] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:37.729724 21201 consensus_queue.cc:237] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:37.731438 14229 leader_election.cc:304] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:37.740726 21132 leader_election.cc:290] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 20 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:37.721984 21085 raft_consensus.cc:2749] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341) with higher term. Message: Invalid argument: T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 18. Current term is 19.
W20260709 12:12:37.726096 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 155460us
I20260709 12:12:37.727144 21137 consensus_queue.cc:1048] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:12:37.746647 14877 leader_election.cc:304] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:37.748116 14877 leader_election.cc:304] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:12:37.653798 20975 consensus_queue.cc:237] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:37.755316 14183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56046 (request call id 3024) took 1051 ms. Trace:
I20260709 12:12:37.661068 21037 raft_consensus.cc:2749] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341) with higher term. Message: Invalid argument: T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 14. Current term is 15.
I20260709 12:12:37.755736 14183 rpcz_store.cc:276] 0709 12:12:36.704104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:36.942902 (+238798us) service_pool.cc:224] Handling call
0709 12:12:36.943344 (+   442us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:36.943910 (+   566us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:36.943944 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:36.944671 (+   727us) log.cc:844] Serialized 26 byte log entry
0709 12:12:37.125975 (+181304us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:12:37.126044 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:37.126200 (+   156us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:37.755077 (+628877us) raft_consensus.cc:1685] finished
0709 12:12:37.755099 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:37.755251 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1567,"raft.run_cpu_time_us":276,"raft.run_wall_time_us":14789,"thread_start_us":180638,"threads_started":1,"wal-append.queue_time_us":558853}
I20260709 12:12:37.785928 21006 raft_consensus.cc:2749] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:37.749629 21187 raft_consensus.cc:515] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:12:37.809197 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 167815us
I20260709 12:12:37.829926 14907 raft_consensus.cc:1240] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 17 LEADER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:37.818216 20767 leader_election.cc:290] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 15 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:37.776986 21031 consensus_queue.cc:260] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:37.802239 21182 raft_consensus.cc:697] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 18 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:37.822738 20891 raft_consensus.cc:2804] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:12:37.823031 21223 raft_consensus.cc:2804] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:12:37.825856 20691 leader_election.cc:290] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:37.838548 21223 raft_consensus.cc:697] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 24 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:12:37.839591 21223 consensus_queue.cc:237] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:37.806675 21085 raft_consensus.cc:2749] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:12:37.817572 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 275412us
I20260709 12:12:37.835696 21056 raft_consensus.cc:2749] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:37.836557 21182 consensus_queue.cc:237] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:37.846235 21169 raft_consensus.cc:515] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:12:37.846946 21242 log.cc:927] Time spent T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 12:12:37.847982 14155 leader_election.cc:304] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:37.851281 14303 leader_election.cc:400] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 21 election: Vote denied by peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187) with higher term. Message: Invalid argument: T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for earlier term 21. Current term is 22.
I20260709 12:12:37.833833 20891 raft_consensus.cc:493] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:37.851008 14230 leader_election.cc:304] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
W20260709 12:12:37.851617 20916 consensus_meta.cc:287] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.562s	user 0.008s	sys 0.007s
I20260709 12:12:37.860327 20916 raft_consensus.cc:2749] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:37.862214 14261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41764 (request call id 3538) took 1313 ms. Trace:
I20260709 12:12:37.862669 14261 rpcz_store.cc:276] 0709 12:12:36.535795 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:36.536862 (+  1067us) service_pool.cc:224] Handling call
0709 12:12:36.537204 (+   342us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:12:36.537639 (+   435us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:36.537669 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:12:36.547481 (+  9812us) log.cc:844] Serialized 52 byte log entry
0709 12:12:36.930442 (+382961us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:12:36.931045 (+   603us) log.cc:844] Serialized 14 byte log entry
0709 12:12:36.966395 (+ 35350us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:36.972147 (+  5752us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:37.104271 (+132124us) spinlock_profiling.cc:243] Waited 4.29 ms on lock 0x7b48001b0258. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f212c064aa1 00007f212c05bb37 00007f212c05b9ca 00007f212c15326f 00007f212c152f37 00007f212c16755c 00007f212c167508 00007f212c167488 00007f212c167443 00007f212c1666ec 00007f212b090a96
0709 12:12:37.847622 (+743351us) spinlock_profiling.cc:243] Waited 48.4 ms on lock 0x7b540006aca0. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f21270b0dbe 00007f21270bb930 00007f21270bb8d8 00007f21270bb858 00007f21270bb813 00007f21270baa9c 00007f212cfa62f6 00007f212cfa0aa8 00007f21270f77cb 00007f21270fa2c0
0709 12:12:37.849019 (+  1397us) raft_consensus.cc:1685] finished
0709 12:12:37.849041 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:37.849202 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27738,"prepare.queue_time_us":2323,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":36619,"raft.run_cpu_time_us":3649,"raft.run_wall_time_us":653204,"spinlock_wait_cycles":121217536,"thread_start_us":262509,"threads_started":1,"wal-append.queue_time_us":298203}
I20260709 12:12:37.854600 14184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56046 (request call id 3012) took 1154 ms. Trace:
I20260709 12:12:37.867990 21187 leader_election.cc:290] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 21 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:37.850122 21037 raft_consensus.cc:2804] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Leader election won for term 22
W20260709 12:12:37.852227 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 118160us
I20260709 12:12:37.870394 20891 raft_consensus.cc:3060] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:12:37.891425 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 47922.7us
I20260709 12:12:37.895191 21251 raft_consensus.cc:2749] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:37.897012 14155 leader_election.cc:304] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:37.890722 21122 raft_consensus.cc:2749] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:37.850389 20979 raft_consensus.cc:515] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:37.866569 14184 rpcz_store.cc:276] 0709 12:12:36.700059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:36.817333 (+117274us) service_pool.cc:224] Handling call
0709 12:12:37.428235 (+610902us) spinlock_profiling.cc:243] Waited 20.8 ms on lock 0x7b5800001298. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2124016b71 00007f2124016a22 00007f212cf2f8d9 00007f212c089ee0 00007f212c1530ab 00007f212c153131 00007f212c114fc0 00007f212c0ff929 00007f212c0ff3d2 00007f2125676bd4
0709 12:12:37.428481 (+   246us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:37.504896 (+ 76415us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:37.504934 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:37.514480 (+  9546us) log.cc:844] Serialized 26 byte log entry
0709 12:12:37.607439 (+ 92959us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:37.649920 (+ 42481us) log.cc:844] Serialized 14 byte log entry
0709 12:12:37.650195 (+   275us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:37.650281 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:37.849131 (+198850us) raft_consensus.cc:1685] finished
0709 12:12:37.854345 (+  5214us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:37.854516 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":67256,"prepare.queue_time_us":35817,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":50,"raft.queue_time_us":66210,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":8428,"spinlock_wait_cycles":51479168,"thread_start_us":57826,"threads_started":1,"wal-append.queue_time_us":122147}
W20260709 12:12:37.911878 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 66084us
W20260709 12:12:37.912177 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 61255.7us
I20260709 12:12:37.913532 21187 raft_consensus.cc:2804] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:37.914103 21187 raft_consensus.cc:697] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 19 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:12:37.914256 21169 leader_election.cc:290] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 18 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:37.894033 21037 raft_consensus.cc:697] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 22 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:12:37.915112 21187 consensus_queue.cc:237] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:37.915784 20891 raft_consensus.cc:515] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:37.916271 21037 consensus_queue.cc:237] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:37.920143 14230 leader_election.cc:304] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:37.906184 20916 raft_consensus.cc:493] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:37.926644 20891 leader_election.cc:290] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:37.929860 21168 raft_consensus.cc:493] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:12:37.930512 21168 raft_consensus.cc:515] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:37.932732 21168 leader_election.cc:290] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:37.933813 21168 consensus_queue.cc:1059] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:12:37.934614 21169 raft_consensus.cc:3055] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:37.935092 21169 raft_consensus.cc:740] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:12:37.936146 21169 consensus_queue.cc:260] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:37.947150 14910 consensus_queue.cc:237] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:37.947314 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:12:37.950903 14156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:37.948545 14303 leader_election.cc:304] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:37.950562 14155 leader_election.cc:304] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:37.960122 20975 consensus_queue.cc:1048] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 12:12:37.986279 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:37.991648 14876 leader_election.cc:304] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
W20260709 12:12:37.995680 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 75630.6us
W20260709 12:12:37.942493 21231 log.cc:927] Time spent T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.463s	user 0.003s	sys 0.002s
I20260709 12:12:37.942845 21169 raft_consensus.cc:3060] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:38.001307 14337 raft_consensus.cc:2468] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 22.
I20260709 12:12:38.002345 14230 leader_election.cc:304] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
W20260709 12:12:38.003520 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 53101us
I20260709 12:12:38.008179 14084 catalog_manager.cc:5697] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: term changed from 10 to 11, leader changed from 65c9c1653b3346b39a0e118540e6080c (127.12.174.131) to 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130). New cstate: current_term: 11 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:38.009877 21256 raft_consensus.cc:493] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:37.957155 21056 raft_consensus.cc:2749] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:12:37.947793 21132 raft_consensus.cc:493] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:38.018522 14185 raft_consensus.cc:1275] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:12:37.964061 20979 leader_election.cc:290] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 21 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:12:38.016198 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 67714us
W20260709 12:12:38.020961 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 62314.9us
I20260709 12:12:38.022068 14303 leader_election.cc:304] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:12:37.966231 21085 consensus_queue.cc:1059] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.051s
I20260709 12:12:37.959834 21136 consensus_queue.cc:1059] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 18.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.058s
I20260709 12:12:37.941165 20948 consensus_queue.cc:1048] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.076s
I20260709 12:12:37.999481 20692 raft_consensus.cc:2749] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:37.948194 21253 consensus_queue.cc:1059] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.071s
I20260709 12:12:37.941450 20916 raft_consensus.cc:515] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:38.029452 14230 leader_election.cc:304] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:37.947971 20767 consensus_queue.cc:1048] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.073s
I20260709 12:12:37.950431 20953 consensus_queue.cc:1059] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.071s
I20260709 12:12:38.032306 14155 leader_election.cc:304] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:38.065855 14907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53194 (request call id 1184) took 1614 ms. Trace:
I20260709 12:12:38.065078 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:38.080578 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:38.021400 21176 raft_consensus.cc:2749] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:37.939177 20944 consensus_queue.cc:1059] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.088s
I20260709 12:12:38.065057 20691 raft_consensus.cc:2804] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:12:38.022893 21201 raft_consensus.cc:2804] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:38.089119 14907 rpcz_store.cc:276] 0709 12:12:36.451467 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:36.458401 (+  6934us) service_pool.cc:224] Handling call
0709 12:12:36.458749 (+   348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:37.845429 (+1386680us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:38.029082 (+183653us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b54005e01d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:12:38.065782 (+ 36700us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3038809984}
W20260709 12:12:38.091467 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 69479.2us
I20260709 12:12:38.094751 14903 raft_consensus.cc:2368] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 17. Current term is 18.
I20260709 12:12:38.065491 21251 raft_consensus.cc:2749] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 12:12:38.089958 21056 raft_consensus.cc:493] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:38.129177 14303 leader_election.cc:304] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:38.096374 14084 catalog_manager.cc:5697] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:38.129948 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:38.129263 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:38.138931 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:38.093547 21136 raft_consensus.cc:493] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:12:38.100055 20691 raft_consensus.cc:493] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
W20260709 12:12:38.127676 21036 consensus_meta.cc:287] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.643s	user 0.016s	sys 0.001s
I20260709 12:12:38.141443 14912 raft_consensus.cc:3060] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:12:38.144546 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 115166us
I20260709 12:12:38.152391 14260 raft_consensus.cc:1240] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:38.154179 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:38.157927 14230 leader_election.cc:304] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:38.080487 21256 raft_consensus.cc:515] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:38.088658 21132 raft_consensus.cc:515] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:38.157013 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:38.184768 14084 catalog_manager.cc:5697] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: term changed from 11 to 17, leader changed from 65c9c1653b3346b39a0e118540e6080c (127.12.174.131) to 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130). New cstate: current_term: 17 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } }
W20260709 12:12:38.183326 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 159810us
I20260709 12:12:38.165762 14229 leader_election.cc:304] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:38.155974 20691 raft_consensus.cc:3060] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:12:38.194566 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 62425.3us
I20260709 12:12:38.188426 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
W20260709 12:12:38.200289 14876 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:38.200768 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:38.128388 20692 consensus_queue.cc:1059] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 18.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.060s
I20260709 12:12:38.178753 21251 raft_consensus.cc:2749] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:38.206647 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:38.140838 21267 raft_consensus.cc:2749] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
W20260709 12:12:38.209625 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 46119.1us
I20260709 12:12:38.211673 14230 leader_election.cc:304] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:38.212517 14229 leader_election.cc:304] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:38.207360 14259 raft_consensus.cc:2468] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 17.
I20260709 12:12:38.218345 14260 raft_consensus.cc:2468] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 17.
W20260709 12:12:38.217095 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 190626us
I20260709 12:12:38.162736 21136 raft_consensus.cc:515] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:38.222002 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:38.225448 14257 raft_consensus.cc:3060] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:38.226251 21245 raft_consensus.cc:2749] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:38.226733 20995 consensus_queue.cc:1048] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 12:12:38.227376 21230 log.cc:927] Time spent T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.794s	user 0.003s	sys 0.002s
I20260709 12:12:38.216396 21036 raft_consensus.cc:2804] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:12:38.247754 20767 consensus_queue.cc:1059] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 22.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.013s
I20260709 12:12:38.240962 21034 raft_consensus.cc:493] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:38.257933 21034 raft_consensus.cc:515] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:38.260612 21034 leader_election.cc:290] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:38.222844 21085 raft_consensus.cc:3060] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:38.269364 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:38.270120 14184 raft_consensus.cc:3060] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:38.271966 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:12:38.288343 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 76767.7us
W20260709 12:12:38.291587 21265 log.cc:927] Time spent T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.160s	user 0.001s	sys 0.000s
W20260709 12:12:38.292860 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 80442.2us
I20260709 12:12:38.294082 14229 leader_election.cc:304] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
W20260709 12:12:38.295131 21269 log.cc:927] Time spent T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:12:38.200335 21056 raft_consensus.cc:515] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:38.300488 14084 catalog_manager.cc:5697] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: term changed from 7 to 12, leader changed from 65c9c1653b3346b39a0e118540e6080c (127.12.174.131) to 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130). New cstate: current_term: 12 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:38.239004 20953 raft_consensus.cc:2749] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:12:38.309023 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 292446us
I20260709 12:12:38.312820 14304 leader_election.cc:304] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:38.320894 14877 leader_election.cc:304] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:38.329183 14909 raft_consensus.cc:2468] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 22.
I20260709 12:12:38.287678 21251 raft_consensus.cc:2749] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:12:38.329260 14084 catalog_manager.cc:5697] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: term changed from 9 to 10, leader changed from 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) to 885067a0d31741bfb5c9935788e315bf (127.12.174.129). New cstate: current_term: 10 leader_uuid: "885067a0d31741bfb5c9935788e315bf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
W20260709 12:12:38.336078 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 156666us
I20260709 12:12:38.337334 14912 raft_consensus.cc:2468] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 22.
I20260709 12:12:38.308840 21201 raft_consensus.cc:697] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 19 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
W20260709 12:12:38.341251 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 47256.4us
I20260709 12:12:38.364020 14229 leader_election.cc:304] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:38.319952 21036 raft_consensus.cc:697] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 24 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:38.238544 21241 consensus_queue.cc:1059] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.221s
I20260709 12:12:38.339506 20916 leader_election.cc:290] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:38.365059 21266 raft_consensus.cc:2749] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:38.365799 14256 raft_consensus.cc:1240] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 20. Current term is 21. Ops: []
I20260709 12:12:38.366479 14259 raft_consensus.cc:1275] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:12:38.367012 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:38.373492 14182 raft_consensus.cc:2468] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 16.
I20260709 12:12:38.367187 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:38.367947 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:38.366487 14183 raft_consensus.cc:1240] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 22. Current term is 23. Ops: []
I20260709 12:12:38.362820 14258 raft_consensus.cc:1275] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
W20260709 12:12:38.365221 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 75485.4us
I20260709 12:12:38.335341 21168 raft_consensus.cc:2804] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 12:12:38.337523 21228 log.cc:927] Time spent T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.961s	user 0.004s	sys 0.000s
I20260709 12:12:38.322641 21182 raft_consensus.cc:2749] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:12:38.390410 14084 catalog_manager.cc:5697] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } }
I20260709 12:12:38.400882 14912 raft_consensus.cc:1240] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 21. Current term is 22. Ops: [21.15-21.15]
W20260709 12:12:38.386339 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 44791.8us
I20260709 12:12:38.387671 21241 raft_consensus.cc:3055] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:38.389295 21245 raft_consensus.cc:3055] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:38.390262 21246 raft_consensus.cc:3055] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:38.336786 20692 consensus_queue.cc:1059] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.061s
I20260709 12:12:38.376459 14184 raft_consensus.cc:2468] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 18.
I20260709 12:12:38.339746 20975 raft_consensus.cc:2749] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:12:38.433558 20692 raft_consensus.cc:3055] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:38.434024 20692 raft_consensus.cc:740] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:38.434943 20692 consensus_queue.cc:260] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:38.436285 20692 raft_consensus.cc:3060] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:38.438783 21085 raft_consensus.cc:2749] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:38.432417 14876 leader_election.cc:304] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:38.442848 21286 consensus_queue.cc:1048] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:12:38.443784 21281 consensus_queue.cc:1059] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 12:12:38.445062 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 68216.5us
I20260709 12:12:38.399549 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
W20260709 12:12:38.408960 14877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:38.408970 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:38.413076 14154 leader_election.cc:400] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 election: Vote denied by peer 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341) with higher term. Message: Invalid argument: T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 17. Current term is 18.
I20260709 12:12:38.414722 14907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:38.446861 14154 leader_election.cc:403] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
W20260709 12:12:38.415989 14878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:38.416472 21036 consensus_queue.cc:237] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:38.417603 14265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41768 (request call id 2459) took 1642 ms. Trace:
I20260709 12:12:38.418000 14338 raft_consensus.cc:1275] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:12:38.445551 14186 raft_consensus.cc:1240] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 21. Current term is 22. Ops: [21.15-21.15]
I20260709 12:12:38.428689 14256 raft_consensus.cc:1275] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:12:38.393240 21168 raft_consensus.cc:493] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:12:38.430088 14155 leader_election.cc:304] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:12:38.385553 21275 raft_consensus.cc:493] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:38.390986 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:38.447479 14182 raft_consensus.cc:1240] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 20. Current term is 21. Ops: [20.12-20.12]
I20260709 12:12:38.444698 21056 leader_election.cc:290] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:38.451875 21168 raft_consensus.cc:3060] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:38.453483 14084 catalog_manager.cc:5697] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: term changed from 11 to 14, leader changed from 885067a0d31741bfb5c9935788e315bf (127.12.174.129) to 65c9c1653b3346b39a0e118540e6080c (127.12.174.131). New cstate: current_term: 14 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } }
I20260709 12:12:38.444548 21286 consensus_queue.cc:1048] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.005s
I20260709 12:12:38.467355 14262 raft_consensus.cc:2468] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 19.
I20260709 12:12:38.452832 14154 leader_election.cc:304] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:38.450048 14265 rpcz_store.cc:276] 0709 12:12:36.774938 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:37.086265 (+311327us) service_pool.cc:224] Handling call
0709 12:12:37.086767 (+   502us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:37.087371 (+   604us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:37.087413 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:37.088031 (+   618us) log.cc:844] Serialized 26 byte log entry
0709 12:12:37.311839 (+223808us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:12:37.311885 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:37.311956 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:38.102043 (+790087us) spinlock_profiling.cc:243] Waited 25 ms on lock 0x7b4400022b4c. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2123f74c85 00007f2123f756a2 00007f2126ce71db 00007f2126ce2aaf 00007f2126cd686e 00007f2126cd5bb6 00007f2126cd57d8 00007f2126cdf221 00007f2126cdf1d9 00007f2126cdf169
0709 12:12:38.417255 (+315212us) raft_consensus.cc:1685] finished
0709 12:12:38.417281 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:38.417534 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4025,"raft.run_cpu_time_us":201,"raft.run_wall_time_us":201,"spinlock_wait_cycles":57474304,"thread_start_us":223258,"threads_started":1,"wal-append.queue_time_us":273875}
I20260709 12:12:38.406025 21241 raft_consensus.cc:740] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:38.452351 21136 leader_election.cc:290] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:38.472643 14258 raft_consensus.cc:1275] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:12:38.427222 20953 raft_consensus.cc:493] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:38.411811 21245 raft_consensus.cc:740] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:38.453548 21283 raft_consensus.cc:2749] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341) with higher term. Message: Invalid argument: T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 17. Current term is 18.
I20260709 12:12:38.468040 14181 raft_consensus.cc:1240] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 20. Current term is 21. Ops: []
I20260709 12:12:38.427024 21246 raft_consensus.cc:740] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:38.475755 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:38.485903 14334 raft_consensus.cc:3060] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:38.483319 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:38.469643 21132 leader_election.cc:290] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:38.490803 21284 raft_consensus.cc:2804] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:38.494484 21284 raft_consensus.cc:697] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 18 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:12:38.495790 14877 leader_election.cc:304] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:38.495518 21284 consensus_queue.cc:237] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:38.500280 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:38.496062 21136 raft_consensus.cc:493] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:38.485101 21037 raft_consensus.cc:2804] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:38.502583 21136 raft_consensus.cc:515] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:38.484781 20953 raft_consensus.cc:515] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:38.483167 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:38.493602 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:38.494132 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:38.512847 14186 raft_consensus.cc:1275] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:12:38.506120 14904 raft_consensus.cc:3060] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:38.493352 14084 catalog_manager.cc:5697] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:38.493634 14336 raft_consensus.cc:1240] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 22. Current term is 23. Ops: []
W20260709 12:12:38.493628 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 63667.4us
I20260709 12:12:38.507797 21273 raft_consensus.cc:2804] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:38.495821 21274 raft_consensus.cc:2804] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:12:38.518759 14155 leader_election.cc:400] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 election: Vote denied by peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957) with higher term. Message: Invalid argument: T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 17. Current term is 18.
I20260709 12:12:38.518147 14257 raft_consensus.cc:2468] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 18.
I20260709 12:12:38.519173 14155 leader_election.cc:403] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 12:12:38.518858 21274 raft_consensus.cc:697] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 22 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:12:38.512602 21037 raft_consensus.cc:697] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 19 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:12:38.503144 20691 raft_consensus.cc:515] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:38.506554 21246 consensus_queue.cc:260] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:38.524801 21273 raft_consensus.cc:493] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:12:38.525328 21273 raft_consensus.cc:3060] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:38.526280 20691 leader_election.cc:290] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 22 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:38.527452 14084 catalog_manager.cc:5697] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: term changed from 7 to 12, leader changed from 885067a0d31741bfb5c9935788e315bf (127.12.174.129) to 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130). New cstate: current_term: 12 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:38.532104 21241 consensus_queue.cc:260] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:38.478514 21256 leader_election.cc:290] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:38.385646 21201 consensus_queue.cc:237] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:38.534965 21031 raft_consensus.cc:3060] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:12:38.522301 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 137483us
W20260709 12:12:38.537866 14156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:38.541767 14084 catalog_manager.cc:5697] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: term changed from 11 to 12, leader changed from 65c9c1653b3346b39a0e118540e6080c (127.12.174.131) to 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130). New cstate: current_term: 12 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:38.505689 20953 leader_election.cc:290] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:12:38.554513 14303 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:38.532150 21189 raft_consensus.cc:3060] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:38.548281 20691 raft_consensus.cc:493] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:12:38.556488 20691 raft_consensus.cc:515] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:38.558612 14336 raft_consensus.cc:1275] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:12:38.559262 20691 leader_election.cc:290] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:38.559748 21282 consensus_queue.cc:1048] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.019s
I20260709 12:12:38.524660 21037 consensus_queue.cc:237] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:38.562348 20979 raft_consensus.cc:3055] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:38.562814 20979 raft_consensus.cc:740] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:38.569401 14084 catalog_manager.cc:5697] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: term changed from 10 to 11, leader changed from 65c9c1653b3346b39a0e118540e6080c (127.12.174.131) to 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130). New cstate: current_term: 11 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:38.574673 14334 raft_consensus.cc:2468] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 22.
I20260709 12:12:38.552194 21246 raft_consensus.cc:3060] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:38.552424 20944 raft_consensus.cc:2749] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957) with higher term. Message: Invalid argument: T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 17. Current term is 18.
I20260709 12:12:38.551952 21182 raft_consensus.cc:493] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:38.577664 14260 raft_consensus.cc:1275] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
W20260709 12:12:38.576028 14154 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 84120us
I20260709 12:12:38.480221 21275 raft_consensus.cc:515] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:12:38.579360 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 60774.3us
I20260709 12:12:38.541313 21169 consensus_queue.cc:1048] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.031s
I20260709 12:12:38.503144 21245 consensus_queue.cc:260] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:38.584168 14303 leader_election.cc:304] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:38.585531 14904 raft_consensus.cc:2468] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 22.
I20260709 12:12:38.595253 14229 leader_election.cc:304] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:12:38.591514 14154 leader_election.cc:304] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:38.606192 21262 consensus_queue.cc:1048] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.053s
I20260709 12:12:38.608973 14303 leader_election.cc:304] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:38.609869 21052 raft_consensus.cc:493] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:12:38.610493 21052 raft_consensus.cc:515] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:38.612723 21052 leader_election.cc:290] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:38.577474 21286 raft_consensus.cc:493] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:38.617867 14084 catalog_manager.cc:5697] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: term changed from 8 to 13. New cstate: current_term: 13 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:38.620610 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:38.622887 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:38.627942 14190 raft_consensus.cc:2393] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 21: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:12:38.574671 21282 consensus_queue.cc:1048] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.023s
I20260709 12:12:38.613976 21006 raft_consensus.cc:493] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:38.626591 20944 raft_consensus.cc:2804] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:12:38.631008 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:38.631174 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:38.644912 14189 raft_consensus.cc:2393] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 19: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:12:38.623287 21281 raft_consensus.cc:2749] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:38.631932 21285 consensus_queue.cc:1059] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:12:38.632915 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:38.633114 14187 raft_consensus.cc:1240] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:38.633445 20995 consensus_queue.cc:1048] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.007s
I20260709 12:12:38.633862 14155 leader_election.cc:304] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:38.634801 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:38.635403 21244 raft_consensus.cc:493] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:38.636510 14907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:38.639664 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:12:38.646540 14302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:38.647006 20691 raft_consensus.cc:493] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:38.664485 14907 raft_consensus.cc:2368] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for earlier term 21. Current term is 22.
I20260709 12:12:38.665154 14184 raft_consensus.cc:2468] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 18.
I20260709 12:12:38.664397 20691 raft_consensus.cc:515] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:38.654716 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:38.627141 21256 raft_consensus.cc:2804] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:12:38.657641 14084 catalog_manager.cc:5697] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:38.635294 21109 raft_consensus.cc:2749] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:38.612808 21273 raft_consensus.cc:515] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:38.584239 21182 raft_consensus.cc:515] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:38.676812 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:38.579056 21274 consensus_queue.cc:237] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:38.659103 20944 raft_consensus.cc:697] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 22 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:12:38.686304 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:38.673583 21245 raft_consensus.cc:3060] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:12:38.692819 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 59076us
I20260709 12:12:38.685500 14084 catalog_manager.cc:5697] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:38.681273 14229 leader_election.cc:304] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:38.695101 14303 leader_election.cc:304] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:12:38.696319 14229 leader_election.cc:304] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:38.679013 20691 leader_election.cc:290] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:38.679874 21256 raft_consensus.cc:697] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 22 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:38.700001 14303 leader_election.cc:304] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:38.704574 14183 raft_consensus.cc:1240] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:38.697763 14084 catalog_manager.cc:5697] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: term changed from 6 to 12. New cstate: current_term: 12 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } }
I20260709 12:12:38.643651 21286 raft_consensus.cc:515] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:38.690388 21295 raft_consensus.cc:2749] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:12:38.673184 21244 raft_consensus.cc:515] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:38.703740 21266 raft_consensus.cc:2804] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:38.679464 21006 raft_consensus.cc:515] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:38.706270 21109 raft_consensus.cc:2804] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:38.723155 21273 leader_election.cc:290] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 18 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:12:38.726507 21277 log.cc:927] Time spent T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.268s	user 0.001s	sys 0.004s
I20260709 12:12:38.708004 20691 raft_consensus.cc:2749] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:38.703776 20768 consensus_queue.cc:1059] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 22.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.036s
I20260709 12:12:38.709857 21085 raft_consensus.cc:2749] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:12:38.777655 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 47531.4us
I20260709 12:12:38.729607 21266 raft_consensus.cc:493] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:38.780452 14903 raft_consensus.cc:1275] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
W20260709 12:12:38.765038 20962 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.005s	sys 0.002s
I20260709 12:12:38.741305 21109 raft_consensus.cc:493] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:38.788108 21109 raft_consensus.cc:3060] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:38.745002 21299 raft_consensus.cc:493] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:38.795890 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 78981us
I20260709 12:12:38.731839 21281 consensus_queue.cc:1059] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.056s
I20260709 12:12:38.739841 21285 consensus_queue.cc:1059] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.046s
W20260709 12:12:38.793784 20962 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.632s	user 0.007s	sys 0.003s
W20260709 12:12:38.808420 21279 log.cc:927] Time spent T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.198s	user 0.000s	sys 0.001s
I20260709 12:12:38.802542 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:38.744764 21250 consensus_queue.cc:1059] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.110s
I20260709 12:12:38.795508 21256 consensus_queue.cc:237] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:38.808835 21252 raft_consensus.cc:493] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:38.837953 21252 raft_consensus.cc:515] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:38.839051 14188 raft_consensus.cc:1240] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 12:12:38.840590 14188 raft_consensus.cc:1275] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:12:38.747561 21195 raft_consensus.cc:493] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:12:38.830940 14912 raft_consensus.cc:1240] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 19 LEADER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:38.786567 20692 raft_consensus.cc:3055] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:12:38.834077 21207 consensus_queue.cc:1059] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 12:12:38.786252 21266 raft_consensus.cc:3060] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:38.831255 21176 raft_consensus.cc:3055] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:12:38.840410 21252 leader_election.cc:290] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:38.854183 14188 raft_consensus.cc:1275] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:12:38.856886 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:38.779454 20944 consensus_queue.cc:237] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:12:38.864523 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 63353.5us
I20260709 12:12:38.865450 21129 raft_consensus.cc:3055] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:12:38.865950 21129 raft_consensus.cc:740] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:38.867198 21286 leader_election.cc:290] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:38.866870 21129 consensus_queue.cc:260] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:38.864567 21309 raft_consensus.cc:493] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:38.868989 21309 raft_consensus.cc:515] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:38.875267 21182 leader_election.cc:290] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:38.854146 21176 raft_consensus.cc:740] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:12:38.856959 21307 raft_consensus.cc:3055] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:12:38.876888 21309 leader_election.cc:290] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:38.872800 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:38.869798 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:38.877218 21307 raft_consensus.cc:740] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:38.824949 21299 raft_consensus.cc:515] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:38.878484 21307 consensus_queue.cc:260] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 23.11, Last appended by leader: 11, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:38.870625 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:38.880209 14334 raft_consensus.cc:2368] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 23. Current term is 24.
I20260709 12:12:38.882290 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 24 candidate_status { last_received { term: 22 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:38.871209 21129 raft_consensus.cc:3060] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:38.871615 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:38.872400 21006 leader_election.cc:290] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:38.872427 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:38.886595 14264 raft_consensus.cc:2368] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 17. Current term is 18.
I20260709 12:12:38.861106 14903 raft_consensus.cc:2468] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 21.
I20260709 12:12:38.874217 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 24 candidate_status { last_received { term: 22 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:38.874693 21244 leader_election.cc:290] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:38.848351 20692 raft_consensus.cc:740] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:38.851598 21275 leader_election.cc:290] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:38.898986 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:38.899971 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:38.902099 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:38.903318 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:38.904125 14188 raft_consensus.cc:2393] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 17: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:12:38.877560 21176 consensus_queue.cc:260] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:38.904816 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:38.909897 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:38.910986 14335 raft_consensus.cc:2468] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 19.
I20260709 12:12:38.911964 21307 raft_consensus.cc:3060] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:38.914239 21168 raft_consensus.cc:515] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:38.917701 21168 leader_election.cc:290] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 23 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:38.918092 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:38.918920 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:38.853539 21195 raft_consensus.cc:515] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:38.920115 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:38.922451 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:38.923440 14336 raft_consensus.cc:2410] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for term 17 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 12:12:38.917295 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:38.903995 14185 raft_consensus.cc:2468] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 19.
I20260709 12:12:38.921525 21195 leader_election.cc:290] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:38.933004 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:38.940336 21187 raft_consensus.cc:3055] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:38.940917 21187 raft_consensus.cc:740] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
W20260709 12:12:38.942812 14303 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:38.957201 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:38.942004 21187 consensus_queue.cc:260] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:38.958920 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:38.979565 14264 raft_consensus.cc:2468] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 18.
I20260709 12:12:38.959854 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:12:38.960320 14302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:38.960870 21299 leader_election.cc:290] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:38.961601 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:38.962610 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:38.963135 14903 raft_consensus.cc:1240] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 21. Current term is 22. Ops: [21.15-21.15]
I20260709 12:12:38.901634 20962 consensus_queue.cc:1048] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.063s
I20260709 12:12:38.966775 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:38.969249 14155 leader_election.cc:304] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:38.966959 21109 raft_consensus.cc:515] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:38.991690 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:38.985693 21299 raft_consensus.cc:493] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:38.993876 21299 raft_consensus.cc:515] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:38.994484 21034 raft_consensus.cc:493] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:38.995141 21034 raft_consensus.cc:515] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } }
I20260709 12:12:38.995944 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:38.997466 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:12:38.998451 21263 log.cc:927] Time spent T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.832s	user 0.002s	sys 0.003s
I20260709 12:12:38.998804 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:38.997303 21034 leader_election.cc:290] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:38.999555 14264 raft_consensus.cc:2393] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 21: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:12:39.000443 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:39.002380 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:39.003804 14303 leader_election.cc:304] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:39.003649 20691 consensus_queue.cc:1048] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:12:39.005151 20916 consensus_queue.cc:1059] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:12:39.005343 20691 consensus_queue.cc:1048] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:12:39.006474 14903 raft_consensus.cc:1240] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 23 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 22. Current term is 23. Ops: []
I20260709 12:12:38.997412 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:38.969933 21309 raft_consensus.cc:493] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:39.011430 21309 raft_consensus.cc:515] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:39.005677 21246 raft_consensus.cc:2804] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:39.013186 21246 raft_consensus.cc:493] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:39.013572 21246 raft_consensus.cc:3060] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:38.970763 21195 raft_consensus.cc:493] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:38.984109 21245 raft_consensus.cc:493] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:38.996230 21299 leader_election.cc:290] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:39.021765 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
W20260709 12:12:39.017577 14303 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:39.032397 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:39.038451 14260 raft_consensus.cc:1275] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:12:39.040212 14260 raft_consensus.cc:1275] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
W20260709 12:12:39.043224 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 74113.6us
I20260709 12:12:39.022378 21187 raft_consensus.cc:3060] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:39.048136 14155 leader_election.cc:304] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:39.058108 14189 raft_consensus.cc:1240] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 18. Current term is 19. Ops: [18.16-18.16]
I20260709 12:12:39.042480 21274 raft_consensus.cc:2749] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:12:39.023509 21195 raft_consensus.cc:515] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:39.078914 20692 consensus_queue.cc:260] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:39.080101 20692 raft_consensus.cc:3060] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:39.081291 21195 leader_election.cc:290] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:39.074877 14155 leader_election.cc:400] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 election: Vote denied by peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673) with higher term. Message: Invalid argument: T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 17. Current term is 18.
I20260709 12:12:39.028331 21245 raft_consensus.cc:515] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:39.072604 14334 raft_consensus.cc:2410] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for term 24 because replica has last-logged OpId of term: 23 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 10.
I20260709 12:12:39.093618 14336 raft_consensus.cc:1275] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 12:12:39.082023 21309 leader_election.cc:290] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:39.078744 21266 raft_consensus.cc:515] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:39.096993 14303 leader_election.cc:304] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:39.056991 21109 leader_election.cc:290] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 17 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:39.064980 20944 raft_consensus.cc:2749] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:39.126479 14303 leader_election.cc:400] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 21 election: Vote denied by peer 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341) with higher term. Message: Invalid argument: T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for earlier term 21. Current term is 22.
I20260709 12:12:39.126811 14303 leader_election.cc:403] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 21 election: Cancelling election due to peer responding with higher term
I20260709 12:12:39.126331 14155 leader_election.cc:304] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:39.127940 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:39.139721 21037 raft_consensus.cc:2804] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:39.140259 21037 raft_consensus.cc:493] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:39.140619 21037 raft_consensus.cc:3060] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:39.147949 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:39.150921 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:39.152113 21299 consensus_queue.cc:1059] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 17.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:12:39.163381 21037 raft_consensus.cc:515] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:39.168864 21037 leader_election.cc:290] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:39.175169 21303 raft_consensus.cc:3055] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:39.175807 21303 raft_consensus.cc:740] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:39.178236 21052 raft_consensus.cc:3055] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:12:39.178790 21052 raft_consensus.cc:740] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:39.179890 21052 consensus_queue.cc:260] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:39.183696 21136 leader_election.cc:290] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:12:39.191099 21304 log.cc:927] Time spent T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.344s	user 0.000s	sys 0.002s
I20260709 12:12:39.067513 20979 consensus_queue.cc:260] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:39.205173 21245 leader_election.cc:290] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:39.126250 21195 raft_consensus.cc:2749] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:12:39.220587 21266 leader_election.cc:290] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:39.134027 21109 raft_consensus.cc:2749] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Leader election lost for term 21. Reason: Vote denied by peer 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341) with higher term. Message: Invalid argument: T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for earlier term 21. Current term is 22.
I20260709 12:12:39.226265 14190 raft_consensus.cc:1275] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
W20260709 12:12:39.226280 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 114471us
I20260709 12:12:39.231178 14303 leader_election.cc:304] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:12:39.231570 14183 raft_consensus.cc:1240] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 22. Current term is 23. Ops: []
I20260709 12:12:39.232815 21195 consensus_queue.cc:1048] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:39.234637 21195 raft_consensus.cc:2804] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:39.235085 21195 raft_consensus.cc:493] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:39.243263 14331 pending_rounds.cc:85] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c: Aborting all ops after (but not including) 13
I20260709 12:12:39.243835 14331 pending_rounds.cc:107] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c: Aborting uncommitted NO_OP operation due to leader change: 16.14
I20260709 12:12:39.244477 14331 raft_consensus.cc:2889] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:39.245342 21195 raft_consensus.cc:3060] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:39.243652 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:39.247905 14265 raft_consensus.cc:2410] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for term 17 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 12:12:39.232232 14303 leader_election.cc:304] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:39.258671 21109 raft_consensus.cc:2749] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:39.260771 14303 leader_election.cc:304] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:39.261718 21109 raft_consensus.cc:2749] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:39.262275 14188 raft_consensus.cc:1240] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 18. Current term is 19. Ops: []
W20260709 12:12:39.268090 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 141835us
I20260709 12:12:39.268970 14155 leader_election.cc:304] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:39.270303 20944 raft_consensus.cc:2749] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:39.177037 21303 consensus_queue.cc:260] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.16, Last appended by leader: 16, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:39.273597 21303 raft_consensus.cc:3060] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:39.181560 21052 raft_consensus.cc:3060] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:39.275967 21176 raft_consensus.cc:3060] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:12:39.279599 21085 consensus_queue.cc:1175] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "73d01e9b1a9d49358da4985b21d681db" responder_term: 19 status { last_received { term: 19 index: 16 } last_committed_idx: 15 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 18. Current term is 19. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:12:39.287331 20979 raft_consensus.cc:3060] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:39.315521 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:39.316361 14190 raft_consensus.cc:3060] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:39.310840 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
W20260709 12:12:39.295365 21223 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.033s	user 0.012s	sys 0.053s
I20260709 12:12:39.319749 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:39.320458 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
W20260709 12:12:39.295531 21253 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.040s	user 0.016s	sys 0.056s
I20260709 12:12:39.328191 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:39.331072 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:39.334607 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:39.337756 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:39.338729 14330 raft_consensus.cc:2393] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 23: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
W20260709 12:12:39.322170 21223 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.065s	user 0.012s	sys 0.055s
I20260709 12:12:39.345414 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:39.351979 14262 raft_consensus.cc:1275] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
W20260709 12:12:39.326685 21253 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.071s	user 0.017s	sys 0.056s
I20260709 12:12:39.369467 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:39.381153 14265 raft_consensus.cc:1240] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:39.381431 14155 leader_election.cc:304] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:39.366320 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:39.369278 20547 consensus_queue.cc:1048] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.028s
I20260709 12:12:39.374284 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:39.323424 21132 consensus_queue.cc:1048] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.052s
W20260709 12:12:39.381596 14303 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:39.387297 14264 raft_consensus.cc:3060] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:39.367660 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:39.390137 14155 leader_election.cc:400] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 23 election: Vote denied by peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957) with higher term. Message: Invalid argument: T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 23. Current term is 24.
I20260709 12:12:39.390538 14155 leader_election.cc:403] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 23 election: Cancelling election due to peer responding with higher term
I20260709 12:12:39.391251 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:39.397292 14190 raft_consensus.cc:2468] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 19.
I20260709 12:12:39.323625 21037 consensus_queue.cc:1048] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.062s
I20260709 12:12:39.398712 14181 raft_consensus.cc:1240] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 12:12:39.315940 21295 consensus_queue.cc:1059] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 22.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.073s
I20260709 12:12:39.405787 14265 raft_consensus.cc:1275] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 12:12:39.407511 14155 leader_election.cc:304] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:39.409987 14877 leader_election.cc:304] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:39.414247 14155 leader_election.cc:304] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:39.343115 21109 consensus_queue.cc:1059] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.057s
I20260709 12:12:39.418557 14189 raft_consensus.cc:1240] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 20. Current term is 21. Ops: [20.12-20.12]
I20260709 12:12:39.427948 14155 leader_election.cc:304] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:39.426476 14185 raft_consensus.cc:2468] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 18.
I20260709 12:12:39.408725 20891 raft_consensus.cc:493] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:39.408831 21274 raft_consensus.cc:2749] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 24 FOLLOWER]: Leader election lost for term 23. Reason: Vote denied by peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957) with higher term. Message: Invalid argument: T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 23. Current term is 24.
I20260709 12:12:39.409363 21309 raft_consensus.cc:2749] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:12:39.438889 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:39.440605 14155 leader_election.cc:304] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:39.420122 21283 raft_consensus.cc:2749] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:39.419842 21129 raft_consensus.cc:493] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:39.403347 21223 consensus_queue.cc:1048] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.030s
I20260709 12:12:39.448755 14264 raft_consensus.cc:2468] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 19.
I20260709 12:12:39.432899 21270 raft_consensus.cc:2749] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:12:39.451908 14155 leader_election.cc:304] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:39.453166 21245 consensus_queue.cc:1059] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.002s
I20260709 12:12:39.438772 20953 raft_consensus.cc:2749] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:12:39.454362 21278 consensus_queue.cc:1048] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:12:39.458081 14877 leader_election.cc:304] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:39.462615 14877 leader_election.cc:304] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:39.463475 21168 raft_consensus.cc:2749] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:39.465548 21260 raft_consensus.cc:2749] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:12:39.444272 20891 raft_consensus.cc:515] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:39.471783 20891 leader_election.cc:290] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:39.467393 21187 raft_consensus.cc:2749] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 12:12:39.476076 21321 log.cc:927] Time spent T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:12:39.433687 21295 raft_consensus.cc:2749] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:12:39.482034 14303 leader_election.cc:304] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:39.484404 14155 leader_election.cc:304] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:39.482973 21217 raft_consensus.cc:493] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:39.487715 21217 raft_consensus.cc:515] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:39.488538 14188 raft_consensus.cc:1275] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:12:39.494109 14155 leader_election.cc:304] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:39.496079 21309 raft_consensus.cc:2749] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:39.497049 21309 raft_consensus.cc:2749] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:39.497846 21309 consensus_queue.cc:1048] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:12:39.499102 14155 leader_election.cc:304] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:39.498142 21307 raft_consensus.cc:2804] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:39.500120 21307 raft_consensus.cc:493] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:12:39.500530 21307 raft_consensus.cc:3060] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:39.501540 14912 raft_consensus.cc:1275] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:12:39.514585 14188 raft_consensus.cc:1275] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 24 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
W20260709 12:12:39.543234 14303 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:39.582784 14156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:39.608064 14304 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:39.622728 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 112568us
W20260709 12:12:39.581058 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 53954.7us
I20260709 12:12:39.511896 21274 raft_consensus.cc:2749] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:39.632436 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:39.528782 20953 raft_consensus.cc:2749] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 12:12:39.480659 21246 raft_consensus.cc:515] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:39.645581 14189 raft_consensus.cc:2393] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 21: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:12:39.485873 21129 raft_consensus.cc:515] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:39.496876 21195 raft_consensus.cc:515] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:39.629936 21109 raft_consensus.cc:493] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:12:39.579494 21278 consensus_queue.cc:1048] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.069s
I20260709 12:12:39.650931 14229 leader_election.cc:304] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:39.673447 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:39.678370 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:39.680361 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:39.696178 14333 raft_consensus.cc:2468] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 19.
I20260709 12:12:39.700142 14258 raft_consensus.cc:1240] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 12:12:39.701995 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:12:39.702188 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 67923.9us
I20260709 12:12:39.706398 14230 leader_election.cc:304] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:39.706476 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:39.666150 21217 leader_election.cc:290] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:39.671736 21267 raft_consensus.cc:493] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:39.710697 14877 leader_election.cc:304] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:12:39.715734 14188 raft_consensus.cc:1240] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:39.720283 14262 raft_consensus.cc:1240] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 18. Current term is 19. Ops: []
W20260709 12:12:39.723147 21320 log.cc:927] Time spent T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
W20260709 12:12:39.723685 21322 log.cc:927] Time spent T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.201s	user 0.000s	sys 0.000s
W20260709 12:12:39.723208 21325 log.cc:927] Time spent T 00000000000000000000000000000000 P d07070be2c074f4cb9ad35f1580c4ef7: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
W20260709 12:12:39.739274 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 88441.3us
I20260709 12:12:39.746423 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:39.670436 21109 raft_consensus.cc:515] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:39.754305 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:12:39.758064 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 51787.3us
I20260709 12:12:39.759981 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:39.742471 21217 raft_consensus.cc:2804] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:39.769456 14230 leader_election.cc:304] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:39.772065 14333 raft_consensus.cc:1275] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 12:12:39.752782 21256 raft_consensus.cc:2804] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:39.774492 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:39.777464 14258 raft_consensus.cc:2393] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 21: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:12:39.774449 14230 leader_election.cc:304] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:39.741207 21267 raft_consensus.cc:515] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:39.786088 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:39.786791 14256 raft_consensus.cc:2468] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 19.
I20260709 12:12:39.773006 21217 raft_consensus.cc:493] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:39.776019 21326 raft_consensus.cc:2804] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:39.754372 21307 raft_consensus.cc:515] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:39.840926 21129 leader_election.cc:290] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:39.797847 14337 raft_consensus.cc:1275] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
W20260709 12:12:39.841311 21331 log.cc:927] Time spent T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 12:12:39.760447 21296 raft_consensus.cc:2749] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:12:39.842639 21307 leader_election.cc:290] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:12:39.843456 21332 log.cc:927] Time spent T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:12:39.752498 21085 consensus_queue.cc:1048] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.025s
I20260709 12:12:39.820634 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:39.844375 14184 raft_consensus.cc:3060] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:39.825294 20979 raft_consensus.cc:2749] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:12:39.826848 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 52482.6us
I20260709 12:12:39.788693 21256 raft_consensus.cc:697] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 19 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:39.833328 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:39.835464 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:39.776644 21266 consensus_queue.cc:1059] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 22.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.043s
I20260709 12:12:39.855424 14184 raft_consensus.cc:2468] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 20.
I20260709 12:12:39.768563 21136 raft_consensus.cc:493] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:39.839632 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 250874us
I20260709 12:12:39.840122 14257 raft_consensus.cc:2468] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 20.
I20260709 12:12:39.840507 21326 raft_consensus.cc:493] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:39.790376 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:39.850117 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:39.824875 14260 raft_consensus.cc:1275] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:12:39.858482 14155 leader_election.cc:304] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
W20260709 12:12:39.906210 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 48668.8us
I20260709 12:12:39.907495 14155 leader_election.cc:304] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:39.839285 21217 raft_consensus.cc:3060] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:39.908167 21309 raft_consensus.cc:2749] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:39.908934 21309 consensus_queue.cc:1048] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:12:39.911089 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:39.882015 14181 raft_consensus.cc:1240] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 20. Current term is 21. Ops: [20.12-20.12]
I20260709 12:12:39.875419 14258 raft_consensus.cc:2393] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 18: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:12:39.876545 21085 raft_consensus.cc:493] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:39.875782 21136 raft_consensus.cc:515] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:39.879200 21326 raft_consensus.cc:3060] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:39.877609 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:39.886610 20962 raft_consensus.cc:3055] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:12:39.927991 20962 raft_consensus.cc:740] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:12:39.928975 20962 consensus_queue.cc:260] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:12:39.860276 14230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:39.852038 21246 leader_election.cc:290] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 20 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:12:39.878702 21333 log.cc:927] Time spent T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:12:39.891476 21241 raft_consensus.cc:3060] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:39.892608 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:39.896327 21109 leader_election.cc:290] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:39.898343 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:39.898583 21267 leader_election.cc:290] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:39.861279 21195 leader_election.cc:290] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 21 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:39.899317 21256 consensus_queue.cc:237] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:39.904804 21056 raft_consensus.cc:493] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:39.911772 14265 raft_consensus.cc:2468] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 20.
I20260709 12:12:39.919749 21283 raft_consensus.cc:2804] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:39.925262 21136 leader_election.cc:290] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:39.913765 21085 raft_consensus.cc:515] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:39.912501 21309 raft_consensus.cc:493] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:39.880970 20979 raft_consensus.cc:493] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:39.930043 14187 raft_consensus.cc:2468] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 18.
I20260709 12:12:39.933254 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:39.949096 14155 leader_election.cc:304] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:39.954455 14184 raft_consensus.cc:2468] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 22.
I20260709 12:12:39.954864 14336 raft_consensus.cc:1275] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 11. (term mismatch)
I20260709 12:12:39.968142 14336 pending_rounds.cc:85] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c: Aborting all ops after (but not including) 10
I20260709 12:12:39.968393 14336 pending_rounds.cc:107] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c: Aborting uncommitted NO_OP operation due to leader change: 18.11
I20260709 12:12:39.968627 14336 raft_consensus.cc:2889] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:39.955762 21129 raft_consensus.cc:493] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:39.963934 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:39.974524 20979 raft_consensus.cc:515] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:39.976903 20979 leader_election.cc:290] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:39.965622 21344 raft_consensus.cc:493] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:39.978345 21344 raft_consensus.cc:515] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:39.980335 14304 leader_election.cc:304] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:39.982216 21052 raft_consensus.cc:2749] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
W20260709 12:12:39.982466 14303 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:39.980530 21344 leader_election.cc:290] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:39.962080 21056 raft_consensus.cc:515] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:39.985710 14304 leader_election.cc:304] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:39.956067 20962 raft_consensus.cc:3060] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:40.001022 14155 leader_election.cc:304] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:39.970817 21034 raft_consensus.cc:3060] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:39.971688 21267 raft_consensus.cc:493] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:40.004036 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:39.984275 21283 raft_consensus.cc:697] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 19 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:12:39.987428 21246 raft_consensus.cc:493] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:40.017091 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:40.005442 21344 raft_consensus.cc:493] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:39.986783 21129 raft_consensus.cc:515] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:40.010479 21274 raft_consensus.cc:2749] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:39.970924 21309 raft_consensus.cc:515] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:40.021272 20979 raft_consensus.cc:493] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:40.016814 21052 raft_consensus.cc:2749] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:40.032187 21342 raft_consensus.cc:493] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:40.002170 21195 consensus_queue.cc:1059] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.037s
W20260709 12:12:40.071965 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 60857.7us
I20260709 12:12:40.031869 20691 raft_consensus.cc:493] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:40.042237 14304 leader_election.cc:304] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:40.023159 21295 consensus_queue.cc:1048] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 12, Time since last communication: 0.036s
I20260709 12:12:40.081282 14912 raft_consensus.cc:2468] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 21.
I20260709 12:12:40.032845 21267 raft_consensus.cc:515] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:40.055577 21109 raft_consensus.cc:493] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:40.039103 21246 raft_consensus.cc:515] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:12:40.090461 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 48310.5us
I20260709 12:12:40.041229 20953 consensus_queue.cc:1048] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 12:12:40.094576 14304 leader_election.cc:304] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:40.047816 21344 raft_consensus.cc:515] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:40.099301 21270 raft_consensus.cc:2955] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 16 LEADER]: Committing config change with OpId 16.12: config changed from index 6 to 12, VOTER 885067a0d31741bfb5c9935788e315bf (127.12.174.129) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
W20260709 12:12:40.102447 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 69945.9us
I20260709 12:12:40.091228 21195 raft_consensus.cc:2749] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:40.082104 20691 raft_consensus.cc:515] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } }
I20260709 12:12:40.110731 14304 leader_election.cc:304] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:40.087167 21275 consensus_queue.cc:1048] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 12:12:40.130420 21056 leader_election.cc:290] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:40.089650 20979 raft_consensus.cc:515] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:40.086840 21217 raft_consensus.cc:515] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:40.137591 21034 raft_consensus.cc:2749] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:12:40.107564 21052 raft_consensus.cc:2749] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:40.094105 21109 raft_consensus.cc:515] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:40.145810 14303 leader_election.cc:304] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:12:40.076953 21342 raft_consensus.cc:515] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:40.104172 21356 consensus_queue.cc:1059] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.031s
W20260709 12:12:40.163031 21349 log.cc:927] Time spent T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
W20260709 12:12:40.164310 21351 log.cc:927] Time spent T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:12:40.167416 21342 leader_election.cc:290] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:40.093878 21283 consensus_queue.cc:237] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:12:40.173663 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 137600us
I20260709 12:12:40.159065 21195 raft_consensus.cc:2749] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:12:40.174175 21085 leader_election.cc:290] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:40.184801 21036 raft_consensus.cc:493] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:40.195552 21036 raft_consensus.cc:515] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:40.196094 21246 leader_election.cc:290] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:40.198470 21217 leader_election.cc:290] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 21 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:40.199349 21036 leader_election.cc:290] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:40.173904 21056 consensus_queue.cc:1048] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.020s
I20260709 12:12:40.195397 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:40.205181 14261 raft_consensus.cc:2468] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 19.
I20260709 12:12:40.221484 14155 leader_election.cc:304] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
W20260709 12:12:40.195755 21350 log.cc:927] Time spent T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.164s	user 0.001s	sys 0.000s
W20260709 12:12:40.195449 21352 log.cc:927] Time spent T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
W20260709 12:12:40.274197 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 163537us
I20260709 12:12:40.275686 14304 leader_election.cc:304] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:40.277590 14304 leader_election.cc:304] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:40.210901 21129 leader_election.cc:290] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:40.236733 21085 raft_consensus.cc:493] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:40.268287 21217 raft_consensus.cc:493] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:40.287098 14337 raft_consensus.cc:1240] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 21. Current term is 22. Ops: []
I20260709 12:12:40.288866 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:40.290683 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:40.293650 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:40.296407 14331 raft_consensus.cc:1240] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:40.300002 14334 raft_consensus.cc:1275] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:12:40.297690 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:40.277027 21052 raft_consensus.cc:2749] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:12:40.308758 21309 leader_election.cc:290] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:40.313351 21365 raft_consensus.cc:2804] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:12:40.314133 21359 raft_consensus.cc:2804] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:40.314597 21359 raft_consensus.cc:493] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:40.314983 21359 raft_consensus.cc:3060] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:40.318157 20979 leader_election.cc:290] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:40.280143 21342 raft_consensus.cc:2749] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:12:40.321820 21357 log.cc:927] Time spent T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
W20260709 12:12:40.323995 21368 log.cc:927] Time spent T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.138s	user 0.000s	sys 0.000s
W20260709 12:12:40.305601 21355 log.cc:927] Time spent T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:12:40.325719 14260 raft_consensus.cc:1275] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 18 index: 16. Preceding OpId from leader: term: 19 index: 16. (term mismatch)
I20260709 12:12:40.321713 21366 raft_consensus.cc:493] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:40.321651 21137 raft_consensus.cc:3055] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:40.326620 21137 raft_consensus.cc:740] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:40.326184 14260 pending_rounds.cc:85] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec: Aborting all ops after (but not including) 15
I20260709 12:12:40.327912 14260 pending_rounds.cc:107] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec: Aborting uncommitted NO_OP operation due to leader change: 18.16
I20260709 12:12:40.328292 14260 raft_consensus.cc:2889] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:40.327474 21137 consensus_queue.cc:260] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:40.334131 21137 raft_consensus.cc:3060] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:40.339334 21366 raft_consensus.cc:515] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:40.343866 21366 leader_election.cc:290] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:40.305068 21326 raft_consensus.cc:515] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:40.349709 21109 leader_election.cc:290] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:40.351428 21326 leader_election.cc:290] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:40.298444 21217 raft_consensus.cc:515] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:40.354367 21217 leader_election.cc:290] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:40.355684 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:40.347010 21052 raft_consensus.cc:493] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:40.362627 21052 raft_consensus.cc:515] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:40.359997 21365 raft_consensus.cc:697] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 21 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:40.367388 21365 consensus_queue.cc:237] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:40.368423 21245 consensus_queue.cc:1059] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:12:40.367769 14303 leader_election.cc:304] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:40.369925 20692 raft_consensus.cc:2804] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:40.370484 20692 raft_consensus.cc:697] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 20 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:40.371646 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:40.371423 20692 consensus_queue.cc:237] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:40.373555 21250 raft_consensus.cc:3055] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:12:40.374037 21250 raft_consensus.cc:740] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:40.374729 14303 leader_election.cc:304] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:40.376281 14303 leader_election.cc:304] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:40.378878 21137 consensus_queue.cc:1059] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:12:40.374917 21250 consensus_queue.cc:260] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:12:40.380940 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 82440.2us
I20260709 12:12:40.383087 14912 raft_consensus.cc:1275] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 12:12:40.294919 21085 raft_consensus.cc:515] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:12:40.389034 14257 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41768 (request call id 2473) took 1500 ms (client timeout 1607 ms). Trace:
W20260709 12:12:40.401398 14257 rpcz_store.cc:269] 0709 12:12:38.900962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:38.916978 (+ 16016us) service_pool.cc:224] Handling call
0709 12:12:40.388805 (+1471827us) spinlock_profiling.cc:243] Waited 825 ms on lock 0x7b5400212354. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:12:40.388952 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1897375104}
I20260709 12:12:40.403539 14903 raft_consensus.cc:1240] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:40.403370 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:40.404186 14338 raft_consensus.cc:2468] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 21.
I20260709 12:12:40.379415 21267 leader_election.cc:290] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:40.364940 21052 leader_election.cc:290] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:40.429477 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:40.379868 21137 raft_consensus.cc:2804] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:40.432693 14190 raft_consensus.cc:2393] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 20: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:12:40.432591 14910 raft_consensus.cc:1275] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 12:12:40.360469 21326 raft_consensus.cc:493] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:40.433641 14262 raft_consensus.cc:2468] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 17.
I20260709 12:12:40.442296 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:40.443616 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:40.444808 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:40.405939 21109 raft_consensus.cc:2804] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:12:40.450966 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:40.446236 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:40.407457 21253 raft_consensus.cc:3055] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:12:40.452862 14155 leader_election.cc:304] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:40.405532 21034 raft_consensus.cc:493] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:40.466806 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:40.468871 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:40.469530 14184 raft_consensus.cc:2468] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 23.
I20260709 12:12:40.472370 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:40.473265 14181 raft_consensus.cc:2393] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 23: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:12:40.476346 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:40.482303 21137 raft_consensus.cc:697] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 18 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:40.483501 21137 consensus_queue.cc:237] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:40.489778 14339 raft_consensus.cc:1275] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 12:12:40.492036 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:40.492905 14190 raft_consensus.cc:2393] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 19: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:12:40.443159 21251 raft_consensus.cc:493] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:40.457965 21109 raft_consensus.cc:493] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:12:40.457018 21253 raft_consensus.cc:740] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:40.509577 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:40.496261 21132 raft_consensus.cc:2804] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:40.510658 14181 raft_consensus.cc:2393] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 24: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:12:40.511276 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:12:40.512049 14230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:40.518301 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:40.452644 21326 raft_consensus.cc:515] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:40.472219 21034 raft_consensus.cc:515] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:40.548872 14903 raft_consensus.cc:1275] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 12:12:40.512842 21109 raft_consensus.cc:3060] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:40.557538 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:40.556833 14339 raft_consensus.cc:1275] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 12:12:40.562422 14903 raft_consensus.cc:2410] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for term 22 because replica has last-logged OpId of term: 20 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 13.
I20260709 12:12:40.516558 21372 raft_consensus.cc:493] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:40.549015 21132 raft_consensus.cc:697] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 20 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:12:40.580284 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:40.584024 14303 leader_election.cc:304] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:40.586692 14303 leader_election.cc:304] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
W20260709 12:12:40.601720 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 148940us
I20260709 12:12:40.571496 21363 raft_consensus.cc:493] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:12:40.591082 21342 raft_consensus.cc:2749] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:40.646577 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:12:40.683462 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:40.598627 21129 raft_consensus.cc:2804] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:12:40.505439 21251 raft_consensus.cc:515] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:40.603825 21270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:37230 (request call id 0) took 2646 ms. Trace:
I20260709 12:12:40.592453 21256 consensus_queue.cc:1048] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.042s
I20260709 12:12:40.796439 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:40.598249 21295 consensus_queue.cc:1048] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.179s
I20260709 12:12:40.604570 21037 consensus_queue.cc:1059] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.186s
I20260709 12:12:40.583503 21372 raft_consensus.cc:515] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:12:40.777858 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 121167us
I20260709 12:12:40.780182 21129 raft_consensus.cc:493] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:40.799520 14903 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080"
dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
mode: GRACEFUL
new_leader_uuid: "17aab1bbf5014936aa18cc21818b26ec"
 from {username='slave'} at 127.0.0.1:38628
I20260709 12:12:40.810353 14903 raft_consensus.cc:606] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 21 FOLLOWER]: Received request to transfer leadership to TS 17aab1bbf5014936aa18cc21818b26ec
W20260709 12:12:40.810667 21378 log.cc:927] Time spent T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.155s	user 0.000s	sys 0.000s
I20260709 12:12:40.812875 21372 leader_election.cc:290] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:40.814242 21034 leader_election.cc:290] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:40.598469 21253 consensus_queue.cc:260] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:40.816694 21253 raft_consensus.cc:3060] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:40.810755 14903 raft_consensus.cc:614] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 21 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:40.817924 21136 raft_consensus.cc:493] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:40.829929 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:40.793310 20916 raft_consensus.cc:493] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:40.841926 21372 raft_consensus.cc:493] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:12:40.797237 21132 consensus_queue.cc:237] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:40.842690 21372 raft_consensus.cc:515] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:40.844964 21372 leader_election.cc:290] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:40.823846 21129 raft_consensus.cc:3060] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:40.842721 20916 raft_consensus.cc:515] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:40.795804 21359 raft_consensus.cc:515] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:40.848417 20916 leader_election.cc:290] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:40.849221 14188 raft_consensus.cc:2393] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 20: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:12:40.845927 21283 raft_consensus.cc:493] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:40.851086 21283 raft_consensus.cc:515] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:40.853253 21283 leader_election.cc:290] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:12:40.855855 21353 log.cc:927] Time spent T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.750s	user 0.005s	sys 0.000s
I20260709 12:12:40.855543 21372 raft_consensus.cc:493] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:40.856843 21372 raft_consensus.cc:515] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:12:40.858253 21382 log.cc:927] Time spent T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
W20260709 12:12:40.859753 21383 log.cc:927] Time spent T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260709 12:12:40.868618 21372 leader_election.cc:290] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:12:40.870448 21370 log.cc:927] Time spent T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.354s	user 0.002s	sys 0.000s
I20260709 12:12:40.871186 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:40.872156 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:40.872876 14332 raft_consensus.cc:1240] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 22. Current term is 23. Ops: []
I20260709 12:12:40.874915 20916 raft_consensus.cc:493] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:12:40.875516 20916 raft_consensus.cc:515] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:40.876925 21266 raft_consensus.cc:493] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:40.799569 21085 leader_election.cc:290] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:40.636946 21363 raft_consensus.cc:515] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:40.883292 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:40.872908 14336 raft_consensus.cc:2468] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 24.
I20260709 12:12:40.877585 21266 raft_consensus.cc:515] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:40.935014 14903 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb"
dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
mode: GRACEFUL
new_leader_uuid: "17aab1bbf5014936aa18cc21818b26ec"
 from {username='slave'} at 127.0.0.1:38628
I20260709 12:12:40.939677 14903 raft_consensus.cc:606] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 21 FOLLOWER]: Received request to transfer leadership to TS 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:12:40.940114 14903 raft_consensus.cc:614] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 21 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:40.842136 21136 raft_consensus.cc:515] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:40.942438 20979 raft_consensus.cc:493] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:40.943192 20979 raft_consensus.cc:515] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:40.943928 21136 leader_election.cc:290] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:40.944590 21136 raft_consensus.cc:493] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:40.945614 20979 leader_election.cc:290] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:40.946640 21326 leader_election.cc:290] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:40.930267 20916 leader_election.cc:290] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:40.945111 21136 raft_consensus.cc:515] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:12:40.944454 21384 log.cc:927] Time spent T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 12:12:41.021282 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:41.044270 14257 raft_consensus.cc:1275] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:12:41.046028 21136 leader_election.cc:290] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:12:41.058629 21377 log.cc:927] Time spent T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
I20260709 12:12:41.059839 21245 raft_consensus.cc:493] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:41.060554 21245 raft_consensus.cc:515] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:41.063236 21245 leader_election.cc:290] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:41.067871 21223 raft_consensus.cc:493] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:41.068508 21223 raft_consensus.cc:515] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:41.071408 21223 leader_election.cc:290] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:41.076148 21363 leader_election.cc:290] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:41.082422 21344 leader_election.cc:290] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:41.084306 14188 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56046 (request call id 3069) took 1106 ms. Trace:
I20260709 12:12:41.086378 14184 raft_consensus.cc:1240] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:41.077373 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:41.087862 14265 raft_consensus.cc:2468] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 18.
I20260709 12:12:41.084762 14188 rpcz_store.cc:276] 0709 12:12:39.978163 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:40.371348 (+393185us) service_pool.cc:224] Handling call
0709 12:12:41.084067 (+712719us) spinlock_profiling.cc:243] Waited 477 ms on lock 0x7b54001121d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:12:41.084231 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1096151808}
I20260709 12:12:41.096982 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
W20260709 12:12:41.028828 14230 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.174.131:45957 timed out after 1.553s (SENT) [suppressed 5 similar messages]
I20260709 12:12:41.101123 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:41.111653 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:40.994634 20979 raft_consensus.cc:493] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:41.117022 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:41.117139 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:41.119808 14265 raft_consensus.cc:3060] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:41.119781 14331 raft_consensus.cc:2468] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 17.
I20260709 12:12:41.040326 21342 raft_consensus.cc:493] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:41.089084 21295 raft_consensus.cc:493] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:41.091550 21359 leader_election.cc:290] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 20 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:12:41.135174 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:41.139735 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:41.140596 14260 raft_consensus.cc:3060] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:41.147701 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 20 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:41.150655 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 23 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:41.162906 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:41.168371 14339 raft_consensus.cc:2468] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 19.
I20260709 12:12:40.790500 21270 rpcz_store.cc:276] 0709 12:12:37.943955 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:37.944167 (+   212us) service_pool.cc:224] Handling call
0709 12:12:38.010337 (+ 66170us) log.cc:844] Serialized 508 byte log entry
0709 12:12:40.590592 (+2580255us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19625,"raft.queue_time_us":157503,"raft.run_cpu_time_us":1607,"raft.run_wall_time_us":117468,"spinlock_wait_cycles":731520,"thread_start_us":231248,"threads_started":2,"wal-append.queue_time_us":185807,"wal-append.run_cpu_time_us":3263,"wal-append.run_wall_time_us":1213669}
I20260709 12:12:41.188871 21284 consensus_queue.cc:1048] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:12:41.162498 21359 raft_consensus.cc:493] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:41.210299 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:41.133661 20979 raft_consensus.cc:515] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:41.157563 21342 raft_consensus.cc:515] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:12:41.188977 21380 log.cc:927] Time spent T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.244s	user 0.001s	sys 0.001s
I20260709 12:12:41.217221 14339 raft_consensus.cc:1275] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:12:41.219314 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:41.227770 14265 raft_consensus.cc:2468] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 20.
I20260709 12:12:41.170224 21295 raft_consensus.cc:515] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:41.232542 14260 raft_consensus.cc:2468] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 21.
I20260709 12:12:41.233258 14261 raft_consensus.cc:2393] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 21: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:12:41.235644 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:41.237474 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:41.238395 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:41.239355 14261 raft_consensus.cc:3060] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:41.238827 14264 raft_consensus.cc:1240] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 20. Current term is 21. Ops: []
I20260709 12:12:41.243083 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:41.244942 14265 raft_consensus.cc:2393] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 22: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:12:41.237468 14258 raft_consensus.cc:2955] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 6 to 12, VOTER 885067a0d31741bfb5c9935788e315bf (127.12.174.129) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:12:41.251022 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:41.251989 14264 raft_consensus.cc:2393] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 18: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:12:41.212255 21359 raft_consensus.cc:515] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:41.238390 21137 raft_consensus.cc:493] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:41.241107 21344 raft_consensus.cc:493] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
W20260709 12:12:41.281451 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 252662us
I20260709 12:12:41.283592 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:41.280310 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:41.285251 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:41.285979 14265 raft_consensus.cc:2468] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 22.
W20260709 12:12:41.288058 14230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:41.245609 21253 consensus_queue.cc:1048] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 12:12:41.291531 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:41.293725 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:41.292385 14336 raft_consensus.cc:2468] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 17.
I20260709 12:12:41.298743 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:41.300254 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:41.300925 14264 raft_consensus.cc:2468] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 19.
I20260709 12:12:41.301756 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:41.305593 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:41.287649 20916 raft_consensus.cc:493] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:41.307747 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:41.308779 14264 raft_consensus.cc:1240] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:41.309706 14256 raft_consensus.cc:1240] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 19 LEADER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 12:12:41.314697 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:41.317050 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:41.318091 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:41.291404 21266 leader_election.cc:290] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:41.318826 14188 raft_consensus.cc:2468] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 23.
I20260709 12:12:41.321727 14230 leader_election.cc:304] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:41.317165 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:41.319561 14903 raft_consensus.cc:2393] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 23: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
I20260709 12:12:41.323305 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:41.324223 14182 raft_consensus.cc:2468] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 19.
I20260709 12:12:41.318109 20916 raft_consensus.cc:515] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:41.329445 20975 consensus_queue.cc:1048] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:12:41.330377 21267 consensus_queue.cc:1048] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:12:41.330864 20916 leader_election.cc:290] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:41.331655 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:12:41.332712 21394 log.cc:927] Time spent T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 12:12:41.333379 14181 raft_consensus.cc:1240] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 12:12:41.334960 14304 leader_election.cc:304] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:41.335860 14230 leader_election.cc:304] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:41.337324 14304 leader_election.cc:304] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:41.337244 21267 raft_consensus.cc:2749] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:41.432984 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:41.337584 20975 consensus_queue.cc:1048] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:12:41.329887 14257 raft_consensus.cc:2393] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 20: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
W20260709 12:12:41.439553 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 102294us
I20260709 12:12:41.326059 14303 leader_election.cc:304] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
W20260709 12:12:41.440696 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 114722us
I20260709 12:12:41.338034 20692 raft_consensus.cc:2749] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:41.347347 21359 leader_election.cc:290] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:41.349606 14073 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 35b39d0f3270452a8bd4f4b1800a837c with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:12:41.353976 20979 leader_election.cc:290] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:41.358651 21342 leader_election.cc:290] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:41.284148 21344 raft_consensus.cc:515] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:41.364665 21295 leader_election.cc:290] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:41.365851 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:41.328675 21386 raft_consensus.cc:493] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:41.311218 21326 consensus_queue.cc:1059] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.067s
I20260709 12:12:41.318186 21136 consensus_queue.cc:1059] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 16.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.060s
I20260709 12:12:41.307418 21132 consensus_queue.cc:1048] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.078s
I20260709 12:12:41.325522 14877 leader_election.cc:304] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
W20260709 12:12:41.479609 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 154164us
I20260709 12:12:41.282907 21137 raft_consensus.cc:515] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:41.389175 21396 raft_consensus.cc:493] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:41.392647 20691 leader_election.cc:290] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:41.396620 21034 consensus_queue.cc:1048] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:12:41.406152 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 23 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:41.455581 21245 raft_consensus.cc:2749] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:41.408308 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:12:41.408841 14262 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41764 (request call id 3570) took 1655 ms (client timeout 1948 ms). Trace:
I20260709 12:12:41.410326 21341 raft_consensus.cc:493] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:41.458604 21299 raft_consensus.cc:493] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:41.414731 21187 raft_consensus.cc:493] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:41.417183 14337 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50856 (request call id 2976) took 1125 ms. Trace:
I20260709 12:12:41.418848 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:41.420133 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:41.422329 14907 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba"
dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
mode: GRACEFUL
new_leader_uuid: "885067a0d31741bfb5c9935788e315bf"
 from {username='slave'} at 127.0.0.1:38628
I20260709 12:12:41.494922 14907 raft_consensus.cc:606] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 19 LEADER]: Received request to transfer leadership to TS 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:41.422585 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:41.423379 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:41.424568 21274 raft_consensus.cc:493] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:41.428516 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:41.430763 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:41.431854 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:41.498109 14187 raft_consensus.cc:2468] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 18.
I20260709 12:12:41.494396 14182 raft_consensus.cc:2468] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 18.
I20260709 12:12:41.499147 14189 raft_consensus.cc:2468] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 15.
I20260709 12:12:41.494029 14337 rpcz_store.cc:276] 0709 12:12:40.292019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:40.292405 (+   386us) service_pool.cc:224] Handling call
0709 12:12:40.292832 (+   427us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:40.328273 (+ 35441us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:40.328307 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:40.328350 (+    43us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:12:40.328390 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:41.416940 (+1088550us) spinlock_profiling.cc:243] Waited 35.2 ms on lock 0x7b54000fd2d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:12:41.416985 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:41.417105 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":80947584}
I20260709 12:12:41.438436 14261 raft_consensus.cc:2468] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 20.
I20260709 12:12:41.497668 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 23 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:41.443710 14304 leader_election.cc:304] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:41.444692 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 22 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:41.444965 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:41.442902 14303 leader_election.cc:304] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:41.450594 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 22 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:41.454557 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:41.501170 14257 raft_consensus.cc:2410] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for term 22 because replica has last-logged OpId of term: 20 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
W20260709 12:12:41.501202 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 60892us
I20260709 12:12:41.502262 14339 raft_consensus.cc:2410] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for term 22 because replica has last-logged OpId of term: 20 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
I20260709 12:12:41.472680 14330 raft_consensus.cc:1275] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 22 index: 15. (term mismatch)
W20260709 12:12:41.501541 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 58726us
W20260709 12:12:41.470232 14073 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 239997us
I20260709 12:12:41.503981 14184 raft_consensus.cc:2468] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 17.
I20260709 12:12:41.504128 14303 leader_election.cc:304] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:41.506084 21250 raft_consensus.cc:3060] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:41.506631 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:41.507843 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:41.509059 21034 raft_consensus.cc:493] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:41.477277 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:41.510609 14185 raft_consensus.cc:2410] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for term 23 because replica has last-logged OpId of term: 21 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 10.
I20260709 12:12:41.503123 14304 leader_election.cc:304] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:41.461725 21253 raft_consensus.cc:2804] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:12:41.414227 21129 raft_consensus.cc:515] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:12:41.490718 14262 rpcz_store.cc:269] 0709 12:12:39.753855 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:39.754002 (+   147us) service_pool.cc:224] Handling call
0709 12:12:41.408623 (+1654621us) spinlock_profiling.cc:243] Waited 678 ms on lock 0x7b54002c0454. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:12:41.408765 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1559757568}
I20260709 12:12:41.492966 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:41.494940 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:41.470504 21372 raft_consensus.cc:493] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:41.338958 21056 raft_consensus.cc:2749] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:12:41.419628 21109 consensus_meta.cc:287] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.842s	user 0.012s	sys 0.000s
I20260709 12:12:41.472856 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:41.503237 14330 pending_rounds.cc:85] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c: Aborting all ops after (but not including) 14
I20260709 12:12:41.506137 14256 raft_consensus.cc:1275] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 12:12:41.498519 14876 leader_election.cc:304] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:41.490355 20995 raft_consensus.cc:2804] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:12:41.533248 14330 pending_rounds.cc:107] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c: Aborting uncommitted NO_OP operation due to leader change: 21.15
I20260709 12:12:41.488767 21396 raft_consensus.cc:515] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:41.509716 21034 raft_consensus.cc:515] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:41.534277 14330 raft_consensus.cc:2889] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:41.536365 14338 raft_consensus.cc:2368] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 23. Current term is 24.
I20260709 12:12:41.510424 20691 raft_consensus.cc:2749] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:41.534487 14185 raft_consensus.cc:1275] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:12:41.521929 20692 raft_consensus.cc:2804] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:41.522055 21342 raft_consensus.cc:2749] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:41.514448 21253 raft_consensus.cc:493] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:12:41.481359 21386 raft_consensus.cc:515] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:41.555332 20995 raft_consensus.cc:697] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 21 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:12:41.524333 21245 consensus_queue.cc:1059] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.019s
I20260709 12:12:41.557847 21386 leader_election.cc:290] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:41.500759 21187 raft_consensus.cc:515] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:41.556440 20995 consensus_queue.cc:237] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:41.500185 21299 raft_consensus.cc:515] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:41.510214 21274 raft_consensus.cc:515] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:41.494010 21341 raft_consensus.cc:515] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:41.541800 20692 raft_consensus.cc:493] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:41.534605 21109 raft_consensus.cc:515] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:41.550899 21253 raft_consensus.cc:3060] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:41.533680 21372 raft_consensus.cc:515] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:41.559063 21342 raft_consensus.cc:2749] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:41.546973 21363 raft_consensus.cc:2749] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:41.541795 20691 consensus_queue.cc:1059] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.026s
I20260709 12:12:41.581326 21034 leader_election.cc:290] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:41.571808 20692 raft_consensus.cc:3060] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:12:41.595642 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:41.598924 21283 raft_consensus.cc:3055] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:41.599403 21283 raft_consensus.cc:740] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:12:41.599988 21109 leader_election.cc:290] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 22 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:41.600327 21283 consensus_queue.cc:260] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:12:41.614648 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 278863us
W20260709 12:12:41.622314 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:41.594959 21404 raft_consensus.cc:493] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:41.648586 14230 leader_election.cc:304] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:41.605266 21283 raft_consensus.cc:3060] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:41.657958 14230 leader_election.cc:304] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:41.609503 21307 raft_consensus.cc:3055] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:41.665199 14230 leader_election.cc:304] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:41.605057 21397 raft_consensus.cc:493] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:41.666507 21266 raft_consensus.cc:2749] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:12:41.675609 21402 log.cc:927] Time spent T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.136s	user 0.000s	sys 0.001s
W20260709 12:12:41.682497 21387 log.cc:927] Time spent T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.737s	user 0.003s	sys 0.000s
W20260709 12:12:41.685453 21398 log.cc:927] Time spent T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.160s	user 0.000s	sys 0.001s
I20260709 12:12:41.696153 14155 leader_election.cc:304] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:41.689926 21342 raft_consensus.cc:493] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:41.652750 21405 raft_consensus.cc:493] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:41.716362 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 20 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:41.717240 14337 raft_consensus.cc:2468] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 19.
I20260709 12:12:41.692189 14339 raft_consensus.cc:2955] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 6 to 12, VOTER 885067a0d31741bfb5c9935788e315bf (127.12.174.129) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:12:41.700455 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:41.719353 14331 raft_consensus.cc:3060] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Advancing to term 21
I20260709 12:12:41.697587 14230 leader_election.cc:304] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
W20260709 12:12:41.701529 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 198467us
W20260709 12:12:41.698633 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 192938us
I20260709 12:12:41.702592 14155 leader_election.cc:304] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:41.662721 21137 leader_election.cc:290] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:41.667109 21344 leader_election.cc:290] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:41.723984 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:41.724781 14304 leader_election.cc:304] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:41.759469 14304 leader_election.cc:304] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:41.740813 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 23 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:41.668459 21307 raft_consensus.cc:740] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:41.694181 21056 raft_consensus.cc:2749] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:12:41.750660 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 48164.7us
I20260709 12:12:41.751945 14230 leader_election.cc:304] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:41.761220 14304 leader_election.cc:304] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:41.765851 14333 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194"
dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
mode: GRACEFUL
new_leader_uuid: "885067a0d31741bfb5c9935788e315bf"
 from {username='slave'} at 127.0.0.1:50896
I20260709 12:12:41.766471 14333 raft_consensus.cc:606] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Received request to transfer leadership to TS 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:41.766873 14333 raft_consensus.cc:614] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:41.761837 14337 raft_consensus.cc:2468] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 22.
I20260709 12:12:41.765451 14155 leader_election.cc:304] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:41.777482 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:41.778592 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:41.779371 14257 raft_consensus.cc:2393] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 22: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:12:41.779920 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:41.767515 21386 raft_consensus.cc:2749] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:41.724392 21278 raft_consensus.cc:493] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:41.666201 21404 raft_consensus.cc:515] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:41.754549 21405 raft_consensus.cc:515] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:41.784049 21274 leader_election.cc:290] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:41.784296 21405 leader_election.cc:290] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:41.764818 21187 leader_election.cc:290] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:41.780575 14261 raft_consensus.cc:3060] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Advancing to term 24
I20260709 12:12:41.708343 21367 raft_consensus.cc:493] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:41.788719 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:41.785792 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:41.805291 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 23 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:41.801589 14261 raft_consensus.cc:2468] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 24.
I20260709 12:12:41.762656 21129 leader_election.cc:290] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 24 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:12:41.826730 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 74889us
I20260709 12:12:41.837391 14230 leader_election.cc:304] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:12:41.757107 20975 raft_consensus.cc:2804] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:12:41.838431 14230 leader_election.cc:304] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:41.843046 21266 raft_consensus.cc:2804] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:41.843202 21408 raft_consensus.cc:2804] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:41.843639 21266 raft_consensus.cc:493] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:41.843868 21408 raft_consensus.cc:697] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 19 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:41.844858 21408 consensus_queue.cc:237] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:41.731498 21342 raft_consensus.cc:515] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:41.847685 21372 leader_election.cc:290] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:41.769668 21137 raft_consensus.cc:2749] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:41.848096 21342 leader_election.cc:290] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:41.849104 14190 raft_consensus.cc:2468] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 22.
I20260709 12:12:41.850025 21266 raft_consensus.cc:3060] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:41.849931 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 23 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:41.850667 21341 leader_election.cc:290] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:41.788197 21344 consensus_queue.cc:1059] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 12:12:41.837764 21085 raft_consensus.cc:2749] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:41.855821 14230 leader_election.cc:304] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:12:41.856980 20916 raft_consensus.cc:2804] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:41.857375 20916 raft_consensus.cc:493] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:41.756477 21109 consensus_queue.cc:1059] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.080s
I20260709 12:12:41.857724 20916 raft_consensus.cc:3060] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:41.780634 21391 raft_consensus.cc:2804] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:41.861231 21391 raft_consensus.cc:493] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:41.862025 21391 raft_consensus.cc:3060] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:41.866127 21415 raft_consensus.cc:3060] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:41.866568 21372 raft_consensus.cc:2804] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:41.846167 21299 leader_election.cc:290] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:41.695330 21397 raft_consensus.cc:515] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:41.866864 20916 raft_consensus.cc:515] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:41.871811 21245 raft_consensus.cc:3055] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:41.872310 21245 raft_consensus.cc:740] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:41.713665 21406 consensus_queue.cc:1048] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.136s
I20260709 12:12:41.872664 20916 leader_election.cc:290] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:41.873291 20916 raft_consensus.cc:493] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:41.879935 14334 raft_consensus.cc:2468] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 22.
I20260709 12:12:41.879864 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:41.894840 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:41.910343 14186 raft_consensus.cc:3060] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:41.887198 20916 raft_consensus.cc:515] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:41.874737 21372 raft_consensus.cc:493] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:41.914692 21266 raft_consensus.cc:515] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:41.915088 20916 leader_election.cc:290] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:41.782163 21278 raft_consensus.cc:515] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:41.921705 14265 raft_consensus.cc:2468] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 23.
I20260709 12:12:41.802603 21037 raft_consensus.cc:2804] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:41.942700 14155 leader_election.cc:304] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:41.958438 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:41.944864 14331 raft_consensus.cc:2468] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 21.
I20260709 12:12:41.802978 21396 leader_election.cc:290] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:41.802809 21187 raft_consensus.cc:493] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:41.955809 14303 leader_election.cc:304] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:41.937410 21109 consensus_queue.cc:1243] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer 17aab1bbf5014936aa18cc21818b26ec log is divergent from this leader: its last log entry 19.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 12:12:41.872140 21397 leader_election.cc:290] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:41.911919 21085 raft_consensus.cc:493] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:41.892019 20975 raft_consensus.cc:493] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:41.954458 21372 raft_consensus.cc:3060] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:41.966475 20916 raft_consensus.cc:493] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:12:41.989533 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 23 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:41.954437 21137 raft_consensus.cc:493] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
W20260709 12:12:42.001377 21413 log.cc:927] Time spent T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:12:42.002560 21342 raft_consensus.cc:2804] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:12:42.003491 21404 leader_election.cc:290] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:41.995115 20975 raft_consensus.cc:3060] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:41.988812 21037 raft_consensus.cc:697] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 20 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:12:41.926951 21391 raft_consensus.cc:515] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:12:42.083318 21373 log.cc:927] Time spent T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 1.314s	user 0.006s	sys 0.007s
I20260709 12:12:42.084479 21391 leader_election.cc:290] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:41.988574 21187 raft_consensus.cc:515] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:42.084899 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:42.087323 21187 leader_election.cc:290] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:42.087602 21307 consensus_queue.cc:260] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:42.006964 21085 raft_consensus.cc:515] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:42.089154 21307 raft_consensus.cc:3060] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:42.090165 21085 leader_election.cc:290] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:42.017678 21253 raft_consensus.cc:515] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:42.090862 21278 leader_election.cc:290] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:42.092252 21253 leader_election.cc:290] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 23 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:41.964893 21129 raft_consensus.cc:493] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:12:42.095777 21129 raft_consensus.cc:515] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:41.974926 21176 raft_consensus.cc:2749] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:41.990492 21344 raft_consensus.cc:493] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:12:42.098398 21344 raft_consensus.cc:515] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:41.827028 21367 raft_consensus.cc:515] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:42.102626 21129 leader_election.cc:290] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:42.067996 14877 leader_election.cc:304] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:12:41.977236 21034 consensus_queue.cc:1048] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.052s
I20260709 12:12:42.085026 21037 consensus_queue.cc:237] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:42.079548 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:42.088114 14335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50858 (request call id 2466) took 1917 ms. Trace:
I20260709 12:12:42.053637 14304 leader_election.cc:304] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
W20260709 12:12:42.112753 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 44836.1us
I20260709 12:12:42.113327 14334 raft_consensus.cc:2468] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 21.
I20260709 12:12:42.047395 20916 raft_consensus.cc:515] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:42.113477 14335 rpcz_store.cc:276] 0709 12:12:40.170225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:40.170367 (+   142us) service_pool.cc:224] Handling call
0709 12:12:40.178231 (+  7864us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:40.181971 (+  3740us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:40.182002 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:40.182482 (+   480us) log.cc:844] Serialized 26 byte log entry
0709 12:12:40.380944 (+198462us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:12:40.380993 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:40.381074 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:41.995423 (+1614349us) spinlock_profiling.cc:243] Waited 10.4 ms on lock 0x7b4400022b4c. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2123f74c85 00007f2123f756a2 00007f2126ce71db 00007f2126ce2aaf 00007f2126cd686e 00007f2126cd5bb6 00007f2126cd57d8 00007f2126cdf221 00007f2126cdf1d9 00007f2126cdf169
0709 12:12:42.087785 (+ 92362us) raft_consensus.cc:1685] finished
0709 12:12:42.087810 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:42.088044 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2152,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":6157,"spinlock_wait_cycles":23949696,"thread_start_us":176994,"threads_started":1,"wal-append.queue_time_us":389013}
I20260709 12:12:42.124161 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:42.118481 14877 leader_election.cc:304] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec
W20260709 12:12:42.130028 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 76501.1us
I20260709 12:12:42.114056 21391 raft_consensus.cc:493] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:42.118330 20934 raft_consensus.cc:2804] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:42.136950 14877 leader_election.cc:304] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:42.128579 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:42.110879 14186 raft_consensus.cc:2468] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 24.
I20260709 12:12:42.131260 14304 leader_election.cc:304] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:12:42.154495 14304 leader_election.cc:304] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:42.156962 14230 leader_election.cc:304] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:42.159827 14265 raft_consensus.cc:1275] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 12:12:42.161711 14261 raft_consensus.cc:1275] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:12:42.165628 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 25 candidate_status { last_received { term: 22 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:42.166603 14334 raft_consensus.cc:2410] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for term 25 because replica has last-logged OpId of term: 23 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 10.
I20260709 12:12:42.069826 21137 raft_consensus.cc:515] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:42.114739 21342 raft_consensus.cc:697] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 22 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:42.132001 21422 raft_consensus.cc:493] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:42.172464 14230 leader_election.cc:304] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:42.168048 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:42.175782 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:42.116322 21253 raft_consensus.cc:493] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:42.188342 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:42.150859 21417 raft_consensus.cc:2749] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:42.181882 21122 raft_consensus.cc:2804] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:12:42.155858 21034 raft_consensus.cc:493] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:42.132120 21391 raft_consensus.cc:515] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:42.155547 20934 raft_consensus.cc:493] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:42.163232 21369 raft_consensus.cc:2804] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:12:42.171128 21266 leader_election.cc:290] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:42.178042 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:42.198944 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:42.116106 21372 raft_consensus.cc:515] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:42.186105 21408 raft_consensus.cc:2804] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:42.194379 21122 raft_consensus.cc:493] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:42.187093 21314 raft_consensus.cc:2749] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:42.203111 20934 raft_consensus.cc:3060] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:42.222193 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:42.203290 21369 raft_consensus.cc:493] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:42.229133 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:42.205356 21129 raft_consensus.cc:493] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:42.183971 21422 raft_consensus.cc:515] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:42.230024 14336 raft_consensus.cc:2468] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 16.
W20260709 12:12:42.230664 20692 consensus_meta.cc:287] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.625s	user 0.010s	sys 0.001s
I20260709 12:12:42.236801 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:42.213469 21408 raft_consensus.cc:493] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:42.241756 14336 raft_consensus.cc:2468] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 15.
I20260709 12:12:42.194841 21253 raft_consensus.cc:515] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:42.203229 21034 raft_consensus.cc:515] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:42.237820 14155 leader_election.cc:304] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:42.227977 21417 raft_consensus.cc:2804] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:12:42.217142 21122 raft_consensus.cc:3060] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:42.228590 21369 raft_consensus.cc:3060] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:42.249249 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:42.268755 14334 raft_consensus.cc:2468] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 19.
I20260709 12:12:42.265893 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:42.273250 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:12:42.266139 21414 log.cc:927] Time spent T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.196s	user 0.000s	sys 0.001s
W20260709 12:12:42.247546 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 291787us
W20260709 12:12:42.268008 21389 log.cc:927] Time spent T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 1.318s	user 0.000s	sys 0.006s
I20260709 12:12:42.280822 21267 raft_consensus.cc:3055] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:12:42.279287 14155 leader_election.cc:304] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:42.239490 21425 raft_consensus.cc:2804] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:12:42.275789 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:42.245988 21408 raft_consensus.cc:3060] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:42.246709 21367 leader_election.cc:290] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:42.289502 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:42.238309 21129 raft_consensus.cc:515] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:42.291985 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:42.295771 21391 leader_election.cc:290] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:42.296811 21372 leader_election.cc:290] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 17 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:42.286120 21176 raft_consensus.cc:2804] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:42.298157 21404 raft_consensus.cc:2804] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:42.245950 20692 raft_consensus.cc:515] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:42.274399 21052 consensus_queue.cc:1048] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.027s
I20260709 12:12:42.292735 21425 raft_consensus.cc:493] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:42.299571 14905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53200 (request call id 924) took 1769 ms. Trace:
I20260709 12:12:42.304086 14330 raft_consensus.cc:2468] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 21.
I20260709 12:12:42.297686 20916 leader_election.cc:290] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:42.289552 21267 raft_consensus.cc:740] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:42.298337 21137 leader_election.cc:290] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:42.313202 14905 rpcz_store.cc:276] 0709 12:12:40.530093 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:40.554417 (+ 24324us) service_pool.cc:224] Handling call
0709 12:12:40.554943 (+   526us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:12:40.570431 (+ 15488us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:40.570464 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:12:40.575501 (+  5037us) log.cc:844] Serialized 52 byte log entry
0709 12:12:40.798830 (+223329us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:40.798871 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:40.798935 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:42.179062 (+1380127us) spinlock_profiling.cc:243] Waited 16.6 ms on lock 0x7b4400022b4c. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2123f74c85 00007f2123f756a2 00007f2126ce71db 00007f2126ce2aaf 00007f2126cd686e 00007f2126cd5bb6 00007f2126cd57d8 00007f2126cdf221 00007f2126cdf1d9 00007f2126cdf169
0709 12:12:42.299250 (+120188us) raft_consensus.cc:1685] finished
0709 12:12:42.299273 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:42.299500 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21020,"raft.queue_time_us":18230,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":13418,"spinlock_wait_cycles":38347264,"thread_start_us":191494,"threads_started":1,"wal-append.queue_time_us":354505}
I20260709 12:12:42.311331 21404 raft_consensus.cc:493] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:42.315419 21425 raft_consensus.cc:3060] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:42.310175 21176 raft_consensus.cc:493] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:42.239624 21342 consensus_queue.cc:237] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:42.407092 21122 raft_consensus.cc:515] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:42.386508 14260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41764 (request call id 3584) took 1144 ms. Trace:
W20260709 12:12:42.397878 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 228229us
I20260709 12:12:42.386493 14336 raft_consensus.cc:2468] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 18.
I20260709 12:12:42.315675 21415 raft_consensus.cc:2749] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:42.387312 21136 raft_consensus.cc:2749] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:42.409588 21176 raft_consensus.cc:3060] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:42.416242 21344 leader_election.cc:290] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:42.417861 21122 leader_election.cc:290] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 23 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:42.421566 21397 raft_consensus.cc:493] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:42.422145 21397 raft_consensus.cc:515] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:42.424276 21397 leader_election.cc:290] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:42.427208 21422 leader_election.cc:290] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:42.427223 14258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53050 (request call id 1391) took 1288 ms. Trace:
I20260709 12:12:42.429919 21129 leader_election.cc:290] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:42.429363 14258 rpcz_store.cc:276] 0709 12:12:41.139243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:41.141919 (+  2676us) service_pool.cc:224] Handling call
0709 12:12:41.142318 (+   399us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:41.237338 (+ 95020us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:12:41.452023 (+214685us) log.cc:844] Serialized 14 byte log entry
0709 12:12:41.655694 (+203671us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:41.655755 (+    61us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:41.655812 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:42.426968 (+771156us) spinlock_profiling.cc:243] Waited 94.8 ms on lock 0x7b54002224d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:12:42.427026 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:42.427161 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":190,"raft.queue_time_us":1801,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":2250,"spinlock_wait_cycles":217976192,"thread_start_us":201392,"threads_started":1,"wal-append.queue_time_us":350927}
I20260709 12:12:42.431190 20692 leader_election.cc:290] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 20 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:42.433012 14303 leader_election.cc:304] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
W20260709 12:12:42.435725 14338 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50856 (request call id 2989) took 1639 ms (client timeout 1647 ms). Trace:
W20260709 12:12:42.436232 14338 rpcz_store.cc:269] 0709 12:12:40.795831 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:40.796136 (+   305us) service_pool.cc:224] Handling call
0709 12:12:42.435426 (+1639290us) spinlock_profiling.cc:243] Waited 739 ms on lock 0x7b540023a854. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:12:42.435593 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1699734400}
I20260709 12:12:42.438081 20975 raft_consensus.cc:515] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:42.436793 14188 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56652 (request call id 1704) took 1011 ms. Trace:
I20260709 12:12:42.440626 14188 rpcz_store.cc:276] 0709 12:12:41.425173 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:41.524893 (+ 99720us) service_pool.cc:224] Handling call
0709 12:12:41.525205 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:41.551411 (+ 26206us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:41.551443 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:41.551487 (+    44us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:12:41.551525 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:42.436529 (+885004us) spinlock_profiling.cc:243] Waited 26 ms on lock 0x7b54003b2254. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:12:42.436582 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:42.436722 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":59797376}
I20260709 12:12:42.444900 14905 raft_consensus.cc:1240] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 23 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 22. Current term is 23. Ops: [22.15-22.15]
I20260709 12:12:42.445449 21251 leader_election.cc:290] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:42.446172 14908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:42.448441 21363 raft_consensus.cc:493] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:42.449018 21363 raft_consensus.cc:515] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:42.450699 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:42.453365 21386 raft_consensus.cc:493] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:42.454002 21386 raft_consensus.cc:515] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:42.454432 14908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:42.455758 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:42.457125 14907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:42.454026 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:42.458078 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:42.458979 14907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:42.459437 21386 leader_election.cc:290] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:42.390097 21034 leader_election.cc:290] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:42.449388 14154 leader_election.cc:304] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:42.409394 14260 rpcz_store.cc:276] 0709 12:12:41.242582 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:41.243669 (+  1087us) service_pool.cc:224] Handling call
0709 12:12:41.244545 (+   876us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:41.245272 (+   727us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 12:12:41.273114 (+ 27842us) log.cc:844] Serialized 14 byte log entry
0709 12:12:41.999380 (+726266us) spinlock_profiling.cc:243] Waited 2.95 ms on lock 0x7b180026b840. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f212cf16ab1 00007f212cf23281 00007f2124030e07 00007f212ce8b9a9 00007f212404d69b 00007f212404b93f 00007f212404dc02 00007f2126cd520b 00007f2126cdad23 00007f2126cdb23a 00007f2127145a2a
0709 12:12:42.386050 (+386670us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:42.386129 (+    79us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:12:42.386183 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:42.386281 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:42.386435 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22510,"prepare.queue_time_us":30209,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":51,"raft.queue_time_us":1014,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":9193,"spinlock_wait_cycles":6793472,"thread_start_us":347039,"threads_started":1}
I20260709 12:12:42.473063 14907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 23 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:42.403995 21404 raft_consensus.cc:3060] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:42.489024 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:42.474011 14337 raft_consensus.cc:2468] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 20.
I20260709 12:12:42.494318 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:42.495136 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:42.496919 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:42.497121 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:42.498303 14189 raft_consensus.cc:1275] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 12:12:42.498951 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:42.502980 14260 raft_consensus.cc:2468] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 21.
I20260709 12:12:42.500658 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:42.499931 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:42.514122 14907 raft_consensus.cc:2393] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 23: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
I20260709 12:12:42.514559 14906 raft_consensus.cc:2393] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 23: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
I20260709 12:12:42.516693 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:42.517481 14190 raft_consensus.cc:3060] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:42.518131 14185 raft_consensus.cc:2393] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 17: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:12:42.520267 14155 leader_election.cc:304] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:42.520601 14188 raft_consensus.cc:1275] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:12:42.468638 20975 leader_election.cc:290] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 24 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:42.537061 14906 raft_consensus.cc:1275] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 21 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 12:12:42.538843 20979 raft_consensus.cc:3055] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:42.539326 20979 raft_consensus.cc:740] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:42.539469 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:42.541944 14330 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c"
dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
mode: GRACEFUL
new_leader_uuid: "885067a0d31741bfb5c9935788e315bf"
 from {username='slave'} at 127.0.0.1:50896
I20260709 12:12:42.542769 14330 raft_consensus.cc:606] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Received request to transfer leadership to TS 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:42.543141 14330 raft_consensus.cc:614] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:12:42.543625 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 110709us
W20260709 12:12:42.548035 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 82460.1us
I20260709 12:12:42.566498 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:42.551366 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:42.576632 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:42.544204 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:42.519990 21363 leader_election.cc:290] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:42.588451 14907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:42.590029 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:42.493441 21386 raft_consensus.cc:2749] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:42.598555 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:12:42.573621 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 45984.1us
W20260709 12:12:42.601136 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 80941.7us
I20260709 12:12:42.602042 14155 leader_election.cc:304] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:42.603201 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:42.603933 14188 raft_consensus.cc:2468] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 18.
I20260709 12:12:42.606243 14229 leader_election.cc:304] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:42.606307 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:42.607739 14229 leader_election.cc:304] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:42.608390 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 23 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:42.631047 14877 leader_election.cc:304] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:42.624190 14184 raft_consensus.cc:2468] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 23.
I20260709 12:12:42.622419 14229 leader_election.cc:304] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:42.633389 14256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41764 (request call id 3594) took 1319 ms. Trace:
W20260709 12:12:42.563760 21400 log.cc:927] Time spent T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 1.037s	user 0.000s	sys 0.003s
I20260709 12:12:42.614785 14189 raft_consensus.cc:1240] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:42.635053 14263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53050 (request call id 1393) took 1490 ms. Trace:
I20260709 12:12:42.545317 20692 raft_consensus.cc:2749] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:42.630730 12986 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:12:42.626472 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 23 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:42.633854 14256 rpcz_store.cc:276] 0709 12:12:41.313859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:41.315698 (+  1839us) service_pool.cc:224] Handling call
0709 12:12:41.501293 (+185595us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:41.533527 (+ 32234us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:42.633163 (+1099636us) spinlock_profiling.cc:243] Waited 173 ms on lock 0x7b54002c0950. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713a8ad 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:12:42.633316 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":397718400}
I20260709 12:12:42.642948 14907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:42.731307 14330 raft_consensus.cc:3060] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:42.635463 14263 rpcz_store.cc:276] 0709 12:12:41.144519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:41.144963 (+   444us) service_pool.cc:224] Handling call
0709 12:12:41.145347 (+   384us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:41.145831 (+   484us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:41.145864 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:41.146503 (+   639us) log.cc:844] Serialized 26 byte log entry
0709 12:12:41.292993 (+146490us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:12:41.648925 (+355932us) log.cc:844] Serialized 14 byte log entry
0709 12:12:41.650701 (+  1776us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:41.651808 (+  1107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:42.563124 (+911316us) spinlock_profiling.cc:243] Waited 2.67 ms on lock 0x7b4400022b4c. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2123f74c85 00007f2123f756a2 00007f2126ce71db 00007f2126ce2aaf 00007f2126cd686e 00007f2126cd5bb6 00007f2126cd57d8 00007f2126cdf221 00007f2126cdf1d9 00007f2126cdf169
0709 12:12:42.634773 (+ 71649us) raft_consensus.cc:1685] finished
0709 12:12:42.634877 (+   104us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:42.634996 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36,"prepare.queue_time_us":70246,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":51,"raft.queue_time_us":531,"raft.run_cpu_time_us":253,"raft.run_wall_time_us":5840,"spinlock_wait_cycles":6135680,"thread_start_us":435343,"threads_started":2,"wal-append.queue_time_us":335630}
I20260709 12:12:42.545811 21372 raft_consensus.cc:493] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:42.611316 21326 raft_consensus.cc:2749] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:12:42.670332 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 74766.6us
I20260709 12:12:42.739198 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:42.685791 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:12:42.735462 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 93068.2us
I20260709 12:12:42.685009 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:12:42.727593 21307 consensus_meta.cc:287] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.637s	user 0.010s	sys 0.013s
I20260709 12:12:42.598917 20916 raft_consensus.cc:493] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:42.666046 20979 consensus_queue.cc:260] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:42.677523 21408 raft_consensus.cc:515] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:42.717231 20691 consensus_queue.cc:1048] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
W20260709 12:12:42.679563 21428 log.cc:927] Time spent T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.280s	user 0.002s	sys 0.000s
I20260709 12:12:42.497088 21267 consensus_queue.cc:260] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:42.682833 21251 raft_consensus.cc:2804] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:42.684741 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:42.611251 21275 raft_consensus.cc:2804] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:12:42.717231 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:42.611796 21314 raft_consensus.cc:2749] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:42.718907 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:42.721390 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:42.720227 14876 leader_election.cc:304] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:12:42.724370 14257 raft_consensus.cc:1240] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:42.568372 21369 raft_consensus.cc:515] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:42.671149 20547 raft_consensus.cc:2749] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:42.668180 21253 leader_election.cc:290] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:42.740193 14258 raft_consensus.cc:2468] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 19.
I20260709 12:12:42.553614 21367 consensus_queue.cc:1048] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.119s
I20260709 12:12:42.805754 21176 raft_consensus.cc:515] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:42.809175 21369 leader_election.cc:290] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 23 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:42.810510 21176 leader_election.cc:290] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:42.747112 14333 raft_consensus.cc:1275] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 12:12:42.715212 14190 raft_consensus.cc:2468] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 20.
I20260709 12:12:42.819713 21052 raft_consensus.cc:493] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:12:42.820395 21052 raft_consensus.cc:515] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:42.822651 21052 leader_election.cc:290] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:42.823128 21052 raft_consensus.cc:493] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:42.823590 21052 raft_consensus.cc:515] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:42.827620 21425 raft_consensus.cc:515] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:42.636430 21391 raft_consensus.cc:2804] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:42.828900 21391 raft_consensus.cc:493] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:42.829329 21391 raft_consensus.cc:3060] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:42.591904 21417 raft_consensus.cc:697] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 24 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:42.740072 14181 raft_consensus.cc:2468] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 23.
I20260709 12:12:42.750101 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:12:42.765098 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 73897.5us
I20260709 12:12:42.770087 14877 leader_election.cc:304] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:42.787525 14260 raft_consensus.cc:2468] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 19.
I20260709 12:12:42.792366 21187 raft_consensus.cc:493] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:42.793838 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 73730.9us
I20260709 12:12:42.837159 14304 leader_election.cc:304] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
W20260709 12:12:42.840011 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 70031.2us
I20260709 12:12:42.840399 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:42.801635 14336 raft_consensus.cc:1275] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 12. (term mismatch)
W20260709 12:12:42.788244 21438 log.cc:927] Time spent T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
W20260709 12:12:42.769517 20934 consensus_meta.cc:287] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db: Time spent flushing consensus metadata: real 0.536s	user 0.003s	sys 0.013s
I20260709 12:12:42.742400 21372 raft_consensus.cc:515] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:42.804455 21278 raft_consensus.cc:2804] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:42.811122 21408 leader_election.cc:290] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 21 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:42.739641 14303 leader_election.cc:304] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:42.747330 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:42.841560 14336 pending_rounds.cc:85] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c: Aborting all ops after (but not including) 11
W20260709 12:12:42.862498 14228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:42.790956 21275 raft_consensus.cc:493] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:42.851123 14330 raft_consensus.cc:2468] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 23.
I20260709 12:12:42.762338 21109 raft_consensus.cc:493] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:42.845353 14304 leader_election.cc:304] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:12:42.862672 14337 raft_consensus.cc:2468] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 17.
I20260709 12:12:42.862938 14336 pending_rounds.cc:107] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c: Aborting uncommitted NO_OP operation due to leader change: 18.12
I20260709 12:12:42.879659 14336 raft_consensus.cc:2889] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:42.876336 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:42.880143 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:42.877931 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:42.880820 14337 raft_consensus.cc:3060] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:42.803735 20916 raft_consensus.cc:515] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:42.855830 21278 raft_consensus.cc:493] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:42.883154 21278 raft_consensus.cc:3060] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:42.881448 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:42.881492 14262 raft_consensus.cc:2468] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 17.
I20260709 12:12:42.849170 21434 raft_consensus.cc:493] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:12:42.825682 21052 leader_election.cc:290] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:12:42.883929 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 144366us
I20260709 12:12:42.888415 14304 leader_election.cc:304] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:42.889602 14303 leader_election.cc:304] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:42.843333 21251 raft_consensus.cc:493] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:42.890901 21251 raft_consensus.cc:3060] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:42.886984 14334 raft_consensus.cc:2393] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 24: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:12:42.844364 21253 raft_consensus.cc:2749] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:42.877452 20979 raft_consensus.cc:3060] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:42.876529 21284 raft_consensus.cc:2804] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 12:12:42.905023 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 282671us
I20260709 12:12:42.907351 14303 leader_election.cc:304] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:42.910554 14304 leader_election.cc:304] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:42.879033 21275 raft_consensus.cc:3060] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:42.916507 14303 leader_election.cc:304] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:42.865113 20934 raft_consensus.cc:515] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:42.864395 21307 consensus_queue.cc:1059] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.049s
I20260709 12:12:42.854554 21129 consensus_queue.cc:1048] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.063s
I20260709 12:12:42.919472 14229 leader_election.cc:304] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:42.910012 21371 raft_consensus.cc:993] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db: : Instructing follower 885067a0d31741bfb5c9935788e315bf to start an election
I20260709 12:12:42.919183 14303 leader_election.cc:304] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:42.932154 14303 leader_election.cc:304] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:42.933815 14229 leader_election.cc:304] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:42.921695 14154 leader_election.cc:304] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:42.848642 21187 raft_consensus.cc:515] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:42.894057 21367 raft_consensus.cc:2749] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:42.909356 21435 raft_consensus.cc:2804] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:42.934965 14337 raft_consensus.cc:2468] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 18.
I20260709 12:12:42.937844 14330 raft_consensus.cc:2468] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 24.
I20260709 12:12:42.888187 21109 raft_consensus.cc:515] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:42.913199 21284 raft_consensus.cc:493] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:42.943460 14229 leader_election.cc:304] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:42.914146 21436 raft_consensus.cc:2804] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:12:42.920378 21431 raft_consensus.cc:2749] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:42.920163 21415 raft_consensus.cc:2749] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:42.985425 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:42.913693 21176 consensus_queue.cc:1059] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.050s
I20260709 12:12:42.920120 21253 raft_consensus.cc:2804] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:42.894493 21434 raft_consensus.cc:515] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:42.904851 21404 raft_consensus.cc:515] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:42.998140 20916 leader_election.cc:290] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:42.943819 21408 raft_consensus.cc:2804] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:42.943527 14154 leader_election.cc:304] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:42.943907 20995 raft_consensus.cc:1081] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 19 LEADER]: Signalling peer 885067a0d31741bfb5c9935788e315bf to start an election
W20260709 12:12:42.997876 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:42.908118 21342 consensus_queue.cc:1048] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.031s
I20260709 12:12:42.940611 20692 raft_consensus.cc:2749] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:43.001221 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:43.040071 14256 raft_consensus.cc:3060] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:42.943956 21037 raft_consensus.cc:2749] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:42.966112 21284 raft_consensus.cc:3060] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:42.917521 21417 consensus_queue.cc:237] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:42.977574 21372 leader_election.cc:290] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:42.978436 21425 leader_election.cc:290] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 24 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:43.053447 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:12:43.014357 21439 log.cc:927] Time spent T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
W20260709 12:12:42.990672 21441 log.cc:927] Time spent T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:12:42.967904 21314 raft_consensus.cc:2749] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:43.018206 14261 raft_consensus.cc:2468] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 17.
I20260709 12:12:43.015267 14336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50856 (request call id 3006) took 1018 ms. Trace:
I20260709 12:12:43.059489 14336 rpcz_store.cc:276] 0709 12:12:41.997322 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:42.411349 (+414027us) service_pool.cc:224] Handling call
0709 12:12:42.411697 (+   348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:42.880170 (+468473us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:43.014993 (+134823us) spinlock_profiling.cc:243] Waited 382 ms on lock 0x7b5400338e54. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:12:43.015189 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":877779200}
W20260709 12:12:43.022119 14154 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 78690us
I20260709 12:12:43.030813 14331 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50856 (request call id 3002) took 1073 ms. Trace:
I20260709 12:12:43.063774 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:43.063946 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:43.064844 14190 raft_consensus.cc:1240] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 20 LEADER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:43.066002 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:43.067541 14189 raft_consensus.cc:1240] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 16. Current term is 17. Ops: []
W20260709 12:12:43.002921 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 44155.4us
I20260709 12:12:43.068825 14303 leader_election.cc:304] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:43.070166 14303 leader_election.cc:304] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:42.965251 21435 raft_consensus.cc:493] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
W20260709 12:12:43.048336 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 184257us
I20260709 12:12:43.054260 14257 raft_consensus.cc:2468] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 21.
I20260709 12:12:42.961853 21344 raft_consensus.cc:493] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
W20260709 12:12:43.052801 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 201909us
I20260709 12:12:43.002962 21266 raft_consensus.cc:2804] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:43.022315 21386 raft_consensus.cc:2749] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:42.990645 21430 raft_consensus.cc:2749] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:12:43.002552 21408 raft_consensus.cc:493] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:43.005348 21404 leader_election.cc:290] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 16 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:43.005371 21434 leader_election.cc:290] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:43.077512 14265 raft_consensus.cc:1240] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:43.077795 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:43.078559 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:43.079250 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:43.004977 20934 leader_election.cc:290] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 20 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:43.006264 21109 leader_election.cc:290] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:43.014746 21253 raft_consensus.cc:697] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 17 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:43.120631 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:43.064114 14331 rpcz_store.cc:276] 0709 12:12:41.957900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:41.987695 (+ 29795us) service_pool.cc:224] Handling call
0709 12:12:43.030560 (+1042865us) spinlock_profiling.cc:243] Waited 740 ms on lock 0x7b540023a354. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:12:43.030740 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1702705024}
I20260709 12:12:43.121856 14337 raft_consensus.cc:1240] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 22. Current term is 23. Ops: [22.15-22.15]
I20260709 12:12:42.968761 21137 consensus_queue.cc:1048] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.086s
I20260709 12:12:43.006916 21436 raft_consensus.cc:697] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 23 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:43.117192 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:12:43.087406 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 118002us
I20260709 12:12:43.082715 21408 raft_consensus.cc:3060] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:43.121402 14181 raft_consensus.cc:2468] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 18.
I20260709 12:12:43.126570 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:43.131512 14189 raft_consensus.cc:3060] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:43.133869 14264 raft_consensus.cc:1275] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 12:12:43.087828 21371 consensus_queue.cc:1059] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.053s
I20260709 12:12:43.147495 21251 raft_consensus.cc:515] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:43.238365 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:43.243425 14181 raft_consensus.cc:2468] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 21.
I20260709 12:12:43.152170 14332 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50856 (request call id 3004) took 1174 ms. Trace:
I20260709 12:12:43.234980 14304 leader_election.cc:304] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:12:43.130144 14188 raft_consensus.cc:2468] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 17.
I20260709 12:12:43.081396 21085 consensus_queue.cc:1048] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.080s
I20260709 12:12:43.157902 21275 raft_consensus.cc:515] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:43.122531 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:43.080040 21425 raft_consensus.cc:2749] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:12:43.215147 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 47287us
I20260709 12:12:43.085219 21435 raft_consensus.cc:3060] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:43.224437 14256 raft_consensus.cc:2468] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 24.
I20260709 12:12:43.227843 14877 leader_election.cc:304] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:43.117304 21372 raft_consensus.cc:2749] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:43.230001 14337 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50858 (request call id 2496) took 1004 ms. Trace:
I20260709 12:12:43.087877 21437 raft_consensus.cc:493] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:43.235761 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:43.241519 14333 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50858 (request call id 2484) took 1117 ms. Trace:
I20260709 12:12:43.234488 14263 raft_consensus.cc:1240] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:43.092587 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:43.246855 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:43.274654 14183 raft_consensus.cc:2393] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 24: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:12:43.272982 14333 rpcz_store.cc:276] 0709 12:12:42.125845 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:42.469192 (+343347us) service_pool.cc:224] Handling call
0709 12:12:42.746694 (+277502us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:42.812074 (+ 65380us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:43.231439 (+419365us) spinlock_profiling.cc:243] Waited 277 ms on lock 0x7b540001b650. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713a8ad 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:12:43.241429 (+  9990us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":637300480}
I20260709 12:12:43.246790 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:43.275879 14188 raft_consensus.cc:3060] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Advancing to term 24
W20260709 12:12:43.276976 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 49240.6us
I20260709 12:12:43.249840 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:43.279325 14187 raft_consensus.cc:2468] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 21.
I20260709 12:12:43.084784 21052 raft_consensus.cc:2804] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:43.252542 14181 raft_consensus.cc:1275] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 12:12:43.253340 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:43.252171 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:43.261303 14304 leader_election.cc:304] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:12:43.088361 21344 raft_consensus.cc:515] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:43.259425 21444 raft_consensus.cc:3055] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:12:43.292382 21444 raft_consensus.cc:740] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:12:43.266610 14337 rpcz_store.cc:276] 0709 12:12:42.225307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:42.964223 (+738916us) service_pool.cc:224] Handling call
0709 12:12:42.964552 (+   329us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:43.122294 (+157742us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:43.229714 (+107420us) spinlock_profiling.cc:243] Waited 157 ms on lock 0x7b54002819d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:12:43.229938 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":361148288}
I20260709 12:12:43.267728 14229 leader_election.cc:304] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:43.244355 14332 rpcz_store.cc:276] 0709 12:12:41.977438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:42.311341 (+333903us) service_pool.cc:224] Handling call
0709 12:12:42.325690 (+ 14349us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:12:42.394513 (+ 68823us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:42.394552 (+    39us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:12:42.404747 (+ 10195us) log.cc:844] Serialized 52 byte log entry
0709 12:12:42.715831 (+311084us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:42.715870 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:42.715932 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:43.151595 (+435663us) raft_consensus.cc:1685] finished
0709 12:12:43.151637 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:43.152005 (+   368us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":42809,"raft.queue_time_us":82201,"raft.run_cpu_time_us":210,"raft.run_wall_time_us":44296,"thread_start_us":310667,"threads_started":1,"wal-append.queue_time_us":479322}
I20260709 12:12:43.295078 14229 leader_election.cc:304] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:43.213913 20692 raft_consensus.cc:493] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:43.214145 21109 raft_consensus.cc:493] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:12:43.269028 14257 raft_consensus.cc:1240] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:43.270182 14912 raft_consensus.cc:1240] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 23 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 22. Current term is 23. Ops: [22.15-22.15]
I20260709 12:12:43.270717 14264 raft_consensus.cc:1275] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 12:12:43.241959 21406 raft_consensus.cc:493] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:43.243876 21363 raft_consensus.cc:493] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:43.305966 14229 leader_election.cc:304] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:43.306975 14229 leader_election.cc:304] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:43.285621 14189 raft_consensus.cc:2468] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 18.
W20260709 12:12:43.275671 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 193610us
I20260709 12:12:43.253192 21415 raft_consensus.cc:2804] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:12:43.287119 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:43.286463 21037 consensus_queue.cc:1048] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.003s
I20260709 12:12:43.290766 21344 leader_election.cc:290] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:43.311066 14229 leader_election.cc:304] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:43.317266 14188 raft_consensus.cc:2468] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 24.
I20260709 12:12:43.316859 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:43.319136 14263 raft_consensus.cc:2468] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 22.
I20260709 12:12:43.320941 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 25 candidate_status { last_received { term: 22 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:43.322744 14265 raft_consensus.cc:2410] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for term 25 because replica has last-logged OpId of term: 23 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 10.
I20260709 12:12:43.323941 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:43.309496 21415 raft_consensus.cc:493] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:43.324721 21056 raft_consensus.cc:2804] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:43.325148 21415 raft_consensus.cc:3060] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:43.325371 21056 raft_consensus.cc:697] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 18 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:43.326416 21056 consensus_queue.cc:237] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:43.330458 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:43.331158 14256 raft_consensus.cc:2468] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 21.
I20260709 12:12:43.317054 20979 raft_consensus.cc:493] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:43.309450 20692 raft_consensus.cc:515] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:43.334817 21251 leader_election.cc:290] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:43.335297 20692 leader_election.cc:290] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:43.309689 21109 raft_consensus.cc:515] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:43.336644 21275 leader_election.cc:290] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 22 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:43.337507 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:43.337934 14331 raft_consensus.cc:2468] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 22.
I20260709 12:12:43.333078 20979 raft_consensus.cc:515] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:43.339936 21449 consensus_queue.cc:1059] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.019s
I20260709 12:12:43.340704 21109 leader_election.cc:290] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:43.341302 21449 raft_consensus.cc:3055] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:43.341854 21455 consensus_queue.cc:1048] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.020s
I20260709 12:12:43.342080 21436 consensus_queue.cc:237] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:43.282891 21437 raft_consensus.cc:515] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:43.346760 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:43.340255 20979 leader_election.cc:290] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:43.308154 21367 raft_consensus.cc:2804] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:12:43.341328 21109 raft_consensus.cc:493] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:43.309782 21136 raft_consensus.cc:2749] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:43.370235 21406 raft_consensus.cc:515] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:43.341821 21449 raft_consensus.cc:740] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:12:43.304543 21326 raft_consensus.cc:2749] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:43.303692 21342 raft_consensus.cc:493] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:43.427438 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:43.379773 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:43.380517 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:43.429136 14256 raft_consensus.cc:2468] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 22.
I20260709 12:12:43.380622 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:43.362535 21446 raft_consensus.cc:2749] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:12:43.372361 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 49908.9us
I20260709 12:12:43.430462 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:43.322305 21314 raft_consensus.cc:2804] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 12:12:43.395231 21452 log.cc:927] Time spent T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
I20260709 12:12:43.396791 21406 leader_election.cc:290] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:43.308861 20975 consensus_queue.cc:1059] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 16.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.073s
I20260709 12:12:43.439635 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:43.440603 14183 raft_consensus.cc:2393] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 19: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:12:43.376914 20692 raft_consensus.cc:493] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:43.409497 21187 leader_election.cc:290] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:12:43.410300 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:43.397625 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:43.373456 14876 leader_election.cc:304] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:43.418776 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:43.419626 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:43.444936 14188 raft_consensus.cc:2368] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 21. Current term is 22.
I20260709 12:12:43.445009 14189 raft_consensus.cc:2468] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 21.
I20260709 12:12:43.425565 14229 leader_election.cc:304] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:43.347357 21437 leader_election.cc:290] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:43.309677 21372 consensus_queue.cc:1059] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.075s
I20260709 12:12:43.322643 21450 raft_consensus.cc:2804] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:12:43.434219 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:43.434973 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:43.455430 14264 raft_consensus.cc:1813] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Handling vote request from an unknown peer 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:43.456163 14264 raft_consensus.cc:2410] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for term 17 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
I20260709 12:12:43.374114 20691 raft_consensus.cc:493] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
W20260709 12:12:43.408948 21442 log.cc:927] Time spent T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.413s	user 0.001s	sys 0.000s
I20260709 12:12:43.311947 21363 raft_consensus.cc:515] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:43.442880 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:43.384711 21367 raft_consensus.cc:697] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 24 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
W20260709 12:12:43.459687 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 86347.8us
I20260709 12:12:43.470279 14229 leader_election.cc:400] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 21 election: Vote denied by peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187) with higher term. Message: Invalid argument: T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 21. Current term is 22.
I20260709 12:12:43.433295 21314 raft_consensus.cc:493] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:43.478826 14229 leader_election.cc:403] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 21 election: Cancelling election due to peer responding with higher term
I20260709 12:12:43.317970 21253 consensus_queue.cc:237] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:43.482652 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:43.483278 21464 raft_consensus.cc:2804] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:12:43.381942 21109 raft_consensus.cc:515] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:43.293300 21444 consensus_queue.cc:260] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:43.494277 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:43.496918 14265 raft_consensus.cc:2393] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 24: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:12:43.498500 14265 raft_consensus.cc:1275] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 12:12:43.469528 21446 raft_consensus.cc:2749] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 12:12:43.517760 14230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:43.518872 14230 leader_election.cc:304] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:43.492238 21449 consensus_queue.cc:260] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:43.525352 21109 leader_election.cc:290] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:43.526716 21463 raft_consensus.cc:493] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:12:43.527367 21463 raft_consensus.cc:515] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:43.478672 20691 raft_consensus.cc:515] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:43.530074 21245 consensus_queue.cc:260] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:43.532364 20691 leader_election.cc:290] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:43.532474 21245 raft_consensus.cc:3060] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:43.533525 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:43.534893 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:43.529631 21463 leader_election.cc:290] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:43.541711 14190 raft_consensus.cc:1240] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:43.542258 21367 consensus_queue.cc:237] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:43.485492 21314 raft_consensus.cc:3060] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:43.436735 21342 raft_consensus.cc:515] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:43.492444 21464 raft_consensus.cc:493] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:43.456182 20692 raft_consensus.cc:515] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:43.550823 14230 leader_election.cc:304] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:43.495105 20975 raft_consensus.cc:3060] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:12:43.560066 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 82082us
I20260709 12:12:43.560716 14230 leader_election.cc:304] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
W20260709 12:12:43.545910 21460 log.cc:927] Time spent T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 12:12:43.566442 14230 leader_election.cc:304] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:43.544173 21444 raft_consensus.cc:3060] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:43.515084 21404 raft_consensus.cc:493] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:43.549000 21442 log.cc:927] Time spent T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 12:12:43.513234 21406 raft_consensus.cc:493] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:43.583289 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:43.570987 14230 leader_election.cc:304] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:43.546712 21085 raft_consensus.cc:2749] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:43.574841 14912 raft_consensus.cc:1240] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 23 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 22. Current term is 23. Ops: []
I20260709 12:12:43.575975 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:12:43.581596 14304 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:43.565105 21459 log.cc:927] Time spent T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 12:12:43.585300 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:43.588618 14230 leader_election.cc:304] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:43.558440 21464 raft_consensus.cc:3060] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:43.566130 21136 raft_consensus.cc:2749] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:12:43.600036 14184 raft_consensus.cc:1240] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 15. Current term is 16. Ops: []
W20260709 12:12:43.557492 21393 consensus_queue.cc:1175] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "73d01e9b1a9d49358da4985b21d681db" responder_term: 23 status { last_received { term: 19 index: 14 } last_committed_idx: 14 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 22. Current term is 23. Ops: [22.15-22.15]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:12:43.603642 14230 leader_election.cc:304] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:43.605087 14907 raft_consensus.cc:1240] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:43.585846 20979 raft_consensus.cc:2764] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260709 12:12:43.656268 14339 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50858 (request call id 2483) took 1532 ms. Trace:
I20260709 12:12:43.585989 21251 raft_consensus.cc:2804] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:43.657716 21251 raft_consensus.cc:493] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:43.656757 14339 rpcz_store.cc:276] 0709 12:12:42.123817 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:42.450599 (+326782us) service_pool.cc:224] Handling call
0709 12:12:42.567456 (+116857us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:42.590333 (+ 22877us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:42.590373 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:42.608303 (+ 17930us) log.cc:844] Serialized 26 byte log entry
0709 12:12:43.062234 (+453931us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:12:43.062286 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:43.062374 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:43.268224 (+205850us) raft_consensus.cc:1685] finished
0709 12:12:43.268248 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:43.655987 (+387739us) spinlock_profiling.cc:243] Waited 116 ms on lock 0x7b54002a6f50. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713a8ad 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:12:43.656197 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":146057,"raft.queue_time_us":31290,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":5643,"spinlock_wait_cycles":267865984,"thread_start_us":334514,"threads_started":1,"wal-append.queue_time_us":611007}
I20260709 12:12:43.658192 21251 raft_consensus.cc:3060] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:43.608431 21250 consensus_queue.cc:1048] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.006s
W20260709 12:12:43.615175 21391 consensus_meta.cc:287] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.785s	user 0.010s	sys 0.003s
I20260709 12:12:43.616833 21415 raft_consensus.cc:515] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:43.606349 21256 raft_consensus.cc:2804] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:12:43.597693 21056 consensus_queue.cc:1059] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 22.16, Next index: 17, Last known committed idx: 14, Time since last communication: 0.032s
I20260709 12:12:43.632719 20975 raft_consensus.cc:2749] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Leader election lost for term 21. Reason: Vote denied by peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187) with higher term. Message: Invalid argument: T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 21. Current term is 22.
I20260709 12:12:43.634521 21363 leader_election.cc:290] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:43.590781 21406 raft_consensus.cc:515] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } }
I20260709 12:12:43.668146 21391 raft_consensus.cc:515] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:43.675424 21391 leader_election.cc:290] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:43.677093 21450 raft_consensus.cc:697] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 23 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:12:43.640734 21435 raft_consensus.cc:515] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:43.679543 14330 raft_consensus.cc:1240] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:43.678893 21450 consensus_queue.cc:237] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:12:43.642498 21462 log.cc:927] Time spent T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:12:43.680742 14336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 1405) took 1135 ms. Trace:
I20260709 12:12:43.611259 20916 raft_consensus.cc:2749] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:12:43.601841 14190 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba"
dest_uuid: "885067a0d31741bfb5c9935788e315bf"
 from {username='slave'} at 127.0.0.1:56652
I20260709 12:12:43.682938 14190 raft_consensus.cc:493] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:43.683303 14190 raft_consensus.cc:3060] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:12:43.683645 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 250588us
I20260709 12:12:43.684242 21408 raft_consensus.cc:515] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:43.687098 21415 leader_election.cc:290] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 22 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:43.687098 21435 leader_election.cc:290] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 20 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:43.687979 14338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50856 (request call id 3008) took 1688 ms. Trace:
I20260709 12:12:43.593302 21443 raft_consensus.cc:2749] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:12:43.688423 14338 rpcz_store.cc:276] 0709 12:12:41.999853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:42.437345 (+437492us) service_pool.cc:224] Handling call
0709 12:12:42.462341 (+ 24996us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:12:42.544389 (+ 82048us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 12:12:42.544735 (+   346us) log.cc:844] Serialized 14 byte log entry
0709 12:12:42.842818 (+298083us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:12:42.863257 (+ 20439us) log.cc:844] Serialized 52 byte log entry
0709 12:12:42.863413 (+   156us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:12:42.863443 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:42.863516 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:43.408184 (+544668us) spinlock_profiling.cc:243] Waited 36.9 ms on lock 0x7b4400022b4c. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2123f74c85 00007f2123f756a2 00007f2126ce71db 00007f2126ce2aaf 00007f2126cd686e 00007f2126cd5bb6 00007f2126cd57d8 00007f2126cdf221 00007f2126cdf1d9 00007f2126cdf169
0709 12:12:43.687645 (+279461us) raft_consensus.cc:1685] finished
0709 12:12:43.687760 (+   115us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:43.687913 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":81563,"prepare.queue_time_us":1021,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":37,"raft.queue_time_us":82889,"raft.run_cpu_time_us":238,"raft.run_wall_time_us":12538,"spinlock_wait_cycles":84769664,"thread_start_us":297655,"threads_started":1,"wal-append.queue_time_us":450204}
I20260709 12:12:43.690492 21406 leader_election.cc:290] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:43.691686 14338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 1406) took 1145 ms. Trace:
I20260709 12:12:43.692262 14338 rpcz_store.cc:276] 0709 12:12:42.545981 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:43.690433 (+1144452us) service_pool.cc:224] Handling call
0709 12:12:43.690787 (+   354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:43.690978 (+   191us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:43.691002 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:43.691044 (+    42us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:43.691075 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:43.691129 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:43.691622 (+   493us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:43.694177 14338 raft_consensus.cc:1240] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:43.694878 14338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50856 (request call id 3016) took 1006 ms. Trace:
I20260709 12:12:43.695312 14338 rpcz_store.cc:276] 0709 12:12:42.688014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:43.693641 (+1005627us) service_pool.cc:224] Handling call
0709 12:12:43.693992 (+   351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:43.694666 (+   674us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:43.694828 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:43.697206 14338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50856 (request call id 3019) took 1008 ms. Trace:
I20260709 12:12:43.650928 21342 leader_election.cc:290] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:43.659417 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:43.698773 14339 raft_consensus.cc:2393] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 22: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
W20260709 12:12:43.660063 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 45627.8us
I20260709 12:12:43.699877 14229 leader_election.cc:304] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:43.583714 21404 raft_consensus.cc:515] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:43.668052 21256 raft_consensus.cc:697] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 24 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
W20260709 12:12:43.646062 21278 consensus_meta.cc:287] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db: Time spent flushing consensus metadata: real 0.751s	user 0.014s	sys 0.000s
I20260709 12:12:43.697599 14338 rpcz_store.cc:276] 0709 12:12:42.688965 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:43.696433 (+1007468us) service_pool.cc:224] Handling call
0709 12:12:43.696731 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:43.696918 (+   187us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:43.696944 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:43.696987 (+    43us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:12:43.697020 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:43.697070 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:43.697157 (+    87us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:12:43.663452 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 65029us
I20260709 12:12:43.730031 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:43.637163 14332 raft_consensus.cc:2468] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 21.
I20260709 12:12:43.707744 14331 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50856 (request call id 3021) took 1018 ms. Trace:
I20260709 12:12:43.731207 14331 rpcz_store.cc:276] 0709 12:12:42.689498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:43.706780 (+1017282us) service_pool.cc:224] Handling call
0709 12:12:43.707174 (+   394us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:43.707402 (+   228us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:43.707428 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:43.707474 (+    46us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:12:43.707514 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:43.707569 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:43.707675 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:43.711120 14304 leader_election.cc:304] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:12:43.701102 14190 raft_consensus.cc:515] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:43.712735 14339 raft_consensus.cc:1240] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 21. Current term is 22. Ops: []
I20260709 12:12:43.713606 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:43.733511 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:43.731817 14229 leader_election.cc:304] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:43.736285 21250 raft_consensus.cc:2749] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:12:43.737150 21250 raft_consensus.cc:2804] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:12:43.737528 21250 raft_consensus.cc:493] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:43.738075 21250 raft_consensus.cc:3060] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:43.740842 21326 raft_consensus.cc:3055] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:43.741390 21326 raft_consensus.cc:740] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:43.742007 21056 consensus_queue.cc:1059] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:12:43.743145 21056 raft_consensus.cc:493] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:43.743696 21056 raft_consensus.cc:515] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:43.744038 21326 consensus_queue.cc:260] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:43.745579 21326 raft_consensus.cc:3060] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:43.745949 20979 raft_consensus.cc:3055] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:43.746430 20979 raft_consensus.cc:740] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:43.747334 20979 consensus_queue.cc:260] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:43.748842 20979 raft_consensus.cc:3060] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:43.750061 12986 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:43.751154 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:43.756489 21266 raft_consensus.cc:493] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:43.757045 21266 raft_consensus.cc:3060] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:43.763002 21267 raft_consensus.cc:3060] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:43.767494 21217 raft_consensus.cc:3055] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:43.768038 21217 raft_consensus.cc:740] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:12:43.772323 14338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50856 (request call id 3023) took 1082 ms. Trace:
I20260709 12:12:43.715250 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:43.722644 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:43.723309 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:43.722782 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:43.724365 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 20 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:43.680761 14330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50858 (request call id 2488) took 1512 ms. Trace:
I20260709 12:12:43.733361 14339 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50856 (request call id 3022) took 1043 ms. Trace:
I20260709 12:12:43.774463 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:43.714354 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:43.681205 14336 rpcz_store.cc:276] 0709 12:12:42.545712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:43.679859 (+1134147us) service_pool.cc:224] Handling call
0709 12:12:43.680242 (+   383us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:43.680422 (+   180us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:43.680446 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:43.680490 (+    44us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:12:43.680521 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:43.680572 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:43.680679 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:12:43.775206 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 64193us
I20260709 12:12:43.775938 14303 leader_election.cc:304] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:12:43.728324 14908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:43.715993 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:43.774890 14339 rpcz_store.cc:276] 0709 12:12:42.689834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:43.712206 (+1022372us) service_pool.cc:224] Handling call
0709 12:12:43.712541 (+   335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:43.733095 (+ 20554us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:43.733305 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:43.779592 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 20 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:43.774725 14330 rpcz_store.cc:276] 0709 12:12:42.168007 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:42.965402 (+797395us) service_pool.cc:224] Handling call
0709 12:12:42.965701 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:43.679987 (+714286us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:43.680512 (+   525us) spinlock_profiling.cc:243] Waited 713 ms on lock 0x7b540029e354. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:12:43.680687 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1640886656}
I20260709 12:12:43.780367 14339 raft_consensus.cc:2468] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 19.
I20260709 12:12:43.784547 14330 raft_consensus.cc:1240] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:43.786197 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:43.786237 21256 consensus_queue.cc:237] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 23.11, Last appended by leader: 11, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:43.786927 14182 raft_consensus.cc:3060] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:43.788414 14190 leader_election.cc:290] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 20 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:43.788671 21464 raft_consensus.cc:515] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:43.713821 21435 raft_consensus.cc:493] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:43.779553 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:43.790520 14336 raft_consensus.cc:2468] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 20.
I20260709 12:12:43.769115 21217 consensus_queue.cc:260] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:43.792409 21404 leader_election.cc:290] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:43.793030 21217 raft_consensus.cc:3060] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:43.790086 21435 raft_consensus.cc:515] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:43.794410 21408 leader_election.cc:290] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:43.688619 20692 leader_election.cc:290] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:43.727231 21052 raft_consensus.cc:493] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:12:43.795475 21052 raft_consensus.cc:3060] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:43.795763 21435 leader_election.cc:290] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:43.780012 21342 raft_consensus.cc:2804] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:12:43.796757 21342 raft_consensus.cc:493] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:12:43.797137 21342 raft_consensus.cc:3060] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:43.800123 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
W20260709 12:12:43.801101 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 70527.4us
I20260709 12:12:43.802568 14331 raft_consensus.cc:1275] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 12:12:43.804694 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:43.805258 14332 raft_consensus.cc:3060] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:43.772783 14338 rpcz_store.cc:276] 0709 12:12:42.690087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:43.729583 (+1039496us) service_pool.cc:224] Handling call
0709 12:12:43.771498 (+ 41915us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:43.771700 (+   202us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:43.771730 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:43.771998 (+   268us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:12:43.772046 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:43.772110 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:43.772251 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:12:43.807792 14228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:43.818872 14303 leader_election.cc:304] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:43.819371 14331 raft_consensus.cc:1275] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
W20260709 12:12:43.812742 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 203326us
I20260709 12:12:43.821233 14230 leader_election.cc:304] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:43.828334 14332 raft_consensus.cc:2468] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 22.
I20260709 12:12:43.831598 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:43.833455 14303 leader_election.cc:304] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
W20260709 12:12:43.835332 14878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:43.837267 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:43.837958 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:43.726740 21415 consensus_queue.cc:1048] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.090s
I20260709 12:12:43.850183 14908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:43.851780 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:43.842563 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 20 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:43.857959 20916 consensus_queue.cc:1059] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:43.860019 20916 raft_consensus.cc:3055] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:43.860425 20916 raft_consensus.cc:740] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:43.861300 20916 consensus_queue.cc:260] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:43.863198 20916 raft_consensus.cc:3060] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:43.834931 21435 raft_consensus.cc:2749] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:43.839579 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:43.839859 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:43.840685 14303 leader_election.cc:304] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:43.842378 21245 raft_consensus.cc:2804] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:43.842958 21250 raft_consensus.cc:515] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:43.843441 14877 leader_election.cc:304] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
W20260709 12:12:43.913597 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 70282.7us
I20260709 12:12:43.914541 14877 leader_election.cc:304] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:43.838056 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:43.800163 21253 raft_consensus.cc:493] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:43.773590 21278 raft_consensus.cc:515] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:43.871145 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:43.872901 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:43.823514 21443 raft_consensus.cc:493] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:43.892856 14878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:43.884097 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:43.829326 20692 raft_consensus.cc:2804] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:43.927848 14260 raft_consensus.cc:2393] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 18: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:12:43.908545 14261 raft_consensus.cc:1240] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:43.823122 21408 raft_consensus.cc:493] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:12:43.885607 14189 raft_consensus.cc:1240] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:43.908835 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:43.931231 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
W20260709 12:12:43.884785 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 63642.4us
W20260709 12:12:43.911890 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 71294.9us
I20260709 12:12:43.930140 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:43.933071 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:43.916523 14182 raft_consensus.cc:2468] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 22.
I20260709 12:12:43.834992 21056 leader_election.cc:290] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:43.921865 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 20 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:43.923712 14257 raft_consensus.cc:2468] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 22.
I20260709 12:12:43.924815 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:43.924165 14877 leader_election.cc:304] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:43.921900 14229 leader_election.cc:304] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
W20260709 12:12:43.911846 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 111734us
I20260709 12:12:43.910895 14181 raft_consensus.cc:1240] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:43.920626 21455 raft_consensus.cc:2749] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:12:43.916765 21415 raft_consensus.cc:2804] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:12:43.912693 21245 raft_consensus.cc:493] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:44.001859 14260 raft_consensus.cc:2393] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 22: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
W20260709 12:12:43.996529 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 62511.2us
I20260709 12:12:43.934561 20934 consensus_queue.cc:1059] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.052s
W20260709 12:12:43.990744 14878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:43.911834 21474 raft_consensus.cc:2749] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:43.883375 21473 consensus_queue.cc:1059] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 15.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.039s
I20260709 12:12:44.084448 21250 leader_election.cc:290] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:12:44.086400 14154 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.12.174.190:39655, user_credentials={real_user=slave}} blocked reactor thread for 53068.8us
I20260709 12:12:44.087697 14303 leader_election.cc:304] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:44.088909 21129 raft_consensus.cc:2804] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:12:44.089567 21129 raft_consensus.cc:697] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 22 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:44.001189 20692 raft_consensus.cc:697] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 20 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:44.090518 21129 consensus_queue.cc:237] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:44.090904 20692 consensus_queue.cc:237] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:44.092177 21278 leader_election.cc:290] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 19 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:12:44.094071 21284 consensus_meta.cc:287] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db: Time spent flushing consensus metadata: real 1.036s	user 0.012s	sys 0.002s
I20260709 12:12:44.095026 21464 leader_election.cc:290] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 24 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:12:44.096282 21479 log.cc:927] Time spent T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 12:12:44.099037 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:43.920158 21363 raft_consensus.cc:2749] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 12:12:44.015959 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 91984.4us
I20260709 12:12:43.926082 21253 raft_consensus.cc:515] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:44.013226 14334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50858 (request call id 2499) took 1514 ms. Trace:
W20260709 12:12:44.021518 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 99671.8us
I20260709 12:12:43.989820 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:44.036453 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:44.112900 14181 raft_consensus.cc:3060] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:44.076231 21367 raft_consensus.cc:493] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:44.112222 14334 rpcz_store.cc:276] 0709 12:12:42.499244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:42.598255 (+ 99011us) service_pool.cc:224] Handling call
0709 12:12:44.012787 (+1414532us) spinlock_profiling.cc:243] Waited 284 ms on lock 0x7b54000b8954. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:12:44.013075 (+   288us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":653821696}
I20260709 12:12:44.111146 21342 raft_consensus.cc:515] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:44.116799 21342 leader_election.cc:290] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 23 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:43.979048 21137 consensus_queue.cc:1048] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.122s
I20260709 12:12:44.119149 21367 raft_consensus.cc:515] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:44.035071 21136 raft_consensus.cc:2749] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:12:43.997020 21314 raft_consensus.cc:515] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:44.094861 21284 raft_consensus.cc:515] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:44.122705 21314 leader_election.cc:290] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:12:44.123245 21471 log.cc:927] Time spent T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.209s	user 0.002s	sys 0.002s
I20260709 12:12:44.123811 21284 leader_election.cc:290] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 22 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:44.124552 14877 leader_election.cc:304] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:44.125376 21253 leader_election.cc:290] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:44.127831 14339 raft_consensus.cc:1240] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 22. Current term is 23. Ops: []
I20260709 12:12:44.130631 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:44.027873 21415 raft_consensus.cc:493] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:44.038045 21245 raft_consensus.cc:3060] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:12:44.016048 14155 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:44.146600 14155 leader_election.cc:304] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:44.146865 21449 raft_consensus.cc:3060] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:43.930500 21443 raft_consensus.cc:515] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:44.148061 14263 raft_consensus.cc:1275] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 12:12:44.149166 21443 leader_election.cc:290] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:44.024992 21397 raft_consensus.cc:2804] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:12:44.026619 21408 raft_consensus.cc:515] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:44.132244 21464 consensus_queue.cc:1059] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.018s
I20260709 12:12:44.132613 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:44.150770 21464 raft_consensus.cc:3055] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:44.133167 14189 raft_consensus.cc:3060] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:44.151669 21408 leader_election.cc:290] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:44.133344 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
W20260709 12:12:44.139403 21440 log.cc:927] Time spent T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 1.148s	user 0.001s	sys 0.006s
I20260709 12:12:44.154340 14183 raft_consensus.cc:2393] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 22: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:12:44.127238 21278 raft_consensus.cc:2749] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:44.127390 21406 raft_consensus.cc:493] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:44.155197 21397 raft_consensus.cc:493] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:12:44.142477 14911 raft_consensus.cc:1240] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 21. Current term is 22. Ops: [21.15-21.15]
I20260709 12:12:44.107450 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:44.155781 21397 raft_consensus.cc:3060] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:44.156217 14335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50856 (request call id 3003) took 2180 ms. Trace:
I20260709 12:12:44.156448 14265 raft_consensus.cc:3060] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Advancing to term 19
I20260709 12:12:44.155607 21406 raft_consensus.cc:515] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:44.163026 21404 raft_consensus.cc:2749] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:12:44.151149 21464 raft_consensus.cc:740] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:12:44.166688 21464 consensus_queue.cc:260] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:44.167373 21406 leader_election.cc:290] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:44.168983 21052 raft_consensus.cc:515] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:44.156663 14335 rpcz_store.cc:276] 0709 12:12:41.975538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:42.309580 (+334042us) service_pool.cc:224] Handling call
0709 12:12:42.317035 (+  7455us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:12:42.386027 (+ 68992us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:42.386066 (+    39us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:12:42.393440 (+  7374us) log.cc:844] Serialized 52 byte log entry
0709 12:12:42.553264 (+159824us) spinlock_profiling.cc:243] Waited 7.55 ms on lock 0x7b4800100bd8. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f212c064aa1 00007f212c05bb37 00007f212c05b9ca 00007f212c15326f 00007f212c152f37 00007f212c16755c 00007f212c167508 00007f212c167488 00007f212c167443 00007f212c1666ec 00007f212b090a96
0709 12:12:42.788988 (+235724us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:12:42.813957 (+ 24969us) log.cc:844] Serialized 14 byte log entry
0709 12:12:42.814345 (+   388us) log.cc:844] Serialized 14 byte log entry
0709 12:12:42.814509 (+   164us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:42.814583 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:44.138755 (+1324172us) spinlock_profiling.cc:243] Waited 36.5 ms on lock 0x7b4400022b4c. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2123f74c85 00007f2123f756a2 00007f2126ce71db 00007f2126ce2aaf 00007f2126cd686e 00007f2126cd5bb6 00007f2126cd57d8 00007f2126cdf221 00007f2126cdf1d9 00007f2126cdf169
0709 12:12:44.155926 (+ 17171us) raft_consensus.cc:1685] finished
0709 12:12:44.155951 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:44.156130 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":36402,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":52,"raft.queue_time_us":78124,"raft.run_cpu_time_us":2527,"raft.run_wall_time_us":155094,"spinlock_wait_cycles":101372160,"thread_start_us":383563,"threads_started":1,"wal-append.queue_time_us":512268}
I20260709 12:12:44.170724 21397 raft_consensus.cc:515] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:44.172039 14189 raft_consensus.cc:2468] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 19.
I20260709 12:12:44.174909 21397 leader_election.cc:290] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 23 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:44.175343 21052 leader_election.cc:290] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 20 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:44.121423 21266 raft_consensus.cc:515] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:44.135684 21251 raft_consensus.cc:515] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:44.162598 14155 leader_election.cc:304] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:44.179183 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:44.180663 14155 leader_election.cc:304] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:44.184484 14905 raft_consensus.cc:2368] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 18. Current term is 19.
I20260709 12:12:44.184669 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:44.185797 14155 leader_election.cc:304] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:44.185932 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:44.186101 14189 raft_consensus.cc:2468] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 17.
I20260709 12:12:44.188570 14155 leader_election.cc:304] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:44.191393 14189 raft_consensus.cc:1275] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:12:44.199021 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:44.121608 21367 leader_election.cc:290] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:44.199613 14265 raft_consensus.cc:2468] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 19.
I20260709 12:12:44.200100 14181 raft_consensus.cc:2468] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 24.
I20260709 12:12:44.162739 21453 raft_consensus.cc:3055] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 22 LEADER]: Stepping down as leader of term 22
W20260709 12:12:44.196020 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 43575.2us
I20260709 12:12:44.201014 14183 raft_consensus.cc:1275] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 24 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 12:12:44.278968 14229 leader_election.cc:400] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 pre-election: Vote denied by peer 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341) with higher term. Message: Invalid argument: T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 18. Current term is 19.
W20260709 12:12:44.204969 21478 log.cc:927] Time spent T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 12:12:44.220389 14261 raft_consensus.cc:1240] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:44.221158 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:44.280488 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: true dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
W20260709 12:12:44.274550 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 90879us
I20260709 12:12:44.281100 14905 raft_consensus.cc:3055] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:44.282054 14905 raft_consensus.cc:740] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:12:44.278389 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:44.284252 14906 raft_consensus.cc:2393] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 20: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
I20260709 12:12:44.284533 14303 leader_election.cc:304] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:44.179248 21415 raft_consensus.cc:3060] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:44.282902 14905 consensus_queue.cc:260] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:44.253849 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:44.198257 21444 raft_consensus.cc:2749] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:12:44.294107 21251 leader_election.cc:290] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 21 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:12:44.295182 21484 log.cc:927] Time spent T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.218s	user 0.002s	sys 0.001s
W20260709 12:12:44.296275 21267 consensus_meta.cc:287] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.533s	user 0.004s	sys 0.008s
I20260709 12:12:44.298460 14339 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50858 (request call id 2500) took 1153 ms. Trace:
I20260709 12:12:44.298872 14339 rpcz_store.cc:276] 0709 12:12:43.144772 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:43.781047 (+636275us) service_pool.cc:224] Handling call
0709 12:12:43.781366 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:44.128230 (+346864us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:44.298172 (+169942us) spinlock_profiling.cc:243] Waited 346 ms on lock 0x7b5400145d54. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:12:44.298381 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":796323200}
I20260709 12:12:44.302143 14262 raft_consensus.cc:2468] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 22.
I20260709 12:12:44.305975 14189 raft_consensus.cc:1275] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:12:44.302268 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:44.308393 14183 raft_consensus.cc:3060] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:44.279368 21453 raft_consensus.cc:740] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:44.314981 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:44.316452 14262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41764 (request call id 3617) took 1331 ms. Trace:
I20260709 12:12:44.316911 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:44.317629 14189 raft_consensus.cc:2368] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 18. Current term is 19.
I20260709 12:12:44.316847 14262 rpcz_store.cc:276] 0709 12:12:42.984890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:42.985088 (+   198us) service_pool.cc:224] Handling call
0709 12:12:44.316264 (+1331176us) spinlock_profiling.cc:243] Waited 1.31 s on lock 0x7b54002229d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:12:44.316381 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3017447680}
I20260709 12:12:44.318590 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:44.319032 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:44.273300 21176 consensus_queue.cc:1048] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.037s
I20260709 12:12:44.330857 21266 leader_election.cc:290] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:44.337678 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:44.339840 14877 leader_election.cc:304] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:12:44.316051 21464 raft_consensus.cc:3060] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:44.272675 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:44.279356 14229 leader_election.cc:403] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:12:44.343400 14332 raft_consensus.cc:2468] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 20.
I20260709 12:12:44.285871 14303 leader_election.cc:304] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:44.184329 21393 raft_consensus.cc:2749] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:44.285245 14912 raft_consensus.cc:1240] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 23 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 22. Current term is 23. Ops: []
I20260709 12:12:44.347563 21367 raft_consensus.cc:2749] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:44.289186 14334 raft_consensus.cc:2468] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 21.
I20260709 12:12:44.257489 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:44.348158 21415 raft_consensus.cc:515] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:44.289321 14905 raft_consensus.cc:3060] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:44.190222 21404 raft_consensus.cc:2749] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:44.291302 21430 raft_consensus.cc:2749] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:12:44.271078 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:44.311496 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:44.342386 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
W20260709 12:12:44.343601 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 64802.7us
I20260709 12:12:44.222007 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:44.345017 21266 raft_consensus.cc:2749] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341) with higher term. Message: Invalid argument: T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 18. Current term is 19.
W20260709 12:12:44.345830 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 60070us
I20260709 12:12:44.287374 14876 leader_election.cc:304] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
W20260709 12:12:44.364955 14229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:44.243654 14081 catalog_manager.cc:5697] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf reported cstate change: term changed from 13 to 18. New cstate: current_term: 18 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } }
I20260709 12:12:44.365903 14303 leader_election.cc:304] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:44.363937 14260 raft_consensus.cc:2468] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 20.
W20260709 12:12:44.368505 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 81225.6us
I20260709 12:12:44.371182 14229 leader_election.cc:400] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 pre-election: Vote denied by peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187) with higher term. Message: Invalid argument: T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 18. Current term is 19.
I20260709 12:12:44.372069 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:44.373905 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:44.272539 14304 leader_election.cc:304] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:44.379007 21267 consensus_queue.cc:1048] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:12:44.379329 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:44.380023 14189 raft_consensus.cc:1240] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 24 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 23. Current term is 24. Ops: []
I20260709 12:12:44.381618 14187 raft_consensus.cc:1275] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 24 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
W20260709 12:12:44.389832 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 117389us
I20260709 12:12:44.390950 14304 leader_election.cc:304] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:44.406046 14183 raft_consensus.cc:2468] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 18.
I20260709 12:12:44.353230 21467 raft_consensus.cc:2804] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 12:12:44.410642 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 44875.9us
I20260709 12:12:44.415820 14911 raft_consensus.cc:1240] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 24 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 23. Current term is 24. Ops: []
I20260709 12:12:44.409760 14081 catalog_manager.cc:5697] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf reported cstate change: term changed from 12 to 18. New cstate: current_term: 18 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } }
I20260709 12:12:44.418529 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:44.419181 14184 raft_consensus.cc:3060] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Advancing to term 23
I20260709 12:12:44.412853 14304 leader_election.cc:304] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:44.416985 14877 leader_election.cc:304] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:44.422788 14304 leader_election.cc:304] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:44.362787 21450 consensus_queue.cc:1048] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.059s
I20260709 12:12:44.423689 14229 leader_election.cc:304] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:44.409363 20692 raft_consensus.cc:2804] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:44.411708 21473 raft_consensus.cc:2804] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:44.426450 14081 catalog_manager.cc:5697] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf reported cstate change: term changed from 14 to 18. New cstate: current_term: 18 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } }
I20260709 12:12:44.395040 21245 raft_consensus.cc:515] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:44.416520 21367 raft_consensus.cc:2749] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:12:44.432264 14304 leader_election.cc:304] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:44.413569 21430 raft_consensus.cc:2749] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:44.463181 14303 leader_election.cc:304] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:44.416102 21467 raft_consensus.cc:493] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:44.462903 14081 catalog_manager.cc:5697] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf reported cstate change: term changed from 13 to 20, leader changed from 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) to 885067a0d31741bfb5c9935788e315bf (127.12.174.129). New cstate: current_term: 20 leader_uuid: "885067a0d31741bfb5c9935788e315bf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:44.470805 14903 raft_consensus.cc:2468] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 18.
I20260709 12:12:44.469686 14184 raft_consensus.cc:2468] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 23.
I20260709 12:12:44.411181 21404 consensus_queue.cc:1059] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 22.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.038s
I20260709 12:12:44.451951 20692 raft_consensus.cc:493] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:12:44.470345 14073 catalog_manager.cc:5220] ChangeConfig:REMOVE_PEER RPC for tablet 35b39d0f3270452a8bd4f4b1800a837c with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341) due to CAS failure; no further retry: Illegal state: Request specified cas_config_opid_index of 6 but the committed config has opid_index of 12
I20260709 12:12:44.451537 21397 raft_consensus.cc:2749] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
W20260709 12:12:44.477782 14877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:44.476368 14081 catalog_manager.cc:5697] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf reported cstate change: term changed from 12 to 17, leader changed from 65c9c1653b3346b39a0e118540e6080c (127.12.174.131) to 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130). New cstate: current_term: 17 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } }
I20260709 12:12:44.421700 21109 consensus_queue.cc:1059] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.053s
I20260709 12:12:44.424292 21052 raft_consensus.cc:2749] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:12:44.449502 21137 raft_consensus.cc:2749] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:44.480551 14304 leader_election.cc:304] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:44.473281 21408 raft_consensus.cc:2804] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:44.405722 21453 consensus_queue.cc:260] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:44.475006 20691 raft_consensus.cc:2804] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 12:12:44.478363 21436 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.019s	user 0.058s	sys 0.030s
W20260709 12:12:44.501653 14084 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60420 (request call id 257) took 55309 ms (client timeout 15000 ms). Trace:
I20260709 12:12:44.478245 21467 raft_consensus.cc:3060] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:44.478823 21473 raft_consensus.cc:697] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 19 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:12:44.479120 20692 raft_consensus.cc:3060] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:44.527923 21137 consensus_queue.cc:1059] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:12:44.506585 20691 raft_consensus.cc:493] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:44.532609 20691 raft_consensus.cc:3060] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:44.536042 21367 consensus_queue.cc:1048] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:12:44.502678 21406 raft_consensus.cc:2749] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:44.542282 21430 raft_consensus.cc:2749] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:12:44.507601 21436 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.064s	user 0.062s	sys 0.035s
I20260709 12:12:44.560041 14905 raft_consensus.cc:2468] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 20.
I20260709 12:12:44.528312 21245 leader_election.cc:290] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:44.566461 14154 leader_election.cc:304] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:44.513906 21408 raft_consensus.cc:697] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 18 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
W20260709 12:12:44.561494 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 362207us
W20260709 12:12:44.559525 21481 log.cc:927] Time spent T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.441s	user 0.001s	sys 0.002s
I20260709 12:12:44.576329 21386 raft_consensus.cc:2804] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Leader election won for term 20
W20260709 12:12:44.560921 21482 log.cc:927] Time spent T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.438s	user 0.000s	sys 0.004s
I20260709 12:12:44.574800 14185 raft_consensus.cc:1240] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:44.510113 14081 catalog_manager.cc:5697] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf reported cstate change: term changed from 12 to 17, leader changed from 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130) to 885067a0d31741bfb5c9935788e315bf (127.12.174.129). New cstate: current_term: 17 leader_uuid: "885067a0d31741bfb5c9935788e315bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } }
W20260709 12:12:44.576617 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 207158us
W20260709 12:12:44.559877 21475 log.cc:927] Time spent T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 12:12:44.545152 21052 raft_consensus.cc:493] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
W20260709 12:12:44.505995 14084 rpcz_store.cc:269] 0709 12:11:49.183564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:49.183842 (+   278us) service_pool.cc:224] Handling call
0709 12:12:44.482595 (+55298753us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:12:39.020346 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:12:39.075739 (+ 55393us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:12:39.075795 (+    56us) write_op.cc:435] Acquired schema lock
0709 12:12:39.075818 (+    23us) tablet.cc:662] Decoding operations
0709 12:12:39.077210 (+  1392us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:12:39.077301 (+    91us) write_op.cc:641] Partition lock acquired for write op
0709 12:12:39.077326 (+    25us) tablet.cc:685] Acquiring locks for 15 operations
0709 12:12:39.091174 (+ 13848us) tablet.cc:701] Row locks acquired
0709 12:12:39.091242 (+    68us) write_op.cc:260] PREPARE: finished
0709 12:12:39.091475 (+   233us) write_op.cc:270] Start()
0709 12:12:39.091666 (+   191us) write_op.cc:276] Timestamp: P: 1783599159091377 usec, L: 0
0709 12:12:39.091715 (+    49us) op_driver.cc:348] REPLICATION: starting
0709 12:12:39.125594 (+ 33879us) log.cc:844] Serialized 6010 byte log entry
0709 12:12:39.898081 (+772487us) spinlock_profiling.cc:243] Waited 12.9 ms on lock 0x7b54002e3454. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f2127136e28 00007f212ab71581 00007f212ab70d58 00007f212ab759f1 00007f212ab759a9 00007f212ab75939 00007f212ab75901 00007f212ab74b2d 0000000000388634 0000000000388479
0709 12:12:40.008809 (+110728us) op_driver.cc:464] REPLICATION: finished
0709 12:12:40.123898 (+115089us) write_op.cc:301] APPLY: starting
0709 12:12:40.124004 (+   106us) tablet.cc:1367] starting BulkCheckPresence
0709 12:12:40.201179 (+ 77175us) tablet.cc:1370] finished BulkCheckPresence
0709 12:12:40.201218 (+    39us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:12:41.371800 (+1170582us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:12:41.372229 (+   429us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=30,key_file_lookups=30,delta_file_lookups=30,mrs_lookups=0
0709 12:12:41.372318 (+    89us) write_op.cc:312] APPLY: finished
0709 12:12:41.372856 (+   538us) log.cc:844] Serialized 139 byte log entry
0709 12:12:41.756970 (+384114us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:41.789286 (+ 32316us) write_op.cc:454] Released schema lock
0709 12:12:41.837109 (+ 47823us) write_op.cc:341] FINISH: Updating metrics
0709 12:12:41.869331 (+ 32222us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:41.869366 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":150736,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":114763,"apply.run_cpu_time_us":69914,"apply.run_wall_time_us":1745395,"cfile_cache_hit":62,"cfile_cache_hit_bytes":66947,"num_ops":15,"prepare.queue_time_us":238178,"prepare.run_cpu_time_us":53312,"prepare.run_wall_time_us":918048,"raft.queue_time_us":272186,"raft.run_cpu_time_us":36823,"raft.run_wall_time_us":97123,"replication_time_us":916913,"spinlock_wait_cycles":29719936,"thread_start_us":947859,"threads_started":5,"wal-append.queue_time_us":779262,"wal-append.run_cpu_time_us":17471,"wal-append.run_wall_time_us":2514597}]]}
I20260709 12:12:44.585333 14876 leader_election.cc:304] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:44.526825 21129 consensus_queue.cc:1048] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.049s
I20260709 12:12:44.506148 21425 consensus_queue.cc:1048] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.080s
I20260709 12:12:44.586424 21430 raft_consensus.cc:3055] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:12:44.596604 20691 raft_consensus.cc:515] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:44.597150 14185 raft_consensus.cc:1275] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 23 index: 15. (term mismatch)
I20260709 12:12:44.598726 14181 raft_consensus.cc:1240] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 15. Current term is 16. Ops: []
W20260709 12:12:44.609414 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 128945us
I20260709 12:12:44.602681 21408 consensus_queue.cc:237] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:44.612325 14185 pending_rounds.cc:85] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf: Aborting all ops after (but not including) 14
I20260709 12:12:44.592633 21434 raft_consensus.cc:2804] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:12:44.612775 14185 pending_rounds.cc:107] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf: Aborting uncommitted NO_OP operation due to leader change: 22.15
I20260709 12:12:44.617671 14185 raft_consensus.cc:2889] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:44.606622 14081 catalog_manager.cc:5697] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf reported cstate change: term changed from 17 to 18, leader changed from 885067a0d31741bfb5c9935788e315bf (127.12.174.129) to 73d01e9b1a9d49358da4985b21d681db (127.12.174.132). New cstate: current_term: 18 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
W20260709 12:12:44.618867 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 93668.8us
I20260709 12:12:44.622368 14303 leader_election.cc:304] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:44.631876 14230 leader_election.cc:304] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:44.585606 21266 consensus_queue.cc:1059] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.027s
I20260709 12:12:44.588155 21052 raft_consensus.cc:515] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:44.608500 21430 raft_consensus.cc:740] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:44.651914 14081 catalog_manager.cc:5697] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf reported cstate change: term changed from 7 to 17. New cstate: current_term: 17 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } }
I20260709 12:12:44.652311 14230 leader_election.cc:304] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db
W20260709 12:12:44.659965 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 64600.6us
I20260709 12:12:44.661456 14230 leader_election.cc:304] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:44.623481 21253 raft_consensus.cc:2749] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:44.667564 14155 leader_election.cc:304] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:44.667171 14081 catalog_manager.cc:5697] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf reported cstate change: term changed from 15 to 19. New cstate: current_term: 19 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } }
I20260709 12:12:44.657035 20916 raft_consensus.cc:2804] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:44.675849 14337 raft_consensus.cc:1240] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:44.674268 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:44.676060 14339 raft_consensus.cc:1240] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:44.674556 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:44.656203 21434 raft_consensus.cc:697] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 24 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:12:44.676192 14081 catalog_manager.cc:5697] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf reported cstate change: term changed from 11 to 21, leader changed from 65c9c1653b3346b39a0e118540e6080c (127.12.174.131) to 885067a0d31741bfb5c9935788e315bf (127.12.174.129). New cstate: current_term: 21 leader_uuid: "885067a0d31741bfb5c9935788e315bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:44.649123 20692 raft_consensus.cc:515] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:44.681762 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: true dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:44.683665 14259 raft_consensus.cc:3060] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:44.681953 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:44.684273 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:44.668385 21267 raft_consensus.cc:2804] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:12:44.662026 21404 raft_consensus.cc:493] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:44.690867 14081 catalog_manager.cc:5697] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf reported cstate change: term changed from 8 to 17, leader changed from 885067a0d31741bfb5c9935788e315bf (127.12.174.129) to 65c9c1653b3346b39a0e118540e6080c (127.12.174.131). New cstate: current_term: 17 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } }
I20260709 12:12:44.686439 14155 leader_election.cc:304] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:44.667829 21449 consensus_queue.cc:1059] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 15.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.020s
I20260709 12:12:44.682817 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:44.669486 21326 raft_consensus.cc:2749] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:12:44.687889 21501 raft_consensus.cc:493] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:12:44.697958 14258 raft_consensus.cc:1240] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 20. Current term is 21. Ops: [20.11-20.11]
W20260709 12:12:44.690924 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 68655.7us
I20260709 12:12:44.691502 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:44.695097 14230 leader_election.cc:304] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:44.679358 20916 raft_consensus.cc:493] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:44.699599 14081 catalog_manager.cc:5697] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf reported cstate change: term changed from 13 to 18, leader changed from 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130) to 885067a0d31741bfb5c9935788e315bf (127.12.174.129). New cstate: current_term: 18 leader_uuid: "885067a0d31741bfb5c9935788e315bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:44.611785 21473 consensus_queue.cc:237] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:44.703763 14155 leader_election.cc:304] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:44.689320 21267 raft_consensus.cc:493] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:44.684005 21266 consensus_queue.cc:1059] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.019s
I20260709 12:12:44.722477 21266 raft_consensus.cc:3055] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:44.722941 21266 raft_consensus.cc:740] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:44.723829 21266 consensus_queue.cc:260] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:44.725250 21266 raft_consensus.cc:3060] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:44.706568 21505 raft_consensus.cc:2804] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:12:44.706748 21496 consensus_queue.cc:1048] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.007s
I20260709 12:12:44.697667 21467 raft_consensus.cc:515] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 21 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:44.729341 21467 leader_election.cc:290] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 21 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:44.702203 20916 raft_consensus.cc:3060] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:44.709204 21501 raft_consensus.cc:515] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:44.713042 21434 consensus_queue.cc:237] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:44.688721 20975 consensus_queue.cc:1059] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 12:12:44.697870 21245 raft_consensus.cc:2804] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:12:44.736500 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:44.739020 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:44.743371 21435 raft_consensus.cc:493] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:44.717029 20692 leader_election.cc:290] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:44.702363 21446 raft_consensus.cc:2749] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:12:44.696658 21404 raft_consensus.cc:515] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:44.739487 21267 raft_consensus.cc:3060] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:44.698655 21463 consensus_queue.cc:1048] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.049s
I20260709 12:12:44.767935 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:44.765089 14081 catalog_manager.cc:5697] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf reported cstate change: term changed from 12 to 20. New cstate: current_term: 20 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } }
W20260709 12:12:44.750422 21455 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 20 current term: 20 is higher.
I20260709 12:12:44.775874 14184 raft_consensus.cc:3060] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Advancing to term 18
I20260709 12:12:44.777614 14081 catalog_manager.cc:5697] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf reported cstate change: term changed from 11 to 22, leader changed from 65c9c1653b3346b39a0e118540e6080c (127.12.174.131) to 885067a0d31741bfb5c9935788e315bf (127.12.174.129). New cstate: current_term: 22 leader_uuid: "885067a0d31741bfb5c9935788e315bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:44.780386 14081 catalog_manager.cc:5697] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf reported cstate change: term changed from 14 to 21, leader changed from 65c9c1653b3346b39a0e118540e6080c (127.12.174.131) to 885067a0d31741bfb5c9935788e315bf (127.12.174.129). New cstate: current_term: 21 leader_uuid: "885067a0d31741bfb5c9935788e315bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:44.784294 14081 catalog_manager.cc:5697] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf reported cstate change: term changed from 9 to 19, leader changed from 65c9c1653b3346b39a0e118540e6080c (127.12.174.131) to 885067a0d31741bfb5c9935788e315bf (127.12.174.129). New cstate: current_term: 19 leader_uuid: "885067a0d31741bfb5c9935788e315bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:44.688532 21430 consensus_queue.cc:260] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.17, Last appended by leader: 17, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:44.763095 21507 raft_consensus.cc:2749] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:12:44.788915 14184 raft_consensus.cc:2468] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 18.
I20260709 12:12:44.765164 21245 raft_consensus.cc:697] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 23 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
W20260709 12:12:44.836313 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 91791.5us
I20260709 12:12:44.837803 14155 leader_election.cc:304] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:44.839782 14155 leader_election.cc:304] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:12:44.843009 20547 raft_consensus.cc:3055] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:44.843498 20547 raft_consensus.cc:740] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
W20260709 12:12:44.858286 21491 log.cc:927] Time spent T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.262s	user 0.003s	sys 0.000s
W20260709 12:12:44.854633 21489 log.cc:927] Time spent T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.252s	user 0.000s	sys 0.003s
I20260709 12:12:44.844803 20547 consensus_queue.cc:260] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:44.885645 20547 raft_consensus.cc:3060] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:44.886549 21176 raft_consensus.cc:3055] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:12:44.887123 21176 raft_consensus.cc:740] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:12:44.887986 21176 consensus_queue.cc:260] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:44.885035 21342 raft_consensus.cc:3055] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:12:44.894922 21406 raft_consensus.cc:2749] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:44.895551 21444 consensus_queue.cc:1059] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:12:44.897379 21444 raft_consensus.cc:2804] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:44.892791 21342 raft_consensus.cc:740] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
W20260709 12:12:44.899828 14903 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53194 (request call id 1222) took 1166 ms (client timeout 1503 ms). Trace:
I20260709 12:12:44.899546 21342 consensus_queue.cc:260] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:44.900817 21342 raft_consensus.cc:3060] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:44.901098 21176 raft_consensus.cc:3060] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:12:44.900288 14903 rpcz_store.cc:269] 0709 12:12:43.733079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:43.733228 (+   149us) service_pool.cc:224] Handling call
0709 12:12:44.899658 (+1166430us) spinlock_profiling.cc:243] Waited 736 ms on lock 0x7b5400472cd4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:12:44.899764 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1693584256}
I20260709 12:12:44.763993 21435 raft_consensus.cc:515] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:44.808197 20691 leader_election.cc:290] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:44.797287 21508 raft_consensus.cc:2749] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:12:44.911481 21052 leader_election.cc:290] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:44.914163 21430 raft_consensus.cc:3060] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:44.906044 21444 raft_consensus.cc:493] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:44.942890 14304 leader_election.cc:304] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:44.919768 21519 raft_consensus.cc:493] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:44.945653 20916 raft_consensus.cc:515] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:12:44.834671 21109 consensus_queue.cc:1175] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "73d01e9b1a9d49358da4985b21d681db" responder_term: 24 status { last_received { term: 22 index: 16 } last_committed_idx: 16 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 23. Current term is 24. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:12:44.929168 21406 raft_consensus.cc:3055] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:44.931316 21496 raft_consensus.cc:493] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:44.966408 14304 leader_election.cc:304] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:44.974579 14304 leader_election.cc:304] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:44.955289 21505 raft_consensus.cc:697] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 22 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:12:44.979940 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:44.972460 14261 raft_consensus.cc:1275] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
W20260709 12:12:44.964569 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 194185us
I20260709 12:12:45.002487 14905 raft_consensus.cc:1240] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 21. Current term is 22. Ops: [21.15-21.15]
I20260709 12:12:45.002596 14303 leader_election.cc:304] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:12:44.964775 14081 catalog_manager.cc:5697] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf reported cstate change: term changed from 11 to 14, leader changed from 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130) to 65c9c1653b3346b39a0e118540e6080c (127.12.174.131). New cstate: current_term: 14 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } }
W20260709 12:12:44.979218 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 131225us
I20260709 12:12:44.959988 21444 raft_consensus.cc:3060] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:44.997356 14257 raft_consensus.cc:3060] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:45.005296 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:45.009047 14259 raft_consensus.cc:2468] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 20.
I20260709 12:12:45.010393 14081 catalog_manager.cc:5697] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf reported cstate change: term changed from 14 to 15, leader changed from 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) to 885067a0d31741bfb5c9935788e315bf (127.12.174.129). New cstate: current_term: 15 leader_uuid: "885067a0d31741bfb5c9935788e315bf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:45.010152 14263 raft_consensus.cc:1275] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 12:12:44.966271 21500 raft_consensus.cc:2749] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:12:45.014545 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:44.974035 21406 raft_consensus.cc:740] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:12:44.961376 21501 leader_election.cc:290] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:12:45.017951 14154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:45.019433 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:45.029471 14257 raft_consensus.cc:2468] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 23.
I20260709 12:12:45.026172 14189 raft_consensus.cc:2393] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 17: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:12:45.010232 21503 raft_consensus.cc:2749] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:12:45.048601 14263 raft_consensus.cc:1240] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 18 LEADER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:45.042961 14181 raft_consensus.cc:1275] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 12:12:44.974418 20691 consensus_queue.cc:1059] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.043s
I20260709 12:12:44.966977 21519 raft_consensus.cc:515] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:45.015712 21443 raft_consensus.cc:493] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:12:45.057452 14081 catalog_manager.cc:5697] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf reported cstate change: term changed from 10 to 18, leader changed from 885067a0d31741bfb5c9935788e315bf (127.12.174.129) to 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130). New cstate: current_term: 18 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } }
I20260709 12:12:45.060842 14181 raft_consensus.cc:1240] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 12:12:45.019359 21404 leader_election.cc:290] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:45.068758 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:45.071981 21505 consensus_queue.cc:237] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:12:45.079006 21522 log.cc:927] Time spent T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
W20260709 12:12:45.079932 21417 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.206s	user 0.029s	sys 0.066s
W20260709 12:12:45.080855 21417 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.211s	user 0.030s	sys 0.066s
I20260709 12:12:44.988317 21245 consensus_queue.cc:237] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:45.082780 20916 leader_election.cc:290] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 21 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:45.083463 20916 raft_consensus.cc:493] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
W20260709 12:12:45.072259 21511 log.cc:927] Time spent T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.115s	user 0.000s	sys 0.001s
I20260709 12:12:45.049191 21501 raft_consensus.cc:2804] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:45.105466 21501 raft_consensus.cc:493] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:45.106078 21501 raft_consensus.cc:3060] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:45.108891 21519 leader_election.cc:290] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:12:45.116906 21483 log.cc:927] Time spent T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 1.021s	user 0.004s	sys 0.005s
I20260709 12:12:45.079897 14081 catalog_manager.cc:5697] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf reported cstate change: term changed from 5 to 16, leader changed from 65c9c1653b3346b39a0e118540e6080c (127.12.174.131) to 885067a0d31741bfb5c9935788e315bf (127.12.174.129). New cstate: current_term: 16 leader_uuid: "885067a0d31741bfb5c9935788e315bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:44.977778 21496 raft_consensus.cc:515] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:45.094188 21435 leader_election.cc:290] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:12:45.095247 21514 log.cc:927] Time spent T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 12:12:45.096164 20979 raft_consensus.cc:493] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:45.096529 21406 consensus_queue.cc:260] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:45.059015 21052 raft_consensus.cc:2804] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:45.084487 21443 raft_consensus.cc:515] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:12:45.160379 14878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:45.164407 14081 catalog_manager.cc:5697] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf reported cstate change: term changed from 11 to 13, leader changed from 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) to 65c9c1653b3346b39a0e118540e6080c (127.12.174.131). New cstate: current_term: 13 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
W20260709 12:12:45.167158 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 190313us
I20260709 12:12:45.174841 14187 raft_consensus.cc:1275] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
W20260709 12:12:45.192474 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 175442us
I20260709 12:12:45.193346 21408 raft_consensus.cc:493] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:45.193569 21531 raft_consensus.cc:493] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:12:45.194029 21408 raft_consensus.cc:515] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:45.194167 21531 raft_consensus.cc:515] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:45.196470 21531 leader_election.cc:290] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:45.197060 21408 leader_election.cc:290] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:12:45.198891 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 196366us
W20260709 12:12:45.199788 14154 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 60803.2us
I20260709 12:12:45.202064 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 24 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:45.202256 14334 raft_consensus.cc:1275] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:12:45.202469 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 24 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:45.202998 14339 raft_consensus.cc:1240] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:45.203915 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:45.204118 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:45.204631 14330 raft_consensus.cc:2468] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 16.
I20260709 12:12:45.204772 14337 raft_consensus.cc:3060] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:45.206337 14081 catalog_manager.cc:5697] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } }
I20260709 12:12:45.165053 21342 raft_consensus.cc:493] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:45.211642 14189 raft_consensus.cc:1275] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
I20260709 12:12:45.211525 14081 catalog_manager.cc:5697] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf reported cstate change: term changed from 13 to 16. New cstate: current_term: 16 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } }
I20260709 12:12:45.084034 20916 raft_consensus.cc:515] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:45.213712 14081 catalog_manager.cc:5697] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf reported cstate change: term changed from 11 to 17. New cstate: current_term: 17 leader_uuid: "885067a0d31741bfb5c9935788e315bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:45.215910 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:45.214036 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:12:45.219530 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 215010us
I20260709 12:12:45.184243 21052 raft_consensus.cc:493] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
W20260709 12:12:45.232478 14303 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:45.202898 21404 raft_consensus.cc:493] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:45.242799 21502 consensus_queue.cc:1048] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.031s
I20260709 12:12:45.214037 21431 consensus_queue.cc:1059] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 12:12:45.199453 21435 raft_consensus.cc:493] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:45.183959 20979 raft_consensus.cc:515] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:45.253947 21526 raft_consensus.cc:493] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:45.254606 21267 raft_consensus.cc:515] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:45.257941 21517 raft_consensus.cc:493] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:45.213696 21406 raft_consensus.cc:3060] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:45.264722 14337 raft_consensus.cc:2468] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 21.
I20260709 12:12:45.238240 21052 raft_consensus.cc:3060] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:45.270273 14155 leader_election.cc:304] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:45.231099 21531 raft_consensus.cc:493] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
W20260709 12:12:45.266114 21266 consensus_meta.cc:287] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.540s	user 0.016s	sys 0.003s
I20260709 12:12:45.219606 21342 raft_consensus.cc:515] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:45.253293 21501 raft_consensus.cc:515] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:45.229346 21513 consensus_queue.cc:1048] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.060s
I20260709 12:12:45.274623 14155 leader_election.cc:304] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:45.269407 21431 consensus_queue.cc:1243] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer 17aab1bbf5014936aa18cc21818b26ec log is divergent from this leader: its last log entry 18.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 12:12:45.261101 21404 raft_consensus.cc:515] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:45.304049 21443 leader_election.cc:290] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:45.305665 21404 leader_election.cc:290] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:45.305846 20979 leader_election.cc:290] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:45.270044 21526 raft_consensus.cc:515] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:45.307196 21528 raft_consensus.cc:2749] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:45.308648 21526 leader_election.cc:290] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:45.309275 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:45.310556 21503 raft_consensus.cc:493] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:45.311110 21503 raft_consensus.cc:515] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:45.312353 21342 leader_election.cc:290] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:45.313109 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:45.313378 21503 leader_election.cc:290] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:45.313879 14337 raft_consensus.cc:2468] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 19.
W20260709 12:12:45.318055 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:45.321689 21537 consensus_queue.cc:1048] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:12:45.304095 20916 leader_election.cc:290] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:45.314482 21519 raft_consensus.cc:493] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:45.324108 21501 leader_election.cc:290] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 20 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:45.318898 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:45.306921 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:45.343698 21406 raft_consensus.cc:493] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:45.316155 21444 raft_consensus.cc:515] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:45.350422 14258 raft_consensus.cc:2468] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 19.
I20260709 12:12:45.329810 20691 consensus_queue.cc:1059] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:12:45.294579 21137 consensus_queue.cc:1048] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.036s
I20260709 12:12:45.352857 14303 leader_election.cc:304] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:45.358270 21524 raft_consensus.cc:493] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:45.359002 21524 raft_consensus.cc:515] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:12:45.359701 21487 log.cc:927] Time spent T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.758s	user 0.003s	sys 0.002s
I20260709 12:12:45.275004 21508 raft_consensus.cc:2749] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:12:45.272095 21510 consensus_queue.cc:1048] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.063s
I20260709 12:12:45.334520 21496 leader_election.cc:290] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:45.338160 21534 raft_consensus.cc:493] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:12:45.339262 14155 leader_election.cc:304] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:45.338523 21503 raft_consensus.cc:493] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:45.344647 21519 raft_consensus.cc:515] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:45.275086 21531 raft_consensus.cc:515] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:45.375990 21503 raft_consensus.cc:515] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:45.268486 21435 raft_consensus.cc:515] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:45.378239 21519 leader_election.cc:290] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:45.378355 21503 leader_election.cc:290] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:45.378939 21435 leader_election.cc:290] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:45.315128 21502 raft_consensus.cc:493] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:12:45.361788 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:45.362843 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:45.403878 14903 raft_consensus.cc:2393] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 20: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
I20260709 12:12:45.363003 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 25 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:45.363366 20692 raft_consensus.cc:2749] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:12:45.403949 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:45.363651 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:45.404707 14187 raft_consensus.cc:2468] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 24.
I20260709 12:12:45.405150 14183 raft_consensus.cc:2393] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 16: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
W20260709 12:12:45.366043 14302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:45.366237 21444 leader_election.cc:290] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 20 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:45.271617 21517 raft_consensus.cc:515] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:45.345953 21431 raft_consensus.cc:493] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:12:45.418767 21431 raft_consensus.cc:515] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:45.347719 14332 raft_consensus.cc:2393] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 18: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
W20260709 12:12:45.409309 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 70159.2us
I20260709 12:12:45.410949 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:45.411216 21496 raft_consensus.cc:2749] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:12:45.411866 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:45.412153 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:45.413332 21415 leader_election.cc:290] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 23 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:45.415727 20916 raft_consensus.cc:493] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:45.407119 21250 raft_consensus.cc:493] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:45.414893 14303 leader_election.cc:304] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:45.416467 21505 raft_consensus.cc:493] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:45.416944 21502 raft_consensus.cc:515] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:45.453068 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:45.426028 14332 raft_consensus.cc:1240] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:45.422111 14337 raft_consensus.cc:1275] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 23 index: 11. Preceding OpId from leader: term: 24 index: 12. (index mismatch)
I20260709 12:12:45.431795 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:45.433152 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:45.434056 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:45.415329 21406 raft_consensus.cc:515] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:45.436085 20547 consensus_queue.cc:1048] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:12:45.436654 14263 raft_consensus.cc:1240] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 20. Current term is 21. Ops: [20.11-20.11]
I20260709 12:12:45.454659 14185 raft_consensus.cc:2468] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 15.
W20260709 12:12:45.437111 21498 log.cc:927] Time spent T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.835s	user 0.002s	sys 0.003s
I20260709 12:12:45.436970 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:45.458302 14337 raft_consensus.cc:1240] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 20. Current term is 21. Ops: [20.11-20.11]
I20260709 12:12:45.431509 14912 raft_consensus.cc:2468] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 16.
I20260709 12:12:45.437646 21528 consensus_queue.cc:1059] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 22.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:12:45.421701 21431 leader_election.cc:290] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:45.437958 14187 raft_consensus.cc:1275] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 24 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 12:12:45.438285 21393 raft_consensus.cc:493] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:45.448062 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:45.448554 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:45.449358 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:45.466935 14339 raft_consensus.cc:2468] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 15.
I20260709 12:12:45.452737 14303 leader_election.cc:304] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:45.455327 14335 raft_consensus.cc:2368] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 17. Current term is 18.
I20260709 12:12:45.457585 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:45.458490 14257 raft_consensus.cc:2468] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 17.
I20260709 12:12:45.468061 14332 raft_consensus.cc:3060] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:45.453059 21250 raft_consensus.cc:515] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:45.462122 21502 leader_election.cc:290] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:45.453199 20916 raft_consensus.cc:515] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:45.450091 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:45.472954 14260 raft_consensus.cc:2410] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for term 21 because replica has last-logged OpId of term: 19 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 9.
I20260709 12:12:45.472973 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:45.478945 14303 leader_election.cc:304] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:45.484942 14155 leader_election.cc:304] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:45.457509 21430 raft_consensus.cc:2804] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:12:45.490813 14155 leader_election.cc:400] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 pre-election: Vote denied by peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957) with higher term. Message: Invalid argument: T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 17. Current term is 18.
I20260709 12:12:45.491954 14155 leader_election.cc:403] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:12:45.465633 21530 raft_consensus.cc:493] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:45.375546 21534 raft_consensus.cc:515] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:45.503252 14332 raft_consensus.cc:2468] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 22.
I20260709 12:12:45.480760 21502 raft_consensus.cc:2749] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:45.456100 21505 raft_consensus.cc:515] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:45.515930 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:45.507715 21267 leader_election.cc:290] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:45.502936 20547 consensus_queue.cc:1048] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.017s
I20260709 12:12:45.523069 21531 leader_election.cc:290] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:45.496943 21523 raft_consensus.cc:2804] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:45.506189 21528 raft_consensus.cc:2749] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957) with higher term. Message: Invalid argument: T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 17. Current term is 18.
I20260709 12:12:45.528477 21523 raft_consensus.cc:493] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:45.505616 21533 raft_consensus.cc:493] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:45.556491 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:45.497252 21537 raft_consensus.cc:2804] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:45.477592 21393 raft_consensus.cc:515] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:45.487099 21444 consensus_queue.cc:1059] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.048s
I20260709 12:12:45.492466 21496 consensus_queue.cc:1059] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.062s
I20260709 12:12:45.512951 21530 raft_consensus.cc:515] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:45.563457 21531 raft_consensus.cc:493] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:45.556005 21523 raft_consensus.cc:3060] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:45.566322 21267 raft_consensus.cc:493] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:45.567449 21537 raft_consensus.cc:493] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:45.600713 21534 leader_election.cc:290] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:45.595247 21446 raft_consensus.cc:493] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:45.613085 21085 raft_consensus.cc:493] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:45.615024 21267 raft_consensus.cc:515] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:45.618235 14186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56046 (request call id 3124) took 1206 ms. Trace:
I20260709 12:12:45.635685 14186 rpcz_store.cc:276] 0709 12:12:44.411655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:44.413616 (+  1961us) service_pool.cc:224] Handling call
0709 12:12:44.414017 (+   401us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:12:44.414426 (+   409us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:44.414458 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:12:44.422635 (+  8177us) log.cc:844] Serialized 52 byte log entry
0709 12:12:44.575695 (+153060us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:12:44.575754 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:44.575846 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:45.436472 (+860626us) spinlock_profiling.cc:243] Waited 2.26 ms on lock 0x7b4400022b4c. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2123f74c85 00007f2123f756a2 00007f2126ce71db 00007f2126ce2aaf 00007f2126cd686e 00007f2126cd5bb6 00007f2126cd57d8 00007f2126cdf221 00007f2126cdf1d9 00007f2126cdf169
0709 12:12:45.613979 (+177507us) raft_consensus.cc:1685] finished
0709 12:12:45.614004 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:45.618144 (+  4140us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2068,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":3277,"spinlock_wait_cycles":5208448,"thread_start_us":103642,"threads_started":1,"wal-append.queue_time_us":151827}
I20260709 12:12:45.608302 21528 raft_consensus.cc:3055] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:45.634733 21537 raft_consensus.cc:3060] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:45.575016 21533 raft_consensus.cc:515] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:45.611830 21406 leader_election.cc:290] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:45.635455 20979 raft_consensus.cc:493] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:45.614678 21531 raft_consensus.cc:515] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:45.643201 21528 raft_consensus.cc:740] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:12:45.639714 21446 raft_consensus.cc:515] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:45.658762 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:45.640933 21085 raft_consensus.cc:515] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:45.660547 14332 raft_consensus.cc:2468] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 16.
I20260709 12:12:45.651793 21250 leader_election.cc:290] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:45.671249 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:45.672192 21393 leader_election.cc:290] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:45.665606 21326 raft_consensus.cc:3055] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:45.674173 21326 raft_consensus.cc:740] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:45.674767 21085 leader_election.cc:290] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:45.675098 21326 consensus_queue.cc:260] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:45.676456 21326 raft_consensus.cc:3060] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:12:45.677724 14878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:45.676451 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:45.678697 20916 leader_election.cc:290] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:45.682435 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:45.667757 21502 raft_consensus.cc:493] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:45.649705 20979 raft_consensus.cc:515] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:45.684827 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:45.690948 21502 raft_consensus.cc:515] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:45.694420 21530 leader_election.cc:290] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:45.694649 21502 leader_election.cc:290] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:45.683019 21267 leader_election.cc:290] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:45.700173 20979 leader_election.cc:290] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:45.700934 14261 raft_consensus.cc:2468] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 16.
I20260709 12:12:45.702592 14330 raft_consensus.cc:2468] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 17.
I20260709 12:12:45.691407 21528 consensus_queue.cc:260] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:45.713367 21531 leader_election.cc:290] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:45.677459 21446 leader_election.cc:290] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:45.717521 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:45.720485 14256 raft_consensus.cc:3060] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:12:45.731465 21547 log.cc:927] Time spent T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 12:12:45.734375 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
W20260709 12:12:45.735006 14303 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:45.709357 21256 raft_consensus.cc:3055] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:45.736310 14335 raft_consensus.cc:1240] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 21. Current term is 22. Ops: [21.15-21.15]
I20260709 12:12:45.731777 14338 raft_consensus.cc:1275] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 12:12:45.739292 14230 leader_election.cc:304] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:45.755235 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:45.760426 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:45.760921 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:45.763579 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:45.761458 14260 raft_consensus.cc:2468] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 17.
I20260709 12:12:45.765377 14259 raft_consensus.cc:1275] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 12:12:45.767994 14264 raft_consensus.cc:1275] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 10. (term mismatch)
I20260709 12:12:45.768931 14264 pending_rounds.cc:85] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec: Aborting all ops after (but not including) 9
I20260709 12:12:45.769301 14264 pending_rounds.cc:107] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec: Aborting uncommitted NO_OP operation due to leader change: 19.10
I20260709 12:12:45.769532 14264 raft_consensus.cc:2889] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:45.756188 21363 raft_consensus.cc:493] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:45.775641 20979 raft_consensus.cc:2749] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:12:45.736384 21256 raft_consensus.cc:740] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:45.777503 21531 raft_consensus.cc:493] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:45.777336 21256 consensus_queue.cc:260] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:45.778332 21531 raft_consensus.cc:515] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:45.781098 21517 leader_election.cc:290] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:45.781289 21531 leader_election.cc:290] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:45.778724 21256 raft_consensus.cc:3060] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:45.782353 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:45.786307 20979 consensus_queue.cc:1048] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.002s
I20260709 12:12:45.776153 21363 raft_consensus.cc:515] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:45.809585 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:45.810539 14334 raft_consensus.cc:2393] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 19: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:12:45.811172 14339 raft_consensus.cc:2468] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 22.
I20260709 12:12:45.811688 21363 leader_election.cc:290] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:45.812937 14334 raft_consensus.cc:1275] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 24 index: 17. (term mismatch)
W20260709 12:12:45.793915 21052 consensus_meta.cc:287] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.519s	user 0.015s	sys 0.000s
I20260709 12:12:45.701151 21533 leader_election.cc:290] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:45.796948 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:45.800781 14184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56044 (request call id 3578) took 1063 ms. Trace:
I20260709 12:12:45.802286 21500 raft_consensus.cc:493] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:45.804227 21436 raft_consensus.cc:493] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
W20260709 12:12:45.813747 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:45.814118 14877 leader_election.cc:304] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:45.819173 14333 raft_consensus.cc:3055] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:45.825234 21430 raft_consensus.cc:493] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:45.789968 14230 leader_election.cc:304] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:12:45.831449 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:45.830199 14256 raft_consensus.cc:2468] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 18.
I20260709 12:12:45.834728 14334 pending_rounds.cc:85] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c: Aborting all ops after (but not including) 16
W20260709 12:12:45.855496 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 65625.7us
I20260709 12:12:45.838063 14184 rpcz_store.cc:276] 0709 12:12:44.737393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:44.738728 (+  1335us) service_pool.cc:224] Handling call
0709 12:12:45.800558 (+1061830us) spinlock_profiling.cc:243] Waited 26.4 ms on lock 0x7b54001117d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:12:45.800709 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":60742016}
W20260709 12:12:45.841856 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:45.855434 14334 pending_rounds.cc:107] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c: Aborting uncommitted NO_OP operation due to leader change: 23.17
I20260709 12:12:45.855155 14333 raft_consensus.cc:740] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:45.858263 14334 raft_consensus.cc:2889] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:45.838362 21528 raft_consensus.cc:3060] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:45.847681 14330 raft_consensus.cc:1275] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 12:12:45.860284 14230 leader_election.cc:304] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:12:45.856413 21430 raft_consensus.cc:3060] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:12:45.859386 14333 consensus_queue.cc:260] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:45.856911 20547 raft_consensus.cc:2749] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:12:45.868388 14333 raft_consensus.cc:3060] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:45.865458 14230 leader_election.cc:304] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:12:45.869350 14256 raft_consensus.cc:1240] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 18. Current term is 19. Ops: []
W20260709 12:12:45.861420 21386 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.263s	user 0.007s	sys 0.010s
I20260709 12:12:45.859123 21533 raft_consensus.cc:2804] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:45.871649 14877 leader_election.cc:304] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:45.845921 21052 raft_consensus.cc:515] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:45.872939 14230 leader_election.cc:304] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:12:45.875977 21136 consensus_queue.cc:1048] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.002s
I20260709 12:12:45.874729 21533 raft_consensus.cc:493] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:45.871973 21473 consensus_queue.cc:1048] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.009s
I20260709 12:12:45.872123 21530 raft_consensus.cc:2804] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:45.868016 21469 consensus_queue.cc:1059] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.015s
I20260709 12:12:45.868127 21085 raft_consensus.cc:2804] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:12:45.887076 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:45.887903 14262 raft_consensus.cc:2468] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 17.
I20260709 12:12:45.888815 21453 raft_consensus.cc:3060] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:45.889178 14262 raft_consensus.cc:1275] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 12:12:45.858693 21537 raft_consensus.cc:515] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:45.857887 21436 raft_consensus.cc:515] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:45.892262 14338 raft_consensus.cc:1240] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:45.892202 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 25 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:45.894922 14262 raft_consensus.cc:1240] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 18 LEADER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 12:12:45.856405 21500 raft_consensus.cc:515] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:45.876379 21510 consensus_queue.cc:1048] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.014s
I20260709 12:12:45.896136 21524 leader_election.cc:290] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:45.897522 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:12:45.891896 21548 log.cc:927] Time spent T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.201s	user 0.000s	sys 0.001s
I20260709 12:12:45.898335 21367 raft_consensus.cc:493] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:45.898869 21367 raft_consensus.cc:515] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:45.876801 14155 leader_election.cc:304] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:45.880847 14912 raft_consensus.cc:1240] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 21 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 20. Current term is 21. Ops: []
I20260709 12:12:45.901973 14155 leader_election.cc:304] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:45.886698 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:45.903666 14265 raft_consensus.cc:2393] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 21: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
W20260709 12:12:45.903694 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:45.872290 21386 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.277s	user 0.007s	sys 0.010s
I20260709 12:12:45.904790 14260 raft_consensus.cc:1275] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:12:45.903947 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:45.904513 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:45.880337 21533 raft_consensus.cc:3060] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:45.882688 21530 raft_consensus.cc:493] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:12:45.881608 21444 raft_consensus.cc:3055] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:12:45.905268 20547 raft_consensus.cc:2749] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:12:45.912418 21367 leader_election.cc:290] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:45.912827 21417 raft_consensus.cc:3055] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:45.878991 21136 raft_consensus.cc:2804] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:12:45.886230 21085 raft_consensus.cc:697] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 21 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:45.939728 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:45.914076 21508 raft_consensus.cc:3055] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:12:45.904819 14230 leader_election.cc:304] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:12:45.893664 21537 leader_election.cc:290] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:45.922923 14332 raft_consensus.cc:2468] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 18.
I20260709 12:12:45.922793 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:45.927956 14155 leader_election.cc:304] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:45.928516 21393 raft_consensus.cc:2749] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:12:45.929193 21507 consensus_queue.cc:1059] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:12:45.929975 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:45.943292 21314 raft_consensus.cc:2804] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:45.931087 21500 leader_election.cc:290] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:45.923372 21551 raft_consensus.cc:2749] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:46.004875 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:46.007295 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:45.943009 21508 raft_consensus.cc:740] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:12:45.876560 21517 raft_consensus.cc:493] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:45.934219 14304 leader_election.cc:304] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
W20260709 12:12:46.024712 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 90588.4us
W20260709 12:12:46.024645 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 65436.1us
I20260709 12:12:45.937290 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:46.025939 14304 leader_election.cc:304] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:45.926836 21523 raft_consensus.cc:515] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:45.941532 14230 leader_election.cc:304] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:12:45.926050 21530 raft_consensus.cc:3060] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:45.923579 21386 raft_consensus.cc:697] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 20 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:12:45.925364 21444 raft_consensus.cc:740] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:12:45.940551 21469 consensus_queue.cc:1048] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.061s
I20260709 12:12:45.946112 21136 raft_consensus.cc:697] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 22 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:46.008088 14912 raft_consensus.cc:2468] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 18.
I20260709 12:12:45.938344 21417 raft_consensus.cc:740] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:45.942008 14261 raft_consensus.cc:2468] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 22.
I20260709 12:12:45.999879 21524 raft_consensus.cc:2749] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:46.034559 14304 leader_election.cc:304] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
W20260709 12:12:46.035826 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 94338us
I20260709 12:12:46.058730 14230 leader_election.cc:304] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:12:46.036716 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:46.000084 21314 raft_consensus.cc:493] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:46.068243 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:46.004452 21436 leader_election.cc:290] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:45.934257 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:46.071121 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:46.074072 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:46.075587 14256 raft_consensus.cc:2468] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 19.
I20260709 12:12:46.035945 21500 raft_consensus.cc:2804] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 12:12:46.076713 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 80952.1us
I20260709 12:12:46.034575 21109 raft_consensus.cc:2749] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:46.071911 14304 leader_election.cc:304] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:46.053427 21531 raft_consensus.cc:2804] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:46.035467 21513 consensus_queue.cc:1048] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.036s
I20260709 12:12:46.079252 14877 leader_election.cc:304] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:12:46.079135 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:46.084874 14906 raft_consensus.cc:2393] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 23: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
I20260709 12:12:46.072068 21314 raft_consensus.cc:3060] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:46.071326 21326 raft_consensus.cc:2804] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:12:46.084288 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:46.088675 14229 leader_election.cc:304] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:12:46.090335 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:46.094874 14906 raft_consensus.cc:2393] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 22: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
I20260709 12:12:46.094471 21136 consensus_queue.cc:237] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:46.096903 14155 leader_election.cc:304] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:46.043504 21537 consensus_queue.cc:1048] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 12:12:46.098388 21417 consensus_queue.cc:260] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:46.099532 21326 raft_consensus.cc:493] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:46.100069 21326 raft_consensus.cc:3060] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:46.085597 21436 raft_consensus.cc:2749] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:46.102520 21507 raft_consensus.cc:2749] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:46.104473 21446 consensus_queue.cc:1059] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:12:46.110160 21386 consensus_queue.cc:237] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:46.112397 21251 raft_consensus.cc:3055] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:12:46.114106 21251 raft_consensus.cc:740] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:46.081287 14304 leader_election.cc:304] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:12:46.117971 21444 consensus_queue.cc:260] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:46.119575 21510 consensus_queue.cc:1059] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:12:46.119927 21431 raft_consensus.cc:2804] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:46.120752 21431 raft_consensus.cc:697] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 18 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:46.122403 21431 consensus_queue.cc:237] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:46.128053 14304 leader_election.cc:304] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:46.131430 21052 leader_election.cc:290] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:46.135124 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:46.078554 21500 raft_consensus.cc:493] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:46.138844 21500 raft_consensus.cc:3060] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:46.143173 21513 raft_consensus.cc:2804] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:46.143865 21513 raft_consensus.cc:493] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:46.144411 21513 raft_consensus.cc:3060] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:46.084102 21531 raft_consensus.cc:493] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:46.147066 21531 raft_consensus.cc:3060] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:46.076839 21367 raft_consensus.cc:2804] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:46.150542 21367 raft_consensus.cc:697] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 19 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:46.152139 21367 consensus_queue.cc:237] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:12:46.158200 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 69695.4us
I20260709 12:12:46.098448 14155 leader_election.cc:304] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:46.161913 14229 leader_election.cc:304] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:46.139897 21251 consensus_queue.cc:260] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:46.043587 21517 raft_consensus.cc:515] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:46.187018 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:46.089573 21284 raft_consensus.cc:2804] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:46.207193 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:46.208022 14188 raft_consensus.cc:2468] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 19.
I20260709 12:12:46.090811 21508 consensus_queue.cc:260] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:46.099670 21417 raft_consensus.cc:3060] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:46.173529 21256 raft_consensus.cc:2804] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:46.174283 21415 consensus_queue.cc:1048] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:46.176774 21523 leader_election.cc:290] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 16 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:12:46.179495 14154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:46.182260 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:46.183635 14303 leader_election.cc:304] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
W20260709 12:12:46.238552 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 55031.5us
I20260709 12:12:46.239456 14303 leader_election.cc:304] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:46.084525 21473 consensus_queue.cc:1048] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.101s
I20260709 12:12:46.185722 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:46.165226 21267 raft_consensus.cc:2749] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:12:46.191386 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 93007.6us
I20260709 12:12:46.200474 21517 leader_election.cc:290] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:46.185384 14304 leader_election.cc:304] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:12:46.215869 21516 raft_consensus.cc:493] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:46.215369 21284 raft_consensus.cc:493] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:46.222072 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:46.183526 21393 raft_consensus.cc:2749] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:12:46.241472 20691 raft_consensus.cc:2749] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:12:46.243191 14878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:46.254201 14154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:46.222767 21256 raft_consensus.cc:493] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:46.218789 14912 raft_consensus.cc:2468] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 16.
I20260709 12:12:46.255053 14155 leader_election.cc:304] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:46.258106 21512 raft_consensus.cc:2804] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:12:46.287000 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:46.268796 21449 raft_consensus.cc:493] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:46.269994 21523 raft_consensus.cc:493] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:46.219590 21251 raft_consensus.cc:3060] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:46.270394 14190 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 3576) took 1533 ms. Trace:
I20260709 12:12:46.201447 21052 raft_consensus.cc:493] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
W20260709 12:12:46.255474 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 70184.2us
I20260709 12:12:46.081678 21085 consensus_queue.cc:237] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:46.307056 14190 rpcz_store.cc:276] 0709 12:12:44.736717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:44.737998 (+  1281us) service_pool.cc:224] Handling call
0709 12:12:44.738369 (+   371us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:44.832286 (+ 93917us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 12:12:44.925318 (+ 93032us) log.cc:844] Serialized 14 byte log entry
0709 12:12:45.826118 (+900800us) spinlock_profiling.cc:243] Waited 7.76 ms on lock 0x7b1800302560. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f212cf16ab1 00007f212cf23281 00007f2124030e07 00007f212ce8b9a9 00007f212404d69b 00007f212404b93f 00007f212404dc02 00007f2126cd520b 00007f2126cdad23 00007f2126cdb23a 00007f2127145a2a
0709 12:12:46.057615 (+231497us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:46.077178 (+ 19563us) log.cc:844] Serialized 26 byte log entry
0709 12:12:46.077351 (+   173us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:12:46.077387 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:46.077555 (+   168us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:46.270075 (+192520us) raft_consensus.cc:1685] finished
0709 12:12:46.270188 (+   113us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:46.270325 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":51658,"prepare.queue_time_us":92922,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":3034,"raft.queue_time_us":177320,"raft.run_cpu_time_us":260,"raft.run_wall_time_us":6148,"spinlock_wait_cycles":17859456,"thread_start_us":274013,"threads_started":2,"wal-append.queue_time_us":1246917}
I20260709 12:12:46.297051 14333 raft_consensus.cc:1275] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 11. (term mismatch)
I20260709 12:12:46.300055 14905 raft_consensus.cc:2468] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 18.
I20260709 12:12:46.315299 14333 pending_rounds.cc:85] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c: Aborting all ops after (but not including) 10
I20260709 12:12:46.302584 14186 raft_consensus.cc:1240] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:46.310595 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:46.311743 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:46.275921 21508 raft_consensus.cc:3060] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:12:46.312520 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:46.315632 14333 pending_rounds.cc:107] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c: Aborting uncommitted NO_OP operation due to leader change: 17.11
I20260709 12:12:46.321367 14333 raft_consensus.cc:2889] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:46.318984 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:12:46.315157 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 60210.7us
I20260709 12:12:46.316588 14188 raft_consensus.cc:1240] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:46.323845 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:46.317116 14256 raft_consensus.cc:2468] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 19.
I20260709 12:12:46.255021 21245 raft_consensus.cc:2804] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:46.279279 21284 raft_consensus.cc:3060] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:46.288235 21256 raft_consensus.cc:3060] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:46.330472 14264 raft_consensus.cc:1240] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 22 LEADER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 21. Current term is 22. Ops: []
I20260709 12:12:46.323231 14155 leader_election.cc:304] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:46.329479 14304 leader_election.cc:304] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:12:46.336367 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:46.257405 21516 raft_consensus.cc:515] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:46.285992 21512 raft_consensus.cc:493] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:46.354756 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:46.355618 14181 raft_consensus.cc:2393] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 18: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:12:46.360555 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:46.338797 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:46.340703 14187 raft_consensus.cc:2468] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 17.
I20260709 12:12:46.342031 20691 raft_consensus.cc:2804] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:46.343613 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:46.365262 20691 raft_consensus.cc:493] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:46.350747 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:46.365783 20691 raft_consensus.cc:3060] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:46.298923 21267 raft_consensus.cc:493] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:12:46.351819 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:46.372524 14183 raft_consensus.cc:2468] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 20.
I20260709 12:12:46.352360 21176 raft_consensus.cc:2804] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:46.333977 21534 raft_consensus.cc:493] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:46.331903 21507 raft_consensus.cc:3060] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:12:46.337603 21499 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 18 current term: 18 is higher.
I20260709 12:12:46.388711 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:46.337203 21136 raft_consensus.cc:493] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:46.334187 21245 raft_consensus.cc:493] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
W20260709 12:12:46.352475 21487 log.cc:927] Time spent T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:12:46.330170 21052 raft_consensus.cc:515] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:46.352190 21217 raft_consensus.cc:3055] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:12:46.345173 21524 raft_consensus.cc:493] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:46.371483 21512 raft_consensus.cc:3060] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:46.312976 21449 raft_consensus.cc:515] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:46.380631 21176 raft_consensus.cc:493] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:46.319692 21523 raft_consensus.cc:515] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:46.415729 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:46.396559 14258 raft_consensus.cc:2468] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 20.
I20260709 12:12:46.445921 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:46.408212 21245 raft_consensus.cc:3060] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:46.405265 21520 raft_consensus.cc:493] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:46.464082 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:46.466169 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:46.421157 21217 raft_consensus.cc:740] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:12:46.468021 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:46.382464 21267 raft_consensus.cc:515] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:12:46.469810 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:46.478003 14181 raft_consensus.cc:2410] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for term 25 because replica has last-logged OpId of term: 24 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 12.
I20260709 12:12:46.458673 21176 raft_consensus.cc:3060] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:46.487486 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:46.462908 21504 raft_consensus.cc:493] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:12:46.473501 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:46.472872 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:46.388542 21534 raft_consensus.cc:515] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:12:46.474190 21528 consensus_meta.cc:287] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.607s	user 0.008s	sys 0.007s
I20260709 12:12:46.412169 21136 raft_consensus.cc:515] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:46.444881 21524 raft_consensus.cc:515] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:12:46.432399 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 216797us
I20260709 12:12:46.505951 20691 raft_consensus.cc:515] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:46.470155 14304 leader_election.cc:304] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:46.518239 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:12:46.530542 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 60495.5us
I20260709 12:12:46.486465 21415 raft_consensus.cc:493] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:46.541639 20691 leader_election.cc:290] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:46.553025 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:12:46.545634 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 320638us
I20260709 12:12:46.467880 21520 raft_consensus.cc:515] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:12:46.585698 21559 log.cc:927] Time spent T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
W20260709 12:12:46.611016 21557 log.cc:927] Time spent T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 12:12:46.536386 21516 leader_election.cc:290] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:46.572131 21415 raft_consensus.cc:515] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:46.581997 21217 consensus_queue.cc:260] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:46.767390 14263 raft_consensus.cc:2468] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 18.
I20260709 12:12:46.535471 21109 raft_consensus.cc:2804] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:46.806663 14187 raft_consensus.cc:1275] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
W20260709 12:12:46.766849 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 238132us
W20260709 12:12:46.788000 21453 consensus_meta.cc:287] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.895s	user 0.011s	sys 0.005s
W20260709 12:12:46.786641 21530 consensus_meta.cc:287] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.730s	user 0.013s	sys 0.003s
I20260709 12:12:46.768949 14188 raft_consensus.cc:2410] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for term 25 because replica has last-logged OpId of term: 24 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 15.
W20260709 12:12:46.787700 21430 consensus_meta.cc:287] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.911s	user 0.015s	sys 0.002s
W20260709 12:12:46.798429 21326 consensus_meta.cc:287] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.698s	user 0.018s	sys 0.000s
W20260709 12:12:46.819897 14878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:46.792366 21558 log.cc:927] Time spent T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.328s	user 0.008s	sys 0.000s
I20260709 12:12:46.780630 21393 raft_consensus.cc:493] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:46.837317 14265 raft_consensus.cc:2468] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 23.
I20260709 12:12:46.503665 21504 raft_consensus.cc:515] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:12:46.860371 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:46.800531 14263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41764 (request call id 3648) took 1041 ms. Trace:
I20260709 12:12:46.887100 14263 rpcz_store.cc:276] 0709 12:12:45.759530 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:45.759660 (+   130us) service_pool.cc:224] Handling call
0709 12:12:46.350548 (+590888us) spinlock_profiling.cc:243] Waited 35.9 ms on lock 0x7b5800060c98. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2124016b71 00007f2124016a22 00007f212cf2f8d9 00007f212c089ee0 00007f212c1530ab 00007f212c153131 00007f212c1010a0 00007f212c100984 00007f212567b6d4 00007f212567b662
0709 12:12:46.800464 (+449916us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":82484480}
I20260709 12:12:46.814361 21516 raft_consensus.cc:493] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:46.815935 21217 raft_consensus.cc:3060] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:46.865103 21551 raft_consensus.cc:493] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:46.914716 14185 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.005s	sys 0.016s
W20260709 12:12:46.915990 14185 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.509s	user 0.006s	sys 0.016s
I20260709 12:12:46.918011 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:46.859730 21473 raft_consensus.cc:493] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:46.855758 21109 raft_consensus.cc:697] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 20 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:46.923758 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:46.925088 14189 raft_consensus.cc:2393] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 16: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:12:46.930124 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:46.882649 21326 raft_consensus.cc:515] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:46.886511 21526 raft_consensus.cc:493] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:46.912230 21551 raft_consensus.cc:515] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:46.862689 21430 raft_consensus.cc:515] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:46.862164 21530 raft_consensus.cc:515] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:46.933804 21539 raft_consensus.cc:493] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:46.957165 14339 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 1437) took 1019 ms. Trace:
I20260709 12:12:46.970158 14339 rpcz_store.cc:276] 0709 12:12:45.937869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:45.938037 (+   168us) service_pool.cc:224] Handling call
0709 12:12:45.938400 (+   363us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:45.938912 (+   512us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:45.938944 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:45.939356 (+   412us) log.cc:844] Serialized 26 byte log entry
0709 12:12:46.278037 (+338681us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:12:46.298209 (+ 20172us) log.cc:844] Serialized 14 byte log entry
0709 12:12:46.298820 (+   611us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:46.298898 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:46.956887 (+657989us) raft_consensus.cc:1685] finished
0709 12:12:46.956913 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:46.957084 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":19796,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":8448,"raft.queue_time_us":3842,"raft.run_cpu_time_us":274,"raft.run_wall_time_us":4303,"thread_start_us":273869,"threads_started":1,"wal-append.queue_time_us":464965}
I20260709 12:12:46.909843 21393 raft_consensus.cc:515] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:46.974884 14335 raft_consensus.cc:1240] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 25 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 24. Current term is 25. Ops: [24.12-24.12]
I20260709 12:12:46.949023 21573 raft_consensus.cc:493] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:12:46.981882 21520 leader_election.cc:290] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:46.949757 21449 leader_election.cc:290] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:46.951968 21534 leader_election.cc:290] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:12:46.982651 21314 consensus_meta.cc:287] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.848s	user 0.018s	sys 0.002s
I20260709 12:12:46.953785 21136 leader_election.cc:290] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:46.983130 21326 leader_election.cc:290] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:46.920145 21516 raft_consensus.cc:515] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:46.953992 21267 leader_election.cc:290] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:46.953788 21526 raft_consensus.cc:515] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:46.934046 21473 raft_consensus.cc:515] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:46.976675 21517 raft_consensus.cc:493] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:46.997455 21523 leader_election.cc:290] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:46.976171 21539 raft_consensus.cc:515] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:12:47.035985 21531 consensus_meta.cc:287] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.888s	user 0.017s	sys 0.001s
W20260709 12:12:47.040484 21500 consensus_meta.cc:287] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.901s	user 0.010s	sys 0.008s
W20260709 12:12:47.042279 21508 consensus_meta.cc:287] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.706s	user 0.009s	sys 0.015s
I20260709 12:12:47.002485 21572 consensus_queue.cc:1048] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.050s
I20260709 12:12:47.056231 21530 leader_election.cc:290] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:12:47.042116 21512 consensus_meta.cc:287] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.584s	user 0.015s	sys 0.009s
I20260709 12:12:47.057171 21512 raft_consensus.cc:515] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:12:47.042706 21533 consensus_meta.cc:287] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 1.109s	user 0.017s	sys 0.003s
I20260709 12:12:47.059201 21533 raft_consensus.cc:515] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:47.059628 21512 leader_election.cc:290] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 23 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:12:47.048005 21561 log.cc:927] Time spent T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.254s	user 0.000s	sys 0.001s
I20260709 12:12:47.048179 21430 leader_election.cc:290] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 25 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:46.993885 21573 raft_consensus.cc:515] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:12:47.045101 21513 consensus_meta.cc:287] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.900s	user 0.014s	sys 0.008s
I20260709 12:12:47.062132 21513 raft_consensus.cc:515] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:47.062698 21573 leader_election.cc:290] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:47.047078 21517 raft_consensus.cc:515] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:47.050252 21473 leader_election.cc:290] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:47.051158 21504 leader_election.cc:290] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:47.051426 21500 raft_consensus.cc:515] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:47.065948 21500 leader_election.cc:290] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 17 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:47.047345 21531 raft_consensus.cc:515] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:47.068940 21531 leader_election.cc:290] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:12:47.052641 21417 consensus_meta.cc:287] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.824s	user 0.005s	sys 0.006s
W20260709 12:12:47.053529 21507 consensus_meta.cc:287] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.656s	user 0.009s	sys 0.000s
I20260709 12:12:47.070158 21507 raft_consensus.cc:2749] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:47.054418 21539 leader_election.cc:290] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:47.054723 21393 leader_election.cc:290] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:47.056598 21551 leader_election.cc:290] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:47.049659 21516 leader_election.cc:290] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:47.072036 21513 leader_election.cc:290] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:47.061590 21533 leader_election.cc:290] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:47.066015 21517 leader_election.cc:290] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:47.129016 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:47.130635 14257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41764 (request call id 3654) took 1304 ms. Trace:
I20260709 12:12:47.131313 14257 rpcz_store.cc:276] 0709 12:12:45.826167 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:45.827734 (+  1567us) service_pool.cc:224] Handling call
0709 12:12:46.343921 (+516187us) spinlock_profiling.cc:243] Waited 3.41 ms on lock 0x7b5800060c98. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2124016b71 00007f2124016a22 00007f212cf2f8d9 00007f212c089ee0 00007f212c1530ab 00007f212c153131 00007f212c114fc0 00007f212c0ff929 00007f212c0ff3d2 00007f2125676bd4
0709 12:12:46.344130 (+   209us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:46.344466 (+   336us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:46.344497 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:46.371245 (+ 26748us) log.cc:844] Serialized 26 byte log entry
0709 12:12:46.680496 (+309251us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:12:46.680547 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:46.682537 (+  1990us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:47.129658 (+447121us) raft_consensus.cc:1685] finished
0709 12:12:47.129707 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:47.130235 (+   528us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":242873,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":109,"spinlock_wait_cycles":7833856,"thread_start_us":308870,"threads_started":1,"wal-append.queue_time_us":557980}
W20260709 12:12:47.128818 14181 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.587s	user 0.013s	sys 0.018s
W20260709 12:12:47.138278 14181 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.603s	user 0.013s	sys 0.018s
I20260709 12:12:47.131402 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
W20260709 12:12:46.979482 14303 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.174.129:37187 timed out after 1.529s (SENT) [suppressed 5 similar messages]
I20260709 12:12:47.131438 14189 raft_consensus.cc:2393] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 19: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:12:47.162977 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:46.992302 21052 leader_election.cc:290] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:47.001989 21109 consensus_queue.cc:237] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:12:47.202220 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 342692us
W20260709 12:12:47.038215 21251 consensus_meta.cc:287] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.719s	user 0.006s	sys 0.006s
W20260709 12:12:47.040593 21256 consensus_meta.cc:287] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.674s	user 0.015s	sys 0.000s
I20260709 12:12:47.211381 21513 raft_consensus.cc:493] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:47.212044 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 233293us
I20260709 12:12:47.211704 21256 raft_consensus.cc:515] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:46.994457 21314 raft_consensus.cc:515] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:47.214430 14261 raft_consensus.cc:2368] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for earlier term 18. Current term is 19.
I20260709 12:12:47.215490 14262 raft_consensus.cc:1240] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:47.216078 21314 leader_election.cc:290] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:47.217831 14263 raft_consensus.cc:2468] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 19.
I20260709 12:12:47.212512 21513 raft_consensus.cc:515] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:47.187995 21517 raft_consensus.cc:493] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:47.228184 21517 raft_consensus.cc:515] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:12:47.232211 21284 consensus_meta.cc:287] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db: Time spent flushing consensus metadata: real 0.861s	user 0.009s	sys 0.005s
I20260709 12:12:47.211491 21393 raft_consensus.cc:493] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:47.234946 21507 raft_consensus.cc:493] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:47.235339 21393 raft_consensus.cc:515] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:47.235965 21507 raft_consensus.cc:515] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:47.233034 21284 raft_consensus.cc:515] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:47.239136 21507 leader_election.cc:290] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:47.239362 21508 raft_consensus.cc:493] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:47.240365 21508 raft_consensus.cc:515] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:47.242928 14185 raft_consensus.cc:2468] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 20.
I20260709 12:12:47.238154 21551 raft_consensus.cc:493] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:47.245064 21551 raft_consensus.cc:515] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:47.246044 21284 leader_election.cc:290] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 20 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:47.261404 21473 raft_consensus.cc:493] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:47.262557 21473 raft_consensus.cc:515] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:47.277729 21473 leader_election.cc:290] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:47.279381 14259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41764 (request call id 3653) took 1504 ms. Trace:
I20260709 12:12:47.283157 21507 raft_consensus.cc:493] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:47.284317 21453 raft_consensus.cc:493] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:47.302824 21453 raft_consensus.cc:515] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:47.305361 21507 raft_consensus.cc:515] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:47.306926 21505 leader_election.cc:290] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:47.279961 14259 rpcz_store.cc:276] 0709 12:12:45.775003 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:45.779439 (+  4436us) service_pool.cc:224] Handling call
0709 12:12:46.349348 (+569909us) spinlock_profiling.cc:243] Waited 51.6 ms on lock 0x7b5800060c98. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2124016b71 00007f2124016a22 00007f212cf2f8d9 00007f212c089ee0 00007f212c1530ab 00007f212c153131 00007f212c114fc0 00007f212c0ff929 00007f212c0ff3d2 00007f2125676bd4
0709 12:12:46.349601 (+   253us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:46.790830 (+441229us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:46.790867 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:46.791412 (+   545us) log.cc:844] Serialized 26 byte log entry
0709 12:12:47.185269 (+393857us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:47.185415 (+   146us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:47.185610 (+   195us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:47.278668 (+ 93058us) raft_consensus.cc:1685] finished
0709 12:12:47.278704 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:47.279154 (+   450us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":237578,"raft.run_cpu_time_us":66,"raft.run_wall_time_us":78,"spinlock_wait_cycles":118651776,"thread_start_us":735975,"threads_started":2,"wal-append.queue_time_us":406837}
I20260709 12:12:47.317910 14260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41764 (request call id 3673) took 1006 ms. Trace:
I20260709 12:12:47.319087 21518 raft_consensus.cc:3055] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:12:47.319660 21518 raft_consensus.cc:740] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:12:47.323958 14334 raft_consensus.cc:1240] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 21. Current term is 22. Ops: [21.15-21.15]
I20260709 12:12:47.325697 21524 leader_election.cc:290] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:47.326256 21444 raft_consensus.cc:3060] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:12:47.336489 21570 log.cc:927] Time spent T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.298s	user 0.003s	sys 0.000s
I20260709 12:12:47.337626 21415 leader_election.cc:290] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:47.355212 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:47.339013 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:47.312047 21507 leader_election.cc:290] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:47.344439 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:47.345108 14336 raft_consensus.cc:1240] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 22. Current term is 23. Ops: [22.12-22.12]
I20260709 12:12:47.318655 14260 rpcz_store.cc:276] 0709 12:12:46.310998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:46.354103 (+ 43105us) service_pool.cc:224] Handling call
0709 12:12:46.354525 (+   422us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:46.795149 (+440624us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:12:46.919374 (+124225us) log.cc:844] Serialized 14 byte log entry
0709 12:12:47.214620 (+295246us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:47.215490 (+   870us) log.cc:844] Serialized 26 byte log entry
0709 12:12:47.215639 (+   149us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:12:47.216080 (+   441us) log.cc:844] Serialized 14 byte log entry
0709 12:12:47.227246 (+ 11166us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:47.270335 (+ 43089us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:47.312642 (+ 42307us) raft_consensus.cc:1685] finished
0709 12:12:47.312667 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:47.317632 (+  4965us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":73203,"prepare.queue_time_us":214585,"prepare.run_cpu_time_us":122,"prepare.run_wall_time_us":125,"raft.queue_time_us":301180,"raft.run_cpu_time_us":602,"raft.run_wall_time_us":27144,"thread_start_us":763422,"threads_started":3,"wal-append.queue_time_us":251417}
I20260709 12:12:47.349584 14261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41764 (request call id 3671) took 1039 ms. Trace:
I20260709 12:12:47.350934 21518 consensus_queue.cc:260] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:47.352015 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:47.352568 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:47.352912 21517 leader_election.cc:290] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:12:47.353874 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:47.358253 14185 raft_consensus.cc:2468] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 15.
I20260709 12:12:47.354425 14331 raft_consensus.cc:1240] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 20. Current term is 21. Ops: [20.11-20.11]
W20260709 12:12:47.338572 21574 log.cc:927] Time spent T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.339s	user 0.000s	sys 0.001s
I20260709 12:12:47.341104 21256 leader_election.cc:290] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:47.357131 14261 rpcz_store.cc:276] 0709 12:12:46.310435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:46.311383 (+   948us) service_pool.cc:224] Handling call
0709 12:12:47.349244 (+1037861us) spinlock_profiling.cc:243] Waited 897 ms on lock 0x7b54001c3254. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:12:47.349471 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2064119168}
I20260709 12:12:47.366276 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:47.377031 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:47.378741 14334 raft_consensus.cc:2468] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 22.
I20260709 12:12:47.384019 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:47.385205 14190 raft_consensus.cc:2468] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 23.
I20260709 12:12:47.386272 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:47.386574 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:47.386786 14188 raft_consensus.cc:1240] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:47.387550 14181 raft_consensus.cc:3060] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:12:47.388336 21176 consensus_meta.cc:287] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.889s	user 0.015s	sys 0.014s
I20260709 12:12:47.388952 21513 leader_election.cc:290] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:12:47.388479 14876 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:47.388947 21176 raft_consensus.cc:515] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:47.371536 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:47.394979 14257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53050 (request call id 1451) took 1054 ms. Trace:
I20260709 12:12:47.395411 21085 raft_consensus.cc:493] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:12:47.392689 21176 leader_election.cc:290] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:12:47.382148 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 247166us
I20260709 12:12:47.396014 14331 raft_consensus.cc:2468] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 22.
I20260709 12:12:47.397022 21085 raft_consensus.cc:515] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:12:47.400068 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 80273.3us
I20260709 12:12:47.395495 14257 rpcz_store.cc:276] 0709 12:12:46.340243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:47.136262 (+796019us) service_pool.cc:224] Handling call
0709 12:12:47.137143 (+   881us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:47.141291 (+  4148us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:47.141336 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:47.142450 (+  1114us) log.cc:844] Serialized 26 byte log entry
0709 12:12:47.207102 (+ 64652us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:12:47.207146 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:47.207222 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:47.394711 (+187489us) raft_consensus.cc:1685] finished
0709 12:12:47.394733 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:47.394880 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":27162,"raft.run_cpu_time_us":455,"raft.run_wall_time_us":22641,"thread_start_us":64056,"threads_started":1,"wal-append.queue_time_us":84853}
I20260709 12:12:47.402287 14259 raft_consensus.cc:2468] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 16.
I20260709 12:12:47.370396 21551 leader_election.cc:290] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:47.396994 21563 raft_consensus.cc:493] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:47.406718 21563 raft_consensus.cc:515] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:47.412932 21563 leader_election.cc:290] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:47.413882 21085 leader_election.cc:290] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:47.416965 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:47.420632 14876 leader_election.cc:304] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
W20260709 12:12:47.421870 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:47.423285 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:47.424401 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:47.430204 14181 raft_consensus.cc:2468] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 20.
I20260709 12:12:47.443527 14905 raft_consensus.cc:2393] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 23: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
I20260709 12:12:47.448397 14264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53050 (request call id 1446) took 1523 ms. Trace:
I20260709 12:12:47.449779 14264 rpcz_store.cc:276] 0709 12:12:45.925137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:45.925394 (+   257us) service_pool.cc:224] Handling call
0709 12:12:45.926137 (+   743us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:46.339536 (+413399us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:47.447701 (+1108165us) spinlock_profiling.cc:243] Waited 404 ms on lock 0x7b5400211e54. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:12:47.448111 (+   410us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":929426688}
I20260709 12:12:47.450306 14335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50856 (request call id 3070) took 1125 ms. Trace:
I20260709 12:12:47.450896 21526 leader_election.cc:290] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:47.452669 14335 rpcz_store.cc:276] 0709 12:12:46.324271 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:46.324918 (+   647us) service_pool.cc:224] Handling call
0709 12:12:46.325224 (+   306us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:46.975477 (+650253us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:47.449699 (+474222us) spinlock_profiling.cc:243] Waited 649 ms on lock 0x7b5400002154. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:12:47.450110 (+   411us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1493400960}
W20260709 12:12:47.455281 14229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:47.455628 21363 raft_consensus.cc:2804] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:47.456096 21363 raft_consensus.cc:493] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:47.456506 21363 raft_consensus.cc:3060] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:47.463151 14910 raft_consensus.cc:2393] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 21: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
I20260709 12:12:47.437157 21508 leader_election.cc:290] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:47.471161 21518 raft_consensus.cc:3060] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:47.474887 14262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53050 (request call id 1443) took 1586 ms. Trace:
I20260709 12:12:47.475453 14262 rpcz_store.cc:276] 0709 12:12:45.888134 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:45.896638 (+  8504us) service_pool.cc:224] Handling call
0709 12:12:46.358582 (+461944us) spinlock_profiling.cc:243] Waited 9.41 ms on lock 0x7b5800060c98. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2124016b71 00007f2124016a22 00007f212cf2f8d9 00007f212c089ee0 00007f212c1530ab 00007f212c153131 00007f212c114fc0 00007f212c0ff929 00007f212c0ff3d2 00007f2125676bd4
0709 12:12:46.358847 (+   265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:47.215987 (+857140us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:47.474456 (+258469us) spinlock_profiling.cc:243] Waited 856 ms on lock 0x7b54002224d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:12:47.474786 (+   330us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1990558848}
I20260709 12:12:47.477159 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:47.461303 21563 raft_consensus.cc:493] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:12:47.478622 14262 raft_consensus.cc:3060] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:47.478299 21563 raft_consensus.cc:515] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:12:47.479314 21217 consensus_meta.cc:287] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db: Time spent flushing consensus metadata: real 0.561s	user 0.007s	sys 0.014s
I20260709 12:12:47.479943 21393 leader_election.cc:290] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:47.481189 14260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41764 (request call id 3676) took 1058 ms. Trace:
I20260709 12:12:47.481631 14260 rpcz_store.cc:276] 0709 12:12:46.408814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:47.381946 (+973132us) service_pool.cc:224] Handling call
0709 12:12:47.453350 (+ 71404us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:47.463010 (+  9660us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:47.463053 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:47.466843 (+  3790us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:47.466889 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:47.466964 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:47.467107 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:12:47.483398 14302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:47.483757 14303 leader_election.cc:304] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:12:47.485145 14265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41764 (request call id 3668) took 1548 ms. Trace:
I20260709 12:12:47.485602 14265 rpcz_store.cc:276] 0709 12:12:45.936669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:45.936954 (+   285us) service_pool.cc:224] Handling call
0709 12:12:47.484700 (+1547746us) spinlock_profiling.cc:243] Waited 811 ms on lock 0x7b54002003d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:12:47.484894 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1865492864}
I20260709 12:12:47.486304 14304 leader_election.cc:304] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:47.488689 21367 raft_consensus.cc:493] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:47.488879 14304 leader_election.cc:304] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:12:47.464608 14256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41764 (request call id 3672) took 1152 ms. Trace:
I20260709 12:12:47.489573 21367 raft_consensus.cc:515] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:47.489964 14256 rpcz_store.cc:276] 0709 12:12:46.310732 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:46.326160 (+ 15428us) service_pool.cc:224] Handling call
0709 12:12:46.326490 (+   330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:46.326881 (+   391us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:46.326907 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:46.327429 (+   522us) log.cc:844] Serialized 26 byte log entry
0709 12:12:46.815991 (+488562us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:12:46.816261 (+   270us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:46.816713 (+   452us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:47.335360 (+518647us) spinlock_profiling.cc:243] Waited 1.2 ms on lock 0x7b4400022b4c. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2123f74c85 00007f2123f756a2 00007f2126ce71db 00007f2126ce2aaf 00007f2126cd686e 00007f2126cd5bb6 00007f2126cd57d8 00007f2126cdf221 00007f2126cdf1d9 00007f2126cdf169
0709 12:12:47.462592 (+127232us) raft_consensus.cc:1685] finished
0709 12:12:47.462623 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:47.462946 (+   323us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":246243,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":187,"spinlock_wait_cycles":2752384,"thread_start_us":488125,"threads_started":1,"wal-append.queue_time_us":663579}
I20260709 12:12:47.492388 21367 leader_election.cc:290] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:47.494647 14260 raft_consensus.cc:1240] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:47.495211 14184 raft_consensus.cc:2410] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for term 21 because replica has last-logged OpId of term: 20 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 10.
W20260709 12:12:47.496205 21596 log.cc:927] Time spent T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.139s	user 0.000s	sys 0.000s
I20260709 12:12:47.496501 14184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56046 (request call id 3128) took 1210 ms. Trace:
I20260709 12:12:47.496909 14184 rpcz_store.cc:276] 0709 12:12:46.286519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:46.286684 (+   165us) service_pool.cc:224] Handling call
0709 12:12:47.496232 (+1209548us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b54001121d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:12:47.496419 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2775863168}
I20260709 12:12:47.443595 21085 raft_consensus.cc:493] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:47.502591 21085 raft_consensus.cc:515] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:47.469916 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:47.504853 21453 leader_election.cc:290] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:47.505606 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:47.506693 14338 raft_consensus.cc:2393] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 18: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:12:47.507640 14333 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50856 (request call id 3073) took 1182 ms. Trace:
I20260709 12:12:47.504082 14261 raft_consensus.cc:2468] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 20.
I20260709 12:12:47.513237 21526 raft_consensus.cc:493] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:47.508091 14333 rpcz_store.cc:276] 0709 12:12:46.325109 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:46.326151 (+  1042us) service_pool.cc:224] Handling call
0709 12:12:46.378800 (+ 52649us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:46.463605 (+ 84805us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:46.463648 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:46.463691 (+    43us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:12:46.463731 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:47.507199 (+1043468us) spinlock_profiling.cc:243] Waited 84.6 ms on lock 0x7b540010dbd4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:12:47.507264 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:47.507445 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":194492672}
I20260709 12:12:47.513978 21526 raft_consensus.cc:515] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:47.516392 21526 leader_election.cc:290] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:47.517349 21436 raft_consensus.cc:493] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:47.518782 21417 raft_consensus.cc:2804] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:12:47.518528 21436 raft_consensus.cc:515] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:47.485159 14303 leader_election.cc:304] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:12:47.504977 21085 leader_election.cc:290] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:47.522208 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:12:47.523864 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 54092.6us
I20260709 12:12:47.527519 14262 raft_consensus.cc:2468] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 20.
I20260709 12:12:47.527154 14257 raft_consensus.cc:2468] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 20.
I20260709 12:12:47.531469 14264 raft_consensus.cc:2468] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 23.
I20260709 12:12:47.517876 21513 raft_consensus.cc:493] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:12:47.538477 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:47.538940 21109 raft_consensus.cc:2804] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:47.539740 21367 raft_consensus.cc:2804] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Leader election won for term 19
W20260709 12:12:47.543955 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 59008.8us
W20260709 12:12:47.535898 21245 consensus_meta.cc:287] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 1.018s	user 0.014s	sys 0.008s
I20260709 12:12:47.533056 21417 raft_consensus.cc:697] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 16 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:47.568348 14876 leader_election.cc:304] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
W20260709 12:12:47.578739 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 50547.9us
I20260709 12:12:47.566829 21367 raft_consensus.cc:697] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 19 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:47.575400 21563 leader_election.cc:290] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:47.592103 21450 raft_consensus.cc:2804] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:12:47.592674 21450 raft_consensus.cc:493] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:47.593027 21450 raft_consensus.cc:3060] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:47.584892 21415 raft_consensus.cc:2804] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:47.570866 21245 raft_consensus.cc:515] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:12:47.611274 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 64434.4us
W20260709 12:12:47.617849 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 145342us
I20260709 12:12:47.618851 14263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41764 (request call id 3675) took 1211 ms. Trace:
I20260709 12:12:47.619263 14330 raft_consensus.cc:1240] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:47.624497 20547 consensus_queue.cc:1059] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:47.590749 21109 raft_consensus.cc:697] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 18 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:47.621495 14330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 1438) took 1349 ms. Trace:
I20260709 12:12:47.619259 14263 rpcz_store.cc:276] 0709 12:12:46.407755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:47.219593 (+811838us) service_pool.cc:224] Handling call
0709 12:12:47.220281 (+   688us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:47.310066 (+ 89785us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:47.310106 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:47.310727 (+   621us) log.cc:844] Serialized 26 byte log entry
0709 12:12:47.381139 (+ 70412us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:47.381193 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:47.381267 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:47.618565 (+237298us) raft_consensus.cc:1685] finished
0709 12:12:47.618586 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:47.618762 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":47140,"raft.queue_time_us":53516,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":175,"thread_start_us":69838,"threads_started":1,"wal-append.queue_time_us":215386}
I20260709 12:12:47.589558 21513 raft_consensus.cc:515] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:47.628511 14330 rpcz_store.cc:276] 0709 12:12:46.271893 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:46.272990 (+  1097us) service_pool.cc:224] Handling call
0709 12:12:46.300476 (+ 27486us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:47.619766 (+1319290us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:47.621160 (+  1394us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b540001a754. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:12:47.621425 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3032082816}
I20260709 12:12:47.647827 21513 leader_election.cc:290] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:12:47.649019 14877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:47.651573 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:47.652503 21109 consensus_queue.cc:237] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:47.656582 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:47.658295 14304 leader_election.cc:400] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 election: Vote denied by peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673) with higher term. Message: Invalid argument: T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for earlier term 18. Current term is 19.
I20260709 12:12:47.658529 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:47.628077 21415 raft_consensus.cc:697] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 18 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:47.660318 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:47.653082 21436 leader_election.cc:290] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:47.660665 21415 consensus_queue.cc:237] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:47.661338 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:47.662799 14876 leader_election.cc:304] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:47.666075 14338 raft_consensus.cc:2468] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 22.
I20260709 12:12:47.682968 21444 consensus_queue.cc:1059] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.007s
I20260709 12:12:47.690793 21563 raft_consensus.cc:493] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:47.691541 21563 raft_consensus.cc:515] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:47.697432 21363 raft_consensus.cc:515] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:47.698004 20979 raft_consensus.cc:493] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:47.702111 21606 log.cc:927] Time spent T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 12:12:47.702255 21393 raft_consensus.cc:3055] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:12:47.699432 20547 raft_consensus.cc:2804] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:47.712182 14304 leader_election.cc:304] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:47.714004 14187 raft_consensus.cc:1240] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:47.715389 21469 raft_consensus.cc:3055] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:47.716464 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:47.717814 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:47.735060 14330 raft_consensus.cc:2468] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 23.
I20260709 12:12:47.719856 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:47.721019 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:47.721860 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:47.722033 21500 raft_consensus.cc:493] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:47.722132 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:47.657101 21417 consensus_queue.cc:237] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:47.738958 20979 raft_consensus.cc:515] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:12:47.727202 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 46365.4us
I20260709 12:12:47.740343 14877 leader_election.cc:304] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:12:47.741321 21565 raft_consensus.cc:2804] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:12:47.709589 21393 raft_consensus.cc:740] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:12:47.741865 21565 raft_consensus.cc:493] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:47.742265 21565 raft_consensus.cc:3060] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:47.742455 21245 leader_election.cc:290] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:47.745831 20547 raft_consensus.cc:697] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 20 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:12:47.747385 20547 consensus_queue.cc:237] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:47.751734 21369 consensus_queue.cc:1059] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:47.752491 21500 raft_consensus.cc:515] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:47.751785 14337 raft_consensus.cc:2468] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 20.
I20260709 12:12:47.754992 21500 leader_election.cc:290] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:47.755805 21367 consensus_queue.cc:237] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:47.753057 21369 consensus_queue.cc:1059] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.005s
I20260709 12:12:47.741513 20979 leader_election.cc:290] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:47.758112 21284 consensus_queue.cc:1059] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.003s
I20260709 12:12:47.761857 21284 raft_consensus.cc:3055] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:47.762280 21284 raft_consensus.cc:740] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:12:47.763015 21563 leader_election.cc:290] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:47.763351 21284 consensus_queue.cc:260] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:47.765439 21284 raft_consensus.cc:3060] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:12:47.766758 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 57924.9us
I20260709 12:12:47.767410 14877 leader_election.cc:304] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:47.767669 14155 leader_election.cc:304] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:47.768649 21444 raft_consensus.cc:2749] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:12:47.769490 21369 raft_consensus.cc:2804] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:47.770207 21369 raft_consensus.cc:493] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:47.762192 21393 consensus_queue.cc:260] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 22.12, Last appended by leader: 12, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:47.760864 21516 raft_consensus.cc:3055] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:47.771653 21516 raft_consensus.cc:740] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:12:47.772526 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:47.772806 21516 consensus_queue.cc:260] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:47.770592 21369 raft_consensus.cc:3060] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:12:47.774477 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 62488.7us
I20260709 12:12:47.771569 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:47.734596 21469 raft_consensus.cc:740] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:12:47.773314 14338 raft_consensus.cc:2468] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 20.
I20260709 12:12:47.805549 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:47.796087 21506 consensus_queue.cc:1059] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:12:47.802660 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:47.800469 21393 raft_consensus.cc:3060] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:47.800666 14181 raft_consensus.cc:1240] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:47.805171 14908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:47.794294 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:47.817647 14904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:47.795905 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:47.793344 14905 raft_consensus.cc:1275] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 12:12:47.796777 21473 raft_consensus.cc:493] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:47.822712 21473 raft_consensus.cc:515] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:47.825009 21473 leader_election.cc:290] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:47.803699 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:47.826519 21506 raft_consensus.cc:3055] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:47.826973 21506 raft_consensus.cc:740] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:12:47.827924 21506 consensus_queue.cc:260] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:47.829628 21506 raft_consensus.cc:3060] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:47.789664 21516 raft_consensus.cc:3060] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:47.816817 14909 raft_consensus.cc:2368] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 16. Current term is 17.
I20260709 12:12:47.817269 14907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:47.818392 14877 leader_election.cc:304] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:47.830282 14910 raft_consensus.cc:2393] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 22: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
I20260709 12:12:47.832769 21245 raft_consensus.cc:493] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
W20260709 12:12:47.834620 21611 log.cc:927] Time spent T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
W20260709 12:12:47.836520 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:47.833437 21513 raft_consensus.cc:493] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:47.838181 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:47.820667 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:47.790405 21469 consensus_queue.cc:260] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:12:47.852391 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 76216.5us
I20260709 12:12:47.860870 14260 raft_consensus.cc:2393] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 16: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:12:47.867658 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:47.842273 21109 raft_consensus.cc:2804] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:12:47.819185 21518 raft_consensus.cc:493] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:47.872876 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:47.878014 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:47.879508 14257 raft_consensus.cc:2393] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 18: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:12:47.883028 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:47.878793 14259 raft_consensus.cc:2468] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 21.
I20260709 12:12:47.884088 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:47.906596 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 25 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:47.913915 14187 raft_consensus.cc:1275] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 24 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 22 index: 10. Preceding OpId from leader: term: 24 index: 12. (index mismatch)
I20260709 12:12:47.915132 14263 raft_consensus.cc:2393] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 18: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:12:47.863829 21436 raft_consensus.cc:493] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:47.921267 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:47.913326 14303 leader_election.cc:304] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:47.920452 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:47.928117 14264 raft_consensus.cc:2368] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for earlier term 17. Current term is 18.
I20260709 12:12:47.928972 14262 raft_consensus.cc:1275] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 12:12:47.926458 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:47.931704 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:47.862025 21473 consensus_queue.cc:1059] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.054s
I20260709 12:12:47.931631 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:47.934964 14181 raft_consensus.cc:2468] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 23.
I20260709 12:12:47.941576 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:47.871289 21109 raft_consensus.cc:493] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:47.888612 21518 raft_consensus.cc:515] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } }
I20260709 12:12:47.948220 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:47.948544 14187 raft_consensus.cc:1275] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:12:47.949827 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:47.954066 21363 leader_election.cc:290] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 17 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:47.958076 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:47.958827 14184 raft_consensus.cc:3060] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:47.959304 21450 raft_consensus.cc:515] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:47.960677 14911 raft_consensus.cc:2393] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 24: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
I20260709 12:12:47.961963 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:47.963259 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:47.922165 21245 raft_consensus.cc:515] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:47.963970 14258 raft_consensus.cc:2468] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 19.
I20260709 12:12:47.961989 14259 raft_consensus.cc:2468] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 22.
I20260709 12:12:47.965287 14256 raft_consensus.cc:1813] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Handling vote request from an unknown peer 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:47.965929 14256 raft_consensus.cc:2393] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 17: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:12:47.967056 14263 raft_consensus.cc:2393] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 20: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:12:47.910830 21513 raft_consensus.cc:515] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:47.972558 21513 leader_election.cc:290] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:47.947630 21436 raft_consensus.cc:515] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:47.975286 21534 raft_consensus.cc:493] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:47.976202 21245 leader_election.cc:290] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:47.976020 21534 raft_consensus.cc:515] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:47.976665 21436 leader_election.cc:290] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:47.977809 21456 raft_consensus.cc:2804] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:47.978251 21456 raft_consensus.cc:493] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:47.978574 21456 raft_consensus.cc:3060] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:47.981007 21518 leader_election.cc:290] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:47.909921 20979 consensus_queue.cc:1059] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 23.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.034s
I20260709 12:12:47.977450 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:47.951629 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:47.983294 14188 raft_consensus.cc:2468] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 15.
I20260709 12:12:47.985297 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:47.949867 14155 leader_election.cc:304] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:47.891321 21508 raft_consensus.cc:493] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:47.985656 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:47.933763 21500 raft_consensus.cc:493] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:47.994737 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 84841.6us
I20260709 12:12:47.946918 21109 raft_consensus.cc:3060] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:12:48.021255 14302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:48.028911 14260 raft_consensus.cc:2468] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 24.
I20260709 12:12:48.039446 14257 raft_consensus.cc:2468] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 22.
I20260709 12:12:47.995545 21450 leader_election.cc:290] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 24 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:48.042718 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:48.044286 14907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:48.045056 14907 raft_consensus.cc:3060] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:48.045910 21369 raft_consensus.cc:515] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:48.048357 21369 leader_election.cc:290] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 21 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:48.050442 20979 raft_consensus.cc:493] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:48.050750 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:47.997124 21500 raft_consensus.cc:515] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:48.066480 20979 raft_consensus.cc:515] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:12:48.068282 14154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:48.068727 20979 leader_election.cc:290] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:48.066043 14907 raft_consensus.cc:2468] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 19.
I20260709 12:12:48.000649 21518 raft_consensus.cc:2804] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:12:48.071215 21518 raft_consensus.cc:493] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:48.071626 21518 raft_consensus.cc:3060] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:48.072285 21500 leader_election.cc:290] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:48.073089 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:48.073781 14188 raft_consensus.cc:2468] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 20.
I20260709 12:12:48.070405 21508 raft_consensus.cc:515] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:48.074296 14265 raft_consensus.cc:1240] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:48.076849 21508 leader_election.cc:290] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:48.070017 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:48.077711 14187 raft_consensus.cc:2468] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 19.
I20260709 12:12:48.074466 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:12:48.077991 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 81123.2us
I20260709 12:12:48.078410 14264 raft_consensus.cc:2468] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 19.
I20260709 12:12:48.079011 14155 leader_election.cc:304] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:48.079643 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:48.080144 14155 leader_election.cc:304] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:48.070524 21444 raft_consensus.cc:493] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:48.081368 21444 raft_consensus.cc:515] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:48.083016 21518 raft_consensus.cc:515] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:48.085894 21523 raft_consensus.cc:493] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:48.090046 21523 raft_consensus.cc:515] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:48.091305 21453 raft_consensus.cc:3055] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:12:48.091764 21453 raft_consensus.cc:740] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:48.088316 21469 raft_consensus.cc:3060] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:48.092491 21523 leader_election.cc:290] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:48.105835 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:48.106904 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:48.107538 14260 raft_consensus.cc:2468] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 22.
I20260709 12:12:48.104179 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:47.998030 21417 raft_consensus.cc:3060] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:48.109894 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:48.110550 14189 raft_consensus.cc:2468] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 18.
I20260709 12:12:48.111841 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:48.113041 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:48.105336 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:48.114421 14154 leader_election.cc:304] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:48.042538 21534 leader_election.cc:290] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:48.116194 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:12:48.100199 21617 log.cc:927] Time spent T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 12:12:48.119139 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 25 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:48.121794 14188 raft_consensus.cc:3060] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:12:48.119997 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:48.099087 14184 raft_consensus.cc:2468] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 18.
I20260709 12:12:48.116150 21523 raft_consensus.cc:2804] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:12:48.142815 14187 raft_consensus.cc:2368] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for earlier term 23. Current term is 24.
I20260709 12:12:48.142611 14181 raft_consensus.cc:2468] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 22.
I20260709 12:12:48.153715 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:48.163309 14903 raft_consensus.cc:2468] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 18.
I20260709 12:12:48.124347 21444 leader_election.cc:290] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:48.151093 21523 raft_consensus.cc:493] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:48.181526 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:48.092779 21453 consensus_queue.cc:260] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 24.12, Last appended by leader: 12, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:48.182822 14260 raft_consensus.cc:2468] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 18.
I20260709 12:12:48.187393 14257 raft_consensus.cc:2468] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 19.
I20260709 12:12:48.185935 21523 raft_consensus.cc:3060] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:48.189284 21518 leader_election.cc:290] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 24 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:48.190029 21518 raft_consensus.cc:2749] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:12:48.184731 21444 raft_consensus.cc:2804] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:48.194113 21444 raft_consensus.cc:493] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:48.194478 21444 raft_consensus.cc:3060] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:48.198940 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:48.199739 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:48.200374 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:48.201913 14907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:48.202548 14907 raft_consensus.cc:2468] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 21.
I20260709 12:12:48.206072 21537 raft_consensus.cc:493] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:48.206800 21537 raft_consensus.cc:515] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:48.210062 21537 leader_election.cc:290] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:48.217837 14906 raft_consensus.cc:1813] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Handling vote request from an unknown peer 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:48.220420 14906 raft_consensus.cc:2410] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for term 17 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
W20260709 12:12:48.222208 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 370121us
I20260709 12:12:48.214985 21523 raft_consensus.cc:515] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:48.227984 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:48.221344 21444 raft_consensus.cc:515] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:48.237262 14186 raft_consensus.cc:2393] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 24: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:12:48.237025 14257 raft_consensus.cc:2468] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 19.
I20260709 12:12:48.238277 21523 leader_election.cc:290] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 24 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:48.239946 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:48.240664 14181 raft_consensus.cc:3060] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Advancing to term 17
I20260709 12:12:48.239754 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:48.244966 14338 raft_consensus.cc:2393] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 23: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:12:48.245537 14188 raft_consensus.cc:2468] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 25.
I20260709 12:12:48.246801 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:48.251233 21444 leader_election.cc:290] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 21 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:12:48.251978 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:48.255009 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:48.258206 14186 raft_consensus.cc:2393] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db in current term 24: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:12:48.265125 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
W20260709 12:12:48.272401 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 192301us
I20260709 12:12:48.275897 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:48.273849 14155 leader_election.cc:304] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:48.278081 14338 raft_consensus.cc:1275] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 12:12:48.284245 21456 raft_consensus.cc:515] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:48.287730 21453 raft_consensus.cc:3060] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:12:48.290251 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:48.290998 14336 raft_consensus.cc:3060] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:48.291953 21109 raft_consensus.cc:515] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:48.298003 14190 raft_consensus.cc:2410] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for term 23 because replica has last-logged OpId of term: 22 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 11.
I20260709 12:12:48.244693 21565 raft_consensus.cc:515] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:48.299615 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:48.300410 21565 leader_election.cc:290] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 24 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:48.301002 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:48.301826 14337 raft_consensus.cc:2393] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 18: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:12:48.302006 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:48.301329 14912 raft_consensus.cc:2393] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 24: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
I20260709 12:12:48.298908 21456 leader_election.cc:290] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 21 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:48.302631 14334 raft_consensus.cc:2468] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 23.
I20260709 12:12:48.305487 14332 raft_consensus.cc:2468] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 22.
I20260709 12:12:48.306249 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:48.310072 14333 raft_consensus.cc:3060] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:48.309963 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:48.310779 14331 raft_consensus.cc:2393] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 20: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
W20260709 12:12:48.312480 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 531909us
I20260709 12:12:48.318076 14181 raft_consensus.cc:2468] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 17.
I20260709 12:12:48.305778 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:48.319914 14333 raft_consensus.cc:2468] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 17.
I20260709 12:12:48.324038 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:48.326115 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:48.326924 14264 raft_consensus.cc:2468] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 21.
I20260709 12:12:48.330492 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:48.331182 14265 raft_consensus.cc:3060] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:48.331830 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:48.332502 14257 raft_consensus.cc:3060] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:48.333066 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:12:48.334774 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 61008.4us
I20260709 12:12:48.302631 21417 raft_consensus.cc:2749] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:48.337944 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:48.344295 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:48.347715 14261 raft_consensus.cc:3060] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:48.344422 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
W20260709 12:12:48.349658 14154 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 235341us
I20260709 12:12:48.350582 14154 leader_election.cc:304] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:48.352926 14154 leader_election.cc:304] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:48.349063 21109 leader_election.cc:290] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 23 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:48.349622 14258 raft_consensus.cc:3060] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:48.355499 14877 leader_election.cc:304] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:12:48.335829 21506 raft_consensus.cc:493] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:48.362149 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:48.359068 14333 raft_consensus.cc:2468] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 20.
I20260709 12:12:48.362825 14334 raft_consensus.cc:3060] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Advancing to term 24
I20260709 12:12:48.363093 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:12:48.356189 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 487326us
W20260709 12:12:48.359754 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 120936us
W20260709 12:12:48.365250 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:48.370065 14154 leader_election.cc:400] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 16 pre-election: Vote denied by peer 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341) with higher term. Message: Invalid argument: T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 16. Current term is 17.
I20260709 12:12:48.370533 21591 raft_consensus.cc:2804] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:12:48.371032 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:48.371778 14333 raft_consensus.cc:2468] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 18.
I20260709 12:12:48.370491 14154 leader_election.cc:403] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:12:48.373472 21633 raft_consensus.cc:2749] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341) with higher term. Message: Invalid argument: T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 16. Current term is 17.
I20260709 12:12:48.375473 21621 raft_consensus.cc:2749] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:12:48.360136 21508 raft_consensus.cc:2749] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:48.377975 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:48.378715 14337 raft_consensus.cc:2468] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 19.
I20260709 12:12:48.379590 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:48.380748 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:48.381430 14337 raft_consensus.cc:2393] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 23: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:12:48.381569 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:48.382102 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:48.382685 14330 raft_consensus.cc:2468] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 20.
I20260709 12:12:48.385159 14338 raft_consensus.cc:1275] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 12:12:48.387840 14263 raft_consensus.cc:1275] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 12:12:48.391801 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:48.394788 14331 raft_consensus.cc:2410] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for term 22 because replica has last-logged OpId of term: 20 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 10.
I20260709 12:12:48.395359 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:48.366849 14876 leader_election.cc:304] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:48.376029 14154 leader_election.cc:304] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:48.400192 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:48.400980 14258 raft_consensus.cc:2468] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 21.
I20260709 12:12:48.407473 14265 raft_consensus.cc:2468] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 17.
I20260709 12:12:48.407699 14263 raft_consensus.cc:2393] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 17: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:12:48.408094 14332 raft_consensus.cc:2393] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 20: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:12:48.414629 14336 raft_consensus.cc:2468] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 18.
I20260709 12:12:48.353693 21632 raft_consensus.cc:2804] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:48.370978 21591 raft_consensus.cc:493] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:48.415987 14257 raft_consensus.cc:2468] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 21.
I20260709 12:12:48.422106 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:48.422725 14335 raft_consensus.cc:3060] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Advancing to term 24
W20260709 12:12:48.426230 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 59524.6us
I20260709 12:12:48.427470 14265 raft_consensus.cc:1275] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:12:48.428618 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:48.430724 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:48.431735 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:48.432510 14903 raft_consensus.cc:2393] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 24: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
I20260709 12:12:48.433048 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 23 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:48.432610 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:48.442440 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:48.417042 21632 raft_consensus.cc:493] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:48.444558 14188 raft_consensus.cc:1275] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:12:48.447547 14304 leader_election.cc:304] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:48.447674 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:48.421792 21508 raft_consensus.cc:3060] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:48.366117 21506 raft_consensus.cc:515] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:48.458586 21619 raft_consensus.cc:493] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:48.459227 21619 raft_consensus.cc:515] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:48.459614 21506 leader_election.cc:290] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:48.427282 21591 raft_consensus.cc:3060] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:48.461431 21619 leader_election.cc:290] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:48.461901 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:48.503059 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:48.503720 14338 raft_consensus.cc:3060] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:48.463199 21369 raft_consensus.cc:493] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:12:48.505412 21369 raft_consensus.cc:515] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:48.510978 21369 leader_election.cc:290] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:48.464632 14877 leader_election.cc:304] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:48.465838 21630 consensus_queue.cc:1048] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:12:48.436198 21628 raft_consensus.cc:2804] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:48.471112 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:48.473045 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:48.446200 21633 raft_consensus.cc:493] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:48.483515 14263 raft_consensus.cc:1240] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:48.447038 21632 raft_consensus.cc:3060] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:12:48.489137 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 44671.5us
I20260709 12:12:48.491302 14912 raft_consensus.cc:2468] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 16.
W20260709 12:12:48.491788 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 46264.1us
I20260709 12:12:48.525655 21393 raft_consensus.cc:493] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:48.514853 14334 raft_consensus.cc:2468] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 24.
I20260709 12:12:48.512872 14335 raft_consensus.cc:2468] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 24.
W20260709 12:12:48.513237 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 48663.3us
I20260709 12:12:48.523326 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:48.540053 14182 raft_consensus.cc:2410] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for term 22 because replica has last-logged OpId of term: 20 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 10.
I20260709 12:12:48.527071 14333 raft_consensus.cc:3060] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:48.530767 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:48.531013 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:48.540349 14877 leader_election.cc:304] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:48.532387 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:48.541430 14188 raft_consensus.cc:2468] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 22.
W20260709 12:12:48.527480 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 101922us
I20260709 12:12:48.537009 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:48.532588 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:48.578862 14261 raft_consensus.cc:2468] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 24.
I20260709 12:12:48.579759 14154 leader_election.cc:304] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:48.580952 14187 raft_consensus.cc:2410] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for term 23 because replica has last-logged OpId of term: 22 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 11.
I20260709 12:12:48.582376 14877 leader_election.cc:304] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 885067a0d31741bfb5c9935788e315bf
W20260709 12:12:48.584367 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 55743us
I20260709 12:12:48.584286 14877 leader_election.cc:304] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
W20260709 12:12:48.592360 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 144870us
I20260709 12:12:48.535233 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:48.596568 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:48.534363 21622 raft_consensus.cc:493] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:48.597272 14334 raft_consensus.cc:2468] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 22.
I20260709 12:12:48.598654 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:48.605986 14335 raft_consensus.cc:2410] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db for term 23 because replica has last-logged OpId of term: 21 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 14.
I20260709 12:12:48.601843 14304 leader_election.cc:304] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:48.534808 14230 leader_election.cc:304] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:12:48.594013 20979 consensus_queue.cc:1048] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.010s
I20260709 12:12:48.594169 21450 raft_consensus.cc:2804] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:12:48.586295 21444 raft_consensus.cc:493] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:48.534874 21456 raft_consensus.cc:493] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:48.533207 21367 raft_consensus.cc:2749] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:12:48.586483 21628 raft_consensus.cc:697] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [term 17 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:12:48.590133 21523 raft_consensus.cc:2804] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:48.529906 21369 raft_consensus.cc:2804] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:12:48.609555 14229 leader_election.cc:304] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:12:48.588645 21625 raft_consensus.cc:2804] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:12:48.570307 21506 consensus_queue.cc:1048] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.039s
I20260709 12:12:48.629254 14338 raft_consensus.cc:2468] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 21.
W20260709 12:12:48.634488 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 99778us
I20260709 12:12:48.640687 14333 raft_consensus.cc:2468] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 24.
I20260709 12:12:48.606266 21508 raft_consensus.cc:2749] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:48.572326 21633 raft_consensus.cc:515] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:12:48.648461 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 55318.9us
I20260709 12:12:48.536777 21393 raft_consensus.cc:515] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:48.650588 21615 raft_consensus.cc:2804] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 24 FOLLOWER]: Leader election won for term 24
W20260709 12:12:48.653631 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 44267.4us
I20260709 12:12:48.618057 21622 raft_consensus.cc:515] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:12:48.657989 21636 log.cc:927] Time spent T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 12:12:48.662405 21369 raft_consensus.cc:697] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 21 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:12:48.634192 21109 raft_consensus.cc:2804] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:48.647418 21523 raft_consensus.cc:493] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:48.683884 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:48.661382 21563 raft_consensus.cc:2804] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:48.641783 21630 raft_consensus.cc:2764] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Leader pre-election decision vote started in defunct term 23: won
W20260709 12:12:48.647673 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 60082.6us
I20260709 12:12:48.675073 14184 raft_consensus.cc:2468] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 18.
I20260709 12:12:48.642439 21450 raft_consensus.cc:697] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 24 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:12:48.676009 14261 raft_consensus.cc:1275] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
W20260709 12:12:48.677543 14154 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 69039.7us
I20260709 12:12:48.674103 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:12:48.668776 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 83165.4us
I20260709 12:12:48.676505 14229 leader_election.cc:304] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:12:48.680797 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:48.675827 14230 leader_election.cc:304] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:48.681054 21615 raft_consensus.cc:697] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 24 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:12:48.691339 14263 raft_consensus.cc:2410] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db for term 23 because replica has last-logged OpId of term: 21 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 14.
I20260709 12:12:48.643036 21444 raft_consensus.cc:515] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:48.675173 21625 raft_consensus.cc:697] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 21 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:12:48.695295 14230 leader_election.cc:304] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:48.695634 14229 leader_election.cc:304] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:48.698370 21453 raft_consensus.cc:2804] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Leader election won for term 17
W20260709 12:12:48.698702 21635 log.cc:927] Time spent T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 12:12:48.684734 21109 raft_consensus.cc:493] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:48.687047 21523 raft_consensus.cc:3060] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:48.699508 21622 leader_election.cc:290] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:48.704958 14304 leader_election.cc:400] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 17 election: Vote denied by peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673) with higher term. Message: Invalid argument: T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for earlier term 17. Current term is 18.
I20260709 12:12:48.706312 14304 leader_election.cc:403] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 12:12:48.668879 21456 raft_consensus.cc:515] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:48.677067 21591 raft_consensus.cc:515] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:48.692364 20979 raft_consensus.cc:2804] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:12:48.705924 21109 raft_consensus.cc:3060] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:48.694319 21640 raft_consensus.cc:493] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:48.703119 21369 consensus_queue.cc:237] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:48.711297 14155 leader_election.cc:304] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:48.704281 21518 raft_consensus.cc:493] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:48.725989 21640 raft_consensus.cc:515] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:48.712427 20979 raft_consensus.cc:493] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:48.735222 21393 leader_election.cc:290] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:48.690797 21628 consensus_queue.cc:237] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:48.736189 14304 leader_election.cc:304] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:12:48.701565 21615 consensus_queue.cc:237] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:48.746950 21641 raft_consensus.cc:493] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:48.747529 21641 raft_consensus.cc:515] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:48.712967 21450 consensus_queue.cc:237] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:48.758136 21444 leader_election.cc:290] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:48.737928 21633 leader_election.cc:290] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:48.776510 14304 leader_election.cc:304] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
W20260709 12:12:48.783969 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 85943.1us
I20260709 12:12:48.734532 21622 raft_consensus.cc:2749] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673) with higher term. Message: Invalid argument: T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for earlier term 17. Current term is 18.
I20260709 12:12:48.736388 20979 raft_consensus.cc:3060] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:48.795374 21393 raft_consensus.cc:3060] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:12:48.797621 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 106201us
I20260709 12:12:48.730060 21518 raft_consensus.cc:515] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:12:48.798666 14154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:48.796240 21646 raft_consensus.cc:2804] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:12:48.796687 21563 raft_consensus.cc:697] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 19 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:48.797567 21643 raft_consensus.cc:2804] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:48.806396 21591 leader_election.cc:290] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 22 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:48.807122 21456 leader_election.cc:290] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:48.749676 21641 leader_election.cc:290] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:48.799286 21624 raft_consensus.cc:2804] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:48.801136 21623 raft_consensus.cc:2764] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Leader pre-election decision vote started in defunct term 23: won
I20260709 12:12:48.818740 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:48.821555 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
W20260709 12:12:48.826241 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 114781us
I20260709 12:12:48.818553 21624 raft_consensus.cc:493] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:48.829094 21624 raft_consensus.cc:3060] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:12:48.841861 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:48.843328 21622 consensus_queue.cc:1048] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:12:48.849251 14303 leader_election.cc:304] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:12:48.855298 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:48.857039 21624 raft_consensus.cc:515] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:48.857766 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
W20260709 12:12:48.858206 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 163002us
I20260709 12:12:48.860167 21518 leader_election.cc:290] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:12:48.860956 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:48.736866 21625 consensus_queue.cc:237] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:12:48.862766 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 59817.7us
I20260709 12:12:48.869993 21622 raft_consensus.cc:2804] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:48.876186 14303 leader_election.cc:304] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:48.818578 21453 raft_consensus.cc:697] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 17 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:48.872004 14230 leader_election.cc:304] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:12:48.821156 21643 raft_consensus.cc:697] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 18 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:48.874760 14304 leader_election.cc:304] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:12:48.879678 14304 leader_election.cc:304] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:12:48.880970 21367 raft_consensus.cc:2804] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:12:48.881400 21367 raft_consensus.cc:493] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:48.873188 20979 raft_consensus.cc:515] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:48.879379 21643 consensus_queue.cc:237] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:12:48.956418 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 84081.3us
W20260709 12:12:48.958775 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 83097.1us
I20260709 12:12:48.955942 21523 raft_consensus.cc:515] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:48.963871 21523 leader_election.cc:290] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:48.965061 14261 raft_consensus.cc:2393] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db in current term 22: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:12:48.965989 20979 leader_election.cc:290] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:48.966667 20979 raft_consensus.cc:2804] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:48.967048 20979 raft_consensus.cc:493] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:48.967368 20979 raft_consensus.cc:3060] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:48.954252 21109 raft_consensus.cc:515] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:48.966768 21624 leader_election.cc:290] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 21 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:48.971951 14336 raft_consensus.cc:3060] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:48.972971 21109 leader_election.cc:290] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 21 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:12:48.958144 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 87843.5us
I20260709 12:12:48.885481 21563 consensus_queue.cc:237] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:48.985972 14190 raft_consensus.cc:2393] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db in current term 17: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:12:48.989058 14336 raft_consensus.cc:2468] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 22.
I20260709 12:12:48.990338 14155 leader_election.cc:304] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:48.876755 21622 raft_consensus.cc:493] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:48.891476 21367 raft_consensus.cc:3060] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:48.999977 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:49.002417 14903 raft_consensus.cc:3060] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:48.995298 21624 raft_consensus.cc:2804] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:12:49.026046 14229 leader_election.cc:304] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:49.006182 21640 leader_election.cc:290] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:49.018471 21649 raft_consensus.cc:2749] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:12:49.041268 14229 leader_election.cc:304] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:49.042695 14229 leader_election.cc:304] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:49.043993 14229 leader_election.cc:304] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:49.044912 21644 raft_consensus.cc:2749] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:49.048929 21651 raft_consensus.cc:493] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:49.049559 21651 raft_consensus.cc:515] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:49.051802 21651 leader_election.cc:290] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:49.052373 21651 raft_consensus.cc:2749] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:49.053038 21651 raft_consensus.cc:2749] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:49.054347 21632 raft_consensus.cc:515] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:49.056466 21632 leader_election.cc:290] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 21 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:49.057227 14181 raft_consensus.cc:2368] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 20. Current term is 21.
I20260709 12:12:49.014321 21650 raft_consensus.cc:2749] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:48.978235 21453 consensus_queue.cc:237] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:12:49.066287 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 61796.5us
I20260709 12:12:49.045621 21644 raft_consensus.cc:2804] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:49.081990 14877 leader_election.cc:304] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:49.001534 21622 raft_consensus.cc:3060] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:49.067322 14155 leader_election.cc:304] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:49.087061 20547 raft_consensus.cc:2749] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:49.078531 21644 raft_consensus.cc:493] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:49.021808 21624 raft_consensus.cc:493] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:48.997520 21109 consensus_queue.cc:1048] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.094s
I20260709 12:12:49.017632 21523 consensus_queue.cc:1059] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.073s
W20260709 12:12:49.103916 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 223353us
I20260709 12:12:49.118191 21449 consensus_queue.cc:1048] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:12:49.094457 21644 raft_consensus.cc:3060] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:49.099305 21624 raft_consensus.cc:3060] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:12:49.138510 14903 raft_consensus.cc:2468] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 17.
W20260709 12:12:49.139568 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 72351.7us
I20260709 12:12:49.147408 14155 leader_election.cc:304] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:49.149801 14155 leader_election.cc:304] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:49.136818 21632 raft_consensus.cc:2749] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:12:49.158393 21367 raft_consensus.cc:515] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:49.160784 21367 leader_election.cc:290] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 23 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:12:49.170162 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 126242us
I20260709 12:12:49.171154 14229 leader_election.cc:304] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:49.173118 21640 raft_consensus.cc:2804] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:49.173604 21640 raft_consensus.cc:493] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:49.173992 21640 raft_consensus.cc:3060] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:49.151605 14154 leader_election.cc:304] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:49.181560 21641 raft_consensus.cc:2804] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:49.182035 21641 raft_consensus.cc:493] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:49.182389 21641 raft_consensus.cc:3060] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:49.182557 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:49.182813 21518 raft_consensus.cc:2804] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:49.183247 14330 raft_consensus.cc:2468] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 21.
I20260709 12:12:49.183377 21518 raft_consensus.cc:697] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 17 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:12:49.184257 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:49.184479 21518 consensus_queue.cc:237] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:49.185454 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:49.187345 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
W20260709 12:12:49.189030 21647 log.cc:927] Time spent T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.151s	user 0.001s	sys 0.000s
I20260709 12:12:49.191910 14261 raft_consensus.cc:1275] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 12:12:49.194396 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:49.195441 21523 raft_consensus.cc:3055] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:49.195833 21523 raft_consensus.cc:740] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:12:49.196641 21523 consensus_queue.cc:260] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:49.182081 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:49.242964 14336 raft_consensus.cc:2468] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 19.
I20260709 12:12:49.216998 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:49.244349 14338 raft_consensus.cc:2393] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 21: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:12:49.236829 14181 raft_consensus.cc:1275] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:12:49.237632 21450 consensus_queue.cc:1048] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.014s
I20260709 12:12:49.251700 21449 consensus_queue.cc:1048] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:12:49.252023 14335 raft_consensus.cc:1275] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 12:12:49.252971 21633 raft_consensus.cc:493] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:49.253510 21633 raft_consensus.cc:515] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:49.210588 21393 raft_consensus.cc:2749] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:49.255046 21523 raft_consensus.cc:3060] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:49.255602 21633 leader_election.cc:290] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:49.196812 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:49.256172 21109 consensus_queue.cc:1048] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:12:49.200892 14087 catalog_manager.cc:5697] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 16 to 19, leader changed from 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) to 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130). New cstate: current_term: 19 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:12:49.236981 14877 leader_election.cc:304] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec
W20260709 12:12:49.260177 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 89127.4us
I20260709 12:12:49.269197 14334 raft_consensus.cc:1275] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 12:12:49.269096 14877 leader_election.cc:304] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
W20260709 12:12:49.270664 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 398668us
I20260709 12:12:49.271453 14303 leader_election.cc:304] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:12:49.265406 14155 leader_election.cc:304] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:49.237478 21630 raft_consensus.cc:2749] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:12:49.211881 21619 raft_consensus.cc:493] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:49.282264 14877 leader_election.cc:304] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:49.282496 14087 catalog_manager.cc:5697] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 17 to 20, leader changed from 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) to 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130). New cstate: current_term: 20 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:12:49.286837 14303 leader_election.cc:304] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:49.272585 21284 raft_consensus.cc:2804] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:12:49.288569 14877 leader_election.cc:304] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:12:49.288710 14229 leader_election.cc:304] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:49.230741 21622 raft_consensus.cc:515] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:49.302484 14155 leader_election.cc:304] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:49.308065 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:49.310371 14261 raft_consensus.cc:1240] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 20. Current term is 21. Ops: []
I20260709 12:12:49.284842 21449 raft_consensus.cc:2749] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:12:49.286231 21453 raft_consensus.cc:493] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:49.313843 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:49.326867 14265 raft_consensus.cc:3060] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Advancing to term 21
I20260709 12:12:49.314672 14155 leader_election.cc:304] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:49.319330 21656 raft_consensus.cc:2804] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:49.306511 14087 catalog_manager.cc:5697] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 16 to 18, leader changed from 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130) to 73d01e9b1a9d49358da4985b21d681db (127.12.174.132). New cstate: current_term: 18 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:49.320446 21622 leader_election.cc:290] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 20 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:49.323457 21565 consensus_queue.cc:1048] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:12:49.324216 20547 consensus_queue.cc:1048] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:12:49.304395 21649 raft_consensus.cc:2804] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:49.289079 21641 raft_consensus.cc:515] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:49.298007 21284 raft_consensus.cc:493] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:49.298231 21369 raft_consensus.cc:2749] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:12:49.330710 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:49.332629 14912 raft_consensus.cc:1240] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 21 LEADER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 20. Current term is 21. Ops: []
I20260709 12:12:49.306231 21516 raft_consensus.cc:2804] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:12:49.332122 14155 leader_election.cc:304] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:49.300208 21646 raft_consensus.cc:697] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 22 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:49.325881 21632 raft_consensus.cc:2749] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 12:12:49.345889 21284 raft_consensus.cc:3060] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:49.340515 14230 leader_election.cc:304] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:12:49.356370 14229 leader_election.cc:304] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:49.346767 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:49.361917 14261 raft_consensus.cc:2368] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for earlier term 21. Current term is 22.
I20260709 12:12:49.288596 21619 raft_consensus.cc:515] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:12:49.364831 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 47090.5us
I20260709 12:12:49.339052 21444 raft_consensus.cc:2804] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:12:49.331112 21656 raft_consensus.cc:493] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:49.333129 21417 raft_consensus.cc:2749] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:49.359125 14155 leader_election.cc:304] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:49.303920 21650 consensus_queue.cc:1059] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.038s
I20260709 12:12:49.338351 21649 raft_consensus.cc:493] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:49.325626 21652 raft_consensus.cc:2749] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:12:49.371102 14155 leader_election.cc:304] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
W20260709 12:12:49.382529 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:49.333658 21453 raft_consensus.cc:515] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:49.366535 21633 raft_consensus.cc:2804] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:12:49.425742 21518 raft_consensus.cc:2804] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:49.392794 20979 raft_consensus.cc:515] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:49.444859 20979 leader_election.cc:290] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:49.374972 21630 consensus_queue.cc:1059] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.058s
I20260709 12:12:49.375701 21444 raft_consensus.cc:697] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 24 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:12:49.446040 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:49.446247 21444 consensus_queue.cc:237] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:49.341750 21624 raft_consensus.cc:515] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:49.448858 21624 leader_election.cc:290] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 25 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:49.341493 21657 consensus_queue.cc:1048] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.046s
I20260709 12:12:49.449599 14333 raft_consensus.cc:1240] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 25 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 24. Current term is 25. Ops: []
I20260709 12:12:49.450505 21646 consensus_queue.cc:237] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:49.451875 21640 raft_consensus.cc:515] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:49.456528 21644 raft_consensus.cc:515] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:49.442727 21518 raft_consensus.cc:493] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
W20260709 12:12:49.437222 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 80940.6us
W20260709 12:12:49.438540 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 67501.5us
I20260709 12:12:49.375784 21649 raft_consensus.cc:3060] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:49.366689 21516 raft_consensus.cc:697] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 22 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:12:49.375001 21651 raft_consensus.cc:2804] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:49.390530 21642 raft_consensus.cc:2749] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:12:49.469769 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:49.490415 14338 raft_consensus.cc:2393] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 22: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
I20260709 12:12:49.481768 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:49.375612 21632 raft_consensus.cc:2804] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:12:49.373627 21656 raft_consensus.cc:3060] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:49.485069 14304 leader_election.cc:400] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 21 election: Vote denied by peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673) with higher term. Message: Invalid argument: T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for earlier term 21. Current term is 22.
I20260709 12:12:49.486436 14265 raft_consensus.cc:2468] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 21.
I20260709 12:12:49.487016 14336 raft_consensus.cc:1240] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:49.479229 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:49.449710 21641 leader_election.cc:290] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 20 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:49.438314 21622 raft_consensus.cc:3055] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:49.539168 21641 raft_consensus.cc:493] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:49.494850 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:49.482456 21518 raft_consensus.cc:3060] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:12:49.477301 21661 log.cc:927] Time spent T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.103s	user 0.000s	sys 0.001s
I20260709 12:12:49.542268 21622 raft_consensus.cc:740] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:49.477048 21633 raft_consensus.cc:697] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 21 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:12:49.541523 14304 leader_election.cc:403] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 21 election: Cancelling election due to peer responding with higher term
I20260709 12:12:49.540474 21591 raft_consensus.cc:493] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:49.554558 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 185500us
W20260709 12:12:49.559593 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 74661.5us
I20260709 12:12:49.559710 14259 raft_consensus.cc:1275] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:12:49.555922 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:49.564383 21622 consensus_queue.cc:260] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:49.540959 21632 raft_consensus.cc:493] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:49.544203 21640 leader_election.cc:290] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:49.577010 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:49.571175 14304 leader_election.cc:304] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:12:49.567500 21417 raft_consensus.cc:2749] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Leader election lost for term 21. Reason: Vote denied by peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673) with higher term. Message: Invalid argument: T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for earlier term 21. Current term is 22.
I20260709 12:12:49.547243 21651 raft_consensus.cc:697] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 18 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:49.554052 21672 raft_consensus.cc:493] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:49.489702 21624 consensus_queue.cc:1059] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.080s
I20260709 12:12:49.539811 21641 raft_consensus.cc:515] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:49.575538 21632 raft_consensus.cc:3060] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:12:49.611280 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 337098us
I20260709 12:12:49.612202 14303 leader_election.cc:400] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 23 pre-election: Vote denied by peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187) with higher term. Message: Invalid argument: T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for earlier term 23. Current term is 24.
I20260709 12:12:49.614214 14303 leader_election.cc:403] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 23 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:12:49.618309 14256 raft_consensus.cc:1275] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 12:12:49.608739 21622 raft_consensus.cc:3060] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:49.576207 21591 raft_consensus.cc:515] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:12:49.655467 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 174592us
W20260709 12:12:49.655768 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 43710.2us
I20260709 12:12:49.657516 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
W20260709 12:12:49.658533 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 112367us
I20260709 12:12:49.631088 21217 raft_consensus.cc:493] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:49.657130 14303 leader_election.cc:304] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:12:49.635954 21650 raft_consensus.cc:2804] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:12:49.608814 21672 raft_consensus.cc:515] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:49.613097 21516 consensus_queue.cc:237] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:49.683782 21619 leader_election.cc:290] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:49.684988 21473 raft_consensus.cc:493] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:49.704291 14229 leader_election.cc:304] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
W20260709 12:12:49.711881 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 54834.3us
I20260709 12:12:49.695912 21644 leader_election.cc:290] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 21 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:49.697584 21650 raft_consensus.cc:697] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 21 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:49.720031 14303 leader_election.cc:304] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:49.636368 21633 consensus_queue.cc:237] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:49.723107 21655 raft_consensus.cc:3055] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 19 LEADER]: Stepping down as leader of term 19
W20260709 12:12:49.723825 21667 log.cc:927] Time spent T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:12:49.701805 21640 raft_consensus.cc:493] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:49.728600 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:49.728653 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:49.735149 14181 raft_consensus.cc:2393] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 16: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:12:49.735662 14229 leader_election.cc:304] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:49.737066 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:49.737599 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:49.712826 21453 leader_election.cc:290] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:49.756991 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:49.694820 21217 raft_consensus.cc:515] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:49.744127 14189 raft_consensus.cc:1240] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 17 LEADER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:49.748351 14185 raft_consensus.cc:1240] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:49.730602 21655 raft_consensus.cc:740] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:49.702446 21651 consensus_queue.cc:237] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:49.754278 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:49.733034 21646 raft_consensus.cc:2804] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:12:49.705919 21473 raft_consensus.cc:515] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:49.813748 14187 raft_consensus.cc:1240] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:49.814711 14186 raft_consensus.cc:1275] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:12:49.711488 21666 raft_consensus.cc:2804] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:12:49.734881 14182 raft_consensus.cc:2468] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 18.
I20260709 12:12:49.796105 14184 raft_consensus.cc:2468] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 20.
W20260709 12:12:49.796389 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 225281us
I20260709 12:12:49.799434 14188 raft_consensus.cc:2393] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 20: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:12:49.742861 21284 raft_consensus.cc:515] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:49.739468 21367 raft_consensus.cc:2749] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
W20260709 12:12:49.782439 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 46872.9us
I20260709 12:12:49.783165 21644 raft_consensus.cc:2749] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:12:49.799643 21669 log.cc:927] Time spent T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.145s	user 0.001s	sys 0.000s
I20260709 12:12:49.782775 21640 raft_consensus.cc:515] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:49.805013 21646 raft_consensus.cc:493] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:12:49.835763 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:49.835427 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:49.837492 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:49.839291 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 26 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:49.818184 21630 raft_consensus.cc:493] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:49.837587 14229 leader_election.cc:304] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:49.866760 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:49.866415 14338 raft_consensus.cc:1275] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:12:49.893587 14189 raft_consensus.cc:2393] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 21: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:12:49.869220 14182 raft_consensus.cc:3060] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:49.869105 14337 raft_consensus.cc:3060] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:49.869082 14339 raft_consensus.cc:1275] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 12:12:49.896273 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:49.897275 14188 raft_consensus.cc:2410] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for term 22 because replica has last-logged OpId of term: 20 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 10.
I20260709 12:12:49.840536 21641 leader_election.cc:290] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:12:49.904327 21681 log.cc:927] Time spent T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.107s	user 0.000s	sys 0.001s
I20260709 12:12:49.834798 21671 consensus_queue.cc:1059] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.061s
I20260709 12:12:49.824502 21650 consensus_queue.cc:237] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:49.905345 21473 leader_election.cc:290] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:49.905673 21671 raft_consensus.cc:3055] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:49.906131 21671 raft_consensus.cc:740] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:49.907109 21671 consensus_queue.cc:260] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:49.908392 21671 raft_consensus.cc:3060] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:49.910724 21217 leader_election.cc:290] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:49.869234 21623 raft_consensus.cc:2749] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Leader pre-election lost for term 23. Reason: Vote denied by peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187) with higher term. Message: Invalid argument: T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for earlier term 23. Current term is 24.
I20260709 12:12:49.889846 21591 leader_election.cc:290] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:49.895117 21646 raft_consensus.cc:3060] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:12:49.936661 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 99155.2us
I20260709 12:12:49.940423 14229 leader_election.cc:304] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:49.863389 21670 consensus_queue.cc:1048] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.061s
I20260709 12:12:49.916639 21644 raft_consensus.cc:2749] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:12:49.942471 21677 log.cc:927] Time spent T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.220s	user 0.001s	sys 0.000s
I20260709 12:12:49.958868 14229 leader_election.cc:304] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:49.894850 21630 raft_consensus.cc:515] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:49.961889 14229 leader_election.cc:304] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:49.957127 21691 raft_consensus.cc:493] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:49.964450 21644 raft_consensus.cc:2804] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:49.964890 21644 raft_consensus.cc:493] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:12:49.965305 21644 raft_consensus.cc:3060] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:49.964653 21691 raft_consensus.cc:515] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } }
I20260709 12:12:49.969328 21691 leader_election.cc:290] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:49.941601 21666 raft_consensus.cc:697] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 25 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:49.970127 14087 catalog_manager.cc:5697] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 13 to 17. New cstate: current_term: 17 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:49.951488 21643 raft_consensus.cc:2764] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 12:12:49.952708 21672 leader_election.cc:290] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:49.975827 21284 leader_election.cc:290] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 23 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:49.978806 21666 consensus_queue.cc:237] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 23.11, Last appended by leader: 11, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:49.892254 21655 consensus_queue.cc:260] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:49.983408 14182 raft_consensus.cc:2468] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 20.
W20260709 12:12:49.965830 21683 log.cc:927] Time spent T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
I20260709 12:12:49.970790 21453 raft_consensus.cc:2749] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:12:49.990324 21655 raft_consensus.cc:3060] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:49.997145 14087 catalog_manager.cc:5697] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 15 to 22, leader changed from 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) to 885067a0d31741bfb5c9935788e315bf (127.12.174.129). New cstate: current_term: 22 leader_uuid: "885067a0d31741bfb5c9935788e315bf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:12:49.999056 14087 catalog_manager.cc:5697] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 16 to 18, leader changed from 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130) to 73d01e9b1a9d49358da4985b21d681db (127.12.174.132). New cstate: current_term: 18 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:49.997889 21684 raft_consensus.cc:493] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:12:50.002609 14229 leader_election.cc:304] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:49.971175 21630 leader_election.cc:290] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:50.012075 14229 leader_election.cc:304] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:50.016430 20979 raft_consensus.cc:2804] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:12:50.016943 20979 raft_consensus.cc:493] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:50.017452 20979 raft_consensus.cc:3060] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:50.016819 14229 leader_election.cc:304] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:49.963582 21649 raft_consensus.cc:515] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } }
I20260709 12:12:50.036209 14229 leader_election.cc:304] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:50.036595 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:50.039721 14263 raft_consensus.cc:1240] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 20. Current term is 21. Ops: [20.15-20.15]
I20260709 12:12:50.040395 21696 raft_consensus.cc:2804] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 12:12:50.040779 21685 log.cc:927] Time spent T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.092s	user 0.002s	sys 0.002s
I20260709 12:12:50.040880 21696 raft_consensus.cc:493] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:50.041409 21696 raft_consensus.cc:3060] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:50.038693 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:50.042286 20979 raft_consensus.cc:515] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:50.048331 20979 leader_election.cc:290] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 23 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:50.036829 21563 raft_consensus.cc:2749] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:50.052923 14087 catalog_manager.cc:5697] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 13 to 22, leader changed from 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) to 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130). New cstate: current_term: 22 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:12:50.010655 21670 consensus_queue.cc:1048] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.035s
I20260709 12:12:50.054721 20979 raft_consensus.cc:3060] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:50.058789 14087 catalog_manager.cc:5697] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 17 to 21. New cstate: current_term: 21 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:12:50.070268 14081 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60410 (request call id 261) took 21382 ms (client timeout 15000 ms). Trace:
I20260709 12:12:50.073144 21691 consensus_queue.cc:1059] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:50.074219 21691 raft_consensus.cc:3055] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:50.074572 21691 raft_consensus.cc:740] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:50.075428 21691 consensus_queue.cc:260] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:50.076604 21691 raft_consensus.cc:3060] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:50.077955 21695 consensus_queue.cc:1059] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.023s
I20260709 12:12:50.078896 21695 consensus_queue.cc:1243] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer 885067a0d31741bfb5c9935788e315bf log is divergent from this leader: its last log entry 17.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 12:12:50.079449 21695 raft_consensus.cc:3055] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:12:50.079793 21695 raft_consensus.cc:740] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
W20260709 12:12:50.086799 21673 log.cc:927] Time spent T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.494s	user 0.003s	sys 0.000s
I20260709 12:12:50.087564 14087 catalog_manager.cc:5697] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db reported cstate change: config changed from index 6 to 12, VOTER 885067a0d31741bfb5c9935788e315bf (127.12.174.129) evicted. New cstate: current_term: 16 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:50.089897 21633 raft_consensus.cc:493] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:50.090473 21633 raft_consensus.cc:515] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:50.090806 14087 catalog_manager.cc:5697] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:50.091791 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:50.092634 14181 raft_consensus.cc:2393] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 19: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:12:50.092927 21633 leader_election.cc:290] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:50.033977 21643 consensus_queue.cc:1048] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.028s
I20260709 12:12:50.095743 21284 consensus_queue.cc:1059] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 24.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:12:50.096102 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:50.096796 14335 raft_consensus.cc:2468] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 23.
I20260709 12:12:50.098062 21450 raft_consensus.cc:3055] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:12:50.098479 21450 raft_consensus.cc:740] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:12:50.099336 14337 raft_consensus.cc:2468] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 20.
I20260709 12:12:50.099478 21450 consensus_queue.cc:260] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.15, Last appended by leader: 15, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:12:50.104696 21678 log.cc:927] Time spent T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.489s	user 0.005s	sys 0.000s
I20260709 12:12:50.007756 21684 raft_consensus.cc:515] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:50.111949 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:50.113837 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:50.114470 14264 raft_consensus.cc:2468] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 16.
I20260709 12:12:50.115805 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:50.116214 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:50.126362 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:50.128571 14265 raft_consensus.cc:1275] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:12:50.130781 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:50.132849 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:50.131453 14335 raft_consensus.cc:2468] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 16.
I20260709 12:12:50.137746 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:50.138480 14335 raft_consensus.cc:2468] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 17.
I20260709 12:12:50.130420 14155 leader_election.cc:304] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:50.139815 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:50.140468 14335 raft_consensus.cc:2468] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 16.
I20260709 12:12:50.058768 21640 leader_election.cc:290] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:50.144176 14263 raft_consensus.cc:1275] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 12:12:50.141848 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:50.144353 14877 leader_election.cc:304] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
W20260709 12:12:50.142356 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 86063.8us
I20260709 12:12:50.146426 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:50.135645 21450 raft_consensus.cc:3060] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:12:50.205312 14877 leader_election.cc:304] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:12:50.148900 14155 leader_election.cc:304] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
W20260709 12:12:50.070789 14081 rpcz_store.cc:269] 0709 12:12:28.656653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:28.656986 (+   333us) service_pool.cc:224] Handling call
0709 12:12:50.034278 (+21377292us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:12:45.630221 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:12:45.630820 (+   599us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:12:45.630862 (+    42us) write_op.cc:435] Acquired schema lock
0709 12:12:45.630880 (+    18us) tablet.cc:662] Decoding operations
0709 12:12:45.632528 (+  1648us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:12:45.632593 (+    65us) write_op.cc:641] Partition lock acquired for write op
0709 12:12:45.632621 (+    28us) tablet.cc:685] Acquiring locks for 24 operations
0709 12:12:45.726434 (+ 93813us) tablet.cc:701] Row locks acquired
0709 12:12:45.726456 (+    22us) write_op.cc:260] PREPARE: finished
0709 12:12:45.726616 (+   160us) write_op.cc:270] Start()
0709 12:12:45.726777 (+   161us) write_op.cc:276] Timestamp: P: 1783599165726562 usec, L: 0
0709 12:12:45.726800 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 12:12:45.871928 (+145128us) log.cc:844] Serialized 9514 byte log entry
0709 12:12:46.799883 (+927955us) op_driver.cc:464] REPLICATION: finished
0709 12:12:47.073654 (+273771us) write_op.cc:301] APPLY: starting
0709 12:12:47.073787 (+   133us) tablet.cc:1367] starting BulkCheckPresence
0709 12:12:47.294732 (+220945us) tablet.cc:1370] finished BulkCheckPresence
0709 12:12:47.320246 (+ 25514us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:12:47.968883 (+648637us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:12:47.969413 (+   530us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=48,key_file_lookups=48,delta_file_lookups=48,mrs_lookups=0
0709 12:12:47.969483 (+    70us) write_op.cc:312] APPLY: finished
0709 12:12:47.970185 (+   702us) log.cc:844] Serialized 212 byte log entry
0709 12:12:48.260308 (+290123us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:48.260646 (+   338us) write_op.cc:454] Released schema lock
0709 12:12:48.260740 (+    94us) write_op.cc:341] FINISH: Updating metrics
0709 12:12:48.297782 (+ 37042us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:48.297825 (+    43us) write_op.cc:454] Released schema lock
0709 12:12:48.308455 (+ 10630us) spinlock_profiling.cc:243] Waited 5.6 ms on lock 0x7b18002f6200. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f212cf16ab1 00007f212cf23281 00007f212404e3f3 00007f21240507c1 00007f2124050779 00007f2124050709 00007f21240506d1 00007f212404f9cd 0000000000388634 0000000000388479 00007f212403183a
Metrics: {"mutex_wait_us":22618,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":246086,"apply.run_cpu_time_us":73200,"apply.run_wall_time_us":1187619,"cfile_cache_hit":98,"cfile_cache_hit_bytes":104639,"num_ops":24,"prepare.queue_time_us":207556,"prepare.run_cpu_time_us":29462,"prepare.run_wall_time_us":368138,"raft.queue_time_us":441796,"raft.run_cpu_time_us":39315,"raft.run_wall_time_us":463958,"replication_time_us":1037291,"spinlock_wait_cycles":12880128,"thread_start_us":973071,"threads_started":5,"wal-append.queue_time_us":498263,"wal-append.run_cpu_time_us":18952,"wal-append.run_wall_time_us":2461009}]]}
W20260709 12:12:50.146080 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 102788us
W20260709 12:12:50.145777 21632 consensus_meta.cc:287] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.526s	user 0.001s	sys 0.011s
I20260709 12:12:50.136831 21672 raft_consensus.cc:493] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
W20260709 12:12:50.212543 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 105583us
W20260709 12:12:50.147491 21622 consensus_meta.cc:287] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.514s	user 0.006s	sys 0.005s
I20260709 12:12:50.150650 14087 catalog_manager.cc:5697] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 22 to 24, leader changed from 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130) to 73d01e9b1a9d49358da4985b21d681db (127.12.174.132). New cstate: current_term: 24 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:50.208305 14189 raft_consensus.cc:3055] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 20 LEADER]: Stepping down as leader of term 20
W20260709 12:12:50.215983 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 67162.1us
I20260709 12:12:50.149943 21469 raft_consensus.cc:2804] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:50.227075 14189 raft_consensus.cc:740] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
W20260709 12:12:50.212292 21656 consensus_meta.cc:287] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.665s	user 0.010s	sys 0.006s
I20260709 12:12:50.221071 14230 leader_election.cc:304] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:12:50.143520 21687 raft_consensus.cc:493] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
W20260709 12:12:50.220660 21518 consensus_meta.cc:287] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.665s	user 0.012s	sys 0.007s
I20260709 12:12:50.143862 21591 consensus_queue.cc:1048] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.080s
W20260709 12:12:50.237450 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 90239.9us
I20260709 12:12:50.236341 14087 catalog_manager.cc:5697] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:50.230602 20979 raft_consensus.cc:2749] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:12:50.232137 14877 leader_election.cc:304] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:12:50.220593 21444 raft_consensus.cc:2804] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:50.243846 14303 leader_election.cc:304] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:12:50.230419 14189 consensus_queue.cc:260] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:50.249636 14303 leader_election.cc:304] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:50.231312 21469 raft_consensus.cc:493] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:50.253109 14183 raft_consensus.cc:1275] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 24 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 12:12:50.217514 21666 consensus_queue.cc:1048] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 12:12:50.137233 21695 consensus_queue.cc:260] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.15, Last appended by leader: 15, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:50.257902 20979 raft_consensus.cc:493] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:50.246294 21444 raft_consensus.cc:493] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:50.261336 14336 raft_consensus.cc:1275] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 12:12:50.268307 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:50.269109 14335 raft_consensus.cc:3060] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:50.223218 21456 consensus_queue.cc:1048] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.026s
I20260709 12:12:50.270546 21710 raft_consensus.cc:2804] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:50.271009 21710 raft_consensus.cc:493] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:50.243076 21518 raft_consensus.cc:515] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:50.271358 21710 raft_consensus.cc:3060] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:50.272537 21646 raft_consensus.cc:515] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:50.273433 21518 leader_election.cc:290] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:50.223278 21632 raft_consensus.cc:515] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:50.275529 21632 leader_election.cc:290] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 22 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:50.257206 21469 raft_consensus.cc:3060] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:50.285187 21676 raft_consensus.cc:2804] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:12:50.284955 21644 raft_consensus.cc:515] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:50.255889 14087 catalog_manager.cc:5697] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 13 to 15, leader changed from 65c9c1653b3346b39a0e118540e6080c (127.12.174.131) to 73d01e9b1a9d49358da4985b21d681db (127.12.174.132). New cstate: current_term: 15 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:50.251488 21217 raft_consensus.cc:2804] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:50.263895 21473 raft_consensus.cc:2804] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:50.225752 21672 raft_consensus.cc:515] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:50.285691 21676 raft_consensus.cc:493] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:50.266377 20979 raft_consensus.cc:515] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:50.240271 21700 consensus_queue.cc:1059] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
W20260709 12:12:50.291802 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:50.313345 14087 catalog_manager.cc:5697] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 10 to 19, leader changed from 885067a0d31741bfb5c9935788e315bf (127.12.174.129) to 73d01e9b1a9d49358da4985b21d681db (127.12.174.132). New cstate: current_term: 19 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:50.288381 14335 raft_consensus.cc:2468] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 19.
I20260709 12:12:50.239555 21656 raft_consensus.cc:515] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:50.286046 21444 raft_consensus.cc:3060] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:50.298791 21217 raft_consensus.cc:493] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:50.386767 21649 leader_election.cc:290] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:12:50.390084 21699 log.cc:927] Time spent T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.180s	user 0.000s	sys 0.001s
I20260709 12:12:50.314465 21473 raft_consensus.cc:493] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:50.318519 21695 raft_consensus.cc:3060] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:50.395555 21672 leader_election.cc:290] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:50.252017 21641 consensus_queue.cc:1059] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.042s
I20260709 12:12:50.387174 21217 raft_consensus.cc:3060] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:50.404181 21623 raft_consensus.cc:3060] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:50.322294 21704 raft_consensus.cc:2804] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:50.243294 21687 raft_consensus.cc:515] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:50.375978 14087 catalog_manager.cc:5697] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:12:50.409238 20979 leader_election.cc:290] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:50.328734 21676 raft_consensus.cc:3060] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:50.416354 14332 raft_consensus.cc:3055] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:12:50.419924 14332 raft_consensus.cc:740] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:50.391180 21473 raft_consensus.cc:3060] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:50.420852 14332 consensus_queue.cc:260] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:50.426292 14332 raft_consensus.cc:3060] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:12:50.419062 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 187013us
I20260709 12:12:50.431504 14877 leader_election.cc:304] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
W20260709 12:12:50.417383 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 381224us
I20260709 12:12:50.434520 14229 leader_election.cc:304] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:50.391237 21644 leader_election.cc:290] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:50.443948 14087 catalog_manager.cc:5697] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 16 to 18, leader changed from 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) to 65c9c1653b3346b39a0e118540e6080c (127.12.174.131). New cstate: current_term: 18 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:12:50.416297 21713 raft_consensus.cc:493] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:50.452083 20979 raft_consensus.cc:2749] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:50.453280 14229 leader_election.cc:400] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 pre-election: Vote denied by peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187) with higher term. Message: Invalid argument: T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 20. Current term is 21.
I20260709 12:12:50.454280 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:50.456393 14188 raft_consensus.cc:2468] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 17.
I20260709 12:12:50.422049 21704 raft_consensus.cc:697] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 20 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:50.457391 14229 leader_election.cc:403] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:12:50.460971 14912 raft_consensus.cc:1275] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 12:12:50.462224 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:50.466329 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:50.467199 14335 raft_consensus.cc:2368] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 19. Current term is 20.
I20260709 12:12:50.469388 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:50.470074 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:50.473321 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:50.474064 14335 raft_consensus.cc:3060] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:50.475456 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:50.496574 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:50.498123 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:50.498873 14903 raft_consensus.cc:2468] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 22.
I20260709 12:12:50.507200 14332 raft_consensus.cc:1275] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 15. (term mismatch)
I20260709 12:12:50.519521 14332 pending_rounds.cc:85] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c: Aborting all ops after (but not including) 14
I20260709 12:12:50.463963 21684 leader_election.cc:290] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:50.523113 14907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:50.526985 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:50.529768 14186 raft_consensus.cc:2376] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 18. Re-sending same reply.
I20260709 12:12:50.533578 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:50.520920 14332 pending_rounds.cc:107] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c: Aborting uncommitted NO_OP operation due to leader change: 20.15
I20260709 12:12:50.463280 21713 raft_consensus.cc:515] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:50.495988 21644 raft_consensus.cc:2749] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: Vote denied by peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187) with higher term. Message: Invalid argument: T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 20. Current term is 21.
I20260709 12:12:50.536610 14187 raft_consensus.cc:2368] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 18. Current term is 19.
I20260709 12:12:50.594324 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:50.728374 14190 raft_consensus.cc:1240] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 18. Current term is 19. Ops: []
W20260709 12:12:50.540923 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 133266us
I20260709 12:12:50.617727 21622 raft_consensus.cc:493] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:50.630717 21217 raft_consensus.cc:515] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:50.537725 21469 raft_consensus.cc:515] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:50.554762 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:50.861591 14332 raft_consensus.cc:2889] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:50.699131 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 23 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:50.538321 21444 raft_consensus.cc:515] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:50.723865 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
W20260709 12:12:50.899755 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 468299us
I20260709 12:12:50.558593 14908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:50.711119 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:50.911305 14903 raft_consensus.cc:2368] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for earlier term 17. Current term is 18.
I20260709 12:12:50.555397 14909 raft_consensus.cc:1240] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 16. Current term is 17. Ops: []
I20260709 12:12:50.720811 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:50.912760 14182 raft_consensus.cc:3060] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:12:50.860906 14304 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.636s	user 0.021s	sys 0.027s
I20260709 12:12:50.620455 14907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:50.759022 14337 raft_consensus.cc:1275] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 16 index: 15. Preceding OpId from leader: term: 17 index: 15. (term mismatch)
W20260709 12:12:50.638005 14305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:50.914155 14304 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.690s	user 0.021s	sys 0.027s
W20260709 12:12:50.914556 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 690101us
I20260709 12:12:50.789433 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:50.915792 14181 raft_consensus.cc:2393] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 20: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:12:50.722126 14184 raft_consensus.cc:1240] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:50.769124 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 26 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:50.917057 14185 raft_consensus.cc:2468] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 25.
I20260709 12:12:50.866237 14335 raft_consensus.cc:2468] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 22.
I20260709 12:12:50.497148 21449 raft_consensus.cc:493] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:50.913991 14337 pending_rounds.cc:85] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c: Aborting all ops after (but not including) 14
I20260709 12:12:50.919478 14337 pending_rounds.cc:107] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c: Aborting uncommitted NO_OP operation due to leader change: 16.15
I20260709 12:12:50.919739 14337 raft_consensus.cc:2889] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:50.558192 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:50.557767 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:50.920971 14905 raft_consensus.cc:3060] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:50.924647 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:50.540028 21393 raft_consensus.cc:493] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:50.925851 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:50.896943 14155 leader_election.cc:304] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:50.933930 14332 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 1478) took 1338 ms. Trace:
I20260709 12:12:50.926296 14256 raft_consensus.cc:1240] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 20. Current term is 21. Ops: []
I20260709 12:12:50.928812 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:12:50.701432 21671 consensus_meta.cc:287] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.793s	user 0.014s	sys 0.000s
W20260709 12:12:50.643831 21708 log.cc:927] Time spent T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.229s	user 0.001s	sys 0.000s
W20260709 12:12:50.633466 21691 consensus_meta.cc:287] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.556s	user 0.013s	sys 0.001s
W20260709 12:12:50.896775 21710 consensus_meta.cc:287] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.615s	user 0.007s	sys 0.005s
I20260709 12:12:50.934288 14332 rpcz_store.cc:276] 0709 12:12:49.595740 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:49.595863 (+   123us) service_pool.cc:224] Handling call
0709 12:12:49.596238 (+   375us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:50.416244 (+820006us) spinlock_profiling.cc:243] Waited 23.7 ms on lock 0x7b54001ebca0. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f21270b2dc0 00007f212713d1c0 00007f212713e231 00007f212713ad8f 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c
0709 12:12:50.933655 (+517411us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:50.933871 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":54467968}
I20260709 12:12:50.941797 14155 leader_election.cc:400] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 election: Vote denied by peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957) with higher term. Message: Invalid argument: T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 19. Current term is 20.
W20260709 12:12:50.554625 21709 log.cc:927] Time spent T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.288s	user 0.001s	sys 0.000s
I20260709 12:12:50.534528 21646 leader_election.cc:290] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 23 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:50.926271 21695 raft_consensus.cc:493] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:50.540714 21641 consensus_queue.cc:1243] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Peer 73d01e9b1a9d49358da4985b21d681db log is divergent from this leader: its last log entry 21.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 12:12:50.940960 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:50.950320 21690 raft_consensus.cc:493] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:50.951304 14877 leader_election.cc:304] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:50.532778 21714 raft_consensus.cc:2749] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:12:50.952898 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:50.954123 14155 leader_election.cc:403] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 12:12:50.946537 21523 raft_consensus.cc:2804] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:50.553990 21687 leader_election.cc:290] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:50.619745 21656 leader_election.cc:290] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:50.762904 21453 raft_consensus.cc:493] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:12:50.991817 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:50.995548 14181 raft_consensus.cc:3060] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:50.956251 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:50.639168 21623 raft_consensus.cc:2749] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:50.962527 14256 raft_consensus.cc:1275] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 12:12:50.958278 14188 raft_consensus.cc:2393] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db in current term 17: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:12:50.622232 21632 consensus_queue.cc:1048] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.333s
I20260709 12:12:50.964273 14263 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95"
dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
mode: GRACEFUL
new_leader_uuid: "65c9c1653b3346b39a0e118540e6080c"
 from {username='slave'} at 127.0.0.1:54238
I20260709 12:12:50.968461 21691 raft_consensus.cc:493] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:50.974170 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:50.541383 21649 consensus_queue.cc:1048] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.411s
I20260709 12:12:50.697794 21450 consensus_queue.cc:1048] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.255s
I20260709 12:12:51.009472 21619 consensus_queue.cc:1048] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 12:12:50.990516 21700 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.017s	sys 0.041s
W20260709 12:12:51.011125 21700 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.590s	user 0.018s	sys 0.041s
I20260709 12:12:51.013909 14181 raft_consensus.cc:2468] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 18.
I20260709 12:12:51.019166 21665 raft_consensus.cc:3055] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:51.019663 21665 raft_consensus.cc:740] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:51.020506 21665 consensus_queue.cc:260] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 18.9, Last appended by leader: 9, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:50.993305 21690 raft_consensus.cc:515] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:51.023978 21690 leader_election.cc:290] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:50.552832 21704 consensus_queue.cc:237] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:12:51.024686 21689 consensus_queue.cc:1175] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "17aab1bbf5014936aa18cc21818b26ec" responder_term: 18 status { last_received { term: 18 index: 9 } last_committed_idx: 8 last_received_current_leader { term: 18 index: 9 } }
I20260709 12:12:50.978426 14185 pending_rounds.cc:85] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf: Aborting all ops after (but not including) 10
I20260709 12:12:51.025858 14185 pending_rounds.cc:107] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf: Aborting uncommitted NO_OP operation due to leader change: 20.11
I20260709 12:12:51.026151 14185 raft_consensus.cc:2889] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:50.979401 14907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:50.874485 21622 raft_consensus.cc:515] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:50.641009 21473 raft_consensus.cc:515] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:50.974011 21718 raft_consensus.cc:493] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:50.947312 21393 raft_consensus.cc:515] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:50.979341 21695 raft_consensus.cc:515] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:50.983322 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:50.989037 14184 raft_consensus.cc:3060] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:12:50.989234 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 55653.6us
I20260709 12:12:50.988447 14908 raft_consensus.cc:2468] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 25.
I20260709 12:12:50.954468 14265 raft_consensus.cc:2468] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 20.
W20260709 12:12:50.952191 21417 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 21 current term: 21 is higher.
W20260709 12:12:50.990572 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:50.999132 14263 raft_consensus.cc:606] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Received request to transfer leadership to TS 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:50.965153 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:51.000643 14904 raft_consensus.cc:1240] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 23 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 22. Current term is 23. Ops: [22.16-22.16]
I20260709 12:12:50.994302 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:51.044620 14155 leader_election.cc:304] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:51.003062 14910 raft_consensus.cc:1240] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 17. Current term is 18. Ops: []
I20260709 12:12:51.045441 14263 raft_consensus.cc:614] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:51.044827 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:51.045413 14264 raft_consensus.cc:3060] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:50.997895 21284 consensus_queue.cc:1048] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.006s
I20260709 12:12:50.993224 21717 raft_consensus.cc:2749] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:51.053179 21644 raft_consensus.cc:493] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:51.053771 21644 raft_consensus.cc:515] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:51.054215 21622 leader_election.cc:290] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:51.055044 14260 raft_consensus.cc:2393] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 21: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:12:51.001520 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:50.978458 21469 leader_election.cc:290] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 18 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:51.006325 21523 raft_consensus.cc:697] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 19 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:12:51.007812 21444 leader_election.cc:290] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:50.562074 21696 raft_consensus.cc:515] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:51.027642 14182 raft_consensus.cc:2468] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 20.
I20260709 12:12:51.067126 14335 raft_consensus.cc:1275] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 12:12:51.039686 21713 leader_election.cc:290] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:50.943303 21449 raft_consensus.cc:515] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:51.029757 14876 leader_election.cc:304] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:50.957441 21710 raft_consensus.cc:515] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:51.047374 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:51.057912 14903 raft_consensus.cc:2468] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 18.
I20260709 12:12:51.063680 14912 raft_consensus.cc:2368] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for earlier term 16. Current term is 17.
I20260709 12:12:51.063939 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
W20260709 12:12:51.043517 21711 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.010s	sys 0.016s
I20260709 12:12:51.074256 14339 raft_consensus.cc:3060] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:51.069649 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:51.058014 21518 raft_consensus.cc:2804] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:12:51.001348 21453 raft_consensus.cc:515] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:51.073539 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:51.051790 21665 raft_consensus.cc:3060] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:51.031924 14189 raft_consensus.cc:3060] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:51.090325 14184 raft_consensus.cc:2468] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 23.
W20260709 12:12:51.060503 21651 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.653s	user 0.025s	sys 0.028s
W20260709 12:12:51.065204 14303 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.778s	user 0.023s	sys 0.002s
W20260709 12:12:51.076911 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 47292us
W20260709 12:12:51.091935 14303 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.804s	user 0.023s	sys 0.002s
I20260709 12:12:51.031388 21691 raft_consensus.cc:515] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:51.083129 21523 consensus_queue.cc:237] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } }
I20260709 12:12:51.084379 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:51.069949 21217 leader_election.cc:290] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 18 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:51.087021 14257 raft_consensus.cc:1240] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 22. Current term is 23. Ops: []
W20260709 12:12:51.075153 21711 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.613s	user 0.010s	sys 0.016s
W20260709 12:12:51.092551 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 842945us
I20260709 12:12:51.070399 21621 raft_consensus.cc:2749] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957) with higher term. Message: Invalid argument: T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 19. Current term is 20.
I20260709 12:12:51.099102 14906 raft_consensus.cc:1275] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:12:51.084522 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:51.139433 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:51.103408 21691 leader_election.cc:290] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:51.104858 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:51.145342 14256 raft_consensus.cc:2468] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 18.
I20260709 12:12:51.058240 21632 consensus_queue.cc:1048] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.028s
I20260709 12:12:51.117352 14336 raft_consensus.cc:1240] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:51.086028 21656 raft_consensus.cc:493] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:51.093602 21651 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.686s	user 0.025s	sys 0.028s
I20260709 12:12:51.137053 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:51.137706 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:51.139936 14260 raft_consensus.cc:3060] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 16 FOLLOWER]: Advancing to term 18
I20260709 12:12:51.139709 14339 raft_consensus.cc:2468] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 17.
I20260709 12:12:51.142525 14189 raft_consensus.cc:1275] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 15. (term mismatch)
I20260709 12:12:51.086350 21713 raft_consensus.cc:2804] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:51.163066 21713 raft_consensus.cc:697] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [term 18 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:12:51.093362 21518 raft_consensus.cc:697] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 22 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:12:51.154688 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:51.157004 14189 pending_rounds.cc:85] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf: Aborting all ops after (but not including) 14
I20260709 12:12:51.170893 14189 pending_rounds.cc:107] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf: Aborting uncommitted NO_OP operation due to leader change: 20.15
I20260709 12:12:51.174064 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:51.174414 14189 raft_consensus.cc:2889] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:51.174790 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:51.175148 14189 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56652 (request call id 1827) took 1033 ms. Trace:
I20260709 12:12:51.172082 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:51.175678 14256 raft_consensus.cc:2410] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for term 20 because replica has last-logged OpId of term: 19 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 10.
I20260709 12:12:51.171752 14190 raft_consensus.cc:1240] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 22. Current term is 23. Ops: []
I20260709 12:12:51.171671 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:51.171172 14339 raft_consensus.cc:1240] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:51.177932 14265 raft_consensus.cc:2468] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 21.
W20260709 12:12:51.181687 14303 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:51.175822 14189 rpcz_store.cc:276] 0709 12:12:50.141606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:50.142577 (+   971us) service_pool.cc:224] Handling call
0709 12:12:50.188284 (+ 45707us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:51.031697 (+843413us) spinlock_profiling.cc:243] Waited 733 ms on lock 0x7b54000d82a0. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f21270b0a1d 00007f21270971a4 00007f2127119447 00007f2127131fe7 00007f21271337de 00007f212713db49 00007f212713e416 00007f212713ad8f 00007f212713a83e 00007f212c0ff419
0709 12:12:51.174900 (+143203us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:51.175087 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1686129024}
I20260709 12:12:51.185891 14907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:51.186269 14906 raft_consensus.cc:1240] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 21 LEADER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 20. Current term is 21. Ops: []
I20260709 12:12:51.187666 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:51.174793 14909 raft_consensus.cc:2468] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 18.
I20260709 12:12:51.189167 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:51.296048 14265 raft_consensus.cc:2468] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 19.
I20260709 12:12:51.297117 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:51.297772 14265 raft_consensus.cc:3060] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:51.189967 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
W20260709 12:12:51.169544 21676 consensus_meta.cc:287] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.732s	user 0.007s	sys 0.004s
I20260709 12:12:51.190874 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:51.300354 14263 raft_consensus.cc:3060] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:51.194235 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:51.187036 21646 consensus_queue.cc:1059] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.014s
I20260709 12:12:51.200186 21518 consensus_queue.cc:237] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:51.201416 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:51.206874 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:51.309128 14190 raft_consensus.cc:2468] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 18.
I20260709 12:12:51.209748 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:51.210657 21671 consensus_queue.cc:1059] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:12:51.206684 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:51.310191 14188 raft_consensus.cc:2393] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db in current term 17: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:12:51.214370 21644 leader_election.cc:290] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:12:51.215998 14302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:51.217803 14905 raft_consensus.cc:2468] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 23.
I20260709 12:12:51.303138 14304 leader_election.cc:304] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:12:51.170013 21656 raft_consensus.cc:515] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:51.213994 21450 consensus_queue.cc:1048] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:12:51.310302 14330 raft_consensus.cc:2368] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 20. Current term is 21.
I20260709 12:12:51.313143 14261 raft_consensus.cc:2393] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 21: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:12:51.313323 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:51.317101 21727 raft_consensus.cc:2804] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:51.317579 21727 raft_consensus.cc:493] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:12:51.317878 21696 leader_election.cc:290] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 23 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:51.323652 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:51.306826 14303 leader_election.cc:304] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
W20260709 12:12:51.378156 14305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:51.364008 14087 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.706s	user 0.010s	sys 0.024s
W20260709 12:12:51.382975 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 76249.7us
W20260709 12:12:51.383406 14087 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.726s	user 0.011s	sys 0.025s
I20260709 12:12:51.385469 14230 leader_election.cc:400] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 election: Vote denied by peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957) with higher term. Message: Invalid argument: T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 20. Current term is 21.
I20260709 12:12:51.385893 14230 leader_election.cc:403] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 election: Cancelling election due to peer responding with higher term
I20260709 12:12:51.365955 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:51.387622 14256 raft_consensus.cc:2468] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 20.
I20260709 12:12:51.312590 21632 raft_consensus.cc:493] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:51.389041 21632 raft_consensus.cc:515] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:51.317988 21727 raft_consensus.cc:3060] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:51.391495 14303 leader_election.cc:400] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 17 pre-election: Vote denied by peer 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341) with higher term. Message: Invalid argument: T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for earlier term 17. Current term is 18.
I20260709 12:12:51.400097 14303 leader_election.cc:403] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:12:51.393941 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:51.392897 14265 raft_consensus.cc:2468] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 20.
I20260709 12:12:51.391692 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:51.406394 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:51.407805 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:51.419214 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:51.422246 21453 leader_election.cc:290] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:51.422957 21453 raft_consensus.cc:493] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:51.423480 21453 raft_consensus.cc:515] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:51.424142 14333 raft_consensus.cc:1275] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 12:12:51.425837 14339 raft_consensus.cc:1240] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:51.207943 21713 consensus_queue.cc:237] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:51.390986 21653 raft_consensus.cc:2749] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:51.397324 21473 leader_election.cc:290] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 17 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:51.439800 14264 raft_consensus.cc:2468] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 24.
W20260709 12:12:51.440127 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 53517.4us
I20260709 12:12:51.404232 21690 raft_consensus.cc:493] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:51.446162 14303 leader_election.cc:304] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:51.450253 14264 raft_consensus.cc:1240] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 20. Current term is 21. Ops: []
I20260709 12:12:51.455675 21453 leader_election.cc:290] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:51.459864 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:51.464869 14303 leader_election.cc:304] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:51.460639 14256 raft_consensus.cc:2468] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 23.
I20260709 12:12:51.469702 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:51.468605 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:51.299919 21676 raft_consensus.cc:515] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:51.437918 21393 leader_election.cc:290] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:51.055222 21718 raft_consensus.cc:515] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:51.477707 14303 leader_election.cc:304] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:51.500327 14303 leader_election.cc:304] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:12:51.495606 14256 raft_consensus.cc:1240] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 22. Current term is 23. Ops: []
I20260709 12:12:51.512286 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:51.473376 21622 raft_consensus.cc:2749] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:12:51.517218 14303 leader_election.cc:304] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:51.471339 21725 raft_consensus.cc:2749] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:12:51.533119 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:51.540551 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:51.546574 14303 leader_election.cc:304] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:12:51.496109 21444 raft_consensus.cc:493] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:51.511720 21623 raft_consensus.cc:2749] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:51.520409 21730 raft_consensus.cc:2804] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:12:51.569422 21756 raft_consensus.cc:493] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:51.572682 21756 raft_consensus.cc:515] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:12:51.575182 14154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:51.529798 21632 leader_election.cc:290] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:51.567416 14256 raft_consensus.cc:1275] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 25 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 24 index: 12. Preceding OpId from leader: term: 25 index: 12. (term mismatch)
I20260709 12:12:51.471064 21690 raft_consensus.cc:515] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:51.576818 14256 pending_rounds.cc:85] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec: Aborting all ops after (but not including) 11
I20260709 12:12:51.594192 14256 pending_rounds.cc:107] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec: Aborting uncommitted NO_OP operation due to leader change: 24.12
I20260709 12:12:51.594599 14256 raft_consensus.cc:2889] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 25 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:51.595748 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:51.602336 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:51.615294 14256 raft_consensus.cc:3060] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:51.542546 21729 consensus_queue.cc:1048] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.061s
I20260709 12:12:51.612772 14332 raft_consensus.cc:1275] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 12:12:51.567552 21449 leader_election.cc:290] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:51.624696 14260 raft_consensus.cc:2468] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 18.
W20260709 12:12:51.620234 21704 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.006s	sys 0.015s
W20260709 12:12:51.629072 21704 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.545s	user 0.006s	sys 0.016s
I20260709 12:12:51.629719 21704 raft_consensus.cc:493] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:51.630290 21704 raft_consensus.cc:515] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:12:51.630803 14185 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.000s	sys 0.016s
W20260709 12:12:51.631289 14185 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.576s	user 0.000s	sys 0.016s
I20260709 12:12:51.632494 21651 raft_consensus.cc:493] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:51.632759 21704 leader_election.cc:290] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:51.633256 21651 raft_consensus.cc:515] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:51.635871 21651 leader_election.cc:290] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:51.602587 21689 raft_consensus.cc:2804] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:51.599300 21730 raft_consensus.cc:697] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 25 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:51.633536 21704 consensus_queue.cc:1059] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:12:51.565879 21444 raft_consensus.cc:515] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:12:51.654189 14155 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.606s	user 0.013s	sys 0.008s
I20260709 12:12:51.656059 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:51.621634 21656 leader_election.cc:290] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:12:51.662947 14331 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.020s	sys 0.085s
I20260709 12:12:51.664799 14263 raft_consensus.cc:2468] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 21.
I20260709 12:12:51.649727 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:51.667178 14261 raft_consensus.cc:2468] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 20.
W20260709 12:12:51.670415 14331 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.574s	user 0.021s	sys 0.085s
W20260709 12:12:51.667565 14155 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.619s	user 0.013s	sys 0.008s
W20260709 12:12:51.670934 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 622645us
I20260709 12:12:51.669859 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:51.674011 14260 raft_consensus.cc:2376] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 24. Re-sending same reply.
I20260709 12:12:51.674011 14263 raft_consensus.cc:2376] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 21. Re-sending same reply.
I20260709 12:12:51.683106 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:51.685001 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:51.720091 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:51.731194 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:51.676411 21453 raft_consensus.cc:2749] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader election lost for term 20. Reason: Vote denied by peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957) with higher term. Message: Invalid argument: T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 20. Current term is 21.
I20260709 12:12:51.729202 21651 raft_consensus.cc:3055] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:51.753158 21695 leader_election.cc:290] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:51.676195 21393 raft_consensus.cc:493] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:51.678485 21691 raft_consensus.cc:3060] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:51.785759 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:51.678784 21689 raft_consensus.cc:697] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 20 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:51.732822 21712 raft_consensus.cc:493] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:51.717484 21622 raft_consensus.cc:2749] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:51.679220 21641 raft_consensus.cc:493] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:51.866104 21641 raft_consensus.cc:515] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:51.866180 21730 consensus_queue.cc:237] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.15, Last appended by leader: 15, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:51.868702 21641 leader_election.cc:290] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:12:51.870191 21740 log.cc:927] Time spent T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.315s	user 0.000s	sys 0.001s
I20260709 12:12:51.879189 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:51.880116 14336 raft_consensus.cc:2393] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db in current term 17: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:12:51.882194 14903 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53200 (request call id 966) took 1166 ms. Trace:
I20260709 12:12:51.882601 14903 rpcz_store.cc:276] 0709 12:12:50.716294 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:50.955735 (+239441us) service_pool.cc:224] Handling call
0709 12:12:51.881996 (+926261us) spinlock_profiling.cc:243] Waited 15.9 ms on lock 0x7b5400692dd4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:12:51.882128 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":36525952}
I20260709 12:12:51.883832 21711 raft_consensus.cc:493] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:51.884406 21711 raft_consensus.cc:515] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:12:51.892048 21748 log.cc:927] Time spent T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.138s	user 0.001s	sys 0.000s
I20260709 12:12:51.892339 14257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41764 (request call id 3729) took 1809 ms. Trace:
I20260709 12:12:51.892727 14257 rpcz_store.cc:276] 0709 12:12:50.083218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:50.104854 (+ 21636us) service_pool.cc:224] Handling call
0709 12:12:50.105226 (+   372us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:51.107476 (+1002250us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:51.892088 (+784612us) spinlock_profiling.cc:243] Waited 981 ms on lock 0x7b5400210a54. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:12:51.892274 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2257407744}
I20260709 12:12:51.861761 21444 leader_election.cc:290] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:51.863087 21712 raft_consensus.cc:515] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:51.864575 21689 consensus_queue.cc:237] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:51.757058 21651 raft_consensus.cc:740] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
W20260709 12:12:51.937728 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 395295us
I20260709 12:12:51.794377 21632 raft_consensus.cc:493] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:51.896118 21676 leader_election.cc:290] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 24 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:51.795903 21393 raft_consensus.cc:515] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:51.955674 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:12:51.961875 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 351631us
I20260709 12:12:51.962735 14303 leader_election.cc:304] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:51.965318 14262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53050 (request call id 1500) took 1028 ms. Trace:
I20260709 12:12:51.965834 14262 rpcz_store.cc:276] 0709 12:12:50.936992 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:50.940701 (+  3709us) service_pool.cc:224] Handling call
0709 12:12:50.961238 (+ 20537us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:50.961458 (+   220us) raft_consensus.cc:1534] Early marking committed up to index 17
0709 12:12:51.396910 (+435452us) log.cc:844] Serialized 14 byte log entry
0709 12:12:51.964937 (+568027us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:51.964998 (+    61us) raft_consensus.cc:1645] Marking committed up to 17
0709 12:12:51.965050 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:51.965121 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:51.965248 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2593,"prepare.queue_time_us":495382,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":43,"raft.queue_time_us":94000,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":4681,"thread_start_us":973795,"threads_started":3,"wal-append.queue_time_us":173090}
I20260709 12:12:51.935801 21756 leader_election.cc:290] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:51.946079 21718 leader_election.cc:290] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:51.984181 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:51.989709 14257 raft_consensus.cc:1275] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 12:12:51.954463 21632 raft_consensus.cc:515] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:51.996943 14906 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb"
dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
mode: GRACEFUL
new_leader_uuid: "65c9c1653b3346b39a0e118540e6080c"
 from {username='slave'} at 127.0.0.1:38628
I20260709 12:12:51.997670 14906 raft_consensus.cc:606] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 23 FOLLOWER]: Received request to transfer leadership to TS 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:51.998085 14906 raft_consensus.cc:614] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 23 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:51.960336 21690 leader_election.cc:290] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:52.004004 21651 consensus_queue.cc:260] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:52.007536 21393 leader_election.cc:290] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:52.010344 21711 leader_election.cc:290] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:52.017938 14256 raft_consensus.cc:2468] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 22.
I20260709 12:12:51.972158 21695 raft_consensus.cc:2749] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:52.020249 14265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41764 (request call id 3730) took 1079 ms. Trace:
I20260709 12:12:51.997499 21632 leader_election.cc:290] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:52.022301 14265 rpcz_store.cc:276] 0709 12:12:50.941031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:51.419344 (+478313us) service_pool.cc:224] Handling call
0709 12:12:51.419672 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:51.419904 (+   232us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:12:51.669464 (+249560us) log.cc:844] Serialized 14 byte log entry
0709 12:12:52.019850 (+350386us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:52.019912 (+    62us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:12:52.019971 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:52.020040 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:52.020179 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":55126,"prepare.queue_time_us":37535,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":29,"thread_start_us":509444,"threads_started":2,"wal-append.queue_time_us":352667}
I20260709 12:12:52.034830 14912 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53194 (request call id 1244) took 1558 ms. Trace:
I20260709 12:12:52.035449 14912 rpcz_store.cc:276] 0709 12:12:50.469584 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:50.469840 (+   256us) service_pool.cc:224] Handling call
0709 12:12:52.027731 (+1557891us) spinlock_profiling.cc:243] Waited 585 ms on lock 0x7b54007760d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:12:52.027894 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1344541952}
I20260709 12:12:52.048944 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:52.050449 14155 leader_election.cc:304] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:52.054566 14303 leader_election.cc:304] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:12:52.055938 14303 leader_election.cc:304] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:52.034101 21753 raft_consensus.cc:493] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:52.058179 21393 raft_consensus.cc:2804] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:52.051621 21632 consensus_queue.cc:1048] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.013s
I20260709 12:12:52.057991 21773 raft_consensus.cc:2804] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:52.110903 14303 leader_election.cc:304] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:12:52.101308 14229 leader_election.cc:304] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:52.106705 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:52.123039 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:52.123917 14912 raft_consensus.cc:2468] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 19.
I20260709 12:12:52.132421 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:52.133443 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:52.134066 14335 raft_consensus.cc:3060] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:52.134416 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:52.141103 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:52.115041 21756 raft_consensus.cc:493] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:52.140175 21755 raft_consensus.cc:2749] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:12:52.142956 21756 raft_consensus.cc:515] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:12:52.143821 21775 log.cc:927] Time spent T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260709 12:12:52.145303 21756 leader_election.cc:290] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:52.105873 21695 raft_consensus.cc:2749] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:12:52.154402 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:52.058305 21753 raft_consensus.cc:515] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:52.116760 21773 raft_consensus.cc:493] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:12:52.128233 21393 raft_consensus.cc:697] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 17 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:12:52.163061 21755 consensus_queue.cc:1059] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:52.164067 21755 raft_consensus.cc:3055] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:52.163095 14335 raft_consensus.cc:2468] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 24.
I20260709 12:12:52.164604 21755 raft_consensus.cc:740] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:52.167635 21712 leader_election.cc:290] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:12:52.169760 21749 log.cc:927] Time spent T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.234s	user 0.000s	sys 0.000s
W20260709 12:12:52.171286 21751 log.cc:927] Time spent T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.191s	user 0.000s	sys 0.000s
I20260709 12:12:52.167249 21755 consensus_queue.cc:260] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:52.178589 21755 raft_consensus.cc:3060] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:52.174045 14185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56046 (request call id 3174) took 1368 ms. Trace:
I20260709 12:12:52.173579 14260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53050 (request call id 1508) took 1138 ms. Trace:
I20260709 12:12:52.161100 21710 leader_election.cc:290] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:52.175973 14330 raft_consensus.cc:1275] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
W20260709 12:12:52.171999 21665 consensus_meta.cc:287] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 1.074s	user 0.013s	sys 0.000s
W20260709 12:12:52.184463 14154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:52.183024 14260 rpcz_store.cc:276] 0709 12:12:51.035216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:51.674863 (+639647us) service_pool.cc:224] Handling call
0709 12:12:51.683928 (+  9065us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:51.721417 (+ 37489us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:51.721449 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:51.733382 (+ 11933us) log.cc:844] Serialized 26 byte log entry
0709 12:12:52.054037 (+320655us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:12:52.054081 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:52.054153 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:52.173351 (+119198us) raft_consensus.cc:1685] finished
0709 12:12:52.173372 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:52.173516 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37047,"raft.queue_time_us":48274,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":3282,"thread_start_us":291916,"threads_started":1,"wal-append.queue_time_us":378681}
I20260709 12:12:52.185894 21644 raft_consensus.cc:3055] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:52.186336 21644 raft_consensus.cc:740] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:52.186470 21756 consensus_queue.cc:1048] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:12:52.187314 21644 consensus_queue.cc:260] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:52.188024 21756 consensus_queue.cc:1059] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:12:52.188405 21644 raft_consensus.cc:3060] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:52.188935 21756 raft_consensus.cc:3055] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:12:52.176194 21622 raft_consensus.cc:493] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:52.189973 21622 raft_consensus.cc:515] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:52.188871 14229 leader_election.cc:304] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:52.189311 21756 raft_consensus.cc:740] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:52.195077 21756 consensus_queue.cc:260] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:52.196393 21756 raft_consensus.cc:3060] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:52.186183 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:52.192126 21622 leader_election.cc:290] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:52.192637 14259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53050 (request call id 1497) took 1256 ms. Trace:
I20260709 12:12:52.199319 14259 rpcz_store.cc:276] 0709 12:12:50.936034 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:50.936170 (+   136us) service_pool.cc:224] Handling call
0709 12:12:50.962269 (+ 26099us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:51.535019 (+572750us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:51.535057 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:51.542583 (+  7526us) log.cc:844] Serialized 26 byte log entry
0709 12:12:51.916940 (+374357us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:51.916991 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:52.173483 (+256492us) spinlock_profiling.cc:243] Waited 572 ms on lock 0x7b54004088d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:12:52.173536 (+    53us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:52.173588 (+    52us) raft_consensus.cc:1685] finished
0709 12:12:52.173602 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:52.192556 (+ 18954us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":98325,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":93,"spinlock_wait_cycles":1316200832,"thread_start_us":367321,"threads_started":1,"wal-append.queue_time_us":507210}
I20260709 12:12:52.202497 14190 raft_consensus.cc:1275] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 12:12:52.127663 21711 consensus_queue.cc:1059] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 22.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.032s
I20260709 12:12:52.211253 14229 leader_election.cc:304] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:52.216553 21783 raft_consensus.cc:2804] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:52.217054 21783 raft_consensus.cc:493] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:52.217453 21622 consensus_queue.cc:1059] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 20.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 12:12:52.218426 21782 log.cc:927] Time spent T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.076s	user 0.003s	sys 0.000s
I20260709 12:12:52.218582 21622 raft_consensus.cc:3055] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:12:52.218995 21622 raft_consensus.cc:740] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:52.219935 21622 consensus_queue.cc:260] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 10, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:52.220489 14332 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 1492) took 1055 ms. Trace:
I20260709 12:12:52.220902 14332 rpcz_store.cc:276] 0709 12:12:51.165231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:51.523209 (+357978us) service_pool.cc:224] Handling call
0709 12:12:51.523476 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:51.623768 (+100292us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:52.220214 (+596446us) spinlock_profiling.cc:243] Waited 88.9 ms on lock 0x7b540010dbd4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:12:52.220418 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":204453760}
I20260709 12:12:52.217468 21783 raft_consensus.cc:3060] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:52.225028 21704 raft_consensus.cc:2749] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:12:52.226316 21752 log.cc:927] Time spent T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.283s	user 0.000s	sys 0.001s
I20260709 12:12:52.226491 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:52.227219 14334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50856 (request call id 3126) took 1162 ms. Trace:
I20260709 12:12:52.227461 14331 raft_consensus.cc:2410] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db for term 20 because replica has last-logged OpId of term: 18 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 13.
I20260709 12:12:52.231233 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:52.231910 14190 raft_consensus.cc:3060] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:52.181938 14185 rpcz_store.cc:276] 0709 12:12:50.803938 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:50.977758 (+173820us) service_pool.cc:224] Handling call
0709 12:12:50.978205 (+   447us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:51.026698 (+ 48493us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:51.026736 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:51.027182 (+   446us) log.cc:844] Serialized 26 byte log entry
0709 12:12:51.631733 (+604551us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:12:51.631778 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:51.631849 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:52.172235 (+540386us) raft_consensus.cc:1685] finished
0709 12:12:52.172263 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:52.172486 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":576767,"threads_started":1,"wal-append.queue_time_us":708488}
I20260709 12:12:52.234146 14181 raft_consensus.cc:1275] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 25 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 22 index: 10. Preceding OpId from leader: term: 25 index: 12. (index mismatch)
I20260709 12:12:52.235598 21691 raft_consensus.cc:2749] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341) with higher term. Message: Invalid argument: T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for earlier term 17. Current term is 18.
I20260709 12:12:52.236620 14183 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 3647) took 1098 ms. Trace:
I20260709 12:12:52.237296 14229 leader_election.cc:400] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 pre-election: Vote denied by peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187) with higher term. Message: Invalid argument: T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 18. Current term is 19.
I20260709 12:12:52.237910 14229 leader_election.cc:403] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:12:52.159740 21773 raft_consensus.cc:3060] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:52.227627 14334 rpcz_store.cc:276] 0709 12:12:51.065116 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:51.441991 (+376875us) service_pool.cc:224] Handling call
0709 12:12:51.468584 (+ 26593us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:51.555996 (+ 87412us) raft_consensus.cc:1534] Early marking committed up to index 16
0709 12:12:51.594047 (+ 38051us) log.cc:844] Serialized 14 byte log entry
0709 12:12:51.981389 (+387342us) log.cc:844] Serialized 14 byte log entry
0709 12:12:51.981666 (+   277us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:51.981714 (+    48us) raft_consensus.cc:1645] Marking committed up to 16
0709 12:12:51.981786 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:52.191325 (+209539us) spinlock_profiling.cc:243] Waited 20.9 ms on lock 0x7b1800376900. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f212cf16ab1 00007f212cf23281 00007f212401c2a6 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f212c064aa1 00007f212c05bb37 00007f212c05b9ca 00007f212c15326f
0709 12:12:52.192750 (+  1425us) spinlock_profiling.cc:243] Waited 4.5 ms on lock 0x7b4800100bd8. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f212c064aa1 00007f212c05bb37 00007f212c05b9ca 00007f212c15326f 00007f212c152f37 00007f212c16755c 00007f212c167508 00007f212c167488 00007f212c167443 00007f212c1666ec 00007f212b090a96
0709 12:12:52.202061 (+  9311us) spinlock_profiling.cc:243] Waited 39.5 ms on lock 0x7b1800376900. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f212cf16ab1 00007f212cf23281 00007f212401c2a6 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419
0709 12:12:52.226965 (+ 24904us) spinlock_profiling.cc:243] Waited 87.1 ms on lock 0x7b54000b8e54. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:12:52.227016 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:52.227158 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5134,"prepare.queue_time_us":40916,"prepare.run_cpu_time_us":99,"prepare.run_wall_time_us":92,"raft.queue_time_us":5989,"raft.run_cpu_time_us":3744,"raft.run_wall_time_us":216718,"spinlock_wait_cycles":349553536,"thread_start_us":370129,"threads_started":1,"wal-append.queue_time_us":467481}
I20260709 12:12:52.242419 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
W20260709 12:12:52.243146 21771 log.cc:927] Time spent T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 12:12:52.246356 21753 leader_election.cc:290] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:12:52.248096 14155 leader_election.cc:336] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Timed out: RequestConsensusVote RPC to 127.12.174.130:36673 timed out after 1.669s (SENT)
I20260709 12:12:52.248624 14155 leader_election.cc:304] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:52.249394 14258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53050 (request call id 1509) took 1033 ms. Trace:
I20260709 12:12:52.250133 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:52.249799 14258 rpcz_store.cc:276] 0709 12:12:51.215869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:51.872291 (+656422us) service_pool.cc:224] Handling call
0709 12:12:51.872689 (+   398us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:51.956576 (+ 83887us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:51.956614 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:51.981012 (+ 24398us) log.cc:844] Serialized 26 byte log entry
0709 12:12:52.098148 (+117136us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:12:52.098211 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:52.098317 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:52.249167 (+150850us) raft_consensus.cc:1685] finished
0709 12:12:52.249189 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:52.249333 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":103046,"raft.queue_time_us":81149,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":9724,"thread_start_us":70457,"threads_started":1,"wal-append.queue_time_us":224384}
I20260709 12:12:52.253258 21704 raft_consensus.cc:3060] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:52.182389 21696 raft_consensus.cc:3055] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:52.253265 21393 consensus_queue.cc:237] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:52.215044 21653 raft_consensus.cc:2804] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:52.263760 21653 raft_consensus.cc:493] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:52.264189 21653 raft_consensus.cc:3060] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:12:52.260782 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:52.262986 21632 raft_consensus.cc:2749] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:52.262923 14229 leader_election.cc:304] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:52.237032 14183 rpcz_store.cc:276] 0709 12:12:51.138304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:51.138467 (+   163us) service_pool.cc:224] Handling call
0709 12:12:51.154450 (+ 15983us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:51.170596 (+ 16146us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:51.170631 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:51.171135 (+   504us) log.cc:844] Serialized 26 byte log entry
0709 12:12:51.632132 (+460997us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:12:51.632177 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:51.632246 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:52.225585 (+593339us) spinlock_profiling.cc:243] Waited 9.5 ms on lock 0x7b4400022b4c. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2123f74c85 00007f2123f756a2 00007f2126ce71db 00007f2126ce2aaf 00007f2126cd686e 00007f2126cd5bb6 00007f2126cd57d8 00007f2126cdf221 00007f2126cdf1d9 00007f2126cdf169
0709 12:12:52.228746 (+  3161us) raft_consensus.cc:1685] finished
0709 12:12:52.228769 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:52.236547 (+  7778us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":19096,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":125,"spinlock_wait_cycles":21857152,"thread_start_us":416262,"threads_started":1,"wal-append.queue_time_us":557877}
I20260709 12:12:52.269567 14229 leader_election.cc:304] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:52.270924 14229 leader_election.cc:304] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:52.271700 21764 raft_consensus.cc:2749] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:52.272176 14229 leader_election.cc:304] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:52.273592 14229 leader_election.cc:304] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
W20260709 12:12:52.257208 14155 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.174.130:36673 timed out after 2.018s (SENT) [suppressed 21 similar messages]
I20260709 12:12:52.277455 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:12:52.278859 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 63025.8us
I20260709 12:12:52.267517 21651 raft_consensus.cc:3060] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:52.221451 21622 raft_consensus.cc:3060] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:52.282105 14229 leader_election.cc:304] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:52.334354 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:52.337365 20979 raft_consensus.cc:2749] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:12:52.337549 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 55545.5us
I20260709 12:12:52.339347 14229 leader_election.cc:304] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:52.340178 20979 raft_consensus.cc:2804] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:12:52.340692 20979 raft_consensus.cc:697] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 23 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:52.341534 20979 consensus_queue.cc:237] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:52.343838 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:52.344045 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:52.344507 14262 raft_consensus.cc:3060] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:52.345548 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:52.346916 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:52.347312 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:52.347882 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:52.348187 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:52.348699 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:52.348934 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:52.349953 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:52.350221 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:52.350788 14257 raft_consensus.cc:2376] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 22. Re-sending same reply.
I20260709 12:12:52.351094 14263 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d"
dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
mode: GRACEFUL
new_leader_uuid: "885067a0d31741bfb5c9935788e315bf"
 from {username='slave'} at 127.0.0.1:54238
I20260709 12:12:52.351684 14263 raft_consensus.cc:606] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Received request to transfer leadership to TS 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:52.352002 14263 raft_consensus.cc:614] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:52.283906 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:52.350040 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:12:52.260607 21727 consensus_meta.cc:287] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.846s	user 0.008s	sys 0.006s
I20260709 12:12:52.355909 14912 raft_consensus.cc:1275] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
W20260709 12:12:52.357129 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 70746.2us
I20260709 12:12:52.358835 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:52.367113 14909 raft_consensus.cc:1813] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Handling vote request from an unknown peer 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:52.367624 14909 raft_consensus.cc:2393] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 18: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
I20260709 12:12:52.358300 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:52.279686 21769 raft_consensus.cc:2749] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:52.272496 21764 consensus_queue.cc:1059] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.082s
I20260709 12:12:52.370344 14910 raft_consensus.cc:2393] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 25: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:12:52.332782 21646 raft_consensus.cc:2804] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:12:52.377434 21646 raft_consensus.cc:493] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:52.377856 21646 raft_consensus.cc:3060] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:12:52.370580 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:52.332978 21774 raft_consensus.cc:3055] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:12:52.333088 21453 raft_consensus.cc:2749] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:12:52.371093 14877 leader_election.cc:304] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:52.371831 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:52.386086 14260 raft_consensus.cc:2468] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 20.
I20260709 12:12:52.260906 21696 raft_consensus.cc:740] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:52.373463 14911 raft_consensus.cc:1240] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 23 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 22. Current term is 23. Ops: []
I20260709 12:12:52.391130 14258 raft_consensus.cc:2393] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 21: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:12:52.391690 21453 consensus_queue.cc:1059] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:12:52.392580 21453 raft_consensus.cc:3055] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:12:52.392907 21453 raft_consensus.cc:740] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:52.393834 21453 consensus_queue.cc:260] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:52.395074 21453 raft_consensus.cc:3060] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:52.386534 21727 raft_consensus.cc:515] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:52.402943 14333 raft_consensus.cc:1240] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:52.375031 14262 raft_consensus.cc:2468] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 24.
I20260709 12:12:52.375248 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:52.336058 21753 raft_consensus.cc:2749] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:12:52.382688 21774 raft_consensus.cc:740] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:52.387866 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:52.404287 14183 raft_consensus.cc:2468] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 23.
I20260709 12:12:52.407088 14259 raft_consensus.cc:2376] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 20. Re-sending same reply.
W20260709 12:12:52.418183 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 47178.2us
I20260709 12:12:52.420838 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:12:52.419433 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 169677us
I20260709 12:12:52.421655 14183 raft_consensus.cc:2468] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 24.
I20260709 12:12:52.420082 21646 raft_consensus.cc:515] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:52.426205 21725 consensus_queue.cc:1059] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 22.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:12:52.428526 14877 leader_election.cc:304] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:52.383958 21718 consensus_queue.cc:1048] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.036s
I20260709 12:12:52.435021 14256 raft_consensus.cc:1275] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 12:12:52.435662 14155 leader_election.cc:304] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:52.437666 14155 leader_election.cc:304] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
W20260709 12:12:52.438248 14230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:52.439579 14155 leader_election.cc:304] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:52.442853 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:52.443588 14183 raft_consensus.cc:2468] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 24.
I20260709 12:12:52.397181 21783 raft_consensus.cc:515] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:52.445904 14155 leader_election.cc:304] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:52.422642 21717 raft_consensus.cc:2749] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:52.445663 14877 leader_election.cc:304] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:52.427109 21646 leader_election.cc:290] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 26 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:52.449849 14155 leader_election.cc:304] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:52.453840 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:52.454468 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:52.461040 14335 raft_consensus.cc:1275] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 14. (term mismatch)
I20260709 12:12:52.473800 14335 pending_rounds.cc:85] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c: Aborting all ops after (but not including) 13
W20260709 12:12:52.447736 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 114458us
I20260709 12:12:52.474778 14303 leader_election.cc:304] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:12:52.442101 21523 raft_consensus.cc:2749] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:12:52.476805 14332 raft_consensus.cc:1240] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:52.477164 14335 pending_rounds.cc:107] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c: Aborting uncommitted NO_OP operation due to leader change: 18.14
I20260709 12:12:52.480916 14335 raft_consensus.cc:2889] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:52.444325 21518 raft_consensus.cc:2804] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:52.482566 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:52.482784 14337 raft_consensus.cc:1275] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:12:52.448717 21674 raft_consensus.cc:2749] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:12:52.479065 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:52.479236 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:52.479863 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:52.487087 14333 raft_consensus.cc:1240] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:52.482813 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:52.481909 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:52.483608 14185 raft_consensus.cc:2468] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 20.
I20260709 12:12:52.480038 14303 leader_election.cc:304] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:52.478272 14877 leader_election.cc:304] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:52.473627 21644 consensus_queue.cc:1048] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.015s
I20260709 12:12:52.450217 21676 raft_consensus.cc:2749] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:12:52.471204 21695 raft_consensus.cc:493] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:52.509194 14185 raft_consensus.cc:1275] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:12:52.509107 21695 raft_consensus.cc:515] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:52.511359 21695 leader_election.cc:290] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:52.485949 21730 raft_consensus.cc:2804] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:52.512046 21730 raft_consensus.cc:493] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:52.448032 21690 consensus_queue.cc:1059] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 22.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.047s
I20260709 12:12:52.476936 21506 raft_consensus.cc:2749] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:12:52.488095 21518 raft_consensus.cc:493] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:52.478856 21689 raft_consensus.cc:493] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:52.513849 21689 raft_consensus.cc:515] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:52.513662 14190 raft_consensus.cc:2468] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 19.
I20260709 12:12:52.515106 21621 raft_consensus.cc:2749] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:52.516305 21689 leader_election.cc:290] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:52.482271 21714 consensus_queue.cc:1048] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.017s
I20260709 12:12:52.450351 21696 consensus_queue.cc:260] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } }
I20260709 12:12:52.518394 21696 raft_consensus.cc:3060] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:52.503968 21523 raft_consensus.cc:2749] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:52.506456 14339 raft_consensus.cc:1240] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 22. Current term is 23. Ops: []
W20260709 12:12:52.506759 14228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:52.523192 21791 raft_consensus.cc:2749] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:52.524067 14303 leader_election.cc:304] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
W20260709 12:12:52.524668 14228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:52.525342 21725 raft_consensus.cc:2804] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:52.525815 21725 raft_consensus.cc:493] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:52.512457 21730 raft_consensus.cc:3060] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:52.526211 21725 raft_consensus.cc:3060] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:52.508256 21783 leader_election.cc:290] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:52.446843 21790 consensus_queue.cc:1048] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.039s
I20260709 12:12:52.489563 21646 raft_consensus.cc:493] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:52.563874 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:52.564673 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:52.567049 14257 raft_consensus.cc:2468] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 21.
I20260709 12:12:52.572536 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:52.572928 14260 raft_consensus.cc:1275] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 12:12:52.479729 21774 consensus_queue.cc:260] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:52.573427 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 26 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:52.575002 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:52.513015 21518 raft_consensus.cc:3060] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:52.587483 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:52.587194 21674 consensus_queue.cc:1048] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.005s
I20260709 12:12:52.588253 14190 raft_consensus.cc:2468] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 20.
I20260709 12:12:52.594002 14154 leader_election.cc:304] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:52.589570 14229 leader_election.cc:304] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:52.568066 21671 raft_consensus.cc:493] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:52.590325 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:52.603169 14229 leader_election.cc:304] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:52.603183 14303 leader_election.cc:304] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:52.606559 14911 raft_consensus.cc:2368] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for earlier term 16. Current term is 17.
I20260709 12:12:52.604530 14185 raft_consensus.cc:1275] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 12:12:52.630167 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:52.631997 14303 leader_election.cc:304] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:52.632377 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:52.633229 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:52.639138 14304 leader_election.cc:304] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:52.641296 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:52.642004 14183 raft_consensus.cc:2468] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 20.
I20260709 12:12:52.583310 21695 raft_consensus.cc:3055] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:12:52.646590 21695 raft_consensus.cc:740] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:52.647450 21695 consensus_queue.cc:260] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:52.575232 21646 raft_consensus.cc:515] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:52.649809 21790 raft_consensus.cc:2749] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:12:52.650513 21790 raft_consensus.cc:2804] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:52.650974 21790 raft_consensus.cc:697] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 19 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:52.651325 21718 consensus_queue.cc:1048] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:12:52.651873 21790 consensus_queue.cc:237] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:52.651158 20979 consensus_queue.cc:1048] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.003s
I20260709 12:12:52.631027 14229 leader_election.cc:304] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:52.657100 14229 leader_election.cc:304] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:52.658881 14303 leader_election.cc:400] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 election: Vote denied by peer 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341) with higher term. Message: Invalid argument: T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for earlier term 16. Current term is 17.
I20260709 12:12:52.659224 14303 leader_election.cc:403] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 12:12:52.659979 20979 raft_consensus.cc:2804] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:12:52.660372 20979 raft_consensus.cc:493] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:52.660835 20979 raft_consensus.cc:3060] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Advancing to term 25
W20260709 12:12:52.661106 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 211350us
I20260709 12:12:52.632911 14906 raft_consensus.cc:2376] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 23 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 23. Re-sending same reply.
I20260709 12:12:52.662410 14155 leader_election.cc:304] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:52.660316 14229 leader_election.cc:304] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:52.665139 14229 leader_election.cc:304] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:52.667547 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
W20260709 12:12:52.693634 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 54578us
I20260709 12:12:52.612071 21764 raft_consensus.cc:2749] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:52.694244 14155 leader_election.cc:304] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:52.613129 21523 raft_consensus.cc:2749] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:52.691717 14230 leader_election.cc:304] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:52.512466 21727 leader_election.cc:290] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 20 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:52.706229 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:52.699994 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:52.700155 14229 leader_election.cc:304] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:52.700315 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:52.634037 21769 raft_consensus.cc:2749] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:12:52.701882 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:52.710790 14259 raft_consensus.cc:1275] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 12:12:52.665014 21756 raft_consensus.cc:2804] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:12:52.706923 14258 raft_consensus.cc:2468] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 20.
I20260709 12:12:52.708570 14261 raft_consensus.cc:3060] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:12:52.709012 14183 raft_consensus.cc:1275] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 12:12:52.651140 21646 leader_election.cc:290] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:52.712678 14304 leader_election.cc:304] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:52.607071 21710 consensus_queue.cc:1048] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.091s
I20260709 12:12:52.617146 21690 consensus_queue.cc:1048] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.085s
I20260709 12:12:52.692765 21644 raft_consensus.cc:2804] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:12:52.715516 14155 leader_election.cc:304] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:52.680419 21729 raft_consensus.cc:2749] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:52.696619 21753 raft_consensus.cc:2804] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:52.696461 21691 raft_consensus.cc:2749] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341) with higher term. Message: Invalid argument: T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for earlier term 16. Current term is 17.
I20260709 12:12:52.696830 21712 raft_consensus.cc:2749] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:12:52.702503 21417 raft_consensus.cc:2804] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:12:52.725924 14155 leader_election.cc:304] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:52.731036 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:52.726436 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:52.727883 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:52.631955 21671 raft_consensus.cc:515] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:52.722363 20979 raft_consensus.cc:515] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:52.728968 14304 leader_election.cc:304] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:12:52.738893 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 26 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:52.759639 14190 raft_consensus.cc:3060] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 25 FOLLOWER]: Advancing to term 26
W20260709 12:12:52.765820 21704 consensus_meta.cc:287] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.511s	user 0.000s	sys 0.015s
I20260709 12:12:52.766333 21704 raft_consensus.cc:2749] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187) with higher term. Message: Invalid argument: T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 18. Current term is 19.
W20260709 12:12:52.769685 21653 consensus_meta.cc:287] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.505s	user 0.007s	sys 0.012s
I20260709 12:12:52.770030 21417 raft_consensus.cc:493] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:52.706094 21755 consensus_queue.cc:1048] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.048s
I20260709 12:12:52.770511 21417 raft_consensus.cc:3060] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:52.770375 21622 raft_consensus.cc:2804] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:52.771152 21622 raft_consensus.cc:493] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:52.771486 21622 raft_consensus.cc:3060] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:52.715037 21756 raft_consensus.cc:493] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:52.766597 14258 raft_consensus.cc:1240] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 26 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 25. Current term is 26. Ops: [25.12-25.12]
I20260709 12:12:52.758605 14183 raft_consensus.cc:2468] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 20.
I20260709 12:12:52.770182 21653 raft_consensus.cc:515] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:12:52.774202 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 48478.2us
I20260709 12:12:52.785342 14155 leader_election.cc:304] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:52.789927 21632 raft_consensus.cc:2749] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:12:52.774597 20979 leader_election.cc:290] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 25 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:52.792734 21804 consensus_queue.cc:1048] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:52.789623 14155 leader_election.cc:304] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:52.796561 21804 raft_consensus.cc:2749] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:52.798394 14155 leader_election.cc:304] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:52.799701 21804 raft_consensus.cc:2749] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:12:52.801496 14155 leader_election.cc:304] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:52.802800 21804 raft_consensus.cc:2749] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:52.803181 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:52.715035 21764 raft_consensus.cc:2749] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:52.723909 21646 raft_consensus.cc:2749] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:52.723351 21801 raft_consensus.cc:2764] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
I20260709 12:12:52.810289 14303 leader_election.cc:304] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:52.813156 14258 raft_consensus.cc:1240] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 22. Current term is 23. Ops: []
W20260709 12:12:52.854364 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 44161.3us
I20260709 12:12:52.724233 21644 raft_consensus.cc:493] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:52.745097 21776 raft_consensus.cc:2749] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:12:52.756760 21773 consensus_meta.cc:287] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.501s	user 0.008s	sys 0.003s
I20260709 12:12:52.811856 14908 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f"
dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
mode: GRACEFUL
new_leader_uuid: "885067a0d31741bfb5c9935788e315bf"
 from {username='slave'} at 127.0.0.1:38628
I20260709 12:12:52.817375 14190 raft_consensus.cc:2468] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 26.
I20260709 12:12:52.818707 14261 raft_consensus.cc:1275] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 25 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
W20260709 12:12:52.824596 14304 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:52.753890 21753 raft_consensus.cc:493] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:52.770794 21727 raft_consensus.cc:493] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:12:52.809698 21756 raft_consensus.cc:3060] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:52.728341 21656 consensus_queue.cc:1048] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.090s
I20260709 12:12:52.806620 21523 raft_consensus.cc:2749] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:12:52.901229 21644 raft_consensus.cc:3060] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:12:52.983345 21653 leader_election.cc:290] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:52.985659 21646 raft_consensus.cc:493] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:52.986404 21646 raft_consensus.cc:515] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:52.987200 21671 leader_election.cc:290] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:52.988629 21646 leader_election.cc:290] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:52.935920 21727 raft_consensus.cc:515] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:12:52.994197 21651 consensus_meta.cc:287] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.639s	user 0.009s	sys 0.002s
I20260709 12:12:52.999464 21690 raft_consensus.cc:493] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:53.000185 21690 raft_consensus.cc:515] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:53.002990 14264 raft_consensus.cc:1275] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:12:53.014302 14265 raft_consensus.cc:2468] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 19.
I20260709 12:12:52.782675 21689 raft_consensus.cc:493] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:12:52.814620 21725 raft_consensus.cc:515] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:53.019937 21689 raft_consensus.cc:515] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:52.855468 21710 consensus_queue.cc:1059] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 23.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.090s
I20260709 12:12:52.925032 21753 raft_consensus.cc:3060] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:52.925688 21773 raft_consensus.cc:515] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:52.901409 21790 raft_consensus.cc:2804] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:53.023383 21691 raft_consensus.cc:3055] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 25 LEADER]: Stepping down as leader of term 25
I20260709 12:12:53.023787 21691 raft_consensus.cc:740] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:53.024663 21691 consensus_queue.cc:260] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 25.12, Last appended by leader: 12, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:53.027885 21773 leader_election.cc:290] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 20 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:53.028789 14338 raft_consensus.cc:2468] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 20.
I20260709 12:12:53.029588 21790 raft_consensus.cc:493] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:53.030071 21790 raft_consensus.cc:3060] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:53.033931 21691 raft_consensus.cc:3060] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:12:53.037793 21730 raft_consensus.cc:515] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:53.021620 21725 leader_election.cc:290] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 20 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:53.042078 21730 leader_election.cc:290] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:12:52.904482 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 212838us
I20260709 12:12:53.047746 14230 leader_election.cc:304] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:53.030009 21690 leader_election.cc:290] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:52.994653 21727 leader_election.cc:290] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:53.055977 21696 raft_consensus.cc:2749] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:12:53.040761 21518 raft_consensus.cc:515] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:53.059513 21518 leader_election.cc:290] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 21 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:52.902259 14908 raft_consensus.cc:606] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [term 17 LEADER]: Received request to transfer leadership to TS 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:52.813015 14155 leader_election.cc:304] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:53.018209 21644 raft_consensus.cc:515] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:53.074527 14332 raft_consensus.cc:1240] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 18. Current term is 19. Ops: [18.9-18.9]
W20260709 12:12:53.091177 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 278344us
I20260709 12:12:53.092597 14155 leader_election.cc:304] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:53.095366 14155 leader_election.cc:304] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:53.097856 14155 leader_election.cc:304] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:53.098881 14155 leader_election.cc:304] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:53.100065 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:53.100586 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:53.101879 14155 leader_election.cc:304] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:53.126070 14339 raft_consensus.cc:1240] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:53.103554 14331 raft_consensus.cc:1240] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 19. Current term is 20. Ops: [19.14-19.14]
I20260709 12:12:53.104408 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:12:53.135730 21796 log.cc:927] Time spent T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.650s	user 0.001s	sys 0.000s
W20260709 12:12:53.151234 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 49427.1us
I20260709 12:12:53.096547 21801 raft_consensus.cc:2749] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:53.096527 21776 raft_consensus.cc:2749] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:12:53.103421 21523 raft_consensus.cc:2804] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:53.124956 21804 raft_consensus.cc:3060] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:53.103292 21393 raft_consensus.cc:2804] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:12:53.101501 21651 consensus_queue.cc:1059] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 16.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.057s
I20260709 12:12:53.156286 21417 raft_consensus.cc:515] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:53.157182 21676 raft_consensus.cc:2804] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:53.100379 21756 raft_consensus.cc:515] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:12:53.164347 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 309244us
I20260709 12:12:53.167939 14155 leader_election.cc:304] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
W20260709 12:12:53.165027 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 464932us
I20260709 12:12:53.160450 21523 raft_consensus.cc:493] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:53.169759 14303 leader_election.cc:304] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:53.171243 14303 leader_election.cc:304] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:53.163141 21776 raft_consensus.cc:493] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
W20260709 12:12:53.201537 14303 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:53.202601 14303 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:53.158806 21753 raft_consensus.cc:515] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:53.175309 21518 raft_consensus.cc:2749] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:53.205255 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:53.205955 14189 raft_consensus.cc:2468] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 19.
I20260709 12:12:53.207269 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:53.207680 14183 raft_consensus.cc:1240] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 26 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 25. Current term is 26. Ops: [23.11-25.12]
I20260709 12:12:53.202943 14262 raft_consensus.cc:1240] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 23. Current term is 24. Ops: []
I20260709 12:12:53.208747 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:53.208995 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:53.209615 14188 raft_consensus.cc:3060] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:53.212142 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:53.174628 21523 raft_consensus.cc:3060] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:53.169137 21676 raft_consensus.cc:697] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 20 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:12:53.194413 14155 leader_election.cc:304] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:53.165102 21393 raft_consensus.cc:697] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 24 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:12:53.226300 14303 leader_election.cc:304] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:53.167659 21632 raft_consensus.cc:493] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:53.208635 21753 leader_election.cc:290] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 21 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:53.174551 21711 raft_consensus.cc:2749] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:12:53.202324 21710 raft_consensus.cc:2749] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:12:53.220821 21712 raft_consensus.cc:2749] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:12:53.229717 21790 raft_consensus.cc:515] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:53.250603 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:53.251191 21790 leader_election.cc:290] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 21 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:53.175478 21725 raft_consensus.cc:2749] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:12:53.214267 21689 leader_election.cc:290] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:53.214589 21656 raft_consensus.cc:493] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:53.199379 21622 raft_consensus.cc:515] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:12:53.237485 21807 log.cc:927] Time spent T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:12:53.174278 21690 consensus_queue.cc:1048] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.063s
I20260709 12:12:53.225402 21801 consensus_queue.cc:1048] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.021s
W20260709 12:12:53.254846 21809 log.cc:927] Time spent T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:12:53.256485 14188 raft_consensus.cc:2468] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 19.
I20260709 12:12:53.241954 21818 raft_consensus.cc:2804] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:53.315613 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:53.254516 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:53.358417 14185 raft_consensus.cc:3060] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:12:53.254417 21793 log.cc:927] Time spent T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:12:53.356283 14303 leader_election.cc:304] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:53.254571 21644 leader_election.cc:290] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 25 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:53.221297 21776 raft_consensus.cc:515] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:53.257093 21787 raft_consensus.cc:493] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:53.408371 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:53.419368 14256 raft_consensus.cc:2468] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 24.
I20260709 12:12:53.425005 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:53.357604 21818 raft_consensus.cc:493] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:53.409258 21790 raft_consensus.cc:2804] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:53.411334 21565 raft_consensus.cc:493] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:53.456965 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:53.440399 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:53.318620 21656 raft_consensus.cc:515] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:53.465680 14256 raft_consensus.cc:2468] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 19.
I20260709 12:12:53.435738 21818 raft_consensus.cc:3060] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:53.444366 21644 raft_consensus.cc:493] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:53.240283 21632 raft_consensus.cc:515] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:53.498185 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:53.505350 14336 raft_consensus.cc:1813] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Handling vote request from an unknown peer 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:53.498240 21789 raft_consensus.cc:493] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:53.506309 14336 raft_consensus.cc:2410] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for term 18 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
I20260709 12:12:53.506335 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
W20260709 12:12:53.438371 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 219366us
I20260709 12:12:53.368453 21393 consensus_queue.cc:237] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 22.12, Last appended by leader: 12, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:53.445283 21790 raft_consensus.cc:697] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 19 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:53.424192 21787 raft_consensus.cc:515] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:53.504572 14185 raft_consensus.cc:2468] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 21.
I20260709 12:12:53.517879 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:53.566802 14303 leader_election.cc:304] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:53.549010 14256 raft_consensus.cc:2393] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 20: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:12:53.559623 14332 raft_consensus.cc:1275] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 12:12:53.575346 14330 raft_consensus.cc:1240] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 21. Current term is 22. Ops: [21.13-21.13]
I20260709 12:12:53.445919 21565 raft_consensus.cc:515] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:53.503341 21417 leader_election.cc:290] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 22 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:53.441540 21676 consensus_queue.cc:237] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:53.505498 21756 leader_election.cc:290] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 24 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:53.604127 21565 leader_election.cc:290] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:53.606133 21622 leader_election.cc:290] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 21 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:53.505374 21644 raft_consensus.cc:515] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:53.611037 21632 leader_election.cc:290] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:53.561878 21651 raft_consensus.cc:493] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:53.611886 21651 raft_consensus.cc:515] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:53.619292 21787 leader_election.cc:290] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:53.620223 21818 raft_consensus.cc:515] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:53.584122 21801 consensus_queue.cc:1059] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.009s
I20260709 12:12:53.623664 21801 raft_consensus.cc:3055] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:53.624084 21801 raft_consensus.cc:740] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:12:53.584316 21827 raft_consensus.cc:2804] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:12:53.626307 21827 raft_consensus.cc:697] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 21 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:53.627522 21827 consensus_queue.cc:237] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:12:53.590473 21823 log.cc:927] Time spent T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.145s	user 0.000s	sys 0.000s
I20260709 12:12:53.602247 21790 consensus_queue.cc:237] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:53.621083 21656 leader_election.cc:290] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:53.625046 21801 consensus_queue.cc:260] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:53.635108 21801 raft_consensus.cc:3060] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:53.517544 21789 raft_consensus.cc:515] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:12:53.643967 14303 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:53.646473 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:53.652947 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:53.582819 14256 raft_consensus.cc:1240] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 18. Current term is 19. Ops: []
I20260709 12:12:53.622749 21776 leader_election.cc:290] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:53.663367 21818 leader_election.cc:290] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 20 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:53.664414 21783 raft_consensus.cc:493] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:53.672780 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:53.673514 14190 raft_consensus.cc:3060] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:53.675129 14336 raft_consensus.cc:3060] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:53.627523 21804 raft_consensus.cc:2749] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:53.673004 21690 raft_consensus.cc:493] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:53.677618 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:53.682608 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:53.684458 14155 leader_election.cc:304] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:53.688457 14337 raft_consensus.cc:2393] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 19: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:12:53.690864 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:53.692130 14256 raft_consensus.cc:2393] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db in current term 19: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:12:53.689313 21632 consensus_queue.cc:1048] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.010s
I20260709 12:12:53.700218 21632 consensus_queue.cc:1059] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:12:53.701380 21695 raft_consensus.cc:3060] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:53.702060 21804 raft_consensus.cc:3055] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:12:53.703307 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:53.677117 21783 raft_consensus.cc:515] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:53.678745 21690 raft_consensus.cc:515] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:53.688230 21776 raft_consensus.cc:3060] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:53.703260 14190 raft_consensus.cc:2468] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 20.
I20260709 12:12:53.707604 21804 raft_consensus.cc:740] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:12:53.730474 21804 consensus_queue.cc:260] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:53.692799 21711 raft_consensus.cc:493] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:53.745468 14303 leader_election.cc:304] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:53.745679 14186 raft_consensus.cc:1275] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:12:53.750119 14257 raft_consensus.cc:2410] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db for term 24 because replica has last-logged OpId of term: 22 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 15.
I20260709 12:12:53.751830 21818 raft_consensus.cc:2804] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Leader election won for term 20
W20260709 12:12:53.752193 21780 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.606s	user 0.025s	sys 0.025s
I20260709 12:12:53.752507 21818 raft_consensus.cc:697] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 20 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:53.741464 14336 raft_consensus.cc:2468] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 21.
W20260709 12:12:53.752620 21780 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.607s	user 0.025s	sys 0.025s
W20260709 12:12:53.756644 21523 consensus_meta.cc:287] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.543s	user 0.012s	sys 0.001s
I20260709 12:12:53.777179 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:53.780035 14264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41768 (request call id 2631) took 1430 ms. Trace:
I20260709 12:12:53.780375 14264 rpcz_store.cc:276] 0709 12:12:52.349928 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:52.351474 (+  1546us) service_pool.cc:224] Handling call
0709 12:12:52.351789 (+   315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:53.003508 (+651719us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:53.779842 (+776334us) spinlock_profiling.cc:243] Waited 651 ms on lock 0x7b5400100c54. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:12:53.779979 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1496661888}
I20260709 12:12:53.782244 14186 raft_consensus.cc:2393] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 21: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:12:53.747816 21711 raft_consensus.cc:515] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:53.777395 21676 raft_consensus.cc:493] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
W20260709 12:12:53.785462 21691 consensus_meta.cc:287] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.751s	user 0.010s	sys 0.002s
I20260709 12:12:53.777472 21780 raft_consensus.cc:493] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:53.791527 21789 leader_election.cc:290] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:53.797545 21644 leader_election.cc:290] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:53.798791 14262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41764 (request call id 3757) took 1118 ms. Trace:
I20260709 12:12:53.799201 14262 rpcz_store.cc:276] 0709 12:12:52.680695 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:52.785209 (+104514us) service_pool.cc:224] Handling call
0709 12:12:52.785564 (+   355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:53.208401 (+422837us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:53.798494 (+590093us) spinlock_profiling.cc:243] Waited 417 ms on lock 0x7b54002229d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:12:53.798715 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":959340288}
I20260709 12:12:53.761067 21622 consensus_queue.cc:1048] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.027s
I20260709 12:12:53.774623 21523 raft_consensus.cc:515] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:53.807299 21766 raft_consensus.cc:493] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:12:53.825099 21766 raft_consensus.cc:515] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:53.827631 21766 leader_election.cc:290] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:53.824164 14182 raft_consensus.cc:2368] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for earlier term 20. Current term is 21.
I20260709 12:12:53.822918 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 25 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:53.828879 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:53.829636 14262 raft_consensus.cc:2468] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 20.
I20260709 12:12:53.830302 21690 leader_election.cc:290] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:12:53.832279 21820 log.cc:927] Time spent T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.465s	user 0.001s	sys 0.001s
I20260709 12:12:53.832994 21783 leader_election.cc:290] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:53.790458 21818 consensus_queue.cc:237] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 18.9, Last appended by leader: 9, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:53.794319 21676 raft_consensus.cc:515] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:53.849879 21676 leader_election.cc:290] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:53.851610 21711 leader_election.cc:290] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:53.856904 21801 raft_consensus.cc:493] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:53.857677 21801 raft_consensus.cc:515] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:53.858374 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:53.858980 14260 raft_consensus.cc:3060] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:53.860174 21801 leader_election.cc:290] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:53.862147 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:53.862836 14264 raft_consensus.cc:2468] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 20.
I20260709 12:12:53.863731 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:53.864257 14264 raft_consensus.cc:3060] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:53.866875 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:53.867280 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:53.867913 14258 raft_consensus.cc:2468] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 20.
I20260709 12:12:53.868902 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:53.870373 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:53.870929 14261 raft_consensus.cc:3060] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:53.807770 21780 raft_consensus.cc:515] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:53.874958 14303 leader_election.cc:304] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:12:53.875267 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:53.876061 21783 raft_consensus.cc:493] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:53.876729 21783 raft_consensus.cc:515] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:53.877629 21804 raft_consensus.cc:3060] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:53.878440 21644 consensus_queue.cc:1059] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:12:53.879364 21644 consensus_queue.cc:1059] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:12:53.880129 21756 raft_consensus.cc:3055] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:53.880640 21756 raft_consensus.cc:740] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:53.881534 21756 consensus_queue.cc:260] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:53.882896 21756 raft_consensus.cc:3060] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:53.888247 21450 raft_consensus.cc:493] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:12:53.888875 21450 raft_consensus.cc:515] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:12:53.894881 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 208756us
I20260709 12:12:53.896019 21696 raft_consensus.cc:3055] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:53.896529 21696 raft_consensus.cc:740] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:53.897444 21696 consensus_queue.cc:260] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 18.9, Last appended by leader: 9, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:53.902182 14265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41764 (request call id 3747) took 1338 ms. Trace:
I20260709 12:12:53.902827 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:53.902660 14265 rpcz_store.cc:276] 0709 12:12:52.563813 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:52.564446 (+   633us) service_pool.cc:224] Handling call
0709 12:12:53.901992 (+1337546us) spinlock_profiling.cc:243] Waited 428 ms on lock 0x7b54002fd854. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:12:53.902112 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":984268672}
I20260709 12:12:53.905370 14265 raft_consensus.cc:1240] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 25 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 24. Current term is 25. Ops: []
W20260709 12:12:53.876238 14263 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41764 (request call id 3750) took 1311 ms (client timeout 1690 ms). Trace:
W20260709 12:12:53.922991 14263 rpcz_store.cc:269] 0709 12:12:52.564604 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:52.631927 (+ 67323us) service_pool.cc:224] Handling call
0709 12:12:53.875178 (+1243251us) spinlock_profiling.cc:243] Waited 17.2 ms on lock 0x7b5c0002b18c. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f212aaa5161 00007f212ac46a79 00007f212c1009b6 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:12:53.876149 (+   971us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":39487232}
I20260709 12:12:53.924343 21827 raft_consensus.cc:493] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:53.925001 21827 raft_consensus.cc:515] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:53.880163 21644 raft_consensus.cc:3055] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:53.930106 21644 raft_consensus.cc:740] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:53.931102 21644 consensus_queue.cc:260] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:53.932484 21644 raft_consensus.cc:3060] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:12:53.950469 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:53.965055 14331 raft_consensus.cc:1275] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:12:53.971612 21711 raft_consensus.cc:493] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:53.972399 21711 raft_consensus.cc:515] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:12:53.984396 14156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:53.985040 14156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:53.985718 21837 raft_consensus.cc:493] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:53.986109 21518 raft_consensus.cc:493] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:53.986792 21836 raft_consensus.cc:493] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:53.986498 21837 raft_consensus.cc:515] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:53.988098 21518 raft_consensus.cc:515] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:12:53.989874 14338 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50858 (request call id 2595) took 1884 ms (client timeout 2145 ms). Trace:
I20260709 12:12:53.988451 14184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56046 (request call id 3191) took 1231 ms. Trace:
I20260709 12:12:53.990396 14184 rpcz_store.cc:276] 0709 12:12:52.757041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:52.757168 (+   127us) service_pool.cc:224] Handling call
0709 12:12:52.757455 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:52.973636 (+216181us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:12:52.974066 (+   430us) log.cc:844] Serialized 14 byte log entry
0709 12:12:52.974279 (+   213us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:52.974329 (+    50us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:12:52.974377 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:53.988190 (+1013813us) spinlock_profiling.cc:243] Waited 216 ms on lock 0x7b54001121d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:12:53.988242 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:53.988385 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":804,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":55,"raft.queue_time_us":1600,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":108,"spinlock_wait_cycles":496462208}
I20260709 12:12:53.996307 21774 raft_consensus.cc:3060] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:53.998793 14182 raft_consensus.cc:1275] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
W20260709 12:12:53.990288 14338 rpcz_store.cc:269] 0709 12:12:52.105532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:52.106362 (+   830us) service_pool.cc:224] Handling call
0709 12:12:53.989655 (+1883293us) spinlock_profiling.cc:243] Waited 911 ms on lock 0x7b54000fbed4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:12:53.989786 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2094771072}
I20260709 12:12:54.003810 21718 raft_consensus.cc:493] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:54.004516 21718 raft_consensus.cc:515] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:54.010133 21632 consensus_queue.cc:1048] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:12:54.010561 21712 consensus_queue.cc:1048] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:12:54.012090 21712 consensus_queue.cc:1048] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:12:54.014699 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 25 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:54.015650 14258 raft_consensus.cc:2468] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 24.
I20260709 12:12:54.017853 21718 leader_election.cc:290] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:54.018738 21518 leader_election.cc:290] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:54.019171 21837 leader_election.cc:290] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:54.019552 21651 leader_election.cc:290] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:54.020301 21696 raft_consensus.cc:3060] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:54.020862 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:54.021593 14338 raft_consensus.cc:2468] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 15.
I20260709 12:12:54.024243 21725 raft_consensus.cc:493] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:54.024842 21725 raft_consensus.cc:515] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:54.026055 21417 raft_consensus.cc:493] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:54.026628 21417 raft_consensus.cc:515] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:54.028964 21417 leader_election.cc:290] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:12:54.030426 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 155568us
W20260709 12:12:54.031113 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:54.031680 21695 raft_consensus.cc:2804] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:12:54.032315 21695 raft_consensus.cc:697] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 23 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:54.032640 14303 leader_election.cc:400] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 20 election: Vote denied by peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187) with higher term. Message: Invalid argument: T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for earlier term 20. Current term is 21.
I20260709 12:12:54.033012 14303 leader_election.cc:403] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 20 election: Cancelling election due to peer responding with higher term
I20260709 12:12:54.033571 21653 raft_consensus.cc:3060] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:54.034950 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:54.036360 21695 consensus_queue.cc:237] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:54.043427 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:54.035223 21783 leader_election.cc:290] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:54.047899 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:54.048619 14906 raft_consensus.cc:3060] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:54.049863 21450 leader_election.cc:290] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:54.045560 14155 leader_election.cc:304] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:54.047755 21787 raft_consensus.cc:493] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:54.054020 21837 raft_consensus.cc:2804] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:12:54.054157 21787 raft_consensus.cc:515] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:54.056075 21837 raft_consensus.cc:697] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 21 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:12:54.057379 21837 consensus_queue.cc:237] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:54.061990 21783 raft_consensus.cc:493] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:54.062790 21783 raft_consensus.cc:515] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:54.031378 21725 leader_election.cc:290] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:54.068379 21523 leader_election.cc:290] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 21 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:54.070772 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:54.071693 14336 raft_consensus.cc:2410] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db for term 24 because replica has last-logged OpId of term: 22 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 15.
I20260709 12:12:54.076854 21651 raft_consensus.cc:493] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:54.077140 14908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:54.077797 14908 raft_consensus.cc:2468] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 23.
I20260709 12:12:54.077672 21651 raft_consensus.cc:515] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:54.080138 21651 leader_election.cc:290] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:12:54.086879 21830 log.cc:927] Time spent T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.151s	user 0.005s	sys 0.008s
W20260709 12:12:54.087416 21828 log.cc:927] Time spent T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.298s	user 0.003s	sys 0.015s
I20260709 12:12:54.166109 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:54.087580 14261 raft_consensus.cc:2468] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 22.
W20260709 12:12:54.088191 21835 log.cc:927] Time spent T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.195s	user 0.005s	sys 0.000s
W20260709 12:12:54.089883 21842 log.cc:927] Time spent T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.072s	user 0.000s	sys 0.005s
W20260709 12:12:54.090332 21843 log.cc:927] Time spent T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.061s	user 0.001s	sys 0.003s
W20260709 12:12:54.090960 14230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:54.097182 14908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:54.098711 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:54.172029 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:54.098860 14911 raft_consensus.cc:1275] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 25 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260709 12:12:54.174280 14338 raft_consensus.cc:2468] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 22.
I20260709 12:12:54.099880 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:54.175084 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:54.175612 14909 raft_consensus.cc:2393] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 23: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
I20260709 12:12:54.175819 14330 raft_consensus.cc:2468] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 18.
I20260709 12:12:54.130970 21776 raft_consensus.cc:2749] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:54.176723 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:53.987373 21836 raft_consensus.cc:515] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:54.175185 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:12:54.143940 21824 log.cc:927] Time spent T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.194s	user 0.009s	sys 0.000s
W20260709 12:12:54.144466 21797 log.cc:927] Time spent T 00000000000000000000000000000000 P d07070be2c074f4cb9ad35f1580c4ef7: Append to log took a long time: real 0.175s	user 0.007s	sys 0.002s
I20260709 12:12:54.148952 14264 raft_consensus.cc:2468] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 21.
I20260709 12:12:54.150415 14259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41764 (request call id 3759) took 1202 ms. Trace:
W20260709 12:12:54.151358 21833 log.cc:927] Time spent T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.257s	user 0.003s	sys 0.006s
I20260709 12:12:54.153887 14189 raft_consensus.cc:1240] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 20. Current term is 21. Ops: [20.13-20.13]
I20260709 12:12:54.154695 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:54.154930 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:54.155067 14155 leader_election.cc:304] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:54.155447 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:54.197255 14912 raft_consensus.cc:2468] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 18.
I20260709 12:12:54.156139 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:54.153992 21783 leader_election.cc:290] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:54.158084 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:54.205981 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:12:54.160215 14229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:54.161998 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:54.163131 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
W20260709 12:12:54.206952 14229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:54.164402 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:54.164721 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:54.165059 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:54.207876 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:54.208293 14331 raft_consensus.cc:2468] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 22.
I20260709 12:12:54.163077 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:54.207789 14333 raft_consensus.cc:2393] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 21: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:12:54.214025 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:54.215466 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:54.216058 14265 raft_consensus.cc:3060] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:54.216325 14263 raft_consensus.cc:1240] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 21. Current term is 22. Ops: [21.13-21.13]
I20260709 12:12:54.214133 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:54.167060 21787 leader_election.cc:290] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:54.167537 14256 raft_consensus.cc:1240] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 20. Current term is 21. Ops: []
I20260709 12:12:54.168653 14906 raft_consensus.cc:2410] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for term 20 because replica has last-logged OpId of term: 19 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 13.
I20260709 12:12:54.169293 21711 leader_election.cc:290] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:54.232007 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:54.169190 21780 leader_election.cc:290] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:54.179698 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:54.185302 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:54.187301 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:54.245464 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
W20260709 12:12:54.246335 21848 log.cc:927] Time spent T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 12:12:54.204152 21623 raft_consensus.cc:493] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:54.247548 21623 raft_consensus.cc:515] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:54.195972 21756 raft_consensus.cc:493] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:12:54.251178 21756 raft_consensus.cc:515] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:54.253607 14261 raft_consensus.cc:1275] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:12:54.209261 21393 raft_consensus.cc:2804] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:54.255131 21393 raft_consensus.cc:493] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:54.255525 21393 raft_consensus.cc:3060] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:54.238570 21772 raft_consensus.cc:493] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:54.257385 21772 raft_consensus.cc:515] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:54.204957 21653 raft_consensus.cc:2749] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Leader election lost for term 20. Reason: Vote denied by peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187) with higher term. Message: Invalid argument: T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for earlier term 20. Current term is 21.
I20260709 12:12:54.260576 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:54.139103 14260 raft_consensus.cc:2468] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 20.
I20260709 12:12:54.188966 14338 raft_consensus.cc:2468] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 21.
I20260709 12:12:54.192322 14259 rpcz_store.cc:276] 0709 12:12:52.948083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:52.948427 (+   344us) service_pool.cc:224] Handling call
0709 12:12:52.948713 (+   286us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:52.949089 (+   376us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:52.949117 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:52.949609 (+   492us) log.cc:844] Serialized 26 byte log entry
0709 12:12:53.174791 (+225182us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:12:53.174834 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:53.174903 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:53.831676 (+656773us) spinlock_profiling.cc:243] Waited 6.58 ms on lock 0x7b4400022b4c. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2123f74c85 00007f2123f756a2 00007f2126ce71db 00007f2126ce2aaf 00007f2126cd686e 00007f2126cd5bb6 00007f2126cd57d8 00007f2126cdf221 00007f2126cdf1d9 00007f2126cdf169
0709 12:12:54.150073 (+318397us) raft_consensus.cc:1685] finished
0709 12:12:54.150110 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:54.150350 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1330,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":116,"spinlock_wait_cycles":15132416,"thread_start_us":205009,"threads_started":1,"wal-append.queue_time_us":269321}
I20260709 12:12:54.265038 21827 leader_election.cc:290] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:54.192109 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:54.203977 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:54.268834 21674 consensus_queue.cc:1048] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:12:54.270447 21450 raft_consensus.cc:493] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:54.271030 21450 raft_consensus.cc:515] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:54.159660 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:54.164374 14337 raft_consensus.cc:1240] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 19 LEADER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 18. Current term is 19. Ops: [18.9-18.9]
I20260709 12:12:54.220044 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:54.220537 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:12:54.191210 21831 log.cc:927] Time spent T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.296s	user 0.003s	sys 0.006s
W20260709 12:12:54.289915 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 105146us
I20260709 12:12:54.289490 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:54.291210 14262 raft_consensus.cc:2468] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 25.
I20260709 12:12:54.223532 14229 leader_election.cc:304] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:54.227105 14265 raft_consensus.cc:2468] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 21.
I20260709 12:12:54.230160 14303 leader_election.cc:304] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:54.240264 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:54.293326 14257 raft_consensus.cc:3060] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:54.274000 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:54.275238 14877 leader_election.cc:304] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:54.254801 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:54.277729 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:54.294274 14258 raft_consensus.cc:1813] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Handling vote request from an unknown peer 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:54.294929 14258 raft_consensus.cc:2410] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for term 18 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
I20260709 12:12:54.241317 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:54.221499 14331 raft_consensus.cc:1240] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 21 LEADER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 20. Current term is 21. Ops: [20.13-20.13]
I20260709 12:12:54.298022 14263 raft_consensus.cc:2468] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 19.
I20260709 12:12:54.291285 14332 raft_consensus.cc:2468] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 23.
W20260709 12:12:54.293262 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 69835.5us
I20260709 12:12:54.225677 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:54.187219 21818 raft_consensus.cc:493] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:54.210067 21651 raft_consensus.cc:493] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:54.300580 14229 leader_election.cc:304] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
W20260709 12:12:54.307088 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 76995us
I20260709 12:12:54.300710 14304 leader_election.cc:304] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
W20260709 12:12:54.288964 21849 log.cc:927] Time spent T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.135s	user 0.000s	sys 0.003s
I20260709 12:12:54.310601 21565 raft_consensus.cc:3060] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:54.370844 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:54.383216 14336 raft_consensus.cc:2468] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 24.
I20260709 12:12:54.310778 21623 leader_election.cc:290] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:54.304184 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:54.316826 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:54.376612 14154 leader_election.cc:304] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
W20260709 12:12:54.310737 21853 log.cc:927] Time spent T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
W20260709 12:12:54.380264 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 78437us
I20260709 12:12:54.390446 14256 raft_consensus.cc:2468] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 23.
I20260709 12:12:54.386691 14335 raft_consensus.cc:2468] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 21.
I20260709 12:12:54.374040 14257 raft_consensus.cc:2468] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 21.
W20260709 12:12:54.387413 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 86881.2us
I20260709 12:12:54.363097 21690 raft_consensus.cc:2749] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 12:12:54.385288 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 81466us
I20260709 12:12:54.391338 14877 leader_election.cc:304] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:54.390295 14303 leader_election.cc:304] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:12:54.390407 14181 raft_consensus.cc:2468] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 21.
I20260709 12:12:54.301671 21827 consensus_queue.cc:1048] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.083s
W20260709 12:12:54.399994 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 99333.9us
I20260709 12:12:54.403599 14304 leader_election.cc:304] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:54.384611 21644 raft_consensus.cc:2804] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:12:54.403626 14877 leader_election.cc:304] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:54.409198 14876 leader_election.cc:304] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:54.410801 14303 leader_election.cc:304] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:54.382975 21450 leader_election.cc:290] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:54.413676 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:54.364607 21818 raft_consensus.cc:515] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:54.406805 14330 raft_consensus.cc:1275] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 12:12:54.405107 21725 raft_consensus.cc:2749] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:12:54.418529 21725 consensus_queue.cc:1059] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:12:54.405369 21695 raft_consensus.cc:493] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:54.419195 21623 consensus_queue.cc:1048] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:12:54.419833 21695 raft_consensus.cc:515] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:54.403415 21621 raft_consensus.cc:2749] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:54.422294 21695 leader_election.cc:290] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:54.422844 21695 raft_consensus.cc:3055] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:12:54.423162 21695 raft_consensus.cc:740] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:54.424875 21695 consensus_queue.cc:260] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:54.374795 21651 raft_consensus.cc:515] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:54.399957 21783 raft_consensus.cc:2764] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader pre-election decision vote started in defunct term 20: won
I20260709 12:12:54.478169 14155 leader_election.cc:304] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:54.479974 14155 leader_election.cc:304] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:54.482338 14336 raft_consensus.cc:1240] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 20. Current term is 21. Ops: []
I20260709 12:12:54.410118 21841 raft_consensus.cc:2804] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:54.410728 21756 leader_election.cc:290] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:54.414631 21417 raft_consensus.cc:2804] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:54.414448 21711 raft_consensus.cc:2749] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:12:54.488543 14264 raft_consensus.cc:1275] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 12:12:54.485989 14335 raft_consensus.cc:1275] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
I20260709 12:12:54.443132 21469 raft_consensus.cc:2749] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:12:54.490595 14155 leader_election.cc:304] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:54.488624 21417 raft_consensus.cc:493] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:54.497030 21818 leader_election.cc:290] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:54.497442 21417 raft_consensus.cc:3060] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:54.489516 21841 raft_consensus.cc:493] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:12:54.501709 21841 raft_consensus.cc:3060] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:54.449308 21772 leader_election.cc:290] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:12:54.509407 14302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:54.512418 21565 raft_consensus.cc:2749] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:54.514336 21417 raft_consensus.cc:515] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:54.426149 21622 raft_consensus.cc:2804] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:12:54.476168 21632 raft_consensus.cc:493] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:54.519876 21836 leader_election.cc:290] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:54.521482 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:54.541157 21827 raft_consensus.cc:493] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:54.541811 21827 raft_consensus.cc:515] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:54.542529 21417 leader_election.cc:290] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:54.537508 21622 raft_consensus.cc:493] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:12:54.543599 21622 raft_consensus.cc:3060] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:12:54.449590 21644 raft_consensus.cc:697] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 26 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:54.444687 21450 raft_consensus.cc:2749] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:54.492738 21801 raft_consensus.cc:2804] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:12:54.547204 21801 raft_consensus.cc:493] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 24 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:54.547605 21801 raft_consensus.cc:3060] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:12:54.549103 21644 consensus_queue.cc:237] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 23.11, Last appended by leader: 12, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:54.524426 21841 raft_consensus.cc:515] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:12:54.527230 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 115465us
I20260709 12:12:54.554373 14903 raft_consensus.cc:1240] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 21 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 20. Current term is 21. Ops: []
I20260709 12:12:54.555522 21623 consensus_queue.cc:1059] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 23.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:12:54.554877 14304 leader_election.cc:304] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:54.529186 14155 leader_election.cc:304] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
W20260709 12:12:54.531315 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 133774us
I20260709 12:12:54.488291 21712 raft_consensus.cc:2749] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:12:54.483834 21690 raft_consensus.cc:493] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:54.497359 21857 log.cc:927] Time spent T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:12:54.537168 21632 raft_consensus.cc:515] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:54.559703 14229 leader_election.cc:304] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
W20260709 12:12:54.563097 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:54.574681 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 45564.6us
I20260709 12:12:54.574241 14304 leader_election.cc:304] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:54.556623 21623 raft_consensus.cc:3055] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:12:54.583745 14229 leader_election.cc:304] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
W20260709 12:12:54.586239 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:54.536203 21837 raft_consensus.cc:2804] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:12:54.587311 14229 leader_election.cc:304] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:54.592024 14229 leader_election.cc:304] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:54.596694 14229 leader_election.cc:304] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:54.578879 21836 raft_consensus.cc:2804] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:12:54.578733 21791 raft_consensus.cc:2804] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 12:12:54.589072 21696 consensus_meta.cc:287] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.568s	user 0.009s	sys 0.001s
W20260709 12:12:54.600597 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 149261us
I20260709 12:12:54.592093 21753 raft_consensus.cc:2749] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:12:54.605541 14156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:54.576732 21776 consensus_queue.cc:1059] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.033s
I20260709 12:12:54.590900 21725 raft_consensus.cc:2764] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Leader pre-election decision vote started in defunct term 20: won
I20260709 12:12:54.619613 14304 leader_election.cc:304] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:54.600201 21756 raft_consensus.cc:2749] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:12:54.588830 21623 raft_consensus.cc:740] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
W20260709 12:12:54.599232 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 185392us
I20260709 12:12:54.621784 14877 leader_election.cc:304] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:12:54.578122 21718 consensus_queue.cc:1059] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.032s
I20260709 12:12:54.597426 21772 raft_consensus.cc:2749] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:54.596649 21827 leader_election.cc:290] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:54.594885 21860 raft_consensus.cc:2749] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 12:12:54.635207 14304 leader_election.cc:304] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:54.583868 21690 raft_consensus.cc:515] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:54.620808 21836 raft_consensus.cc:493] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:54.648918 14303 leader_election.cc:304] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:54.621505 21837 raft_consensus.cc:697] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 21 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:12:54.619019 21774 consensus_queue.cc:1059] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 24.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.014s
I20260709 12:12:54.648545 14304 leader_election.cc:304] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:54.619158 21791 raft_consensus.cc:493] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:12:54.595342 21780 consensus_queue.cc:1048] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.036s
I20260709 12:12:54.595296 21523 consensus_queue.cc:1059] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.039s
I20260709 12:12:54.652254 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:54.658272 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:54.655880 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:54.658419 14264 raft_consensus.cc:2468] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 19.
I20260709 12:12:54.633414 21696 raft_consensus.cc:2749] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:12:54.646299 21711 raft_consensus.cc:2804] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:12:54.661561 14330 raft_consensus.cc:2393] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db in current term 19: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:12:54.636476 21841 leader_election.cc:290] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 21 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:54.649964 21787 raft_consensus.cc:2804] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:12:54.651404 21836 raft_consensus.cc:3060] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:54.654484 21791 raft_consensus.cc:3060] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:12:54.664343 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 67753.7us
I20260709 12:12:54.655174 21827 raft_consensus.cc:2804] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:12:54.656912 21756 raft_consensus.cc:493] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:54.660801 21718 raft_consensus.cc:3055] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:12:54.694806 14229 leader_election.cc:304] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:12:54.662957 21725 raft_consensus.cc:2749] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:54.665827 21711 raft_consensus.cc:493] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:54.700958 21644 raft_consensus.cc:2804] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:12:54.702044 21644 raft_consensus.cc:493] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:54.702929 21644 raft_consensus.cc:3060] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:54.705585 14256 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21"
dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
mode: GRACEFUL
new_leader_uuid: "885067a0d31741bfb5c9935788e315bf"
 from {username='slave'} at 127.0.0.1:54238
I20260709 12:12:54.706348 14256 raft_consensus.cc:606] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Received request to transfer leadership to TS 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:54.706679 14256 raft_consensus.cc:614] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:54.708042 14264 raft_consensus.cc:1240] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 20. Current term is 21. Ops: []
I20260709 12:12:54.710201 14264 raft_consensus.cc:1275] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
I20260709 12:12:54.711261 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:54.683791 21523 consensus_queue.cc:1243] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer 65c9c1653b3346b39a0e118540e6080c log is divergent from this leader: its last log entry 19.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 12:12:54.667243 21787 raft_consensus.cc:493] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:54.722447 21827 raft_consensus.cc:697] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 22 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
W20260709 12:12:54.723706 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 63397.9us
W20260709 12:12:54.723284 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 61574us
W20260709 12:12:54.724798 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 64908.1us
I20260709 12:12:54.730263 14304 leader_election.cc:304] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:54.731057 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:54.698585 21756 raft_consensus.cc:515] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:54.731868 14903 raft_consensus.cc:2468] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 23.
I20260709 12:12:54.733645 21756 leader_election.cc:290] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:54.721197 21711 raft_consensus.cc:3060] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:12:54.726585 21623 consensus_queue.cc:260] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:54.739073 21623 raft_consensus.cc:3060] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:54.739881 21622 raft_consensus.cc:515] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:54.728575 21787 raft_consensus.cc:3060] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 25 FOLLOWER]: Advancing to term 26
W20260709 12:12:54.743441 21417 consensus_queue.cc:1175] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "885067a0d31741bfb5c9935788e315bf" responder_term: 23 status { last_received { term: 23 index: 13 } last_committed_idx: 13 last_received_current_leader { term: 23 index: 13 } }
W20260709 12:12:54.749378 21864 log.cc:927] Time spent T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.127s	user 0.003s	sys 0.000s
I20260709 12:12:54.751039 21506 raft_consensus.cc:493] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:54.751355 21827 consensus_queue.cc:237] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:54.694528 21718 raft_consensus.cc:740] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:54.758941 12986 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:12:54.759805 21622 leader_election.cc:290] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 25 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:54.760270 21516 raft_consensus.cc:993] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db: : Instructing follower 885067a0d31741bfb5c9935788e315bf to start an election
I20260709 12:12:54.762470 21695 raft_consensus.cc:3060] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:54.724359 21789 consensus_queue.cc:1059] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.039s
I20260709 12:12:54.692380 21861 raft_consensus.cc:2804] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:12:54.730285 21837 consensus_queue.cc:237] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:54.758893 21632 leader_election.cc:290] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:54.769310 21651 leader_election.cc:290] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:54.769297 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:54.806329 21877 raft_consensus.cc:2749] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:54.770133 14229 leader_election.cc:304] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
W20260709 12:12:54.797370 21393 consensus_meta.cc:287] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.540s	user 0.013s	sys 0.000s
I20260709 12:12:54.771646 21801 raft_consensus.cc:515] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:54.772816 21772 raft_consensus.cc:493] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:54.769388 14877 leader_election.cc:304] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:54.837996 21393 raft_consensus.cc:515] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:54.838357 21772 raft_consensus.cc:515] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:54.839494 21801 leader_election.cc:290] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 25 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:54.840193 14181 raft_consensus.cc:1240] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 25 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 24. Current term is 25. Ops: []
I20260709 12:12:54.840411 21772 leader_election.cc:290] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:12:54.779521 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 45404.4us
W20260709 12:12:54.841565 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 72254us
I20260709 12:12:54.846944 21804 raft_consensus.cc:3055] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:12:54.847445 21804 raft_consensus.cc:740] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:12:54.848326 21804 consensus_queue.cc:260] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:54.782450 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:54.728825 14303 leader_election.cc:304] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:54.851503 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:54.852614 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:54.793664 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:54.807838 21718 consensus_queue.cc:260] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:54.856901 14903 raft_consensus.cc:2468] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 18.
I20260709 12:12:54.857445 21718 raft_consensus.cc:3060] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:54.809188 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:54.862120 14187 raft_consensus.cc:2468] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 21.
I20260709 12:12:54.762693 21690 leader_election.cc:290] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:12:54.771267 14230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:54.811283 21865 raft_consensus.cc:1081] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [term 17 LEADER]: Signalling peer 885067a0d31741bfb5c9935788e315bf to start an election
W20260709 12:12:54.828310 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 58257.6us
I20260709 12:12:54.866868 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:54.835464 21651 raft_consensus.cc:2804] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:12:54.868012 21651 raft_consensus.cc:493] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:54.836151 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:54.868391 14229 leader_election.cc:304] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:12:54.868402 21651 raft_consensus.cc:3060] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:54.849623 21804 raft_consensus.cc:3060] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:54.869747 14190 raft_consensus.cc:1240] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 15. Current term is 16. Ops: []
I20260709 12:12:54.871155 14184 raft_consensus.cc:2468] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 18.
I20260709 12:12:54.836998 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:54.796139 21506 raft_consensus.cc:515] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:54.873821 14911 raft_consensus.cc:1275] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:12:54.875926 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:54.851719 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 23 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:54.874580 21772 raft_consensus.cc:2804] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:54.888377 14876 leader_election.cc:304] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:54.929123 14229 leader_election.cc:304] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
W20260709 12:12:55.138605 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:55.135488 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 206448us
W20260709 12:12:54.959100 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 230389us
W20260709 12:12:54.966313 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 376618us
W20260709 12:12:55.043159 14156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:54.986790 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 134491us
W20260709 12:12:55.078145 14228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:55.072618 14087 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44116 (request call id 163) took 12853 ms (client timeout 15000 ms). Trace:
W20260709 12:12:54.997925 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 75617.8us
I20260709 12:12:55.144642 14304 leader_election.cc:304] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db
W20260709 12:12:54.970405 14154 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 67729us
I20260709 12:12:55.146548 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:55.147135 14229 leader_election.cc:304] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:55.147460 14256 raft_consensus.cc:1275] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
W20260709 12:12:55.148586 14154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:55.149837 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 261532us
I20260709 12:12:54.971484 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:55.152016 14911 raft_consensus.cc:1240] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 21 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 20. Current term is 21. Ops: []
I20260709 12:12:55.026264 12986 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:55.154903 14256 raft_consensus.cc:1275] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 13. (term mismatch)
I20260709 12:12:55.155472 14256 pending_rounds.cc:85] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec: Aborting all ops after (but not including) 12
I20260709 12:12:55.155869 14256 pending_rounds.cc:107] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec: Aborting uncommitted NO_OP operation due to leader change: 20.13
I20260709 12:12:55.156322 14256 raft_consensus.cc:2889] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:54.886085 21801 raft_consensus.cc:493] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:54.840265 21393 leader_election.cc:290] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 16 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:55.156611 14230 leader_election.cc:304] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:55.158882 14256 raft_consensus.cc:1240] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 25 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 24. Current term is 25. Ops: []
I20260709 12:12:55.159889 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:55.161186 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:54.841784 21754 raft_consensus.cc:2804] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:54.896445 21772 raft_consensus.cc:493] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:55.163849 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:54.928683 21518 raft_consensus.cc:3055] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:12:54.965961 14185 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f"
dest_uuid: "885067a0d31741bfb5c9935788e315bf"
 from {username='slave'} at 127.0.0.1:56652
I20260709 12:12:55.136629 21818 raft_consensus.cc:493] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:55.001092 21841 raft_consensus.cc:493] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:55.173482 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:55.165627 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:55.167860 14185 raft_consensus.cc:493] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:54.975240 21690 raft_consensus.cc:2804] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:12:55.015578 21774 raft_consensus.cc:3055] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:12:54.966703 21506 leader_election.cc:290] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:54.985855 21863 raft_consensus.cc:3055] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:12:55.160928 21837 raft_consensus.cc:493] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:55.168951 14230 leader_election.cc:304] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:55.170531 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:55.190025 14261 raft_consensus.cc:2468] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 23.
I20260709 12:12:55.160573 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:55.144373 21756 raft_consensus.cc:2804] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:12:55.167470 21754 raft_consensus.cc:493] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:55.167196 21518 raft_consensus.cc:740] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:12:55.172199 21772 raft_consensus.cc:3060] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:55.138211 21791 raft_consensus.cc:515] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:54.898802 21861 raft_consensus.cc:697] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 21 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:55.171705 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:55.172161 14260 raft_consensus.cc:1275] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
I20260709 12:12:55.173574 14257 raft_consensus.cc:1275] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 19 index: 9. (term mismatch)
I20260709 12:12:55.174966 14185 raft_consensus.cc:3060] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:55.176693 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:55.153862 21804 raft_consensus.cc:493] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:55.039175 14083 catalog_manager.cc:5697] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: term changed from 18 to 19, leader changed from 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130) to 885067a0d31741bfb5c9935788e315bf (127.12.174.129). New cstate: current_term: 19 leader_uuid: "885067a0d31741bfb5c9935788e315bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } }
I20260709 12:12:55.179474 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:55.180239 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:55.180533 14186 raft_consensus.cc:1275] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
I20260709 12:12:55.180822 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:54.975160 21780 consensus_queue.cc:1048] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.194s
I20260709 12:12:55.171033 21591 consensus_queue.cc:1059] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 24.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.044s
I20260709 12:12:55.182904 14181 raft_consensus.cc:1275] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 26 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 22 index: 10. Preceding OpId from leader: term: 26 index: 12. (index mismatch)
I20260709 12:12:54.995076 21789 consensus_queue.cc:1048] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.179s
I20260709 12:12:55.185220 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:55.261685 21791 leader_election.cc:290] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 21 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:55.262735 14083 catalog_manager.cc:5697] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } }
I20260709 12:12:54.815701 21644 raft_consensus.cc:515] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:54.827775 21836 raft_consensus.cc:515] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:55.158202 21873 raft_consensus.cc:2804] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:55.181563 21844 consensus_queue.cc:1059] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.025s
I20260709 12:12:55.167188 21712 consensus_queue.cc:1059] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.048s
I20260709 12:12:55.040426 21787 raft_consensus.cc:515] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:55.192006 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:55.193028 14230 leader_election.cc:304] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:55.006271 21711 raft_consensus.cc:515] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:55.213065 14264 raft_consensus.cc:2468] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 21.
I20260709 12:12:55.194272 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:55.213824 14257 pending_rounds.cc:85] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec: Aborting all ops after (but not including) 8
I20260709 12:12:55.194103 21860 raft_consensus.cc:2749] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:55.284121 21860 raft_consensus.cc:2749] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 12:12:55.287096 21711 leader_election.cc:290] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 25 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:55.259749 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:55.216395 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:55.266445 21754 raft_consensus.cc:3060] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:55.289834 14182 raft_consensus.cc:2468] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 18.
I20260709 12:12:55.182210 21690 raft_consensus.cc:493] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:55.267148 21873 raft_consensus.cc:493] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:55.177137 21818 raft_consensus.cc:515] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:55.265347 14083 catalog_manager.cc:5697] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: term changed from 11 to 19, leader changed from 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130) to 885067a0d31741bfb5c9935788e315bf (127.12.174.129). New cstate: current_term: 19 leader_uuid: "885067a0d31741bfb5c9935788e315bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } }
I20260709 12:12:55.182399 21774 raft_consensus.cc:740] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:54.991740 21882 raft_consensus.cc:493] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:55.272661 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:55.189702 21651 raft_consensus.cc:515] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:12:55.143818 14087 rpcz_store.cc:269] 0709 12:12:42.219638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:42.247255 (+ 27617us) service_pool.cc:224] Handling call
0709 12:12:55.072526 (+12825271us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:12:51.642880 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:12:51.978855 (+335975us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:12:51.987259 (+  8404us) write_op.cc:435] Acquired schema lock
0709 12:12:52.013526 (+ 26267us) tablet.cc:662] Decoding operations
0709 12:12:52.175488 (+161962us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:12:52.175591 (+   103us) write_op.cc:641] Partition lock acquired for write op
0709 12:12:52.175618 (+    27us) tablet.cc:685] Acquiring locks for 16 operations
0709 12:12:52.176949 (+  1331us) tablet.cc:701] Row locks acquired
0709 12:12:52.177020 (+    71us) write_op.cc:260] PREPARE: finished
0709 12:12:52.177221 (+   201us) write_op.cc:270] Start()
0709 12:12:52.177403 (+   182us) write_op.cc:276] Timestamp: P: 1783599172177142 usec, L: 0
0709 12:12:52.177425 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:12:52.271501 (+ 94076us) log.cc:844] Serialized 6330 byte log entry
0709 12:12:53.207755 (+936254us) op_driver.cc:464] REPLICATION: finished
0709 12:12:53.494017 (+286262us) write_op.cc:301] APPLY: starting
0709 12:12:53.505414 (+ 11397us) tablet.cc:1367] starting BulkCheckPresence
0709 12:12:53.843593 (+338179us) tablet.cc:1370] finished BulkCheckPresence
0709 12:12:53.843709 (+   116us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:12:53.968355 (+124646us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:12:53.968664 (+   309us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=32,key_file_lookups=32,delta_file_lookups=32,mrs_lookups=0
0709 12:12:53.968707 (+    43us) write_op.cc:312] APPLY: finished
0709 12:12:53.969073 (+   366us) log.cc:844] Serialized 148 byte log entry
0709 12:12:54.218868 (+249795us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:54.258279 (+ 39411us) write_op.cc:454] Released schema lock
0709 12:12:54.258349 (+    70us) write_op.cc:341] FINISH: Updating metrics
0709 12:12:54.258852 (+   503us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:54.258882 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":901993,"reported_tablets":25,"child_traces":[["op",{"apply.queue_time_us":233562,"apply.run_cpu_time_us":24425,"apply.run_wall_time_us":794941,"cfile_cache_hit":66,"cfile_cache_hit_bytes":71135,"num_ops":16,"prepare.queue_time_us":935332,"prepare.run_cpu_time_us":30674,"prepare.run_wall_time_us":875689,"raft.queue_time_us":500970,"raft.run_cpu_time_us":108891,"raft.run_wall_time_us":200881,"replication_time_us":1030153,"thread_start_us":1429138,"threads_started":4,"wal-append.queue_time_us":236858}]]}
I20260709 12:12:55.164608 21866 raft_consensus.cc:2749] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:12:55.168912 21801 raft_consensus.cc:515] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:55.181674 21878 raft_consensus.cc:2804] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:12:55.281440 14257 pending_rounds.cc:107] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec: Aborting uncommitted NO_OP operation due to leader change: 18.9
I20260709 12:12:55.187785 21863 raft_consensus.cc:740] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:55.195297 21783 raft_consensus.cc:493] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:55.261547 14188 raft_consensus.cc:1275] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 19 index: 9. (index mismatch)
I20260709 12:12:55.284051 14189 raft_consensus.cc:1240] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 24 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 23. Current term is 24. Ops: []
I20260709 12:12:55.355373 21651 leader_election.cc:290] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 24 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:55.342368 21469 raft_consensus.cc:3055] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:12:55.358850 21469 raft_consensus.cc:740] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:12:55.359805 21469 consensus_queue.cc:260] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:55.281565 21691 consensus_queue.cc:1048] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.054s
I20260709 12:12:55.333169 21882 raft_consensus.cc:515] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:55.305411 21873 raft_consensus.cc:3060] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:55.366861 21836 leader_election.cc:290] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 24 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:12:55.332345 21623 consensus_meta.cc:287] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.593s	user 0.011s	sys 0.000s
I20260709 12:12:55.182242 21841 raft_consensus.cc:515] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:55.369410 21841 leader_election.cc:290] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:55.370098 14256 raft_consensus.cc:1240] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 23. Current term is 24. Ops: []
I20260709 12:12:55.372794 14184 raft_consensus.cc:2468] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 22.
I20260709 12:12:55.298764 14187 raft_consensus.cc:1275] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 12:12:55.173622 21718 raft_consensus.cc:2804] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:12:55.271459 14903 raft_consensus.cc:3060] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:55.314178 14185 raft_consensus.cc:515] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:55.325474 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 25 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:55.281564 21756 raft_consensus.cc:493] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:55.318950 14912 raft_consensus.cc:1240] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 26 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 25. Current term is 26. Ops: [25.16-25.16]
I20260709 12:12:55.195742 21837 raft_consensus.cc:515] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:55.337860 14155 leader_election.cc:304] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:55.303227 21690 raft_consensus.cc:3060] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:55.270964 21872 consensus_queue.cc:1048] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.048s
I20260709 12:12:55.273588 21804 raft_consensus.cc:515] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:55.346000 14257 raft_consensus.cc:2889] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:55.400566 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:55.401311 14330 raft_consensus.cc:2468] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 19.
I20260709 12:12:55.402552 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:55.377723 14303 leader_election.cc:304] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:55.380208 14190 raft_consensus.cc:1240] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 17. Current term is 18. Ops: []
W20260709 12:12:55.384673 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 46922us
I20260709 12:12:55.444320 14903 raft_consensus.cc:2468] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 19.
I20260709 12:12:55.451227 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:12:55.454823 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 77184.1us
I20260709 12:12:55.457616 14185 leader_election.cc:290] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 18 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:55.345606 21878 raft_consensus.cc:493] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:55.360502 21712 raft_consensus.cc:493] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:55.464480 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 23 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:55.464354 14905 raft_consensus.cc:1275] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 23 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 12:12:55.456327 14303 leader_election.cc:304] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:12:55.472808 14303 leader_election.cc:304] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
W20260709 12:12:55.462030 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 51698.5us
I20260709 12:12:55.369451 21801 leader_election.cc:290] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:55.383811 21756 raft_consensus.cc:3060] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:55.378304 21718 raft_consensus.cc:493] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:55.383184 21651 raft_consensus.cc:493] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:55.502643 14155 leader_election.cc:304] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:55.398298 21393 raft_consensus.cc:2749] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:55.480684 14083 catalog_manager.cc:5697] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: term changed from 18 to 20, leader changed from 885067a0d31741bfb5c9935788e315bf (127.12.174.129) to 65c9c1653b3346b39a0e118540e6080c (127.12.174.131). New cstate: current_term: 20 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } }
I20260709 12:12:55.507433 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:55.511708 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:55.517242 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:55.513329 14155 leader_election.cc:304] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:55.459115 21623 raft_consensus.cc:2749] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:55.517130 14339 raft_consensus.cc:2468] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 23.
I20260709 12:12:55.459343 21725 raft_consensus.cc:493] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:55.524729 14333 raft_consensus.cc:1240] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 20. Current term is 21. Ops: []
I20260709 12:12:55.537683 14339 raft_consensus.cc:1240] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 25 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 24. Current term is 25. Ops: [22.12-24.13]
I20260709 12:12:55.538214 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:55.539413 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:55.501950 21875 raft_consensus.cc:2804] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:55.508553 21691 raft_consensus.cc:2804] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:55.378479 21783 raft_consensus.cc:515] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:55.546553 14083 catalog_manager.cc:5697] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: term changed from 9 to 19. New cstate: current_term: 19 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:55.546806 14334 raft_consensus.cc:1240] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 25 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 24. Current term is 25. Ops: []
I20260709 12:12:55.525801 14304 leader_election.cc:304] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:55.501346 21621 raft_consensus.cc:493] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:55.543386 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:55.525023 21801 raft_consensus.cc:2749] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:55.510468 21718 raft_consensus.cc:3060] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:55.482947 21878 raft_consensus.cc:3060] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:55.548329 14083 catalog_manager.cc:5697] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: term changed from 17 to 24. New cstate: current_term: 24 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } }
W20260709 12:12:55.523254 21695 consensus_meta.cc:287] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.693s	user 0.007s	sys 0.003s
I20260709 12:12:55.549919 14304 leader_election.cc:304] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:55.501822 21712 raft_consensus.cc:515] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:55.459892 21774 consensus_queue.cc:260] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:12:55.581724 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 394377us
I20260709 12:12:55.546793 21691 raft_consensus.cc:493] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:55.374159 21861 consensus_queue.cc:237] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:55.542297 21789 consensus_queue.cc:1048] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.038s
I20260709 12:12:55.572443 21393 raft_consensus.cc:2804] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:12:55.534359 21651 raft_consensus.cc:515] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:55.544714 21725 raft_consensus.cc:515] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:55.600394 14083 catalog_manager.cc:5697] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: term changed from 21 to 22, leader changed from 885067a0d31741bfb5c9935788e315bf (127.12.174.129) to 65c9c1653b3346b39a0e118540e6080c (127.12.174.131). New cstate: current_term: 22 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } }
I20260709 12:12:55.572182 21860 raft_consensus.cc:493] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:55.576931 21875 raft_consensus.cc:697] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 19 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:55.589926 21691 raft_consensus.cc:3060] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:55.607645 21875 consensus_queue.cc:237] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:55.558269 21621 raft_consensus.cc:515] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:55.590055 21695 raft_consensus.cc:2749] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:12:55.580590 21882 leader_election.cc:290] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:55.576472 21894 raft_consensus.cc:2749] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:12:55.595129 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 402092us
I20260709 12:12:55.615856 14083 catalog_manager.cc:5697] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: term changed from 8 to 18, leader changed from 885067a0d31741bfb5c9935788e315bf (127.12.174.129) to 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130). New cstate: current_term: 18 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } }
W20260709 12:12:55.639331 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 169264us
I20260709 12:12:55.558476 21644 leader_election.cc:290] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 24 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:55.601850 21393 raft_consensus.cc:493] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:55.647197 14083 catalog_manager.cc:5697] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: term changed from 17 to 18, leader changed from 885067a0d31741bfb5c9935788e315bf (127.12.174.129) to 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130). New cstate: current_term: 18 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:55.662834 14083 catalog_manager.cc:5697] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: term changed from 22 to 23, leader changed from 885067a0d31741bfb5c9935788e315bf (127.12.174.129) to 65c9c1653b3346b39a0e118540e6080c (127.12.174.131). New cstate: current_term: 23 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } }
I20260709 12:12:55.593062 21653 consensus_queue.cc:1059] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 24.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.051s
I20260709 12:12:55.621066 21818 leader_election.cc:290] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:55.686473 21902 consensus_queue.cc:1048] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:12:55.687698 21863 consensus_queue.cc:260] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.13, Last appended by leader: 13, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:55.691314 14229 leader_election.cc:304] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
W20260709 12:12:55.693172 14154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:55.697252 21791 raft_consensus.cc:493] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:55.656248 21393 raft_consensus.cc:3060] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:12:55.698168 21891 consensus_queue.cc:1048] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:12:55.711850 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:55.712397 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:55.723637 14905 raft_consensus.cc:3060] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:55.714248 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:12:55.724773 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 104523us
I20260709 12:12:55.725728 14230 leader_election.cc:304] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:55.726089 14185 raft_consensus.cc:2468] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 20.
I20260709 12:12:55.715073 14183 raft_consensus.cc:1275] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 13. (term mismatch)
I20260709 12:12:55.715749 14876 leader_election.cc:304] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:55.727070 14183 pending_rounds.cc:85] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf: Aborting all ops after (but not including) 12
I20260709 12:12:55.727404 14183 pending_rounds.cc:107] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf: Aborting uncommitted NO_OP operation due to leader change: 21.13
I20260709 12:12:55.727631 14183 raft_consensus.cc:2889] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:55.732080 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:55.732834 14912 raft_consensus.cc:3060] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:55.725303 14330 raft_consensus.cc:2468] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 20.
I20260709 12:12:55.620714 21860 raft_consensus.cc:515] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:55.697851 21695 consensus_queue.cc:1048] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 12:12:55.714174 21837 leader_election.cc:290] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:12:55.715941 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 133585us
I20260709 12:12:55.702121 14083 catalog_manager.cc:5697] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: term changed from 14 to 16, leader changed from 65c9c1653b3346b39a0e118540e6080c (127.12.174.131) to 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130). New cstate: current_term: 16 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:55.768946 14905 raft_consensus.cc:2468] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 24.
I20260709 12:12:55.770607 14229 leader_election.cc:304] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:12:55.733246 21804 leader_election.cc:290] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:55.721900 21791 raft_consensus.cc:515] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:55.721905 21882 raft_consensus.cc:493] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:55.804323 14083 catalog_manager.cc:5697] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: term changed from 21 to 22, leader changed from 885067a0d31741bfb5c9935788e315bf (127.12.174.129) to 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130). New cstate: current_term: 22 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:55.798252 14877 leader_election.cc:304] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:12:55.746096 21897 raft_consensus.cc:2804] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:12:55.716763 21754 raft_consensus.cc:515] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:55.703176 21772 raft_consensus.cc:515] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:55.782104 21217 raft_consensus.cc:2749] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:55.720566 21644 consensus_queue.cc:1059] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.098s
W20260709 12:12:55.823118 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 97503.7us
I20260709 12:12:55.862038 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:55.867215 14265 raft_consensus.cc:2393] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 19: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:12:55.870234 21780 raft_consensus.cc:493] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:55.870875 21780 raft_consensus.cc:515] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:55.873065 21780 leader_election.cc:290] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:55.876612 21910 raft_consensus.cc:493] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:55.877260 21910 raft_consensus.cc:515] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:55.878408 21907 raft_consensus.cc:493] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:12:55.879045 21907 raft_consensus.cc:515] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:55.820051 21890 raft_consensus.cc:2804] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:55.820459 21897 raft_consensus.cc:493] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:12:55.889328 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 124107us
W20260709 12:12:55.892163 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 121657us
I20260709 12:12:55.831543 21766 raft_consensus.cc:3055] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:12:55.844884 21787 leader_election.cc:290] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 26 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:55.893849 14304 leader_election.cc:304] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:55.918355 14304 leader_election.cc:304] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:55.829615 21860 leader_election.cc:290] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:55.879650 21910 leader_election.cc:290] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:55.843189 21783 leader_election.cc:290] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:55.842444 21651 leader_election.cc:290] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:12:55.892510 21874 log.cc:927] Time spent T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 12:12:55.810321 21882 raft_consensus.cc:515] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:55.928638 14083 catalog_manager.cc:5697] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: term changed from 11 to 16, leader changed from 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130) to 65c9c1653b3346b39a0e118540e6080c (127.12.174.131). New cstate: current_term: 16 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } }
I20260709 12:12:55.932914 14181 raft_consensus.cc:1240] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 25 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 24. Current term is 25. Ops: []
I20260709 12:12:55.929185 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:55.893602 21890 raft_consensus.cc:493] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:55.937052 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:55.937841 14257 raft_consensus.cc:2468] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 20.
I20260709 12:12:55.866490 21695 consensus_queue.cc:1048] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 13, Time since last communication: 0.063s
I20260709 12:12:55.940114 14083 catalog_manager.cc:5697] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: term changed from 9 to 20, leader changed from 65c9c1653b3346b39a0e118540e6080c (127.12.174.131) to 885067a0d31741bfb5c9935788e315bf (127.12.174.129). New cstate: current_term: 20 leader_uuid: "885067a0d31741bfb5c9935788e315bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } }
I20260709 12:12:55.942315 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:55.913228 21766 raft_consensus.cc:740] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:12:55.912868 21897 raft_consensus.cc:3060] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:55.866755 21891 consensus_queue.cc:1059] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 24.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.063s
I20260709 12:12:55.881491 21873 raft_consensus.cc:515] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:55.926824 21711 raft_consensus.cc:2749] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 12:12:55.939771 21890 raft_consensus.cc:3060] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:55.939684 21860 raft_consensus.cc:2804] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:12:55.926129 21906 raft_consensus.cc:493] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:55.933494 21725 leader_election.cc:290] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:12:55.939939 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 417579us
I20260709 12:12:55.945963 14083 catalog_manager.cc:5697] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: term changed from 13 to 18, leader changed from 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130) to 65c9c1653b3346b39a0e118540e6080c (127.12.174.131). New cstate: current_term: 18 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } }
I20260709 12:12:55.974516 14083 catalog_manager.cc:5697] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: term changed from 14 to 16, leader changed from 65c9c1653b3346b39a0e118540e6080c (127.12.174.131) to 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130). New cstate: current_term: 16 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:55.939443 21910 raft_consensus.cc:493] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:12:55.976085 21837 consensus_queue.cc:1048] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:12:55.976303 14155 leader_election.cc:304] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:55.976222 14083 catalog_manager.cc:5697] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "885067a0d31741bfb5c9935788e315bf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:12:55.927129 21718 raft_consensus.cc:515] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:12:55.978649 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 117144us
I20260709 12:12:55.991142 14230 leader_election.cc:304] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:55.983909 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:55.984684 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:55.985086 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: true dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:55.993569 14264 raft_consensus.cc:2468] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 19.
I20260709 12:12:55.993659 14260 raft_consensus.cc:3060] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:55.995069 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:55.995940 14264 raft_consensus.cc:2468] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 22.
I20260709 12:12:55.997236 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:55.999195 14264 raft_consensus.cc:3060] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:56.002921 14263 raft_consensus.cc:2393] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 20: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:12:56.005793 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:55.946978 21756 raft_consensus.cc:515] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:56.018523 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:56.019753 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:56.011294 14083 catalog_manager.cc:5697] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: term changed from 12 to 21, leader changed from 65c9c1653b3346b39a0e118540e6080c (127.12.174.131) to 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130). New cstate: current_term: 21 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:56.016371 21754 leader_election.cc:290] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 19 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:56.023454 14262 raft_consensus.cc:2393] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 24: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:12:55.979605 21632 raft_consensus.cc:2749] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:56.024722 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:56.038458 14256 raft_consensus.cc:1240] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 22. Current term is 23. Ops: []
W20260709 12:12:56.035590 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 44575.8us
I20260709 12:12:56.033725 14260 raft_consensus.cc:2468] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 18.
I20260709 12:12:55.967378 21844 consensus_queue.cc:1059] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 24.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.044s
I20260709 12:12:56.041512 14912 raft_consensus.cc:2468] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 24.
I20260709 12:12:56.048059 14229 leader_election.cc:304] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:12:56.048476 14264 raft_consensus.cc:2468] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 21.
I20260709 12:12:56.050722 14155 leader_election.cc:304] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:55.976609 21910 raft_consensus.cc:515] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:56.112900 21922 raft_consensus.cc:493] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:12:56.113615 21924 raft_consensus.cc:2804] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:12:56.113541 21922 raft_consensus.cc:515] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } }
I20260709 12:12:56.114418 21924 raft_consensus.cc:697] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 24 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:56.115322 21924 consensus_queue.cc:237] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:56.116021 21922 leader_election.cc:290] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187)
I20260709 12:12:56.052376 14877 leader_election.cc:304] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:55.979965 21780 consensus_queue.cc:1048] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.057s
I20260709 12:12:56.034407 21921 raft_consensus.cc:493] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:56.017932 21860 raft_consensus.cc:697] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 24 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:55.980463 21861 consensus_queue.cc:1048] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.057s
I20260709 12:12:55.988634 21711 consensus_queue.cc:1059] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.065s
W20260709 12:12:56.118770 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 79216.3us
I20260709 12:12:56.044672 21783 raft_consensus.cc:2749] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:12:56.018541 21789 consensus_queue.cc:1048] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.054s
I20260709 12:12:56.125552 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
W20260709 12:12:56.127446 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 76812.2us
I20260709 12:12:56.127851 21837 raft_consensus.cc:2749] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 12:12:56.034407 21881 consensus_queue.cc:1048] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.128s
I20260709 12:12:56.128080 21921 raft_consensus.cc:515] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:12:56.129370 21908 log.cc:927] Time spent T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.170s	user 0.000s	sys 0.000s
I20260709 12:12:56.128966 21518 consensus_queue.cc:260] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:56.129634 21912 raft_consensus.cc:2804] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:12:56.187649 21912 raft_consensus.cc:493] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:56.188097 21912 raft_consensus.cc:3060] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:56.189790 21873 leader_election.cc:290] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:56.130110 21917 consensus_queue.cc:1059] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.072s
I20260709 12:12:56.130673 21909 raft_consensus.cc:2749] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:56.178879 21711 consensus_queue.cc:1243] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer 17aab1bbf5014936aa18cc21818b26ec log is divergent from this leader: its last log entry 22.16 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 15
I20260709 12:12:56.057390 21801 consensus_queue.cc:1059] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.077s
W20260709 12:12:56.135556 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 83279.2us
I20260709 12:12:55.977674 21906 raft_consensus.cc:515] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:56.135402 14303 leader_election.cc:304] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
W20260709 12:12:56.336396 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 201091us
I20260709 12:12:56.056375 21725 raft_consensus.cc:493] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:56.154330 14230 leader_election.cc:304] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
W20260709 12:12:56.339371 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 185289us
I20260709 12:12:56.340281 14230 leader_election.cc:304] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
W20260709 12:12:56.158891 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 110932us
I20260709 12:12:56.167193 14338 raft_consensus.cc:2393] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db in current term 19: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
W20260709 12:12:56.128388 21903 log.cc:927] Time spent T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
I20260709 12:12:56.169165 21882 leader_election.cc:290] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:56.172724 14155 leader_election.cc:304] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:56.119609 21913 raft_consensus.cc:493] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:12:56.137914 21804 raft_consensus.cc:493] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:56.178227 21837 raft_consensus.cc:493] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:56.183916 21907 leader_election.cc:290] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:56.161502 21841 raft_consensus.cc:2749] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 12:12:56.111476 21695 raft_consensus.cc:493] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:56.186765 21920 raft_consensus.cc:493] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:56.153244 21632 raft_consensus.cc:493] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
W20260709 12:12:56.178720 21690 consensus_meta.cc:287] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.716s	user 0.013s	sys 0.000s
I20260709 12:12:56.131146 21925 raft_consensus.cc:493] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:12:56.347465 21929 raft_consensus.cc:2804] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:56.402128 21929 raft_consensus.cc:493] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:56.402495 21929 raft_consensus.cc:3060] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:12:56.403218 21892 log.cc:927] Time spent T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.756s	user 0.000s	sys 0.002s
I20260709 12:12:56.404448 21783 raft_consensus.cc:493] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:56.404989 21783 raft_consensus.cc:515] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:56.369029 21913 raft_consensus.cc:515] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:56.407199 21783 leader_election.cc:290] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:56.407967 21913 leader_election.cc:290] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:56.409540 14260 raft_consensus.cc:1240] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 20. Current term is 21. Ops: []
I20260709 12:12:56.410671 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:12:56.365520 21878 consensus_meta.cc:287] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.778s	user 0.013s	sys 0.000s
I20260709 12:12:56.412606 21878 raft_consensus.cc:515] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:56.414036 14263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41764 (request call id 3797) took 1238 ms. Trace:
I20260709 12:12:56.414448 14263 rpcz_store.cc:276] 0709 12:12:55.176376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:55.176474 (+    98us) service_pool.cc:224] Handling call
0709 12:12:56.413827 (+1237353us) spinlock_profiling.cc:243] Waited 767 ms on lock 0x7b54002c0454. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:12:56.413966 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1763887872}
I20260709 12:12:56.414826 21878 leader_election.cc:290] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 23 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:56.415772 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 27 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:56.416970 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:56.351382 21622 raft_consensus.cc:493] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:56.418120 21622 raft_consensus.cc:515] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:56.420365 21622 leader_election.cc:290] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:12:56.420819 14290 heartbeater.cc:646] Failed to heartbeat to 127.12.174.190:39655 (5 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.12.174.190:39655 timed out after 15.000s (SENT)
I20260709 12:12:56.421365 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 27 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:56.422614 21923 raft_consensus.cc:3055] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 25 LEADER]: Stepping down as leader of term 25
I20260709 12:12:56.422802 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:56.423054 21923 raft_consensus.cc:740] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:56.275169 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:56.424059 14256 raft_consensus.cc:2468] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 19.
W20260709 12:12:56.424788 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 252161us
I20260709 12:12:56.425454 14256 raft_consensus.cc:1275] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 12:12:56.425561 14155 leader_election.cc:304] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:56.392970 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:56.232610 21393 raft_consensus.cc:515] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:12:56.229141 21691 consensus_meta.cc:287] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.621s	user 0.011s	sys 0.001s
I20260709 12:12:56.227283 21905 raft_consensus.cc:493] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:12:56.364327 21644 raft_consensus.cc:493] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:56.251186 21921 leader_election.cc:290] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:56.180717 21791 leader_election.cc:290] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:56.256664 21910 leader_election.cc:290] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:56.315476 21916 raft_consensus.cc:493] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:56.237043 21718 leader_election.cc:290] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 23 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:56.330667 21780 raft_consensus.cc:3055] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:12:56.345824 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:56.341637 14230 leader_election.cc:304] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
W20260709 12:12:56.355777 14877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:56.360857 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:56.364813 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:56.368454 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:56.362918 21711 raft_consensus.cc:493] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:56.430568 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:56.428099 14304 leader_election.cc:304] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:56.431908 14259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41764 (request call id 3790) took 1268 ms. Trace:
I20260709 12:12:56.350371 21873 raft_consensus.cc:2749] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:56.401269 21906 leader_election.cc:290] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:56.399631 21632 raft_consensus.cc:515] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:56.353328 21877 consensus_queue.cc:1048] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.079s
I20260709 12:12:56.399276 21695 raft_consensus.cc:515] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:56.399907 21837 raft_consensus.cc:515] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:56.447487 21935 raft_consensus.cc:493] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:56.448446 21469 raft_consensus.cc:3060] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:56.449918 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:56.394344 21909 raft_consensus.cc:493] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:56.455686 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:56.535836 14338 raft_consensus.cc:3060] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:56.536484 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:56.457191 14332 raft_consensus.cc:1275] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 12:12:56.458002 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:56.398803 21838 raft_consensus.cc:493] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:12:56.507642 14909 raft_consensus.cc:2393] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 21: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
I20260709 12:12:56.545630 14182 raft_consensus.cc:2393] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 24: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:12:56.400444 21925 raft_consensus.cc:515] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:56.476620 14263 raft_consensus.cc:2468] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 19.
W20260709 12:12:56.508749 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 46638.1us
I20260709 12:12:56.549996 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:56.550209 14229 leader_election.cc:304] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:56.453236 21644 raft_consensus.cc:515] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:56.437629 21902 raft_consensus.cc:493] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:56.509572 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:56.392374 21844 consensus_queue.cc:1059] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 22.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.060s
W20260709 12:12:56.510304 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 168748us
I20260709 12:12:56.507709 14912 raft_consensus.cc:2393] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 19: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
W20260709 12:12:56.552160 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 113214us
I20260709 12:12:56.461679 14911 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59144 (request call id 818) took 1060 ms. Trace:
I20260709 12:12:56.462694 14333 raft_consensus.cc:1275] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 12:12:56.510949 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:56.511214 14186 raft_consensus.cc:2468] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 20.
I20260709 12:12:56.449908 21930 consensus_queue.cc:1059] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 24.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.070s
I20260709 12:12:56.514515 21711 raft_consensus.cc:515] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:56.433141 21882 raft_consensus.cc:2749] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:12:56.454356 21923 consensus_queue.cc:260] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 25.16, Last appended by leader: 16, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:56.443487 21897 raft_consensus.cc:515] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:56.513530 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:56.352706 21725 raft_consensus.cc:515] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:56.443106 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:12:56.523895 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 95869.8us
I20260709 12:12:56.399888 21690 raft_consensus.cc:515] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:56.392534 21804 raft_consensus.cc:515] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:56.527298 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:56.526289 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:56.458941 21780 raft_consensus.cc:740] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:12:56.509888 21718 raft_consensus.cc:2749] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 12:12:56.439935 21691 raft_consensus.cc:515] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:56.456254 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:56.399480 21920 raft_consensus.cc:515] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:56.234424 21860 consensus_queue.cc:237] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:56.440135 21934 raft_consensus.cc:2749] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:56.564693 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:56.597100 21924 raft_consensus.cc:493] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:56.444969 21905 raft_consensus.cc:515] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:56.507858 14259 rpcz_store.cc:276] 0709 12:12:55.163770 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:55.163886 (+   116us) service_pool.cc:224] Handling call
0709 12:12:55.164180 (+   294us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:55.164904 (+   724us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:55.164935 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:55.171823 (+  6888us) log.cc:844] Serialized 26 byte log entry
0709 12:12:55.378478 (+206655us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:12:55.378522 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:55.378810 (+   288us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:56.402624 (+1023814us) spinlock_profiling.cc:243] Waited 59.6 ms on lock 0x7b4400022b4c. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2123f74c85 00007f2123f756a2 00007f2126ce71db 00007f2126ce2aaf 00007f2126cd686e 00007f2126cd5bb6 00007f2126cd57d8 00007f2126cdf221 00007f2126cdf1d9 00007f2126cdf169
0709 12:12:56.431590 (+ 28966us) raft_consensus.cc:1685] finished
0709 12:12:56.431613 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:56.431838 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":301,"raft.queue_time_us":2866,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":4429,"spinlock_wait_cycles":137139968,"thread_start_us":163267,"threads_started":1,"wal-append.queue_time_us":403539}
I20260709 12:12:56.585888 14229 leader_election.cc:304] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:56.595857 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 25 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:56.598582 14338 raft_consensus.cc:2468] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 24.
I20260709 12:12:56.617336 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:56.617518 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:56.618161 14338 raft_consensus.cc:2468] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 20.
I20260709 12:12:56.582019 14911 rpcz_store.cc:276] 0709 12:12:55.392066 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:55.392186 (+   120us) service_pool.cc:224] Handling call
0709 12:12:55.392577 (+   391us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:55.407241 (+ 14664us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:55.407281 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:55.480808 (+ 73527us) log.cc:844] Serialized 26 byte log entry
0709 12:12:55.764407 (+283599us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:55.764454 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:55.764530 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:56.452508 (+687978us) raft_consensus.cc:1685] finished
0709 12:12:56.452534 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:56.452680 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14154,"raft.queue_time_us":79104,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":109,"thread_start_us":225070,"threads_started":1,"wal-append.queue_time_us":401322}
I20260709 12:12:56.603130 14336 raft_consensus.cc:1275] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 26 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 25 index: 12. Preceding OpId from leader: term: 26 index: 12. (term mismatch)
I20260709 12:12:56.618914 14336 pending_rounds.cc:85] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c: Aborting all ops after (but not including) 11
I20260709 12:12:56.619181 14336 pending_rounds.cc:107] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c: Aborting uncommitted NO_OP operation due to leader change: 25.12
I20260709 12:12:56.619503 14336 raft_consensus.cc:2889] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 26 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:56.620713 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:56.621331 21711 leader_election.cc:290] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:56.552582 21912 raft_consensus.cc:515] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:56.603818 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:56.604465 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:56.599684 14155 leader_election.cc:304] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:56.606607 14337 raft_consensus.cc:2468] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 24.
I20260709 12:12:56.593397 21907 raft_consensus.cc:2749] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:56.589318 21791 raft_consensus.cc:493] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
W20260709 12:12:56.601246 21890 consensus_meta.cc:287] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db: Time spent flushing consensus metadata: real 0.621s	user 0.005s	sys 0.006s
I20260709 12:12:56.612613 14261 raft_consensus.cc:2368] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 23. Current term is 24.
I20260709 12:12:56.507198 21916 raft_consensus.cc:515] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:56.585517 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:56.595819 21921 raft_consensus.cc:493] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:56.634306 14186 raft_consensus.cc:3060] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:56.601570 21906 raft_consensus.cc:3055] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:12:56.606304 21450 raft_consensus.cc:493] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:56.623699 21691 leader_election.cc:290] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 20 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:56.625689 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:56.603544 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:56.627179 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:56.626601 14304 leader_election.cc:304] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:56.645205 14332 raft_consensus.cc:3060] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:56.647003 14304 leader_election.cc:304] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:56.629571 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:56.629643 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:56.648020 14337 raft_consensus.cc:2393] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 25: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:12:56.648456 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:56.631009 21930 raft_consensus.cc:2804] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:56.550908 21838 raft_consensus.cc:515] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:56.542937 21935 raft_consensus.cc:515] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:56.615722 21923 raft_consensus.cc:3060] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:12:56.634440 21921 raft_consensus.cc:515] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:56.618530 14182 raft_consensus.cc:1240] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 24 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 23. Current term is 24. Ops: [23.14-23.14]
I20260709 12:12:56.658876 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:56.659500 14182 raft_consensus.cc:2468] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 23.
I20260709 12:12:56.627749 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:56.648929 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:56.629434 14155 leader_election.cc:304] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:56.662493 14155 leader_election.cc:304] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:56.648959 21861 raft_consensus.cc:2749] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:12:56.660671 14303 leader_election.cc:304] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:56.650892 14304 leader_election.cc:304] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:56.652185 14331 raft_consensus.cc:2368] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 23. Current term is 24.
I20260709 12:12:56.631717 21718 raft_consensus.cc:2804] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:56.655930 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:56.668673 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:56.656250 21936 raft_consensus.cc:2804] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:12:56.665015 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:56.638877 21906 raft_consensus.cc:740] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:12:56.677181 14337 raft_consensus.cc:2393] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 20: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:12:56.675313 14230 leader_election.cc:304] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:12:56.654152 21711 raft_consensus.cc:2749] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:12:56.683166 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:56.654721 21930 raft_consensus.cc:493] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:56.685514 21930 raft_consensus.cc:3060] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:56.686306 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:56.686558 21907 raft_consensus.cc:2804] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:56.686975 21907 raft_consensus.cc:493] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:56.687311 21907 raft_consensus.cc:3060] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:56.692124 14332 raft_consensus.cc:2468] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 24.
I20260709 12:12:56.657291 21393 leader_election.cc:290] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:56.624328 21924 raft_consensus.cc:515] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:12:56.704372 14305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:56.668632 21691 raft_consensus.cc:2749] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:12:56.674567 21718 raft_consensus.cc:493] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:56.638450 21791 raft_consensus.cc:515] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:56.684892 21877 raft_consensus.cc:2804] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:12:56.637270 21780 consensus_queue.cc:260] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 24.13, Last appended by leader: 13, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:56.651872 21450 raft_consensus.cc:515] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:56.716662 21873 consensus_queue.cc:1048] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:12:56.676008 21934 raft_consensus.cc:2804] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:12:56.663529 21783 consensus_queue.cc:1059] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 22.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.043s
W20260709 12:12:56.705950 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 156903us
I20260709 12:12:56.684645 21882 consensus_queue.cc:1059] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.104s
I20260709 12:12:56.785005 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 25 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:56.701224 21913 raft_consensus.cc:493] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:56.684737 21936 raft_consensus.cc:697] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 21 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:56.804986 14333 raft_consensus.cc:2393] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 25: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:12:56.798127 14877 leader_election.cc:304] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:56.546893 21909 raft_consensus.cc:515] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:56.817929 21909 leader_election.cc:290] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:12:56.802321 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 111555us
I20260709 12:12:56.719422 21718 raft_consensus.cc:3060] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:56.592502 21902 raft_consensus.cc:515] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:56.820132 14230 leader_election.cc:304] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:56.820413 21902 leader_election.cc:290] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:56.638019 21890 raft_consensus.cc:515] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:12:56.811280 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 132312us
I20260709 12:12:56.787196 21877 raft_consensus.cc:493] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:56.821552 21877 raft_consensus.cc:3060] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:12:56.696569 21930 raft_consensus.cc:515] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:56.822057 14905 raft_consensus.cc:2393] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 21: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
I20260709 12:12:56.825449 14176 tablet_service.cc:1558] Processing DeleteTablet for tablet 35b39d0f3270452a8bd4f4b1800a837c with delete_type TABLET_DATA_TOMBSTONED (TS 885067a0d31741bfb5c9935788e315bf not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:45350
I20260709 12:12:56.827589 21930 leader_election.cc:290] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 21 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:56.696849 21907 raft_consensus.cc:515] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:56.791980 21827 raft_consensus.cc:493] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:56.834702 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:56.836293 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:56.836362 14230 leader_election.cc:304] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:56.838887 14182 raft_consensus.cc:2410] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for term 22 because replica has last-logged OpId of term: 20 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 12.
I20260709 12:12:56.837986 14911 raft_consensus.cc:2468] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 19.
I20260709 12:12:56.796030 21804 leader_election.cc:290] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:56.844836 14229 leader_election.cc:304] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:12:56.795879 21621 leader_election.cc:290] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:56.802539 21954 raft_consensus.cc:493] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:56.830787 21780 raft_consensus.cc:3060] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:12:56.813119 21934 raft_consensus.cc:697] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 18 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:12:56.832118 21913 raft_consensus.cc:515] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:56.809023 21925 leader_election.cc:290] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:12:56.882140 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 45903us
I20260709 12:12:56.883087 14230 leader_election.cc:304] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:56.848873 21725 leader_election.cc:290] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:56.887624 14155 leader_election.cc:304] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:56.891623 14155 leader_election.cc:304] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:12:56.861528 21644 leader_election.cc:290] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:56.850409 21945 raft_consensus.cc:2804] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:12:56.793723 21906 consensus_queue.cc:260] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 14, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:56.904834 14333 raft_consensus.cc:1240] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 23. Current term is 24. Ops: [23.14-23.14]
I20260709 12:12:56.912096 14155 leader_election.cc:304] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
W20260709 12:12:56.923782 14877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:56.925441 14186 raft_consensus.cc:2468] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 20.
I20260709 12:12:56.877090 21882 consensus_queue.cc:1048] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.021s
I20260709 12:12:56.878378 21897 leader_election.cc:290] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 24 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:56.852324 21954 raft_consensus.cc:515] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:56.847067 21827 raft_consensus.cc:515] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:56.910876 21804 raft_consensus.cc:2749] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:56.932052 21393 raft_consensus.cc:2804] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:12:56.922087 21621 raft_consensus.cc:2804] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 24 FOLLOWER]: Leader election won for term 24
W20260709 12:12:56.973690 21941 log.cc:927] Time spent T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.274s	user 0.000s	sys 0.001s
I20260709 12:12:56.974822 21881 raft_consensus.cc:3055] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 20 LEADER]: Stepping down as leader of term 20
W20260709 12:12:56.980108 21944 log.cc:927] Time spent T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.296s	user 0.001s	sys 0.000s
I20260709 12:12:56.981169 21956 raft_consensus.cc:2749] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:56.982996 21924 leader_election.cc:290] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:56.984565 21962 raft_consensus.cc:2804] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:56.984992 21935 leader_election.cc:290] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:12:57.049583 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 204841us
I20260709 12:12:56.972929 21933 consensus_queue.cc:1048] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.266s
I20260709 12:12:56.977794 21953 raft_consensus.cc:2749] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:56.924670 21644 raft_consensus.cc:3060] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:12:57.091908 21393 raft_consensus.cc:493] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:57.110316 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:57.092563 21930 raft_consensus.cc:493] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:56.952279 21912 leader_election.cc:290] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 24 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:56.914536 21943 raft_consensus.cc:2804] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:12:57.093207 21906 raft_consensus.cc:3060] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 24 FOLLOWER]: Advancing to term 25
W20260709 12:12:57.118175 21942 log.cc:927] Time spent T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.436s	user 0.000s	sys 0.001s
I20260709 12:12:57.092885 21725 raft_consensus.cc:493] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:12:57.134950 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:57.135492 14190 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56652 (request call id 1905) took 1963 ms. Trace:
I20260709 12:12:56.934942 21945 raft_consensus.cc:697] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 19 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:12:57.133013 21924 raft_consensus.cc:493] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:57.146350 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:57.117472 21881 raft_consensus.cc:740] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:12:56.857563 21934 consensus_queue.cc:237] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:57.118745 21916 leader_election.cc:290] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:57.128906 21962 raft_consensus.cc:493] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:57.155786 14189 raft_consensus.cc:2410] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for term 25 because replica has last-logged OpId of term: 24 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 11.
I20260709 12:12:57.152884 14190 rpcz_store.cc:276] 0709 12:12:55.171818 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:55.171975 (+   157us) service_pool.cc:224] Handling call
0709 12:12:55.172268 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:55.408530 (+236262us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:57.135224 (+1726694us) spinlock_profiling.cc:243] Waited 208 ms on lock 0x7b54003f2ad4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:12:57.135421 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":477729664}
I20260709 12:12:57.145794 21393 raft_consensus.cc:3060] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:57.136206 21921 leader_election.cc:290] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:57.135748 21935 raft_consensus.cc:493] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:57.178025 21962 raft_consensus.cc:3060] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:56.970309 21936 consensus_queue.cc:237] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:57.186697 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:57.191651 21894 raft_consensus.cc:3055] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:12:57.202553 21894 raft_consensus.cc:740] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:57.192499 14261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41768 (request call id 2655) took 1206 ms. Trace:
I20260709 12:12:57.150882 21930 raft_consensus.cc:515] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:57.205106 14261 rpcz_store.cc:276] 0709 12:12:55.985784 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:55.985938 (+   154us) service_pool.cc:224] Handling call
0709 12:12:57.192145 (+1206207us) spinlock_profiling.cc:243] Waited 593 ms on lock 0x7b5400210a54. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:12:57.192400 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1364452608}
I20260709 12:12:57.203428 21894 consensus_queue.cc:260] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.16, Last appended by leader: 16, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:57.187594 21960 tablet_replica.cc:333] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf: stopping tablet replica
I20260709 12:12:57.152621 21877 raft_consensus.cc:515] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:12:57.182600 21929 consensus_meta.cc:287] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.780s	user 0.009s	sys 0.004s
I20260709 12:12:57.169101 21725 raft_consensus.cc:515] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } }
I20260709 12:12:57.264005 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:57.264591 14261 raft_consensus.cc:2468] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 19.
I20260709 12:12:57.174587 21924 raft_consensus.cc:515] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:57.265350 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:57.266577 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:57.204288 21450 leader_election.cc:290] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:57.270483 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:57.246455 21882 raft_consensus.cc:493] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
W20260709 12:12:57.258441 21942 log.cc:927] Time spent T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.062s	user 0.000s	sys 0.004s
W20260709 12:12:57.263697 21469 consensus_meta.cc:287] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db: Time spent flushing consensus metadata: real 0.720s	user 0.012s	sys 0.000s
I20260709 12:12:57.179610 21955 consensus_queue.cc:1048] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.092s
I20260709 12:12:57.271878 14261 raft_consensus.cc:3060] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Advancing to term 21
I20260709 12:12:57.196015 21935 raft_consensus.cc:515] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:57.263877 21894 raft_consensus.cc:3060] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:12:57.294664 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:57.273033 21916 raft_consensus.cc:493] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:57.307237 14261 raft_consensus.cc:2468] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 21.
I20260709 12:12:57.308868 21712 leader_election.cc:290] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:57.308580 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:57.312462 14261 raft_consensus.cc:2368] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 19. Current term is 20.
I20260709 12:12:57.276290 21621 raft_consensus.cc:697] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 24 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:12:57.313421 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:57.314222 14261 raft_consensus.cc:2468] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 21.
I20260709 12:12:57.312230 21827 leader_election.cc:290] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:12:57.316313 14155 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:57.330339 14265 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41764 (request call id 3791) took 2165 ms (client timeout 1907 ms). Trace:
W20260709 12:12:57.330755 21961 log.cc:927] Time spent T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
I20260709 12:12:57.332172 14155 leader_election.cc:400] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 23 pre-election: Vote denied by peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673) with higher term. Message: Invalid argument: T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 23. Current term is 24.
I20260709 12:12:57.332530 14155 leader_election.cc:403] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 23 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:12:57.270668 21945 consensus_queue.cc:237] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:57.318464 21907 leader_election.cc:290] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 21 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:57.320130 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:57.322813 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:57.336874 14333 raft_consensus.cc:2368] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 19. Current term is 20.
I20260709 12:12:57.324391 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 22 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:57.326684 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:57.262856 21929 raft_consensus.cc:515] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:57.329133 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:57.278328 21882 raft_consensus.cc:515] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:12:57.330770 14265 rpcz_store.cc:269] 0709 12:12:55.165261 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:55.165385 (+   124us) service_pool.cc:224] Handling call
0709 12:12:57.330063 (+2164678us) spinlock_profiling.cc:243] Waited 692 ms on lock 0x7b54002224d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:12:57.330237 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1591632128}
I20260709 12:12:57.338711 14304 leader_election.cc:304] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:12:57.327533 21766 consensus_queue.cc:260] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.17, Last appended by leader: 17, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:57.339048 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:57.352188 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:57.336194 21968 raft_consensus.cc:493] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:57.352924 14265 raft_consensus.cc:2468] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 24.
I20260709 12:12:57.341090 21712 raft_consensus.cc:3060] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Advancing to term 24
I20260709 12:12:57.348495 21954 leader_election.cc:290] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:57.345057 21789 raft_consensus.cc:2804] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:57.356511 21789 raft_consensus.cc:493] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:57.340612 21912 raft_consensus.cc:493] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:57.355149 21725 leader_election.cc:290] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:57.356904 21789 raft_consensus.cc:3060] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:57.357566 14335 raft_consensus.cc:2393] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 21: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:12:57.306713 21718 raft_consensus.cc:515] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:57.312175 21916 raft_consensus.cc:515] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:57.360311 21912 raft_consensus.cc:515] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:57.273128 21881 consensus_queue.cc:260] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:57.355755 21877 leader_election.cc:290] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 25 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:12:57.358747 21875 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.678s	user 0.005s	sys 0.023s
I20260709 12:12:57.354624 21621 consensus_queue.cc:237] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:57.355717 21968 raft_consensus.cc:515] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:57.362180 21766 raft_consensus.cc:3060] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 24 FOLLOWER]: Advancing to term 25
W20260709 12:12:57.371104 21875 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.691s	user 0.005s	sys 0.023s
I20260709 12:12:57.382758 21881 raft_consensus.cc:3060] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:57.383496 21912 leader_election.cc:290] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:57.384502 21924 leader_election.cc:290] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:57.383427 21718 leader_election.cc:290] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 21 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:57.386368 21916 leader_election.cc:290] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:57.386382 21968 leader_election.cc:290] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:57.384894 21929 leader_election.cc:290] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 21 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:57.391367 21962 raft_consensus.cc:515] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:57.392665 21935 leader_election.cc:290] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:57.380038 21930 leader_election.cc:290] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:57.393693 21882 leader_election.cc:290] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:57.393067 21962 leader_election.cc:290] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:12:57.395354 21923 consensus_meta.cc:287] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.731s	user 0.010s	sys 0.001s
I20260709 12:12:57.337529 14155 leader_election.cc:304] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:57.422959 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:57.437089 14257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41764 (request call id 3799) took 1469 ms. Trace:
I20260709 12:12:57.433502 14187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 3724) took 1066 ms. Trace:
W20260709 12:12:57.438153 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 100542us
I20260709 12:12:57.438648 14261 raft_consensus.cc:2393] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 20: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:12:57.356685 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:57.441645 14155 leader_election.cc:400] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 election: Vote denied by peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673) with higher term. Message: Invalid argument: T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 19. Current term is 20.
I20260709 12:12:57.441876 14265 raft_consensus.cc:2468] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 19.
I20260709 12:12:57.443094 14155 leader_election.cc:403] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 12:12:57.444401 14911 raft_consensus.cc:1275] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 24 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 12:12:57.444553 14155 leader_election.cc:304] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:57.444902 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:57.446403 14265 raft_consensus.cc:2393] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 23: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:12:57.447296 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:57.440271 14187 rpcz_store.cc:276] 0709 12:12:56.366284 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:56.366423 (+   139us) service_pool.cc:224] Handling call
0709 12:12:56.368168 (+  1745us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:56.535325 (+167157us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:56.535371 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:56.535424 (+    53us) raft_consensus.cc:1645] Marking committed up to 16
0709 12:12:56.535461 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:57.432555 (+897094us) spinlock_profiling.cc:243] Waited 167 ms on lock 0x7b5400110dd4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:12:57.432676 (+   121us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:57.433125 (+   449us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":383863552}
I20260709 12:12:57.455060 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:57.476866 14912 raft_consensus.cc:3060] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:57.463650 21644 raft_consensus.cc:2749] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:12:57.447489 14188 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56046 (request call id 3217) took 1077 ms. Trace:
I20260709 12:12:57.471479 14263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41764 (request call id 3809) took 1073 ms. Trace:
I20260709 12:12:57.446287 14259 raft_consensus.cc:2393] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 21: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:12:57.473423 14264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41768 (request call id 2660) took 1485 ms. Trace:
W20260709 12:12:57.439697 14877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:57.439101 14257 rpcz_store.cc:276] 0709 12:12:55.967901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:55.968014 (+   113us) service_pool.cc:224] Handling call
0709 12:12:55.968303 (+   289us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:55.968600 (+   297us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:55.968626 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:55.969088 (+   462us) log.cc:844] Serialized 26 byte log entry
0709 12:12:57.435492 (+1466404us) spinlock_profiling.cc:243] Waited 1.9 ms on lock 0x7b18001c74a0. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f212cf16ab1 00007f212cf23281 00007f2126ce34bc 00007f212403148b 00007f212ce8b9a9 00007f212404d69b 00007f212404b93f 00007f212404dc02 00007f2126cd520b 00007f2126cdad23 00007f2126cdb0d1
0709 12:12:57.435956 (+   464us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:12:57.436049 (+    93us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:57.436203 (+   154us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:57.436278 (+    75us) raft_consensus.cc:1685] finished
0709 12:12:57.436292 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:57.436730 (+   438us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":65833,"raft.queue_time_us":19773,"raft.run_cpu_time_us":218,"raft.run_wall_time_us":24328,"spinlock_wait_cycles":4380416,"thread_start_us":66060,"threads_started":1,"wal-append.queue_time_us":205184,"wal-append.run_cpu_time_us":1963,"wal-append.run_wall_time_us":1077691}
I20260709 12:12:57.447759 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 20 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:12:57.447577 14229 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.174.132:37341 timed out after 1.525s (SENT) [suppressed 4 similar messages]
I20260709 12:12:57.483986 14263 rpcz_store.cc:276] 0709 12:12:56.397438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:56.549814 (+152376us) service_pool.cc:224] Handling call
0709 12:12:56.550139 (+   325us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:56.837256 (+287117us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:12:56.837292 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:56.837843 (+   551us) log.cc:844] Serialized 26 byte log entry
0709 12:12:56.918119 (+ 80276us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:12:56.918161 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:57.470515 (+552354us) spinlock_profiling.cc:243] Waited 271 ms on lock 0x7b54002652d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:12:57.470616 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:57.470725 (+   109us) raft_consensus.cc:1685] finished
0709 12:12:57.470754 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:57.471197 (+   443us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":57259,"raft.queue_time_us":66006,"raft.run_cpu_time_us":201,"raft.run_wall_time_us":32504,"spinlock_wait_cycles":622392704,"thread_start_us":79941,"threads_started":1,"wal-append.queue_time_us":325388}
I20260709 12:12:57.484280 14264 rpcz_store.cc:276] 0709 12:12:55.987477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:56.049373 (+ 61896us) service_pool.cc:224] Handling call
0709 12:12:56.049729 (+   356us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:56.332147 (+282418us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:56.332183 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:56.332228 (+    45us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:12:56.332259 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:57.472713 (+1140454us) spinlock_profiling.cc:243] Waited 282 ms on lock 0x7b54002fce54. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:12:57.472808 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:57.473143 (+   335us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":648934272}
I20260709 12:12:57.483732 14188 rpcz_store.cc:276] 0709 12:12:56.370056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:56.616579 (+246523us) service_pool.cc:224] Handling call
0709 12:12:56.635844 (+ 19265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:56.641179 (+  5335us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:56.641214 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:56.641251 (+    37us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:12:56.641273 (+    22us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:57.446873 (+805600us) spinlock_profiling.cc:243] Waited 5.11 ms on lock 0x7b54001121d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:12:57.446946 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:57.447246 (+   300us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11757952}
I20260709 12:12:57.500200 21935 raft_consensus.cc:2749] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673) with higher term. Message: Invalid argument: T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 19. Current term is 20.
I20260709 12:12:57.501808 21930 raft_consensus.cc:2804] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:12:57.502810 21930 raft_consensus.cc:697] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 21 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:12:57.483112 21932 raft_consensus.cc:2749] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:57.524480 21651 raft_consensus.cc:3055] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:12:57.525168 21651 raft_consensus.cc:740] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:57.532963 21772 leader_election.cc:290] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:12:57.533337 14878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:57.504776 21930 consensus_queue.cc:237] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:57.536978 21651 consensus_queue.cc:260] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.14, Last appended by leader: 14, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:57.538800 21651 raft_consensus.cc:3060] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:12:57.550633 21906 raft_consensus.cc:2804] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:12:57.551512 21906 raft_consensus.cc:493] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:57.552139 21906 raft_consensus.cc:3060] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:12:57.553676 14302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:57.545210 14304 leader_election.cc:304] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:12:57.559913 21891 raft_consensus.cc:493] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:12:57.555200 21838 leader_election.cc:290] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:57.562083 21711 raft_consensus.cc:2804] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:57.562628 21711 raft_consensus.cc:493] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:12:57.563089 21711 raft_consensus.cc:3060] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:57.557601 21774 raft_consensus.cc:3060] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:57.568639 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:57.559576 21393 raft_consensus.cc:515] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:57.549247 14260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41764 (request call id 3804) took 1370 ms. Trace:
I20260709 12:12:57.557896 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:12:57.570005 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 91933.9us
I20260709 12:12:57.571341 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:57.584434 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:57.584812 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: true dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:57.585301 14334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50858 (request call id 2633) took 1130 ms. Trace:
I20260709 12:12:57.585438 21393 leader_election.cc:290] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 24 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:57.585410 14910 raft_consensus.cc:1813] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Handling vote request from an unknown peer 885067a0d31741bfb5c9935788e315bf
W20260709 12:12:57.582851 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 86993.2us
I20260709 12:12:57.570436 14265 raft_consensus.cc:2468] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 19.
I20260709 12:12:57.584450 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:57.585585 14911 raft_consensus.cc:3055] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:12:57.590096 14911 raft_consensus.cc:740] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:12:57.595634 14911 consensus_queue.cc:260] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:57.597280 14911 raft_consensus.cc:3060] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:57.586169 14334 rpcz_store.cc:276] 0709 12:12:56.454944 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:56.455098 (+   154us) service_pool.cc:224] Handling call
0709 12:12:56.521542 (+ 66444us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:56.623526 (+101984us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:56.623561 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:56.623603 (+    42us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:12:56.623635 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:57.584756 (+961121us) spinlock_profiling.cc:243] Waited 102 ms on lock 0x7b54002800d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:12:57.584826 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:57.585073 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":234004736}
I20260709 12:12:57.601856 14910 raft_consensus.cc:2393] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 19: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:12:57.602743 21890 leader_election.cc:290] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 21 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:57.603772 21883 raft_consensus.cc:493] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:57.604802 21883 raft_consensus.cc:515] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:57.608615 21883 leader_election.cc:290] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:12:57.609146 21949 log.cc:927] Time spent T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.813s	user 0.004s	sys 0.000s
I20260709 12:12:57.610173 21883 raft_consensus.cc:493] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:57.611465 21883 raft_consensus.cc:515] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:57.614709 21883 leader_election.cc:290] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:57.604866 21905 leader_election.cc:290] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:57.574767 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:57.620954 14330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50858 (request call id 2635) took 1165 ms. Trace:
W20260709 12:12:57.645596 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:57.646607 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:57.648164 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:57.649323 14261 raft_consensus.cc:2393] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 21: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:12:57.649847 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:57.650023 21955 raft_consensus.cc:493] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:57.649186 14912 raft_consensus.cc:2468] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 20.
I20260709 12:12:57.651609 21879 raft_consensus.cc:493] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:57.652335 21879 raft_consensus.cc:515] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:57.653134 21920 leader_election.cc:290] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:57.620853 21913 leader_election.cc:290] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:57.645673 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 25 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:57.656872 14262 raft_consensus.cc:3060] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Advancing to term 25
W20260709 12:12:57.659324 14905 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53200 (request call id 985) took 1764 ms (client timeout 1525 ms). Trace:
W20260709 12:12:57.659950 14905 rpcz_store.cc:269] 0709 12:12:55.895142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:55.895277 (+   135us) service_pool.cc:224] Handling call
0709 12:12:57.658719 (+1763442us) spinlock_profiling.cc:243] Waited 886 ms on lock 0x7b5400472cd4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:12:57.659025 (+   306us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2038779136}
I20260709 12:12:57.560806 21891 raft_consensus.cc:515] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:57.662701 14182 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56652 (request call id 1925) took 1119 ms. Trace:
I20260709 12:12:57.663132 14182 rpcz_store.cc:276] 0709 12:12:56.543336 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:56.859142 (+315806us) service_pool.cc:224] Handling call
0709 12:12:56.859433 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:57.121683 (+262250us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:57.121722 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:57.122446 (+   724us) raft_consensus.cc:1645] Marking committed up to 17
0709 12:12:57.122483 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:57.662111 (+539628us) spinlock_profiling.cc:243] Waited 262 ms on lock 0x7b54003e8354. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:12:57.662193 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:57.662459 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":602604288}
I20260709 12:12:57.664157 21891 leader_election.cc:290] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:57.640668 14330 rpcz_store.cc:276] 0709 12:12:56.455589 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:56.456201 (+   612us) service_pool.cc:224] Handling call
0709 12:12:56.456556 (+   355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:56.596235 (+139679us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 12:12:56.607475 (+ 11240us) log.cc:844] Serialized 14 byte log entry
0709 12:12:56.791201 (+183726us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:56.791259 (+    58us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:12:56.791307 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:57.620033 (+828726us) spinlock_profiling.cc:243] Waited 139 ms on lock 0x7b540001a754. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:12:57.620125 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:57.620747 (+   622us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8070,"prepare.queue_time_us":12280,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":42,"raft.queue_time_us":5270,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":10035,"spinlock_wait_cycles":320684928,"thread_start_us":182696,"threads_started":1,"wal-append.queue_time_us":283914}
I20260709 12:12:57.667877 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:57.668440 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:57.669567 14261 raft_consensus.cc:2393] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 20: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:12:57.670477 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:57.676039 21690 leader_election.cc:290] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 22 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:57.571004 21791 leader_election.cc:290] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:57.679032 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:57.680037 14336 raft_consensus.cc:3060] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:57.681895 14258 raft_consensus.cc:1813] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Handling vote request from an unknown peer 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:57.682619 14258 raft_consensus.cc:2393] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 19: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
W20260709 12:12:57.684315 14230 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.796s	user 0.039s	sys 0.088s
W20260709 12:12:57.684728 14230 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.797s	user 0.039s	sys 0.088s
W20260709 12:12:57.619637 21963 log.cc:927] Time spent T 00000000000000000000000000000000 P d07070be2c074f4cb9ad35f1580c4ef7: Append to log took a long time: real 0.493s	user 0.002s	sys 0.000s
W20260709 12:12:57.695363 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 48500.2us
I20260709 12:12:57.682507 14189 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56046 (request call id 3224) took 1228 ms. Trace:
I20260709 12:12:57.699478 14261 raft_consensus.cc:2393] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db in current term 20: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:12:57.701366 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:57.702417 14187 raft_consensus.cc:2468] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 19.
I20260709 12:12:57.702574 14184 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 3720) took 1337 ms. Trace:
I20260709 12:12:57.702970 14184 rpcz_store.cc:276] 0709 12:12:56.365026 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:56.366566 (+  1540us) service_pool.cc:224] Handling call
0709 12:12:56.429115 (+ 62549us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:56.578240 (+149125us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:56.578274 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:56.598169 (+ 19895us) log.cc:844] Serialized 26 byte log entry
0709 12:12:56.642593 (+ 44424us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:56.642640 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:56.643226 (+   586us) spinlock_profiling.cc:243] Waited 120 ms on lock 0x7b540028aad4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:12:56.643278 (+    52us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:57.607922 (+964644us) spinlock_profiling.cc:243] Waited 6.32 ms on lock 0x7b4400022b4c. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2123f74c85 00007f2123f756a2 00007f2126ce71db 00007f2126ce2aaf 00007f2126cd686e 00007f2126cd5bb6 00007f2126cd57d8 00007f2126cdf221 00007f2126cdf1d9 00007f2126cdf169
0709 12:12:57.702103 (+ 94181us) raft_consensus.cc:1685] finished
0709 12:12:57.702125 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:57.702368 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1989,"raft.queue_time_us":39859,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":1469,"spinlock_wait_cycles":289698816,"thread_start_us":15346,"threads_started":1,"wal-append.queue_time_us":55252}
I20260709 12:12:57.705852 14257 raft_consensus.cc:3060] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:12:57.705075 14188 raft_consensus.cc:1240] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 25 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 24. Current term is 25. Ops: []
I20260709 12:12:57.699628 14189 rpcz_store.cc:276] 0709 12:12:56.453693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:56.595550 (+141857us) service_pool.cc:224] Handling call
0709 12:12:57.682040 (+1086490us) spinlock_profiling.cc:243] Waited 538 ms on lock 0x7b54001112d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:12:57.682295 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1238087552}
W20260709 12:12:57.707923 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 260504us
I20260709 12:12:57.717775 14265 raft_consensus.cc:1275] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 12:12:57.718613 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:57.719691 14337 raft_consensus.cc:2468] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 19.
I20260709 12:12:57.650889 21955 raft_consensus.cc:515] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:57.718577 14265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41764 (request call id 3811) took 1320 ms. Trace:
I20260709 12:12:57.616822 21883 raft_consensus.cc:493] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:57.723796 14265 rpcz_store.cc:276] 0709 12:12:56.397977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:57.716869 (+1318892us) service_pool.cc:224] Handling call
0709 12:12:57.717290 (+   421us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:57.718303 (+  1013us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:57.718492 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:57.725351 14262 raft_consensus.cc:2468] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 25.
I20260709 12:12:57.728667 14262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41764 (request call id 3801) took 1723 ms. Trace:
I20260709 12:12:57.728996 14262 rpcz_store.cc:276] 0709 12:12:56.003420 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:56.039922 (+ 36502us) service_pool.cc:224] Handling call
0709 12:12:57.645207 (+1605285us) spinlock_profiling.cc:243] Waited 7.82 ms on lock 0x7b5800060c98. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2124016b71 00007f2124016a22 00007f212cf2f8d9 00007f212c089ee0 00007f212c1530ab 00007f212c153131 00007f212c1010a0 00007f212c100984 00007f212567b6d4 00007f212567b662
0709 12:12:57.726980 (+ 81773us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17978624}
I20260709 12:12:57.735960 14911 raft_consensus.cc:2468] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 18.
I20260709 12:12:57.736783 21883 raft_consensus.cc:515] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:57.740882 21837 leader_election.cc:290] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:57.736821 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:12:57.743733 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 43666.1us
I20260709 12:12:57.731858 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
W20260709 12:12:57.729671 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 846621us
I20260709 12:12:57.726538 21882 raft_consensus.cc:493] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:57.580964 14260 rpcz_store.cc:276] 0709 12:12:56.179142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:56.436040 (+256898us) service_pool.cc:224] Handling call
0709 12:12:56.436380 (+   340us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:56.655587 (+219207us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:12:56.847542 (+191955us) log.cc:844] Serialized 14 byte log entry
0709 12:12:57.121126 (+273584us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:57.121705 (+   579us) log.cc:844] Serialized 26 byte log entry
0709 12:12:57.121891 (+   186us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:57.121928 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:57.547582 (+425654us) spinlock_profiling.cc:243] Waited 3.62 ms on lock 0x7b18000d2940. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f212cf16ab1 00007f212cf23281 00007f212401c2a6 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419
0709 12:12:57.548356 (+   774us) spinlock_profiling.cc:243] Waited 219 ms on lock 0x7b5400221fd4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:12:57.548422 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:57.548529 (+   107us) raft_consensus.cc:1685] finished
0709 12:12:57.548548 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:57.548949 (+   401us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2238,"prepare.queue_time_us":222243,"prepare.run_cpu_time_us":88,"prepare.run_wall_time_us":18724,"raft.queue_time_us":607,"raft.run_cpu_time_us":278,"raft.run_wall_time_us":14738,"spinlock_wait_cycles":511488512,"thread_start_us":463965,"threads_started":2,"wal-append.queue_time_us":329270}
I20260709 12:12:57.747951 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:57.753522 14260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53050 (request call id 1561) took 1204 ms. Trace:
I20260709 12:12:57.753612 21955 leader_election.cc:290] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:57.760450 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:57.748299 14877 leader_election.cc:304] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:12:57.757579 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:57.762907 21890 raft_consensus.cc:2764] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
I20260709 12:12:57.763724 14257 raft_consensus.cc:2468] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 25.
I20260709 12:12:57.764261 21955 raft_consensus.cc:493] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:57.764858 21841 raft_consensus.cc:3055] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:12:57.759410 21879 leader_election.cc:290] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:57.766240 14257 raft_consensus.cc:1240] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 25 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 24. Current term is 25. Ops: [22.12-24.13]
I20260709 12:12:57.767006 14257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41768 (request call id 2664) took 1186 ms. Trace:
I20260709 12:12:57.767419 14257 rpcz_store.cc:276] 0709 12:12:56.581024 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:57.765413 (+1184389us) service_pool.cc:224] Handling call
0709 12:12:57.765944 (+   531us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:12:57.766658 (+   714us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:57.766909 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:57.768477 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:57.772111 21695 leader_election.cc:290] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:57.758447 21217 raft_consensus.cc:493] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:57.773137 21217 raft_consensus.cc:515] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:57.774158 21863 raft_consensus.cc:3060] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:12:57.775722 21217 leader_election.cc:290] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:57.758473 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:57.777155 14905 raft_consensus.cc:2368] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for earlier term 23. Current term is 24.
I20260709 12:12:57.758620 14906 raft_consensus.cc:1275] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:12:57.758855 21469 raft_consensus.cc:493] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:57.779711 21469 raft_consensus.cc:515] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:57.760484 21928 raft_consensus.cc:3055] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 23 LEADER]: Stepping down as leader of term 23
W20260709 12:12:57.782171 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:57.782444 21928 raft_consensus.cc:740] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:57.758008 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:57.769665 14264 raft_consensus.cc:2393] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 24: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:12:57.754097 14260 rpcz_store.cc:276] 0709 12:12:56.548981 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:57.748843 (+1199862us) service_pool.cc:224] Handling call
0709 12:12:57.752868 (+  4025us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:57.753199 (+   331us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:57.753225 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:57.753267 (+    42us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:12:57.753296 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:57.753348 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:57.753442 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:57.787843 14910 raft_consensus.cc:2468] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 17.
I20260709 12:12:57.788451 21756 leader_election.cc:290] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:57.783439 21841 raft_consensus.cc:740] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:12:57.773020 14230 leader_election.cc:304] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:57.790222 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:57.796015 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:57.747577 21882 raft_consensus.cc:515] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:57.796896 14910 raft_consensus.cc:2393] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 20: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:12:57.798897 21632 leader_election.cc:290] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:57.799670 14256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41764 (request call id 3808) took 1400 ms. Trace:
I20260709 12:12:57.800081 14256 rpcz_store.cc:276] 0709 12:12:56.397114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:56.446949 (+ 49835us) service_pool.cc:224] Handling call
0709 12:12:56.447218 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:56.524931 (+ 77713us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:56.524970 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:56.525013 (+    43us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:56.525056 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:57.797244 (+1272188us) spinlock_profiling.cc:243] Waited 77.5 ms on lock 0x7b5400031e54. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:12:57.797314 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:57.797587 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":178160512}
I20260709 12:12:57.765230 21955 raft_consensus.cc:515] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:57.804178 21955 leader_election.cc:290] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:57.804908 21841 consensus_queue.cc:260] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:12:57.807168 14335 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50858 (request call id 2636) took 1351 ms (client timeout 1519 ms). Trace:
I20260709 12:12:57.807183 21518 raft_consensus.cc:3060] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:57.787994 21928 consensus_queue.cc:260] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.16, Last appended by leader: 16, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:57.809146 14259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41768 (request call id 2668) took 1183 ms. Trace:
I20260709 12:12:57.809545 14259 rpcz_store.cc:276] 0709 12:12:56.625306 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:56.625484 (+   178us) service_pool.cc:224] Handling call
0709 12:12:57.808896 (+1183412us) spinlock_profiling.cc:243] Waited 792 ms on lock 0x7b54003822d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:12:57.809076 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1821881216}
I20260709 12:12:57.811129 14259 raft_consensus.cc:1240] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 25 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 24. Current term is 25. Ops: []
I20260709 12:12:57.812539 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:57.813052 14258 raft_consensus.cc:1240] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 20. Current term is 21. Ops: []
I20260709 12:12:57.814248 21893 raft_consensus.cc:493] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:57.815140 14230 leader_election.cc:304] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
W20260709 12:12:57.815555 14877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:57.821767 21953 raft_consensus.cc:2749] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:12:57.823488 21943 raft_consensus.cc:493] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:57.824095 21943 raft_consensus.cc:3060] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:57.798810 21882 leader_election.cc:290] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:57.825824 21955 raft_consensus.cc:493] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:57.826563 21955 raft_consensus.cc:515] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:57.827138 14260 raft_consensus.cc:1275] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 12:12:57.827888 14260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41764 (request call id 3814) took 1222 ms. Trace:
I20260709 12:12:57.757227 21883 leader_election.cc:290] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:12:57.828402 14305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:57.832582 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:57.835050 14183 raft_consensus.cc:1240] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 24 LEADER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 23. Current term is 24. Ops: [23.14-23.14]
I20260709 12:12:57.835551 21955 leader_election.cc:290] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:57.837131 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:57.838152 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:57.838369 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:57.838801 14903 raft_consensus.cc:2468] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 16.
I20260709 12:12:57.840119 21789 raft_consensus.cc:515] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:57.842806 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:57.833588 14336 raft_consensus.cc:2468] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 21.
I20260709 12:12:57.844218 21622 raft_consensus.cc:493] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:57.844760 21622 raft_consensus.cc:515] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:57.828217 14260 rpcz_store.cc:276] 0709 12:12:56.605453 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:57.785541 (+1180088us) service_pool.cc:224] Handling call
0709 12:12:57.826714 (+ 41173us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:57.827563 (+   849us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:57.827792 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:57.814901 21893 raft_consensus.cc:515] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:57.848115 21893 leader_election.cc:290] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:57.848613 21622 leader_election.cc:290] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:57.849129 21469 leader_election.cc:290] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:12:57.850783 14305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:57.850610 14304 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:57.845324 14877 leader_election.cc:304] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:12:57.809060 21928 raft_consensus.cc:3060] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Advancing to term 24
W20260709 12:12:57.807687 14335 rpcz_store.cc:269] 0709 12:12:56.455894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:56.456010 (+   116us) service_pool.cc:224] Handling call
0709 12:12:57.806727 (+1350717us) spinlock_profiling.cc:243] Waited 749 ms on lock 0x7b54000b8454. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:12:57.806969 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1721817344}
I20260709 12:12:57.850380 14265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53050 (request call id 1562) took 1301 ms. Trace:
I20260709 12:12:57.864301 14261 raft_consensus.cc:1240] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 25 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 24. Current term is 25. Ops: []
I20260709 12:12:57.807690 21841 raft_consensus.cc:3060] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:57.884394 14258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41764 (request call id 3810) took 1486 ms. Trace:
I20260709 12:12:57.884754 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:57.861148 14260 raft_consensus.cc:1240] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 24 LEADER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 23. Current term is 24. Ops: [23.16-23.16]
I20260709 12:12:57.866066 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:57.863175 14265 rpcz_store.cc:276] 0709 12:12:56.549337 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:57.762157 (+1212820us) service_pool.cc:224] Handling call
0709 12:12:57.784845 (+ 22688us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:57.849982 (+ 65137us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:57.850008 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:57.850067 (+    59us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:12:57.850116 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:57.850179 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:57.850298 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:57.873055 21711 raft_consensus.cc:515] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } }
I20260709 12:12:57.873888 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:57.880314 14259 raft_consensus.cc:1240] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 17. Current term is 18. Ops: []
W20260709 12:12:57.887252 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 45513.4us
I20260709 12:12:57.880923 14339 raft_consensus.cc:2468] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 21.
I20260709 12:12:57.881852 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:57.882881 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:57.883602 14261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41764 (request call id 3812) took 1471 ms. Trace:
I20260709 12:12:57.884795 14258 rpcz_store.cc:276] 0709 12:12:56.397700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:57.683392 (+1285692us) service_pool.cc:224] Handling call
0709 12:12:57.812837 (+129445us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:57.813458 (+   621us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:57.884179 (+ 70721us) spinlock_profiling.cc:243] Waited 129 ms on lock 0x7b54003822d0. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713a8ad 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:12:57.884335 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":296322304}
I20260709 12:12:57.881603 14303 leader_election.cc:400] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 23 election: Vote denied by peer 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341) with higher term. Message: Invalid argument: T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for earlier term 23. Current term is 24.
I20260709 12:12:57.889220 14303 leader_election.cc:403] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 23 election: Cancelling election due to peer responding with higher term
I20260709 12:12:57.889709 14261 rpcz_store.cc:276] 0709 12:12:56.398255 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:57.725245 (+1326990us) service_pool.cc:224] Handling call
0709 12:12:57.816781 (+ 91536us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:57.868984 (+ 52203us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:57.869380 (+   396us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:12:57.888290 14332 raft_consensus.cc:2468] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 15.
I20260709 12:12:57.902884 14911 raft_consensus.cc:1240] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 24 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 23. Current term is 24. Ops: [21.15-23.16]
I20260709 12:12:57.904038 14912 raft_consensus.cc:1240] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 21 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 20. Current term is 21. Ops: []
I20260709 12:12:57.910285 14877 leader_election.cc:304] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:12:57.915210 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:57.918437 21674 raft_consensus.cc:2804] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:12:57.918920 21925 raft_consensus.cc:493] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:57.920190 21674 raft_consensus.cc:493] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:57.919482 21925 raft_consensus.cc:515] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:12:57.922876 21979 log.cc:927] Time spent T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 12:12:57.923053 21674 raft_consensus.cc:3060] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:57.923847 14910 raft_consensus.cc:1275] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:12:57.924271 14262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41764 (request call id 3815) took 1318 ms. Trace:
I20260709 12:12:57.924687 14262 rpcz_store.cc:276] 0709 12:12:56.605709 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:57.795441 (+1189732us) service_pool.cc:224] Handling call
0709 12:12:57.870426 (+ 74985us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:57.923772 (+ 53346us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:12:57.923808 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:57.923857 (+    49us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:57.923891 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:57.924060 (+   169us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:57.924195 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33153}
I20260709 12:12:57.925902 14187 raft_consensus.cc:2468] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 19.
I20260709 12:12:57.926815 21955 raft_consensus.cc:493] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:57.927122 21789 leader_election.cc:290] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 20 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:12:57.927974 14339 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50856 (request call id 3174) took 1325 ms (client timeout 1558 ms). Trace:
W20260709 12:12:57.928375 14339 rpcz_store.cc:269] 0709 12:12:56.602507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:56.603572 (+  1065us) service_pool.cc:224] Handling call
0709 12:12:57.927757 (+1324185us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b540010d6d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:12:57.927917 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2693626112}
I20260709 12:12:57.930860 21925 leader_election.cc:290] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:12:57.932682 21881 consensus_meta.cc:287] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.549s	user 0.003s	sys 0.012s
I20260709 12:12:57.933106 21966 raft_consensus.cc:2749] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:57.918668 21711 leader_election.cc:290] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 20 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:57.934091 14336 raft_consensus.cc:2468] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 24.
I20260709 12:12:57.934470 21674 raft_consensus.cc:515] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:12:57.936422 14878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:57.936965 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 121968us
I20260709 12:12:57.897408 21469 raft_consensus.cc:2804] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:12:57.941864 14184 raft_consensus.cc:3060] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:57.943425 21955 raft_consensus.cc:515] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:12:57.946228 14229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:57.946834 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:57.955492 21943 raft_consensus.cc:515] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:57.933625 21924 raft_consensus.cc:493] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:57.924858 21895 raft_consensus.cc:493] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:57.961405 21912 raft_consensus.cc:493] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:57.962842 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 81497.2us
I20260709 12:12:57.963541 21789 raft_consensus.cc:2749] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Leader election lost for term 23. Reason: Vote denied by peer 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341) with higher term. Message: Invalid argument: T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for earlier term 23. Current term is 24.
I20260709 12:12:57.977475 21789 consensus_queue.cc:1048] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:57.979799 14154 leader_election.cc:304] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:57.980723 14230 leader_election.cc:304] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:57.982777 21632 raft_consensus.cc:2749] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:12:57.985751 21712 consensus_meta.cc:287] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.629s	user 0.009s	sys 0.013s
I20260709 12:12:57.986295 21712 raft_consensus.cc:2749] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 24 FOLLOWER]: Leader pre-election lost for term 23. Reason: Vote denied by peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673) with higher term. Message: Invalid argument: T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 23. Current term is 24.
I20260709 12:12:57.986759 21912 raft_consensus.cc:515] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:57.989244 21912 leader_election.cc:290] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:57.976450 14303 leader_election.cc:304] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:57.989933 21966 raft_consensus.cc:2749] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:12:57.990765 21924 raft_consensus.cc:515] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:57.991112 14303 leader_election.cc:304] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:57.992306 14257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41768 (request call id 2665) took 1410 ms. Trace:
I20260709 12:12:57.964654 14304 leader_election.cc:304] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
W20260709 12:12:57.977406 14305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:57.993079 14303 leader_election.cc:304] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:12:57.993593 21711 raft_consensus.cc:2804] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:12:57.992834 14257 rpcz_store.cc:276] 0709 12:12:56.581938 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:57.768478 (+1186540us) service_pool.cc:224] Handling call
0709 12:12:57.769038 (+   560us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:12:57.780248 (+ 11210us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:57.780285 (+    37us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:12:57.780997 (+   712us) log.cc:844] Serialized 52 byte log entry
0709 12:12:57.850002 (+ 69005us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:57.890623 (+ 40621us) log.cc:844] Serialized 14 byte log entry
0709 12:12:57.927044 (+ 36421us) log.cc:844] Serialized 14 byte log entry
0709 12:12:57.927500 (+   456us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:57.927584 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:57.992041 (+ 64457us) raft_consensus.cc:1685] finished
0709 12:12:57.992066 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:57.992237 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34201,"raft.queue_time_us":38201,"raft.run_cpu_time_us":275,"raft.run_wall_time_us":276,"thread_start_us":76307,"threads_started":2,"wal-append.queue_time_us":190201}
I20260709 12:12:57.998661 14264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41764 (request call id 3813) took 1393 ms. Trace:
I20260709 12:12:57.999064 21712 consensus_queue.cc:1048] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:57.999161 14264 rpcz_store.cc:276] 0709 12:12:56.605127 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:57.785343 (+1180216us) service_pool.cc:224] Handling call
0709 12:12:57.788176 (+  2833us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:57.788631 (+   455us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:57.788661 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:57.789305 (+   644us) log.cc:844] Serialized 26 byte log entry
0709 12:12:57.884755 (+ 95450us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:12:57.884800 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:57.884901 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:57.992308 (+107407us) spinlock_profiling.cc:243] Waited 11 ms on lock 0x7b4400022b4c. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2123f74c85 00007f2123f756a2 00007f2126ce71db 00007f2126ce2aaf 00007f2126cd686e 00007f2126cd5bb6 00007f2126cd57d8 00007f2126cdf221 00007f2126cdf1d9 00007f2126cdf169
0709 12:12:57.993793 (+  1485us) raft_consensus.cc:1685] finished
0709 12:12:57.993818 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:57.998573 (+  4755us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":646,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":91,"spinlock_wait_cycles":25337216,"thread_start_us":95044,"threads_started":1,"wal-append.queue_time_us":188813}
I20260709 12:12:58.001111 14186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 3728) took 1362 ms. Trace:
I20260709 12:12:58.001571 21789 raft_consensus.cc:2749] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:12:58.003196 21960 raft_consensus.cc:2243] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:58.003418 21789 consensus_queue.cc:1048] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:12:58.004101 21966 raft_consensus.cc:493] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:58.001029 14304 leader_election.cc:304] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:12:57.977257 21674 leader_election.cc:290] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 17 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:58.007201 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:58.007589 21925 raft_consensus.cc:2804] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:12:58.008173 21925 raft_consensus.cc:697] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 25 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:58.004868 21960 raft_consensus.cc:2272] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:58.007203 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:58.006629 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:58.002085 14155 leader_election.cc:304] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:58.010691 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:58.010684 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:58.011832 14303 leader_election.cc:304] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:58.034749 14187 raft_consensus.cc:3060] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:58.005368 14186 rpcz_store.cc:276] 0709 12:12:56.608526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:56.926466 (+317940us) service_pool.cc:224] Handling call
0709 12:12:56.926891 (+   425us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:57.143611 (+216720us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:57.143650 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:57.144258 (+   608us) log.cc:844] Serialized 26 byte log entry
0709 12:12:57.603717 (+459459us) spinlock_profiling.cc:243] Waited 3.16 ms on lock 0x7b1800128f20. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f212cf16ab1 00007f212cf23281 00007f2124030e07 00007f212ce8b9a9 00007f212404d69b 00007f212404b93f 00007f212404dc02 00007f2126cd520b 00007f2126cdad23 00007f2126cdb0d1 00007f21270f6a0f
0709 12:12:57.749840 (+146123us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:12:57.786650 (+ 36810us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:57.889352 (+102702us) spinlock_profiling.cc:243] Waited 216 ms on lock 0x7b54003f2fd4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:12:57.890839 (+  1487us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:57.959390 (+ 68551us) raft_consensus.cc:1685] finished
0709 12:12:57.959415 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:57.967193 (+  7778us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":378,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":7994,"spinlock_wait_cycles":504569984,"thread_start_us":117142,"threads_started":1,"wal-append.queue_time_us":645686}
I20260709 12:12:58.035993 14229 leader_election.cc:304] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
W20260709 12:12:58.036645 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 56109.6us
I20260709 12:12:58.036942 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:58.037454 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:58.038241 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:58.040342 14259 raft_consensus.cc:1240] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 25 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 24. Current term is 25. Ops: []
I20260709 12:12:57.998320 21711 raft_consensus.cc:493] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:12:58.050503 21695 raft_consensus.cc:2749] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:58.050930 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:58.051507 14265 raft_consensus.cc:2393] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 22: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:12:58.011476 21774 raft_consensus.cc:2804] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:12:58.053355 14304 leader_election.cc:304] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:58.054003 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:58.009279 21883 raft_consensus.cc:3060] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:57.993449 21924 leader_election.cc:290] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:58.056201 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:58.057868 14184 raft_consensus.cc:2468] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 21.
I20260709 12:12:58.059629 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:58.058630 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:58.024716 21469 raft_consensus.cc:697] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 21 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:12:58.072499 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:58.068900 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:58.068516 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:58.074255 14259 raft_consensus.cc:2393] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db in current term 21: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:12:58.074555 14265 raft_consensus.cc:1240] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 22. Current term is 23. Ops: []
I20260709 12:12:58.075160 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:58.075878 14259 raft_consensus.cc:2468] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 20.
I20260709 12:12:58.073627 14188 raft_consensus.cc:3060] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:12:58.079759 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 20 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:12:58.080065 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 60545.4us
I20260709 12:12:58.080816 14876 leader_election.cc:304] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:57.993837 21895 raft_consensus.cc:515] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:58.081966 21948 raft_consensus.cc:2749] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:58.083873 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:12:58.084681 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 82772.3us
I20260709 12:12:58.084744 14189 raft_consensus.cc:2468] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 16.
W20260709 12:12:58.080994 14302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:58.085860 14260 raft_consensus.cc:3060] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:58.086609 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:58.067385 21774 raft_consensus.cc:493] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:58.088438 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:58.095301 14258 raft_consensus.cc:2468] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 25.
I20260709 12:12:58.057825 21711 raft_consensus.cc:3060] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:12:58.004863 21966 raft_consensus.cc:515] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:58.096321 14339 raft_consensus.cc:2393] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 21: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:12:58.097694 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 27 candidate_status { last_received { term: 26 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:58.102558 14264 raft_consensus.cc:2468] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 21.
I20260709 12:12:58.100020 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:58.100443 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:58.107913 14909 raft_consensus.cc:1275] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 24 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 12:12:58.102648 14335 raft_consensus.cc:2468] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 26.
I20260709 12:12:58.085115 21712 raft_consensus.cc:2749] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:58.110761 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:12:58.099471 21906 consensus_meta.cc:287] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.546s	user 0.015s	sys 0.000s
I20260709 12:12:58.112370 14261 raft_consensus.cc:1275] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 12:12:58.113051 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:58.112071 14262 raft_consensus.cc:2468] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 21.
W20260709 12:12:58.116331 14875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:58.089681 21924 raft_consensus.cc:2804] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:58.114606 14184 raft_consensus.cc:2468] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 25.
I20260709 12:12:58.098448 21774 raft_consensus.cc:3060] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:12:58.118716 21960 ts_tablet_manager.cc:1916] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:12:58.116132 14189 raft_consensus.cc:3060] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:12:58.125144 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 89247.1us
I20260709 12:12:58.035921 21925 consensus_queue.cc:237] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:58.123518 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:58.116055 14155 leader_election.cc:400] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 23 pre-election: Vote denied by peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957) with higher term. Message: Invalid argument: T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 23. Current term is 24.
I20260709 12:12:58.102770 21756 raft_consensus.cc:493] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:58.133513 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 138230us
I20260709 12:12:58.137197 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:58.128669 14181 raft_consensus.cc:2468] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 21.
I20260709 12:12:58.131767 21695 raft_consensus.cc:2804] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:12:58.144560 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:58.156903 14182 raft_consensus.cc:2468] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 24.
I20260709 12:12:58.158989 14877 leader_election.cc:304] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:12:58.127954 21924 raft_consensus.cc:697] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 20 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:58.180874 14184 raft_consensus.cc:2468] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 21.
I20260709 12:12:58.181053 14334 raft_consensus.cc:1240] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:58.186345 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:58.130065 21906 raft_consensus.cc:515] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:58.188812 14338 raft_consensus.cc:1240] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:58.188189 14877 leader_election.cc:304] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:12:58.190569 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
W20260709 12:12:58.175259 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 169003us
I20260709 12:12:58.194458 21804 raft_consensus.cc:493] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:58.170571 21976 raft_consensus.cc:2804] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:12:58.170356 21695 raft_consensus.cc:697] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 25 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
W20260709 12:12:58.204967 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 89112.9us
I20260709 12:12:58.155642 21756 raft_consensus.cc:515] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:58.206918 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:58.201081 14230 leader_election.cc:304] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:58.206830 14183 raft_consensus.cc:1240] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 21. Current term is 22. Ops: []
I20260709 12:12:58.209383 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 22 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:58.216866 14182 raft_consensus.cc:1240] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 20. Current term is 21. Ops: []
I20260709 12:12:58.202013 21838 raft_consensus.cc:2804] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:12:58.220113 21754 raft_consensus.cc:493] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:58.225210 21893 consensus_queue.cc:1059] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:12:58.207175 21976 raft_consensus.cc:493] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:58.227852 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:58.225581 21754 raft_consensus.cc:515] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:58.231040 21976 raft_consensus.cc:3060] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 25 FOLLOWER]: Advancing to term 26
W20260709 12:12:58.238607 21988 log.cc:927] Time spent T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:12:58.238946 21906 leader_election.cc:290] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 22 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:58.239995 14256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41768 (request call id 2666) took 1615 ms. Trace:
I20260709 12:12:58.240374 14256 rpcz_store.cc:276] 0709 12:12:56.624733 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:57.801292 (+1176559us) service_pool.cc:224] Handling call
0709 12:12:57.801827 (+   535us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:57.803024 (+  1197us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:57.803077 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:57.804014 (+   937us) log.cc:844] Serialized 26 byte log entry
0709 12:12:57.969184 (+165170us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:57.969237 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:57.969314 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:58.239759 (+270445us) raft_consensus.cc:1685] finished
0709 12:12:58.239781 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:58.239911 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":296,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":101,"thread_start_us":100629,"threads_started":1,"wal-append.queue_time_us":280953}
I20260709 12:12:58.198094 21469 consensus_queue.cc:237] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:58.248836 14188 raft_consensus.cc:2468] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 25.
I20260709 12:12:58.248741 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:58.221026 21838 raft_consensus.cc:493] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:58.249631 14263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41768 (request call id 2667) took 1624 ms. Trace:
I20260709 12:12:58.250814 14182 raft_consensus.cc:2468] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 24.
I20260709 12:12:58.257303 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:58.261060 14185 raft_consensus.cc:1275] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
W20260709 12:12:58.247663 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 44985.4us
W20260709 12:12:58.263731 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:58.264572 21695 consensus_queue.cc:237] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:58.265143 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:58.265904 14188 raft_consensus.cc:2468] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 20.
I20260709 12:12:58.266780 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:58.267508 14188 raft_consensus.cc:2468] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 25.
W20260709 12:12:58.265954 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 78546.7us
I20260709 12:12:58.265594 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:58.269263 14336 raft_consensus.cc:2468] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 25.
I20260709 12:12:58.270053 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:58.268792 14229 leader_election.cc:304] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 73d01e9b1a9d49358da4985b21d681db
W20260709 12:12:58.272368 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 47583.9us
I20260709 12:12:58.254948 21838 raft_consensus.cc:3060] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:58.254521 21953 raft_consensus.cc:493] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:12:58.273993 14303 leader_election.cc:304] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:58.254360 21966 leader_election.cc:290] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:58.279628 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:58.216228 21804 raft_consensus.cc:515] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:58.282146 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: true dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:58.259662 21924 consensus_queue.cc:237] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:58.286803 21955 leader_election.cc:290] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:58.287727 21756 leader_election.cc:290] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:58.289250 21895 leader_election.cc:290] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:58.291078 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:58.292040 14336 raft_consensus.cc:2393] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 22: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
W20260709 12:12:58.293495 14181 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56046 (request call id 3225) took 1834 ms (client timeout 1677 ms). Trace:
W20260709 12:12:58.293942 14181 rpcz_store.cc:269] 0709 12:12:56.459048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:56.513281 (+ 54233us) service_pool.cc:224] Handling call
0709 12:12:58.282189 (+1768908us) spinlock_profiling.cc:243] Waited 1.51 s on lock 0x7b54001126d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:12:58.293414 (+ 11225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3462352768}
I20260709 12:12:58.294541 21909 raft_consensus.cc:2749] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:12:58.280509 21989 log.cc:927] Time spent T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 12:12:58.301312 14187 raft_consensus.cc:2468] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 22.
I20260709 12:12:58.314747 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:58.317348 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:58.309300 14230 leader_election.cc:304] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:58.317960 14336 raft_consensus.cc:2468] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 25.
I20260709 12:12:58.304857 21966 raft_consensus.cc:2804] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:58.308178 21690 raft_consensus.cc:2749] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:58.324952 14155 leader_election.cc:400] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 election: Vote denied by peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957) with higher term. Message: Invalid argument: T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 19. Current term is 20.
I20260709 12:12:58.295150 21953 raft_consensus.cc:515] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:58.324434 21943 leader_election.cc:290] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 23 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:58.323004 21966 raft_consensus.cc:493] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
W20260709 12:12:58.340821 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 73282.6us
I20260709 12:12:58.341890 14229 leader_election.cc:304] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:58.328564 21909 raft_consensus.cc:2804] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:12:58.312224 21774 raft_consensus.cc:515] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:58.322101 21863 consensus_queue.cc:1048] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.017s
I20260709 12:12:58.349848 14229 leader_election.cc:304] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:58.352596 14229 leader_election.cc:304] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
W20260709 12:12:58.353768 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 47563us
I20260709 12:12:58.354156 21873 raft_consensus.cc:2749] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:12:58.355072 21873 raft_consensus.cc:2749] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:58.356381 21873 raft_consensus.cc:2804] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:58.356765 21873 raft_consensus.cc:493] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:58.357110 21873 raft_consensus.cc:3060] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:58.361709 21754 leader_election.cc:290] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:58.253252 14263 rpcz_store.cc:276] 0709 12:12:56.625025 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:57.802676 (+1177651us) service_pool.cc:224] Handling call
0709 12:12:57.803066 (+   390us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:57.803420 (+   354us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 12:12:58.031027 (+227607us) log.cc:844] Serialized 14 byte log entry
0709 12:12:58.249244 (+218217us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:12:58.249306 (+    62us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:12:58.249357 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:58.249436 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:58.249561 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":202363,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":49,"raft.queue_time_us":11086,"thread_start_us":379595,"threads_started":2}
I20260709 12:12:58.367451 21953 leader_election.cc:290] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:58.371037 21976 raft_consensus.cc:515] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:58.374071 21909 raft_consensus.cc:697] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 21 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:58.375216 21909 consensus_queue.cc:237] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:12:58.385047 14154 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 71126.3us
I20260709 12:12:58.339388 21966 raft_consensus.cc:3060] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:58.388223 14339 raft_consensus.cc:3060] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:12:58.373472 21976 leader_election.cc:290] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 26 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:58.396059 14155 leader_election.cc:304] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
W20260709 12:12:58.404767 14305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:58.394505 21841 consensus_meta.cc:287] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db: Time spent flushing consensus metadata: real 0.507s	user 0.010s	sys 0.003s
I20260709 12:12:58.414088 14189 raft_consensus.cc:2468] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 17.
I20260709 12:12:58.415194 14260 raft_consensus.cc:2468] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 20.
I20260709 12:12:58.421516 14259 raft_consensus.cc:1240] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 19. Current term is 20. Ops: []
W20260709 12:12:58.416471 14155 raft_consensus.cc:2686] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260709 12:12:58.450923 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 129457us
I20260709 12:12:58.442359 14905 raft_consensus.cc:2468] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 23.
I20260709 12:12:58.462430 21818 raft_consensus.cc:493] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:58.463114 21818 raft_consensus.cc:515] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:58.465287 21818 leader_election.cc:290] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:12:58.466315 21991 log.cc:927] Time spent T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.155s	user 0.001s	sys 0.001s
I20260709 12:12:58.470191 14339 raft_consensus.cc:2468] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 17.
W20260709 12:12:58.480401 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 151383us
W20260709 12:12:58.488761 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 260202us
I20260709 12:12:58.455235 21955 raft_consensus.cc:493] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:12:58.476318 21818 raft_consensus.cc:493] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:58.495121 14303 leader_election.cc:304] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
W20260709 12:12:58.495848 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 143347us
I20260709 12:12:58.474435 21711 raft_consensus.cc:515] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:58.509368 21695 raft_consensus.cc:2749] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:58.510129 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:58.510756 14187 raft_consensus.cc:3060] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:12:58.518062 14304 leader_election.cc:304] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
W20260709 12:12:58.506078 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 278825us
I20260709 12:12:58.506254 14229 leader_election.cc:304] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:58.532090 14304 leader_election.cc:304] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:12:58.536062 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 25 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:58.537353 22005 raft_consensus.cc:2804] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:12:58.537870 22005 raft_consensus.cc:493] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:58.538256 22005 raft_consensus.cc:3060] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:12:58.541615 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 25 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:58.542454 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 25 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:58.543937 14187 raft_consensus.cc:2468] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 26.
I20260709 12:12:58.548967 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 25 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:58.548009 14304 leader_election.cc:304] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:12:58.550908 14332 raft_consensus.cc:2410] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db for term 25 because replica has last-logged OpId of term: 23 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 14.
I20260709 12:12:58.494306 21622 consensus_queue.cc:1059] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.040s
I20260709 12:12:58.551784 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:58.554059 14330 raft_consensus.cc:3060] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Advancing to term 26
I20260709 12:12:58.558784 14304 leader_election.cc:304] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:12:58.560462 21894 raft_consensus.cc:2804] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:12:58.560951 21894 raft_consensus.cc:493] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:12:58.561137 14155 leader_election.cc:304] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:58.555959 14337 raft_consensus.cc:2410] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db for term 25 because replica has last-logged OpId of term: 22 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 15.
W20260709 12:12:58.565819 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 59618us
I20260709 12:12:58.548077 21774 leader_election.cc:290] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:58.522051 21818 raft_consensus.cc:515] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:58.553336 21883 raft_consensus.cc:2749] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:58.531870 21955 raft_consensus.cc:515] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:58.572696 14229 leader_election.cc:304] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:58.563849 21894 raft_consensus.cc:3060] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:58.568909 21912 raft_consensus.cc:2804] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:12:58.569556 21953 raft_consensus.cc:2804] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:12:58.580857 22004 consensus_queue.cc:1048] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.023s
I20260709 12:12:58.603034 14155 leader_election.cc:304] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:58.575929 21712 raft_consensus.cc:2749] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 12:12:58.608731 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 99938.5us
W20260709 12:12:58.610971 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 44030.6us
I20260709 12:12:58.593541 21912 raft_consensus.cc:493] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:58.611903 14303 leader_election.cc:304] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:58.620512 21883 raft_consensus.cc:2804] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:58.621167 21883 raft_consensus.cc:697] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 20 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
W20260709 12:12:58.621902 14136 auto_rebalancer.cc:629] Failed to schedule move for tablet 88b5f4f19c2a4585b93b312cc1f3d17f: Illegal state: Replica 65c9c1653b3346b39a0e118540e6080c is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 20 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } }
I20260709 12:12:58.627018 21955 leader_election.cc:290] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:58.629812 21217 raft_consensus.cc:3055] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:58.630326 21217 raft_consensus.cc:740] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:12:58.631336 21217 consensus_queue.cc:260] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.16, Last appended by leader: 16, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:58.629850 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:58.632707 21217 raft_consensus.cc:3060] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:58.612717 21912 raft_consensus.cc:3060] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:58.614990 21953 raft_consensus.cc:697] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 21 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:58.638944 21804 leader_election.cc:290] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:58.639245 21953 consensus_queue.cc:237] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:58.640450 21883 consensus_queue.cc:237] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:58.644001 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:58.651875 14330 raft_consensus.cc:2468] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 26.
I20260709 12:12:58.658847 14155 leader_election.cc:304] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:58.659629 21818 leader_election.cc:290] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:58.660279 14155 leader_election.cc:304] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:58.618544 21518 raft_consensus.cc:2804] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:12:58.662781 21906 consensus_queue.cc:1059] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:12:58.663245 21955 raft_consensus.cc:2804] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:12:58.662883 21943 raft_consensus.cc:2749] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:58.667870 14229 leader_election.cc:304] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:58.670284 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:58.671221 14330 raft_consensus.cc:2468] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 20.
I20260709 12:12:58.673462 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:58.655014 21909 raft_consensus.cc:2804] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Leader election won for term 24
W20260709 12:12:58.678095 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 66299.5us
I20260709 12:12:58.679064 14303 leader_election.cc:304] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:58.663705 21955 raft_consensus.cc:493] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 24 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:58.662881 21518 raft_consensus.cc:493] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 26 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:58.675417 22009 raft_consensus.cc:2804] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:58.702411 22009 raft_consensus.cc:493] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:12:58.702894 22009 raft_consensus.cc:3060] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:58.707175 21873 raft_consensus.cc:515] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:58.682657 21711 leader_election.cc:290] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:58.677243 22013 raft_consensus.cc:2749] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 12:12:58.701792 21518 raft_consensus.cc:3060] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:12:58.720340 21838 raft_consensus.cc:515] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:58.721683 21909 raft_consensus.cc:697] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 24 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:58.722600 14260 raft_consensus.cc:1275] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 12:12:58.720616 14877 leader_election.cc:304] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:58.725554 14906 raft_consensus.cc:2393] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 22: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
I20260709 12:12:58.724467 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:58.728896 14877 leader_election.cc:304] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:58.713093 22005 raft_consensus.cc:515] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:58.734308 14259 raft_consensus.cc:1240] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:58.734139 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:58.736444 14263 raft_consensus.cc:2468] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 25.
I20260709 12:12:58.735288 14876 leader_election.cc:304] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:58.685348 21955 raft_consensus.cc:3060] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:12:58.741863 14877 leader_election.cc:304] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:12:58.742658 21976 raft_consensus.cc:2749] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:12:58.747495 21469 raft_consensus.cc:2804] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:12:58.748188 21469 raft_consensus.cc:697] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [term 17 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
W20260709 12:12:58.751181 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:58.737423 21756 consensus_queue.cc:1048] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.016s
I20260709 12:12:58.757457 21995 raft_consensus.cc:2749] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:12:58.758610 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:58.759519 14330 raft_consensus.cc:2393] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 24: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
W20260709 12:12:58.760535 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 81521us
I20260709 12:12:58.749331 21469 consensus_queue.cc:237] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:58.763027 21774 raft_consensus.cc:3055] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:12:58.763522 21774 raft_consensus.cc:740] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
W20260709 12:12:58.765391 22014 log.cc:927] Time spent T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.078s	user 0.000s	sys 0.004s
I20260709 12:12:58.765048 21774 consensus_queue.cc:260] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:58.766793 21774 raft_consensus.cc:3060] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:58.767328 21943 raft_consensus.cc:3055] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:58.767947 21943 raft_consensus.cc:740] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:12:58.768985 21943 consensus_queue.cc:260] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } }
I20260709 12:12:58.763584 21912 raft_consensus.cc:515] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:58.730811 21804 raft_consensus.cc:493] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:58.778162 14303 leader_election.cc:304] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:12:58.742043 21863 raft_consensus.cc:2749] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
W20260709 12:12:58.788106 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 46384.5us
I20260709 12:12:58.790206 14303 leader_election.cc:304] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:58.793306 21912 leader_election.cc:290] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 22 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:58.794008 21804 raft_consensus.cc:515] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:58.796164 21804 leader_election.cc:290] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:58.797401 22016 raft_consensus.cc:2804] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:12:58.797817 21890 raft_consensus.cc:493] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:58.797936 22016 raft_consensus.cc:493] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:12:58.798460 22016 raft_consensus.cc:3060] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:58.798820 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:58.800698 21943 raft_consensus.cc:3060] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:58.800990 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:12:58.803165 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 72483.6us
I20260709 12:12:58.805989 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:58.813714 14190 raft_consensus.cc:3060] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:58.780074 22013 raft_consensus.cc:493] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:58.817345 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 157136us
I20260709 12:12:58.798709 21945 raft_consensus.cc:2804] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:12:58.804150 21873 leader_election.cc:290] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:58.722929 21909 consensus_queue.cc:237] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:58.822877 21516 consensus_queue.cc:1048] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:12:58.827584 14155 leader_election.cc:304] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:58.824087 21893 consensus_queue.cc:1059] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 19.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:12:58.813050 22017 raft_consensus.cc:2749] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:12:58.835991 14229 leader_election.cc:304] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:12:58.844838 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:58.845808 14330 raft_consensus.cc:2393] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 21: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
W20260709 12:12:58.861155 14154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:12:58.866968 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 61426.8us
W20260709 12:12:58.877373 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 51775.6us
I20260709 12:12:58.879285 14303 leader_election.cc:304] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:58.842566 21945 raft_consensus.cc:697] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 26 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:12:58.798455 21890 raft_consensus.cc:515] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:58.880251 14303 leader_election.cc:304] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:58.889151 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:58.889195 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:58.891618 14303 leader_election.cc:304] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:12:58.874912 21712 raft_consensus.cc:2804] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:12:58.898864 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:58.871841 21873 raft_consensus.cc:2804] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:12:58.886698 21863 raft_consensus.cc:2804] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:12:58.920809 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:58.889669 21883 raft_consensus.cc:2749] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:12:58.913952 21712 raft_consensus.cc:493] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 24 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:58.884966 22017 consensus_queue.cc:1048] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.041s
I20260709 12:12:58.850419 22013 raft_consensus.cc:515] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:12:58.985394 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 93932.2us
I20260709 12:12:58.919217 21928 raft_consensus.cc:2804] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:12:58.941476 21945 consensus_queue.cc:237] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.17, Last appended by leader: 17, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:12:59.012038 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 105452us
W20260709 12:12:59.018599 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 127392us
I20260709 12:12:59.022504 14190 raft_consensus.cc:2468] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 22.
W20260709 12:12:58.947172 14154 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 53118us
I20260709 12:12:59.025199 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
W20260709 12:12:59.064080 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 185843us
I20260709 12:12:59.064769 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:59.067382 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:58.922559 21863 raft_consensus.cc:493] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:59.060671 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:59.075948 14330 raft_consensus.cc:1275] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 22 index: 16. (term mismatch)
I20260709 12:12:59.076418 14330 pending_rounds.cc:85] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c: Aborting all ops after (but not including) 15
W20260709 12:12:59.030488 21966 consensus_meta.cc:287] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.621s	user 0.011s	sys 0.006s
I20260709 12:12:59.024945 21712 raft_consensus.cc:3060] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:12:59.064090 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:59.086628 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 27 candidate_status { last_received { term: 26 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:59.023216 21953 raft_consensus.cc:493] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:59.108613 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:59.086511 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 23 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:59.109586 14184 raft_consensus.cc:2393] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 23: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:12:59.011582 21756 raft_consensus.cc:493] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:59.094051 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:59.111626 14188 raft_consensus.cc:2368] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for earlier term 16. Current term is 17.
I20260709 12:12:59.095261 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:59.107865 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:59.026005 21873 raft_consensus.cc:697] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 20 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:12:59.029908 21818 raft_consensus.cc:493] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:12:59.076645 14330 pending_rounds.cc:107] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c: Aborting uncommitted NO_OP operation due to leader change: 23.16
I20260709 12:12:59.113867 14330 raft_consensus.cc:2889] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:59.112488 14906 raft_consensus.cc:2468] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 26.
I20260709 12:12:59.117949 14186 raft_consensus.cc:1240] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 22. Current term is 23. Ops: []
I20260709 12:12:59.088898 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:59.119056 14332 raft_consensus.cc:1275] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 12:12:59.075574 21863 raft_consensus.cc:3060] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:12:59.117096 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:59.122093 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:59.129047 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:59.132648 14264 raft_consensus.cc:2368] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 24. Current term is 25.
I20260709 12:12:59.089644 22005 leader_election.cc:290] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 26 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:59.136976 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:59.133972 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:59.090255 21928 raft_consensus.cc:697] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 22 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:59.137275 14303 leader_election.cc:304] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:12:59.064934 21883 consensus_queue.cc:1059] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.059s
I20260709 12:12:59.068312 21518 raft_consensus.cc:515] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:59.145977 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
W20260709 12:12:59.155136 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 78476.1us
I20260709 12:12:59.156632 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:12:59.170222 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:59.178043 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:12:59.183147 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 50792.3us
I20260709 12:12:59.133555 21695 raft_consensus.cc:493] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:12:59.108129 21966 raft_consensus.cc:515] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:59.190570 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:59.194065 14186 raft_consensus.cc:3060] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Advancing to term 22
I20260709 12:12:59.114097 21953 raft_consensus.cc:515] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:59.201555 14303 leader_election.cc:304] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:12:59.211009 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:59.171265 22004 raft_consensus.cc:2804] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:12:59.218289 14155 leader_election.cc:304] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:59.229986 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:59.231861 14261 raft_consensus.cc:1240] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 19. Current term is 20. Ops: []
I20260709 12:12:59.153918 21756 raft_consensus.cc:515] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:59.145328 21818 raft_consensus.cc:515] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:59.257197 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:59.258266 14264 raft_consensus.cc:2393] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 25: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:12:59.144991 21962 consensus_queue.cc:1048] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 13, Time since last communication: 0.359s
I20260709 12:12:59.261456 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:59.234051 22004 raft_consensus.cc:493] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
W20260709 12:12:59.264331 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 46189us
I20260709 12:12:59.267356 14336 raft_consensus.cc:2468] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 25.
W20260709 12:12:59.252102 22009 consensus_meta.cc:287] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.549s	user 0.016s	sys 0.024s
I20260709 12:12:59.243544 22018 raft_consensus.cc:2804] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:12:59.246558 21890 leader_election.cc:290] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:59.233162 21883 consensus_queue.cc:1243] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer 885067a0d31741bfb5c9935788e315bf log is divergent from this leader: its last log entry 20.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 12:12:59.284608 22016 raft_consensus.cc:515] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:59.287276 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:12:59.282087 21894 consensus_meta.cc:287] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.677s	user 0.013s	sys 0.004s
I20260709 12:12:59.290181 21894 raft_consensus.cc:515] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:59.291991 22042 raft_consensus.cc:493] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:59.292555 21894 leader_election.cc:290] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 22 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:59.293551 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:59.294695 21953 leader_election.cc:290] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:12:59.295177 22034 log.cc:927] Time spent T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 12:12:59.296871 14336 raft_consensus.cc:1275] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 12:12:59.299283 14264 raft_consensus.cc:2393] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 22: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:12:59.242566 21912 consensus_queue.cc:1059] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 22.13, Next index: 14, Last known committed idx: 11, Time since last communication: 0.031s
I20260709 12:12:59.243067 21695 raft_consensus.cc:515] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:59.305066 21917 raft_consensus.cc:2804] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:12:59.305552 21917 raft_consensus.cc:493] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:59.305930 14332 raft_consensus.cc:2410] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for term 22 because replica has last-logged OpId of term: 21 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 12.
W20260709 12:12:59.306887 22031 log.cc:927] Time spent T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:12:59.283607 22009 raft_consensus.cc:515] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:59.309055 21901 raft_consensus.cc:3055] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:59.309454 21912 raft_consensus.cc:3055] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:12:59.309903 21912 raft_consensus.cc:740] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:59.311017 21912 consensus_queue.cc:260] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:59.270185 22004 raft_consensus.cc:3060] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:59.301604 14330 raft_consensus.cc:2468] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 20.
W20260709 12:12:59.301456 21774 consensus_meta.cc:287] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.534s	user 0.006s	sys 0.008s
I20260709 12:12:59.281494 22018 raft_consensus.cc:493] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:59.331836 14155 leader_election.cc:304] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:59.322832 14186 raft_consensus.cc:2468] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 22.
I20260709 12:12:59.317814 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:59.318078 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
W20260709 12:12:59.307848 22028 log.cc:927] Time spent T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.175s	user 0.000s	sys 0.001s
I20260709 12:12:59.332231 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:59.336864 14181 raft_consensus.cc:1240] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 21. Current term is 22. Ops: []
I20260709 12:12:59.292630 22042 raft_consensus.cc:515] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:59.309487 21901 raft_consensus.cc:740] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:12:59.339896 22042 leader_election.cc:290] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:59.340401 21901 consensus_queue.cc:260] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:12:59.341571 22036 log.cc:927] Time spent T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.149s	user 0.000s	sys 0.000s
I20260709 12:12:59.342620 14264 raft_consensus.cc:1275] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:12:59.342993 21838 leader_election.cc:290] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 22 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:12:59.343555 22027 log.cc:927] Time spent T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.273s	user 0.001s	sys 0.000s
I20260709 12:12:59.344851 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:59.345541 14338 raft_consensus.cc:2468] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 21.
I20260709 12:12:59.346881 14338 raft_consensus.cc:1275] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:12:59.347942 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:59.348590 14338 raft_consensus.cc:2468] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 24.
I20260709 12:12:59.334477 22018 raft_consensus.cc:3060] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:12:59.354202 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 23 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:59.355525 14334 raft_consensus.cc:1240] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 21. Current term is 22. Ops: []
I20260709 12:12:59.358094 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:59.305969 21917 raft_consensus.cc:3060] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:59.358918 14229 leader_election.cc:304] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:59.345099 14257 raft_consensus.cc:2393] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 25: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:12:59.317222 21912 raft_consensus.cc:3060] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:12:59.362022 14230 leader_election.cc:304] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:59.264688 21873 consensus_queue.cc:237] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:59.332237 22039 raft_consensus.cc:493] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:59.377341 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:59.381088 14186 raft_consensus.cc:1240] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 27 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 26. Current term is 27. Ops: []
I20260709 12:12:59.382781 14331 raft_consensus.cc:2468] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 21.
W20260709 12:12:59.382560 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 151539us
W20260709 12:12:59.371724 22032 log.cc:927] Time spent T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.303s	user 0.000s	sys 0.001s
I20260709 12:12:59.386368 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:59.299598 21928 consensus_queue.cc:237] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 10, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:59.370883 21924 raft_consensus.cc:2749] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:12:59.392951 14181 raft_consensus.cc:2368] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 21. Current term is 22.
I20260709 12:12:59.397430 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:59.382848 22013 leader_election.cc:290] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:59.406735 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:59.412583 14339 raft_consensus.cc:2468] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 21.
I20260709 12:12:59.414186 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
W20260709 12:12:59.415746 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 93567.9us
I20260709 12:12:59.421936 22043 raft_consensus.cc:2749] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:59.423130 22022 raft_consensus.cc:493] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:59.423797 22022 raft_consensus.cc:515] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:59.431116 14184 raft_consensus.cc:1275] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:12:59.432127 14188 raft_consensus.cc:1275] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 12:12:59.435940 22017 raft_consensus.cc:3055] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:12:59.436443 22017 raft_consensus.cc:740] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:59.440546 21756 leader_election.cc:290] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:12:59.447400 21955 consensus_meta.cc:287] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.680s	user 0.013s	sys 0.000s
I20260709 12:12:59.448556 22048 raft_consensus.cc:493] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:12:59.448848 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 27 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:59.449136 22048 raft_consensus.cc:515] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:59.447992 21955 raft_consensus.cc:515] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:59.451442 22048 leader_election.cc:290] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:59.454433 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:59.456194 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:59.459064 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:59.461668 14906 raft_consensus.cc:2393] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 26: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
I20260709 12:12:59.463204 14876 leader_election.cc:304] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:59.413954 21518 leader_election.cc:290] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 27 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:12:59.470662 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 69568.7us
I20260709 12:12:59.471622 14230 leader_election.cc:304] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:59.458745 21818 leader_election.cc:290] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:59.476604 21893 raft_consensus.cc:2804] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Leader election won for term 22
W20260709 12:12:59.534049 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 62530.1us
I20260709 12:12:59.485257 21711 raft_consensus.cc:493] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:59.486007 22022 leader_election.cc:290] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:59.468990 21841 consensus_queue.cc:1048] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.051s
I20260709 12:12:59.437568 22017 consensus_queue.cc:260] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:59.547124 21712 raft_consensus.cc:515] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:59.484016 22048 raft_consensus.cc:2749] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:59.398002 22039 raft_consensus.cc:515] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:59.479975 21960 ts_tablet_manager.cc:1929] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 16.11
W20260709 12:12:59.560719 21943 consensus_meta.cc:287] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.759s	user 0.015s	sys 0.000s
I20260709 12:12:59.570888 14230 leader_election.cc:304] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:59.573559 14189 raft_consensus.cc:3060] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:12:59.578238 21924 raft_consensus.cc:2749] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:59.578102 21565 raft_consensus.cc:493] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:59.588186 21565 raft_consensus.cc:515] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:59.574875 21955 leader_election.cc:290] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 25 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:59.560236 21711 raft_consensus.cc:515] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:59.590750 21565 leader_election.cc:290] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:59.591272 21711 leader_election.cc:290] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:59.565191 21893 raft_consensus.cc:697] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 22 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:12:59.586560 14155 leader_election.cc:304] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:59.607020 14155 leader_election.cc:304] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:59.607790 22018 raft_consensus.cc:515] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:59.609138 14335 raft_consensus.cc:2393] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db in current term 27: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:12:59.611368 21955 raft_consensus.cc:2749] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:59.612182 21955 raft_consensus.cc:2749] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:12:59.613979 14903 raft_consensus.cc:1275] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 20 index: 16. (term mismatch)
I20260709 12:12:59.614377 14903 pending_rounds.cc:85] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db: Aborting all ops after (but not including) 15
I20260709 12:12:59.614599 14903 pending_rounds.cc:107] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db: Aborting uncommitted NO_OP operation due to leader change: 19.16
I20260709 12:12:59.614843 14903 raft_consensus.cc:2889] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:59.605491 21893 consensus_queue.cc:237] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:59.613341 14155 leader_election.cc:304] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:59.600926 21712 leader_election.cc:290] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 25 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:12:59.601890 22024 log.cc:927] Time spent T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.529s	user 0.001s	sys 0.005s
I20260709 12:12:59.584223 21960 log.cc:1199] T 35b39d0f3270452a8bd4f4b1800a837c P 885067a0d31741bfb5c9935788e315bf: Deleting WAL directory at /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598886212958-12986-0/minicluster-data/ts-0-root/wals/35b39d0f3270452a8bd4f4b1800a837c
I20260709 12:12:59.556916 21863 raft_consensus.cc:515] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:59.604303 14230 leader_election.cc:304] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:59.623566 14189 raft_consensus.cc:2468] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 26.
I20260709 12:12:59.633082 14335 raft_consensus.cc:1275] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:12:59.631723 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:59.634889 14334 raft_consensus.cc:2468] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 20.
I20260709 12:12:59.637490 21960 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45350 (request call id 0) took 2812 ms. Trace:
I20260709 12:12:59.637868 21960 rpcz_store.cc:276] 0709 12:12:56.824809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:56.825069 (+   260us) service_pool.cc:224] Handling call
0709 12:12:57.187040 (+361971us) ts_tablet_manager.cc:1151] Deleting tablet 35b39d0f3270452a8bd4f4b1800a837c
0709 12:12:57.187147 (+   107us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 12:12:58.629480 (+1442333us) tablet_metadata.cc:665] Metadata flushed
0709 12:12:59.475558 (+846078us) tablet_metadata.cc:665] Metadata flushed
0709 12:12:59.637397 (+161839us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":743195,"tablet-delete.queue_time_us":357777,"thread_start_us":87837,"threads_started":1}
I20260709 12:12:59.641577 14877 leader_election.cc:304] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:12:59.630329 21924 raft_consensus.cc:2749] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:12:59.635787 21943 raft_consensus.cc:2749] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:12:59.648391 14188 raft_consensus.cc:1275] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
W20260709 12:12:59.648960 22056 log.cc:927] Time spent T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
W20260709 12:12:59.649605 14305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:59.650365 22039 leader_election.cc:290] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:59.651929 14155 leader_election.cc:400] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 24 election: Vote denied by peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673) with higher term. Message: Invalid argument: T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 24. Current term is 25.
I20260709 12:12:59.661963 14155 leader_election.cc:403] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 24 election: Cancelling election due to peer responding with higher term
I20260709 12:12:59.653497 21863 leader_election.cc:290] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 26 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:12:59.662798 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 58616.9us
I20260709 12:12:59.664844 14230 leader_election.cc:304] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:59.654215 21217 raft_consensus.cc:2804] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:12:59.688696 21217 raft_consensus.cc:493] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:59.689103 21217 raft_consensus.cc:3060] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:12:59.691334 21695 leader_election.cc:290] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:59.666283 22018 leader_election.cc:290] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 27 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:59.654985 21754 consensus_queue.cc:1048] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.012s
I20260709 12:12:59.656424 21711 raft_consensus.cc:493] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:12:59.676199 14155 leader_election.cc:304] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:59.676772 21712 raft_consensus.cc:2749] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 25 FOLLOWER]: Leader election lost for term 24. Reason: Vote denied by peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673) with higher term. Message: Invalid argument: T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 24. Current term is 25.
I20260709 12:12:59.679349 21917 raft_consensus.cc:515] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:59.685705 22009 leader_election.cc:290] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 21 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:59.687110 21966 leader_election.cc:290] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:59.687486 14336 raft_consensus.cc:2410] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for term 23 because replica has last-logged OpId of term: 22 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 12.
I20260709 12:12:59.687873 14261 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280"
dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
mode: GRACEFUL
new_leader_uuid: "65c9c1653b3346b39a0e118540e6080c"
 from {username='slave'} at 127.0.0.1:54238
I20260709 12:12:59.716109 14261 raft_consensus.cc:606] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 25 FOLLOWER]: Received request to transfer leadership to TS 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:59.716528 14261 raft_consensus.cc:614] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 25 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:59.701421 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:59.697798 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 27 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:59.717006 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:59.709998 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:59.675917 22016 leader_election.cc:290] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 22 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:12:59.713765 14155 leader_election.cc:304] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:59.722371 14265 raft_consensus.cc:2410] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db for term 27 because replica has last-logged OpId of term: 25 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 24 index: 15.
I20260709 12:12:59.723994 22035 raft_consensus.cc:2749] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:59.724622 14155 leader_election.cc:304] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:59.725307 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
W20260709 12:12:59.725975 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 61230.9us
I20260709 12:12:59.727113 14261 raft_consensus.cc:1275] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 25 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
I20260709 12:12:59.722790 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:59.724725 21943 raft_consensus.cc:2749] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:59.725430 22035 raft_consensus.cc:2749] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:59.720017 14257 raft_consensus.cc:3060] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:59.727065 14230 leader_election.cc:304] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:59.730855 14155 leader_election.cc:304] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
W20260709 12:12:59.722504 14304 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:12:59.705693 22039 raft_consensus.cc:2749] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:12:59.743108 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:59.710688 21909 raft_consensus.cc:493] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:12:59.747920 14335 raft_consensus.cc:1275] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 12:12:59.745580 21924 raft_consensus.cc:2804] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:12:59.754010 21924 raft_consensus.cc:493] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:59.754390 21924 raft_consensus.cc:3060] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:12:59.755585 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 25 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:59.758540 22009 consensus_queue.cc:1048] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:12:59.759388 14230 leader_election.cc:304] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:59.742952 21955 consensus_queue.cc:1048] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.016s
I20260709 12:12:59.760680 14230 leader_election.cc:304] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:12:59.761260 22038 raft_consensus.cc:2749] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:12:59.762042 22038 raft_consensus.cc:2804] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:12:59.762387 22038 raft_consensus.cc:493] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:12:59.694675 22004 raft_consensus.cc:515] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:59.762758 22038 raft_consensus.cc:3060] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:59.764403 22004 leader_election.cc:290] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 23 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:59.767050 21917 leader_election.cc:290] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 20 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:59.738072 21711 raft_consensus.cc:515] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:59.753402 14262 raft_consensus.cc:1275] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 12:12:59.771155 21711 leader_election.cc:290] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:12:59.771944 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:59.772578 14910 raft_consensus.cc:3060] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:12:59.772884 22038 raft_consensus.cc:515] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:12:59.775601 14303 leader_election.cc:304] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:59.779496 14262 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2"
dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
mode: GRACEFUL
new_leader_uuid: "65c9c1653b3346b39a0e118540e6080c"
 from {username='slave'} at 127.0.0.1:54238
I20260709 12:12:59.780184 14262 raft_consensus.cc:606] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Received request to transfer leadership to TS 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:59.780519 14262 raft_consensus.cc:614] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:12:59.781090 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:59.786587 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:59.789301 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:59.790375 14257 raft_consensus.cc:2468] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 22.
I20260709 12:12:59.735736 21712 raft_consensus.cc:2749] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:59.791709 14331 raft_consensus.cc:2393] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 21: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:12:59.792446 14230 leader_election.cc:304] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:12:59.795471 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:59.796929 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:59.799373 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:59.800596 14261 raft_consensus.cc:1275] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 12:12:59.737028 21893 consensus_queue.cc:1059] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.080s
I20260709 12:12:59.816008 22038 leader_election.cc:290] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:59.802071 22004 raft_consensus.cc:2749] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:12:59.820058 21893 raft_consensus.cc:3055] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:59.820451 21893 raft_consensus.cc:740] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:12:59.815078 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:59.822252 14303 leader_election.cc:400] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 election: Vote denied by peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187) with higher term. Message: Invalid argument: T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for earlier term 16. Current term is 17.
I20260709 12:12:59.822567 14303 leader_election.cc:403] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 12:12:59.823083 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:59.823576 14303 leader_election.cc:304] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:59.824868 22018 raft_consensus.cc:2749] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:12:59.816170 22009 consensus_queue.cc:1048] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.009s
I20260709 12:12:59.826457 14338 raft_consensus.cc:1240] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 21. Current term is 22. Ops: []
I20260709 12:12:59.816877 21622 consensus_queue.cc:1048] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.010s
I20260709 12:12:59.821303 21893 consensus_queue.cc:260] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:59.816728 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:12:59.817147 14333 raft_consensus.cc:1275] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 12:12:59.838585 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:59.839541 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:59.840345 14263 raft_consensus.cc:2393] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 20: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:12:59.816725 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:59.816403 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:59.841321 14303 leader_election.cc:304] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:59.817030 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:12:59.842712 14262 raft_consensus.cc:2468] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 21.
I20260709 12:12:59.851147 14229 leader_election.cc:304] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:59.841234 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:59.853156 14263 raft_consensus.cc:3060] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 25 FOLLOWER]: Advancing to term 27
I20260709 12:12:59.855605 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:59.861081 14330 raft_consensus.cc:1275] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 12:12:59.863432 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:59.865315 14257 raft_consensus.cc:3060] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:12:59.866060 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:59.866714 14181 raft_consensus.cc:3060] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:12:59.868230 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:59.841204 22017 raft_consensus.cc:3060] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:59.869870 14183 raft_consensus.cc:1240] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 19. Current term is 20. Ops: []
W20260709 12:12:59.870321 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 77987.4us
I20260709 12:12:59.871281 14303 leader_election.cc:304] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:12:59.876837 14229 leader_election.cc:400] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 21 election: Vote denied by peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187) with higher term. Message: Invalid argument: T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 21. Current term is 22.
I20260709 12:12:59.877249 14229 leader_election.cc:403] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 21 election: Cancelling election due to peer responding with higher term
I20260709 12:12:59.871222 14260 raft_consensus.cc:2393] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 22: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
I20260709 12:12:59.870260 14265 raft_consensus.cc:2393] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 22: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:12:59.879199 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:59.881659 14183 raft_consensus.cc:1275] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 25 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 24 index: 13. Preceding OpId from leader: term: 25 index: 12. (term mismatch)
I20260709 12:12:59.882254 14183 pending_rounds.cc:85] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf: Aborting all ops after (but not including) 11
I20260709 12:12:59.882565 14183 pending_rounds.cc:107] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf: Aborting uncommitted NO_OP operation due to leader change: 22.12
I20260709 12:12:59.882973 14183 raft_consensus.cc:2889] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 25 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:59.882477 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:59.875836 14230 leader_election.cc:304] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:59.885692 14230 leader_election.cc:304] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:59.738142 21966 consensus_queue.cc:1048] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.112s
I20260709 12:12:59.887723 14230 leader_election.cc:304] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:59.888563 14189 raft_consensus.cc:1275] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 25 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
I20260709 12:12:59.878690 14911 raft_consensus.cc:2468] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 23.
I20260709 12:12:59.890635 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:59.814401 22061 raft_consensus.cc:493] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:12:59.892064 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:59.891561 14183 pending_rounds.cc:107] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf: Aborting uncommitted NO_OP operation due to leader change: 24.13
I20260709 12:12:59.835297 21893 raft_consensus.cc:3060] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:59.900467 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:12:59.903126 14331 raft_consensus.cc:2468] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 20.
I20260709 12:12:59.903232 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 25 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:59.860248 22009 raft_consensus.cc:2749] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:12:59.896970 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:12:59.897665 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:12:59.899889 14265 raft_consensus.cc:2393] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 23: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:12:59.869623 21711 raft_consensus.cc:2804] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:12:59.896422 14183 raft_consensus.cc:2889] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 25 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:59.906108 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:59.902343 14303 leader_election.cc:304] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:12:59.748253 21909 raft_consensus.cc:515] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } }
I20260709 12:12:59.909564 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:59.911986 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:59.914646 14261 raft_consensus.cc:3060] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:12:59.881728 21873 raft_consensus.cc:2804] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:12:59.911944 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:12:59.891629 21953 raft_consensus.cc:2749] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:59.917181 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 27 candidate_status { last_received { term: 26 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:12:59.895418 21962 raft_consensus.cc:2804] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:12:59.893822 21818 raft_consensus.cc:2804] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:12:59.923995 14303 leader_election.cc:304] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:59.924551 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:12:59.928267 14258 raft_consensus.cc:2468] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 25.
I20260709 12:12:59.873162 22038 consensus_queue.cc:1059] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.043s
I20260709 12:12:59.924939 14877 leader_election.cc:304] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:12:59.926574 14257 raft_consensus.cc:2468] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 26.
I20260709 12:12:59.898855 22041 raft_consensus.cc:2749] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Leader election lost for term 21. Reason: Vote denied by peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187) with higher term. Message: Invalid argument: T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 21. Current term is 22.
I20260709 12:12:59.881671 22039 consensus_queue.cc:1059] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 26.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.039s
I20260709 12:12:59.920163 21873 raft_consensus.cc:493] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:59.947767 14265 raft_consensus.cc:1240] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 21. Current term is 22. Ops: []
I20260709 12:12:59.927326 21962 raft_consensus.cc:493] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:59.952128 14257 raft_consensus.cc:1275] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 25 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 25 index: 12. (index mismatch)
I20260709 12:12:59.909484 22004 consensus_queue.cc:1059] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 19.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 12:12:59.928215 21774 raft_consensus.cc:2804] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:12:59.958973 14911 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "afce5304599246a580d798fc0c843964"
dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
mode: GRACEFUL
new_leader_uuid: "885067a0d31741bfb5c9935788e315bf"
 from {username='slave'} at 127.0.0.1:38628
I20260709 12:12:59.965478 14911 raft_consensus.cc:606] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 18 LEADER]: Received request to transfer leadership to TS 885067a0d31741bfb5c9935788e315bf
I20260709 12:12:59.968636 14155 leader_election.cc:304] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:12:59.906625 22061 raft_consensus.cc:515] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:12:59.970038 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 82442.8us
I20260709 12:12:59.937093 22048 raft_consensus.cc:2749] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:12:59.944308 21711 raft_consensus.cc:697] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 22 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:59.976004 14155 leader_election.cc:304] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
W20260709 12:12:59.986439 22045 log.cc:927] Time spent T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.580s	user 0.004s	sys 0.000s
I20260709 12:12:59.986881 22022 consensus_queue.cc:1048] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.004s
I20260709 12:12:59.986896 21774 raft_consensus.cc:697] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 23 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:59.993633 21774 consensus_queue.cc:237] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:59.995571 22061 leader_election.cc:290] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:12:59.996431 22004 raft_consensus.cc:3055] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:12:59.996838 22004 raft_consensus.cc:740] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:12:59.958416 21690 raft_consensus.cc:2749] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:12:59.977274 14909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53200 (request call id 1001) took 1052 ms. Trace:
I20260709 12:12:59.932968 21894 consensus_queue.cc:1048] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.042s
I20260709 12:12:59.930680 21217 raft_consensus.cc:515] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:12:59.978096 21943 raft_consensus.cc:3060] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:12:59.954109 21873 raft_consensus.cc:3060] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:12:59.966367 21962 raft_consensus.cc:3060] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:12:59.962846 21756 consensus_queue.cc:1059] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.016s
W20260709 12:13:00.007602 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 119326us
I20260709 12:12:59.930328 22009 consensus_queue.cc:1048] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.034s
I20260709 12:13:00.012602 14910 raft_consensus.cc:2468] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 27.
I20260709 12:12:59.962491 21912 consensus_queue.cc:1048] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.042s
I20260709 12:13:00.022433 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:13:00.002487 14909 rpcz_store.cc:276] 0709 12:12:58.921341 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:58.921488 (+   147us) service_pool.cc:224] Handling call
0709 12:12:59.009955 (+ 88467us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:12:59.060966 (+ 51011us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:59.061003 (+    37us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:12:59.235462 (+174459us) spinlock_profiling.cc:243] Waited 2.36 ms on lock 0x7b2c00125df8. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2125a34a11 00007f2125a44372 00007f2127176a01 00007f212713b43a 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2
0709 12:12:59.598852 (+363390us) spinlock_profiling.cc:243] Waited 2.72 ms on lock 0x7b2c00125df8. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2125a34a11 00007f2125a44372 00007f2127176a01 00007f212713b43a 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2
0709 12:12:59.599492 (+   640us) log.cc:844] Serialized 52 byte log entry
0709 12:12:59.718770 (+119278us) raft_consensus.cc:1645] Marking committed up to 16
0709 12:12:59.739141 (+ 20371us) log.cc:844] Serialized 14 byte log entry
0709 12:12:59.739353 (+   212us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:59.739421 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:12:59.973225 (+233804us) raft_consensus.cc:1685] finished
0709 12:12:59.973250 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:12:59.973447 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25141,"prepare.queue_time_us":23879,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":63,"raft.queue_time_us":20970,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":7582,"spinlock_wait_cycles":17269120,"thread_start_us":118887,"threads_started":1,"wal-append.queue_time_us":215032}
I20260709 12:12:59.972697 21955 consensus_queue.cc:1048] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 12:13:00.061339 14303 leader_election.cc:304] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
W20260709 12:13:00.065359 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 127952us
I20260709 12:13:00.050421 21863 raft_consensus.cc:493] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:00.053436 22040 raft_consensus.cc:2749] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
W20260709 12:13:00.078051 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 102159us
I20260709 12:13:00.079877 14155 leader_election.cc:304] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:13:00.085409 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:13:00.064028 21818 raft_consensus.cc:697] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 26 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:13:00.062013 21695 consensus_queue.cc:1048] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.023s
I20260709 12:13:00.078081 21883 raft_consensus.cc:2804] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 27 FOLLOWER]: Leader election won for term 27
I20260709 12:13:00.093570 21766 raft_consensus.cc:2749] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 27 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:13:00.080266 21711 consensus_queue.cc:237] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:00.102035 21883 raft_consensus.cc:697] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 27 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:13:00.101825 21924 raft_consensus.cc:515] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:00.103103 21883 consensus_queue.cc:237] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 25.16, Last appended by leader: 16, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:00.104070 21924 leader_election.cc:290] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 26 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:00.088456 22004 consensus_queue.cc:260] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.9, Last appended by leader: 9, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:00.106519 22004 raft_consensus.cc:3060] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:00.114118 14155 leader_election.cc:304] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:13:00.121671 21945 consensus_queue.cc:1048] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:13:00.123948 14331 raft_consensus.cc:2468] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 25.
I20260709 12:13:00.122339 21838 raft_consensus.cc:993] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db: : Instructing follower 885067a0d31741bfb5c9935788e315bf to start an election
I20260709 12:13:00.125125 21838 raft_consensus.cc:1081] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 18 LEADER]: Signalling peer 885067a0d31741bfb5c9935788e315bf to start an election
I20260709 12:13:00.125900 21818 consensus_queue.cc:237] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.13, Last appended by leader: 13, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:00.130751 14261 raft_consensus.cc:2468] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 26.
W20260709 12:13:00.113982 22051 log.cc:927] Time spent T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.571s	user 0.005s	sys 0.000s
I20260709 12:13:00.085153 21518 raft_consensus.cc:2749] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:00.134402 14181 raft_consensus.cc:2468] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 26.
W20260709 12:13:00.135848 22071 log.cc:927] Time spent T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:13:00.136869 14337 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50856 (request call id 3198) took 1246 ms. Trace:
I20260709 12:13:00.146919 14303 leader_election.cc:304] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
W20260709 12:13:00.137064 22070 log.cc:927] Time spent T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:13:00.127944 22023 consensus_queue.cc:1059] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.010s
I20260709 12:13:00.135789 21712 raft_consensus.cc:2804] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:13:00.140404 21909 leader_election.cc:290] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187)
I20260709 12:13:00.143348 14183 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "afce5304599246a580d798fc0c843964"
dest_uuid: "885067a0d31741bfb5c9935788e315bf"
 from {username='slave'} at 127.0.0.1:56652
I20260709 12:13:00.077316 21863 raft_consensus.cc:515] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:00.148865 14187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 3758) took 1056 ms. Trace:
I20260709 12:13:00.165102 14183 raft_consensus.cc:493] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:00.148016 14155 leader_election.cc:304] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:13:00.165608 14183 raft_consensus.cc:3060] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:00.159518 14334 raft_consensus.cc:1240] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 17. Current term is 18. Ops: []
I20260709 12:13:00.146242 14337 rpcz_store.cc:276] 0709 12:12:58.890619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:58.894212 (+  3593us) service_pool.cc:224] Handling call
0709 12:12:58.894632 (+   420us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:12:59.025575 (+130943us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:12:59.025611 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:12:59.086097 (+ 60486us) log.cc:844] Serialized 26 byte log entry
0709 12:12:59.388201 (+302104us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:12:59.474798 (+ 86597us) log.cc:844] Serialized 14 byte log entry
0709 12:12:59.475220 (+   422us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:12:59.475305 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:00.113631 (+638326us) spinlock_profiling.cc:243] Waited 2.72 ms on lock 0x7b24001f7288. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2123ed49c4 00007f2123ed2acb 00007f212408ddc9 00007f212408da55 00007f212408d09d 00007f2126cbf10e 00007f2126cd688c 00007f2126cd5bb6 00007f2126cd57d8 00007f2126cdf221
0709 12:13:00.136502 (+ 22871us) raft_consensus.cc:1685] finished
0709 12:13:00.136629 (+   127us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:00.136798 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":140847,"prepare.queue_time_us":133602,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"raft.queue_time_us":109206,"raft.run_cpu_time_us":329,"raft.run_wall_time_us":11160,"spinlock_wait_cycles":6256512,"thread_start_us":317669,"threads_started":2,"wal-append.queue_time_us":339367}
I20260709 12:13:00.158860 21955 consensus_queue.cc:1048] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.010s
I20260709 12:13:00.159943 21912 raft_consensus.cc:2804] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:13:00.178542 14263 raft_consensus.cc:2468] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 27.
I20260709 12:13:00.163976 21712 raft_consensus.cc:493] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:00.183146 21217 leader_election.cc:290] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 21 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:00.187258 21863 leader_election.cc:290] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:13:00.188025 21873 raft_consensus.cc:515] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:00.189405 21917 consensus_queue.cc:1059] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:13:00.190142 14260 raft_consensus.cc:2393] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 25: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:13:00.190562 21518 raft_consensus.cc:3055] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:13:00.190970 21518 raft_consensus.cc:740] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:13:00.192073 21518 consensus_queue.cc:260] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:00.202013 22023 raft_consensus.cc:2804] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 25 FOLLOWER]: Leader election won for term 25
W20260709 12:13:00.203459 14875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:00.204612 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:13:00.215178 14333 raft_consensus.cc:2468] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 20.
W20260709 12:13:00.203434 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 124607us
I20260709 12:13:00.183526 21712 raft_consensus.cc:3060] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:00.246884 14304 leader_election.cc:304] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:00.202749 22023 raft_consensus.cc:697] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 25 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:13:00.252390 14304 leader_election.cc:304] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:00.253849 14304 leader_election.cc:304] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:13:00.255110 14304 leader_election.cc:304] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:00.220085 21912 raft_consensus.cc:697] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 26 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:13:00.258876 14332 raft_consensus.cc:2410] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for term 22 because replica has last-logged OpId of term: 21 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 13.
I20260709 12:13:00.279002 14304 leader_election.cc:304] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
W20260709 12:13:00.343910 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 64989.3us
I20260709 12:13:00.260456 21863 raft_consensus.cc:3060] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:00.318114 22018 raft_consensus.cc:2749] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:13:00.261344 21711 raft_consensus.cc:2749] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:00.352582 21873 leader_election.cc:290] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 25 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:00.323403 21955 raft_consensus.cc:493] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:00.358894 21912 consensus_queue.cc:237] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 14, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:13:00.360292 22087 log.cc:927] Time spent T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.136s	user 0.000s	sys 0.001s
I20260709 12:13:00.342195 21962 raft_consensus.cc:515] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:00.397648 21962 leader_election.cc:290] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:13:00.398999 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 226903us
I20260709 12:13:00.377996 22023 consensus_queue.cc:237] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.16, Last appended by leader: 16, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:00.333755 22016 raft_consensus.cc:2749] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187) with higher term. Message: Invalid argument: T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for earlier term 16. Current term is 17.
I20260709 12:13:00.252094 21928 consensus_queue.cc:1048] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.094s
I20260709 12:13:00.353412 21622 raft_consensus.cc:2749] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:13:00.438144 14330 raft_consensus.cc:1240] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 21. Current term is 22. Ops: []
I20260709 12:13:00.444029 22005 consensus_queue.cc:1048] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:13:00.393471 21955 raft_consensus.cc:515] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } }
I20260709 12:13:00.478253 22099 consensus_queue.cc:1059] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:13:00.500603 14183 raft_consensus.cc:515] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:13:00.541893 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 123126us
I20260709 12:13:00.544971 14183 leader_election.cc:290] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:13:00.543457 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 119335us
I20260709 12:13:00.540943 21994 raft_consensus.cc:493] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
W20260709 12:13:00.562155 21943 consensus_meta.cc:287] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.512s	user 0.012s	sys 0.000s
I20260709 12:13:00.591593 21943 raft_consensus.cc:2749] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:13:00.566427 14256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41764 (request call id 3841) took 1846 ms. Trace:
I20260709 12:13:00.592466 21943 raft_consensus.cc:493] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
W20260709 12:13:00.567637 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 586765us
I20260709 12:13:00.570324 22048 consensus_queue.cc:1048] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:13:00.593041 21943 raft_consensus.cc:515] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:13:00.571424 14155 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:00.572032 21901 raft_consensus.cc:3060] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:00.578917 21955 leader_election.cc:290] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:13:00.585773 14875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:00.586344 21953 raft_consensus.cc:3055] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 26 LEADER]: Stepping down as leader of term 26
I20260709 12:13:00.569406 22046 raft_consensus.cc:2749] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:00.563781 21994 raft_consensus.cc:515] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:00.592842 14256 rpcz_store.cc:276] 0709 12:12:58.719969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:58.721864 (+  1895us) service_pool.cc:224] Handling call
0709 12:12:58.722198 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:58.722482 (+   284us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:12:58.820737 (+ 98255us) log.cc:844] Serialized 14 byte log entry
0709 12:12:59.954539 (+1133802us) spinlock_profiling.cc:243] Waited 64.2 ms on lock 0x7b18000c1de0. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f212cf16ab1 00007f212cf23281 00007f2123fc8c0a 00007f212d708219 00007f2124050a40 00007f212404b4e4 00007f212404b455 00007f212ab333c7 00007f21271459a7 00007f21271550bf 00007f2127155038
0709 12:12:59.954756 (+   217us) log.cc:844] Serialized 14 byte log entry
0709 12:13:00.565298 (+610542us) spinlock_profiling.cc:243] Waited 2.04 ms on lock 0x7b18000c1de0. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f212cf16ab1 00007f212cf23281 00007f2123fc8c0a 00007f212d708219 00007f2124050a40 00007f212404b4e4 00007f212404b455 00007f2127133060 00007f2127145716 00007f2127156287 00007f2127156208
0709 12:13:00.565476 (+   178us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:00.565528 (+    52us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:13:00.565575 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:00.565663 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:00.566349 (+   686us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":956644,"prepare.queue_time_us":1258040,"prepare.run_cpu_time_us":101,"prepare.run_wall_time_us":114,"raft.queue_time_us":624525,"raft.run_cpu_time_us":204,"raft.run_wall_time_us":5305,"spinlock_wait_cycles":152273152,"thread_start_us":176186,"threads_started":2,"wal-append.queue_time_us":368123}
I20260709 12:13:00.594589 22048 consensus_queue.cc:1048] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.002s
W20260709 12:13:00.571275 22089 log.cc:927] Time spent T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
W20260709 12:13:00.594421 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 543458us
I20260709 12:13:00.165144 14187 rpcz_store.cc:276] 0709 12:12:59.092229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:59.092732 (+   503us) service_pool.cc:224] Handling call
0709 12:12:59.093105 (+   373us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:12:59.117203 (+ 24098us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 12:12:59.151442 (+ 34239us) log.cc:844] Serialized 14 byte log entry
0709 12:13:00.014543 (+863101us) spinlock_profiling.cc:243] Waited 2.98 ms on lock 0x7b18001f6420. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f212cf16ab1 00007f212cf23281 00007f2124030e07 00007f212ce8b9a9 00007f212404d69b 00007f212404b93f 00007f212404dc02 00007f2126cd520b 00007f2126cdad23 00007f2126cdb23a 00007f2127145a2a
0709 12:13:00.148372 (+133829us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:00.148427 (+    55us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:13:00.148606 (+   179us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:00.148677 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:00.148799 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40797,"prepare.queue_time_us":29197,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":18059,"raft.queue_time_us":3604,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":4874,"spinlock_wait_cycles":6862208,"thread_start_us":133521,"threads_started":1}
I20260709 12:13:00.606029 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:00.562664 21712 raft_consensus.cc:515] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:00.616804 21943 leader_election.cc:290] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:00.619470 22041 raft_consensus.cc:3055] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:13:00.620066 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: true dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:13:00.638263 14909 raft_consensus.cc:3055] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:13:00.620990 21863 raft_consensus.cc:2749] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:13:00.621838 14156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:00.641712 14258 raft_consensus.cc:1275] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 22 index: 11. (index mismatch)
I20260709 12:13:00.624361 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:00.626395 14336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50856 (request call id 3207) took 1282 ms. Trace:
I20260709 12:13:00.627282 21994 leader_election.cc:290] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:00.644007 14183 raft_consensus.cc:1240] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 20. Current term is 21. Ops: [20.12-20.12]
I20260709 12:13:00.642599 14336 rpcz_store.cc:276] 0709 12:12:59.343925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:59.353869 (+  9944us) service_pool.cc:224] Handling call
0709 12:13:00.626188 (+1272319us) spinlock_profiling.cc:243] Waited 332 ms on lock 0x7b54002a6f54. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:13:00.626332 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":764159360}
I20260709 12:13:00.630421 14155 leader_election.cc:304] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:13:00.632208 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:13:00.634249 14181 raft_consensus.cc:1240] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 21. Current term is 22. Ops: [21.12-21.12]
I20260709 12:13:00.630288 14338 raft_consensus.cc:2468] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 20.
I20260709 12:13:00.636473 14903 raft_consensus.cc:1240] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 21 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 20. Current term is 21. Ops: []
I20260709 12:13:00.638558 14909 raft_consensus.cc:740] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:13:00.639663 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:13:00.639739 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:13:00.652994 14189 raft_consensus.cc:2468] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 20.
I20260709 12:13:00.641779 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:00.643021 14330 raft_consensus.cc:2393] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 22: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:13:00.609594 21953 raft_consensus.cc:740] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:13:00.658783 14335 raft_consensus.cc:1240] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 21. Current term is 22. Ops: []
I20260709 12:13:00.653471 14155 leader_election.cc:304] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:13:00.659451 14262 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d"
dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
mode: GRACEFUL
new_leader_uuid: "885067a0d31741bfb5c9935788e315bf"
 from {username='slave'} at 127.0.0.1:54238
I20260709 12:13:00.660470 14262 raft_consensus.cc:606] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 24 LEADER]: Received request to transfer leadership to TS 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:00.660899 14155 leader_election.cc:304] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:13:00.662395 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:13:00.663235 14257 raft_consensus.cc:2368] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 25. Current term is 26.
I20260709 12:13:00.662057 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:00.664849 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:13:00.637970 22041 raft_consensus.cc:740] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:13:00.668892 14265 raft_consensus.cc:2368] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 25. Current term is 26.
I20260709 12:13:00.671203 14155 leader_election.cc:304] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:13:00.673378 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 27 candidate_status { last_received { term: 26 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:13:00.676136 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:13:00.643581 21924 raft_consensus.cc:493] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:13:00.658448 22082 raft_consensus.cc:2749] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:13:00.681751 21955 consensus_queue.cc:1059] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 21.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:13:00.686401 21953 consensus_queue.cc:260] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 26.12, Last appended by leader: 12, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:00.668602 22040 raft_consensus.cc:2804] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:13:00.675391 14909 consensus_queue.cc:260] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:00.710906 14909 raft_consensus.cc:3060] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:00.664661 22038 raft_consensus.cc:493] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:13:00.691650 14229 leader_election.cc:304] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:00.694998 21518 raft_consensus.cc:3060] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:13:00.696498 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: true dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
W20260709 12:13:00.700146 14136 auto_rebalancer.cc:629] Failed to schedule move for tablet f1a4a5f0a8324f479c5e1f499164bf42: Illegal state: Replica 17aab1bbf5014936aa18cc21818b26ec is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 25 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } }
I20260709 12:13:00.730372 14263 raft_consensus.cc:3060] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:00.702423 21955 raft_consensus.cc:3055] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:13:00.678218 22080 raft_consensus.cc:2804] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:00.687242 21943 raft_consensus.cc:2804] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:13:00.711395 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:00.745404 14155 leader_election.cc:400] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 25 election: Vote denied by peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673) with higher term. Message: Invalid argument: T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 25. Current term is 26.
I20260709 12:13:00.753180 14155 leader_election.cc:400] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 25 election: Vote denied by peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673) with higher term. Message: Invalid argument: T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 25. Current term is 26.
I20260709 12:13:00.753543 14155 leader_election.cc:403] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 25 election: Cancelling election due to peer responding with higher term
I20260709 12:13:00.731783 22038 raft_consensus.cc:515] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:00.710633 22040 raft_consensus.cc:493] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:00.760785 22040 raft_consensus.cc:3060] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:00.771314 22081 raft_consensus.cc:3055] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:13:00.771736 22081 raft_consensus.cc:740] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:13:00.750018 21909 consensus_queue.cc:1059] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.023s
I20260709 12:13:00.773275 21909 raft_consensus.cc:3055] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:13:00.773609 21909 raft_consensus.cc:740] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:13:00.754236 14258 raft_consensus.cc:2468] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 19.
W20260709 12:13:00.781080 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 223499us
I20260709 12:13:00.783162 14155 leader_election.cc:304] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:13:00.786666 14181 raft_consensus.cc:1275] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 12:13:00.748334 14229 leader_election.cc:304] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:13:00.678821 22023 raft_consensus.cc:2749] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:00.792122 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:13:00.690035 21924 raft_consensus.cc:515] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:00.746402 22077 raft_consensus.cc:2749] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:13:00.743837 21955 raft_consensus.cc:740] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:13:00.750716 21943 raft_consensus.cc:493] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 25 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:13:00.802802 14188 raft_consensus.cc:1275] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 22 index: 11. (index mismatch)
W20260709 12:13:00.808859 14875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:00.810994 14263 raft_consensus.cc:2468] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 19.
I20260709 12:13:00.791435 22099 raft_consensus.cc:2749] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 12:13:00.784389 22022 raft_consensus.cc:2749] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 26 FOLLOWER]: Leader election lost for term 25. Reason: Vote denied by peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673) with higher term. Message: Invalid argument: T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 25. Current term is 26.
I20260709 12:13:00.815152 21943 raft_consensus.cc:3060] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:00.794035 22009 raft_consensus.cc:2804] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:13:00.823441 21894 raft_consensus.cc:493] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:00.848186 14903 raft_consensus.cc:1275] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 23 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 12:13:00.846501 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:13:00.841885 22102 log.cc:927] Time spent T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.189s	user 0.001s	sys 0.001s
W20260709 12:13:00.862780 14878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:00.770210 22072 consensus_queue.cc:1059] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.072s
I20260709 12:13:00.866791 14304 leader_election.cc:304] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:13:00.892041 14258 raft_consensus.cc:1240] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 21. Current term is 22. Ops: [21.11-21.11]
I20260709 12:13:00.849258 22009 raft_consensus.cc:493] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:13:00.853426 22077 raft_consensus.cc:493] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:00.908862 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 51848.7us
W20260709 12:13:00.910959 22108 log.cc:927] Time spent T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
W20260709 12:13:00.912127 22111 log.cc:927] Time spent T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 12:13:00.913395 21622 consensus_queue.cc:1048] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.006s
I20260709 12:13:00.914697 21924 leader_election.cc:290] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:13:00.917183 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:13:00.917549 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:13:00.920475 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:13:00.942862 14330 raft_consensus.cc:3060] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:00.920570 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:13:00.942921 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 76220.4us
I20260709 12:13:00.910825 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:00.943981 14339 raft_consensus.cc:2393] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db in current term 18: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:13:00.944787 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:00.943409 14334 raft_consensus.cc:2468] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 24.
I20260709 12:13:00.946537 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:00.947335 14334 raft_consensus.cc:2393] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 20: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:13:00.946440 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:00.890470 22047 raft_consensus.cc:493] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:00.950696 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:13:00.049618 14073 catalog_manager.cc:5028] TS 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): tablet 35b39d0f3270452a8bd4f4b1800a837c (table test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]) successfully deleted
I20260709 12:13:00.896034 22121 raft_consensus.cc:493] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:13:00.953295 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:00.909711 22009 raft_consensus.cc:3060] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:00.856016 21894 raft_consensus.cc:515] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:00.960719 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:00.965431 14265 raft_consensus.cc:1240] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 18. Current term is 19. Ops: []
I20260709 12:13:00.968580 14257 raft_consensus.cc:1240] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 19. Current term is 20. Ops: []
I20260709 12:13:00.969956 14257 raft_consensus.cc:1275] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 12:13:00.977252 14330 raft_consensus.cc:2468] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 21.
W20260709 12:13:00.978158 14073 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 1.00818e+06us
I20260709 12:13:00.853222 22081 consensus_queue.cc:260] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:13:00.967918 22105 log.cc:927] Time spent T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.186s	user 0.001s	sys 0.000s
I20260709 12:13:00.997546 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:13:00.984990 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:13:01.001502 14338 raft_consensus.cc:3060] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:00.989199 21565 raft_consensus.cc:493] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:00.983829 14336 raft_consensus.cc:1275] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 26 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 26 index: 18. (index mismatch)
I20260709 12:13:00.995962 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:13:00.942178 22077 raft_consensus.cc:515] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:00.958359 22047 raft_consensus.cc:515] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:01.038599 14339 raft_consensus.cc:1240] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 21. Current term is 22. Ops: []
I20260709 12:13:00.963662 22121 raft_consensus.cc:515] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:01.084812 14909 raft_consensus.cc:2468] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 19.
W20260709 12:13:01.120992 14229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:01.124430 21450 raft_consensus.cc:493] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:01.125352 21894 leader_election.cc:290] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:13:01.126205 22047 leader_election.cc:290] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:13:01.126619 22117 log.cc:927] Time spent T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 12:13:01.127167 14154 leader_election.cc:304] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:13:01.128077 22022 raft_consensus.cc:493] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:01.128595 22022 raft_consensus.cc:515] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:01.130641 22022 leader_election.cc:290] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:01.131228 22022 raft_consensus.cc:2804] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:13:01.131692 22022 raft_consensus.cc:697] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 19 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:13:01.132618 22022 consensus_queue.cc:237] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:01.133486 22077 leader_election.cc:290] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:13:01.035089 22081 raft_consensus.cc:3060] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:01.126641 22072 raft_consensus.cc:493] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:01.140275 22072 raft_consensus.cc:515] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:01.142602 22072 leader_election.cc:290] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:13:01.145256 22121 leader_election.cc:290] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:13:01.147063 14331 raft_consensus.cc:1240] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 20. Current term is 21. Ops: []
I20260709 12:13:01.125108 21450 raft_consensus.cc:515] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:01.015463 21565 raft_consensus.cc:515] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:01.040598 22086 raft_consensus.cc:493] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:01.147078 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 211690us
I20260709 12:13:01.165263 14338 raft_consensus.cc:2468] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 26.
W20260709 12:13:01.202813 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 250565us
I20260709 12:13:01.176404 21894 raft_consensus.cc:493] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:13:01.211278 14331 consensus_queue.cc:237] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } }
I20260709 12:13:01.212764 14912 raft_consensus.cc:1275] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 27 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 27 index: 17. (index mismatch)
I20260709 12:13:01.213515 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 27 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:13:01.216746 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:13:01.218441 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:13:01.219066 14909 raft_consensus.cc:2468] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 23.
I20260709 12:13:01.223346 14188 raft_consensus.cc:1275] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 26 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 24 index: 13. Preceding OpId from leader: term: 26 index: 14. (index mismatch)
W20260709 12:13:01.224603 14875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:01.217581 14186 raft_consensus.cc:2468] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 20.
I20260709 12:13:01.234728 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 27 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:13:01.233516 14877 leader_election.cc:304] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:13:01.236027 14877 leader_election.cc:304] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:01.242710 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:13:01.243149 14229 leader_election.cc:304] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:13:01.243393 14186 raft_consensus.cc:2468] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 22.
I20260709 12:13:01.245152 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:13:01.245481 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:13:01.246042 14909 raft_consensus.cc:2468] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 20.
I20260709 12:13:01.200210 22086 raft_consensus.cc:515] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:01.234506 22122 raft_consensus.cc:493] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:01.253566 14229 leader_election.cc:304] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:13:01.254153 14877 leader_election.cc:304] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:13:01.235227 21912 raft_consensus.cc:2749] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:01.241295 21996 raft_consensus.cc:2804] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:01.233048 21894 raft_consensus.cc:515] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:01.236640 22078 raft_consensus.cc:493] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:01.249364 22074 raft_consensus.cc:2804] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:13:01.262283 22121 raft_consensus.cc:2804] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:13:01.250584 22099 raft_consensus.cc:493] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:13:01.258244 21994 raft_consensus.cc:3060] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:13:01.264683 21518 consensus_meta.cc:287] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.513s	user 0.012s	sys 0.000s
I20260709 12:13:01.268385 22121 raft_consensus.cc:493] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:01.270254 22099 raft_consensus.cc:515] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:01.260363 21996 raft_consensus.cc:493] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 24 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:13:01.260788 22122 raft_consensus.cc:515] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:01.244355 22047 consensus_queue.cc:1048] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.018s
I20260709 12:13:01.244577 22103 consensus_queue.cc:1048] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.022s
I20260709 12:13:01.266389 22074 raft_consensus.cc:493] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:01.295100 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:13:01.301549 14875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:01.287923 22121 raft_consensus.cc:3060] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:01.389911 21518 raft_consensus.cc:493] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:13:01.390725 21518 raft_consensus.cc:515] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:13:01.391728 22123 log.cc:927] Time spent T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
I20260709 12:13:01.393298 21518 leader_election.cc:290] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:13:01.393918 22077 raft_consensus.cc:493] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
W20260709 12:13:01.394812 22131 log.cc:927] Time spent T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 12:13:01.394574 22077 raft_consensus.cc:515] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:01.395625 22086 leader_election.cc:290] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:13:01.289359 21996 raft_consensus.cc:3060] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:01.419654 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:13:01.420603 14188 raft_consensus.cc:2468] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 23.
I20260709 12:13:01.296307 22074 raft_consensus.cc:3060] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:01.390143 21844 raft_consensus.cc:2804] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:13:01.267791 22078 raft_consensus.cc:515] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:01.394197 21450 leader_election.cc:290] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:13:01.438375 22134 log.cc:927] Time spent T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.138s	user 0.000s	sys 0.001s
I20260709 12:13:01.443570 21909 consensus_queue.cc:260] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:01.444936 21909 raft_consensus.cc:3060] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:01.450045 14257 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3"
dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
mode: GRACEFUL
new_leader_uuid: "65c9c1653b3346b39a0e118540e6080c"
 from {username='slave'} at 127.0.0.1:54238
I20260709 12:13:01.450898 14257 raft_consensus.cc:606] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Received request to transfer leadership to TS 65c9c1653b3346b39a0e118540e6080c
I20260709 12:13:01.451264 14257 raft_consensus.cc:614] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:13:01.451429 22122 leader_election.cc:290] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:13:01.453660 14188 raft_consensus.cc:1275] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 24 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
I20260709 12:13:01.454880 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:13:01.455547 14183 raft_consensus.cc:2468] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 20.
I20260709 12:13:01.453346 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:13:01.470674 22082 raft_consensus.cc:493] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:13:01.471764 21844 raft_consensus.cc:697] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 21 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:13:01.290808 22127 consensus_queue.cc:1048] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.175s
I20260709 12:13:01.579463 14257 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da"
dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
mode: GRACEFUL
new_leader_uuid: "65c9c1653b3346b39a0e118540e6080c"
 from {username='slave'} at 127.0.0.1:54238
I20260709 12:13:01.581894 14257 raft_consensus.cc:606] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 26 FOLLOWER]: Received request to transfer leadership to TS 65c9c1653b3346b39a0e118540e6080c
I20260709 12:13:01.582314 14257 raft_consensus.cc:614] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 26 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:13:01.464470 21966 raft_consensus.cc:493] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:13:01.464881 22122 raft_consensus.cc:493] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
W20260709 12:13:01.579551 14229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:01.471457 22082 raft_consensus.cc:515] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:01.592985 21844 consensus_queue.cc:237] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:01.597966 12986 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:13:01.604509 21994 raft_consensus.cc:2749] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:13:01.608134 21943 consensus_meta.cc:287] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.756s	user 0.007s	sys 0.002s
I20260709 12:13:01.608623 21943 raft_consensus.cc:515] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:01.611932 22133 raft_consensus.cc:493] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:13:01.612552 22133 raft_consensus.cc:515] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:01.613821 22124 raft_consensus.cc:493] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:13:01.614414 22124 raft_consensus.cc:515] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:01.616770 22124 leader_election.cc:290] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:13:01.617900 14305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:01.614426 14186 raft_consensus.cc:1240] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 26 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 25. Current term is 26. Ops: []
I20260709 12:13:01.621841 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:01.622732 14257 raft_consensus.cc:2468] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 20.
I20260709 12:13:01.624502 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:13:01.623992 14877 leader_election.cc:304] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:13:01.622748 21873 raft_consensus.cc:493] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
W20260709 12:13:01.632596 22040 consensus_meta.cc:287] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.871s	user 0.012s	sys 0.001s
I20260709 12:13:01.589280 21966 raft_consensus.cc:515] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:13:01.643399 22081 consensus_meta.cc:287] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.507s	user 0.006s	sys 0.006s
I20260709 12:13:01.590721 22122 raft_consensus.cc:515] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:01.640508 22061 raft_consensus.cc:2804] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 12:13:01.651049 14303 consensus_peers.cc:597] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c -> Peer 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341): Couldn't send request to peer 73d01e9b1a9d49358da4985b21d681db. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 90097151efa7426faeaea3ff87a7ea78. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:01.657255 14909 raft_consensus.cc:1240] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 21 LEADER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 20. Current term is 21. Ops: [20.15-20.15]
I20260709 12:13:01.653340 22081 raft_consensus.cc:493] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:13:01.658247 22081 raft_consensus.cc:515] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:01.648384 22022 raft_consensus.cc:493] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
W20260709 12:13:01.664284 14260 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41764 (request call id 3861) took 1865 ms (client timeout 2113 ms). Trace:
I20260709 12:13:01.642321 21873 raft_consensus.cc:515] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:13:01.664659 14229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:01.664829 14260 rpcz_store.cc:269] 0709 12:12:59.798624 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:59.882244 (+ 83620us) service_pool.cc:224] Handling call
0709 12:13:01.664008 (+1781764us) spinlock_profiling.cc:243] Waited 306 ms on lock 0x7b54002012d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:13:01.664183 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":703785856}
W20260709 12:13:01.661074 22009 consensus_meta.cc:287] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.671s	user 0.006s	sys 0.007s
W20260709 12:13:01.666076 14333 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50858 (request call id 2681) took 1587 ms (client timeout 1783 ms). Trace:
I20260709 12:13:01.665645 14263 raft_consensus.cc:1240] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 25 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 24. Current term is 25. Ops: []
I20260709 12:13:01.654917 22061 raft_consensus.cc:493] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:01.645426 22040 raft_consensus.cc:515] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } }
I20260709 12:13:01.670568 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:13:01.668927 14333 rpcz_store.cc:269] 0709 12:13:00.078329 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:00.078483 (+   154us) service_pool.cc:224] Handling call
0709 12:13:01.665892 (+1587409us) spinlock_profiling.cc:243] Waited 112 ms on lock 0x7b54000fc8d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:13:01.666016 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":257085184}
I20260709 12:13:01.672498 14183 raft_consensus.cc:2393] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 20: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:13:01.691041 22078 leader_election.cc:290] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:13:01.692939 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:13:01.693655 14188 raft_consensus.cc:2468] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 24.
I20260709 12:13:01.694572 22125 raft_consensus.cc:493] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:13:01.695168 22125 raft_consensus.cc:515] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:01.699290 22133 leader_election.cc:290] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:01.702574 22080 raft_consensus.cc:493] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:13:01.703181 22121 raft_consensus.cc:515] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:01.704097 22038 leader_election.cc:290] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:01.707170 21873 leader_election.cc:290] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:01.703141 22080 raft_consensus.cc:3060] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:01.708282 22122 leader_election.cc:290] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:13:01.707206 21966 leader_election.cc:290] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:01.711242 21894 leader_election.cc:290] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:13:01.711925 21996 raft_consensus.cc:515] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:01.713088 14910 raft_consensus.cc:1240] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 25 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 24. Current term is 25. Ops: []
I20260709 12:13:01.714350 21565 leader_election.cc:290] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:13:01.715574 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:01.718777 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 27 candidate_status { last_received { term: 26 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:13:01.669044 22099 leader_election.cc:290] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:13:01.723685 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:13:01.724542 14188 raft_consensus.cc:2393] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 27: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:13:01.727458 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:13:01.728951 22141 raft_consensus.cc:493] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:01.729542 22141 raft_consensus.cc:515] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:01.731761 22141 leader_election.cc:290] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:01.737151 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:13:01.672765 22004 raft_consensus.cc:493] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:13:01.667979 22046 raft_consensus.cc:493] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:13:01.697593 22125 leader_election.cc:290] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:13:01.715193 22081 leader_election.cc:290] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:13:01.745602 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:13:01.750000 14181 raft_consensus.cc:3060] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:01.745620 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:01.727025 21894 raft_consensus.cc:493] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
W20260709 12:13:01.740355 22143 log.cc:927] Time spent T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.083s	user 0.000s	sys 0.004s
I20260709 12:13:01.808377 22074 raft_consensus.cc:515] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:01.747927 14188 raft_consensus.cc:1240] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 27 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 26. Current term is 27. Ops: []
I20260709 12:13:01.751567 14256 raft_consensus.cc:2393] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db in current term 21: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:13:01.741132 21518 raft_consensus.cc:493] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:01.842518 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:13:01.750394 22046 raft_consensus.cc:515] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:01.766084 21894 raft_consensus.cc:515] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:01.733222 21565 consensus_queue.cc:1048] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.022s
I20260709 12:13:01.742650 22004 raft_consensus.cc:515] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:01.770969 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:13:01.773411 22135 log.cc:927] Time spent T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
I20260709 12:13:01.774314 22082 leader_election.cc:290] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:01.775924 22040 leader_election.cc:290] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 21 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:13:01.854182 14304 leader_election.cc:304] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:01.671833 22009 raft_consensus.cc:515] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } }
W20260709 12:13:01.781085 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:01.783167 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:13:01.748768 21943 leader_election.cc:290] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 26 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:01.673269 22022 raft_consensus.cc:515] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:01.754796 21996 leader_election.cc:290] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 25 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:01.794332 22121 leader_election.cc:290] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 21 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:13:01.801476 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:13:01.801944 21955 consensus_queue.cc:260] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:01.867965 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:13:01.688827 22061 raft_consensus.cc:3060] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:01.821192 14229 leader_election.cc:304] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
W20260709 12:13:01.870007 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 48934.3us
I20260709 12:13:01.829192 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:13:01.872537 14903 raft_consensus.cc:3060] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:01.875617 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:13:01.876377 14188 raft_consensus.cc:2468] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 19.
I20260709 12:13:01.878526 22124 raft_consensus.cc:3060] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:01.831183 14181 raft_consensus.cc:2468] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 21.
W20260709 12:13:01.836513 14875 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:01.837458 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:13:01.824716 21966 consensus_queue.cc:1059] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 24.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.021s
I20260709 12:13:01.880239 14229 leader_election.cc:304] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:13:01.889151 21873 consensus_queue.cc:1048] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:13:01.891258 21966 raft_consensus.cc:3055] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:13:01.891680 21966 raft_consensus.cc:740] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:13:01.892532 21966 consensus_queue.cc:260] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.17, Last appended by leader: 17, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:01.841959 21909 consensus_queue.cc:1059] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.040s
I20260709 12:13:01.854153 21690 consensus_queue.cc:1048] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.051s
I20260709 12:13:01.904496 21894 leader_election.cc:290] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:13:01.901930 22017 consensus_queue.cc:1048] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.005s
I20260709 12:13:01.906132 22004 leader_election.cc:290] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:13:01.793835 22041 consensus_queue.cc:260] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:01.906909 21909 raft_consensus.cc:3055] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:13:01.907328 21909 raft_consensus.cc:740] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:13:01.908229 21909 consensus_queue.cc:260] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:01.885233 22072 raft_consensus.cc:2749] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:13:01.902061 21955 raft_consensus.cc:3060] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:01.849305 21518 raft_consensus.cc:515] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:01.878793 22145 raft_consensus.cc:493] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:13:01.829308 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:13:01.882475 14188 raft_consensus.cc:1275] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:13:01.909439 21909 raft_consensus.cc:3060] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:13:01.913283 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 59192.1us
I20260709 12:13:01.920728 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:13:01.921762 14188 raft_consensus.cc:2368] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 20. Current term is 21.
I20260709 12:13:01.922606 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:13:01.923403 14188 raft_consensus.cc:2393] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 22: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:13:01.909516 22009 leader_election.cc:290] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187)
I20260709 12:13:01.918864 22145 raft_consensus.cc:515] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:01.895220 22046 leader_election.cc:290] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:01.901899 22121 raft_consensus.cc:2804] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:13:01.902448 21966 raft_consensus.cc:3060] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:01.938534 14903 raft_consensus.cc:2468] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 21.
I20260709 12:13:01.955001 14229 leader_election.cc:304] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:13:01.865896 22151 consensus_queue.cc:1048] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 12:13:01.945993 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 80278.5us
I20260709 12:13:01.955734 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:01.956638 14260 raft_consensus.cc:2468] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 21.
I20260709 12:13:01.959302 14260 raft_consensus.cc:1275] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 26 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 26 index: 15. (index mismatch)
I20260709 12:13:01.963557 14258 raft_consensus.cc:1275] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 26 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 24 index: 13. Preceding OpId from leader: term: 26 index: 14. (index mismatch)
I20260709 12:13:01.964990 14303 leader_election.cc:304] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:01.969815 21894 raft_consensus.cc:2749] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:13:01.944964 22041 raft_consensus.cc:3060] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:01.969310 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:01.950063 22082 raft_consensus.cc:493] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:01.974964 14260 raft_consensus.cc:1240] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 23. Current term is 24. Ops: []
I20260709 12:13:01.971800 14303 leader_election.cc:304] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:13:01.950821 22121 raft_consensus.cc:493] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:13:01.973394 14258 raft_consensus.cc:2468] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 22.
I20260709 12:13:01.980554 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 27 candidate_status { last_received { term: 26 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:01.981937 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:01.983927 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:01.984649 14265 raft_consensus.cc:2468] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 21.
I20260709 12:13:01.982988 14303 leader_election.cc:304] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:01.990556 14260 raft_consensus.cc:1275] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:13:01.972491 22009 raft_consensus.cc:2804] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:13:02.002660 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:01.982607 22121 raft_consensus.cc:3060] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:02.010774 14303 leader_election.cc:304] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:13:02.012861 14303 leader_election.cc:304] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:13:01.983705 22153 raft_consensus.cc:2804] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:02.036012 14182 raft_consensus.cc:1275] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 26 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 26 index: 15. (index mismatch)
I20260709 12:13:02.009991 22009 raft_consensus.cc:697] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 21 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:13:02.037221 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:13:02.037705 22009 consensus_queue.cc:237] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:02.039821 14265 raft_consensus.cc:1275] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 27 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 25 index: 16. Preceding OpId from leader: term: 27 index: 17. (index mismatch)
I20260709 12:13:02.034952 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:13:01.962296 22080 raft_consensus.cc:515] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:02.033075 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:13:02.003082 22078 raft_consensus.cc:493] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:13:02.028070 22103 raft_consensus.cc:2749] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:01.981824 22082 raft_consensus.cc:515] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:02.055061 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:13:02.036410 22153 raft_consensus.cc:493] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:02.042999 22004 raft_consensus.cc:2804] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Leader pre-election won for term 24
W20260709 12:13:02.056869 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 107973us
I20260709 12:13:02.042225 21818 raft_consensus.cc:2804] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:02.048354 22022 leader_election.cc:290] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:13:02.051291 22074 leader_election.cc:290] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 24 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:13:02.044435 21894 consensus_queue.cc:1059] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 25.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.019s
I20260709 12:13:02.061834 22004 raft_consensus.cc:493] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:02.082648 14230 leader_election.cc:304] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:13:02.060556 22153 raft_consensus.cc:3060] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:02.089197 22074 raft_consensus.cc:2749] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 27 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:02.063295 21818 raft_consensus.cc:493] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:02.091651 14230 leader_election.cc:304] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:02.084962 21756 raft_consensus.cc:493] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:02.094327 21756 raft_consensus.cc:515] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:02.094043 22038 raft_consensus.cc:2749] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:02.060619 22151 consensus_queue.cc:1048] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.028s
I20260709 12:13:02.058135 22078 raft_consensus.cc:515] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:02.110733 14230 leader_election.cc:304] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:13:02.090435 22004 raft_consensus.cc:3060] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:02.093102 21818 raft_consensus.cc:3060] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:02.119693 22145 leader_election.cc:290] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:13:02.063733 22154 consensus_queue.cc:1048] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.049s
I20260709 12:13:02.096671 21894 raft_consensus.cc:3055] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 25 LEADER]: Stepping down as leader of term 25
I20260709 12:13:02.120949 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:13:02.121589 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:13:02.122293 14230 leader_election.cc:304] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:02.107523 21518 leader_election.cc:290] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:13:02.126142 22009 raft_consensus.cc:2749] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:13:02.128612 14335 raft_consensus.cc:3060] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:02.129122 22122 raft_consensus.cc:2749] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:13:02.134111 22077 leader_election.cc:290] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:13:02.135183 22082 leader_election.cc:290] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:02.138979 21756 leader_election.cc:290] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:02.140496 14263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41768 (request call id 2704) took 1476 ms. Trace:
I20260709 12:13:02.140980 14263 rpcz_store.cc:276] 0709 12:13:00.664246 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:00.847857 (+183611us) service_pool.cc:224] Handling call
0709 12:13:01.665405 (+817548us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:01.669291 (+  3886us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:02.140249 (+470958us) spinlock_profiling.cc:243] Waited 816 ms on lock 0x7b54002012d0. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713a8ad 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:13:02.140418 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1877155584}
I20260709 12:13:02.127167 21894 raft_consensus.cc:740] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:13:02.142709 21894 consensus_queue.cc:260] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 25.12, Last appended by leader: 12, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:02.143975 21894 raft_consensus.cc:3060] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:02.134900 22133 consensus_queue.cc:1059] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 21.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:13:02.156252 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 27 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:13:02.158416 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 43588us
I20260709 12:13:02.158493 14188 raft_consensus.cc:2468] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 26.
I20260709 12:13:02.159703 14230 leader_election.cc:304] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
W20260709 12:13:02.162510 14229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:02.165289 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 112517us
I20260709 12:13:02.169246 14336 raft_consensus.cc:1240] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 22 LEADER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 21. Current term is 22. Ops: [21.12-21.12]
I20260709 12:13:02.171829 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:13:02.172194 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:02.172453 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:02.181660 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:02.182397 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:02.184845 22038 raft_consensus.cc:2804] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:13:02.186160 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:02.187964 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:02.173537 14330 raft_consensus.cc:2393] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 20: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:13:02.190090 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:02.170421 22047 raft_consensus.cc:493] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:13:02.197898 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:02.187353 22005 raft_consensus.cc:493] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:02.201973 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:02.203855 14333 raft_consensus.cc:2468] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 21.
I20260709 12:13:02.194448 22077 raft_consensus.cc:493] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:13:02.210537 14335 raft_consensus.cc:2410] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for term 22 because replica has last-logged OpId of term: 21 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 10.
I20260709 12:13:02.211078 14335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50856 (request call id 3226) took 1264 ms. Trace:
I20260709 12:13:02.212474 14335 rpcz_store.cc:276] 0709 12:13:00.946849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:02.121290 (+1174441us) service_pool.cc:224] Handling call
0709 12:13:02.211012 (+ 89722us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:02.203455 22038 raft_consensus.cc:697] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 26 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:13:02.214165 22038 consensus_queue.cc:237] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.16, Last appended by leader: 16, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:02.202615 22047 raft_consensus.cc:515] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:02.222164 14332 raft_consensus.cc:2468] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 22.
I20260709 12:13:02.201905 22080 leader_election.cc:290] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 22 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:13:02.226507 14156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:02.221724 22047 leader_election.cc:290] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:13:02.222014 22155 log.cc:927] Time spent T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.141s	user 0.001s	sys 0.000s
I20260709 12:13:02.207252 22122 raft_consensus.cc:493] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:13:02.209592 22005 raft_consensus.cc:515] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:13:02.240797 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:02.240067 22078 leader_election.cc:290] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:13:02.257697 21948 raft_consensus.cc:493] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:13:02.274351 21948 raft_consensus.cc:515] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:02.275871 22005 leader_election.cc:290] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:13:02.253988 14183 raft_consensus.cc:1275] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 12:13:02.277829 21948 leader_election.cc:290] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:02.279857 22061 raft_consensus.cc:515] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:02.281134 14909 raft_consensus.cc:2368] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 20. Current term is 21.
I20260709 12:13:02.284301 22124 raft_consensus.cc:2749] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:02.284873 21712 leader_election.cc:290] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 21 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:02.285396 14334 raft_consensus.cc:2410] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for term 25 because replica has last-logged OpId of term: 24 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 23 index: 14.
I20260709 12:13:02.286207 22046 raft_consensus.cc:993] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec: : Instructing follower 885067a0d31741bfb5c9935788e315bf to start an election
I20260709 12:13:02.286757 22046 raft_consensus.cc:1081] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 24 LEADER]: Signalling peer 885067a0d31741bfb5c9935788e315bf to start an election
I20260709 12:13:02.287443 22004 raft_consensus.cc:515] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:02.234274 22122 raft_consensus.cc:515] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:02.292763 22122 leader_election.cc:290] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:13:02.294528 22139 raft_consensus.cc:493] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:13:02.295210 22139 raft_consensus.cc:515] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:02.295929 22004 leader_election.cc:290] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 24 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:13:02.297366 22139 leader_election.cc:290] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:02.222453 22077 raft_consensus.cc:515] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:02.305438 21953 raft_consensus.cc:3060] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:02.307142 21712 raft_consensus.cc:493] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:13:02.317631 14877 leader_election.cc:304] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:13:02.324332 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:13:02.324723 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c8882b1b37d4e84a94a2e1e321a8755" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:02.325209 14336 raft_consensus.cc:2393] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 20: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
W20260709 12:13:02.320878 22164 log.cc:927] Time spent T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.136s	user 0.000s	sys 0.001s
I20260709 12:13:02.325978 22139 raft_consensus.cc:2749] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 12:13:02.332535 22153 raft_consensus.cc:515] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:02.332917 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:02.334533 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:02.335397 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:13:02.336169 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:02.336699 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:13:02.337844 14876 leader_election.cc:304] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:02.339377 22077 leader_election.cc:290] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:02.312129 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:02.310325 14185 raft_consensus.cc:1240] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 19 LEADER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 18. Current term is 19. Ops: []
I20260709 12:13:02.341522 14333 raft_consensus.cc:2468] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 17.
I20260709 12:13:02.314671 14256 raft_consensus.cc:1275] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 12. (term mismatch)
I20260709 12:13:02.342211 22061 leader_election.cc:290] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 21 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:13:02.342460 14256 pending_rounds.cc:85] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec: Aborting all ops after (but not including) 11
I20260709 12:13:02.325133 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:02.340399 22023 raft_consensus.cc:493] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:02.341543 22121 raft_consensus.cc:515] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:02.343428 22023 raft_consensus.cc:515] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:02.340211 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:13:02.346716 14260 raft_consensus.cc:1240] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 20. Current term is 21. Ops: []
I20260709 12:13:02.347383 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:13:02.348013 14184 raft_consensus.cc:2468] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 22.
I20260709 12:13:02.349021 21912 raft_consensus.cc:493] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:02.337628 21712 raft_consensus.cc:515] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:02.349558 21912 raft_consensus.cc:515] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:02.350577 14230 leader_election.cc:304] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:13:02.351375 21712 leader_election.cc:290] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:02.342871 14256 pending_rounds.cc:107] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec: Aborting uncommitted NO_OP operation due to leader change: 21.12
I20260709 12:13:02.351698 21912 leader_election.cc:290] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:13:02.345476 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:13:02.352169 21924 raft_consensus.cc:2749] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:02.352607 14264 raft_consensus.cc:3060] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:02.345569 22121 leader_election.cc:290] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 21 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:13:02.354400 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:13:02.355195 14181 raft_consensus.cc:3060] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Advancing to term 24
W20260709 12:13:02.358247 22165 log.cc:927] Time spent T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.211s	user 0.001s	sys 0.001s
I20260709 12:13:02.359612 22039 raft_consensus.cc:493] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:13:02.354648 21695 consensus_queue.cc:1059] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.007s
I20260709 12:13:02.361377 22039 raft_consensus.cc:515] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:02.363629 22039 leader_election.cc:290] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:02.360502 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:13:02.360508 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:13:02.365099 14903 raft_consensus.cc:2468] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 18.
I20260709 12:13:02.365677 14230 leader_election.cc:304] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:13:02.351985 14256 raft_consensus.cc:2889] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:02.366632 22039 raft_consensus.cc:2749] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:02.367015 21695 raft_consensus.cc:3055] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:13:02.367465 21695 raft_consensus.cc:740] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:13:02.368273 14230 leader_election.cc:304] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:02.349292 14304 leader_election.cc:304] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:13:02.372870 14265 raft_consensus.cc:1240] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 21. Current term is 22. Ops: []
I20260709 12:13:02.373663 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:13:02.374214 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 26 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:13:02.375420 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:02.374842 14081 catalog_manager.cc:5697] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c reported cstate change: term changed from 22 to 24, leader changed from 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130) to 65c9c1653b3346b39a0e118540e6080c (127.12.174.131). New cstate: current_term: 24 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:02.376173 14265 raft_consensus.cc:2393] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 20: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:13:02.377095 12986 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:02.377007 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:02.378346 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:02.378595 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:02.379714 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:02.380328 22151 raft_consensus.cc:2804] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:02.380743 22151 raft_consensus.cc:493] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:13:02.381150 22018 consensus_queue.cc:1048] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:13:02.382695 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 26 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:13:02.381093 22151 raft_consensus.cc:3060] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:02.383296 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:02.342595 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:13:02.374585 14260 raft_consensus.cc:2410] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for term 21 because replica has last-logged OpId of term: 20 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
I20260709 12:13:02.389938 14264 raft_consensus.cc:2468] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 22.
I20260709 12:13:02.386861 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:13:02.377022 14081 catalog_manager.cc:5697] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c reported cstate change: term changed from 21 to 24. New cstate: current_term: 24 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:13:02.392302 14333 raft_consensus.cc:3060] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:02.386950 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:02.398347 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:13:02.399140 14186 raft_consensus.cc:2468] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 18.
I20260709 12:13:02.340850 21994 raft_consensus.cc:2749] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:13:02.404333 14334 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50856 (request call id 3225) took 1457 ms (client timeout 1641 ms). Trace:
W20260709 12:13:02.390187 22142 log.cc:927] Time spent T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.498s	user 0.005s	sys 0.000s
W20260709 12:13:02.404819 14334 rpcz_store.cc:269] 0709 12:13:00.946605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:02.120155 (+1173550us) service_pool.cc:224] Handling call
0709 12:13:02.404085 (+283930us) spinlock_profiling.cc:243] Waited 157 ms on lock 0x7b54002e81d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:13:02.404262 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":360001280}
W20260709 12:13:02.404647 22169 log.cc:927] Time spent T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.276s	user 0.003s	sys 0.000s
I20260709 12:13:02.368505 21695 consensus_queue.cc:260] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.16, Last appended by leader: 16, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:02.411123 21695 raft_consensus.cc:3060] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:02.415937 14877 leader_election.cc:304] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:13:02.417534 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:13:02.418062 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:13:02.418231 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 50052.2us
I20260709 12:13:02.417527 14264 raft_consensus.cc:1275] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 15. (term mismatch)
I20260709 12:13:02.418735 14261 raft_consensus.cc:2468] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 22.
I20260709 12:13:02.418332 14260 raft_consensus.cc:3060] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:02.420663 14230 leader_election.cc:304] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:13:02.422883 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:13:02.424153 14261 raft_consensus.cc:3060] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Advancing to term 24
I20260709 12:13:02.424906 14264 pending_rounds.cc:85] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec: Aborting all ops after (but not including) 14
I20260709 12:13:02.425130 14264 pending_rounds.cc:107] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec: Aborting uncommitted NO_OP operation due to leader change: 20.15
I20260709 12:13:02.427428 14264 raft_consensus.cc:2889] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:02.426030 14181 raft_consensus.cc:2468] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 24.
I20260709 12:13:02.392807 22151 raft_consensus.cc:515] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:02.432132 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:02.432437 14332 raft_consensus.cc:1240] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 26 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 25. Current term is 26. Ops: []
I20260709 12:13:02.435298 14230 leader_election.cc:304] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:02.316125 22041 raft_consensus.cc:493] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:13:02.397452 22023 leader_election.cc:290] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:02.439204 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:02.454291 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:02.455349 14330 raft_consensus.cc:2468] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 18.
I20260709 12:13:02.455955 14181 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d"
dest_uuid: "885067a0d31741bfb5c9935788e315bf"
 from {username='slave'} at 127.0.0.1:56046
I20260709 12:13:02.456519 14181 raft_consensus.cc:493] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 24 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:02.456862 14181 raft_consensus.cc:3060] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:02.454797 14338 raft_consensus.cc:2368] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 22. Current term is 23.
W20260709 12:13:02.457484 14305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:02.456977 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:13:02.454346 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:13:02.459715 14183 raft_consensus.cc:3060] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Advancing to term 21
I20260709 12:13:02.443903 14333 raft_consensus.cc:2468] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 21.
I20260709 12:13:02.438186 21894 consensus_queue.cc:1048] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.025s
I20260709 12:13:02.463264 14339 raft_consensus.cc:1240] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 25 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 24. Current term is 25. Ops: []
I20260709 12:13:02.352262 21912 raft_consensus.cc:493] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:02.465692 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 23 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:02.460247 14304 leader_election.cc:304] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:13:02.466753 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:13:02.469578 14337 raft_consensus.cc:2468] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 26.
I20260709 12:13:02.432930 22039 raft_consensus.cc:3060] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:13:02.438278 22160 log.cc:927] Time spent T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.308s	user 0.003s	sys 0.003s
I20260709 12:13:02.483179 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:13:02.480321 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:02.483939 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 68088.6us
I20260709 12:13:02.480839 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:13:02.466291 22163 log.cc:927] Time spent T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.282s	user 0.000s	sys 0.010s
I20260709 12:13:02.488231 14155 leader_election.cc:304] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:13:02.492331 14155 leader_election.cc:304] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:13:02.485237 14304 leader_election.cc:304] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
W20260709 12:13:02.489776 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 54554.7us
I20260709 12:13:02.494714 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:13:02.483985 14264 raft_consensus.cc:2393] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 22: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
W20260709 12:13:02.495886 14230 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.174.131:45957 timed out after 1.641s (SENT) [suppressed 3 similar messages]
I20260709 12:13:02.497658 14260 raft_consensus.cc:2468] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 21.
I20260709 12:13:02.459328 22072 raft_consensus.cc:2804] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:02.502416 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:02.485718 14877 leader_election.cc:304] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:13:02.502580 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:13:02.503638 14230 leader_election.cc:304] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:02.464339 21943 raft_consensus.cc:493] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:13:02.508172 14155 leader_election.cc:304] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:13:02.506072 14181 raft_consensus.cc:515] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 25 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:02.530342 14303 leader_election.cc:304] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
W20260709 12:13:02.517279 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 140884us
W20260709 12:13:02.490525 22172 log.cc:927] Time spent T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.226s	user 0.005s	sys 0.000s
I20260709 12:13:02.535782 14229 leader_election.cc:304] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:13:02.536991 14303 leader_election.cc:304] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:02.513424 14261 raft_consensus.cc:2468] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 24.
I20260709 12:13:02.509059 14154 leader_election.cc:400] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 20 pre-election: Vote denied by peer 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341) with higher term. Message: Invalid argument: T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 20. Current term is 21.
I20260709 12:13:02.509303 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 23 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:02.542070 14154 leader_election.cc:403] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 20 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:13:02.542723 14337 raft_consensus.cc:2368] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 23. Current term is 24.
I20260709 12:13:02.484270 22017 raft_consensus.cc:493] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:02.545315 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 27 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:02.488324 21894 raft_consensus.cc:2804] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Leader election won for term 22
W20260709 12:13:02.552937 14154 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 44042.1us
I20260709 12:13:02.438405 21818 raft_consensus.cc:515] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:02.555320 14181 leader_election.cc:290] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 25 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:02.490947 21924 raft_consensus.cc:493] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:02.507252 22145 raft_consensus.cc:2804] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:13:02.507196 21966 raft_consensus.cc:2749] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:13:02.528481 21690 raft_consensus.cc:2804] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:02.560204 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:13:02.561204 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 98356.5us
I20260709 12:13:02.567616 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:02.564980 14303 leader_election.cc:304] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:13:02.547174 14155 leader_election.cc:304] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:13:02.507822 22072 raft_consensus.cc:493] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:13:02.533921 21217 raft_consensus.cc:2804] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:13:02.602219 21217 raft_consensus.cc:493] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:13:02.602779 21217 raft_consensus.cc:3060] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:13:02.544253 22022 consensus_queue.cc:1059] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.070s
I20260709 12:13:02.528563 22082 raft_consensus.cc:2749] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:02.578660 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:13:02.582894 14264 raft_consensus.cc:2468] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 22.
I20260709 12:13:02.606252 14909 raft_consensus.cc:2468] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 18.
I20260709 12:13:02.582347 14183 raft_consensus.cc:2468] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 21.
I20260709 12:13:02.499018 21863 consensus_queue.cc:1048] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.071s
I20260709 12:13:02.586329 21924 raft_consensus.cc:515] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:02.586306 21565 consensus_queue.cc:1048] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.007s
I20260709 12:13:02.596374 22153 leader_election.cc:290] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 23 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:13:02.600394 21756 raft_consensus.cc:3055] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:13:02.550443 22107 raft_consensus.cc:493] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:13:02.547843 22124 raft_consensus.cc:2749] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:02.637948 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:13:02.638783 14264 raft_consensus.cc:3060] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Advancing to term 23
I20260709 12:13:02.605837 22072 raft_consensus.cc:3060] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:13:02.551134 22148 log.cc:927] Time spent T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:13:02.589244 14229 leader_election.cc:304] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:02.460443 22041 raft_consensus.cc:515] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:02.551879 22122 raft_consensus.cc:2804] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:13:02.611866 14331 raft_consensus.cc:1240] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 25 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 24. Current term is 25. Ops: []
I20260709 12:13:02.554206 21712 raft_consensus.cc:2804] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:13:02.528625 22086 consensus_queue.cc:1048] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.061s
I20260709 12:13:02.577281 22125 raft_consensus.cc:2749] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:13:02.620479 14906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53194 (request call id 1309) took 1187 ms. Trace:
I20260709 12:13:02.581094 21996 raft_consensus.cc:2749] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:13:02.637100 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:13:02.544718 21943 raft_consensus.cc:515] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:02.547612 22004 consensus_queue.cc:1048] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.064s
I20260709 12:13:02.556571 22017 raft_consensus.cc:515] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:02.614346 22016 raft_consensus.cc:2804] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:02.698710 14336 raft_consensus.cc:2410] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for term 24 because replica has last-logged OpId of term: 23 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 15.
I20260709 12:13:02.615939 22005 raft_consensus.cc:493] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:13:02.697464 14264 raft_consensus.cc:2468] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 23.
W20260709 12:13:02.700604 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 111493us
I20260709 12:13:02.635661 14304 leader_election.cc:304] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:02.644342 14230 leader_election.cc:400] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 23 pre-election: Vote denied by peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957) with higher term. Message: Invalid argument: T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 23. Current term is 24.
I20260709 12:13:02.702500 14333 raft_consensus.cc:2410] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for term 25 because replica has last-logged OpId of term: 24 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 23 index: 14.
I20260709 12:13:02.723094 14265 raft_consensus.cc:1240] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 26 LEADER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 25. Current term is 26. Ops: []
I20260709 12:13:02.730646 14230 leader_election.cc:403] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 23 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:13:02.720316 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 234680us
I20260709 12:13:02.636464 21217 raft_consensus.cc:515] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:02.548796 22121 raft_consensus.cc:2804] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:02.633399 14303 leader_election.cc:304] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:13:02.485321 21912 raft_consensus.cc:515] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:02.607250 22042 raft_consensus.cc:493] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:13:02.590129 21690 raft_consensus.cc:493] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:13:02.701517 14229 leader_election.cc:304] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:02.729897 14906 rpcz_store.cc:276] 0709 12:13:01.432646 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:01.432802 (+   156us) service_pool.cc:224] Handling call
0709 12:13:01.438310 (+  5508us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:01.584976 (+146666us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:01.585011 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:02.119821 (+534810us) spinlock_profiling.cc:243] Waited 3.12 ms on lock 0x7b2c00125df8. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2125a34a11 00007f2125a44372 00007f2127176a01 00007f212713b43a 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2
0709 12:13:02.125610 (+  5789us) log.cc:844] Serialized 26 byte log entry
0709 12:13:02.200252 (+ 74642us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:13:02.200289 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:02.200360 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:02.367756 (+167396us) spinlock_profiling.cc:243] Waited 6.09 ms on lock 0x7b4400022b4c. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2123f74c85 00007f2123f756a2 00007f2126ce71db 00007f2126ce2aaf 00007f2126cd686e 00007f2126cd5bb6 00007f2126cd57d8 00007f2126cdf221 00007f2126cdf1d9 00007f2126cdf169
0709 12:13:02.620244 (+252488us) raft_consensus.cc:1685] finished
0709 12:13:02.620267 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:02.620413 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3703,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":85,"spinlock_wait_cycles":21177472,"thread_start_us":212270,"threads_started":2,"wal-append.queue_time_us":77925}
I20260709 12:13:02.611407 22040 raft_consensus.cc:2749] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: Vote denied by peer 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341) with higher term. Message: Invalid argument: T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 20. Current term is 21.
I20260709 12:13:02.635764 21756 raft_consensus.cc:740] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:13:02.611696 21894 raft_consensus.cc:697] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 22 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:13:02.658291 22168 raft_consensus.cc:493] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:02.753641 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 118077us
I20260709 12:13:02.621551 21966 raft_consensus.cc:493] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:02.755170 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 121852us
I20260709 12:13:02.670133 22082 raft_consensus.cc:2804] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:13:02.733641 21873 raft_consensus.cc:2749] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:13:02.701478 21909 raft_consensus.cc:493] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:13:02.700738 22016 raft_consensus.cc:493] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:02.757872 21690 raft_consensus.cc:3060] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:02.734736 22121 raft_consensus.cc:493] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:13:02.724788 22023 raft_consensus.cc:493] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:02.703354 22122 raft_consensus.cc:493] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
W20260709 12:13:02.778213 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 231097us
I20260709 12:13:02.662644 22151 leader_election.cc:290] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 22 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:13:02.729851 21712 raft_consensus.cc:493] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:02.644763 22107 raft_consensus.cc:515] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:02.758001 22153 raft_consensus.cc:2749] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:13:02.758955 22146 log.cc:927] Time spent T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 12:13:02.814114 14155 leader_election.cc:304] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:13:02.812740 21712 raft_consensus.cc:3060] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:02.761871 22130 consensus_queue.cc:1059] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.039s
I20260709 12:13:02.788991 22038 raft_consensus.cc:2749] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:13:02.787415 22016 raft_consensus.cc:3060] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:13:02.784878 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 140685us
I20260709 12:13:02.760363 22042 raft_consensus.cc:515] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:02.766151 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:13:02.667461 21818 leader_election.cc:290] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 25 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:13:02.775444 22145 raft_consensus.cc:697] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 20 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:13:02.776073 21996 consensus_queue.cc:1048] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.035s
I20260709 12:13:02.753969 22005 raft_consensus.cc:515] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:02.761471 21928 raft_consensus.cc:2804] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:13:02.789904 21909 raft_consensus.cc:515] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:02.797180 22121 raft_consensus.cc:3060] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:13:02.795527 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 94133.8us
I20260709 12:13:02.860580 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:13:02.861965 14229 leader_election.cc:400] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 election: Vote denied by peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187) with higher term. Message: Invalid argument: T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 20. Current term is 21.
I20260709 12:13:02.862300 14229 leader_election.cc:403] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 election: Cancelling election due to peer responding with higher term
I20260709 12:13:02.826709 14230 leader_election.cc:400] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 pre-election: Vote denied by peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957) with higher term. Message: Invalid argument: T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 22. Current term is 23.
I20260709 12:13:02.864053 14230 leader_election.cc:403] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:13:02.789708 22048 raft_consensus.cc:2749] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Leader pre-election lost for term 23. Reason: Vote denied by peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957) with higher term. Message: Invalid argument: T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 23. Current term is 24.
I20260709 12:13:02.792621 22082 raft_consensus.cc:697] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 21 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:13:02.782310 21966 raft_consensus.cc:515] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:02.818208 22122 raft_consensus.cc:3060] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:02.895917 14229 leader_election.cc:304] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:13:02.821765 22023 raft_consensus.cc:515] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:02.898456 22189 raft_consensus.cc:2804] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:13:02.829664 14258 raft_consensus.cc:2468] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 27.
I20260709 12:13:02.841403 21712 raft_consensus.cc:515] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:02.899058 22189 raft_consensus.cc:697] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 26 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:13:02.900077 22189 consensus_queue.cc:237] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 25.12, Last appended by leader: 12, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:02.900799 21712 leader_election.cc:290] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:13:02.850658 14156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:02.781904 22168 raft_consensus.cc:515] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:02.763286 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:13:02.851243 14876 leader_election.cc:304] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:13:02.903561 22168 leader_election.cc:290] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:13:02.904122 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 53004.7us
W20260709 12:13:02.879267 14305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:02.863195 21894 consensus_queue.cc:237] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:02.882261 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:13:02.855767 21928 raft_consensus.cc:493] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:02.883220 22145 consensus_queue.cc:237] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.9, Last appended by leader: 9, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:02.884399 14903 raft_consensus.cc:1240] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 17. Current term is 18. Ops: []
I20260709 12:13:02.822510 21756 consensus_queue.cc:260] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:02.879186 14230 leader_election.cc:304] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:02.892344 22022 consensus_queue.cc:1059] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 24.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:13:02.893116 22077 raft_consensus.cc:3060] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:02.924465 22046 raft_consensus.cc:2749] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 12:13:02.893715 22048 raft_consensus.cc:2749] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Leader pre-election lost for term 22. Reason: Vote denied by peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957) with higher term. Message: Invalid argument: T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 22. Current term is 23.
I20260709 12:13:02.898155 21966 leader_election.cc:290] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:02.926649 21912 leader_election.cc:290] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:13:02.927390 21924 leader_election.cc:290] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:13:02.909459 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:02.912698 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
W20260709 12:13:02.901614 22175 log.cc:927] Time spent T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 12:13:02.898125 21873 raft_consensus.cc:2804] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:13:02.928277 22017 leader_election.cc:290] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:13:02.973090 22185 ts_tablet_manager.cc:933] T 90097151efa7426faeaea3ff87a7ea78 P 73d01e9b1a9d49358da4985b21d681db: Initiating tablet copy from peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:02.973232 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:13:02.973984 14182 raft_consensus.cc:2468] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 18.
W20260709 12:13:02.974560 22180 log.cc:927] Time spent T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.152s	user 0.000s	sys 0.001s
I20260709 12:13:02.975394 14183 raft_consensus.cc:1275] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 12:13:02.976459 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:13:02.976768 14911 raft_consensus.cc:1275] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:13:02.929445 14909 raft_consensus.cc:2468] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 18.
I20260709 12:13:02.933353 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:13:02.977921 22082 consensus_queue.cc:237] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } }
I20260709 12:13:02.979291 14903 raft_consensus.cc:1275] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 21 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
W20260709 12:13:02.973918 22179 log.cc:927] Time spent T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260709 12:13:02.980551 21943 leader_election.cc:290] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:02.909096 22074 raft_consensus.cc:493] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:02.982175 22041 leader_election.cc:290] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:02.982023 22074 raft_consensus.cc:515] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:02.937290 21873 raft_consensus.cc:493] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 26 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:13:02.985015 21873 raft_consensus.cc:3060] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:02.985085 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:13:02.985904 14903 raft_consensus.cc:3060] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:02.979542 21217 leader_election.cc:290] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 18 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:02.973395 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:13:02.990602 14906 raft_consensus.cc:2468] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 19.
I20260709 12:13:02.990724 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:13:02.915518 21994 raft_consensus.cc:2804] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:13:02.935985 14229 leader_election.cc:304] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:02.915459 21928 raft_consensus.cc:3060] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:13:02.994238 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 59392.6us
I20260709 12:13:02.971653 14186 raft_consensus.cc:3055] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 25 LEADER]: Stepping down as leader of term 25
I20260709 12:13:02.935674 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:13:02.993104 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:13:02.995064 14186 raft_consensus.cc:740] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
W20260709 12:13:02.993631 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 57759.9us
W20260709 12:13:03.001628 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:02.995910 14186 consensus_queue.cc:260] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 25.17, Last appended by leader: 17, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:13:03.004525 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 220089us
I20260709 12:13:03.005280 14186 raft_consensus.cc:3060] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 25 FOLLOWER]: Advancing to term 26
W20260709 12:13:03.010303 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:02.890153 22072 raft_consensus.cc:515] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:02.961575 22042 leader_election.cc:290] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:03.016583 14154 leader_election.cc:304] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:13:03.016876 14229 leader_election.cc:304] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
W20260709 12:13:03.024420 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 210411us
I20260709 12:13:03.036207 14229 leader_election.cc:304] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:13:03.026026 14186 raft_consensus.cc:1275] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 26 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 25 index: 17. Preceding OpId from leader: term: 26 index: 17. (term mismatch)
I20260709 12:13:03.005224 14303 leader_election.cc:304] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:13:03.037931 14186 pending_rounds.cc:85] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf: Aborting all ops after (but not including) 16
I20260709 12:13:03.038251 14186 pending_rounds.cc:107] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf: Aborting uncommitted NO_OP operation due to leader change: 25.17
I20260709 12:13:03.038491 14186 raft_consensus.cc:2889] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 26 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:03.039507 14155 leader_election.cc:304] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:13:02.999679 22103 raft_consensus.cc:493] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:03.002487 22038 raft_consensus.cc:2749] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:13:03.003922 21994 raft_consensus.cc:697] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 21 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:13:03.061455 14256 raft_consensus.cc:1240] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 21. Current term is 22. Ops: []
I20260709 12:13:03.017510 22190 raft_consensus.cc:493] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:03.061758 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:13:03.018750 21943 raft_consensus.cc:493] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:13:03.048480 22048 raft_consensus.cc:2804] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:13:03.073988 21994 consensus_queue.cc:237] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:03.074090 14258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41764 (request call id 3896) took 1095 ms. Trace:
I20260709 12:13:03.078554 14258 rpcz_store.cc:276] 0709 12:13:01.978387 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:01.980353 (+  1966us) service_pool.cc:224] Handling call
0709 12:13:03.073892 (+1093539us) spinlock_profiling.cc:243] Waited 849 ms on lock 0x7b54001b1cd4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:13:03.074022 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1951582464}
I20260709 12:13:03.048739 22017 raft_consensus.cc:2804] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:13:03.079627 22017 raft_consensus.cc:697] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 24 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:13:03.080227 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:03.081002 14258 raft_consensus.cc:2468] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 21.
I20260709 12:13:03.082511 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:13:03.073285 21690 raft_consensus.cc:515] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:03.086656 21690 leader_election.cc:290] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 23 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:13:03.090042 22130 raft_consensus.cc:493] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
W20260709 12:13:03.068892 22183 log.cc:927] Time spent T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.190s	user 0.001s	sys 0.000s
W20260709 12:13:03.069820 22039 consensus_meta.cc:287] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.582s	user 0.010s	sys 0.002s
I20260709 12:13:03.072616 22074 leader_election.cc:290] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:03.008489 22122 raft_consensus.cc:515] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:03.073976 22048 raft_consensus.cc:493] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:03.114238 22048 raft_consensus.cc:3060] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:03.096082 22039 raft_consensus.cc:2749] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:13:03.032182 21966 consensus_queue.cc:1048] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.035s
I20260709 12:13:03.092026 22190 raft_consensus.cc:515] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:13:03.109912 14156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:03.106714 22107 leader_election.cc:290] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:13:03.110426 21909 leader_election.cc:290] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:03.093590 21943 raft_consensus.cc:515] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:03.079018 22023 leader_election.cc:290] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:03.118305 14264 raft_consensus.cc:2468] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 20.
I20260709 12:13:03.120648 22198 raft_consensus.cc:3060] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:03.090687 22130 raft_consensus.cc:515] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:03.080889 22017 consensus_queue.cc:237] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:03.120138 22190 leader_election.cc:290] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:03.140837 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 23 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:03.121511 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:13:03.118285 14903 raft_consensus.cc:2468] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 19.
I20260709 12:13:03.156145 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:03.157181 14260 raft_consensus.cc:2468] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 21.
I20260709 12:13:03.092458 21518 raft_consensus.cc:2749] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:13:03.163793 14304 leader_election.cc:304] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:13:03.170022 14336 raft_consensus.cc:1240] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 21. Current term is 22. Ops: []
I20260709 12:13:03.177996 14334 raft_consensus.cc:1275] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 12:13:03.165153 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:03.060156 22103 raft_consensus.cc:515] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:03.190631 14304 leader_election.cc:304] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:13:03.203047 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:13:03.203812 14334 raft_consensus.cc:3060] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:13:03.200937 14304 leader_election.cc:304] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
W20260709 12:13:03.211524 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 332406us
I20260709 12:13:03.217607 14230 leader_election.cc:304] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:13:03.205467 21217 consensus_queue.cc:1059] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:13:03.240869 14304 leader_election.cc:304] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:13:03.189646 22168 raft_consensus.cc:2804] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Leader election won for term 23
W20260709 12:13:03.250612 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 43934us
I20260709 12:13:03.251818 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:13:03.119961 21924 consensus_queue.cc:1048] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.079s
I20260709 12:13:03.250977 14304 leader_election.cc:304] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:13:03.117660 21873 raft_consensus.cc:515] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:03.131852 22023 consensus_queue.cc:1059] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.071s
I20260709 12:13:03.199008 22122 leader_election.cc:290] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:13:03.239706 21909 raft_consensus.cc:2749] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 12:13:03.241650 22042 raft_consensus.cc:2804] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:13:03.130820 22195 consensus_queue.cc:1059] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.121s
I20260709 12:13:03.179301 21928 raft_consensus.cc:515] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:03.254004 21966 raft_consensus.cc:493] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:03.265859 21863 raft_consensus.cc:2804] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:13:03.287433 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:03.267968 22185 tablet_copy_client.cc:323] T 90097151efa7426faeaea3ff87a7ea78 P 73d01e9b1a9d49358da4985b21d681db: tablet copy: Beginning tablet copy session from remote peer at address 127.12.174.131:45957
I20260709 12:13:03.284819 21863 raft_consensus.cc:493] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 26 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:13:03.291440 21863 raft_consensus.cc:3060] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:03.291738 14337 raft_consensus.cc:1275] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 26 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 26 index: 17. (index mismatch)
I20260709 12:13:03.292450 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 26 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:03.293255 14339 raft_consensus.cc:2393] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 26: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:13:03.286834 22193 raft_consensus.cc:2749] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:13:03.288803 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:03.289426 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 28 candidate_status { last_received { term: 26 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:03.296378 14230 leader_election.cc:304] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:03.285032 21695 raft_consensus.cc:2804] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:13:03.298269 21695 raft_consensus.cc:493] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:13:03.298669 21695 raft_consensus.cc:3060] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:03.298986 21873 leader_election.cc:290] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 27 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:03.291980 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:03.301276 22130 leader_election.cc:290] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:03.302227 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:13:03.302455 22079 raft_consensus.cc:2804] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:03.257824 21893 consensus_queue.cc:1048] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.026s
I20260709 12:13:03.298571 22074 raft_consensus.cc:2749] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:03.304347 22072 leader_election.cc:290] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:13:03.305132 22103 leader_election.cc:290] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:13:03.305783 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:13:03.270174 22174 consensus_queue.cc:1059] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.060s
W20260709 12:13:03.308020 22176 log.cc:927] Time spent T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.423s	user 0.001s	sys 0.000s
I20260709 12:13:03.308192 21928 leader_election.cc:290] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:13:03.308872 21928 raft_consensus.cc:493] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:13:03.310706 21943 leader_election.cc:290] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:03.280005 22168 raft_consensus.cc:697] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 23 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:13:03.313932 22077 raft_consensus.cc:2749] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader election lost for term 20. Reason: Vote denied by peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187) with higher term. Message: Invalid argument: T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 20. Current term is 21.
I20260709 12:13:03.314642 22168 consensus_queue.cc:237] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:03.319236 22198 raft_consensus.cc:2749] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:03.319607 22016 raft_consensus.cc:515] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:03.321102 21712 raft_consensus.cc:3055] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:13:03.321544 21712 raft_consensus.cc:740] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:13:03.322446 21712 consensus_queue.cc:260] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:03.285987 21966 raft_consensus.cc:515] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:03.299064 22201 consensus_queue.cc:1048] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.028s
I20260709 12:13:03.329452 22048 raft_consensus.cc:515] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:03.330655 14262 raft_consensus.cc:1240] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 19. Current term is 20. Ops: []
I20260709 12:13:03.333374 21754 raft_consensus.cc:3055] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:13:03.337154 14230 leader_election.cc:304] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:03.341296 14334 raft_consensus.cc:2468] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 18.
I20260709 12:13:03.302974 22079 raft_consensus.cc:493] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:03.346112 14230 leader_election.cc:304] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
W20260709 12:13:03.347647 14154 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 295875us
W20260709 12:13:03.347658 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 303307us
I20260709 12:13:03.347158 14304 leader_election.cc:304] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:13:03.357781 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 27 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:03.309379 21928 raft_consensus.cc:515] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:03.361032 14154 leader_election.cc:304] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:13:03.344103 21754 raft_consensus.cc:740] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:13:03.286569 21894 raft_consensus.cc:493] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:03.348832 22079 raft_consensus.cc:3060] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:13:03.374138 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 118155us
I20260709 12:13:03.349257 22201 raft_consensus.cc:2749] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:03.382792 21754 consensus_queue.cc:260] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:03.383424 21894 raft_consensus.cc:515] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:03.354485 22077 raft_consensus.cc:2749] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:13:03.389340 14877 leader_election.cc:304] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:03.389959 14258 raft_consensus.cc:2468] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 21.
W20260709 12:13:03.454435 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 64226.9us
I20260709 12:13:03.392442 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
W20260709 12:13:03.484855 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 91356.5us
I20260709 12:13:03.372112 22080 raft_consensus.cc:2804] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:13:03.361414 22016 leader_election.cc:290] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 23 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:13:03.358297 22145 consensus_queue.cc:1048] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.037s
W20260709 12:13:03.450870 22164 log.cc:927] Time spent T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 12:13:03.488524 14903 raft_consensus.cc:2393] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 19: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
W20260709 12:13:03.497519 14156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:03.491839 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 102581us
I20260709 12:13:03.391953 14154 leader_election.cc:304] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
W20260709 12:13:03.500139 14154 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 108328us
I20260709 12:13:03.503188 14229 leader_election.cc:304] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:03.492322 21754 raft_consensus.cc:3060] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:03.491184 22080 raft_consensus.cc:493] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:03.510850 14155 leader_election.cc:304] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:13:03.511226 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 28 candidate_status { last_received { term: 26 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:13:03.512161 14187 raft_consensus.cc:2468] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 27.
I20260709 12:13:03.393616 22121 raft_consensus.cc:515] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:03.374544 21518 raft_consensus.cc:2749] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:03.491627 21217 raft_consensus.cc:2804] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:13:03.513464 14155 leader_election.cc:304] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:13:03.515333 14336 raft_consensus.cc:1240] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 21. Current term is 22. Ops: []
I20260709 12:13:03.504113 22201 raft_consensus.cc:493] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:03.510625 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:03.517167 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
W20260709 12:13:03.497963 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:03.537480 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:13:03.519836 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:03.538118 14188 raft_consensus.cc:3060] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:03.520771 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:13:03.523488 21217 raft_consensus.cc:697] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 18 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:13:03.515220 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 26 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:13:03.531333 22212 raft_consensus.cc:2749] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:03.506544 22174 raft_consensus.cc:2749] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:13:03.542954 14265 raft_consensus.cc:2393] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 23: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:13:03.542762 21217 consensus_queue.cc:237] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:03.532858 22038 raft_consensus.cc:3055] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 24 LEADER]: Stepping down as leader of term 24
W20260709 12:13:03.548946 22204 log.cc:927] Time spent T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.192s	user 0.001s	sys 0.000s
I20260709 12:13:03.550603 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:13:03.551290 21894 leader_election.cc:290] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:13:03.551895 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:13:03.522328 22005 leader_election.cc:290] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:13:03.553923 22202 log.cc:927] Time spent T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 12:13:03.554168 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
W20260709 12:13:03.554800 22211 log.cc:927] Time spent T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.189s	user 0.001s	sys 0.000s
I20260709 12:13:03.555358 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:13:03.533661 22144 raft_consensus.cc:3055] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:13:03.556295 14183 raft_consensus.cc:2393] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 21: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:13:03.536216 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:13:03.556734 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:13:03.548835 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:13:03.557399 14187 raft_consensus.cc:2468] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 22.
I20260709 12:13:03.558370 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 27 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:13:03.558930 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:03.559038 14187 raft_consensus.cc:2468] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 26.
I20260709 12:13:03.560386 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:13:03.536252 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:03.537508 14333 raft_consensus.cc:2468] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 24.
I20260709 12:13:03.537052 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:13:03.541826 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:13:03.569137 14906 raft_consensus.cc:3060] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:03.509989 22048 leader_election.cc:290] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:13:03.515755 22080 raft_consensus.cc:3060] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:03.504834 22082 raft_consensus.cc:2804] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Leader election won for term 19
W20260709 12:13:03.567129 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 44845.1us
I20260709 12:13:03.577349 14229 leader_election.cc:304] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:13:03.586217 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:03.587560 14229 leader_election.cc:304] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:03.513877 22072 consensus_queue.cc:1048] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.042s
I20260709 12:13:03.548785 22038 raft_consensus.cc:740] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:13:03.510671 22206 consensus_queue.cc:1059] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.062s
I20260709 12:13:03.597483 14303 leader_election.cc:304] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:13:03.608953 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:13:03.557036 21518 raft_consensus.cc:2749] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:03.612602 14182 raft_consensus.cc:3060] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:03.614306 22174 raft_consensus.cc:3060] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:03.620735 14303 leader_election.cc:304] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:03.545184 22151 raft_consensus.cc:493] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:13:03.611034 14229 leader_election.cc:304] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:03.608309 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:13:03.617851 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 22 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:13:03.561306 22144 raft_consensus.cc:740] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
W20260709 12:13:03.610956 22214 log.cc:927] Time spent T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
I20260709 12:13:03.623864 14183 raft_consensus.cc:2468] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 22.
I20260709 12:13:03.625974 14188 raft_consensus.cc:2468] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 23.
I20260709 12:13:03.590559 14264 raft_consensus.cc:2393] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db in current term 24: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
W20260709 12:13:03.618906 22205 log.cc:927] Time spent T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 12:13:03.612920 22048 raft_consensus.cc:2804] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:13:03.650712 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:13:03.645818 14229 leader_election.cc:304] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
W20260709 12:13:03.646476 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 71689.6us
I20260709 12:13:03.656240 14264 raft_consensus.cc:3060] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:03.611434 22082 raft_consensus.cc:697] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 19 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:13:03.653061 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:13:03.544343 22201 raft_consensus.cc:515] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:03.644780 22193 raft_consensus.cc:2749] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 12:13:03.669879 14181 raft_consensus.cc:2468] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 24.
W20260709 12:13:03.646288 22180 log.cc:927] Time spent T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:13:03.651793 22206 consensus_queue.cc:1243] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer 17aab1bbf5014936aa18cc21818b26ec log is divergent from this leader: its last log entry 23.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 12:13:03.652001 22077 raft_consensus.cc:2749] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:13:03.675742 14877 leader_election.cc:304] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:13:03.666581 14303 leader_election.cc:304] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:13:03.680893 14264 raft_consensus.cc:2468] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 23.
W20260709 12:13:03.683802 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 137140us
W20260709 12:13:03.691799 14156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:03.694212 14182 raft_consensus.cc:2468] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 23.
I20260709 12:13:03.667312 22074 raft_consensus.cc:2749] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 12:13:03.698683 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
W20260709 12:13:03.703100 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 189868us
I20260709 12:13:03.647496 22151 raft_consensus.cc:515] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:03.699005 14303 leader_election.cc:304] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:13:03.655763 22048 raft_consensus.cc:493] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:03.660390 22004 raft_consensus.cc:2804] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:13:03.700716 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 22 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:03.706940 14155 leader_election.cc:304] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:13:03.683403 22140 raft_consensus.cc:2804] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:13:03.711596 14304 leader_election.cc:304] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:13:03.667325 22079 raft_consensus.cc:515] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:03.726596 14264 raft_consensus.cc:1240] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 20. Current term is 21. Ops: []
I20260709 12:13:03.728713 14264 raft_consensus.cc:1275] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 12:13:03.730412 14264 raft_consensus.cc:1240] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 27 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 26. Current term is 27. Ops: []
I20260709 12:13:03.724627 14155 leader_election.cc:304] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:13:03.685550 21928 leader_election.cc:290] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:13:03.735139 14303 leader_election.cc:304] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:13:03.677723 21695 raft_consensus.cc:515] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:03.706481 22017 raft_consensus.cc:2804] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:03.752384 14155 leader_election.cc:304] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:13:03.750216 14903 raft_consensus.cc:1240] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 18 LEADER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 17. Current term is 18. Ops: []
I20260709 12:13:03.712404 22048 raft_consensus.cc:3060] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:03.727743 22140 raft_consensus.cc:493] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 23 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:13:03.735354 22206 raft_consensus.cc:2749] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:13:03.669936 22038 consensus_queue.cc:260] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.13, Last appended by leader: 13, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:03.748608 21818 raft_consensus.cc:2804] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:03.755131 14304 leader_election.cc:304] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:13:03.754771 14155 leader_election.cc:304] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:13:03.754333 22017 raft_consensus.cc:493] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:03.770946 22017 raft_consensus.cc:3060] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:03.749864 22082 consensus_queue.cc:237] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:03.753963 22145 raft_consensus.cc:2749] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:03.781906 14906 raft_consensus.cc:2468] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 20.
I20260709 12:13:03.783888 14912 raft_consensus.cc:1240] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 19. Current term is 20. Ops: [19.15-19.15]
I20260709 12:13:03.757054 22198 raft_consensus.cc:2749] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:13:03.757864 22140 raft_consensus.cc:3060] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:03.787173 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 27 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:03.696209 22144 consensus_queue.cc:260] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:03.753986 22221 raft_consensus.cc:2749] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 12:13:03.798420 22181 log.cc:927] Time spent T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.916s	user 0.000s	sys 0.005s
I20260709 12:13:03.759152 21818 raft_consensus.cc:493] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:13:03.800268 22151 leader_election.cc:290] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:13:03.802155 22018 raft_consensus.cc:2749] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:03.786387 22222 raft_consensus.cc:2804] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:13:03.810182 21818 raft_consensus.cc:3060] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:03.811853 22187 consensus_queue.cc:1059] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.004s
I20260709 12:13:03.750804 14348 tablet_copy_service.cc:140] P 65c9c1653b3346b39a0e118540e6080c: Received BeginTabletCopySession request for tablet 90097151efa7426faeaea3ff87a7ea78 from peer 73d01e9b1a9d49358da4985b21d681db ({username='slave'} at 127.0.0.1:55492)
I20260709 12:13:03.814623 14348 tablet_copy_service.cc:161] P 65c9c1653b3346b39a0e118540e6080c: Beginning new tablet copy session on tablet 90097151efa7426faeaea3ff87a7ea78 from peer 73d01e9b1a9d49358da4985b21d681db at {username='slave'} at 127.0.0.1:55492: session id = 73d01e9b1a9d49358da4985b21d681db-90097151efa7426faeaea3ff87a7ea78
I20260709 12:13:03.818994 21695 leader_election.cc:290] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 21 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:13:03.822610 22201 leader_election.cc:290] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:13:03.784746 22121 leader_election.cc:290] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 23 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:03.814250 22222 raft_consensus.cc:697] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 23 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:13:03.756843 22184 raft_consensus.cc:493] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:13:03.826874 22222 consensus_queue.cc:237] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:03.827757 22184 raft_consensus.cc:515] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:03.807327 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:03.784415 22227 raft_consensus.cc:2749] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:03.829847 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:03.831007 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: true dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:13:03.831570 14264 raft_consensus.cc:3055] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:13:03.831923 14264 raft_consensus.cc:740] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:13:03.831000 22079 leader_election.cc:290] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 23 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:13:03.836797 14264 consensus_queue.cc:260] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.15, Last appended by leader: 15, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:03.840699 14264 raft_consensus.cc:3060] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:03.855062 22189 raft_consensus.cc:3055] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:13:03.855547 22189 raft_consensus.cc:740] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:13:03.856449 22189 consensus_queue.cc:260] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:03.857442 22189 raft_consensus.cc:3060] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:13:03.859810 22174 raft_consensus.cc:2749] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 12:13:03.855041 21863 consensus_meta.cc:287] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.563s	user 0.010s	sys 0.001s
I20260709 12:13:03.872612 14264 raft_consensus.cc:2468] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 25.
I20260709 12:13:03.876114 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:03.876768 14264 raft_consensus.cc:2468] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 21.
W20260709 12:13:03.879640 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 124568us
I20260709 12:13:03.881557 22154 consensus_queue.cc:1059] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 26.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:13:03.877548 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:03.883997 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 28 candidate_status { last_received { term: 26 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:03.891858 21948 consensus_queue.cc:1048] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:13:03.893085 21818 raft_consensus.cc:515] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:03.900138 22038 raft_consensus.cc:3060] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:03.892326 21756 raft_consensus.cc:3060] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:13:03.914012 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:03.908432 22145 raft_consensus.cc:493] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:13:03.921708 14256 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53050 (request call id 1626) took 1504 ms. Trace:
I20260709 12:13:03.922215 14256 rpcz_store.cc:276] 0709 12:13:02.417332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:02.420798 (+  3466us) service_pool.cc:224] Handling call
0709 12:13:02.456529 (+ 35731us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:03.062195 (+605666us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:03.921361 (+859166us) spinlock_profiling.cc:243] Waited 602 ms on lock 0x7b54001c3254. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:13:03.921611 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1385393024}
I20260709 12:13:03.922632 22140 raft_consensus.cc:515] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 24 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:03.923722 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:13:03.921502 22145 raft_consensus.cc:515] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:03.927533 21948 consensus_queue.cc:1059] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.002s
W20260709 12:13:03.931358 22240 log.cc:927] Time spent T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.050s	user 0.000s	sys 0.001s
I20260709 12:13:03.931011 22080 raft_consensus.cc:515] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:03.933672 22080 leader_election.cc:290] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 21 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:13:03.926016 22082 raft_consensus.cc:493] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:03.936046 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:13:03.935904 22082 raft_consensus.cc:515] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:03.937922 22048 raft_consensus.cc:515] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:03.945612 14264 raft_consensus.cc:2393] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 28: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:13:03.951181 22186 raft_consensus.cc:3055] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:13:03.951714 22186 raft_consensus.cc:740] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:13:03.952567 22186 consensus_queue.cc:260] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 14, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:03.896889 21863 raft_consensus.cc:515] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:03.957538 21712 raft_consensus.cc:3060] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:13:03.966807 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 57445.9us
W20260709 12:13:03.969331 22207 log.cc:927] Time spent T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.610s	user 0.001s	sys 0.001s
I20260709 12:13:03.970783 14338 raft_consensus.cc:2468] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 27.
I20260709 12:13:03.972191 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:03.973076 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: true dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:13:03.974155 14339 raft_consensus.cc:3060] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:03.978348 14337 raft_consensus.cc:2468] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 24.
I20260709 12:13:03.979483 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:13:03.979679 14877 leader_election.cc:304] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:13:03.980341 14337 raft_consensus.cc:2393] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 19: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:13:03.980693 21754 raft_consensus.cc:2804] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:13:03.984596 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:03.988082 14335 raft_consensus.cc:1240] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 17. Current term is 18. Ops: []
I20260709 12:13:03.990442 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 27 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:03.990305 14335 raft_consensus.cc:1240] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 21. Current term is 22. Ops: []
I20260709 12:13:03.993556 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 22 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:13:03.996268 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:03.954071 22140 leader_election.cc:290] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 24 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:03.997934 22048 leader_election.cc:290] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 28 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:04.003325 14335 raft_consensus.cc:2393] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 23: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:13:04.005275 22107 raft_consensus.cc:493] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:13:04.005896 22107 raft_consensus.cc:515] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:04.008157 22107 leader_election.cc:290] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:13:04.010730 21863 leader_election.cc:290] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 27 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:13:04.010893 21818 leader_election.cc:290] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 25 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:13:04.013809 22145 leader_election.cc:290] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:03.995193 22082 leader_election.cc:290] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:13:04.019033 14260 raft_consensus.cc:2468] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 22.
W20260709 12:13:04.019258 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 260851us
I20260709 12:13:04.004227 21754 raft_consensus.cc:697] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 24 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:13:04.025362 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 28 candidate_status { last_received { term: 26 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:04.026039 22017 raft_consensus.cc:515] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:04.028225 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 27 candidate_status { last_received { term: 26 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:13:04.028566 14339 raft_consensus.cc:2468] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 25.
I20260709 12:13:04.029011 14264 raft_consensus.cc:2368] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for earlier term 27. Current term is 28.
I20260709 12:13:04.029569 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:04.030287 14337 raft_consensus.cc:1240] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 20. Current term is 21. Ops: []
W20260709 12:13:04.030408 21955 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 26 current term: 26 is higher.
I20260709 12:13:04.031555 14258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41768 (request call id 2719) took 1119 ms. Trace:
I20260709 12:13:04.031952 14258 rpcz_store.cc:276] 0709 12:13:02.911954 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:03.082209 (+170255us) service_pool.cc:224] Handling call
0709 12:13:04.031346 (+949137us) spinlock_profiling.cc:243] Waited 231 ms on lock 0x7b5400100c54. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:13:04.031473 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":531815808}
I20260709 12:13:04.033051 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:13:04.033492 14261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41764 (request call id 3919) took 1195 ms. Trace:
I20260709 12:13:04.033506 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:13:04.034237 14264 raft_consensus.cc:3060] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Advancing to term 23
I20260709 12:13:04.034742 14258 raft_consensus.cc:2393] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db in current term 24: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:13:04.035653 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:13:04.036191 14258 raft_consensus.cc:3060] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:04.038552 14155 leader_election.cc:304] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:13:04.039954 14332 raft_consensus.cc:1240] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 21. Current term is 23. Ops: []
I20260709 12:13:04.040232 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:04.040867 14336 raft_consensus.cc:1240] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 22 LEADER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 21. Current term is 22. Ops: []
I20260709 12:13:04.031720 14335 raft_consensus.cc:1275] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 26 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 25 index: 12. Preceding OpId from leader: term: 26 index: 13. (index mismatch)
I20260709 12:13:04.032411 14331 raft_consensus.cc:1240] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 22. Current term is 23. Ops: []
I20260709 12:13:04.034018 14261 rpcz_store.cc:276] 0709 12:13:02.838079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:02.839495 (+  1416us) service_pool.cc:224] Handling call
0709 12:13:02.839894 (+   399us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:02.897920 (+ 58026us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:02.897957 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:02.898496 (+   539us) log.cc:844] Serialized 26 byte log entry
0709 12:13:03.047500 (+149004us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:13:03.047550 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:04.033043 (+985493us) spinlock_profiling.cc:243] Waited 57.5 ms on lock 0x7b54002c0954. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:13:04.033094 (+    51us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:04.033145 (+    51us) raft_consensus.cc:1685] finished
0709 12:13:04.033160 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:04.033421 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10929,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":6857,"spinlock_wait_cycles":132221184,"thread_start_us":148595,"threads_started":1,"wal-append.queue_time_us":355495}
I20260709 12:13:04.044157 14264 raft_consensus.cc:2468] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 23.
I20260709 12:13:04.044399 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:04.045142 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:13:04.035611 14330 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50856 (request call id 3247) took 1533 ms (client timeout 1558 ms). Trace:
W20260709 12:13:04.045887 14330 rpcz_store.cc:269] 0709 12:13:02.502026 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:02.502145 (+   119us) service_pool.cc:224] Handling call
0709 12:13:04.035426 (+1533281us) spinlock_profiling.cc:243] Waited 786 ms on lock 0x7b5400338e54. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:13:04.035554 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1808057600}
I20260709 12:13:04.046247 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 22 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:04.048892 14258 raft_consensus.cc:2468] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 21.
I20260709 12:13:04.039431 21955 raft_consensus.cc:2804] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:13:04.050005 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:04.071004 14261 raft_consensus.cc:2468] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 25.
I20260709 12:13:04.071640 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:13:04.072244 14188 raft_consensus.cc:3060] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:04.029150 22017 leader_election.cc:290] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 23 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:13:04.075268 14257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41764 (request call id 3905) took 1741 ms. Trace:
I20260709 12:13:04.075662 14257 rpcz_store.cc:276] 0709 12:13:02.334364 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:02.335485 (+  1121us) service_pool.cc:224] Handling call
0709 12:13:02.335773 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:02.761101 (+425328us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:02.761135 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:02.761180 (+    45us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:13:02.761212 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:04.075037 (+1313825us) spinlock_profiling.cc:243] Waited 425 ms on lock 0x7b540007b054. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:13:04.075085 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:04.075205 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":977654144}
I20260709 12:13:04.077296 14257 raft_consensus.cc:1240] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 25 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 24. Current term is 25. Ops: [24.14-24.14]
I20260709 12:13:04.025378 21754 consensus_queue.cc:237] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:04.064706 22144 raft_consensus.cc:3060] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:04.069339 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:13:04.086956 14906 raft_consensus.cc:2393] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 25: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
I20260709 12:13:04.069955 22082 consensus_queue.cc:1059] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 22.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.018s
I20260709 12:13:04.087651 21756 raft_consensus.cc:493] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:13:04.088491 22082 raft_consensus.cc:3055] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:13:04.088869 22082 raft_consensus.cc:740] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:13:04.089880 22082 consensus_queue.cc:260] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:04.088418 21756 raft_consensus.cc:515] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:04.091447 22082 raft_consensus.cc:3060] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:04.091872 22041 raft_consensus.cc:493] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:13:04.092631 22041 raft_consensus.cc:515] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:04.093906 21955 raft_consensus.cc:697] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 25 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:13:04.091262 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:13:04.096721 14264 raft_consensus.cc:1240] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 20. Current term is 21. Ops: []
I20260709 12:13:04.072086 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:13:04.074869 22145 consensus_queue.cc:1048] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:13:04.079619 14262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41768 (request call id 2721) took 1162 ms. Trace:
I20260709 12:13:04.055269 22042 raft_consensus.cc:493] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:13:04.077800 21966 leader_election.cc:290] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:13:04.096020 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 28 candidate_status { last_received { term: 26 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:13:04.100378 14182 raft_consensus.cc:3060] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:04.100817 21948 raft_consensus.cc:493] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:13:04.101059 22041 leader_election.cc:290] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:13:04.083570 14256 raft_consensus.cc:2468] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 21.
I20260709 12:13:04.096994 14189 raft_consensus.cc:2393] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 21: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:13:04.101613 21948 raft_consensus.cc:515] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:04.078224 21712 consensus_queue.cc:1059] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 12:13:04.104365 21712 raft_consensus.cc:3055] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:13:04.098392 14262 rpcz_store.cc:276] 0709 12:13:02.916920 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:03.199112 (+282192us) service_pool.cc:224] Handling call
0709 12:13:03.199421 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:03.331040 (+131619us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:04.079395 (+748355us) spinlock_profiling.cc:243] Waited 131 ms on lock 0x7b54001c1e54. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:13:04.079558 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":301392768}
I20260709 12:13:04.091703 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:13:04.104841 21712 raft_consensus.cc:740] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:13:04.106130 21712 consensus_queue.cc:260] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 20.10, Last appended by leader: 10, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:04.107779 21712 raft_consensus.cc:3060] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:04.107008 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:04.061343 14304 leader_election.cc:400] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 27 election: Vote denied by peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673) with higher term. Message: Invalid argument: T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for earlier term 27. Current term is 28.
I20260709 12:13:04.094310 22079 raft_consensus.cc:493] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:04.130730 14304 leader_election.cc:403] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 27 election: Cancelling election due to peer responding with higher term
I20260709 12:13:04.112401 14256 raft_consensus.cc:1275] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 12:13:04.079753 14258 raft_consensus.cc:1275] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 26 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 25 index: 12. Preceding OpId from leader: term: 26 index: 13. (index mismatch)
I20260709 12:13:04.132367 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:13:04.099596 21756 leader_election.cc:290] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:04.121152 14261 raft_consensus.cc:1275] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 12:13:04.143579 14188 raft_consensus.cc:2468] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 23.
I20260709 12:13:04.095465 21955 consensus_queue.cc:237] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.15, Last appended by leader: 15, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:04.147938 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
W20260709 12:13:04.134064 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 72890.8us
I20260709 12:13:04.124859 21948 leader_election.cc:290] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:04.149765 14304 leader_election.cc:304] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:13:04.153658 14182 raft_consensus.cc:2468] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 28.
I20260709 12:13:04.108902 22042 raft_consensus.cc:3060] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:04.166188 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
W20260709 12:13:04.168226 14228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:04.175253 14228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:04.166188 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:13:04.171156 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 27 candidate_status { last_received { term: 26 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:13:04.135468 21928 raft_consensus.cc:3060] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:04.178081 14182 raft_consensus.cc:2368] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for earlier term 27. Current term is 28.
I20260709 12:13:04.178649 14304 leader_election.cc:304] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:13:04.179221 14183 raft_consensus.cc:1275] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 24 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 12:13:04.182150 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:13:04.179032 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:04.182775 14182 raft_consensus.cc:3060] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:04.191947 14304 leader_election.cc:304] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:13:04.193369 14304 leader_election.cc:304] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:13:04.198954 14877 leader_election.cc:304] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
W20260709 12:13:04.203148 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 133854us
I20260709 12:13:04.133960 22079 raft_consensus.cc:515] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:04.209239 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:13:04.209455 14155 leader_election.cc:304] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:13:04.210068 14183 raft_consensus.cc:3060] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:04.211073 14155 leader_election.cc:304] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:13:04.207118 14304 leader_election.cc:304] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:04.212805 14155 leader_election.cc:304] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:13:04.206053 21948 raft_consensus.cc:2749] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:13:04.208403 22153 raft_consensus.cc:2804] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:04.215700 22153 raft_consensus.cc:493] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:13:04.216264 22153 raft_consensus.cc:3060] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:04.216931 22189 consensus_queue.cc:1059] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:13:04.218101 22189 consensus_queue.cc:1243] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer 65c9c1653b3346b39a0e118540e6080c log is divergent from this leader: its last log entry 22.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 12:13:04.218789 22189 raft_consensus.cc:3055] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:13:04.219408 22189 raft_consensus.cc:740] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:13:04.221930 22195 raft_consensus.cc:2749] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:13:04.202399 21818 raft_consensus.cc:2749] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:04.223032 22227 raft_consensus.cc:2749] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:04.219143 22107 raft_consensus.cc:2804] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:13:04.224339 22107 raft_consensus.cc:697] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 21 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:13:04.219115 14260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41764 (request call id 3925) took 1285 ms. Trace:
I20260709 12:13:04.227795 14260 rpcz_store.cc:276] 0709 12:13:02.934176 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:03.164835 (+230659us) service_pool.cc:224] Handling call
0709 12:13:04.218926 (+1054091us) spinlock_profiling.cc:243] Waited 834 ms on lock 0x7b54001b30d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:13:04.219044 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1918404992}
W20260709 12:13:04.200307 22168 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.659s	user 0.007s	sys 0.030s
I20260709 12:13:04.220788 22189 consensus_queue.cc:260] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:04.206476 22017 raft_consensus.cc:2804] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:13:04.245647 14155 leader_election.cc:304] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:13:04.213773 22047 raft_consensus.cc:2804] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:13:04.250887 22047 raft_consensus.cc:697] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 21 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
W20260709 12:13:04.253127 14229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:04.252691 22047 consensus_queue.cc:237] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.9, Last appended by leader: 9, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:04.233403 22245 consensus_queue.cc:1048] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.008s
I20260709 12:13:04.259631 22079 leader_election.cc:290] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:13:04.260586 22017 raft_consensus.cc:697] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 23 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:13:04.262218 22017 consensus_queue.cc:237] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:13:04.232214 22168 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.707s	user 0.007s	sys 0.030s
I20260709 12:13:04.266207 14336 raft_consensus.cc:1240] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 25 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 24. Current term is 25. Ops: []
I20260709 12:13:04.274459 14155 leader_election.cc:304] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:13:04.266639 14182 raft_consensus.cc:2468] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 25.
I20260709 12:13:04.286213 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 27 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:13:04.281896 14183 raft_consensus.cc:2468] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 23.
I20260709 12:13:04.289728 14155 leader_election.cc:304] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:13:04.290439 14182 raft_consensus.cc:1275] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 12:13:04.294075 22227 raft_consensus.cc:2749] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:04.231695 22171 consensus_queue.cc:1048] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.055s
I20260709 12:13:04.272825 22022 raft_consensus.cc:2764] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Leader pre-election decision vote started in defunct term 22: won
I20260709 12:13:04.300251 14155 leader_election.cc:304] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:13:04.299470 21754 consensus_queue.cc:1059] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 24.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.006s
I20260709 12:13:04.302578 22195 raft_consensus.cc:2749] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 28 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:13:04.287324 22245 raft_consensus.cc:493] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:13:04.308475 22245 raft_consensus.cc:515] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:04.310083 22217 raft_consensus.cc:493] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:13:04.310834 22245 leader_election.cc:290] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:13:04.310709 22217 raft_consensus.cc:515] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:04.242787 22107 consensus_queue.cc:237] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:04.313043 22217 leader_election.cc:290] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:04.316781 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:04.324580 21756 raft_consensus.cc:493] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:04.325287 21756 raft_consensus.cc:515] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:04.327694 21756 leader_election.cc:290] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:04.329063 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:13:04.334057 14878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:04.336884 14229 leader_election.cc:304] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:04.342398 14181 raft_consensus.cc:2468] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 23.
W20260709 12:13:04.346519 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 48169.8us
I20260709 12:13:04.348407 14189 raft_consensus.cc:2410] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for term 21 because replica has last-logged OpId of term: 20 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 9.
I20260709 12:13:04.347530 14155 leader_election.cc:304] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:13:04.350057 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 23 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:13:04.351047 14183 raft_consensus.cc:2410] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for term 23 because replica has last-logged OpId of term: 21 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 10.
I20260709 12:13:04.303647 21754 raft_consensus.cc:3055] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:13:04.301924 22189 raft_consensus.cc:3060] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:04.355383 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:13:04.375444 22004 raft_consensus.cc:493] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 26 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:13:04.376163 22004 raft_consensus.cc:3060] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:04.384449 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:04.386787 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 27 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:04.387485 14262 raft_consensus.cc:2468] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 26.
I20260709 12:13:04.388389 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:04.392017 22082 consensus_queue.cc:1059] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:13:04.392841 22082 consensus_queue.cc:1243] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Peer 17aab1bbf5014936aa18cc21818b26ec log is divergent from this leader: its last log entry 23.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 12:13:04.371403 21912 raft_consensus.cc:3055] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 26 LEADER]: Stepping down as leader of term 26
I20260709 12:13:04.394729 21912 raft_consensus.cc:740] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:13:04.395655 21912 consensus_queue.cc:260] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 26.14, Last appended by leader: 14, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:04.396696 21912 raft_consensus.cc:3060] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:04.347678 21756 raft_consensus.cc:2804] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:13:04.399842 21756 raft_consensus.cc:697] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 20 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:13:04.401046 21756 consensus_queue.cc:237] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:04.403301 14263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53050 (request call id 1631) took 1243 ms. Trace:
I20260709 12:13:04.403784 14263 rpcz_store.cc:276] 0709 12:13:03.159487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:03.312727 (+153240us) service_pool.cc:224] Handling call
0709 12:13:03.313072 (+   345us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:03.337111 (+ 24039us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:03.337152 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:03.344505 (+  7353us) log.cc:844] Serialized 26 byte log entry
0709 12:13:03.923493 (+578988us) spinlock_profiling.cc:243] Waited 2.06 ms on lock 0x7b1800366880. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f212cf16ab1 00007f212cf23281 00007f2124030e07 00007f212ce8b9a9 00007f212404d69b 00007f212404b93f 00007f212404dc02 00007f2126cd520b 00007f2126cdad23 00007f2126cdb0d1 00007f21270f6a0f
0709 12:13:03.986947 (+ 63454us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:13:03.986990 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:04.402890 (+415900us) spinlock_profiling.cc:243] Waited 23.6 ms on lock 0x7b5400031954. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:13:04.402949 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:04.403004 (+    55us) raft_consensus.cc:1685] finished
0709 12:13:04.403017 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:04.403203 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1151,"raft.queue_time_us":7021,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":5627,"spinlock_wait_cycles":59000960,"thread_start_us":63262,"threads_started":1,"wal-append.queue_time_us":666658}
I20260709 12:13:04.406342 14257 raft_consensus.cc:1240] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 22. Current term is 23. Ops: []
W20260709 12:13:04.392086 14265 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41764 (request call id 3928) took 1298 ms (client timeout 1524 ms). Trace:
W20260709 12:13:04.407636 14265 rpcz_store.cc:269] 0709 12:13:03.094093 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:03.121206 (+ 27113us) service_pool.cc:224] Handling call
0709 12:13:04.391886 (+1270680us) spinlock_profiling.cc:243] Waited 397 ms on lock 0x7b5400212354. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:13:04.392020 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":913152384}
I20260709 12:13:04.386669 14338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50856 (request call id 3255) took 1099 ms. Trace:
I20260709 12:13:04.411466 14304 leader_election.cc:304] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:13:04.410274 14338 rpcz_store.cc:276] 0709 12:13:03.287590 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:03.289166 (+  1576us) service_pool.cc:224] Handling call
0709 12:13:04.386504 (+1097338us) spinlock_profiling.cc:243] Waited 675 ms on lock 0x7b5400002154. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:13:04.386611 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1551470336}
I20260709 12:13:04.417351 14259 raft_consensus.cc:1240] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 27 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 26. Current term is 27. Ops: []
I20260709 12:13:04.419214 14338 raft_consensus.cc:1275] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 12:13:04.416868 14877 leader_election.cc:304] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:13:04.419690 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:13:04.427639 14265 raft_consensus.cc:2376] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 21. Re-sending same reply.
I20260709 12:13:04.435808 14304 leader_election.cc:304] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:04.348078 22195 raft_consensus.cc:2749] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:04.441654 14229 leader_election.cc:304] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:13:04.443189 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:13:04.445536 14906 raft_consensus.cc:2468] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 25.
I20260709 12:13:04.355445 21754 raft_consensus.cc:740] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:13:04.356717 21712 raft_consensus.cc:2749] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:04.447592 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:13:04.442215 22082 raft_consensus.cc:493] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:13:04.451260 21966 raft_consensus.cc:2749] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:04.445748 22193 raft_consensus.cc:493] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:04.482818 22193 raft_consensus.cc:515] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:04.485317 22193 leader_election.cc:290] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:13:04.455619 22208 log.cc:927] Time spent T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.968s	user 0.003s	sys 0.000s
I20260709 12:13:04.445474 22086 raft_consensus.cc:2749] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:13:04.434600 22218 raft_consensus.cc:2749] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:13:04.439244 22191 log.cc:927] Time spent T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 1.554s	user 0.005s	sys 0.000s
I20260709 12:13:04.464671 14259 raft_consensus.cc:1275] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 23 index: 12. (index mismatch)
I20260709 12:13:04.440142 21928 raft_consensus.cc:2749] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 28 FOLLOWER]: Leader election lost for term 27. Reason: Vote denied by peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673) with higher term. Message: Invalid argument: T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for earlier term 27. Current term is 28.
I20260709 12:13:04.472306 22082 raft_consensus.cc:515] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:04.445501 22227 consensus_queue.cc:1048] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.030s
I20260709 12:13:04.478260 21754 consensus_queue.cc:260] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.17, Last appended by leader: 17, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:04.405187 22153 raft_consensus.cc:515] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:04.492434 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:04.670310 14262 raft_consensus.cc:2468] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 25.
I20260709 12:13:04.491915 14229 leader_election.cc:304] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
W20260709 12:13:04.671802 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 179989us
I20260709 12:13:04.494751 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:13:04.592331 14228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:04.634640 14155 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:04.434574 22022 consensus_queue.cc:1059] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.043s
I20260709 12:13:04.640606 14187 raft_consensus.cc:1275] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 12:13:04.663946 14186 raft_consensus.cc:1275] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
W20260709 12:13:04.681703 14303 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:04.674589 14304 leader_election.cc:304] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:13:04.690198 14184 raft_consensus.cc:1240] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 25 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 24. Current term is 25. Ops: []
I20260709 12:13:04.663338 21712 raft_consensus.cc:493] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:13:04.701822 14185 raft_consensus.cc:1240] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 25 LEADER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 24. Current term is 25. Ops: []
W20260709 12:13:04.703568 14229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:04.696429 22042 consensus_meta.cc:287] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.501s	user 0.011s	sys 0.001s
I20260709 12:13:04.725106 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:13:04.725399 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:04.683688 21966 raft_consensus.cc:2804] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:13:04.702915 22195 raft_consensus.cc:3055] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:13:04.693616 21928 raft_consensus.cc:2804] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:13:04.667451 22193 consensus_queue.cc:1048] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.059s
W20260709 12:13:04.715996 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:04.733786 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:04.729048 14262 raft_consensus.cc:1275] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 12:13:04.706660 22078 raft_consensus.cc:2804] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:13:04.722970 21754 raft_consensus.cc:3060] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:04.716958 22004 raft_consensus.cc:515] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:04.713279 22082 leader_election.cc:290] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:13:04.736325 14228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:04.738386 22189 raft_consensus.cc:493] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:13:04.741523 21955 raft_consensus.cc:493] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:04.731177 22042 raft_consensus.cc:515] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } }
I20260709 12:13:04.743274 22023 consensus_queue.cc:1048] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:13:04.730518 22195 raft_consensus.cc:740] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:13:04.731652 21966 raft_consensus.cc:493] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:04.736276 21928 raft_consensus.cc:493] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:04.735146 22227 raft_consensus.cc:493] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:13:04.710312 21712 raft_consensus.cc:515] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:04.753939 22239 raft_consensus.cc:493] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:04.774451 14261 raft_consensus.cc:1240] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 18. Current term is 19. Ops: []
I20260709 12:13:04.771724 22153 leader_election.cc:290] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 25 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:13:04.764827 21966 raft_consensus.cc:3060] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:04.783535 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
W20260709 12:13:04.778503 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 108247us
I20260709 12:13:04.781548 22042 leader_election.cc:290] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:04.764024 21955 raft_consensus.cc:515] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:04.782538 22195 consensus_queue.cc:260] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:04.766000 21928 raft_consensus.cc:3060] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:04.763032 22189 raft_consensus.cc:515] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:04.799047 22195 raft_consensus.cc:3060] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:04.779347 22239 raft_consensus.cc:515] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:04.811657 14259 raft_consensus.cc:1240] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 20 LEADER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 19. Current term is 20. Ops: [19.15-19.15]
I20260709 12:13:04.813753 22216 consensus_queue.cc:1048] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:13:04.790733 22227 raft_consensus.cc:515] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:04.826757 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:13:04.820695 21909 raft_consensus.cc:493] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:04.832918 21909 raft_consensus.cc:515] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:04.839313 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:13:04.840103 14187 raft_consensus.cc:2468] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 22.
I20260709 12:13:04.841252 22004 leader_election.cc:290] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 27 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:13:04.843281 22189 leader_election.cc:290] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:13:04.815644 21756 raft_consensus.cc:493] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:13:04.844998 21756 raft_consensus.cc:515] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:04.846473 21909 leader_election.cc:290] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:13:04.847086 21756 leader_election.cc:290] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:13:04.849233 22227 leader_election.cc:290] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:13:04.866902 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:13:04.874397 14908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:13:04.875135 14908 raft_consensus.cc:2468] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 21.
I20260709 12:13:04.877415 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:13:04.880757 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:13:04.881567 14187 raft_consensus.cc:2468] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 18.
I20260709 12:13:04.882210 14229 leader_election.cc:304] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:13:04.866279 22040 raft_consensus.cc:2749] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:13:04.873464 22184 leader_election.cc:290] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:13:04.879132 22255 log.cc:927] Time spent T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.073s	user 0.005s	sys 0.001s
I20260709 12:13:04.888758 21756 raft_consensus.cc:2804] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:04.917559 21756 raft_consensus.cc:493] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:04.932269 14190 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56044 (request call id 3835) took 1392 ms. Trace:
I20260709 12:13:04.932647 21955 leader_election.cc:290] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:04.933429 14190 rpcz_store.cc:276] 0709 12:13:03.540559 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:03.590712 (+ 50153us) service_pool.cc:224] Handling call
0709 12:13:03.591298 (+   586us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:03.591707 (+   409us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:03.591735 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:04.491341 (+899606us) spinlock_profiling.cc:243] Waited 1.79 ms on lock 0x7b2c0006d948. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2125a34a11 00007f2125a44372 00007f2127176a01 00007f212713b43a 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2
0709 12:13:04.641853 (+150512us) log.cc:844] Serialized 513 byte log entry
0709 12:13:04.864523 (+222670us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:13:04.864568 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:04.864658 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:04.931929 (+ 67271us) raft_consensus.cc:1685] finished
0709 12:13:04.931953 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:04.932197 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4109696,"thread_start_us":166199,"threads_started":1,"wal-append.queue_time_us":233996}
I20260709 12:13:04.938572 14911 raft_consensus.cc:1275] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:13:04.927320 21756 raft_consensus.cc:3060] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:13:04.944798 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 139902us
I20260709 12:13:04.942605 22042 consensus_queue.cc:1048] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.006s
I20260709 12:13:04.961843 21966 raft_consensus.cc:515] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:04.981802 22268 raft_consensus.cc:493] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:04.988302 14265 raft_consensus.cc:2368] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for earlier term 25. Current term is 26.
I20260709 12:13:04.991163 14903 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59144 (request call id 856) took 1319 ms. Trace:
I20260709 12:13:04.991551 14903 rpcz_store.cc:276] 0709 12:13:03.671740 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:03.671908 (+   168us) service_pool.cc:224] Handling call
0709 12:13:03.672233 (+   325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:03.753102 (+ 80869us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:04.990859 (+1237757us) spinlock_profiling.cc:243] Waited 77.8 ms on lock 0x7b5400649bd4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:13:04.991086 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":178865024}
I20260709 12:13:04.994935 21966 leader_election.cc:290] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 26 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:13:05.007226 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:13:05.008111 14903 raft_consensus.cc:3060] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:05.000540 22268 raft_consensus.cc:515] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:05.024542 14903 raft_consensus.cc:2468] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 26.
I20260709 12:13:05.026021 14229 leader_election.cc:304] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:13:05.013324 21928 raft_consensus.cc:515] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:05.032051 22042 raft_consensus.cc:2804] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:13:05.032733 22042 raft_consensus.cc:697] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 26 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:13:05.033885 22042 consensus_queue.cc:237] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.17, Last appended by leader: 17, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:05.038866 22004 raft_consensus.cc:493] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:05.039510 22004 raft_consensus.cc:515] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:05.049816 22004 leader_election.cc:290] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:13:05.026149 21756 raft_consensus.cc:515] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:05.049602 22186 raft_consensus.cc:3060] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:05.064460 14912 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59144 (request call id 855) took 1447 ms. Trace:
I20260709 12:13:05.064926 14912 rpcz_store.cc:276] 0709 12:13:03.616615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:03.617473 (+   858us) service_pool.cc:224] Handling call
0709 12:13:03.783639 (+166166us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:03.784261 (+   622us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:05.064240 (+1279979us) spinlock_profiling.cc:243] Waited 164 ms on lock 0x7b5400040950. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713a8ad 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:13:05.064384 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":377256832}
I20260709 12:13:05.072080 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:13:05.061988 21928 leader_election.cc:290] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 26 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:13:05.074442 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:13:05.076278 14912 raft_consensus.cc:3060] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:05.088347 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:05.088893 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:05.089071 14260 raft_consensus.cc:2468] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 22.
I20260709 12:13:05.094547 14185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56046 (request call id 3302) took 1012 ms. Trace:
I20260709 12:13:05.097321 22078 raft_consensus.cc:493] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 26 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:13:05.097836 22078 raft_consensus.cc:3060] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:05.095016 14185 rpcz_store.cc:276] 0709 12:13:04.082424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:04.089556 (+  7132us) service_pool.cc:224] Handling call
0709 12:13:04.089945 (+   389us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:04.705109 (+615164us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:05.094262 (+389153us) spinlock_profiling.cc:243] Waited 612 ms on lock 0x7b540028b4d4. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:13:05.094473 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1406631680}
I20260709 12:13:05.111460 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:05.112185 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:05.112829 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:13:05.113324 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 58525.6us
I20260709 12:13:05.114089 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:05.112150 14155 leader_election.cc:304] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:13:05.119156 14330 raft_consensus.cc:1275] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:13:05.121994 14332 raft_consensus.cc:1240] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 26 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 24. Current term is 26. Ops: []
I20260709 12:13:05.123370 22268 leader_election.cc:290] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:05.113685 14333 raft_consensus.cc:2468] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 22.
I20260709 12:13:05.125089 14912 raft_consensus.cc:2468] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 22.
I20260709 12:13:05.126950 14229 leader_election.cc:304] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:13:05.129300 21909 raft_consensus.cc:2804] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:13:05.129863 21909 raft_consensus.cc:697] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 22 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:13:05.130496 21955 consensus_queue.cc:1048] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:13:05.130955 21909 consensus_queue.cc:237] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:05.132421 21712 leader_election.cc:290] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:13:05.129837 14338 raft_consensus.cc:1275] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 25 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260709 12:13:05.133003 22194 raft_consensus.cc:2804] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:05.133460 22194 raft_consensus.cc:493] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:05.133841 22194 raft_consensus.cc:3060] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:05.135138 14189 raft_consensus.cc:2468] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 25.
W20260709 12:13:05.140934 14153 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:05.141368 14190 raft_consensus.cc:1275] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 15. (term mismatch)
I20260709 12:13:05.141817 14190 pending_rounds.cc:85] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf: Aborting all ops after (but not including) 14
I20260709 12:13:05.142045 14190 pending_rounds.cc:107] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf: Aborting uncommitted NO_OP operation due to leader change: 19.15
I20260709 12:13:05.142328 14190 raft_consensus.cc:2889] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:05.141151 22195 consensus_queue.cc:1048] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.002s
I20260709 12:13:05.141284 22223 raft_consensus.cc:2955] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 18 LEADER]: Committing config change with OpId 18.12: config changed from index -1 to 12, NON_VOTER 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } } }
I20260709 12:13:05.093997 21756 leader_election.cc:290] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:13:05.153100 14256 raft_consensus.cc:1275] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
W20260709 12:13:05.153693 14228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:05.170625 14181 raft_consensus.cc:1275] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 12:13:05.174546 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:13:05.181597 14182 raft_consensus.cc:2468] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 18.
I20260709 12:13:05.186239 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
W20260709 12:13:05.166105 22256 log.cc:927] Time spent T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.387s	user 0.004s	sys 0.000s
I20260709 12:13:05.161422 22078 raft_consensus.cc:515] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:05.189561 22040 consensus_queue.cc:1048] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.019s
I20260709 12:13:05.204237 22223 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:60282 (request call id 1) took 4191 ms. Trace:
I20260709 12:13:05.219978 14187 raft_consensus.cc:1275] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 23 index: 12. (index mismatch)
I20260709 12:13:05.206743 22041 raft_consensus.cc:493] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:05.223101 14333 raft_consensus.cc:1240] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 27 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 26. Current term is 27. Ops: []
I20260709 12:13:05.230310 22078 leader_election.cc:290] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 27 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:13:05.228143 22041 raft_consensus.cc:515] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:05.234126 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 27 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:13:05.234898 22041 leader_election.cc:290] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:13:05.239904 14228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:05.241070 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:05.241752 14259 raft_consensus.cc:2468] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 22.
I20260709 12:13:05.245378 14265 raft_consensus.cc:1240] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 18. Current term is 19. Ops: []
I20260709 12:13:05.245898 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:13:05.248642 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:13:05.249338 14911 raft_consensus.cc:2468] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 18.
I20260709 12:13:05.250500 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:05.251891 14229 leader_election.cc:304] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:13:05.253892 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:13:05.255246 14336 raft_consensus.cc:1275] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 12:13:05.255291 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:05.256242 14256 raft_consensus.cc:2468] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 22.
I20260709 12:13:05.251151 14332 raft_consensus.cc:2468] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 22.
I20260709 12:13:05.258889 14336 raft_consensus.cc:1240] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 25 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 24. Current term is 25. Ops: []
I20260709 12:13:05.259145 14332 raft_consensus.cc:1240] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 25 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 24. Current term is 25. Ops: [24.13-24.13]
I20260709 12:13:05.258940 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:13:05.259992 14330 raft_consensus.cc:2393] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 23: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:13:05.215818 22194 raft_consensus.cc:515] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:05.261682 14337 raft_consensus.cc:1240] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 27 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 26. Current term is 27. Ops: []
I20260709 12:13:05.260847 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:05.263264 14336 raft_consensus.cc:2468] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 25.
I20260709 12:13:05.263746 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:05.264719 14257 raft_consensus.cc:1275] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 19 index: 9. Preceding OpId from leader: term: 21 index: 10. (index mismatch)
I20260709 12:13:05.265861 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 28 candidate_status { last_received { term: 26 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
W20260709 12:13:05.268571 22254 log.cc:927] Time spent T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.466s	user 0.003s	sys 0.000s
I20260709 12:13:05.269935 22239 leader_election.cc:290] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:13:05.272346 14877 leader_election.cc:304] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:13:05.273226 22270 raft_consensus.cc:2804] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:05.273622 22270 raft_consensus.cc:493] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:05.273972 22270 raft_consensus.cc:3060] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:05.273862 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:13:05.275312 14911 raft_consensus.cc:2368] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for earlier term 25. Current term is 26.
I20260709 12:13:05.280628 22194 leader_election.cc:290] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 23 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:05.250272 22187 consensus_queue.cc:1048] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.036s
I20260709 12:13:05.286983 14185 raft_consensus.cc:1275] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 12:13:05.260391 21909 raft_consensus.cc:2804] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:13:05.287863 21909 raft_consensus.cc:493] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:05.288233 21909 raft_consensus.cc:3060] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:05.290030 22218 consensus_queue.cc:1048] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260709 12:13:05.291040 14229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:05.291873 22187 consensus_queue.cc:1048] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:13:05.298883 14303 leader_election.cc:400] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 25 election: Vote denied by peer 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341) with higher term. Message: Invalid argument: T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for earlier term 25. Current term is 26.
I20260709 12:13:05.299243 14303 leader_election.cc:403] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 25 election: Cancelling election due to peer responding with higher term
W20260709 12:13:05.299870 14303 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:05.301189 14303 leader_election.cc:400] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 27 election: Vote denied by peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187) with higher term. Message: Invalid argument: T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for earlier term 27. Current term is 28.
I20260709 12:13:05.301975 14330 raft_consensus.cc:2468] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 28.
I20260709 12:13:05.304502 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:13:05.306011 14330 raft_consensus.cc:3060] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:05.302866 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:05.310616 14911 raft_consensus.cc:1275] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:13:05.314239 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:13:05.317442 22239 raft_consensus.cc:3060] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:05.221161 22223 rpcz_store.cc:276] 0709 12:13:01.013285 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:01.176713 (+163428us) service_pool.cc:224] Handling call
0709 12:13:01.255046 (+ 78333us) log.cc:844] Serialized 513 byte log entry
0709 12:13:01.697006 (+441960us) spinlock_profiling.cc:243] Waited 36.1 ms on lock 0x7b54001ea8a0. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f21270b4142 00007f2127094eaa 00007f212709bd53 00007f212709bcd9 00007f212709bc69 00007f212709bc31 00007f212709adfd 0000000000388634 0000000000388479 00007f212404e475
0709 12:13:01.699444 (+  2438us) spinlock_profiling.cc:243] Waited 4.11 ms on lock 0x7b54001ea8a0. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f21270b1aaa 00007f21270b0dd9 00007f21270bb930 00007f21270bb8d8 00007f21270bb858 00007f21270bb813 00007f21270baa9c 00007f212cfa62f6 00007f212cfa0aa8 00007f21270f77cb
0709 12:13:01.805139 (+105695us) spinlock_profiling.cc:243] Waited 40.5 ms on lock 0x7b54001ea8a0. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f21270b4142 00007f2127094eaa 00007f212709bd53 00007f212709bcd9 00007f212709bc69 00007f212709bc31 00007f212709adfd 0000000000388634 0000000000388479 00007f212404e475
0709 12:13:05.204131 (+3398992us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40378,"raft.queue_time_us":151059,"raft.run_cpu_time_us":19842,"raft.run_wall_time_us":640273,"spinlock_wait_cycles":187539328,"thread_start_us":160675,"threads_started":1,"wal-append.queue_time_us":201730,"wal-append.run_cpu_time_us":8403,"wal-append.run_wall_time_us":1255151}
I20260709 12:13:05.249661 22186 consensus_queue.cc:1059] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.078s
I20260709 12:13:05.327732 22194 raft_consensus.cc:3055] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:13:05.328146 22194 raft_consensus.cc:740] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:13:05.329193 22194 consensus_queue.cc:260] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:13:05.331812 14136 auto_rebalancer.cc:629] Failed to schedule move for tablet e1947202e59d4516a1b38a1583a3242d: Illegal state: Replica 17aab1bbf5014936aa18cc21818b26ec is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 25 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } }
I20260709 12:13:05.337885 22186 raft_consensus.cc:493] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:05.338532 22186 raft_consensus.cc:515] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:05.339656 22194 raft_consensus.cc:3060] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:05.343365 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 24 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:05.351238 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:13:05.352334 14348 tablet_copy_source_session.cc:215] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:05.357880 22186 leader_election.cc:290] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:05.303409 14229 leader_election.cc:304] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
W20260709 12:13:05.359284 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 55996.7us
I20260709 12:13:05.362569 14333 raft_consensus.cc:1275] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 12:13:05.358140 14348 rpcz_store.cc:275] Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.0.0.1:55492 (request call id 1629) took 1856 ms. Trace:
W20260709 12:13:05.365983 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 63474.9us
I20260709 12:13:05.366772 14303 leader_election.cc:304] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:13:05.369714 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:05.376395 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 23 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:05.377436 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:13:05.378059 14260 raft_consensus.cc:3060] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:05.380667 14229 leader_election.cc:304] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:13:05.381295 14303 leader_election.cc:304] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:13:05.383278 14330 raft_consensus.cc:2468] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 23.
I20260709 12:13:05.359615 22041 raft_consensus.cc:2804] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 28 FOLLOWER]: Leader election won for term 28
I20260709 12:13:05.388666 14229 leader_election.cc:304] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:13:05.384310 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:13:05.385437 14155 leader_election.cc:304] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:13:05.379350 14081 catalog_manager.cc:5697] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c reported cstate change: term changed from 16 to 18, leader changed from 65c9c1653b3346b39a0e118540e6080c (127.12.174.131) to 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130). New cstate: current_term: 18 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } }
I20260709 12:13:05.400709 14260 raft_consensus.cc:2468] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 26.
I20260709 12:13:05.403169 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:13:05.406155 21690 raft_consensus.cc:2804] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:13:05.406847 21690 raft_consensus.cc:697] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 23 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:13:05.406968 14303 leader_election.cc:304] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:05.407624 22124 consensus_queue.cc:1048] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:13:05.408391 22124 consensus_queue.cc:1243] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer 885067a0d31741bfb5c9935788e315bf log is divergent from this leader: its last log entry 20.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 12:13:05.407977 21690 consensus_queue.cc:237] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:05.409967 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:13:05.374984 14348 rpcz_store.cc:276] 0709 12:13:03.503854 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:03.542220 (+ 38366us) service_pool.cc:224] Handling call
0709 12:13:05.351932 (+1809712us) spinlock_profiling.cc:243] Waited 1.47 s on lock 0x7b540023b254. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f21271453f7 00007f212c0db036 00007f212c0e4a3e 00007f21239a827b 00007f212c0e49ba 00007f212c0dfacc 00007f212c0dac7b 00007f212c0cf8d1 00007f212b1834b4 00007f212b183442
0709 12:13:05.357987 (+  6055us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3376342912}
I20260709 12:13:05.426507 14154 leader_election.cc:304] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:13:05.413962 14303 leader_election.cc:304] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:05.439193 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:13:05.414990 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
W20260709 12:13:05.438258 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 48473.5us
I20260709 12:13:05.392381 21912 raft_consensus.cc:2804] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:13:05.392776 21966 raft_consensus.cc:2804] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 12:13:05.469942 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 67415.6us
I20260709 12:13:05.459386 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
W20260709 12:13:05.470975 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 57134.5us
I20260709 12:13:05.461228 14154 leader_election.cc:304] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:13:05.395330 21712 raft_consensus.cc:2804] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:13:05.463842 14257 raft_consensus.cc:1275] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 12:13:05.478772 14154 leader_election.cc:304] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:13:05.465988 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 27 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:13:05.446286 22227 raft_consensus.cc:2749] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:05.382062 22223 consensus_queue.cc:1048] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.065s
I20260709 12:13:05.395435 22122 raft_consensus.cc:2804] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:13:05.385414 22140 consensus_queue.cc:1048] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.073s
I20260709 12:13:05.381809 22186 consensus_queue.cc:1059] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 26.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.078s
I20260709 12:13:05.447227 22124 raft_consensus.cc:2749] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:05.464232 22239 raft_consensus.cc:2749] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 26 FOLLOWER]: Leader election lost for term 25. Reason: Vote denied by peer 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341) with higher term. Message: Invalid argument: T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for earlier term 25. Current term is 26.
I20260709 12:13:05.550580 14081 catalog_manager.cc:5697] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c reported cstate change: term changed from 22 to 24. New cstate: current_term: 24 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } }
W20260709 12:13:05.550755 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 73726.3us
W20260709 12:13:05.551914 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 73213.4us
I20260709 12:13:05.559788 14154 leader_election.cc:304] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:13:05.476341 22022 raft_consensus.cc:493] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:05.563823 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 76471.7us
I20260709 12:13:05.477608 21966 raft_consensus.cc:493] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:13:05.443015 22040 consensus_queue.cc:1048] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.054s
I20260709 12:13:05.571053 14154 leader_election.cc:304] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:13:05.487052 22195 raft_consensus.cc:2749] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:05.489670 22125 raft_consensus.cc:2749] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:13:05.570174 22189 raft_consensus.cc:2749] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:05.574659 14304 leader_election.cc:400] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 25 election: Vote denied by peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673) with higher term. Message: Invalid argument: T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for earlier term 25. Current term is 26.
I20260709 12:13:05.490366 21955 raft_consensus.cc:2749] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:13:05.490636 21712 raft_consensus.cc:697] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 23 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:13:05.579196 21966 raft_consensus.cc:3060] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:05.628301 14330 raft_consensus.cc:2468] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 26.
I20260709 12:13:05.559479 21912 raft_consensus.cc:697] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 25 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
W20260709 12:13:05.636315 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 189559us
I20260709 12:13:05.574242 22042 raft_consensus.cc:493] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:05.577394 14081 catalog_manager.cc:5697] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c reported cstate change: term changed from 18 to 19, leader changed from 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130) to 65c9c1653b3346b39a0e118540e6080c (127.12.174.131). New cstate: current_term: 19 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } }
W20260709 12:13:05.652917 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 83725.5us
I20260709 12:13:05.574203 22041 raft_consensus.cc:697] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 28 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
W20260709 12:13:05.667153 14228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:05.570173 22022 raft_consensus.cc:515] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:05.565975 21756 consensus_queue.cc:1048] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.077s
I20260709 12:13:05.660991 14303 leader_election.cc:304] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:13:05.574295 22122 raft_consensus.cc:697] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 23 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:13:05.579384 22151 consensus_queue.cc:1059] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.080s
I20260709 12:13:05.654932 22227 raft_consensus.cc:2749] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 12:13:05.716243 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 55353.5us
I20260709 12:13:05.717963 22124 raft_consensus.cc:2764] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Leader pre-election decision vote started in defunct term 22: won
W20260709 12:13:05.722371 22284 log.cc:927] Time spent T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.151s	user 0.000s	sys 0.000s
W20260709 12:13:05.726323 22286 log.cc:927] Time spent T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.164s	user 0.000s	sys 0.000s
I20260709 12:13:05.672678 21909 raft_consensus.cc:515] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:13:05.741906 14083 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60420 (request call id 259) took 25027 ms (client timeout 15000 ms). Trace:
I20260709 12:13:05.687901 22222 raft_consensus.cc:493] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:05.671729 22042 raft_consensus.cc:515] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:05.687891 22038 raft_consensus.cc:493] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:05.676184 22268 raft_consensus.cc:493] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:13:05.670524 22189 raft_consensus.cc:493] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:13:05.743939 21712 consensus_queue.cc:237] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:05.749472 22041 consensus_queue.cc:237] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 26.12, Last appended by leader: 12, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:05.747888 21912 consensus_queue.cc:237] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.17, Last appended by leader: 17, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:05.778342 14081 catalog_manager.cc:5697] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c reported cstate change: term changed from 16 to 19, leader changed from 885067a0d31741bfb5c9935788e315bf (127.12.174.129) to 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130). New cstate: current_term: 19 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } }
W20260709 12:13:05.780372 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 110493us
W20260709 12:13:05.788378 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 65096.3us
I20260709 12:13:05.791210 14081 catalog_manager.cc:5697] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:05.797950 14304 leader_election.cc:304] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:05.795823 14081 catalog_manager.cc:5697] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c reported cstate change: term changed from 18 to 22, leader changed from 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130) to 65c9c1653b3346b39a0e118540e6080c (127.12.174.131). New cstate: current_term: 22 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:05.806090 14303 leader_election.cc:304] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:13:05.785320 22189 raft_consensus.cc:515] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:05.780445 22268 raft_consensus.cc:515] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:05.822355 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:05.812489 14081 catalog_manager.cc:5697] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c reported cstate change: term changed from 17 to 18, leader changed from 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130) to 65c9c1653b3346b39a0e118540e6080c (127.12.174.131). New cstate: current_term: 18 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:05.768834 22222 raft_consensus.cc:515] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:05.778234 22038 raft_consensus.cc:515] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:05.852195 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:13:05.876330 14257 raft_consensus.cc:3060] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:05.853926 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 24 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:05.809309 22294 raft_consensus.cc:493] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:05.814679 21756 raft_consensus.cc:493] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
W20260709 12:13:05.876528 14154 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 305549us
I20260709 12:13:05.881547 14081 catalog_manager.cc:5697] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c reported cstate change: term changed from 11 to 18. New cstate: current_term: 18 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:05.814811 22239 raft_consensus.cc:2749] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 12:13:05.883404 14906 raft_consensus.cc:1275] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 26 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 26 index: 18. (index mismatch)
I20260709 12:13:05.814198 22185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90097151efa7426faeaea3ff87a7ea78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:05.818114 22186 raft_consensus.cc:493] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:13:05.817466 22268 leader_election.cc:290] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:13:05.856097 14229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:05.874151 22291 raft_consensus.cc:493] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
W20260709 12:13:05.902153 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 85728.5us
I20260709 12:13:05.904961 14257 raft_consensus.cc:2468] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 23.
I20260709 12:13:05.809767 22103 consensus_queue.cc:1048] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.078s
I20260709 12:13:05.812479 22005 consensus_queue.cc:1048] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.070s
I20260709 12:13:05.908147 14081 catalog_manager.cc:5697] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "885067a0d31741bfb5c9935788e315bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } }
W20260709 12:13:05.921366 14337 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.510s	user 0.007s	sys 0.005s
I20260709 12:13:05.907341 22186 raft_consensus.cc:515] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:13:05.908968 14332 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.610s	user 0.008s	sys 0.004s
W20260709 12:13:05.922580 14332 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.624s	user 0.009s	sys 0.004s
W20260709 12:13:05.928506 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 114205us
I20260709 12:13:05.891875 22040 raft_consensus.cc:493] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:13:05.907590 21909 leader_election.cc:290] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:13:05.824407 22122 consensus_queue.cc:237] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:05.910071 22297 raft_consensus.cc:493] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:05.895967 22022 leader_election.cc:290] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:05.895179 22291 raft_consensus.cc:515] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:05.935281 14081 catalog_manager.cc:5697] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c reported cstate change: term changed from 16 to 18, leader changed from 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130) to 65c9c1653b3346b39a0e118540e6080c (127.12.174.131). New cstate: current_term: 18 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } }
W20260709 12:13:05.742553 14083 rpcz_store.cc:269] 0709 12:12:40.797191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:40.818478 (+ 21287us) service_pool.cc:224] Handling call
0709 12:12:42.004812 (+1186334us) spinlock_profiling.cc:243] Waited 35.4 ms on lock 0x7b5400030890. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2124016b71 00007f21240170b2 00007f212cf90759 00007f212cf28a76 00007f212cef9d58 00007f212cff804e 00007f212b4b92a4 00007f212b4b9232 00007f212b4b9161 00007f212b4b90dc
0709 12:13:05.667209 (+23662397us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:12:56.602150 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:12:56.711896 (+109746us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:12:56.720001 (+  8105us) write_op.cc:435] Acquired schema lock
0709 12:12:56.784852 (+ 64851us) tablet.cc:662] Decoding operations
0709 12:12:56.853430 (+ 68578us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:12:56.853514 (+    84us) write_op.cc:641] Partition lock acquired for write op
0709 12:12:56.853546 (+    32us) tablet.cc:685] Acquiring locks for 18 operations
0709 12:12:56.854922 (+  1376us) tablet.cc:701] Row locks acquired
0709 12:12:56.854942 (+    20us) write_op.cc:260] PREPARE: finished
0709 12:12:56.855101 (+   159us) write_op.cc:270] Start()
0709 12:12:56.855224 (+   123us) write_op.cc:276] Timestamp: P: 1783599176855051 usec, L: 0
0709 12:12:56.855243 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 12:12:56.855996 (+   753us) log.cc:844] Serialized 7183 byte log entry
0709 12:12:57.613642 (+757646us) spinlock_profiling.cc:243] Waited 8.94 ms on lock 0x7b4400022b4c. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2123f74c85 00007f2123f756a2 00007f2126ce71db 00007f2126ce2aaf 00007f2126cd686e 00007f2126cd5bb6 00007f2126cd57d8 00007f2126cdf221 00007f2126cdf1d9 00007f2126cdf169
0709 12:12:58.001382 (+387740us) op_driver.cc:464] REPLICATION: finished
0709 12:12:58.280879 (+279497us) spinlock_profiling.cc:243] Waited 38.4 ms on lock 0x7b4400022b4c. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2123f74c85 00007f2123f756a2 00007f2126ce71db 00007f2126ce2aaf 00007f21240310ac 00007f212ce8b9a9 00007f212404d69b 00007f212404b93f 00007f212404dc02 00007f212ab71ef0
0709 12:12:58.574189 (+293310us) write_op.cc:301] APPLY: starting
0709 12:12:58.574448 (+   259us) tablet.cc:1367] starting BulkCheckPresence
0709 12:12:58.703545 (+129097us) tablet.cc:1370] finished BulkCheckPresence
0709 12:12:58.703592 (+    47us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:12:58.750025 (+ 46433us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:12:58.750422 (+   397us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=36,key_file_lookups=36,delta_file_lookups=36,mrs_lookups=0
0709 12:12:58.750488 (+    66us) write_op.cc:312] APPLY: finished
0709 12:12:58.751024 (+   536us) log.cc:844] Serialized 164 byte log entry
0709 12:12:58.752284 (+  1260us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:58.752670 (+   386us) write_op.cc:454] Released schema lock
0709 12:12:58.752747 (+    77us) write_op.cc:341] FINISH: Updating metrics
0709 12:12:58.753714 (+   967us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:12:58.753766 (+    52us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":543638,"reported_tablets":50,"spinlock_wait_cycles":81429248,"child_traces":[["op",{"apply.queue_time_us":537239,"apply.run_cpu_time_us":28886,"apply.run_wall_time_us":195045,"cfile_cache_hit":74,"cfile_cache_hit_bytes":79511,"num_ops":18,"prepare.queue_time_us":277785,"prepare.run_cpu_time_us":10659,"prepare.run_wall_time_us":307988,"raft.queue_time_us":255103,"raft.run_cpu_time_us":15363,"raft.run_wall_time_us":480779,"replication_time_us":1142741,"spinlock_wait_cycles":108902400,"thread_start_us":857542,"threads_started":4,"wal-append.queue_time_us":193140,"wal-append.run_cpu_time_us":36713,"wal-append.run_wall_time_us":2674231}]]}
I20260709 12:13:05.888901 21756 raft_consensus.cc:515] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:05.946121 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:13:05.947566 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 28 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:13:05.948580 14081 catalog_manager.cc:5697] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c reported cstate change: term changed from 14 to 22. New cstate: current_term: 22 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:05.920679 22299 raft_consensus.cc:493] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:13:05.933311 22004 raft_consensus.cc:2804] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:13:05.886806 22294 raft_consensus.cc:515] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:05.979980 14260 raft_consensus.cc:2410] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for term 24 because replica has last-logged OpId of term: 23 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 13.
I20260709 12:13:05.953372 14182 raft_consensus.cc:1275] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 21 index: 10. (term mismatch)
I20260709 12:13:05.921414 22125 consensus_queue.cc:1048] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.023s
I20260709 12:13:05.961946 22310 consensus_queue.cc:1048] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.010s
I20260709 12:13:05.949204 22298 raft_consensus.cc:493] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:05.951946 22022 raft_consensus.cc:493] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:13:05.937580 22040 raft_consensus.cc:515] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:05.964318 22300 raft_consensus.cc:493] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:05.993808 22300 raft_consensus.cc:515] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:13:05.982234 22194 consensus_meta.cc:287] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.641s	user 0.013s	sys 0.000s
I20260709 12:13:05.965435 14181 pending_rounds.cc:85] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf: Aborting all ops after (but not including) 12
I20260709 12:13:05.963176 22299 raft_consensus.cc:515] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:05.967638 14081 catalog_manager.cc:5697] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c reported cstate change: term changed from 12 to 20, leader changed from 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130) to 65c9c1653b3346b39a0e118540e6080c (127.12.174.131). New cstate: current_term: 20 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:05.973448 22227 raft_consensus.cc:493] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:13:06.001003 22227 raft_consensus.cc:515] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:06.002585 22299 leader_election.cc:290] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:13:05.987097 22289 log.cc:927] Time spent T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.381s	user 0.003s	sys 0.006s
I20260709 12:13:06.003129 22227 leader_election.cc:290] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:06.003713 22227 raft_consensus.cc:493] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:06.004181 22227 raft_consensus.cc:515] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:05.976186 22107 raft_consensus.cc:3055] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:13:05.948238 22297 raft_consensus.cc:515] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } }
I20260709 12:13:06.006075 22107 raft_consensus.cc:740] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:13:06.007421 14081 catalog_manager.cc:5697] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c reported cstate change: term changed from 19 to 20, leader changed from 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130) to 65c9c1653b3346b39a0e118540e6080c (127.12.174.131). New cstate: current_term: 20 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:05.978626 22042 leader_election.cc:290] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:05.978951 22291 leader_election.cc:290] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:05.980978 14182 pending_rounds.cc:85] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf: Aborting all ops after (but not including) 9
I20260709 12:13:06.009229 14182 pending_rounds.cc:107] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf: Aborting uncommitted NO_OP operation due to leader change: 20.10
I20260709 12:13:06.009527 14182 raft_consensus.cc:2889] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:05.990293 22298 raft_consensus.cc:515] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:06.012212 22042 raft_consensus.cc:493] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:13:06.012754 22042 raft_consensus.cc:515] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:05.991098 22022 raft_consensus.cc:515] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:06.014900 22042 leader_election.cc:290] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:06.015425 22042 raft_consensus.cc:493] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:06.015861 22042 raft_consensus.cc:515] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:06.016492 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:13:06.017167 14903 raft_consensus.cc:2468] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 20.
I20260709 12:13:06.017560 21909 consensus_queue.cc:1048] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 12:13:05.993207 22040 leader_election.cc:290] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:05.995636 14181 pending_rounds.cc:107] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf: Aborting uncommitted NO_OP operation due to leader change: 20.13
I20260709 12:13:05.996464 22302 raft_consensus.cc:493] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:13:06.019281 14181 raft_consensus.cc:2889] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:06.012683 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:13:06.019868 22302 raft_consensus.cc:515] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:06.020673 22294 leader_election.cc:290] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:05.977155 21756 leader_election.cc:290] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:13:06.008267 22297 leader_election.cc:290] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:13:05.988108 22270 consensus_meta.cc:287] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db: Time spent flushing consensus metadata: real 0.714s	user 0.013s	sys 0.000s
I20260709 12:13:06.009477 14081 catalog_manager.cc:5697] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } }
I20260709 12:13:06.022447 14190 raft_consensus.cc:2468] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 26.
I20260709 12:13:06.022926 14188 raft_consensus.cc:3060] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:06.000468 22300 leader_election.cc:290] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:06.009083 22222 leader_election.cc:290] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:13:06.038630 14081 catalog_manager.cc:5697] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c reported cstate change: term changed from 18 to 19, leader changed from 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130) to 65c9c1653b3346b39a0e118540e6080c (127.12.174.131). New cstate: current_term: 19 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:06.023285 22299 raft_consensus.cc:493] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:06.047902 14229 leader_election.cc:304] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:13:06.052662 14081 catalog_manager.cc:5697] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c reported cstate change: term changed from 17 to 18, leader changed from 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) to 65c9c1653b3346b39a0e118540e6080c (127.12.174.131). New cstate: current_term: 18 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:06.055058 14188 raft_consensus.cc:2468] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 20.
I20260709 12:13:06.058476 22315 raft_consensus.cc:2804] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:13:06.059062 22315 raft_consensus.cc:493] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:13:06.059417 22315 raft_consensus.cc:3060] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:06.063841 22038 leader_election.cc:290] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:06.024964 22294 raft_consensus.cc:493] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:13:06.084801 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:13:06.088798 14228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:06.089197 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:13:06.094421 14081 catalog_manager.cc:5697] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c reported cstate change: term changed from 21 to 23, leader changed from 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130) to 65c9c1653b3346b39a0e118540e6080c (127.12.174.131). New cstate: current_term: 23 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:06.099406 14081 catalog_manager.cc:5697] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c reported cstate change: term changed from 19 to 23, leader changed from 65c9c1653b3346b39a0e118540e6080c (127.12.174.131) to 73d01e9b1a9d49358da4985b21d681db (127.12.174.132). New cstate: current_term: 23 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:13:06.101333 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:13:06.101617 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:13:06.102972 14182 raft_consensus.cc:2468] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 18.
I20260709 12:13:06.102839 14081 catalog_manager.cc:5697] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c reported cstate change: term changed from 15 to 16, leader changed from 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) to 65c9c1653b3346b39a0e118540e6080c (127.12.174.131). New cstate: current_term: 16 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:13:06.104588 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 169512us
I20260709 12:13:06.106637 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:13:06.107246 14182 raft_consensus.cc:2468] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 24.
I20260709 12:13:06.102053 14184 raft_consensus.cc:2468] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 26.
I20260709 12:13:06.111654 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:13:06.118737 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:13:06.120656 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:06.123839 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:13:06.173542 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 55930.8us
I20260709 12:13:06.040123 21966 raft_consensus.cc:515] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:06.191787 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:06.184034 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:06.195662 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:06.195833 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:06.196542 14261 raft_consensus.cc:2393] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 27: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:13:06.198207 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:06.192013 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:06.106238 22038 raft_consensus.cc:493] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:06.200024 22038 raft_consensus.cc:515] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:06.201006 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:06.199765 14259 raft_consensus.cc:2410] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for term 23 because replica has last-logged OpId of term: 22 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 13.
I20260709 12:13:06.202158 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:06.202060 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:06.198625 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:06.201954 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:06.204608 14330 raft_consensus.cc:2468] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 27.
I20260709 12:13:06.204739 14263 raft_consensus.cc:2468] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 25.
I20260709 12:13:06.218137 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:06.220112 22218 raft_consensus.cc:493] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:06.189694 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:13:06.174638 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 68917.9us
W20260709 12:13:06.221225 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 45675.4us
I20260709 12:13:06.184486 14257 raft_consensus.cc:1275] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 25 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260709 12:13:06.225193 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:13:06.036810 22270 raft_consensus.cc:515] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:06.231263 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:13:06.173715 22227 leader_election.cc:290] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:13:06.290169 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 61593.3us
I20260709 12:13:06.092253 22299 raft_consensus.cc:515] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:06.116549 21909 raft_consensus.cc:493] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:06.224633 14155 leader_election.cc:304] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:13:06.101563 22294 raft_consensus.cc:515] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:06.202272 22038 leader_election.cc:290] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:06.225162 22042 leader_election.cc:290] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:13:06.282909 22311 log.cc:927] Time spent T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.155s	user 0.000s	sys 0.001s
W20260709 12:13:06.290268 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 61625.6us
W20260709 12:13:06.306452 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 88697.1us
I20260709 12:13:06.308749 14304 leader_election.cc:304] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:06.288901 22302 leader_election.cc:290] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:06.294945 22297 raft_consensus.cc:493] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:13:06.282095 22125 consensus_queue.cc:1048] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.078s
I20260709 12:13:06.325522 14261 raft_consensus.cc:2410] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for term 25 because replica has last-logged OpId of term: 24 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 13.
I20260709 12:13:06.315276 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:06.330456 14155 leader_election.cc:304] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:13:06.337006 14304 leader_election.cc:304] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:06.338492 22018 raft_consensus.cc:2749] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 12:13:06.339207 22168 consensus_queue.cc:1048] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:13:06.341686 22080 raft_consensus.cc:2804] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:13:06.334494 14338 raft_consensus.cc:2468] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 23.
I20260709 12:13:06.309515 22194 raft_consensus.cc:2804] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:06.282086 22218 raft_consensus.cc:515] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:06.365701 21955 raft_consensus.cc:493] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:13:06.366487 21955 raft_consensus.cc:515] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:06.369207 21955 leader_election.cc:290] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:06.351298 22080 raft_consensus.cc:697] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 26 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:13:06.361050 14155 leader_election.cc:304] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:13:06.307539 21909 raft_consensus.cc:515] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:06.360857 22194 raft_consensus.cc:493] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 24 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:13:06.348434 22297 raft_consensus.cc:515] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:13:06.387727 14229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:06.393131 22270 leader_election.cc:290] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 23 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:06.399775 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:06.401482 14264 raft_consensus.cc:1240] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 18. Current term is 19. Ops: []
I20260709 12:13:06.379499 21955 raft_consensus.cc:2749] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:06.391069 22194 raft_consensus.cc:3060] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 24 FOLLOWER]: Advancing to term 25
W20260709 12:13:06.411779 22307 log.cc:927] Time spent T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
W20260709 12:13:06.426376 22321 log.cc:927] Time spent T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:13:06.426769 21966 leader_election.cc:290] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:13:06.427366 22312 log.cc:927] Time spent T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
W20260709 12:13:06.428315 22313 log.cc:927] Time spent T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
I20260709 12:13:06.428969 22294 leader_election.cc:290] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:06.430373 14337 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 1661) took 1126 ms. Trace:
I20260709 12:13:06.431114 22297 leader_election.cc:290] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:13:06.415781 22320 raft_consensus.cc:2804] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:13:06.433975 22320 raft_consensus.cc:493] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 26 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:13:06.434407 22320 raft_consensus.cc:3060] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:06.430768 14337 rpcz_store.cc:276] 0709 12:13:05.304093 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:05.304296 (+   203us) service_pool.cc:224] Handling call
0709 12:13:05.304650 (+   354us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:05.367665 (+ 63015us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:05.367700 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:05.368182 (+   482us) log.cc:844] Serialized 26 byte log entry
0709 12:13:05.922161 (+553979us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:13:05.922216 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:05.926312 (+  4096us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:06.430146 (+503834us) raft_consensus.cc:1685] finished
0709 12:13:06.430169 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:06.430307 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":110119,"raft.queue_time_us":72159,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":8573,"thread_start_us":510876,"threads_started":1,"wal-append.queue_time_us":709629}
I20260709 12:13:06.444550 22315 raft_consensus.cc:515] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:06.443081 22080 consensus_queue.cc:237] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 14, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:13:06.446398 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 89720.5us
I20260709 12:13:06.448889 14155 leader_election.cc:304] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:13:06.446805 22332 raft_consensus.cc:493] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:13:06.459331 22332 raft_consensus.cc:515] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:06.461809 22332 leader_election.cc:290] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:06.462015 14258 raft_consensus.cc:1240] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 20. Current term is 21. Ops: []
I20260709 12:13:06.462442 22332 raft_consensus.cc:2749] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:06.463347 22315 leader_election.cc:290] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 21 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:13:06.464059 21909 leader_election.cc:290] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:06.489758 22184 raft_consensus.cc:3055] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 26 LEADER]: Stepping down as leader of term 26
I20260709 12:13:06.490337 22184 raft_consensus.cc:740] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:13:06.491217 22184 consensus_queue.cc:260] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 26.13, Last appended by leader: 13, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:13:06.506139 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 57448.2us
I20260709 12:13:06.507339 14155 leader_election.cc:304] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:13:06.508961 14155 leader_election.cc:304] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:13:06.510366 22335 raft_consensus.cc:2749] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:06.511209 22335 raft_consensus.cc:2804] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:13:06.511607 22335 raft_consensus.cc:493] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:06.511953 22335 raft_consensus.cc:3060] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Advancing to term 24
W20260709 12:13:06.517280 22306 log.cc:927] Time spent T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.547s	user 0.007s	sys 0.000s
I20260709 12:13:06.519743 14155 leader_election.cc:304] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:13:06.529158 14332 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50858 (request call id 2733) took 1234 ms. Trace:
I20260709 12:13:06.537513 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:06.538345 14338 raft_consensus.cc:1240] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 27 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 26. Current term is 27. Ops: []
I20260709 12:13:06.538028 14332 rpcz_store.cc:276] 0709 12:13:05.294446 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:05.295606 (+  1160us) service_pool.cc:224] Handling call
0709 12:13:05.295923 (+   317us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:05.296297 (+   374us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:05.296331 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:05.298244 (+  1913us) log.cc:844] Serialized 26 byte log entry
0709 12:13:05.926104 (+627860us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:13:05.926155 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:05.926241 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:06.516619 (+590378us) spinlock_profiling.cc:243] Waited 9.93 ms on lock 0x7b4400022b4c. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2123f74c85 00007f2123f756a2 00007f2126ce71db 00007f2126ce2aaf 00007f2126cd686e 00007f2126cd5bb6 00007f2126cd57d8 00007f2126cdf221 00007f2126cdf1d9 00007f2126cdf169
0709 12:13:06.518423 (+  1804us) raft_consensus.cc:1685] finished
0709 12:13:06.518447 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:06.529055 (+ 10608us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1770,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":85,"spinlock_wait_cycles":22846336,"thread_start_us":627424,"threads_started":1,"wal-append.queue_time_us":650036}
I20260709 12:13:06.542169 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:06.527014 22332 consensus_queue.cc:1048] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.017s
I20260709 12:13:06.540846 22340 raft_consensus.cc:2749] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:13:06.553097 14228 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:06.553918 22329 raft_consensus.cc:493] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:13:06.554605 22329 raft_consensus.cc:515] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:06.556835 22329 leader_election.cc:290] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:13:06.566016 22185 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:53194 (request call id 1316) took 4009 ms. Trace:
I20260709 12:13:06.566699 22185 rpcz_store.cc:276] 0709 12:13:02.556680 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:02.557227 (+   547us) service_pool.cc:224] Handling call
0709 12:13:02.973515 (+416288us) ts_tablet_manager.cc:934] T 90097151efa7426faeaea3ff87a7ea78 P 73d01e9b1a9d49358da4985b21d681db: Initiating tablet copy from peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
0709 12:13:05.575559 (+2602044us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:13:06.316854 (+741295us) tablet_metadata.cc:665] Metadata flushed
0709 12:13:06.335062 (+ 18208us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:13:06.564990 (+229928us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:13:06.565415 (+   425us) tablet_replica.cc:206] Creating consensus instance
0709 12:13:06.565821 (+   406us) ts_tablet_manager.cc:989] Replica registered.
0709 12:13:06.565900 (+    79us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":68434,"tablet-copy.queue_time_us":314944,"thread_start_us":403744,"threads_started":2}
I20260709 12:13:06.562850 22299 leader_election.cc:290] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:06.584009 22189 leader_election.cc:290] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:06.573773 22185 tablet_copy_client.cc:806] T 90097151efa7426faeaea3ff87a7ea78 P 73d01e9b1a9d49358da4985b21d681db: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:06.585250 22185 tablet_copy_client.cc:670] T 90097151efa7426faeaea3ff87a7ea78 P 73d01e9b1a9d49358da4985b21d681db: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:06.571486 22320 raft_consensus.cc:515] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:06.562835 22335 raft_consensus.cc:515] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:06.599463 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:06.608110 14258 raft_consensus.cc:1240] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 18. Current term is 19. Ops: []
I20260709 12:13:06.617774 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:13:06.619204 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 22 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:06.629037 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:06.620963 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:06.630537 14263 raft_consensus.cc:2393] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db in current term 21: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:13:06.629065 14264 raft_consensus.cc:3060] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:06.639608 14334 raft_consensus.cc:2393] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 27: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:13:06.644349 14230 leader_election.cc:304] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:06.652580 14264 raft_consensus.cc:2468] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 23.
I20260709 12:13:06.654668 14230 leader_election.cc:304] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:06.658087 14230 leader_election.cc:304] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:13:06.636104 22315 raft_consensus.cc:493] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:13:06.658907 22302 raft_consensus.cc:2749] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:06.659135 22315 raft_consensus.cc:515] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:06.660418 22320 leader_election.cc:290] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 27 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:06.656085 22295 consensus_queue.cc:1059] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 26.17, Next index: 18, Last known committed idx: 16, Time since last communication: 0.005s
I20260709 12:13:06.661865 22294 raft_consensus.cc:2749] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:06.661331 22315 leader_election.cc:290] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:06.662087 22295 raft_consensus.cc:3055] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 26 LEADER]: Stepping down as leader of term 26
I20260709 12:13:06.662562 22295 raft_consensus.cc:740] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:13:06.663540 22295 consensus_queue.cc:260] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 26.17, Last appended by leader: 17, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:06.664961 22295 raft_consensus.cc:3060] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:06.671551 22335 leader_election.cc:290] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 24 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:06.677873 14230 leader_election.cc:304] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:06.683171 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:13:06.658001 14155 leader_election.cc:304] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:13:06.686827 14230 leader_election.cc:304] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:06.684329 14332 raft_consensus.cc:3060] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:06.690073 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:13:06.689553 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:13:06.692251 14337 raft_consensus.cc:3060] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:06.682982 21966 raft_consensus.cc:2749] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:13:06.686041 22294 raft_consensus.cc:2749] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 12:13:06.724673 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 87126.6us
I20260709 12:13:06.730221 14337 raft_consensus.cc:2468] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 24.
I20260709 12:13:06.730958 14334 raft_consensus.cc:2468] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 27.
I20260709 12:13:06.734293 14155 leader_election.cc:304] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:13:06.702795 22335 raft_consensus.cc:3060] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:06.735312 14155 leader_election.cc:304] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:13:06.738165 22320 raft_consensus.cc:2804] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:13:06.740819 22320 raft_consensus.cc:697] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 24 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:13:06.741798 22320 consensus_queue.cc:237] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:06.714706 21712 raft_consensus.cc:493] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:13:06.743863 21712 raft_consensus.cc:515] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:06.746021 21712 leader_election.cc:290] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:06.746867 21754 consensus_queue.cc:1059] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:13:06.713339 22189 raft_consensus.cc:493] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:13:06.747373 22298 leader_election.cc:290] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:06.747833 22189 raft_consensus.cc:515] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:13:06.748636 22343 log.cc:927] Time spent T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
W20260709 12:13:06.749724 22345 log.cc:927] Time spent T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 12:13:06.750150 22189 leader_election.cc:290] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:06.751502 22022 leader_election.cc:290] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:06.753993 22296 raft_consensus.cc:2804] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 27 FOLLOWER]: Leader election won for term 27
I20260709 12:13:06.754578 22296 raft_consensus.cc:697] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 27 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:13:06.755502 22296 consensus_queue.cc:237] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 26.14, Last appended by leader: 14, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:06.760360 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:13:06.760561 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:06.761083 14189 raft_consensus.cc:2468] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 25.
I20260709 12:13:06.761842 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:06.765578 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:06.766561 14336 raft_consensus.cc:2393] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 25: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:13:06.760608 14877 leader_election.cc:304] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:13:06.700066 22194 raft_consensus.cc:515] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:06.767710 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:13:06.769644 14156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:06.780821 22347 raft_consensus.cc:2804] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 23 FOLLOWER]: Leader election won for term 23
W20260709 12:13:06.813319 22314 log.cc:927] Time spent T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.531s	user 0.003s	sys 0.000s
I20260709 12:13:06.817247 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:13:06.819737 22270 raft_consensus.cc:493] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:13:06.824371 22144 raft_consensus.cc:3055] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:13:06.789899 21754 raft_consensus.cc:493] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:13:06.840441 14332 raft_consensus.cc:2468] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 23.
W20260709 12:13:06.841579 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 70408.6us
I20260709 12:13:06.842772 14903 raft_consensus.cc:2368] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 21. Current term is 22.
W20260709 12:13:06.845329 22324 log.cc:927] Time spent T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.429s	user 0.004s	sys 0.000s
I20260709 12:13:06.865931 14154 leader_election.cc:400] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 21 pre-election: Vote denied by peer 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341) with higher term. Message: Invalid argument: T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 21. Current term is 22.
W20260709 12:13:06.855686 22342 log.cc:927] Time spent T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 12:13:06.841255 22005 raft_consensus.cc:493] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:06.870388 22005 raft_consensus.cc:515] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:06.866407 14154 leader_election.cc:403] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 21 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:13:06.845120 22326 log.cc:927] Time spent T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.453s	user 0.005s	sys 0.000s
I20260709 12:13:06.866887 14876 leader_election.cc:304] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:13:06.785965 22107 consensus_queue.cc:260] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } }
W20260709 12:13:06.863561 22307 log.cc:927] Time spent T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 12:13:06.843645 22144 raft_consensus.cc:740] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:13:06.856870 21754 raft_consensus.cc:515] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:06.854853 22270 raft_consensus.cc:515] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:13:06.857450 22330 log.cc:927] Time spent T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.460s	user 0.006s	sys 0.002s
I20260709 12:13:06.872663 22005 leader_election.cc:290] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:13:06.846410 22347 raft_consensus.cc:697] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 23 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
W20260709 12:13:06.886197 14156 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:06.904210 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:13:06.916952 22144 consensus_queue.cc:260] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:06.904166 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:13:06.918771 14183 raft_consensus.cc:2468] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 21.
I20260709 12:13:06.919169 22218 leader_election.cc:290] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:06.903733 14910 raft_consensus.cc:1275] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 12:13:06.920368 22186 leader_election.cc:290] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:06.898590 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:13:06.898887 22293 raft_consensus.cc:2749] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:13:06.899717 14155 leader_election.cc:304] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
W20260709 12:13:06.924896 22316 log.cc:927] Time spent T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.510s	user 0.000s	sys 0.002s
I20260709 12:13:06.904598 22122 raft_consensus.cc:493] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:13:06.926016 22186 raft_consensus.cc:2749] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:06.926581 14155 leader_election.cc:304] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:13:06.881500 22217 raft_consensus.cc:2804] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:13:06.926915 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:06.928587 22004 raft_consensus.cc:493] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:13:06.929090 22004 raft_consensus.cc:3060] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:06.926160 22122 raft_consensus.cc:515] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:06.936806 22122 leader_election.cc:290] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:06.870409 22184 raft_consensus.cc:3060] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:06.940966 22186 raft_consensus.cc:2749] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:06.901793 14181 raft_consensus.cc:1240] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 24 LEADER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 23. Current term is 24. Ops: []
I20260709 12:13:06.941924 14155 leader_election.cc:304] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:13:06.903558 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:13:06.922384 22270 leader_election.cc:290] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:13:06.902158 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:13:06.943318 22122 raft_consensus.cc:493] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:13:06.877995 22296 raft_consensus.cc:3060] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Advancing to term 22
I20260709 12:13:06.944980 14186 raft_consensus.cc:1275] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 25 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 25 index: 18. (index mismatch)
I20260709 12:13:06.943861 22122 raft_consensus.cc:515] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:06.946528 22194 leader_election.cc:290] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 25 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:06.920372 21754 leader_election.cc:290] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:06.904716 22315 raft_consensus.cc:493] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:13:06.947754 22315 raft_consensus.cc:515] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:06.902988 21909 raft_consensus.cc:493] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:13:06.875949 22216 raft_consensus.cc:493] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:13:06.950301 21909 raft_consensus.cc:515] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:06.950556 22216 raft_consensus.cc:515] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:06.927367 22217 raft_consensus.cc:493] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:06.951967 22217 raft_consensus.cc:3060] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:06.952369 22004 raft_consensus.cc:515] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:06.952818 22216 leader_election.cc:290] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:06.906839 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:13:06.904896 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 27 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:13:06.897843 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 211100us
I20260709 12:13:06.957432 22293 raft_consensus.cc:493] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:13:06.957723 22042 raft_consensus.cc:493] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:13:06.958031 22041 raft_consensus.cc:493] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:13:06.958578 22042 raft_consensus.cc:515] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:06.949990 22315 leader_election.cc:290] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:06.958956 22041 raft_consensus.cc:515] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:06.959637 22315 raft_consensus.cc:493] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:13:06.918812 22144 raft_consensus.cc:3060] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:06.960870 22042 leader_election.cc:290] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:06.961103 22041 leader_election.cc:290] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:06.958067 22293 raft_consensus.cc:515] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:06.964035 22293 leader_election.cc:290] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:06.958329 22302 raft_consensus.cc:493] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:13:06.965349 22302 raft_consensus.cc:515] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:06.966524 21909 leader_election.cc:290] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:13:06.966919 14303 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:06.967448 22302 leader_election.cc:290] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:06.958869 14187 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56046 (request call id 3318) took 1017 ms. Trace:
I20260709 12:13:06.968958 14187 rpcz_store.cc:276] 0709 12:13:05.941529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:05.941664 (+   135us) service_pool.cc:224] Handling call
0709 12:13:05.942042 (+   378us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:05.942507 (+   465us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:05.942539 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:05.943093 (+   554us) log.cc:844] Serialized 26 byte log entry
0709 12:13:06.291059 (+347966us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:13:06.301837 (+ 10778us) log.cc:844] Serialized 14 byte log entry
0709 12:13:06.303557 (+  1720us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:06.303650 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:06.369564 (+ 65914us) spinlock_profiling.cc:243] Waited 6.62 ms on lock 0x7b18003bf080. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f212cf16ab1 00007f212cf23281 00007f212404e3f3 00007f21240507c1 00007f2124050779 00007f2124050709 00007f21240506d1 00007f212404f9cd 0000000000388634 0000000000388479 00007f212403183a
0709 12:13:06.924282 (+554718us) spinlock_profiling.cc:243] Waited 2.78 ms on lock 0x7b4400022b4c. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2123f74c85 00007f2123f756a2 00007f2126ce71db 00007f2126ce2aaf 00007f2126cd686e 00007f2126cd5bb6 00007f2126cd57d8 00007f2126cdf221 00007f2126cdf1d9 00007f2126cdf169
0709 12:13:06.958620 (+ 34338us) raft_consensus.cc:1685] finished
0709 12:13:06.958645 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:06.958802 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12501,"prepare.queue_time_us":25081,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":38,"raft.queue_time_us":4385,"raft.run_cpu_time_us":301,"raft.run_wall_time_us":14735,"spinlock_wait_cycles":21627648,"thread_start_us":287962,"threads_started":1,"wal-append.queue_time_us":435119}
W20260709 12:13:06.971313 22305 log.cc:927] Time spent T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.669s	user 0.000s	sys 0.002s
I20260709 12:13:06.948002 22122 leader_election.cc:290] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:06.976411 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 26 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:13:06.977458 14188 raft_consensus.cc:2410] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for term 26 because replica has last-logged OpId of term: 24 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 12.
I20260709 12:13:06.978428 22022 raft_consensus.cc:2749] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:13:06.982658 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:13:06.983480 14332 raft_consensus.cc:2393] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 25: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:13:06.984493 22004 leader_election.cc:290] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:13:06.986901 22328 log.cc:927] Time spent T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.579s	user 0.006s	sys 0.007s
I20260709 12:13:06.960144 22315 raft_consensus.cc:515] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:06.901724 14229 leader_election.cc:304] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:13:07.006259 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:13:07.017516 14187 raft_consensus.cc:2368] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db for earlier term 19. Current term is 20.
W20260709 12:13:07.018544 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 116885us
I20260709 12:13:07.019466 14229 leader_election.cc:304] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:13:06.909192 22335 raft_consensus.cc:2749] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 27 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:13:07.022219 14229 leader_election.cc:304] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:13:07.022934 22296 raft_consensus.cc:2749] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Leader pre-election lost for term 21. Reason: Vote denied by peer 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341) with higher term. Message: Invalid argument: T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 21. Current term is 22.
I20260709 12:13:07.023798 22293 raft_consensus.cc:2804] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:13:07.040896 14229 leader_election.cc:304] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:13:07.028415 22302 raft_consensus.cc:2804] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:13:07.045215 14876 leader_election.cc:400] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 19 pre-election: Vote denied by peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187) with higher term. Message: Invalid argument: T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db for earlier term 19. Current term is 20.
I20260709 12:13:07.047194 14229 leader_election.cc:304] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:13:07.047549 14876 leader_election.cc:403] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 19 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:13:07.052151 22042 raft_consensus.cc:2804] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:13:07.052625 22042 raft_consensus.cc:493] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:07.052616 14229 leader_election.cc:304] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:13:07.056782 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:07.057536 14258 raft_consensus.cc:2468] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 21.
I20260709 12:13:07.042647 21966 raft_consensus.cc:2804] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:13:07.060529 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:07.046065 22293 raft_consensus.cc:493] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:07.050580 21909 raft_consensus.cc:2804] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:13:07.048816 22302 raft_consensus.cc:493] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:07.050021 22216 raft_consensus.cc:3060] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Advancing to term 20
I20260709 12:13:07.066255 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:07.068177 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 22 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:07.054531 22042 raft_consensus.cc:3060] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:07.074206 14261 raft_consensus.cc:1275] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 12:13:07.059621 21953 raft_consensus.cc:2804] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:07.055114 22347 consensus_queue.cc:237] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:07.071808 22302 raft_consensus.cc:3060] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:07.075186 21909 raft_consensus.cc:697] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 20 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:13:07.083158 21909 consensus_queue.cc:237] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:07.060858 21966 raft_consensus.cc:493] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 26 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:13:07.092192 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:13:07.066644 22293 raft_consensus.cc:3060] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:07.104677 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:13:07.060400 22294 consensus_queue.cc:1059] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.026s
I20260709 12:13:07.110555 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:07.111272 14256 raft_consensus.cc:2468] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 20.
I20260709 12:13:07.112730 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:07.118449 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:13:07.119730 22216 raft_consensus.cc:2749] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: Vote denied by peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187) with higher term. Message: Invalid argument: T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db for earlier term 19. Current term is 20.
I20260709 12:13:07.123769 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:13:07.065163 22004 consensus_queue.cc:1048] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.037s
I20260709 12:13:07.127890 22315 leader_election.cc:290] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:13:07.128798 22294 consensus_queue.cc:1243] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer 885067a0d31741bfb5c9935788e315bf log is divergent from this leader: its last log entry 24.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 12:13:07.074178 22217 raft_consensus.cc:515] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:07.129383 22294 raft_consensus.cc:3055] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:13:07.129766 22294 raft_consensus.cc:740] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:13:07.130645 22294 consensus_queue.cc:260] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.13, Last appended by leader: 13, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:07.131846 22294 raft_consensus.cc:3060] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:07.128973 14184 raft_consensus.cc:2468] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 27.
I20260709 12:13:07.137356 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:13:07.138139 14187 raft_consensus.cc:2468] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 18.
I20260709 12:13:07.087373 21953 raft_consensus.cc:493] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:07.098402 21966 raft_consensus.cc:3060] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:07.142257 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:13:07.136381 22355 log.cc:927] Time spent T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.216s	user 0.000s	sys 0.005s
I20260709 12:13:07.143992 14905 raft_consensus.cc:1240] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 26 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 25. Current term is 26. Ops: []
I20260709 12:13:07.151578 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:13:07.152361 14188 raft_consensus.cc:2468] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 21.
I20260709 12:13:07.152740 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:13:07.156909 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:13:07.159123 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:13:07.159776 14188 raft_consensus.cc:2468] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 21.
I20260709 12:13:07.159809 22217 leader_election.cc:290] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 26 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:07.161088 14183 raft_consensus.cc:1275] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 12:13:07.161621 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:13:07.140620 21953 raft_consensus.cc:3060] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:07.162462 14188 raft_consensus.cc:3060] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:07.161695 14155 leader_election.cc:304] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:13:07.163993 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:13:07.165241 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:13:07.174295 14155 leader_election.cc:304] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:13:07.177302 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:07.177850 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:07.178117 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 28 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:07.180209 14336 raft_consensus.cc:2468] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 27.
I20260709 12:13:07.178970 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:07.181408 14188 raft_consensus.cc:2468] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 26.
W20260709 12:13:07.171620 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 140695us
I20260709 12:13:07.192348 14155 leader_election.cc:304] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:13:07.192366 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:07.181864 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:07.182711 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:07.197201 14876 leader_election.cc:304] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:13:07.199491 14332 raft_consensus.cc:1275] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 26 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 26 index: 18. (index mismatch)
I20260709 12:13:07.201609 14336 raft_consensus.cc:2468] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 25.
I20260709 12:13:07.202149 14155 leader_election.cc:304] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:13:07.173885 22296 raft_consensus.cc:2804] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:07.210450 14155 leader_election.cc:304] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:13:07.214125 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:07.211340 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:07.219739 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:07.221458 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:07.221853 14335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50858 (request call id 2737) took 1038 ms. Trace:
I20260709 12:13:07.198076 22323 raft_consensus.cc:2749] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:07.221967 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:07.191623 22360 raft_consensus.cc:493] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:13:07.227041 14335 rpcz_store.cc:276] 0709 12:13:06.183516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:06.183676 (+   160us) service_pool.cc:224] Handling call
0709 12:13:06.871856 (+688180us) spinlock_profiling.cc:243] Waited 8.21 ms on lock 0x7b540001a5a8. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f212c064aa1 00007f212c0dfebc 00007f212c11508c 00007f212c0ff93b 00007f212c0ff3d2 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c
0709 12:13:06.871979 (+   123us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:06.872197 (+   218us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 12:13:06.872509 (+   312us) log.cc:844] Serialized 14 byte log entry
0709 12:13:07.221469 (+348960us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:07.221532 (+    63us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:13:07.221582 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:07.221649 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:07.221787 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1995,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":26829,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":94,"spinlock_wait_cycles":18925952,"thread_start_us":348351,"threads_started":2,"wal-append.queue_time_us":236050}
I20260709 12:13:07.174460 22042 raft_consensus.cc:515] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:07.216935 22139 raft_consensus.cc:2804] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:13:07.217725 22335 raft_consensus.cc:2749] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:07.216678 22296 raft_consensus.cc:493] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:13:07.215648 22227 raft_consensus.cc:2804] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:13:07.235271 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:13:07.245432 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:13:07.247299 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:13:07.251207 14877 leader_election.cc:304] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:13:07.221092 22122 consensus_queue.cc:1048] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.037s
I20260709 12:13:07.260535 22042 leader_election.cc:290] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 28 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:07.213071 22186 consensus_queue.cc:1048] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.026s
I20260709 12:13:07.268839 14261 raft_consensus.cc:2368] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 27. Current term is 28.
I20260709 12:13:07.272327 22216 raft_consensus.cc:3060] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:07.249624 22296 raft_consensus.cc:3060] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:07.249297 22139 raft_consensus.cc:697] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 26 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:13:07.280100 22185 tablet_copy_client.cc:538] T 90097151efa7426faeaea3ff87a7ea78 P 73d01e9b1a9d49358da4985b21d681db: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:07.280607 22139 consensus_queue.cc:237] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.17, Last appended by leader: 17, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:07.249794 22227 raft_consensus.cc:493] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:13:07.282217 22227 raft_consensus.cc:3060] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:07.283192 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:07.236825 22184 raft_consensus.cc:2749] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:07.286322 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:07.237953 22360 raft_consensus.cc:515] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:07.288259 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:07.288964 14259 raft_consensus.cc:2468] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 27.
I20260709 12:13:07.289095 22360 leader_election.cc:290] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:13:07.289105 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:07.290612 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:07.290091 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:07.294646 14336 raft_consensus.cc:1275] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
I20260709 12:13:07.300649 14183 raft_consensus.cc:1275] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 12:13:07.322667 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:07.326043 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 27 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:07.326937 14335 raft_consensus.cc:2393] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 27: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:13:07.332424 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8bff37f52742a3a3b8a39c45ade183" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:13:07.341120 14903 raft_consensus.cc:2468] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 19.
I20260709 12:13:07.342454 22194 consensus_queue.cc:1048] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:13:07.345422 14877 leader_election.cc:304] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:13:07.261659 22302 raft_consensus.cc:515] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:07.326494 22354 raft_consensus.cc:493] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:07.354355 21841 raft_consensus.cc:2804] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:13:07.352646 22194 raft_consensus.cc:493] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:07.361814 21883 raft_consensus.cc:493] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:13:07.379789 14256 raft_consensus.cc:2368] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 25. Current term is 26.
I20260709 12:13:07.387257 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:07.365500 22366 raft_consensus.cc:493] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:13:07.415439 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:13:07.388197 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 173760us
I20260709 12:13:07.422221 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:13:07.428433 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:13:07.429819 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:07.378199 22365 raft_consensus.cc:493] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:07.435719 14185 raft_consensus.cc:1275] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 28 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 26 index: 12. Preceding OpId from leader: term: 28 index: 13. (index mismatch)
I20260709 12:13:07.376629 21841 raft_consensus.cc:493] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 27 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:13:07.376694 22124 consensus_queue.cc:1059] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.055s
I20260709 12:13:07.438889 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:07.440164 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 28 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:13:07.442420 21841 raft_consensus.cc:3060] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:07.443341 22124 raft_consensus.cc:3055] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 25 LEADER]: Stepping down as leader of term 25
I20260709 12:13:07.443840 22124 raft_consensus.cc:740] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:13:07.444732 22124 consensus_queue.cc:260] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 25.18, Last appended by leader: 18, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:07.446038 22124 raft_consensus.cc:3060] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:07.386968 21883 raft_consensus.cc:515] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:07.448473 21883 leader_election.cc:290] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:13:07.449355 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:13:07.367350 22354 raft_consensus.cc:515] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:13:07.442126 22367 log.cc:927] Time spent T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.172s	user 0.001s	sys 0.000s
I20260709 12:13:07.457566 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:07.387756 22194 raft_consensus.cc:515] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:13:07.460935 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 159199us
I20260709 12:13:07.468250 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:07.413714 21966 raft_consensus.cc:515] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:07.473320 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:07.479238 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:07.420287 22366 raft_consensus.cc:515] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:07.486683 22366 leader_election.cc:290] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:13:07.487591 22184 raft_consensus.cc:493] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:13:07.488273 22184 raft_consensus.cc:515] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:07.488636 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:13:07.489218 22302 leader_election.cc:290] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 26 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:13:07.491571 22373 log.cc:927] Time spent T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.053s	user 0.002s	sys 0.000s
I20260709 12:13:07.492684 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:13:07.493371 14339 raft_consensus.cc:3060] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:07.494117 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:07.498390 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 28 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:13:07.498965 14230 leader_election.cc:304] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:07.502511 14262 raft_consensus.cc:3060] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:07.514215 14257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41764 (request call id 3997) took 1119 ms. Trace:
I20260709 12:13:07.514726 14257 rpcz_store.cc:276] 0709 12:13:06.394604 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:06.397426 (+  2822us) service_pool.cc:224] Handling call
0709 12:13:06.832801 (+435375us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:06.833048 (+   247us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 12:13:07.058979 (+225931us) log.cc:844] Serialized 14 byte log entry
0709 12:13:07.168163 (+109184us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:07.168240 (+    77us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:13:07.168291 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:07.168362 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:07.514044 (+345682us) spinlock_profiling.cc:243] Waited 435 ms on lock 0x7b54001b2bd0. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713a8ad 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:13:07.514146 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16185,"prepare.queue_time_us":308156,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":695,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":2196,"spinlock_wait_cycles":1000560384,"thread_start_us":333184,"threads_started":2,"wal-append.queue_time_us":149513}
W20260709 12:13:07.514896 14304 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:07.518712 22194 leader_election.cc:290] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:07.520570 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 26 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:07.499079 14336 raft_consensus.cc:3060] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:07.531993 14339 raft_consensus.cc:2468] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 26.
I20260709 12:13:07.536386 14263 raft_consensus.cc:2393] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 26: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:13:07.472009 22216 raft_consensus.cc:2749] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:07.538522 14257 raft_consensus.cc:1275] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 26 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 26 index: 15. (index mismatch)
I20260709 12:13:07.537177 14304 leader_election.cc:304] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:13:07.574685 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:07.450960 22293 raft_consensus.cc:515] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } }
W20260709 12:13:07.576881 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 229118us
I20260709 12:13:07.439023 22365 raft_consensus.cc:515] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:07.571177 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:07.583590 14877 leader_election.cc:304] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:13:07.569314 14262 raft_consensus.cc:1275] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 23 index: 12. (index mismatch)
I20260709 12:13:07.597505 14336 raft_consensus.cc:2468] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 28.
W20260709 12:13:07.620337 14303 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:07.621001 14303 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:07.587818 22151 raft_consensus.cc:2749] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:07.642223 14335 raft_consensus.cc:1275] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 28 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 26 index: 12. Preceding OpId from leader: term: 28 index: 13. (index mismatch)
I20260709 12:13:07.590919 22216 raft_consensus.cc:2749] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:13:07.660406 14337 raft_consensus.cc:1240] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 23. Current term is 24. Ops: []
I20260709 12:13:07.662417 22293 leader_election.cc:290] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:07.669047 22227 raft_consensus.cc:515] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:07.671003 22365 leader_election.cc:290] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:13:07.625886 22364 consensus_queue.cc:1059] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 20.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.062s
I20260709 12:13:07.671531 22227 leader_election.cc:290] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 21 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:07.672283 22365 raft_consensus.cc:3055] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:13:07.672569 22365 raft_consensus.cc:740] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:13:07.673235 22365 consensus_queue.cc:260] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:07.674525 22365 raft_consensus.cc:3060] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:13:07.674867 22362 log.cc:927] Time spent T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
W20260709 12:13:07.682035 22377 log.cc:927] Time spent T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
W20260709 12:13:07.686094 21953 consensus_meta.cc:287] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.514s	user 0.008s	sys 0.004s
I20260709 12:13:07.686604 21953 raft_consensus.cc:515] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:07.689122 22185 tablet_bootstrap.cc:492] T 90097151efa7426faeaea3ff87a7ea78 P 73d01e9b1a9d49358da4985b21d681db: Bootstrap starting.
I20260709 12:13:07.696753 14264 raft_consensus.cc:1240] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 21. Current term is 22. Ops: []
I20260709 12:13:07.684947 21841 raft_consensus.cc:515] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 28 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:07.710502 21966 leader_election.cc:290] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 27 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:07.652397 22184 leader_election.cc:290] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:13:07.713178 22296 raft_consensus.cc:515] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:07.654917 22329 raft_consensus.cc:493] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:07.714905 22294 consensus_meta.cc:287] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.583s	user 0.014s	sys 0.000s
I20260709 12:13:07.726871 22107 raft_consensus.cc:3060] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:07.728719 22296 leader_election.cc:290] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 22 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:07.730895 21953 leader_election.cc:290] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:07.692094 22354 leader_election.cc:290] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:13:07.725898 22329 raft_consensus.cc:515] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:07.738619 14903 raft_consensus.cc:1240] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 28 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 27. Current term is 28. Ops: []
I20260709 12:13:07.739867 22329 leader_election.cc:290] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:13:07.746300 21841 leader_election.cc:290] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 28 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:07.785638 14189 raft_consensus.cc:1240] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 21. Current term is 22. Ops: []
I20260709 12:13:07.797117 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 29 candidate_status { last_received { term: 26 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:13:07.798542 14183 raft_consensus.cc:2468] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 28.
I20260709 12:13:07.810590 14330 raft_consensus.cc:2468] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 19.
I20260709 12:13:07.814738 22040 raft_consensus.cc:493] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:13:07.823369 14265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41764 (request call id 3996) took 1429 ms. Trace:
I20260709 12:13:07.816092 22040 raft_consensus.cc:515] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:07.859297 22004 consensus_queue.cc:1059] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 27.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.007s
I20260709 12:13:07.878190 14303 leader_election.cc:304] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:07.894553 22004 raft_consensus.cc:2749] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 12:13:07.895247 22352 log.cc:927] Time spent T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.972s	user 0.000s	sys 0.007s
I20260709 12:13:07.897953 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:13:07.898891 14187 raft_consensus.cc:2468] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 22.
I20260709 12:13:07.904290 22040 leader_election.cc:290] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:13:07.912461 22366 raft_consensus.cc:493] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:07.916085 22366 raft_consensus.cc:515] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:07.920208 22366 leader_election.cc:290] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:13:07.904374 22361 log.cc:927] Time spent T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.490s	user 0.002s	sys 0.000s
W20260709 12:13:07.926486 22370 log.cc:927] Time spent T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.485s	user 0.001s	sys 0.001s
I20260709 12:13:07.927439 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:13:07.927306 22309 raft_consensus.cc:3055] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 27 LEADER]: Stepping down as leader of term 27
I20260709 12:13:07.931185 22309 raft_consensus.cc:740] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 27 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:13:07.932888 22309 consensus_queue.cc:260] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 27.17, Last appended by leader: 17, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:07.934880 22309 raft_consensus.cc:3060] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 27 FOLLOWER]: Advancing to term 28
W20260709 12:13:07.899941 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 282750us
I20260709 12:13:07.994246 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:07.999861 21953 raft_consensus.cc:493] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:13:08.000317 21966 raft_consensus.cc:493] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:13:08.000864 21953 raft_consensus.cc:515] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:08.002564 22293 raft_consensus.cc:2749] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:08.001160 21966 raft_consensus.cc:515] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:07.824026 14265 rpcz_store.cc:276] 0709 12:13:06.394235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:06.396943 (+  2708us) service_pool.cc:224] Handling call
0709 12:13:06.594686 (+197743us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:06.594937 (+   251us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 12:13:06.595262 (+   325us) log.cc:844] Serialized 14 byte log entry
0709 12:13:06.691116 (+ 95854us) log.cc:844] Serialized 14 byte log entry
0709 12:13:06.894862 (+203746us) spinlock_profiling.cc:243] Waited 7.72 ms on lock 0x7b180026f440. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f212cf16ab1 00007f212cf23281 00007f2123fc8c0a 00007f212d708219 00007f2124050a40 00007f212404b4e4 00007f212404b455 00007f2127133060 00007f2127145716 00007f2127156287 00007f2127156208
0709 12:13:06.895296 (+   434us) log.cc:844] Serialized 14 byte log entry
0709 12:13:07.092406 (+197110us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:07.092482 (+    76us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:13:07.092548 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:07.092629 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:07.383141 (+290512us) spinlock_profiling.cc:243] Waited 2.46 ms on lock 0x7b180026f440. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f212cf16ab1 00007f212cf23281 00007f212404e522 00007f21240507c1 00007f2124050779 00007f2124050709 00007f21240506d1 00007f212404f9cd 0000000000388634 0000000000388479 00007f212403183a
0709 12:13:07.822803 (+439662us) spinlock_profiling.cc:243] Waited 197 ms on lock 0x7b54002fc950. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713a8ad 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:13:07.823032 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":182629,"prepare.queue_time_us":493784,"prepare.run_cpu_time_us":163,"prepare.run_wall_time_us":7001,"raft.queue_time_us":211331,"raft.run_cpu_time_us":312,"raft.run_wall_time_us":7339,"spinlock_wait_cycles":477263872,"thread_start_us":292009,"threads_started":2,"wal-append.queue_time_us":129178,"wal-append.run_cpu_time_us":2387,"wal-append.run_wall_time_us":1166983}
I20260709 12:13:08.029600 14330 raft_consensus.cc:1240] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 18. Current term is 19. Ops: []
I20260709 12:13:08.021636 14876 leader_election.cc:304] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:13:08.051568 14264 raft_consensus.cc:1275] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 24 index: 13. (term mismatch)
I20260709 12:13:08.052915 14264 pending_rounds.cc:85] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec: Aborting all ops after (but not including) 12
W20260709 12:13:08.052168 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 116587us
I20260709 12:13:08.053217 21966 leader_election.cc:290] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:08.054827 14229 leader_election.cc:304] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:13:08.060377 14333 raft_consensus.cc:1240] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 28 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 27. Current term is 28. Ops: []
W20260709 12:13:08.065975 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 560261us
I20260709 12:13:08.067780 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:13:08.041283 21953 leader_election.cc:290] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:08.053247 14264 pending_rounds.cc:107] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec: Aborting uncommitted NO_OP operation due to leader change: 23.13
I20260709 12:13:08.057964 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 27 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:13:08.074215 14264 raft_consensus.cc:2889] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:08.086933 22151 raft_consensus.cc:493] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:08.087949 22151 raft_consensus.cc:515] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:08.071367 22397 raft_consensus.cc:2804] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:13:08.098665 22397 raft_consensus.cc:493] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:13:08.099152 22397 raft_consensus.cc:3060] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:08.092783 22139 raft_consensus.cc:2804] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:08.093115 14259 raft_consensus.cc:1240] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 28 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 27. Current term is 28. Ops: []
I20260709 12:13:08.101958 22139 raft_consensus.cc:493] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:13:08.093540 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:08.102419 22139 raft_consensus.cc:3060] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:13:08.104562 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 46920.3us
I20260709 12:13:08.105767 14229 leader_election.cc:304] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:13:08.107928 14229 leader_election.cc:304] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:13:08.108968 22297 raft_consensus.cc:2804] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:08.109402 22297 raft_consensus.cc:493] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:13:08.081158 22004 consensus_queue.cc:1048] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.014s
I20260709 12:13:08.093835 22151 leader_election.cc:290] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:13:08.094379 14230 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.174.131:45957 timed out after 1.575s (SENT) [suppressed 2 similar messages]
I20260709 12:13:08.110160 22400 raft_consensus.cc:2804] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:08.112771 22315 consensus_queue.cc:1048] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.003s
I20260709 12:13:08.114851 22400 raft_consensus.cc:493] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:13:08.115373 22400 raft_consensus.cc:3060] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:08.112950 22297 raft_consensus.cc:3060] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:08.125864 14304 leader_election.cc:304] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:08.127054 22151 raft_consensus.cc:2749] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 12:13:08.127470 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 48531.4us
I20260709 12:13:08.129026 14304 leader_election.cc:304] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:13:08.134001 22366 raft_consensus.cc:2749] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 12:13:08.134491 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 113232us
I20260709 12:13:08.139137 14335 raft_consensus.cc:1275] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 26 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 25 index: 18. Preceding OpId from leader: term: 26 index: 18. (term mismatch)
I20260709 12:13:08.139660 14335 pending_rounds.cc:85] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c: Aborting all ops after (but not including) 17
I20260709 12:13:08.139979 14335 pending_rounds.cc:107] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c: Aborting uncommitted NO_OP operation due to leader change: 25.18
I20260709 12:13:08.140259 14335 raft_consensus.cc:2889] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 26 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:08.129756 22151 consensus_queue.cc:1048] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.016s
I20260709 12:13:08.145819 22151 consensus_queue.cc:1243] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer 17aab1bbf5014936aa18cc21818b26ec log is divergent from this leader: its last log entry 23.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
W20260709 12:13:08.154330 14230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:08.155874 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:08.157999 22151 raft_consensus.cc:493] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:08.163231 14877 leader_election.cc:304] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 28 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:13:08.165649 21841 raft_consensus.cc:2749] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 28 FOLLOWER]: Leader election lost for term 28. Reason: could not achieve majority
I20260709 12:13:08.166014 22217 consensus_queue.cc:1059] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 18.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:13:08.167188 22217 raft_consensus.cc:3055] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:13:08.167634 22217 raft_consensus.cc:740] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:13:08.151506 21953 raft_consensus.cc:493] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:08.176848 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:13:08.158787 22151 raft_consensus.cc:515] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:08.186566 22186 raft_consensus.cc:493] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:13:08.193476 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:13:08.181078 21953 raft_consensus.cc:515] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:08.202071 22356 consensus_queue.cc:1048] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.025s
I20260709 12:13:08.201012 22186 raft_consensus.cc:515] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } }
I20260709 12:13:08.206806 22186 leader_election.cc:290] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:08.207221 22217 consensus_queue.cc:260] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 18.16, Last appended by leader: 16, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:08.208751 22217 raft_consensus.cc:3060] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:13:08.211764 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 80783us
I20260709 12:13:08.243135 14189 raft_consensus.cc:1275] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 26 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 26 index: 18. (index mismatch)
I20260709 12:13:08.239902 14155 leader_election.cc:400] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 27 election: Vote denied by peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673) with higher term. Message: Invalid argument: T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 27. Current term is 28.
W20260709 12:13:08.246542 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 49250.9us
I20260709 12:13:08.231941 22400 raft_consensus.cc:515] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:08.246809 22151 leader_election.cc:290] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:13:08.260958 21953 leader_election.cc:290] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:08.278038 14230 leader_election.cc:304] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:08.281224 14230 leader_election.cc:304] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:08.283341 22400 leader_election.cc:290] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:08.284317 22139 raft_consensus.cc:515] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 23 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:08.293288 14905 raft_consensus.cc:1275] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 12:13:08.275365 22315 consensus_queue.cc:1048] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.023s
I20260709 12:13:08.299084 14229 leader_election.cc:304] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:08.300226 22041 raft_consensus.cc:2749] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:13:08.301283 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 121536us
I20260709 12:13:08.302495 14155 leader_election.cc:400] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 25 election: Vote denied by peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673) with higher term. Message: Invalid argument: T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 25. Current term is 26.
I20260709 12:13:08.302794 14155 leader_election.cc:403] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 25 election: Cancelling election due to peer responding with higher term
I20260709 12:13:08.261344 21928 consensus_queue.cc:1048] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.062s
I20260709 12:13:08.305037 22186 raft_consensus.cc:3060] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:08.301265 14229 leader_election.cc:304] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:08.319015 22268 consensus_queue.cc:1048] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.003s
I20260709 12:13:08.319217 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:13:08.314491 22376 raft_consensus.cc:2749] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:08.317586 21953 raft_consensus.cc:2749] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:08.345429 22400 raft_consensus.cc:2804] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Leader election won for term 19
W20260709 12:13:08.349609 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 68517.7us
I20260709 12:13:08.361577 14304 leader_election.cc:304] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
W20260709 12:13:08.363026 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 61940.5us
I20260709 12:13:08.364112 14230 leader_election.cc:304] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:08.365728 22401 consensus_queue.cc:1048] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:13:08.353765 22400 raft_consensus.cc:697] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 19 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:13:08.367039 21953 raft_consensus.cc:2749] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:08.367288 22400 consensus_queue.cc:237] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:08.370007 22297 raft_consensus.cc:515] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:08.340718 22397 raft_consensus.cc:515] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:08.378338 22297 leader_election.cc:290] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:08.392675 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:13:08.393867 14260 raft_consensus.cc:2393] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 22: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:13:08.395234 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:13:08.396025 14265 raft_consensus.cc:3060] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:08.398239 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:13:08.399127 14912 raft_consensus.cc:2393] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 19: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:13:08.398239 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:08.402374 14230 leader_election.cc:304] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:08.409611 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:08.411368 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:08.399683 21928 raft_consensus.cc:2749] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:08.415131 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:13:08.415378 22139 leader_election.cc:290] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 23 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:13:08.416397 22397 leader_election.cc:290] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:08.418334 14911 raft_consensus.cc:2468] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 20.
I20260709 12:13:08.420466 14261 raft_consensus.cc:2393] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 26: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
W20260709 12:13:08.420835 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 170741us
W20260709 12:13:08.421605 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 68139us
I20260709 12:13:08.428267 22329 raft_consensus.cc:493] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:13:08.428627 14303 leader_election.cc:304] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:13:08.429201 14229 leader_election.cc:304] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:13:08.429036 22329 raft_consensus.cc:515] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:08.431469 22329 leader_election.cc:290] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:08.434634 14911 raft_consensus.cc:1240] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 23 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 22. Current term is 23. Ops: []
I20260709 12:13:08.426208 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:13:08.404590 22040 consensus_queue.cc:1059] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.022s
I20260709 12:13:08.442626 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:13:08.443418 14190 raft_consensus.cc:3060] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:08.420621 22397 raft_consensus.cc:2749] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:08.443478 22368 consensus_queue.cc:1059] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.011s
I20260709 12:13:08.461865 22040 raft_consensus.cc:3055] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 27 LEADER]: Stepping down as leader of term 27
I20260709 12:13:08.467665 22310 consensus_queue.cc:1059] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.019s
W20260709 12:13:08.470594 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 43553.7us
I20260709 12:13:08.449402 22366 raft_consensus.cc:2804] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 12:13:08.471931 22366 raft_consensus.cc:493] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 28 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:13:08.483139 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 50704.2us
I20260709 12:13:08.468854 22040 raft_consensus.cc:740] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 27 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:13:08.472314 22366 raft_consensus.cc:3060] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:08.485471 22297 raft_consensus.cc:2804] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:13:08.464260 21953 consensus_queue.cc:1048] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.025s
W20260709 12:13:08.513068 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 147391us
I20260709 12:13:08.482933 22397 consensus_queue.cc:1059] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 22.16, Next index: 17, Last known committed idx: 15, Time since last communication: 0.025s
I20260709 12:13:08.480113 22329 consensus_queue.cc:1048] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.034s
I20260709 12:13:08.506188 22297 raft_consensus.cc:493] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 26 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:13:08.531808 14230 leader_election.cc:304] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:08.522142 14259 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064"
dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
mode: GRACEFUL
new_leader_uuid: "885067a0d31741bfb5c9935788e315bf"
 from {username='slave'} at 127.0.0.1:54238
I20260709 12:13:08.537819 14259 raft_consensus.cc:606] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Received request to transfer leadership to TS 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:08.538261 14259 raft_consensus.cc:614] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:13:08.542094 22040 consensus_queue.cc:260] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 27.15, Last appended by leader: 15, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:08.543547 22186 raft_consensus.cc:2749] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 26 FOLLOWER]: Leader election lost for term 25. Reason: Vote denied by peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673) with higher term. Message: Invalid argument: T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 25. Current term is 26.
I20260709 12:13:08.543866 22040 raft_consensus.cc:3060] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:08.549849 14154 leader_election.cc:304] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:13:08.553233 22400 raft_consensus.cc:3055] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:13:08.559842 22400 raft_consensus.cc:740] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:13:08.560860 22400 consensus_queue.cc:260] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:08.532872 22297 raft_consensus.cc:3060] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:08.585268 14190 raft_consensus.cc:2468] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 23.
I20260709 12:13:08.587571 14265 raft_consensus.cc:2468] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 21.
I20260709 12:13:08.511363 22413 raft_consensus.cc:493] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:13:08.535770 14155 leader_election.cc:304] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
W20260709 12:13:08.592290 14154 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 75725.9us
W20260709 12:13:08.595592 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 67604.5us
W20260709 12:13:08.592729 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 57068.5us
W20260709 12:13:08.604951 22412 log.cc:927] Time spent T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 12:13:08.609702 22420 log.cc:927] Time spent T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.083s	user 0.003s	sys 0.000s
I20260709 12:13:08.821857 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:13:08.594594 22413 raft_consensus.cc:515] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:08.595127 22400 raft_consensus.cc:3060] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:08.636920 22422 raft_consensus.cc:493] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:13:08.599949 22329 raft_consensus.cc:2804] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:13:08.592290 22041 raft_consensus.cc:2749] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:08.600431 22419 raft_consensus.cc:3060] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:08.715137 22409 raft_consensus.cc:493] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:08.831398 14230 leader_election.cc:304] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:13:08.824726 22315 raft_consensus.cc:493] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:13:08.830716 22186 raft_consensus.cc:493] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:13:08.846707 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:13:08.847504 14183 raft_consensus.cc:3060] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:08.846850 22425 raft_consensus.cc:3055] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:13:08.841143 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:13:08.853824 14189 raft_consensus.cc:3060] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Advancing to term 20
I20260709 12:13:08.829476 22329 raft_consensus.cc:493] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:13:08.852200 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 252272us
I20260709 12:13:08.837678 22315 raft_consensus.cc:515] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:08.853511 22425 raft_consensus.cc:740] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:13:08.864620 22329 raft_consensus.cc:3060] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:08.837836 22186 raft_consensus.cc:515] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:08.871397 22397 raft_consensus.cc:2749] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:13:08.834591 22422 raft_consensus.cc:515] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:08.925067 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:13:08.983721 14182 raft_consensus.cc:3060] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:08.926564 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:13:08.929847 22185 tablet_bootstrap.cc:492] T 90097151efa7426faeaea3ff87a7ea78 P 73d01e9b1a9d49358da4985b21d681db: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=0 applied=12 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:08.932034 22315 leader_election.cc:290] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:08.932845 22186 leader_election.cc:290] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:08.988927 22415 raft_consensus.cc:493] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:13:08.935333 22413 leader_election.cc:290] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:08.936077 22425 consensus_queue.cc:260] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:08.991230 22425 raft_consensus.cc:3060] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:08.942102 14183 raft_consensus.cc:2468] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 27.
W20260709 12:13:08.946538 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 135175us
I20260709 12:13:08.948496 22310 raft_consensus.cc:493] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:08.950953 14184 raft_consensus.cc:1240] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 22. Current term is 23. Ops: [22.16-22.16]
I20260709 12:13:08.952425 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 28 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:13:08.958108 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:13:08.966042 22431 raft_consensus.cc:493] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:13:08.968477 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
W20260709 12:13:08.970600 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 463574us
I20260709 12:13:08.973213 22410 raft_consensus.cc:493] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:13:08.974510 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:08.975310 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:08.975831 22295 raft_consensus.cc:493] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:08.998749 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:13:08.844928 22409 raft_consensus.cc:515] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:08.989598 22415 raft_consensus.cc:515] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:08.998500 14336 raft_consensus.cc:2468] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 19.
I20260709 12:13:09.021960 22295 raft_consensus.cc:515] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:09.021996 14265 raft_consensus.cc:1240] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 20. Current term is 21. Ops: []
I20260709 12:13:09.015404 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:13:09.041889 14186 raft_consensus.cc:2468] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 27.
I20260709 12:13:09.044654 14184 raft_consensus.cc:2393] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 22: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:13:09.050971 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 28 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:13:09.053040 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 29 candidate_status { last_received { term: 26 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:09.053773 14230 leader_election.cc:304] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:13:09.054484 22422 leader_election.cc:290] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:13:09.057291 14230 leader_election.cc:304] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:09.061949 22315 raft_consensus.cc:2749] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:13:09.062657 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 28 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:13:09.049116 22413 raft_consensus.cc:493] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:13:09.076359 14260 raft_consensus.cc:1240] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 21. Current term is 22. Ops: []
I20260709 12:13:09.077761 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 27 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:09.082440 14264 pending_rounds.cc:85] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec: Aborting all ops after (but not including) 13
I20260709 12:13:09.118450 14264 pending_rounds.cc:107] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec: Aborting uncommitted NO_OP operation due to leader change: 23.14
I20260709 12:13:09.118788 14264 raft_consensus.cc:2889] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 26 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:09.081135 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 28 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:09.083670 14256 raft_consensus.cc:1240] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 27 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 26. Current term is 27. Ops: []
I20260709 12:13:09.119446 14265 raft_consensus.cc:2468] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 27.
I20260709 12:13:09.084625 14181 raft_consensus.cc:1240] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 20. Current term is 21. Ops: []
I20260709 12:13:09.084937 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 28 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:09.086256 22415 leader_election.cc:290] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:09.010299 22431 raft_consensus.cc:515] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:09.089917 22409 leader_election.cc:290] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:09.090700 14262 raft_consensus.cc:1240] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 21. Current term is 22. Ops: []
I20260709 12:13:09.091986 14263 raft_consensus.cc:1240] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 18. Current term is 19. Ops: []
I20260709 12:13:09.008260 22410 raft_consensus.cc:515] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:09.100709 22329 raft_consensus.cc:515] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:09.102756 22295 leader_election.cc:290] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:09.103694 22185 tablet_bootstrap.cc:492] T 90097151efa7426faeaea3ff87a7ea78 P 73d01e9b1a9d49358da4985b21d681db: Bootstrap complete.
W20260709 12:13:09.104470 22297 consensus_meta.cc:287] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.541s	user 0.007s	sys 0.017s
I20260709 12:13:09.106336 14182 raft_consensus.cc:2468] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 22.
I20260709 12:13:09.108518 14190 raft_consensus.cc:2468] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 26.
W20260709 12:13:09.116225 22366 consensus_meta.cc:287] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.604s	user 0.018s	sys 0.007s
I20260709 12:13:09.118142 14185 raft_consensus.cc:2468] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 27.
I20260709 12:13:09.123096 22400 raft_consensus.cc:2749] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:09.126832 14189 raft_consensus.cc:2468] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 20.
I20260709 12:13:09.002123 22310 raft_consensus.cc:515] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:13:09.165539 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 192833us
W20260709 12:13:09.178643 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 569880us
I20260709 12:13:09.183198 14876 leader_election.cc:304] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
W20260709 12:13:09.191426 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 134215us
I20260709 12:13:09.192906 14187 raft_consensus.cc:1240] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 20. Current term is 21. Ops: []
I20260709 12:13:09.194270 14155 leader_election.cc:304] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:13:09.201345 14303 leader_election.cc:304] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
W20260709 12:13:09.192318 22040 consensus_meta.cc:287] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.648s	user 0.015s	sys 0.000s
I20260709 12:13:09.125728 22413 raft_consensus.cc:515] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:09.162451 22409 raft_consensus.cc:493] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:13:09.214803 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:13:09.215571 14336 raft_consensus.cc:3060] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:09.200448 22368 raft_consensus.cc:493] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:09.214057 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:13:09.232043 22004 consensus_queue.cc:1059] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 20.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:13:09.233343 22004 raft_consensus.cc:3055] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:13:09.234218 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:13:09.234799 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9f69e925a8f4da7ba2b318edae7b194" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:09.238270 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:09.243727 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:09.245215 14256 raft_consensus.cc:1240] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 21. Current term is 22. Ops: [21.13-21.13]
I20260709 12:13:09.203044 22268 raft_consensus.cc:493] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:09.179593 22297 raft_consensus.cc:515] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:09.284054 14258 raft_consensus.cc:2468] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 27.
I20260709 12:13:09.285168 22297 leader_election.cc:290] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 27 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:09.291955 14188 raft_consensus.cc:1240] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 21. Current term is 22. Ops: [20.12-21.13]
I20260709 12:13:09.303380 14185 raft_consensus.cc:1240] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 27 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 26. Current term is 27. Ops: []
I20260709 12:13:09.250545 22004 raft_consensus.cc:740] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:13:09.308691 22004 consensus_queue.cc:260] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 10, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:09.310169 22004 raft_consensus.cc:3060] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:09.252830 22310 leader_election.cc:290] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:13:09.254419 22410 leader_election.cc:290] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:09.226644 22409 raft_consensus.cc:515] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:13:09.259445 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 50194.3us
I20260709 12:13:09.315199 14230 leader_election.cc:304] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:09.317358 14230 leader_election.cc:304] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:09.263276 22413 leader_election.cc:290] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:09.266870 22185 ts_tablet_manager.cc:1403] T 90097151efa7426faeaea3ff87a7ea78 P 73d01e9b1a9d49358da4985b21d681db: Time spent bootstrapping tablet: real 1.578s	user 0.058s	sys 0.036s
I20260709 12:13:09.219743 22415 raft_consensus.cc:493] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:13:09.216733 22309 raft_consensus.cc:2804] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:13:09.271054 22040 raft_consensus.cc:3060] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:09.273562 22368 raft_consensus.cc:515] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:13:09.278219 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 95110.2us
I20260709 12:13:09.279034 22217 raft_consensus.cc:2804] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:13:09.282755 22268 raft_consensus.cc:515] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:09.181828 22366 raft_consensus.cc:515] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 29 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:09.261477 22329 leader_election.cc:290] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 21 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:13:09.323525 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:13:09.325768 22409 leader_election.cc:290] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:09.330838 14256 raft_consensus.cc:1275] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 12:13:09.349079 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:13:09.345950 22297 raft_consensus.cc:2749] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:13:09.415299 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 51751us
W20260709 12:13:09.415891 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 63821.8us
I20260709 12:13:09.359691 22309 raft_consensus.cc:493] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:13:09.484649 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 247405us
I20260709 12:13:09.498474 14911 raft_consensus.cc:2468] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 21.
I20260709 12:13:09.506502 22217 raft_consensus.cc:697] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 23 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:13:09.469543 22041 raft_consensus.cc:2749] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:09.507902 22366 leader_election.cc:290] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 29 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:13:09.507650 22217 consensus_queue.cc:237] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:09.508118 14303 leader_election.cc:304] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:13:09.366531 22422 consensus_queue.cc:1059] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.135s
I20260709 12:13:09.498843 22309 raft_consensus.cc:3060] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 27 FOLLOWER]: Advancing to term 28
W20260709 12:13:09.508886 22419 consensus_meta.cc:287] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.656s	user 0.012s	sys 0.000s
I20260709 12:13:09.365415 22415 raft_consensus.cc:515] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:13:09.536386 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 46938.3us
I20260709 12:13:09.535171 14334 raft_consensus.cc:1275] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
W20260709 12:13:09.539057 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 221783us
I20260709 12:13:09.508944 22409 raft_consensus.cc:493] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:13:09.469336 21928 consensus_queue.cc:1059] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 26.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.073s
I20260709 12:13:09.530748 22366 raft_consensus.cc:2804] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:09.583676 14230 leader_election.cc:304] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:09.549000 14336 raft_consensus.cc:2468] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 20.
I20260709 12:13:09.543016 22419 raft_consensus.cc:2749] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:13:09.589236 14912 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8"
dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
mode: GRACEFUL
new_leader_uuid: "885067a0d31741bfb5c9935788e315bf"
 from {username='slave'} at 127.0.0.1:38628
W20260709 12:13:09.594071 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 88095.6us
I20260709 12:13:09.590648 14912 raft_consensus.cc:606] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 19 LEADER]: Received request to transfer leadership to TS 885067a0d31741bfb5c9935788e315bf
W20260709 12:13:09.596608 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 402402us
I20260709 12:13:09.603596 14155 leader_election.cc:304] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:13:09.600420 14304 leader_election.cc:304] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:09.608588 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:13:09.609935 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 29 candidate_status { last_received { term: 26 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:13:09.620078 14230 leader_election.cc:304] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:09.620982 22041 raft_consensus.cc:2749] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:13:09.624426 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:09.624514 22419 raft_consensus.cc:493] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:13:09.628691 22413 raft_consensus.cc:493] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:13:09.629323 22413 raft_consensus.cc:515] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:09.625032 22419 raft_consensus.cc:515] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:09.631575 22413 leader_election.cc:290] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:13:09.631682 22419 leader_election.cc:290] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:09.633688 14304 leader_election.cc:304] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:13:09.634668 22427 raft_consensus.cc:2804] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:13:09.635102 22427 raft_consensus.cc:493] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:09.635459 22427 raft_consensus.cc:3060] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:09.638162 22442 raft_consensus.cc:2749] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:13:09.641358 22442 consensus_queue.cc:1059] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 26.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:13:09.642517 22442 consensus_queue.cc:1059] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 12:13:09.646735 22430 log.cc:927] Time spent T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.624s	user 0.002s	sys 0.019s
I20260709 12:13:09.587697 22366 raft_consensus.cc:493] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:13:09.649269 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 54543.7us
I20260709 12:13:09.604184 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:13:09.638528 22441 log.cc:927] Time spent T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 12:13:09.657256 14302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:09.603391 22297 raft_consensus.cc:2749] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:13:09.648329 22431 leader_election.cc:290] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:13:09.654580 22004 raft_consensus.cc:3055] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:13:09.653218 22366 raft_consensus.cc:3060] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:09.586485 22409 raft_consensus.cc:515] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:09.655907 22040 raft_consensus.cc:2749] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:09.658167 22329 raft_consensus.cc:2749] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 12:13:09.675688 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 78343.1us
I20260709 12:13:09.670670 22004 raft_consensus.cc:740] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:13:09.689605 14155 leader_election.cc:304] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:13:09.690490 14182 raft_consensus.cc:1275] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 26 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 26 index: 15. (index mismatch)
I20260709 12:13:09.683811 21928 raft_consensus.cc:493] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:13:09.691555 14903 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53200 (request call id 1073) took 1220 ms. Trace:
I20260709 12:13:09.691509 21928 raft_consensus.cc:515] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:09.695250 14230 leader_election.cc:304] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:13:09.696997 22295 raft_consensus.cc:2749] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:09.701962 21928 leader_election.cc:290] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:13:09.692010 14903 rpcz_store.cc:276] 0709 12:13:08.433396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:08.436948 (+  3552us) service_pool.cc:224] Handling call
0709 12:13:08.464451 (+ 27503us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:08.471434 (+  6983us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:08.471469 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:08.472004 (+   535us) log.cc:844] Serialized 26 byte log entry
0709 12:13:08.884724 (+412720us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:13:08.884766 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:08.884841 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:09.646080 (+761239us) spinlock_profiling.cc:243] Waited 19 ms on lock 0x7b4400022b4c. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2123f74c85 00007f2123f756a2 00007f2126ce71db 00007f2126ce2aaf 00007f2126cd686e 00007f2126cd5bb6 00007f2126cd57d8 00007f2126cdf221 00007f2126cdf1d9 00007f2126cdf169
0709 12:13:09.648656 (+  2576us) raft_consensus.cc:1685] finished
0709 12:13:09.648678 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:09.653236 (+  4558us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2203,"raft.queue_time_us":512,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":10854,"spinlock_wait_cycles":43694976,"thread_start_us":412336,"threads_started":1,"wal-append.queue_time_us":549965}
W20260709 12:13:09.706869 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 87194.9us
I20260709 12:13:09.710691 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:13:09.722407 22040 raft_consensus.cc:2749] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:13:09.726836 14155 leader_election.cc:304] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:13:09.730504 14155 leader_election.cc:304] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
W20260709 12:13:09.734824 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 60858.6us
I20260709 12:13:09.733359 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:13:09.699100 22379 consensus_queue.cc:1048] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.033s
W20260709 12:13:09.737121 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 96703.7us
I20260709 12:13:09.732061 22438 raft_consensus.cc:2764] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260709 12:13:09.750149 14230 leader_election.cc:304] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:13:09.721361 22309 raft_consensus.cc:515] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:09.776373 22185 raft_consensus.cc:359] T 90097151efa7426faeaea3ff87a7ea78 P 73d01e9b1a9d49358da4985b21d681db [term 18 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } }
I20260709 12:13:09.777345 22185 raft_consensus.cc:740] T 90097151efa7426faeaea3ff87a7ea78 P 73d01e9b1a9d49358da4985b21d681db [term 18 LEARNER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Initialized, Role: LEARNER
I20260709 12:13:09.778589 22409 leader_election.cc:290] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:09.784633 22379 raft_consensus.cc:993] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db: : Instructing follower 885067a0d31741bfb5c9935788e315bf to start an election
I20260709 12:13:09.785163 22379 raft_consensus.cc:1081] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 19 LEADER]: Signalling peer 885067a0d31741bfb5c9935788e315bf to start an election
I20260709 12:13:09.766672 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:09.767215 21928 raft_consensus.cc:493] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:09.733446 22368 leader_election.cc:290] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:13:09.768273 22458 raft_consensus.cc:493] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:09.773998 22418 raft_consensus.cc:3055] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:13:09.742570 22268 leader_election.cc:290] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:13:09.790920 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 53504.1us
I20260709 12:13:09.747643 22419 raft_consensus.cc:2804] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:13:09.794202 14304 leader_election.cc:304] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:09.797297 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 28 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:13:09.803398 14188 raft_consensus.cc:3060] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:09.798513 22041 raft_consensus.cc:2804] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:13:09.804586 22041 raft_consensus.cc:697] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 26 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:13:09.804351 22431 raft_consensus.cc:2749] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:09.807189 14230 leader_election.cc:304] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:09.805405 22458 raft_consensus.cc:515] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:09.777635 22309 leader_election.cc:290] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 28 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:13:09.795424 22295 raft_consensus.cc:493] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:09.809963 22416 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.177s	user 0.011s	sys 0.030s
I20260709 12:13:09.793608 22418 raft_consensus.cc:740] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:13:09.778093 22185 consensus_queue.cc:260] T 90097151efa7426faeaea3ff87a7ea78 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } }
W20260709 12:13:09.817924 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 81524.1us
I20260709 12:13:09.800239 22438 raft_consensus.cc:493] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:13:09.797230 21928 raft_consensus.cc:515] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:09.845875 22438 raft_consensus.cc:515] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:09.847412 21928 leader_election.cc:290] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:13:09.823194 22295 raft_consensus.cc:515] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:09.848112 22438 leader_election.cc:290] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:09.848407 14187 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8"
dest_uuid: "885067a0d31741bfb5c9935788e315bf"
 from {username='slave'} at 127.0.0.1:56652
I20260709 12:13:09.848984 14187 raft_consensus.cc:493] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:09.849323 14187 raft_consensus.cc:3060] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:09.849574 22295 leader_election.cc:290] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:13:09.805657 22041 consensus_queue.cc:237] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.13, Last appended by leader: 13, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:09.852322 22415 leader_election.cc:290] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:09.833658 22268 raft_consensus.cc:493] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:13:09.816324 22431 consensus_queue.cc:1059] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.018s
I20260709 12:13:09.804791 22419 raft_consensus.cc:697] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 21 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:13:09.855841 22268 raft_consensus.cc:515] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:09.856681 22419 consensus_queue.cc:237] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:09.858018 22268 leader_election.cc:290] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:09.748250 22004 consensus_queue.cc:260] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:09.859979 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:13:09.860610 14189 raft_consensus.cc:2468] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 19.
W20260709 12:13:09.862368 22447 log.cc:927] Time spent T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
I20260709 12:13:09.864077 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 29 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:09.864837 14264 raft_consensus.cc:2468] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 27.
I20260709 12:13:09.865974 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:09.864413 14334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:09.867128 14334 raft_consensus.cc:2468] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 26.
I20260709 12:13:09.869349 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:13:09.869975 14186 raft_consensus.cc:2468] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 23.
I20260709 12:13:09.872758 14903 raft_consensus.cc:1275] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 12:13:09.873998 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:13:09.800072 22455 consensus_queue.cc:1059] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.038s
I20260709 12:13:09.875703 22422 raft_consensus.cc:3055] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 26 LEADER]: Stepping down as leader of term 26
I20260709 12:13:09.876073 22422 raft_consensus.cc:740] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:13:09.876601 22428 raft_consensus.cc:3055] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:13:09.876979 22422 consensus_queue.cc:260] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 26.15, Last appended by leader: 15, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:13:09.819371 22416 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.260s	user 0.012s	sys 0.031s
I20260709 12:13:09.845096 22458 leader_election.cc:290] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:09.878464 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 27 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:13:09.878964 22356 consensus_queue.cc:1048] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260709 12:13:09.879518 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 72426.3us
I20260709 12:13:09.864073 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 29 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:09.839190 22459 raft_consensus.cc:493] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:09.883355 14188 raft_consensus.cc:2468] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 28.
I20260709 12:13:09.878892 14877 leader_election.cc:304] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:13:09.886745 14187 raft_consensus.cc:515] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:09.894390 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:13:09.893075 14332 raft_consensus.cc:2468] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 28.
I20260709 12:13:09.889334 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 29 candidate_status { last_received { term: 26 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:13:09.886802 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:13:09.896010 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:13:09.867081 22185 ts_tablet_manager.cc:1434] T 90097151efa7426faeaea3ff87a7ea78 P 73d01e9b1a9d49358da4985b21d681db: Time spent starting tablet: real 0.500s	user 0.009s	sys 0.000s
I20260709 12:13:09.898051 14877 leader_election.cc:304] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:13:09.897483 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:09.897492 14258 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae"
dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
mode: GRACEFUL
new_leader_uuid: "65c9c1653b3346b39a0e118540e6080c"
 from {username='slave'} at 127.0.0.1:54238
I20260709 12:13:09.899545 14258 raft_consensus.cc:606] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Received request to transfer leadership to TS 65c9c1653b3346b39a0e118540e6080c
I20260709 12:13:09.899873 14258 raft_consensus.cc:614] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:13:09.896966 14876 leader_election.cc:304] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:13:09.901500 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:09.911067 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:09.911312 14256 raft_consensus.cc:2468] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 25.
I20260709 12:13:09.902146 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:09.902333 14187 leader_election.cc:290] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 20 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:13:09.912285 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 28 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:13:09.877000 22428 raft_consensus.cc:740] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:13:09.912921 14263 raft_consensus.cc:3060] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:09.889287 21953 raft_consensus.cc:2804] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 28 FOLLOWER]: Leader election won for term 28
I20260709 12:13:09.897850 22459 raft_consensus.cc:515] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:09.906138 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:13:09.906363 22433 raft_consensus.cc:2804] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 12:13:09.904827 22366 raft_consensus.cc:515] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:09.889534 22295 raft_consensus.cc:493] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:13:09.917512 14258 raft_consensus.cc:1240] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 27 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 26. Current term is 27. Ops: []
I20260709 12:13:09.915889 14264 raft_consensus.cc:2468] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 21.
I20260709 12:13:09.925416 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:09.919605 22433 raft_consensus.cc:493] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 28 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:09.929091 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 29 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:13:09.929230 14303 leader_election.cc:304] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:09.934592 22295 raft_consensus.cc:515] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:09.936691 22295 leader_election.cc:290] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:09.940912 22187 raft_consensus.cc:2804] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:13:09.941435 22187 raft_consensus.cc:493] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 26 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:13:09.941848 22187 raft_consensus.cc:3060] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:09.942152 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:09.948828 14263 raft_consensus.cc:2468] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 28.
I20260709 12:13:09.918560 22422 raft_consensus.cc:3060] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:09.929020 22433 raft_consensus.cc:3060] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 28 FOLLOWER]: Advancing to term 29
W20260709 12:13:09.914191 22185 ts_tablet_manager.cc:1467] T 90097151efa7426faeaea3ff87a7ea78 P 73d01e9b1a9d49358da4985b21d681db: Tablet startup took 541ms
I20260709 12:13:09.963768 14262 raft_consensus.cc:1240] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 18. Current term is 19. Ops: []
I20260709 12:13:09.961017 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:13:09.965090 14263 raft_consensus.cc:3060] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:09.968506 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 28 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:09.973336 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:09.973848 22429 raft_consensus.cc:493] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:09.974359 22429 raft_consensus.cc:515] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:09.976228 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 29 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:09.943925 22432 raft_consensus.cc:2804] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:13:09.976897 14259 raft_consensus.cc:2468] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 27.
I20260709 12:13:09.982089 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:09.954735 22309 raft_consensus.cc:2749] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:13:09.989097 14263 raft_consensus.cc:2468] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 22.
I20260709 12:13:09.991536 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:09.979451 22432 raft_consensus.cc:493] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:09.987174 22452 raft_consensus.cc:493] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:13:09.969264 22297 consensus_queue.cc:1048] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.030s
I20260709 12:13:09.999480 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:09.984087 14304 leader_election.cc:304] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 29 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
W20260709 12:13:10.008277 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 119391us
I20260709 12:13:09.994102 22409 raft_consensus.cc:493] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:13:09.996913 22432 raft_consensus.cc:3060] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:09.987507 22428 consensus_queue.cc:260] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:10.018021 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:13:10.018682 14903 raft_consensus.cc:3060] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:10.017509 14304 leader_election.cc:304] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:10.020434 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:10.028151 14304 leader_election.cc:304] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:13:10.018810 22423 raft_consensus.cc:2749] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 29 FOLLOWER]: Leader election lost for term 29. Reason: could not achieve majority
I20260709 12:13:10.018824 22429 leader_election.cc:290] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:13:10.025059 22418 consensus_queue.cc:260] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:10.039287 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:10.041029 22004 raft_consensus.cc:3060] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:10.045508 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 29 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:13:10.046443 14181 raft_consensus.cc:2410] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for term 29 because replica has last-logged OpId of term: 27 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 26 index: 14.
I20260709 12:13:10.019286 22409 raft_consensus.cc:515] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:10.002720 22452 raft_consensus.cc:515] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } }
I20260709 12:13:10.024925 22151 raft_consensus.cc:2804] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:13:10.047917 22151 raft_consensus.cc:493] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 25 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:13:10.048310 22151 raft_consensus.cc:3060] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:10.048650 22409 leader_election.cc:290] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:10.048723 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:10.048976 22452 leader_election.cc:290] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:13:10.046941 22459 leader_election.cc:290] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:10.066223 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:13:10.066953 14181 raft_consensus.cc:2468] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 18.
I20260709 12:13:10.068183 14876 leader_election.cc:304] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:13:10.071007 14903 raft_consensus.cc:2468] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 22.
W20260709 12:13:09.970505 22185 ts_tablet_manager.cc:1469] T 90097151efa7426faeaea3ff87a7ea78 P 73d01e9b1a9d49358da4985b21d681db: Trace:
0709 12:13:02.556680 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:02.557227 (+   547us) service_pool.cc:224] Handling call
0709 12:13:02.973515 (+416288us) ts_tablet_manager.cc:934] T 90097151efa7426faeaea3ff87a7ea78 P 73d01e9b1a9d49358da4985b21d681db: Initiating tablet copy from peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
0709 12:13:05.575559 (+2602044us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:13:06.316854 (+741295us) tablet_metadata.cc:665] Metadata flushed
0709 12:13:06.335062 (+ 18208us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:13:06.564990 (+229928us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:13:06.565415 (+   425us) tablet_replica.cc:206] Creating consensus instance
0709 12:13:06.565821 (+   406us) ts_tablet_manager.cc:989] Replica registered.
0709 12:13:06.565900 (+    79us) inbound_call.cc:177] Queueing success response
0709 12:13:06.889395 (+323495us) spinlock_profiling.cc:243] Waited 22 ms on lock 0x7b1800024c40. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f212cf16ab1 00007f212cf23281 00007f2123fc8c0a 00007f212d708219 00007f2123ef2ed8 00007f212404dde2 00007f212c0b2d23 00007f212c0b255d 00007f212c14e3d8 00007f212c17ff4e 00007f212c164fdd
0709 12:13:07.688713 (+799318us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 12:13:09.454497 (+1765784us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 12:13:09.622877 (+168380us) tablet_replica.cc:261] Starting instrumentation
0709 12:13:09.623593 (+   716us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":68434,"mutex_wait_us":48431,"raft.queue_time_us":2017,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":113,"spinlock_wait_cycles":50672512,"tablet-copy.queue_time_us":314944,"tablet-download-pool.queue_time_us":117,"tablet-download-pool.run_cpu_time_us":1372,"tablet-download-pool.run_wall_time_us":653329,"thread_start_us":403744,"threads_started":2}
I20260709 12:13:10.029596 22428 raft_consensus.cc:3060] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:13:10.092811 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 60776.9us
I20260709 12:13:10.096019 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:13:10.096693 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:10.096908 14187 raft_consensus.cc:1240] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 21. Current term is 22. Ops: [20.12-21.13]
I20260709 12:13:10.099037 21953 raft_consensus.cc:697] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 28 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:13:10.100245 21953 consensus_queue.cc:237] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 26.14, Last appended by leader: 14, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:13:10.104847 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 198159us
I20260709 12:13:10.093684 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: true dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:13:10.107467 14911 raft_consensus.cc:3055] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:13:10.107759 14911 raft_consensus.cc:740] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:13:10.113687 14911 consensus_queue.cc:260] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:10.122401 14303 leader_election.cc:304] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:13:10.122808 14304 leader_election.cc:304] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:13:10.125288 22368 raft_consensus.cc:2804] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:13:10.125826 22368 raft_consensus.cc:697] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 22 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:13:10.126650 22368 consensus_queue.cc:237] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:13:10.108832 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 99864.8us
I20260709 12:13:10.136834 14257 raft_consensus.cc:1275] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 12:13:10.141083 22469 consensus_queue.cc:1048] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:13:10.140928 22423 consensus_queue.cc:1048] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:13:10.143776 22366 leader_election.cc:290] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 22 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:13:10.144573 22442 raft_consensus.cc:2804] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 28 FOLLOWER]: Leader election won for term 28
I20260709 12:13:10.145146 22442 raft_consensus.cc:697] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 28 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:13:10.146440 14911 raft_consensus.cc:3060] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:10.146095 22442 consensus_queue.cc:237] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 26.13, Last appended by leader: 13, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:10.160085 22187 raft_consensus.cc:515] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:10.162019 14339 raft_consensus.cc:2468] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 22.
I20260709 12:13:10.164754 22151 raft_consensus.cc:515] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:10.165867 14338 raft_consensus.cc:1240] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 26 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 25. Current term is 26. Ops: []
I20260709 12:13:10.133315 22427 raft_consensus.cc:515] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:10.166047 22418 raft_consensus.cc:3060] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:10.167814 22427 leader_election.cc:290] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 28 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:13:10.091516 22435 raft_consensus.cc:2804] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:13:10.168452 14332 raft_consensus.cc:2393] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 28: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:13:10.168524 22435 raft_consensus.cc:493] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:10.169008 22435 raft_consensus.cc:3060] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:10.135260 14304 leader_election.cc:304] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:13:10.174265 22139 consensus_queue.cc:1048] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:13:10.185158 22431 raft_consensus.cc:493] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:13:10.185835 22431 raft_consensus.cc:515] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:10.185714 22422 raft_consensus.cc:493] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:10.187302 22422 raft_consensus.cc:515] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:10.187875 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:10.188256 22425 raft_consensus.cc:2804] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 12:13:10.188690 22425 raft_consensus.cc:493] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 28 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:10.189010 22425 raft_consensus.cc:3060] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:10.189544 22422 leader_election.cc:290] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:13:10.191236 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 28 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:13:10.191823 14181 raft_consensus.cc:3060] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:10.193013 14337 raft_consensus.cc:2468] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 19.
I20260709 12:13:10.193413 22433 raft_consensus.cc:515] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 29 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:10.194593 14906 raft_consensus.cc:2393] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 29 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 29: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
W20260709 12:13:10.188156 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 52988.1us
I20260709 12:13:10.207212 14911 raft_consensus.cc:2468] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 20.
I20260709 12:13:10.196108 14332 raft_consensus.cc:2468] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 19.
I20260709 12:13:10.195298 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:13:10.205862 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 69903.4us
I20260709 12:13:10.216754 14263 raft_consensus.cc:1240] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 21. Current term is 22. Ops: [21.13-21.13]
I20260709 12:13:10.216617 14229 leader_election.cc:304] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:13:10.218108 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 29 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:10.218695 14229 leader_election.cc:304] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:10.219512 22469 raft_consensus.cc:2804] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 27 FOLLOWER]: Leader election won for term 27
I20260709 12:13:10.219915 14229 leader_election.cc:304] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:10.220512 22470 raft_consensus.cc:2749] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:10.219995 22469 raft_consensus.cc:697] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 27 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:13:10.221372 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:10.222119 14264 raft_consensus.cc:2468] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 21.
I20260709 12:13:10.222244 22469 consensus_queue.cc:237] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 26.15, Last appended by leader: 15, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:10.224153 14229 leader_election.cc:304] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 65c9c1653b3346b39a0e118540e6080c
I20260709 12:13:10.224946 22297 raft_consensus.cc:2804] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:13:10.225464 22297 raft_consensus.cc:697] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 22 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:13:10.221346 22470 raft_consensus.cc:2749] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:10.226366 22297 consensus_queue.cc:237] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:10.214145 14230 leader_election.cc:304] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:13:10.213994 14184 raft_consensus.cc:2468] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 18.
I20260709 12:13:10.243851 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
W20260709 12:13:10.253996 14081 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60436 (request call id 290) took 20350 ms (client timeout 15000 ms). Trace:
I20260709 12:13:10.236132 22309 raft_consensus.cc:2749] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:10.258949 14154 leader_election.cc:304] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:13:10.259065 14084 catalog_manager.cc:5697] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf reported cstate change: term changed from 19 to 20, leader changed from 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) to 885067a0d31741bfb5c9935788e315bf (127.12.174.129). New cstate: current_term: 20 leader_uuid: "885067a0d31741bfb5c9935788e315bf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:10.260995 14348 tablet_copy_service.cc:342] P 65c9c1653b3346b39a0e118540e6080c: Request end of tablet copy session 73d01e9b1a9d49358da4985b21d681db-90097151efa7426faeaea3ff87a7ea78 received from {username='slave'} at 127.0.0.1:55492
I20260709 12:13:10.261579 14348 tablet_copy_service.cc:434] P 65c9c1653b3346b39a0e118540e6080c: ending tablet copy session 73d01e9b1a9d49358da4985b21d681db-90097151efa7426faeaea3ff87a7ea78 on tablet 90097151efa7426faeaea3ff87a7ea78 with peer 73d01e9b1a9d49358da4985b21d681db
I20260709 12:13:10.261933 22186 raft_consensus.cc:2804] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:13:10.235394 22187 leader_election.cc:290] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 27 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:10.236804 22419 consensus_queue.cc:1059] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 25.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.026s
I20260709 12:13:10.263415 22419 raft_consensus.cc:3055] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 25 LEADER]: Stepping down as leader of term 25
I20260709 12:13:10.263799 22432 raft_consensus.cc:515] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:10.264586 22151 leader_election.cc:290] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 26 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:13:10.256142 22466 raft_consensus.cc:2804] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:13:10.266117 14303 leader_election.cc:304] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:13:10.266566 22466 raft_consensus.cc:697] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 20 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:13:10.267509 22466 consensus_queue.cc:237] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } }
I20260709 12:13:10.268411 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:13:10.269022 14338 raft_consensus.cc:3060] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:10.270062 22431 leader_election.cc:290] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:13:10.273157 14155 leader_election.cc:304] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:13:10.273994 22416 raft_consensus.cc:2804] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:10.274394 22416 raft_consensus.cc:493] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:13:10.274729 22416 raft_consensus.cc:3060] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:13:10.254448 14081 rpcz_store.cc:269] 0709 12:12:49.903401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:50.282093 (+378692us) service_pool.cc:224] Handling call
0709 12:13:10.253758 (+19971665us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:13:06.676551 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:13:06.794856 (+118305us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:13:06.800081 (+  5225us) write_op.cc:435] Acquired schema lock
0709 12:13:06.833539 (+ 33458us) tablet.cc:662] Decoding operations
0709 12:13:06.907758 (+ 74219us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:13:06.907863 (+   105us) write_op.cc:641] Partition lock acquired for write op
0709 12:13:06.907890 (+    27us) tablet.cc:685] Acquiring locks for 21 operations
0709 12:13:06.909549 (+  1659us) tablet.cc:701] Row locks acquired
0709 12:13:06.909605 (+    56us) write_op.cc:260] PREPARE: finished
0709 12:13:06.993063 (+ 83458us) write_op.cc:270] Start()
0709 12:13:06.993288 (+   225us) write_op.cc:276] Timestamp: P: 1783599186909722 usec, L: 0
0709 12:13:06.993313 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 12:13:07.074578 (+ 81265us) log.cc:844] Serialized 8336 byte log entry
0709 12:13:07.666366 (+591788us) op_driver.cc:464] REPLICATION: finished
0709 12:13:07.710487 (+ 44121us) spinlock_profiling.cc:243] Waited 2.65 ms on lock 0x7b54002e3454. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f2127136e28 00007f212ab71581 00007f212ab70d58 00007f212ab759f1 00007f212ab759a9 00007f212ab75939 00007f212ab75901 00007f212ab74b2d 0000000000388634 0000000000388479
0709 12:13:07.754576 (+ 44089us) write_op.cc:301] APPLY: starting
0709 12:13:07.754706 (+   130us) tablet.cc:1367] starting BulkCheckPresence
0709 12:13:08.050869 (+296163us) tablet.cc:1370] finished BulkCheckPresence
0709 12:13:08.070712 (+ 19843us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:13:08.556297 (+485585us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:13:08.556730 (+   433us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=42,key_file_lookups=42,delta_file_lookups=42,mrs_lookups=0
0709 12:13:08.556821 (+    91us) write_op.cc:312] APPLY: finished
0709 12:13:08.557434 (+   613us) log.cc:844] Serialized 188 byte log entry
0709 12:13:08.557690 (+   256us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:08.842834 (+285144us) write_op.cc:454] Released schema lock
0709 12:13:08.861853 (+ 19019us) write_op.cc:341] FINISH: Updating metrics
0709 12:13:09.015248 (+153395us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:09.035504 (+ 20256us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3124538,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":87938,"apply.run_cpu_time_us":49193,"apply.run_wall_time_us":1241982,"cfile_cache_hit":86,"cfile_cache_hit_bytes":92075,"num_ops":21,"prepare.queue_time_us":130561,"prepare.run_cpu_time_us":52355,"prepare.run_wall_time_us":1082634,"raft.queue_time_us":177478,"raft.run_cpu_time_us":53152,"raft.run_wall_time_us":88397,"replication_time_us":672810,"spinlock_wait_cycles":6153856,"thread_start_us":567700,"threads_started":4,"wal-append.queue_time_us":392214,"wal-append.run_cpu_time_us":22515,"wal-append.run_wall_time_us":2152891}]]}
I20260709 12:13:10.275080 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:13:10.275676 14182 raft_consensus.cc:3060] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:10.261761 22409 raft_consensus.cc:493] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:10.280148 22409 raft_consensus.cc:515] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:10.282425 22409 leader_election.cc:290] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:10.263746 22419 raft_consensus.cc:740] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:13:10.274873 14084 catalog_manager.cc:5697] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf reported cstate change: term changed from 19 to 21, leader changed from 65c9c1653b3346b39a0e118540e6080c (127.12.174.131) to 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130). New cstate: current_term: 21 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } }
I20260709 12:13:10.284327 22419 consensus_queue.cc:260] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 25.16, Last appended by leader: 16, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:10.285043 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:10.267426 22456 raft_consensus.cc:2804] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:13:10.286111 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:13:10.286777 14259 raft_consensus.cc:3060] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:10.287879 14084 catalog_manager.cc:5697] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf reported cstate change: term changed from 17 to 19, leader changed from 885067a0d31741bfb5c9935788e315bf (127.12.174.129) to 73d01e9b1a9d49358da4985b21d681db (127.12.174.132). New cstate: current_term: 19 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
W20260709 12:13:10.289654 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 63788.6us
W20260709 12:13:10.249723 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 109395us
I20260709 12:13:10.291931 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:13:10.295048 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 29 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:10.297147 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:13:10.297235 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:13:10.270273 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:13:10.299170 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 28 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:10.299916 14339 raft_consensus.cc:2393] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 28: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:13:10.262480 22186 raft_consensus.cc:697] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 20 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:13:10.285544 22419 raft_consensus.cc:3060] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:10.297320 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:13:10.301685 14185 raft_consensus.cc:1275] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 12:13:10.302851 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:10.286276 22427 raft_consensus.cc:493] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:10.299218 14084 catalog_manager.cc:5697] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf reported cstate change: term changed from 17 to 18, leader changed from 885067a0d31741bfb5c9935788e315bf (127.12.174.129) to 65c9c1653b3346b39a0e118540e6080c (127.12.174.131). New cstate: current_term: 18 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } }
I20260709 12:13:10.322180 14332 raft_consensus.cc:2468] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 22.
I20260709 12:13:10.323724 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:13:10.318522 14181 raft_consensus.cc:2468] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 28.
I20260709 12:13:10.298164 14304 leader_election.cc:304] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:10.302953 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 28 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:13:10.332686 14258 raft_consensus.cc:3060] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:10.320008 14155 leader_election.cc:304] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:13:10.318720 14337 raft_consensus.cc:2376] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 20. Re-sending same reply.
I20260709 12:13:10.333673 14303 leader_election.cc:304] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:13:10.306694 14333 raft_consensus.cc:2468] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 28.
I20260709 12:13:10.333187 14229 leader_election.cc:304] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:13:10.340044 14229 leader_election.cc:304] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:13:10.342043 14155 leader_election.cc:304] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:13:10.344233 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:10.286123 22456 raft_consensus.cc:493] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:10.339478 22310 raft_consensus.cc:2749] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
W20260709 12:13:10.345116 22478 log.cc:927] Time spent T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.080s	user 0.000s	sys 0.002s
I20260709 12:13:10.345593 22467 raft_consensus.cc:2804] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:13:10.302507 22186 consensus_queue.cc:237] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:10.347502 14304 leader_election.cc:304] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:10.335078 22432 leader_election.cc:290] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 20 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:13:10.350819 14338 raft_consensus.cc:2468] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 27.
I20260709 12:13:10.339493 22427 raft_consensus.cc:515] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:10.342770 22151 raft_consensus.cc:2804] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 28 FOLLOWER]: Leader election won for term 28
I20260709 12:13:10.342171 22409 raft_consensus.cc:2804] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:13:10.364715 14182 raft_consensus.cc:2468] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 20.
I20260709 12:13:10.376870 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:10.378834 14335 raft_consensus.cc:1240] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 27 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 26. Current term is 27. Ops: [26.18-26.18]
I20260709 12:13:10.350864 22456 raft_consensus.cc:3060] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:10.350517 22415 raft_consensus.cc:2804] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 12:13:10.341933 22470 consensus_queue.cc:1059] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.039s
I20260709 12:13:10.354533 22467 raft_consensus.cc:493] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:13:10.390488 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:10.391904 14304 leader_election.cc:304] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:13:10.311447 22435 raft_consensus.cc:515] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:10.394170 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:10.391366 14876 leader_election.cc:304] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:13:10.394125 22425 raft_consensus.cc:515] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 29 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:10.395828 22347 consensus_queue.cc:1048] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.055s
I20260709 12:13:10.405894 22415 raft_consensus.cc:493] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 28 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:10.412127 22433 leader_election.cc:290] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 29 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:10.413360 14258 raft_consensus.cc:2468] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 28.
I20260709 12:13:10.416376 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:10.416946 22456 raft_consensus.cc:515] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:10.457983 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 29 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:13:10.432080 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:13:10.436069 14259 raft_consensus.cc:2468] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 26.
I20260709 12:13:10.472796 14182 raft_consensus.cc:2468] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 22.
I20260709 12:13:10.473062 14263 raft_consensus.cc:1240] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 26 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 25. Current term is 26. Ops: []
I20260709 12:13:10.384547 22368 raft_consensus.cc:2804] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:10.393079 14330 raft_consensus.cc:2468] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 19.
I20260709 12:13:10.477892 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 29 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:13:10.480297 14258 raft_consensus.cc:3060] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 27 FOLLOWER]: Advancing to term 29
I20260709 12:13:10.481154 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:13:10.482532 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 90728.6us
I20260709 12:13:10.481074 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 28 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:10.485765 22431 raft_consensus.cc:2749] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:10.487905 22457 raft_consensus.cc:2804] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:13:10.488481 22457 raft_consensus.cc:697] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [term 20 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
W20260709 12:13:10.489343 22480 log.cc:927] Time spent T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 12:13:10.485783 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:13:10.490425 22423 raft_consensus.cc:493] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:10.490921 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:10.491654 14261 raft_consensus.cc:2393] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 19: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:13:10.492547 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:10.493607 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:13:10.482961 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 91698.8us
I20260709 12:13:10.493551 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:10.504679 14338 raft_consensus.cc:2393] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 29 FOLLOWER]: Leader election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db in current term 29: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:13:10.393143 22409 raft_consensus.cc:493] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Starting leader election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:13:10.513556 14258 raft_consensus.cc:2468] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 29.
I20260709 12:13:10.513725 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:13:10.520241 14189 raft_consensus.cc:2468] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 26.
I20260709 12:13:10.419034 22151 raft_consensus.cc:697] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 28 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:13:10.521891 14877 leader_election.cc:304] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:13:10.417889 22427 leader_election.cc:290] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:13:10.522080 14903 raft_consensus.cc:2393] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 20: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
I20260709 12:13:10.521492 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53f6ce2ae2d8465cb314a84096322886" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:10.474655 22041 raft_consensus.cc:2764] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 28 FOLLOWER]: Leader pre-election decision vote started in defunct term 27: won
I20260709 12:13:10.476145 22415 raft_consensus.cc:3060] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:10.482357 22368 raft_consensus.cc:493] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:13:10.529595 14331 raft_consensus.cc:2468] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 22.
I20260709 12:13:10.524436 14304 leader_election.cc:304] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:13:10.539892 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:10.546188 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: true dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:13:10.555907 14258 raft_consensus.cc:3060] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:10.546519 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 29 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:10.546907 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:10.548363 14155 leader_election.cc:304] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:13:10.557937 14155 leader_election.cc:304] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:13:10.559042 14155 leader_election.cc:304] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:13:10.559643 22419 raft_consensus.cc:2749] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 27 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:13:10.560168 14155 leader_election.cc:304] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:13:10.560345 22419 raft_consensus.cc:2749] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:10.560758 22040 raft_consensus.cc:2749] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:10.560425 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:10.546188 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:10.561769 14263 raft_consensus.cc:2468] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 22.
I20260709 12:13:10.471746 22467 raft_consensus.cc:3060] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:10.562534 22040 raft_consensus.cc:2749] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:10.563728 14155 leader_election.cc:304] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:13:10.564435 22040 raft_consensus.cc:2749] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:10.481390 22422 raft_consensus.cc:493] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:13:10.565590 14155 leader_election.cc:304] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:13:10.566490 14261 raft_consensus.cc:2393] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 22: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:13:10.569053 14230 leader_election.cc:304] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:10.569963 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:13:10.522370 22409 raft_consensus.cc:3060] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:13:10.575387 14155 leader_election.cc:304] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:13:10.476388 22416 raft_consensus.cc:515] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:10.490957 22423 raft_consensus.cc:515] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:10.593420 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:10.593693 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 27 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:13:10.556766 22368 raft_consensus.cc:3060] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:10.555279 22427 raft_consensus.cc:493] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:10.653596 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a0f56d071c4634842ea1584dfe40e6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:10.573885 22310 raft_consensus.cc:2804] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:13:10.663187 14258 raft_consensus.cc:2468] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 20.
I20260709 12:13:10.665776 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:10.587430 22040 raft_consensus.cc:2749] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:13:10.667701 14262 raft_consensus.cc:2393] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 28: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
W20260709 12:13:10.668314 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 81818.2us
I20260709 12:13:10.668365 14330 raft_consensus.cc:1275] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 12:13:10.566020 22422 raft_consensus.cc:515] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:10.673434 14912 raft_consensus.cc:1275] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 12:13:10.598845 22329 raft_consensus.cc:493] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:13:10.489382 22457 consensus_queue.cc:237] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:10.690511 14335 raft_consensus.cc:1240] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 29 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 28. Current term is 29. Ops: [28.13-28.13]
I20260709 12:13:10.693845 14230 leader_election.cc:304] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
W20260709 12:13:10.697026 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 167949us
I20260709 12:13:10.699609 14230 leader_election.cc:304] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:10.697254 14304 leader_election.cc:304] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:13:10.659861 22485 raft_consensus.cc:2804] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:13:10.674847 22310 raft_consensus.cc:697] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 26 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:13:10.701939 22461 raft_consensus.cc:2804] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 27 FOLLOWER]: Leader election won for term 27
I20260709 12:13:10.665511 22427 raft_consensus.cc:515] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:10.748919 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:13:10.749661 14181 raft_consensus.cc:3060] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Advancing to term 20
I20260709 12:13:10.692458 22329 raft_consensus.cc:515] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:10.731868 22040 raft_consensus.cc:2749] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 12:13:10.762253 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 49685.2us
I20260709 12:13:10.767844 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
W20260709 12:13:10.770113 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 72939.7us
I20260709 12:13:10.803161 14181 raft_consensus.cc:2468] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 20.
I20260709 12:13:10.715394 22469 consensus_queue.cc:1059] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 24.17, Next index: 18, Last known committed idx: 16, Time since last communication: 0.041s
I20260709 12:13:10.754549 22462 raft_consensus.cc:2804] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:10.693302 22151 consensus_queue.cc:237] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 26.17, Last appended by leader: 17, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:10.772590 22425 leader_election.cc:290] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 29 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:13:10.792012 22435 leader_election.cc:290] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 20 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:10.837028 14181 raft_consensus.cc:1275] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 28 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 26 index: 13. Preceding OpId from leader: term: 28 index: 14. (index mismatch)
I20260709 12:13:10.812402 22462 raft_consensus.cc:493] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:13:10.841303 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 286276us
I20260709 12:13:10.846451 14182 raft_consensus.cc:1275] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 26 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 24 index: 13. Preceding OpId from leader: term: 26 index: 14. (index mismatch)
W20260709 12:13:10.846781 22481 log.cc:927] Time spent T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.295s	user 0.001s	sys 0.000s
I20260709 12:13:10.842167 22186 raft_consensus.cc:493] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:13:10.848033 22186 raft_consensus.cc:515] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:10.850791 22329 leader_election.cc:290] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:10.851315 22310 consensus_queue.cc:237] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 25.16, Last appended by leader: 16, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:10.854256 22423 leader_election.cc:290] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:13:10.855499 22503 consensus_queue.cc:1048] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.049s
W20260709 12:13:10.857800 22490 log.cc:927] Time spent T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260709 12:13:10.858031 22295 raft_consensus.cc:3055] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:13:10.858438 22295 raft_consensus.cc:740] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:13:10.859323 22295 consensus_queue.cc:260] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:10.860291 22186 leader_election.cc:290] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:13:10.866140 22484 log.cc:927] Time spent T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.197s	user 0.000s	sys 0.001s
I20260709 12:13:10.860545 22295 raft_consensus.cc:3060] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:10.867806 22427 leader_election.cc:290] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:13:10.869575 14876 leader_election.cc:304] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
W20260709 12:13:10.874096 22483 log.cc:927] Time spent T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.192s	user 0.000s	sys 0.001s
I20260709 12:13:10.821389 22416 leader_election.cc:290] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 22 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:13:10.874210 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 174652us
I20260709 12:13:10.899394 14230 leader_election.cc:304] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
W20260709 12:13:10.874588 22489 log.cc:927] Time spent T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.142s	user 0.000s	sys 0.001s
I20260709 12:13:10.870172 22422 leader_election.cc:290] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:13:10.894124 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:13:10.897902 14154 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:10.845675 22462 raft_consensus.cc:3060] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:13:10.939703 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 55227.9us
I20260709 12:13:10.941392 14261 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2"
dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
mode: GRACEFUL
new_leader_uuid: "885067a0d31741bfb5c9935788e315bf"
 from {username='slave'} at 127.0.0.1:54238
W20260709 12:13:10.941825 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 50030.9us
I20260709 12:13:10.942011 14261 raft_consensus.cc:606] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Received request to transfer leadership to TS 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:10.942431 14261 raft_consensus.cc:614] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:13:10.915607 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 27 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:13:10.943186 14189 raft_consensus.cc:2410] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for term 27 because replica has last-logged OpId of term: 24 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 12.
I20260709 12:13:10.943444 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:13:10.873723 22466 raft_consensus.cc:2804] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Leader election won for term 19
W20260709 12:13:10.917761 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 111378us
I20260709 12:13:10.944660 14181 raft_consensus.cc:2468] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 21.
I20260709 12:13:10.955502 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 29 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
W20260709 12:13:10.958236 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 382890us
I20260709 12:13:10.959208 14906 raft_consensus.cc:2393] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 29 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 29: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
I20260709 12:13:10.960739 14155 leader_election.cc:304] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:13:10.939297 22470 raft_consensus.cc:493] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
W20260709 12:13:11.014174 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 59001.8us
W20260709 12:13:11.014598 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 53971.9us
I20260709 12:13:11.025928 14155 leader_election.cc:304] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:13:10.939647 22461 raft_consensus.cc:697] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 27 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
W20260709 12:13:11.025952 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 56373.7us
W20260709 12:13:11.033845 22495 log.cc:927] Time spent T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.124s	user 0.000s	sys 0.001s
I20260709 12:13:11.037312 22502 raft_consensus.cc:2749] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 12:13:11.026690 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 127405us
I20260709 12:13:11.038319 22409 raft_consensus.cc:515] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:11.038828 14230 leader_election.cc:304] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:11.045867 22469 raft_consensus.cc:3055] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 26 LEADER]: Stepping down as leader of term 26
I20260709 12:13:11.046397 22469 raft_consensus.cc:740] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:13:11.047451 22469 consensus_queue.cc:260] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 26.18, Last appended by leader: 18, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:11.049685 22469 raft_consensus.cc:3060] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:11.061878 14155 leader_election.cc:304] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
W20260709 12:13:11.062983 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 45954.9us
I20260709 12:13:11.066645 14155 leader_election.cc:304] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:13:11.070812 14155 leader_election.cc:304] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:13:11.073975 22492 raft_consensus.cc:2804] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:13:11.074651 22492 raft_consensus.cc:697] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 20 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:13:11.075582 22492 consensus_queue.cc:237] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 18.16, Last appended by leader: 16, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:11.077837 22468 raft_consensus.cc:2749] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 28 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 12:13:11.085242 14303 leader_election.cc:304] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:13:11.061110 22502 raft_consensus.cc:2749] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 12:13:11.108930 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 79520us
I20260709 12:13:11.070367 21953 raft_consensus.cc:2749] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:11.113453 22040 raft_consensus.cc:2749] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:13:11.105074 22186 raft_consensus.cc:2749] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:11.115569 22460 raft_consensus.cc:493] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:13:11.137806 22460 raft_consensus.cc:515] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:11.116047 22500 consensus_queue.cc:1048] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.160s
I20260709 12:13:11.116654 22504 raft_consensus.cc:2804] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:11.163781 22504 raft_consensus.cc:493] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:13:11.164235 22504 raft_consensus.cc:3060] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:11.164671 22416 raft_consensus.cc:493] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:11.165223 22416 raft_consensus.cc:515] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:11.117901 22461 consensus_queue.cc:237] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 26.18, Last appended by leader: 18, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:11.167413 22416 leader_election.cc:290] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:11.067786 22470 raft_consensus.cc:515] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:11.123678 22499 consensus_queue.cc:1048] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.056s
I20260709 12:13:11.126333 22521 raft_consensus.cc:2749] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:11.127740 14155 leader_election.cc:304] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
W20260709 12:13:11.171973 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 44338.4us
I20260709 12:13:11.174296 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:13:11.135390 22512 raft_consensus.cc:2749] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 12:13:11.111105 22481 log.cc:927] Time spent T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
I20260709 12:13:11.158684 22456 leader_election.cc:290] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 20 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:13:11.160871 22460 leader_election.cc:290] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:13:11.177510 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 29 candidate_status { last_received { term: 28 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:11.190775 14331 raft_consensus.cc:2393] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 29 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 29: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:13:11.186954 14333 raft_consensus.cc:2393] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 22: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:13:11.194667 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:11.195822 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:13:11.199961 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 23 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:11.201012 14338 raft_consensus.cc:2410] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for term 23 because replica has last-logged OpId of term: 21 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
I20260709 12:13:11.168766 22409 leader_election.cc:290] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:11.202953 14337 raft_consensus.cc:2393] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 19: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
W20260709 12:13:11.229240 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 189141us
I20260709 12:13:11.158504 22368 raft_consensus.cc:515] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } }
W20260709 12:13:11.218787 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 176952us
I20260709 12:13:11.235575 14230 leader_election.cc:304] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:11.237165 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 29 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:13:11.243132 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:13:11.246372 14911 raft_consensus.cc:1240] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [term 20 LEADER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 19. Current term is 20. Ops: [19.16-19.16]
W20260709 12:13:11.214181 22467 consensus_meta.cc:287] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.652s	user 0.006s	sys 0.005s
I20260709 12:13:11.248188 14256 raft_consensus.cc:1275] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 28 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 26 index: 13. Preceding OpId from leader: term: 28 index: 14. (index mismatch)
I20260709 12:13:11.239192 14877 leader_election.cc:304] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:13:11.202486 22040 raft_consensus.cc:493] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:13:11.251331 14261 raft_consensus.cc:1275] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 12:13:11.256773 14264 raft_consensus.cc:2393] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 29 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 29: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
I20260709 12:13:11.258350 14187 raft_consensus.cc:1275] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 12:13:11.261675 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:13:11.262277 22415 consensus_meta.cc:287] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf: Time spent flushing consensus metadata: real 0.677s	user 0.013s	sys 0.000s
I20260709 12:13:11.216058 22455 raft_consensus.cc:493] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:11.263051 22455 raft_consensus.cc:515] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:11.262503 14262 raft_consensus.cc:2468] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 21.
I20260709 12:13:11.264758 22514 raft_consensus.cc:2749] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 28 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:13:11.265359 22455 leader_election.cc:290] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:13:11.265961 22435 raft_consensus.cc:2804] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 29 FOLLOWER]: Leader election won for term 29
I20260709 12:13:11.261847 22467 raft_consensus.cc:515] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:11.269840 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 27 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:13:11.274935 22516 log.cc:927] Time spent T 00000000000000000000000000000000 P d07070be2c074f4cb9ad35f1580c4ef7: Append to log took a long time: real 0.148s	user 0.001s	sys 0.000s
I20260709 12:13:11.276607 22368 leader_election.cc:290] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 22 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:13:11.265947 22497 log.cc:927] Time spent T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 12:13:11.230937 22485 raft_consensus.cc:697] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 22 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:13:11.213621 22466 raft_consensus.cc:697] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 19 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:13:11.301935 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:13:11.291008 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:11.209259 22502 consensus_queue.cc:1048] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.066s
I20260709 12:13:11.299726 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:13:11.301273 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:11.303583 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 23 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:11.311445 14260 raft_consensus.cc:1275] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 12:13:11.274984 22435 raft_consensus.cc:697] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 29 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:13:11.314296 14338 raft_consensus.cc:1240] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 21. Current term is 22. Ops: []
I20260709 12:13:11.313779 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 28 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:13:11.315907 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 29 candidate_status { last_received { term: 28 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:11.316543 14265 raft_consensus.cc:1275] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 12:13:11.331573 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:13:11.272481 22040 raft_consensus.cc:515] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:11.340756 14337 raft_consensus.cc:2393] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db in current term 20: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:13:11.343119 14190 raft_consensus.cc:2468] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 27.
I20260709 12:13:11.282577 22415 raft_consensus.cc:515] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 29 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:11.347357 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
W20260709 12:13:11.352649 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 49176.2us
W20260709 12:13:11.352880 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 118377us
I20260709 12:13:11.377347 14181 raft_consensus.cc:2468] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 21.
I20260709 12:13:11.425334 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 28 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:13:11.445622 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 91895.2us
I20260709 12:13:11.446615 14230 leader_election.cc:304] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
W20260709 12:13:11.447459 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 94039us
I20260709 12:13:11.475704 14903 raft_consensus.cc:1275] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 12:13:11.475443 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3832505489c04d04a69e256187061921" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:13:11.480263 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:11.484485 14256 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c"
dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
mode: GRACEFUL
new_leader_uuid: "885067a0d31741bfb5c9935788e315bf"
 from {username='slave'} at 127.0.0.1:54238
I20260709 12:13:11.485203 14256 raft_consensus.cc:606] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Received request to transfer leadership to TS 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:11.485574 14256 raft_consensus.cc:614] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:13:11.478554 14304 leader_election.cc:304] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:11.488344 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:13:11.492656 14262 raft_consensus.cc:1240] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 23. Current term is 24. Ops: []
I20260709 12:13:11.494467 14304 leader_election.cc:304] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 29 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:13:11.490995 14903 raft_consensus.cc:3060] T 90097151efa7426faeaea3ff87a7ea78 P 73d01e9b1a9d49358da4985b21d681db [term 18 LEARNER]: Advancing to term 20
I20260709 12:13:11.388504 22529 raft_consensus.cc:2749] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:11.505089 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:13:11.510506 14903 raft_consensus.cc:1275] T 90097151efa7426faeaea3ff87a7ea78 P 73d01e9b1a9d49358da4985b21d681db [term 20 LEARNER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:13:11.530085 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:13:11.530735 22523 raft_consensus.cc:2804] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:13:11.531584 22040 leader_election.cc:290] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:13:11.532549 14155 leader_election.cc:304] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:13:11.528422 22151 raft_consensus.cc:2749] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 29 FOLLOWER]: Leader election lost for term 29. Reason: could not achieve majority
I20260709 12:13:11.534312 22512 raft_consensus.cc:3060] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:11.488160 22368 consensus_queue.cc:1048] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.028s
I20260709 12:13:11.535362 22040 consensus_queue.cc:1048] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.004s
I20260709 12:13:11.499109 22502 raft_consensus.cc:493] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:11.540462 14155 leader_election.cc:304] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:13:11.543639 22502 raft_consensus.cc:515] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } }
I20260709 12:13:11.546506 22510 raft_consensus.cc:2749] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:13:11.546635 14304 leader_election.cc:304] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:11.548075 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:11.549687 22309 raft_consensus.cc:2749] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:13:11.549897 22513 raft_consensus.cc:493] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:13:11.550566 22309 raft_consensus.cc:493] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:13:11.548805 22366 consensus_queue.cc:1048] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.003s
I20260709 12:13:11.552305 12986 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:13:11.553056 22295 consensus_queue.cc:1048] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:13:11.555372 22469 consensus_queue.cc:1059] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:13:11.556607 22469 consensus_queue.cc:1243] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer 73d01e9b1a9d49358da4985b21d681db log is divergent from this leader: its last log entry 20.16 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 15
I20260709 12:13:11.554977 14155 leader_election.cc:304] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:13:11.555733 22458 consensus_queue.cc:1059] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 23.17, Next index: 18, Last known committed idx: 15, Time since last communication: 0.002s
I20260709 12:13:11.551141 22309 raft_consensus.cc:515] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:11.558264 22040 raft_consensus.cc:2749] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:11.560917 14155 leader_election.cc:304] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:13:11.476632 22456 raft_consensus.cc:493] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:13:11.509665 22470 leader_election.cc:290] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:13:11.554642 12986 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:11.580430 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a11d7ae457a408cac205ac501217c61" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:13:11.534397 22534 log.cc:927] Time spent T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.154s	user 0.000s	sys 0.001s
I20260709 12:13:11.533403 22514 consensus_queue.cc:1048] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.041s
W20260709 12:13:11.578714 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 84071.4us
I20260709 12:13:11.594079 14229 leader_election.cc:304] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:11.596467 14876 leader_election.cc:304] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:13:11.588680 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:13:11.589540 14181 raft_consensus.cc:1275] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 26 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 25 index: 16. Preceding OpId from leader: term: 26 index: 17. (index mismatch)
I20260709 12:13:11.531417 22523 raft_consensus.cc:697] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 22 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:13:11.598369 14188 raft_consensus.cc:1275] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:13:11.562071 22519 consensus_queue.cc:1048] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.091s
I20260709 12:13:11.601867 22409 raft_consensus.cc:2749] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:13:11.489054 22531 consensus_queue.cc:1059] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 26.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.117s
I20260709 12:13:11.550577 22513 raft_consensus.cc:515] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:11.610540 14303 leader_election.cc:304] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:13:11.443136 22435 consensus_queue.cc:237] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 27.17, Last appended by leader: 17, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:11.615980 14154 leader_election.cc:304] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:13:11.489266 22504 raft_consensus.cc:515] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:13:11.610488 22527 log.cc:927] Time spent T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.231s	user 0.001s	sys 0.000s
I20260709 12:13:11.515966 22466 consensus_queue.cc:237] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:13:11.627876 22530 log.cc:927] Time spent T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.234s	user 0.001s	sys 0.000s
I20260709 12:13:11.610231 22505 raft_consensus.cc:2804] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:11.627761 22427 raft_consensus.cc:2804] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:13:11.627982 22486 consensus_queue.cc:1048] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.035s
W20260709 12:13:11.662727 22515 log.cc:927] Time spent T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.288s	user 0.000s	sys 0.001s
W20260709 12:13:11.683341 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 89355.7us
W20260709 12:13:11.670961 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 55999.8us
I20260709 12:13:11.590698 22456 raft_consensus.cc:515] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:11.620101 22470 raft_consensus.cc:3055] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 28 LEADER]: Stepping down as leader of term 28
I20260709 12:13:11.675519 14330 raft_consensus.cc:2393] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 22: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
W20260709 12:13:11.674821 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 47258.1us
I20260709 12:13:11.621423 22416 raft_consensus.cc:2749] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:11.443845 22485 consensus_queue.cc:237] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:11.685281 14304 leader_election.cc:304] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:11.688366 22309 leader_election.cc:290] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:13:11.690064 22502 leader_election.cc:290] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:11.690297 22504 leader_election.cc:290] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 22 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:13:11.692126 22456 leader_election.cc:290] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:13:11.691630 22523 consensus_queue.cc:237] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:11.692587 22415 leader_election.cc:290] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 29 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:11.616253 22040 consensus_queue.cc:1059] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 21.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.062s
W20260709 12:13:11.678442 22538 log.cc:927] Time spent T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.065s	user 0.001s	sys 0.001s
I20260709 12:13:11.701705 14303 leader_election.cc:304] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:11.702317 14258 raft_consensus.cc:3055] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:13:11.766319 14258 raft_consensus.cc:740] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
W20260709 12:13:11.766819 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 65211.8us
I20260709 12:13:11.706136 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:13:11.706063 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:13:11.743047 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36091607df2f46059df62d677842a031" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:13:11.744659 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:11.677093 22505 raft_consensus.cc:493] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 21 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:13:11.768610 14333 raft_consensus.cc:2468] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 20.
I20260709 12:13:11.707885 22467 leader_election.cc:290] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 24 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:13:11.747076 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 29 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:13:11.771733 14336 raft_consensus.cc:3060] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:11.680362 22427 raft_consensus.cc:493] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:11.762251 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:13:11.704515 22187 raft_consensus.cc:3055] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:13:11.740644 14185 raft_consensus.cc:1275] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 12:13:11.743834 22442 raft_consensus.cc:2804] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:11.694209 22470 raft_consensus.cc:740] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 28 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:13:11.767202 14258 consensus_queue.cc:260] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.16, Last appended by leader: 16, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:11.774076 14155 leader_election.cc:304] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:13:11.756916 22309 raft_consensus.cc:2749] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
W20260709 12:13:11.745702 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 60501us
I20260709 12:13:11.679733 22528 raft_consensus.cc:2749] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:11.772550 22505 raft_consensus.cc:3060] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:11.810448 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:11.772782 22004 raft_consensus.cc:2749] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:13:11.811586 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:13:11.703044 22366 consensus_queue.cc:1048] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.088s
I20260709 12:13:11.780987 22427 raft_consensus.cc:3060] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:11.784319 22187 raft_consensus.cc:740] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:13:11.789156 22416 raft_consensus.cc:2804] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:13:11.788816 22456 raft_consensus.cc:493] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:13:11.839594 22187 consensus_queue.cc:260] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.17, Last appended by leader: 17, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:11.839751 22456 raft_consensus.cc:515] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:11.842149 22416 raft_consensus.cc:493] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:11.842625 22416 raft_consensus.cc:3060] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:13:11.811919 22535 log.cc:927] Time spent T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.207s	user 0.001s	sys 0.000s
I20260709 12:13:11.842830 22442 raft_consensus.cc:493] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
W20260709 12:13:11.833422 22462 consensus_meta.cc:287] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c: Time spent flushing consensus metadata: real 0.880s	user 0.008s	sys 0.001s
I20260709 12:13:11.838562 22513 leader_election.cc:290] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:13:11.843376 22442 raft_consensus.cc:3060] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:11.854482 14155 leader_election.cc:304] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:13:11.847492 22456 leader_election.cc:290] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:13:11.851024 14336 raft_consensus.cc:2468] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 29.
I20260709 12:13:11.859292 14303 leader_election.cc:304] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:11.867357 22004 raft_consensus.cc:2749] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:11.870687 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:13:11.874114 14155 leader_election.cc:304] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:13:11.883271 14333 raft_consensus.cc:1275] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:13:11.883585 14337 raft_consensus.cc:1240] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 29 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 28. Current term is 29. Ops: [28.13-28.13]
I20260709 12:13:11.888929 14333 raft_consensus.cc:1275] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 13. (term mismatch)
I20260709 12:13:11.889520 14333 pending_rounds.cc:85] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c: Aborting all ops after (but not including) 12
I20260709 12:13:11.889781 14333 pending_rounds.cc:107] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c: Aborting uncommitted NO_OP operation due to leader change: 21.13
I20260709 12:13:11.890043 14333 raft_consensus.cc:2889] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:11.855914 22409 raft_consensus.cc:493] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:13:11.877452 22547 raft_consensus.cc:3060] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:11.894775 14331 raft_consensus.cc:1240] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 21. Current term is 22. Ops: []
I20260709 12:13:11.900859 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:11.886024 22040 raft_consensus.cc:2804] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 29 FOLLOWER]: Leader election won for term 29
I20260709 12:13:11.914177 22040 raft_consensus.cc:697] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 29 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:13:11.915241 22040 consensus_queue.cc:237] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 27.15, Last appended by leader: 15, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:11.916676 22512 raft_consensus.cc:2749] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 29 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:13:11.919428 14186 raft_consensus.cc:1275] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 28 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 26 index: 17. Preceding OpId from leader: term: 28 index: 18. (index mismatch)
I20260709 12:13:11.854969 22462 raft_consensus.cc:515] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:11.922456 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 29 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:13:11.923792 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:11.923934 22462 leader_election.cc:290] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 23 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:13:11.925367 22505 raft_consensus.cc:515] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:11.925803 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:13:11.926471 14186 raft_consensus.cc:3060] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:11.927680 22505 leader_election.cc:290] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 22 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:13:11.929143 14259 raft_consensus.cc:1275] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 27 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 26 index: 18. Preceding OpId from leader: term: 27 index: 19. (index mismatch)
I20260709 12:13:11.901638 14333 raft_consensus.cc:2468] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 24.
I20260709 12:13:11.906430 22545 consensus_queue.cc:1059] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 26.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:13:11.909215 22529 consensus_queue.cc:1048] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:13:11.935082 14230 leader_election.cc:304] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:13:11.938127 22529 raft_consensus.cc:2804] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:11.895218 22428 raft_consensus.cc:493] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:11.938576 22529 raft_consensus.cc:493] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:13:11.910552 22468 consensus_queue.cc:1048] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:13:11.935954 22513 consensus_queue.cc:1048] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:13:11.909934 22519 consensus_queue.cc:1059] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:13:11.961174 14333 raft_consensus.cc:1240] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 29 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 28. Current term is 29. Ops: []
I20260709 12:13:11.965684 22309 raft_consensus.cc:493] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:13:11.899698 22409 raft_consensus.cc:515] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:11.975371 22427 raft_consensus.cc:515] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:11.982497 22409 leader_election.cc:290] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:11.982997 22427 leader_election.cc:290] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 28 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:13:11.983750 14330 raft_consensus.cc:1240] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 28 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 27. Current term is 28. Ops: []
I20260709 12:13:11.939013 22529 raft_consensus.cc:3060] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:11.938731 22428 raft_consensus.cc:515] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:11.976040 22442 raft_consensus.cc:515] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:11.987952 22470 consensus_queue.cc:260] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 28.13, Last appended by leader: 13, Current term: 28, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:11.988948 22442 leader_election.cc:290] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 22 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:13:11.989674 14335 raft_consensus.cc:1240] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 21. Current term is 22. Ops: []
I20260709 12:13:11.990151 14304 leader_election.cc:304] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:11.979763 22309 raft_consensus.cc:515] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:11.993940 22347 consensus_queue.cc:1048] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
I20260709 12:13:12.002900 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:12.004695 22309 leader_election.cc:290] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:13:12.006220 22547 raft_consensus.cc:2749] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:12.010324 14186 raft_consensus.cc:2468] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 23.
I20260709 12:13:12.010818 22416 raft_consensus.cc:515] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } }
I20260709 12:13:12.012243 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 28 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:13:12.012493 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:13:12.013325 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:13:12.014567 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:13:12.013561 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1f0497acbe4a31944b5bac60c5482c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:13:12.018716 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:13:12.021183 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:12.023321 22485 raft_consensus.cc:3055] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:13:12.023800 22485 raft_consensus.cc:740] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:13:12.024088 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 28 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:13:12.024832 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:13:12.026134 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:13:12.026953 21953 consensus_queue.cc:1059] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:13:12.027894 21953 raft_consensus.cc:3055] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 28 LEADER]: Stepping down as leader of term 28
I20260709 12:13:12.028239 21953 raft_consensus.cc:740] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 28 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:13:12.031435 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:13:12.024724 14185 raft_consensus.cc:3060] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:12.013242 22416 leader_election.cc:290] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 21 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:12.029075 21953 consensus_queue.cc:260] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 28.15, Last appended by leader: 15, Current term: 28, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:13:12.045930 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 55856.6us
I20260709 12:13:12.051985 14876 leader_election.cc:304] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:12.053558 14257 raft_consensus.cc:1275] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 28 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 26 index: 17. Preceding OpId from leader: term: 28 index: 18. (index mismatch)
I20260709 12:13:12.065397 14336 raft_consensus.cc:1240] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 21. Current term is 22. Ops: []
I20260709 12:13:12.060846 22540 raft_consensus.cc:493] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:13:12.074271 22540 raft_consensus.cc:515] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:12.076650 22540 leader_election.cc:290] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:13:12.078949 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:12.079954 14257 raft_consensus.cc:2468] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 21.
I20260709 12:13:12.083739 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:13:12.084609 14181 raft_consensus.cc:2393] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db in current term 21: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:13:12.063457 22442 raft_consensus.cc:2749] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:13:12.104669 14336 raft_consensus.cc:1275] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 27 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 27 index: 19. (index mismatch)
W20260709 12:13:12.106401 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 70570.2us
I20260709 12:13:12.060194 22507 consensus_queue.cc:1048] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.040s
I20260709 12:13:12.080947 22498 raft_consensus.cc:493] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:13:12.082537 22416 consensus_queue.cc:1059] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 21.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.031s
W20260709 12:13:12.180408 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 72840.4us
I20260709 12:13:12.119644 22498 raft_consensus.cc:515] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:12.193128 22498 leader_election.cc:290] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:13:12.193840 22501 raft_consensus.cc:2749] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
W20260709 12:13:12.195806 22550 log.cc:927] Time spent T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 12:13:12.204017 22366 consensus_queue.cc:1048] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 12:13:12.213999 14185 raft_consensus.cc:2468] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 28.
W20260709 12:13:12.233876 22555 log.cc:927] Time spent T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 12:13:12.248277 22529 raft_consensus.cc:515] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 25 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:12.217578 14303 leader_election.cc:304] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:13:12.260923 14303 leader_election.cc:304] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:13:12.261977 22366 raft_consensus.cc:2804] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 28 FOLLOWER]: Leader election won for term 28
I20260709 12:13:12.262598 22366 raft_consensus.cc:697] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 28 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:13:12.263736 22366 consensus_queue.cc:237] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 26.15, Last appended by leader: 15, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:12.267122 22470 raft_consensus.cc:3060] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:12.278046 22416 raft_consensus.cc:493] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:12.278779 22416 raft_consensus.cc:515] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:12.282171 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:13:12.285434 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:13:12.287720 14909 raft_consensus.cc:1240] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 21. Current term is 22. Ops: []
I20260709 12:13:12.285571 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:13:12.261071 22151 raft_consensus.cc:2804] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:13:12.298677 22151 raft_consensus.cc:697] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 23 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:13:12.300170 22151 consensus_queue.cc:237] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:12.317549 14155 leader_election.cc:304] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:13:12.332376 14155 leader_election.cc:304] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:13:12.333914 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b1a5d42755443119571654ad5c5f2f3" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:13:12.334920 14186 raft_consensus.cc:1275] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:13:12.347055 14186 raft_consensus.cc:1240] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 29 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 28. Current term is 29. Ops: []
W20260709 12:13:12.348482 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 228621us
I20260709 12:13:12.351989 14303 leader_election.cc:304] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:13:12.357971 14339 raft_consensus.cc:1275] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 18 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 12:13:12.358984 22416 leader_election.cc:290] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:13:12.359155 14181 raft_consensus.cc:1275] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 18 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 12:13:12.359910 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:13:12.369354 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 22 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:12.370357 14303 leader_election.cc:304] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:12.340803 22456 raft_consensus.cc:493] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:12.374147 22456 raft_consensus.cc:515] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:12.375677 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 22 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:13:12.376592 22456 leader_election.cc:290] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:13:12.376639 14905 raft_consensus.cc:2410] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for term 22 because replica has last-logged OpId of term: 20 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 13.
I20260709 12:13:12.380326 14262 raft_consensus.cc:2410] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for term 22 because replica has last-logged OpId of term: 20 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 13.
I20260709 12:13:12.381557 14303 leader_election.cc:304] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:12.350411 22186 raft_consensus.cc:2749] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 12:13:12.358253 22558 log.cc:927] Time spent T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.110s	user 0.000s	sys 0.002s
I20260709 12:13:12.355355 22486 raft_consensus.cc:2749] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
W20260709 12:13:12.407650 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 359478us
I20260709 12:13:12.429965 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:13:12.430801 14181 raft_consensus.cc:2468] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 19.
I20260709 12:13:12.433481 14304 leader_election.cc:304] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:12.354444 22295 consensus_queue.cc:1059] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 21.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.070s
I20260709 12:13:12.377610 22563 raft_consensus.cc:2749] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:12.403923 22423 raft_consensus.cc:2749] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:13:12.406142 22498 raft_consensus.cc:2749] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:13:12.363374 22507 consensus_queue.cc:1048] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 16, Time since last communication: 0.066s
I20260709 12:13:12.361564 22565 consensus_queue.cc:1048] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.075s
I20260709 12:13:12.444846 22500 raft_consensus.cc:2749] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:13:12.481076 22546 consensus_queue.cc:1048] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.126s
I20260709 12:13:12.482407 14262 raft_consensus.cc:1275] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 26 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 25 index: 16. Preceding OpId from leader: term: 26 index: 17. (index mismatch)
W20260709 12:13:12.486099 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:12.490832 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b3f8ef40054811944ba9bd9ed74eb3" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:12.492328 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:12.464408 22523 raft_consensus.cc:493] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:12.499044 14260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53050 (request call id 1727) took 1017 ms. Trace:
I20260709 12:13:12.502065 14260 rpcz_store.cc:276] 0709 12:13:11.481756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:11.484947 (+  3191us) service_pool.cc:224] Handling call
0709 12:13:11.491890 (+  6943us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:11.671171 (+179281us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:11.671211 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:13:11.671258 (+    47us) raft_consensus.cc:1645] Marking committed up to 17
0709 12:13:11.671290 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:12.498807 (+827517us) spinlock_profiling.cc:243] Waited 172 ms on lock 0x7b5400072954. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:13:12.498861 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:12.498981 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":394979072}
W20260709 12:13:12.524955 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 54672.7us
I20260709 12:13:12.534566 14336 raft_consensus.cc:1275] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 12:13:12.532812 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:13:12.493582 22523 raft_consensus.cc:515] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:12.545390 14335 raft_consensus.cc:1240] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 21. Current term is 22. Ops: []
I20260709 12:13:12.506145 22575 raft_consensus.cc:2955] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 20 LEADER]: Committing config change with OpId 18.12: config changed from index -1 to 12, NON_VOTER 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } } }
I20260709 12:13:12.542358 22529 leader_election.cc:290] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 25 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:13:12.579332 22571 log.cc:927] Time spent T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 12:13:12.582455 22523 leader_election.cc:290] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:13:12.587339 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 30 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:12.576743 22507 raft_consensus.cc:493] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:13:12.590082 22579 consensus_queue.cc:1059] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:13:12.613245 14333 raft_consensus.cc:2468] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 29.
I20260709 12:13:12.620250 14230 leader_election.cc:304] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:13:12.627655 22519 raft_consensus.cc:2804] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 12:13:12.628147 22519 raft_consensus.cc:493] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 29 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:12.628496 22519 raft_consensus.cc:3060] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:13:12.553929 22525 consensus_queue.cc:1048] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.070s
I20260709 12:13:12.618564 22004 raft_consensus.cc:493] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:12.659572 22428 leader_election.cc:290] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:13:12.660461 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:13:12.662849 22518 raft_consensus.cc:493] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:12.663166 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b5f4f19c2a4585b93b312cc1f3d17f" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:12.663426 22518 raft_consensus.cc:515] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:12.655427 22004 raft_consensus.cc:515] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:12.689428 22004 leader_election.cc:290] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:13:12.687204 22518 leader_election.cc:290] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:12.720486 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 29 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:12.727643 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 30 candidate_status { last_received { term: 26 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:13:12.728646 14187 raft_consensus.cc:2410] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 29 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for term 30 because replica has last-logged OpId of term: 28 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 26 index: 12.
I20260709 12:13:12.621218 22507 raft_consensus.cc:515] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:12.740662 14155 leader_election.cc:304] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:13:12.746738 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 30 candidate_status { last_received { term: 26 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
W20260709 12:13:12.747934 14229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:12.748263 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 30 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:13:12.750310 14260 raft_consensus.cc:2410] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 29 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for term 30 because replica has last-logged OpId of term: 28 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 26 index: 12.
I20260709 12:13:12.756166 14183 raft_consensus.cc:1240] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 19. Current term is 20. Ops: []
I20260709 12:13:12.758442 14905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:13:12.771395 14181 raft_consensus.cc:1240] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 21. Current term is 22. Ops: []
I20260709 12:13:12.727963 22435 consensus_queue.cc:1048] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.027s
I20260709 12:13:12.741503 22518 raft_consensus.cc:493] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:13:12.751129 22415 raft_consensus.cc:3055] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:13:12.768673 14260 raft_consensus.cc:1240] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 23. Current term is 24. Ops: []
I20260709 12:13:12.754901 22510 raft_consensus.cc:2749] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:12.807112 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae82f0f3bcac4608987cd7c935c9799b" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 29 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:13:12.805213 22577 log.cc:927] Time spent T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.142s	user 0.001s	sys 0.000s
I20260709 12:13:12.752020 22502 consensus_queue.cc:1059] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 21.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.055s
W20260709 12:13:12.815254 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 78727.1us
I20260709 12:13:12.804330 22491 raft_consensus.cc:493] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
W20260709 12:13:12.837005 22586 log.cc:927] Time spent T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 12:13:12.812175 22415 raft_consensus.cc:740] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
W20260709 12:13:12.873842 22578 log.cc:927] Time spent T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.177s	user 0.004s	sys 0.000s
I20260709 12:13:12.814764 22518 raft_consensus.cc:515] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:13:12.882340 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:12.902266 14877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:12.930805 22485 consensus_queue.cc:260] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:12.845280 22491 raft_consensus.cc:515] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:13:12.939419 22582 log.cc:927] Time spent T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 12:13:12.969600 22507 leader_election.cc:290] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:12.972199 22518 leader_election.cc:290] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:13:13.016598 14304 leader_election.cc:304] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:13:13.013079 22502 raft_consensus.cc:493] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:13:13.012765 22512 raft_consensus.cc:493] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:13:13.021186 22512 raft_consensus.cc:515] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:13.032392 22485 raft_consensus.cc:3060] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:13:13.015627 22593 log.cc:927] Time spent T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 12:13:13.004621 22429 consensus_queue.cc:1048] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.012s
W20260709 12:13:13.057053 14229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:12.917503 22415 consensus_queue.cc:260] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } }
I20260709 12:13:13.061592 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:13:13.070896 14183 raft_consensus.cc:1240] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 20. Current term is 21. Ops: [20.13-20.13]
I20260709 12:13:13.073559 14183 raft_consensus.cc:1240] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 29 LEADER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 28. Current term is 29. Ops: []
I20260709 12:13:13.017838 22425 consensus_queue.cc:1048] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.036s
I20260709 12:13:13.082214 14181 raft_consensus.cc:1240] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 28 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 27. Current term is 28. Ops: []
I20260709 12:13:13.044174 22186 raft_consensus.cc:493] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:13:13.041838 22512 leader_election.cc:290] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:13:13.084827 14903 raft_consensus.cc:1240] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 21. Current term is 22. Ops: []
I20260709 12:13:13.090056 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:13:13.090121 22518 raft_consensus.cc:493] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:13.091588 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:13.053695 22452 raft_consensus.cc:2749] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:13.102602 14189 raft_consensus.cc:1275] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 12:13:13.040591 22502 raft_consensus.cc:515] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:13.097836 22186 raft_consensus.cc:515] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:13.104044 22518 raft_consensus.cc:515] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:13:13.147622 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 76804us
I20260709 12:13:13.135324 22512 raft_consensus.cc:493] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
W20260709 12:13:13.149008 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 56066.6us
I20260709 12:13:13.152405 14229 leader_election.cc:304] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:13.150190 22546 consensus_queue.cc:1059] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.007s
I20260709 12:13:13.158914 22186 leader_election.cc:290] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:13.161705 22595 raft_consensus.cc:2749] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:13:13.169755 14330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50856 (request call id 3326) took 1274 ms. Trace:
I20260709 12:13:13.170351 14330 rpcz_store.cc:276] 0709 12:13:11.882007 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:11.882139 (+   132us) service_pool.cc:224] Handling call
0709 12:13:11.896092 (+ 13953us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:11.984170 (+ 88078us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:13.156175 (+1172005us) spinlock_profiling.cc:243] Waited 87.4 ms on lock 0x7b5400145d54. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:13:13.156382 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":201113472}
I20260709 12:13:13.173007 22590 consensus_queue.cc:1048] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:13:13.182097 14303 leader_election.cc:304] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:13:13.184281 22528 consensus_queue.cc:1059] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:13:13.185287 22528 raft_consensus.cc:3055] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 27 LEADER]: Stepping down as leader of term 27
I20260709 12:13:13.185671 22528 raft_consensus.cc:740] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 27 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:13:13.186568 22528 consensus_queue.cc:260] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 27.16, Last appended by leader: 16, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:13.187536 22528 raft_consensus.cc:3060] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:13.187660 22418 raft_consensus.cc:2804] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:13:13.188097 22418 raft_consensus.cc:493] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:13.188434 22418 raft_consensus.cc:3060] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:13.190718 22517 raft_consensus.cc:493] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:13:13.199080 14877 leader_election.cc:304] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:13.209960 14184 raft_consensus.cc:1275] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 12:13:13.191310 22517 raft_consensus.cc:515] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:13:13.212028 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 127651us
W20260709 12:13:13.214216 14230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:13.217163 22517 leader_election.cc:290] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:13:13.197345 22425 raft_consensus.cc:493] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:13:13.218179 22425 raft_consensus.cc:515] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:13.218822 22588 raft_consensus.cc:2804] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:13:13.219290 22588 raft_consensus.cc:493] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:13:13.219691 22588 raft_consensus.cc:3060] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:13.220530 22425 leader_election.cc:290] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:13:13.227959 22502 leader_election.cc:290] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:13.151407 22512 raft_consensus.cc:515] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:13.230436 22512 leader_election.cc:290] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:13:13.207629 22515 log.cc:927] Time spent T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:13:13.232661 22491 leader_election.cc:290] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:13:13.234045 22295 raft_consensus.cc:3055] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:13:13.234506 22295 raft_consensus.cc:740] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:13:13.235437 22295 consensus_queue.cc:260] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 21.17, Last appended by leader: 17, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:13.236545 22295 raft_consensus.cc:3060] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:13.237686 22518 leader_election.cc:290] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:13.238304 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:13.244417 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
W20260709 12:13:13.243206 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 49576.2us
I20260709 12:13:13.246855 14229 leader_election.cc:304] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:13:13.248584 14304 leader_election.cc:304] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
W20260709 12:13:13.245213 22519 consensus_meta.cc:287] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.616s	user 0.014s	sys 0.000s
I20260709 12:13:13.192427 22485 consensus_queue.cc:1059] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.056s
I20260709 12:13:13.258196 14304 leader_election.cc:304] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:13.264652 14155 leader_election.cc:304] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:13:13.279153 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:13.279945 14181 raft_consensus.cc:1240] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 22. Current term is 23. Ops: []
I20260709 12:13:13.280789 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:13:13.282290 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:13.290531 14908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c9d740fa53e42179ad8d244b4c179fd" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:13:13.294476 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:13.300081 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 30 candidate_status { last_received { term: 28 index: 13 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:13:13.300997 14190 raft_consensus.cc:2468] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 29.
I20260709 12:13:13.275226 22429 raft_consensus.cc:2749] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:13.281594 22431 raft_consensus.cc:2749] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 12:13:13.285938 22590 raft_consensus.cc:2749] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 12:13:13.281358 22512 raft_consensus.cc:2749] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:13.313194 14303 leader_election.cc:304] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:13.284863 22518 raft_consensus.cc:493] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:13:13.320349 22452 raft_consensus.cc:2749] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:13:13.326795 22187 raft_consensus.cc:3060] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:13.309721 22517 raft_consensus.cc:493] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:13:13.274590 22519 raft_consensus.cc:515] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 30 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:13.295564 22427 consensus_queue.cc:1048] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.028s
I20260709 12:13:13.325083 22518 raft_consensus.cc:515] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:13.369634 22518 leader_election.cc:290] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:13:13.330210 22517 raft_consensus.cc:515] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:13.378993 22040 raft_consensus.cc:493] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:13:13.379670 22040 raft_consensus.cc:515] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:13.380438 22517 leader_election.cc:290] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:13:13.381510 14265 raft_consensus.cc:1240] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 30 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 29. Current term is 30. Ops: []
I20260709 12:13:13.381960 22040 leader_election.cc:290] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:13.385301 22309 raft_consensus.cc:493] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:13:13.393260 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:13.318055 22469 consensus_queue.cc:1059] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.055s
I20260709 12:13:13.397367 14258 raft_consensus.cc:3060] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:13.407544 14330 raft_consensus.cc:1240] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 23 LEADER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 22. Current term is 23. Ops: []
I20260709 12:13:13.408061 14331 raft_consensus.cc:1275] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 26 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 26 index: 14. (index mismatch)
I20260709 12:13:13.409662 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:13:13.410884 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:13:13.416407 22608 raft_consensus.cc:493] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:13:13.418442 22608 raft_consensus.cc:515] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:13.421245 22608 leader_election.cc:290] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:13:13.423326 14331 raft_consensus.cc:1240] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 21. Current term is 22. Ops: []
I20260709 12:13:13.426524 14333 raft_consensus.cc:1240] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 21. Current term is 22. Ops: []
I20260709 12:13:13.430845 14339 raft_consensus.cc:1240] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 21. Current term is 22. Ops: []
W20260709 12:13:13.432832 14231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:13.439270 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02513fb0dbdd4cbdb019d79f0f448d18" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:13.453083 14258 raft_consensus.cc:1275] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 20 index: 16. (term mismatch)
I20260709 12:13:13.453600 14258 pending_rounds.cc:85] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec: Aborting all ops after (but not including) 15
I20260709 12:13:13.454505 14258 pending_rounds.cc:107] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec: Aborting uncommitted NO_OP operation due to leader change: 19.16
I20260709 12:13:13.454829 14258 raft_consensus.cc:2889] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:13.455641 14258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53050 (request call id 1733) took 1759 ms. Trace:
W20260709 12:13:13.456636 14877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:13.457903 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:13.459924 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:13.461920 14337 raft_consensus.cc:1275] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 29 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 26 index: 14. Preceding OpId from leader: term: 29 index: 16. (index mismatch)
I20260709 12:13:13.463543 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:13.465283 22599 consensus_queue.cc:1059] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 21.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:13:13.392774 22309 raft_consensus.cc:515] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:13.467764 22309 leader_election.cc:290] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:13:13.467984 22600 consensus_queue.cc:1059] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 21.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:13:13.469497 14155 leader_election.cc:304] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:13:13.471082 22599 raft_consensus.cc:2749] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:13.472307 14155 leader_election.cc:304] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:13:13.473588 22599 raft_consensus.cc:2749] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:13:13.474045 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 30 candidate_status { last_received { term: 28 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:13.474748 14339 raft_consensus.cc:2468] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 29.
I20260709 12:13:13.475116 22599 consensus_queue.cc:1048] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:13:13.477310 14155 leader_election.cc:304] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:13:13.478215 14229 leader_election.cc:304] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:13:13.478808 22599 raft_consensus.cc:2749] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:13.479216 22469 raft_consensus.cc:2804] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 12:13:13.479666 22469 raft_consensus.cc:493] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 29 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:13.480037 22469 raft_consensus.cc:3060] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:13:13.427369 22418 raft_consensus.cc:515] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:13.484020 22418 leader_election.cc:290] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 20 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:13:13.486163 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:13.485802 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:13.491165 22467 consensus_queue.cc:1059] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:13:13.491933 22590 consensus_queue.cc:1048] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:13:13.492882 22467 consensus_queue.cc:1243] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer 65c9c1653b3346b39a0e118540e6080c log is divergent from this leader: its last log entry 23.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 12:13:13.493592 14337 raft_consensus.cc:2468] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 21.
I20260709 12:13:13.493681 14263 raft_consensus.cc:3055] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:13:13.495697 14263 raft_consensus.cc:740] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:13:13.496661 14263 consensus_queue.cc:260] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.14, Last appended by leader: 14, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:13.498281 14263 raft_consensus.cc:3060] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:13.504266 14188 raft_consensus.cc:1275] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 28 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 26 index: 15. Preceding OpId from leader: term: 28 index: 16. (index mismatch)
I20260709 12:13:13.508910 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:13.509678 14335 raft_consensus.cc:2468] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 26.
I20260709 12:13:13.510807 14155 leader_election.cc:304] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
W20260709 12:13:13.511757 22606 log.cc:927] Time spent T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 12:13:13.524191 22519 leader_election.cc:290] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 30 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:13:13.515596 22469 raft_consensus.cc:515] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 30 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:13.531342 22469 leader_election.cc:290] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 30 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:13.539587 14263 raft_consensus.cc:1275] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 23 index: 14. (term mismatch)
I20260709 12:13:13.540786 14263 pending_rounds.cc:85] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec: Aborting all ops after (but not including) 13
I20260709 12:13:13.542300 14263 pending_rounds.cc:107] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec: Aborting uncommitted NO_OP operation due to leader change: 22.14
I20260709 12:13:13.544915 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:13.455999 14258 rpcz_store.cc:276] 0709 12:13:11.696498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:11.696615 (+   117us) service_pool.cc:224] Handling call
0709 12:13:11.702172 (+  5557us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:12.584280 (+882108us) spinlock_profiling.cc:243] Waited 161 ms on lock 0x7b18000a44c0. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f2127176646 00007f21270b058e 00007f2127131f9e 00007f21271337de 00007f212713db49 00007f212713e416 00007f212713ad8f 00007f212713a83e 00007f212c0ff419 00007f2125676bd4
0709 12:13:13.396666 (+812386us) spinlock_profiling.cc:243] Waited 25.3 ms on lock 0x7b580088fdd0. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f21270970aa 00007f2127119447 00007f2127131fe7 00007f21271337de 00007f212713db49 00007f212713e416 00007f212713ad8f 00007f212713a83e 00007f212c0ff419 00007f2125676bd4
0709 12:13:13.455333 (+ 58667us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:13.455585 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":429053056}
I20260709 12:13:13.546698 14263 raft_consensus.cc:2889] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:13.546185 14257 raft_consensus.cc:2468] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 21.
I20260709 12:13:13.561627 14908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:13:13.561802 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 30 candidate_status { last_received { term: 28 index: 13 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:13:13.562561 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:13:13.563020 14190 raft_consensus.cc:3060] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:13:13.580475 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
W20260709 12:13:13.493840 22499 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 20 current term: 20 is higher.
W20260709 12:13:13.605095 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 62386.6us
W20260709 12:13:13.607061 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 59208.4us
W20260709 12:13:13.616021 14229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:13.634740 14229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:13.666484 14190 raft_consensus.cc:2468] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 30 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 30.
I20260709 12:13:13.670066 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:13:13.617622 22599 raft_consensus.cc:493] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:13.564464 22576 raft_consensus.cc:493] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:13.620090 22531 raft_consensus.cc:493] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:13:13.610538 22517 raft_consensus.cc:493] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:13.615434 22519 raft_consensus.cc:493] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:13:13.692258 14257 raft_consensus.cc:1240] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 25 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 24. Current term is 25. Ops: []
I20260709 12:13:13.682991 14229 leader_election.cc:304] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 30 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:13:13.706470 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:13:13.707962 22501 consensus_queue.cc:1059] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 24.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 12:13:13.710067 22501 raft_consensus.cc:3055] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:13:13.710444 22501 raft_consensus.cc:740] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:13:13.711429 22501 consensus_queue.cc:260] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.17, Last appended by leader: 17, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:13.712772 22501 raft_consensus.cc:3060] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:13.618198 22452 consensus_queue.cc:1048] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.085s
I20260709 12:13:13.703084 22517 raft_consensus.cc:515] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:13.638660 22508 consensus_queue.cc:1048] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.084s
I20260709 12:13:13.685819 22576 raft_consensus.cc:515] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } }
I20260709 12:13:13.720914 22576 leader_election.cc:290] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:13:13.705260 22519 raft_consensus.cc:515] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:13:13.722576 22528 consensus_meta.cc:287] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.512s	user 0.008s	sys 0.003s
I20260709 12:13:13.723445 14260 raft_consensus.cc:1275] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 28 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 27 index: 16. Preceding OpId from leader: term: 28 index: 16. (term mismatch)
I20260709 12:13:13.723794 14260 pending_rounds.cc:85] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec: Aborting all ops after (but not including) 15
I20260709 12:13:13.724013 14260 pending_rounds.cc:107] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec: Aborting uncommitted NO_OP operation due to leader change: 27.16
I20260709 12:13:13.724226 14260 raft_consensus.cc:2889] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 28 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:13:13.739840 22295 consensus_meta.cc:287] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec: Time spent flushing consensus metadata: real 0.503s	user 0.013s	sys 0.000s
I20260709 12:13:13.742648 22575 raft_consensus.cc:3055] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:13:13.743065 22575 raft_consensus.cc:740] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
W20260709 12:13:13.743297 22588 consensus_meta.cc:287] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db: Time spent flushing consensus metadata: real 0.523s	user 0.009s	sys 0.004s
I20260709 12:13:13.743981 22575 consensus_queue.cc:260] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } }
I20260709 12:13:13.745357 22575 raft_consensus.cc:3060] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:13.751360 14876 leader_election.cc:304] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:13.753887 22458 raft_consensus.cc:2749] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:13:13.756578 22468 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 23 current term: 23 is higher.
I20260709 12:13:13.743897 22588 raft_consensus.cc:515] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:13.767920 22588 leader_election.cc:290] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 21 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:13:13.771176 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:13:13.773316 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:13:13.773887 22366 raft_consensus.cc:493] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:13:13.774302 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a4b57f88ee477d8c90d6b0f0cf2e57" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:13:13.774492 22366 raft_consensus.cc:515] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:13.776634 14903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 30 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:13:13.777139 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:13.776654 22366 leader_election.cc:290] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:13:13.778189 14183 raft_consensus.cc:2468] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 21.
I20260709 12:13:13.785641 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:13:13.786471 14181 raft_consensus.cc:2393] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db in current term 21: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:13:13.787377 22510 raft_consensus.cc:3055] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:13:13.787777 22510 raft_consensus.cc:740] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:13:13.788611 22510 consensus_queue.cc:260] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:13.790827 22517 leader_election.cc:290] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:13:13.795553 21953 raft_consensus.cc:3060] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:13.800909 22415 raft_consensus.cc:3060] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:13.804600 22510 raft_consensus.cc:3060] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:13.810674 14265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53050 (request call id 1743) took 1116 ms. Trace:
I20260709 12:13:13.811100 14265 rpcz_store.cc:276] 0709 12:13:12.694292 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:12.694532 (+   240us) service_pool.cc:224] Handling call
0709 12:13:12.694954 (+   422us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:13:13.381970 (+687016us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:13.810426 (+428456us) spinlock_profiling.cc:243] Waited 681 ms on lock 0x7b5400101b54. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713be01 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2 00007f212547648c 00007f21254758c6
0709 12:13:13.810606 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1566642560}
I20260709 12:13:13.814833 22508 consensus_queue.cc:1059] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 12:13:13.815739 22508 raft_consensus.cc:3055] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 29 LEADER]: Stepping down as leader of term 29
I20260709 12:13:13.816066 22508 raft_consensus.cc:740] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 29 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:13:13.817210 14330 raft_consensus.cc:1275] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 29 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 27 index: 17. Preceding OpId from leader: term: 29 index: 18. (index mismatch)
I20260709 12:13:13.816921 22508 consensus_queue.cc:260] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 29.18, Last appended by leader: 18, Current term: 29, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:13.820919 22508 raft_consensus.cc:3060] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:13:13.828644 14877 leader_election.cc:304] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:13.829628 22433 raft_consensus.cc:2749] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:13:13.014587 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:13.842577 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57e398f580944f0866ea5fab71be87f" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:13:13.850369 14911 raft_consensus.cc:2468] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 24.
W20260709 12:13:13.874782 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 191647us
I20260709 12:13:13.690438 22531 raft_consensus.cc:515] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } }
I20260709 12:13:13.910151 22492 raft_consensus.cc:493] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:13.910832 22492 raft_consensus.cc:515] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:13.913219 22492 leader_election.cc:290] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:13:13.915577 14183 raft_consensus.cc:1240] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 20. Current term is 21. Ops: [20.13-20.13]
I20260709 12:13:13.918445 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:13:13.920543 22512 raft_consensus.cc:493] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:13:13.921402 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:13.921902 22502 raft_consensus.cc:493] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:13:13.922137 14256 raft_consensus.cc:2468] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 22.
I20260709 12:13:13.922461 22502 raft_consensus.cc:515] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:13.923486 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9bea0d16e44efabb5cdd53e3828438" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:13:13.925014 22502 leader_election.cc:290] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:13:13.927270 14911 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53200 (request call id 1088) took 1643 ms (client timeout 1912 ms). Trace:
W20260709 12:13:13.927688 14911 rpcz_store.cc:269] 0709 12:13:12.284311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:12.285142 (+   831us) service_pool.cc:224] Handling call
0709 12:13:13.927058 (+1641916us) spinlock_profiling.cc:243] Waited 1.42 s on lock 0x7b54007f0154. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a4571 00007f212713f2fa 00007f212c100b17 00007f212567b6d4 00007f212567b662 00007f212567b591 00007f212567b50c 00007f212567a7c2 00007f212547648c 00007f21254758c6 00007f212547526f
0709 12:13:13.927181 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3257381760}
I20260709 12:13:13.898141 22409 raft_consensus.cc:2804] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:13:13.875764 22540 raft_consensus.cc:493] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:13.930907 22540 raft_consensus.cc:515] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:13.676891 22599 raft_consensus.cc:515] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:13.932667 14260 raft_consensus.cc:2468] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 21.
I20260709 12:13:13.940310 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:13:13.940829 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:13:13.941133 14911 raft_consensus.cc:2393] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 22: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
W20260709 12:13:13.942121 14184 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.622s	user 0.025s	sys 0.025s
W20260709 12:13:13.943642 14184 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.626s	user 0.026s	sys 0.025s
I20260709 12:13:13.946492 14186 raft_consensus.cc:2468] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 21.
W20260709 12:13:13.950397 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 49398us
I20260709 12:13:13.952428 14229 leader_election.cc:304] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:13.921139 22512 raft_consensus.cc:515] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:13.955082 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:13:13.955816 14183 raft_consensus.cc:2468] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 22.
I20260709 12:13:13.956758 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:13:13.959252 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15f7cecfe772454980c8ae9d1803fe98" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:13:13.966476 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:13.967231 14331 raft_consensus.cc:2468] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 22.
I20260709 12:13:13.954319 22415 raft_consensus.cc:493] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:13:13.968705 22415 raft_consensus.cc:515] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:13.970795 22512 leader_election.cc:290] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:13:13.974278 14264 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.604s	user 0.007s	sys 0.020s
W20260709 12:13:13.981169 14264 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.611s	user 0.007s	sys 0.020s
I20260709 12:13:13.974581 14877 leader_election.cc:304] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
W20260709 12:13:13.976233 14230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:13.978056 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:13:13.905133 22499 raft_consensus.cc:2804] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 30 FOLLOWER]: Leader election won for term 30
I20260709 12:13:13.990278 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:13.995492 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:13.996743 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afce5304599246a580d798fc0c843964" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:14.003053 14877 leader_election.cc:304] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:14.002168 14256 raft_consensus.cc:2468] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 22.
I20260709 12:13:13.933319 22519 leader_election.cc:290] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:13:13.975798 14155 leader_election.cc:304] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:13:13.947958 22547 raft_consensus.cc:493] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:13:13.971453 22523 raft_consensus.cc:493] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:14.013515 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
W20260709 12:13:13.974227 22466 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.733s	user 0.007s	sys 0.020s
I20260709 12:13:14.020394 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:13.936615 22599 leader_election.cc:290] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:14.026378 14259 raft_consensus.cc:2468] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 22.
I20260709 12:13:14.031694 14910 raft_consensus.cc:2393] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 24: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
W20260709 12:13:14.033298 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 57579.1us
I20260709 12:13:14.017436 22468 raft_consensus.cc:493] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:13:14.036580 22468 raft_consensus.cc:515] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:14.014194 22511 raft_consensus.cc:2804] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:13:14.038378 22510 raft_consensus.cc:2804] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:14.038848 22510 raft_consensus.cc:493] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:14.039012 22468 leader_election.cc:290] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:14.039306 22510 raft_consensus.cc:3060] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:14.018198 22517 raft_consensus.cc:493] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:13:14.042228 22517 raft_consensus.cc:515] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:14.044798 22517 leader_election.cc:290] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:14.010397 22492 raft_consensus.cc:2804] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 12:13:14.028131 22466 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.787s	user 0.008s	sys 0.020s
I20260709 12:13:13.970795 22415 leader_election.cc:290] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:13:13.971447 22597 raft_consensus.cc:493] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:13:13.996716 14229 leader_election.cc:304] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 73d01e9b1a9d49358da4985b21d681db
W20260709 12:13:14.058281 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 442037us
W20260709 12:13:14.034160 22578 log.cc:927] Time spent T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 12:13:14.021304 22499 raft_consensus.cc:697] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 30 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:13:14.048943 22506 raft_consensus.cc:2804] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [term 21 FOLLOWER]: Leader election won for term 21
W20260709 12:13:14.067302 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 87305.6us
I20260709 12:13:14.080112 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:13:14.071332 14304 leader_election.cc:304] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:13:14.085667 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:13:14.057214 22492 raft_consensus.cc:493] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:14.053867 22518 raft_consensus.cc:493] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
W20260709 12:13:14.092396 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 95804.3us
I20260709 12:13:14.080874 14184 raft_consensus.cc:2468] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 22.
I20260709 12:13:14.100741 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60aca7b73a544dfc9a4bd6918b27d132" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:13:14.057623 22511 raft_consensus.cc:697] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 24 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:13:14.102622 14230 leader_election.cc:304] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:13:14.103935 14229 leader_election.cc:304] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:14.029422 22547 raft_consensus.cc:515] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:14.034365 22523 raft_consensus.cc:515] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:14.107976 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:14.112200 14230 leader_election.cc:304] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:13:14.113247 14303 leader_election.cc:304] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:14.115302 14256 raft_consensus.cc:2468] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 21.
I20260709 12:13:14.078840 22468 raft_consensus.cc:493] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:13:14.097798 22492 raft_consensus.cc:3060] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:14.122370 14229 leader_election.cc:304] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:13:14.097381 22466 raft_consensus.cc:2804] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:14.127943 14230 leader_election.cc:304] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:13:14.070137 22597 raft_consensus.cc:515] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:14.088831 22452 consensus_queue.cc:1048] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.033s
I20260709 12:13:14.093525 22624 raft_consensus.cc:2804] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:14.163069 14262 raft_consensus.cc:1275] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 29 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 28 index: 15. Preceding OpId from leader: term: 29 index: 16. (index mismatch)
W20260709 12:13:14.166544 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 53381.9us
I20260709 12:13:14.168088 14303 leader_election.cc:304] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:14.113538 22295 raft_consensus.cc:2749] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:14.175782 14337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:14.175405 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:14.176626 14337 raft_consensus.cc:2393] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 22: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
W20260709 12:13:14.179435 14229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:14.179497 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 29 candidate_status { last_received { term: 28 index: 14 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:14.127067 22506 raft_consensus.cc:697] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [term 21 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:13:14.184276 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:13:14.184737 14155 leader_election.cc:304] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:13:14.184953 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 30 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:13:14.189689 14188 raft_consensus.cc:2468] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 23.
I20260709 12:13:14.109786 22518 raft_consensus.cc:515] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:14.132102 22466 raft_consensus.cc:493] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:13:14.177337 22309 raft_consensus.cc:2749] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 12:13:14.171672 22578 log.cc:927] Time spent T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:13:14.135221 22590 raft_consensus.cc:2804] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:14.172492 21953 raft_consensus.cc:2749] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:14.114593 22576 consensus_queue.cc:1048] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.064s
I20260709 12:13:14.217203 22506 consensus_queue.cc:237] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:14.195421 22512 raft_consensus.cc:2749] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:14.128955 22519 raft_consensus.cc:2804] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:14.161245 22468 raft_consensus.cc:515] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:14.189858 14332 raft_consensus.cc:3060] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:13:14.194784 14155 leader_election.cc:304] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:13:14.136451 22531 leader_election.cc:290] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187)
I20260709 12:13:14.174007 22422 raft_consensus.cc:2749] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:13:14.172051 22624 raft_consensus.cc:493] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
W20260709 12:13:14.188498 22615 log.cc:927] Time spent T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:13:14.204406 14876 leader_election.cc:304] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
W20260709 12:13:14.192320 22619 log.cc:927] Time spent T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 12:13:14.206705 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:14.149358 22540 leader_election.cc:290] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:13:14.207557 14336 raft_consensus.cc:1240] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 19. Current term is 20. Ops: []
W20260709 12:13:14.154445 22611 log.cc:927] Time spent T 90097151efa7426faeaea3ff87a7ea78 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.225s	user 0.002s	sys 0.002s
I20260709 12:13:14.200374 22466 raft_consensus.cc:3060] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:14.222496 22519 raft_consensus.cc:493] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:13:14.205891 22590 raft_consensus.cc:493] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:13:14.179440 22499 consensus_queue.cc:237] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 28.13, Last appended by leader: 13, Current term: 30, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:14.235868 22599 raft_consensus.cc:2804] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:14.263474 14304 leader_election.cc:304] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:13:14.247277 22507 raft_consensus.cc:2804] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:14.271324 22547 leader_election.cc:290] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:14.256620 22519 raft_consensus.cc:3060] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:14.276111 22468 leader_election.cc:290] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:14.277194 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 29 candidate_status { last_received { term: 28 index: 14 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:13:14.280081 14184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938efad339fd47e1b0b6d37fbc612db2" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:13:14.282902 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 29 candidate_status { last_received { term: 28 index: 14 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:14.242147 22624 raft_consensus.cc:3060] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:14.284996 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f548bfe8d3c540e487760b5966d0e7f8" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 29 candidate_status { last_received { term: 28 index: 14 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:14.287730 22622 raft_consensus.cc:2804] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:14.202401 22511 consensus_queue.cc:237] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.17, Last appended by leader: 17, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:14.269606 22518 leader_election.cc:290] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:14.300930 14332 raft_consensus.cc:2468] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 30 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 30.
I20260709 12:13:14.262960 22590 raft_consensus.cc:3060] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:14.312179 14155 leader_election.cc:304] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:13:14.309089 22622 raft_consensus.cc:493] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:14.343917 22622 raft_consensus.cc:3060] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:14.345994 22547 raft_consensus.cc:2749] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:13:14.283659 22599 raft_consensus.cc:493] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:13:14.347096 22599 raft_consensus.cc:3060] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:14.291507 22507 raft_consensus.cc:493] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:14.350179 22507 raft_consensus.cc:3060] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:14.254465 22510 raft_consensus.cc:515] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:14.314203 14230 leader_election.cc:304] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 30 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:13:14.319155 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:13:14.356333 22468 raft_consensus.cc:2804] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 30 FOLLOWER]: Leader election won for term 30
I20260709 12:13:14.356755 22518 raft_consensus.cc:493] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:14.357419 22518 raft_consensus.cc:515] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:14.358304 22468 raft_consensus.cc:697] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 30 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:13:14.359936 22518 leader_election.cc:290] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:14.286216 22295 raft_consensus.cc:493] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:13:14.320345 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:13:14.361974 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 29 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:13:14.363437 22468 consensus_queue.cc:237] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 27.17, Last appended by leader: 17, Current term: 30, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:14.320608 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:14.376185 14333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e5f03a80374104a130f5b0e70a0280" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 29 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:14.382758 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:14.361227 22295 raft_consensus.cc:515] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:14.397210 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:14.406327 14229 leader_election.cc:304] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:14.411478 14229 leader_election.cc:304] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:14.418915 14229 leader_election.cc:304] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:14.420564 22518 raft_consensus.cc:2749] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:13:14.414619 22597 leader_election.cc:290] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:14.423476 22521 raft_consensus.cc:2749] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:13:14.415028 14303 leader_election.cc:304] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:14.425967 14229 leader_election.cc:304] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:14.429652 14229 leader_election.cc:304] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:14.432690 22452 raft_consensus.cc:2749] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:13:14.439765 22622 raft_consensus.cc:515] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } }
I20260709 12:13:14.443449 22295 leader_election.cc:290] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:14.444026 22590 raft_consensus.cc:515] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } }
I20260709 12:13:14.446280 22590 leader_election.cc:290] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187)
I20260709 12:13:14.448321 14906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53200 (request call id 1087) took 2164 ms. Trace:
I20260709 12:13:14.448729 14906 rpcz_store.cc:276] 0709 12:13:12.283940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:12.284097 (+   157us) service_pool.cc:224] Handling call
0709 12:13:12.284493 (+   396us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:12.284918 (+   425us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:12.284947 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:13.253643 (+968696us) spinlock_profiling.cc:243] Waited 9.05 ms on lock 0x7b2c00125df8. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2125a34a11 00007f2125a44372 00007f2127176a01 00007f212713b43a 00007f212713a83e 00007f212c0ff419 00007f2125676bd4 00007f2125676b62 00007f2125676a91 00007f2125676a0c 00007f2125675cc2
0709 12:13:13.259564 (+  5921us) log.cc:844] Serialized 26 byte log entry
0709 12:13:13.617221 (+357657us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:13:13.617956 (+   735us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:13.618033 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:14.153853 (+535820us) spinlock_profiling.cc:243] Waited 28.4 ms on lock 0x7b4400022b4c. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2123f74c85 00007f2123f756a2 00007f2126ce71db 00007f2126ce2aaf 00007f2126cd686e 00007f2126cd5bb6 00007f2126cd57d8 00007f2126cdf221 00007f2126cdf1d9 00007f2126cdf169
0709 12:13:14.393654 (+239801us) spinlock_profiling.cc:243] Waited 19.5 ms on lock 0x7b2400318d88. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2123ed49c4 00007f2123ed2acb 00007f212408ddc9 00007f212408da55 00007f212408cfb0 00007f2126d03488 00007f2126d03be8 00007f2126cdb398 00007f2126cd676a 00007f2126cd5bb6
0709 12:13:14.448041 (+ 54387us) raft_consensus.cc:1685] finished
0709 12:13:14.448065 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:14.448216 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6827,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":119,"spinlock_wait_cycles":131091968,"thread_start_us":291647,"threads_started":1,"wal-append.queue_time_us":639143}
I20260709 12:13:14.452292 22409 raft_consensus.cc:493] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 26 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:13:14.452881 22409 raft_consensus.cc:3060] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:14.456935 22599 raft_consensus.cc:515] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:14.460331 22492 raft_consensus.cc:515] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:14.467172 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:13:14.414434 22575 raft_consensus.cc:2749] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:14.491789 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:13:14.432374 22531 raft_consensus.cc:2749] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:14.471947 22295 raft_consensus.cc:2749] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:13:14.522807 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c03baacf444c019b39ae64998e2686" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:14.499433 22415 raft_consensus.cc:493] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:13:14.512081 22622 leader_election.cc:290] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 23 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:13:14.535569 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:13:14.538995 14332 raft_consensus.cc:2368] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 22. Current term is 23.
I20260709 12:13:14.512907 22507 raft_consensus.cc:515] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 25 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:14.558810 22507 leader_election.cc:290] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 25 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:13:14.559502 22612 log.cc:927] Time spent T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.630s	user 0.003s	sys 0.000s
I20260709 12:13:14.561303 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 30 candidate_status { last_received { term: 28 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:13:14.562091 14331 raft_consensus.cc:3060] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:13:14.566879 22409 raft_consensus.cc:515] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:14.569032 22590 raft_consensus.cc:493] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:13:14.576025 14331 raft_consensus.cc:2468] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 30 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 30.
I20260709 12:13:14.574281 14182 raft_consensus.cc:2468] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 22.
I20260709 12:13:14.578853 22590 raft_consensus.cc:515] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:14.585215 22590 leader_election.cc:290] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:14.589694 14331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:14.590741 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:13:14.591498 14181 raft_consensus.cc:2468] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 22.
I20260709 12:13:14.594982 14331 raft_consensus.cc:2393] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 22: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:13:14.604969 14229 leader_election.cc:304] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:13:14.541872 22415 raft_consensus.cc:515] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:14.621176 22531 raft_consensus.cc:2804] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:14.616641 22409 leader_election.cc:290] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 27 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:14.628509 22492 leader_election.cc:290] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 23 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:13:14.659874 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 137989us
I20260709 12:13:14.650342 22531 raft_consensus.cc:493] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:13:14.666008 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:13:14.667266 14263 raft_consensus.cc:3060] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:14.652769 22574 raft_consensus.cc:2749] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:14.656881 22599 leader_election.cc:290] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 22 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:13:14.682361 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:13:14.629123 22624 raft_consensus.cc:515] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:14.667833 22531 raft_consensus.cc:3060] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:14.692237 14263 raft_consensus.cc:2468] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 23.
I20260709 12:13:14.694607 14877 leader_election.cc:304] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:13:14.709357 14338 raft_consensus.cc:1240] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 21. Current term is 22. Ops: []
W20260709 12:13:14.712718 22632 log.cc:927] Time spent T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:13:14.714896 22466 raft_consensus.cc:515] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:13:14.715714 22631 log.cc:927] Time spent T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:13:14.720492 22466 leader_election.cc:290] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:13:14.722878 14176 tablet_service.cc:1558] Processing DeleteTablet for tablet 35b39d0f3270452a8bd4f4b1800a837c with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 6 (current committed config index is 12)) from {username='slave'} at 127.0.0.1:45350
I20260709 12:13:14.724732 14087 catalog_manager.cc:5697] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 15 to 17, leader changed from 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) to 885067a0d31741bfb5c9935788e315bf (127.12.174.129). New cstate: current_term: 17 leader_uuid: "885067a0d31741bfb5c9935788e315bf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:13:14.731635 22409 consensus_queue.cc:1048] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:13:14.732472 22409 consensus_queue.cc:1243] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer 17aab1bbf5014936aa18cc21818b26ec log is divergent from this leader: its last log entry 28.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 12:13:14.735208 22523 leader_election.cc:290] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:14.736475 14183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
W20260709 12:13:14.721490 14084 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60410 (request call id 262) took 24932 ms (client timeout 15000 ms). Trace:
I20260709 12:13:14.739120 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 30 candidate_status { last_received { term: 28 index: 15 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:13:14.737582 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:13:14.726910 14087 catalog_manager.cc:5697] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 22 to 24, leader changed from 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130) to 73d01e9b1a9d49358da4985b21d681db (127.12.174.132). New cstate: current_term: 24 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:14.747884 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 30 candidate_status { last_received { term: 28 index: 15 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:14.703006 22460 raft_consensus.cc:2804] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:13:14.758558 14087 catalog_manager.cc:5697] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 18 to 21, leader changed from 65c9c1653b3346b39a0e118540e6080c (127.12.174.131) to 73d01e9b1a9d49358da4985b21d681db (127.12.174.132). New cstate: current_term: 21 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:13:14.763597 22635 log.cc:927] Time spent T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:13:14.767550 22415 leader_election.cc:290] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:14.768524 14087 catalog_manager.cc:5697] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 20 to 21, leader changed from 65c9c1653b3346b39a0e118540e6080c (127.12.174.131) to 73d01e9b1a9d49358da4985b21d681db (127.12.174.132). New cstate: current_term: 21 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:14.785473 14155 leader_election.cc:304] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
W20260709 12:13:14.738386 14084 rpcz_store.cc:269] 0709 12:12:49.789003 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:49.789377 (+   374us) service_pool.cc:224] Handling call
0709 12:13:14.721367 (+24931990us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:13:10.589959 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:13:10.590524 (+   565us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:13:10.590584 (+    60us) write_op.cc:435] Acquired schema lock
0709 12:13:10.590605 (+    21us) tablet.cc:662] Decoding operations
0709 12:13:10.591301 (+   696us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:13:10.591424 (+   123us) write_op.cc:641] Partition lock acquired for write op
0709 12:13:10.591450 (+    26us) tablet.cc:685] Acquiring locks for 4 operations
0709 12:13:10.685208 (+ 93758us) tablet.cc:701] Row locks acquired
0709 12:13:10.712796 (+ 27588us) write_op.cc:260] PREPARE: finished
0709 12:13:10.745436 (+ 32640us) write_op.cc:270] Start()
0709 12:13:10.792452 (+ 47016us) write_op.cc:276] Timestamp: P: 1783599190735348 usec, L: 0
0709 12:13:10.805807 (+ 13355us) op_driver.cc:348] REPLICATION: starting
0709 12:13:10.869215 (+ 63408us) log.cc:844] Serialized 1708 byte log entry
0709 12:13:11.594531 (+725316us) op_driver.cc:464] REPLICATION: finished
0709 12:13:11.906372 (+311841us) write_op.cc:301] APPLY: starting
0709 12:13:11.906493 (+   121us) tablet.cc:1367] starting BulkCheckPresence
0709 12:13:11.918234 (+ 11741us) tablet.cc:1370] finished BulkCheckPresence
0709 12:13:11.918364 (+   130us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:13:11.920953 (+  2589us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:13:11.921203 (+   250us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=8,key_file_lookups=8,delta_file_lookups=8,mrs_lookups=0
0709 12:13:11.921250 (+    47us) write_op.cc:312] APPLY: finished
0709 12:13:11.921537 (+   287us) log.cc:844] Serialized 49 byte log entry
0709 12:13:11.921767 (+   230us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:11.921882 (+   115us) write_op.cc:454] Released schema lock
0709 12:13:11.921934 (+    52us) write_op.cc:341] FINISH: Updating metrics
0709 12:13:11.922385 (+   451us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:11.922416 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":151947,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":303970,"apply.run_cpu_time_us":7712,"apply.run_wall_time_us":15980,"cfile_cache_hit":18,"cfile_cache_hit_bytes":20879,"num_ops":4,"prepare.queue_time_us":257787,"prepare.run_cpu_time_us":22102,"prepare.run_wall_time_us":373898,"raft.queue_time_us":217205,"raft.run_cpu_time_us":40084,"raft.run_wall_time_us":375853,"replication_time_us":766217,"thread_start_us":570764,"threads_started":4,"wal-append.queue_time_us":257504,"wal-append.run_cpu_time_us":27721,"wal-append.run_wall_time_us":1802985}]]}
I20260709 12:13:14.786315 14087 catalog_manager.cc:5697] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:14.790238 22415 raft_consensus.cc:3060] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:14.769069 22460 raft_consensus.cc:697] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 23 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:13:14.804644 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:13:14.805406 14189 raft_consensus.cc:3060] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:14.808979 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
W20260709 12:13:14.810497 22620 log.cc:927] Time spent T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.594s	user 0.002s	sys 0.003s
I20260709 12:13:14.812695 14087 catalog_manager.cc:5697] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 16 to 17, leader changed from 65c9c1653b3346b39a0e118540e6080c (127.12.174.131) to 885067a0d31741bfb5c9935788e315bf (127.12.174.129). New cstate: current_term: 17 leader_uuid: "885067a0d31741bfb5c9935788e315bf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:13:14.815120 14087 catalog_manager.cc:5697] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 20 to 21, leader changed from 885067a0d31741bfb5c9935788e315bf (127.12.174.129) to 73d01e9b1a9d49358da4985b21d681db (127.12.174.132). New cstate: current_term: 21 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:14.822490 22624 leader_election.cc:290] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 22 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:13:14.825069 22510 leader_election.cc:290] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 23 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:14.829947 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:13:14.832036 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:13:14.832283 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:14.833038 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:13:14.830636 14262 raft_consensus.cc:3060] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:14.833841 14256 raft_consensus.cc:2368] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 22. Current term is 23.
I20260709 12:13:14.834195 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8efcd0417f0c412280654006e6389763" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:14.834471 14259 raft_consensus.cc:1217] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 29 FOLLOWER]: Deduplicated request from leader. Original: 24.13->[26.14-29.16]   Dedup: 26.14->[27.15-29.16]
I20260709 12:13:14.835734 14259 pending_rounds.cc:85] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec: Aborting all ops after (but not including) 14
I20260709 12:13:14.835968 14259 pending_rounds.cc:107] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec: Aborting uncommitted NO_OP operation due to leader change: 28.15
I20260709 12:13:14.836225 14259 raft_consensus.cc:2889] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 29 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:14.838876 14338 raft_consensus.cc:1275] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 30 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 27 index: 17. Preceding OpId from leader: term: 30 index: 18. (index mismatch)
I20260709 12:13:14.840380 14155 leader_election.cc:400] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 22 election: Vote denied by peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673) with higher term. Message: Invalid argument: T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 22. Current term is 23.
I20260709 12:13:14.840647 14155 leader_election.cc:403] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 22 election: Cancelling election due to peer responding with higher term
I20260709 12:13:14.842541 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:14.843163 14189 raft_consensus.cc:2468] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 23.
I20260709 12:13:14.844609 14087 catalog_manager.cc:5697] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 22 to 24, leader changed from 885067a0d31741bfb5c9935788e315bf (127.12.174.129) to 73d01e9b1a9d49358da4985b21d681db (127.12.174.132). New cstate: current_term: 24 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:14.825398 22460 consensus_queue.cc:237] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 21.17, Last appended by leader: 17, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:14.846184 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:13:14.831022 22468 raft_consensus.cc:493] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:13:14.849696 22547 raft_consensus.cc:2749] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Leader election lost for term 22. Reason: Vote denied by peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673) with higher term. Message: Invalid argument: T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 22. Current term is 23.
I20260709 12:13:14.851444 22519 raft_consensus.cc:515] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:14.838749 22517 raft_consensus.cc:493] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:14.855908 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:13:14.941995 14339 raft_consensus.cc:3060] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:14.856907 14230 leader_election.cc:304] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
W20260709 12:13:14.943322 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 86530us
I20260709 12:13:14.944219 14230 leader_election.cc:304] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:14.860468 22531 raft_consensus.cc:515] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:14.864892 14911 raft_consensus.cc:1240] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 25 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 24. Current term is 25. Ops: []
I20260709 12:13:14.867178 14906 raft_consensus.cc:1275] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 30 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 29 index: 18. Preceding OpId from leader: term: 30 index: 18. (term mismatch)
I20260709 12:13:14.959508 14906 pending_rounds.cc:85] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db: Aborting all ops after (but not including) 17
I20260709 12:13:14.959821 14906 pending_rounds.cc:107] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db: Aborting uncommitted NO_OP operation due to leader change: 29.18
I20260709 12:13:14.960072 14906 raft_consensus.cc:2889] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 30 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:14.870092 14190 raft_consensus.cc:1240] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 27 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 26. Current term is 27. Ops: []
W20260709 12:13:14.871698 22627 log.cc:927] Time spent T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.478s	user 0.002s	sys 0.000s
I20260709 12:13:14.872006 22415 raft_consensus.cc:2749] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:14.845342 14155 leader_election.cc:304] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:13:14.889366 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52421be255e4fab824173d17981b5bb" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:13:14.889873 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:13:14.893406 22485 raft_consensus.cc:493] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:13:14.895017 14229 leader_election.cc:304] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:13:14.895572 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
W20260709 12:13:14.971223 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 76298.1us
I20260709 12:13:14.906642 22494 consensus_queue.cc:1059] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
W20260709 12:13:14.929867 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 49429.3us
I20260709 12:13:14.917287 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:13:14.934126 14262 raft_consensus.cc:2468] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 23.
I20260709 12:13:14.939765 14087 catalog_manager.cc:5697] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:14.973235 14260 raft_consensus.cc:1240] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 21. Current term is 22. Ops: []
I20260709 12:13:14.956086 14256 raft_consensus.cc:1240] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 21. Current term is 22. Ops: []
W20260709 12:13:14.966688 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 121396us
I20260709 12:13:14.974428 14155 leader_election.cc:304] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:13:14.971251 14257 raft_consensus.cc:3060] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:14.899698 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd9d6c9c152f47769123b7748d8c8262" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:13:14.971875 14230 leader_election.cc:400] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 election: Vote denied by peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957) with higher term. Message: Invalid argument: T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec for earlier term 22. Current term is 23.
I20260709 12:13:14.975983 14185 raft_consensus.cc:3060] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:14.958967 22466 raft_consensus.cc:2749] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:14.957630 22431 raft_consensus.cc:493] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:14.958786 22523 raft_consensus.cc:2749] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:14.988797 14188 raft_consensus.cc:3060] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:14.985438 14229 leader_election.cc:304] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:14.970685 22597 raft_consensus.cc:2749] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:14.998248 14155 leader_election.cc:304] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:13:15.006045 14155 leader_election.cc:304] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:13:15.002811 14073 catalog_manager.cc:5028] TS 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): tablet 35b39d0f3270452a8bd4f4b1800a837c (table test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]) successfully deleted
W20260709 12:13:15.011503 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 66028.2us
I20260709 12:13:14.986346 22599 raft_consensus.cc:2749] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:14.963675 22517 raft_consensus.cc:515] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:14.945894 22468 raft_consensus.cc:515] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:15.006987 22502 raft_consensus.cc:2804] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Leader election won for term 23
W20260709 12:13:15.110319 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 96392.4us
I20260709 12:13:15.000396 22511 raft_consensus.cc:2749] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:13:15.020931 14188 raft_consensus.cc:2468] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 25.
W20260709 12:13:15.115576 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 116033us
I20260709 12:13:15.145970 14187 raft_consensus.cc:1275] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 30 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 28 index: 13. Preceding OpId from leader: term: 30 index: 14. (index mismatch)
I20260709 12:13:15.118155 22647 raft_consensus.cc:493] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:13:14.976634 22485 raft_consensus.cc:515] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:13:15.122725 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 143009us
I20260709 12:13:15.020985 22186 raft_consensus.cc:2749] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 12:13:14.995740 22431 raft_consensus.cc:515] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:15.003726 22295 consensus_queue.cc:1059] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 26.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.123s
I20260709 12:13:15.119354 22433 consensus_queue.cc:1059] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.039s
W20260709 12:13:15.157670 22613 log.cc:927] Time spent T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 1.223s	user 0.000s	sys 0.006s
I20260709 12:13:15.141853 14185 raft_consensus.cc:2468] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 23.
I20260709 12:13:15.025681 22574 consensus_queue.cc:1059] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.114s
I20260709 12:13:15.111089 22507 consensus_queue.cc:1059] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.028s
I20260709 12:13:15.106490 22466 consensus_queue.cc:1048] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.042s
I20260709 12:13:15.180157 22468 leader_election.cc:290] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:15.181133 22531 leader_election.cc:290] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:15.182392 22519 leader_election.cc:290] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:13:15.184259 22574 raft_consensus.cc:3055] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:13:15.184741 22574 raft_consensus.cc:740] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:13:15.186511 22295 raft_consensus.cc:3055] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 26 LEADER]: Stepping down as leader of term 26
I20260709 12:13:15.186959 22295 raft_consensus.cc:740] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:13:15.149262 22502 raft_consensus.cc:697] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 23 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
W20260709 12:13:15.115725 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 120276us
W20260709 12:13:15.197777 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 62676.2us
W20260709 12:13:15.202167 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 58096.4us
I20260709 12:13:15.202693 14230 leader_election.cc:304] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:15.204438 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:13:15.207505 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:13:15.220211 14262 raft_consensus.cc:1275] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 12:13:15.177662 22431 leader_election.cc:290] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:13:15.225309 22218 raft_consensus.cc:493] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:15.226099 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:13:15.167450 22648 consensus_queue.cc:1059] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.059s
W20260709 12:13:15.244084 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 77080.7us
I20260709 12:13:15.272173 14185 raft_consensus.cc:2468] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 22.
W20260709 12:13:15.232842 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 73850.2us
I20260709 12:13:15.161535 22647 raft_consensus.cc:515] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } }
I20260709 12:13:15.187822 22295 consensus_queue.cc:260] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 26.14, Last appended by leader: 14, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:15.253038 14261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41764 (request call id 4130) took 1931 ms. Trace:
I20260709 12:13:15.260896 22485 leader_election.cc:290] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:15.262434 22533 consensus_queue.cc:1048] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:13:15.264557 14257 raft_consensus.cc:2468] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 23.
I20260709 12:13:15.243472 14339 raft_consensus.cc:2468] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 23.
I20260709 12:13:15.279289 14229 leader_election.cc:304] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:13:15.283298 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:13:15.286660 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:15.244721 22218 raft_consensus.cc:515] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:15.290939 22647 leader_election.cc:290] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:13:15.185653 22574 consensus_queue.cc:260] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.18, Last appended by leader: 18, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:15.282217 14261 rpcz_store.cc:276] 0709 12:13:13.321461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:13.321658 (+   197us) service_pool.cc:224] Handling call
0709 12:13:13.322027 (+   369us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:13.322399 (+   372us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:13.322429 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:13.323061 (+   632us) log.cc:844] Serialized 26 byte log entry
0709 12:13:13.613996 (+290935us) raft_consensus.cc:1645] Marking committed up to 16
0709 12:13:13.614041 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:13.614113 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:14.989540 (+1375427us) spinlock_profiling.cc:243] Waited 23.5 ms on lock 0x7b4400022b4c. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2123f74c85 00007f2123f756a2 00007f2126ce71db 00007f2126ce2aaf 00007f2126cd686e 00007f2126cd5bb6 00007f2126cd57d8 00007f2126cdf221 00007f2126cdf1d9 00007f2126cdf169
0709 12:13:15.247346 (+257806us) raft_consensus.cc:1685] finished
0709 12:13:15.247369 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:15.252953 (+  5584us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5141,"raft.queue_time_us":8625,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":23759,"spinlock_wait_cycles":54033152,"thread_start_us":290253,"threads_started":1,"wal-append.queue_time_us":611093}
I20260709 12:13:15.245126 22469 consensus_queue.cc:1048] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.040s
I20260709 12:13:15.312075 14303 leader_election.cc:304] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
W20260709 12:13:15.313308 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 70196.4us
I20260709 12:13:15.314348 14185 raft_consensus.cc:1275] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 12:13:15.267282 22648 consensus_queue.cc:1048] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.040s
W20260709 12:13:15.294054 22590 consensus_queue.cc:1175] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "65c9c1653b3346b39a0e118540e6080c" responder_term: 26 status { last_received { term: 26 index: 14 } last_committed_idx: 14 last_received_current_leader { term: 26 index: 14 } }
I20260709 12:13:15.301632 22502 consensus_queue.cc:237] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:15.319509 22218 leader_election.cc:290] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:15.322520 22510 raft_consensus.cc:493] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:15.329101 22510 raft_consensus.cc:515] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:15.331930 22510 leader_election.cc:290] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:15.332468 22517 leader_election.cc:290] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:13:15.301898 22466 raft_consensus.cc:2804] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:13:15.336828 22466 raft_consensus.cc:697] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 22 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:13:15.337882 22466 consensus_queue.cc:237] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:15.299278 22499 raft_consensus.cc:2764] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Leader election decision vote started in defunct term 22: won
I20260709 12:13:15.341558 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:15.342396 14261 raft_consensus.cc:2468] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 25.
I20260709 12:13:15.345330 22427 raft_consensus.cc:493] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:13:15.345997 22427 raft_consensus.cc:515] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:15.348325 22427 leader_election.cc:290] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:13:15.348906 22427 raft_consensus.cc:2804] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:13:15.353065 22427 raft_consensus.cc:697] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 23 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:13:15.356978 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:13:15.357749 14181 raft_consensus.cc:2468] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 22.
I20260709 12:13:15.358336 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 31 candidate_status { last_received { term: 28 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:15.358556 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:15.359014 14330 raft_consensus.cc:2468] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 30.
I20260709 12:13:15.359215 14336 raft_consensus.cc:2468] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 24.
I20260709 12:13:15.361328 22542 consensus_queue.cc:1048] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:13:15.363655 14155 leader_election.cc:304] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:13:15.364935 22512 raft_consensus.cc:2804] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 30 FOLLOWER]: Leader pre-election won for term 31
I20260709 12:13:15.365361 22512 raft_consensus.cc:493] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 30 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:15.365694 22512 raft_consensus.cc:3060] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:13:15.349036 14303 leader_election.cc:304] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:13:15.363700 14339 raft_consensus.cc:1240] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 21. Current term is 22. Ops: []
I20260709 12:13:15.353163 14185 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:13:15.371922 14185 raft_consensus.cc:2393] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 21: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:13:15.373661 22608 raft_consensus.cc:2749] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:13:15.371021 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:13:15.375824 14906 raft_consensus.cc:2468] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 25.
I20260709 12:13:15.378919 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:13:15.379736 14339 raft_consensus.cc:2393] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 22: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:13:15.381132 22575 raft_consensus.cc:2749] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 12:13:15.382125 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c1eed5e91b4c908f1f9ebf315fbc6f" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:15.382476 14186 raft_consensus.cc:1240] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 25 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 24. Current term is 25. Ops: []
I20260709 12:13:15.390615 22435 raft_consensus.cc:3055] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:13:15.391153 22435 raft_consensus.cc:740] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:13:15.392130 22435 consensus_queue.cc:260] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:15.392993 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:15.393698 14263 raft_consensus.cc:2468] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 21.
I20260709 12:13:15.395330 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:15.396116 14259 raft_consensus.cc:2393] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 25: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:13:15.396466 14877 leader_election.cc:304] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:13:15.398111 22507 raft_consensus.cc:2804] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:13:15.398511 22507 raft_consensus.cc:493] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:15.398881 22507 raft_consensus.cc:3060] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 25 FOLLOWER]: Advancing to term 26
W20260709 12:13:15.395457 22627 log.cc:927] Time spent T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.390s	user 0.010s	sys 0.000s
I20260709 12:13:15.380823 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:13:15.412349 14336 raft_consensus.cc:2393] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 22: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:13:15.418166 14304 leader_election.cc:304] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:13:15.414770 14876 leader_election.cc:304] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:13:15.393936 22511 raft_consensus.cc:3055] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 19 LEADER]: Stepping down as leader of term 19
W20260709 12:13:15.425623 14230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:15.432619 14335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55492 (request call id 1765) took 1621 ms. Trace:
I20260709 12:13:15.433866 14230 leader_election.cc:304] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:15.356446 22427 consensus_queue.cc:237] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } }
I20260709 12:13:15.441463 22433 raft_consensus.cc:2804] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:13:15.446043 22139 consensus_queue.cc:1059] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:13:15.447599 22433 raft_consensus.cc:697] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 25 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:13:15.433072 14335 rpcz_store.cc:276] 0709 12:13:13.811347 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:13.811464 (+   117us) service_pool.cc:224] Handling call
0709 12:13:13.811794 (+   330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:13:13.812156 (+   362us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:13:13.812184 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:13:13.812778 (+   594us) log.cc:844] Serialized 26 byte log entry
0709 12:13:14.302015 (+489237us) raft_consensus.cc:1645] Marking committed up to 17
0709 12:13:14.314015 (+ 12000us) log.cc:844] Serialized 14 byte log entry
0709 12:13:14.314436 (+   421us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:13:14.314516 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:13:14.871373 (+556857us) spinlock_profiling.cc:243] Waited 7.8 ms on lock 0x7b24001f7168. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2123ed49c4 00007f2123ed2acb 00007f212408ddc9 00007f212408da55 00007f212408d09d 00007f2126cbf10e 00007f2126cd688c 00007f2126cd5bb6 00007f2126cd57d8 00007f2126cdf221
0709 12:13:15.395136 (+523763us) spinlock_profiling.cc:243] Waited 10.4 ms on lock 0x7b24001f7168. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2123ed49c4 00007f2123ed2acb 00007f212408ddc9 00007f212408da55 00007f212408d09d 00007f2126cbf10e 00007f2126cd688c 00007f2126cd5bb6 00007f2126cd57d8 00007f2126cdf221
0709 12:13:15.432404 (+ 37268us) raft_consensus.cc:1685] finished
0709 12:13:15.432426 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:13:15.432552 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":10931,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":864,"raft.run_cpu_time_us":204,"raft.run_wall_time_us":204,"spinlock_wait_cycles":41902080,"thread_start_us":488532,"threads_started":1,"wal-append.queue_time_us":580043}
I20260709 12:13:15.430163 22511 raft_consensus.cc:740] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:13:15.437259 22519 raft_consensus.cc:2749] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:15.439512 22435 raft_consensus.cc:3060] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:15.439036 22428 raft_consensus.cc:2804] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 12:13:15.489033 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 48732.3us
I20260709 12:13:15.475519 22428 raft_consensus.cc:493] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:13:15.490506 22428 raft_consensus.cc:3060] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:13:15.494333 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 74151.8us
I20260709 12:13:15.505723 14303 leader_election.cc:304] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:13:15.503700 22428 raft_consensus.cc:515] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } }
I20260709 12:13:15.509790 22428 leader_election.cc:290] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 21 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:13:15.512867 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:15.516366 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:13:15.514796 14330 raft_consensus.cc:2468] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 24.
I20260709 12:13:15.505046 22433 consensus_queue.cc:237] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.17, Last appended by leader: 17, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:15.510550 22511 consensus_queue.cc:260] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:15.531225 22511 raft_consensus.cc:3060] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:15.531410 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1947202e59d4516a1b38a1583a3242d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:13:15.534216 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 76024.9us
I20260709 12:13:15.526230 21928 raft_consensus.cc:2804] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:15.543254 21928 raft_consensus.cc:493] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:15.559188 22512 raft_consensus.cc:515] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 31 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:15.573035 22512 leader_election.cc:290] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 31 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:15.574060 22461 raft_consensus.cc:3055] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:13:15.562084 21928 raft_consensus.cc:3060] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:15.574555 22461 raft_consensus.cc:740] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:13:15.575174 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 31 candidate_status { last_received { term: 28 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:13:15.575881 14332 raft_consensus.cc:3060] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:13:15.575580 22461 consensus_queue.cc:260] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:15.578078 22461 raft_consensus.cc:3060] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:15.582377 22574 raft_consensus.cc:3060] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:15.585278 14303 leader_election.cc:304] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:13:15.589422 22663 raft_consensus.cc:2804] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:15.589943 22663 raft_consensus.cc:493] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:13:15.590318 22663 raft_consensus.cc:3060] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:15.596665 14185 raft_consensus.cc:1240] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 31 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 30. Current term is 31. Ops: [30.14-30.14]
I20260709 12:13:15.611737 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:13:15.617996 22599 raft_consensus.cc:493] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:13:15.618709 22599 raft_consensus.cc:515] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:13:15.620652 22667 log.cc:927] Time spent T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
W20260709 12:13:15.638859 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 45579.1us
I20260709 12:13:15.649708 14230 leader_election.cc:304] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:13:15.650372 22507 raft_consensus.cc:515] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 26 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:15.642110 14187 raft_consensus.cc:1275] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 21 index: 17. Preceding OpId from leader: term: 23 index: 18. (index mismatch)
I20260709 12:13:15.651366 22651 raft_consensus.cc:2804] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 25 FOLLOWER]: Leader pre-election won for term 26
W20260709 12:13:15.651675 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 55177.5us
I20260709 12:13:15.652066 22651 raft_consensus.cc:493] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:15.652468 22651 raft_consensus.cc:3060] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:15.651496 14230 leader_election.cc:304] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:15.654140 22499 raft_consensus.cc:2749] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 12:13:15.657893 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 72728.4us
I20260709 12:13:15.659060 22295 raft_consensus.cc:3060] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:15.652483 14229 leader_election.cc:304] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:13:15.668850 22511 raft_consensus.cc:2749] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:13:15.674198 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 31 candidate_status { last_received { term: 28 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:15.676827 22599 leader_election.cc:290] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:15.678700 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:15.681447 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:13:15.682410 14187 raft_consensus.cc:2393] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 21: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:13:15.682188 22139 consensus_queue.cc:1048] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 12:13:15.689374 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 31 candidate_status { last_received { term: 28 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:13:15.693027 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe93a4954a24795882e04fa537ddf4d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:15.696393 22455 raft_consensus.cc:493] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:13:15.697062 22455 raft_consensus.cc:515] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:15.700752 14332 raft_consensus.cc:2468] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 31 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 31.
I20260709 12:13:15.648075 14261 raft_consensus.cc:2468] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 21.
I20260709 12:13:15.723398 14330 raft_consensus.cc:1240] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 31 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 30. Current term is 31. Ops: []
I20260709 12:13:15.721566 14264 raft_consensus.cc:1275] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 21 index: 17. Preceding OpId from leader: term: 23 index: 18. (index mismatch)
I20260709 12:13:15.726195 14155 leader_election.cc:304] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:13:15.729326 14155 leader_election.cc:304] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 31 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:13:15.731624 14304 leader_election.cc:304] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:15.733023 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:15.746539 22455 leader_election.cc:290] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:13:15.748387 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:15.734652 22510 raft_consensus.cc:2749] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:15.736156 22502 raft_consensus.cc:2804] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 31 FOLLOWER]: Leader election won for term 31
I20260709 12:13:15.751044 22502 raft_consensus.cc:697] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 31 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:13:15.752274 22502 consensus_queue.cc:237] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 28.13, Last appended by leader: 13, Current term: 31, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:15.724642 22511 consensus_queue.cc:1059] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 28.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.030s
I20260709 12:13:15.755334 22511 raft_consensus.cc:3055] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 30 LEADER]: Stepping down as leader of term 30
I20260709 12:13:15.755795 22511 raft_consensus.cc:740] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 30 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:13:15.756270 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:13:15.757146 14188 raft_consensus.cc:2393] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 27: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:13:15.758191 22630 raft_consensus.cc:493] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:15.758872 22630 raft_consensus.cc:515] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } }
I20260709 12:13:15.762323 22508 consensus_queue.cc:1048] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 12:13:15.765056 14909 raft_consensus.cc:2393] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 26: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
I20260709 12:13:15.767282 21928 raft_consensus.cc:515] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:15.772358 22576 raft_consensus.cc:2804] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:13:15.772986 22576 raft_consensus.cc:697] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 21 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:13:15.784797 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
W20260709 12:13:15.736934 22661 log.cc:927] Time spent T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.199s	user 0.001s	sys 0.000s
I20260709 12:13:15.788560 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 22 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:15.792294 14258 raft_consensus.cc:2410] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for term 22 because replica has last-logged OpId of term: 20 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 12.
I20260709 12:13:15.789570 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 22 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:15.749101 22663 raft_consensus.cc:515] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 25 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:15.780504 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b317dbf6b7fd4860be0fa436e8b54807" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:13:15.795253 14190 raft_consensus.cc:3060] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:15.756879 22511 consensus_queue.cc:260] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 30.14, Last appended by leader: 14, Current term: 30, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:15.769631 21928 leader_election.cc:290] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 23 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:13:15.801898 14155 leader_election.cc:304] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:13:15.811233 14190 raft_consensus.cc:2468] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 23.
I20260709 12:13:15.790930 22630 leader_election.cc:290] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:15.773990 22576 consensus_queue.cc:237] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } }
I20260709 12:13:15.824319 22512 raft_consensus.cc:2749] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:15.835718 22511 raft_consensus.cc:3060] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:13:15.827795 22651 raft_consensus.cc:515] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 26 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:15.871017 22651 leader_election.cc:290] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 26 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:13:15.874032 14264 raft_consensus.cc:2468] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 27.
I20260709 12:13:15.875149 14188 raft_consensus.cc:1240] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 22. Current term is 23. Ops: []
I20260709 12:13:15.905975 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:13:15.906710 14330 raft_consensus.cc:3060] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 25 FOLLOWER]: Advancing to term 26
W20260709 12:13:15.967525 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 43897.7us
I20260709 12:13:15.974875 22663 leader_election.cc:290] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 25 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:13:15.992439 14332 raft_consensus.cc:1275] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
W20260709 12:13:15.974936 22672 log.cc:927] Time spent T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 12:13:16.002305 14339 raft_consensus.cc:1240] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 22. Current term is 23. Ops: []
I20260709 12:13:16.003017 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:13:16.004024 14258 raft_consensus.cc:2368] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for earlier term 25. Current term is 26.
I20260709 12:13:16.006666 22630 consensus_queue.cc:1048] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.003s
I20260709 12:13:16.011085 14330 raft_consensus.cc:2468] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 26.
W20260709 12:13:15.821380 22590 consensus_queue.cc:1175] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "65c9c1653b3346b39a0e118540e6080c" responder_term: 31 status { last_received { term: 26 index: 12 } last_committed_idx: 12 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 17aab1bbf5014936aa18cc21818b26ec for earlier term 30. Current term is 31. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:13:16.012456 14304 leader_election.cc:400] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 25 election: Vote denied by peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673) with higher term. Message: Invalid argument: T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for earlier term 25. Current term is 26.
I20260709 12:13:16.013628 14304 leader_election.cc:403] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 25 election: Cancelling election due to peer responding with higher term
I20260709 12:13:16.003998 22507 leader_election.cc:290] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 26 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:16.016391 22427 raft_consensus.cc:2749] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 26 FOLLOWER]: Leader election lost for term 25. Reason: Vote denied by peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673) with higher term. Message: Invalid argument: T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for earlier term 25. Current term is 26.
I20260709 12:13:16.025975 14304 leader_election.cc:304] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:16.027211 14303 leader_election.cc:304] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:13:16.030829 22665 raft_consensus.cc:2804] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:13:16.031324 22665 raft_consensus.cc:493] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 26 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:13:16.031705 22665 raft_consensus.cc:3060] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:16.032909 14264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:13:16.033829 14264 raft_consensus.cc:2393] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db in current term 26: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:13:16.035148 22295 consensus_queue.cc:1059] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:13:16.036072 22574 raft_consensus.cc:3055] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:13:16.036477 22574 raft_consensus.cc:740] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:13:16.033933 22427 raft_consensus.cc:2804] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:13:16.037367 22574 consensus_queue.cc:260] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.12, Last appended by leader: 12, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:16.038218 22427 raft_consensus.cc:697] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 23 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:13:16.038353 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:13:16.039160 14339 raft_consensus.cc:2393] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db in current term 26: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:13:16.039007 22574 raft_consensus.cc:3060] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:13:16.073660 14230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:16.043406 22427 consensus_queue.cc:237] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 21.11, Last appended by leader: 11, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:16.097147 22431 raft_consensus.cc:493] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:16.097959 22431 raft_consensus.cc:515] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:16.100231 22431 leader_election.cc:290] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:13:16.130568 22665 raft_consensus.cc:515] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:16.060719 14877 leader_election.cc:304] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
W20260709 12:13:16.152719 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 92132.2us
I20260709 12:13:16.158486 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:13:16.215077 14258 raft_consensus.cc:1275] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 12:13:16.158061 22533 raft_consensus.cc:2749] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 12:13:16.223836 22510 consensus_queue.cc:1048] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.004s
I20260709 12:13:16.235359 14910 raft_consensus.cc:2393] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 26: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
I20260709 12:13:16.133710 22665 leader_election.cc:290] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 27 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:13:16.282083 14230 leader_election.cc:304] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:13:16.287758 22574 raft_consensus.cc:2804] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:13:16.288746 22574 raft_consensus.cc:697] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 26 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:13:16.289856 22574 consensus_queue.cc:237] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.17, Last appended by leader: 17, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:16.304236 14259 raft_consensus.cc:1275] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 12:13:16.317940 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:16.321162 14259 raft_consensus.cc:2410] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for term 21 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
I20260709 12:13:16.322448 14910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:13:16.323685 14910 raft_consensus.cc:2368] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for earlier term 25. Current term is 26.
I20260709 12:13:16.329629 14182 raft_consensus.cc:1275] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 12:13:16.331547 14258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
W20260709 12:13:16.332139 22668 log.cc:927] Time spent T 00000000000000000000000000000000 P d07070be2c074f4cb9ad35f1580c4ef7: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:13:16.333066 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:13:16.338740 14303 leader_election.cc:400] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 25 election: Vote denied by peer 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341) with higher term. Message: Invalid argument: T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c for earlier term 25. Current term is 26.
I20260709 12:13:16.349963 14188 raft_consensus.cc:1275] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 25 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 25 index: 18. (index mismatch)
I20260709 12:13:16.351388 14181 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:13:16.357069 14181 raft_consensus.cc:2393] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 27: Already voted for candidate 885067a0d31741bfb5c9935788e315bf in this term.
I20260709 12:13:16.362092 14258 raft_consensus.cc:2468] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 27.
I20260709 12:13:16.360472 22427 consensus_queue.cc:1048] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.016s
I20260709 12:13:16.378587 14304 leader_election.cc:304] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
W20260709 12:13:16.383018 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 130632us
I20260709 12:13:16.383836 22309 consensus_queue.cc:1048] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.023s
I20260709 12:13:16.409536 14304 leader_election.cc:304] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:16.410725 22665 raft_consensus.cc:2804] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 27 FOLLOWER]: Leader election won for term 27
I20260709 12:13:16.411252 22665 raft_consensus.cc:697] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 27 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:13:16.412216 22665 consensus_queue.cc:237] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 26.14, Last appended by leader: 14, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:16.394995 22622 raft_consensus.cc:2749] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:16.429358 14261 raft_consensus.cc:1275] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 31 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 30 index: 14. Preceding OpId from leader: term: 31 index: 14. (term mismatch)
I20260709 12:13:16.429831 14261 pending_rounds.cc:85] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec: Aborting all ops after (but not including) 13
I20260709 12:13:16.430064 14261 pending_rounds.cc:107] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec: Aborting uncommitted NO_OP operation due to leader change: 30.14
I20260709 12:13:16.430332 14261 raft_consensus.cc:2889] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 31 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:16.434113 22676 consensus_queue.cc:1048] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 12:13:16.439060 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 51660.7us
I20260709 12:13:16.443939 14263 raft_consensus.cc:1275] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 25 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 24 index: 18. Preceding OpId from leader: term: 25 index: 18. (term mismatch)
I20260709 12:13:16.444694 14263 pending_rounds.cc:85] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec: Aborting all ops after (but not including) 17
I20260709 12:13:16.445055 14263 pending_rounds.cc:107] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec: Aborting uncommitted NO_OP operation due to leader change: 24.18
I20260709 12:13:16.445452 14263 raft_consensus.cc:2889] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 25 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:16.442113 22507 consensus_queue.cc:1048] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.004s
I20260709 12:13:16.522500 22574 raft_consensus.cc:493] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:16.509688 22630 raft_consensus.cc:493] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:13:16.522982 22139 consensus_queue.cc:1048] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.026s
W20260709 12:13:16.548624 14087 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44116 (request call id 164) took 16701 ms (client timeout 15000 ms). Trace:
W20260709 12:13:16.549167 14087 rpcz_store.cc:269] 0709 12:12:59.837021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:59.837388 (+   367us) service_pool.cc:224] Handling call
0709 12:13:16.537831 (+16700443us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:13:15.431497 (+     0us) spinlock_profiling.cc:243] Waited 2.47 ms on lock 0x7b54002e32a8. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f212d4f79e1 00007f212d4f664c 00007f212ab85adc 00007f212ab710a6 00007f212ab70d58 00007f212ab759f1 00007f212ab759a9 00007f212ab75939 00007f212ab75901 00007f212ab74b2d 0000000000388634
0709 12:13:15.438377 (+  6880us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:13:15.467538 (+ 29161us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:13:15.467578 (+    40us) write_op.cc:435] Acquired schema lock
0709 12:13:15.467597 (+    19us) tablet.cc:662] Decoding operations
0709 12:13:15.468595 (+   998us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:13:15.468675 (+    80us) write_op.cc:641] Partition lock acquired for write op
0709 12:13:15.468702 (+    27us) tablet.cc:685] Acquiring locks for 9 operations
0709 12:13:15.469453 (+   751us) tablet.cc:701] Row locks acquired
0709 12:13:15.469474 (+    21us) write_op.cc:260] PREPARE: finished
0709 12:13:15.469630 (+   156us) write_op.cc:270] Start()
0709 12:13:15.490554 (+ 20924us) write_op.cc:276] Timestamp: P: 1783599195469577 usec, L: 0
0709 12:13:15.490591 (+    37us) op_driver.cc:348] REPLICATION: starting
0709 12:13:15.491338 (+   747us) log.cc:844] Serialized 3628 byte log entry
0709 12:13:15.864542 (+373204us) op_driver.cc:464] REPLICATION: finished
0709 12:13:16.049801 (+185259us) write_op.cc:301] APPLY: starting
0709 12:13:16.049933 (+   132us) tablet.cc:1367] starting BulkCheckPresence
0709 12:13:16.111536 (+ 61603us) tablet.cc:1370] finished BulkCheckPresence
0709 12:13:16.111561 (+    25us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:13:16.268436 (+156875us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:13:16.268743 (+   307us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=18,key_file_lookups=18,delta_file_lookups=18,mrs_lookups=0
0709 12:13:16.268795 (+    52us) write_op.cc:312] APPLY: finished
0709 12:13:16.269127 (+   332us) log.cc:844] Serialized 89 byte log entry
0709 12:13:16.269354 (+   227us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:16.269525 (+   171us) write_op.cc:454] Released schema lock
0709 12:13:16.269580 (+    55us) write_op.cc:341] FINISH: Updating metrics
0709 12:13:16.311418 (+ 41838us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:16.311456 (+    38us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":934596,"reported_tablets":17,"child_traces":[["op",{"apply.queue_time_us":182574,"apply.run_cpu_time_us":15825,"apply.run_wall_time_us":263965,"cfile_cache_hit":38,"cfile_cache_hit_bytes":41819,"num_ops":9,"prepare.queue_time_us":179817,"prepare.run_cpu_time_us":15811,"prepare.run_wall_time_us":185250,"raft.queue_time_us":298333,"raft.run_cpu_time_us":38279,"raft.run_wall_time_us":153344,"replication_time_us":373765,"spinlock_wait_cycles":5701248,"thread_start_us":526063,"threads_started":4,"wal-append.queue_time_us":52615}]]}
I20260709 12:13:16.541033 22574 raft_consensus.cc:515] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:13:16.573951 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 84848.9us
I20260709 12:13:16.549356 22630 raft_consensus.cc:515] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:16.604626 22574 leader_election.cc:290] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:13:16.607168 22630 leader_election.cc:290] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:13:16.607698 14332 raft_consensus.cc:1275] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 31 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 26 index: 12. Preceding OpId from leader: term: 31 index: 14. (index mismatch)
I20260709 12:13:16.611045 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:16.612063 14257 raft_consensus.cc:2393] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 22: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:13:16.617241 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:13:16.619211 14909 raft_consensus.cc:2468] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 22.
I20260709 12:13:16.636253 14186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 26 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:13:16.637161 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 26 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:13:16.656077 14262 raft_consensus.cc:1275] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 12:13:16.621392 22502 consensus_queue.cc:1048] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.026s
I20260709 12:13:16.643642 14154 leader_election.cc:304] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:13:16.661784 14229 leader_election.cc:304] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:16.664748 22651 raft_consensus.cc:2749] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:16.667858 22502 raft_consensus.cc:2804] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:13:16.671700 22502 raft_consensus.cc:493] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Starting leader election (detected failure of leader 73d01e9b1a9d49358da4985b21d681db)
I20260709 12:13:16.672143 22502 raft_consensus.cc:3060] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:16.681437 22651 raft_consensus.cc:493] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:16.688838 22651 raft_consensus.cc:515] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:16.692533 22651 leader_election.cc:290] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:16.695973 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:13:16.742959 14190 raft_consensus.cc:1275] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 12:13:16.728509 22502 raft_consensus.cc:515] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:16.790115 22677 consensus_queue.cc:1048] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:13:16.793293 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:16.796664 14332 raft_consensus.cc:2468] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 20.
I20260709 12:13:16.794287 14335 raft_consensus.cc:1275] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 26 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 26 index: 18. (index mismatch)
I20260709 12:13:16.797845 22502 leader_election.cc:290] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 22 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:13:16.798468 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:13:16.799327 14263 raft_consensus.cc:2393] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 22: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:13:16.801318 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:13:16.807691 14906 raft_consensus.cc:3060] T 90097151efa7426faeaea3ff87a7ea78 P 73d01e9b1a9d49358da4985b21d681db [term 20 LEARNER]: Advancing to term 21
I20260709 12:13:16.817412 14182 raft_consensus.cc:1275] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 23 index: 12. (index mismatch)
I20260709 12:13:16.823314 14906 raft_consensus.cc:1275] T 90097151efa7426faeaea3ff87a7ea78 P 73d01e9b1a9d49358da4985b21d681db [term 21 LEARNER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 12:13:16.834471 14230 leader_election.cc:304] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:16.826349 14189 raft_consensus.cc:2955] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Committing config change with OpId 18.12: config changed from index -1 to 12, NON_VOTER 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } } }
I20260709 12:13:16.839601 14257 raft_consensus.cc:1275] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 23 index: 12. (term mismatch)
I20260709 12:13:16.840052 14257 pending_rounds.cc:85] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec: Aborting all ops after (but not including) 11
I20260709 12:13:16.840282 14257 pending_rounds.cc:107] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec: Aborting uncommitted NO_OP operation due to leader change: 22.12
I20260709 12:13:16.840510 14257 raft_consensus.cc:2889] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:16.841661 22651 raft_consensus.cc:2804] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:13:16.847023 22651 raft_consensus.cc:493] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:16.847357 22651 raft_consensus.cc:3060] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:16.841403 22576 consensus_queue.cc:1048] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.013s
I20260709 12:13:16.862252 22677 consensus_queue.cc:1048] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:13:16.841921 22590 consensus_queue.cc:1048] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.025s
I20260709 12:13:16.879935 22422 consensus_queue.cc:1048] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:13:16.886472 22701 raft_consensus.cc:493] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:13:16.887181 22701 raft_consensus.cc:515] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:16.889660 14182 raft_consensus.cc:1275] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 27 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 26 index: 14. Preceding OpId from leader: term: 27 index: 15. (index mismatch)
I20260709 12:13:16.891568 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:16.892448 14332 raft_consensus.cc:2393] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf in current term 20: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:13:16.893887 22701 leader_election.cc:290] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:16.895273 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:16.897779 22455 consensus_queue.cc:1048] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:13:16.912731 14909 raft_consensus.cc:2468] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 22.
I20260709 12:13:16.914361 14154 leader_election.cc:304] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:13:16.927846 22701 raft_consensus.cc:2804] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:13:16.928109 22455 consensus_queue.cc:1048] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.007s
I20260709 12:13:16.974884 14909 raft_consensus.cc:1275] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 26 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 26 index: 18. (index mismatch)
I20260709 12:13:16.969138 14087 catalog_manager.cc:5697] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "885067a0d31741bfb5c9935788e315bf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:13:16.976639 14087 catalog_manager.cc:5697] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 20 to 25. New cstate: current_term: 25 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:16.978338 14087 catalog_manager.cc:5697] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 24 to 26. New cstate: current_term: 26 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:16.979898 14087 catalog_manager.cc:5697] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 17 to 20, leader changed from 885067a0d31741bfb5c9935788e315bf (127.12.174.129) to 73d01e9b1a9d49358da4985b21d681db (127.12.174.132). New cstate: current_term: 20 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:16.984990 14330 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7"
dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
mode: GRACEFUL
new_leader_uuid: "885067a0d31741bfb5c9935788e315bf"
 from {username='slave'} at 127.0.0.1:50896
I20260709 12:13:16.985770 14330 raft_consensus.cc:606] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 22 LEADER]: Received request to transfer leadership to TS 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:16.974838 22701 raft_consensus.cc:697] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 22 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:13:16.990098 22701 consensus_queue.cc:237] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:17.020805 14910 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "35b39d0f3270452a8bd4f4b1800a837c"
dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
mode: GRACEFUL
new_leader_uuid: "17aab1bbf5014936aa18cc21818b26ec"
 from {username='slave'} at 127.0.0.1:38628
I20260709 12:13:16.995831 22590 consensus_queue.cc:1048] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.026s
I20260709 12:13:17.021781 14910 raft_consensus.cc:606] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Received request to transfer leadership to TS 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:13:17.032797 14910 raft_consensus.cc:614] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:13:17.026968 14257 raft_consensus.cc:1275] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 27 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 26 index: 14. Preceding OpId from leader: term: 27 index: 15. (index mismatch)
I20260709 12:13:17.035461 14087 catalog_manager.cc:5697] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 20 to 22, leader changed from 885067a0d31741bfb5c9935788e315bf (127.12.174.129) to 73d01e9b1a9d49358da4985b21d681db (127.12.174.132). New cstate: current_term: 22 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:17.061055 14087 catalog_manager.cc:5697] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 16 to 19, leader changed from 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) to 65c9c1653b3346b39a0e118540e6080c (127.12.174.131). New cstate: current_term: 19 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:13:17.062543 14087 catalog_manager.cc:5697] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 18 to 24, leader changed from 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) to 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130). New cstate: current_term: 24 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:13:17.063653 14087 catalog_manager.cc:5697] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 21 to 23. New cstate: current_term: 23 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:17.043663 22422 consensus_queue.cc:1048] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.016s
I20260709 12:13:17.064812 14087 catalog_manager.cc:5697] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 21 to 27. New cstate: current_term: 27 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:17.052771 22651 raft_consensus.cc:515] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:17.068198 14910 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080"
dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
mode: GRACEFUL
new_leader_uuid: "17aab1bbf5014936aa18cc21818b26ec"
 from {username='slave'} at 127.0.0.1:38628
I20260709 12:13:17.068851 14910 raft_consensus.cc:606] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 27 LEADER]: Received request to transfer leadership to TS 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:13:17.052907 22508 raft_consensus.cc:493] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:17.067535 14087 catalog_manager.cc:5697] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 19 to 20, leader changed from 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) to 885067a0d31741bfb5c9935788e315bf (127.12.174.129). New cstate: current_term: 20 leader_uuid: "885067a0d31741bfb5c9935788e315bf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:13:17.071542 14187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:13:17.072172 14187 raft_consensus.cc:3060] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Advancing to term 21
I20260709 12:13:17.072072 14087 catalog_manager.cc:5697] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 18 to 20, leader changed from 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) to 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130). New cstate: current_term: 20 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:13:17.073943 14263 raft_consensus.cc:2368] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 20. Current term is 21.
I20260709 12:13:17.073060 14087 catalog_manager.cc:5697] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 17 to 22, leader changed from 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) to 65c9c1653b3346b39a0e118540e6080c (127.12.174.131). New cstate: current_term: 22 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:13:17.084873 14155 leader_election.cc:400] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 20 pre-election: Vote denied by peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673) with higher term. Message: Invalid argument: T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 20. Current term is 21.
I20260709 12:13:17.085379 14155 leader_election.cc:403] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 20 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:13:17.136365 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:13:17.137128 14335 raft_consensus.cc:3060] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:17.146721 14187 raft_consensus.cc:2468] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 21.
I20260709 12:13:17.151877 14229 leader_election.cc:304] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:13:17.155220 14332 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ba1914a8ae9f4959971f147e578773fc"
dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
mode: GRACEFUL
new_leader_uuid: "885067a0d31741bfb5c9935788e315bf"
 from {username='slave'} at 127.0.0.1:50896
I20260709 12:13:17.120057 22622 raft_consensus.cc:493] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:17.123111 22651 leader_election.cc:290] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 21 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:17.082634 22508 raft_consensus.cc:515] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:17.143559 22511 raft_consensus.cc:493] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:17.167023 22511 raft_consensus.cc:515] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:17.169369 22511 leader_election.cc:290] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:13:17.177441 22511 raft_consensus.cc:2804] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:13:17.178062 22511 raft_consensus.cc:697] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 21 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:13:17.174540 14263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:17.178982 22511 consensus_queue.cc:237] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:17.179574 14263 raft_consensus.cc:2468] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 22.
I20260709 12:13:17.174971 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:17.182071 14877 leader_election.cc:304] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:13:17.183792 22699 raft_consensus.cc:2804] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:17.183934 14335 raft_consensus.cc:2468] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 21.
I20260709 12:13:17.184278 22699 raft_consensus.cc:493] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:17.171407 22508 leader_election.cc:290] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:17.184463 14332 raft_consensus.cc:606] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Received request to transfer leadership to TS 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:17.184921 14332 raft_consensus.cc:614] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:13:17.185112 22699 raft_consensus.cc:3060] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:17.152881 22510 raft_consensus.cc:2749] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: Vote denied by peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673) with higher term. Message: Invalid argument: T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 885067a0d31741bfb5c9935788e315bf for earlier term 20. Current term is 21.
I20260709 12:13:17.162235 22622 raft_consensus.cc:515] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:17.211664 22663 raft_consensus.cc:1064] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c: attempting to promote NON_VOTER 73d01e9b1a9d49358da4985b21d681db to VOTER
I20260709 12:13:17.222430 22622 leader_election.cc:290] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:13:17.223104 14330 raft_consensus.cc:2468] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 22.
I20260709 12:13:17.232365 14257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:17.233213 14257 raft_consensus.cc:2468] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 22.
I20260709 12:13:17.234592 14304 leader_election.cc:304] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
W20260709 12:13:17.236330 22663 raft_consensus.cc:1068] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c: Unable to promote non-voter 73d01e9b1a9d49358da4985b21d681db: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:13:17.238873 22576 raft_consensus.cc:2804] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:17.265245 22576 raft_consensus.cc:493] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:17.270766 22576 raft_consensus.cc:3060] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:13:17.305861 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 168985us
W20260709 12:13:17.360745 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 212374us
I20260709 12:13:17.362968 14182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf" is_pre_election: true
I20260709 12:13:17.388073 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:13:17.388821 14909 raft_consensus.cc:2468] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 22.
I20260709 12:13:17.408762 14229 leader_election.cc:304] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:17.437682 22590 raft_consensus.cc:2804] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:17.440279 22590 raft_consensus.cc:493] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:17.440829 22590 raft_consensus.cc:3060] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:17.463371 22699 raft_consensus.cc:515] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:17.469161 22699 leader_election.cc:290] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 23 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:17.483844 22576 raft_consensus.cc:515] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:17.488942 22576 leader_election.cc:290] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 23 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:13:17.490213 14087 catalog_manager.cc:5697] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:17.492028 14087 catalog_manager.cc:5697] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 24 to 26. New cstate: current_term: 26 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:17.528234 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:13:17.631322 14087 catalog_manager.cc:5697] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:17.635241 14909 raft_consensus.cc:2393] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 23: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
W20260709 12:13:17.636263 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 227601us
W20260709 12:13:17.638753 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 127779us
I20260709 12:13:17.643291 14261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:13:17.643985 14261 raft_consensus.cc:3060] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:17.654589 14910 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d"
dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
mode: GRACEFUL
new_leader_uuid: "885067a0d31741bfb5c9935788e315bf"
 from {username='slave'} at 127.0.0.1:38628
I20260709 12:13:17.655164 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:13:17.655463 14910 raft_consensus.cc:606] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 25 LEADER]: Received request to transfer leadership to TS 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:17.656153 14330 raft_consensus.cc:2393] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db in current term 23: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:13:17.662739 14261 raft_consensus.cc:2468] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 23.
I20260709 12:13:17.674021 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:13:17.675019 14262 raft_consensus.cc:2393] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 73d01e9b1a9d49358da4985b21d681db in current term 23: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
I20260709 12:13:17.678791 14087 catalog_manager.cc:5697] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:17.680649 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de6b0d9885648e6b2f6822eb9f85021" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:13:17.688453 12986 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:13:17.680379 14087 catalog_manager.cc:5697] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 15 to 21. New cstate: current_term: 21 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:17.711228 14911 raft_consensus.cc:2393] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 23: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
I20260709 12:13:17.738775 14877 leader_election.cc:304] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:13:17.747713 14304 leader_election.cc:304] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db
I20260709 12:13:17.748745 22354 raft_consensus.cc:2749] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:13:17.749655 22576 raft_consensus.cc:2804] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:13:17.750376 22576 raft_consensus.cc:697] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 23 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:13:17.751027 22723 raft_consensus.cc:993] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db: : Instructing follower 885067a0d31741bfb5c9935788e315bf to start an election
I20260709 12:13:17.751515 22723 raft_consensus.cc:1081] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 25 LEADER]: Signalling peer 885067a0d31741bfb5c9935788e315bf to start an election
I20260709 12:13:17.751322 22576 consensus_queue.cc:237] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:17.753715 22718 raft_consensus.cc:1064] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c: attempting to promote NON_VOTER 73d01e9b1a9d49358da4985b21d681db to VOTER
I20260709 12:13:17.755626 14189 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d"
dest_uuid: "885067a0d31741bfb5c9935788e315bf"
 from {username='slave'} at 127.0.0.1:56652
I20260709 12:13:17.756213 14189 raft_consensus.cc:493] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 25 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:17.756441 22718 consensus_queue.cc:237] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 13, Current term: 21, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:17.732654 22693 raft_consensus.cc:993] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db: : Instructing follower 17aab1bbf5014936aa18cc21818b26ec to start an election
I20260709 12:13:17.758665 22693 raft_consensus.cc:1081] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 27 LEADER]: Signalling peer 17aab1bbf5014936aa18cc21818b26ec to start an election
I20260709 12:13:17.759148 14189 raft_consensus.cc:3060] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:17.768311 12986 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:17.769377 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:17.768754 14087 catalog_manager.cc:5697] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 24 to 30, leader changed from 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) to 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130). New cstate: current_term: 30 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:13:17.770318 14087 catalog_manager.cc:5697] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 19 to 23. New cstate: current_term: 23 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:17.767825 14189 raft_consensus.cc:515] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 26 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:17.774852 14189 leader_election.cc:290] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 26 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:13:17.781164 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: true dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:13:17.781971 14262 raft_consensus.cc:3060] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:17.788743 14909 raft_consensus.cc:1275] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 12:13:17.692685 22590 raft_consensus.cc:515] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:17.800835 22455 raft_consensus.cc:993] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c: : Instructing follower 885067a0d31741bfb5c9935788e315bf to start an election
I20260709 12:13:17.801486 22422 raft_consensus.cc:1081] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 22 LEADER]: Signalling peer 885067a0d31741bfb5c9935788e315bf to start an election
I20260709 12:13:17.805435 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: true dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:13:17.809695 14909 raft_consensus.cc:3055] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 25 LEADER]: Stepping down as leader of term 25
I20260709 12:13:17.810134 14909 raft_consensus.cc:740] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:13:17.813823 14330 raft_consensus.cc:1275] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 12:13:17.815291 14906 raft_consensus.cc:1275] T 90097151efa7426faeaea3ff87a7ea78 P 73d01e9b1a9d49358da4985b21d681db [term 21 LEARNER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 12:13:17.816924 14189 raft_consensus.cc:1275] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 12:13:17.819646 14257 raft_consensus.cc:1240] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 22. Current term is 23. Ops: []
I20260709 12:13:17.806592 14087 catalog_manager.cc:5697] T 90097151efa7426faeaea3ff87a7ea78 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: config changed from index -1 to 12, term changed from 18 to 20, leader changed from 65c9c1653b3346b39a0e118540e6080c (127.12.174.131) to 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130), NON_VOTER 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) added. New cstate: current_term: 20 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } } }
I20260709 12:13:17.842226 14262 raft_consensus.cc:2468] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 26.
I20260709 12:13:17.847136 14261 raft_consensus.cc:1240] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 26 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 25. Current term is 26. Ops: []
I20260709 12:13:17.848227 14262 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080"
dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
 from {username='slave'} at 127.0.0.1:53050
I20260709 12:13:17.848896 14262 raft_consensus.cc:493] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 27 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:17.849381 14262 raft_consensus.cc:3060] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:17.848770 14155 leader_election.cc:304] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:13:17.828624 22727 consensus_queue.cc:1048] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.025s
I20260709 12:13:17.829001 22422 consensus_queue.cc:1048] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.025s
I20260709 12:13:17.863063 14257 raft_consensus.cc:1275] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 12:13:17.832324 22630 consensus_queue.cc:1059] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.025s
I20260709 12:13:17.859601 22502 raft_consensus.cc:2804] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:13:17.894376 14262 raft_consensus.cc:515] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 28 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:17.898408 22431 consensus_queue.cc:1048] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:13:17.908468 14909 consensus_queue.cc:260] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 25.18, Last appended by leader: 18, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:17.910447 22590 leader_election.cc:290] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 23 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:13:17.913826 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:13:17.914438 14906 raft_consensus.cc:3060] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:17.913378 14909 raft_consensus.cc:3060] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:17.928696 14906 raft_consensus.cc:2468] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 23.
I20260709 12:13:17.930574 14229 leader_election.cc:304] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:13:17.950251 14185 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7"
dest_uuid: "885067a0d31741bfb5c9935788e315bf"
 from {username='slave'} at 127.0.0.1:56044
I20260709 12:13:17.951090 14185 raft_consensus.cc:493] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:17.951462 14185 raft_consensus.cc:3060] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:17.953703 14262 leader_election.cc:290] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 28 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:13:17.958803 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: true dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:13:17.959658 14906 raft_consensus.cc:3055] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 27 LEADER]: Stepping down as leader of term 27
I20260709 12:13:17.960103 14906 raft_consensus.cc:740] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 27 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:13:17.926445 22502 raft_consensus.cc:697] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 26 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:13:17.963910 14189 raft_consensus.cc:1275] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 12:13:17.960332 14909 raft_consensus.cc:2468] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 26.
I20260709 12:13:17.939599 22590 raft_consensus.cc:2804] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Leader election won for term 23
W20260709 12:13:17.966058 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 91711.2us
W20260709 12:13:17.967818 14304 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:17.973120 14185 raft_consensus.cc:515] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:17.991791 14262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: true dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:13:17.992508 14262 raft_consensus.cc:3060] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:18.000239 14185 leader_election.cc:290] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 23 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:18.006413 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: true dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:13:18.007179 14332 raft_consensus.cc:3060] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:17.984362 22590 raft_consensus.cc:697] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 23 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:13:17.965811 22727 consensus_queue.cc:1048] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.032s
I20260709 12:13:17.977187 14906 consensus_queue.cc:260] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 27.19, Last appended by leader: 19, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:18.016136 14189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "885067a0d31741bfb5c9935788e315bf"
I20260709 12:13:18.021435 22590 consensus_queue.cc:237] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:18.031369 14332 raft_consensus.cc:2468] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 28.
I20260709 12:13:18.037897 14262 raft_consensus.cc:2468] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 23.
I20260709 12:13:18.016815 14906 raft_consensus.cc:3060] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:18.037251 14230 leader_election.cc:304] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:13:18.050583 14906 raft_consensus.cc:2468] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 28.
I20260709 12:13:18.059203 22502 consensus_queue.cc:237] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 25.18, Last appended by leader: 18, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:18.015070 22676 consensus_queue.cc:1048] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.057s
I20260709 12:13:18.080392 22716 raft_consensus.cc:2804] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 28 FOLLOWER]: Leader election won for term 28
I20260709 12:13:18.104884 22599 raft_consensus.cc:3055] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:13:18.140892 22599 raft_consensus.cc:740] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:13:18.142154 22599 consensus_queue.cc:260] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:18.140951 22716 raft_consensus.cc:697] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 28 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:13:18.144665 22716 consensus_queue.cc:237] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 27.19, Last appended by leader: 19, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:18.148198 22599 raft_consensus.cc:3060] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:13:18.136898 22734 log.cc:927] Time spent T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
W20260709 12:13:18.189602 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 202075us
I20260709 12:13:18.192276 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: true dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:13:18.193005 14330 raft_consensus.cc:3055] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:13:18.193306 14330 raft_consensus.cc:740] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:13:18.194087 14330 consensus_queue.cc:260] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.11, Last appended by leader: 11, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:18.195245 14330 raft_consensus.cc:3060] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:18.195848 22422 consensus_queue.cc:1048] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:13:18.207278 14330 raft_consensus.cc:2468] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 23.
I20260709 12:13:18.219818 14906 raft_consensus.cc:1275] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 23 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
W20260709 12:13:18.013132 14079 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60436 (request call id 289) took 48725 ms (client timeout 15000 ms). Trace:
W20260709 12:13:18.258782 14079 rpcz_store.cc:269] 0709 12:12:29.278125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:29.283551 (+  5426us) service_pool.cc:224] Handling call
0709 12:12:30.666064 (+1382513us) spinlock_profiling.cc:243] Waited 73.3 ms on lock 0x7b5400030890. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f2123ed6db1 00007f2124017640 00007f212ceee846 00007f212cff890e 00007f212b4b92a4 00007f212b4b9232 00007f212b4b9161 00007f212b4b90dc 00007f212b4b8392 00007f212547648c 00007f21254758c6
0709 12:13:17.995610 (+47329546us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":85141,"reported_tablets":50,"spinlock_wait_cycles":168477440}
I20260709 12:13:18.304746 14906 raft_consensus.cc:1240] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 23 FOLLOWER]: Rejecting Update request from peer 885067a0d31741bfb5c9935788e315bf for earlier term 22. Current term is 23. Ops: [22.16-22.16]
I20260709 12:13:18.312913 22623 consensus_queue.cc:1048] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:13:18.346941 14182 raft_consensus.cc:1240] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 22. Current term is 23. Ops: []
I20260709 12:13:18.413273 22718 raft_consensus.cc:2955] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 21 LEADER]: Committing config change with OpId 21.15: config changed from index 12 to 15, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:13:18.039160 14155 leader_election.cc:304] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:13:18.472205 22729 raft_consensus.cc:2804] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:13:18.472972 22729 raft_consensus.cc:697] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 23 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:13:18.474478 22729 consensus_queue.cc:237] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.11, Last appended by leader: 11, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:18.498744 14260 raft_consensus.cc:1275] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
W20260709 12:13:18.505115 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 420521us
I20260709 12:13:18.531116 14181 raft_consensus.cc:2955] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Committing config change with OpId 21.15: config changed from index 12 to 15, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:13:18.531183 14911 raft_consensus.cc:2955] T 90097151efa7426faeaea3ff87a7ea78 P 73d01e9b1a9d49358da4985b21d681db [term 21 FOLLOWER]: Committing config change with OpId 21.15: config changed from index 12 to 15, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:13:18.631698 14187 raft_consensus.cc:1275] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 23 index: 16. (term mismatch)
I20260709 12:13:18.632407 14187 pending_rounds.cc:85] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf: Aborting all ops after (but not including) 15
I20260709 12:13:18.632707 14187 pending_rounds.cc:107] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf: Aborting uncommitted NO_OP operation due to leader change: 22.16
I20260709 12:13:18.633044 14187 raft_consensus.cc:2889] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:18.635356 14909 raft_consensus.cc:1275] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 23 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 12:13:18.639822 14259 raft_consensus.cc:1275] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 26 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 25 index: 18. Preceding OpId from leader: term: 26 index: 19. (index mismatch)
I20260709 12:13:18.642141 22574 consensus_queue.cc:1048] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
W20260709 12:13:18.656591 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 44497us
I20260709 12:13:18.650429 22574 consensus_queue.cc:1048] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.007s
I20260709 12:13:18.646543 22599 consensus_queue.cc:1048] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.019s
I20260709 12:13:18.702591 14908 raft_consensus.cc:1275] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 28 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 27 index: 19. Preceding OpId from leader: term: 28 index: 20. (index mismatch)
I20260709 12:13:18.766333 22727 consensus_queue.cc:1048] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.014s
W20260709 12:13:18.827303 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 114189us
W20260709 12:13:18.833269 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 84780.1us
W20260709 12:13:18.857859 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 79969us
I20260709 12:13:18.861845 22623 consensus_queue.cc:1048] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:13:18.887332 14909 raft_consensus.cc:1275] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 26 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 25 index: 18. Preceding OpId from leader: term: 26 index: 19. (index mismatch)
I20260709 12:13:18.889433 22502 consensus_queue.cc:1048] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
I20260709 12:13:18.914029 14256 raft_consensus.cc:1275] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 22 index: 11. Preceding OpId from leader: term: 23 index: 12. (index mismatch)
I20260709 12:13:18.929920 22599 consensus_queue.cc:1048] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:13:18.938084 14330 raft_consensus.cc:1275] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 28 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 27 index: 19. Preceding OpId from leader: term: 28 index: 20. (index mismatch)
I20260709 12:13:18.940043 14263 raft_consensus.cc:2955] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Committing config change with OpId 21.15: config changed from index 12 to 15, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:13:19.002851 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:13:19.027572 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 98704.8us
I20260709 12:13:19.055069 14335 raft_consensus.cc:1275] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 22 index: 11. Preceding OpId from leader: term: 23 index: 12. (index mismatch)
I20260709 12:13:19.057366 22729 consensus_queue.cc:1048] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 12:13:19.085523 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 59911.2us
W20260709 12:13:19.143940 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 50283.3us
I20260709 12:13:19.198727 14087 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:44116 (request call id 165) took 2841 ms. Trace:
I20260709 12:13:19.199286 14087 rpcz_store.cc:276] 0709 12:13:16.357160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:16.574718 (+217558us) service_pool.cc:224] Handling call
0709 12:13:19.198459 (+2623741us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:13:18.001007 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:13:18.066506 (+ 65499us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:13:18.066557 (+    51us) write_op.cc:435] Acquired schema lock
0709 12:13:18.066583 (+    26us) tablet.cc:662] Decoding operations
0709 12:13:18.105329 (+ 38746us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:13:18.105409 (+    80us) write_op.cc:641] Partition lock acquired for write op
0709 12:13:18.105446 (+    37us) tablet.cc:685] Acquiring locks for 20 operations
0709 12:13:18.107419 (+  1973us) tablet.cc:701] Row locks acquired
0709 12:13:18.107436 (+    17us) write_op.cc:260] PREPARE: finished
0709 12:13:18.107642 (+   206us) write_op.cc:270] Start()
0709 12:13:18.107824 (+   182us) write_op.cc:276] Timestamp: P: 1783599198107566 usec, L: 0
0709 12:13:18.107846 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:13:18.108904 (+  1058us) log.cc:844] Serialized 7938 byte log entry
0709 12:13:18.231755 (+122851us) op_driver.cc:464] REPLICATION: finished
0709 12:13:18.330962 (+ 99207us) write_op.cc:301] APPLY: starting
0709 12:13:18.331186 (+   224us) tablet.cc:1367] starting BulkCheckPresence
0709 12:13:18.456084 (+124898us) tablet.cc:1370] finished BulkCheckPresence
0709 12:13:18.456268 (+   184us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:13:18.773317 (+317049us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:13:18.774315 (+   998us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=40,key_file_lookups=40,delta_file_lookups=40,mrs_lookups=0
0709 12:13:18.774379 (+    64us) write_op.cc:312] APPLY: finished
0709 12:13:18.775041 (+   662us) log.cc:844] Serialized 180 byte log entry
0709 12:13:18.776664 (+  1623us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:18.777228 (+   564us) write_op.cc:454] Released schema lock
0709 12:13:18.777331 (+   103us) write_op.cc:341] FINISH: Updating metrics
0709 12:13:18.831467 (+ 54136us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:18.832282 (+   815us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":666403,"reported_tablets":26,"child_traces":[["op",{"apply.queue_time_us":902,"apply.run_cpu_time_us":37671,"apply.run_wall_time_us":497642,"cfile_cache_hit":82,"cfile_cache_hit_bytes":87887,"num_ops":20,"prepare.queue_time_us":44840,"prepare.run_cpu_time_us":13211,"prepare.run_wall_time_us":233607,"raft.queue_time_us":1018,"raft.run_cpu_time_us":1526,"raft.run_wall_time_us":107116,"replication_time_us":123743,"spinlock_wait_cycles":15232,"thread_start_us":254765,"threads_started":4,"wal-append.queue_time_us":116396}]]}
W20260709 12:13:19.249856 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 68318.5us
I20260709 12:13:19.256816 22769 consensus_queue.cc:1048] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.007s
I20260709 12:13:19.362041 14260 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "90097151efa7426faeaea3ff87a7ea78"
dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:57116
I20260709 12:13:19.363080 14260 raft_consensus.cc:606] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Received request to transfer leadership
I20260709 12:13:19.363482 14260 raft_consensus.cc:614] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:13:19.374902 14136 auto_rebalancer.cc:893] Removing replace marker failed: Replica 17aab1bbf5014936aa18cc21818b26ec is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 21 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
W20260709 12:13:19.375429 14136 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
W20260709 12:13:19.375744 14136 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 12:13:19.390103 14087 catalog_manager.cc:5697] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 20 to 26. New cstate: current_term: 26 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:13:19.391822 14087 catalog_manager.cc:5697] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 25 to 26, leader changed from 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) to 885067a0d31741bfb5c9935788e315bf (127.12.174.129). New cstate: current_term: 26 leader_uuid: "885067a0d31741bfb5c9935788e315bf" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:13:19.392995 14906 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d"
dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
mode: GRACEFUL
new_leader_uuid: "17aab1bbf5014936aa18cc21818b26ec"
 from {username='slave'} at 127.0.0.1:38628
I20260709 12:13:19.393774 14906 raft_consensus.cc:606] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 21 LEADER]: Received request to transfer leadership to TS 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:13:19.402642 14335 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae"
dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
mode: GRACEFUL
new_leader_uuid: "885067a0d31741bfb5c9935788e315bf"
 from {username='slave'} at 127.0.0.1:50896
I20260709 12:13:19.403319 14335 raft_consensus.cc:606] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 23 LEADER]: Received request to transfer leadership to TS 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:19.393296 14087 catalog_manager.cc:5697] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 27 to 28, leader changed from 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) to 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130). New cstate: current_term: 28 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:13:19.408591 14265 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c022caf6920747708b0cfc607c962951"
dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
mode: GRACEFUL
new_leader_uuid: "885067a0d31741bfb5c9935788e315bf"
 from {username='slave'} at 127.0.0.1:54238
I20260709 12:13:19.414497 14265 raft_consensus.cc:606] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Received request to transfer leadership to TS 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:19.414930 14265 raft_consensus.cc:614] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:13:19.422569 14335 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca"
dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
mode: GRACEFUL
new_leader_uuid: "885067a0d31741bfb5c9935788e315bf"
 from {username='slave'} at 127.0.0.1:50896
I20260709 12:13:19.423280 14335 raft_consensus.cc:606] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 24 LEADER]: Received request to transfer leadership to TS 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:19.428197 14335 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42"
dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
mode: GRACEFUL
new_leader_uuid: "885067a0d31741bfb5c9935788e315bf"
 from {username='slave'} at 127.0.0.1:50896
I20260709 12:13:19.429016 14335 raft_consensus.cc:606] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 26 LEADER]: Received request to transfer leadership to TS 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:19.434000 12986 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:13:19.441947 14087 catalog_manager.cc:5697] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 21 to 23, leader changed from 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) to 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130). New cstate: current_term: 23 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:13:19.443888 14087 catalog_manager.cc:5697] T 90097151efa7426faeaea3ff87a7ea78 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: config changed from index 12 to 15, term changed from 20 to 21, leader changed from 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130) to 65c9c1653b3346b39a0e118540e6080c (127.12.174.131), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New cstate: current_term: 21 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:13:19.446156 14087 catalog_manager.cc:5697] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 18 to 23. New cstate: current_term: 23 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:13:19.447727 12986 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:19.456518 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:13:19.461720 14080 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60420 (request call id 258) took 65927 ms (client timeout 15000 ms). Trace:
W20260709 12:13:19.465873 14080 rpcz_store.cc:269] 0709 12:12:13.533788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:13.543229 (+  9441us) service_pool.cc:224] Handling call
0709 12:13:19.461518 (+65918289us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":851762,"reported_tablets":50}
I20260709 12:13:19.718127 14083 catalog_manager.cc:5697] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "885067a0d31741bfb5c9935788e315bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } }
I20260709 12:13:19.720566 14083 catalog_manager.cc:5697] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: term changed from 18 to 21. New cstate: current_term: 21 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } }
I20260709 12:13:19.722461 14083 catalog_manager.cc:5697] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:19.738358 14176 tablet_service.cc:1558] Processing DeleteTablet for tablet 35b39d0f3270452a8bd4f4b1800a837c with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 6 (current committed config index is 12)) from {username='slave'} at 127.0.0.1:45350
I20260709 12:13:19.738485 14083 catalog_manager.cc:5697] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: term changed from 18 to 22. New cstate: current_term: 22 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } }
I20260709 12:13:19.742035 14083 catalog_manager.cc:5697] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: term changed from 18 to 19, leader changed from 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130) to 885067a0d31741bfb5c9935788e315bf (127.12.174.129). New cstate: current_term: 19 leader_uuid: "885067a0d31741bfb5c9935788e315bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } }
I20260709 12:13:19.744583 22508 raft_consensus.cc:993] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db: : Instructing follower 17aab1bbf5014936aa18cc21818b26ec to start an election
I20260709 12:13:19.745496 22508 raft_consensus.cc:1081] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 21 LEADER]: Signalling peer 17aab1bbf5014936aa18cc21818b26ec to start an election
I20260709 12:13:19.750778 14265 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d"
dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
 from {username='slave'} at 127.0.0.1:53050
I20260709 12:13:19.751497 14265 raft_consensus.cc:493] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:19.751832 14265 raft_consensus.cc:3060] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:19.747604 14083 catalog_manager.cc:5697] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: term changed from 23 to 26, leader changed from 65c9c1653b3346b39a0e118540e6080c (127.12.174.131) to 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130). New cstate: current_term: 26 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } }
W20260709 12:13:19.760614 14082 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60410 (request call id 260) took 72164 ms (client timeout 15000 ms). Trace:
I20260709 12:13:19.754805 14083 catalog_manager.cc:5697] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: term changed from 16 to 19, leader changed from 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130) to 65c9c1653b3346b39a0e118540e6080c (127.12.174.131). New cstate: current_term: 19 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } }
I20260709 12:13:19.761814 14265 raft_consensus.cc:515] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:19.762889 14083 catalog_manager.cc:5697] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } }
W20260709 12:13:19.770082 14082 rpcz_store.cc:269] 0709 12:12:07.596770 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:07.597028 (+   258us) service_pool.cc:224] Handling call
0709 12:13:19.760408 (+72163380us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5195,"reported_tablets":50}
I20260709 12:13:19.773532 14083 catalog_manager.cc:5697] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: term changed from 22 to 24, leader changed from 65c9c1653b3346b39a0e118540e6080c (127.12.174.131) to 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130). New cstate: current_term: 24 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:19.775945 14083 catalog_manager.cc:5697] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: term changed from 19 to 22, leader changed from 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130) to 885067a0d31741bfb5c9935788e315bf (127.12.174.129). New cstate: current_term: 22 leader_uuid: "885067a0d31741bfb5c9935788e315bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } }
I20260709 12:13:19.778071 14083 catalog_manager.cc:5697] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: term changed from 20 to 21, leader changed from 65c9c1653b3346b39a0e118540e6080c (127.12.174.131) to 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130). New cstate: current_term: 21 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:19.781656 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: true dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:13:19.782203 14908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: true dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:13:19.782828 14908 raft_consensus.cc:3055] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:13:19.783135 14908 raft_consensus.cc:740] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:13:19.783598 14083 catalog_manager.cc:5697] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: term changed from 18 to 19, leader changed from 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130) to 65c9c1653b3346b39a0e118540e6080c (127.12.174.131). New cstate: current_term: 19 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } }
I20260709 12:13:19.783993 14908 consensus_queue.cc:260] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:19.782387 14332 raft_consensus.cc:3060] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:19.786011 14265 leader_election.cc:290] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:13:19.785815 14908 raft_consensus.cc:3060] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:19.785801 14083 catalog_manager.cc:5697] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: term changed from 19 to 21, leader changed from 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130) to 885067a0d31741bfb5c9935788e315bf (127.12.174.129). New cstate: current_term: 21 leader_uuid: "885067a0d31741bfb5c9935788e315bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } }
I20260709 12:13:19.799582 14083 catalog_manager.cc:5697] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:19.801553 14083 catalog_manager.cc:5697] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } }
I20260709 12:13:19.803089 14083 catalog_manager.cc:5697] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: term changed from 17 to 21, leader changed from 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130) to 65c9c1653b3346b39a0e118540e6080c (127.12.174.131). New cstate: current_term: 21 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } }
I20260709 12:13:19.807575 22576 raft_consensus.cc:993] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c: : Instructing follower 885067a0d31741bfb5c9935788e315bf to start an election
I20260709 12:13:19.808115 22742 raft_consensus.cc:1081] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 26 LEADER]: Signalling peer 885067a0d31741bfb5c9935788e315bf to start an election
I20260709 12:13:19.809333 14073 catalog_manager.cc:5028] TS 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): tablet 35b39d0f3270452a8bd4f4b1800a837c (table test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]) successfully deleted
I20260709 12:13:19.810151 14183 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42"
dest_uuid: "885067a0d31741bfb5c9935788e315bf"
 from {username='slave'} at 127.0.0.1:56044
I20260709 12:13:19.810746 14183 raft_consensus.cc:493] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 26 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:19.811074 14183 raft_consensus.cc:3060] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:19.817101 14332 raft_consensus.cc:2468] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 22.
I20260709 12:13:19.819248 14230 leader_election.cc:304] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:13:19.820307 22725 raft_consensus.cc:2804] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:13:19.820835 22725 raft_consensus.cc:697] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 22 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:13:19.821641 14908 raft_consensus.cc:2468] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 22.
I20260709 12:13:19.822887 22725 consensus_queue.cc:237] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:19.839438 14183 raft_consensus.cc:515] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 27 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:19.849649 14183 leader_election.cc:290] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 27 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:19.851341 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: true dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:13:19.852421 14332 raft_consensus.cc:3055] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 26 LEADER]: Stepping down as leader of term 26
I20260709 12:13:19.852727 14332 raft_consensus.cc:740] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:13:19.853524 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: true dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:13:19.854197 14265 raft_consensus.cc:3060] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:19.859555 14332 consensus_queue.cc:260] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 26.15, Last appended by leader: 15, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:19.868304 14332 raft_consensus.cc:3060] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:19.902230 14332 raft_consensus.cc:2468] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 27.
I20260709 12:13:19.912835 22719 raft_consensus.cc:993] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c: : Instructing follower 885067a0d31741bfb5c9935788e315bf to start an election
I20260709 12:13:19.914143 22719 raft_consensus.cc:1081] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 23 LEADER]: Signalling peer 885067a0d31741bfb5c9935788e315bf to start an election
I20260709 12:13:19.916996 14155 leader_election.cc:304] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:13:19.921983 22676 raft_consensus.cc:2804] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 27 FOLLOWER]: Leader election won for term 27
I20260709 12:13:19.922557 22676 raft_consensus.cc:697] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 27 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:13:19.922761 14184 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae"
dest_uuid: "885067a0d31741bfb5c9935788e315bf"
 from {username='slave'} at 127.0.0.1:56044
I20260709 12:13:19.923735 14184 raft_consensus.cc:493] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:19.923530 22676 consensus_queue.cc:237] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 26.15, Last appended by leader: 15, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:19.924134 14184 raft_consensus.cc:3060] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:19.936630 14184 raft_consensus.cc:515] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 24 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:19.940006 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: true dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:13:19.940685 14256 raft_consensus.cc:3060] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:19.950594 14265 raft_consensus.cc:2468] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 27.
I20260709 12:13:19.954546 14256 raft_consensus.cc:2468] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 24.
I20260709 12:13:19.956877 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: true dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:13:19.958115 14332 raft_consensus.cc:3055] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:13:19.958431 14332 raft_consensus.cc:740] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:13:19.959359 14332 consensus_queue.cc:260] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:19.960299 14332 raft_consensus.cc:3060] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:19.957480 14184 leader_election.cc:290] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 24 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:19.977404 14265 raft_consensus.cc:1240] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Rejecting Update request from peer 65c9c1653b3346b39a0e118540e6080c for earlier term 23. Current term is 24. Ops: []
I20260709 12:13:19.979969 14155 leader_election.cc:304] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:13:19.980737 22772 raft_consensus.cc:2804] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:13:19.981259 22772 raft_consensus.cc:697] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 24 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:13:19.982234 22772 consensus_queue.cc:237] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:20.001273 14332 raft_consensus.cc:2468] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 24.
I20260709 12:13:20.040818 22455 raft_consensus.cc:993] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c: : Instructing follower 885067a0d31741bfb5c9935788e315bf to start an election
I20260709 12:13:20.042040 22455 raft_consensus.cc:1081] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 24 LEADER]: Signalling peer 885067a0d31741bfb5c9935788e315bf to start an election
I20260709 12:13:20.047102 14183 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca"
dest_uuid: "885067a0d31741bfb5c9935788e315bf"
 from {username='slave'} at 127.0.0.1:56044
I20260709 12:13:20.047729 14183 raft_consensus.cc:493] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 24 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:20.048111 14183 raft_consensus.cc:3060] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:20.057080 14183 raft_consensus.cc:515] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 25 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:20.067109 14183 leader_election.cc:290] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 25 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:20.067709 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: true dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:13:20.078542 14265 raft_consensus.cc:3060] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:20.068506 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: true dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:13:20.083024 14332 raft_consensus.cc:3055] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:13:20.083418 14332 raft_consensus.cc:740] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:13:20.084273 14332 consensus_queue.cc:260] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 14, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:20.085460 14332 raft_consensus.cc:3060] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:20.088294 14265 raft_consensus.cc:2468] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 25.
I20260709 12:13:20.089715 14155 leader_election.cc:304] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:13:20.091063 22729 raft_consensus.cc:2804] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:13:20.091553 22729 raft_consensus.cc:697] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 25 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:13:20.092463 22729 consensus_queue.cc:237] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 14, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:20.095570 14332 raft_consensus.cc:2468] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 25.
W20260709 12:13:20.077673 14083 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60420 (request call id 260) took 18805 ms (client timeout 15000 ms). Trace:
W20260709 12:13:20.103197 14083 rpcz_store.cc:269] 0709 12:13:01.272288 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:05.990630 (+4718342us) service_pool.cc:224] Handling call
0709 12:13:20.077572 (+14086942us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:13:19.832448 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:13:19.832983 (+   535us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:13:19.833026 (+    43us) write_op.cc:435] Acquired schema lock
0709 12:13:19.833038 (+    12us) tablet.cc:662] Decoding operations
0709 12:13:19.834343 (+  1305us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:13:19.834402 (+    59us) write_op.cc:641] Partition lock acquired for write op
0709 12:13:19.834433 (+    31us) tablet.cc:685] Acquiring locks for 16 operations
0709 12:13:19.835552 (+  1119us) tablet.cc:701] Row locks acquired
0709 12:13:19.835567 (+    15us) write_op.cc:260] PREPARE: finished
0709 12:13:19.835725 (+   158us) write_op.cc:270] Start()
0709 12:13:19.835846 (+   121us) write_op.cc:276] Timestamp: P: 1783599199835677 usec, L: 0
0709 12:13:19.835860 (+    14us) op_driver.cc:348] REPLICATION: starting
0709 12:13:19.836567 (+   707us) log.cc:844] Serialized 6406 byte log entry
0709 12:13:19.842590 (+  6023us) op_driver.cc:464] REPLICATION: finished
0709 12:13:19.842929 (+   339us) write_op.cc:301] APPLY: starting
0709 12:13:19.843028 (+    99us) tablet.cc:1367] starting BulkCheckPresence
0709 12:13:19.910588 (+ 67560us) tablet.cc:1370] finished BulkCheckPresence
0709 12:13:19.910698 (+   110us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:13:19.987225 (+ 76527us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:13:19.992841 (+  5616us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=32,key_file_lookups=32,delta_file_lookups=32,mrs_lookups=0
0709 12:13:19.992893 (+    52us) write_op.cc:312] APPLY: finished
0709 12:13:19.993253 (+   360us) log.cc:844] Serialized 148 byte log entry
0709 12:13:19.993439 (+   186us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:19.993601 (+   162us) write_op.cc:454] Released schema lock
0709 12:13:19.993660 (+    59us) write_op.cc:341] FINISH: Updating metrics
0709 12:13:19.994090 (+   430us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:19.994119 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":8269,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":104,"apply.run_cpu_time_us":21751,"apply.run_wall_time_us":151108,"cfile_cache_hit":64,"cfile_cache_hit_bytes":67008,"num_ops":16,"prepare.queue_time_us":6904,"prepare.run_cpu_time_us":4493,"prepare.run_wall_time_us":13876,"replication_time_us":6594}]]}
W20260709 12:13:20.174034 14085 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60436 (request call id 288) took 72513 ms (client timeout 15000 ms). Trace:
W20260709 12:13:20.180310 14085 rpcz_store.cc:269] 0709 12:12:07.660292 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:12:07.660543 (+   251us) service_pool.cc:224] Handling call
0709 12:13:20.173827 (+72513284us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":50}
I20260709 12:13:20.259876 14332 raft_consensus.cc:1275] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 12:13:20.262522 22715 consensus_queue.cc:1048] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260709 12:13:20.278863 14086 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60420 (request call id 256) took 113451 ms (client timeout 15000 ms). Trace:
W20260709 12:13:20.280990 14086 rpcz_store.cc:269] 0709 12:11:26.827751 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:26.904618 (+ 76867us) service_pool.cc:224] Handling call
0709 12:13:20.278630 (+113374012us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":268095,"reported_tablets":50,"spinlock_wait_cycles":44288}
I20260709 12:13:20.329465 14908 raft_consensus.cc:1275] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 12:13:20.331426 22715 consensus_queue.cc:1048] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260709 12:13:20.356011 14088 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60436 (request call id 287) took 102884 ms (client timeout 15000 ms). Trace:
I20260709 12:13:20.359354 14081 catalog_manager.cc:5697] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf reported cstate change: term changed from 21 to 23. New cstate: current_term: 23 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } }
W20260709 12:13:20.360540 14088 rpcz_store.cc:269] 0709 12:11:37.471519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:37.471788 (+   269us) service_pool.cc:224] Handling call
0709 12:13:20.355799 (+102884011us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2568,"reported_tablets":50}
I20260709 12:13:20.361511 14081 catalog_manager.cc:5697] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf reported cstate change: term changed from 21 to 23, leader changed from 885067a0d31741bfb5c9935788e315bf (127.12.174.129) to 65c9c1653b3346b39a0e118540e6080c (127.12.174.131). New cstate: current_term: 23 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } }
I20260709 12:13:20.395854 14335 raft_consensus.cc:1275] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 27 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 26 index: 15. Preceding OpId from leader: term: 27 index: 16. (index mismatch)
I20260709 12:13:20.403520 22772 consensus_queue.cc:1048] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:13:20.447433 14265 raft_consensus.cc:1275] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 12:13:20.378471 14081 catalog_manager.cc:5697] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf reported cstate change: term changed from 22 to 24. New cstate: current_term: 24 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } }
I20260709 12:13:20.459805 22729 consensus_queue.cc:1048] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:13:20.460619 14081 catalog_manager.cc:5697] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf reported cstate change: term changed from 24 to 25, leader changed from 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130) to 885067a0d31741bfb5c9935788e315bf (127.12.174.129). New cstate: current_term: 25 leader_uuid: "885067a0d31741bfb5c9935788e315bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:20.462616 14081 catalog_manager.cc:5697] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "885067a0d31741bfb5c9935788e315bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:20.466516 14265 raft_consensus.cc:1275] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 27 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 26 index: 15. Preceding OpId from leader: term: 27 index: 16. (index mismatch)
I20260709 12:13:20.469066 22676 consensus_queue.cc:1048] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:13:20.484408 14332 raft_consensus.cc:1275] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 12:13:20.488091 22772 consensus_queue.cc:1048] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:13:20.492060 14081 catalog_manager.cc:5697] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf reported cstate change: term changed from 22 to 24. New cstate: current_term: 24 leader_uuid: "885067a0d31741bfb5c9935788e315bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:20.496876 14081 catalog_manager.cc:5697] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf reported cstate change: term changed from 24 to 27, leader changed from 65c9c1653b3346b39a0e118540e6080c (127.12.174.131) to 885067a0d31741bfb5c9935788e315bf (127.12.174.129). New cstate: current_term: 27 leader_uuid: "885067a0d31741bfb5c9935788e315bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:20.513407 14081 catalog_manager.cc:5697] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf reported cstate change: term changed from 19 to 23. New cstate: current_term: 23 leader_uuid: "885067a0d31741bfb5c9935788e315bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:20.538287 14081 catalog_manager.cc:5697] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf reported cstate change: term changed from 21 to 23, leader changed from 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130) to 65c9c1653b3346b39a0e118540e6080c (127.12.174.131). New cstate: current_term: 23 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } }
I20260709 12:13:20.549082 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:20.580641 14081 catalog_manager.cc:5697] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf reported cstate change: term changed from 21 to 22, leader changed from 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130) to 65c9c1653b3346b39a0e118540e6080c (127.12.174.131). New cstate: current_term: 22 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } }
I20260709 12:13:20.610224 14081 catalog_manager.cc:5697] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf reported cstate change: term changed from 20 to 26, leader changed from 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130) to 65c9c1653b3346b39a0e118540e6080c (127.12.174.131). New cstate: current_term: 26 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } }
I20260709 12:13:20.645363 14088 catalog_manager.cc:5697] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 21 to 22, leader changed from 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) to 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130). New cstate: current_term: 22 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:13:20.660989 14335 raft_consensus.cc:1275] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 25 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
I20260709 12:13:20.652456 14081 catalog_manager.cc:5697] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf reported cstate change: term changed from 21 to 23, leader changed from 885067a0d31741bfb5c9935788e315bf (127.12.174.129) to 65c9c1653b3346b39a0e118540e6080c (127.12.174.131). New cstate: current_term: 23 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } }
I20260709 12:13:20.666442 22676 consensus_queue.cc:1048] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:13:20.668286 14339 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7"
dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
mode: GRACEFUL
new_leader_uuid: "885067a0d31741bfb5c9935788e315bf"
 from {username='slave'} at 127.0.0.1:50896
I20260709 12:13:20.668931 14339 raft_consensus.cc:606] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Received request to transfer leadership to TS 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:20.669255 14339 raft_consensus.cc:614] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:13:20.672326 14081 catalog_manager.cc:5697] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf reported cstate change: term changed from 23 to 25. New cstate: current_term: 25 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } }
I20260709 12:13:20.677541 14081 catalog_manager.cc:5697] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf reported cstate change: term changed from 20 to 22. New cstate: current_term: 22 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } }
I20260709 12:13:20.680552 14081 catalog_manager.cc:5697] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf reported cstate change: term changed from 21 to 22, leader changed from 885067a0d31741bfb5c9935788e315bf (127.12.174.129) to 65c9c1653b3346b39a0e118540e6080c (127.12.174.131). New cstate: current_term: 22 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } }
I20260709 12:13:20.686852 14081 catalog_manager.cc:5697] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } }
I20260709 12:13:20.704998 14908 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af"
dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
mode: GRACEFUL
new_leader_uuid: "885067a0d31741bfb5c9935788e315bf"
 from {username='slave'} at 127.0.0.1:38628
I20260709 12:13:20.705726 14908 raft_consensus.cc:606] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 26 LEADER]: Received request to transfer leadership to TS 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:20.734063 14259 raft_consensus.cc:1275] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 25 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
I20260709 12:13:20.739671 22676 consensus_queue.cc:1048] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:13:20.740058 14335 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064"
dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
mode: GRACEFUL
new_leader_uuid: "885067a0d31741bfb5c9935788e315bf"
 from {username='slave'} at 127.0.0.1:50896
I20260709 12:13:20.756507 14335 raft_consensus.cc:606] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 21 LEADER]: Received request to transfer leadership to TS 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:20.776731 14339 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c022caf6920747708b0cfc607c962951"
dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
mode: GRACEFUL
new_leader_uuid: "885067a0d31741bfb5c9935788e315bf"
 from {username='slave'} at 127.0.0.1:50896
I20260709 12:13:20.777398 14339 raft_consensus.cc:606] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 19 LEADER]: Received request to transfer leadership to TS 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:20.791556 14339 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca"
dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
mode: GRACEFUL
new_leader_uuid: "885067a0d31741bfb5c9935788e315bf"
 from {username='slave'} at 127.0.0.1:50896
W20260709 12:13:20.860842 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 44803.4us
I20260709 12:13:20.887971 14339 raft_consensus.cc:606] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 25 FOLLOWER]: Received request to transfer leadership to TS 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:20.888458 14339 raft_consensus.cc:614] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 25 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:13:20.898073 12986 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:13:20.900213 12986 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:20.901139 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:20.964375 22797 raft_consensus.cc:993] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db: : Instructing follower 885067a0d31741bfb5c9935788e315bf to start an election
I20260709 12:13:20.965029 22797 raft_consensus.cc:1081] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 26 LEADER]: Signalling peer 885067a0d31741bfb5c9935788e315bf to start an election
I20260709 12:13:20.970799 14183 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af"
dest_uuid: "885067a0d31741bfb5c9935788e315bf"
 from {username='slave'} at 127.0.0.1:56652
I20260709 12:13:20.971431 14183 raft_consensus.cc:493] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 26 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:20.971802 14183 raft_consensus.cc:3060] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:20.981875 14183 raft_consensus.cc:515] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 27 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:13:20.983641 14136 auto_rebalancer.cc:629] Failed to schedule move for tablet b4a0f56d071c4634842ea1584dfe40e6: Illegal state: Replica 885067a0d31741bfb5c9935788e315bf is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 22 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } }
I20260709 12:13:21.000102 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: true dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:13:21.000764 14339 raft_consensus.cc:3060] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:21.014160 22455 raft_consensus.cc:993] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c: : Instructing follower 885067a0d31741bfb5c9935788e315bf to start an election
I20260709 12:13:21.014748 22455 raft_consensus.cc:1081] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 19 LEADER]: Signalling peer 885067a0d31741bfb5c9935788e315bf to start an election
I20260709 12:13:21.016701 14184 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c022caf6920747708b0cfc607c962951"
dest_uuid: "885067a0d31741bfb5c9935788e315bf"
 from {username='slave'} at 127.0.0.1:56044
I20260709 12:13:21.017288 14184 raft_consensus.cc:493] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:21.017666 14184 raft_consensus.cc:3060] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:21.013514 14335 consensus_queue.cc:237] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.12, Last appended by leader: 11, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } }
I20260709 12:13:21.023938 22742 raft_consensus.cc:993] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c: : Instructing follower 885067a0d31741bfb5c9935788e315bf to start an election
I20260709 12:13:21.024490 22742 raft_consensus.cc:1081] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 21 LEADER]: Signalling peer 885067a0d31741bfb5c9935788e315bf to start an election
I20260709 12:13:21.026547 14181 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064"
dest_uuid: "885067a0d31741bfb5c9935788e315bf"
 from {username='slave'} at 127.0.0.1:56044
I20260709 12:13:21.027174 14181 raft_consensus.cc:493] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:21.027526 14181 raft_consensus.cc:3060] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:21.028987 14339 raft_consensus.cc:2468] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 27.
I20260709 12:13:21.035408 14184 raft_consensus.cc:515] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:21.040824 14155 leader_election.cc:304] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:13:21.041306 14908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: true dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:13:21.041702 22729 raft_consensus.cc:2804] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 27 FOLLOWER]: Leader election won for term 27
I20260709 12:13:21.042076 14908 raft_consensus.cc:3055] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 26 LEADER]: Stepping down as leader of term 26
I20260709 12:13:21.042429 14908 raft_consensus.cc:740] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:13:21.042649 22729 raft_consensus.cc:697] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 27 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:13:21.043308 14908 consensus_queue.cc:260] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 26.18, Last appended by leader: 18, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:21.043644 22729 consensus_queue.cc:237] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 26.18, Last appended by leader: 18, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:21.044320 14908 raft_consensus.cc:3060] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:21.047307 14084 catalog_manager.cc:5697] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c reported cstate change: term changed from 20 to 21, leader changed from 885067a0d31741bfb5c9935788e315bf (127.12.174.129) to 65c9c1653b3346b39a0e118540e6080c (127.12.174.131). New cstate: current_term: 21 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:21.048892 14184 leader_election.cc:290] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 20 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:21.052870 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: true dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:13:21.053604 14256 raft_consensus.cc:3060] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:21.038789 14183 leader_election.cc:290] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 27 election: Requested vote from peers 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:13:21.039568 14332 raft_consensus.cc:1240] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 27 FOLLOWER]: Rejecting Update request from peer 73d01e9b1a9d49358da4985b21d681db for earlier term 26. Current term is 27. Ops: []
I20260709 12:13:21.053467 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: true dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:13:21.056619 14330 raft_consensus.cc:3055] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:13:21.056969 14330 raft_consensus.cc:740] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:13:21.057953 14330 consensus_queue.cc:260] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:21.059450 14330 raft_consensus.cc:3060] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:21.061772 14181 raft_consensus.cc:515] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:21.064972 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: true dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:13:21.065623 14265 raft_consensus.cc:3060] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:21.074594 14265 raft_consensus.cc:2468] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 22.
I20260709 12:13:21.081624 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: true dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:13:21.082482 14332 raft_consensus.cc:3055] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:13:21.082862 14332 raft_consensus.cc:740] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:13:21.086938 14260 raft_consensus.cc:1275] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 23 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
W20260709 12:13:21.088205 14081 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60410 (request call id 263) took 12655 ms (client timeout 15000 ms). Trace:
I20260709 12:13:21.088840 22810 consensus_queue.cc:1048] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:13:21.089450 14332 consensus_queue.cc:260] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:21.090749 14332 raft_consensus.cc:3060] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:13:21.083844 14908 raft_consensus.cc:2468] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 27.
W20260709 12:13:21.092751 14303 consensus_peers.cc:597] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c -> Peer 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341): Couldn't send request to peer 73d01e9b1a9d49358da4985b21d681db. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8efcd0417f0c412280654006e6389763. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:21.088629 14081 rpcz_store.cc:269] 0709 12:13:08.432532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:10.276108 (+1843576us) service_pool.cc:224] Handling call
0709 12:13:21.088139 (+10812031us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:13:20.736776 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:13:20.737330 (+   554us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:13:20.737356 (+    26us) write_op.cc:435] Acquired schema lock
0709 12:13:20.737376 (+    20us) tablet.cc:662] Decoding operations
0709 12:13:20.738649 (+  1273us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:13:20.738699 (+    50us) write_op.cc:641] Partition lock acquired for write op
0709 12:13:20.738726 (+    27us) tablet.cc:685] Acquiring locks for 16 operations
0709 12:13:20.739958 (+  1232us) tablet.cc:701] Row locks acquired
0709 12:13:20.739976 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:13:20.740120 (+   144us) write_op.cc:270] Start()
0709 12:13:20.740229 (+   109us) write_op.cc:276] Timestamp: P: 1783599200740061 usec, L: 0
0709 12:13:20.740246 (+    17us) op_driver.cc:348] REPLICATION: starting
0709 12:13:20.740996 (+   750us) log.cc:844] Serialized 6406 byte log entry
0709 12:13:20.864416 (+123420us) op_driver.cc:464] REPLICATION: finished
0709 12:13:20.864871 (+   455us) write_op.cc:301] APPLY: starting
0709 12:13:20.864959 (+    88us) tablet.cc:1367] starting BulkCheckPresence
0709 12:13:20.874376 (+  9417us) tablet.cc:1370] finished BulkCheckPresence
0709 12:13:20.874506 (+   130us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:13:20.923909 (+ 49403us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:13:20.924201 (+   292us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=32,key_file_lookups=32,delta_file_lookups=32,mrs_lookups=0
0709 12:13:20.924254 (+    53us) write_op.cc:312] APPLY: finished
0709 12:13:20.924662 (+   408us) log.cc:844] Serialized 148 byte log entry
0709 12:13:20.930117 (+  5455us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:20.965973 (+ 35856us) write_op.cc:454] Released schema lock
0709 12:13:20.966042 (+    69us) write_op.cc:341] FINISH: Updating metrics
0709 12:13:20.991277 (+ 25235us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:20.991312 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":241,"apply.run_cpu_time_us":23077,"apply.run_wall_time_us":126322,"cfile_cache_hit":64,"cfile_cache_hit_bytes":67008,"num_ops":16,"prepare.queue_time_us":101,"prepare.run_cpu_time_us":4511,"prepare.run_wall_time_us":4511,"replication_time_us":124040}]]}
I20260709 12:13:21.099826 14183 raft_consensus.cc:1275] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 23 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 12:13:21.102480 14084 catalog_manager.cc:5697] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c reported cstate change: term changed from 22 to 26. New cstate: current_term: 26 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:21.106856 14155 leader_election.cc:304] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:13:21.107213 14181 leader_election.cc:290] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 22 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:21.108111 14330 raft_consensus.cc:2468] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 20.
I20260709 12:13:21.109243 22676 raft_consensus.cc:2804] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:13:21.109840 22676 raft_consensus.cc:697] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 22 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:13:21.109421 14155 leader_election.cc:304] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf; no voters: 
I20260709 12:13:21.111148 22799 raft_consensus.cc:2804] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:13:21.110752 22676 consensus_queue.cc:237] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:21.111729 22799 raft_consensus.cc:697] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 20 LEADER]: Becoming Leader. State: Replica: 885067a0d31741bfb5c9935788e315bf, State: Running, Role: LEADER
I20260709 12:13:21.112996 14256 raft_consensus.cc:2468] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 20.
I20260709 12:13:21.110584 22808 consensus_queue.cc:1048] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.005s
I20260709 12:13:21.115017 22799 consensus_queue.cc:237] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:21.147114 14332 raft_consensus.cc:2468] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 885067a0d31741bfb5c9935788e315bf in term 22.
I20260709 12:13:21.162724 14084 catalog_manager.cc:5697] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c reported cstate change: term changed from 20 to 21, leader changed from 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130) to 65c9c1653b3346b39a0e118540e6080c (127.12.174.131). New cstate: current_term: 21 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:21.242236 22810 raft_consensus.cc:2955] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 23 LEADER]: Committing config change with OpId 23.13: config changed from index -1 to 13, NON_VOTER 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } } }
I20260709 12:13:21.246008 14183 raft_consensus.cc:2955] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Committing config change with OpId 23.13: config changed from index -1 to 13, NON_VOTER 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } } }
W20260709 12:13:21.280855 14084 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60436 (request call id 291) took 12397 ms (client timeout 15000 ms). Trace:
W20260709 12:13:21.281684 14084 rpcz_store.cc:269] 0709 12:13:08.883243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:14.816697 (+5933454us) service_pool.cc:224] Handling call
0709 12:13:21.280746 (+6464049us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:13:21.226421 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:13:21.226983 (+   562us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:13:21.227026 (+    43us) write_op.cc:435] Acquired schema lock
0709 12:13:21.227044 (+    18us) tablet.cc:662] Decoding operations
0709 12:13:21.227569 (+   525us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:13:21.227625 (+    56us) write_op.cc:641] Partition lock acquired for write op
0709 12:13:21.227652 (+    27us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:13:21.227987 (+   335us) tablet.cc:701] Row locks acquired
0709 12:13:21.228007 (+    20us) write_op.cc:260] PREPARE: finished
0709 12:13:21.228168 (+   161us) write_op.cc:270] Start()
0709 12:13:21.228289 (+   121us) write_op.cc:276] Timestamp: P: 1783599201228114 usec, L: 0
0709 12:13:21.228312 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 12:13:21.229069 (+   757us) log.cc:844] Serialized 1326 byte log entry
0709 12:13:21.232663 (+  3594us) op_driver.cc:464] REPLICATION: finished
0709 12:13:21.233505 (+   842us) write_op.cc:301] APPLY: starting
0709 12:13:21.233603 (+    98us) tablet.cc:1367] starting BulkCheckPresence
0709 12:13:21.237593 (+  3990us) tablet.cc:1370] finished BulkCheckPresence
0709 12:13:21.237681 (+    88us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:13:21.239519 (+  1838us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:13:21.239710 (+   191us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=6,mrs_lookups=0
0709 12:13:21.239761 (+    51us) write_op.cc:312] APPLY: finished
0709 12:13:21.240000 (+   239us) log.cc:844] Serialized 41 byte log entry
0709 12:13:21.250083 (+ 10083us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:21.250197 (+   114us) write_op.cc:454] Released schema lock
0709 12:13:21.250243 (+    46us) write_op.cc:341] FINISH: Updating metrics
0709 12:13:21.250634 (+   391us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:21.250663 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":10718,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":617,"apply.run_cpu_time_us":5256,"apply.run_wall_time_us":17093,"cfile_cache_hit":12,"cfile_cache_hit_bytes":12564,"num_ops":3,"prepare.queue_time_us":127,"prepare.run_cpu_time_us":2951,"prepare.run_wall_time_us":2952,"replication_time_us":4218}]]}
W20260709 12:13:21.307489 22811 log.cc:927] Time spent T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 12:13:21.330627 14260 raft_consensus.cc:2955] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Committing config change with OpId 23.13: config changed from index -1 to 13, NON_VOTER 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } } }
W20260709 12:13:21.340265 14136 auto_rebalancer.cc:629] Failed to schedule move for tablet e85036847fc14bab8d6b10e9cbee3aca: Illegal state: Replica 65c9c1653b3346b39a0e118540e6080c is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 25 leader_uuid: "885067a0d31741bfb5c9935788e315bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } }
W20260709 12:13:21.355430 14136 auto_rebalancer.cc:629] Failed to schedule move for tablet 5879727b381a48b18b1949c96428b5d0: Illegal state: Replica 17aab1bbf5014936aa18cc21818b26ec is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 31 leader_uuid: "885067a0d31741bfb5c9935788e315bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } }
I20260709 12:13:21.403666 14079 catalog_manager.cc:5697] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: term changed from 21 to 22, leader changed from 65c9c1653b3346b39a0e118540e6080c (127.12.174.131) to 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130). New cstate: current_term: 22 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:21.418813 14079 catalog_manager.cc:5697] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: term changed from 20 to 28. New cstate: current_term: 28 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } }
W20260709 12:13:21.434329 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 50189.2us
I20260709 12:13:21.438683 14079 catalog_manager.cc:5697] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: term changed from 21 to 23, leader changed from 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130) to 885067a0d31741bfb5c9935788e315bf (127.12.174.129). New cstate: current_term: 23 leader_uuid: "885067a0d31741bfb5c9935788e315bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } }
I20260709 12:13:21.440411 14079 catalog_manager.cc:5697] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: term changed from 25 to 26, leader changed from 885067a0d31741bfb5c9935788e315bf (127.12.174.129) to 65c9c1653b3346b39a0e118540e6080c (127.12.174.131). New cstate: current_term: 26 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } }
I20260709 12:13:21.442488 14079 catalog_manager.cc:5697] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: term changed from 24 to 28. New cstate: current_term: 28 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } }
I20260709 12:13:21.455176 14079 catalog_manager.cc:5697] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: term changed from 21 to 23, leader changed from 885067a0d31741bfb5c9935788e315bf (127.12.174.129) to 65c9c1653b3346b39a0e118540e6080c (127.12.174.131). New cstate: current_term: 23 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } }
I20260709 12:13:21.463835 14079 catalog_manager.cc:5697] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: term changed from 26 to 31, leader changed from 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130) to 885067a0d31741bfb5c9935788e315bf (127.12.174.129). New cstate: current_term: 31 leader_uuid: "885067a0d31741bfb5c9935788e315bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } }
I20260709 12:13:21.485473 14079 catalog_manager.cc:5697] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: term changed from 27 to 29. New cstate: current_term: 29 leader_uuid: "885067a0d31741bfb5c9935788e315bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } }
I20260709 12:13:21.502023 14079 catalog_manager.cc:5697] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: term changed from 26 to 28. New cstate: current_term: 28 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } }
I20260709 12:13:21.514935 14079 catalog_manager.cc:5697] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: term changed from 21 to 23. New cstate: current_term: 23 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } }
I20260709 12:13:21.517048 14908 raft_consensus.cc:1275] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 27 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 26 index: 18. Preceding OpId from leader: term: 27 index: 19. (index mismatch)
I20260709 12:13:21.519498 22799 consensus_queue.cc:1048] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260709 12:13:21.517388 14079 catalog_manager.cc:5697] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: term changed from 21 to 22, leader changed from 65c9c1653b3346b39a0e118540e6080c (127.12.174.131) to 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130). New cstate: current_term: 22 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:21.556614 14088 catalog_manager.cc:5697] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 26 to 27, leader changed from 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) to 885067a0d31741bfb5c9935788e315bf (127.12.174.129). New cstate: current_term: 27 leader_uuid: "885067a0d31741bfb5c9935788e315bf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:13:21.597450 14332 raft_consensus.cc:1275] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 27 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 26 index: 18. Preceding OpId from leader: term: 27 index: 19. (index mismatch)
I20260709 12:13:21.599623 22820 consensus_queue.cc:1048] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
I20260709 12:13:21.655320 22828 ts_tablet_manager.cc:933] T 8efcd0417f0c412280654006e6389763 P 73d01e9b1a9d49358da4985b21d681db: Initiating tablet copy from peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:21.662643 14084 catalog_manager.cc:5697] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf reported cstate change: term changed from 23 to 24, leader changed from 65c9c1653b3346b39a0e118540e6080c (127.12.174.131) to 885067a0d31741bfb5c9935788e315bf (127.12.174.129). New cstate: current_term: 24 leader_uuid: "885067a0d31741bfb5c9935788e315bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:21.699048 14084 catalog_manager.cc:5697] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf reported cstate change: term changed from 24 to 25, leader changed from 65c9c1653b3346b39a0e118540e6080c (127.12.174.131) to 885067a0d31741bfb5c9935788e315bf (127.12.174.129). New cstate: current_term: 25 leader_uuid: "885067a0d31741bfb5c9935788e315bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:21.701699 14330 raft_consensus.cc:1275] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:13:21.701871 14084 catalog_manager.cc:5697] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf reported cstate change: term changed from 24 to 27, leader changed from 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130) to 65c9c1653b3346b39a0e118540e6080c (127.12.174.131). New cstate: current_term: 27 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } }
I20260709 12:13:21.705770 22814 consensus_queue.cc:1048] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:13:21.706805 22828 tablet_copy_client.cc:323] T 8efcd0417f0c412280654006e6389763 P 73d01e9b1a9d49358da4985b21d681db: tablet copy: Beginning tablet copy session from remote peer at address 127.12.174.131:45957
I20260709 12:13:21.703583 14084 catalog_manager.cc:5697] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf reported cstate change: term changed from 18 to 21, leader changed from 65c9c1653b3346b39a0e118540e6080c (127.12.174.131) to 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130). New cstate: current_term: 21 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } }
I20260709 12:13:21.718494 14348 tablet_copy_service.cc:140] P 65c9c1653b3346b39a0e118540e6080c: Received BeginTabletCopySession request for tablet 8efcd0417f0c412280654006e6389763 from peer 73d01e9b1a9d49358da4985b21d681db ({username='slave'} at 127.0.0.1:55492)
I20260709 12:13:21.722457 14348 tablet_copy_service.cc:161] P 65c9c1653b3346b39a0e118540e6080c: Beginning new tablet copy session on tablet 8efcd0417f0c412280654006e6389763 from peer 73d01e9b1a9d49358da4985b21d681db at {username='slave'} at 127.0.0.1:55492: session id = 73d01e9b1a9d49358da4985b21d681db-8efcd0417f0c412280654006e6389763
I20260709 12:13:21.732004 14260 raft_consensus.cc:1275] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 12:13:21.736950 14256 raft_consensus.cc:1275] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:13:21.739121 22814 consensus_queue.cc:1048] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:13:21.739048 22820 consensus_queue.cc:1048] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.016s
I20260709 12:13:21.749094 14084 catalog_manager.cc:5697] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf reported cstate change: term changed from 19 to 20, leader changed from 65c9c1653b3346b39a0e118540e6080c (127.12.174.131) to 885067a0d31741bfb5c9935788e315bf (127.12.174.129). New cstate: current_term: 20 leader_uuid: "885067a0d31741bfb5c9935788e315bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:21.760663 14084 catalog_manager.cc:5697] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf reported cstate change: term changed from 22 to 23, leader changed from 65c9c1653b3346b39a0e118540e6080c (127.12.174.131) to 885067a0d31741bfb5c9935788e315bf (127.12.174.129). New cstate: current_term: 23 leader_uuid: "885067a0d31741bfb5c9935788e315bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:21.765166 14079 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60420 (request call id 261) took 4400 ms. Trace:
I20260709 12:13:21.766660 14084 catalog_manager.cc:5697] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf reported cstate change: term changed from 26 to 27, leader changed from 65c9c1653b3346b39a0e118540e6080c (127.12.174.131) to 885067a0d31741bfb5c9935788e315bf (127.12.174.129). New cstate: current_term: 27 leader_uuid: "885067a0d31741bfb5c9935788e315bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:21.777987 14332 raft_consensus.cc:1275] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Refusing update from remote peer 885067a0d31741bfb5c9935788e315bf: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 12:13:21.782467 22814 consensus_queue.cc:1048] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:13:21.771512 14084 catalog_manager.cc:5697] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf reported cstate change: term changed from 21 to 22, leader changed from 65c9c1653b3346b39a0e118540e6080c (127.12.174.131) to 885067a0d31741bfb5c9935788e315bf (127.12.174.129). New cstate: current_term: 22 leader_uuid: "885067a0d31741bfb5c9935788e315bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:21.786553 14084 catalog_manager.cc:5697] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf reported cstate change: term changed from 20 to 23. New cstate: current_term: 23 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } }
I20260709 12:13:21.794854 14348 tablet_copy_source_session.cc:215] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:21.800230 22828 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8efcd0417f0c412280654006e6389763. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:21.791169 14084 catalog_manager.cc:5697] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf reported cstate change: config changed from index -1 to 13, NON_VOTER 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) added. New cstate: current_term: 23 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } } }
I20260709 12:13:21.769893 14079 rpcz_store.cc:276] 0709 12:13:17.364937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:18.262629 (+897692us) service_pool.cc:224] Handling call
0709 12:13:18.518056 (+255427us) spinlock_profiling.cc:243] Waited 81.9 ms on lock 0x7b54002e3454. stack: 00007f212401c343 00007f212401c240 00007f21239ab1d4 00007f212d6e9304 00007f212d6e9299 00007f21270a5090 00007f2127143f3a 00007f212cef9e9c 00007f212cff804e 00007f212b4b92a4 00007f212b4b9232 00007f212b4b9161 00007f212b4b90dc 00007f212b4b8392 00007f212547648c 00007f21254758c6
0709 12:13:21.765086 (+3247030us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:13:21.569224 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:13:21.569906 (+   682us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:13:21.569947 (+    41us) write_op.cc:435] Acquired schema lock
0709 12:13:21.569963 (+    16us) tablet.cc:662] Decoding operations
0709 12:13:21.570940 (+   977us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:13:21.570994 (+    54us) write_op.cc:641] Partition lock acquired for write op
0709 12:13:21.571021 (+    27us) tablet.cc:685] Acquiring locks for 11 operations
0709 12:13:21.571925 (+   904us) tablet.cc:701] Row locks acquired
0709 12:13:21.571944 (+    19us) write_op.cc:260] PREPARE: finished
0709 12:13:21.572092 (+   148us) write_op.cc:270] Start()
0709 12:13:21.572228 (+   136us) write_op.cc:276] Timestamp: P: 1783599201572043 usec, L: 0
0709 12:13:21.572247 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 12:13:21.573057 (+   810us) log.cc:844] Serialized 4451 byte log entry
0709 12:13:21.576078 (+  3021us) op_driver.cc:464] REPLICATION: finished
0709 12:13:21.576887 (+   809us) write_op.cc:301] APPLY: starting
0709 12:13:21.576980 (+    93us) tablet.cc:1367] starting BulkCheckPresence
0709 12:13:21.583139 (+  6159us) tablet.cc:1370] finished BulkCheckPresence
0709 12:13:21.583239 (+   100us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:13:21.623905 (+ 40666us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:13:21.624167 (+   262us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=22,key_file_lookups=22,delta_file_lookups=22,mrs_lookups=0
0709 12:13:21.624214 (+    47us) write_op.cc:312] APPLY: finished
0709 12:13:21.624585 (+   371us) log.cc:844] Serialized 105 byte log entry
0709 12:13:21.627890 (+  3305us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:21.628058 (+   168us) write_op.cc:454] Released schema lock
0709 12:13:21.628113 (+    55us) write_op.cc:341] FINISH: Updating metrics
0709 12:13:21.628544 (+   431us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:13:21.628575 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":65536,"reported_tablets":50,"spinlock_wait_cycles":188444928,"child_traces":[["op",{"apply.queue_time_us":585,"apply.run_cpu_time_us":14777,"apply.run_wall_time_us":51616,"cfile_cache_hit":44,"cfile_cache_hit_bytes":46068,"num_ops":11,"prepare.queue_time_us":3198,"prepare.run_cpu_time_us":4200,"prepare.run_wall_time_us":12705,"replication_time_us":3451,"spinlock_wait_cycles":340736}]]}
I20260709 12:13:21.931463 22828 tablet_copy_client.cc:806] T 8efcd0417f0c412280654006e6389763 P 73d01e9b1a9d49358da4985b21d681db: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:21.932202 22828 tablet_copy_client.cc:670] T 8efcd0417f0c412280654006e6389763 P 73d01e9b1a9d49358da4985b21d681db: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:21.958289 22828 tablet_copy_client.cc:538] T 8efcd0417f0c412280654006e6389763 P 73d01e9b1a9d49358da4985b21d681db: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 12:13:21.971311 14155 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 109474us
I20260709 12:13:22.010183 22828 tablet_bootstrap.cc:492] T 8efcd0417f0c412280654006e6389763 P 73d01e9b1a9d49358da4985b21d681db: Bootstrap starting.
I20260709 12:13:22.116882 14335 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8efcd0417f0c412280654006e6389763"
dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:51484
I20260709 12:13:22.117645 14335 raft_consensus.cc:606] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 23 LEADER]: Received request to transfer leadership
I20260709 12:13:22.121956 14335 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8efcd0417f0c412280654006e6389763"
dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:51484
I20260709 12:13:22.122723 14335 raft_consensus.cc:606] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 23 LEADER]: Received request to transfer leadership
W20260709 12:13:22.124027 14074 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leadership transfer for 8efcd0417f0c412280654006e6389763 already in progress
I20260709 12:13:22.153570 14335 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8efcd0417f0c412280654006e6389763"
dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:51484
I20260709 12:13:22.155297 14335 raft_consensus.cc:606] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 23 LEADER]: Received request to transfer leadership
I20260709 12:13:22.159327 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:13:22.161481 14136 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 12:13:22.161989 14136 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for 8efcd0417f0c412280654006e6389763 already in progress
W20260709 12:13:22.162297 14136 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 8efcd0417f0c412280654006e6389763 already in progress
I20260709 12:13:22.221892 14335 consensus_queue.cc:237] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:22.277925 14339 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05"
dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
mode: GRACEFUL
new_leader_uuid: "17aab1bbf5014936aa18cc21818b26ec"
 from {username='slave'} at 127.0.0.1:50896
I20260709 12:13:22.278585 14339 raft_consensus.cc:606] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 27 LEADER]: Received request to transfer leadership to TS 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:13:22.282961 14339 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8efcd0417f0c412280654006e6389763"
dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
mode: GRACEFUL
new_leader_uuid: "17aab1bbf5014936aa18cc21818b26ec"
 from {username='slave'} at 127.0.0.1:50896
I20260709 12:13:22.285645 14339 raft_consensus.cc:606] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 23 LEADER]: Received request to transfer leadership to TS 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:13:22.290951 14908 raft_consensus.cc:1275] T 90097151efa7426faeaea3ff87a7ea78 P 73d01e9b1a9d49358da4985b21d681db [term 21 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 12:13:22.293866 22822 consensus_queue.cc:1048] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
/apache/dev/git/kudu/src/kudu/master/auto_leader_rebalancer-test.cc:454: Failure
Failed
Bad status: Remote error: Service unavailable: leadership transfer for 8efcd0417f0c412280654006e6389763 already in progress
I20260709 12:13:22.295167 12986 tablet_server.cc:179] TabletServer@127.12.174.129:0 shutting down...
I20260709 12:13:22.308303 22455 raft_consensus.cc:993] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c: : Instructing follower 885067a0d31741bfb5c9935788e315bf to start an election
I20260709 12:13:22.308869 22455 raft_consensus.cc:1081] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 23 LEADER]: Signalling peer 885067a0d31741bfb5c9935788e315bf to start an election
W20260709 12:13:22.378361 14303 consensus_peers.cc:597] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:22.384765 14303 consensus_peers.cc:407] unable to start election on peer 885067a0d31741bfb5c9935788e315bf: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:13:22.388195 14303 consensus_peers.cc:597] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:22.394094 14303 consensus_peers.cc:597] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:22.394002 22810 raft_consensus.cc:2955] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 21 LEADER]: Committing config change with OpId 21.16: config changed from index 15 to 16, VOTER 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:13:22.422636 22623 raft_consensus.cc:993] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c: : Instructing follower 17aab1bbf5014936aa18cc21818b26ec to start an election
I20260709 12:13:22.423388 22808 raft_consensus.cc:1081] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 27 LEADER]: Signalling peer 17aab1bbf5014936aa18cc21818b26ec to start an election
I20260709 12:13:22.431427 14260 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05"
dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
 from {username='slave'} at 127.0.0.1:41764
I20260709 12:13:22.432101 14260 raft_consensus.cc:493] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 27 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:22.432456 14260 raft_consensus.cc:3060] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:22.443214 14260 raft_consensus.cc:515] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 28 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:22.450026 14260 leader_election.cc:290] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 28 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:22.451146 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89bb37b32a7f408b9730abb56b9cfa05" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: true dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:13:22.451970 14339 raft_consensus.cc:3055] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 27 LEADER]: Stepping down as leader of term 27
I20260709 12:13:22.452312 14339 raft_consensus.cc:740] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 27 LEADER]: Becoming Follower/Learner. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:13:22.454536 14339 consensus_queue.cc:260] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 27.15, Last appended by leader: 15, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:13:22.453464 14876 consensus_peers.cc:597] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:22.457691 14339 raft_consensus.cc:3060] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 27 FOLLOWER]: Advancing to term 28
W20260709 12:13:22.459182 14876 consensus_peers.cc:597] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:22.463673 14876 consensus_peers.cc:597] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:22.465780 14876 consensus_peers.cc:597] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:22.474231 14303 consensus_peers.cc:597] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:22.475112 14906 raft_consensus.cc:2955] T 90097151efa7426faeaea3ff87a7ea78 P 73d01e9b1a9d49358da4985b21d681db [term 21 FOLLOWER]: Committing config change with OpId 21.16: config changed from index 15 to 16, VOTER 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
W20260709 12:13:22.482838 14876 consensus_peers.cc:597] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:22.485239 14303 consensus_peers.cc:597] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:22.489606 14339 raft_consensus.cc:2468] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 28.
I20260709 12:13:22.492818 14230 leader_election.cc:304] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:13:22.493775 22823 raft_consensus.cc:2804] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 28 FOLLOWER]: Leader election won for term 28
I20260709 12:13:22.494403 22823 raft_consensus.cc:697] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 28 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:13:22.495357 22823 consensus_queue.cc:237] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 27.15, Last appended by leader: 15, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:13:22.489135 14229 consensus_peers.cc:597] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:22.519507 14303 consensus_peers.cc:597] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:22.498343 14074 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 90097151efa7426faeaea3ff87a7ea78 with cas_config_opid_index 15: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:22.503455 14079 catalog_manager.cc:5697] T 90097151efa7426faeaea3ff87a7ea78 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: config changed from index 15 to 16, VOTER 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130) evicted. New cstate: current_term: 21 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:13:22.497543 22828 tablet_bootstrap.cc:492] T 8efcd0417f0c412280654006e6389763 P 73d01e9b1a9d49358da4985b21d681db: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=1 applied=13 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:22.537249 22828 tablet_bootstrap.cc:492] T 8efcd0417f0c412280654006e6389763 P 73d01e9b1a9d49358da4985b21d681db: Bootstrap complete.
I20260709 12:13:22.542825 22828 ts_tablet_manager.cc:1403] T 8efcd0417f0c412280654006e6389763 P 73d01e9b1a9d49358da4985b21d681db: Time spent bootstrapping tablet: real 0.533s	user 0.045s	sys 0.022s
W20260709 12:13:22.534204 14303 consensus_peers.cc:597] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:22.539713 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 93709.7us
I20260709 12:13:22.553061 22828 raft_consensus.cc:359] T 8efcd0417f0c412280654006e6389763 P 73d01e9b1a9d49358da4985b21d681db [term 23 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } }
I20260709 12:13:22.568015 22828 raft_consensus.cc:740] T 8efcd0417f0c412280654006e6389763 P 73d01e9b1a9d49358da4985b21d681db [term 23 LEARNER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Initialized, Role: LEARNER
I20260709 12:13:22.568665 22828 consensus_queue.cc:260] T 8efcd0417f0c412280654006e6389763 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } }
W20260709 12:13:22.555644 14303 consensus_peers.cc:597] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:22.562682 14229 consensus_peers.cc:597] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:22.545235 14876 consensus_peers.cc:597] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:22.588340 14303 consensus_peers.cc:597] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:22.574194 22828 ts_tablet_manager.cc:1434] T 8efcd0417f0c412280654006e6389763 P 73d01e9b1a9d49358da4985b21d681db: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.002s
I20260709 12:13:22.599661 14088 catalog_manager.cc:5697] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: term changed from 27 to 28, leader changed from 65c9c1653b3346b39a0e118540e6080c (127.12.174.131) to 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130). New cstate: current_term: 28 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } }
W20260709 12:13:22.598349 14229 consensus_peers.cc:597] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:22.603989 14229 leader_election.cc:336] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 28 election: RPC error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:13:22.639492 14303 consensus_peers.cc:597] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:22.638638 14348 tablet_copy_service.cc:342] P 65c9c1653b3346b39a0e118540e6080c: Request end of tablet copy session 73d01e9b1a9d49358da4985b21d681db-8efcd0417f0c412280654006e6389763 received from {username='slave'} at 127.0.0.1:55492
I20260709 12:13:22.642668 14348 tablet_copy_service.cc:434] P 65c9c1653b3346b39a0e118540e6080c: ending tablet copy session 73d01e9b1a9d49358da4985b21d681db-8efcd0417f0c412280654006e6389763 on tablet 8efcd0417f0c412280654006e6389763 with peer 73d01e9b1a9d49358da4985b21d681db
W20260709 12:13:22.655483 14876 consensus_peers.cc:597] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:22.662207 14876 consensus_peers.cc:597] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:22.662424 14906 raft_consensus.cc:1217] T 8efcd0417f0c412280654006e6389763 P 73d01e9b1a9d49358da4985b21d681db [term 23 LEARNER]: Deduplicated request from leader. Original: 23.12->[23.13-23.13]   Dedup: 23.13->[]
W20260709 12:13:22.655179 14229 consensus_peers.cc:597] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:22.694356 14303 consensus_peers.cc:597] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:22.698676 14876 consensus_peers.cc:597] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:22.699411 14876 consensus_peers.cc:597] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:22.711638 14303 consensus_peers.cc:597] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:22.718130 12986 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:13:22.719919 12986 tablet_replica.cc:333] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf: stopping tablet replica
I20260709 12:13:22.721019 12986 raft_consensus.cc:2243] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:22.721717 12986 raft_consensus.cc:2272] T fc8bff37f52742a3a3b8a39c45ade183 P 885067a0d31741bfb5c9935788e315bf [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.722043 14246 tablet_service.cc:1558] Processing DeleteTablet for tablet 90097151efa7426faeaea3ff87a7ea78 with delete_type TABLET_DATA_TOMBSTONED (TS 17aab1bbf5014936aa18cc21818b26ec not found in new config with opid_index 16) from {username='slave'} at 127.0.0.1:57116
I20260709 12:13:22.725054 12986 tablet_replica.cc:333] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf: stopping tablet replica
W20260709 12:13:22.735785 14303 consensus_peers.cc:597] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:22.737674 12986 raft_consensus.cc:2243] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:22.742467 12986 raft_consensus.cc:2272] T 15f7cecfe772454980c8ae9d1803fe98 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:22.745095 14876 consensus_peers.cc:597] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:22.752125 12986 tablet_replica.cc:333] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf: stopping tablet replica
W20260709 12:13:22.752959 14229 consensus_peers.cc:597] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:22.753294 12986 raft_consensus.cc:2243] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 25 FOLLOWER]: Raft consensus shutting down.
W20260709 12:13:22.768731 14303 consensus_peers.cc:597] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:22.783659 12986 raft_consensus.cc:2272] T cbe93a4954a24795882e04fa537ddf4d P 885067a0d31741bfb5c9935788e315bf [term 25 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:22.785238 14303 consensus_peers.cc:597] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:22.786976 22858 tablet_replica.cc:333] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec: stopping tablet replica
I20260709 12:13:22.788215 22858 raft_consensus.cc:2243] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:22.789280 22858 raft_consensus.cc:2272] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.794587 22858 ts_tablet_manager.cc:1916] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:13:22.802908 12986 tablet_replica.cc:333] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf: stopping tablet replica
I20260709 12:13:22.804008 12986 raft_consensus.cc:2243] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:22.804700 12986 raft_consensus.cc:2272] T 7c8882b1b37d4e84a94a2e1e321a8755 P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:22.804639 14303 consensus_peers.cc:597] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:22.824832 14876 consensus_peers.cc:597] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:22.824930 22858 ts_tablet_manager.cc:1929] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 21.15
I20260709 12:13:22.825641 22858 log.cc:1199] T 90097151efa7426faeaea3ff87a7ea78 P 17aab1bbf5014936aa18cc21818b26ec: Deleting WAL directory at /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598886212958-12986-0/minicluster-data/ts-1-root/wals/90097151efa7426faeaea3ff87a7ea78
W20260709 12:13:22.840325 14303 consensus_peers.cc:597] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:22.845541 14074 catalog_manager.cc:5028] TS 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): tablet 90097151efa7426faeaea3ff87a7ea78 (table test-workload [id=9799d484f7a34e5da74a97eb5250aa4d]) successfully deleted
I20260709 12:13:22.928294 12986 tablet_replica.cc:333] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf: stopping tablet replica
I20260709 12:13:22.929296 12986 raft_consensus.cc:2243] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:22.930166 12986 raft_consensus.cc:2272] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:22.945998 14229 consensus_peers.cc:597] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:22.949808 12986 tablet_replica.cc:333] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf: stopping tablet replica
I20260709 12:13:22.950800 12986 raft_consensus.cc:2243] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:22.959632 12986 raft_consensus.cc:2272] T e0c03baacf444c019b39ae64998e2686 P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.966396 12986 tablet_replica.cc:333] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf: stopping tablet replica
I20260709 12:13:22.967260 12986 raft_consensus.cc:2243] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:22.968115 12986 raft_consensus.cc:2272] T 2b1a5d42755443119571654ad5c5f2f3 P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.971534 12986 tablet_replica.cc:333] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf: stopping tablet replica
I20260709 12:13:22.972535 12986 raft_consensus.cc:2243] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 23 LEADER]: Raft consensus shutting down.
I20260709 12:13:22.973572 12986 raft_consensus.cc:2272] T 0041f9f2b90844269c31eba4aeeab0a7 P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:22.997998 12986 tablet_replica.cc:333] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf: stopping tablet replica
I20260709 12:13:22.998925 12986 raft_consensus.cc:2243] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:22.999548 12986 raft_consensus.cc:2272] T b4a0f56d071c4634842ea1584dfe40e6 P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.018813 12986 tablet_replica.cc:333] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf: stopping tablet replica
I20260709 12:13:23.028733 12986 raft_consensus.cc:2243] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 27 LEADER]: Raft consensus shutting down.
I20260709 12:13:23.029851 12986 raft_consensus.cc:2272] T f1a4a5f0a8324f479c5e1f499164bf42 P 885067a0d31741bfb5c9935788e315bf [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.034654 14077 maintenance_manager.cc:419] P d07070be2c074f4cb9ad35f1580c4ef7: Scheduling FlushDeltaMemStoresOp(00000000000000000000000000000000): perf score=0.033349
I20260709 12:13:23.050779 12986 tablet_replica.cc:333] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf: stopping tablet replica
I20260709 12:13:23.051947 12986 raft_consensus.cc:2243] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:23.063081 12986 raft_consensus.cc:2272] T e1947202e59d4516a1b38a1583a3242d P 885067a0d31741bfb5c9935788e315bf [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.069135 12986 tablet_replica.cc:333] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf: stopping tablet replica
I20260709 12:13:23.070113 12986 raft_consensus.cc:2243] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 23 LEADER]: Raft consensus shutting down.
I20260709 12:13:23.075016 12986 raft_consensus.cc:2272] T fb01374e8ef4493d909377b2b9179e39 P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.077946 12986 tablet_replica.cc:333] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf: stopping tablet replica
I20260709 12:13:23.079071 12986 raft_consensus.cc:2243] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:23.079799 12986 raft_consensus.cc:2272] T 0a11d7ae457a408cac205ac501217c61 P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.082772 12986 tablet_replica.cc:333] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf: stopping tablet replica
I20260709 12:13:23.083560 12986 raft_consensus.cc:2243] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 25 LEADER]: Raft consensus shutting down.
I20260709 12:13:23.084632 12986 raft_consensus.cc:2272] T e85036847fc14bab8d6b10e9cbee3aca P 885067a0d31741bfb5c9935788e315bf [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.087854 12986 tablet_replica.cc:333] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf: stopping tablet replica
I20260709 12:13:23.088647 12986 raft_consensus.cc:2243] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 23 LEADER]: Raft consensus shutting down.
I20260709 12:13:23.089833 12986 raft_consensus.cc:2272] T fd6a20fc287b48fbb5cbf25078173b21 P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.093493 12986 tablet_replica.cc:333] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf: stopping tablet replica
I20260709 12:13:23.094381 12986 raft_consensus.cc:2243] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:23.094995 12986 raft_consensus.cc:2272] T afdbef67ffe54739bdccc3b631f66c89 P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.097951 12986 tablet_replica.cc:333] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf: stopping tablet replica
I20260709 12:13:23.098783 12986 raft_consensus.cc:2243] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:23.099754 12986 raft_consensus.cc:2272] T b317dbf6b7fd4860be0fa436e8b54807 P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.103466 12986 tablet_replica.cc:333] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf: stopping tablet replica
I20260709 12:13:23.104329 12986 raft_consensus.cc:2243] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:23.105271 12986 raft_consensus.cc:2272] T 60aca7b73a544dfc9a4bd6918b27d132 P 885067a0d31741bfb5c9935788e315bf [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.108157 12986 tablet_replica.cc:333] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf: stopping tablet replica
I20260709 12:13:23.108883 12986 raft_consensus.cc:2243] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:23.109566 12986 raft_consensus.cc:2272] T f9f69e925a8f4da7ba2b318edae7b194 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.112246 12986 tablet_replica.cc:333] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf: stopping tablet replica
I20260709 12:13:23.113171 12986 raft_consensus.cc:2243] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:23.114045 12986 raft_consensus.cc:2272] T 8efcd0417f0c412280654006e6389763 P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.117059 12986 tablet_replica.cc:333] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf: stopping tablet replica
I20260709 12:13:23.117949 12986 raft_consensus.cc:2243] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 28 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:23.118582 12986 raft_consensus.cc:2272] T 57e5f03a80374104a130f5b0e70a0280 P 885067a0d31741bfb5c9935788e315bf [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.121579 12986 tablet_replica.cc:333] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf: stopping tablet replica
I20260709 12:13:23.122676 12986 raft_consensus.cc:2243] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:23.123865 12986 raft_consensus.cc:2272] T 88b5f4f19c2a4585b93b312cc1f3d17f P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.126677 12986 tablet_replica.cc:333] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf: stopping tablet replica
I20260709 12:13:23.127535 12986 raft_consensus.cc:2243] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 26 LEADER]: Raft consensus shutting down.
I20260709 12:13:23.128654 12986 raft_consensus.cc:2272] T ec0fc0e91c904a0daeb3e29ee24a492d P 885067a0d31741bfb5c9935788e315bf [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.132851 12986 tablet_replica.cc:333] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf: stopping tablet replica
I20260709 12:13:23.133821 12986 raft_consensus.cc:2243] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 31 LEADER]: Raft consensus shutting down.
I20260709 12:13:23.135087 12986 raft_consensus.cc:2272] T 5879727b381a48b18b1949c96428b5d0 P 885067a0d31741bfb5c9935788e315bf [term 31 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.137567 12986 tablet_replica.cc:333] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf: stopping tablet replica
I20260709 12:13:23.138373 12986 raft_consensus.cc:2243] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 27 LEADER]: Raft consensus shutting down.
I20260709 12:13:23.139472 12986 raft_consensus.cc:2272] T 0d203245740a4821b7ebcc7669c8b2af P 885067a0d31741bfb5c9935788e315bf [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.142297 12986 tablet_replica.cc:333] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf: stopping tablet replica
I20260709 12:13:23.143121 12986 raft_consensus.cc:2243] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:23.143944 12986 raft_consensus.cc:2272] T f52421be255e4fab824173d17981b5bb P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.146880 12986 tablet_replica.cc:333] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf: stopping tablet replica
I20260709 12:13:23.147646 12986 raft_consensus.cc:2243] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:23.148372 12986 raft_consensus.cc:2272] T 36091607df2f46059df62d677842a031 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.151119 12986 tablet_replica.cc:333] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf: stopping tablet replica
I20260709 12:13:23.154951 12986 raft_consensus.cc:2243] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 22 LEADER]: Raft consensus shutting down.
I20260709 12:13:23.155943 12986 raft_consensus.cc:2272] T 1eb6edfa93424aa68a4239fd27a62064 P 885067a0d31741bfb5c9935788e315bf [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.158679 12986 tablet_replica.cc:333] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf: stopping tablet replica
I20260709 12:13:23.159543 12986 raft_consensus.cc:2243] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:13:23.160729 12986 raft_consensus.cc:2272] T 7879f4a298eb4e69ac692911bd5ac5f8 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.163848 12986 tablet_replica.cc:333] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf: stopping tablet replica
I20260709 12:13:23.164674 12986 raft_consensus.cc:2243] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:23.165766 12986 raft_consensus.cc:2272] T 90097151efa7426faeaea3ff87a7ea78 P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.168578 12986 tablet_replica.cc:333] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf: stopping tablet replica
I20260709 12:13:23.169438 12986 raft_consensus.cc:2243] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:23.170069 12986 raft_consensus.cc:2272] T afce5304599246a580d798fc0c843964 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.171691 14076 maintenance_manager.cc:643] P d07070be2c074f4cb9ad35f1580c4ef7: FlushDeltaMemStoresOp(00000000000000000000000000000000) complete. Timing: real 0.135s	user 0.033s	sys 0.008s Metrics: {"bytes_written":7562,"delete_count":0,"lbm_write_time_us":980,"lbm_writes_lt_1ms":7,"reinsert_count":0,"update_count":316}
I20260709 12:13:23.172977 12986 tablet_replica.cc:333] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf: stopping tablet replica
I20260709 12:13:23.173887 14077 maintenance_manager.cc:419] P d07070be2c074f4cb9ad35f1580c4ef7: Scheduling MajorDeltaCompactionOp(00000000000000000000000000000000): perf score=0.363668
I20260709 12:13:23.175483 12986 raft_consensus.cc:2243] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:23.176276 12986 raft_consensus.cc:2272] T 3832505489c04d04a69e256187061921 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.179204 12986 tablet_replica.cc:333] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf: stopping tablet replica
I20260709 12:13:23.180078 12986 raft_consensus.cc:2243] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:23.180694 12986 raft_consensus.cc:2272] T 53f6ce2ae2d8465cb314a84096322886 P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.183758 12986 tablet_replica.cc:333] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf: stopping tablet replica
I20260709 12:13:23.184600 12986 raft_consensus.cc:2243] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:13:23.185660 12986 raft_consensus.cc:2272] T c022caf6920747708b0cfc607c962951 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.188431 12986 tablet_replica.cc:333] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf: stopping tablet replica
I20260709 12:13:23.189358 12986 raft_consensus.cc:2243] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:23.190069 12986 raft_consensus.cc:2272] T ff1f0497acbe4a31944b5bac60c5482c P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.193164 12986 tablet_replica.cc:333] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf: stopping tablet replica
I20260709 12:13:23.212634 12986 raft_consensus.cc:2243] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:23.213595 12986 raft_consensus.cc:2272] T 3c9d740fa53e42179ad8d244b4c179fd P 885067a0d31741bfb5c9935788e315bf [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.232762 12986 tablet_replica.cc:333] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf: stopping tablet replica
I20260709 12:13:23.233898 12986 raft_consensus.cc:2243] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:13:23.235376 12986 raft_consensus.cc:2272] T 5485933837894417a3f0f89d55af1296 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.238480 12986 tablet_replica.cc:333] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf: stopping tablet replica
I20260709 12:13:23.240442 12986 raft_consensus.cc:2243] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:23.241346 12986 raft_consensus.cc:2272] T 89bb37b32a7f408b9730abb56b9cfa05 P 885067a0d31741bfb5c9935788e315bf [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.246717 12986 tablet_replica.cc:333] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf: stopping tablet replica
I20260709 12:13:23.248621 12986 raft_consensus.cc:2243] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 24 LEADER]: Raft consensus shutting down.
I20260709 12:13:23.250159 12986 raft_consensus.cc:2272] T bd5274ac33c2483681726f6b8eccdc6c P 885067a0d31741bfb5c9935788e315bf [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.253542 12986 tablet_replica.cc:333] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf: stopping tablet replica
I20260709 12:13:23.254448 12986 raft_consensus.cc:2243] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 29 LEADER]: Raft consensus shutting down.
I20260709 12:13:23.255774 12986 raft_consensus.cc:2272] T e9b8048bcdf74441aac2cd21ac7af4da P 885067a0d31741bfb5c9935788e315bf [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.258713 22814 raft_consensus.cc:493] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:13:23.259501 12986 tablet_replica.cc:333] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf: stopping tablet replica
I20260709 12:13:23.259462 22814 raft_consensus.cc:515] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:23.260667 12986 raft_consensus.cc:2243] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:23.261823 12986 raft_consensus.cc:2272] T ba1914a8ae9f4959971f147e578773fc P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.264732 12986 tablet_replica.cc:333] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf: stopping tablet replica
I20260709 12:13:23.275218 12986 raft_consensus.cc:2243] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:23.275816 12986 raft_consensus.cc:2272] T 938efad339fd47e1b0b6d37fbc612db2 P 885067a0d31741bfb5c9935788e315bf [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.266366 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:23.267657 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e244b5af3ce244339f6fe0bd22a35eba" candidate_uuid: "885067a0d31741bfb5c9935788e315bf" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:13:23.292146 14335 raft_consensus.cc:1275] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 28 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 27 index: 15. Preceding OpId from leader: term: 28 index: 16. (index mismatch)
I20260709 12:13:23.295280 12986 tablet_replica.cc:333] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf: stopping tablet replica
I20260709 12:13:23.295977 14155 leader_election.cc:304] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 885067a0d31741bfb5c9935788e315bf; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:13:23.296988 22837 raft_consensus.cc:2749] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:23.267758 22814 leader_election.cc:290] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:13:23.296263 12986 raft_consensus.cc:2243] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 28 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:23.306663 12986 raft_consensus.cc:2272] T ae82f0f3bcac4608987cd7c935c9799b P 885067a0d31741bfb5c9935788e315bf [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.309973 12986 tablet_replica.cc:333] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf: stopping tablet replica
I20260709 12:13:23.311422 12986 raft_consensus.cc:2243] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:23.315552 22790 consensus_queue.cc:1048] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:13:23.316398 12986 raft_consensus.cc:2272] T bf9bea0d16e44efabb5cdd53e3828438 P 885067a0d31741bfb5c9935788e315bf [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.320007 12986 tablet_replica.cc:333] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf: stopping tablet replica
I20260709 12:13:23.323148 12986 raft_consensus.cc:2243] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:23.326954 12986 raft_consensus.cc:2272] T f57e398f580944f0866ea5fab71be87f P 885067a0d31741bfb5c9935788e315bf [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.363612 12986 tablet_replica.cc:333] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf: stopping tablet replica
I20260709 12:13:23.364533 12986 raft_consensus.cc:2243] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 28 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:23.374100 12986 raft_consensus.cc:2272] T f548bfe8d3c540e487760b5966d0e7f8 P 885067a0d31741bfb5c9935788e315bf [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.382597 12986 tablet_replica.cc:333] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf: stopping tablet replica
I20260709 12:13:23.383471 12986 raft_consensus.cc:2243] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 24 LEADER]: Raft consensus shutting down.
I20260709 12:13:23.384588 12986 raft_consensus.cc:2272] T 8d9964631a6940e4b111e1b1dabb0aae P 885067a0d31741bfb5c9935788e315bf [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.391052 12986 tablet_replica.cc:333] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf: stopping tablet replica
I20260709 12:13:23.392110 12986 raft_consensus.cc:2243] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:23.392894 12986 raft_consensus.cc:2272] T e244b5af3ce244339f6fe0bd22a35eba P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.395859 12986 tablet_replica.cc:333] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf: stopping tablet replica
I20260709 12:13:23.396634 12986 raft_consensus.cc:2243] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:23.397307 12986 raft_consensus.cc:2272] T cd9d6c9c152f47769123b7748d8c8262 P 885067a0d31741bfb5c9935788e315bf [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:23.436528 22808 raft_consensus.cc:1064] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c: attempting to promote NON_VOTER 73d01e9b1a9d49358da4985b21d681db to VOTER
W20260709 12:13:23.437038 22808 raft_consensus.cc:1068] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c: Unable to promote non-voter 73d01e9b1a9d49358da4985b21d681db: Service unavailable: leader transfer in progress
I20260709 12:13:23.499014 14256 consensus_queue.cc:237] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } }
I20260709 12:13:23.581451 14330 raft_consensus.cc:1275] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 12:13:23.587487 22790 consensus_queue.cc:1048] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 12:13:23.591174 14229 consensus_peers.cc:597] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec -> Peer 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341): Couldn't send request to peer 73d01e9b1a9d49358da4985b21d681db. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: afdbef67ffe54739bdccc3b631f66c89. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:23.596436 14229 consensus_peers.cc:597] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:23.630411 14076 maintenance_manager.cc:643] P d07070be2c074f4cb9ad35f1580c4ef7: MajorDeltaCompactionOp(00000000000000000000000000000000) complete. Timing: real 0.455s	user 0.130s	sys 0.086s Metrics: {"cfile_cache_miss":10,"cfile_cache_miss_bytes":28854,"cfile_init":4,"delete_count":0,"delta_blocks_compacted":2,"delta_iterators_relevant":2,"dirs.queue_time_us":92987,"dirs.run_cpu_time_us":660,"dirs.run_wall_time_us":2595,"lbm_read_time_us":11118,"lbm_reads_1-10_ms":2,"lbm_reads_lt_1ms":24,"lbm_write_time_us":6801,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":11,"peak_mem_usage":581174,"reinsert_count":0,"thread_start_us":95858,"threads_started":2,"update_count":330}
I20260709 12:13:23.634006 14077 maintenance_manager.cc:419] P d07070be2c074f4cb9ad35f1580c4ef7: Scheduling MinorDeltaCompactionOp(00000000000000000000000000000000): perf score=0.002000
I20260709 12:13:23.635087 14076 maintenance_manager.cc:643] P d07070be2c074f4cb9ad35f1580c4ef7: MinorDeltaCompactionOp(00000000000000000000000000000000) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {}
I20260709 12:13:23.639770 22790 raft_consensus.cc:2955] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 22 LEADER]: Committing config change with OpId 22.15: config changed from index -1 to 15, NON_VOTER 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } } }
I20260709 12:13:23.644394 14330 raft_consensus.cc:2955] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Committing config change with OpId 22.15: config changed from index -1 to 15, NON_VOTER 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } } }
I20260709 12:13:23.675239 14330 consensus_queue.cc:237] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } }
I20260709 12:13:23.677270 14079 catalog_manager.cc:5697] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c reported cstate change: config changed from index -1 to 15, NON_VOTER 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) added. New cstate: current_term: 22 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } } }
I20260709 12:13:23.723671 14260 raft_consensus.cc:1275] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:13:23.727357 22822 consensus_queue.cc:1048] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 12:13:23.755275 14303 consensus_peers.cc:597] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c -> Peer 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341): Couldn't send request to peer 73d01e9b1a9d49358da4985b21d681db. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 938efad339fd47e1b0b6d37fbc612db2. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:23.802312 14303 consensus_peers.cc:597] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:23.845148 22861 raft_consensus.cc:2955] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 19 LEADER]: Committing config change with OpId 19.12: config changed from index -1 to 12, NON_VOTER 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } } }
I20260709 12:13:23.847704 14260 raft_consensus.cc:2955] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Committing config change with OpId 19.12: config changed from index -1 to 12, NON_VOTER 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } } }
I20260709 12:13:23.891535 14081 catalog_manager.cc:5697] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: config changed from index -1 to 12, NON_VOTER 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) added. New cstate: current_term: 19 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } } }
I20260709 12:13:23.910864 22623 raft_consensus.cc:1064] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c: attempting to promote NON_VOTER 73d01e9b1a9d49358da4985b21d681db to VOTER
I20260709 12:13:23.918200 22623 consensus_queue.cc:237] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 11, Current term: 23, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:13:23.932235 14136 auto_rebalancer.cc:629] Failed to schedule move for tablet 1eb6edfa93424aa68a4239fd27a62064: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111)
I20260709 12:13:23.937814 14330 consensus_queue.cc:237] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 25.14, Last appended by leader: 13, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } }
I20260709 12:13:23.953694 14906 raft_consensus.cc:1275] T 8efcd0417f0c412280654006e6389763 P 73d01e9b1a9d49358da4985b21d681db [term 23 LEARNER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 12:13:23.954550 14260 raft_consensus.cc:1275] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 12:13:23.958714 22861 consensus_queue.cc:1048] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:13:23.959816 22808 consensus_queue.cc:1048] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 12:13:23.963243 14303 consensus_peers.cc:597] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:23.984731 14303 consensus_peers.cc:597] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c -> Peer 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341): Couldn't send request to peer 73d01e9b1a9d49358da4985b21d681db. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: cbe93a4954a24795882e04fa537ddf4d. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:23.988655 14256 raft_consensus.cc:1275] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 25 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 25 index: 14. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
I20260709 12:13:23.991775 22861 consensus_queue.cc:1048] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 12:13:24.000821 14303 consensus_peers.cc:597] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:24.000145 22808 raft_consensus.cc:2955] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 23 LEADER]: Committing config change with OpId 23.14: config changed from index 13 to 14, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:13:24.008217 22623 raft_consensus.cc:493] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:13:24.008888 22623 raft_consensus.cc:515] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:24.009567 14260 raft_consensus.cc:2955] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Committing config change with OpId 23.14: config changed from index 13 to 14, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:13:24.011540 22623 leader_election.cc:290] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:13:24.019186 14303 leader_election.cc:336] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111)
I20260709 12:13:24.019268 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:24.021502 14304 leader_election.cc:304] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:24.028756 22623 raft_consensus.cc:2749] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:24.028425 14906 raft_consensus.cc:2955] T 8efcd0417f0c412280654006e6389763 P 73d01e9b1a9d49358da4985b21d681db [term 23 FOLLOWER]: Committing config change with OpId 23.14: config changed from index 13 to 14, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:13:24.044984 14079 catalog_manager.cc:5697] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: config changed from index 13 to 14, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New cstate: current_term: 23 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:13:24.046921 22623 raft_consensus.cc:2955] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 25 LEADER]: Committing config change with OpId 25.15: config changed from index -1 to 15, NON_VOTER 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } } }
I20260709 12:13:24.063143 14256 raft_consensus.cc:2955] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 25 FOLLOWER]: Committing config change with OpId 25.15: config changed from index -1 to 15, NON_VOTER 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } } }
W20260709 12:13:24.064628 14211 debug-util.cc:398] Leaking SignalData structure 0x7b080025a740 after lost signal to thread 12989
W20260709 12:13:24.074864 14211 debug-util.cc:398] Leaking SignalData structure 0x7b0800324120 after lost signal to thread 14122
W20260709 12:13:24.076531 14211 debug-util.cc:398] Leaking SignalData structure 0x7b080032b7c0 after lost signal to thread 14289
I20260709 12:13:24.090840 22854 raft_consensus.cc:493] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:13:24.091634 22854 raft_consensus.cc:515] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:24.092585 22791 raft_consensus.cc:493] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:13:24.093220 22791 raft_consensus.cc:515] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:13:24.099313 14876 leader_election.cc:336] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111)
I20260709 12:13:24.102588 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 28 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:13:24.100574 14211 debug-util.cc:398] Leaking SignalData structure 0x7b080034a960 after lost signal to thread 14363
I20260709 12:13:24.101282 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
W20260709 12:13:24.108557 14211 debug-util.cc:398] Leaking SignalData structure 0x7b08002c0020 after lost signal to thread 14936
I20260709 12:13:24.108736 14877 leader_election.cc:304] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:24.109862 22850 raft_consensus.cc:2749] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:13:24.101312 22791 leader_election.cc:290] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:24.102151 22854 leader_election.cc:290] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:13:24.112434 14229 leader_election.cc:336] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111)
I20260709 12:13:24.112995 14229 leader_election.cc:304] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:24.113859 22791 raft_consensus.cc:2749] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:13:24.122325 14079 catalog_manager.cc:5697] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c reported cstate change: config changed from index -1 to 15, NON_VOTER 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) added. New cstate: current_term: 25 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:24.163966 22861 raft_consensus.cc:493] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:13:24.164608 22861 raft_consensus.cc:515] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:24.166832 22861 leader_election.cc:290] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:13:24.168942 22854 raft_consensus.cc:493] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:13:24.169572 22854 raft_consensus.cc:515] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:24.170873 14908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:13:24.171599 14908 raft_consensus.cc:2468] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 27.
I20260709 12:13:24.171944 22854 leader_election.cc:290] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:13:24.174186 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:24.174379 14303 leader_election.cc:304] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:13:24.175916 22623 raft_consensus.cc:2804] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:13:24.176317 22623 raft_consensus.cc:493] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 27 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:13:24.176679 22623 raft_consensus.cc:3060] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:24.181417 22822 raft_consensus.cc:493] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:13:24.182585 22822 raft_consensus.cc:515] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:24.185550 22855 raft_consensus.cc:493] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:13:24.186192 22855 raft_consensus.cc:515] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:13:24.187522 14876 leader_election.cc:336] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111)
I20260709 12:13:24.195124 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:24.188416 22855 leader_election.cc:290] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:13:24.184883 22822 leader_election.cc:290] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:13:24.191679 14908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
W20260709 12:13:24.193862 14229 leader_election.cc:336] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111)
I20260709 12:13:24.195108 14876 leader_election.cc:304] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
W20260709 12:13:24.199949 14303 leader_election.cc:336] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111)
I20260709 12:13:24.200130 22854 raft_consensus.cc:2749] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:13:24.199154 14229 leader_election.cc:304] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:24.202495 22855 raft_consensus.cc:2749] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:24.214547 22822 raft_consensus.cc:493] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 31 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:13:24.215366 22822 raft_consensus.cc:515] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:24.217783 22822 leader_election.cc:290] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:13:24.216749 14303 leader_election.cc:336] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111)
I20260709 12:13:24.219352 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 32 candidate_status { last_received { term: 31 index: 14 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:24.222050 14303 leader_election.cc:304] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:24.222891 22884 ts_tablet_manager.cc:933] T afdbef67ffe54739bdccc3b631f66c89 P 73d01e9b1a9d49358da4985b21d681db: Initiating tablet copy from peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:13:24.224184 22822 raft_consensus.cc:2749] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:24.228211 22822 raft_consensus.cc:493] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:13:24.228843 22822 raft_consensus.cc:515] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:24.234025 22791 raft_consensus.cc:493] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:13:24.234797 22791 raft_consensus.cc:515] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:13:24.241519 14229 leader_election.cc:336] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111)
I20260709 12:13:24.241855 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:24.242455 22791 leader_election.cc:290] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:24.243610 22822 leader_election.cc:290] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:13:24.244532 14230 leader_election.cc:304] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:24.245935 22855 raft_consensus.cc:2749] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:24.247989 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:24.234117 22623 raft_consensus.cc:515] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 28 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:24.252015 22623 leader_election.cc:290] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 28 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:13:24.254410 22884 tablet_copy_client.cc:323] T afdbef67ffe54739bdccc3b631f66c89 P 73d01e9b1a9d49358da4985b21d681db: tablet copy: Beginning tablet copy session from remote peer at address 127.12.174.130:36673
W20260709 12:13:24.254819 14303 leader_election.cc:336] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 32 pre-election: RPC error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111)
I20260709 12:13:24.255425 14303 leader_election.cc:304] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:24.256588 22623 raft_consensus.cc:2749] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 31 FOLLOWER]: Leader pre-election lost for term 32. Reason: could not achieve majority
I20260709 12:13:24.257407 14275 tablet_copy_service.cc:140] P 17aab1bbf5014936aa18cc21818b26ec: Received BeginTabletCopySession request for tablet afdbef67ffe54739bdccc3b631f66c89 from peer 73d01e9b1a9d49358da4985b21d681db ({username='slave'} at 127.0.0.1:53050)
I20260709 12:13:24.258057 14275 tablet_copy_service.cc:161] P 17aab1bbf5014936aa18cc21818b26ec: Beginning new tablet copy session on tablet afdbef67ffe54739bdccc3b631f66c89 from peer 73d01e9b1a9d49358da4985b21d681db at {username='slave'} at 127.0.0.1:53050: session id = 73d01e9b1a9d49358da4985b21d681db-afdbef67ffe54739bdccc3b631f66c89
I20260709 12:13:24.263227 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d203245740a4821b7ebcc7669c8b2af" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:13:24.263972 14906 raft_consensus.cc:3060] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:24.268330 14275 tablet_copy_source_session.cc:215] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 12:13:24.270113 14303 leader_election.cc:336] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111)
I20260709 12:13:24.275784 14303 leader_election.cc:304] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:24.276774 22808 raft_consensus.cc:2749] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:24.271819 14906 raft_consensus.cc:2468] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 28.
I20260709 12:13:24.281664 22884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afdbef67ffe54739bdccc3b631f66c89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:24.283651 22791 raft_consensus.cc:493] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:13:24.284281 22791 raft_consensus.cc:515] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:24.287253 22855 raft_consensus.cc:493] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:13:24.287688 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:24.287992 22855 raft_consensus.cc:515] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:24.288479 14330 raft_consensus.cc:2468] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 23.
I20260709 12:13:24.290026 14230 leader_election.cc:304] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:13:24.290378 22855 leader_election.cc:290] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:13:24.290978 22790 raft_consensus.cc:493] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:13:24.292066 22790 raft_consensus.cc:515] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:13:24.291258 14229 leader_election.cc:336] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111)
I20260709 12:13:24.294260 22790 leader_election.cc:290] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:24.294884 22790 raft_consensus.cc:2804] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:13:24.295122 22791 leader_election.cc:290] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:24.295301 22790 raft_consensus.cc:493] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:13:24.295969 22790 raft_consensus.cc:3060] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:24.296701 14303 leader_election.cc:304] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:13:24.297480 22623 raft_consensus.cc:2804] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 28 FOLLOWER]: Leader election won for term 28
I20260709 12:13:24.298079 22623 raft_consensus.cc:697] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 28 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:13:24.299093 22623 consensus_queue.cc:237] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 27.19, Last appended by leader: 19, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:13:24.299610 14229 leader_election.cc:336] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111)
I20260709 12:13:24.295624 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:13:24.303000 14906 raft_consensus.cc:2468] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 26.
W20260709 12:13:24.314672 14229 leader_election.cc:336] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111)
I20260709 12:13:24.315773 14229 leader_election.cc:304] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:24.319775 22790 raft_consensus.cc:515] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:24.320883 22854 raft_consensus.cc:493] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:13:24.322468 22822 raft_consensus.cc:493] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:13:24.323150 22822 raft_consensus.cc:515] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:24.325304 22822 leader_election.cc:290] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:13:24.322496 22855 raft_consensus.cc:2804] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:13:24.326247 22855 raft_consensus.cc:493] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 26 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:13:24.326638 22855 raft_consensus.cc:3060] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:24.329941 22854 raft_consensus.cc:515] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:24.332754 22854 leader_election.cc:290] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:13:24.333959 14303 leader_election.cc:336] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 28 election: RPC error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111)
I20260709 12:13:24.335103 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:24.335824 14330 raft_consensus.cc:2468] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 19.
I20260709 12:13:24.337070 14877 leader_election.cc:304] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
W20260709 12:13:24.338127 14876 leader_election.cc:336] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111)
I20260709 12:13:24.338538 22797 raft_consensus.cc:2804] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:13:24.339020 22797 raft_consensus.cc:493] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:13:24.339418 22797 raft_consensus.cc:3060] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:13:24.348666 14908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:13:24.345417 14079 catalog_manager.cc:5697] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c reported cstate change: term changed from 27 to 28, leader changed from 885067a0d31741bfb5c9935788e315bf (127.12.174.129) to 65c9c1653b3346b39a0e118540e6080c (127.12.174.131). New cstate: current_term: 28 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:13:24.353289 14303 leader_election.cc:336] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111)
W20260709 12:13:24.355074 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 65137.2us
I20260709 12:13:24.356896 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:24.357570 14330 raft_consensus.cc:2468] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 23.
I20260709 12:13:24.361943 22886 raft_consensus.cc:493] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:13:24.366134 22855 raft_consensus.cc:515] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 27 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:24.421880 22886 raft_consensus.cc:515] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:24.423554 22855 leader_election.cc:290] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 27 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:13:24.368290 22790 leader_election.cc:290] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 24 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:24.372145 22797 raft_consensus.cc:515] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:13:24.379681 14229 leader_election.cc:336] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111)
W20260709 12:13:24.434141 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 54501.1us
I20260709 12:13:24.435227 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb01374e8ef4493d909377b2b9179e39" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:13:24.435868 14330 raft_consensus.cc:3060] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:24.403216 22623 raft_consensus.cc:493] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:13:24.436730 14908 raft_consensus.cc:2393] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 20: Already voted for candidate 73d01e9b1a9d49358da4985b21d681db in this term.
I20260709 12:13:24.406049 22888 raft_consensus.cc:493] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 31 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:13:24.438795 22888 raft_consensus.cc:515] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:24.436731 22623 raft_consensus.cc:515] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:24.410183 22808 raft_consensus.cc:493] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:13:24.440755 22808 raft_consensus.cc:515] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:24.442168 22623 leader_election.cc:290] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:13:24.442915 22808 leader_election.cc:290] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:13:24.444620 22888 leader_election.cc:290] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:24.445874 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5485933837894417a3f0f89d55af1296" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:13:24.446511 14336 raft_consensus.cc:3060] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:13:24.450443 14876 leader_election.cc:336] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111)
I20260709 12:13:24.453192 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:24.454587 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:24.440382 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec0fc0e91c904a0daeb3e29ee24a492d" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:13:24.455466 14909 raft_consensus.cc:3060] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:24.455946 22884 tablet_copy_client.cc:806] T afdbef67ffe54739bdccc3b631f66c89 P 73d01e9b1a9d49358da4985b21d681db: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:24.458132 22884 tablet_copy_client.cc:670] T afdbef67ffe54739bdccc3b631f66c89 P 73d01e9b1a9d49358da4985b21d681db: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:24.470898 22854 raft_consensus.cc:493] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
W20260709 12:13:24.421046 14303 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.12.174.190:39655, user_credentials={real_user=slave}} blocked reactor thread for 47809.1us
I20260709 12:13:24.478168 22854 raft_consensus.cc:515] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:24.480829 22854 leader_election.cc:290] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:13:24.472906 14229 leader_election.cc:336] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111)
W20260709 12:13:24.482208 14229 leader_election.cc:336] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111)
I20260709 12:13:24.482533 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:24.483340 14256 raft_consensus.cc:2468] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 20.
I20260709 12:13:24.485201 14877 leader_election.cc:304] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:13:24.487540 14336 raft_consensus.cc:2468] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 20.
I20260709 12:13:24.489972 14230 leader_election.cc:304] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:24.492467 14877 leader_election.cc:304] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:24.444661 22797 leader_election.cc:290] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 20 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:24.497648 22797 raft_consensus.cc:2804] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:13:24.494410 22854 raft_consensus.cc:2804] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:13:24.499491 22854 raft_consensus.cc:493] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:13:24.500128 22854 raft_consensus.cc:3060] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:13:24.500567 14229 leader_election.cc:336] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 32 pre-election: RPC error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111)
I20260709 12:13:24.496868 14330 raft_consensus.cc:2468] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 24.
W20260709 12:13:24.500169 14876 leader_election.cc:336] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111)
I20260709 12:13:24.531047 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 30 candidate_status { last_received { term: 29 index: 16 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:24.530049 14909 raft_consensus.cc:2468] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 27.
I20260709 12:13:24.514936 14303 leader_election.cc:304] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 73d01e9b1a9d49358da4985b21d681db, 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:24.532670 14229 leader_election.cc:304] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 885067a0d31741bfb5c9935788e315bf
W20260709 12:13:24.538098 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 48247.7us
I20260709 12:13:24.508324 22884 tablet_copy_client.cc:538] T afdbef67ffe54739bdccc3b631f66c89 P 73d01e9b1a9d49358da4985b21d681db: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:24.542137 22855 raft_consensus.cc:2804] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 27 FOLLOWER]: Leader election won for term 27
I20260709 12:13:24.542759 22855 raft_consensus.cc:697] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 27 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:13:24.543681 22855 consensus_queue.cc:237] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 26.19, Last appended by leader: 19, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:24.536129 22822 raft_consensus.cc:2749] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:13:24.530113 22808 raft_consensus.cc:493] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:13:24.547669 22808 raft_consensus.cc:515] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:24.537909 22888 raft_consensus.cc:2804] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:13:24.550311 22888 raft_consensus.cc:493] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:13:24.550714 22888 raft_consensus.cc:3060] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:24.534384 22797 raft_consensus.cc:697] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 20 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:13:24.424203 22886 leader_election.cc:290] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:24.563329 22889 ts_tablet_manager.cc:933] T 938efad339fd47e1b0b6d37fbc612db2 P 73d01e9b1a9d49358da4985b21d681db: Initiating tablet copy from peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:24.563679 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 28 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:24.559401 22790 raft_consensus.cc:493] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:13:24.564422 14256 raft_consensus.cc:2468] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 27.
I20260709 12:13:24.564947 22790 raft_consensus.cc:515] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:24.566082 14304 leader_election.cc:304] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:13:24.567242 22623 raft_consensus.cc:2804] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:13:24.567617 22623 raft_consensus.cc:493] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 27 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:13:24.567943 22623 raft_consensus.cc:3060] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:24.568513 22791 raft_consensus.cc:493] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:13:24.569077 22791 raft_consensus.cc:515] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:24.574944 14230 leader_election.cc:304] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:24.576822 22886 raft_consensus.cc:2804] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:13:24.580364 14230 leader_election.cc:304] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:24.586426 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 32 candidate_status { last_received { term: 31 index: 14 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:24.587278 14330 raft_consensus.cc:2468] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 31 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 31.
I20260709 12:13:24.571470 22808 leader_election.cc:290] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:13:24.590749 22790 leader_election.cc:290] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:24.591559 22790 raft_consensus.cc:2749] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 12:13:24.595717 22886 raft_consensus.cc:697] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 24 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:13:24.606472 22886 consensus_queue.cc:237] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:24.557397 22797 consensus_queue.cc:237] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:24.610105 22889 tablet_copy_client.cc:323] T 938efad339fd47e1b0b6d37fbc612db2 P 73d01e9b1a9d49358da4985b21d681db: tablet copy: Beginning tablet copy session from remote peer at address 127.12.174.131:45957
I20260709 12:13:24.639858 22791 leader_election.cc:290] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:24.641768 22790 raft_consensus.cc:493] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:13:24.658445 22790 raft_consensus.cc:515] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:24.663420 22893 raft_consensus.cc:493] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:13:24.664199 22893 raft_consensus.cc:515] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:24.705905 22623 raft_consensus.cc:515] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:24.714838 22808 raft_consensus.cc:493] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:13:24.715518 22808 raft_consensus.cc:515] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:13:24.715229 14229 leader_election.cc:336] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111)
I20260709 12:13:24.719570 22808 leader_election.cc:290] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:13:24.719758 22888 raft_consensus.cc:515] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:24.726380 22623 leader_election.cc:290] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 28 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:13:24.728899 14348 tablet_copy_service.cc:140] P 65c9c1653b3346b39a0e118540e6080c: Received BeginTabletCopySession request for tablet 938efad339fd47e1b0b6d37fbc612db2 from peer 73d01e9b1a9d49358da4985b21d681db ({username='slave'} at 127.0.0.1:55492)
I20260709 12:13:24.729492 14348 tablet_copy_service.cc:161] P 65c9c1653b3346b39a0e118540e6080c: Beginning new tablet copy session on tablet 938efad339fd47e1b0b6d37fbc612db2 from peer 73d01e9b1a9d49358da4985b21d681db at {username='slave'} at 127.0.0.1:55492: session id = 73d01e9b1a9d49358da4985b21d681db-938efad339fd47e1b0b6d37fbc612db2
W20260709 12:13:24.727829 14303 leader_election.cc:336] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111)
I20260709 12:13:24.730150 14303 leader_election.cc:304] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
W20260709 12:13:24.731148 14303 leader_election.cc:336] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111)
I20260709 12:13:24.731564 14303 leader_election.cc:304] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
W20260709 12:13:24.732386 14229 leader_election.cc:336] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111)
I20260709 12:13:24.733230 22623 raft_consensus.cc:2749] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:24.735613 22854 raft_consensus.cc:515] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:24.738653 14348 tablet_copy_source_session.cc:215] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 12:13:24.742072 12986 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 14211)
I20260709 12:13:24.740262 22790 leader_election.cc:290] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:24.740607 22893 leader_election.cc:290] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:24.744174 14079 catalog_manager.cc:5697] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: term changed from 26 to 27, leader changed from 885067a0d31741bfb5c9935788e315bf (127.12.174.129) to 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130). New cstate: current_term: 27 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:24.746704 22889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 938efad339fd47e1b0b6d37fbc612db2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:24.710580 22895 raft_consensus.cc:493] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:13:24.748700 22808 raft_consensus.cc:2749] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:24.746592 22888 leader_election.cc:290] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 24 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:24.747037 22884 tablet_bootstrap.cc:492] T afdbef67ffe54739bdccc3b631f66c89 P 73d01e9b1a9d49358da4985b21d681db: Bootstrap starting.
W20260709 12:13:24.788188 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 72573us
I20260709 12:13:24.791632 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:24.792402 14259 raft_consensus.cc:2468] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 24.
I20260709 12:13:24.793821 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a4a5f0a8324f479c5e1f499164bf42" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 28 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:13:24.794448 14256 raft_consensus.cc:3060] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:13:24.839107 14256 raft_consensus.cc:2468] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 28.
I20260709 12:13:24.772472 22895 raft_consensus.cc:515] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:24.846976 22895 leader_election.cc:290] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:13:24.814688 22808 raft_consensus.cc:493] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:13:24.847922 22808 raft_consensus.cc:515] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:24.851276 22854 leader_election.cc:290] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 21 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:13:24.852574 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 59661.6us
W20260709 12:13:24.853855 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 273572us
I20260709 12:13:24.868973 14230 leader_election.cc:304] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:24.882094 14304 leader_election.cc:304] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:13:24.886299 22623 raft_consensus.cc:493] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:13:24.886917 22623 raft_consensus.cc:515] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:24.890717 22623 leader_election.cc:290] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:13:24.892731 22902 raft_consensus.cc:2804] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:24.893277 22902 raft_consensus.cc:493] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:13:24.893668 22902 raft_consensus.cc:3060] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:24.885279 22808 leader_election.cc:290] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:13:24.905128 14304 leader_election.cc:304] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:13:24.910741 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:24.911511 14336 raft_consensus.cc:2468] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 23.
I20260709 12:13:24.914052 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:24.914815 14335 raft_consensus.cc:2468] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 22.
I20260709 12:13:24.922693 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:24.923486 14335 raft_consensus.cc:2468] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 20.
I20260709 12:13:24.924371 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0041f9f2b90844269c31eba4aeeab0a7" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:13:24.925011 14330 raft_consensus.cc:3060] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:24.927310 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:24.928198 14336 raft_consensus.cc:2468] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 24.
W20260709 12:13:24.928795 14229 leader_election.cc:336] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111)
W20260709 12:13:24.941474 14229 leader_election.cc:336] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111)
W20260709 12:13:24.942183 14229 leader_election.cc:336] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111)
W20260709 12:13:24.953068 14876 leader_election.cc:336] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111)
I20260709 12:13:24.953846 22905 raft_consensus.cc:2804] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 31 FOLLOWER]: Leader pre-election won for term 32
I20260709 12:13:24.954427 22905 raft_consensus.cc:493] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 31 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:13:24.954672 14330 raft_consensus.cc:2468] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 24.
I20260709 12:13:24.954802 22905 raft_consensus.cc:3060] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 31 FOLLOWER]: Advancing to term 32
W20260709 12:13:24.954720 14876 consensus_peers.cc:597] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:24.960965 14876 consensus_peers.cc:597] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:24.961524 14876 consensus_peers.cc:597] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:24.930197 22896 raft_consensus.cc:2804] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 28 FOLLOWER]: Leader election won for term 28
I20260709 12:13:24.969671 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:24.970182 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 30 candidate_status { last_received { term: 29 index: 16 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:24.970929 14256 raft_consensus.cc:2468] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 29.
I20260709 12:13:24.971625 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec" is_pre_election: true
I20260709 12:13:24.972355 14259 raft_consensus.cc:2468] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 25.
I20260709 12:13:24.970556 14260 raft_consensus.cc:2468] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 22.
I20260709 12:13:24.973277 22896 raft_consensus.cc:697] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 28 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:13:24.980746 14088 catalog_manager.cc:5697] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 19 to 20, leader changed from 885067a0d31741bfb5c9935788e315bf (127.12.174.129) to 73d01e9b1a9d49358da4985b21d681db (127.12.174.132). New cstate: current_term: 20 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:24.992079 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7879f4a298eb4e69ac692911bd5ac5f8" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:13:24.992867 14256 raft_consensus.cc:3060] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:24.993165 22896 consensus_queue.cc:237] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 27.16, Last appended by leader: 16, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:13:24.998262 14876 consensus_peers.cc:597] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:25.010011 14876 consensus_peers.cc:597] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:25.015625 14229 consensus_peers.cc:597] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:25.017920 14256 raft_consensus.cc:2468] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 21.
I20260709 12:13:25.024315 22905 raft_consensus.cc:515] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 32 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:25.027894 22902 raft_consensus.cc:515] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:13:25.032032 14229 leader_election.cc:336] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 32 election: RPC error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111)
W20260709 12:13:25.037722 14876 consensus_peers.cc:597] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:25.040781 14304 leader_election.cc:304] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:13:25.041417 14877 leader_election.cc:304] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:25.041827 14304 leader_election.cc:304] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:13:25.043700 22808 raft_consensus.cc:2804] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 12:13:25.044162 22808 raft_consensus.cc:493] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 29 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:13:25.044580 22808 raft_consensus.cc:3060] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:13:25.046868 22854 raft_consensus.cc:2804] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:13:25.048537 22861 raft_consensus.cc:2804] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:13:25.048867 14304 leader_election.cc:304] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:13:25.049208 22861 raft_consensus.cc:493] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 25 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:13:25.049783 22861 raft_consensus.cc:3060] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:25.050042 22895 raft_consensus.cc:2804] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:25.050477 22895 raft_consensus.cc:493] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:13:25.050899 22895 raft_consensus.cc:3060] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:25.053318 14909 raft_consensus.cc:1275] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 27 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 26 index: 19. Preceding OpId from leader: term: 27 index: 20. (index mismatch)
I20260709 12:13:25.048622 22854 raft_consensus.cc:697] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 21 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:13:25.056310 22854 consensus_queue.cc:237] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:25.059898 22791 consensus_queue.cc:1048] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.001s
I20260709 12:13:25.046814 22905 leader_election.cc:290] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 32 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:13:25.059967 14229 consensus_peers.cc:597] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:25.042887 14230 leader_election.cc:304] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:25.065382 14230 leader_election.cc:304] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:25.066414 22905 raft_consensus.cc:2804] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:13:25.067396 22905 raft_consensus.cc:493] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:13:25.067775 22905 raft_consensus.cc:3060] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:25.069540 14230 leader_election.cc:304] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:25.069290 22791 raft_consensus.cc:2804] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:25.083633 22791 raft_consensus.cc:493] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:13:25.084098 22791 raft_consensus.cc:3060] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:25.076942 22808 raft_consensus.cc:515] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 30 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:25.080381 22895 raft_consensus.cc:515] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:13:25.089682 14876 consensus_peers.cc:597] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:25.090312 14876 consensus_peers.cc:597] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:25.093194 14256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:13:25.094401 22910 raft_consensus.cc:2804] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:13:25.094918 22910 raft_consensus.cc:493] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:13:25.095427 22910 raft_consensus.cc:3060] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:13:25.096524 14229 consensus_peers.cc:597] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:25.077446 22861 raft_consensus.cc:515] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:25.094872 14230 leader_election.cc:304] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:25.099500 14230 leader_election.cc:304] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
W20260709 12:13:25.100801 14303 leader_election.cc:336] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111)
I20260709 12:13:25.108618 22906 raft_consensus.cc:2804] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:13:25.101172 22855 raft_consensus.cc:2804] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:25.109556 22855 raft_consensus.cc:493] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Starting leader election (detected failure of leader 885067a0d31741bfb5c9935788e315bf)
I20260709 12:13:25.110069 22855 raft_consensus.cc:3060] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:25.110579 22906 raft_consensus.cc:697] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 24 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:13:25.110926 22861 leader_election.cc:290] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 26 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:13:25.111588 22906 consensus_queue.cc:237] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.12, Last appended by leader: 12, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:25.099591 22895 leader_election.cc:290] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 23 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:13:25.130123 14260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85036847fc14bab8d6b10e9cbee3aca" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:13:25.130837 14260 raft_consensus.cc:3060] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:13:25.131760 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5879727b381a48b18b1949c96428b5d0" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 32 candidate_status { last_received { term: 31 index: 14 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:13:25.132431 14336 raft_consensus.cc:3060] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 31 FOLLOWER]: Advancing to term 32
I20260709 12:13:25.133462 14259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d9964631a6940e4b111e1b1dabb0aae" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:13:25.134068 14259 raft_consensus.cc:3060] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:25.136998 14908 raft_consensus.cc:1275] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 28 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 27 index: 19. Preceding OpId from leader: term: 28 index: 20. (index mismatch)
I20260709 12:13:25.145358 14260 raft_consensus.cc:2468] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 26.
I20260709 12:13:25.147236 22791 raft_consensus.cc:515] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:25.151448 22855 raft_consensus.cc:515] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:25.154381 22808 leader_election.cc:290] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 30 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:13:25.158108 14336 raft_consensus.cc:2468] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 32 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 32.
I20260709 12:13:25.161005 14304 leader_election.cc:304] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:13:25.161924 14259 raft_consensus.cc:2468] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 25.
I20260709 12:13:25.166064 14265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9b8048bcdf74441aac2cd21ac7af4da" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 30 candidate_status { last_received { term: 29 index: 16 } } ignore_live_leader: false dest_uuid: "17aab1bbf5014936aa18cc21818b26ec"
I20260709 12:13:25.166740 14265 raft_consensus.cc:3060] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:13:25.121930 22902 leader_election.cc:290] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 25 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:13:25.171942 14256 raft_consensus.cc:2393] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 65c9c1653b3346b39a0e118540e6080c in current term 23: Already voted for candidate 17aab1bbf5014936aa18cc21818b26ec in this term.
I20260709 12:13:25.176080 14230 leader_election.cc:304] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 32 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:25.174211 14081 catalog_manager.cc:5697] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c reported cstate change: term changed from 27 to 28, leader changed from 885067a0d31741bfb5c9935788e315bf (127.12.174.129) to 65c9c1653b3346b39a0e118540e6080c (127.12.174.131). New cstate: current_term: 28 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:25.178910 22907 raft_consensus.cc:2804] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:13:25.181800 22907 raft_consensus.cc:697] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 26 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:13:25.178766 22886 raft_consensus.cc:2804] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 32 FOLLOWER]: Leader election won for term 32
I20260709 12:13:25.179325 14304 leader_election.cc:304] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:13:25.182725 22907 consensus_queue.cc:237] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 25.15, Last appended by leader: 15, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:25.184631 22912 ts_tablet_manager.cc:933] T cbe93a4954a24795882e04fa537ddf4d P 73d01e9b1a9d49358da4985b21d681db: Initiating tablet copy from peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:25.182721 22886 raft_consensus.cc:697] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 32 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:13:25.196930 14265 raft_consensus.cc:2468] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 30 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 30.
I20260709 12:13:25.198904 22886 consensus_queue.cc:237] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 31.14, Last appended by leader: 14, Current term: 32, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:25.200541 22889 tablet_copy_client.cc:806] T 938efad339fd47e1b0b6d37fbc612db2 P 73d01e9b1a9d49358da4985b21d681db: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:25.201143 22889 tablet_copy_client.cc:670] T 938efad339fd47e1b0b6d37fbc612db2 P 73d01e9b1a9d49358da4985b21d681db: tablet copy: Starting download of 1 WAL segments...
W20260709 12:13:25.192051 14303 leader_election.cc:336] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111)
I20260709 12:13:25.193275 22903 raft_consensus.cc:2804] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 25 FOLLOWER]: Leader election won for term 25
W20260709 12:13:25.211187 14303 leader_election.cc:336] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 28 election: RPC error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111)
I20260709 12:13:25.215549 14304 leader_election.cc:304] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 30 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:13:25.218191 22623 raft_consensus.cc:2804] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 30 FOLLOWER]: Leader election won for term 30
W20260709 12:13:25.217350 14303 leader_election.cc:336] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111)
I20260709 12:13:25.218744 22623 raft_consensus.cc:697] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 30 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
W20260709 12:13:25.220355 14303 leader_election.cc:336] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111)
I20260709 12:13:25.219825 22623 consensus_queue.cc:237] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 29.16, Last appended by leader: 16, Current term: 30, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:13:25.222842 14876 consensus_peers.cc:597] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:25.224408 14303 leader_election.cc:336] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111)
I20260709 12:13:25.224473 14336 raft_consensus.cc:1275] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
W20260709 12:13:25.225879 14303 consensus_peers.cc:597] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:25.182778 22902 consensus_queue.cc:1048] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.031s
I20260709 12:13:25.230530 22901 consensus_queue.cc:1048] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:13:25.241089 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:13:25.242422 14336 raft_consensus.cc:2393] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 17aab1bbf5014936aa18cc21818b26ec in current term 23: Already voted for candidate 65c9c1653b3346b39a0e118540e6080c in this term.
W20260709 12:13:25.231602 14876 consensus_peers.cc:597] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:25.231523 22905 raft_consensus.cc:515] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:25.232208 22791 leader_election.cc:290] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 23 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:13:25.235855 14229 consensus_peers.cc:597] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:25.215372 22889 tablet_copy_client.cc:538] T 938efad339fd47e1b0b6d37fbc612db2 P 73d01e9b1a9d49358da4985b21d681db: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:25.269932 22903 raft_consensus.cc:697] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 25 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:13:25.269905 22912 tablet_copy_client.cc:323] T cbe93a4954a24795882e04fa537ddf4d P 73d01e9b1a9d49358da4985b21d681db: tablet copy: Beginning tablet copy session from remote peer at address 127.12.174.131:45957
W20260709 12:13:25.282915 14303 consensus_peers.cc:597] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:25.283715 14303 leader_election.cc:336] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111)
W20260709 12:13:25.284534 14303 leader_election.cc:336] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111)
W20260709 12:13:25.285041 14303 leader_election.cc:336] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 30 election: RPC error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111)
W20260709 12:13:25.286141 14303 leader_election.cc:336] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111)
I20260709 12:13:25.293898 22855 leader_election.cc:290] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 25 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:25.275653 22903 consensus_queue.cc:237] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.16, Last appended by leader: 16, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:25.298893 22905 leader_election.cc:290] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 24 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:13:25.309118 14229 consensus_peers.cc:597] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:25.315081 14348 tablet_copy_service.cc:140] P 65c9c1653b3346b39a0e118540e6080c: Received BeginTabletCopySession request for tablet cbe93a4954a24795882e04fa537ddf4d from peer 73d01e9b1a9d49358da4985b21d681db ({username='slave'} at 127.0.0.1:55492)
I20260709 12:13:25.317925 14336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd5274ac33c2483681726f6b8eccdc6c" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
W20260709 12:13:25.342478 14229 leader_election.cc:336] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111)
I20260709 12:13:25.342898 14336 raft_consensus.cc:3060] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:25.318674 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd6a20fc287b48fbb5cbf25078173b21" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:13:25.343108 14229 leader_election.cc:304] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:25.343608 14332 raft_consensus.cc:3060] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Advancing to term 24
W20260709 12:13:25.328706 14876 consensus_peers.cc:597] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:25.345937 14348 tablet_copy_service.cc:161] P 65c9c1653b3346b39a0e118540e6080c: Beginning new tablet copy session on tablet cbe93a4954a24795882e04fa537ddf4d from peer 73d01e9b1a9d49358da4985b21d681db at {username='slave'} at 127.0.0.1:55492: session id = 73d01e9b1a9d49358da4985b21d681db-cbe93a4954a24795882e04fa537ddf4d
I20260709 12:13:25.350128 22855 raft_consensus.cc:2749] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
W20260709 12:13:25.380676 14229 leader_election.cc:336] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111)
I20260709 12:13:25.410207 14336 raft_consensus.cc:2468] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 25.
I20260709 12:13:25.416761 22889 tablet_bootstrap.cc:492] T 938efad339fd47e1b0b6d37fbc612db2 P 73d01e9b1a9d49358da4985b21d681db: Bootstrap starting.
I20260709 12:13:25.423233 22910 raft_consensus.cc:515] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:25.396385 14304 leader_election.cc:304] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
W20260709 12:13:25.436456 14229 leader_election.cc:336] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111)
I20260709 12:13:25.445986 22910 leader_election.cc:290] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 21 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:13:25.448012 14876 consensus_peers.cc:597] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:25.450641 14336 raft_consensus.cc:1275] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 12:13:25.451758 14339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c022caf6920747708b0cfc607c962951" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:13:25.452472 14339 raft_consensus.cc:3060] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:13:25.461035 14339 raft_consensus.cc:2468] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 21.
W20260709 12:13:25.462122 14303 consensus_peers.cc:597] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:25.462365 14332 raft_consensus.cc:2468] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 24.
I20260709 12:13:25.464443 14348 tablet_copy_source_session.cc:215] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:13:25.465420 22808 raft_consensus.cc:2749] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
W20260709 12:13:25.470343 22923 log.cc:927] Time spent T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 12:13:25.486379 14230 leader_election.cc:304] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:25.497458 14259 raft_consensus.cc:1275] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 28 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 27 index: 16. Preceding OpId from leader: term: 28 index: 17. (index mismatch)
I20260709 12:13:25.508847 22892 raft_consensus.cc:2804] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:13:25.501751 14081 catalog_manager.cc:5697] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: term changed from 23 to 24, leader changed from 885067a0d31741bfb5c9935788e315bf (127.12.174.129) to 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130). New cstate: current_term: 24 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:25.509248 22790 consensus_queue.cc:1048] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:13:25.511041 14081 catalog_manager.cc:5697] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: term changed from 23 to 24, leader changed from 885067a0d31741bfb5c9935788e315bf (127.12.174.129) to 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130). New cstate: current_term: 24 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:25.512791 14081 catalog_manager.cc:5697] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: term changed from 31 to 32, leader changed from 885067a0d31741bfb5c9935788e315bf (127.12.174.129) to 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130). New cstate: current_term: 32 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:25.509451 22892 raft_consensus.cc:697] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 25 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:13:25.518481 22892 consensus_queue.cc:237] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.13, Last appended by leader: 13, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:13:25.520344 14876 consensus_peers.cc:597] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:25.521588 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 111346us
I20260709 12:13:25.532708 22912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbe93a4954a24795882e04fa537ddf4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:25.546881 14088 catalog_manager.cc:5697] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 20 to 21, leader changed from 885067a0d31741bfb5c9935788e315bf (127.12.174.129) to 73d01e9b1a9d49358da4985b21d681db (127.12.174.132). New cstate: current_term: 21 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:13:25.520398 14229 leader_election.cc:336] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111)
I20260709 12:13:25.559473 14230 leader_election.cc:304] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:25.567652 22910 raft_consensus.cc:2804] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:13:25.568249 22910 raft_consensus.cc:697] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 21 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:13:25.570269 14230 leader_election.cc:304] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:25.571194 22855 raft_consensus.cc:2804] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:13:25.571691 22855 raft_consensus.cc:697] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 24 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:13:25.572378 22912 tablet_copy_client.cc:806] T cbe93a4954a24795882e04fa537ddf4d P 73d01e9b1a9d49358da4985b21d681db: tablet copy: Starting download of 0 data blocks...
I20260709 12:13:25.573009 22912 tablet_copy_client.cc:670] T cbe93a4954a24795882e04fa537ddf4d P 73d01e9b1a9d49358da4985b21d681db: tablet copy: Starting download of 1 WAL segments...
I20260709 12:13:25.569169 22910 consensus_queue.cc:237] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:25.572599 22855 consensus_queue.cc:237] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.12, Last appended by leader: 12, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:25.580745 22912 tablet_copy_client.cc:538] T cbe93a4954a24795882e04fa537ddf4d P 73d01e9b1a9d49358da4985b21d681db: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:13:25.590337 22896 consensus_queue.cc:1048] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
W20260709 12:13:25.610440 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 90064.5us
W20260709 12:13:25.616118 14229 consensus_peers.cc:597] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:25.614324 14303 consensus_peers.cc:597] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:25.703274 14876 consensus_peers.cc:597] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:25.704314 22912 tablet_bootstrap.cc:492] T cbe93a4954a24795882e04fa537ddf4d P 73d01e9b1a9d49358da4985b21d681db: Bootstrap starting.
W20260709 12:13:25.707497 14303 consensus_peers.cc:597] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:25.708097 14303 consensus_peers.cc:597] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:25.708576 14303 consensus_peers.cc:597] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:25.709249 14303 consensus_peers.cc:597] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:25.711323 14303 consensus_peers.cc:597] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:25.717928 14265 raft_consensus.cc:1275] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 12:13:25.719859 22901 consensus_queue.cc:1048] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:13:25.721130 14265 raft_consensus.cc:1275] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 30 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 29 index: 16. Preceding OpId from leader: term: 30 index: 17. (index mismatch)
W20260709 12:13:25.727279 14303 consensus_peers.cc:597] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:25.731520 14088 catalog_manager.cc:5697] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c reported cstate change: term changed from 25 to 26, leader changed from 885067a0d31741bfb5c9935788e315bf (127.12.174.129) to 65c9c1653b3346b39a0e118540e6080c (127.12.174.131). New cstate: current_term: 26 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } }
W20260709 12:13:25.734048 22931 log.cc:927] Time spent T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 12:13:25.733397 14088 catalog_manager.cc:5697] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c reported cstate change: term changed from 29 to 30, leader changed from 885067a0d31741bfb5c9935788e315bf (127.12.174.129) to 65c9c1653b3346b39a0e118540e6080c (127.12.174.131). New cstate: current_term: 30 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:25.735189 14088 catalog_manager.cc:5697] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c reported cstate change: term changed from 24 to 25, leader changed from 885067a0d31741bfb5c9935788e315bf (127.12.174.129) to 65c9c1653b3346b39a0e118540e6080c (127.12.174.131). New cstate: current_term: 25 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:25.731433 22808 consensus_queue.cc:1048] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.006s
W20260709 12:13:25.738862 14230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 76728.7us
W20260709 12:13:25.742635 12986 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 14211)
W20260709 12:13:25.751428 14303 consensus_peers.cc:597] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:25.752074 14303 consensus_peers.cc:597] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:25.752488 14303 consensus_peers.cc:597] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:25.752877 14265 raft_consensus.cc:1275] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 26 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 25 index: 15. Preceding OpId from leader: term: 26 index: 16. (index mismatch)
I20260709 12:13:25.768038 14334 raft_consensus.cc:1275] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 23 index: 12. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
W20260709 12:13:25.770306 14229 consensus_peers.cc:597] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:25.771734 22919 consensus_queue.cc:1048] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.011s
W20260709 12:13:25.771727 14303 consensus_peers.cc:597] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:25.787179 14229 consensus_peers.cc:597] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:25.792084 14334 raft_consensus.cc:1275] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 32 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 31 index: 14. Preceding OpId from leader: term: 32 index: 15. (index mismatch)
I20260709 12:13:25.802419 22886 consensus_queue.cc:1048] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:13:25.795550 22905 consensus_queue.cc:1048] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.019s
W20260709 12:13:25.831977 14303 consensus_peers.cc:597] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:25.907922 14303 consensus_peers.cc:597] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:25.907936 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 59357.1us
W20260709 12:13:25.921825 14303 consensus_peers.cc:597] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:25.924170 14229 consensus_peers.cc:597] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:25.946538 14088 catalog_manager.cc:5697] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: term changed from 24 to 25, leader changed from 885067a0d31741bfb5c9935788e315bf (127.12.174.129) to 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130). New cstate: current_term: 25 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:25.948632 14088 catalog_manager.cc:5697] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: term changed from 20 to 21, leader changed from 885067a0d31741bfb5c9935788e315bf (127.12.174.129) to 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130). New cstate: current_term: 21 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:25.951783 14088 catalog_manager.cc:5697] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: term changed from 23 to 24, leader changed from 885067a0d31741bfb5c9935788e315bf (127.12.174.129) to 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130). New cstate: current_term: 24 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:25.967298 14265 raft_consensus.cc:1275] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 25 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
I20260709 12:13:25.969245 22903 consensus_queue.cc:1048] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:13:25.970013 22884 tablet_bootstrap.cc:492] T afdbef67ffe54739bdccc3b631f66c89 P 73d01e9b1a9d49358da4985b21d681db: Bootstrap replayed 1/1 log segments. Stats: ops{read=16 overwritten=1 applied=15 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:25.971004 22884 tablet_bootstrap.cc:492] T afdbef67ffe54739bdccc3b631f66c89 P 73d01e9b1a9d49358da4985b21d681db: Bootstrap complete.
I20260709 12:13:25.971751 22884 ts_tablet_manager.cc:1403] T afdbef67ffe54739bdccc3b631f66c89 P 73d01e9b1a9d49358da4985b21d681db: Time spent bootstrapping tablet: real 1.233s	user 0.080s	sys 0.113s
I20260709 12:13:25.991745 22884 raft_consensus.cc:359] T afdbef67ffe54739bdccc3b631f66c89 P 73d01e9b1a9d49358da4985b21d681db [term 22 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } }
I20260709 12:13:25.992677 22884 raft_consensus.cc:740] T afdbef67ffe54739bdccc3b631f66c89 P 73d01e9b1a9d49358da4985b21d681db [term 22 LEARNER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Initialized, Role: LEARNER
W20260709 12:13:26.022559 14303 consensus_peers.cc:597] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:25.993378 22884 consensus_queue.cc:260] T afdbef67ffe54739bdccc3b631f66c89 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } }
I20260709 12:13:26.031930 22884 ts_tablet_manager.cc:1434] T afdbef67ffe54739bdccc3b631f66c89 P 73d01e9b1a9d49358da4985b21d681db: Time spent starting tablet: real 0.058s	user 0.006s	sys 0.000s
I20260709 12:13:26.033836 14275 tablet_copy_service.cc:342] P 17aab1bbf5014936aa18cc21818b26ec: Request end of tablet copy session 73d01e9b1a9d49358da4985b21d681db-afdbef67ffe54739bdccc3b631f66c89 received from {username='slave'} at 127.0.0.1:53050
I20260709 12:13:26.034332 14275 tablet_copy_service.cc:434] P 17aab1bbf5014936aa18cc21818b26ec: ending tablet copy session 73d01e9b1a9d49358da4985b21d681db-afdbef67ffe54739bdccc3b631f66c89 on tablet afdbef67ffe54739bdccc3b631f66c89 with peer 73d01e9b1a9d49358da4985b21d681db
W20260709 12:13:26.036991 14229 consensus_peers.cc:597] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:26.079028 14334 raft_consensus.cc:1275] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 23 index: 12. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
I20260709 12:13:26.083199 22886 consensus_queue.cc:1048] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:13:26.093909 14338 raft_consensus.cc:1275] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 12:13:26.100816 22906 consensus_queue.cc:1048] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:13:26.116169 14338 raft_consensus.cc:1275] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 25 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 24 index: 13. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
I20260709 12:13:26.118676 22906 consensus_queue.cc:1048] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 12:13:26.144250 14229 consensus_peers.cc:597] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:26.156678 14229 consensus_peers.cc:597] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:26.309808 14229 consensus_peers.cc:597] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:26.354482 22947 log.cc:927] Time spent T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c: Append to log took a long time: real 0.072s	user 0.002s	sys 0.000s
I20260709 12:13:26.435295 22889 tablet_bootstrap.cc:492] T 938efad339fd47e1b0b6d37fbc612db2 P 73d01e9b1a9d49358da4985b21d681db: Bootstrap replayed 1/1 log segments. Stats: ops{read=13 overwritten=1 applied=12 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:26.436523 22889 tablet_bootstrap.cc:492] T 938efad339fd47e1b0b6d37fbc612db2 P 73d01e9b1a9d49358da4985b21d681db: Bootstrap complete.
I20260709 12:13:26.437423 22889 ts_tablet_manager.cc:1403] T 938efad339fd47e1b0b6d37fbc612db2 P 73d01e9b1a9d49358da4985b21d681db: Time spent bootstrapping tablet: real 1.021s	user 0.060s	sys 0.025s
I20260709 12:13:26.440932 22889 raft_consensus.cc:359] T 938efad339fd47e1b0b6d37fbc612db2 P 73d01e9b1a9d49358da4985b21d681db [term 19 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } }
I20260709 12:13:26.474349 22889 raft_consensus.cc:740] T 938efad339fd47e1b0b6d37fbc612db2 P 73d01e9b1a9d49358da4985b21d681db [term 19 LEARNER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Initialized, Role: LEARNER
I20260709 12:13:26.475239 22889 consensus_queue.cc:260] T 938efad339fd47e1b0b6d37fbc612db2 P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } }
I20260709 12:13:26.502312 22889 ts_tablet_manager.cc:1434] T 938efad339fd47e1b0b6d37fbc612db2 P 73d01e9b1a9d49358da4985b21d681db: Time spent starting tablet: real 0.064s	user 0.007s	sys 0.000s
I20260709 12:13:26.506696 14348 tablet_copy_service.cc:342] P 65c9c1653b3346b39a0e118540e6080c: Request end of tablet copy session 73d01e9b1a9d49358da4985b21d681db-938efad339fd47e1b0b6d37fbc612db2 received from {username='slave'} at 127.0.0.1:55492
I20260709 12:13:26.507193 14348 tablet_copy_service.cc:434] P 65c9c1653b3346b39a0e118540e6080c: ending tablet copy session 73d01e9b1a9d49358da4985b21d681db-938efad339fd47e1b0b6d37fbc612db2 on tablet 938efad339fd47e1b0b6d37fbc612db2 with peer 73d01e9b1a9d49358da4985b21d681db
W20260709 12:13:26.511744 14303 consensus_peers.cc:597] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:26.552491 14906 raft_consensus.cc:1217] T afdbef67ffe54739bdccc3b631f66c89 P 73d01e9b1a9d49358da4985b21d681db [term 22 LEARNER]: Deduplicated request from leader. Original: 22.14->[22.15-22.15]   Dedup: 22.15->[]
I20260709 12:13:26.600200 22912 tablet_bootstrap.cc:492] T cbe93a4954a24795882e04fa537ddf4d P 73d01e9b1a9d49358da4985b21d681db: Bootstrap replayed 1/1 log segments. Stats: ops{read=18 overwritten=3 applied=15 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:13:26.601260 22912 tablet_bootstrap.cc:492] T cbe93a4954a24795882e04fa537ddf4d P 73d01e9b1a9d49358da4985b21d681db: Bootstrap complete.
I20260709 12:13:26.615600 22912 ts_tablet_manager.cc:1403] T cbe93a4954a24795882e04fa537ddf4d P 73d01e9b1a9d49358da4985b21d681db: Time spent bootstrapping tablet: real 0.912s	user 0.065s	sys 0.034s
I20260709 12:13:26.676352 22912 raft_consensus.cc:359] T cbe93a4954a24795882e04fa537ddf4d P 73d01e9b1a9d49358da4985b21d681db [term 25 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } }
I20260709 12:13:26.677330 22912 raft_consensus.cc:740] T cbe93a4954a24795882e04fa537ddf4d P 73d01e9b1a9d49358da4985b21d681db [term 25 LEARNER]: Becoming Follower/Learner. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Initialized, Role: LEARNER
I20260709 12:13:26.678097 22912 consensus_queue.cc:260] T cbe93a4954a24795882e04fa537ddf4d P 73d01e9b1a9d49358da4985b21d681db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 15, Last appended: 25.15, Last appended by leader: 15, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: NON_VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: true } }
I20260709 12:13:26.680780 22912 ts_tablet_manager.cc:1434] T cbe93a4954a24795882e04fa537ddf4d P 73d01e9b1a9d49358da4985b21d681db: Time spent starting tablet: real 0.058s	user 0.001s	sys 0.004s
I20260709 12:13:26.685909 14348 tablet_copy_service.cc:342] P 65c9c1653b3346b39a0e118540e6080c: Request end of tablet copy session 73d01e9b1a9d49358da4985b21d681db-cbe93a4954a24795882e04fa537ddf4d received from {username='slave'} at 127.0.0.1:55492
I20260709 12:13:26.686411 14348 tablet_copy_service.cc:434] P 65c9c1653b3346b39a0e118540e6080c: ending tablet copy session 73d01e9b1a9d49358da4985b21d681db-cbe93a4954a24795882e04fa537ddf4d on tablet cbe93a4954a24795882e04fa537ddf4d with peer 73d01e9b1a9d49358da4985b21d681db
W20260709 12:13:26.743080 12986 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 14211)
W20260709 12:13:26.750988 14303 consensus_peers.cc:597] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:26.791880 14906 raft_consensus.cc:1217] T 938efad339fd47e1b0b6d37fbc612db2 P 73d01e9b1a9d49358da4985b21d681db [term 19 LEARNER]: Deduplicated request from leader. Original: 19.11->[19.12-19.12]   Dedup: 19.12->[]
W20260709 12:13:26.818761 14303 consensus_peers.cc:597] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:27.087215 14876 consensus_peers.cc:597] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:13:27.101123 22886 raft_consensus.cc:1064] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec: attempting to promote NON_VOTER 73d01e9b1a9d49358da4985b21d681db to VOTER
I20260709 12:13:27.104239 22886 consensus_queue.cc:237] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 13, Current term: 22, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:27.124481 14906 raft_consensus.cc:1217] T cbe93a4954a24795882e04fa537ddf4d P 73d01e9b1a9d49358da4985b21d681db [term 25 LEARNER]: Deduplicated request from leader. Original: 25.14->[25.15-25.15]   Dedup: 25.15->[]
I20260709 12:13:27.128877 14335 raft_consensus.cc:1275] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
W20260709 12:13:27.130050 14229 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111) [suppressed 412 similar messages]
I20260709 12:13:27.135207 14906 raft_consensus.cc:1275] T afdbef67ffe54739bdccc3b631f66c89 P 73d01e9b1a9d49358da4985b21d681db [term 22 LEARNER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 12:13:27.137488 22936 consensus_queue.cc:1048] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
W20260709 12:13:27.140170 14229 consensus_peers.cc:597] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:27.143533 22886 consensus_queue.cc:1048] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260709 12:13:27.321913 14876 consensus_peers.cc:597] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:13:27.334209 22936 raft_consensus.cc:2955] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 22 LEADER]: Committing config change with OpId 22.16: config changed from index 15 to 16, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:13:27.353734 22963 raft_consensus.cc:1064] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c: attempting to promote NON_VOTER 73d01e9b1a9d49358da4985b21d681db to VOTER
I20260709 12:13:27.360689 22963 consensus_queue.cc:237] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 10, Current term: 19, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:13:27.373088 14303 consensus_peers.cc:597] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:27.376981 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 51775.4us
W20260709 12:13:27.395813 14876 consensus_peers.cc:597] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:13:27.402671 14338 raft_consensus.cc:2955] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Committing config change with OpId 22.16: config changed from index 15 to 16, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:13:27.415074 14909 raft_consensus.cc:2955] T afdbef67ffe54739bdccc3b631f66c89 P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Committing config change with OpId 22.16: config changed from index 15 to 16, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
W20260709 12:13:27.422037 14876 consensus_peers.cc:597] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:13:27.473788 14911 raft_consensus.cc:1275] T 938efad339fd47e1b0b6d37fbc612db2 P 73d01e9b1a9d49358da4985b21d681db [term 19 LEARNER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
W20260709 12:13:27.477371 14303 consensus_peers.cc:597] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:27.476913 14088 catalog_manager.cc:5697] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: config changed from index 15 to 16, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New cstate: current_term: 22 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:27.479055 22907 consensus_queue.cc:1048] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:13:27.487736 14265 raft_consensus.cc:1275] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
W20260709 12:13:27.490240 14876 consensus_peers.cc:597] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:13:27.494062 22951 consensus_queue.cc:1048] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 12:13:27.507964 14876 consensus_peers.cc:597] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:13:27.527343 22936 raft_consensus.cc:493] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:27.527990 22936 raft_consensus.cc:515] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:13:27.529800 14876 consensus_peers.cc:597] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:27.546852 14229 consensus_peers.cc:597] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:27.550313 14335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:27.551344 14335 raft_consensus.cc:2468] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 23.
I20260709 12:13:27.550354 22936 leader_election.cc:290] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:27.553297 14230 leader_election.cc:304] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:13:27.560189 22958 raft_consensus.cc:1064] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c: attempting to promote NON_VOTER 73d01e9b1a9d49358da4985b21d681db to VOTER
I20260709 12:13:27.563731 22958 consensus_queue.cc:237] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 25.15, Last appended by leader: 13, Current term: 25, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:13:27.574384 14303 consensus_peers.cc:597] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:27.578585 22966 raft_consensus.cc:2804] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:13:27.579149 22966 raft_consensus.cc:493] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:27.579499 22966 raft_consensus.cc:3060] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Advancing to term 24
W20260709 12:13:27.602624 14229 consensus_peers.cc:597] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:27.603272 14229 leader_election.cc:336] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111)
I20260709 12:13:27.584122 22951 raft_consensus.cc:2955] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 19 LEADER]: Committing config change with OpId 19.13: config changed from index 12 to 13, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
W20260709 12:13:27.610556 14876 consensus_peers.cc:597] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:13:27.622931 22966 raft_consensus.cc:515] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:27.626458 14265 raft_consensus.cc:2955] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Committing config change with OpId 19.13: config changed from index 12 to 13, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:13:27.655965 14911 raft_consensus.cc:1275] T cbe93a4954a24795882e04fa537ddf4d P 73d01e9b1a9d49358da4985b21d681db [term 25 LEARNER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 25 index: 15. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260709 12:13:27.658506 22966 leader_election.cc:290] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 24 election: Requested vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:27.659603 14338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1eb6edfa93424aa68a4239fd27a62064" candidate_uuid: "17aab1bbf5014936aa18cc21818b26ec" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:13:27.660305 14338 raft_consensus.cc:3060] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:13:27.660585 22963 consensus_queue.cc:1048] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260709 12:13:27.664139 14876 consensus_peers.cc:597] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:13:27.682934 14338 raft_consensus.cc:2468] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17aab1bbf5014936aa18cc21818b26ec in term 24.
I20260709 12:13:27.692142 14265 raft_consensus.cc:1275] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 25 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 25 index: 15. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260709 12:13:27.690513 14230 leader_election.cc:304] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c; no voters: 
I20260709 12:13:27.697399 22906 raft_consensus.cc:2804] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:13:27.698016 22906 raft_consensus.cc:697] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 24 LEADER]: Becoming Leader. State: Replica: 17aab1bbf5014936aa18cc21818b26ec, State: Running, Role: LEADER
I20260709 12:13:27.698885 22906 consensus_queue.cc:237] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
W20260709 12:13:27.710222 14303 consensus_peers.cc:597] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:27.723429 14876 consensus_peers.cc:597] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:27.743618 12986 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 14211)
W20260709 12:13:27.746838 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 107239us
W20260709 12:13:27.762008 14876 consensus_peers.cc:597] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:13:27.748490 22958 consensus_queue.cc:1048] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.018s
I20260709 12:13:27.773138 14909 raft_consensus.cc:2955] T 938efad339fd47e1b0b6d37fbc612db2 P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Committing config change with OpId 19.13: config changed from index 12 to 13, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
W20260709 12:13:27.775030 14303 consensus_peers.cc:597] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:27.778991 14229 consensus_peers.cc:597] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:27.779513 14229 leader_election.cc:336] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111)
W20260709 12:13:27.781510 14229 consensus_peers.cc:597] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:27.783205 14876 consensus_peers.cc:597] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:27.837271 14876 consensus_peers.cc:597] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:27.838203 14229 consensus_peers.cc:597] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:27.838981 14229 consensus_peers.cc:597] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:13:27.878067 22954 raft_consensus.cc:2955] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 25 LEADER]: Committing config change with OpId 25.16: config changed from index 15 to 16, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:13:27.887084 14265 raft_consensus.cc:2955] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 25 FOLLOWER]: Committing config change with OpId 25.16: config changed from index 15 to 16, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
W20260709 12:13:27.900427 14229 consensus_peers.cc:597] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:13:27.882408 14081 catalog_manager.cc:5697] T 938efad339fd47e1b0b6d37fbc612db2 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: config changed from index 12 to 13, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New cstate: current_term: 19 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
W20260709 12:13:27.959381 14303 consensus_peers.cc:597] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:13:27.960556 14909 raft_consensus.cc:2955] T cbe93a4954a24795882e04fa537ddf4d P 73d01e9b1a9d49358da4985b21d681db [term 25 FOLLOWER]: Committing config change with OpId 25.16: config changed from index 15 to 16, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
W20260709 12:13:27.982545 14229 consensus_peers.cc:597] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:27.985080 14303 consensus_peers.cc:597] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:13:28.006629 14079 catalog_manager.cc:5697] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec reported cstate change: term changed from 22 to 24, leader changed from 885067a0d31741bfb5c9935788e315bf (127.12.174.129) to 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130). New cstate: current_term: 24 leader_uuid: "17aab1bbf5014936aa18cc21818b26ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } }
W20260709 12:13:28.035755 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 49183.4us
W20260709 12:13:28.052382 14303 consensus_peers.cc:597] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:13:28.062986 14079 catalog_manager.cc:5697] T cbe93a4954a24795882e04fa537ddf4d P 73d01e9b1a9d49358da4985b21d681db reported cstate change: config changed from index 15 to 16, 73d01e9b1a9d49358da4985b21d681db (127.12.174.132) changed from NON_VOTER to VOTER. New cstate: current_term: 25 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } attrs { replace: true } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
W20260709 12:13:28.142964 14303 consensus_peers.cc:597] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:13:28.150842 14338 consensus_queue.cc:237] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 25.16, Last appended by leader: 13, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:28.161023 14265 raft_consensus.cc:1275] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 25 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 25 index: 16. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
I20260709 12:13:28.164145 22978 consensus_queue.cc:1048] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:13:28.173283 22954 raft_consensus.cc:2955] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 25 LEADER]: Committing config change with OpId 25.17: config changed from index 16 to 17, VOTER 885067a0d31741bfb5c9935788e315bf (127.12.174.129) evicted. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
I20260709 12:13:28.183100 14265 raft_consensus.cc:2955] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 25 FOLLOWER]: Committing config change with OpId 25.17: config changed from index 16 to 17, VOTER 885067a0d31741bfb5c9935788e315bf (127.12.174.129) evicted. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
W20260709 12:13:28.215731 14229 consensus_peers.cc:597] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:28.239965 14876 consensus_peers.cc:597] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:28.242583 14909 raft_consensus.cc:1275] T cbe93a4954a24795882e04fa537ddf4d P 73d01e9b1a9d49358da4985b21d681db [term 25 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 25 index: 16. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
I20260709 12:13:28.289868 14074 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet cbe93a4954a24795882e04fa537ddf4d with cas_config_opid_index 16: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:13:28.291350 14335 raft_consensus.cc:1275] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Refusing update from remote peer 17aab1bbf5014936aa18cc21818b26ec: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 12:13:28.293804 22906 consensus_queue.cc:1048] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 12:13:28.291182 14303 consensus_peers.cc:597] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:28.302338 14303 consensus_peers.cc:597] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:28.388334 14303 consensus_peers.cc:597] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:28.390143 14303 consensus_peers.cc:597] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:28.392618 14303 consensus_peers.cc:597] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:13:28.380237 22902 consensus_queue.cc:1048] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.022s
I20260709 12:13:28.419155 14079 catalog_manager.cc:5697] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c reported cstate change: config changed from index 16 to 17, VOTER 885067a0d31741bfb5c9935788e315bf (127.12.174.129) evicted. New cstate: current_term: 25 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:13:28.447919 14303 consensus_peers.cc:597] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:28.459609 14303 consensus_peers.cc:597] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:28.454113 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 90618us
I20260709 12:13:28.511832 14909 raft_consensus.cc:2955] T cbe93a4954a24795882e04fa537ddf4d P 73d01e9b1a9d49358da4985b21d681db [term 25 FOLLOWER]: Committing config change with OpId 25.17: config changed from index 16 to 17, VOTER 885067a0d31741bfb5c9935788e315bf (127.12.174.129) evicted. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } } }
W20260709 12:13:28.458241 14229 consensus_peers.cc:597] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:28.578466 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 120068us
W20260709 12:13:28.607810 14073 catalog_manager.cc:4755] TS 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet cbe93a4954a24795882e04fa537ddf4d: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111)
W20260709 12:13:28.636340 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 44788.2us
W20260709 12:13:28.639250 14303 consensus_peers.cc:597] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:28.697639 14303 consensus_peers.cc:597] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:28.713395 14229 consensus_peers.cc:597] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:28.744370 12986 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 14211)
W20260709 12:13:28.773037 14303 consensus_peers.cc:597] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:28.810783 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 66024.3us
W20260709 12:13:28.786717 14303 consensus_peers.cc:597] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:28.904006 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 61909.1us
W20260709 12:13:28.905318 14229 consensus_peers.cc:597] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:29.005275 14229 consensus_peers.cc:597] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:29.488898 14303 consensus_peers.cc:597] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:29.536165 14876 consensus_peers.cc:597] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:29.695453 14303 consensus_peers.cc:597] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:29.728736 14229 consensus_peers.cc:597] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:29.744973 12986 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 14211)
W20260709 12:13:29.799894 14876 consensus_peers.cc:597] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:29.802803 14876 consensus_peers.cc:597] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:29.825886 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 49669.6us
W20260709 12:13:29.836927 14876 consensus_peers.cc:597] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:29.951968 14229 consensus_peers.cc:597] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:29.965193 14073 catalog_manager.cc:4755] TS 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet cbe93a4954a24795882e04fa537ddf4d: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111)
W20260709 12:13:30.008190 14229 consensus_peers.cc:597] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:30.028717 14876 consensus_peers.cc:597] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:30.116343 14229 consensus_peers.cc:597] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:30.135609 14303 consensus_peers.cc:597] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:30.164068 14229 consensus_peers.cc:597] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:30.200167 14876 consensus_peers.cc:597] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:30.205904 14303 consensus_peers.cc:597] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:30.214937 14876 consensus_peers.cc:597] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:30.272500 14876 consensus_peers.cc:597] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:30.302965 14876 consensus_peers.cc:597] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:30.338536 14876 consensus_peers.cc:597] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:30.375097 14229 consensus_peers.cc:597] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:30.423231 14876 consensus_peers.cc:597] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:30.432256 14876 consensus_peers.cc:597] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:30.448915 14303 consensus_peers.cc:597] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:30.507905 14876 consensus_peers.cc:597] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:30.525156 14303 consensus_peers.cc:597] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:30.600525 14303 consensus_peers.cc:597] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:30.601577 14229 consensus_peers.cc:597] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:30.624981 14229 consensus_peers.cc:597] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:30.633415 14303 consensus_peers.cc:597] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:30.642982 14229 consensus_peers.cc:597] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:30.689204 14876 consensus_peers.cc:597] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:30.746166 12986 thread.cc:527] Waited for 7000ms trying to join with diag-logger (tid 14211)
W20260709 12:13:30.742892 14229 consensus_peers.cc:597] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:30.769724 14303 consensus_peers.cc:597] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:30.776758 14303 consensus_peers.cc:597] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:30.801393 14229 consensus_peers.cc:597] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:30.828552 14303 consensus_peers.cc:597] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:30.830252 14303 consensus_peers.cc:597] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:30.970677 14303 consensus_peers.cc:597] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:30.992120 14303 consensus_peers.cc:597] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:30.992646 14303 consensus_peers.cc:597] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:31.015977 14303 consensus_peers.cc:597] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:31.040602 14303 consensus_peers.cc:597] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:31.045766 14303 consensus_peers.cc:597] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:31.051779 14073 catalog_manager.cc:4755] TS 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet cbe93a4954a24795882e04fa537ddf4d: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111)
W20260709 12:13:31.139333 14303 consensus_peers.cc:597] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:31.167243 14229 consensus_peers.cc:597] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:31.244437 14229 consensus_peers.cc:597] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:31.339897 14229 consensus_peers.cc:597] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:31.520184 14303 consensus_peers.cc:597] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:31.746737 12986 thread.cc:527] Waited for 8000ms trying to join with diag-logger (tid 14211)
W20260709 12:13:32.005034 14303 consensus_peers.cc:597] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:32.149708 14876 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111) [suppressed 478 similar messages]
W20260709 12:13:32.156562 14876 consensus_peers.cc:597] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:32.163018 14303 consensus_peers.cc:597] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:32.194327 14876 consensus_peers.cc:597] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:32.235344 14876 consensus_peers.cc:597] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:32.264519 14229 consensus_peers.cc:597] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:32.374013 14229 consensus_peers.cc:597] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:32.411423 14876 consensus_peers.cc:597] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:32.460834 14876 consensus_peers.cc:597] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:32.490294 14876 consensus_peers.cc:597] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:32.493489 14229 consensus_peers.cc:597] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:32.543743 14229 consensus_peers.cc:597] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:32.574747 14876 consensus_peers.cc:597] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:32.597510 14303 consensus_peers.cc:597] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:32.655417 14229 consensus_peers.cc:597] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:32.747272 12986 thread.cc:527] Waited for 9000ms trying to join with diag-logger (tid 14211)
W20260709 12:13:32.769351 14876 consensus_peers.cc:597] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:32.810696 14876 consensus_peers.cc:597] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:32.856757 14303 consensus_peers.cc:597] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:32.857311 14303 consensus_peers.cc:597] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:32.883201 14303 consensus_peers.cc:597] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:33.122284 14876 consensus_peers.cc:597] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:33.132404 14229 consensus_peers.cc:597] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:33.148993 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 90621.6us
W20260709 12:13:33.193493 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 71273us
W20260709 12:13:33.193624 14229 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 61287.7us
W20260709 12:13:33.194466 14229 consensus_peers.cc:597] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:33.198282 14876 consensus_peers.cc:597] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:33.213873 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.132:37341, user_credentials={real_user=slave}} blocked reactor thread for 59102.6us
W20260709 12:13:33.239553 14073 catalog_manager.cc:4755] TS 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet cbe93a4954a24795882e04fa537ddf4d: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111)
W20260709 12:13:33.248378 14876 consensus_peers.cc:597] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:33.254134 14876 consensus_peers.cc:597] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:33.252190 14303 consensus_peers.cc:597] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:33.261845 14303 consensus_peers.cc:597] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:33.262468 14303 consensus_peers.cc:597] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:33.250344 14229 consensus_peers.cc:597] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:33.264886 14876 consensus_peers.cc:597] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:33.303272 14229 consensus_peers.cc:597] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:33.336499 14229 consensus_peers.cc:597] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:33.342331 14303 consensus_peers.cc:597] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:33.345796 14303 consensus_peers.cc:597] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:33.346455 14303 consensus_peers.cc:597] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:33.429579 14303 consensus_peers.cc:597] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:33.442674 14303 consensus_peers.cc:597] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:33.444650 14303 consensus_peers.cc:597] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:33.479939 14303 consensus_peers.cc:597] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:33.612736 14303 consensus_peers.cc:597] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:33.637336 14303 consensus_peers.cc:597] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:33.661367 14229 consensus_peers.cc:597] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:33.721091 14303 consensus_peers.cc:597] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:33.747810 12986 thread.cc:527] Waited for 10000ms trying to join with diag-logger (tid 14211)
W20260709 12:13:33.890530 14303 consensus_peers.cc:597] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:33.891223 14229 consensus_peers.cc:597] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:33.919124 14229 consensus_peers.cc:597] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:13:34.216436 12986 tablet_server.cc:196] TabletServer@127.12.174.129:0 shutdown complete.
W20260709 12:13:34.316664 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 58238.2us
W20260709 12:13:34.372258 14229 consensus_peers.cc:597] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:34.515657 14876 consensus_peers.cc:597] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:13:34.600391 12986 tablet_server.cc:179] TabletServer@127.12.174.130:0 shutting down...
W20260709 12:13:34.647432 14304 consensus_peers.cc:597] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c -> Peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Couldn't send request to peer 17aab1bbf5014936aa18cc21818b26ec. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:34.657367 14303 consensus_peers.cc:597] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:13:34.657181 14304 consensus_peers.cc:597] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c -> Peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Couldn't send request to peer 17aab1bbf5014936aa18cc21818b26ec. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:34.685904 14229 consensus_peers.cc:597] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:34.691370 14304 consensus_peers.cc:597] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c -> Peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Couldn't send request to peer 17aab1bbf5014936aa18cc21818b26ec. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:34.704810 14876 consensus_peers.cc:597] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:13:34.710872 14304 consensus_peers.cc:597] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c -> Peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Couldn't send request to peer 17aab1bbf5014936aa18cc21818b26ec. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:34.716104 14876 consensus_peers.cc:597] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:13:34.748497 14303 consensus_peers.cc:597] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:34.746932 14876 consensus_peers.cc:597] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:34.757886 14877 consensus_peers.cc:597] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db -> Peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Couldn't send request to peer 17aab1bbf5014936aa18cc21818b26ec. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:34.797183 14877 consensus_peers.cc:597] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db -> Peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Couldn't send request to peer 17aab1bbf5014936aa18cc21818b26ec. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:34.801101 14304 consensus_peers.cc:597] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c -> Peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Couldn't send request to peer 17aab1bbf5014936aa18cc21818b26ec. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:34.820870 14877 consensus_peers.cc:597] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db -> Peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Couldn't send request to peer 17aab1bbf5014936aa18cc21818b26ec. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:34.827965 14304 consensus_peers.cc:597] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c -> Peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Couldn't send request to peer 17aab1bbf5014936aa18cc21818b26ec. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:34.828676 14304 consensus_peers.cc:597] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c -> Peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Couldn't send request to peer 17aab1bbf5014936aa18cc21818b26ec. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:34.840548 14304 consensus_peers.cc:597] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c -> Peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Couldn't send request to peer 17aab1bbf5014936aa18cc21818b26ec. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:34.848523 14304 consensus_peers.cc:597] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c -> Peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Couldn't send request to peer 17aab1bbf5014936aa18cc21818b26ec. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:34.855561 14304 consensus_peers.cc:597] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c -> Peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Couldn't send request to peer 17aab1bbf5014936aa18cc21818b26ec. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:34.870618 14229 consensus_peers.cc:597] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:34.879256 14304 consensus_peers.cc:597] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c -> Peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Couldn't send request to peer 17aab1bbf5014936aa18cc21818b26ec. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:34.899231 14304 consensus_peers.cc:597] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c -> Peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Couldn't send request to peer 17aab1bbf5014936aa18cc21818b26ec. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:34.881230 12986 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:13:34.903970 12986 tablet_replica.cc:333] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec: stopping tablet replica
I20260709 12:13:34.905323 12986 raft_consensus.cc:2243] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Raft consensus shutting down.
W20260709 12:13:34.911794 14877 consensus_peers.cc:597] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db -> Peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Couldn't send request to peer 17aab1bbf5014936aa18cc21818b26ec. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:34.910425 12986 raft_consensus.cc:2272] T 02513fb0dbdd4cbdb019d79f0f448d18 P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:34.917572 14304 consensus_peers.cc:597] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c -> Peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Couldn't send request to peer 17aab1bbf5014936aa18cc21818b26ec. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:34.918345 14304 consensus_peers.cc:597] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c -> Peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Couldn't send request to peer 17aab1bbf5014936aa18cc21818b26ec. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:34.918866 12986 tablet_replica.cc:333] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec: stopping tablet replica
I20260709 12:13:34.920697 12986 raft_consensus.cc:2243] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 26 LEADER]: Raft consensus shutting down.
W20260709 12:13:34.926841 14877 consensus_peers.cc:597] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db -> Peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Couldn't send request to peer 17aab1bbf5014936aa18cc21818b26ec. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:34.929848 12986 raft_consensus.cc:2272] T f4739bc22bfe44fcba807da02d9351b6 P 17aab1bbf5014936aa18cc21818b26ec [term 26 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:34.932144 14877 consensus_peers.cc:597] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db -> Peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Couldn't send request to peer 17aab1bbf5014936aa18cc21818b26ec. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:34.933586 12986 tablet_replica.cc:333] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec: stopping tablet replica
I20260709 12:13:34.935595 12986 raft_consensus.cc:2243] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Raft consensus shutting down.
W20260709 12:13:34.939078 14876 consensus_peers.cc:597] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:13:34.947394 14304 consensus_peers.cc:597] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c -> Peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Couldn't send request to peer 17aab1bbf5014936aa18cc21818b26ec. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:34.948130 14304 consensus_peers.cc:597] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c -> Peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Couldn't send request to peer 17aab1bbf5014936aa18cc21818b26ec. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:34.959441 12986 raft_consensus.cc:2272] T 15f7cecfe772454980c8ae9d1803fe98 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:34.964483 12986 tablet_replica.cc:333] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec: stopping tablet replica
W20260709 12:13:34.960285 14304 consensus_peers.cc:597] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c -> Peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Couldn't send request to peer 17aab1bbf5014936aa18cc21818b26ec. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:34.974536 12986 raft_consensus.cc:2243] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:34.975309 12986 raft_consensus.cc:2272] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:34.981294 12986 tablet_replica.cc:333] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec: stopping tablet replica
W20260709 12:13:34.983949 14877 consensus_peers.cc:597] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db -> Peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Couldn't send request to peer 17aab1bbf5014936aa18cc21818b26ec. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:34.985647 14304 consensus_peers.cc:597] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c -> Peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Couldn't send request to peer 17aab1bbf5014936aa18cc21818b26ec. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:34.986965 12986 raft_consensus.cc:2243] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:34.990980 12986 raft_consensus.cc:2272] T cbe93a4954a24795882e04fa537ddf4d P 17aab1bbf5014936aa18cc21818b26ec [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:34.994028 12986 tablet_replica.cc:333] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec: stopping tablet replica
W20260709 12:13:34.994761 14304 consensus_peers.cc:597] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c -> Peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Couldn't send request to peer 17aab1bbf5014936aa18cc21818b26ec. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:34.995005 12986 raft_consensus.cc:2243] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 23 LEADER]: Raft consensus shutting down.
I20260709 12:13:35.001179 12986 raft_consensus.cc:2272] T e244b5af3ce244339f6fe0bd22a35eba P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:35.004469 12986 tablet_replica.cc:333] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec: stopping tablet replica
I20260709 12:13:35.005618 12986 raft_consensus.cc:2243] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:35.006546 12986 raft_consensus.cc:2272] T ff1f0497acbe4a31944b5bac60c5482c P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:35.010272 12986 tablet_replica.cc:333] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec: stopping tablet replica
I20260709 12:13:35.011330 12986 raft_consensus.cc:2243] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:13:35.013212 12986 raft_consensus.cc:2272] T c022caf6920747708b0cfc607c962951 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:35.018136 12986 tablet_replica.cc:333] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec: stopping tablet replica
I20260709 12:13:35.019173 12986 raft_consensus.cc:2243] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:35.019918 12986 raft_consensus.cc:2272] T b4a0f56d071c4634842ea1584dfe40e6 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:35.022701 12986 tablet_replica.cc:333] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec: stopping tablet replica
I20260709 12:13:35.023566 12986 raft_consensus.cc:2243] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 24 LEADER]: Raft consensus shutting down.
I20260709 12:13:35.026690 12986 raft_consensus.cc:2272] T 0041f9f2b90844269c31eba4aeeab0a7 P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:35.030220 12986 tablet_replica.cc:333] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec: stopping tablet replica
I20260709 12:13:35.031160 12986 raft_consensus.cc:2243] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 28 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:35.036432 12986 raft_consensus.cc:2272] T f1a4a5f0a8324f479c5e1f499164bf42 P 17aab1bbf5014936aa18cc21818b26ec [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:35.039685 12986 tablet_replica.cc:333] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec: stopping tablet replica
I20260709 12:13:35.040632 12986 raft_consensus.cc:2243] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:35.041424 12986 raft_consensus.cc:2272] T e1947202e59d4516a1b38a1583a3242d P 17aab1bbf5014936aa18cc21818b26ec [term 26 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:35.042224 14304 consensus_peers.cc:597] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c -> Peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Couldn't send request to peer 17aab1bbf5014936aa18cc21818b26ec. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:35.051555 12986 tablet_replica.cc:333] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec: stopping tablet replica
I20260709 12:13:35.053000 12986 raft_consensus.cc:2243] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 24 LEADER]: Raft consensus shutting down.
I20260709 12:13:35.054451 12986 raft_consensus.cc:2272] T fb01374e8ef4493d909377b2b9179e39 P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:35.057437 12986 tablet_replica.cc:333] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec: stopping tablet replica
I20260709 12:13:35.058374 12986 raft_consensus.cc:2243] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Raft consensus shutting down.
W20260709 12:13:35.059072 14304 consensus_peers.cc:597] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c -> Peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Couldn't send request to peer 17aab1bbf5014936aa18cc21818b26ec. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:35.059365 12986 raft_consensus.cc:2272] T 0a11d7ae457a408cac205ac501217c61 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:35.062649 12986 tablet_replica.cc:333] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec: stopping tablet replica
I20260709 12:13:35.063576 12986 raft_consensus.cc:2243] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:35.064225 12986 raft_consensus.cc:2272] T e85036847fc14bab8d6b10e9cbee3aca P 17aab1bbf5014936aa18cc21818b26ec [term 26 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:35.074016 14304 consensus_peers.cc:597] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c -> Peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Couldn't send request to peer 17aab1bbf5014936aa18cc21818b26ec. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:35.076350 12986 tablet_replica.cc:333] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec: stopping tablet replica
I20260709 12:13:35.094271 12986 raft_consensus.cc:2243] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:35.095242 12986 raft_consensus.cc:2272] T e0c03baacf444c019b39ae64998e2686 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:35.109449 14877 consensus_peers.cc:597] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db -> Peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Couldn't send request to peer 17aab1bbf5014936aa18cc21818b26ec. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:35.115309 12986 tablet_replica.cc:333] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec: stopping tablet replica
W20260709 12:13:35.116043 14229 consensus_peers.cc:597] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:13:35.117429 12986 raft_consensus.cc:2243] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 28 LEADER]: Raft consensus shutting down.
I20260709 12:13:35.119279 12986 raft_consensus.cc:2272] T 981a078d2d9d479abecc8b0b45771080 P 17aab1bbf5014936aa18cc21818b26ec [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:35.122943 12986 tablet_replica.cc:333] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec: stopping tablet replica
I20260709 12:13:35.123847 12986 raft_consensus.cc:2243] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 22 LEADER]: Raft consensus shutting down.
I20260709 12:13:35.125933 12986 raft_consensus.cc:2272] T afdbef67ffe54739bdccc3b631f66c89 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:35.129110 12986 tablet_replica.cc:333] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec: stopping tablet replica
I20260709 12:13:35.159592 12986 raft_consensus.cc:2243] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 22 LEADER]: Raft consensus shutting down.
I20260709 12:13:35.161015 12986 raft_consensus.cc:2272] T 88b5f4f19c2a4585b93b312cc1f3d17f P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:35.164389 12986 tablet_replica.cc:333] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec: stopping tablet replica
I20260709 12:13:35.169152 12986 raft_consensus.cc:2243] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 24 LEADER]: Raft consensus shutting down.
W20260709 12:13:35.175288 14876 consensus_peers.cc:597] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:13:35.176935 12986 raft_consensus.cc:2272] T fd6a20fc287b48fbb5cbf25078173b21 P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:35.181932 12986 tablet_replica.cc:333] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec: stopping tablet replica
I20260709 12:13:35.182950 12986 raft_consensus.cc:2243] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Raft consensus shutting down.
W20260709 12:13:35.183128 14303 consensus_peers.cc:597] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:13:35.185837 12986 raft_consensus.cc:2272] T 8efcd0417f0c412280654006e6389763 P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:35.188845 12986 tablet_replica.cc:333] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec: stopping tablet replica
I20260709 12:13:35.197839 12986 raft_consensus.cc:2243] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:35.198576 12986 raft_consensus.cc:2272] T 6de6b0d9885648e6b2f6822eb9f85021 P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:35.201689 12986 tablet_replica.cc:333] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec: stopping tablet replica
I20260709 12:13:35.202587 12986 raft_consensus.cc:2243] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 28 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:35.203336 12986 raft_consensus.cc:2272] T 57e5f03a80374104a130f5b0e70a0280 P 17aab1bbf5014936aa18cc21818b26ec [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:35.206161 12986 tablet_replica.cc:333] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec: stopping tablet replica
I20260709 12:13:35.207278 12986 raft_consensus.cc:2243] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:35.208016 12986 raft_consensus.cc:2272] T b317dbf6b7fd4860be0fa436e8b54807 P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:35.210685 12986 tablet_replica.cc:333] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec: stopping tablet replica
I20260709 12:13:35.211500 12986 raft_consensus.cc:2243] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:35.212134 12986 raft_consensus.cc:2272] T f52421be255e4fab824173d17981b5bb P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:35.214852 12986 tablet_replica.cc:333] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec: stopping tablet replica
I20260709 12:13:35.216087 12986 raft_consensus.cc:2243] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 24 LEADER]: Raft consensus shutting down.
I20260709 12:13:35.217408 12986 raft_consensus.cc:2272] T 1eb6edfa93424aa68a4239fd27a62064 P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:35.220198 12986 tablet_replica.cc:333] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec: stopping tablet replica
W20260709 12:13:35.220252 14876 consensus_peers.cc:597] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:13:35.221191 12986 raft_consensus.cc:2243] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 27 LEADER]: Raft consensus shutting down.
I20260709 12:13:35.222630 12986 raft_consensus.cc:2272] T ec0fc0e91c904a0daeb3e29ee24a492d P 17aab1bbf5014936aa18cc21818b26ec [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:35.225370 12986 tablet_replica.cc:333] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec: stopping tablet replica
I20260709 12:13:35.226274 12986 raft_consensus.cc:2243] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 32 LEADER]: Raft consensus shutting down.
I20260709 12:13:35.227736 12986 raft_consensus.cc:2272] T 5879727b381a48b18b1949c96428b5d0 P 17aab1bbf5014936aa18cc21818b26ec [term 32 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:35.228567 14303 consensus_peers.cc:597] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:13:35.230863 12986 tablet_replica.cc:333] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec: stopping tablet replica
I20260709 12:13:35.231812 12986 raft_consensus.cc:2243] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 24 LEADER]: Raft consensus shutting down.
I20260709 12:13:35.233008 12986 raft_consensus.cc:2272] T d82ca0c0e51a4e148b8d3e226ff7cebb P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:35.235898 12986 tablet_replica.cc:333] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec: stopping tablet replica
I20260709 12:13:35.236809 12986 raft_consensus.cc:2243] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:35.237509 12986 raft_consensus.cc:2272] T f9f69e925a8f4da7ba2b318edae7b194 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:35.240381 12986 tablet_replica.cc:333] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec: stopping tablet replica
I20260709 12:13:35.241231 12986 raft_consensus.cc:2243] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:35.242514 12986 raft_consensus.cc:2272] T f57e398f580944f0866ea5fab71be87f P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:35.245304 12986 tablet_replica.cc:333] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec: stopping tablet replica
I20260709 12:13:35.246143 12986 raft_consensus.cc:2243] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 28 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:35.247009 12986 raft_consensus.cc:2272] T f548bfe8d3c540e487760b5966d0e7f8 P 17aab1bbf5014936aa18cc21818b26ec [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:35.250038 12986 tablet_replica.cc:333] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec: stopping tablet replica
I20260709 12:13:35.250877 12986 raft_consensus.cc:2243] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:35.252349 12986 raft_consensus.cc:2272] T e9b3f8ef40054811944ba9bd9ed74eb3 P 17aab1bbf5014936aa18cc21818b26ec [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:35.255370 12986 tablet_replica.cc:333] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec: stopping tablet replica
I20260709 12:13:35.256328 12986 raft_consensus.cc:2243] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:35.257094 12986 raft_consensus.cc:2272] T 7879f4a298eb4e69ac692911bd5ac5f8 P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:35.259985 12986 tablet_replica.cc:333] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec: stopping tablet replica
I20260709 12:13:35.260818 12986 raft_consensus.cc:2243] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:35.262351 12986 raft_consensus.cc:2272] T 938efad339fd47e1b0b6d37fbc612db2 P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:35.265208 12986 tablet_replica.cc:333] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec: stopping tablet replica
I20260709 12:13:35.266072 12986 raft_consensus.cc:2243] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:35.266958 12986 raft_consensus.cc:2272] T 35b39d0f3270452a8bd4f4b1800a837c P 17aab1bbf5014936aa18cc21818b26ec [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:35.269577 12986 tablet_replica.cc:333] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec: stopping tablet replica
I20260709 12:13:35.270460 12986 raft_consensus.cc:2243] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 28 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:35.271123 12986 raft_consensus.cc:2272] T ae82f0f3bcac4608987cd7c935c9799b P 17aab1bbf5014936aa18cc21818b26ec [term 28 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:35.271938 14876 consensus_peers.cc:597] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:13:35.273875 12986 tablet_replica.cc:333] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec: stopping tablet replica
I20260709 12:13:35.274739 12986 raft_consensus.cc:2243] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 28 LEADER]: Raft consensus shutting down.
I20260709 12:13:35.276361 12986 raft_consensus.cc:2272] T 89bb37b32a7f408b9730abb56b9cfa05 P 17aab1bbf5014936aa18cc21818b26ec [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:35.294644 12986 tablet_replica.cc:333] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec: stopping tablet replica
I20260709 12:13:35.300313 12986 raft_consensus.cc:2243] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 25 LEADER]: Raft consensus shutting down.
I20260709 12:13:35.301837 12986 raft_consensus.cc:2272] T bd5274ac33c2483681726f6b8eccdc6c P 17aab1bbf5014936aa18cc21818b26ec [term 25 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:35.302866 14876 consensus_peers.cc:597] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:13:35.304656 12986 tablet_replica.cc:333] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec: stopping tablet replica
I20260709 12:13:35.305673 12986 raft_consensus.cc:2243] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 30 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:35.307046 12986 raft_consensus.cc:2272] T e9b8048bcdf74441aac2cd21ac7af4da P 17aab1bbf5014936aa18cc21818b26ec [term 30 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:35.309916 12986 tablet_replica.cc:333] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec: stopping tablet replica
I20260709 12:13:35.310806 12986 raft_consensus.cc:2243] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:35.311672 12986 raft_consensus.cc:2272] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:35.314837 12986 tablet_replica.cc:333] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec: stopping tablet replica
I20260709 12:13:35.315696 12986 raft_consensus.cc:2243] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:13:35.316987 12986 raft_consensus.cc:2272] T ba1914a8ae9f4959971f147e578773fc P 17aab1bbf5014936aa18cc21818b26ec [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:35.329717 12986 tablet_replica.cc:333] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec: stopping tablet replica
I20260709 12:13:35.330825 12986 raft_consensus.cc:2243] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:35.331804 12986 raft_consensus.cc:2272] T 8d9964631a6940e4b111e1b1dabb0aae P 17aab1bbf5014936aa18cc21818b26ec [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:35.336573 12986 tablet_replica.cc:333] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec: stopping tablet replica
I20260709 12:13:35.337518 12986 raft_consensus.cc:2243] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:35.339413 12986 raft_consensus.cc:2272] T cd9d6c9c152f47769123b7748d8c8262 P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:35.342388 12986 tablet_replica.cc:333] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec: stopping tablet replica
I20260709 12:13:35.343384 12986 raft_consensus.cc:2243] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:13:35.344617 12986 raft_consensus.cc:2272] T afce5304599246a580d798fc0c843964 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:35.346557 14303 consensus_peers.cc:597] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:13:35.348908 12986 tablet_replica.cc:333] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec: stopping tablet replica
I20260709 12:13:35.349864 12986 raft_consensus.cc:2243] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:35.350636 12986 raft_consensus.cc:2272] T 53f6ce2ae2d8465cb314a84096322886 P 17aab1bbf5014936aa18cc21818b26ec [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:35.358986 12986 tablet_replica.cc:333] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec: stopping tablet replica
I20260709 12:13:35.360852 12986 raft_consensus.cc:2243] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 30 LEADER]: Raft consensus shutting down.
I20260709 12:13:35.362242 12986 raft_consensus.cc:2272] T 55a08950f57748dea047f3190b2c0e95 P 17aab1bbf5014936aa18cc21818b26ec [term 30 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:35.363435 14303 consensus_peers.cc:597] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:13:35.365082 12986 tablet_replica.cc:333] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec: stopping tablet replica
I20260709 12:13:35.365924 12986 raft_consensus.cc:2243] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 22 LEADER]: Raft consensus shutting down.
I20260709 12:13:35.367228 12986 raft_consensus.cc:2272] T 1dfd3f2bd71343f789aa5733a23d4b8d P 17aab1bbf5014936aa18cc21818b26ec [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:35.373832 12986 tablet_replica.cc:333] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec: stopping tablet replica
I20260709 12:13:35.374610 12986 raft_consensus.cc:2243] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:35.375555 12986 raft_consensus.cc:2272] T bf9bea0d16e44efabb5cdd53e3828438 P 17aab1bbf5014936aa18cc21818b26ec [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:35.419966 14876 consensus_peers.cc:597] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:13:35.541759 14876 consensus_peers.cc:597] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:13:35.663028 14303 consensus_peers.cc:597] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:35.678112 14303 consensus_peers.cc:597] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:35.693611 14303 consensus_peers.cc:597] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:13:35.720151 14303 consensus_peers.cc:597] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:13:35.738682 14303 consensus_peers.cc:597] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:13:35.741906 14876 consensus_peers.cc:597] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:13:35.743758 14303 consensus_peers.cc:597] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:13:35.748235 14876 consensus_peers.cc:597] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:35.836555 14303 consensus_peers.cc:597] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:13:35.905664 14876 consensus_peers.cc:597] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:13:35.927727 14303 consensus_peers.cc:597] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:13:35.977845 14303 consensus_peers.cc:597] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:13:36.032476 14303 consensus_peers.cc:597] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:13:36.044250 23034 raft_consensus.cc:493] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:13:36.045070 23034 raft_consensus.cc:515] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:13:36.074041 14876 leader_election.cc:336] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111)
I20260709 12:13:36.082861 23034 leader_election.cc:290] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:13:36.090363 14303 consensus_peers.cc:597] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:13:36.108676 14877 leader_election.cc:336] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Network error: Client connection negotiation failed: client connection to 127.12.174.130:36673: connect: Connection refused (error 111)
I20260709 12:13:36.115206 14877 leader_election.cc:304] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:36.117194 23034 raft_consensus.cc:2749] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 12:13:36.123921 14303 consensus_peers.cc:597] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:13:36.156070 23033 raft_consensus.cc:493] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:13:36.156852 23033 raft_consensus.cc:515] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:36.162456 23033 leader_election.cc:290] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:13:36.165899 23033 raft_consensus.cc:493] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:13:36.166970 23033 raft_consensus.cc:515] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:36.200354 23016 raft_consensus.cc:493] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:13:36.201719 23016 raft_consensus.cc:515] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:36.206626 23016 leader_election.cc:290] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:36.244416 23033 leader_election.cc:290] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:13:36.251248 14304 leader_election.cc:336] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Network error: Client connection negotiation failed: client connection to 127.12.174.130:36673: connect: Connection refused (error 111)
W20260709 12:13:36.257627 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 43614us
W20260709 12:13:36.263266 14877 leader_election.cc:336] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Network error: Client connection negotiation failed: client connection to 127.12.174.130:36673: connect: Connection refused (error 111)
I20260709 12:13:36.266378 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 29 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:36.275019 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
W20260709 12:13:36.286022 14303 leader_election.cc:336] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111)
I20260709 12:13:36.286620 14303 leader_election.cc:304] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
W20260709 12:13:36.275362 14304 leader_election.cc:336] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Network error: Client connection negotiation failed: client connection to 127.12.174.130:36673: connect: Connection refused (error 111)
I20260709 12:13:36.280531 14877 leader_election.cc:304] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:13:36.295771 23034 raft_consensus.cc:2749] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:13:36.296599 23034 raft_consensus.cc:493] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:13:36.297082 23034 raft_consensus.cc:515] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:36.298660 23042 raft_consensus.cc:493] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:13:36.299300 23042 raft_consensus.cc:515] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:36.303124 23034 leader_election.cc:290] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:36.301566 23042 leader_election.cc:290] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:36.319350 23033 raft_consensus.cc:2749] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:36.322518 23034 raft_consensus.cc:493] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:13:36.323207 23034 raft_consensus.cc:515] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:36.327807 23033 raft_consensus.cc:493] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:13:36.328459 23033 raft_consensus.cc:515] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:36.332125 23033 leader_election.cc:290] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:13:36.336120 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:36.347255 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:36.351543 23014 raft_consensus.cc:493] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:13:36.352170 23014 raft_consensus.cc:515] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:36.354936 23014 leader_election.cc:290] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:13:36.368790 23034 leader_election.cc:290] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:36.370124 14303 leader_election.cc:304] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 73d01e9b1a9d49358da4985b21d681db
I20260709 12:13:36.378013 23034 raft_consensus.cc:493] T afdbef67ffe54739bdccc3b631f66c89 P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:13:36.378706 23034 raft_consensus.cc:515] T afdbef67ffe54739bdccc3b631f66c89 P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:36.391886 23014 raft_consensus.cc:2749] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:13:36.422930 23037 raft_consensus.cc:493] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:13:36.423568 23037 raft_consensus.cc:515] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:36.426151 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:36.427399 14332 raft_consensus.cc:2468] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 26.
I20260709 12:13:36.428440 23037 leader_election.cc:290] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:13:36.433542 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:36.436218 23034 leader_election.cc:290] T afdbef67ffe54739bdccc3b631f66c89 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:36.445056 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 29 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:13:36.445900 14906 raft_consensus.cc:2468] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 28.
I20260709 12:13:36.446997 23034 raft_consensus.cc:493] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:13:36.447590 23034 raft_consensus.cc:515] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:36.450207 23034 leader_election.cc:290] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:13:36.446368 14877 leader_election.cc:336] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Network error: Client connection negotiation failed: client connection to 127.12.174.130:36673: connect: Connection refused (error 111)
I20260709 12:13:36.454226 14877 leader_election.cc:304] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:13:36.459012 23043 raft_consensus.cc:493] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 30 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:13:36.459713 23043 raft_consensus.cc:515] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 30 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:36.462424 23043 leader_election.cc:290] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:36.463022 23043 raft_consensus.cc:2749] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 12:13:36.464205 14877 leader_election.cc:336] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Network error: Client connection negotiation failed: client connection to 127.12.174.130:36673: connect: Connection refused (error 111)
I20260709 12:13:36.464672 14877 leader_election.cc:304] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:13:36.465497 23037 raft_consensus.cc:493] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:13:36.466086 23037 raft_consensus.cc:515] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:36.469226 23037 leader_election.cc:290] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:13:36.470551 23026 raft_consensus.cc:493] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:13:36.471212 23026 raft_consensus.cc:515] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:36.474586 23014 raft_consensus.cc:493] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:13:36.475207 23014 raft_consensus.cc:515] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:36.477437 23014 leader_election.cc:290] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:13:36.469779 23037 raft_consensus.cc:493] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:13:36.479779 23037 raft_consensus.cc:515] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:36.482041 23037 leader_election.cc:290] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:13:36.478015 23033 raft_consensus.cc:493] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 32 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:13:36.482757 23033 raft_consensus.cc:515] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 32 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:36.485179 23033 leader_election.cc:290] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:13:36.478993 23026 leader_election.cc:290] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:13:36.486699 23026 raft_consensus.cc:493] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:13:36.487221 23026 raft_consensus.cc:515] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:36.489933 23026 leader_election.cc:290] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:13:36.492579 14304 leader_election.cc:336] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Network error: Client connection negotiation failed: client connection to 127.12.174.130:36673: connect: Connection refused (error 111)
W20260709 12:13:36.498931 14876 leader_election.cc:336] T afdbef67ffe54739bdccc3b631f66c89 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111)
W20260709 12:13:36.501451 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 44941.3us
I20260709 12:13:36.503546 23043 raft_consensus.cc:2749] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 12:13:36.520337 14304 leader_election.cc:336] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Network error: Client connection negotiation failed: client connection to 127.12.174.130:36673: connect: Connection refused (error 111)
I20260709 12:13:36.523135 14877 leader_election.cc:304] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:13:36.524232 14877 leader_election.cc:304] T afdbef67ffe54739bdccc3b631f66c89 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:36.525590 23042 raft_consensus.cc:2804] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:13:36.526047 23042 raft_consensus.cc:493] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 26 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:13:36.526429 23042 raft_consensus.cc:3060] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:36.537964 23034 raft_consensus.cc:2749] T afdbef67ffe54739bdccc3b631f66c89 P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:36.547715 14303 leader_election.cc:304] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:13:36.548684 23033 raft_consensus.cc:2804] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 12:13:36.549485 23033 raft_consensus.cc:493] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 28 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:13:36.550041 23033 raft_consensus.cc:3060] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 28 FOLLOWER]: Advancing to term 29
W20260709 12:13:36.540915 14876 leader_election.cc:336] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111)
W20260709 12:13:36.571521 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 47359.8us
W20260709 12:13:36.572077 12986 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 14286)
I20260709 12:13:36.583649 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:13:36.584410 14906 raft_consensus.cc:2468] T afdbef67ffe54739bdccc3b631f66c89 P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 22.
I20260709 12:13:36.592204 23026 raft_consensus.cc:493] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:13:36.592962 23026 raft_consensus.cc:515] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:36.596091 23026 leader_election.cc:290] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:13:36.598138 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 31 candidate_status { last_received { term: 30 index: 18 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:36.598924 14332 raft_consensus.cc:2468] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 30.
I20260709 12:13:36.614830 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:13:36.615592 14906 raft_consensus.cc:2468] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 24.
I20260709 12:13:36.537436 23042 raft_consensus.cc:515] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 27 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:36.620594 23042 leader_election.cc:290] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 27 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:13:36.631413 14877 leader_election.cc:336] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Network error: Client connection negotiation failed: client connection to 127.12.174.130:36673: connect: Connection refused (error 111)
W20260709 12:13:36.645211 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 79928.5us
W20260709 12:13:36.648602 14304 leader_election.cc:336] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Network error: Client connection negotiation failed: client connection to 127.12.174.130:36673: connect: Connection refused (error 111)
W20260709 12:13:36.657771 14877 leader_election.cc:336] T afdbef67ffe54739bdccc3b631f66c89 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Network error: Client connection negotiation failed: client connection to 127.12.174.130:36673: connect: Connection refused (error 111)
I20260709 12:13:36.675148 23033 raft_consensus.cc:515] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 29 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:13:36.698217 14303 leader_election.cc:336] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111)
I20260709 12:13:36.703156 14303 leader_election.cc:304] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:36.701030 14877 leader_election.cc:304] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:13:36.705053 23044 raft_consensus.cc:493] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:13:36.709877 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4739bc22bfe44fcba807da02d9351b6" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:13:36.716113 14332 raft_consensus.cc:3060] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:13:36.725181 14332 raft_consensus.cc:2468] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 27.
I20260709 12:13:36.725839 23044 raft_consensus.cc:515] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:36.729161 23044 leader_election.cc:290] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:13:36.729981 23044 raft_consensus.cc:2749] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:36.737450 23043 raft_consensus.cc:2804] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 30 FOLLOWER]: Leader pre-election won for term 31
I20260709 12:13:36.738116 23043 raft_consensus.cc:493] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 30 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:13:36.738595 23043 raft_consensus.cc:3060] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:13:36.700248 23033 leader_election.cc:290] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 29 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:13:36.772149 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 57331.7us
W20260709 12:13:36.773336 14303 leader_election.cc:336] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111)
I20260709 12:13:36.774145 14303 leader_election.cc:304] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:36.775696 23033 raft_consensus.cc:2749] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 12:13:36.713110 14304 leader_election.cc:336] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Network error: Client connection negotiation failed: client connection to 127.12.174.130:36673: connect: Connection refused (error 111)
W20260709 12:13:36.776893 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 63837.4us
W20260709 12:13:36.777462 14304 leader_election.cc:336] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Network error: Client connection negotiation failed: client connection to 127.12.174.130:36673: connect: Connection refused (error 111)
W20260709 12:13:36.778012 14304 leader_election.cc:336] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Network error: Client connection negotiation failed: client connection to 127.12.174.130:36673: connect: Connection refused (error 111)
W20260709 12:13:36.780529 14877 leader_election.cc:336] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Network error: Client connection negotiation failed: client connection to 127.12.174.130:36673: connect: Connection refused (error 111)
I20260709 12:13:36.783314 14877 leader_election.cc:304] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:36.784317 23042 raft_consensus.cc:2749] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:13:36.787262 23043 raft_consensus.cc:515] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 31 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:36.802734 23043 leader_election.cc:290] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 31 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:13:36.794059 14304 leader_election.cc:336] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Network error: Client connection negotiation failed: client connection to 127.12.174.130:36673: connect: Connection refused (error 111)
I20260709 12:13:36.798156 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db" is_pre_election: true
I20260709 12:13:36.810494 14909 raft_consensus.cc:2468] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 22.
W20260709 12:13:36.789371 14877 leader_election.cc:336] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 31 pre-election: RPC error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Network error: Client connection negotiation failed: client connection to 127.12.174.130:36673: connect: Connection refused (error 111)
W20260709 12:13:36.813030 14304 leader_election.cc:336] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 33 pre-election: RPC error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Network error: Client connection negotiation failed: client connection to 127.12.174.130:36673: connect: Connection refused (error 111)
W20260709 12:13:36.814581 14304 leader_election.cc:336] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Network error: Client connection negotiation failed: client connection to 127.12.174.130:36673: connect: Connection refused (error 111)
I20260709 12:13:36.840757 23042 raft_consensus.cc:493] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:13:36.841400 23042 raft_consensus.cc:515] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:36.843734 23042 leader_election.cc:290] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:13:36.861901 23033 raft_consensus.cc:493] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:13:36.862707 23033 raft_consensus.cc:515] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:36.866253 23033 leader_election.cc:290] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:13:36.877022 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55a08950f57748dea047f3190b2c0e95" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 31 candidate_status { last_received { term: 30 index: 18 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c"
I20260709 12:13:36.877945 14332 raft_consensus.cc:3060] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 30 FOLLOWER]: Advancing to term 31
W20260709 12:13:36.885316 14876 leader_election.cc:336] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111)
I20260709 12:13:36.886237 23045 raft_consensus.cc:493] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:13:36.912257 23045 raft_consensus.cc:515] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:36.914789 23045 leader_election.cc:290] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:13:36.888783 14303 leader_election.cc:304] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:13:36.917030 23044 raft_consensus.cc:2804] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:13:36.917541 23044 raft_consensus.cc:493] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:13:36.917977 23044 raft_consensus.cc:3060] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Advancing to term 25
W20260709 12:13:36.928789 14876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 43522.7us
I20260709 12:13:36.936542 14877 leader_election.cc:304] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:13:36.937721 23043 raft_consensus.cc:2804] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 27 FOLLOWER]: Leader election won for term 27
I20260709 12:13:36.938791 23043 raft_consensus.cc:697] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 27 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:13:36.939952 23043 consensus_queue.cc:237] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 26.18, Last appended by leader: 18, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:13:36.946123 14304 leader_election.cc:336] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Network error: Client connection negotiation failed: client connection to 127.12.174.130:36673: connect: Connection refused (error 111)
I20260709 12:13:36.953864 14303 leader_election.cc:304] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:13:36.963042 14909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981a078d2d9d479abecc8b0b45771080" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 29 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:13:36.963919 14909 raft_consensus.cc:3060] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:13:36.959633 23026 raft_consensus.cc:2804] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:13:36.970193 23026 raft_consensus.cc:493] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Starting leader election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:13:36.970606 23026 raft_consensus.cc:3060] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:13:36.958772 14332 raft_consensus.cc:2468] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 31 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 31.
I20260709 12:13:36.980549 14088 catalog_manager.cc:5697] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 26 to 27, leader changed from 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130) to 73d01e9b1a9d49358da4985b21d681db (127.12.174.132). New cstate: current_term: 27 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:13:36.989694 14876 consensus_peers.cc:597] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:13:36.992973 14909 raft_consensus.cc:2468] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 29.
I20260709 12:13:37.009187 23044 raft_consensus.cc:515] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:13:37.006678 14303 leader_election.cc:336] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111)
W20260709 12:13:36.992849 14304 leader_election.cc:336] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 29 election: RPC error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Network error: Client connection negotiation failed: client connection to 127.12.174.130:36673: connect: Connection refused (error 111)
I20260709 12:13:37.026088 14303 leader_election.cc:304] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
W20260709 12:13:37.026096 14877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:45957, user_credentials={real_user=slave}} blocked reactor thread for 62916.8us
W20260709 12:13:37.028014 14303 leader_election.cc:336] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111)
W20260709 12:13:37.026674 14304 leader_election.cc:336] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Network error: Client connection negotiation failed: client connection to 127.12.174.130:36673: connect: Connection refused (error 111)
I20260709 12:13:37.028466 14303 leader_election.cc:304] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
W20260709 12:13:37.030002 14303 leader_election.cc:336] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111)
I20260709 12:13:37.030472 14303 leader_election.cc:304] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
W20260709 12:13:37.031956 14303 leader_election.cc:336] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111)
I20260709 12:13:37.032383 14303 leader_election.cc:304] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:37.029911 14877 leader_election.cc:304] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 31 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 
I20260709 12:13:37.029168 23014 raft_consensus.cc:2749] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:13:37.034432 23043 raft_consensus.cc:2804] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 31 FOLLOWER]: Leader election won for term 31
W20260709 12:13:37.035732 14303 leader_election.cc:336] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 33 pre-election: RPC error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111)
I20260709 12:13:37.036360 23043 raft_consensus.cc:697] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 31 LEADER]: Becoming Leader. State: Replica: 73d01e9b1a9d49358da4985b21d681db, State: Running, Role: LEADER
I20260709 12:13:37.034960 23033 raft_consensus.cc:2749] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:37.037386 23043 consensus_queue.cc:237] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 30.18, Last appended by leader: 18, Current term: 31, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:37.038033 23044 leader_election.cc:290] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 25 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
I20260709 12:13:37.038424 23014 raft_consensus.cc:2749] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:13:37.035259 23045 raft_consensus.cc:2749] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:13:37.041121 14303 leader_election.cc:304] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:37.044407 23026 raft_consensus.cc:515] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:37.047123 23026 leader_election.cc:290] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 23 election: Requested vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 73d01e9b1a9d49358da4985b21d681db (127.12.174.132:37341)
W20260709 12:13:37.047395 14877 leader_election.cc:336] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Network error: Client connection negotiation failed: client connection to 127.12.174.130:36673: connect: Connection refused (error 111)
W20260709 12:13:37.067698 14303 consensus_peers.cc:597] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:13:37.067560 14906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82ca0c0e51a4e148b8d3e226ff7cebb" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:13:37.059460 23033 raft_consensus.cc:2749] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 32 FOLLOWER]: Leader pre-election lost for term 33. Reason: could not achieve majority
I20260709 12:13:37.068542 14906 raft_consensus.cc:3060] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:13:37.067610 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfd3f2bd71343f789aa5733a23d4b8d" candidate_uuid: "65c9c1653b3346b39a0e118540e6080c" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "73d01e9b1a9d49358da4985b21d681db"
I20260709 12:13:37.074021 14911 raft_consensus.cc:3060] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:13:37.079634 14303 consensus_peers.cc:597] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:13:37.080397 14303 leader_election.cc:336] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111)
I20260709 12:13:37.080814 14303 leader_election.cc:304] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:37.081640 23045 raft_consensus.cc:2749] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 12:13:37.095438 14304 leader_election.cc:336] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Network error: Client connection negotiation failed: client connection to 127.12.174.130:36673: connect: Connection refused (error 111)
I20260709 12:13:37.096225 14303 leader_election.cc:304] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:13:37.097126 23045 raft_consensus.cc:2804] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 29 FOLLOWER]: Leader election won for term 29
I20260709 12:13:37.097659 23045 raft_consensus.cc:697] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 29 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
W20260709 12:13:37.098328 14877 leader_election.cc:336] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 31 election: RPC error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Network error: Client connection negotiation failed: client connection to 127.12.174.130:36673: connect: Connection refused (error 111)
I20260709 12:13:37.098577 23045 consensus_queue.cc:237] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 28.20, Last appended by leader: 20, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:13:37.104406 14877 leader_election.cc:336] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Network error: Client connection negotiation failed: client connection to 127.12.174.130:36673: connect: Connection refused (error 111)
I20260709 12:13:37.106110 14877 leader_election.cc:304] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
W20260709 12:13:37.105546 14304 leader_election.cc:336] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Network error: Client connection negotiation failed: client connection to 127.12.174.130:36673: connect: Connection refused (error 111)
W20260709 12:13:37.110217 14876 consensus_peers.cc:597] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:13:37.108672 23043 raft_consensus.cc:2749] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:37.106541 14911 raft_consensus.cc:2468] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 23.
I20260709 12:13:37.102361 14906 raft_consensus.cc:2468] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65c9c1653b3346b39a0e118540e6080c in term 25.
W20260709 12:13:37.147342 14304 leader_election.cc:336] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Network error: Client connection negotiation failed: client connection to 127.12.174.130:36673: connect: Connection refused (error 111)
W20260709 12:13:37.148371 14304 consensus_peers.cc:597] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c -> Peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Couldn't send request to peer 17aab1bbf5014936aa18cc21818b26ec. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.130:36673: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:37.148928 14304 leader_election.cc:336] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Network error: Client connection negotiation failed: client connection to 127.12.174.130:36673: connect: Connection refused (error 111)
W20260709 12:13:37.155496 14877 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.174.130:36673: connect: Connection refused (error 111) [suppressed 588 similar messages]
W20260709 12:13:37.174559 14304 consensus_peers.cc:597] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c -> Peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Couldn't send request to peer 17aab1bbf5014936aa18cc21818b26ec. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.130:36673: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:37.276842 14876 consensus_peers.cc:597] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:13:37.316911 14876 consensus_peers.cc:597] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:13:37.339286 14304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:36673, user_credentials={real_user=slave}} blocked reactor thread for 162265us
W20260709 12:13:37.351953 14877 consensus_peers.cc:597] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db -> Peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Couldn't send request to peer 17aab1bbf5014936aa18cc21818b26ec. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.130:36673: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:37.352526 14877 consensus_peers.cc:597] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db -> Peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Couldn't send request to peer 17aab1bbf5014936aa18cc21818b26ec. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.130:36673: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:37.352988 14877 consensus_peers.cc:597] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db -> Peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Couldn't send request to peer 17aab1bbf5014936aa18cc21818b26ec. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.130:36673: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:37.354995 14876 consensus_peers.cc:597] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:13:37.360858 14303 leader_election.cc:336] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111)
I20260709 12:13:37.362697 14303 leader_election.cc:304] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:37.366274 23044 raft_consensus.cc:2749] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 12:13:37.387212 14303 leader_election.cc:336] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111)
I20260709 12:13:37.388409 14303 leader_election.cc:304] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:37.391095 23044 raft_consensus.cc:2749] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 12:13:37.389325 14304 consensus_peers.cc:597] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c -> Peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Couldn't send request to peer 17aab1bbf5014936aa18cc21818b26ec. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.130:36673: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:37.368496 14339 raft_consensus.cc:1275] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 27 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 26 index: 18. Preceding OpId from leader: term: 27 index: 19. (index mismatch)
W20260709 12:13:37.392321 14304 consensus_peers.cc:597] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c -> Peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Couldn't send request to peer 17aab1bbf5014936aa18cc21818b26ec. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.130:36673: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:37.392871 14304 consensus_peers.cc:597] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c -> Peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Couldn't send request to peer 17aab1bbf5014936aa18cc21818b26ec. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.130:36673: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:37.394873 14877 consensus_peers.cc:597] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db -> Peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Couldn't send request to peer 17aab1bbf5014936aa18cc21818b26ec. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.130:36673: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:37.396071 23016 consensus_queue.cc:1048] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260709 12:13:37.420488 14303 leader_election.cc:304] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec
I20260709 12:13:37.423646 14303 leader_election.cc:304] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec
W20260709 12:13:37.423827 14073 catalog_manager.cc:4755] TS 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet cbe93a4954a24795882e04fa537ddf4d: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111)
I20260709 12:13:37.428092 23059 raft_consensus.cc:2804] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:13:37.428761 23059 raft_consensus.cc:697] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 23 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:13:37.431288 23060 raft_consensus.cc:2804] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:13:37.431131 23059 consensus_queue.cc:237] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:37.431933 23060 raft_consensus.cc:697] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 25 LEADER]: Becoming Leader. State: Replica: 65c9c1653b3346b39a0e118540e6080c, State: Running, Role: LEADER
I20260709 12:13:37.433008 23060 consensus_queue.cc:237] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.17, Last appended by leader: 17, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:13:37.456914 14304 consensus_peers.cc:597] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c -> Peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Couldn't send request to peer 17aab1bbf5014936aa18cc21818b26ec. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.130:36673: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:37.490172 14079 catalog_manager.cc:5697] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c reported cstate change: term changed from 28 to 29, leader changed from 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130) to 65c9c1653b3346b39a0e118540e6080c (127.12.174.131). New cstate: current_term: 29 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:37.508332 14911 raft_consensus.cc:1275] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 29 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 28 index: 20. Preceding OpId from leader: term: 29 index: 21. (index mismatch)
W20260709 12:13:37.517169 14304 consensus_peers.cc:597] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c -> Peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Couldn't send request to peer 17aab1bbf5014936aa18cc21818b26ec. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.130:36673: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:37.519078 14304 consensus_peers.cc:597] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c -> Peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Couldn't send request to peer 17aab1bbf5014936aa18cc21818b26ec. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.130:36673: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:37.519526 14304 consensus_peers.cc:597] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c -> Peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Couldn't send request to peer 17aab1bbf5014936aa18cc21818b26ec. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.130:36673: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:37.519979 14304 consensus_peers.cc:597] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c -> Peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Couldn't send request to peer 17aab1bbf5014936aa18cc21818b26ec. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.130:36673: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:37.520462 14304 consensus_peers.cc:597] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c -> Peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Couldn't send request to peer 17aab1bbf5014936aa18cc21818b26ec. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.130:36673: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:37.526336 23045 consensus_queue.cc:1048] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.001s
W20260709 12:13:37.553143 14304 consensus_peers.cc:597] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c -> Peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Couldn't send request to peer 17aab1bbf5014936aa18cc21818b26ec. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.130:36673: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:37.552923 14303 consensus_peers.cc:597] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:13:37.584736 14303 consensus_peers.cc:597] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:13:37.603084 14304 consensus_peers.cc:597] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c -> Peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Couldn't send request to peer 17aab1bbf5014936aa18cc21818b26ec. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.130:36673: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:37.611553 14876 consensus_peers.cc:597] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:13:37.626848 14304 consensus_peers.cc:597] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c -> Peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Couldn't send request to peer 17aab1bbf5014936aa18cc21818b26ec. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.130:36673: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:37.636457 14339 raft_consensus.cc:1275] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 31 FOLLOWER]: Refusing update from remote peer 73d01e9b1a9d49358da4985b21d681db: Log matching property violated. Preceding OpId in replica: term: 30 index: 18. Preceding OpId from leader: term: 31 index: 19. (index mismatch)
W20260709 12:13:37.644418 14304 consensus_peers.cc:597] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c -> Peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Couldn't send request to peer 17aab1bbf5014936aa18cc21818b26ec. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.130:36673: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:37.645561 14079 catalog_manager.cc:5697] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db reported cstate change: term changed from 30 to 31, leader changed from 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130) to 73d01e9b1a9d49358da4985b21d681db (127.12.174.132). New cstate: current_term: 31 leader_uuid: "73d01e9b1a9d49358da4985b21d681db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:13:37.651365 23043 consensus_queue.cc:1048] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
W20260709 12:13:37.672011 14877 consensus_peers.cc:597] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db -> Peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Couldn't send request to peer 17aab1bbf5014936aa18cc21818b26ec. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.130:36673: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:37.671937 14088 catalog_manager.cc:5697] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c reported cstate change: term changed from 22 to 23, leader changed from 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130) to 65c9c1653b3346b39a0e118540e6080c (127.12.174.131). New cstate: current_term: 23 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:13:37.673949 14877 consensus_peers.cc:597] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db -> Peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Couldn't send request to peer 17aab1bbf5014936aa18cc21818b26ec. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.130:36673: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:37.674458 14877 consensus_peers.cc:597] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db -> Peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Couldn't send request to peer 17aab1bbf5014936aa18cc21818b26ec. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.130:36673: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:37.674865 14088 catalog_manager.cc:5697] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c reported cstate change: term changed from 24 to 25, leader changed from 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130) to 65c9c1653b3346b39a0e118540e6080c (127.12.174.131). New cstate: current_term: 25 leader_uuid: "65c9c1653b3346b39a0e118540e6080c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:13:37.686707 14304 consensus_peers.cc:597] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c -> Peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Couldn't send request to peer 17aab1bbf5014936aa18cc21818b26ec. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.130:36673: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:37.704691 14304 consensus_peers.cc:597] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c -> Peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Couldn't send request to peer 17aab1bbf5014936aa18cc21818b26ec. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.130:36673: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:37.706565 14876 consensus_peers.cc:597] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:13:37.724046 14877 consensus_peers.cc:597] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db -> Peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Couldn't send request to peer 17aab1bbf5014936aa18cc21818b26ec. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.130:36673: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:37.734879 14877 consensus_peers.cc:597] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db -> Peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Couldn't send request to peer 17aab1bbf5014936aa18cc21818b26ec. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.130:36673: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:37.770653 14304 consensus_peers.cc:597] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c -> Peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Couldn't send request to peer 17aab1bbf5014936aa18cc21818b26ec. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.130:36673: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:37.783401 23016 raft_consensus.cc:493] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:13:37.784122 23016 raft_consensus.cc:515] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:13:37.785770 14877 consensus_peers.cc:597] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db -> Peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Couldn't send request to peer 17aab1bbf5014936aa18cc21818b26ec. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.130:36673: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:37.786580 23016 leader_election.cc:290] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:13:37.791297 14876 leader_election.cc:336] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111)
W20260709 12:13:37.810504 14877 leader_election.cc:336] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Network error: Client connection negotiation failed: client connection to 127.12.174.130:36673: connect: Connection refused (error 111)
I20260709 12:13:37.811033 14877 leader_election.cc:304] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:37.811856 23067 raft_consensus.cc:2749] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 12:13:37.814646 14304 consensus_peers.cc:597] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c -> Peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Couldn't send request to peer 17aab1bbf5014936aa18cc21818b26ec. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.130:36673: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:37.845253 14304 consensus_peers.cc:597] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c -> Peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Couldn't send request to peer 17aab1bbf5014936aa18cc21818b26ec. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.130:36673: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:37.903005 14303 consensus_peers.cc:597] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:13:37.940084 14906 raft_consensus.cc:1275] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 25 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 25 index: 18. (index mismatch)
I20260709 12:13:37.941617 23014 consensus_queue.cc:1048] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
W20260709 12:13:37.962935 14876 consensus_peers.cc:597] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:13:37.979744 14304 consensus_peers.cc:597] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c -> Peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Couldn't send request to peer 17aab1bbf5014936aa18cc21818b26ec. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.130:36673: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:37.992425 14304 consensus_peers.cc:597] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c -> Peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Couldn't send request to peer 17aab1bbf5014936aa18cc21818b26ec. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.130:36673: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:38.008908 14906 raft_consensus.cc:1275] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 23 FOLLOWER]: Refusing update from remote peer 65c9c1653b3346b39a0e118540e6080c: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 12:13:38.011211 23033 consensus_queue.cc:1048] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
W20260709 12:13:38.026293 14304 consensus_peers.cc:597] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c -> Peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Couldn't send request to peer 17aab1bbf5014936aa18cc21818b26ec. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.130:36673: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:38.033424 14304 consensus_peers.cc:597] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c -> Peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Couldn't send request to peer 17aab1bbf5014936aa18cc21818b26ec. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.130:36673: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:38.051357 14303 consensus_peers.cc:597] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:13:38.058574 14876 consensus_peers.cc:597] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:13:38.070502 14304 consensus_peers.cc:597] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c -> Peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Couldn't send request to peer 17aab1bbf5014936aa18cc21818b26ec. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.130:36673: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:38.074003 14876 consensus_peers.cc:597] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:13:38.075206 14303 consensus_peers.cc:597] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:13:38.137554 14303 consensus_peers.cc:597] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:13:38.147177 14876 consensus_peers.cc:597] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:13:38.155290 14303 consensus_peers.cc:597] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:13:38.256572 14876 consensus_peers.cc:597] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:13:38.619993 14360 debug-util.cc:398] Leaking SignalData structure 0x7b0800268760 after lost signal to thread 12989
W20260709 12:13:38.621316 14360 debug-util.cc:398] Leaking SignalData structure 0x7b0800268480 after lost signal to thread 14122
W20260709 12:13:38.622922 14360 debug-util.cc:398] Leaking SignalData structure 0x7b080040d800 after lost signal to thread 14363
W20260709 12:13:38.624364 14360 debug-util.cc:398] Leaking SignalData structure 0x7b080036d5c0 after lost signal to thread 14936
I20260709 12:13:38.796357 23026 raft_consensus.cc:493] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:13:38.826514 23061 raft_consensus.cc:493] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:13:38.827515 23061 raft_consensus.cc:515] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:38.803313 23026 raft_consensus.cc:515] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:38.831063 23061 leader_election.cc:290] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:13:38.835394 23026 leader_election.cc:290] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:13:38.856485 23080 raft_consensus.cc:493] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:13:38.857470 23080 raft_consensus.cc:515] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:38.870807 23082 raft_consensus.cc:493] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:13:38.871848 23082 raft_consensus.cc:515] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:38.874732 23082 leader_election.cc:290] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:13:38.880606 23080 leader_election.cc:290] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:13:38.883525 14304 leader_election.cc:336] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Network error: Client connection negotiation failed: client connection to 127.12.174.130:36673: connect: Connection refused (error 111)
W20260709 12:13:38.888147 14304 leader_election.cc:336] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Network error: Client connection negotiation failed: client connection to 127.12.174.130:36673: connect: Connection refused (error 111)
W20260709 12:13:38.898772 14304 leader_election.cc:336] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Network error: Client connection negotiation failed: client connection to 127.12.174.130:36673: connect: Connection refused (error 111)
W20260709 12:13:38.922093 14877 leader_election.cc:336] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Network error: Client connection negotiation failed: client connection to 127.12.174.130:36673: connect: Connection refused (error 111)
W20260709 12:13:38.956297 14876 consensus_peers.cc:597] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:13:38.977875 14876 consensus_peers.cc:597] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:13:38.980393 23026 raft_consensus.cc:493] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:13:38.981207 23082 raft_consensus.cc:493] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:13:38.983780 23026 raft_consensus.cc:515] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:38.983883 23082 raft_consensus.cc:515] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:38.991463 23026 leader_election.cc:290] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:13:38.998656 23082 leader_election.cc:290] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:13:38.997809 14304 leader_election.cc:336] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Network error: Client connection negotiation failed: client connection to 127.12.174.130:36673: connect: Connection refused (error 111)
W20260709 12:13:39.012665 14304 leader_election.cc:336] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Network error: Client connection negotiation failed: client connection to 127.12.174.130:36673: connect: Connection refused (error 111)
W20260709 12:13:39.019697 14876 leader_election.cc:336] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111)
I20260709 12:13:39.020498 14876 leader_election.cc:304] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:39.021634 23067 raft_consensus.cc:2749] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:13:39.031517 23082 raft_consensus.cc:493] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:13:39.031697 23067 raft_consensus.cc:493] T afdbef67ffe54739bdccc3b631f66c89 P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:13:39.032555 23082 raft_consensus.cc:515] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:39.032892 23067 raft_consensus.cc:515] T afdbef67ffe54739bdccc3b631f66c89 P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:39.035964 23082 leader_election.cc:290] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:13:39.037432 23067 leader_election.cc:290] T afdbef67ffe54739bdccc3b631f66c89 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:39.042271 14332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdbef67ffe54739bdccc3b631f66c89" candidate_uuid: "73d01e9b1a9d49358da4985b21d681db" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "65c9c1653b3346b39a0e118540e6080c" is_pre_election: true
I20260709 12:13:39.043598 14332 raft_consensus.cc:2468] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d01e9b1a9d49358da4985b21d681db in term 22.
W20260709 12:13:39.045301 14304 leader_election.cc:336] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Network error: Client connection negotiation failed: client connection to 127.12.174.130:36673: connect: Connection refused (error 111)
W20260709 12:13:39.045846 14877 leader_election.cc:336] T afdbef67ffe54739bdccc3b631f66c89 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Network error: Client connection negotiation failed: client connection to 127.12.174.130:36673: connect: Connection refused (error 111)
I20260709 12:13:39.052572 23067 raft_consensus.cc:493] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:13:39.053608 23067 raft_consensus.cc:515] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:39.057189 23067 leader_election.cc:290] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:13:39.060791 14876 leader_election.cc:336] T afdbef67ffe54739bdccc3b631f66c89 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111)
I20260709 12:13:39.061702 23026 raft_consensus.cc:493] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
W20260709 12:13:39.063825 14877 leader_election.cc:336] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Network error: Client connection negotiation failed: client connection to 127.12.174.130:36673: connect: Connection refused (error 111)
I20260709 12:13:39.069119 23026 raft_consensus.cc:515] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:39.071848 23026 leader_election.cc:290] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
I20260709 12:13:39.072782 14876 leader_election.cc:304] T afdbef67ffe54739bdccc3b631f66c89 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c, 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:39.079981 23080 raft_consensus.cc:2749] T afdbef67ffe54739bdccc3b631f66c89 P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 12:13:39.092325 14304 leader_election.cc:336] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Network error: Client connection negotiation failed: client connection to 127.12.174.130:36673: connect: Connection refused (error 111)
W20260709 12:13:39.111677 14876 leader_election.cc:336] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111)
I20260709 12:13:39.112317 14876 leader_election.cc:304] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:39.131107 23067 raft_consensus.cc:2749] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:39.178946 23026 raft_consensus.cc:493] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 32 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:13:39.179765 23026 raft_consensus.cc:515] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 32 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:39.183749 23026 leader_election.cc:290] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:13:39.192956 14303 consensus_peers.cc:597] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:13:39.203274 14303 consensus_peers.cc:597] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:13:39.210070 14303 consensus_peers.cc:597] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:13:39.211607 14303 consensus_peers.cc:597] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:13:39.216912 14303 consensus_peers.cc:597] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:13:39.218438 14303 consensus_peers.cc:597] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:13:39.217597 14304 leader_election.cc:336] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 33 pre-election: RPC error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Network error: Client connection negotiation failed: client connection to 127.12.174.130:36673: connect: Connection refused (error 111)
W20260709 12:13:39.243579 14303 leader_election.cc:336] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111)
I20260709 12:13:39.244246 14303 leader_election.cc:304] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:39.247249 23026 raft_consensus.cc:2749] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:13:39.248508 14303 consensus_peers.cc:597] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:13:39.249104 14303 leader_election.cc:336] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111)
I20260709 12:13:39.249572 14303 leader_election.cc:304] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:39.251648 23026 raft_consensus.cc:2749] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:13:39.252880 23026 raft_consensus.cc:493] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:13:39.253593 23026 raft_consensus.cc:515] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:39.256314 23026 leader_election.cc:290] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:13:39.257447 14303 consensus_peers.cc:597] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:13:39.262573 14303 leader_election.cc:336] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111)
I20260709 12:13:39.266178 14303 leader_election.cc:304] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:39.267786 23026 raft_consensus.cc:2749] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:13:39.291503 14304 leader_election.cc:336] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Network error: Client connection negotiation failed: client connection to 127.12.174.130:36673: connect: Connection refused (error 111)
I20260709 12:13:39.308594 23026 raft_consensus.cc:493] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:13:39.309393 23026 raft_consensus.cc:515] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } }
I20260709 12:13:39.311877 23026 leader_election.cc:290] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:13:39.332691 14304 leader_election.cc:336] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Network error: Client connection negotiation failed: client connection to 127.12.174.130:36673: connect: Connection refused (error 111)
W20260709 12:13:39.359081 14303 leader_election.cc:336] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111)
I20260709 12:13:39.360260 14303 leader_election.cc:304] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:39.362352 23061 raft_consensus.cc:2749] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 12:13:39.367849 14303 leader_election.cc:336] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111)
I20260709 12:13:39.368827 14303 leader_election.cc:304] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:39.369724 23061 raft_consensus.cc:2749] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 12:13:39.377779 14303 leader_election.cc:336] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111)
I20260709 12:13:39.378376 14303 leader_election.cc:304] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:39.379204 23061 raft_consensus.cc:2749] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 12:13:39.380300 14303 leader_election.cc:336] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111)
I20260709 12:13:39.380896 14303 leader_election.cc:304] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:39.381753 23061 raft_consensus.cc:2749] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 12:13:39.404421 14303 leader_election.cc:336] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 33 pre-election: RPC error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111)
I20260709 12:13:39.405098 14303 leader_election.cc:304] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:39.405985 23061 raft_consensus.cc:2749] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 32 FOLLOWER]: Leader pre-election lost for term 33. Reason: could not achieve majority
W20260709 12:13:39.407557 14303 consensus_peers.cc:597] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:13:39.408183 14303 leader_election.cc:336] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111)
I20260709 12:13:39.408634 14303 leader_election.cc:304] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:39.409511 23061 raft_consensus.cc:2749] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 12:13:39.421321 14303 leader_election.cc:336] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111)
I20260709 12:13:39.421986 14303 leader_election.cc:304] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65c9c1653b3346b39a0e118540e6080c; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:39.422824 23061 raft_consensus.cc:2749] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 12:13:39.424100 14303 consensus_peers.cc:597] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:13:39.424693 14303 consensus_peers.cc:597] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:13:39.561852 14876 consensus_peers.cc:597] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:13:39.564950 14876 consensus_peers.cc:597] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:13:39.578847 14304 consensus_peers.cc:597] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c -> Peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Couldn't send request to peer 17aab1bbf5014936aa18cc21818b26ec. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.130:36673: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:39.622622 14876 consensus_peers.cc:597] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:13:39.654995 14933 debug-util.cc:398] Leaking SignalData structure 0x7b08002dcb20 after lost signal to thread 12989
W20260709 12:13:39.656939 14933 debug-util.cc:398] Leaking SignalData structure 0x7b08002a2d20 after lost signal to thread 14122
W20260709 12:13:39.659065 14933 debug-util.cc:398] Leaking SignalData structure 0x7b0800327a00 after lost signal to thread 14363
W20260709 12:13:39.662196 14933 debug-util.cc:398] Leaking SignalData structure 0x7b08002dc4e0 after lost signal to thread 14936
W20260709 12:13:39.666402 14876 consensus_peers.cc:597] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:13:39.662844 14933 debug-util.cc:398] Leaking SignalData structure 0x7b08002dc360 after lost signal to thread 23046
W20260709 12:13:39.759490 14877 consensus_peers.cc:597] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db -> Peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Couldn't send request to peer 17aab1bbf5014936aa18cc21818b26ec. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.130:36673: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:39.793269 14877 consensus_peers.cc:597] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db -> Peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Couldn't send request to peer 17aab1bbf5014936aa18cc21818b26ec. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.130:36673: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:39.794339 14304 consensus_peers.cc:597] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c -> Peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Couldn't send request to peer 17aab1bbf5014936aa18cc21818b26ec. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.130:36673: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:13:39.809054 12986 tablet_server.cc:196] TabletServer@127.12.174.130:0 shutdown complete.
W20260709 12:13:39.873028 14303 consensus_peers.cc:597] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:13:39.877543 14303 consensus_peers.cc:597] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:13:39.927168 23074 raft_consensus.cc:493] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:13:39.927939 23074 raft_consensus.cc:515] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:13:39.937536 14877 consensus_peers.cc:597] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db -> Peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Couldn't send request to peer 17aab1bbf5014936aa18cc21818b26ec. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.130:36673: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:13:39.940387 23074 leader_election.cc:290] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:13:39.950076 14876 leader_election.cc:336] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111)
W20260709 12:13:39.972653 14877 leader_election.cc:336] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Network error: Client connection negotiation failed: client connection to 127.12.174.130:36673: connect: Connection refused (error 111)
I20260709 12:13:39.974170 14877 leader_election.cc:304] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:39.975181 23074 raft_consensus.cc:2749] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 12:13:40.038053 14304 consensus_peers.cc:597] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c -> Peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Couldn't send request to peer 17aab1bbf5014936aa18cc21818b26ec. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.130:36673: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:40.062512 14877 consensus_peers.cc:597] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db -> Peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Couldn't send request to peer 17aab1bbf5014936aa18cc21818b26ec. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.130:36673: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:40.073392 14304 consensus_peers.cc:597] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c -> Peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Couldn't send request to peer 17aab1bbf5014936aa18cc21818b26ec. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.130:36673: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:40.094010 14304 consensus_peers.cc:597] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c -> Peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Couldn't send request to peer 17aab1bbf5014936aa18cc21818b26ec. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.130:36673: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:40.120994 14304 consensus_peers.cc:597] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c -> Peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Couldn't send request to peer 17aab1bbf5014936aa18cc21818b26ec. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.130:36673: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:40.127748 14877 consensus_peers.cc:597] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db -> Peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Couldn't send request to peer 17aab1bbf5014936aa18cc21818b26ec. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.130:36673: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:40.128839 14876 consensus_peers.cc:597] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:13:40.142099 14304 consensus_peers.cc:597] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c -> Peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Couldn't send request to peer 17aab1bbf5014936aa18cc21818b26ec. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.130:36673: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:40.168613 14877 consensus_peers.cc:597] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db -> Peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Couldn't send request to peer 17aab1bbf5014936aa18cc21818b26ec. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.130:36673: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:40.169953 14304 consensus_peers.cc:597] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c -> Peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Couldn't send request to peer 17aab1bbf5014936aa18cc21818b26ec. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.130:36673: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:40.184932 14304 consensus_peers.cc:597] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c -> Peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Couldn't send request to peer 17aab1bbf5014936aa18cc21818b26ec. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.130:36673: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:40.198964 14876 consensus_peers.cc:597] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:13:40.211130 14877 consensus_peers.cc:597] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db -> Peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Couldn't send request to peer 17aab1bbf5014936aa18cc21818b26ec. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.130:36673: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:40.221374 14876 consensus_peers.cc:597] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:13:40.234262 14877 consensus_peers.cc:597] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db -> Peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Couldn't send request to peer 17aab1bbf5014936aa18cc21818b26ec. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.130:36673: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:40.330648 14877 consensus_peers.cc:597] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db -> Peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Couldn't send request to peer 17aab1bbf5014936aa18cc21818b26ec. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.130:36673: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:13:40.341310 12986 tablet_server.cc:179] TabletServer@127.12.174.131:0 shutting down...
W20260709 12:13:40.360975 14877 consensus_peers.cc:597] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db -> Peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957): Couldn't send request to peer 65c9c1653b3346b39a0e118540e6080c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:40.369414 14877 consensus_peers.cc:597] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db -> Peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957): Couldn't send request to peer 65c9c1653b3346b39a0e118540e6080c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:40.373446 14877 consensus_peers.cc:597] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db -> Peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957): Couldn't send request to peer 65c9c1653b3346b39a0e118540e6080c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:40.389228 14877 consensus_peers.cc:597] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db -> Peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957): Couldn't send request to peer 65c9c1653b3346b39a0e118540e6080c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:40.409178 14877 consensus_peers.cc:597] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db -> Peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Couldn't send request to peer 17aab1bbf5014936aa18cc21818b26ec. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.130:36673: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:40.441534 14303 consensus_peers.cc:597] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:13:40.501013 12986 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:13:40.504185 12986 tablet_replica.cc:333] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c: stopping tablet replica
I20260709 12:13:40.505342 12986 raft_consensus.cc:2243] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:40.506247 12986 raft_consensus.cc:2272] T 7c8882b1b37d4e84a94a2e1e321a8755 P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:40.510365 12986 tablet_replica.cc:333] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c: stopping tablet replica
I20260709 12:13:40.518229 12986 raft_consensus.cc:2243] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:40.523372 12986 raft_consensus.cc:2272] T fc8bff37f52742a3a3b8a39c45ade183 P 65c9c1653b3346b39a0e118540e6080c [term 26 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:40.537621 14877 consensus_peers.cc:597] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db -> Peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957): Couldn't send request to peer 65c9c1653b3346b39a0e118540e6080c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:40.557726 14303 consensus_peers.cc:597] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:13:40.562407 14877 consensus_peers.cc:597] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db -> Peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957): Couldn't send request to peer 65c9c1653b3346b39a0e118540e6080c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:40.564217 12986 tablet_replica.cc:333] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c: stopping tablet replica
I20260709 12:13:40.566803 12986 raft_consensus.cc:2243] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:40.574646 12986 raft_consensus.cc:2272] T f4739bc22bfe44fcba807da02d9351b6 P 65c9c1653b3346b39a0e118540e6080c [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:40.581528 12986 tablet_replica.cc:333] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c: stopping tablet replica
I20260709 12:13:40.582319 12986 raft_consensus.cc:2243] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:40.583491 12986 raft_consensus.cc:2272] T 02513fb0dbdd4cbdb019d79f0f448d18 P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:40.586537 12986 tablet_replica.cc:333] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c: stopping tablet replica
I20260709 12:13:40.587313 12986 raft_consensus.cc:2243] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 25 LEADER]: Raft consensus shutting down.
I20260709 12:13:40.588450 12986 raft_consensus.cc:2272] T cbe93a4954a24795882e04fa537ddf4d P 65c9c1653b3346b39a0e118540e6080c [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:40.615828 12986 tablet_replica.cc:333] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c: stopping tablet replica
I20260709 12:13:40.621516 12986 raft_consensus.cc:2243] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 23 LEADER]: Raft consensus shutting down.
I20260709 12:13:40.626942 12986 raft_consensus.cc:2272] T e5c1eed5e91b4c908f1f9ebf315fbc6f P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:40.630299 12986 tablet_replica.cc:333] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c: stopping tablet replica
I20260709 12:13:40.640378 12986 raft_consensus.cc:2243] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:40.641278 12986 raft_consensus.cc:2272] T 2b1a5d42755443119571654ad5c5f2f3 P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:40.652020 14877 consensus_peers.cc:597] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db -> Peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957): Couldn't send request to peer 65c9c1653b3346b39a0e118540e6080c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:40.653309 12986 tablet_replica.cc:333] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c: stopping tablet replica
I20260709 12:13:40.654798 12986 raft_consensus.cc:2243] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 22 LEADER]: Raft consensus shutting down.
W20260709 12:13:40.659720 14877 consensus_peers.cc:597] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db -> Peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957): Couldn't send request to peer 65c9c1653b3346b39a0e118540e6080c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:40.669626 14877 consensus_peers.cc:597] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db -> Peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957): Couldn't send request to peer 65c9c1653b3346b39a0e118540e6080c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:40.671173 12986 raft_consensus.cc:2272] T e0c03baacf444c019b39ae64998e2686 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:40.692972 14877 consensus_peers.cc:597] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db -> Peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957): Couldn't send request to peer 65c9c1653b3346b39a0e118540e6080c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:40.693342 23074 raft_consensus.cc:493] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:13:40.695572 23074 raft_consensus.cc:515] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:13:40.698050 14876 consensus_peers.cc:597] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:13:40.698580 23074 leader_election.cc:290] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:13:40.709022 14877 leader_election.cc:336] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Network error: Client connection negotiation failed: client connection to 127.12.174.130:36673: connect: Connection refused (error 111)
W20260709 12:13:40.710620 14876 leader_election.cc:336] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111)
I20260709 12:13:40.711278 14876 leader_election.cc:304] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:40.712101 23074 raft_consensus.cc:2749] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:13:40.713981 12986 tablet_replica.cc:333] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c: stopping tablet replica
I20260709 12:13:40.723086 12986 raft_consensus.cc:2243] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:40.726456 12986 raft_consensus.cc:2272] T 0041f9f2b90844269c31eba4aeeab0a7 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:40.727535 14877 consensus_peers.cc:597] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db -> Peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957): Couldn't send request to peer 65c9c1653b3346b39a0e118540e6080c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:40.730144 12986 tablet_replica.cc:333] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c: stopping tablet replica
I20260709 12:13:40.731318 12986 raft_consensus.cc:2243] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 22 LEADER]: Raft consensus shutting down.
I20260709 12:13:40.738474 12986 raft_consensus.cc:2272] T b4a0f56d071c4634842ea1584dfe40e6 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:40.742125 12986 tablet_replica.cc:333] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c: stopping tablet replica
W20260709 12:13:40.757161 14303 consensus_peers.cc:597] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:13:40.763991 12986 raft_consensus.cc:2243] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 28 LEADER]: Raft consensus shutting down.
I20260709 12:13:40.766531 12986 raft_consensus.cc:2272] T f1a4a5f0a8324f479c5e1f499164bf42 P 65c9c1653b3346b39a0e118540e6080c [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:40.770521 12986 tablet_replica.cc:333] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c: stopping tablet replica
I20260709 12:13:40.772020 12986 raft_consensus.cc:2243] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 23 LEADER]: Raft consensus shutting down.
I20260709 12:13:40.773351 12986 raft_consensus.cc:2272] T ff1f0497acbe4a31944b5bac60c5482c P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:40.779026 12986 tablet_replica.cc:333] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c: stopping tablet replica
W20260709 12:13:40.781572 14303 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:40.794183 14876 consensus_peers.cc:597] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:13:40.804764 12986 raft_consensus.cc:2243] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:40.830087 12986 raft_consensus.cc:2272] T c022caf6920747708b0cfc607c962951 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:40.843654 14876 consensus_peers.cc:597] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:13:40.846679 12986 tablet_replica.cc:333] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c: stopping tablet replica
I20260709 12:13:40.848086 12986 raft_consensus.cc:2243] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 26 LEADER]: Raft consensus shutting down.
I20260709 12:13:40.849645 12986 raft_consensus.cc:2272] T e1947202e59d4516a1b38a1583a3242d P 65c9c1653b3346b39a0e118540e6080c [term 26 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:40.860230 14876 consensus_peers.cc:597] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:13:40.857470 14877 consensus_peers.cc:597] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db -> Peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957): Couldn't send request to peer 65c9c1653b3346b39a0e118540e6080c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:40.865298 12986 tablet_replica.cc:333] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c: stopping tablet replica
I20260709 12:13:40.873446 12986 raft_consensus.cc:2243] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:40.884963 12986 raft_consensus.cc:2272] T fb01374e8ef4493d909377b2b9179e39 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:40.888741 12986 tablet_replica.cc:333] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c: stopping tablet replica
I20260709 12:13:40.889694 12986 raft_consensus.cc:2243] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 26 LEADER]: Raft consensus shutting down.
I20260709 12:13:40.898425 12986 raft_consensus.cc:2272] T e85036847fc14bab8d6b10e9cbee3aca P 65c9c1653b3346b39a0e118540e6080c [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:40.901818 12986 tablet_replica.cc:333] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c: stopping tablet replica
I20260709 12:13:40.902789 12986 raft_consensus.cc:2243] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 29 LEADER]: Raft consensus shutting down.
I20260709 12:13:40.907203 12986 raft_consensus.cc:2272] T 981a078d2d9d479abecc8b0b45771080 P 65c9c1653b3346b39a0e118540e6080c [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:40.914383 12986 tablet_replica.cc:333] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c: stopping tablet replica
I20260709 12:13:40.915364 12986 raft_consensus.cc:2243] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:40.916716 12986 raft_consensus.cc:2272] T afdbef67ffe54739bdccc3b631f66c89 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:40.928951 12986 tablet_replica.cc:333] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c: stopping tablet replica
I20260709 12:13:40.930187 12986 raft_consensus.cc:2243] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:40.931294 12986 raft_consensus.cc:2272] T 88b5f4f19c2a4585b93b312cc1f3d17f P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:40.934252 12986 tablet_replica.cc:333] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c: stopping tablet replica
I20260709 12:13:40.938036 12986 raft_consensus.cc:2243] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 23 LEADER]: Raft consensus shutting down.
I20260709 12:13:40.939668 12986 raft_consensus.cc:2272] T 8efcd0417f0c412280654006e6389763 P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:40.944299 12986 tablet_replica.cc:333] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c: stopping tablet replica
I20260709 12:13:40.949402 12986 raft_consensus.cc:2243] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:40.950596 12986 raft_consensus.cc:2272] T fd6a20fc287b48fbb5cbf25078173b21 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:40.959280 12986 tablet_replica.cc:333] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c: stopping tablet replica
I20260709 12:13:40.960374 12986 raft_consensus.cc:2243] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 23 LEADER]: Raft consensus shutting down.
I20260709 12:13:40.966773 12986 raft_consensus.cc:2272] T 6de6b0d9885648e6b2f6822eb9f85021 P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:40.970465 12986 tablet_replica.cc:333] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c: stopping tablet replica
W20260709 12:13:40.973971 14305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:40.973551 12986 raft_consensus.cc:2243] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 28 LEADER]: Raft consensus shutting down.
I20260709 12:13:40.975672 12986 raft_consensus.cc:2272] T 57e5f03a80374104a130f5b0e70a0280 P 65c9c1653b3346b39a0e118540e6080c [term 28 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:40.976219 14303 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:40.985234 12986 tablet_replica.cc:333] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c: stopping tablet replica
I20260709 12:13:40.997115 12986 raft_consensus.cc:2243] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 23 LEADER]: Raft consensus shutting down.
I20260709 12:13:40.998507 12986 raft_consensus.cc:2272] T b317dbf6b7fd4860be0fa436e8b54807 P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:41.001564 12986 tablet_replica.cc:333] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c: stopping tablet replica
I20260709 12:13:41.002511 12986 raft_consensus.cc:2243] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 32 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:41.003589 12986 raft_consensus.cc:2272] T 5879727b381a48b18b1949c96428b5d0 P 65c9c1653b3346b39a0e118540e6080c [term 32 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:41.006705 12986 tablet_replica.cc:333] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c: stopping tablet replica
W20260709 12:13:41.013024 14304 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:41.016985 12986 raft_consensus.cc:2243] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 28 LEADER]: Raft consensus shutting down.
I20260709 12:13:41.018575 12986 raft_consensus.cc:2272] T 0d203245740a4821b7ebcc7669c8b2af P 65c9c1653b3346b39a0e118540e6080c [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:41.022107 12986 tablet_replica.cc:333] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c: stopping tablet replica
I20260709 12:13:41.023026 12986 raft_consensus.cc:2243] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 23 LEADER]: Raft consensus shutting down.
I20260709 12:13:41.024756 12986 raft_consensus.cc:2272] T 1dfd3f2bd71343f789aa5733a23d4b8d P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:41.028579 12986 tablet_replica.cc:333] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c: stopping tablet replica
I20260709 12:13:41.032333 12986 raft_consensus.cc:2243] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 25 LEADER]: Raft consensus shutting down.
I20260709 12:13:41.034740 12986 raft_consensus.cc:2272] T d82ca0c0e51a4e148b8d3e226ff7cebb P 65c9c1653b3346b39a0e118540e6080c [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:41.040228 12986 tablet_replica.cc:333] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c: stopping tablet replica
W20260709 12:13:41.040689 14876 consensus_peers.cc:597] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:13:41.047554 12986 raft_consensus.cc:2243] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:13:41.048831 12986 raft_consensus.cc:2272] T f9f69e925a8f4da7ba2b318edae7b194 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:41.052175 12986 tablet_replica.cc:333] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c: stopping tablet replica
I20260709 12:13:41.057999 12986 raft_consensus.cc:2243] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:41.058753 12986 raft_consensus.cc:2272] T 60aca7b73a544dfc9a4bd6918b27d132 P 65c9c1653b3346b39a0e118540e6080c [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:41.059599 14305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:41.064541 14302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:41.071671 12986 tablet_replica.cc:333] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c: stopping tablet replica
I20260709 12:13:41.072609 12986 raft_consensus.cc:2243] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:13:41.074196 12986 raft_consensus.cc:2272] T 90097151efa7426faeaea3ff87a7ea78 P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:41.075963 14303 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:41.077159 12986 tablet_replica.cc:333] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c: stopping tablet replica
W20260709 12:13:41.112152 14304 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:41.116499 14303 consensus_peers.cc:597] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:13:41.193416 12986 raft_consensus.cc:2243] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 22 LEADER]: Raft consensus shutting down.
W20260709 12:13:41.234880 14303 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:37187, user_credentials={real_user=slave}} blocked reactor thread for 118446us
W20260709 12:13:41.235977 14303 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:41.236099 12986 raft_consensus.cc:2272] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 65c9c1653b3346b39a0e118540e6080c [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:41.241168 12986 tablet_replica.cc:333] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c: stopping tablet replica
I20260709 12:13:41.242611 12986 raft_consensus.cc:2243] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:41.245579 12986 raft_consensus.cc:2272] T 3832505489c04d04a69e256187061921 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:41.249454 12986 tablet_replica.cc:333] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c: stopping tablet replica
I20260709 12:13:41.251624 12986 raft_consensus.cc:2243] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 23 LEADER]: Raft consensus shutting down.
I20260709 12:13:41.253360 12986 raft_consensus.cc:2272] T 53f6ce2ae2d8465cb314a84096322886 P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:41.258512 12986 tablet_replica.cc:333] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c: stopping tablet replica
W20260709 12:13:41.258965 14302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:41.263060 14302 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:41.259769 14305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:41.263809 14305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:41.264227 14305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:41.265379 12986 raft_consensus.cc:2243] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 28 LEADER]: Raft consensus shutting down.
I20260709 12:13:41.266716 12986 raft_consensus.cc:2272] T f548bfe8d3c540e487760b5966d0e7f8 P 65c9c1653b3346b39a0e118540e6080c [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:41.269975 12986 tablet_replica.cc:333] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c: stopping tablet replica
I20260709 12:13:41.270920 12986 raft_consensus.cc:2243] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:41.272486 12986 raft_consensus.cc:2272] T e9b3f8ef40054811944ba9bd9ed74eb3 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:41.275710 12986 tablet_replica.cc:333] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c: stopping tablet replica
I20260709 12:13:41.276611 12986 raft_consensus.cc:2243] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:13:41.278456 12986 raft_consensus.cc:2272] T 938efad339fd47e1b0b6d37fbc612db2 P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:41.282087 12986 tablet_replica.cc:333] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c: stopping tablet replica
I20260709 12:13:41.283011 12986 raft_consensus.cc:2243] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:13:41.284291 12986 raft_consensus.cc:2272] T 35b39d0f3270452a8bd4f4b1800a837c P 65c9c1653b3346b39a0e118540e6080c [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:41.288323 12986 tablet_replica.cc:333] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c: stopping tablet replica
I20260709 12:13:41.289302 12986 raft_consensus.cc:2243] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 28 LEADER]: Raft consensus shutting down.
I20260709 12:13:41.290668 12986 raft_consensus.cc:2272] T ae82f0f3bcac4608987cd7c935c9799b P 65c9c1653b3346b39a0e118540e6080c [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:41.293773 12986 tablet_replica.cc:333] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c: stopping tablet replica
I20260709 12:13:41.294672 12986 raft_consensus.cc:2243] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:41.295751 12986 raft_consensus.cc:2272] T 3c9d740fa53e42179ad8d244b4c179fd P 65c9c1653b3346b39a0e118540e6080c [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:41.298750 12986 tablet_replica.cc:333] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c: stopping tablet replica
I20260709 12:13:41.299642 12986 raft_consensus.cc:2243] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:41.300683 12986 raft_consensus.cc:2272] T 5485933837894417a3f0f89d55af1296 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:41.303934 12986 tablet_replica.cc:333] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c: stopping tablet replica
I20260709 12:13:41.304855 12986 raft_consensus.cc:2243] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 28 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:41.305625 12986 raft_consensus.cc:2272] T 89bb37b32a7f408b9730abb56b9cfa05 P 65c9c1653b3346b39a0e118540e6080c [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:41.308914 12986 tablet_replica.cc:333] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c: stopping tablet replica
I20260709 12:13:41.309813 12986 raft_consensus.cc:2243] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:41.310832 12986 raft_consensus.cc:2272] T bd5274ac33c2483681726f6b8eccdc6c P 65c9c1653b3346b39a0e118540e6080c [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:41.313835 12986 tablet_replica.cc:333] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c: stopping tablet replica
I20260709 12:13:41.314692 12986 raft_consensus.cc:2243] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 30 LEADER]: Raft consensus shutting down.
I20260709 12:13:41.315925 12986 raft_consensus.cc:2272] T e9b8048bcdf74441aac2cd21ac7af4da P 65c9c1653b3346b39a0e118540e6080c [term 30 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:41.318858 12986 tablet_replica.cc:333] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c: stopping tablet replica
I20260709 12:13:41.319706 12986 raft_consensus.cc:2243] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:41.320480 12986 raft_consensus.cc:2272] T ba1914a8ae9f4959971f147e578773fc P 65c9c1653b3346b39a0e118540e6080c [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:41.323508 12986 tablet_replica.cc:333] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c: stopping tablet replica
I20260709 12:13:41.324352 12986 raft_consensus.cc:2243] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 25 LEADER]: Raft consensus shutting down.
I20260709 12:13:41.325662 12986 raft_consensus.cc:2272] T 8d9964631a6940e4b111e1b1dabb0aae P 65c9c1653b3346b39a0e118540e6080c [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:41.328872 12986 tablet_replica.cc:333] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c: stopping tablet replica
I20260709 12:13:41.330071 12986 raft_consensus.cc:2243] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 23 LEADER]: Raft consensus shutting down.
I20260709 12:13:41.331650 12986 raft_consensus.cc:2272] T cd9d6c9c152f47769123b7748d8c8262 P 65c9c1653b3346b39a0e118540e6080c [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:41.335054 12986 tablet_replica.cc:333] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c: stopping tablet replica
I20260709 12:13:41.335909 12986 raft_consensus.cc:2243] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:41.336951 12986 raft_consensus.cc:2272] T 36091607df2f46059df62d677842a031 P 65c9c1653b3346b39a0e118540e6080c [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:41.340029 12986 tablet_replica.cc:333] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c: stopping tablet replica
I20260709 12:13:41.341109 12986 raft_consensus.cc:2243] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:41.344340 12986 raft_consensus.cc:2272] T 1eb6edfa93424aa68a4239fd27a62064 P 65c9c1653b3346b39a0e118540e6080c [term 24 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:41.347829 14305 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:41.348996 12986 tablet_replica.cc:333] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c: stopping tablet replica
I20260709 12:13:41.349879 12986 raft_consensus.cc:2243] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 31 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:41.350911 12986 raft_consensus.cc:2272] T 55a08950f57748dea047f3190b2c0e95 P 65c9c1653b3346b39a0e118540e6080c [term 31 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:41.358727 14304 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:41.359329 14304 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:41.359638 14304 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:41.386592 14303 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:41.393879 14303 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:13:41.405853 14876 consensus_peers.cc:597] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:13:41.472388 14876 consensus_peers.cc:597] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:13:41.560382 23090 raft_consensus.cc:493] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:13:41.561065 23090 raft_consensus.cc:515] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:41.563534 23090 leader_election.cc:290] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673)
W20260709 12:13:41.569989 14876 leader_election.cc:336] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111)
W20260709 12:13:41.571260 14877 leader_election.cc:336] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Network error: Client connection negotiation failed: client connection to 127.12.174.130:36673: connect: Connection refused (error 111)
I20260709 12:13:41.571723 14877 leader_election.cc:304] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:41.572546 23090 raft_consensus.cc:2749] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:13:41.670897 23090 raft_consensus.cc:493] T afdbef67ffe54739bdccc3b631f66c89 P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 17aab1bbf5014936aa18cc21818b26ec)
I20260709 12:13:41.671597 23090 raft_consensus.cc:515] T afdbef67ffe54739bdccc3b631f66c89 P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
W20260709 12:13:41.681612 14876 leader_election.cc:336] T afdbef67ffe54739bdccc3b631f66c89 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111)
I20260709 12:13:41.683153 23090 leader_election.cc:290] T afdbef67ffe54739bdccc3b631f66c89 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:13:41.694537 14877 leader_election.cc:336] T afdbef67ffe54739bdccc3b631f66c89 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Network error: Client connection negotiation failed: client connection to 127.12.174.130:36673: connect: Connection refused (error 111)
I20260709 12:13:41.695164 14877 leader_election.cc:304] T afdbef67ffe54739bdccc3b631f66c89 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:41.696034 23090 raft_consensus.cc:2749] T afdbef67ffe54739bdccc3b631f66c89 P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 12:13:41.697052 14877 leader_election.cc:336] T afdbef67ffe54739bdccc3b631f66c89 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957): Network error: Client connection negotiation failed: client connection to 127.12.174.131:45957: connect: Connection refused (error 111)
I20260709 12:13:41.733114 23090 raft_consensus.cc:493] T cbe93a4954a24795882e04fa537ddf4d P 73d01e9b1a9d49358da4985b21d681db [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:13:41.736629 23090 raft_consensus.cc:515] T cbe93a4954a24795882e04fa537ddf4d P 73d01e9b1a9d49358da4985b21d681db [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:41.743646 23090 leader_election.cc:290] T cbe93a4954a24795882e04fa537ddf4d P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:13:41.756786 14877 leader_election.cc:336] T cbe93a4954a24795882e04fa537ddf4d P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957): Network error: Client connection negotiation failed: client connection to 127.12.174.131:45957: connect: Connection refused (error 111)
W20260709 12:13:41.757699 14877 leader_election.cc:336] T cbe93a4954a24795882e04fa537ddf4d P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Network error: Client connection negotiation failed: client connection to 127.12.174.130:36673: connect: Connection refused (error 111)
I20260709 12:13:41.758306 14877 leader_election.cc:304] T cbe93a4954a24795882e04fa537ddf4d P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:13:41.759178 23090 raft_consensus.cc:2749] T cbe93a4954a24795882e04fa537ddf4d P 73d01e9b1a9d49358da4985b21d681db [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 12:13:41.982228 14876 consensus_peers.cc:597] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:13:42.000728 14877 consensus_peers.cc:597] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db -> Peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Couldn't send request to peer 17aab1bbf5014936aa18cc21818b26ec. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.130:36673: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:42.010641 14876 consensus_peers.cc:597] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:13:42.064298 14876 consensus_peers.cc:597] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:13:42.075986 23091 raft_consensus.cc:493] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:13:42.080083 23091 raft_consensus.cc:515] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:42.082665 23091 leader_election.cc:290] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:13:42.089715 14877 leader_election.cc:336] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957): Network error: Client connection negotiation failed: client connection to 127.12.174.131:45957: connect: Connection refused (error 111)
W20260709 12:13:42.092553 14877 leader_election.cc:336] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Network error: Client connection negotiation failed: client connection to 127.12.174.130:36673: connect: Connection refused (error 111)
I20260709 12:13:42.093091 14877 leader_election.cc:304] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:13:42.094424 23091 raft_consensus.cc:2749] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:13:42.111083 23091 raft_consensus.cc:493] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:13:42.111810 23091 raft_consensus.cc:515] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:42.115401 23090 raft_consensus.cc:493] T 8efcd0417f0c412280654006e6389763 P 73d01e9b1a9d49358da4985b21d681db [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:13:42.116102 23090 raft_consensus.cc:515] T 8efcd0417f0c412280654006e6389763 P 73d01e9b1a9d49358da4985b21d681db [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } attrs { replace: true } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:42.120277 23090 leader_election.cc:290] T 8efcd0417f0c412280654006e6389763 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:13:42.123562 14876 leader_election.cc:336] T 8efcd0417f0c412280654006e6389763 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111)
I20260709 12:13:42.124720 23091 leader_election.cc:290] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:13:42.137019 14877 leader_election.cc:336] T 8efcd0417f0c412280654006e6389763 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Network error: Client connection negotiation failed: client connection to 127.12.174.130:36673: connect: Connection refused (error 111)
I20260709 12:13:42.137631 14877 leader_election.cc:304] T 8efcd0417f0c412280654006e6389763 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:42.138551 23091 raft_consensus.cc:2749] T 8efcd0417f0c412280654006e6389763 P 73d01e9b1a9d49358da4985b21d681db [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 12:13:42.139567 14877 leader_election.cc:336] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Network error: Client connection negotiation failed: client connection to 127.12.174.130:36673: connect: Connection refused (error 111)
W20260709 12:13:42.140355 14877 leader_election.cc:336] T 8efcd0417f0c412280654006e6389763 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957): Network error: Client connection negotiation failed: client connection to 127.12.174.131:45957: connect: Connection refused (error 111)
W20260709 12:13:42.141261 14877 leader_election.cc:336] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957): Network error: Client connection negotiation failed: client connection to 127.12.174.131:45957: connect: Connection refused (error 111)
I20260709 12:13:42.141798 14877 leader_election.cc:304] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:13:42.142633 23091 raft_consensus.cc:2749] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 12:13:42.143126 14119 debug-util.cc:398] Leaking SignalData structure 0x7b080000b6c0 after lost signal to thread 12989
W20260709 12:13:42.144443 14119 debug-util.cc:398] Leaking SignalData structure 0x7b0800377000 after lost signal to thread 14122
W20260709 12:13:42.145130 14119 debug-util.cc:398] Leaking SignalData structure 0x7b08003f96c0 after lost signal to thread 14363
W20260709 12:13:42.146545 14119 debug-util.cc:398] Leaking SignalData structure 0x7b0800250660 after lost signal to thread 14936
W20260709 12:13:42.173098 14877 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.174.130:36673: connect: Connection refused (error 111) [suppressed 625 similar messages]
I20260709 12:13:42.225266 23091 raft_consensus.cc:493] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:13:42.226131 23091 raft_consensus.cc:515] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:42.228494 23091 leader_election.cc:290] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:13:42.235642 14877 leader_election.cc:336] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Network error: Client connection negotiation failed: client connection to 127.12.174.130:36673: connect: Connection refused (error 111)
W20260709 12:13:42.236549 14877 leader_election.cc:336] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957): Network error: Client connection negotiation failed: client connection to 127.12.174.131:45957: connect: Connection refused (error 111)
I20260709 12:13:42.236977 14877 leader_election.cc:304] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:13:42.238266 23091 raft_consensus.cc:2749] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:13:42.260085 14877 consensus_peers.cc:597] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db -> Peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Couldn't send request to peer 17aab1bbf5014936aa18cc21818b26ec. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.130:36673: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:13:42.311635 23091 raft_consensus.cc:493] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:13:42.312296 23091 raft_consensus.cc:515] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:42.314618 23091 leader_election.cc:290] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:13:42.322656 14877 leader_election.cc:336] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Network error: Client connection negotiation failed: client connection to 127.12.174.130:36673: connect: Connection refused (error 111)
W20260709 12:13:42.323854 14877 leader_election.cc:336] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957): Network error: Client connection negotiation failed: client connection to 127.12.174.131:45957: connect: Connection refused (error 111)
I20260709 12:13:42.324259 14877 leader_election.cc:304] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:13:42.325026 23091 raft_consensus.cc:2749] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:13:42.340233 23091 raft_consensus.cc:493] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:13:42.340837 23091 raft_consensus.cc:515] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:42.343163 23091 leader_election.cc:290] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:13:42.348731 14877 leader_election.cc:336] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Network error: Client connection negotiation failed: client connection to 127.12.174.130:36673: connect: Connection refused (error 111)
W20260709 12:13:42.349565 14877 leader_election.cc:336] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957): Network error: Client connection negotiation failed: client connection to 127.12.174.131:45957: connect: Connection refused (error 111)
I20260709 12:13:42.350064 14877 leader_election.cc:304] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:13:42.350898 23091 raft_consensus.cc:2749] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 12:13:42.367667 23090 raft_consensus.cc:493] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:13:42.368247 23090 raft_consensus.cc:515] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:42.373196 23090 leader_election.cc:290] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:13:42.374272 14877 consensus_peers.cc:597] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db -> Peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Couldn't send request to peer 17aab1bbf5014936aa18cc21818b26ec. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.130:36673: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:42.377624 14876 leader_election.cc:336] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111)
W20260709 12:13:42.382216 14877 leader_election.cc:336] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957): Network error: Client connection negotiation failed: client connection to 127.12.174.131:45957: connect: Connection refused (error 111)
I20260709 12:13:42.383222 14877 leader_election.cc:304] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:42.384267 23096 raft_consensus.cc:2749] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
W20260709 12:13:42.418267 14876 consensus_peers.cc:597] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:13:42.453670 23096 raft_consensus.cc:493] T 90097151efa7426faeaea3ff87a7ea78 P 73d01e9b1a9d49358da4985b21d681db [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:13:42.454358 23096 raft_consensus.cc:515] T 90097151efa7426faeaea3ff87a7ea78 P 73d01e9b1a9d49358da4985b21d681db [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:42.456789 23096 leader_election.cc:290] T 90097151efa7426faeaea3ff87a7ea78 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:13:42.464219 14876 leader_election.cc:336] T 90097151efa7426faeaea3ff87a7ea78 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111)
W20260709 12:13:42.480177 14877 leader_election.cc:336] T 90097151efa7426faeaea3ff87a7ea78 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957): Network error: Client connection negotiation failed: client connection to 127.12.174.131:45957: connect: Connection refused (error 111)
I20260709 12:13:42.486740 14877 leader_election.cc:304] T 90097151efa7426faeaea3ff87a7ea78 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 65c9c1653b3346b39a0e118540e6080c, 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:42.487721 23096 raft_consensus.cc:2749] T 90097151efa7426faeaea3ff87a7ea78 P 73d01e9b1a9d49358da4985b21d681db [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:13:42.489526 23096 raft_consensus.cc:493] T 938efad339fd47e1b0b6d37fbc612db2 P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:13:42.490298 23096 raft_consensus.cc:515] T 938efad339fd47e1b0b6d37fbc612db2 P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "885067a0d31741bfb5c9935788e315bf" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 37187 } } peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } attrs { replace: true } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:42.493294 23096 leader_election.cc:290] T 938efad339fd47e1b0b6d37fbc612db2 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187), 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:13:42.500512 14876 leader_election.cc:336] T 938efad339fd47e1b0b6d37fbc612db2 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111)
W20260709 12:13:42.522428 14877 leader_election.cc:336] T 938efad339fd47e1b0b6d37fbc612db2 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Network error: Client connection negotiation failed: client connection to 127.12.174.130:36673: connect: Connection refused (error 111)
I20260709 12:13:42.523048 14877 leader_election.cc:304] T 938efad339fd47e1b0b6d37fbc612db2 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 885067a0d31741bfb5c9935788e315bf
I20260709 12:13:42.523957 23096 raft_consensus.cc:2749] T 938efad339fd47e1b0b6d37fbc612db2 P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:13:42.533284 14877 leader_election.cc:336] T 938efad339fd47e1b0b6d37fbc612db2 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957): Network error: Client connection negotiation failed: client connection to 127.12.174.131:45957: connect: Connection refused (error 111)
W20260709 12:13:42.540814 14877 consensus_peers.cc:597] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db -> Peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957): Couldn't send request to peer 65c9c1653b3346b39a0e118540e6080c. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.131:45957: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:42.585160 14877 consensus_peers.cc:597] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db -> Peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Couldn't send request to peer 17aab1bbf5014936aa18cc21818b26ec. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.130:36673: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:13:42.586124 23096 raft_consensus.cc:493] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:13:42.586671 23096 raft_consensus.cc:515] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:42.588825 23096 leader_election.cc:290] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
W20260709 12:13:42.607192 14877 leader_election.cc:336] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Network error: Client connection negotiation failed: client connection to 127.12.174.130:36673: connect: Connection refused (error 111)
W20260709 12:13:42.608021 14877 leader_election.cc:336] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957): Network error: Client connection negotiation failed: client connection to 127.12.174.131:45957: connect: Connection refused (error 111)
I20260709 12:13:42.608458 14877 leader_election.cc:304] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:13:42.609238 23096 raft_consensus.cc:2749] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 12:13:42.616618 14877 consensus_peers.cc:597] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db -> Peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Couldn't send request to peer 17aab1bbf5014936aa18cc21818b26ec. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.130:36673: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:42.700062 14877 consensus_peers.cc:597] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db -> Peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Couldn't send request to peer 17aab1bbf5014936aa18cc21818b26ec. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.130:36673: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:42.826097 14877 consensus_peers.cc:597] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db -> Peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Couldn't send request to peer 17aab1bbf5014936aa18cc21818b26ec. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.130:36673: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:42.858206 14876 consensus_peers.cc:597] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:13:42.861891 14876 consensus_peers.cc:597] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:13:42.872062 14877 consensus_peers.cc:597] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db -> Peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957): Couldn't send request to peer 65c9c1653b3346b39a0e118540e6080c. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.131:45957: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:42.959443 14876 consensus_peers.cc:597] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:13:42.966552 14877 consensus_peers.cc:597] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db -> Peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Couldn't send request to peer 17aab1bbf5014936aa18cc21818b26ec. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.130:36673: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:42.967440 14877 consensus_peers.cc:597] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db -> Peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957): Couldn't send request to peer 65c9c1653b3346b39a0e118540e6080c. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.131:45957: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:42.987198 14877 consensus_peers.cc:597] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db -> Peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Couldn't send request to peer 17aab1bbf5014936aa18cc21818b26ec. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.130:36673: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:13:43.010732 14877 consensus_peers.cc:597] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db -> Peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957): Couldn't send request to peer 65c9c1653b3346b39a0e118540e6080c. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.131:45957: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:43.057178 14877 consensus_peers.cc:597] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db -> Peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957): Couldn't send request to peer 65c9c1653b3346b39a0e118540e6080c. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.131:45957: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:43.070978 14877 consensus_peers.cc:597] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db -> Peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957): Couldn't send request to peer 65c9c1653b3346b39a0e118540e6080c. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.131:45957: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:43.085408 14877 consensus_peers.cc:597] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db -> Peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957): Couldn't send request to peer 65c9c1653b3346b39a0e118540e6080c. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.131:45957: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:43.108253 14876 consensus_peers.cc:597] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:13:43.221976 14877 consensus_peers.cc:597] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db -> Peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957): Couldn't send request to peer 65c9c1653b3346b39a0e118540e6080c. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.131:45957: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:43.229293 14877 consensus_peers.cc:597] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db -> Peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957): Couldn't send request to peer 65c9c1653b3346b39a0e118540e6080c. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.131:45957: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:43.233608 14877 consensus_peers.cc:597] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db -> Peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Couldn't send request to peer 17aab1bbf5014936aa18cc21818b26ec. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.130:36673: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:13:43.326102 14876 consensus_peers.cc:597] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:13:43.338754 14877 consensus_peers.cc:597] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db -> Peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957): Couldn't send request to peer 65c9c1653b3346b39a0e118540e6080c. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.131:45957: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:13:43.389500 14876 consensus_peers.cc:597] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:13:43.399892 12986 tablet_server.cc:196] TabletServer@127.12.174.131:0 shutdown complete.
W20260709 12:13:43.437455 14876 consensus_peers.cc:597] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db -> Peer 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): Couldn't send request to peer 885067a0d31741bfb5c9935788e315bf. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:13:43.483031 23097 raft_consensus.cc:493] T cbe93a4954a24795882e04fa537ddf4d P 73d01e9b1a9d49358da4985b21d681db [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 65c9c1653b3346b39a0e118540e6080c)
I20260709 12:13:43.485399 23097 raft_consensus.cc:515] T cbe93a4954a24795882e04fa537ddf4d P 73d01e9b1a9d49358da4985b21d681db [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "17aab1bbf5014936aa18cc21818b26ec" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 36673 } } peers { permanent_uuid: "65c9c1653b3346b39a0e118540e6080c" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 45957 } } peers { permanent_uuid: "73d01e9b1a9d49358da4985b21d681db" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 37341 } attrs { promote: false } }
I20260709 12:13:43.488356 23097 leader_election.cc:290] T cbe93a4954a24795882e04fa537ddf4d P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673), 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957)
I20260709 12:13:43.525151 12986 tablet_server.cc:179] TabletServer@127.12.174.132:0 shutting down...
W20260709 12:13:43.525151 14877 leader_election.cc:336] T cbe93a4954a24795882e04fa537ddf4d P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957): Network error: Client connection negotiation failed: client connection to 127.12.174.131:45957: connect: Connection refused (error 111)
W20260709 12:13:43.531505 14877 leader_election.cc:336] T cbe93a4954a24795882e04fa537ddf4d P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 17aab1bbf5014936aa18cc21818b26ec (127.12.174.130:36673): Network error: Client connection negotiation failed: client connection to 127.12.174.130:36673: connect: Connection refused (error 111)
I20260709 12:13:43.531905 14877 leader_election.cc:304] T cbe93a4954a24795882e04fa537ddf4d P 73d01e9b1a9d49358da4985b21d681db [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d01e9b1a9d49358da4985b21d681db; no voters: 17aab1bbf5014936aa18cc21818b26ec, 65c9c1653b3346b39a0e118540e6080c
I20260709 12:13:43.532550 23097 raft_consensus.cc:2749] T cbe93a4954a24795882e04fa537ddf4d P 73d01e9b1a9d49358da4985b21d681db [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 12:13:43.534627 14877 consensus_peers.cc:597] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db -> Peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957): Couldn't send request to peer 65c9c1653b3346b39a0e118540e6080c. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.131:45957: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:43.597357 12986 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:13:43.598762 12986 tablet_replica.cc:333] T cbe93a4954a24795882e04fa537ddf4d P 73d01e9b1a9d49358da4985b21d681db: stopping tablet replica
I20260709 12:13:43.600013 12986 raft_consensus.cc:2243] T cbe93a4954a24795882e04fa537ddf4d P 73d01e9b1a9d49358da4985b21d681db [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:43.601323 12986 raft_consensus.cc:2272] T cbe93a4954a24795882e04fa537ddf4d P 73d01e9b1a9d49358da4985b21d681db [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:43.605526 12986 tablet_replica.cc:333] T 938efad339fd47e1b0b6d37fbc612db2 P 73d01e9b1a9d49358da4985b21d681db: stopping tablet replica
I20260709 12:13:43.606732 12986 raft_consensus.cc:2243] T 938efad339fd47e1b0b6d37fbc612db2 P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:43.607736 12986 raft_consensus.cc:2272] T 938efad339fd47e1b0b6d37fbc612db2 P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:43.613649 12986 tablet_replica.cc:333] T 8efcd0417f0c412280654006e6389763 P 73d01e9b1a9d49358da4985b21d681db: stopping tablet replica
I20260709 12:13:43.615168 12986 raft_consensus.cc:2243] T 8efcd0417f0c412280654006e6389763 P 73d01e9b1a9d49358da4985b21d681db [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:43.616183 12986 raft_consensus.cc:2272] T 8efcd0417f0c412280654006e6389763 P 73d01e9b1a9d49358da4985b21d681db [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:43.617654 14877 consensus_peers.cc:597] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db -> Peer 65c9c1653b3346b39a0e118540e6080c (127.12.174.131:45957): Couldn't send request to peer 65c9c1653b3346b39a0e118540e6080c. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.131:45957: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:13:43.620402 12986 tablet_replica.cc:333] T 90097151efa7426faeaea3ff87a7ea78 P 73d01e9b1a9d49358da4985b21d681db: stopping tablet replica
I20260709 12:13:43.621210 12986 raft_consensus.cc:2243] T 90097151efa7426faeaea3ff87a7ea78 P 73d01e9b1a9d49358da4985b21d681db [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:43.622341 12986 raft_consensus.cc:2272] T 90097151efa7426faeaea3ff87a7ea78 P 73d01e9b1a9d49358da4985b21d681db [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:43.628669 12986 tablet_replica.cc:333] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db: stopping tablet replica
I20260709 12:13:43.629695 12986 raft_consensus.cc:2243] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 27 LEADER]: Raft consensus shutting down.
I20260709 12:13:43.630831 12986 raft_consensus.cc:2272] T f4739bc22bfe44fcba807da02d9351b6 P 73d01e9b1a9d49358da4985b21d681db [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:43.633595 12986 tablet_replica.cc:333] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db: stopping tablet replica
I20260709 12:13:43.634311 12986 raft_consensus.cc:2243] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:13:43.635443 12986 raft_consensus.cc:2272] T bf9bea0d16e44efabb5cdd53e3828438 P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:43.638054 12986 tablet_replica.cc:333] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db: stopping tablet replica
I20260709 12:13:43.638835 12986 raft_consensus.cc:2243] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 23 LEADER]: Raft consensus shutting down.
I20260709 12:13:43.640524 12986 raft_consensus.cc:2272] T f52421be255e4fab824173d17981b5bb P 73d01e9b1a9d49358da4985b21d681db [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:43.643996 12986 tablet_replica.cc:333] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db: stopping tablet replica
I20260709 12:13:43.645192 12986 raft_consensus.cc:2243] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:13:43.646512 12986 raft_consensus.cc:2272] T 36091607df2f46059df62d677842a031 P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:43.649848 12986 tablet_replica.cc:333] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db: stopping tablet replica
I20260709 12:13:43.650897 12986 raft_consensus.cc:2243] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:43.651621 12986 raft_consensus.cc:2272] T 35b39d0f3270452a8bd4f4b1800a837c P 73d01e9b1a9d49358da4985b21d681db [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:43.654194 12986 tablet_replica.cc:333] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db: stopping tablet replica
I20260709 12:13:43.656836 12986 raft_consensus.cc:2243] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:43.657380 12986 raft_consensus.cc:2272] T d82ca0c0e51a4e148b8d3e226ff7cebb P 73d01e9b1a9d49358da4985b21d681db [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:43.659829 12986 tablet_replica.cc:333] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db: stopping tablet replica
I20260709 12:13:43.660737 12986 raft_consensus.cc:2243] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 23 LEADER]: Raft consensus shutting down.
I20260709 12:13:43.662197 12986 raft_consensus.cc:2272] T 02513fb0dbdd4cbdb019d79f0f448d18 P 73d01e9b1a9d49358da4985b21d681db [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:43.665722 12986 tablet_replica.cc:333] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db: stopping tablet replica
I20260709 12:13:43.666697 12986 raft_consensus.cc:2243] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 24 LEADER]: Raft consensus shutting down.
I20260709 12:13:43.667982 12986 raft_consensus.cc:2272] T e9b3f8ef40054811944ba9bd9ed74eb3 P 73d01e9b1a9d49358da4985b21d681db [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:43.670603 12986 tablet_replica.cc:333] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db: stopping tablet replica
I20260709 12:13:43.671329 12986 raft_consensus.cc:2243] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:13:43.672451 12986 raft_consensus.cc:2272] T 3832505489c04d04a69e256187061921 P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:43.675112 12986 tablet_replica.cc:333] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db: stopping tablet replica
I20260709 12:13:43.675766 12986 raft_consensus.cc:2243] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 22 LEADER]: Raft consensus shutting down.
I20260709 12:13:43.677049 12986 raft_consensus.cc:2272] T 0a11d7ae457a408cac205ac501217c61 P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:43.679693 12986 tablet_replica.cc:333] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db: stopping tablet replica
I20260709 12:13:43.680385 12986 raft_consensus.cc:2243] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 31 LEADER]: Raft consensus shutting down.
I20260709 12:13:43.681607 12986 raft_consensus.cc:2272] T 55a08950f57748dea047f3190b2c0e95 P 73d01e9b1a9d49358da4985b21d681db [term 31 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:43.684211 12986 tablet_replica.cc:333] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db: stopping tablet replica
I20260709 12:13:43.684926 12986 raft_consensus.cc:2243] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:43.685451 12986 raft_consensus.cc:2272] T 6de6b0d9885648e6b2f6822eb9f85021 P 73d01e9b1a9d49358da4985b21d681db [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:43.688012 12986 tablet_replica.cc:333] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db: stopping tablet replica
I20260709 12:13:43.688762 12986 raft_consensus.cc:2243] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:43.689309 12986 raft_consensus.cc:2272] T 53a4b57f88ee477d8c90d6b0f0cf2e57 P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:43.691550 12986 tablet_replica.cc:333] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db: stopping tablet replica
I20260709 12:13:43.692171 12986 raft_consensus.cc:2243] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:43.692726 12986 raft_consensus.cc:2272] T afce5304599246a580d798fc0c843964 P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:43.695703 12986 tablet_replica.cc:333] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db: stopping tablet replica
I20260709 12:13:43.696353 12986 raft_consensus.cc:2243] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:43.696887 12986 raft_consensus.cc:2272] T 1dfd3f2bd71343f789aa5733a23d4b8d P 73d01e9b1a9d49358da4985b21d681db [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:43.699216 12986 tablet_replica.cc:333] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db: stopping tablet replica
I20260709 12:13:43.699829 12986 raft_consensus.cc:2243] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 28 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:43.700395 12986 raft_consensus.cc:2272] T 0d203245740a4821b7ebcc7669c8b2af P 73d01e9b1a9d49358da4985b21d681db [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:43.702816 12986 tablet_replica.cc:333] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db: stopping tablet replica
I20260709 12:13:43.703434 12986 raft_consensus.cc:2243] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:43.704036 12986 raft_consensus.cc:2272] T ec0fc0e91c904a0daeb3e29ee24a492d P 73d01e9b1a9d49358da4985b21d681db [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:43.706723 12986 tablet_replica.cc:333] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db: stopping tablet replica
I20260709 12:13:43.707437 12986 raft_consensus.cc:2243] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:13:43.708447 12986 raft_consensus.cc:2272] T 7879f4a298eb4e69ac692911bd5ac5f8 P 73d01e9b1a9d49358da4985b21d681db [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:43.710862 12986 tablet_replica.cc:333] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db: stopping tablet replica
I20260709 12:13:43.711440 12986 raft_consensus.cc:2243] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 23 LEADER]: Raft consensus shutting down.
I20260709 12:13:43.712459 12986 raft_consensus.cc:2272] T 7c8882b1b37d4e84a94a2e1e321a8755 P 73d01e9b1a9d49358da4985b21d681db [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:43.714800 12986 tablet_replica.cc:333] T afdbef67ffe54739bdccc3b631f66c89 P 73d01e9b1a9d49358da4985b21d681db: stopping tablet replica
I20260709 12:13:43.715445 12986 raft_consensus.cc:2243] T afdbef67ffe54739bdccc3b631f66c89 P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:43.716125 12986 raft_consensus.cc:2272] T afdbef67ffe54739bdccc3b631f66c89 P 73d01e9b1a9d49358da4985b21d681db [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:43.718997 12986 tablet_replica.cc:333] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db: stopping tablet replica
I20260709 12:13:43.719584 12986 raft_consensus.cc:2243] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 29 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:43.720089 12986 raft_consensus.cc:2272] T 981a078d2d9d479abecc8b0b45771080 P 73d01e9b1a9d49358da4985b21d681db [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:43.722339 12986 tablet_replica.cc:333] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db: stopping tablet replica
I20260709 12:13:43.722980 12986 raft_consensus.cc:2243] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:13:43.723946 12986 raft_consensus.cc:2272] T 3c9d740fa53e42179ad8d244b4c179fd P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:43.726387 12986 tablet_replica.cc:333] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db: stopping tablet replica
I20260709 12:13:43.726995 12986 raft_consensus.cc:2243] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:13:43.728096 12986 raft_consensus.cc:2272] T 5485933837894417a3f0f89d55af1296 P 73d01e9b1a9d49358da4985b21d681db [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:43.731312 12986 tablet_replica.cc:333] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db: stopping tablet replica
I20260709 12:13:43.731870 12986 raft_consensus.cc:2243] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:13:43.732892 12986 raft_consensus.cc:2272] T 60aca7b73a544dfc9a4bd6918b27d132 P 73d01e9b1a9d49358da4985b21d681db [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:43.735231 12986 tablet_replica.cc:333] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db: stopping tablet replica
I20260709 12:13:43.735828 12986 raft_consensus.cc:2243] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:13:43.736817 12986 raft_consensus.cc:2272] T 15f7cecfe772454980c8ae9d1803fe98 P 73d01e9b1a9d49358da4985b21d681db [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:43.739022 12986 tablet_replica.cc:333] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db: stopping tablet replica
I20260709 12:13:43.739588 12986 raft_consensus.cc:2243] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 26 LEADER]: Raft consensus shutting down.
I20260709 12:13:43.740542 12986 raft_consensus.cc:2272] T fc8bff37f52742a3a3b8a39c45ade183 P 73d01e9b1a9d49358da4985b21d681db [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:43.742842 12986 tablet_replica.cc:333] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db: stopping tablet replica
I20260709 12:13:43.743405 12986 raft_consensus.cc:2243] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:13:43.744525 12986 raft_consensus.cc:2272] T f57e398f580944f0866ea5fab71be87f P 73d01e9b1a9d49358da4985b21d681db [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:43.746942 12986 tablet_replica.cc:333] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db: stopping tablet replica
I20260709 12:13:43.747483 12986 raft_consensus.cc:2243] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:13:43.748355 12986 raft_consensus.cc:2272] T 2b1a5d42755443119571654ad5c5f2f3 P 73d01e9b1a9d49358da4985b21d681db [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:43.750483 12986 tablet_replica.cc:333] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db: stopping tablet replica
I20260709 12:13:43.750942 12986 raft_consensus.cc:2243] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:43.751423 12986 raft_consensus.cc:2272] T e244b5af3ce244339f6fe0bd22a35eba P 73d01e9b1a9d49358da4985b21d681db [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:44.085014 12986 tablet_server.cc:196] TabletServer@127.12.174.132:0 shutdown complete.
I20260709 12:13:44.161953 12986 master.cc:562] Master@127.12.174.190:39655 shutting down...
W20260709 12:13:44.199385 14136 auto_rebalancer.cc:873] Removing replace marker failed: Catalog manager is not initialized. State: Closing
W20260709 12:13:44.199687 14136 auto_rebalancer.cc:901] Could not move replica: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 12:13:44.199941 14136 auto_rebalancer.cc:330] scheduled replica move failed to complete: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 12:13:45.636650 14073 catalog_manager.cc:4755] TS 885067a0d31741bfb5c9935788e315bf (127.12.174.129:37187): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet cbe93a4954a24795882e04fa537ddf4d: Network error: Client connection negotiation failed: client connection to 127.12.174.129:37187: connect: Connection refused (error 111)
I20260709 12:13:45.689416 12986 raft_consensus.cc:2243] T 00000000000000000000000000000000 P d07070be2c074f4cb9ad35f1580c4ef7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:45.690232 12986 raft_consensus.cc:2272] T 00000000000000000000000000000000 P d07070be2c074f4cb9ad35f1580c4ef7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:45.690567 12986 tablet_replica.cc:333] T 00000000000000000000000000000000 P d07070be2c074f4cb9ad35f1580c4ef7: stopping tablet replica
I20260709 12:13:45.907392 12986 master.cc:584] Master@127.12.174.190:39655 shutdown complete.
I20260709 12:13:45.948462 12986 test_util.cc:182] -----------------------------------------------
I20260709 12:13:45.948724 12986 test_util.cc:183] Had failures, leaving test files at /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598886212958-12986-0
[  FAILED  ] LeaderRebalancerTest.AddTserver (275003 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 12:13:45.953018 12986 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.12.174.190:35723
I20260709 12:13:45.954668 12986 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:13:45.960979 23101 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:45.962563 23100 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:45.962733 23103 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:13:45.966276 12986 server_base.cc:1061] running on GCE node
I20260709 12:13:45.969627 12986 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:13:45.969941 12986 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:13:45.970108 12986 hybrid_clock.cc:648] HybridClock initialized: now 1783599225970093 us; error 0 us; skew 500 ppm
I20260709 12:13:45.970719 12986 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:13:45.973503 12986 webserver.cc:533] Webserver started at http://127.12.174.190:45713/ using document root <none> and password file <none>
I20260709 12:13:45.974103 12986 fs_manager.cc:362] Metadata directory not provided
I20260709 12:13:45.974287 12986 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:13:45.974615 12986 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:13:45.976177 12986 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598886212958-12986-0/minicluster-data/master-0-root/instance:
uuid: "8590568173a443959894f885fddb0e86"
format_stamp: "Formatted at 2026-07-09 12:13:45 on dist-test-slave-9q7n"
I20260709 12:13:45.981684 12986 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.000s
I20260709 12:13:45.986338 23108 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:45.987335 12986 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.003s
I20260709 12:13:45.987736 12986 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598886212958-12986-0/minicluster-data/master-0-root
uuid: "8590568173a443959894f885fddb0e86"
format_stamp: "Formatted at 2026-07-09 12:13:45 on dist-test-slave-9q7n"
I20260709 12:13:45.988066 12986 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598886212958-12986-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598886212958-12986-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598886212958-12986-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:13:46.018882 12986 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:13:46.020292 12986 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:13:46.067018 12986 rpc_server.cc:307] RPC server started. Bound to: 127.12.174.190:35723
I20260709 12:13:46.067162 23159 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.174.190:35723 every 8 connection(s)
I20260709 12:13:46.071664 23160 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:46.084921 23160 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8590568173a443959894f885fddb0e86: Bootstrap starting.
I20260709 12:13:46.090651 23160 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8590568173a443959894f885fddb0e86: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:46.095854 23160 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8590568173a443959894f885fddb0e86: No bootstrap required, opened a new log
I20260709 12:13:46.098438 23160 raft_consensus.cc:359] T 00000000000000000000000000000000 P 8590568173a443959894f885fddb0e86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8590568173a443959894f885fddb0e86" member_type: VOTER }
I20260709 12:13:46.098891 23160 raft_consensus.cc:385] T 00000000000000000000000000000000 P 8590568173a443959894f885fddb0e86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:46.099087 23160 raft_consensus.cc:740] T 00000000000000000000000000000000 P 8590568173a443959894f885fddb0e86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8590568173a443959894f885fddb0e86, State: Initialized, Role: FOLLOWER
I20260709 12:13:46.099723 23160 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8590568173a443959894f885fddb0e86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8590568173a443959894f885fddb0e86" member_type: VOTER }
I20260709 12:13:46.100234 23160 raft_consensus.cc:399] T 00000000000000000000000000000000 P 8590568173a443959894f885fddb0e86 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:13:46.100453 23160 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8590568173a443959894f885fddb0e86 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:13:46.100678 23160 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 8590568173a443959894f885fddb0e86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:46.107580 23160 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8590568173a443959894f885fddb0e86 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8590568173a443959894f885fddb0e86" member_type: VOTER }
I20260709 12:13:46.108348 23160 leader_election.cc:304] T 00000000000000000000000000000000 P 8590568173a443959894f885fddb0e86 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8590568173a443959894f885fddb0e86; no voters: 
I20260709 12:13:46.109725 23160 leader_election.cc:290] T 00000000000000000000000000000000 P 8590568173a443959894f885fddb0e86 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:13:46.110147 23163 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 8590568173a443959894f885fddb0e86 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:46.111824 23163 raft_consensus.cc:697] T 00000000000000000000000000000000 P 8590568173a443959894f885fddb0e86 [term 1 LEADER]: Becoming Leader. State: Replica: 8590568173a443959894f885fddb0e86, State: Running, Role: LEADER
I20260709 12:13:46.112730 23163 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8590568173a443959894f885fddb0e86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8590568173a443959894f885fddb0e86" member_type: VOTER }
I20260709 12:13:46.113705 23160 sys_catalog.cc:565] T 00000000000000000000000000000000 P 8590568173a443959894f885fddb0e86 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:13:46.119704 23165 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8590568173a443959894f885fddb0e86 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8590568173a443959894f885fddb0e86. Latest consensus state: current_term: 1 leader_uuid: "8590568173a443959894f885fddb0e86" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8590568173a443959894f885fddb0e86" member_type: VOTER } }
I20260709 12:13:46.120589 23165 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8590568173a443959894f885fddb0e86 [sys.catalog]: This master's current role is: LEADER
I20260709 12:13:46.120898 23164 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8590568173a443959894f885fddb0e86 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8590568173a443959894f885fddb0e86" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8590568173a443959894f885fddb0e86" member_type: VOTER } }
I20260709 12:13:46.121549 23164 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8590568173a443959894f885fddb0e86 [sys.catalog]: This master's current role is: LEADER
I20260709 12:13:46.123745 23171 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:13:46.129871 23171 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:13:46.132475 12986 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:13:46.141650 23171 catalog_manager.cc:1383] Generated new cluster ID: e71255735a684ccebe07cef25f33edca
I20260709 12:13:46.142127 23171 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:13:46.166772 23171 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:13:46.168249 23171 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:13:46.187532 23171 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 8590568173a443959894f885fddb0e86: Generated new TSK 0
I20260709 12:13:46.188372 23171 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:13:46.201116 12986 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:13:46.208822 23181 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:46.210309 23182 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:46.211663 23184 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:13:46.213395 12986 server_base.cc:1061] running on GCE node
I20260709 12:13:46.217198 12986 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:13:46.217469 12986 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:13:46.217631 12986 hybrid_clock.cc:648] HybridClock initialized: now 1783599226217611 us; error 0 us; skew 500 ppm
I20260709 12:13:46.218243 12986 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:13:46.221182 12986 webserver.cc:533] Webserver started at http://127.12.174.129:35747/ using document root <none> and password file <none>
I20260709 12:13:46.221778 12986 fs_manager.cc:362] Metadata directory not provided
I20260709 12:13:46.222028 12986 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:13:46.222385 12986 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:13:46.224464 12986 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598886212958-12986-0/minicluster-data/ts-0-root/instance:
uuid: "288a46a90f26471584043331107dc0dd"
format_stamp: "Formatted at 2026-07-09 12:13:46 on dist-test-slave-9q7n"
I20260709 12:13:46.232195 12986 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.006s	sys 0.003s
I20260709 12:13:46.236681 23189 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:46.238103 12986 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.002s
I20260709 12:13:46.238703 12986 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598886212958-12986-0/minicluster-data/ts-0-root
uuid: "288a46a90f26471584043331107dc0dd"
format_stamp: "Formatted at 2026-07-09 12:13:46 on dist-test-slave-9q7n"
I20260709 12:13:46.239054 12986 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598886212958-12986-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598886212958-12986-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598886212958-12986-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:13:46.258124 12986 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:13:46.259560 12986 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:13:46.261374 12986 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:13:46.264485 12986 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:13:46.264717 12986 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:46.265209 12986 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:13:46.265399 12986 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:46.325807 12986 rpc_server.cc:307] RPC server started. Bound to: 127.12.174.129:46159
I20260709 12:13:46.325956 23251 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.174.129:46159 every 8 connection(s)
I20260709 12:13:46.331543 12986 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:13:46.341519 23257 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:46.343045 23256 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:46.343801 23259 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:13:46.347471 12986 server_base.cc:1061] running on GCE node
I20260709 12:13:46.350353 12986 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:13:46.350818 12986 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:13:46.351058 12986 hybrid_clock.cc:648] HybridClock initialized: now 1783599226351030 us; error 0 us; skew 500 ppm
I20260709 12:13:46.351908 12986 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:13:46.355754 12986 webserver.cc:533] Webserver started at http://127.12.174.130:33015/ using document root <none> and password file <none>
I20260709 12:13:46.356354 12986 fs_manager.cc:362] Metadata directory not provided
I20260709 12:13:46.356611 12986 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:13:46.356937 12986 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:13:46.357025 23252 heartbeater.cc:344] Connected to a master server at 127.12.174.190:35723
I20260709 12:13:46.357583 23252 heartbeater.cc:461] Registering TS with master...
I20260709 12:13:46.358639 23252 heartbeater.cc:507] Master 127.12.174.190:35723 requested a full tablet report, sending...
I20260709 12:13:46.358750 12986 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598886212958-12986-0/minicluster-data/ts-1-root/instance:
uuid: "2904b089bdb249b78950db76f4a70e9f"
format_stamp: "Formatted at 2026-07-09 12:13:46 on dist-test-slave-9q7n"
I20260709 12:13:46.361714 23125 ts_manager.cc:194] Registered new tserver with Master: 288a46a90f26471584043331107dc0dd (127.12.174.129:46159)
I20260709 12:13:46.363956 23125 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39536
I20260709 12:13:46.365304 12986 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.006s	sys 0.001s
I20260709 12:13:46.370460 23264 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:46.371361 12986 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 12:13:46.371701 12986 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598886212958-12986-0/minicluster-data/ts-1-root
uuid: "2904b089bdb249b78950db76f4a70e9f"
format_stamp: "Formatted at 2026-07-09 12:13:46 on dist-test-slave-9q7n"
I20260709 12:13:46.371977 12986 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598886212958-12986-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598886212958-12986-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598886212958-12986-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:13:46.386616 12986 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:13:46.387974 12986 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:13:46.389683 12986 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:13:46.392293 12986 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:13:46.392525 12986 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:46.392758 12986 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:13:46.392922 12986 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:46.450383 12986 rpc_server.cc:307] RPC server started. Bound to: 127.12.174.130:45789
I20260709 12:13:46.450570 23326 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.174.130:45789 every 8 connection(s)
I20260709 12:13:46.456300 12986 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:13:46.464424 23330 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:46.466198 23331 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:46.468183 23333 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:13:46.468531 12986 server_base.cc:1061] running on GCE node
I20260709 12:13:46.470114 23327 heartbeater.cc:344] Connected to a master server at 127.12.174.190:35723
I20260709 12:13:46.470429 12986 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:13:46.470599 23327 heartbeater.cc:461] Registering TS with master...
W20260709 12:13:46.470736 12986 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:13:46.471017 12986 hybrid_clock.cc:648] HybridClock initialized: now 1783599226470991 us; error 0 us; skew 500 ppm
I20260709 12:13:46.471664 23327 heartbeater.cc:507] Master 127.12.174.190:35723 requested a full tablet report, sending...
I20260709 12:13:46.471897 12986 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:13:46.474398 23125 ts_manager.cc:194] Registered new tserver with Master: 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789)
I20260709 12:13:46.475435 12986 webserver.cc:533] Webserver started at http://127.12.174.131:45667/ using document root <none> and password file <none>
I20260709 12:13:46.476186 12986 fs_manager.cc:362] Metadata directory not provided
I20260709 12:13:46.476112 23125 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39540
I20260709 12:13:46.476660 12986 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:13:46.476990 12986 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:13:46.478421 12986 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598886212958-12986-0/minicluster-data/ts-2-root/instance:
uuid: "3a9a63ca97694ebdb84bca730762d735"
format_stamp: "Formatted at 2026-07-09 12:13:46 on dist-test-slave-9q7n"
I20260709 12:13:46.484010 12986 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:13:46.488176 23338 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:46.489185 12986 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 12:13:46.489531 12986 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598886212958-12986-0/minicluster-data/ts-2-root
uuid: "3a9a63ca97694ebdb84bca730762d735"
format_stamp: "Formatted at 2026-07-09 12:13:46 on dist-test-slave-9q7n"
I20260709 12:13:46.489943 12986 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598886212958-12986-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598886212958-12986-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598886212958-12986-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:13:46.509472 12986 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:13:46.510914 12986 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:13:46.512616 12986 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:13:46.515556 12986 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:13:46.515806 12986 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:46.516043 12986 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:13:46.516201 12986 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:46.598213 12986 rpc_server.cc:307] RPC server started. Bound to: 127.12.174.131:40061
I20260709 12:13:46.598415 23400 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.174.131:40061 every 8 connection(s)
I20260709 12:13:46.607372 12986 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:13:46.620177 23404 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:46.622675 23405 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:13:46.630542 12986 server_base.cc:1061] running on GCE node
W20260709 12:13:46.630932 23407 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:13:46.631969 23401 heartbeater.cc:344] Connected to a master server at 127.12.174.190:35723
I20260709 12:13:46.632977 23401 heartbeater.cc:461] Registering TS with master...
I20260709 12:13:46.633378 12986 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:13:46.633980 12986 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:13:46.634402 12986 hybrid_clock.cc:648] HybridClock initialized: now 1783599226634364 us; error 0 us; skew 500 ppm
I20260709 12:13:46.635171 23401 heartbeater.cc:507] Master 127.12.174.190:35723 requested a full tablet report, sending...
I20260709 12:13:46.636204 12986 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:13:46.640407 23125 ts_manager.cc:194] Registered new tserver with Master: 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061)
I20260709 12:13:46.642128 12986 webserver.cc:533] Webserver started at http://127.12.174.132:37719/ using document root <none> and password file <none>
I20260709 12:13:46.643530 12986 fs_manager.cc:362] Metadata directory not provided
I20260709 12:13:46.644001 12986 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:13:46.644667 12986 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:13:46.644484 23125 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39556
I20260709 12:13:46.647166 12986 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598886212958-12986-0/minicluster-data/ts-3-root/instance:
uuid: "9ba0da223cf24c97bc7d225e25015924"
format_stamp: "Formatted at 2026-07-09 12:13:46 on dist-test-slave-9q7n"
I20260709 12:13:46.656489 12986 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.006s	sys 0.003s
I20260709 12:13:46.663533 23412 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:46.664986 12986 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:13:46.665560 12986 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598886212958-12986-0/minicluster-data/ts-3-root
uuid: "9ba0da223cf24c97bc7d225e25015924"
format_stamp: "Formatted at 2026-07-09 12:13:46 on dist-test-slave-9q7n"
I20260709 12:13:46.666190 12986 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598886212958-12986-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598886212958-12986-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598886212958-12986-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:13:46.684615 12986 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:13:46.688659 12986 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:13:46.693794 12986 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:13:46.698230 12986 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:13:46.698724 12986 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.001s	user 0.000s	sys 0.000s
I20260709 12:13:46.699244 12986 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:13:46.699544 12986 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:46.781965 12986 rpc_server.cc:307] RPC server started. Bound to: 127.12.174.132:46081
I20260709 12:13:46.782176 23474 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.174.132:46081 every 8 connection(s)
I20260709 12:13:46.812367 23475 heartbeater.cc:344] Connected to a master server at 127.12.174.190:35723
I20260709 12:13:46.812948 23475 heartbeater.cc:461] Registering TS with master...
I20260709 12:13:46.814459 23475 heartbeater.cc:507] Master 127.12.174.190:35723 requested a full tablet report, sending...
I20260709 12:13:46.818717 23125 ts_manager.cc:194] Registered new tserver with Master: 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081)
I20260709 12:13:46.819785 12986 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.032232881s
I20260709 12:13:46.821336 23125 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39564
I20260709 12:13:46.870874 23125 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39574:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:13:47.128590 23173 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:13:47.312024 23216 tablet_service.cc:1511] Processing CreateTablet for tablet 6d7d1c502ee24072a41a2a55cfc3a5fa (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:13:47.316094 23217 tablet_service.cc:1511] Processing CreateTablet for tablet b1a6e82689a84e36949e5efca6592772 (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:13:47.318780 23216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d7d1c502ee24072a41a2a55cfc3a5fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:47.322664 23217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1a6e82689a84e36949e5efca6592772. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:47.328343 23440 tablet_service.cc:1511] Processing CreateTablet for tablet b1a6e82689a84e36949e5efca6592772 (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:13:47.329018 23215 tablet_service.cc:1511] Processing CreateTablet for tablet ac854957ad6246c6b123638cfafeacd4 (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:13:47.331112 23440 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1a6e82689a84e36949e5efca6592772. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:47.332125 23215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac854957ad6246c6b123638cfafeacd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:47.337922 23214 tablet_service.cc:1511] Processing CreateTablet for tablet c1c10ca2f5924b7eb5422f0aee2f85c3 (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:13:47.341039 23214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1c10ca2f5924b7eb5422f0aee2f85c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:47.343648 23439 tablet_service.cc:1511] Processing CreateTablet for tablet ac854957ad6246c6b123638cfafeacd4 (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:13:47.346544 23439 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac854957ad6246c6b123638cfafeacd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:47.354266 23438 tablet_service.cc:1511] Processing CreateTablet for tablet 18f5de2825814c38a0bd15d4c962dbef (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:13:47.370795 23362 tablet_service.cc:1511] Processing CreateTablet for tablet 99bc4210d0b44dd282a5bf7606d122af (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:13:47.372181 23288 tablet_service.cc:1511] Processing CreateTablet for tablet 87c5024fe7274811b9598e504f3963a7 (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:13:47.355818 23292 tablet_service.cc:1511] Processing CreateTablet for tablet 6d7d1c502ee24072a41a2a55cfc3a5fa (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:13:47.373337 23362 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99bc4210d0b44dd282a5bf7606d122af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:47.373315 23438 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18f5de2825814c38a0bd15d4c962dbef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:47.375263 23292 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d7d1c502ee24072a41a2a55cfc3a5fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:47.377430 23436 tablet_service.cc:1511] Processing CreateTablet for tablet 99bc4210d0b44dd282a5bf7606d122af (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:13:47.379595 23213 tablet_service.cc:1511] Processing CreateTablet for tablet 87c5024fe7274811b9598e504f3963a7 (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:13:47.380255 23361 tablet_service.cc:1511] Processing CreateTablet for tablet eeda1df5d1624932a606c0a80e69d33a (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:13:47.382450 23213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87c5024fe7274811b9598e504f3963a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:47.382889 23435 tablet_service.cc:1511] Processing CreateTablet for tablet eeda1df5d1624932a606c0a80e69d33a (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:13:47.382956 23361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eeda1df5d1624932a606c0a80e69d33a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:47.362064 23366 tablet_service.cc:1511] Processing CreateTablet for tablet b1a6e82689a84e36949e5efca6592772 (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:13:47.387264 23366 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1a6e82689a84e36949e5efca6592772. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:47.365422 23365 tablet_service.cc:1511] Processing CreateTablet for tablet 6d7d1c502ee24072a41a2a55cfc3a5fa (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:13:47.367422 23363 tablet_service.cc:1511] Processing CreateTablet for tablet c1c10ca2f5924b7eb5422f0aee2f85c3 (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:13:47.368101 23289 tablet_service.cc:1511] Processing CreateTablet for tablet c1c10ca2f5924b7eb5422f0aee2f85c3 (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:13:47.370371 23252 heartbeater.cc:499] Master 127.12.174.190:35723 was elected leader, sending a full tablet report...
I20260709 12:13:47.395484 23365 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d7d1c502ee24072a41a2a55cfc3a5fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:47.359367 23437 tablet_service.cc:1511] Processing CreateTablet for tablet 87c5024fe7274811b9598e504f3963a7 (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:13:47.396560 23211 tablet_service.cc:1511] Processing CreateTablet for tablet 6626b442492c47849fd3c907d1c12f3e (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:13:47.368737 23364 tablet_service.cc:1511] Processing CreateTablet for tablet 18f5de2825814c38a0bd15d4c962dbef (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:13:47.399386 23211 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6626b442492c47849fd3c907d1c12f3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:47.399891 23287 tablet_service.cc:1511] Processing CreateTablet for tablet eeda1df5d1624932a606c0a80e69d33a (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:13:47.379899 23212 tablet_service.cc:1511] Processing CreateTablet for tablet 99bc4210d0b44dd282a5bf7606d122af (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:13:47.404469 23212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99bc4210d0b44dd282a5bf7606d122af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:47.361186 23291 tablet_service.cc:1511] Processing CreateTablet for tablet ac854957ad6246c6b123638cfafeacd4 (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:13:47.364109 23290 tablet_service.cc:1511] Processing CreateTablet for tablet 18f5de2825814c38a0bd15d4c962dbef (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:13:47.411088 23286 tablet_service.cc:1511] Processing CreateTablet for tablet 6626b442492c47849fd3c907d1c12f3e (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:13:47.412119 23364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18f5de2825814c38a0bd15d4c962dbef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:47.414933 23363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1c10ca2f5924b7eb5422f0aee2f85c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:47.380399 23436 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99bc4210d0b44dd282a5bf7606d122af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:47.389066 23288 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87c5024fe7274811b9598e504f3963a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:47.435367 23435 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eeda1df5d1624932a606c0a80e69d33a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:47.436805 23434 tablet_service.cc:1511] Processing CreateTablet for tablet 5959fc0b70884d699725fb8d560e5de5 (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:13:47.439570 23437 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87c5024fe7274811b9598e504f3963a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:47.425529 23360 tablet_service.cc:1511] Processing CreateTablet for tablet 6626b442492c47849fd3c907d1c12f3e (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:13:47.443481 23360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6626b442492c47849fd3c907d1c12f3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:47.450489 23434 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5959fc0b70884d699725fb8d560e5de5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:47.438447 23291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac854957ad6246c6b123638cfafeacd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:47.462934 23286 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6626b442492c47849fd3c907d1c12f3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:47.466498 23287 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eeda1df5d1624932a606c0a80e69d33a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:47.472292 23289 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1c10ca2f5924b7eb5422f0aee2f85c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:47.473587 23290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18f5de2825814c38a0bd15d4c962dbef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:47.479703 23327 heartbeater.cc:499] Master 127.12.174.190:35723 was elected leader, sending a full tablet report...
I20260709 12:13:47.504643 23210 tablet_service.cc:1511] Processing CreateTablet for tablet 5959fc0b70884d699725fb8d560e5de5 (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:13:47.509838 23210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5959fc0b70884d699725fb8d560e5de5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:47.523339 23285 tablet_service.cc:1511] Processing CreateTablet for tablet 5959fc0b70884d699725fb8d560e5de5 (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:13:47.526883 23285 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5959fc0b70884d699725fb8d560e5de5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:47.552083 23359 tablet_service.cc:1511] Processing CreateTablet for tablet 8da66c3ab79d468dbfd36407c51d423a (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:13:47.554664 23495 tablet_bootstrap.cc:492] T b1a6e82689a84e36949e5efca6592772 P 288a46a90f26471584043331107dc0dd: Bootstrap starting.
I20260709 12:13:47.555879 23359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8da66c3ab79d468dbfd36407c51d423a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:47.575965 23433 tablet_service.cc:1511] Processing CreateTablet for tablet 8da66c3ab79d468dbfd36407c51d423a (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:13:47.579406 23433 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8da66c3ab79d468dbfd36407c51d423a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:47.606793 23217 tablet_service.cc:1511] Processing CreateTablet for tablet 8da66c3ab79d468dbfd36407c51d423a (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:13:47.615859 23217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8da66c3ab79d468dbfd36407c51d423a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:47.642295 23284 tablet_service.cc:1511] Processing CreateTablet for tablet 138c2e6a55da4600a6318719808815ec (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:13:47.645720 23284 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 138c2e6a55da4600a6318719808815ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:47.650211 23401 heartbeater.cc:499] Master 127.12.174.190:35723 was elected leader, sending a full tablet report...
I20260709 12:13:47.678485 23358 tablet_service.cc:1511] Processing CreateTablet for tablet 138c2e6a55da4600a6318719808815ec (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:13:47.681711 23358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 138c2e6a55da4600a6318719808815ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:47.712082 23495 tablet_bootstrap.cc:654] T b1a6e82689a84e36949e5efca6592772 P 288a46a90f26471584043331107dc0dd: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:47.774269 23497 tablet_bootstrap.cc:492] T b1a6e82689a84e36949e5efca6592772 P 3a9a63ca97694ebdb84bca730762d735: Bootstrap starting.
I20260709 12:13:47.780066 23437 tablet_service.cc:1511] Processing CreateTablet for tablet 138c2e6a55da4600a6318719808815ec (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:13:47.786123 23437 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 138c2e6a55da4600a6318719808815ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:47.808657 23496 tablet_bootstrap.cc:492] T b1a6e82689a84e36949e5efca6592772 P 9ba0da223cf24c97bc7d225e25015924: Bootstrap starting.
I20260709 12:13:47.827565 23475 heartbeater.cc:499] Master 127.12.174.190:35723 was elected leader, sending a full tablet report...
I20260709 12:13:47.835122 23497 tablet_bootstrap.cc:654] T b1a6e82689a84e36949e5efca6592772 P 3a9a63ca97694ebdb84bca730762d735: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:47.877380 23498 tablet_bootstrap.cc:492] T c1c10ca2f5924b7eb5422f0aee2f85c3 P 2904b089bdb249b78950db76f4a70e9f: Bootstrap starting.
I20260709 12:13:47.878849 23495 tablet_bootstrap.cc:492] T b1a6e82689a84e36949e5efca6592772 P 288a46a90f26471584043331107dc0dd: No bootstrap required, opened a new log
I20260709 12:13:47.878955 23435 tablet_service.cc:1511] Processing CreateTablet for tablet 00335dfad3394f0c9689c0df8500bc9e (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:13:47.879755 23495 ts_tablet_manager.cc:1403] T b1a6e82689a84e36949e5efca6592772 P 288a46a90f26471584043331107dc0dd: Time spent bootstrapping tablet: real 0.326s	user 0.009s	sys 0.033s
I20260709 12:13:47.881003 23435 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00335dfad3394f0c9689c0df8500bc9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:47.885910 23495 raft_consensus.cc:359] T b1a6e82689a84e36949e5efca6592772 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:47.887843 23495 raft_consensus.cc:385] T b1a6e82689a84e36949e5efca6592772 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:47.888442 23495 raft_consensus.cc:740] T b1a6e82689a84e36949e5efca6592772 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 288a46a90f26471584043331107dc0dd, State: Initialized, Role: FOLLOWER
I20260709 12:13:47.889719 23498 tablet_bootstrap.cc:654] T c1c10ca2f5924b7eb5422f0aee2f85c3 P 2904b089bdb249b78950db76f4a70e9f: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:47.889995 23495 consensus_queue.cc:260] T b1a6e82689a84e36949e5efca6592772 P 288a46a90f26471584043331107dc0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:47.913789 23291 tablet_service.cc:1511] Processing CreateTablet for tablet 00335dfad3394f0c9689c0df8500bc9e (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:13:47.916816 23291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00335dfad3394f0c9689c0df8500bc9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:47.929164 23363 tablet_service.cc:1511] Processing CreateTablet for tablet 0646c3e87a184cd19184ff12695392a7 (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:13:47.932893 23363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0646c3e87a184cd19184ff12695392a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:47.938588 23358 tablet_service.cc:1511] Processing CreateTablet for tablet 509f7e554df04f83aeffd51ec07607d5 (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:13:47.916419 23210 tablet_service.cc:1511] Processing CreateTablet for tablet 0646c3e87a184cd19184ff12695392a7 (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:13:47.942492 23358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 509f7e554df04f83aeffd51ec07607d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:47.944007 23210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0646c3e87a184cd19184ff12695392a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:47.963328 23440 tablet_service.cc:1511] Processing CreateTablet for tablet 509f7e554df04f83aeffd51ec07607d5 (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:13:47.966907 23440 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 509f7e554df04f83aeffd51ec07607d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:47.871865 23290 tablet_service.cc:1511] Processing CreateTablet for tablet 0646c3e87a184cd19184ff12695392a7 (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:13:47.999972 23495 ts_tablet_manager.cc:1434] T b1a6e82689a84e36949e5efca6592772 P 288a46a90f26471584043331107dc0dd: Time spent starting tablet: real 0.120s	user 0.043s	sys 0.072s
I20260709 12:13:48.002482 23498 tablet_bootstrap.cc:492] T c1c10ca2f5924b7eb5422f0aee2f85c3 P 2904b089bdb249b78950db76f4a70e9f: No bootstrap required, opened a new log
I20260709 12:13:48.003691 23498 ts_tablet_manager.cc:1403] T c1c10ca2f5924b7eb5422f0aee2f85c3 P 2904b089bdb249b78950db76f4a70e9f: Time spent bootstrapping tablet: real 0.127s	user 0.039s	sys 0.030s
I20260709 12:13:48.007012 23495 tablet_bootstrap.cc:492] T 6d7d1c502ee24072a41a2a55cfc3a5fa P 288a46a90f26471584043331107dc0dd: Bootstrap starting.
I20260709 12:13:47.981470 23290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0646c3e87a184cd19184ff12695392a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:48.014987 23213 tablet_service.cc:1511] Processing CreateTablet for tablet 509f7e554df04f83aeffd51ec07607d5 (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:13:48.018226 23213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 509f7e554df04f83aeffd51ec07607d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:48.019025 23217 tablet_service.cc:1511] Processing CreateTablet for tablet 00335dfad3394f0c9689c0df8500bc9e (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:13:48.022442 23495 tablet_bootstrap.cc:654] T 6d7d1c502ee24072a41a2a55cfc3a5fa P 288a46a90f26471584043331107dc0dd: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:48.033900 23496 tablet_bootstrap.cc:654] T b1a6e82689a84e36949e5efca6592772 P 9ba0da223cf24c97bc7d225e25015924: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:48.030001 23291 tablet_service.cc:1511] Processing CreateTablet for tablet 00f9b2ddcf6e4a9bacf4a30c16a88765 (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:13:48.040175 23291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00f9b2ddcf6e4a9bacf4a30c16a88765. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:48.021713 23217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00335dfad3394f0c9689c0df8500bc9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:48.035099 23498 raft_consensus.cc:359] T c1c10ca2f5924b7eb5422f0aee2f85c3 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:48.060070 23498 raft_consensus.cc:385] T c1c10ca2f5924b7eb5422f0aee2f85c3 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:48.063797 23498 raft_consensus.cc:740] T c1c10ca2f5924b7eb5422f0aee2f85c3 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2904b089bdb249b78950db76f4a70e9f, State: Initialized, Role: FOLLOWER
I20260709 12:13:48.069388 23498 consensus_queue.cc:260] T c1c10ca2f5924b7eb5422f0aee2f85c3 P 2904b089bdb249b78950db76f4a70e9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
W20260709 12:13:48.083273 23253 tablet.cc:2406] T b1a6e82689a84e36949e5efca6592772 P 288a46a90f26471584043331107dc0dd: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:13:48.088042 23436 tablet_service.cc:1511] Processing CreateTablet for tablet 00f9b2ddcf6e4a9bacf4a30c16a88765 (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:13:48.090233 23495 tablet_bootstrap.cc:492] T 6d7d1c502ee24072a41a2a55cfc3a5fa P 288a46a90f26471584043331107dc0dd: No bootstrap required, opened a new log
I20260709 12:13:48.091869 23359 tablet_service.cc:1511] Processing CreateTablet for tablet 00f9b2ddcf6e4a9bacf4a30c16a88765 (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:13:48.095148 23495 ts_tablet_manager.cc:1403] T 6d7d1c502ee24072a41a2a55cfc3a5fa P 288a46a90f26471584043331107dc0dd: Time spent bootstrapping tablet: real 0.089s	user 0.029s	sys 0.008s
I20260709 12:13:48.091132 23497 tablet_bootstrap.cc:492] T b1a6e82689a84e36949e5efca6592772 P 3a9a63ca97694ebdb84bca730762d735: No bootstrap required, opened a new log
I20260709 12:13:48.098994 23497 ts_tablet_manager.cc:1403] T b1a6e82689a84e36949e5efca6592772 P 3a9a63ca97694ebdb84bca730762d735: Time spent bootstrapping tablet: real 0.325s	user 0.020s	sys 0.011s
I20260709 12:13:48.101680 23436 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00f9b2ddcf6e4a9bacf4a30c16a88765. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:48.102754 23500 raft_consensus.cc:493] T b1a6e82689a84e36949e5efca6592772 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:48.103888 23500 raft_consensus.cc:515] T b1a6e82689a84e36949e5efca6592772 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:48.107156 23359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00f9b2ddcf6e4a9bacf4a30c16a88765. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:48.117256 23497 raft_consensus.cc:359] T b1a6e82689a84e36949e5efca6592772 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:48.118512 23211 tablet_service.cc:1511] Processing CreateTablet for tablet 8771e0b5070c49c589f276c793f87727 (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:13:48.122782 23496 tablet_bootstrap.cc:492] T b1a6e82689a84e36949e5efca6592772 P 9ba0da223cf24c97bc7d225e25015924: No bootstrap required, opened a new log
I20260709 12:13:48.116557 23495 raft_consensus.cc:359] T 6d7d1c502ee24072a41a2a55cfc3a5fa P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:48.127444 23497 raft_consensus.cc:385] T b1a6e82689a84e36949e5efca6592772 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:48.127296 23500 leader_election.cc:290] T b1a6e82689a84e36949e5efca6592772 P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061), 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081)
I20260709 12:13:48.149000 23211 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8771e0b5070c49c589f276c793f87727. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:48.138293 23496 ts_tablet_manager.cc:1403] T b1a6e82689a84e36949e5efca6592772 P 9ba0da223cf24c97bc7d225e25015924: Time spent bootstrapping tablet: real 0.330s	user 0.022s	sys 0.019s
W20260709 12:13:48.156569 23173 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:13:48.151531 23287 tablet_service.cc:1511] Processing CreateTablet for tablet 8771e0b5070c49c589f276c793f87727 (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:13:48.182950 23287 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8771e0b5070c49c589f276c793f87727. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:48.195664 23496 raft_consensus.cc:359] T b1a6e82689a84e36949e5efca6592772 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:48.197257 23496 raft_consensus.cc:385] T b1a6e82689a84e36949e5efca6592772 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:48.150120 23360 tablet_service.cc:1511] Processing CreateTablet for tablet 8771e0b5070c49c589f276c793f87727 (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:13:48.164862 23497 raft_consensus.cc:740] T b1a6e82689a84e36949e5efca6592772 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a9a63ca97694ebdb84bca730762d735, State: Initialized, Role: FOLLOWER
I20260709 12:13:48.138541 23495 raft_consensus.cc:385] T 6d7d1c502ee24072a41a2a55cfc3a5fa P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:48.207847 23498 ts_tablet_manager.cc:1434] T c1c10ca2f5924b7eb5422f0aee2f85c3 P 2904b089bdb249b78950db76f4a70e9f: Time spent starting tablet: real 0.204s	user 0.026s	sys 0.002s
I20260709 12:13:48.219569 23360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8771e0b5070c49c589f276c793f87727. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:48.225186 23497 consensus_queue.cc:260] T b1a6e82689a84e36949e5efca6592772 P 3a9a63ca97694ebdb84bca730762d735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:48.228639 23212 tablet_service.cc:1511] Processing CreateTablet for tablet 859d30d8c3fb4a499256ffad6dc2d1cd (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:13:48.219796 23495 raft_consensus.cc:740] T 6d7d1c502ee24072a41a2a55cfc3a5fa P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 288a46a90f26471584043331107dc0dd, State: Initialized, Role: FOLLOWER
I20260709 12:13:48.217518 23496 raft_consensus.cc:740] T b1a6e82689a84e36949e5efca6592772 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ba0da223cf24c97bc7d225e25015924, State: Initialized, Role: FOLLOWER
I20260709 12:13:48.232339 23435 tablet_service.cc:1511] Processing CreateTablet for tablet 859d30d8c3fb4a499256ffad6dc2d1cd (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:13:48.242587 23284 tablet_service.cc:1511] Processing CreateTablet for tablet 859d30d8c3fb4a499256ffad6dc2d1cd (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:13:48.254388 23363 tablet_service.cc:1511] Processing CreateTablet for tablet a2f2a063cf2b4190826d81b2dcbf7709 (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:13:48.256035 23507 raft_consensus.cc:493] T c1c10ca2f5924b7eb5422f0aee2f85c3 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:48.274006 23435 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 859d30d8c3fb4a499256ffad6dc2d1cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:48.273068 23496 consensus_queue.cc:260] T b1a6e82689a84e36949e5efca6592772 P 9ba0da223cf24c97bc7d225e25015924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:48.274390 23214 tablet_service.cc:1511] Processing CreateTablet for tablet a2f2a063cf2b4190826d81b2dcbf7709 (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:13:48.258417 23437 tablet_service.cc:1511] Processing CreateTablet for tablet a2f2a063cf2b4190826d81b2dcbf7709 (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:13:48.276271 23507 raft_consensus.cc:515] T c1c10ca2f5924b7eb5422f0aee2f85c3 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:48.284190 23437 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2f2a063cf2b4190826d81b2dcbf7709. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:48.285831 23358 tablet_service.cc:1511] Processing CreateTablet for tablet 0411013dc7c347ada4fd2c2a0cf134bd (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:13:48.287766 23363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2f2a063cf2b4190826d81b2dcbf7709. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:48.283661 23284 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 859d30d8c3fb4a499256ffad6dc2d1cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:48.283917 23285 tablet_service.cc:1511] Processing CreateTablet for tablet 0411013dc7c347ada4fd2c2a0cf134bd (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:13:48.297654 23498 tablet_bootstrap.cc:492] T 6d7d1c502ee24072a41a2a55cfc3a5fa P 2904b089bdb249b78950db76f4a70e9f: Bootstrap starting.
I20260709 12:13:48.277642 23495 consensus_queue.cc:260] T 6d7d1c502ee24072a41a2a55cfc3a5fa P 288a46a90f26471584043331107dc0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:48.300451 23212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 859d30d8c3fb4a499256ffad6dc2d1cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:48.303730 23507 leader_election.cc:290] T c1c10ca2f5924b7eb5422f0aee2f85c3 P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 288a46a90f26471584043331107dc0dd (127.12.174.129:46159), 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061)
I20260709 12:13:48.335494 23358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0411013dc7c347ada4fd2c2a0cf134bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:48.358570 23496 ts_tablet_manager.cc:1434] T b1a6e82689a84e36949e5efca6592772 P 9ba0da223cf24c97bc7d225e25015924: Time spent starting tablet: real 0.169s	user 0.020s	sys 0.015s
I20260709 12:13:48.360469 23214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2f2a063cf2b4190826d81b2dcbf7709. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:48.385950 23285 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0411013dc7c347ada4fd2c2a0cf134bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:48.466347 23376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1a6e82689a84e36949e5efca6592772" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a9a63ca97694ebdb84bca730762d735" is_pre_election: true
I20260709 12:13:48.493485 23361 tablet_service.cc:1511] Processing CreateTablet for tablet d55aba14f62b41538fdb710117d67580 (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:13:48.505628 23434 tablet_service.cc:1511] Processing CreateTablet for tablet d55aba14f62b41538fdb710117d67580 (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:13:48.507362 23361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d55aba14f62b41538fdb710117d67580. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:48.508298 23434 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d55aba14f62b41538fdb710117d67580. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:48.483443 23495 ts_tablet_manager.cc:1434] T 6d7d1c502ee24072a41a2a55cfc3a5fa P 288a46a90f26471584043331107dc0dd: Time spent starting tablet: real 0.385s	user 0.021s	sys 0.008s
I20260709 12:13:48.493484 23359 tablet_service.cc:1511] Processing CreateTablet for tablet c3ac99f9dbb24693b97d3994ceb65955 (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:13:48.515583 23359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3ac99f9dbb24693b97d3994ceb65955. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:48.516458 23497 ts_tablet_manager.cc:1434] T b1a6e82689a84e36949e5efca6592772 P 3a9a63ca97694ebdb84bca730762d735: Time spent starting tablet: real 0.417s	user 0.021s	sys 0.021s
I20260709 12:13:48.473042 23433 tablet_service.cc:1511] Processing CreateTablet for tablet b1533753456b445991715da5158c921b (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:13:48.519491 23286 tablet_service.cc:1511] Processing CreateTablet for tablet c3ac99f9dbb24693b97d3994ceb65955 (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:13:48.520533 23433 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1533753456b445991715da5158c921b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:48.526099 23216 tablet_service.cc:1511] Processing CreateTablet for tablet b1533753456b445991715da5158c921b (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:13:48.530537 23497 tablet_bootstrap.cc:492] T 18f5de2825814c38a0bd15d4c962dbef P 3a9a63ca97694ebdb84bca730762d735: Bootstrap starting.
I20260709 12:13:48.534796 23440 tablet_service.cc:1511] Processing CreateTablet for tablet 0411013dc7c347ada4fd2c2a0cf134bd (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:13:48.530061 23209 tablet_service.cc:1511] Processing CreateTablet for tablet d55aba14f62b41538fdb710117d67580 (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:13:48.504031 23376 raft_consensus.cc:2468] T b1a6e82689a84e36949e5efca6592772 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 288a46a90f26471584043331107dc0dd in term 0.
I20260709 12:13:48.463395 23215 tablet_service.cc:1511] Processing CreateTablet for tablet c3ac99f9dbb24693b97d3994ceb65955 (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:13:48.545212 23500 raft_consensus.cc:493] T 6d7d1c502ee24072a41a2a55cfc3a5fa P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:48.546238 23500 raft_consensus.cc:515] T 6d7d1c502ee24072a41a2a55cfc3a5fa P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:48.551795 23495 tablet_bootstrap.cc:492] T ac854957ad6246c6b123638cfafeacd4 P 288a46a90f26471584043331107dc0dd: Bootstrap starting.
I20260709 12:13:48.552897 23192 leader_election.cc:304] T b1a6e82689a84e36949e5efca6592772 P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 288a46a90f26471584043331107dc0dd, 3a9a63ca97694ebdb84bca730762d735; no voters: 
I20260709 12:13:48.554678 23215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3ac99f9dbb24693b97d3994ceb65955. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:48.555790 23500 leader_election.cc:290] T 6d7d1c502ee24072a41a2a55cfc3a5fa P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789), 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061)
I20260709 12:13:48.556900 23500 raft_consensus.cc:2804] T b1a6e82689a84e36949e5efca6592772 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:48.559448 23216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1533753456b445991715da5158c921b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:48.557638 23500 raft_consensus.cc:493] T b1a6e82689a84e36949e5efca6592772 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:48.562507 23500 raft_consensus.cc:3060] T b1a6e82689a84e36949e5efca6592772 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:48.553001 23290 tablet_service.cc:1511] Processing CreateTablet for tablet 525cb2c0e02b473bba2e7025f5765db2 (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:13:48.498320 23496 tablet_bootstrap.cc:492] T ac854957ad6246c6b123638cfafeacd4 P 9ba0da223cf24c97bc7d225e25015924: Bootstrap starting.
I20260709 12:13:48.537585 23440 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0411013dc7c347ada4fd2c2a0cf134bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:48.461535 23289 tablet_service.cc:1511] Processing CreateTablet for tablet b1533753456b445991715da5158c921b (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:13:48.572579 23365 tablet_service.cc:1511] Processing CreateTablet for tablet 525cb2c0e02b473bba2e7025f5765db2 (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:13:48.595129 23450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1a6e82689a84e36949e5efca6592772" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba0da223cf24c97bc7d225e25015924" is_pre_election: true
I20260709 12:13:48.596799 23450 raft_consensus.cc:2468] T b1a6e82689a84e36949e5efca6592772 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 288a46a90f26471584043331107dc0dd in term 0.
I20260709 12:13:48.601802 23286 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3ac99f9dbb24693b97d3994ceb65955. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:48.616910 23209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d55aba14f62b41538fdb710117d67580. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:48.622166 23439 tablet_service.cc:1511] Processing CreateTablet for tablet 525cb2c0e02b473bba2e7025f5765db2 (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:13:48.625197 23439 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 525cb2c0e02b473bba2e7025f5765db2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:48.626219 23290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 525cb2c0e02b473bba2e7025f5765db2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:48.637804 23365 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 525cb2c0e02b473bba2e7025f5765db2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:48.646713 23289 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1533753456b445991715da5158c921b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:48.670779 23376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c10ca2f5924b7eb5422f0aee2f85c3" candidate_uuid: "2904b089bdb249b78950db76f4a70e9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a9a63ca97694ebdb84bca730762d735" is_pre_election: true
W20260709 12:13:48.675146 23267 leader_election.cc:343] T c1c10ca2f5924b7eb5422f0aee2f85c3 P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:48.702396 23498 tablet_bootstrap.cc:654] T 6d7d1c502ee24072a41a2a55cfc3a5fa P 2904b089bdb249b78950db76f4a70e9f: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:48.708539 23495 tablet_bootstrap.cc:654] T ac854957ad6246c6b123638cfafeacd4 P 288a46a90f26471584043331107dc0dd: Neither blocks nor log segments found. Creating new log.
W20260709 12:13:48.692687 23192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:40061, user_credentials={real_user=slave}} blocked reactor thread for 140272us
I20260709 12:13:48.725720 23364 tablet_service.cc:1511] Processing CreateTablet for tablet 92d63c0c6ef9452797da238708c39275 (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:13:48.731871 23364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92d63c0c6ef9452797da238708c39275. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:48.727434 23287 tablet_service.cc:1511] Processing CreateTablet for tablet 92d63c0c6ef9452797da238708c39275 (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:13:48.735630 23287 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92d63c0c6ef9452797da238708c39275. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:13:48.740767 23210 consensus_meta.cc:287] T 0646c3e87a184cd19184ff12695392a7 P 288a46a90f26471584043331107dc0dd: Time spent flushing consensus metadata: real 0.544s	user 0.014s	sys 0.006s
I20260709 12:13:48.742650 23376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d7d1c502ee24072a41a2a55cfc3a5fa" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a9a63ca97694ebdb84bca730762d735" is_pre_election: true
W20260709 12:13:48.753069 23192 leader_election.cc:343] T 6d7d1c502ee24072a41a2a55cfc3a5fa P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:48.755110 23435 tablet_service.cc:1511] Processing CreateTablet for tablet d34300c6c4f2447182942fb5ab8cc3c4 (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:13:48.757728 23435 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d34300c6c4f2447182942fb5ab8cc3c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:48.767700 23213 tablet_service.cc:1511] Processing CreateTablet for tablet d34300c6c4f2447182942fb5ab8cc3c4 (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:13:48.772393 23213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d34300c6c4f2447182942fb5ab8cc3c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:48.806046 23291 tablet_service.cc:1511] Processing CreateTablet for tablet d34300c6c4f2447182942fb5ab8cc3c4 (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:13:48.808652 23291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d34300c6c4f2447182942fb5ab8cc3c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:48.823782 23227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c10ca2f5924b7eb5422f0aee2f85c3" candidate_uuid: "2904b089bdb249b78950db76f4a70e9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "288a46a90f26471584043331107dc0dd" is_pre_election: true
I20260709 12:13:48.827782 23497 tablet_bootstrap.cc:654] T 18f5de2825814c38a0bd15d4c962dbef P 3a9a63ca97694ebdb84bca730762d735: Neither blocks nor log segments found. Creating new log.
W20260709 12:13:48.830772 23268 leader_election.cc:343] T c1c10ca2f5924b7eb5422f0aee2f85c3 P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:48.831653 23268 leader_election.cc:304] T c1c10ca2f5924b7eb5422f0aee2f85c3 P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2904b089bdb249b78950db76f4a70e9f; no voters: 288a46a90f26471584043331107dc0dd, 3a9a63ca97694ebdb84bca730762d735
I20260709 12:13:48.833796 23507 raft_consensus.cc:2749] T c1c10ca2f5924b7eb5422f0aee2f85c3 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:48.853379 23496 tablet_bootstrap.cc:654] T ac854957ad6246c6b123638cfafeacd4 P 9ba0da223cf24c97bc7d225e25015924: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:48.845476 23217 tablet_service.cc:1511] Processing CreateTablet for tablet 92d63c0c6ef9452797da238708c39275 (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:13:48.877645 23361 tablet_service.cc:1511] Processing CreateTablet for tablet d2afee7aeea24f85b4bfecc49efcf841 (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:13:48.879765 23217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92d63c0c6ef9452797da238708c39275. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:48.879895 23361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2afee7aeea24f85b4bfecc49efcf841. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:48.919741 23495 tablet_bootstrap.cc:492] T ac854957ad6246c6b123638cfafeacd4 P 288a46a90f26471584043331107dc0dd: No bootstrap required, opened a new log
I20260709 12:13:48.920928 23495 ts_tablet_manager.cc:1403] T ac854957ad6246c6b123638cfafeacd4 P 288a46a90f26471584043331107dc0dd: Time spent bootstrapping tablet: real 0.370s	user 0.029s	sys 0.007s
I20260709 12:13:48.937880 23500 raft_consensus.cc:515] T b1a6e82689a84e36949e5efca6592772 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:48.952363 23302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d7d1c502ee24072a41a2a55cfc3a5fa" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2904b089bdb249b78950db76f4a70e9f" is_pre_election: true
W20260709 12:13:48.956094 23192 leader_election.cc:343] T 6d7d1c502ee24072a41a2a55cfc3a5fa P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:48.957120 23192 leader_election.cc:304] T 6d7d1c502ee24072a41a2a55cfc3a5fa P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 288a46a90f26471584043331107dc0dd; no voters: 2904b089bdb249b78950db76f4a70e9f, 3a9a63ca97694ebdb84bca730762d735
I20260709 12:13:48.913203 23498 tablet_bootstrap.cc:492] T 6d7d1c502ee24072a41a2a55cfc3a5fa P 2904b089bdb249b78950db76f4a70e9f: No bootstrap required, opened a new log
I20260709 12:13:48.963464 23516 raft_consensus.cc:2749] T 6d7d1c502ee24072a41a2a55cfc3a5fa P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:48.994197 23498 ts_tablet_manager.cc:1403] T 6d7d1c502ee24072a41a2a55cfc3a5fa P 2904b089bdb249b78950db76f4a70e9f: Time spent bootstrapping tablet: real 0.697s	user 0.034s	sys 0.001s
I20260709 12:13:48.999137 23434 tablet_service.cc:1511] Processing CreateTablet for tablet d2afee7aeea24f85b4bfecc49efcf841 (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:13:49.000581 23376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1a6e82689a84e36949e5efca6592772" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a9a63ca97694ebdb84bca730762d735"
I20260709 12:13:49.003899 23376 raft_consensus.cc:3060] T b1a6e82689a84e36949e5efca6592772 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:49.009399 23434 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2afee7aeea24f85b4bfecc49efcf841. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:49.013164 23500 leader_election.cc:290] T b1a6e82689a84e36949e5efca6592772 P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 1 election: Requested vote from peers 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061), 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081)
I20260709 12:13:49.015273 23450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1a6e82689a84e36949e5efca6592772" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba0da223cf24c97bc7d225e25015924"
I20260709 12:13:49.016431 23450 raft_consensus.cc:3060] T b1a6e82689a84e36949e5efca6592772 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:49.018932 23495 raft_consensus.cc:359] T ac854957ad6246c6b123638cfafeacd4 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:49.020519 23495 raft_consensus.cc:385] T ac854957ad6246c6b123638cfafeacd4 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:49.021134 23495 raft_consensus.cc:740] T ac854957ad6246c6b123638cfafeacd4 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 288a46a90f26471584043331107dc0dd, State: Initialized, Role: FOLLOWER
I20260709 12:13:49.037469 23495 consensus_queue.cc:260] T ac854957ad6246c6b123638cfafeacd4 P 288a46a90f26471584043331107dc0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:49.050671 23497 tablet_bootstrap.cc:492] T 18f5de2825814c38a0bd15d4c962dbef P 3a9a63ca97694ebdb84bca730762d735: No bootstrap required, opened a new log
I20260709 12:13:49.051934 23497 ts_tablet_manager.cc:1403] T 18f5de2825814c38a0bd15d4c962dbef P 3a9a63ca97694ebdb84bca730762d735: Time spent bootstrapping tablet: real 0.533s	user 0.023s	sys 0.020s
I20260709 12:13:49.055038 23495 ts_tablet_manager.cc:1434] T ac854957ad6246c6b123638cfafeacd4 P 288a46a90f26471584043331107dc0dd: Time spent starting tablet: real 0.117s	user 0.010s	sys 0.005s
I20260709 12:13:49.063026 23498 raft_consensus.cc:359] T 6d7d1c502ee24072a41a2a55cfc3a5fa P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:49.064260 23498 raft_consensus.cc:385] T 6d7d1c502ee24072a41a2a55cfc3a5fa P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:49.064576 23496 tablet_bootstrap.cc:492] T ac854957ad6246c6b123638cfafeacd4 P 9ba0da223cf24c97bc7d225e25015924: No bootstrap required, opened a new log
I20260709 12:13:49.064625 23498 raft_consensus.cc:740] T 6d7d1c502ee24072a41a2a55cfc3a5fa P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2904b089bdb249b78950db76f4a70e9f, State: Initialized, Role: FOLLOWER
I20260709 12:13:49.065156 23497 raft_consensus.cc:359] T 18f5de2825814c38a0bd15d4c962dbef P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:49.066082 23496 ts_tablet_manager.cc:1403] T ac854957ad6246c6b123638cfafeacd4 P 9ba0da223cf24c97bc7d225e25015924: Time spent bootstrapping tablet: real 0.667s	user 0.027s	sys 0.007s
I20260709 12:13:49.066437 23497 raft_consensus.cc:385] T 18f5de2825814c38a0bd15d4c962dbef P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:49.067360 23497 raft_consensus.cc:740] T 18f5de2825814c38a0bd15d4c962dbef P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a9a63ca97694ebdb84bca730762d735, State: Initialized, Role: FOLLOWER
I20260709 12:13:49.066448 23498 consensus_queue.cc:260] T 6d7d1c502ee24072a41a2a55cfc3a5fa P 2904b089bdb249b78950db76f4a70e9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:49.068758 23497 consensus_queue.cc:260] T 18f5de2825814c38a0bd15d4c962dbef P 3a9a63ca97694ebdb84bca730762d735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:49.071714 23498 ts_tablet_manager.cc:1434] T 6d7d1c502ee24072a41a2a55cfc3a5fa P 2904b089bdb249b78950db76f4a70e9f: Time spent starting tablet: real 0.076s	user 0.009s	sys 0.004s
I20260709 12:13:49.073997 23450 raft_consensus.cc:2468] T b1a6e82689a84e36949e5efca6592772 P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 288a46a90f26471584043331107dc0dd in term 1.
I20260709 12:13:49.075410 23496 raft_consensus.cc:359] T ac854957ad6246c6b123638cfafeacd4 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:49.074818 23498 tablet_bootstrap.cc:492] T 18f5de2825814c38a0bd15d4c962dbef P 2904b089bdb249b78950db76f4a70e9f: Bootstrap starting.
I20260709 12:13:49.077359 23496 raft_consensus.cc:385] T ac854957ad6246c6b123638cfafeacd4 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:49.078307 23496 raft_consensus.cc:740] T ac854957ad6246c6b123638cfafeacd4 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ba0da223cf24c97bc7d225e25015924, State: Initialized, Role: FOLLOWER
I20260709 12:13:49.080181 23496 consensus_queue.cc:260] T ac854957ad6246c6b123638cfafeacd4 P 9ba0da223cf24c97bc7d225e25015924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:49.083916 23495 tablet_bootstrap.cc:492] T c1c10ca2f5924b7eb5422f0aee2f85c3 P 288a46a90f26471584043331107dc0dd: Bootstrap starting.
I20260709 12:13:49.084643 23497 ts_tablet_manager.cc:1434] T 18f5de2825814c38a0bd15d4c962dbef P 3a9a63ca97694ebdb84bca730762d735: Time spent starting tablet: real 0.032s	user 0.020s	sys 0.005s
I20260709 12:13:49.087352 23497 tablet_bootstrap.cc:492] T eeda1df5d1624932a606c0a80e69d33a P 3a9a63ca97694ebdb84bca730762d735: Bootstrap starting.
I20260709 12:13:49.138998 23191 leader_election.cc:304] T b1a6e82689a84e36949e5efca6592772 P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 288a46a90f26471584043331107dc0dd, 9ba0da223cf24c97bc7d225e25015924; no voters: 
I20260709 12:13:49.151680 23214 tablet_service.cc:1511] Processing CreateTablet for tablet d2afee7aeea24f85b4bfecc49efcf841 (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:13:49.158481 23214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2afee7aeea24f85b4bfecc49efcf841. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:49.171314 23363 tablet_service.cc:1511] Processing CreateTablet for tablet 8e5b2401420b4a25a6457b667110f778 (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:13:49.169253 23290 tablet_service.cc:1511] Processing CreateTablet for tablet 8e5b2401420b4a25a6457b667110f778 (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:13:49.176476 23363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e5b2401420b4a25a6457b667110f778. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:49.179088 23376 raft_consensus.cc:2468] T b1a6e82689a84e36949e5efca6592772 P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 288a46a90f26471584043331107dc0dd in term 1.
I20260709 12:13:49.093178 23498 tablet_bootstrap.cc:654] T 18f5de2825814c38a0bd15d4c962dbef P 2904b089bdb249b78950db76f4a70e9f: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:49.093346 23496 ts_tablet_manager.cc:1434] T ac854957ad6246c6b123638cfafeacd4 P 9ba0da223cf24c97bc7d225e25015924: Time spent starting tablet: real 0.026s	user 0.016s	sys 0.005s
I20260709 12:13:49.202538 23500 raft_consensus.cc:2804] T b1a6e82689a84e36949e5efca6592772 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:49.207823 23290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e5b2401420b4a25a6457b667110f778. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:49.204939 23500 raft_consensus.cc:697] T b1a6e82689a84e36949e5efca6592772 P 288a46a90f26471584043331107dc0dd [term 1 LEADER]: Becoming Leader. State: Replica: 288a46a90f26471584043331107dc0dd, State: Running, Role: LEADER
I20260709 12:13:49.215020 23500 consensus_queue.cc:237] T b1a6e82689a84e36949e5efca6592772 P 288a46a90f26471584043331107dc0dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:49.217484 23496 tablet_bootstrap.cc:492] T 18f5de2825814c38a0bd15d4c962dbef P 9ba0da223cf24c97bc7d225e25015924: Bootstrap starting.
I20260709 12:13:49.211427 23434 tablet_service.cc:1511] Processing CreateTablet for tablet 8e5b2401420b4a25a6457b667110f778 (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:13:49.239038 23434 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e5b2401420b4a25a6457b667110f778. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:49.233588 23497 tablet_bootstrap.cc:654] T eeda1df5d1624932a606c0a80e69d33a P 3a9a63ca97694ebdb84bca730762d735: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:49.240248 23496 tablet_bootstrap.cc:654] T 18f5de2825814c38a0bd15d4c962dbef P 9ba0da223cf24c97bc7d225e25015924: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:49.257593 23284 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:33402 (request call id 13) took 1017 ms. Trace:
I20260709 12:13:49.270926 23284 rpcz_store.cc:276] 0709 12:13:48.240226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:13:48.240580 (+   354us) service_pool.cc:224] Handling call
0709 12:13:48.282529 (+ 41949us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:13:48.282793 (+   264us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:13:48.761188 (+478395us) tablet_metadata.cc:665] Metadata flushed
0709 12:13:49.255411 (+494223us) tablet_replica.cc:206] Creating consensus instance
0709 12:13:49.257158 (+  1747us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:13:49.272267 23495 tablet_bootstrap.cc:654] T c1c10ca2f5924b7eb5422f0aee2f85c3 P 288a46a90f26471584043331107dc0dd: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:49.269349 23516 raft_consensus.cc:493] T ac854957ad6246c6b123638cfafeacd4 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:49.278079 23173 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:13:49.268081 23286 tablet_service.cc:1511] Processing CreateTablet for tablet b3e2bbccfb7f4da8baf42735151ff804 (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:13:49.267489 23215 tablet_service.cc:1511] Processing CreateTablet for tablet b3e2bbccfb7f4da8baf42735151ff804 (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:13:49.278923 23516 raft_consensus.cc:515] T ac854957ad6246c6b123638cfafeacd4 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:49.283099 23215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3e2bbccfb7f4da8baf42735151ff804. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:49.288527 23302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac854957ad6246c6b123638cfafeacd4" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2904b089bdb249b78950db76f4a70e9f" is_pre_election: true
I20260709 12:13:49.290175 23516 leader_election.cc:290] T ac854957ad6246c6b123638cfafeacd4 P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789), 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081)
I20260709 12:13:49.290769 23450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac854957ad6246c6b123638cfafeacd4" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba0da223cf24c97bc7d225e25015924" is_pre_election: true
I20260709 12:13:49.292657 23450 raft_consensus.cc:2468] T ac854957ad6246c6b123638cfafeacd4 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 288a46a90f26471584043331107dc0dd in term 0.
W20260709 12:13:49.293727 23192 leader_election.cc:343] T ac854957ad6246c6b123638cfafeacd4 P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:49.294224 23286 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3e2bbccfb7f4da8baf42735151ff804. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:49.299938 23191 leader_election.cc:304] T ac854957ad6246c6b123638cfafeacd4 P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 288a46a90f26471584043331107dc0dd, 9ba0da223cf24c97bc7d225e25015924; no voters: 2904b089bdb249b78950db76f4a70e9f
I20260709 12:13:49.301707 23516 raft_consensus.cc:2804] T ac854957ad6246c6b123638cfafeacd4 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:49.302486 23516 raft_consensus.cc:493] T ac854957ad6246c6b123638cfafeacd4 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:49.303198 23516 raft_consensus.cc:3060] T ac854957ad6246c6b123638cfafeacd4 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:49.334017 23361 tablet_service.cc:1511] Processing CreateTablet for tablet b3e2bbccfb7f4da8baf42735151ff804 (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:13:49.337109 23361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3e2bbccfb7f4da8baf42735151ff804. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:49.353307 23498 tablet_bootstrap.cc:492] T 18f5de2825814c38a0bd15d4c962dbef P 2904b089bdb249b78950db76f4a70e9f: No bootstrap required, opened a new log
I20260709 12:13:49.374243 23498 ts_tablet_manager.cc:1403] T 18f5de2825814c38a0bd15d4c962dbef P 2904b089bdb249b78950db76f4a70e9f: Time spent bootstrapping tablet: real 0.300s	user 0.025s	sys 0.023s
I20260709 12:13:49.395418 23507 raft_consensus.cc:493] T 6d7d1c502ee24072a41a2a55cfc3a5fa P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:49.396591 23507 raft_consensus.cc:515] T 6d7d1c502ee24072a41a2a55cfc3a5fa P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:49.386080 23124 catalog_manager.cc:5697] T b1a6e82689a84e36949e5efca6592772 P 288a46a90f26471584043331107dc0dd reported cstate change: term changed from 0 to 1, leader changed from <none> to 288a46a90f26471584043331107dc0dd (127.12.174.129). New cstate: current_term: 1 leader_uuid: "288a46a90f26471584043331107dc0dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:49.416236 23227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d7d1c502ee24072a41a2a55cfc3a5fa" candidate_uuid: "2904b089bdb249b78950db76f4a70e9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "288a46a90f26471584043331107dc0dd" is_pre_election: true
I20260709 12:13:49.416620 23376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d7d1c502ee24072a41a2a55cfc3a5fa" candidate_uuid: "2904b089bdb249b78950db76f4a70e9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a9a63ca97694ebdb84bca730762d735" is_pre_election: true
I20260709 12:13:49.417650 23227 raft_consensus.cc:2468] T 6d7d1c502ee24072a41a2a55cfc3a5fa P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2904b089bdb249b78950db76f4a70e9f in term 0.
W20260709 12:13:49.420068 23267 leader_election.cc:343] T 6d7d1c502ee24072a41a2a55cfc3a5fa P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:49.419950 23434 tablet_service.cc:1511] Processing CreateTablet for tablet 05b49011442c4131a4ac3c55feed5409 (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:13:49.423318 23434 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05b49011442c4131a4ac3c55feed5409. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:49.425616 23216 tablet_service.cc:1511] Processing CreateTablet for tablet 05b49011442c4131a4ac3c55feed5409 (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:13:49.432046 23216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05b49011442c4131a4ac3c55feed5409. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:49.435750 23291 tablet_service.cc:1511] Processing CreateTablet for tablet 05b49011442c4131a4ac3c55feed5409 (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:13:49.440032 23291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05b49011442c4131a4ac3c55feed5409. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:49.424674 23498 raft_consensus.cc:359] T 18f5de2825814c38a0bd15d4c962dbef P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:49.437178 23268 leader_election.cc:304] T 6d7d1c502ee24072a41a2a55cfc3a5fa P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 288a46a90f26471584043331107dc0dd, 2904b089bdb249b78950db76f4a70e9f; no voters: 3a9a63ca97694ebdb84bca730762d735
I20260709 12:13:49.426973 23507 leader_election.cc:290] T 6d7d1c502ee24072a41a2a55cfc3a5fa P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 288a46a90f26471584043331107dc0dd (127.12.174.129:46159), 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061)
I20260709 12:13:49.482270 23495 tablet_bootstrap.cc:492] T c1c10ca2f5924b7eb5422f0aee2f85c3 P 288a46a90f26471584043331107dc0dd: No bootstrap required, opened a new log
I20260709 12:13:49.451527 23498 raft_consensus.cc:385] T 18f5de2825814c38a0bd15d4c962dbef P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:49.499955 23497 tablet_bootstrap.cc:492] T eeda1df5d1624932a606c0a80e69d33a P 3a9a63ca97694ebdb84bca730762d735: No bootstrap required, opened a new log
I20260709 12:13:49.497504 23359 tablet_service.cc:1511] Processing CreateTablet for tablet 919076caf9f94cd8b631ea3e60dc3593 (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:13:49.498786 23495 ts_tablet_manager.cc:1403] T c1c10ca2f5924b7eb5422f0aee2f85c3 P 288a46a90f26471584043331107dc0dd: Time spent bootstrapping tablet: real 0.415s	user 0.037s	sys 0.037s
I20260709 12:13:49.510352 23497 ts_tablet_manager.cc:1403] T eeda1df5d1624932a606c0a80e69d33a P 3a9a63ca97694ebdb84bca730762d735: Time spent bootstrapping tablet: real 0.424s	user 0.056s	sys 0.015s
I20260709 12:13:49.490423 23507 raft_consensus.cc:2804] T 6d7d1c502ee24072a41a2a55cfc3a5fa P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:49.458571 23516 raft_consensus.cc:515] T ac854957ad6246c6b123638cfafeacd4 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:49.502378 23498 raft_consensus.cc:740] T 18f5de2825814c38a0bd15d4c962dbef P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2904b089bdb249b78950db76f4a70e9f, State: Initialized, Role: FOLLOWER
I20260709 12:13:49.518486 23507 raft_consensus.cc:493] T 6d7d1c502ee24072a41a2a55cfc3a5fa P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:49.528677 23497 raft_consensus.cc:359] T eeda1df5d1624932a606c0a80e69d33a P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:49.531052 23497 raft_consensus.cc:385] T eeda1df5d1624932a606c0a80e69d33a P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:49.531971 23497 raft_consensus.cc:740] T eeda1df5d1624932a606c0a80e69d33a P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a9a63ca97694ebdb84bca730762d735, State: Initialized, Role: FOLLOWER
I20260709 12:13:49.522599 23507 raft_consensus.cc:3060] T 6d7d1c502ee24072a41a2a55cfc3a5fa P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:49.533861 23496 tablet_bootstrap.cc:492] T 18f5de2825814c38a0bd15d4c962dbef P 9ba0da223cf24c97bc7d225e25015924: No bootstrap required, opened a new log
I20260709 12:13:49.534017 23435 tablet_service.cc:1511] Processing CreateTablet for tablet 919076caf9f94cd8b631ea3e60dc3593 (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:13:49.538084 23435 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 919076caf9f94cd8b631ea3e60dc3593. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:49.534425 23359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 919076caf9f94cd8b631ea3e60dc3593. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:49.521891 23498 consensus_queue.cc:260] T 18f5de2825814c38a0bd15d4c962dbef P 2904b089bdb249b78950db76f4a70e9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:49.545491 23217 tablet_service.cc:1511] Processing CreateTablet for tablet 919076caf9f94cd8b631ea3e60dc3593 (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:13:49.548539 23217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 919076caf9f94cd8b631ea3e60dc3593. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:49.535408 23496 ts_tablet_manager.cc:1403] T 18f5de2825814c38a0bd15d4c962dbef P 9ba0da223cf24c97bc7d225e25015924: Time spent bootstrapping tablet: real 0.342s	user 0.043s	sys 0.032s
I20260709 12:13:49.558507 23302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac854957ad6246c6b123638cfafeacd4" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2904b089bdb249b78950db76f4a70e9f"
W20260709 12:13:49.562564 23192 leader_election.cc:343] T ac854957ad6246c6b123638cfafeacd4 P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:49.529611 23495 raft_consensus.cc:359] T c1c10ca2f5924b7eb5422f0aee2f85c3 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:49.565937 23495 raft_consensus.cc:385] T c1c10ca2f5924b7eb5422f0aee2f85c3 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:49.566685 23495 raft_consensus.cc:740] T c1c10ca2f5924b7eb5422f0aee2f85c3 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 288a46a90f26471584043331107dc0dd, State: Initialized, Role: FOLLOWER
I20260709 12:13:49.568398 23495 consensus_queue.cc:260] T c1c10ca2f5924b7eb5422f0aee2f85c3 P 288a46a90f26471584043331107dc0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:49.569444 23496 raft_consensus.cc:359] T 18f5de2825814c38a0bd15d4c962dbef P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:49.579190 23496 raft_consensus.cc:385] T 18f5de2825814c38a0bd15d4c962dbef P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:49.550768 23498 ts_tablet_manager.cc:1434] T 18f5de2825814c38a0bd15d4c962dbef P 2904b089bdb249b78950db76f4a70e9f: Time spent starting tablet: real 0.162s	user 0.015s	sys 0.003s
I20260709 12:13:49.574385 23450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac854957ad6246c6b123638cfafeacd4" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba0da223cf24c97bc7d225e25015924"
I20260709 12:13:49.580008 23496 raft_consensus.cc:740] T 18f5de2825814c38a0bd15d4c962dbef P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ba0da223cf24c97bc7d225e25015924, State: Initialized, Role: FOLLOWER
I20260709 12:13:49.581041 23450 raft_consensus.cc:3060] T ac854957ad6246c6b123638cfafeacd4 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:49.583122 23496 consensus_queue.cc:260] T 18f5de2825814c38a0bd15d4c962dbef P 9ba0da223cf24c97bc7d225e25015924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:49.584851 23290 tablet_service.cc:1511] Processing CreateTablet for tablet fec017d49ead425fbd037e7d1d238e5b (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:13:49.590615 23523 raft_consensus.cc:493] T 18f5de2825814c38a0bd15d4c962dbef P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:49.591869 23523 raft_consensus.cc:515] T 18f5de2825814c38a0bd15d4c962dbef P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:49.579905 23497 consensus_queue.cc:260] T eeda1df5d1624932a606c0a80e69d33a P 3a9a63ca97694ebdb84bca730762d735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:49.600427 23495 ts_tablet_manager.cc:1434] T c1c10ca2f5924b7eb5422f0aee2f85c3 P 288a46a90f26471584043331107dc0dd: Time spent starting tablet: real 0.090s	user 0.009s	sys 0.006s
W20260709 12:13:49.604079 23268 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:46159, user_credentials={real_user=slave}} blocked reactor thread for 183117us
I20260709 12:13:49.607405 23498 tablet_bootstrap.cc:492] T 87c5024fe7274811b9598e504f3963a7 P 2904b089bdb249b78950db76f4a70e9f: Bootstrap starting.
I20260709 12:13:49.580996 23516 leader_election.cc:290] T ac854957ad6246c6b123638cfafeacd4 P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 1 election: Requested vote from peers 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789), 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081)
I20260709 12:13:49.589108 23290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fec017d49ead425fbd037e7d1d238e5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:49.637458 23495 tablet_bootstrap.cc:492] T 99bc4210d0b44dd282a5bf7606d122af P 288a46a90f26471584043331107dc0dd: Bootstrap starting.
I20260709 12:13:49.614178 23523 leader_election.cc:290] T 18f5de2825814c38a0bd15d4c962dbef P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789), 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081)
I20260709 12:13:49.658645 23524 raft_consensus.cc:493] T 18f5de2825814c38a0bd15d4c962dbef P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:49.659948 23524 raft_consensus.cc:515] T 18f5de2825814c38a0bd15d4c962dbef P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:49.666208 23496 ts_tablet_manager.cc:1434] T 18f5de2825814c38a0bd15d4c962dbef P 9ba0da223cf24c97bc7d225e25015924: Time spent starting tablet: real 0.115s	user 0.013s	sys 0.004s
I20260709 12:13:49.668146 23433 tablet_service.cc:1511] Processing CreateTablet for tablet fec017d49ead425fbd037e7d1d238e5b (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:13:49.670035 23496 tablet_bootstrap.cc:492] T 87c5024fe7274811b9598e504f3963a7 P 9ba0da223cf24c97bc7d225e25015924: Bootstrap starting.
I20260709 12:13:49.672601 23433 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fec017d49ead425fbd037e7d1d238e5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:49.676735 23524 leader_election.cc:290] T 18f5de2825814c38a0bd15d4c962dbef P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789), 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061)
I20260709 12:13:49.667990 23363 tablet_service.cc:1511] Processing CreateTablet for tablet fec017d49ead425fbd037e7d1d238e5b (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:13:49.717617 23363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fec017d49ead425fbd037e7d1d238e5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:49.742738 23450 raft_consensus.cc:2468] T ac854957ad6246c6b123638cfafeacd4 P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 288a46a90f26471584043331107dc0dd in term 1.
I20260709 12:13:49.739773 23497 ts_tablet_manager.cc:1434] T eeda1df5d1624932a606c0a80e69d33a P 3a9a63ca97694ebdb84bca730762d735: Time spent starting tablet: real 0.228s	user 0.018s	sys 0.023s
I20260709 12:13:49.732122 23215 tablet_service.cc:1511] Processing CreateTablet for tablet d85273afe57c4f35bb72827d1c5879eb (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:13:49.756948 23507 raft_consensus.cc:515] T 6d7d1c502ee24072a41a2a55cfc3a5fa P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:49.767148 23516 consensus_queue.cc:1048] T b1a6e82689a84e36949e5efca6592772 P 288a46a90f26471584043331107dc0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:49.770834 23215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d85273afe57c4f35bb72827d1c5879eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:49.771512 23191 leader_election.cc:304] T ac854957ad6246c6b123638cfafeacd4 P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 288a46a90f26471584043331107dc0dd, 9ba0da223cf24c97bc7d225e25015924; no voters: 2904b089bdb249b78950db76f4a70e9f
I20260709 12:13:49.772773 23500 raft_consensus.cc:2804] T ac854957ad6246c6b123638cfafeacd4 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:49.794835 23361 tablet_service.cc:1511] Processing CreateTablet for tablet d85273afe57c4f35bb72827d1c5879eb (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:13:49.797674 23361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d85273afe57c4f35bb72827d1c5879eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:49.777119 23495 tablet_bootstrap.cc:654] T 99bc4210d0b44dd282a5bf7606d122af P 288a46a90f26471584043331107dc0dd: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:49.820243 23227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d7d1c502ee24072a41a2a55cfc3a5fa" candidate_uuid: "2904b089bdb249b78950db76f4a70e9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "288a46a90f26471584043331107dc0dd"
I20260709 12:13:49.821725 23227 raft_consensus.cc:3060] T 6d7d1c502ee24072a41a2a55cfc3a5fa P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:49.822011 23287 tablet_service.cc:1511] Processing CreateTablet for tablet d85273afe57c4f35bb72827d1c5879eb (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:13:49.824837 23287 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d85273afe57c4f35bb72827d1c5879eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:49.825289 23498 tablet_bootstrap.cc:654] T 87c5024fe7274811b9598e504f3963a7 P 2904b089bdb249b78950db76f4a70e9f: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:49.830607 23214 tablet_service.cc:1511] Processing CreateTablet for tablet 9f2438f73a8e4760b7b37c5330853b72 (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:13:49.839287 23497 tablet_bootstrap.cc:492] T c1c10ca2f5924b7eb5422f0aee2f85c3 P 3a9a63ca97694ebdb84bca730762d735: Bootstrap starting.
I20260709 12:13:49.839964 23533 raft_consensus.cc:493] T eeda1df5d1624932a606c0a80e69d33a P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:49.841454 23434 tablet_service.cc:1511] Processing CreateTablet for tablet 9f2438f73a8e4760b7b37c5330853b72 (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:13:49.844092 23434 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f2438f73a8e4760b7b37c5330853b72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:49.846410 23507 leader_election.cc:290] T 6d7d1c502ee24072a41a2a55cfc3a5fa P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 1 election: Requested vote from peers 288a46a90f26471584043331107dc0dd (127.12.174.129:46159), 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061)
I20260709 12:13:49.840905 23533 raft_consensus.cc:515] T eeda1df5d1624932a606c0a80e69d33a P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:49.854974 23214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f2438f73a8e4760b7b37c5330853b72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:49.872730 23289 tablet_service.cc:1511] Processing CreateTablet for tablet 9f2438f73a8e4760b7b37c5330853b72 (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:13:49.875569 23531 raft_consensus.cc:493] T 18f5de2825814c38a0bd15d4c962dbef P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:49.875855 23289 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f2438f73a8e4760b7b37c5330853b72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:49.876930 23531 raft_consensus.cc:515] T 18f5de2825814c38a0bd15d4c962dbef P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:49.901074 23375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d7d1c502ee24072a41a2a55cfc3a5fa" candidate_uuid: "2904b089bdb249b78950db76f4a70e9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a9a63ca97694ebdb84bca730762d735"
W20260709 12:13:49.904956 23267 leader_election.cc:343] T 6d7d1c502ee24072a41a2a55cfc3a5fa P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:49.905356 23542 consensus_queue.cc:1048] T b1a6e82689a84e36949e5efca6592772 P 288a46a90f26471584043331107dc0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:49.854318 23500 raft_consensus.cc:697] T ac854957ad6246c6b123638cfafeacd4 P 288a46a90f26471584043331107dc0dd [term 1 LEADER]: Becoming Leader. State: Replica: 288a46a90f26471584043331107dc0dd, State: Running, Role: LEADER
I20260709 12:13:49.940237 23365 tablet_service.cc:1511] Processing CreateTablet for tablet 7754f065b43946f0a3aca8a75cb61273 (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:13:49.943836 23365 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7754f065b43946f0a3aca8a75cb61273. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:49.947732 23496 tablet_bootstrap.cc:654] T 87c5024fe7274811b9598e504f3963a7 P 9ba0da223cf24c97bc7d225e25015924: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:49.949414 23439 tablet_service.cc:1511] Processing CreateTablet for tablet 7754f065b43946f0a3aca8a75cb61273 (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:13:49.951846 23533 leader_election.cc:290] T eeda1df5d1624932a606c0a80e69d33a P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789), 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081)
I20260709 12:13:49.952102 23439 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7754f065b43946f0a3aca8a75cb61273. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:49.952620 23375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f5de2825814c38a0bd15d4c962dbef" candidate_uuid: "2904b089bdb249b78950db76f4a70e9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a9a63ca97694ebdb84bca730762d735" is_pre_election: true
I20260709 12:13:49.960688 23375 raft_consensus.cc:2468] T 18f5de2825814c38a0bd15d4c962dbef P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2904b089bdb249b78950db76f4a70e9f in term 0.
I20260709 12:13:49.939247 23500 consensus_queue.cc:237] T ac854957ad6246c6b123638cfafeacd4 P 288a46a90f26471584043331107dc0dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:49.985544 23542 raft_consensus.cc:493] T c1c10ca2f5924b7eb5422f0aee2f85c3 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:49.986671 23542 raft_consensus.cc:515] T c1c10ca2f5924b7eb5422f0aee2f85c3 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:49.984597 23267 leader_election.cc:304] T 18f5de2825814c38a0bd15d4c962dbef P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2904b089bdb249b78950db76f4a70e9f, 3a9a63ca97694ebdb84bca730762d735; no voters: 
I20260709 12:13:49.998615 23507 raft_consensus.cc:2804] T 18f5de2825814c38a0bd15d4c962dbef P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:49.999248 23507 raft_consensus.cc:493] T 18f5de2825814c38a0bd15d4c962dbef P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:49.999783 23507 raft_consensus.cc:3060] T 18f5de2825814c38a0bd15d4c962dbef P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:49.997416 23497 tablet_bootstrap.cc:654] T c1c10ca2f5924b7eb5422f0aee2f85c3 P 3a9a63ca97694ebdb84bca730762d735: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:50.006542 23531 leader_election.cc:290] T 18f5de2825814c38a0bd15d4c962dbef P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061), 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081)
I20260709 12:13:50.040541 23216 tablet_service.cc:1511] Processing CreateTablet for tablet 7754f065b43946f0a3aca8a75cb61273 (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:13:50.044806 23542 leader_election.cc:290] T c1c10ca2f5924b7eb5422f0aee2f85c3 P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789), 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061)
I20260709 12:13:50.047055 23375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c10ca2f5924b7eb5422f0aee2f85c3" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a9a63ca97694ebdb84bca730762d735" is_pre_election: true
W20260709 12:13:50.050347 23192 leader_election.cc:343] T c1c10ca2f5924b7eb5422f0aee2f85c3 P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:50.051913 23216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7754f065b43946f0a3aca8a75cb61273. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:50.061309 23291 tablet_service.cc:1511] Processing CreateTablet for tablet 94b9ff7f93dc4114b7c59ecfc0fcc9a7 (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:13:50.062016 23302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f5de2825814c38a0bd15d4c962dbef" candidate_uuid: "3a9a63ca97694ebdb84bca730762d735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2904b089bdb249b78950db76f4a70e9f" is_pre_election: true
I20260709 12:13:50.063196 23291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94b9ff7f93dc4114b7c59ecfc0fcc9a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:50.063515 23301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda1df5d1624932a606c0a80e69d33a" candidate_uuid: "3a9a63ca97694ebdb84bca730762d735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2904b089bdb249b78950db76f4a70e9f" is_pre_election: true
W20260709 12:13:50.065883 23341 leader_election.cc:343] T eeda1df5d1624932a606c0a80e69d33a P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:50.077222 23495 tablet_bootstrap.cc:492] T 99bc4210d0b44dd282a5bf7606d122af P 288a46a90f26471584043331107dc0dd: No bootstrap required, opened a new log
I20260709 12:13:50.081524 23376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f5de2825814c38a0bd15d4c962dbef" candidate_uuid: "9ba0da223cf24c97bc7d225e25015924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a9a63ca97694ebdb84bca730762d735" is_pre_election: true
I20260709 12:13:50.082463 23376 raft_consensus.cc:2468] T 18f5de2825814c38a0bd15d4c962dbef P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ba0da223cf24c97bc7d225e25015924 in term 0.
I20260709 12:13:50.084087 23415 leader_election.cc:304] T 18f5de2825814c38a0bd15d4c962dbef P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a9a63ca97694ebdb84bca730762d735, 9ba0da223cf24c97bc7d225e25015924; no voters: 
I20260709 12:13:50.081278 23227 raft_consensus.cc:2468] T 6d7d1c502ee24072a41a2a55cfc3a5fa P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2904b089bdb249b78950db76f4a70e9f in term 1.
I20260709 12:13:50.085166 23524 raft_consensus.cc:2804] T 18f5de2825814c38a0bd15d4c962dbef P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:50.097965 23524 raft_consensus.cc:493] T 18f5de2825814c38a0bd15d4c962dbef P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:50.101539 23524 raft_consensus.cc:3060] T 18f5de2825814c38a0bd15d4c962dbef P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:50.102409 23450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f5de2825814c38a0bd15d4c962dbef" candidate_uuid: "3a9a63ca97694ebdb84bca730762d735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba0da223cf24c97bc7d225e25015924" is_pre_election: true
I20260709 12:13:50.096330 23495 ts_tablet_manager.cc:1403] T 99bc4210d0b44dd282a5bf7606d122af P 288a46a90f26471584043331107dc0dd: Time spent bootstrapping tablet: real 0.460s	user 0.039s	sys 0.044s
I20260709 12:13:50.117377 23363 tablet_service.cc:1511] Processing CreateTablet for tablet 94b9ff7f93dc4114b7c59ecfc0fcc9a7 (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:13:50.119216 23363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94b9ff7f93dc4114b7c59ecfc0fcc9a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:50.122341 23268 leader_election.cc:304] T 6d7d1c502ee24072a41a2a55cfc3a5fa P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 288a46a90f26471584043331107dc0dd, 2904b089bdb249b78950db76f4a70e9f; no voters: 3a9a63ca97694ebdb84bca730762d735
I20260709 12:13:50.123420 23531 raft_consensus.cc:2804] T 6d7d1c502ee24072a41a2a55cfc3a5fa P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:50.097519 23507 raft_consensus.cc:515] T 18f5de2825814c38a0bd15d4c962dbef P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:50.130908 23301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c10ca2f5924b7eb5422f0aee2f85c3" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2904b089bdb249b78950db76f4a70e9f" is_pre_election: true
I20260709 12:13:50.132045 23301 raft_consensus.cc:2468] T c1c10ca2f5924b7eb5422f0aee2f85c3 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 288a46a90f26471584043331107dc0dd in term 0.
I20260709 12:13:50.135455 23302 raft_consensus.cc:2393] T 18f5de2825814c38a0bd15d4c962dbef P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3a9a63ca97694ebdb84bca730762d735 in current term 1: Already voted for candidate 2904b089bdb249b78950db76f4a70e9f in this term.
I20260709 12:13:50.137168 23495 raft_consensus.cc:359] T 99bc4210d0b44dd282a5bf7606d122af P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:50.138188 23496 tablet_bootstrap.cc:492] T 87c5024fe7274811b9598e504f3963a7 P 9ba0da223cf24c97bc7d225e25015924: No bootstrap required, opened a new log
I20260709 12:13:50.138852 23496 ts_tablet_manager.cc:1403] T 87c5024fe7274811b9598e504f3963a7 P 9ba0da223cf24c97bc7d225e25015924: Time spent bootstrapping tablet: real 0.470s	user 0.030s	sys 0.005s
I20260709 12:13:50.142369 23192 leader_election.cc:304] T c1c10ca2f5924b7eb5422f0aee2f85c3 P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 288a46a90f26471584043331107dc0dd, 2904b089bdb249b78950db76f4a70e9f; no voters: 3a9a63ca97694ebdb84bca730762d735
I20260709 12:13:50.142719 23449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda1df5d1624932a606c0a80e69d33a" candidate_uuid: "3a9a63ca97694ebdb84bca730762d735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba0da223cf24c97bc7d225e25015924" is_pre_election: true
I20260709 12:13:50.143630 23542 raft_consensus.cc:2804] T c1c10ca2f5924b7eb5422f0aee2f85c3 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:50.138135 23495 raft_consensus.cc:385] T 99bc4210d0b44dd282a5bf7606d122af P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:50.151232 23435 tablet_service.cc:1511] Processing CreateTablet for tablet 94b9ff7f93dc4114b7c59ecfc0fcc9a7 (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
W20260709 12:13:50.155057 23340 leader_election.cc:343] T eeda1df5d1624932a606c0a80e69d33a P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:50.155668 23340 leader_election.cc:304] T eeda1df5d1624932a606c0a80e69d33a P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3a9a63ca97694ebdb84bca730762d735; no voters: 2904b089bdb249b78950db76f4a70e9f, 9ba0da223cf24c97bc7d225e25015924
I20260709 12:13:50.156531 23217 tablet_service.cc:1511] Processing CreateTablet for tablet ec2c01c273894e73b6a2ab39e0132286 (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:13:50.157056 23533 raft_consensus.cc:2749] T eeda1df5d1624932a606c0a80e69d33a P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:50.144088 23542 raft_consensus.cc:493] T c1c10ca2f5924b7eb5422f0aee2f85c3 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:50.158075 23542 raft_consensus.cc:3060] T c1c10ca2f5924b7eb5422f0aee2f85c3 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:50.155459 23435 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94b9ff7f93dc4114b7c59ecfc0fcc9a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:50.163585 23375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f5de2825814c38a0bd15d4c962dbef" candidate_uuid: "2904b089bdb249b78950db76f4a70e9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a9a63ca97694ebdb84bca730762d735"
I20260709 12:13:50.158185 23217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec2c01c273894e73b6a2ab39e0132286. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:50.163437 23302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f5de2825814c38a0bd15d4c962dbef" candidate_uuid: "9ba0da223cf24c97bc7d225e25015924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2904b089bdb249b78950db76f4a70e9f" is_pre_election: true
I20260709 12:13:50.165266 23302 raft_consensus.cc:2393] T 18f5de2825814c38a0bd15d4c962dbef P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ba0da223cf24c97bc7d225e25015924 in current term 1: Already voted for candidate 2904b089bdb249b78950db76f4a70e9f in this term.
I20260709 12:13:50.156840 23497 tablet_bootstrap.cc:492] T c1c10ca2f5924b7eb5422f0aee2f85c3 P 3a9a63ca97694ebdb84bca730762d735: No bootstrap required, opened a new log
I20260709 12:13:50.166087 23497 ts_tablet_manager.cc:1403] T c1c10ca2f5924b7eb5422f0aee2f85c3 P 3a9a63ca97694ebdb84bca730762d735: Time spent bootstrapping tablet: real 0.327s	user 0.025s	sys 0.020s
I20260709 12:13:50.164355 23375 raft_consensus.cc:3060] T 18f5de2825814c38a0bd15d4c962dbef P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:50.171515 23498 tablet_bootstrap.cc:492] T 87c5024fe7274811b9598e504f3963a7 P 2904b089bdb249b78950db76f4a70e9f: No bootstrap required, opened a new log
I20260709 12:13:50.175729 23498 ts_tablet_manager.cc:1403] T 87c5024fe7274811b9598e504f3963a7 P 2904b089bdb249b78950db76f4a70e9f: Time spent bootstrapping tablet: real 0.569s	user 0.031s	sys 0.014s
I20260709 12:13:50.174633 23496 raft_consensus.cc:359] T 87c5024fe7274811b9598e504f3963a7 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:50.174950 23286 tablet_service.cc:1511] Processing CreateTablet for tablet ec2c01c273894e73b6a2ab39e0132286 (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:13:50.176440 23496 raft_consensus.cc:385] T 87c5024fe7274811b9598e504f3963a7 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:50.176800 23496 raft_consensus.cc:740] T 87c5024fe7274811b9598e504f3963a7 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ba0da223cf24c97bc7d225e25015924, State: Initialized, Role: FOLLOWER
I20260709 12:13:50.177435 23286 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec2c01c273894e73b6a2ab39e0132286. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:50.182684 23496 consensus_queue.cc:260] T 87c5024fe7274811b9598e504f3963a7 P 9ba0da223cf24c97bc7d225e25015924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:50.151162 23495 raft_consensus.cc:740] T 99bc4210d0b44dd282a5bf7606d122af P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 288a46a90f26471584043331107dc0dd, State: Initialized, Role: FOLLOWER
I20260709 12:13:50.183944 23498 raft_consensus.cc:359] T 87c5024fe7274811b9598e504f3963a7 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:50.198629 23498 raft_consensus.cc:385] T 87c5024fe7274811b9598e504f3963a7 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:50.199015 23498 raft_consensus.cc:740] T 87c5024fe7274811b9598e504f3963a7 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2904b089bdb249b78950db76f4a70e9f, State: Initialized, Role: FOLLOWER
I20260709 12:13:50.200191 23498 consensus_queue.cc:260] T 87c5024fe7274811b9598e504f3963a7 P 2904b089bdb249b78950db76f4a70e9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:50.151791 23531 raft_consensus.cc:697] T 6d7d1c502ee24072a41a2a55cfc3a5fa P 2904b089bdb249b78950db76f4a70e9f [term 1 LEADER]: Becoming Leader. State: Replica: 2904b089bdb249b78950db76f4a70e9f, State: Running, Role: LEADER
I20260709 12:13:50.208388 23524 raft_consensus.cc:515] T 18f5de2825814c38a0bd15d4c962dbef P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:50.214130 23359 tablet_service.cc:1511] Processing CreateTablet for tablet ec2c01c273894e73b6a2ab39e0132286 (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:13:50.214404 23214 tablet_service.cc:1511] Processing CreateTablet for tablet 9a21be1df2964860b89acefd66f6fbde (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:13:50.216084 23214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a21be1df2964860b89acefd66f6fbde. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:50.211056 23439 tablet_service.cc:1511] Processing CreateTablet for tablet 9a21be1df2964860b89acefd66f6fbde (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:13:50.219339 23439 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a21be1df2964860b89acefd66f6fbde. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:50.220093 23542 raft_consensus.cc:515] T c1c10ca2f5924b7eb5422f0aee2f85c3 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:50.226212 23495 consensus_queue.cc:260] T 99bc4210d0b44dd282a5bf7606d122af P 288a46a90f26471584043331107dc0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:50.230881 23531 consensus_queue.cc:237] T 6d7d1c502ee24072a41a2a55cfc3a5fa P 2904b089bdb249b78950db76f4a70e9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:50.236389 23497 raft_consensus.cc:359] T c1c10ca2f5924b7eb5422f0aee2f85c3 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:50.237319 23497 raft_consensus.cc:385] T c1c10ca2f5924b7eb5422f0aee2f85c3 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:50.240298 23542 leader_election.cc:290] T c1c10ca2f5924b7eb5422f0aee2f85c3 P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 1 election: Requested vote from peers 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789), 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061)
I20260709 12:13:50.242341 23302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c10ca2f5924b7eb5422f0aee2f85c3" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2904b089bdb249b78950db76f4a70e9f"
I20260709 12:13:50.243103 23302 raft_consensus.cc:3060] T c1c10ca2f5924b7eb5422f0aee2f85c3 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:50.250710 23450 raft_consensus.cc:2393] T 18f5de2825814c38a0bd15d4c962dbef P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3a9a63ca97694ebdb84bca730762d735 in current term 1: Already voted for candidate 9ba0da223cf24c97bc7d225e25015924 in this term.
I20260709 12:13:50.251344 23448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f5de2825814c38a0bd15d4c962dbef" candidate_uuid: "2904b089bdb249b78950db76f4a70e9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba0da223cf24c97bc7d225e25015924" is_pre_election: true
I20260709 12:13:50.252329 23448 raft_consensus.cc:2393] T 18f5de2825814c38a0bd15d4c962dbef P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2904b089bdb249b78950db76f4a70e9f in current term 1: Already voted for candidate 9ba0da223cf24c97bc7d225e25015924 in this term.
I20260709 12:13:50.253831 23340 leader_election.cc:304] T 18f5de2825814c38a0bd15d4c962dbef P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3a9a63ca97694ebdb84bca730762d735; no voters: 2904b089bdb249b78950db76f4a70e9f, 9ba0da223cf24c97bc7d225e25015924
I20260709 12:13:50.254719 23448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f5de2825814c38a0bd15d4c962dbef" candidate_uuid: "2904b089bdb249b78950db76f4a70e9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba0da223cf24c97bc7d225e25015924"
I20260709 12:13:50.255599 23448 raft_consensus.cc:2393] T 18f5de2825814c38a0bd15d4c962dbef P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2904b089bdb249b78950db76f4a70e9f in current term 1: Already voted for candidate 9ba0da223cf24c97bc7d225e25015924 in this term.
I20260709 12:13:50.260310 23122 catalog_manager.cc:5697] T ac854957ad6246c6b123638cfafeacd4 P 288a46a90f26471584043331107dc0dd reported cstate change: term changed from 0 to 1, leader changed from <none> to 288a46a90f26471584043331107dc0dd (127.12.174.129). New cstate: current_term: 1 leader_uuid: "288a46a90f26471584043331107dc0dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:50.266065 23359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec2c01c273894e73b6a2ab39e0132286. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:50.269238 23507 leader_election.cc:290] T 18f5de2825814c38a0bd15d4c962dbef P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 1 election: Requested vote from peers 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061), 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081)
I20260709 12:13:50.271044 23290 tablet_service.cc:1511] Processing CreateTablet for tablet 9a21be1df2964860b89acefd66f6fbde (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:13:50.271370 23376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c10ca2f5924b7eb5422f0aee2f85c3" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a9a63ca97694ebdb84bca730762d735"
I20260709 12:13:50.272725 23290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a21be1df2964860b89acefd66f6fbde. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:50.273804 23361 tablet_service.cc:1511] Processing CreateTablet for tablet 96f1bc9b220f49d5845c08249cb6a44f (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:13:50.275075 23495 ts_tablet_manager.cc:1434] T 99bc4210d0b44dd282a5bf7606d122af P 288a46a90f26471584043331107dc0dd: Time spent starting tablet: real 0.166s	user 0.007s	sys 0.003s
I20260709 12:13:50.275306 23361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96f1bc9b220f49d5845c08249cb6a44f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:50.276538 23495 tablet_bootstrap.cc:492] T 87c5024fe7274811b9598e504f3963a7 P 288a46a90f26471584043331107dc0dd: Bootstrap starting.
I20260709 12:13:50.278169 23213 tablet_service.cc:1511] Processing CreateTablet for tablet 96f1bc9b220f49d5845c08249cb6a44f (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:13:50.279686 23213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96f1bc9b220f49d5845c08249cb6a44f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:50.237637 23497 raft_consensus.cc:740] T c1c10ca2f5924b7eb5422f0aee2f85c3 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a9a63ca97694ebdb84bca730762d735, State: Initialized, Role: FOLLOWER
W20260709 12:13:50.290805 23173 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:13:50.293987 23375 raft_consensus.cc:2468] T 18f5de2825814c38a0bd15d4c962dbef P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2904b089bdb249b78950db76f4a70e9f in term 1.
I20260709 12:13:50.297984 23533 raft_consensus.cc:2749] T 18f5de2825814c38a0bd15d4c962dbef P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:50.298830 23434 tablet_service.cc:1511] Processing CreateTablet for tablet 96f1bc9b220f49d5845c08249cb6a44f (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:13:50.300391 23434 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96f1bc9b220f49d5845c08249cb6a44f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:50.311877 23524 leader_election.cc:290] T 18f5de2825814c38a0bd15d4c962dbef P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 1 election: Requested vote from peers 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789), 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061)
I20260709 12:13:50.299469 23267 leader_election.cc:304] T 18f5de2825814c38a0bd15d4c962dbef P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2904b089bdb249b78950db76f4a70e9f, 3a9a63ca97694ebdb84bca730762d735; no voters: 9ba0da223cf24c97bc7d225e25015924
I20260709 12:13:50.315574 23301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f5de2825814c38a0bd15d4c962dbef" candidate_uuid: "9ba0da223cf24c97bc7d225e25015924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2904b089bdb249b78950db76f4a70e9f"
I20260709 12:13:50.316584 23301 raft_consensus.cc:2393] T 18f5de2825814c38a0bd15d4c962dbef P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ba0da223cf24c97bc7d225e25015924 in current term 1: Already voted for candidate 2904b089bdb249b78950db76f4a70e9f in this term.
I20260709 12:13:50.305965 23302 raft_consensus.cc:2468] T c1c10ca2f5924b7eb5422f0aee2f85c3 P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 288a46a90f26471584043331107dc0dd in term 1.
I20260709 12:13:50.317176 23559 raft_consensus.cc:2804] T 18f5de2825814c38a0bd15d4c962dbef P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:50.317773 23559 raft_consensus.cc:697] T 18f5de2825814c38a0bd15d4c962dbef P 2904b089bdb249b78950db76f4a70e9f [term 1 LEADER]: Becoming Leader. State: Replica: 2904b089bdb249b78950db76f4a70e9f, State: Running, Role: LEADER
I20260709 12:13:50.318732 23559 consensus_queue.cc:237] T 18f5de2825814c38a0bd15d4c962dbef P 2904b089bdb249b78950db76f4a70e9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:50.320181 23497 consensus_queue.cc:260] T c1c10ca2f5924b7eb5422f0aee2f85c3 P 3a9a63ca97694ebdb84bca730762d735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:50.321599 23192 leader_election.cc:304] T c1c10ca2f5924b7eb5422f0aee2f85c3 P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 288a46a90f26471584043331107dc0dd, 2904b089bdb249b78950db76f4a70e9f; no voters: 
I20260709 12:13:50.322926 23497 ts_tablet_manager.cc:1434] T c1c10ca2f5924b7eb5422f0aee2f85c3 P 3a9a63ca97694ebdb84bca730762d735: Time spent starting tablet: real 0.153s	user 0.001s	sys 0.008s
I20260709 12:13:50.324311 23376 raft_consensus.cc:3060] T c1c10ca2f5924b7eb5422f0aee2f85c3 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:50.325825 23375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f5de2825814c38a0bd15d4c962dbef" candidate_uuid: "9ba0da223cf24c97bc7d225e25015924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a9a63ca97694ebdb84bca730762d735"
I20260709 12:13:50.327198 23496 ts_tablet_manager.cc:1434] T 87c5024fe7274811b9598e504f3963a7 P 9ba0da223cf24c97bc7d225e25015924: Time spent starting tablet: real 0.188s	user 0.011s	sys 0.024s
I20260709 12:13:50.315598 23495 tablet_bootstrap.cc:654] T 87c5024fe7274811b9598e504f3963a7 P 288a46a90f26471584043331107dc0dd: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:50.305426 23124 catalog_manager.cc:5697] T 6d7d1c502ee24072a41a2a55cfc3a5fa P 2904b089bdb249b78950db76f4a70e9f reported cstate change: term changed from 0 to 1, leader changed from <none> to 2904b089bdb249b78950db76f4a70e9f (127.12.174.130). New cstate: current_term: 1 leader_uuid: "2904b089bdb249b78950db76f4a70e9f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:50.330576 23498 ts_tablet_manager.cc:1434] T 87c5024fe7274811b9598e504f3963a7 P 2904b089bdb249b78950db76f4a70e9f: Time spent starting tablet: real 0.155s	user 0.014s	sys 0.021s
I20260709 12:13:50.331389 23558 raft_consensus.cc:2804] T c1c10ca2f5924b7eb5422f0aee2f85c3 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:50.326779 23375 raft_consensus.cc:2393] T 18f5de2825814c38a0bd15d4c962dbef P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ba0da223cf24c97bc7d225e25015924 in current term 1: Already voted for candidate 2904b089bdb249b78950db76f4a70e9f in this term.
I20260709 12:13:50.340950 23500 raft_consensus.cc:493] T 99bc4210d0b44dd282a5bf7606d122af P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:50.341995 23558 raft_consensus.cc:697] T c1c10ca2f5924b7eb5422f0aee2f85c3 P 288a46a90f26471584043331107dc0dd [term 1 LEADER]: Becoming Leader. State: Replica: 288a46a90f26471584043331107dc0dd, State: Running, Role: LEADER
I20260709 12:13:50.341902 23500 raft_consensus.cc:515] T 99bc4210d0b44dd282a5bf7606d122af P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:50.343075 23558 consensus_queue.cc:237] T c1c10ca2f5924b7eb5422f0aee2f85c3 P 288a46a90f26471584043331107dc0dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:50.332182 23496 tablet_bootstrap.cc:492] T 5959fc0b70884d699725fb8d560e5de5 P 9ba0da223cf24c97bc7d225e25015924: Bootstrap starting.
I20260709 12:13:50.349089 23374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bc4210d0b44dd282a5bf7606d122af" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a9a63ca97694ebdb84bca730762d735" is_pre_election: true
I20260709 12:13:50.346284 23500 leader_election.cc:290] T 99bc4210d0b44dd282a5bf7606d122af P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061), 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081)
I20260709 12:13:50.351706 23498 tablet_bootstrap.cc:492] T 6626b442492c47849fd3c907d1c12f3e P 2904b089bdb249b78950db76f4a70e9f: Bootstrap starting.
I20260709 12:13:50.354036 23497 tablet_bootstrap.cc:492] T 99bc4210d0b44dd282a5bf7606d122af P 3a9a63ca97694ebdb84bca730762d735: Bootstrap starting.
W20260709 12:13:50.356828 23192 leader_election.cc:343] T 99bc4210d0b44dd282a5bf7606d122af P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:50.359552 23449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bc4210d0b44dd282a5bf7606d122af" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba0da223cf24c97bc7d225e25015924" is_pre_election: true
I20260709 12:13:50.367023 23415 leader_election.cc:304] T 18f5de2825814c38a0bd15d4c962dbef P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ba0da223cf24c97bc7d225e25015924; no voters: 2904b089bdb249b78950db76f4a70e9f, 3a9a63ca97694ebdb84bca730762d735
I20260709 12:13:50.369549 23524 raft_consensus.cc:2749] T 18f5de2825814c38a0bd15d4c962dbef P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:13:50.376107 23496 tablet_bootstrap.cc:654] T 5959fc0b70884d699725fb8d560e5de5 P 9ba0da223cf24c97bc7d225e25015924: Neither blocks nor log segments found. Creating new log.
W20260709 12:13:50.376416 23191 leader_election.cc:343] T 99bc4210d0b44dd282a5bf7606d122af P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:50.377007 23191 leader_election.cc:304] T 99bc4210d0b44dd282a5bf7606d122af P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 288a46a90f26471584043331107dc0dd; no voters: 3a9a63ca97694ebdb84bca730762d735, 9ba0da223cf24c97bc7d225e25015924
I20260709 12:13:50.379143 23500 raft_consensus.cc:2749] T 99bc4210d0b44dd282a5bf7606d122af P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:50.387004 23363 tablet_service.cc:1511] Processing CreateTablet for tablet ac88d753a9f84b22adbe65cbc15d5109 (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:13:50.388629 23363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac88d753a9f84b22adbe65cbc15d5109. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:50.396270 23286 tablet_service.cc:1511] Processing CreateTablet for tablet ac88d753a9f84b22adbe65cbc15d5109 (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:13:50.403003 23498 tablet_bootstrap.cc:654] T 6626b442492c47849fd3c907d1c12f3e P 2904b089bdb249b78950db76f4a70e9f: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:50.418097 23359 tablet_service.cc:1511] Processing CreateTablet for tablet 27166b782a5049198cccb3e5905acbc7 (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:13:50.418445 23435 tablet_service.cc:1511] Processing CreateTablet for tablet ac88d753a9f84b22adbe65cbc15d5109 (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:13:50.419724 23435 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac88d753a9f84b22adbe65cbc15d5109. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:50.420893 23217 tablet_service.cc:1511] Processing CreateTablet for tablet 27166b782a5049198cccb3e5905acbc7 (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:13:50.422508 23290 tablet_service.cc:1511] Processing CreateTablet for tablet 27166b782a5049198cccb3e5905acbc7 (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:13:50.424464 23217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27166b782a5049198cccb3e5905acbc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:50.419724 23359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27166b782a5049198cccb3e5905acbc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:50.432505 23286 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac88d753a9f84b22adbe65cbc15d5109. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:50.434152 23290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27166b782a5049198cccb3e5905acbc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:50.442241 23497 tablet_bootstrap.cc:654] T 99bc4210d0b44dd282a5bf7606d122af P 3a9a63ca97694ebdb84bca730762d735: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:50.450575 23124 catalog_manager.cc:5697] T 18f5de2825814c38a0bd15d4c962dbef P 2904b089bdb249b78950db76f4a70e9f reported cstate change: term changed from 0 to 1, leader changed from <none> to 2904b089bdb249b78950db76f4a70e9f (127.12.174.130). New cstate: current_term: 1 leader_uuid: "2904b089bdb249b78950db76f4a70e9f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:50.458171 23495 tablet_bootstrap.cc:492] T 87c5024fe7274811b9598e504f3963a7 P 288a46a90f26471584043331107dc0dd: No bootstrap required, opened a new log
I20260709 12:13:50.469380 23495 ts_tablet_manager.cc:1403] T 87c5024fe7274811b9598e504f3963a7 P 288a46a90f26471584043331107dc0dd: Time spent bootstrapping tablet: real 0.193s	user 0.006s	sys 0.013s
I20260709 12:13:50.474651 23495 raft_consensus.cc:359] T 87c5024fe7274811b9598e504f3963a7 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:50.438622 23123 catalog_manager.cc:5697] T c1c10ca2f5924b7eb5422f0aee2f85c3 P 288a46a90f26471584043331107dc0dd reported cstate change: term changed from 0 to 1, leader changed from <none> to 288a46a90f26471584043331107dc0dd (127.12.174.129). New cstate: current_term: 1 leader_uuid: "288a46a90f26471584043331107dc0dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:50.480427 23435 tablet_service.cc:1511] Processing CreateTablet for tablet 45e4fb3889cc4d23bab3929c3fdd731e (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:13:50.455896 23559 raft_consensus.cc:493] T 87c5024fe7274811b9598e504f3963a7 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:50.464557 23376 raft_consensus.cc:2468] T c1c10ca2f5924b7eb5422f0aee2f85c3 P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 288a46a90f26471584043331107dc0dd in term 1.
I20260709 12:13:50.487205 23217 tablet_service.cc:1511] Processing CreateTablet for tablet 45e4fb3889cc4d23bab3929c3fdd731e (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:13:50.488722 23217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45e4fb3889cc4d23bab3929c3fdd731e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:50.488495 23289 tablet_service.cc:1511] Processing CreateTablet for tablet 45e4fb3889cc4d23bab3929c3fdd731e (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:13:50.489161 23498 tablet_bootstrap.cc:492] T 6626b442492c47849fd3c907d1c12f3e P 2904b089bdb249b78950db76f4a70e9f: No bootstrap required, opened a new log
I20260709 12:13:50.489789 23498 ts_tablet_manager.cc:1403] T 6626b442492c47849fd3c907d1c12f3e P 2904b089bdb249b78950db76f4a70e9f: Time spent bootstrapping tablet: real 0.138s	user 0.018s	sys 0.032s
I20260709 12:13:50.489925 23289 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45e4fb3889cc4d23bab3929c3fdd731e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:50.484005 23559 raft_consensus.cc:515] T 87c5024fe7274811b9598e504f3963a7 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:50.494743 23435 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45e4fb3889cc4d23bab3929c3fdd731e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:50.496095 23449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87c5024fe7274811b9598e504f3963a7" candidate_uuid: "2904b089bdb249b78950db76f4a70e9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba0da223cf24c97bc7d225e25015924" is_pre_election: true
I20260709 12:13:50.496881 23449 raft_consensus.cc:2468] T 87c5024fe7274811b9598e504f3963a7 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2904b089bdb249b78950db76f4a70e9f in term 0.
I20260709 12:13:50.498649 23266 leader_election.cc:304] T 87c5024fe7274811b9598e504f3963a7 P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2904b089bdb249b78950db76f4a70e9f, 9ba0da223cf24c97bc7d225e25015924; no voters: 
I20260709 12:13:50.499675 23531 raft_consensus.cc:2804] T 87c5024fe7274811b9598e504f3963a7 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:50.500094 23531 raft_consensus.cc:493] T 87c5024fe7274811b9598e504f3963a7 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:50.500500 23531 raft_consensus.cc:3060] T 87c5024fe7274811b9598e504f3963a7 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:50.505524 23498 raft_consensus.cc:359] T 6626b442492c47849fd3c907d1c12f3e P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:50.513274 23497 tablet_bootstrap.cc:492] T 99bc4210d0b44dd282a5bf7606d122af P 3a9a63ca97694ebdb84bca730762d735: No bootstrap required, opened a new log
I20260709 12:13:50.514019 23497 ts_tablet_manager.cc:1403] T 99bc4210d0b44dd282a5bf7606d122af P 3a9a63ca97694ebdb84bca730762d735: Time spent bootstrapping tablet: real 0.190s	user 0.014s	sys 0.005s
I20260709 12:13:50.516494 23227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87c5024fe7274811b9598e504f3963a7" candidate_uuid: "2904b089bdb249b78950db76f4a70e9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "288a46a90f26471584043331107dc0dd" is_pre_election: true
I20260709 12:13:50.521859 23559 leader_election.cc:290] T 87c5024fe7274811b9598e504f3963a7 P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081), 288a46a90f26471584043331107dc0dd (127.12.174.129:46159)
I20260709 12:13:50.484591 23495 raft_consensus.cc:385] T 87c5024fe7274811b9598e504f3963a7 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:50.526919 23498 raft_consensus.cc:385] T 6626b442492c47849fd3c907d1c12f3e P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:50.527393 23498 raft_consensus.cc:740] T 6626b442492c47849fd3c907d1c12f3e P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2904b089bdb249b78950db76f4a70e9f, State: Initialized, Role: FOLLOWER
I20260709 12:13:50.527720 23495 raft_consensus.cc:740] T 87c5024fe7274811b9598e504f3963a7 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 288a46a90f26471584043331107dc0dd, State: Initialized, Role: FOLLOWER
I20260709 12:13:50.528810 23495 consensus_queue.cc:260] T 87c5024fe7274811b9598e504f3963a7 P 288a46a90f26471584043331107dc0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:50.529917 23227 raft_consensus.cc:2468] T 87c5024fe7274811b9598e504f3963a7 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2904b089bdb249b78950db76f4a70e9f in term 0.
I20260709 12:13:50.528908 23361 tablet_service.cc:1511] Processing CreateTablet for tablet 8bed7e0b2b804500b4898a175fba3ebe (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:13:50.532850 23498 consensus_queue.cc:260] T 6626b442492c47849fd3c907d1c12f3e P 2904b089bdb249b78950db76f4a70e9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:50.533520 23439 tablet_service.cc:1511] Processing CreateTablet for tablet 8bed7e0b2b804500b4898a175fba3ebe (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:13:50.538803 23439 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8bed7e0b2b804500b4898a175fba3ebe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:50.517436 23497 raft_consensus.cc:359] T 99bc4210d0b44dd282a5bf7606d122af P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:50.538836 23215 tablet_service.cc:1511] Processing CreateTablet for tablet 8bed7e0b2b804500b4898a175fba3ebe (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:13:50.544580 23497 raft_consensus.cc:385] T 99bc4210d0b44dd282a5bf7606d122af P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:13:50.544948 23192 consensus_peers.cc:597] T ac854957ad6246c6b123638cfafeacd4 P 288a46a90f26471584043331107dc0dd -> Peer 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789): Couldn't send request to peer 2904b089bdb249b78950db76f4a70e9f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:50.545504 23361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8bed7e0b2b804500b4898a175fba3ebe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:50.545504 23215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8bed7e0b2b804500b4898a175fba3ebe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:50.547343 23498 ts_tablet_manager.cc:1434] T 6626b442492c47849fd3c907d1c12f3e P 2904b089bdb249b78950db76f4a70e9f: Time spent starting tablet: real 0.057s	user 0.007s	sys 0.001s
I20260709 12:13:50.548668 23498 tablet_bootstrap.cc:492] T ac854957ad6246c6b123638cfafeacd4 P 2904b089bdb249b78950db76f4a70e9f: Bootstrap starting.
I20260709 12:13:50.530153 23531 raft_consensus.cc:515] T 87c5024fe7274811b9598e504f3963a7 P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:50.556468 23496 tablet_bootstrap.cc:492] T 5959fc0b70884d699725fb8d560e5de5 P 9ba0da223cf24c97bc7d225e25015924: No bootstrap required, opened a new log
I20260709 12:13:50.557118 23496 ts_tablet_manager.cc:1403] T 5959fc0b70884d699725fb8d560e5de5 P 9ba0da223cf24c97bc7d225e25015924: Time spent bootstrapping tablet: real 0.229s	user 0.019s	sys 0.005s
I20260709 12:13:50.557442 23449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87c5024fe7274811b9598e504f3963a7" candidate_uuid: "2904b089bdb249b78950db76f4a70e9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba0da223cf24c97bc7d225e25015924"
I20260709 12:13:50.558183 23449 raft_consensus.cc:3060] T 87c5024fe7274811b9598e504f3963a7 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:50.560516 23496 raft_consensus.cc:359] T 5959fc0b70884d699725fb8d560e5de5 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:50.545001 23497 raft_consensus.cc:740] T 99bc4210d0b44dd282a5bf7606d122af P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a9a63ca97694ebdb84bca730762d735, State: Initialized, Role: FOLLOWER
I20260709 12:13:50.568104 23497 consensus_queue.cc:260] T 99bc4210d0b44dd282a5bf7606d122af P 3a9a63ca97694ebdb84bca730762d735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:50.570749 23497 ts_tablet_manager.cc:1434] T 99bc4210d0b44dd282a5bf7606d122af P 3a9a63ca97694ebdb84bca730762d735: Time spent starting tablet: real 0.056s	user 0.008s	sys 0.000s
I20260709 12:13:50.576244 23434 tablet_service.cc:1511] Processing CreateTablet for tablet 4a007ebead5a454bb48d9784a624f5b8 (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:13:50.576855 23290 tablet_service.cc:1511] Processing CreateTablet for tablet 6efb52601755488885a8baf030e7fae9 (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:13:50.578178 23290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6efb52601755488885a8baf030e7fae9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:50.579231 23434 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a007ebead5a454bb48d9784a624f5b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:50.584432 23449 raft_consensus.cc:2468] T 87c5024fe7274811b9598e504f3963a7 P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2904b089bdb249b78950db76f4a70e9f in term 1.
I20260709 12:13:50.585983 23266 leader_election.cc:304] T 87c5024fe7274811b9598e504f3963a7 P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2904b089bdb249b78950db76f4a70e9f, 9ba0da223cf24c97bc7d225e25015924; no voters: 
I20260709 12:13:50.565008 23496 raft_consensus.cc:385] T 5959fc0b70884d699725fb8d560e5de5 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:50.586663 23496 raft_consensus.cc:740] T 5959fc0b70884d699725fb8d560e5de5 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ba0da223cf24c97bc7d225e25015924, State: Initialized, Role: FOLLOWER
I20260709 12:13:50.586997 23559 raft_consensus.cc:2804] T 87c5024fe7274811b9598e504f3963a7 P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:50.587608 23559 raft_consensus.cc:697] T 87c5024fe7274811b9598e504f3963a7 P 2904b089bdb249b78950db76f4a70e9f [term 1 LEADER]: Becoming Leader. State: Replica: 2904b089bdb249b78950db76f4a70e9f, State: Running, Role: LEADER
I20260709 12:13:50.588253 23497 tablet_bootstrap.cc:492] T 6d7d1c502ee24072a41a2a55cfc3a5fa P 3a9a63ca97694ebdb84bca730762d735: Bootstrap starting.
I20260709 12:13:50.588537 23559 consensus_queue.cc:237] T 87c5024fe7274811b9598e504f3963a7 P 2904b089bdb249b78950db76f4a70e9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:50.593755 23286 tablet_service.cc:1511] Processing CreateTablet for tablet 4a007ebead5a454bb48d9784a624f5b8 (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:13:50.595358 23286 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a007ebead5a454bb48d9784a624f5b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:50.598225 23531 leader_election.cc:290] T 87c5024fe7274811b9598e504f3963a7 P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 1 election: Requested vote from peers 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081), 288a46a90f26471584043331107dc0dd (127.12.174.129:46159)
I20260709 12:13:50.600666 23217 tablet_service.cc:1511] Processing CreateTablet for tablet 6efb52601755488885a8baf030e7fae9 (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:13:50.606248 23359 tablet_service.cc:1511] Processing CreateTablet for tablet 4a007ebead5a454bb48d9784a624f5b8 (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:13:50.606618 23363 tablet_service.cc:1511] Processing CreateTablet for tablet 6efb52601755488885a8baf030e7fae9 (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:13:50.608083 23363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6efb52601755488885a8baf030e7fae9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:50.608578 23498 tablet_bootstrap.cc:654] T ac854957ad6246c6b123638cfafeacd4 P 2904b089bdb249b78950db76f4a70e9f: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:50.608784 23359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a007ebead5a454bb48d9784a624f5b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:50.627992 23497 tablet_bootstrap.cc:654] T 6d7d1c502ee24072a41a2a55cfc3a5fa P 3a9a63ca97694ebdb84bca730762d735: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:50.596246 23496 consensus_queue.cc:260] T 5959fc0b70884d699725fb8d560e5de5 P 9ba0da223cf24c97bc7d225e25015924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:50.634784 23227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87c5024fe7274811b9598e504f3963a7" candidate_uuid: "2904b089bdb249b78950db76f4a70e9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "288a46a90f26471584043331107dc0dd"
I20260709 12:13:50.636098 23217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6efb52601755488885a8baf030e7fae9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:50.637655 23495 ts_tablet_manager.cc:1434] T 87c5024fe7274811b9598e504f3963a7 P 288a46a90f26471584043331107dc0dd: Time spent starting tablet: real 0.167s	user 0.008s	sys 0.004s
I20260709 12:13:50.642542 23227 raft_consensus.cc:3060] T 87c5024fe7274811b9598e504f3963a7 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:50.663745 23496 ts_tablet_manager.cc:1434] T 5959fc0b70884d699725fb8d560e5de5 P 9ba0da223cf24c97bc7d225e25015924: Time spent starting tablet: real 0.106s	user 0.004s	sys 0.006s
I20260709 12:13:50.670116 23439 tablet_service.cc:1511] Processing CreateTablet for tablet 558b91ca6fe3461da7eb4a1344ec14fc (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:13:50.676812 23496 tablet_bootstrap.cc:492] T eeda1df5d1624932a606c0a80e69d33a P 9ba0da223cf24c97bc7d225e25015924: Bootstrap starting.
W20260709 12:13:50.684098 23267 consensus_peers.cc:597] T 6d7d1c502ee24072a41a2a55cfc3a5fa P 2904b089bdb249b78950db76f4a70e9f -> Peer 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061): Couldn't send request to peer 3a9a63ca97694ebdb84bca730762d735. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:50.686827 23495 tablet_bootstrap.cc:492] T 6626b442492c47849fd3c907d1c12f3e P 288a46a90f26471584043331107dc0dd: Bootstrap starting.
I20260709 12:13:50.690658 23558 consensus_queue.cc:1048] T ac854957ad6246c6b123638cfafeacd4 P 288a46a90f26471584043331107dc0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:50.686929 23122 catalog_manager.cc:5697] T 87c5024fe7274811b9598e504f3963a7 P 2904b089bdb249b78950db76f4a70e9f reported cstate change: term changed from 0 to 1, leader changed from <none> to 2904b089bdb249b78950db76f4a70e9f (127.12.174.130). New cstate: current_term: 1 leader_uuid: "2904b089bdb249b78950db76f4a70e9f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:50.691140 23439 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 558b91ca6fe3461da7eb4a1344ec14fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:50.713343 23496 tablet_bootstrap.cc:654] T eeda1df5d1624932a606c0a80e69d33a P 9ba0da223cf24c97bc7d225e25015924: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:50.714001 23227 raft_consensus.cc:2468] T 87c5024fe7274811b9598e504f3963a7 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2904b089bdb249b78950db76f4a70e9f in term 1.
I20260709 12:13:50.726528 23217 tablet_service.cc:1511] Processing CreateTablet for tablet 558b91ca6fe3461da7eb4a1344ec14fc (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:13:50.728137 23217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 558b91ca6fe3461da7eb4a1344ec14fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:50.765532 23495 tablet_bootstrap.cc:654] T 6626b442492c47849fd3c907d1c12f3e P 288a46a90f26471584043331107dc0dd: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:50.767784 23498 tablet_bootstrap.cc:492] T ac854957ad6246c6b123638cfafeacd4 P 2904b089bdb249b78950db76f4a70e9f: No bootstrap required, opened a new log
I20260709 12:13:50.768528 23498 ts_tablet_manager.cc:1403] T ac854957ad6246c6b123638cfafeacd4 P 2904b089bdb249b78950db76f4a70e9f: Time spent bootstrapping tablet: real 0.220s	user 0.032s	sys 0.038s
I20260709 12:13:50.780802 23290 tablet_service.cc:1511] Processing CreateTablet for tablet 558b91ca6fe3461da7eb4a1344ec14fc (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:13:50.782437 23290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 558b91ca6fe3461da7eb4a1344ec14fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:50.787067 23363 tablet_service.cc:1511] Processing CreateTablet for tablet bed12810020c4496969b723bcdd4b4ec (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
W20260709 12:13:50.772337 23268 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:46159, user_credentials={real_user=slave}} blocked reactor thread for 56999us
I20260709 12:13:50.788534 23363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bed12810020c4496969b723bcdd4b4ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:50.788734 23533 raft_consensus.cc:493] T 99bc4210d0b44dd282a5bf7606d122af P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:50.798110 23497 tablet_bootstrap.cc:492] T 6d7d1c502ee24072a41a2a55cfc3a5fa P 3a9a63ca97694ebdb84bca730762d735: No bootstrap required, opened a new log
I20260709 12:13:50.798760 23497 ts_tablet_manager.cc:1403] T 6d7d1c502ee24072a41a2a55cfc3a5fa P 3a9a63ca97694ebdb84bca730762d735: Time spent bootstrapping tablet: real 0.211s	user 0.023s	sys 0.028s
I20260709 12:13:50.801900 23533 raft_consensus.cc:515] T 99bc4210d0b44dd282a5bf7606d122af P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:50.804911 23533 leader_election.cc:290] T 99bc4210d0b44dd282a5bf7606d122af P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081), 288a46a90f26471584043331107dc0dd (127.12.174.129:46159)
I20260709 12:13:50.781437 23498 raft_consensus.cc:359] T ac854957ad6246c6b123638cfafeacd4 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:50.795173 23500 consensus_queue.cc:1048] T c1c10ca2f5924b7eb5422f0aee2f85c3 P 288a46a90f26471584043331107dc0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.023s
I20260709 12:13:50.817688 23498 raft_consensus.cc:385] T ac854957ad6246c6b123638cfafeacd4 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:50.828176 23497 raft_consensus.cc:359] T 6d7d1c502ee24072a41a2a55cfc3a5fa P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:50.829898 23497 raft_consensus.cc:385] T 6d7d1c502ee24072a41a2a55cfc3a5fa P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:50.830215 23497 raft_consensus.cc:740] T 6d7d1c502ee24072a41a2a55cfc3a5fa P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a9a63ca97694ebdb84bca730762d735, State: Initialized, Role: FOLLOWER
I20260709 12:13:50.830436 23434 tablet_service.cc:1511] Processing CreateTablet for tablet bed12810020c4496969b723bcdd4b4ec (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:13:50.831923 23434 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bed12810020c4496969b723bcdd4b4ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:50.831699 23559 consensus_queue.cc:1048] T 6d7d1c502ee24072a41a2a55cfc3a5fa P 2904b089bdb249b78950db76f4a70e9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:50.828228 23448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bc4210d0b44dd282a5bf7606d122af" candidate_uuid: "3a9a63ca97694ebdb84bca730762d735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba0da223cf24c97bc7d225e25015924" is_pre_election: true
W20260709 12:13:50.833607 23573 log.cc:927] Time spent T ac854957ad6246c6b123638cfafeacd4 P 9ba0da223cf24c97bc7d225e25015924: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 12:13:50.827181 23498 raft_consensus.cc:740] T ac854957ad6246c6b123638cfafeacd4 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2904b089bdb249b78950db76f4a70e9f, State: Initialized, Role: FOLLOWER
I20260709 12:13:50.834828 23498 consensus_queue.cc:260] T ac854957ad6246c6b123638cfafeacd4 P 2904b089bdb249b78950db76f4a70e9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:50.837317 23498 ts_tablet_manager.cc:1434] T ac854957ad6246c6b123638cfafeacd4 P 2904b089bdb249b78950db76f4a70e9f: Time spent starting tablet: real 0.068s	user 0.004s	sys 0.004s
W20260709 12:13:50.835457 23340 leader_election.cc:343] T 99bc4210d0b44dd282a5bf7606d122af P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:50.840979 23286 tablet_service.cc:1511] Processing CreateTablet for tablet 28d6ea7193094e8186a5394f3e7ef0b4 (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:13:50.831063 23497 consensus_queue.cc:260] T 6d7d1c502ee24072a41a2a55cfc3a5fa P 3a9a63ca97694ebdb84bca730762d735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:50.844656 23435 tablet_service.cc:1511] Processing CreateTablet for tablet 28d6ea7193094e8186a5394f3e7ef0b4 (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:13:50.849452 23435 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28d6ea7193094e8186a5394f3e7ef0b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:50.845920 23496 tablet_bootstrap.cc:492] T eeda1df5d1624932a606c0a80e69d33a P 9ba0da223cf24c97bc7d225e25015924: No bootstrap required, opened a new log
I20260709 12:13:50.852716 23496 ts_tablet_manager.cc:1403] T eeda1df5d1624932a606c0a80e69d33a P 9ba0da223cf24c97bc7d225e25015924: Time spent bootstrapping tablet: real 0.176s	user 0.020s	sys 0.027s
I20260709 12:13:50.856067 23497 ts_tablet_manager.cc:1434] T 6d7d1c502ee24072a41a2a55cfc3a5fa P 3a9a63ca97694ebdb84bca730762d735: Time spent starting tablet: real 0.057s	user 0.007s	sys 0.002s
I20260709 12:13:50.856338 23496 raft_consensus.cc:359] T eeda1df5d1624932a606c0a80e69d33a P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:50.857337 23496 raft_consensus.cc:385] T eeda1df5d1624932a606c0a80e69d33a P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:50.862501 23495 tablet_bootstrap.cc:492] T 6626b442492c47849fd3c907d1c12f3e P 288a46a90f26471584043331107dc0dd: No bootstrap required, opened a new log
I20260709 12:13:50.862980 23498 tablet_bootstrap.cc:492] T 00335dfad3394f0c9689c0df8500bc9e P 2904b089bdb249b78950db76f4a70e9f: Bootstrap starting.
I20260709 12:13:50.863394 23495 ts_tablet_manager.cc:1403] T 6626b442492c47849fd3c907d1c12f3e P 288a46a90f26471584043331107dc0dd: Time spent bootstrapping tablet: real 0.177s	user 0.040s	sys 0.007s
I20260709 12:13:50.867381 23495 raft_consensus.cc:359] T 6626b442492c47849fd3c907d1c12f3e P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:50.877341 23363 tablet_service.cc:1511] Processing CreateTablet for tablet 28d6ea7193094e8186a5394f3e7ef0b4 (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:13:50.843206 23286 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28d6ea7193094e8186a5394f3e7ef0b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:50.875542 23558 consensus_queue.cc:1048] T c1c10ca2f5924b7eb5422f0aee2f85c3 P 288a46a90f26471584043331107dc0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 12:13:50.890496 23363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28d6ea7193094e8186a5394f3e7ef0b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:50.857671 23496 raft_consensus.cc:740] T eeda1df5d1624932a606c0a80e69d33a P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ba0da223cf24c97bc7d225e25015924, State: Initialized, Role: FOLLOWER
I20260709 12:13:50.898756 23496 consensus_queue.cc:260] T eeda1df5d1624932a606c0a80e69d33a P 9ba0da223cf24c97bc7d225e25015924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:50.875825 23495 raft_consensus.cc:385] T 6626b442492c47849fd3c907d1c12f3e P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:50.879590 23497 tablet_bootstrap.cc:492] T 138c2e6a55da4600a6318719808815ec P 3a9a63ca97694ebdb84bca730762d735: Bootstrap starting.
I20260709 12:13:50.921144 23496 ts_tablet_manager.cc:1434] T eeda1df5d1624932a606c0a80e69d33a P 9ba0da223cf24c97bc7d225e25015924: Time spent starting tablet: real 0.068s	user 0.007s	sys 0.002s
I20260709 12:13:50.927969 23562 raft_consensus.cc:493] T 5959fc0b70884d699725fb8d560e5de5 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:50.928565 23562 raft_consensus.cc:515] T 5959fc0b70884d699725fb8d560e5de5 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:50.929518 23290 tablet_service.cc:1511] Processing CreateTablet for tablet 2eb2c8089ce14124aed9a5d834cd0522 (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:13:50.931015 23290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2eb2c8089ce14124aed9a5d834cd0522. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:50.909202 23495 raft_consensus.cc:740] T 6626b442492c47849fd3c907d1c12f3e P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 288a46a90f26471584043331107dc0dd, State: Initialized, Role: FOLLOWER
I20260709 12:13:50.957149 23496 tablet_bootstrap.cc:492] T 99bc4210d0b44dd282a5bf7606d122af P 9ba0da223cf24c97bc7d225e25015924: Bootstrap starting.
I20260709 12:13:50.966902 23495 consensus_queue.cc:260] T 6626b442492c47849fd3c907d1c12f3e P 288a46a90f26471584043331107dc0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:50.936882 23559 consensus_queue.cc:1048] T 18f5de2825814c38a0bd15d4c962dbef P 2904b089bdb249b78950db76f4a70e9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 12:13:50.974614 23217 tablet_service.cc:1511] Processing CreateTablet for tablet bed12810020c4496969b723bcdd4b4ec (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:13:50.974895 23215 tablet_service.cc:1511] Processing CreateTablet for tablet 2eb2c8089ce14124aed9a5d834cd0522 (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:13:50.976660 23497 tablet_bootstrap.cc:654] T 138c2e6a55da4600a6318719808815ec P 3a9a63ca97694ebdb84bca730762d735: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:50.978277 23227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bc4210d0b44dd282a5bf7606d122af" candidate_uuid: "3a9a63ca97694ebdb84bca730762d735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "288a46a90f26471584043331107dc0dd" is_pre_election: true
I20260709 12:13:50.981827 23217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bed12810020c4496969b723bcdd4b4ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:50.969652 23495 ts_tablet_manager.cc:1434] T 6626b442492c47849fd3c907d1c12f3e P 288a46a90f26471584043331107dc0dd: Time spent starting tablet: real 0.106s	user 0.005s	sys 0.001s
I20260709 12:13:50.986392 23215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2eb2c8089ce14124aed9a5d834cd0522. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:50.984241 23227 raft_consensus.cc:2468] T 99bc4210d0b44dd282a5bf7606d122af P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a9a63ca97694ebdb84bca730762d735 in term 0.
I20260709 12:13:51.001030 23363 tablet_service.cc:1511] Processing CreateTablet for tablet 2eb2c8089ce14124aed9a5d834cd0522 (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:13:51.002557 23363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2eb2c8089ce14124aed9a5d834cd0522. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:51.005530 23342 leader_election.cc:304] T 99bc4210d0b44dd282a5bf7606d122af P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 288a46a90f26471584043331107dc0dd, 3a9a63ca97694ebdb84bca730762d735; no voters: 9ba0da223cf24c97bc7d225e25015924
I20260709 12:13:51.007045 23533 raft_consensus.cc:2804] T 99bc4210d0b44dd282a5bf7606d122af P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:51.007475 23533 raft_consensus.cc:493] T 99bc4210d0b44dd282a5bf7606d122af P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:51.007849 23533 raft_consensus.cc:3060] T 99bc4210d0b44dd282a5bf7606d122af P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:51.010052 23531 consensus_queue.cc:1048] T 87c5024fe7274811b9598e504f3963a7 P 2904b089bdb249b78950db76f4a70e9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:51.011056 23562 leader_election.cc:290] T 5959fc0b70884d699725fb8d560e5de5 P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 288a46a90f26471584043331107dc0dd (127.12.174.129:46159), 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789)
I20260709 12:13:51.005486 23498 tablet_bootstrap.cc:654] T 00335dfad3394f0c9689c0df8500bc9e P 2904b089bdb249b78950db76f4a70e9f: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:51.018733 23496 tablet_bootstrap.cc:654] T 99bc4210d0b44dd282a5bf7606d122af P 9ba0da223cf24c97bc7d225e25015924: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:51.038254 23583 raft_consensus.cc:493] T 6626b442492c47849fd3c907d1c12f3e P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:51.038887 23583 raft_consensus.cc:515] T 6626b442492c47849fd3c907d1c12f3e P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:51.039597 23542 raft_consensus.cc:493] T 6626b442492c47849fd3c907d1c12f3e P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:51.040235 23542 raft_consensus.cc:515] T 6626b442492c47849fd3c907d1c12f3e P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:51.013659 23531 consensus_queue.cc:1048] T 18f5de2825814c38a0bd15d4c962dbef P 2904b089bdb249b78950db76f4a70e9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.029s
I20260709 12:13:51.051568 23439 tablet_service.cc:1511] Processing CreateTablet for tablet 3ad2f373a67b4c9cbb2183c2c73eb3e5 (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:13:51.053102 23439 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ad2f373a67b4c9cbb2183c2c73eb3e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:51.054245 23302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5959fc0b70884d699725fb8d560e5de5" candidate_uuid: "9ba0da223cf24c97bc7d225e25015924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2904b089bdb249b78950db76f4a70e9f" is_pre_election: true
I20260709 12:13:51.063495 23213 tablet_service.cc:1511] Processing CreateTablet for tablet e0352fa4cf674ba8b7d1a0239bcf76e8 (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:13:51.065112 23213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0352fa4cf674ba8b7d1a0239bcf76e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:51.070504 23286 tablet_service.cc:1511] Processing CreateTablet for tablet 3ad2f373a67b4c9cbb2183c2c73eb3e5 (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:13:51.072280 23286 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ad2f373a67b4c9cbb2183c2c73eb3e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:51.072044 23434 tablet_service.cc:1511] Processing CreateTablet for tablet e0352fa4cf674ba8b7d1a0239bcf76e8 (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:13:51.073248 23302 raft_consensus.cc:3060] T ac854957ad6246c6b123638cfafeacd4 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:51.073727 23495 tablet_bootstrap.cc:492] T 5959fc0b70884d699725fb8d560e5de5 P 288a46a90f26471584043331107dc0dd: Bootstrap starting.
W20260709 12:13:51.074110 23415 leader_election.cc:343] T 5959fc0b70884d699725fb8d560e5de5 P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:51.076833 23359 tablet_service.cc:1511] Processing CreateTablet for tablet e0352fa4cf674ba8b7d1a0239bcf76e8 (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:13:51.078636 23359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0352fa4cf674ba8b7d1a0239bcf76e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:51.082008 23226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6626b442492c47849fd3c907d1c12f3e" candidate_uuid: "2904b089bdb249b78950db76f4a70e9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "288a46a90f26471584043331107dc0dd" is_pre_election: true
I20260709 12:13:51.082748 23375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6626b442492c47849fd3c907d1c12f3e" candidate_uuid: "2904b089bdb249b78950db76f4a70e9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a9a63ca97694ebdb84bca730762d735" is_pre_election: true
I20260709 12:13:51.082937 23226 raft_consensus.cc:2468] T 6626b442492c47849fd3c907d1c12f3e P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2904b089bdb249b78950db76f4a70e9f in term 0.
I20260709 12:13:51.073379 23434 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0352fa4cf674ba8b7d1a0239bcf76e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:51.081343 23583 leader_election.cc:290] T 6626b442492c47849fd3c907d1c12f3e P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 288a46a90f26471584043331107dc0dd (127.12.174.129:46159), 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061)
W20260709 12:13:51.088747 23267 leader_election.cc:343] T 6626b442492c47849fd3c907d1c12f3e P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:51.090806 23217 tablet_service.cc:1511] Processing CreateTablet for tablet 3ad2f373a67b4c9cbb2183c2c73eb3e5 (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:13:51.094360 23495 tablet_bootstrap.cc:654] T 5959fc0b70884d699725fb8d560e5de5 P 288a46a90f26471584043331107dc0dd: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:51.095069 23268 leader_election.cc:304] T 6626b442492c47849fd3c907d1c12f3e P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 288a46a90f26471584043331107dc0dd, 2904b089bdb249b78950db76f4a70e9f; no voters: 3a9a63ca97694ebdb84bca730762d735
I20260709 12:13:51.101848 23375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6626b442492c47849fd3c907d1c12f3e" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a9a63ca97694ebdb84bca730762d735" is_pre_election: true
I20260709 12:13:51.108361 23562 raft_consensus.cc:493] T eeda1df5d1624932a606c0a80e69d33a P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:51.109140 23562 raft_consensus.cc:515] T eeda1df5d1624932a606c0a80e69d33a P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
W20260709 12:13:51.109989 23192 leader_election.cc:343] T 6626b442492c47849fd3c907d1c12f3e P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:51.093492 23542 leader_election.cc:290] T 6626b442492c47849fd3c907d1c12f3e P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789), 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061)
I20260709 12:13:51.112937 23217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ad2f373a67b4c9cbb2183c2c73eb3e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:51.124285 23587 consensus_queue.cc:1048] T 87c5024fe7274811b9598e504f3963a7 P 2904b089bdb249b78950db76f4a70e9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.026s
I20260709 12:13:51.129868 23290 tablet_service.cc:1511] Processing CreateTablet for tablet 9485b864470548f28810d4c52cc89850 (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:13:51.131503 23290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9485b864470548f28810d4c52cc89850. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:51.134904 23376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda1df5d1624932a606c0a80e69d33a" candidate_uuid: "9ba0da223cf24c97bc7d225e25015924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a9a63ca97694ebdb84bca730762d735" is_pre_election: true
I20260709 12:13:51.135744 23376 raft_consensus.cc:2468] T eeda1df5d1624932a606c0a80e69d33a P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ba0da223cf24c97bc7d225e25015924 in term 0.
I20260709 12:13:51.137516 23415 leader_election.cc:304] T eeda1df5d1624932a606c0a80e69d33a P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a9a63ca97694ebdb84bca730762d735, 9ba0da223cf24c97bc7d225e25015924; no voters: 
I20260709 12:13:51.149061 23594 raft_consensus.cc:2804] T eeda1df5d1624932a606c0a80e69d33a P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:51.149729 23594 raft_consensus.cc:493] T eeda1df5d1624932a606c0a80e69d33a P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:51.150475 23594 raft_consensus.cc:3060] T eeda1df5d1624932a606c0a80e69d33a P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:51.122974 23507 raft_consensus.cc:2804] T 6626b442492c47849fd3c907d1c12f3e P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:51.152670 23507 raft_consensus.cc:493] T 6626b442492c47849fd3c907d1c12f3e P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:51.153083 23507 raft_consensus.cc:3060] T 6626b442492c47849fd3c907d1c12f3e P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:51.127369 23562 leader_election.cc:290] T eeda1df5d1624932a606c0a80e69d33a P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789), 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061)
I20260709 12:13:51.168879 23300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda1df5d1624932a606c0a80e69d33a" candidate_uuid: "9ba0da223cf24c97bc7d225e25015924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2904b089bdb249b78950db76f4a70e9f" is_pre_election: true
I20260709 12:13:51.171555 23497 tablet_bootstrap.cc:492] T 138c2e6a55da4600a6318719808815ec P 3a9a63ca97694ebdb84bca730762d735: No bootstrap required, opened a new log
I20260709 12:13:51.174091 23363 tablet_service.cc:1511] Processing CreateTablet for tablet 9485b864470548f28810d4c52cc89850 (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:13:51.180269 23363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9485b864470548f28810d4c52cc89850. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:51.157379 23301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6626b442492c47849fd3c907d1c12f3e" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2904b089bdb249b78950db76f4a70e9f" is_pre_election: true
I20260709 12:13:51.193713 23497 ts_tablet_manager.cc:1403] T 138c2e6a55da4600a6318719808815ec P 3a9a63ca97694ebdb84bca730762d735: Time spent bootstrapping tablet: real 0.323s	user 0.019s	sys 0.020s
I20260709 12:13:51.203235 23434 tablet_service.cc:1511] Processing CreateTablet for tablet 9485b864470548f28810d4c52cc89850 (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:13:51.204620 23434 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9485b864470548f28810d4c52cc89850. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:51.211267 23496 tablet_bootstrap.cc:492] T 99bc4210d0b44dd282a5bf7606d122af P 9ba0da223cf24c97bc7d225e25015924: No bootstrap required, opened a new log
I20260709 12:13:51.211966 23496 ts_tablet_manager.cc:1403] T 99bc4210d0b44dd282a5bf7606d122af P 9ba0da223cf24c97bc7d225e25015924: Time spent bootstrapping tablet: real 0.265s	user 0.020s	sys 0.018s
I20260709 12:13:51.268092 23496 raft_consensus.cc:359] T 99bc4210d0b44dd282a5bf7606d122af P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:51.271842 23495 tablet_bootstrap.cc:492] T 5959fc0b70884d699725fb8d560e5de5 P 288a46a90f26471584043331107dc0dd: No bootstrap required, opened a new log
I20260709 12:13:51.272532 23495 ts_tablet_manager.cc:1403] T 5959fc0b70884d699725fb8d560e5de5 P 288a46a90f26471584043331107dc0dd: Time spent bootstrapping tablet: real 0.227s	user 0.013s	sys 0.017s
I20260709 12:13:51.303781 23600 raft_consensus.cc:493] T 6d7d1c502ee24072a41a2a55cfc3a5fa P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:51.304566 23600 raft_consensus.cc:515] T 6d7d1c502ee24072a41a2a55cfc3a5fa P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
W20260709 12:13:51.261948 23415 leader_election.cc:343] T eeda1df5d1624932a606c0a80e69d33a P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:51.269027 23496 raft_consensus.cc:385] T 99bc4210d0b44dd282a5bf7606d122af P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:51.315408 23227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5959fc0b70884d699725fb8d560e5de5" candidate_uuid: "9ba0da223cf24c97bc7d225e25015924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "288a46a90f26471584043331107dc0dd" is_pre_election: true
I20260709 12:13:51.316641 23497 raft_consensus.cc:359] T 138c2e6a55da4600a6318719808815ec P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:51.317129 23226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d7d1c502ee24072a41a2a55cfc3a5fa" candidate_uuid: "3a9a63ca97694ebdb84bca730762d735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "288a46a90f26471584043331107dc0dd" is_pre_election: true
I20260709 12:13:51.307740 23496 raft_consensus.cc:740] T 99bc4210d0b44dd282a5bf7606d122af P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ba0da223cf24c97bc7d225e25015924, State: Initialized, Role: FOLLOWER
I20260709 12:13:51.318670 23496 consensus_queue.cc:260] T 99bc4210d0b44dd282a5bf7606d122af P 9ba0da223cf24c97bc7d225e25015924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
W20260709 12:13:51.319468 23415 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:45789, user_credentials={real_user=slave}} blocked reactor thread for 58333.2us
W20260709 12:13:51.320489 23111 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.12.174.131:40061, user_credentials={real_user=slave}} blocked reactor thread for 45621.5us
I20260709 12:13:51.323256 23300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d7d1c502ee24072a41a2a55cfc3a5fa" candidate_uuid: "3a9a63ca97694ebdb84bca730762d735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2904b089bdb249b78950db76f4a70e9f" is_pre_election: true
I20260709 12:13:51.324007 23215 tablet_service.cc:1511] Processing CreateTablet for tablet 0f7747f7dcab4d6da9caf82c35717552 (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:13:51.326001 23498 tablet_bootstrap.cc:492] T 00335dfad3394f0c9689c0df8500bc9e P 2904b089bdb249b78950db76f4a70e9f: No bootstrap required, opened a new log
I20260709 12:13:51.326581 23498 ts_tablet_manager.cc:1403] T 00335dfad3394f0c9689c0df8500bc9e P 2904b089bdb249b78950db76f4a70e9f: Time spent bootstrapping tablet: real 0.464s	user 0.018s	sys 0.010s
I20260709 12:13:51.315248 23600 leader_election.cc:290] T 6d7d1c502ee24072a41a2a55cfc3a5fa P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789), 288a46a90f26471584043331107dc0dd (127.12.174.129:46159)
I20260709 12:13:51.333874 23496 ts_tablet_manager.cc:1434] T 99bc4210d0b44dd282a5bf7606d122af P 9ba0da223cf24c97bc7d225e25015924: Time spent starting tablet: real 0.122s	user 0.009s	sys 0.002s
I20260709 12:13:51.275831 23533 raft_consensus.cc:515] T 99bc4210d0b44dd282a5bf7606d122af P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:51.335201 23496 tablet_bootstrap.cc:492] T 8da66c3ab79d468dbfd36407c51d423a P 9ba0da223cf24c97bc7d225e25015924: Bootstrap starting.
I20260709 12:13:51.336760 23533 leader_election.cc:290] T 99bc4210d0b44dd282a5bf7606d122af P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 election: Requested vote from peers 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081), 288a46a90f26471584043331107dc0dd (127.12.174.129:46159)
I20260709 12:13:51.338259 23225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bc4210d0b44dd282a5bf7606d122af" candidate_uuid: "3a9a63ca97694ebdb84bca730762d735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "288a46a90f26471584043331107dc0dd"
I20260709 12:13:51.338992 23225 raft_consensus.cc:3060] T 99bc4210d0b44dd282a5bf7606d122af P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:13:51.340124 23173 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:13:51.343897 23450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bc4210d0b44dd282a5bf7606d122af" candidate_uuid: "3a9a63ca97694ebdb84bca730762d735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba0da223cf24c97bc7d225e25015924"
I20260709 12:13:51.344594 23450 raft_consensus.cc:3060] T 99bc4210d0b44dd282a5bf7606d122af P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:51.347227 23342 leader_election.cc:304] T 6d7d1c502ee24072a41a2a55cfc3a5fa P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3a9a63ca97694ebdb84bca730762d735; no voters: 288a46a90f26471584043331107dc0dd, 2904b089bdb249b78950db76f4a70e9f
I20260709 12:13:51.348701 23495 raft_consensus.cc:359] T 5959fc0b70884d699725fb8d560e5de5 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:51.349520 23495 raft_consensus.cc:385] T 5959fc0b70884d699725fb8d560e5de5 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:51.349200 23215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f7747f7dcab4d6da9caf82c35717552. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:51.324025 23594 raft_consensus.cc:515] T eeda1df5d1624932a606c0a80e69d33a P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:51.354647 23533 raft_consensus.cc:2749] T 6d7d1c502ee24072a41a2a55cfc3a5fa P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:51.350426 23498 raft_consensus.cc:359] T 00335dfad3394f0c9689c0df8500bc9e P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:51.317531 23497 raft_consensus.cc:385] T 138c2e6a55da4600a6318719808815ec P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:51.356488 23495 raft_consensus.cc:740] T 5959fc0b70884d699725fb8d560e5de5 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 288a46a90f26471584043331107dc0dd, State: Initialized, Role: FOLLOWER
I20260709 12:13:51.359576 23495 consensus_queue.cc:260] T 5959fc0b70884d699725fb8d560e5de5 P 288a46a90f26471584043331107dc0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:51.364347 23290 tablet_service.cc:1511] Processing CreateTablet for tablet 0f7747f7dcab4d6da9caf82c35717552 (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:13:51.365711 23290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f7747f7dcab4d6da9caf82c35717552. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:51.366730 23496 tablet_bootstrap.cc:654] T 8da66c3ab79d468dbfd36407c51d423a P 9ba0da223cf24c97bc7d225e25015924: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:51.367079 23434 tablet_service.cc:1511] Processing CreateTablet for tablet e3d86fc25f7146c9b1af99387a07bdec (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:13:51.368342 23434 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3d86fc25f7146c9b1af99387a07bdec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:51.358912 23498 raft_consensus.cc:385] T 00335dfad3394f0c9689c0df8500bc9e P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:51.370711 23363 tablet_service.cc:1511] Processing CreateTablet for tablet 0f7747f7dcab4d6da9caf82c35717552 (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:13:51.371272 23498 raft_consensus.cc:740] T 00335dfad3394f0c9689c0df8500bc9e P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2904b089bdb249b78950db76f4a70e9f, State: Initialized, Role: FOLLOWER
I20260709 12:13:51.340574 23507 raft_consensus.cc:515] T 6626b442492c47849fd3c907d1c12f3e P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:51.358868 23497 raft_consensus.cc:740] T 138c2e6a55da4600a6318719808815ec P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a9a63ca97694ebdb84bca730762d735, State: Initialized, Role: FOLLOWER
I20260709 12:13:51.374744 23497 consensus_queue.cc:260] T 138c2e6a55da4600a6318719808815ec P 3a9a63ca97694ebdb84bca730762d735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:51.375833 23301 raft_consensus.cc:2393] T 6626b442492c47849fd3c907d1c12f3e P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 288a46a90f26471584043331107dc0dd in current term 1: Already voted for candidate 2904b089bdb249b78950db76f4a70e9f in this term.
I20260709 12:13:51.372637 23227 raft_consensus.cc:2468] T 5959fc0b70884d699725fb8d560e5de5 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ba0da223cf24c97bc7d225e25015924 in term 0.
I20260709 12:13:51.379328 23495 ts_tablet_manager.cc:1434] T 5959fc0b70884d699725fb8d560e5de5 P 288a46a90f26471584043331107dc0dd: Time spent starting tablet: real 0.105s	user 0.006s	sys 0.000s
I20260709 12:13:51.380578 23495 tablet_bootstrap.cc:492] T 8da66c3ab79d468dbfd36407c51d423a P 288a46a90f26471584043331107dc0dd: Bootstrap starting.
I20260709 12:13:51.382061 23450 raft_consensus.cc:2468] T 99bc4210d0b44dd282a5bf7606d122af P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a9a63ca97694ebdb84bca730762d735 in term 1.
I20260709 12:13:51.382447 23375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6626b442492c47849fd3c907d1c12f3e" candidate_uuid: "2904b089bdb249b78950db76f4a70e9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a9a63ca97694ebdb84bca730762d735"
I20260709 12:13:51.382081 23376 raft_consensus.cc:3060] T 6d7d1c502ee24072a41a2a55cfc3a5fa P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:51.384397 23226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6626b442492c47849fd3c907d1c12f3e" candidate_uuid: "2904b089bdb249b78950db76f4a70e9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "288a46a90f26471584043331107dc0dd"
I20260709 12:13:51.385160 23226 raft_consensus.cc:3060] T 6626b442492c47849fd3c907d1c12f3e P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:13:51.386869 23267 leader_election.cc:343] T 6626b442492c47849fd3c907d1c12f3e P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:51.388913 23416 leader_election.cc:304] T 5959fc0b70884d699725fb8d560e5de5 P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 288a46a90f26471584043331107dc0dd, 9ba0da223cf24c97bc7d225e25015924; no voters: 2904b089bdb249b78950db76f4a70e9f
I20260709 12:13:51.372200 23363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f7747f7dcab4d6da9caf82c35717552. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:51.390447 23562 raft_consensus.cc:2804] T 5959fc0b70884d699725fb8d560e5de5 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:51.390866 23562 raft_consensus.cc:493] T 5959fc0b70884d699725fb8d560e5de5 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:51.391196 23562 raft_consensus.cc:3060] T 5959fc0b70884d699725fb8d560e5de5 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:51.392642 23340 leader_election.cc:304] T 99bc4210d0b44dd282a5bf7606d122af P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a9a63ca97694ebdb84bca730762d735, 9ba0da223cf24c97bc7d225e25015924; no voters: 
I20260709 12:13:51.393770 23599 raft_consensus.cc:2804] T 99bc4210d0b44dd282a5bf7606d122af P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:51.394328 23599 raft_consensus.cc:697] T 99bc4210d0b44dd282a5bf7606d122af P 3a9a63ca97694ebdb84bca730762d735 [term 1 LEADER]: Becoming Leader. State: Replica: 3a9a63ca97694ebdb84bca730762d735, State: Running, Role: LEADER
I20260709 12:13:51.395388 23599 consensus_queue.cc:237] T 99bc4210d0b44dd282a5bf7606d122af P 3a9a63ca97694ebdb84bca730762d735 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:51.398638 23300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda1df5d1624932a606c0a80e69d33a" candidate_uuid: "9ba0da223cf24c97bc7d225e25015924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2904b089bdb249b78950db76f4a70e9f"
I20260709 12:13:51.399350 23594 leader_election.cc:290] T eeda1df5d1624932a606c0a80e69d33a P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 1 election: Requested vote from peers 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789), 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061)
I20260709 12:13:51.399572 23375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda1df5d1624932a606c0a80e69d33a" candidate_uuid: "9ba0da223cf24c97bc7d225e25015924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a9a63ca97694ebdb84bca730762d735"
W20260709 12:13:51.400314 23415 leader_election.cc:343] T eeda1df5d1624932a606c0a80e69d33a P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:51.400220 23375 raft_consensus.cc:3060] T eeda1df5d1624932a606c0a80e69d33a P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:51.375200 23507 leader_election.cc:290] T 6626b442492c47849fd3c907d1c12f3e P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 1 election: Requested vote from peers 288a46a90f26471584043331107dc0dd (127.12.174.129:46159), 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061)
I20260709 12:13:51.415755 23192 leader_election.cc:304] T 6626b442492c47849fd3c907d1c12f3e P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 288a46a90f26471584043331107dc0dd; no voters: 2904b089bdb249b78950db76f4a70e9f, 3a9a63ca97694ebdb84bca730762d735
I20260709 12:13:51.416373 23498 consensus_queue.cc:260] T 00335dfad3394f0c9689c0df8500bc9e P 2904b089bdb249b78950db76f4a70e9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:51.419747 23497 ts_tablet_manager.cc:1434] T 138c2e6a55da4600a6318719808815ec P 3a9a63ca97694ebdb84bca730762d735: Time spent starting tablet: real 0.218s	user 0.013s	sys 0.000s
I20260709 12:13:51.421968 23497 tablet_bootstrap.cc:492] T 8da66c3ab79d468dbfd36407c51d423a P 3a9a63ca97694ebdb84bca730762d735: Bootstrap starting.
I20260709 12:13:51.426853 23531 raft_consensus.cc:493] T ac854957ad6246c6b123638cfafeacd4 P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 288a46a90f26471584043331107dc0dd)
I20260709 12:13:51.427464 23531 raft_consensus.cc:515] T ac854957ad6246c6b123638cfafeacd4 P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:51.436538 23213 tablet_service.cc:1511] Processing CreateTablet for tablet e3d86fc25f7146c9b1af99387a07bdec (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:13:51.442406 23227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac854957ad6246c6b123638cfafeacd4" candidate_uuid: "2904b089bdb249b78950db76f4a70e9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "288a46a90f26471584043331107dc0dd" is_pre_election: true
I20260709 12:13:51.438066 23213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3d86fc25f7146c9b1af99387a07bdec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:51.445176 23498 ts_tablet_manager.cc:1434] T 00335dfad3394f0c9689c0df8500bc9e P 2904b089bdb249b78950db76f4a70e9f: Time spent starting tablet: real 0.118s	user 0.005s	sys 0.007s
I20260709 12:13:51.446496 23498 tablet_bootstrap.cc:492] T 5959fc0b70884d699725fb8d560e5de5 P 2904b089bdb249b78950db76f4a70e9f: Bootstrap starting.
I20260709 12:13:51.447062 23225 raft_consensus.cc:2468] T 99bc4210d0b44dd282a5bf7606d122af P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a9a63ca97694ebdb84bca730762d735 in term 1.
I20260709 12:13:51.437674 23531 leader_election.cc:290] T ac854957ad6246c6b123638cfafeacd4 P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081), 288a46a90f26471584043331107dc0dd (127.12.174.129:46159)
I20260709 12:13:51.451753 23531 raft_consensus.cc:493] T 00335dfad3394f0c9689c0df8500bc9e P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:51.452713 23450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac854957ad6246c6b123638cfafeacd4" candidate_uuid: "2904b089bdb249b78950db76f4a70e9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ba0da223cf24c97bc7d225e25015924" is_pre_election: true
I20260709 12:13:51.453573 23498 tablet_bootstrap.cc:654] T 5959fc0b70884d699725fb8d560e5de5 P 2904b089bdb249b78950db76f4a70e9f: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:51.452333 23531 raft_consensus.cc:515] T 00335dfad3394f0c9689c0df8500bc9e P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:51.457685 23266 leader_election.cc:304] T ac854957ad6246c6b123638cfafeacd4 P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2904b089bdb249b78950db76f4a70e9f; no voters: 288a46a90f26471584043331107dc0dd, 9ba0da223cf24c97bc7d225e25015924
I20260709 12:13:51.458663 23583 raft_consensus.cc:2749] T ac854957ad6246c6b123638cfafeacd4 P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:51.459177 23225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00335dfad3394f0c9689c0df8500bc9e" candidate_uuid: "2904b089bdb249b78950db76f4a70e9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "288a46a90f26471584043331107dc0dd" is_pre_election: true
I20260709 12:13:51.458531 23450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00335dfad3394f0c9689c0df8500bc9e" candidate_uuid: "2904b089bdb249b78950db76f4a70e9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba0da223cf24c97bc7d225e25015924" is_pre_election: true
W20260709 12:13:51.460742 23268 leader_election.cc:343] T 00335dfad3394f0c9689c0df8500bc9e P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:51.461613 23531 leader_election.cc:290] T 00335dfad3394f0c9689c0df8500bc9e P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081), 288a46a90f26471584043331107dc0dd (127.12.174.129:46159)
I20260709 12:13:51.462706 23495 tablet_bootstrap.cc:654] T 8da66c3ab79d468dbfd36407c51d423a P 288a46a90f26471584043331107dc0dd: Neither blocks nor log segments found. Creating new log.
W20260709 12:13:51.469642 23266 leader_election.cc:343] T 00335dfad3394f0c9689c0df8500bc9e P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:51.470191 23266 leader_election.cc:304] T 00335dfad3394f0c9689c0df8500bc9e P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2904b089bdb249b78950db76f4a70e9f; no voters: 288a46a90f26471584043331107dc0dd, 9ba0da223cf24c97bc7d225e25015924
I20260709 12:13:51.471415 23531 raft_consensus.cc:2749] T 00335dfad3394f0c9689c0df8500bc9e P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:51.474407 23497 tablet_bootstrap.cc:654] T 8da66c3ab79d468dbfd36407c51d423a P 3a9a63ca97694ebdb84bca730762d735: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:51.480855 23375 raft_consensus.cc:2468] T eeda1df5d1624932a606c0a80e69d33a P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ba0da223cf24c97bc7d225e25015924 in term 1.
I20260709 12:13:51.465082 23562 raft_consensus.cc:515] T 5959fc0b70884d699725fb8d560e5de5 P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:51.468626 23226 raft_consensus.cc:2468] T 6626b442492c47849fd3c907d1c12f3e P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2904b089bdb249b78950db76f4a70e9f in term 1.
I20260709 12:13:51.488493 23415 leader_election.cc:304] T eeda1df5d1624932a606c0a80e69d33a P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3a9a63ca97694ebdb84bca730762d735, 9ba0da223cf24c97bc7d225e25015924; no voters: 2904b089bdb249b78950db76f4a70e9f
I20260709 12:13:51.492588 23496 tablet_bootstrap.cc:492] T 8da66c3ab79d468dbfd36407c51d423a P 9ba0da223cf24c97bc7d225e25015924: No bootstrap required, opened a new log
I20260709 12:13:51.501955 23496 ts_tablet_manager.cc:1403] T 8da66c3ab79d468dbfd36407c51d423a P 9ba0da223cf24c97bc7d225e25015924: Time spent bootstrapping tablet: real 0.167s	user 0.023s	sys 0.010s
I20260709 12:13:51.502404 23268 leader_election.cc:304] T 6626b442492c47849fd3c907d1c12f3e P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 288a46a90f26471584043331107dc0dd, 2904b089bdb249b78950db76f4a70e9f; no voters: 3a9a63ca97694ebdb84bca730762d735
I20260709 12:13:51.502506 23594 raft_consensus.cc:2804] T eeda1df5d1624932a606c0a80e69d33a P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:51.501600 23439 tablet_service.cc:1511] Processing CreateTablet for tablet 54a02c3fbc0b4807998d018f9c2ecbc3 (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:13:51.503765 23531 raft_consensus.cc:2804] T 6626b442492c47849fd3c907d1c12f3e P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:51.503996 23363 tablet_service.cc:1511] Processing CreateTablet for tablet 54a02c3fbc0b4807998d018f9c2ecbc3 (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:13:51.504351 23439 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54a02c3fbc0b4807998d018f9c2ecbc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:51.504907 23594 raft_consensus.cc:697] T eeda1df5d1624932a606c0a80e69d33a P 9ba0da223cf24c97bc7d225e25015924 [term 1 LEADER]: Becoming Leader. State: Replica: 9ba0da223cf24c97bc7d225e25015924, State: Running, Role: LEADER
I20260709 12:13:51.496347 23286 tablet_service.cc:1511] Processing CreateTablet for tablet e3d86fc25f7146c9b1af99387a07bdec (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:13:51.497846 23225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5959fc0b70884d699725fb8d560e5de5" candidate_uuid: "9ba0da223cf24c97bc7d225e25015924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "288a46a90f26471584043331107dc0dd"
I20260709 12:13:51.506198 23225 raft_consensus.cc:3060] T 5959fc0b70884d699725fb8d560e5de5 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:51.505858 23594 consensus_queue.cc:237] T eeda1df5d1624932a606c0a80e69d33a P 9ba0da223cf24c97bc7d225e25015924 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:51.506554 23286 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3d86fc25f7146c9b1af99387a07bdec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:51.507568 23363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54a02c3fbc0b4807998d018f9c2ecbc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:51.501889 23542 raft_consensus.cc:2749] T 6626b442492c47849fd3c907d1c12f3e P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:51.505218 23496 raft_consensus.cc:359] T 8da66c3ab79d468dbfd36407c51d423a P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:51.515215 23496 raft_consensus.cc:385] T 8da66c3ab79d468dbfd36407c51d423a P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:51.499048 23599 raft_consensus.cc:493] T 138c2e6a55da4600a6318719808815ec P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:51.504276 23531 raft_consensus.cc:697] T 6626b442492c47849fd3c907d1c12f3e P 2904b089bdb249b78950db76f4a70e9f [term 1 LEADER]: Becoming Leader. State: Replica: 2904b089bdb249b78950db76f4a70e9f, State: Running, Role: LEADER
I20260709 12:13:51.496078 23124 catalog_manager.cc:5697] T 99bc4210d0b44dd282a5bf7606d122af P 3a9a63ca97694ebdb84bca730762d735 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131). New cstate: current_term: 1 leader_uuid: "3a9a63ca97694ebdb84bca730762d735" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:51.517772 23531 consensus_queue.cc:237] T 6626b442492c47849fd3c907d1c12f3e P 2904b089bdb249b78950db76f4a70e9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:51.521883 23599 raft_consensus.cc:515] T 138c2e6a55da4600a6318719808815ec P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:51.524067 23599 leader_election.cc:290] T 138c2e6a55da4600a6318719808815ec P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789), 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081)
I20260709 12:13:51.525303 23450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138c2e6a55da4600a6318719808815ec" candidate_uuid: "3a9a63ca97694ebdb84bca730762d735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba0da223cf24c97bc7d225e25015924" is_pre_election: true
I20260709 12:13:51.527124 23302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138c2e6a55da4600a6318719808815ec" candidate_uuid: "3a9a63ca97694ebdb84bca730762d735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2904b089bdb249b78950db76f4a70e9f" is_pre_election: true
W20260709 12:13:51.529036 23341 leader_election.cc:343] T 138c2e6a55da4600a6318719808815ec P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:51.515573 23496 raft_consensus.cc:740] T 8da66c3ab79d468dbfd36407c51d423a P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ba0da223cf24c97bc7d225e25015924, State: Initialized, Role: FOLLOWER
W20260709 12:13:51.530546 23340 leader_election.cc:343] T 138c2e6a55da4600a6318719808815ec P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:51.531059 23340 leader_election.cc:304] T 138c2e6a55da4600a6318719808815ec P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3a9a63ca97694ebdb84bca730762d735; no voters: 2904b089bdb249b78950db76f4a70e9f, 9ba0da223cf24c97bc7d225e25015924
I20260709 12:13:51.531800 23496 consensus_queue.cc:260] T 8da66c3ab79d468dbfd36407c51d423a P 9ba0da223cf24c97bc7d225e25015924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:51.540323 23301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5959fc0b70884d699725fb8d560e5de5" candidate_uuid: "9ba0da223cf24c97bc7d225e25015924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2904b089bdb249b78950db76f4a70e9f"
I20260709 12:13:51.540654 23215 tablet_service.cc:1511] Processing CreateTablet for tablet 54a02c3fbc0b4807998d018f9c2ecbc3 (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:13:51.542101 23215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54a02c3fbc0b4807998d018f9c2ecbc3. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:13:51.542232 23415 leader_election.cc:343] T 5959fc0b70884d699725fb8d560e5de5 P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:51.542999 23562 leader_election.cc:290] T 5959fc0b70884d699725fb8d560e5de5 P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 1 election: Requested vote from peers 288a46a90f26471584043331107dc0dd (127.12.174.129:46159), 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789)
I20260709 12:13:51.550194 23289 tablet_service.cc:1511] Processing CreateTablet for tablet 27202f3dd66a42a3832a9cc25ba6e3e5 (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:13:51.551424 23599 raft_consensus.cc:2749] T 138c2e6a55da4600a6318719808815ec P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:51.551895 23289 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27202f3dd66a42a3832a9cc25ba6e3e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:51.552934 23496 ts_tablet_manager.cc:1434] T 8da66c3ab79d468dbfd36407c51d423a P 9ba0da223cf24c97bc7d225e25015924: Time spent starting tablet: real 0.050s	user 0.008s	sys 0.000s
I20260709 12:13:51.556315 23498 tablet_bootstrap.cc:492] T 5959fc0b70884d699725fb8d560e5de5 P 2904b089bdb249b78950db76f4a70e9f: No bootstrap required, opened a new log
I20260709 12:13:51.556876 23498 ts_tablet_manager.cc:1403] T 5959fc0b70884d699725fb8d560e5de5 P 2904b089bdb249b78950db76f4a70e9f: Time spent bootstrapping tablet: real 0.111s	user 0.013s	sys 0.007s
I20260709 12:13:51.558492 23225 raft_consensus.cc:2468] T 5959fc0b70884d699725fb8d560e5de5 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ba0da223cf24c97bc7d225e25015924 in term 1.
I20260709 12:13:51.567421 23416 leader_election.cc:304] T 5959fc0b70884d699725fb8d560e5de5 P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 288a46a90f26471584043331107dc0dd, 9ba0da223cf24c97bc7d225e25015924; no voters: 2904b089bdb249b78950db76f4a70e9f
I20260709 12:13:51.570215 23562 raft_consensus.cc:2804] T 5959fc0b70884d699725fb8d560e5de5 P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:51.570336 23496 tablet_bootstrap.cc:492] T 509f7e554df04f83aeffd51ec07607d5 P 9ba0da223cf24c97bc7d225e25015924: Bootstrap starting.
I20260709 12:13:51.573712 23562 raft_consensus.cc:697] T 5959fc0b70884d699725fb8d560e5de5 P 9ba0da223cf24c97bc7d225e25015924 [term 1 LEADER]: Becoming Leader. State: Replica: 9ba0da223cf24c97bc7d225e25015924, State: Running, Role: LEADER
I20260709 12:13:51.574710 23562 consensus_queue.cc:237] T 5959fc0b70884d699725fb8d560e5de5 P 9ba0da223cf24c97bc7d225e25015924 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:51.583405 23496 tablet_bootstrap.cc:654] T 509f7e554df04f83aeffd51ec07607d5 P 9ba0da223cf24c97bc7d225e25015924: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:51.582856 23495 tablet_bootstrap.cc:492] T 8da66c3ab79d468dbfd36407c51d423a P 288a46a90f26471584043331107dc0dd: No bootstrap required, opened a new log
I20260709 12:13:51.584419 23495 ts_tablet_manager.cc:1403] T 8da66c3ab79d468dbfd36407c51d423a P 288a46a90f26471584043331107dc0dd: Time spent bootstrapping tablet: real 0.204s	user 0.018s	sys 0.007s
I20260709 12:13:51.599296 23498 raft_consensus.cc:359] T 5959fc0b70884d699725fb8d560e5de5 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:51.600332 23498 raft_consensus.cc:385] T 5959fc0b70884d699725fb8d560e5de5 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:51.600988 23498 raft_consensus.cc:740] T 5959fc0b70884d699725fb8d560e5de5 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2904b089bdb249b78950db76f4a70e9f, State: Initialized, Role: FOLLOWER
I20260709 12:13:51.606381 23498 consensus_queue.cc:260] T 5959fc0b70884d699725fb8d560e5de5 P 2904b089bdb249b78950db76f4a70e9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:51.606704 23363 tablet_service.cc:1511] Processing CreateTablet for tablet 27202f3dd66a42a3832a9cc25ba6e3e5 (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:13:51.609951 23498 ts_tablet_manager.cc:1434] T 5959fc0b70884d699725fb8d560e5de5 P 2904b089bdb249b78950db76f4a70e9f: Time spent starting tablet: real 0.053s	user 0.010s	sys 0.000s
I20260709 12:13:51.611232 23498 tablet_bootstrap.cc:492] T 138c2e6a55da4600a6318719808815ec P 2904b089bdb249b78950db76f4a70e9f: Bootstrap starting.
I20260709 12:13:51.612471 23363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27202f3dd66a42a3832a9cc25ba6e3e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:51.617290 23434 tablet_service.cc:1511] Processing CreateTablet for tablet 27202f3dd66a42a3832a9cc25ba6e3e5 (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:13:51.618738 23434 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27202f3dd66a42a3832a9cc25ba6e3e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:51.620612 23497 tablet_bootstrap.cc:492] T 8da66c3ab79d468dbfd36407c51d423a P 3a9a63ca97694ebdb84bca730762d735: No bootstrap required, opened a new log
I20260709 12:13:51.621207 23497 ts_tablet_manager.cc:1403] T 8da66c3ab79d468dbfd36407c51d423a P 3a9a63ca97694ebdb84bca730762d735: Time spent bootstrapping tablet: real 0.200s	user 0.015s	sys 0.036s
I20260709 12:13:51.624418 23495 raft_consensus.cc:359] T 8da66c3ab79d468dbfd36407c51d423a P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:51.625154 23495 raft_consensus.cc:385] T 8da66c3ab79d468dbfd36407c51d423a P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:51.625429 23495 raft_consensus.cc:740] T 8da66c3ab79d468dbfd36407c51d423a P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 288a46a90f26471584043331107dc0dd, State: Initialized, Role: FOLLOWER
I20260709 12:13:51.626387 23495 consensus_queue.cc:260] T 8da66c3ab79d468dbfd36407c51d423a P 288a46a90f26471584043331107dc0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:51.628927 23495 ts_tablet_manager.cc:1434] T 8da66c3ab79d468dbfd36407c51d423a P 288a46a90f26471584043331107dc0dd: Time spent starting tablet: real 0.044s	user 0.007s	sys 0.000s
I20260709 12:13:51.630396 23498 tablet_bootstrap.cc:654] T 138c2e6a55da4600a6318719808815ec P 2904b089bdb249b78950db76f4a70e9f: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:51.631767 23497 raft_consensus.cc:359] T 8da66c3ab79d468dbfd36407c51d423a P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:51.632524 23497 raft_consensus.cc:385] T 8da66c3ab79d468dbfd36407c51d423a P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:51.632773 23497 raft_consensus.cc:740] T 8da66c3ab79d468dbfd36407c51d423a P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a9a63ca97694ebdb84bca730762d735, State: Initialized, Role: FOLLOWER
I20260709 12:13:51.634569 23495 tablet_bootstrap.cc:492] T 509f7e554df04f83aeffd51ec07607d5 P 288a46a90f26471584043331107dc0dd: Bootstrap starting.
I20260709 12:13:51.639775 23497 consensus_queue.cc:260] T 8da66c3ab79d468dbfd36407c51d423a P 3a9a63ca97694ebdb84bca730762d735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:51.648392 23286 tablet_service.cc:1511] Processing CreateTablet for tablet b90be1e04a3443e989951ea6bc45ed2f (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:13:51.649575 23286 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b90be1e04a3443e989951ea6bc45ed2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:51.651675 23359 tablet_service.cc:1511] Processing CreateTablet for tablet b90be1e04a3443e989951ea6bc45ed2f (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:13:51.652647 23359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b90be1e04a3443e989951ea6bc45ed2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:51.654436 23213 tablet_service.cc:1511] Processing CreateTablet for tablet b90be1e04a3443e989951ea6bc45ed2f (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:13:51.655748 23213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b90be1e04a3443e989951ea6bc45ed2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:51.668411 23496 tablet_bootstrap.cc:492] T 509f7e554df04f83aeffd51ec07607d5 P 9ba0da223cf24c97bc7d225e25015924: No bootstrap required, opened a new log
I20260709 12:13:51.669224 23496 ts_tablet_manager.cc:1403] T 509f7e554df04f83aeffd51ec07607d5 P 9ba0da223cf24c97bc7d225e25015924: Time spent bootstrapping tablet: real 0.099s	user 0.008s	sys 0.013s
I20260709 12:13:51.670523 23497 ts_tablet_manager.cc:1434] T 8da66c3ab79d468dbfd36407c51d423a P 3a9a63ca97694ebdb84bca730762d735: Time spent starting tablet: real 0.049s	user 0.007s	sys 0.002s
I20260709 12:13:51.675591 23439 tablet_service.cc:1511] Processing CreateTablet for tablet b2fd9ee7ac0c442481f7e173874a8d00 (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:13:51.675906 23215 tablet_service.cc:1511] Processing CreateTablet for tablet b2fd9ee7ac0c442481f7e173874a8d00 (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:13:51.676987 23439 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2fd9ee7ac0c442481f7e173874a8d00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:51.678918 23215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2fd9ee7ac0c442481f7e173874a8d00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:51.678745 23290 tablet_service.cc:1511] Processing CreateTablet for tablet b2fd9ee7ac0c442481f7e173874a8d00 (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:13:51.680027 23290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2fd9ee7ac0c442481f7e173874a8d00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:51.682546 23435 tablet_service.cc:1511] Processing CreateTablet for tablet 509296352dfa43369c2637f89e917301 (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:13:51.683840 23435 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 509296352dfa43369c2637f89e917301. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:51.687958 23361 tablet_service.cc:1511] Processing CreateTablet for tablet 509296352dfa43369c2637f89e917301 (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:13:51.689481 23361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 509296352dfa43369c2637f89e917301. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:51.690121 23217 tablet_service.cc:1511] Processing CreateTablet for tablet 509296352dfa43369c2637f89e917301 (DEFAULT_TABLE table=test-workload [id=58d627229f0c46d9ab30e520568b93e1]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:13:51.691350 23217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 509296352dfa43369c2637f89e917301. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:51.716569 23497 tablet_bootstrap.cc:492] T 6626b442492c47849fd3c907d1c12f3e P 3a9a63ca97694ebdb84bca730762d735: Bootstrap starting.
I20260709 12:13:51.739106 23498 tablet_bootstrap.cc:492] T 138c2e6a55da4600a6318719808815ec P 2904b089bdb249b78950db76f4a70e9f: No bootstrap required, opened a new log
I20260709 12:13:51.739748 23498 ts_tablet_manager.cc:1403] T 138c2e6a55da4600a6318719808815ec P 2904b089bdb249b78950db76f4a70e9f: Time spent bootstrapping tablet: real 0.129s	user 0.015s	sys 0.007s
I20260709 12:13:51.746923 23498 raft_consensus.cc:359] T 138c2e6a55da4600a6318719808815ec P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:51.747654 23498 raft_consensus.cc:385] T 138c2e6a55da4600a6318719808815ec P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:51.747793 23496 raft_consensus.cc:359] T 509f7e554df04f83aeffd51ec07607d5 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:51.749267 23496 raft_consensus.cc:385] T 509f7e554df04f83aeffd51ec07607d5 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:51.748903 23495 tablet_bootstrap.cc:654] T 509f7e554df04f83aeffd51ec07607d5 P 288a46a90f26471584043331107dc0dd: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:51.749858 23498 raft_consensus.cc:740] T 138c2e6a55da4600a6318719808815ec P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2904b089bdb249b78950db76f4a70e9f, State: Initialized, Role: FOLLOWER
I20260709 12:13:51.749652 23496 raft_consensus.cc:740] T 509f7e554df04f83aeffd51ec07607d5 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ba0da223cf24c97bc7d225e25015924, State: Initialized, Role: FOLLOWER
I20260709 12:13:51.752780 23498 consensus_queue.cc:260] T 138c2e6a55da4600a6318719808815ec P 2904b089bdb249b78950db76f4a70e9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:51.754448 23496 consensus_queue.cc:260] T 509f7e554df04f83aeffd51ec07607d5 P 9ba0da223cf24c97bc7d225e25015924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:51.756793 23496 ts_tablet_manager.cc:1434] T 509f7e554df04f83aeffd51ec07607d5 P 9ba0da223cf24c97bc7d225e25015924: Time spent starting tablet: real 0.087s	user 0.003s	sys 0.003s
I20260709 12:13:51.757915 23496 tablet_bootstrap.cc:492] T 00335dfad3394f0c9689c0df8500bc9e P 9ba0da223cf24c97bc7d225e25015924: Bootstrap starting.
I20260709 12:13:51.762570 23125 catalog_manager.cc:5697] T eeda1df5d1624932a606c0a80e69d33a P 9ba0da223cf24c97bc7d225e25015924 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132). New cstate: current_term: 1 leader_uuid: "9ba0da223cf24c97bc7d225e25015924" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:51.763878 23496 tablet_bootstrap.cc:654] T 00335dfad3394f0c9689c0df8500bc9e P 9ba0da223cf24c97bc7d225e25015924: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:51.765588 23498 ts_tablet_manager.cc:1434] T 138c2e6a55da4600a6318719808815ec P 2904b089bdb249b78950db76f4a70e9f: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260709 12:13:51.776636 23498 tablet_bootstrap.cc:492] T eeda1df5d1624932a606c0a80e69d33a P 2904b089bdb249b78950db76f4a70e9f: Bootstrap starting.
I20260709 12:13:51.779846 23495 tablet_bootstrap.cc:492] T 509f7e554df04f83aeffd51ec07607d5 P 288a46a90f26471584043331107dc0dd: No bootstrap required, opened a new log
I20260709 12:13:51.780442 23495 ts_tablet_manager.cc:1403] T 509f7e554df04f83aeffd51ec07607d5 P 288a46a90f26471584043331107dc0dd: Time spent bootstrapping tablet: real 0.146s	user 0.014s	sys 0.001s
I20260709 12:13:51.782341 23497 tablet_bootstrap.cc:654] T 6626b442492c47849fd3c907d1c12f3e P 3a9a63ca97694ebdb84bca730762d735: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:51.783048 23498 tablet_bootstrap.cc:654] T eeda1df5d1624932a606c0a80e69d33a P 2904b089bdb249b78950db76f4a70e9f: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:51.784072 23496 tablet_bootstrap.cc:492] T 00335dfad3394f0c9689c0df8500bc9e P 9ba0da223cf24c97bc7d225e25015924: No bootstrap required, opened a new log
I20260709 12:13:51.783501 23495 raft_consensus.cc:359] T 509f7e554df04f83aeffd51ec07607d5 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:51.790134 23496 ts_tablet_manager.cc:1403] T 00335dfad3394f0c9689c0df8500bc9e P 9ba0da223cf24c97bc7d225e25015924: Time spent bootstrapping tablet: real 0.032s	user 0.009s	sys 0.007s
I20260709 12:13:51.790050 23495 raft_consensus.cc:385] T 509f7e554df04f83aeffd51ec07607d5 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:51.790812 23495 raft_consensus.cc:740] T 509f7e554df04f83aeffd51ec07607d5 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 288a46a90f26471584043331107dc0dd, State: Initialized, Role: FOLLOWER
I20260709 12:13:51.791669 23495 consensus_queue.cc:260] T 509f7e554df04f83aeffd51ec07607d5 P 288a46a90f26471584043331107dc0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:51.794191 23495 ts_tablet_manager.cc:1434] T 509f7e554df04f83aeffd51ec07607d5 P 288a46a90f26471584043331107dc0dd: Time spent starting tablet: real 0.013s	user 0.012s	sys 0.002s
I20260709 12:13:51.795360 23495 tablet_bootstrap.cc:492] T 00335dfad3394f0c9689c0df8500bc9e P 288a46a90f26471584043331107dc0dd: Bootstrap starting.
I20260709 12:13:51.798637 23497 tablet_bootstrap.cc:492] T 6626b442492c47849fd3c907d1c12f3e P 3a9a63ca97694ebdb84bca730762d735: No bootstrap required, opened a new log
I20260709 12:13:51.799185 23497 ts_tablet_manager.cc:1403] T 6626b442492c47849fd3c907d1c12f3e P 3a9a63ca97694ebdb84bca730762d735: Time spent bootstrapping tablet: real 0.099s	user 0.014s	sys 0.000s
I20260709 12:13:51.801715 23495 tablet_bootstrap.cc:654] T 00335dfad3394f0c9689c0df8500bc9e P 288a46a90f26471584043331107dc0dd: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:51.806659 23496 raft_consensus.cc:359] T 00335dfad3394f0c9689c0df8500bc9e P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:51.807415 23498 tablet_bootstrap.cc:492] T eeda1df5d1624932a606c0a80e69d33a P 2904b089bdb249b78950db76f4a70e9f: No bootstrap required, opened a new log
I20260709 12:13:51.807937 23498 ts_tablet_manager.cc:1403] T eeda1df5d1624932a606c0a80e69d33a P 2904b089bdb249b78950db76f4a70e9f: Time spent bootstrapping tablet: real 0.034s	user 0.012s	sys 0.000s
I20260709 12:13:51.808459 23497 raft_consensus.cc:359] T 6626b442492c47849fd3c907d1c12f3e P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:51.809141 23497 raft_consensus.cc:385] T 6626b442492c47849fd3c907d1c12f3e P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:51.809418 23497 raft_consensus.cc:740] T 6626b442492c47849fd3c907d1c12f3e P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a9a63ca97694ebdb84bca730762d735, State: Initialized, Role: FOLLOWER
I20260709 12:13:51.807444 23496 raft_consensus.cc:385] T 00335dfad3394f0c9689c0df8500bc9e P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:51.810753 23496 raft_consensus.cc:740] T 00335dfad3394f0c9689c0df8500bc9e P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ba0da223cf24c97bc7d225e25015924, State: Initialized, Role: FOLLOWER
I20260709 12:13:51.811520 23496 consensus_queue.cc:260] T 00335dfad3394f0c9689c0df8500bc9e P 9ba0da223cf24c97bc7d225e25015924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:51.812796 23497 consensus_queue.cc:260] T 6626b442492c47849fd3c907d1c12f3e P 3a9a63ca97694ebdb84bca730762d735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:51.815104 23497 ts_tablet_manager.cc:1434] T 6626b442492c47849fd3c907d1c12f3e P 3a9a63ca97694ebdb84bca730762d735: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 12:13:51.815521 23498 raft_consensus.cc:359] T eeda1df5d1624932a606c0a80e69d33a P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:51.816452 23498 raft_consensus.cc:385] T eeda1df5d1624932a606c0a80e69d33a P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:51.816753 23498 raft_consensus.cc:740] T eeda1df5d1624932a606c0a80e69d33a P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2904b089bdb249b78950db76f4a70e9f, State: Initialized, Role: FOLLOWER
I20260709 12:13:51.817783 23496 ts_tablet_manager.cc:1434] T 00335dfad3394f0c9689c0df8500bc9e P 9ba0da223cf24c97bc7d225e25015924: Time spent starting tablet: real 0.027s	user 0.005s	sys 0.003s
I20260709 12:13:51.818971 23496 tablet_bootstrap.cc:492] T 138c2e6a55da4600a6318719808815ec P 9ba0da223cf24c97bc7d225e25015924: Bootstrap starting.
I20260709 12:13:51.817673 23498 consensus_queue.cc:260] T eeda1df5d1624932a606c0a80e69d33a P 2904b089bdb249b78950db76f4a70e9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:51.823670 23498 ts_tablet_manager.cc:1434] T eeda1df5d1624932a606c0a80e69d33a P 2904b089bdb249b78950db76f4a70e9f: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.003s
I20260709 12:13:51.824754 23498 tablet_bootstrap.cc:492] T 0646c3e87a184cd19184ff12695392a7 P 2904b089bdb249b78950db76f4a70e9f: Bootstrap starting.
I20260709 12:13:51.825505 23496 tablet_bootstrap.cc:654] T 138c2e6a55da4600a6318719808815ec P 9ba0da223cf24c97bc7d225e25015924: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:51.834043 23498 tablet_bootstrap.cc:654] T 0646c3e87a184cd19184ff12695392a7 P 2904b089bdb249b78950db76f4a70e9f: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:51.834447 23599 consensus_queue.cc:1048] T 99bc4210d0b44dd282a5bf7606d122af P 3a9a63ca97694ebdb84bca730762d735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:51.817396 23121 catalog_manager.cc:5697] T 5959fc0b70884d699725fb8d560e5de5 P 9ba0da223cf24c97bc7d225e25015924 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132). New cstate: current_term: 1 leader_uuid: "9ba0da223cf24c97bc7d225e25015924" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:51.839183 23562 raft_consensus.cc:493] T 8da66c3ab79d468dbfd36407c51d423a P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:51.839686 23562 raft_consensus.cc:515] T 8da66c3ab79d468dbfd36407c51d423a P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:51.843449 23376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8da66c3ab79d468dbfd36407c51d423a" candidate_uuid: "9ba0da223cf24c97bc7d225e25015924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a9a63ca97694ebdb84bca730762d735" is_pre_election: true
I20260709 12:13:51.844170 23376 raft_consensus.cc:2468] T 8da66c3ab79d468dbfd36407c51d423a P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ba0da223cf24c97bc7d225e25015924 in term 0.
I20260709 12:13:51.845608 23415 leader_election.cc:304] T 8da66c3ab79d468dbfd36407c51d423a P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a9a63ca97694ebdb84bca730762d735, 9ba0da223cf24c97bc7d225e25015924; no voters: 
I20260709 12:13:51.846558 23594 raft_consensus.cc:2804] T 8da66c3ab79d468dbfd36407c51d423a P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:51.846933 23594 raft_consensus.cc:493] T 8da66c3ab79d468dbfd36407c51d423a P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:51.847244 23594 raft_consensus.cc:3060] T 8da66c3ab79d468dbfd36407c51d423a P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:51.816223 23497 tablet_bootstrap.cc:492] T 0646c3e87a184cd19184ff12695392a7 P 3a9a63ca97694ebdb84bca730762d735: Bootstrap starting.
I20260709 12:13:51.851122 23562 leader_election.cc:290] T 8da66c3ab79d468dbfd36407c51d423a P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061), 288a46a90f26471584043331107dc0dd (127.12.174.129:46159)
I20260709 12:13:51.852690 23225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8da66c3ab79d468dbfd36407c51d423a" candidate_uuid: "9ba0da223cf24c97bc7d225e25015924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "288a46a90f26471584043331107dc0dd" is_pre_election: true
I20260709 12:13:51.853158 23498 tablet_bootstrap.cc:492] T 0646c3e87a184cd19184ff12695392a7 P 2904b089bdb249b78950db76f4a70e9f: No bootstrap required, opened a new log
I20260709 12:13:51.858444 23498 ts_tablet_manager.cc:1403] T 0646c3e87a184cd19184ff12695392a7 P 2904b089bdb249b78950db76f4a70e9f: Time spent bootstrapping tablet: real 0.034s	user 0.007s	sys 0.005s
I20260709 12:13:51.858788 23531 raft_consensus.cc:493] T 138c2e6a55da4600a6318719808815ec P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:51.859323 23531 raft_consensus.cc:515] T 138c2e6a55da4600a6318719808815ec P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:51.857425 23594 raft_consensus.cc:515] T 8da66c3ab79d468dbfd36407c51d423a P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:51.856240 23516 raft_consensus.cc:493] T 509f7e554df04f83aeffd51ec07607d5 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:51.858328 23225 raft_consensus.cc:2468] T 8da66c3ab79d468dbfd36407c51d423a P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ba0da223cf24c97bc7d225e25015924 in term 0.
I20260709 12:13:51.891358 23562 consensus_queue.cc:1048] T eeda1df5d1624932a606c0a80e69d33a P 9ba0da223cf24c97bc7d225e25015924 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 12:13:51.887432 23124 catalog_manager.cc:5697] T 6626b442492c47849fd3c907d1c12f3e P 2904b089bdb249b78950db76f4a70e9f reported cstate change: term changed from 0 to 1, leader changed from <none> to 2904b089bdb249b78950db76f4a70e9f (127.12.174.130). New cstate: current_term: 1 leader_uuid: "2904b089bdb249b78950db76f4a70e9f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:51.862193 23498 raft_consensus.cc:359] T 0646c3e87a184cd19184ff12695392a7 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:51.901640 23498 raft_consensus.cc:385] T 0646c3e87a184cd19184ff12695392a7 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:51.902051 23498 raft_consensus.cc:740] T 0646c3e87a184cd19184ff12695392a7 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2904b089bdb249b78950db76f4a70e9f, State: Initialized, Role: FOLLOWER
I20260709 12:13:51.903002 23498 consensus_queue.cc:260] T 0646c3e87a184cd19184ff12695392a7 P 2904b089bdb249b78950db76f4a70e9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:51.893654 23496 tablet_bootstrap.cc:492] T 138c2e6a55da4600a6318719808815ec P 9ba0da223cf24c97bc7d225e25015924: No bootstrap required, opened a new log
I20260709 12:13:51.861627 23531 leader_election.cc:290] T 138c2e6a55da4600a6318719808815ec P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061), 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081)
I20260709 12:13:51.905288 23496 ts_tablet_manager.cc:1403] T 138c2e6a55da4600a6318719808815ec P 9ba0da223cf24c97bc7d225e25015924: Time spent bootstrapping tablet: real 0.087s	user 0.022s	sys 0.009s
I20260709 12:13:51.905398 23498 ts_tablet_manager.cc:1434] T 0646c3e87a184cd19184ff12695392a7 P 2904b089bdb249b78950db76f4a70e9f: Time spent starting tablet: real 0.047s	user 0.011s	sys 0.007s
I20260709 12:13:51.908388 23374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8da66c3ab79d468dbfd36407c51d423a" candidate_uuid: "9ba0da223cf24c97bc7d225e25015924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a9a63ca97694ebdb84bca730762d735"
I20260709 12:13:51.908651 23496 raft_consensus.cc:359] T 138c2e6a55da4600a6318719808815ec P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:51.909094 23374 raft_consensus.cc:3060] T 8da66c3ab79d468dbfd36407c51d423a P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:51.909538 23498 tablet_bootstrap.cc:492] T 00f9b2ddcf6e4a9bacf4a30c16a88765 P 2904b089bdb249b78950db76f4a70e9f: Bootstrap starting.
I20260709 12:13:51.865923 23376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138c2e6a55da4600a6318719808815ec" candidate_uuid: "2904b089bdb249b78950db76f4a70e9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a9a63ca97694ebdb84bca730762d735" is_pre_election: true
I20260709 12:13:51.910400 23376 raft_consensus.cc:2468] T 138c2e6a55da4600a6318719808815ec P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2904b089bdb249b78950db76f4a70e9f in term 0.
I20260709 12:13:51.911633 23267 leader_election.cc:304] T 138c2e6a55da4600a6318719808815ec P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2904b089bdb249b78950db76f4a70e9f, 3a9a63ca97694ebdb84bca730762d735; no voters: 
I20260709 12:13:51.877566 23533 consensus_queue.cc:1048] T 99bc4210d0b44dd282a5bf7606d122af P 3a9a63ca97694ebdb84bca730762d735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.035s
I20260709 12:13:51.912774 23531 raft_consensus.cc:2804] T 138c2e6a55da4600a6318719808815ec P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:51.913168 23531 raft_consensus.cc:493] T 138c2e6a55da4600a6318719808815ec P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:51.913501 23531 raft_consensus.cc:3060] T 138c2e6a55da4600a6318719808815ec P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:51.909436 23496 raft_consensus.cc:385] T 138c2e6a55da4600a6318719808815ec P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:51.916152 23496 raft_consensus.cc:740] T 138c2e6a55da4600a6318719808815ec P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ba0da223cf24c97bc7d225e25015924, State: Initialized, Role: FOLLOWER
I20260709 12:13:51.918641 23496 consensus_queue.cc:260] T 138c2e6a55da4600a6318719808815ec P 9ba0da223cf24c97bc7d225e25015924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:51.861660 23495 tablet_bootstrap.cc:492] T 00335dfad3394f0c9689c0df8500bc9e P 288a46a90f26471584043331107dc0dd: No bootstrap required, opened a new log
I20260709 12:13:51.868527 23450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138c2e6a55da4600a6318719808815ec" candidate_uuid: "2904b089bdb249b78950db76f4a70e9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba0da223cf24c97bc7d225e25015924" is_pre_election: true
I20260709 12:13:51.923396 23498 tablet_bootstrap.cc:654] T 00f9b2ddcf6e4a9bacf4a30c16a88765 P 2904b089bdb249b78950db76f4a70e9f: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:51.932565 23531 raft_consensus.cc:515] T 138c2e6a55da4600a6318719808815ec P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:51.936115 23376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138c2e6a55da4600a6318719808815ec" candidate_uuid: "2904b089bdb249b78950db76f4a70e9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a9a63ca97694ebdb84bca730762d735"
I20260709 12:13:51.936735 23376 raft_consensus.cc:3060] T 138c2e6a55da4600a6318719808815ec P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:51.945245 23376 raft_consensus.cc:2468] T 138c2e6a55da4600a6318719808815ec P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2904b089bdb249b78950db76f4a70e9f in term 1.
I20260709 12:13:51.946604 23267 leader_election.cc:304] T 138c2e6a55da4600a6318719808815ec P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2904b089bdb249b78950db76f4a70e9f, 3a9a63ca97694ebdb84bca730762d735; no voters: 
I20260709 12:13:51.947799 23603 raft_consensus.cc:2804] T 138c2e6a55da4600a6318719808815ec P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:51.948352 23603 raft_consensus.cc:697] T 138c2e6a55da4600a6318719808815ec P 2904b089bdb249b78950db76f4a70e9f [term 1 LEADER]: Becoming Leader. State: Replica: 2904b089bdb249b78950db76f4a70e9f, State: Running, Role: LEADER
I20260709 12:13:51.925649 23516 raft_consensus.cc:515] T 509f7e554df04f83aeffd51ec07607d5 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:51.928272 23496 ts_tablet_manager.cc:1434] T 138c2e6a55da4600a6318719808815ec P 9ba0da223cf24c97bc7d225e25015924: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.001s
I20260709 12:13:51.949291 23603 consensus_queue.cc:237] T 138c2e6a55da4600a6318719808815ec P 2904b089bdb249b78950db76f4a70e9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:51.929046 23374 raft_consensus.cc:2468] T 8da66c3ab79d468dbfd36407c51d423a P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ba0da223cf24c97bc7d225e25015924 in term 1.
I20260709 12:13:51.951323 23415 leader_election.cc:304] T 8da66c3ab79d468dbfd36407c51d423a P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a9a63ca97694ebdb84bca730762d735, 9ba0da223cf24c97bc7d225e25015924; no voters: 
I20260709 12:13:51.952068 23373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509f7e554df04f83aeffd51ec07607d5" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a9a63ca97694ebdb84bca730762d735" is_pre_election: true
I20260709 12:13:51.952310 23562 raft_consensus.cc:2804] T 8da66c3ab79d468dbfd36407c51d423a P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:51.953466 23562 raft_consensus.cc:697] T 8da66c3ab79d468dbfd36407c51d423a P 9ba0da223cf24c97bc7d225e25015924 [term 1 LEADER]: Becoming Leader. State: Replica: 9ba0da223cf24c97bc7d225e25015924, State: Running, Role: LEADER
I20260709 12:13:51.953956 23496 tablet_bootstrap.cc:492] T 859d30d8c3fb4a499256ffad6dc2d1cd P 9ba0da223cf24c97bc7d225e25015924: Bootstrap starting.
W20260709 12:13:51.954701 23192 leader_election.cc:343] T 509f7e554df04f83aeffd51ec07607d5 P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:51.954430 23562 consensus_queue.cc:237] T 8da66c3ab79d468dbfd36407c51d423a P 9ba0da223cf24c97bc7d225e25015924 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:51.959297 23374 raft_consensus.cc:3060] T 6626b442492c47849fd3c907d1c12f3e P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:51.946934 23450 raft_consensus.cc:2468] T 138c2e6a55da4600a6318719808815ec P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2904b089bdb249b78950db76f4a70e9f in term 0.
I20260709 12:13:51.931051 23495 ts_tablet_manager.cc:1403] T 00335dfad3394f0c9689c0df8500bc9e P 288a46a90f26471584043331107dc0dd: Time spent bootstrapping tablet: real 0.136s	user 0.018s	sys 0.009s
I20260709 12:13:51.966486 23531 leader_election.cc:290] T 138c2e6a55da4600a6318719808815ec P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 1 election: Requested vote from peers 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061), 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081)
I20260709 12:13:51.968238 23450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "138c2e6a55da4600a6318719808815ec" candidate_uuid: "2904b089bdb249b78950db76f4a70e9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba0da223cf24c97bc7d225e25015924"
I20260709 12:13:51.863981 23497 tablet_bootstrap.cc:654] T 0646c3e87a184cd19184ff12695392a7 P 3a9a63ca97694ebdb84bca730762d735: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:51.966743 23594 leader_election.cc:290] T 8da66c3ab79d468dbfd36407c51d423a P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 1 election: Requested vote from peers 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061), 288a46a90f26471584043331107dc0dd (127.12.174.129:46159)
I20260709 12:13:51.969035 23227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8da66c3ab79d468dbfd36407c51d423a" candidate_uuid: "9ba0da223cf24c97bc7d225e25015924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "288a46a90f26471584043331107dc0dd"
I20260709 12:13:51.974645 23227 raft_consensus.cc:3060] T 8da66c3ab79d468dbfd36407c51d423a P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:51.969070 23450 raft_consensus.cc:3060] T 138c2e6a55da4600a6318719808815ec P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:51.979588 23495 raft_consensus.cc:359] T 00335dfad3394f0c9689c0df8500bc9e P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:51.980506 23495 raft_consensus.cc:385] T 00335dfad3394f0c9689c0df8500bc9e P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:51.980834 23495 raft_consensus.cc:740] T 00335dfad3394f0c9689c0df8500bc9e P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 288a46a90f26471584043331107dc0dd, State: Initialized, Role: FOLLOWER
I20260709 12:13:51.983392 23496 tablet_bootstrap.cc:654] T 859d30d8c3fb4a499256ffad6dc2d1cd P 9ba0da223cf24c97bc7d225e25015924: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:51.985380 23495 consensus_queue.cc:260] T 00335dfad3394f0c9689c0df8500bc9e P 288a46a90f26471584043331107dc0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:51.982803 23516 leader_election.cc:290] T 509f7e554df04f83aeffd51ec07607d5 P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061), 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081)
I20260709 12:13:51.997658 23448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509f7e554df04f83aeffd51ec07607d5" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba0da223cf24c97bc7d225e25015924" is_pre_election: true
I20260709 12:13:52.013449 23495 ts_tablet_manager.cc:1434] T 00335dfad3394f0c9689c0df8500bc9e P 288a46a90f26471584043331107dc0dd: Time spent starting tablet: real 0.048s	user 0.013s	sys 0.016s
I20260709 12:13:52.014743 23495 tablet_bootstrap.cc:492] T 8771e0b5070c49c589f276c793f87727 P 288a46a90f26471584043331107dc0dd: Bootstrap starting.
I20260709 12:13:52.016018 23498 tablet_bootstrap.cc:492] T 00f9b2ddcf6e4a9bacf4a30c16a88765 P 2904b089bdb249b78950db76f4a70e9f: No bootstrap required, opened a new log
I20260709 12:13:52.016568 23498 ts_tablet_manager.cc:1403] T 00f9b2ddcf6e4a9bacf4a30c16a88765 P 2904b089bdb249b78950db76f4a70e9f: Time spent bootstrapping tablet: real 0.107s	user 0.021s	sys 0.013s
I20260709 12:13:52.016974 23301 raft_consensus.cc:3060] T 5959fc0b70884d699725fb8d560e5de5 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:52.023190 23448 raft_consensus.cc:2468] T 509f7e554df04f83aeffd51ec07607d5 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 288a46a90f26471584043331107dc0dd in term 0.
I20260709 12:13:52.037403 23603 consensus_queue.cc:1048] T 6626b442492c47849fd3c907d1c12f3e P 2904b089bdb249b78950db76f4a70e9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:52.037827 23191 leader_election.cc:304] T 509f7e554df04f83aeffd51ec07607d5 P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 288a46a90f26471584043331107dc0dd, 9ba0da223cf24c97bc7d225e25015924; no voters: 3a9a63ca97694ebdb84bca730762d735
I20260709 12:13:52.044749 23516 raft_consensus.cc:2804] T 509f7e554df04f83aeffd51ec07607d5 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:52.045308 23516 raft_consensus.cc:493] T 509f7e554df04f83aeffd51ec07607d5 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:52.045674 23516 raft_consensus.cc:3060] T 509f7e554df04f83aeffd51ec07607d5 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:52.047784 23121 catalog_manager.cc:5697] T 138c2e6a55da4600a6318719808815ec P 2904b089bdb249b78950db76f4a70e9f reported cstate change: term changed from 0 to 1, leader changed from <none> to 2904b089bdb249b78950db76f4a70e9f (127.12.174.130). New cstate: current_term: 1 leader_uuid: "2904b089bdb249b78950db76f4a70e9f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:52.042629 23498 raft_consensus.cc:359] T 00f9b2ddcf6e4a9bacf4a30c16a88765 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:52.054272 23498 raft_consensus.cc:385] T 00f9b2ddcf6e4a9bacf4a30c16a88765 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:52.054582 23498 raft_consensus.cc:740] T 00f9b2ddcf6e4a9bacf4a30c16a88765 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2904b089bdb249b78950db76f4a70e9f, State: Initialized, Role: FOLLOWER
I20260709 12:13:52.055349 23302 raft_consensus.cc:3060] T eeda1df5d1624932a606c0a80e69d33a P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:52.055287 23498 consensus_queue.cc:260] T 00f9b2ddcf6e4a9bacf4a30c16a88765 P 2904b089bdb249b78950db76f4a70e9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:52.063472 23497 tablet_bootstrap.cc:492] T 0646c3e87a184cd19184ff12695392a7 P 3a9a63ca97694ebdb84bca730762d735: No bootstrap required, opened a new log
I20260709 12:13:52.064127 23497 ts_tablet_manager.cc:1403] T 0646c3e87a184cd19184ff12695392a7 P 3a9a63ca97694ebdb84bca730762d735: Time spent bootstrapping tablet: real 0.248s	user 0.019s	sys 0.001s
I20260709 12:13:52.064946 23498 ts_tablet_manager.cc:1434] T 00f9b2ddcf6e4a9bacf4a30c16a88765 P 2904b089bdb249b78950db76f4a70e9f: Time spent starting tablet: real 0.048s	user 0.008s	sys 0.001s
I20260709 12:13:52.071734 23531 raft_consensus.cc:493] T 5959fc0b70884d699725fb8d560e5de5 P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:52.072708 23531 raft_consensus.cc:515] T 5959fc0b70884d699725fb8d560e5de5 P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:52.074124 23498 tablet_bootstrap.cc:492] T 8771e0b5070c49c589f276c793f87727 P 2904b089bdb249b78950db76f4a70e9f: Bootstrap starting.
I20260709 12:13:52.076033 23531 leader_election.cc:290] T 5959fc0b70884d699725fb8d560e5de5 P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081), 288a46a90f26471584043331107dc0dd (127.12.174.129:46159)
I20260709 12:13:52.076507 23227 raft_consensus.cc:2468] T 8da66c3ab79d468dbfd36407c51d423a P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ba0da223cf24c97bc7d225e25015924 in term 1.
I20260709 12:13:52.076931 23496 tablet_bootstrap.cc:492] T 859d30d8c3fb4a499256ffad6dc2d1cd P 9ba0da223cf24c97bc7d225e25015924: No bootstrap required, opened a new log
I20260709 12:13:52.071739 23495 tablet_bootstrap.cc:654] T 8771e0b5070c49c589f276c793f87727 P 288a46a90f26471584043331107dc0dd: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:52.080506 23496 ts_tablet_manager.cc:1403] T 859d30d8c3fb4a499256ffad6dc2d1cd P 9ba0da223cf24c97bc7d225e25015924: Time spent bootstrapping tablet: real 0.127s	user 0.016s	sys 0.011s
I20260709 12:13:52.083757 23448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5959fc0b70884d699725fb8d560e5de5" candidate_uuid: "2904b089bdb249b78950db76f4a70e9f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba0da223cf24c97bc7d225e25015924" is_pre_election: true
I20260709 12:13:52.086189 23595 consensus_queue.cc:1048] T 5959fc0b70884d699725fb8d560e5de5 P 9ba0da223cf24c97bc7d225e25015924 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:52.092726 23496 raft_consensus.cc:359] T 859d30d8c3fb4a499256ffad6dc2d1cd P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:52.093604 23496 raft_consensus.cc:385] T 859d30d8c3fb4a499256ffad6dc2d1cd P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:52.093891 23496 raft_consensus.cc:740] T 859d30d8c3fb4a499256ffad6dc2d1cd P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ba0da223cf24c97bc7d225e25015924, State: Initialized, Role: FOLLOWER
I20260709 12:13:52.094631 23496 consensus_queue.cc:260] T 859d30d8c3fb4a499256ffad6dc2d1cd P 9ba0da223cf24c97bc7d225e25015924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:52.095352 23497 raft_consensus.cc:359] T 0646c3e87a184cd19184ff12695392a7 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:52.096095 23497 raft_consensus.cc:385] T 0646c3e87a184cd19184ff12695392a7 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:52.096395 23497 raft_consensus.cc:740] T 0646c3e87a184cd19184ff12695392a7 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a9a63ca97694ebdb84bca730762d735, State: Initialized, Role: FOLLOWER
I20260709 12:13:52.097234 23496 ts_tablet_manager.cc:1434] T 859d30d8c3fb4a499256ffad6dc2d1cd P 9ba0da223cf24c97bc7d225e25015924: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 12:13:52.097121 23497 consensus_queue.cc:260] T 0646c3e87a184cd19184ff12695392a7 P 3a9a63ca97694ebdb84bca730762d735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:52.098251 23498 tablet_bootstrap.cc:654] T 8771e0b5070c49c589f276c793f87727 P 2904b089bdb249b78950db76f4a70e9f: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:52.099615 23496 tablet_bootstrap.cc:492] T 00f9b2ddcf6e4a9bacf4a30c16a88765 P 9ba0da223cf24c97bc7d225e25015924: Bootstrap starting.
I20260709 12:13:52.106412 23595 consensus_queue.cc:1048] T eeda1df5d1624932a606c0a80e69d33a P 9ba0da223cf24c97bc7d225e25015924 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:52.106594 23516 raft_consensus.cc:515] T 509f7e554df04f83aeffd51ec07607d5 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
W20260709 12:13:52.091426 23191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:46081, user_credentials={real_user=slave}} blocked reactor thread for 53759.9us
I20260709 12:13:52.109596 23450 raft_consensus.cc:2468] T 138c2e6a55da4600a6318719808815ec P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2904b089bdb249b78950db76f4a70e9f in term 1.
I20260709 12:13:52.121665 23603 consensus_queue.cc:1048] T 6626b442492c47849fd3c907d1c12f3e P 2904b089bdb249b78950db76f4a70e9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:52.124750 23375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509f7e554df04f83aeffd51ec07607d5" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a9a63ca97694ebdb84bca730762d735"
W20260709 12:13:52.127452 23192 leader_election.cc:343] T 509f7e554df04f83aeffd51ec07607d5 P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:52.122659 23226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5959fc0b70884d699725fb8d560e5de5" candidate_uuid: "2904b089bdb249b78950db76f4a70e9f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "288a46a90f26471584043331107dc0dd" is_pre_election: true
I20260709 12:13:52.128557 23226 raft_consensus.cc:2468] T 5959fc0b70884d699725fb8d560e5de5 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2904b089bdb249b78950db76f4a70e9f in term 1.
I20260709 12:13:52.131650 23268 leader_election.cc:304] T 5959fc0b70884d699725fb8d560e5de5 P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 288a46a90f26471584043331107dc0dd, 2904b089bdb249b78950db76f4a70e9f; no voters: 9ba0da223cf24c97bc7d225e25015924
I20260709 12:13:52.132097 23594 consensus_queue.cc:1048] T 5959fc0b70884d699725fb8d560e5de5 P 9ba0da223cf24c97bc7d225e25015924 [LEADER]: Connected to new peer: Peer: permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:52.134506 23496 tablet_bootstrap.cc:654] T 00f9b2ddcf6e4a9bacf4a30c16a88765 P 9ba0da223cf24c97bc7d225e25015924: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:52.134865 23497 ts_tablet_manager.cc:1434] T 0646c3e87a184cd19184ff12695392a7 P 3a9a63ca97694ebdb84bca730762d735: Time spent starting tablet: real 0.070s	user 0.008s	sys 0.001s
I20260709 12:13:52.136296 23497 tablet_bootstrap.cc:492] T 509f7e554df04f83aeffd51ec07607d5 P 3a9a63ca97694ebdb84bca730762d735: Bootstrap starting.
I20260709 12:13:52.146642 23125 catalog_manager.cc:5697] T 8da66c3ab79d468dbfd36407c51d423a P 9ba0da223cf24c97bc7d225e25015924 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132). New cstate: current_term: 1 leader_uuid: "9ba0da223cf24c97bc7d225e25015924" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:52.163224 23495 tablet_bootstrap.cc:492] T 8771e0b5070c49c589f276c793f87727 P 288a46a90f26471584043331107dc0dd: No bootstrap required, opened a new log
I20260709 12:13:52.164029 23495 ts_tablet_manager.cc:1403] T 8771e0b5070c49c589f276c793f87727 P 288a46a90f26471584043331107dc0dd: Time spent bootstrapping tablet: real 0.150s	user 0.031s	sys 0.022s
I20260709 12:13:52.167682 23603 raft_consensus.cc:2804] T 5959fc0b70884d699725fb8d560e5de5 P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:52.171878 23498 tablet_bootstrap.cc:492] T 8771e0b5070c49c589f276c793f87727 P 2904b089bdb249b78950db76f4a70e9f: No bootstrap required, opened a new log
I20260709 12:13:52.172521 23498 ts_tablet_manager.cc:1403] T 8771e0b5070c49c589f276c793f87727 P 2904b089bdb249b78950db76f4a70e9f: Time spent bootstrapping tablet: real 0.099s	user 0.013s	sys 0.011s
I20260709 12:13:52.173894 23603 raft_consensus.cc:493] T 5959fc0b70884d699725fb8d560e5de5 P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9ba0da223cf24c97bc7d225e25015924)
I20260709 12:13:52.174419 23603 raft_consensus.cc:3060] T 5959fc0b70884d699725fb8d560e5de5 P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:52.176126 23498 raft_consensus.cc:359] T 8771e0b5070c49c589f276c793f87727 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:52.176915 23498 raft_consensus.cc:385] T 8771e0b5070c49c589f276c793f87727 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:52.177178 23498 raft_consensus.cc:740] T 8771e0b5070c49c589f276c793f87727 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2904b089bdb249b78950db76f4a70e9f, State: Initialized, Role: FOLLOWER
I20260709 12:13:52.177979 23498 consensus_queue.cc:260] T 8771e0b5070c49c589f276c793f87727 P 2904b089bdb249b78950db76f4a70e9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:52.180217 23498 ts_tablet_manager.cc:1434] T 8771e0b5070c49c589f276c793f87727 P 2904b089bdb249b78950db76f4a70e9f: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:13:52.181203 23516 leader_election.cc:290] T 509f7e554df04f83aeffd51ec07607d5 P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 1 election: Requested vote from peers 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061), 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081)
I20260709 12:13:52.181360 23498 tablet_bootstrap.cc:492] T 0411013dc7c347ada4fd2c2a0cf134bd P 2904b089bdb249b78950db76f4a70e9f: Bootstrap starting.
I20260709 12:13:52.181921 23497 tablet_bootstrap.cc:654] T 509f7e554df04f83aeffd51ec07607d5 P 3a9a63ca97694ebdb84bca730762d735: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:52.183372 23450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509f7e554df04f83aeffd51ec07607d5" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba0da223cf24c97bc7d225e25015924"
I20260709 12:13:52.184496 23450 raft_consensus.cc:3060] T 509f7e554df04f83aeffd51ec07607d5 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:52.184626 23496 tablet_bootstrap.cc:492] T 00f9b2ddcf6e4a9bacf4a30c16a88765 P 9ba0da223cf24c97bc7d225e25015924: No bootstrap required, opened a new log
I20260709 12:13:52.185439 23496 ts_tablet_manager.cc:1403] T 00f9b2ddcf6e4a9bacf4a30c16a88765 P 9ba0da223cf24c97bc7d225e25015924: Time spent bootstrapping tablet: real 0.086s	user 0.017s	sys 0.000s
I20260709 12:13:52.188810 23496 raft_consensus.cc:359] T 00f9b2ddcf6e4a9bacf4a30c16a88765 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:52.189677 23496 raft_consensus.cc:385] T 00f9b2ddcf6e4a9bacf4a30c16a88765 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:52.190145 23496 raft_consensus.cc:740] T 00f9b2ddcf6e4a9bacf4a30c16a88765 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ba0da223cf24c97bc7d225e25015924, State: Initialized, Role: FOLLOWER
I20260709 12:13:52.191049 23496 consensus_queue.cc:260] T 00f9b2ddcf6e4a9bacf4a30c16a88765 P 9ba0da223cf24c97bc7d225e25015924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:52.193444 23496 ts_tablet_manager.cc:1434] T 00f9b2ddcf6e4a9bacf4a30c16a88765 P 9ba0da223cf24c97bc7d225e25015924: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:13:52.194576 23496 tablet_bootstrap.cc:492] T a2f2a063cf2b4190826d81b2dcbf7709 P 9ba0da223cf24c97bc7d225e25015924: Bootstrap starting.
I20260709 12:13:52.210474 23495 raft_consensus.cc:359] T 8771e0b5070c49c589f276c793f87727 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:52.214673 23594 raft_consensus.cc:493] T 00f9b2ddcf6e4a9bacf4a30c16a88765 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:52.216286 23495 raft_consensus.cc:385] T 8771e0b5070c49c589f276c793f87727 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:52.216838 23495 raft_consensus.cc:740] T 8771e0b5070c49c589f276c793f87727 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 288a46a90f26471584043331107dc0dd, State: Initialized, Role: FOLLOWER
I20260709 12:13:52.218438 23594 raft_consensus.cc:515] T 00f9b2ddcf6e4a9bacf4a30c16a88765 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:52.216084 23595 raft_consensus.cc:493] T 00335dfad3394f0c9689c0df8500bc9e P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:52.222124 23595 raft_consensus.cc:515] T 00335dfad3394f0c9689c0df8500bc9e P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:52.222930 23302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f9b2ddcf6e4a9bacf4a30c16a88765" candidate_uuid: "9ba0da223cf24c97bc7d225e25015924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2904b089bdb249b78950db76f4a70e9f" is_pre_election: true
I20260709 12:13:52.223697 23302 raft_consensus.cc:2468] T 00f9b2ddcf6e4a9bacf4a30c16a88765 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ba0da223cf24c97bc7d225e25015924 in term 0.
I20260709 12:13:52.222944 23374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f9b2ddcf6e4a9bacf4a30c16a88765" candidate_uuid: "9ba0da223cf24c97bc7d225e25015924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a9a63ca97694ebdb84bca730762d735" is_pre_election: true
I20260709 12:13:52.226142 23495 consensus_queue.cc:260] T 8771e0b5070c49c589f276c793f87727 P 288a46a90f26471584043331107dc0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:52.227341 23498 tablet_bootstrap.cc:654] T 0411013dc7c347ada4fd2c2a0cf134bd P 2904b089bdb249b78950db76f4a70e9f: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:52.231354 23415 leader_election.cc:304] T 00f9b2ddcf6e4a9bacf4a30c16a88765 P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2904b089bdb249b78950db76f4a70e9f, 9ba0da223cf24c97bc7d225e25015924; no voters: 
I20260709 12:13:52.231504 23227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00335dfad3394f0c9689c0df8500bc9e" candidate_uuid: "9ba0da223cf24c97bc7d225e25015924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "288a46a90f26471584043331107dc0dd" is_pre_election: true
I20260709 12:13:52.232456 23227 raft_consensus.cc:2468] T 00335dfad3394f0c9689c0df8500bc9e P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ba0da223cf24c97bc7d225e25015924 in term 0.
I20260709 12:13:52.221673 23594 leader_election.cc:290] T 00f9b2ddcf6e4a9bacf4a30c16a88765 P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789), 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061)
I20260709 12:13:52.239128 23495 ts_tablet_manager.cc:1434] T 8771e0b5070c49c589f276c793f87727 P 288a46a90f26471584043331107dc0dd: Time spent starting tablet: real 0.075s	user 0.008s	sys 0.001s
I20260709 12:13:52.224556 23595 leader_election.cc:290] T 00335dfad3394f0c9689c0df8500bc9e P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 288a46a90f26471584043331107dc0dd (127.12.174.129:46159), 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789)
I20260709 12:13:52.241398 23302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00335dfad3394f0c9689c0df8500bc9e" candidate_uuid: "9ba0da223cf24c97bc7d225e25015924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2904b089bdb249b78950db76f4a70e9f" is_pre_election: true
I20260709 12:13:52.250476 23302 raft_consensus.cc:2468] T 00335dfad3394f0c9689c0df8500bc9e P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ba0da223cf24c97bc7d225e25015924 in term 0.
I20260709 12:13:52.244177 23416 leader_election.cc:304] T 00335dfad3394f0c9689c0df8500bc9e P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 288a46a90f26471584043331107dc0dd, 9ba0da223cf24c97bc7d225e25015924; no voters: 
I20260709 12:13:52.244891 23496 tablet_bootstrap.cc:654] T a2f2a063cf2b4190826d81b2dcbf7709 P 9ba0da223cf24c97bc7d225e25015924: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:52.252925 23595 raft_consensus.cc:2804] T 00335dfad3394f0c9689c0df8500bc9e P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:52.253350 23595 raft_consensus.cc:493] T 00335dfad3394f0c9689c0df8500bc9e P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:52.253719 23595 raft_consensus.cc:3060] T 00335dfad3394f0c9689c0df8500bc9e P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:52.245791 23562 raft_consensus.cc:2804] T 00f9b2ddcf6e4a9bacf4a30c16a88765 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:52.257941 23450 raft_consensus.cc:2468] T 509f7e554df04f83aeffd51ec07607d5 P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 288a46a90f26471584043331107dc0dd in term 1.
I20260709 12:13:52.261860 23495 tablet_bootstrap.cc:492] T 0646c3e87a184cd19184ff12695392a7 P 288a46a90f26471584043331107dc0dd: Bootstrap starting.
W20260709 12:13:52.262250 23415 leader_election.cc:343] T 00f9b2ddcf6e4a9bacf4a30c16a88765 P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:52.262439 23191 leader_election.cc:304] T 509f7e554df04f83aeffd51ec07607d5 P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 288a46a90f26471584043331107dc0dd, 9ba0da223cf24c97bc7d225e25015924; no voters: 3a9a63ca97694ebdb84bca730762d735
I20260709 12:13:52.263723 23516 raft_consensus.cc:2804] T 509f7e554df04f83aeffd51ec07607d5 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:52.264264 23516 raft_consensus.cc:697] T 509f7e554df04f83aeffd51ec07607d5 P 288a46a90f26471584043331107dc0dd [term 1 LEADER]: Becoming Leader. State: Replica: 288a46a90f26471584043331107dc0dd, State: Running, Role: LEADER
I20260709 12:13:52.265224 23516 consensus_queue.cc:237] T 509f7e554df04f83aeffd51ec07607d5 P 288a46a90f26471584043331107dc0dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:52.268966 23495 tablet_bootstrap.cc:654] T 0646c3e87a184cd19184ff12695392a7 P 288a46a90f26471584043331107dc0dd: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:52.260946 23603 raft_consensus.cc:515] T 5959fc0b70884d699725fb8d560e5de5 P 2904b089bdb249b78950db76f4a70e9f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:52.260571 23562 raft_consensus.cc:493] T 00f9b2ddcf6e4a9bacf4a30c16a88765 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:52.272940 23302 raft_consensus.cc:1240] T 5959fc0b70884d699725fb8d560e5de5 P 2904b089bdb249b78950db76f4a70e9f [term 2 FOLLOWER]: Rejecting Update request from peer 9ba0da223cf24c97bc7d225e25015924 for earlier term 1. Current term is 2. Ops: []
I20260709 12:13:52.277889 23603 leader_election.cc:290] T 5959fc0b70884d699725fb8d560e5de5 P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 2 election: Requested vote from peers 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081), 288a46a90f26471584043331107dc0dd (127.12.174.129:46159)
I20260709 12:13:52.278698 23227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5959fc0b70884d699725fb8d560e5de5" candidate_uuid: "2904b089bdb249b78950db76f4a70e9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "288a46a90f26471584043331107dc0dd"
I20260709 12:13:52.288209 23450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5959fc0b70884d699725fb8d560e5de5" candidate_uuid: "2904b089bdb249b78950db76f4a70e9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ba0da223cf24c97bc7d225e25015924"
I20260709 12:13:52.289515 23497 tablet_bootstrap.cc:492] T 509f7e554df04f83aeffd51ec07607d5 P 3a9a63ca97694ebdb84bca730762d735: No bootstrap required, opened a new log
I20260709 12:13:52.290189 23497 ts_tablet_manager.cc:1403] T 509f7e554df04f83aeffd51ec07607d5 P 3a9a63ca97694ebdb84bca730762d735: Time spent bootstrapping tablet: real 0.154s	user 0.026s	sys 0.024s
I20260709 12:13:52.291899 23496 tablet_bootstrap.cc:492] T a2f2a063cf2b4190826d81b2dcbf7709 P 9ba0da223cf24c97bc7d225e25015924: No bootstrap required, opened a new log
I20260709 12:13:52.292966 23595 raft_consensus.cc:515] T 00335dfad3394f0c9689c0df8500bc9e P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:52.272717 23562 raft_consensus.cc:3060] T 00f9b2ddcf6e4a9bacf4a30c16a88765 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:52.294327 23497 raft_consensus.cc:359] T 509f7e554df04f83aeffd51ec07607d5 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:52.295087 23496 ts_tablet_manager.cc:1403] T a2f2a063cf2b4190826d81b2dcbf7709 P 9ba0da223cf24c97bc7d225e25015924: Time spent bootstrapping tablet: real 0.101s	user 0.016s	sys 0.002s
I20260709 12:13:52.295823 23497 raft_consensus.cc:385] T 509f7e554df04f83aeffd51ec07607d5 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:52.289764 23266 leader_election.cc:304] T 5959fc0b70884d699725fb8d560e5de5 P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2904b089bdb249b78950db76f4a70e9f; no voters: 288a46a90f26471584043331107dc0dd, 9ba0da223cf24c97bc7d225e25015924
I20260709 12:13:52.297128 23603 raft_consensus.cc:2749] T 5959fc0b70884d699725fb8d560e5de5 P 2904b089bdb249b78950db76f4a70e9f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:13:52.296242 23638 raft_consensus.cc:493] T 8771e0b5070c49c589f276c793f87727 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:52.298004 23638 raft_consensus.cc:515] T 8771e0b5070c49c589f276c793f87727 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:52.299002 23227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00335dfad3394f0c9689c0df8500bc9e" candidate_uuid: "9ba0da223cf24c97bc7d225e25015924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "288a46a90f26471584043331107dc0dd"
I20260709 12:13:52.299649 23227 raft_consensus.cc:3060] T 00335dfad3394f0c9689c0df8500bc9e P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:52.300199 23638 leader_election.cc:290] T 8771e0b5070c49c589f276c793f87727 P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789), 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061)
I20260709 12:13:52.304589 23374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8771e0b5070c49c589f276c793f87727" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a9a63ca97694ebdb84bca730762d735" is_pre_election: true
I20260709 12:13:52.304279 23124 catalog_manager.cc:5697] T 509f7e554df04f83aeffd51ec07607d5 P 288a46a90f26471584043331107dc0dd reported cstate change: term changed from 0 to 1, leader changed from <none> to 288a46a90f26471584043331107dc0dd (127.12.174.129). New cstate: current_term: 1 leader_uuid: "288a46a90f26471584043331107dc0dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } health_report { overall_health: HEALTHY } } }
W20260709 12:13:52.306859 23192 leader_election.cc:343] T 8771e0b5070c49c589f276c793f87727 P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:52.296351 23497 raft_consensus.cc:740] T 509f7e554df04f83aeffd51ec07607d5 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a9a63ca97694ebdb84bca730762d735, State: Initialized, Role: FOLLOWER
I20260709 12:13:52.308336 23302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8771e0b5070c49c589f276c793f87727" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2904b089bdb249b78950db76f4a70e9f" is_pre_election: true
I20260709 12:13:52.309084 23302 raft_consensus.cc:2468] T 8771e0b5070c49c589f276c793f87727 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 288a46a90f26471584043331107dc0dd in term 0.
I20260709 12:13:52.309195 23497 consensus_queue.cc:260] T 509f7e554df04f83aeffd51ec07607d5 P 3a9a63ca97694ebdb84bca730762d735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:52.310590 23192 leader_election.cc:304] T 8771e0b5070c49c589f276c793f87727 P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 288a46a90f26471584043331107dc0dd, 2904b089bdb249b78950db76f4a70e9f; no voters: 3a9a63ca97694ebdb84bca730762d735
I20260709 12:13:52.312678 23497 ts_tablet_manager.cc:1434] T 509f7e554df04f83aeffd51ec07607d5 P 3a9a63ca97694ebdb84bca730762d735: Time spent starting tablet: real 0.022s	user 0.009s	sys 0.000s
I20260709 12:13:52.312966 23638 raft_consensus.cc:2804] T 8771e0b5070c49c589f276c793f87727 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:52.314745 23638 raft_consensus.cc:493] T 8771e0b5070c49c589f276c793f87727 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:52.315011 23497 tablet_bootstrap.cc:492] T 00f9b2ddcf6e4a9bacf4a30c16a88765 P 3a9a63ca97694ebdb84bca730762d735: Bootstrap starting.
I20260709 12:13:52.315289 23638 raft_consensus.cc:3060] T 8771e0b5070c49c589f276c793f87727 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:52.317382 23227 raft_consensus.cc:2468] T 00335dfad3394f0c9689c0df8500bc9e P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ba0da223cf24c97bc7d225e25015924 in term 1.
I20260709 12:13:52.319718 23416 leader_election.cc:304] T 00335dfad3394f0c9689c0df8500bc9e P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 288a46a90f26471584043331107dc0dd, 9ba0da223cf24c97bc7d225e25015924; no voters: 
I20260709 12:13:52.320556 23595 leader_election.cc:290] T 00335dfad3394f0c9689c0df8500bc9e P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 1 election: Requested vote from peers 288a46a90f26471584043331107dc0dd (127.12.174.129:46159), 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789)
I20260709 12:13:52.325255 23562 raft_consensus.cc:515] T 00f9b2ddcf6e4a9bacf4a30c16a88765 P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:52.326900 23533 raft_consensus.cc:493] T 0646c3e87a184cd19184ff12695392a7 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:52.327059 23638 raft_consensus.cc:515] T 8771e0b5070c49c589f276c793f87727 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:52.328087 23533 raft_consensus.cc:515] T 0646c3e87a184cd19184ff12695392a7 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:52.330539 23533 leader_election.cc:290] T 0646c3e87a184cd19184ff12695392a7 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 288a46a90f26471584043331107dc0dd (127.12.174.129:46159), 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789)
I20260709 12:13:52.331866 23302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0646c3e87a184cd19184ff12695392a7" candidate_uuid: "3a9a63ca97694ebdb84bca730762d735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2904b089bdb249b78950db76f4a70e9f" is_pre_election: true
I20260709 12:13:52.332336 23227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0646c3e87a184cd19184ff12695392a7" candidate_uuid: "3a9a63ca97694ebdb84bca730762d735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "288a46a90f26471584043331107dc0dd" is_pre_election: true
I20260709 12:13:52.332607 23302 raft_consensus.cc:2468] T 0646c3e87a184cd19184ff12695392a7 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a9a63ca97694ebdb84bca730762d735 in term 0.
W20260709 12:13:52.333753 23342 leader_election.cc:343] T 0646c3e87a184cd19184ff12695392a7 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:52.334522 23341 leader_election.cc:304] T 0646c3e87a184cd19184ff12695392a7 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2904b089bdb249b78950db76f4a70e9f, 3a9a63ca97694ebdb84bca730762d735; no voters: 288a46a90f26471584043331107dc0dd
I20260709 12:13:52.335947 23533 raft_consensus.cc:2804] T 0646c3e87a184cd19184ff12695392a7 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:52.336802 23533 raft_consensus.cc:493] T 0646c3e87a184cd19184ff12695392a7 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:52.337435 23533 raft_consensus.cc:3060] T 0646c3e87a184cd19184ff12695392a7 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:52.336058 23562 leader_election.cc:290] T 00f9b2ddcf6e4a9bacf4a30c16a88765 P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 1 election: Requested vote from peers 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789), 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061)
I20260709 12:13:52.339672 23302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8771e0b5070c49c589f276c793f87727" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2904b089bdb249b78950db76f4a70e9f"
I20260709 12:13:52.340361 23302 raft_consensus.cc:3060] T 8771e0b5070c49c589f276c793f87727 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:13:52.340173 23415 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:45789, user_credentials={real_user=slave}} blocked reactor thread for 44118.4us
I20260709 12:13:52.346577 23562 raft_consensus.cc:2804] T 00335dfad3394f0c9689c0df8500bc9e P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:52.347193 23562 raft_consensus.cc:697] T 00335dfad3394f0c9689c0df8500bc9e P 9ba0da223cf24c97bc7d225e25015924 [term 1 LEADER]: Becoming Leader. State: Replica: 9ba0da223cf24c97bc7d225e25015924, State: Running, Role: LEADER
I20260709 12:13:52.348067 23562 consensus_queue.cc:237] T 00335dfad3394f0c9689c0df8500bc9e P 9ba0da223cf24c97bc7d225e25015924 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:52.350627 23301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00335dfad3394f0c9689c0df8500bc9e" candidate_uuid: "9ba0da223cf24c97bc7d225e25015924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2904b089bdb249b78950db76f4a70e9f"
I20260709 12:13:52.351289 23301 raft_consensus.cc:3060] T 00335dfad3394f0c9689c0df8500bc9e P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:52.351584 23300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f9b2ddcf6e4a9bacf4a30c16a88765" candidate_uuid: "9ba0da223cf24c97bc7d225e25015924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2904b089bdb249b78950db76f4a70e9f"
I20260709 12:13:52.352285 23300 raft_consensus.cc:3060] T 00f9b2ddcf6e4a9bacf4a30c16a88765 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:52.354332 23497 tablet_bootstrap.cc:654] T 00f9b2ddcf6e4a9bacf4a30c16a88765 P 3a9a63ca97694ebdb84bca730762d735: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:52.346479 23595 consensus_queue.cc:1059] T 5959fc0b70884d699725fb8d560e5de5 P 9ba0da223cf24c97bc7d225e25015924 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 12:13:52.359045 23650 raft_consensus.cc:3055] T 5959fc0b70884d699725fb8d560e5de5 P 9ba0da223cf24c97bc7d225e25015924 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:52.359462 23650 raft_consensus.cc:740] T 5959fc0b70884d699725fb8d560e5de5 P 9ba0da223cf24c97bc7d225e25015924 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9ba0da223cf24c97bc7d225e25015924, State: Running, Role: LEADER
I20260709 12:13:52.351519 23496 raft_consensus.cc:359] T a2f2a063cf2b4190826d81b2dcbf7709 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:52.360430 23650 consensus_queue.cc:260] T 5959fc0b70884d699725fb8d560e5de5 P 9ba0da223cf24c97bc7d225e25015924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:52.364353 23650 raft_consensus.cc:3060] T 5959fc0b70884d699725fb8d560e5de5 P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:52.361752 23374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f9b2ddcf6e4a9bacf4a30c16a88765" candidate_uuid: "9ba0da223cf24c97bc7d225e25015924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a9a63ca97694ebdb84bca730762d735"
I20260709 12:13:52.361719 23595 raft_consensus.cc:493] T 859d30d8c3fb4a499256ffad6dc2d1cd P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:52.366470 23595 raft_consensus.cc:515] T 859d30d8c3fb4a499256ffad6dc2d1cd P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:52.367787 23374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8771e0b5070c49c589f276c793f87727" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a9a63ca97694ebdb84bca730762d735"
W20260709 12:13:52.369621 23192 leader_election.cc:343] T 8771e0b5070c49c589f276c793f87727 P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:13:52.370886 23415 leader_election.cc:343] T 00f9b2ddcf6e4a9bacf4a30c16a88765 P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:52.373003 23301 raft_consensus.cc:2468] T 00335dfad3394f0c9689c0df8500bc9e P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ba0da223cf24c97bc7d225e25015924 in term 1.
I20260709 12:13:52.375169 23299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859d30d8c3fb4a499256ffad6dc2d1cd" candidate_uuid: "9ba0da223cf24c97bc7d225e25015924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2904b089bdb249b78950db76f4a70e9f" is_pre_election: true
I20260709 12:13:52.375458 23300 raft_consensus.cc:2468] T 00f9b2ddcf6e4a9bacf4a30c16a88765 P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ba0da223cf24c97bc7d225e25015924 in term 1.
I20260709 12:13:52.378472 23533 raft_consensus.cc:515] T 0646c3e87a184cd19184ff12695392a7 P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:52.370776 23227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859d30d8c3fb4a499256ffad6dc2d1cd" candidate_uuid: "9ba0da223cf24c97bc7d225e25015924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "288a46a90f26471584043331107dc0dd" is_pre_election: true
W20260709 12:13:52.380487 23416 leader_election.cc:343] T 859d30d8c3fb4a499256ffad6dc2d1cd P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:52.380606 23583 consensus_queue.cc:1048] T 138c2e6a55da4600a6318719808815ec P 2904b089bdb249b78950db76f4a70e9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:52.370743 23595 leader_election.cc:290] T 859d30d8c3fb4a499256ffad6dc2d1cd P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 288a46a90f26471584043331107dc0dd (127.12.174.129:46159), 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789)
I20260709 12:13:52.372099 23496 raft_consensus.cc:385] T a2f2a063cf2b4190826d81b2dcbf7709 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:52.382136 23496 raft_consensus.cc:740] T a2f2a063cf2b4190826d81b2dcbf7709 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ba0da223cf24c97bc7d225e25015924, State: Initialized, Role: FOLLOWER
I20260709 12:13:52.383152 23298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0646c3e87a184cd19184ff12695392a7" candidate_uuid: "3a9a63ca97694ebdb84bca730762d735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2904b089bdb249b78950db76f4a70e9f"
I20260709 12:13:52.383286 23227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0646c3e87a184cd19184ff12695392a7" candidate_uuid: "3a9a63ca97694ebdb84bca730762d735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "288a46a90f26471584043331107dc0dd"
I20260709 12:13:52.382990 23496 consensus_queue.cc:260] T a2f2a063cf2b4190826d81b2dcbf7709 P 9ba0da223cf24c97bc7d225e25015924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:52.383903 23298 raft_consensus.cc:3060] T 0646c3e87a184cd19184ff12695392a7 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:13:52.385250 23342 leader_election.cc:343] T 0646c3e87a184cd19184ff12695392a7 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:52.387526 23496 ts_tablet_manager.cc:1434] T a2f2a063cf2b4190826d81b2dcbf7709 P 9ba0da223cf24c97bc7d225e25015924: Time spent starting tablet: real 0.092s	user 0.005s	sys 0.003s
I20260709 12:13:52.387450 23498 tablet_bootstrap.cc:492] T 0411013dc7c347ada4fd2c2a0cf134bd P 2904b089bdb249b78950db76f4a70e9f: No bootstrap required, opened a new log
I20260709 12:13:52.388291 23638 leader_election.cc:290] T 8771e0b5070c49c589f276c793f87727 P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 1 election: Requested vote from peers 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789), 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061)
I20260709 12:13:52.388500 23498 ts_tablet_manager.cc:1403] T 0411013dc7c347ada4fd2c2a0cf134bd P 2904b089bdb249b78950db76f4a70e9f: Time spent bootstrapping tablet: real 0.207s	user 0.019s	sys 0.000s
I20260709 12:13:52.391877 23533 leader_election.cc:290] T 0646c3e87a184cd19184ff12695392a7 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 election: Requested vote from peers 288a46a90f26471584043331107dc0dd (127.12.174.129:46159), 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789)
I20260709 12:13:52.392165 23496 tablet_bootstrap.cc:492] T 0411013dc7c347ada4fd2c2a0cf134bd P 9ba0da223cf24c97bc7d225e25015924: Bootstrap starting.
I20260709 12:13:52.392596 23495 tablet_bootstrap.cc:492] T 0646c3e87a184cd19184ff12695392a7 P 288a46a90f26471584043331107dc0dd: No bootstrap required, opened a new log
I20260709 12:13:52.395179 23498 raft_consensus.cc:359] T 0411013dc7c347ada4fd2c2a0cf134bd P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:52.395593 23495 ts_tablet_manager.cc:1403] T 0646c3e87a184cd19184ff12695392a7 P 288a46a90f26471584043331107dc0dd: Time spent bootstrapping tablet: real 0.137s	user 0.021s	sys 0.014s
I20260709 12:13:52.395951 23498 raft_consensus.cc:385] T 0411013dc7c347ada4fd2c2a0cf134bd P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:52.396312 23498 raft_consensus.cc:740] T 0411013dc7c347ada4fd2c2a0cf134bd P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2904b089bdb249b78950db76f4a70e9f, State: Initialized, Role: FOLLOWER
I20260709 12:13:52.396955 23498 consensus_queue.cc:260] T 0411013dc7c347ada4fd2c2a0cf134bd P 2904b089bdb249b78950db76f4a70e9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:52.405077 23498 ts_tablet_manager.cc:1434] T 0411013dc7c347ada4fd2c2a0cf134bd P 2904b089bdb249b78950db76f4a70e9f: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 12:13:52.411872 23495 raft_consensus.cc:359] T 0646c3e87a184cd19184ff12695392a7 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:52.412729 23495 raft_consensus.cc:385] T 0646c3e87a184cd19184ff12695392a7 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:52.413015 23495 raft_consensus.cc:740] T 0646c3e87a184cd19184ff12695392a7 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 288a46a90f26471584043331107dc0dd, State: Initialized, Role: FOLLOWER
I20260709 12:13:52.413785 23495 consensus_queue.cc:260] T 0646c3e87a184cd19184ff12695392a7 P 288a46a90f26471584043331107dc0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:52.414194 23583 raft_consensus.cc:493] T 0411013dc7c347ada4fd2c2a0cf134bd P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:52.414713 23583 raft_consensus.cc:515] T 0411013dc7c347ada4fd2c2a0cf134bd P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:52.418534 23583 leader_election.cc:290] T 0411013dc7c347ada4fd2c2a0cf134bd P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061), 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081)
I20260709 12:13:52.419030 23374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0411013dc7c347ada4fd2c2a0cf134bd" candidate_uuid: "2904b089bdb249b78950db76f4a70e9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a9a63ca97694ebdb84bca730762d735" is_pre_election: true
I20260709 12:13:52.420537 23495 ts_tablet_manager.cc:1434] T 0646c3e87a184cd19184ff12695392a7 P 288a46a90f26471584043331107dc0dd: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.000s
I20260709 12:13:52.421963 23498 tablet_bootstrap.cc:492] T c3ac99f9dbb24693b97d3994ceb65955 P 2904b089bdb249b78950db76f4a70e9f: Bootstrap starting.
I20260709 12:13:52.420492 23450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0411013dc7c347ada4fd2c2a0cf134bd" candidate_uuid: "2904b089bdb249b78950db76f4a70e9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba0da223cf24c97bc7d225e25015924" is_pre_election: true
I20260709 12:13:52.423810 23562 consensus_queue.cc:1048] T 8da66c3ab79d468dbfd36407c51d423a P 9ba0da223cf24c97bc7d225e25015924 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:52.424010 23638 raft_consensus.cc:493] T 0646c3e87a184cd19184ff12695392a7 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:52.424677 23638 raft_consensus.cc:515] T 0646c3e87a184cd19184ff12695392a7 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:52.425359 23415 leader_election.cc:304] T 00f9b2ddcf6e4a9bacf4a30c16a88765 P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2904b089bdb249b78950db76f4a70e9f, 9ba0da223cf24c97bc7d225e25015924; no voters: 3a9a63ca97694ebdb84bca730762d735
W20260709 12:13:52.421437 23267 leader_election.cc:343] T 0411013dc7c347ada4fd2c2a0cf134bd P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:52.426366 23595 raft_consensus.cc:2804] T 00f9b2ddcf6e4a9bacf4a30c16a88765 P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:52.426882 23595 raft_consensus.cc:697] T 00f9b2ddcf6e4a9bacf4a30c16a88765 P 9ba0da223cf24c97bc7d225e25015924 [term 1 LEADER]: Becoming Leader. State: Replica: 9ba0da223cf24c97bc7d225e25015924, State: Running, Role: LEADER
I20260709 12:13:52.427775 23595 consensus_queue.cc:237] T 00f9b2ddcf6e4a9bacf4a30c16a88765 P 9ba0da223cf24c97bc7d225e25015924 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
W20260709 12:13:52.430581 23415 leader_election.cc:343] T 859d30d8c3fb4a499256ffad6dc2d1cd P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:52.432175 23374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0646c3e87a184cd19184ff12695392a7" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a9a63ca97694ebdb84bca730762d735" is_pre_election: true
W20260709 12:13:52.426939 23266 leader_election.cc:343] T 0411013dc7c347ada4fd2c2a0cf134bd P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:52.434263 23374 raft_consensus.cc:2393] T 0646c3e87a184cd19184ff12695392a7 P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 288a46a90f26471584043331107dc0dd in current term 1: Already voted for candidate 3a9a63ca97694ebdb84bca730762d735 in this term.
I20260709 12:13:52.433220 23495 tablet_bootstrap.cc:492] T 859d30d8c3fb4a499256ffad6dc2d1cd P 288a46a90f26471584043331107dc0dd: Bootstrap starting.
I20260709 12:13:52.434087 23266 leader_election.cc:304] T 0411013dc7c347ada4fd2c2a0cf134bd P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2904b089bdb249b78950db76f4a70e9f; no voters: 3a9a63ca97694ebdb84bca730762d735, 9ba0da223cf24c97bc7d225e25015924
I20260709 12:13:52.432726 23638 leader_election.cc:290] T 0646c3e87a184cd19184ff12695392a7 P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789), 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061)
I20260709 12:13:52.437979 23298 raft_consensus.cc:2468] T 0646c3e87a184cd19184ff12695392a7 P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a9a63ca97694ebdb84bca730762d735 in term 1.
I20260709 12:13:52.439523 23583 raft_consensus.cc:2749] T 0411013dc7c347ada4fd2c2a0cf134bd P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:52.441414 23299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0646c3e87a184cd19184ff12695392a7" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2904b089bdb249b78950db76f4a70e9f" is_pre_election: true
I20260709 12:13:52.442466 23299 raft_consensus.cc:2393] T 0646c3e87a184cd19184ff12695392a7 P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 288a46a90f26471584043331107dc0dd in current term 1: Already voted for candidate 3a9a63ca97694ebdb84bca730762d735 in this term.
I20260709 12:13:52.443992 23497 tablet_bootstrap.cc:492] T 00f9b2ddcf6e4a9bacf4a30c16a88765 P 3a9a63ca97694ebdb84bca730762d735: No bootstrap required, opened a new log
I20260709 12:13:52.444586 23497 ts_tablet_manager.cc:1403] T 00f9b2ddcf6e4a9bacf4a30c16a88765 P 3a9a63ca97694ebdb84bca730762d735: Time spent bootstrapping tablet: real 0.130s	user 0.029s	sys 0.003s
I20260709 12:13:52.444343 23192 leader_election.cc:304] T 0646c3e87a184cd19184ff12695392a7 P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 288a46a90f26471584043331107dc0dd; no voters: 2904b089bdb249b78950db76f4a70e9f, 3a9a63ca97694ebdb84bca730762d735
I20260709 12:13:52.445412 23638 raft_consensus.cc:3060] T 0646c3e87a184cd19184ff12695392a7 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:52.447254 23341 leader_election.cc:304] T 0646c3e87a184cd19184ff12695392a7 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2904b089bdb249b78950db76f4a70e9f, 3a9a63ca97694ebdb84bca730762d735; no voters: 288a46a90f26471584043331107dc0dd
I20260709 12:13:52.447703 23497 raft_consensus.cc:359] T 00f9b2ddcf6e4a9bacf4a30c16a88765 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:52.448487 23497 raft_consensus.cc:385] T 00f9b2ddcf6e4a9bacf4a30c16a88765 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:52.448793 23497 raft_consensus.cc:740] T 00f9b2ddcf6e4a9bacf4a30c16a88765 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a9a63ca97694ebdb84bca730762d735, State: Initialized, Role: FOLLOWER
I20260709 12:13:52.448851 23533 raft_consensus.cc:2804] T 0646c3e87a184cd19184ff12695392a7 P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:52.449872 23415 leader_election.cc:304] T 859d30d8c3fb4a499256ffad6dc2d1cd P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ba0da223cf24c97bc7d225e25015924; no voters: 288a46a90f26471584043331107dc0dd, 2904b089bdb249b78950db76f4a70e9f
I20260709 12:13:52.450798 23594 raft_consensus.cc:2749] T 859d30d8c3fb4a499256ffad6dc2d1cd P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:52.455678 23124 catalog_manager.cc:5697] T 00335dfad3394f0c9689c0df8500bc9e P 9ba0da223cf24c97bc7d225e25015924 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132). New cstate: current_term: 1 leader_uuid: "9ba0da223cf24c97bc7d225e25015924" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:52.439548 23302 raft_consensus.cc:2468] T 8771e0b5070c49c589f276c793f87727 P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 288a46a90f26471584043331107dc0dd in term 1.
I20260709 12:13:52.461352 23192 leader_election.cc:304] T 8771e0b5070c49c589f276c793f87727 P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 288a46a90f26471584043331107dc0dd, 2904b089bdb249b78950db76f4a70e9f; no voters: 3a9a63ca97694ebdb84bca730762d735
I20260709 12:13:52.464217 23498 tablet_bootstrap.cc:654] T c3ac99f9dbb24693b97d3994ceb65955 P 2904b089bdb249b78950db76f4a70e9f: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:52.464686 23632 raft_consensus.cc:2804] T 8771e0b5070c49c589f276c793f87727 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:52.465250 23632 raft_consensus.cc:697] T 8771e0b5070c49c589f276c793f87727 P 288a46a90f26471584043331107dc0dd [term 1 LEADER]: Becoming Leader. State: Replica: 288a46a90f26471584043331107dc0dd, State: Running, Role: LEADER
I20260709 12:13:52.466131 23495 tablet_bootstrap.cc:654] T 859d30d8c3fb4a499256ffad6dc2d1cd P 288a46a90f26471584043331107dc0dd: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:52.449559 23497 consensus_queue.cc:260] T 00f9b2ddcf6e4a9bacf4a30c16a88765 P 3a9a63ca97694ebdb84bca730762d735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:52.470584 23638 raft_consensus.cc:2749] T 0646c3e87a184cd19184ff12695392a7 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:13:52.478698 23173 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:13:52.477680 23533 raft_consensus.cc:697] T 0646c3e87a184cd19184ff12695392a7 P 3a9a63ca97694ebdb84bca730762d735 [term 1 LEADER]: Becoming Leader. State: Replica: 3a9a63ca97694ebdb84bca730762d735, State: Running, Role: LEADER
I20260709 12:13:52.482278 23531 consensus_queue.cc:1048] T 138c2e6a55da4600a6318719808815ec P 2904b089bdb249b78950db76f4a70e9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:52.482970 23533 consensus_queue.cc:237] T 0646c3e87a184cd19184ff12695392a7 P 3a9a63ca97694ebdb84bca730762d735 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:52.485077 23496 tablet_bootstrap.cc:654] T 0411013dc7c347ada4fd2c2a0cf134bd P 9ba0da223cf24c97bc7d225e25015924: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:52.466259 23632 consensus_queue.cc:237] T 8771e0b5070c49c589f276c793f87727 P 288a46a90f26471584043331107dc0dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:52.504732 23497 ts_tablet_manager.cc:1434] T 00f9b2ddcf6e4a9bacf4a30c16a88765 P 3a9a63ca97694ebdb84bca730762d735: Time spent starting tablet: real 0.060s	user 0.026s	sys 0.004s
I20260709 12:13:52.522212 23661 raft_consensus.cc:493] T 509f7e554df04f83aeffd51ec07607d5 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:52.522924 23661 raft_consensus.cc:515] T 509f7e554df04f83aeffd51ec07607d5 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:52.534590 23661 leader_election.cc:290] T 509f7e554df04f83aeffd51ec07607d5 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081), 288a46a90f26471584043331107dc0dd (127.12.174.129:46159)
I20260709 12:13:52.534729 23448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509f7e554df04f83aeffd51ec07607d5" candidate_uuid: "3a9a63ca97694ebdb84bca730762d735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba0da223cf24c97bc7d225e25015924" is_pre_election: true
I20260709 12:13:52.535316 23663 raft_consensus.cc:493] T 00f9b2ddcf6e4a9bacf4a30c16a88765 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:52.535653 23448 raft_consensus.cc:2393] T 509f7e554df04f83aeffd51ec07607d5 P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3a9a63ca97694ebdb84bca730762d735 in current term 1: Already voted for candidate 288a46a90f26471584043331107dc0dd in this term.
I20260709 12:13:52.535897 23663 raft_consensus.cc:515] T 00f9b2ddcf6e4a9bacf4a30c16a88765 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:52.542866 23663 leader_election.cc:290] T 00f9b2ddcf6e4a9bacf4a30c16a88765 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789), 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081)
I20260709 12:13:52.545819 23497 tablet_bootstrap.cc:492] T 0411013dc7c347ada4fd2c2a0cf134bd P 3a9a63ca97694ebdb84bca730762d735: Bootstrap starting.
I20260709 12:13:52.548346 23302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f9b2ddcf6e4a9bacf4a30c16a88765" candidate_uuid: "3a9a63ca97694ebdb84bca730762d735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2904b089bdb249b78950db76f4a70e9f" is_pre_election: true
I20260709 12:13:52.549369 23302 raft_consensus.cc:2393] T 00f9b2ddcf6e4a9bacf4a30c16a88765 P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3a9a63ca97694ebdb84bca730762d735 in current term 1: Already voted for candidate 9ba0da223cf24c97bc7d225e25015924 in this term.
I20260709 12:13:52.550463 23226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509f7e554df04f83aeffd51ec07607d5" candidate_uuid: "3a9a63ca97694ebdb84bca730762d735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "288a46a90f26471584043331107dc0dd" is_pre_election: true
I20260709 12:13:52.552791 23497 tablet_bootstrap.cc:654] T 0411013dc7c347ada4fd2c2a0cf134bd P 3a9a63ca97694ebdb84bca730762d735: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:52.552393 23342 leader_election.cc:304] T 509f7e554df04f83aeffd51ec07607d5 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3a9a63ca97694ebdb84bca730762d735; no voters: 288a46a90f26471584043331107dc0dd, 9ba0da223cf24c97bc7d225e25015924
I20260709 12:13:52.556846 23450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f9b2ddcf6e4a9bacf4a30c16a88765" candidate_uuid: "3a9a63ca97694ebdb84bca730762d735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba0da223cf24c97bc7d225e25015924" is_pre_election: true
I20260709 12:13:52.563138 23496 tablet_bootstrap.cc:492] T 0411013dc7c347ada4fd2c2a0cf134bd P 9ba0da223cf24c97bc7d225e25015924: No bootstrap required, opened a new log
I20260709 12:13:52.563776 23496 ts_tablet_manager.cc:1403] T 0411013dc7c347ada4fd2c2a0cf134bd P 9ba0da223cf24c97bc7d225e25015924: Time spent bootstrapping tablet: real 0.175s	user 0.022s	sys 0.004s
I20260709 12:13:52.569895 23663 raft_consensus.cc:3060] T 509f7e554df04f83aeffd51ec07607d5 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:52.568259 23340 leader_election.cc:304] T 00f9b2ddcf6e4a9bacf4a30c16a88765 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3a9a63ca97694ebdb84bca730762d735; no voters: 2904b089bdb249b78950db76f4a70e9f, 9ba0da223cf24c97bc7d225e25015924
I20260709 12:13:52.574249 23595 consensus_queue.cc:1048] T 8da66c3ab79d468dbfd36407c51d423a P 9ba0da223cf24c97bc7d225e25015924 [LEADER]: Connected to new peer: Peer: permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:52.574659 23533 raft_consensus.cc:3060] T 00f9b2ddcf6e4a9bacf4a30c16a88765 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:52.593003 23124 catalog_manager.cc:5697] T 8771e0b5070c49c589f276c793f87727 P 288a46a90f26471584043331107dc0dd reported cstate change: term changed from 0 to 1, leader changed from <none> to 288a46a90f26471584043331107dc0dd (127.12.174.129). New cstate: current_term: 1 leader_uuid: "288a46a90f26471584043331107dc0dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:52.601246 23498 tablet_bootstrap.cc:492] T c3ac99f9dbb24693b97d3994ceb65955 P 2904b089bdb249b78950db76f4a70e9f: No bootstrap required, opened a new log
I20260709 12:13:52.602043 23498 ts_tablet_manager.cc:1403] T c3ac99f9dbb24693b97d3994ceb65955 P 2904b089bdb249b78950db76f4a70e9f: Time spent bootstrapping tablet: real 0.193s	user 0.012s	sys 0.015s
I20260709 12:13:52.598928 23495 tablet_bootstrap.cc:492] T 859d30d8c3fb4a499256ffad6dc2d1cd P 288a46a90f26471584043331107dc0dd: No bootstrap required, opened a new log
I20260709 12:13:52.602924 23495 ts_tablet_manager.cc:1403] T 859d30d8c3fb4a499256ffad6dc2d1cd P 288a46a90f26471584043331107dc0dd: Time spent bootstrapping tablet: real 0.172s	user 0.022s	sys 0.002s
I20260709 12:13:52.598426 23496 raft_consensus.cc:359] T 0411013dc7c347ada4fd2c2a0cf134bd P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:52.618129 23496 raft_consensus.cc:385] T 0411013dc7c347ada4fd2c2a0cf134bd P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:52.618505 23496 raft_consensus.cc:740] T 0411013dc7c347ada4fd2c2a0cf134bd P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ba0da223cf24c97bc7d225e25015924, State: Initialized, Role: FOLLOWER
I20260709 12:13:52.619258 23496 consensus_queue.cc:260] T 0411013dc7c347ada4fd2c2a0cf134bd P 9ba0da223cf24c97bc7d225e25015924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:52.607990 23533 raft_consensus.cc:2749] T 00f9b2ddcf6e4a9bacf4a30c16a88765 P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:52.609155 23663 raft_consensus.cc:2749] T 509f7e554df04f83aeffd51ec07607d5 P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:13:52.610348 23671 log.cc:927] Time spent T 0646c3e87a184cd19184ff12695392a7 P 3a9a63ca97694ebdb84bca730762d735: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 12:13:52.620875 23495 raft_consensus.cc:359] T 859d30d8c3fb4a499256ffad6dc2d1cd P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:52.621539 23495 raft_consensus.cc:385] T 859d30d8c3fb4a499256ffad6dc2d1cd P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:52.621723 23495 raft_consensus.cc:740] T 859d30d8c3fb4a499256ffad6dc2d1cd P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 288a46a90f26471584043331107dc0dd, State: Initialized, Role: FOLLOWER
I20260709 12:13:52.616197 23497 tablet_bootstrap.cc:492] T 0411013dc7c347ada4fd2c2a0cf134bd P 3a9a63ca97694ebdb84bca730762d735: No bootstrap required, opened a new log
I20260709 12:13:52.605206 23498 raft_consensus.cc:359] T c3ac99f9dbb24693b97d3994ceb65955 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:52.622732 23498 raft_consensus.cc:385] T c3ac99f9dbb24693b97d3994ceb65955 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:52.623042 23498 raft_consensus.cc:740] T c3ac99f9dbb24693b97d3994ceb65955 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2904b089bdb249b78950db76f4a70e9f, State: Initialized, Role: FOLLOWER
I20260709 12:13:52.623972 23498 consensus_queue.cc:260] T c3ac99f9dbb24693b97d3994ceb65955 P 2904b089bdb249b78950db76f4a70e9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:52.622869 23497 ts_tablet_manager.cc:1403] T 0411013dc7c347ada4fd2c2a0cf134bd P 3a9a63ca97694ebdb84bca730762d735: Time spent bootstrapping tablet: real 0.081s	user 0.030s	sys 0.013s
I20260709 12:13:52.625289 23121 catalog_manager.cc:5697] T 0646c3e87a184cd19184ff12695392a7 P 3a9a63ca97694ebdb84bca730762d735 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131). New cstate: current_term: 1 leader_uuid: "3a9a63ca97694ebdb84bca730762d735" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:52.628849 23497 raft_consensus.cc:359] T 0411013dc7c347ada4fd2c2a0cf134bd P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:52.629562 23497 raft_consensus.cc:385] T 0411013dc7c347ada4fd2c2a0cf134bd P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:52.629846 23497 raft_consensus.cc:740] T 0411013dc7c347ada4fd2c2a0cf134bd P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a9a63ca97694ebdb84bca730762d735, State: Initialized, Role: FOLLOWER
I20260709 12:13:52.630751 23498 ts_tablet_manager.cc:1434] T c3ac99f9dbb24693b97d3994ceb65955 P 2904b089bdb249b78950db76f4a70e9f: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.000s
I20260709 12:13:52.630697 23497 consensus_queue.cc:260] T 0411013dc7c347ada4fd2c2a0cf134bd P 3a9a63ca97694ebdb84bca730762d735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:52.632017 23498 tablet_bootstrap.cc:492] T 525cb2c0e02b473bba2e7025f5765db2 P 2904b089bdb249b78950db76f4a70e9f: Bootstrap starting.
I20260709 12:13:52.622376 23495 consensus_queue.cc:260] T 859d30d8c3fb4a499256ffad6dc2d1cd P 288a46a90f26471584043331107dc0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:52.624800 23496 ts_tablet_manager.cc:1434] T 0411013dc7c347ada4fd2c2a0cf134bd P 9ba0da223cf24c97bc7d225e25015924: Time spent starting tablet: real 0.061s	user 0.007s	sys 0.000s
I20260709 12:13:52.633659 23497 ts_tablet_manager.cc:1434] T 0411013dc7c347ada4fd2c2a0cf134bd P 3a9a63ca97694ebdb84bca730762d735: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:13:52.635001 23497 tablet_bootstrap.cc:492] T 8771e0b5070c49c589f276c793f87727 P 3a9a63ca97694ebdb84bca730762d735: Bootstrap starting.
I20260709 12:13:52.636772 23495 ts_tablet_manager.cc:1434] T 859d30d8c3fb4a499256ffad6dc2d1cd P 288a46a90f26471584043331107dc0dd: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.001s
I20260709 12:13:52.637637 23495 tablet_bootstrap.cc:492] T d55aba14f62b41538fdb710117d67580 P 288a46a90f26471584043331107dc0dd: Bootstrap starting.
I20260709 12:13:52.634948 23496 tablet_bootstrap.cc:492] T 525cb2c0e02b473bba2e7025f5765db2 P 9ba0da223cf24c97bc7d225e25015924: Bootstrap starting.
I20260709 12:13:52.642377 23497 tablet_bootstrap.cc:654] T 8771e0b5070c49c589f276c793f87727 P 3a9a63ca97694ebdb84bca730762d735: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:52.645720 23496 tablet_bootstrap.cc:654] T 525cb2c0e02b473bba2e7025f5765db2 P 9ba0da223cf24c97bc7d225e25015924: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:52.650871 23498 tablet_bootstrap.cc:654] T 525cb2c0e02b473bba2e7025f5765db2 P 2904b089bdb249b78950db76f4a70e9f: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:52.645720 23495 tablet_bootstrap.cc:654] T d55aba14f62b41538fdb710117d67580 P 288a46a90f26471584043331107dc0dd: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:52.658205 23496 tablet_bootstrap.cc:492] T 525cb2c0e02b473bba2e7025f5765db2 P 9ba0da223cf24c97bc7d225e25015924: No bootstrap required, opened a new log
I20260709 12:13:52.658792 23496 ts_tablet_manager.cc:1403] T 525cb2c0e02b473bba2e7025f5765db2 P 9ba0da223cf24c97bc7d225e25015924: Time spent bootstrapping tablet: real 0.024s	user 0.010s	sys 0.008s
I20260709 12:13:52.662880 23122 catalog_manager.cc:5697] T 00f9b2ddcf6e4a9bacf4a30c16a88765 P 9ba0da223cf24c97bc7d225e25015924 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132). New cstate: current_term: 1 leader_uuid: "9ba0da223cf24c97bc7d225e25015924" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:52.665863 23497 tablet_bootstrap.cc:492] T 8771e0b5070c49c589f276c793f87727 P 3a9a63ca97694ebdb84bca730762d735: No bootstrap required, opened a new log
I20260709 12:13:52.666496 23497 ts_tablet_manager.cc:1403] T 8771e0b5070c49c589f276c793f87727 P 3a9a63ca97694ebdb84bca730762d735: Time spent bootstrapping tablet: real 0.032s	user 0.016s	sys 0.015s
I20260709 12:13:52.666554 23496 raft_consensus.cc:359] T 525cb2c0e02b473bba2e7025f5765db2 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:52.667315 23496 raft_consensus.cc:385] T 525cb2c0e02b473bba2e7025f5765db2 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:52.667598 23496 raft_consensus.cc:740] T 525cb2c0e02b473bba2e7025f5765db2 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ba0da223cf24c97bc7d225e25015924, State: Initialized, Role: FOLLOWER
I20260709 12:13:52.668336 23496 consensus_queue.cc:260] T 525cb2c0e02b473bba2e7025f5765db2 P 9ba0da223cf24c97bc7d225e25015924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:52.670027 23497 raft_consensus.cc:359] T 8771e0b5070c49c589f276c793f87727 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:52.670562 23496 ts_tablet_manager.cc:1434] T 525cb2c0e02b473bba2e7025f5765db2 P 9ba0da223cf24c97bc7d225e25015924: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:13:52.670872 23497 raft_consensus.cc:385] T 8771e0b5070c49c589f276c793f87727 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:52.671243 23497 raft_consensus.cc:740] T 8771e0b5070c49c589f276c793f87727 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a9a63ca97694ebdb84bca730762d735, State: Initialized, Role: FOLLOWER
I20260709 12:13:52.671670 23496 tablet_bootstrap.cc:492] T b1533753456b445991715da5158c921b P 9ba0da223cf24c97bc7d225e25015924: Bootstrap starting.
I20260709 12:13:52.672083 23497 consensus_queue.cc:260] T 8771e0b5070c49c589f276c793f87727 P 3a9a63ca97694ebdb84bca730762d735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:52.674670 23497 ts_tablet_manager.cc:1434] T 8771e0b5070c49c589f276c793f87727 P 3a9a63ca97694ebdb84bca730762d735: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:13:52.675956 23497 tablet_bootstrap.cc:492] T d55aba14f62b41538fdb710117d67580 P 3a9a63ca97694ebdb84bca730762d735: Bootstrap starting.
I20260709 12:13:52.691421 23594 raft_consensus.cc:493] T a2f2a063cf2b4190826d81b2dcbf7709 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:52.692274 23594 raft_consensus.cc:515] T a2f2a063cf2b4190826d81b2dcbf7709 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:52.724740 23533 raft_consensus.cc:493] T 8771e0b5070c49c589f276c793f87727 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:52.725471 23533 raft_consensus.cc:515] T 8771e0b5070c49c589f276c793f87727 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:52.727774 23533 leader_election.cc:290] T 8771e0b5070c49c589f276c793f87727 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 288a46a90f26471584043331107dc0dd (127.12.174.129:46159), 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789)
I20260709 12:13:52.728001 23374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f2a063cf2b4190826d81b2dcbf7709" candidate_uuid: "9ba0da223cf24c97bc7d225e25015924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a9a63ca97694ebdb84bca730762d735" is_pre_election: true
I20260709 12:13:52.729485 23226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8771e0b5070c49c589f276c793f87727" candidate_uuid: "3a9a63ca97694ebdb84bca730762d735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "288a46a90f26471584043331107dc0dd" is_pre_election: true
I20260709 12:13:52.729386 23638 consensus_queue.cc:1048] T 509f7e554df04f83aeffd51ec07607d5 P 288a46a90f26471584043331107dc0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:52.731586 23226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f2a063cf2b4190826d81b2dcbf7709" candidate_uuid: "9ba0da223cf24c97bc7d225e25015924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "288a46a90f26471584043331107dc0dd" is_pre_election: true
W20260709 12:13:52.732139 23415 leader_election.cc:343] T a2f2a063cf2b4190826d81b2dcbf7709 P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:52.733103 23302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8771e0b5070c49c589f276c793f87727" candidate_uuid: "3a9a63ca97694ebdb84bca730762d735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2904b089bdb249b78950db76f4a70e9f" is_pre_election: true
W20260709 12:13:52.733294 23416 leader_election.cc:343] T a2f2a063cf2b4190826d81b2dcbf7709 P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:52.733877 23416 leader_election.cc:304] T a2f2a063cf2b4190826d81b2dcbf7709 P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ba0da223cf24c97bc7d225e25015924; no voters: 288a46a90f26471584043331107dc0dd, 3a9a63ca97694ebdb84bca730762d735
I20260709 12:13:52.734937 23651 raft_consensus.cc:2749] T a2f2a063cf2b4190826d81b2dcbf7709 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:52.734040 23302 raft_consensus.cc:2393] T 8771e0b5070c49c589f276c793f87727 P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3a9a63ca97694ebdb84bca730762d735 in current term 1: Already voted for candidate 288a46a90f26471584043331107dc0dd in this term.
I20260709 12:13:52.736409 23594 leader_election.cc:290] T a2f2a063cf2b4190826d81b2dcbf7709 P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061), 288a46a90f26471584043331107dc0dd (127.12.174.129:46159)
I20260709 12:13:52.736967 23341 leader_election.cc:304] T 8771e0b5070c49c589f276c793f87727 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3a9a63ca97694ebdb84bca730762d735; no voters: 288a46a90f26471584043331107dc0dd, 2904b089bdb249b78950db76f4a70e9f
I20260709 12:13:52.738292 23663 raft_consensus.cc:3060] T 8771e0b5070c49c589f276c793f87727 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:52.741261 23497 tablet_bootstrap.cc:654] T d55aba14f62b41538fdb710117d67580 P 3a9a63ca97694ebdb84bca730762d735: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:52.750270 23594 consensus_queue.cc:1048] T 00335dfad3394f0c9689c0df8500bc9e P 9ba0da223cf24c97bc7d225e25015924 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:52.755903 23663 raft_consensus.cc:2749] T 8771e0b5070c49c589f276c793f87727 P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:52.759631 23495 tablet_bootstrap.cc:492] T d55aba14f62b41538fdb710117d67580 P 288a46a90f26471584043331107dc0dd: No bootstrap required, opened a new log
I20260709 12:13:52.760263 23495 ts_tablet_manager.cc:1403] T d55aba14f62b41538fdb710117d67580 P 288a46a90f26471584043331107dc0dd: Time spent bootstrapping tablet: real 0.123s	user 0.013s	sys 0.008s
I20260709 12:13:52.763919 23498 tablet_bootstrap.cc:492] T 525cb2c0e02b473bba2e7025f5765db2 P 2904b089bdb249b78950db76f4a70e9f: No bootstrap required, opened a new log
I20260709 12:13:52.764565 23498 ts_tablet_manager.cc:1403] T 525cb2c0e02b473bba2e7025f5765db2 P 2904b089bdb249b78950db76f4a70e9f: Time spent bootstrapping tablet: real 0.133s	user 0.011s	sys 0.006s
I20260709 12:13:52.768537 23638 consensus_queue.cc:1048] T 509f7e554df04f83aeffd51ec07607d5 P 288a46a90f26471584043331107dc0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:52.755780 23496 tablet_bootstrap.cc:654] T b1533753456b445991715da5158c921b P 9ba0da223cf24c97bc7d225e25015924: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:52.783349 23497 tablet_bootstrap.cc:492] T d55aba14f62b41538fdb710117d67580 P 3a9a63ca97694ebdb84bca730762d735: No bootstrap required, opened a new log
I20260709 12:13:52.783979 23497 ts_tablet_manager.cc:1403] T d55aba14f62b41538fdb710117d67580 P 3a9a63ca97694ebdb84bca730762d735: Time spent bootstrapping tablet: real 0.108s	user 0.028s	sys 0.044s
I20260709 12:13:52.786679 23496 tablet_bootstrap.cc:492] T b1533753456b445991715da5158c921b P 9ba0da223cf24c97bc7d225e25015924: No bootstrap required, opened a new log
I20260709 12:13:52.787294 23496 ts_tablet_manager.cc:1403] T b1533753456b445991715da5158c921b P 9ba0da223cf24c97bc7d225e25015924: Time spent bootstrapping tablet: real 0.116s	user 0.010s	sys 0.001s
I20260709 12:13:52.787168 23497 raft_consensus.cc:359] T d55aba14f62b41538fdb710117d67580 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:52.788093 23497 raft_consensus.cc:385] T d55aba14f62b41538fdb710117d67580 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:52.788472 23497 raft_consensus.cc:740] T d55aba14f62b41538fdb710117d67580 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a9a63ca97694ebdb84bca730762d735, State: Initialized, Role: FOLLOWER
I20260709 12:13:52.789340 23497 consensus_queue.cc:260] T d55aba14f62b41538fdb710117d67580 P 3a9a63ca97694ebdb84bca730762d735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:52.791013 23496 raft_consensus.cc:359] T b1533753456b445991715da5158c921b P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:52.791778 23497 ts_tablet_manager.cc:1434] T d55aba14f62b41538fdb710117d67580 P 3a9a63ca97694ebdb84bca730762d735: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:13:52.791812 23496 raft_consensus.cc:385] T b1533753456b445991715da5158c921b P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:52.792356 23496 raft_consensus.cc:740] T b1533753456b445991715da5158c921b P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ba0da223cf24c97bc7d225e25015924, State: Initialized, Role: FOLLOWER
I20260709 12:13:52.793424 23497 tablet_bootstrap.cc:492] T 92d63c0c6ef9452797da238708c39275 P 3a9a63ca97694ebdb84bca730762d735: Bootstrap starting.
I20260709 12:13:52.793134 23496 consensus_queue.cc:260] T b1533753456b445991715da5158c921b P 9ba0da223cf24c97bc7d225e25015924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:52.796058 23496 ts_tablet_manager.cc:1434] T b1533753456b445991715da5158c921b P 9ba0da223cf24c97bc7d225e25015924: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:13:52.801683 23498 raft_consensus.cc:359] T 525cb2c0e02b473bba2e7025f5765db2 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:52.802601 23498 raft_consensus.cc:385] T 525cb2c0e02b473bba2e7025f5765db2 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:52.802915 23498 raft_consensus.cc:740] T 525cb2c0e02b473bba2e7025f5765db2 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2904b089bdb249b78950db76f4a70e9f, State: Initialized, Role: FOLLOWER
I20260709 12:13:52.803843 23498 consensus_queue.cc:260] T 525cb2c0e02b473bba2e7025f5765db2 P 2904b089bdb249b78950db76f4a70e9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:52.805696 23496 tablet_bootstrap.cc:492] T d55aba14f62b41538fdb710117d67580 P 9ba0da223cf24c97bc7d225e25015924: Bootstrap starting.
I20260709 12:13:52.806553 23498 ts_tablet_manager.cc:1434] T 525cb2c0e02b473bba2e7025f5765db2 P 2904b089bdb249b78950db76f4a70e9f: Time spent starting tablet: real 0.042s	user 0.012s	sys 0.000s
I20260709 12:13:52.807675 23498 tablet_bootstrap.cc:492] T 859d30d8c3fb4a499256ffad6dc2d1cd P 2904b089bdb249b78950db76f4a70e9f: Bootstrap starting.
I20260709 12:13:52.807720 23497 tablet_bootstrap.cc:654] T 92d63c0c6ef9452797da238708c39275 P 3a9a63ca97694ebdb84bca730762d735: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:52.813226 23496 tablet_bootstrap.cc:654] T d55aba14f62b41538fdb710117d67580 P 9ba0da223cf24c97bc7d225e25015924: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:52.820469 23594 consensus_queue.cc:1048] T 00335dfad3394f0c9689c0df8500bc9e P 9ba0da223cf24c97bc7d225e25015924 [LEADER]: Connected to new peer: Peer: permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:52.824071 23497 tablet_bootstrap.cc:492] T 92d63c0c6ef9452797da238708c39275 P 3a9a63ca97694ebdb84bca730762d735: No bootstrap required, opened a new log
I20260709 12:13:52.824738 23497 ts_tablet_manager.cc:1403] T 92d63c0c6ef9452797da238708c39275 P 3a9a63ca97694ebdb84bca730762d735: Time spent bootstrapping tablet: real 0.032s	user 0.016s	sys 0.003s
I20260709 12:13:52.825188 23495 raft_consensus.cc:359] T d55aba14f62b41538fdb710117d67580 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:52.826026 23495 raft_consensus.cc:385] T d55aba14f62b41538fdb710117d67580 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:52.826407 23495 raft_consensus.cc:740] T d55aba14f62b41538fdb710117d67580 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 288a46a90f26471584043331107dc0dd, State: Initialized, Role: FOLLOWER
I20260709 12:13:52.827185 23495 consensus_queue.cc:260] T d55aba14f62b41538fdb710117d67580 P 288a46a90f26471584043331107dc0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:52.828512 23497 raft_consensus.cc:359] T 92d63c0c6ef9452797da238708c39275 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:52.829399 23497 raft_consensus.cc:385] T 92d63c0c6ef9452797da238708c39275 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:52.829793 23497 raft_consensus.cc:740] T 92d63c0c6ef9452797da238708c39275 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a9a63ca97694ebdb84bca730762d735, State: Initialized, Role: FOLLOWER
I20260709 12:13:52.831043 23497 consensus_queue.cc:260] T 92d63c0c6ef9452797da238708c39275 P 3a9a63ca97694ebdb84bca730762d735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:52.833729 23497 ts_tablet_manager.cc:1434] T 92d63c0c6ef9452797da238708c39275 P 3a9a63ca97694ebdb84bca730762d735: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:13:52.830880 23663 raft_consensus.cc:493] T 0411013dc7c347ada4fd2c2a0cf134bd P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:52.834758 23663 raft_consensus.cc:515] T 0411013dc7c347ada4fd2c2a0cf134bd P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:52.837132 23663 leader_election.cc:290] T 0411013dc7c347ada4fd2c2a0cf134bd P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789), 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081)
I20260709 12:13:52.837143 23495 ts_tablet_manager.cc:1434] T d55aba14f62b41538fdb710117d67580 P 288a46a90f26471584043331107dc0dd: Time spent starting tablet: real 0.077s	user 0.008s	sys 0.002s
I20260709 12:13:52.839838 23495 tablet_bootstrap.cc:492] T a2f2a063cf2b4190826d81b2dcbf7709 P 288a46a90f26471584043331107dc0dd: Bootstrap starting.
I20260709 12:13:52.840471 23450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0411013dc7c347ada4fd2c2a0cf134bd" candidate_uuid: "3a9a63ca97694ebdb84bca730762d735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba0da223cf24c97bc7d225e25015924" is_pre_election: true
I20260709 12:13:52.841280 23450 raft_consensus.cc:2468] T 0411013dc7c347ada4fd2c2a0cf134bd P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a9a63ca97694ebdb84bca730762d735 in term 0.
I20260709 12:13:52.842842 23340 leader_election.cc:304] T 0411013dc7c347ada4fd2c2a0cf134bd P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a9a63ca97694ebdb84bca730762d735, 9ba0da223cf24c97bc7d225e25015924; no voters: 
I20260709 12:13:52.844377 23663 raft_consensus.cc:2804] T 0411013dc7c347ada4fd2c2a0cf134bd P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:52.844794 23663 raft_consensus.cc:493] T 0411013dc7c347ada4fd2c2a0cf134bd P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:52.845151 23663 raft_consensus.cc:3060] T 0411013dc7c347ada4fd2c2a0cf134bd P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:52.846990 23298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0411013dc7c347ada4fd2c2a0cf134bd" candidate_uuid: "3a9a63ca97694ebdb84bca730762d735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2904b089bdb249b78950db76f4a70e9f" is_pre_election: true
I20260709 12:13:52.847747 23298 raft_consensus.cc:2468] T 0411013dc7c347ada4fd2c2a0cf134bd P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a9a63ca97694ebdb84bca730762d735 in term 0.
I20260709 12:13:52.850426 23595 consensus_queue.cc:1048] T 00f9b2ddcf6e4a9bacf4a30c16a88765 P 9ba0da223cf24c97bc7d225e25015924 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:52.841459 23497 tablet_bootstrap.cc:492] T 525cb2c0e02b473bba2e7025f5765db2 P 3a9a63ca97694ebdb84bca730762d735: Bootstrap starting.
I20260709 12:13:52.859311 23495 tablet_bootstrap.cc:654] T a2f2a063cf2b4190826d81b2dcbf7709 P 288a46a90f26471584043331107dc0dd: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:52.860085 23498 tablet_bootstrap.cc:654] T 859d30d8c3fb4a499256ffad6dc2d1cd P 2904b089bdb249b78950db76f4a70e9f: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:52.864885 23594 raft_consensus.cc:493] T 525cb2c0e02b473bba2e7025f5765db2 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:52.865526 23594 raft_consensus.cc:515] T 525cb2c0e02b473bba2e7025f5765db2 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:52.866888 23663 raft_consensus.cc:515] T 0411013dc7c347ada4fd2c2a0cf134bd P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:52.868942 23302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525cb2c0e02b473bba2e7025f5765db2" candidate_uuid: "9ba0da223cf24c97bc7d225e25015924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2904b089bdb249b78950db76f4a70e9f" is_pre_election: true
I20260709 12:13:52.869711 23302 raft_consensus.cc:2468] T 525cb2c0e02b473bba2e7025f5765db2 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ba0da223cf24c97bc7d225e25015924 in term 0.
I20260709 12:13:52.871361 23450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0411013dc7c347ada4fd2c2a0cf134bd" candidate_uuid: "3a9a63ca97694ebdb84bca730762d735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba0da223cf24c97bc7d225e25015924"
I20260709 12:13:52.867698 23497 tablet_bootstrap.cc:654] T 525cb2c0e02b473bba2e7025f5765db2 P 3a9a63ca97694ebdb84bca730762d735: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:52.872051 23450 raft_consensus.cc:3060] T 0411013dc7c347ada4fd2c2a0cf134bd P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:52.872025 23302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0411013dc7c347ada4fd2c2a0cf134bd" candidate_uuid: "3a9a63ca97694ebdb84bca730762d735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2904b089bdb249b78950db76f4a70e9f"
I20260709 12:13:52.872726 23663 leader_election.cc:290] T 0411013dc7c347ada4fd2c2a0cf134bd P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 election: Requested vote from peers 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789), 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081)
I20260709 12:13:52.874505 23302 raft_consensus.cc:3060] T 0411013dc7c347ada4fd2c2a0cf134bd P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:52.875552 23415 leader_election.cc:304] T 525cb2c0e02b473bba2e7025f5765db2 P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2904b089bdb249b78950db76f4a70e9f, 9ba0da223cf24c97bc7d225e25015924; no voters: 
I20260709 12:13:52.876538 23651 raft_consensus.cc:2804] T 525cb2c0e02b473bba2e7025f5765db2 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:52.876940 23651 raft_consensus.cc:493] T 525cb2c0e02b473bba2e7025f5765db2 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:52.877266 23651 raft_consensus.cc:3060] T 525cb2c0e02b473bba2e7025f5765db2 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:52.887849 23594 leader_election.cc:290] T 525cb2c0e02b473bba2e7025f5765db2 P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789), 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061)
I20260709 12:13:52.893018 23450 raft_consensus.cc:2468] T 0411013dc7c347ada4fd2c2a0cf134bd P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a9a63ca97694ebdb84bca730762d735 in term 1.
I20260709 12:13:52.916077 23496 tablet_bootstrap.cc:492] T d55aba14f62b41538fdb710117d67580 P 9ba0da223cf24c97bc7d225e25015924: No bootstrap required, opened a new log
I20260709 12:13:52.916738 23496 ts_tablet_manager.cc:1403] T d55aba14f62b41538fdb710117d67580 P 9ba0da223cf24c97bc7d225e25015924: Time spent bootstrapping tablet: real 0.113s	user 0.014s	sys 0.002s
I20260709 12:13:52.917038 23638 consensus_queue.cc:1048] T 8771e0b5070c49c589f276c793f87727 P 288a46a90f26471584043331107dc0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:52.918994 23340 leader_election.cc:304] T 0411013dc7c347ada4fd2c2a0cf134bd P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a9a63ca97694ebdb84bca730762d735, 9ba0da223cf24c97bc7d225e25015924; no voters: 
I20260709 12:13:52.920131 23533 raft_consensus.cc:2804] T 0411013dc7c347ada4fd2c2a0cf134bd P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:52.920689 23533 raft_consensus.cc:697] T 0411013dc7c347ada4fd2c2a0cf134bd P 3a9a63ca97694ebdb84bca730762d735 [term 1 LEADER]: Becoming Leader. State: Replica: 3a9a63ca97694ebdb84bca730762d735, State: Running, Role: LEADER
I20260709 12:13:52.921644 23533 consensus_queue.cc:237] T 0411013dc7c347ada4fd2c2a0cf134bd P 3a9a63ca97694ebdb84bca730762d735 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:52.909266 23375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525cb2c0e02b473bba2e7025f5765db2" candidate_uuid: "9ba0da223cf24c97bc7d225e25015924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a9a63ca97694ebdb84bca730762d735" is_pre_election: true
I20260709 12:13:52.932693 23302 raft_consensus.cc:2468] T 0411013dc7c347ada4fd2c2a0cf134bd P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a9a63ca97694ebdb84bca730762d735 in term 1.
I20260709 12:13:52.934118 23668 consensus_queue.cc:1048] T 0646c3e87a184cd19184ff12695392a7 P 3a9a63ca97694ebdb84bca730762d735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:52.936329 23496 raft_consensus.cc:359] T d55aba14f62b41538fdb710117d67580 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:52.938282 23496 raft_consensus.cc:385] T d55aba14f62b41538fdb710117d67580 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:52.938620 23496 raft_consensus.cc:740] T d55aba14f62b41538fdb710117d67580 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ba0da223cf24c97bc7d225e25015924, State: Initialized, Role: FOLLOWER
I20260709 12:13:52.948865 23651 raft_consensus.cc:515] T 525cb2c0e02b473bba2e7025f5765db2 P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:52.947402 23595 consensus_queue.cc:1048] T 00f9b2ddcf6e4a9bacf4a30c16a88765 P 9ba0da223cf24c97bc7d225e25015924 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
W20260709 12:13:52.951069 23415 leader_election.cc:343] T 525cb2c0e02b473bba2e7025f5765db2 P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:52.963173 23497 tablet_bootstrap.cc:492] T 525cb2c0e02b473bba2e7025f5765db2 P 3a9a63ca97694ebdb84bca730762d735: No bootstrap required, opened a new log
I20260709 12:13:52.963863 23497 ts_tablet_manager.cc:1403] T 525cb2c0e02b473bba2e7025f5765db2 P 3a9a63ca97694ebdb84bca730762d735: Time spent bootstrapping tablet: real 0.123s	user 0.022s	sys 0.013s
I20260709 12:13:52.964152 23298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525cb2c0e02b473bba2e7025f5765db2" candidate_uuid: "9ba0da223cf24c97bc7d225e25015924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2904b089bdb249b78950db76f4a70e9f"
I20260709 12:13:52.964972 23298 raft_consensus.cc:3060] T 525cb2c0e02b473bba2e7025f5765db2 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:52.966980 23497 raft_consensus.cc:359] T 525cb2c0e02b473bba2e7025f5765db2 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:52.967806 23497 raft_consensus.cc:385] T 525cb2c0e02b473bba2e7025f5765db2 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:52.969333 23663 consensus_queue.cc:1048] T 0646c3e87a184cd19184ff12695392a7 P 3a9a63ca97694ebdb84bca730762d735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:52.968101 23497 raft_consensus.cc:740] T 525cb2c0e02b473bba2e7025f5765db2 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a9a63ca97694ebdb84bca730762d735, State: Initialized, Role: FOLLOWER
I20260709 12:13:52.970063 23664 raft_consensus.cc:493] T d55aba14f62b41538fdb710117d67580 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:52.971911 23664 raft_consensus.cc:515] T d55aba14f62b41538fdb710117d67580 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:52.972795 23651 leader_election.cc:290] T 525cb2c0e02b473bba2e7025f5765db2 P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 1 election: Requested vote from peers 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789), 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061)
I20260709 12:13:52.973697 23376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525cb2c0e02b473bba2e7025f5765db2" candidate_uuid: "9ba0da223cf24c97bc7d225e25015924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a9a63ca97694ebdb84bca730762d735"
I20260709 12:13:52.976423 23498 tablet_bootstrap.cc:492] T 859d30d8c3fb4a499256ffad6dc2d1cd P 2904b089bdb249b78950db76f4a70e9f: No bootstrap required, opened a new log
I20260709 12:13:52.977090 23498 ts_tablet_manager.cc:1403] T 859d30d8c3fb4a499256ffad6dc2d1cd P 2904b089bdb249b78950db76f4a70e9f: Time spent bootstrapping tablet: real 0.170s	user 0.012s	sys 0.014s
I20260709 12:13:52.971458 23497 consensus_queue.cc:260] T 525cb2c0e02b473bba2e7025f5765db2 P 3a9a63ca97694ebdb84bca730762d735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:52.980461 23450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55aba14f62b41538fdb710117d67580" candidate_uuid: "3a9a63ca97694ebdb84bca730762d735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba0da223cf24c97bc7d225e25015924" is_pre_election: true
I20260709 12:13:52.980733 23227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55aba14f62b41538fdb710117d67580" candidate_uuid: "3a9a63ca97694ebdb84bca730762d735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "288a46a90f26471584043331107dc0dd" is_pre_election: true
I20260709 12:13:52.981297 23376 raft_consensus.cc:3060] T 525cb2c0e02b473bba2e7025f5765db2 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:52.980998 23496 consensus_queue.cc:260] T d55aba14f62b41538fdb710117d67580 P 9ba0da223cf24c97bc7d225e25015924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:52.976380 23664 leader_election.cc:290] T d55aba14f62b41538fdb710117d67580 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081), 288a46a90f26471584043331107dc0dd (127.12.174.129:46159)
I20260709 12:13:52.994062 23495 tablet_bootstrap.cc:492] T a2f2a063cf2b4190826d81b2dcbf7709 P 288a46a90f26471584043331107dc0dd: No bootstrap required, opened a new log
I20260709 12:13:52.984638 23450 raft_consensus.cc:2468] T d55aba14f62b41538fdb710117d67580 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a9a63ca97694ebdb84bca730762d735 in term 0.
I20260709 12:13:52.985935 23227 raft_consensus.cc:2468] T d55aba14f62b41538fdb710117d67580 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a9a63ca97694ebdb84bca730762d735 in term 0.
I20260709 12:13:52.989300 23496 ts_tablet_manager.cc:1434] T d55aba14f62b41538fdb710117d67580 P 9ba0da223cf24c97bc7d225e25015924: Time spent starting tablet: real 0.072s	user 0.013s	sys 0.000s
I20260709 12:13:52.994992 23495 ts_tablet_manager.cc:1403] T a2f2a063cf2b4190826d81b2dcbf7709 P 288a46a90f26471584043331107dc0dd: Time spent bootstrapping tablet: real 0.155s	user 0.024s	sys 0.033s
I20260709 12:13:52.997184 23497 ts_tablet_manager.cc:1434] T 525cb2c0e02b473bba2e7025f5765db2 P 3a9a63ca97694ebdb84bca730762d735: Time spent starting tablet: real 0.033s	user 0.009s	sys 0.000s
I20260709 12:13:52.998667 23595 raft_consensus.cc:493] T b1533753456b445991715da5158c921b P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:52.999253 23595 raft_consensus.cc:515] T b1533753456b445991715da5158c921b P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:53.003189 23224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1533753456b445991715da5158c921b" candidate_uuid: "9ba0da223cf24c97bc7d225e25015924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "288a46a90f26471584043331107dc0dd" is_pre_election: true
I20260709 12:13:53.006352 23498 raft_consensus.cc:359] T 859d30d8c3fb4a499256ffad6dc2d1cd P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:53.007169 23498 raft_consensus.cc:385] T 859d30d8c3fb4a499256ffad6dc2d1cd P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:53.007452 23498 raft_consensus.cc:740] T 859d30d8c3fb4a499256ffad6dc2d1cd P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2904b089bdb249b78950db76f4a70e9f, State: Initialized, Role: FOLLOWER
I20260709 12:13:53.008195 23299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1533753456b445991715da5158c921b" candidate_uuid: "9ba0da223cf24c97bc7d225e25015924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2904b089bdb249b78950db76f4a70e9f" is_pre_election: true
I20260709 12:13:52.999202 23496 tablet_bootstrap.cc:492] T d34300c6c4f2447182942fb5ab8cc3c4 P 9ba0da223cf24c97bc7d225e25015924: Bootstrap starting.
I20260709 12:13:53.008205 23498 consensus_queue.cc:260] T 859d30d8c3fb4a499256ffad6dc2d1cd P 2904b089bdb249b78950db76f4a70e9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:53.014705 23497 tablet_bootstrap.cc:492] T c3ac99f9dbb24693b97d3994ceb65955 P 3a9a63ca97694ebdb84bca730762d735: Bootstrap starting.
I20260709 12:13:53.017609 23340 leader_election.cc:304] T d55aba14f62b41538fdb710117d67580 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a9a63ca97694ebdb84bca730762d735, 9ba0da223cf24c97bc7d225e25015924; no voters: 
I20260709 12:13:53.018750 23664 raft_consensus.cc:2804] T d55aba14f62b41538fdb710117d67580 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:13:53.019124 23415 leader_election.cc:343] T b1533753456b445991715da5158c921b P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:53.021232 23498 ts_tablet_manager.cc:1434] T 859d30d8c3fb4a499256ffad6dc2d1cd P 2904b089bdb249b78950db76f4a70e9f: Time spent starting tablet: real 0.044s	user 0.006s	sys 0.001s
I20260709 12:13:53.023173 23497 tablet_bootstrap.cc:654] T c3ac99f9dbb24693b97d3994ceb65955 P 3a9a63ca97694ebdb84bca730762d735: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:53.023864 23498 tablet_bootstrap.cc:492] T b1533753456b445991715da5158c921b P 2904b089bdb249b78950db76f4a70e9f: Bootstrap starting.
I20260709 12:13:53.023058 23124 catalog_manager.cc:5697] T 0411013dc7c347ada4fd2c2a0cf134bd P 3a9a63ca97694ebdb84bca730762d735 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131). New cstate: current_term: 1 leader_uuid: "3a9a63ca97694ebdb84bca730762d735" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } health_report { overall_health: UNKNOWN } } }
W20260709 12:13:53.027083 23416 leader_election.cc:343] T b1533753456b445991715da5158c921b P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:53.011123 23595 leader_election.cc:290] T b1533753456b445991715da5158c921b P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 288a46a90f26471584043331107dc0dd (127.12.174.129:46159), 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789)
I20260709 12:13:53.033938 23416 leader_election.cc:304] T b1533753456b445991715da5158c921b P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ba0da223cf24c97bc7d225e25015924; no voters: 288a46a90f26471584043331107dc0dd, 2904b089bdb249b78950db76f4a70e9f
I20260709 12:13:53.019164 23664 raft_consensus.cc:493] T d55aba14f62b41538fdb710117d67580 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:53.039613 23664 raft_consensus.cc:3060] T d55aba14f62b41538fdb710117d67580 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:53.040614 23583 raft_consensus.cc:493] T c3ac99f9dbb24693b97d3994ceb65955 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:53.044215 23651 raft_consensus.cc:2749] T b1533753456b445991715da5158c921b P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:53.027468 23376 raft_consensus.cc:2468] T 525cb2c0e02b473bba2e7025f5765db2 P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ba0da223cf24c97bc7d225e25015924 in term 1.
I20260709 12:13:53.054315 23415 leader_election.cc:304] T 525cb2c0e02b473bba2e7025f5765db2 P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a9a63ca97694ebdb84bca730762d735, 9ba0da223cf24c97bc7d225e25015924; no voters: 
I20260709 12:13:53.055335 23595 raft_consensus.cc:2804] T 525cb2c0e02b473bba2e7025f5765db2 P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:53.055886 23595 raft_consensus.cc:697] T 525cb2c0e02b473bba2e7025f5765db2 P 9ba0da223cf24c97bc7d225e25015924 [term 1 LEADER]: Becoming Leader. State: Replica: 9ba0da223cf24c97bc7d225e25015924, State: Running, Role: LEADER
I20260709 12:13:53.056782 23595 consensus_queue.cc:237] T 525cb2c0e02b473bba2e7025f5765db2 P 9ba0da223cf24c97bc7d225e25015924 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:53.041229 23583 raft_consensus.cc:515] T c3ac99f9dbb24693b97d3994ceb65955 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:53.061679 23542 consensus_queue.cc:1048] T 8771e0b5070c49c589f276c793f87727 P 288a46a90f26471584043331107dc0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:53.067158 23226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ac99f9dbb24693b97d3994ceb65955" candidate_uuid: "2904b089bdb249b78950db76f4a70e9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "288a46a90f26471584043331107dc0dd" is_pre_election: true
I20260709 12:13:53.068327 23583 leader_election.cc:290] T c3ac99f9dbb24693b97d3994ceb65955 P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 288a46a90f26471584043331107dc0dd (127.12.174.129:46159), 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061)
W20260709 12:13:53.069217 23268 leader_election.cc:343] T c3ac99f9dbb24693b97d3994ceb65955 P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:53.071039 23374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ac99f9dbb24693b97d3994ceb65955" candidate_uuid: "2904b089bdb249b78950db76f4a70e9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a9a63ca97694ebdb84bca730762d735" is_pre_election: true
W20260709 12:13:53.075730 23267 leader_election.cc:343] T c3ac99f9dbb24693b97d3994ceb65955 P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:53.076265 23267 leader_election.cc:304] T c3ac99f9dbb24693b97d3994ceb65955 P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2904b089bdb249b78950db76f4a70e9f; no voters: 288a46a90f26471584043331107dc0dd, 3a9a63ca97694ebdb84bca730762d735
I20260709 12:13:53.076923 23498 tablet_bootstrap.cc:654] T b1533753456b445991715da5158c921b P 2904b089bdb249b78950db76f4a70e9f: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:53.064528 23298 raft_consensus.cc:2468] T 525cb2c0e02b473bba2e7025f5765db2 P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ba0da223cf24c97bc7d225e25015924 in term 1.
I20260709 12:13:53.081328 23603 raft_consensus.cc:2749] T c3ac99f9dbb24693b97d3994ceb65955 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:53.086292 23496 tablet_bootstrap.cc:654] T d34300c6c4f2447182942fb5ab8cc3c4 P 9ba0da223cf24c97bc7d225e25015924: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:53.089569 23495 raft_consensus.cc:359] T a2f2a063cf2b4190826d81b2dcbf7709 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:53.091566 23495 raft_consensus.cc:385] T a2f2a063cf2b4190826d81b2dcbf7709 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:53.091935 23495 raft_consensus.cc:740] T a2f2a063cf2b4190826d81b2dcbf7709 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 288a46a90f26471584043331107dc0dd, State: Initialized, Role: FOLLOWER
I20260709 12:13:53.092856 23495 consensus_queue.cc:260] T a2f2a063cf2b4190826d81b2dcbf7709 P 288a46a90f26471584043331107dc0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:53.049467 23664 raft_consensus.cc:515] T d55aba14f62b41538fdb710117d67580 P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:53.102604 23495 ts_tablet_manager.cc:1434] T a2f2a063cf2b4190826d81b2dcbf7709 P 288a46a90f26471584043331107dc0dd: Time spent starting tablet: real 0.106s	user 0.008s	sys 0.000s
I20260709 12:13:53.109855 23497 tablet_bootstrap.cc:492] T c3ac99f9dbb24693b97d3994ceb65955 P 3a9a63ca97694ebdb84bca730762d735: No bootstrap required, opened a new log
I20260709 12:13:53.110558 23497 ts_tablet_manager.cc:1403] T c3ac99f9dbb24693b97d3994ceb65955 P 3a9a63ca97694ebdb84bca730762d735: Time spent bootstrapping tablet: real 0.097s	user 0.015s	sys 0.000s
I20260709 12:13:53.101048 23542 raft_consensus.cc:493] T 859d30d8c3fb4a499256ffad6dc2d1cd P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:53.111209 23542 raft_consensus.cc:515] T 859d30d8c3fb4a499256ffad6dc2d1cd P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:53.114689 23497 raft_consensus.cc:359] T c3ac99f9dbb24693b97d3994ceb65955 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:53.115559 23497 raft_consensus.cc:385] T c3ac99f9dbb24693b97d3994ceb65955 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:53.115886 23497 raft_consensus.cc:740] T c3ac99f9dbb24693b97d3994ceb65955 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a9a63ca97694ebdb84bca730762d735, State: Initialized, Role: FOLLOWER
I20260709 12:13:53.116881 23450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859d30d8c3fb4a499256ffad6dc2d1cd" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba0da223cf24c97bc7d225e25015924" is_pre_election: true
I20260709 12:13:53.117579 23450 raft_consensus.cc:2468] T 859d30d8c3fb4a499256ffad6dc2d1cd P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 288a46a90f26471584043331107dc0dd in term 0.
I20260709 12:13:53.115796 23542 leader_election.cc:290] T 859d30d8c3fb4a499256ffad6dc2d1cd P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081), 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789)
I20260709 12:13:53.118736 23298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859d30d8c3fb4a499256ffad6dc2d1cd" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2904b089bdb249b78950db76f4a70e9f" is_pre_election: true
I20260709 12:13:53.120011 23298 raft_consensus.cc:2468] T 859d30d8c3fb4a499256ffad6dc2d1cd P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 288a46a90f26471584043331107dc0dd in term 0.
I20260709 12:13:53.122143 23192 leader_election.cc:304] T 859d30d8c3fb4a499256ffad6dc2d1cd P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 288a46a90f26471584043331107dc0dd, 2904b089bdb249b78950db76f4a70e9f; no voters: 
I20260709 12:13:53.123317 23121 catalog_manager.cc:5697] T 525cb2c0e02b473bba2e7025f5765db2 P 9ba0da223cf24c97bc7d225e25015924 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132). New cstate: current_term: 1 leader_uuid: "9ba0da223cf24c97bc7d225e25015924" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:53.126277 23497 consensus_queue.cc:260] T c3ac99f9dbb24693b97d3994ceb65955 P 3a9a63ca97694ebdb84bca730762d735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:53.127139 23226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55aba14f62b41538fdb710117d67580" candidate_uuid: "3a9a63ca97694ebdb84bca730762d735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "288a46a90f26471584043331107dc0dd"
I20260709 12:13:53.127801 23226 raft_consensus.cc:3060] T d55aba14f62b41538fdb710117d67580 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:53.129067 23497 ts_tablet_manager.cc:1434] T c3ac99f9dbb24693b97d3994ceb65955 P 3a9a63ca97694ebdb84bca730762d735: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 12:13:53.130226 23450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d55aba14f62b41538fdb710117d67580" candidate_uuid: "3a9a63ca97694ebdb84bca730762d735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba0da223cf24c97bc7d225e25015924"
I20260709 12:13:53.130901 23450 raft_consensus.cc:3060] T d55aba14f62b41538fdb710117d67580 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:53.130848 23497 tablet_bootstrap.cc:492] T d2afee7aeea24f85b4bfecc49efcf841 P 3a9a63ca97694ebdb84bca730762d735: Bootstrap starting.
I20260709 12:13:53.138347 23497 tablet_bootstrap.cc:654] T d2afee7aeea24f85b4bfecc49efcf841 P 3a9a63ca97694ebdb84bca730762d735: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:53.138731 23495 tablet_bootstrap.cc:492] T d34300c6c4f2447182942fb5ab8cc3c4 P 288a46a90f26471584043331107dc0dd: Bootstrap starting.
I20260709 12:13:53.138478 23664 leader_election.cc:290] T d55aba14f62b41538fdb710117d67580 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 election: Requested vote from peers 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081), 288a46a90f26471584043331107dc0dd (127.12.174.129:46159)
I20260709 12:13:53.142959 23226 raft_consensus.cc:2468] T d55aba14f62b41538fdb710117d67580 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a9a63ca97694ebdb84bca730762d735 in term 1.
I20260709 12:13:53.144838 23342 leader_election.cc:304] T d55aba14f62b41538fdb710117d67580 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 288a46a90f26471584043331107dc0dd, 3a9a63ca97694ebdb84bca730762d735; no voters: 
I20260709 12:13:53.146024 23664 raft_consensus.cc:2804] T d55aba14f62b41538fdb710117d67580 P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:53.146917 23664 raft_consensus.cc:697] T d55aba14f62b41538fdb710117d67580 P 3a9a63ca97694ebdb84bca730762d735 [term 1 LEADER]: Becoming Leader. State: Replica: 3a9a63ca97694ebdb84bca730762d735, State: Running, Role: LEADER
I20260709 12:13:53.138411 23542 raft_consensus.cc:2804] T 859d30d8c3fb4a499256ffad6dc2d1cd P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:53.151994 23496 tablet_bootstrap.cc:492] T d34300c6c4f2447182942fb5ab8cc3c4 P 9ba0da223cf24c97bc7d225e25015924: No bootstrap required, opened a new log
I20260709 12:13:53.147693 23542 raft_consensus.cc:493] T 859d30d8c3fb4a499256ffad6dc2d1cd P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:53.152725 23542 raft_consensus.cc:3060] T 859d30d8c3fb4a499256ffad6dc2d1cd P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:53.154973 23496 ts_tablet_manager.cc:1403] T d34300c6c4f2447182942fb5ab8cc3c4 P 9ba0da223cf24c97bc7d225e25015924: Time spent bootstrapping tablet: real 0.156s	user 0.014s	sys 0.006s
I20260709 12:13:53.155200 23450 raft_consensus.cc:2468] T d55aba14f62b41538fdb710117d67580 P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a9a63ca97694ebdb84bca730762d735 in term 1.
I20260709 12:13:53.159279 23496 raft_consensus.cc:359] T d34300c6c4f2447182942fb5ab8cc3c4 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:53.160207 23496 raft_consensus.cc:385] T d34300c6c4f2447182942fb5ab8cc3c4 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:53.160566 23496 raft_consensus.cc:740] T d34300c6c4f2447182942fb5ab8cc3c4 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ba0da223cf24c97bc7d225e25015924, State: Initialized, Role: FOLLOWER
I20260709 12:13:53.161485 23496 consensus_queue.cc:260] T d34300c6c4f2447182942fb5ab8cc3c4 P 9ba0da223cf24c97bc7d225e25015924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:53.162823 23542 raft_consensus.cc:515] T 859d30d8c3fb4a499256ffad6dc2d1cd P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:53.163870 23496 ts_tablet_manager.cc:1434] T d34300c6c4f2447182942fb5ab8cc3c4 P 9ba0da223cf24c97bc7d225e25015924: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:13:53.166885 23450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859d30d8c3fb4a499256ffad6dc2d1cd" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba0da223cf24c97bc7d225e25015924"
I20260709 12:13:53.167585 23450 raft_consensus.cc:3060] T 859d30d8c3fb4a499256ffad6dc2d1cd P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:53.167819 23497 tablet_bootstrap.cc:492] T d2afee7aeea24f85b4bfecc49efcf841 P 3a9a63ca97694ebdb84bca730762d735: No bootstrap required, opened a new log
I20260709 12:13:53.167241 23496 tablet_bootstrap.cc:492] T d2afee7aeea24f85b4bfecc49efcf841 P 9ba0da223cf24c97bc7d225e25015924: Bootstrap starting.
I20260709 12:13:53.169112 23498 tablet_bootstrap.cc:492] T b1533753456b445991715da5158c921b P 2904b089bdb249b78950db76f4a70e9f: No bootstrap required, opened a new log
I20260709 12:13:53.152630 23664 consensus_queue.cc:237] T d55aba14f62b41538fdb710117d67580 P 3a9a63ca97694ebdb84bca730762d735 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:53.167259 23298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859d30d8c3fb4a499256ffad6dc2d1cd" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2904b089bdb249b78950db76f4a70e9f"
I20260709 12:13:53.172396 23298 raft_consensus.cc:3060] T 859d30d8c3fb4a499256ffad6dc2d1cd P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:53.174587 23495 tablet_bootstrap.cc:654] T d34300c6c4f2447182942fb5ab8cc3c4 P 288a46a90f26471584043331107dc0dd: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:53.177320 23496 tablet_bootstrap.cc:654] T d2afee7aeea24f85b4bfecc49efcf841 P 9ba0da223cf24c97bc7d225e25015924: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:53.177606 23498 ts_tablet_manager.cc:1403] T b1533753456b445991715da5158c921b P 2904b089bdb249b78950db76f4a70e9f: Time spent bootstrapping tablet: real 0.146s	user 0.008s	sys 0.008s
I20260709 12:13:53.180823 23498 raft_consensus.cc:359] T b1533753456b445991715da5158c921b P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:53.181605 23498 raft_consensus.cc:385] T b1533753456b445991715da5158c921b P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:53.181931 23498 raft_consensus.cc:740] T b1533753456b445991715da5158c921b P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2904b089bdb249b78950db76f4a70e9f, State: Initialized, Role: FOLLOWER
I20260709 12:13:53.182327 23542 leader_election.cc:290] T 859d30d8c3fb4a499256ffad6dc2d1cd P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 1 election: Requested vote from peers 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081), 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789)
I20260709 12:13:53.168476 23497 ts_tablet_manager.cc:1403] T d2afee7aeea24f85b4bfecc49efcf841 P 3a9a63ca97694ebdb84bca730762d735: Time spent bootstrapping tablet: real 0.038s	user 0.015s	sys 0.016s
I20260709 12:13:53.182077 23298 raft_consensus.cc:2468] T 859d30d8c3fb4a499256ffad6dc2d1cd P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 288a46a90f26471584043331107dc0dd in term 1.
I20260709 12:13:53.190666 23498 consensus_queue.cc:260] T b1533753456b445991715da5158c921b P 2904b089bdb249b78950db76f4a70e9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:53.193222 23192 leader_election.cc:304] T 859d30d8c3fb4a499256ffad6dc2d1cd P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 288a46a90f26471584043331107dc0dd, 2904b089bdb249b78950db76f4a70e9f; no voters: 
I20260709 12:13:53.194645 23542 raft_consensus.cc:2804] T 859d30d8c3fb4a499256ffad6dc2d1cd P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:53.195492 23542 raft_consensus.cc:697] T 859d30d8c3fb4a499256ffad6dc2d1cd P 288a46a90f26471584043331107dc0dd [term 1 LEADER]: Becoming Leader. State: Replica: 288a46a90f26471584043331107dc0dd, State: Running, Role: LEADER
I20260709 12:13:53.196620 23542 consensus_queue.cc:237] T 859d30d8c3fb4a499256ffad6dc2d1cd P 288a46a90f26471584043331107dc0dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:53.189224 23497 raft_consensus.cc:359] T d2afee7aeea24f85b4bfecc49efcf841 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:53.198666 23497 raft_consensus.cc:385] T d2afee7aeea24f85b4bfecc49efcf841 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:53.199030 23497 raft_consensus.cc:740] T d2afee7aeea24f85b4bfecc49efcf841 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a9a63ca97694ebdb84bca730762d735, State: Initialized, Role: FOLLOWER
I20260709 12:13:53.199259 23450 raft_consensus.cc:2468] T 859d30d8c3fb4a499256ffad6dc2d1cd P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 288a46a90f26471584043331107dc0dd in term 1.
I20260709 12:13:53.199803 23497 consensus_queue.cc:260] T d2afee7aeea24f85b4bfecc49efcf841 P 3a9a63ca97694ebdb84bca730762d735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:53.201969 23498 ts_tablet_manager.cc:1434] T b1533753456b445991715da5158c921b P 2904b089bdb249b78950db76f4a70e9f: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.000s
I20260709 12:13:53.203146 23498 tablet_bootstrap.cc:492] T d34300c6c4f2447182942fb5ab8cc3c4 P 2904b089bdb249b78950db76f4a70e9f: Bootstrap starting.
I20260709 12:13:53.205051 23497 ts_tablet_manager.cc:1434] T d2afee7aeea24f85b4bfecc49efcf841 P 3a9a63ca97694ebdb84bca730762d735: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.003s
I20260709 12:13:53.206238 23497 tablet_bootstrap.cc:492] T a2f2a063cf2b4190826d81b2dcbf7709 P 3a9a63ca97694ebdb84bca730762d735: Bootstrap starting.
I20260709 12:13:53.214653 23497 tablet_bootstrap.cc:654] T a2f2a063cf2b4190826d81b2dcbf7709 P 3a9a63ca97694ebdb84bca730762d735: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:53.220456 23498 tablet_bootstrap.cc:654] T d34300c6c4f2447182942fb5ab8cc3c4 P 2904b089bdb249b78950db76f4a70e9f: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:53.224208 23495 tablet_bootstrap.cc:492] T d34300c6c4f2447182942fb5ab8cc3c4 P 288a46a90f26471584043331107dc0dd: No bootstrap required, opened a new log
I20260709 12:13:53.224910 23495 ts_tablet_manager.cc:1403] T d34300c6c4f2447182942fb5ab8cc3c4 P 288a46a90f26471584043331107dc0dd: Time spent bootstrapping tablet: real 0.121s	user 0.004s	sys 0.015s
I20260709 12:13:53.228885 23495 raft_consensus.cc:359] T d34300c6c4f2447182942fb5ab8cc3c4 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:53.230275 23495 raft_consensus.cc:385] T d34300c6c4f2447182942fb5ab8cc3c4 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:53.229286 23125 catalog_manager.cc:5697] T 859d30d8c3fb4a499256ffad6dc2d1cd P 288a46a90f26471584043331107dc0dd reported cstate change: term changed from 0 to 1, leader changed from <none> to 288a46a90f26471584043331107dc0dd (127.12.174.129). New cstate: current_term: 1 leader_uuid: "288a46a90f26471584043331107dc0dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:53.230582 23495 raft_consensus.cc:740] T d34300c6c4f2447182942fb5ab8cc3c4 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 288a46a90f26471584043331107dc0dd, State: Initialized, Role: FOLLOWER
I20260709 12:13:53.231451 23495 consensus_queue.cc:260] T d34300c6c4f2447182942fb5ab8cc3c4 P 288a46a90f26471584043331107dc0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:53.233795 23495 ts_tablet_manager.cc:1434] T d34300c6c4f2447182942fb5ab8cc3c4 P 288a46a90f26471584043331107dc0dd: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.002s
I20260709 12:13:53.234969 23495 tablet_bootstrap.cc:492] T b1533753456b445991715da5158c921b P 288a46a90f26471584043331107dc0dd: Bootstrap starting.
I20260709 12:13:53.237231 23498 tablet_bootstrap.cc:492] T d34300c6c4f2447182942fb5ab8cc3c4 P 2904b089bdb249b78950db76f4a70e9f: No bootstrap required, opened a new log
I20260709 12:13:53.237867 23498 ts_tablet_manager.cc:1403] T d34300c6c4f2447182942fb5ab8cc3c4 P 2904b089bdb249b78950db76f4a70e9f: Time spent bootstrapping tablet: real 0.035s	user 0.015s	sys 0.004s
I20260709 12:13:53.238318 23497 tablet_bootstrap.cc:492] T a2f2a063cf2b4190826d81b2dcbf7709 P 3a9a63ca97694ebdb84bca730762d735: No bootstrap required, opened a new log
I20260709 12:13:53.238904 23497 ts_tablet_manager.cc:1403] T a2f2a063cf2b4190826d81b2dcbf7709 P 3a9a63ca97694ebdb84bca730762d735: Time spent bootstrapping tablet: real 0.033s	user 0.015s	sys 0.002s
I20260709 12:13:53.239274 23496 tablet_bootstrap.cc:492] T d2afee7aeea24f85b4bfecc49efcf841 P 9ba0da223cf24c97bc7d225e25015924: No bootstrap required, opened a new log
I20260709 12:13:53.239809 23496 ts_tablet_manager.cc:1403] T d2afee7aeea24f85b4bfecc49efcf841 P 9ba0da223cf24c97bc7d225e25015924: Time spent bootstrapping tablet: real 0.073s	user 0.013s	sys 0.021s
I20260709 12:13:53.240994 23498 raft_consensus.cc:359] T d34300c6c4f2447182942fb5ab8cc3c4 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:53.241823 23498 raft_consensus.cc:385] T d34300c6c4f2447182942fb5ab8cc3c4 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:53.242116 23498 raft_consensus.cc:740] T d34300c6c4f2447182942fb5ab8cc3c4 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2904b089bdb249b78950db76f4a70e9f, State: Initialized, Role: FOLLOWER
I20260709 12:13:53.242273 23497 raft_consensus.cc:359] T a2f2a063cf2b4190826d81b2dcbf7709 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:53.243142 23497 raft_consensus.cc:385] T a2f2a063cf2b4190826d81b2dcbf7709 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:53.243077 23498 consensus_queue.cc:260] T d34300c6c4f2447182942fb5ab8cc3c4 P 2904b089bdb249b78950db76f4a70e9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:53.243629 23497 raft_consensus.cc:740] T a2f2a063cf2b4190826d81b2dcbf7709 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a9a63ca97694ebdb84bca730762d735, State: Initialized, Role: FOLLOWER
I20260709 12:13:53.244565 23497 consensus_queue.cc:260] T a2f2a063cf2b4190826d81b2dcbf7709 P 3a9a63ca97694ebdb84bca730762d735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:53.246721 23497 ts_tablet_manager.cc:1434] T a2f2a063cf2b4190826d81b2dcbf7709 P 3a9a63ca97694ebdb84bca730762d735: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 12:13:53.247704 23497 tablet_bootstrap.cc:492] T b3e2bbccfb7f4da8baf42735151ff804 P 3a9a63ca97694ebdb84bca730762d735: Bootstrap starting.
I20260709 12:13:53.250059 23495 tablet_bootstrap.cc:654] T b1533753456b445991715da5158c921b P 288a46a90f26471584043331107dc0dd: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:53.242822 23496 raft_consensus.cc:359] T d2afee7aeea24f85b4bfecc49efcf841 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:53.253501 23496 raft_consensus.cc:385] T d2afee7aeea24f85b4bfecc49efcf841 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:53.253826 23496 raft_consensus.cc:740] T d2afee7aeea24f85b4bfecc49efcf841 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ba0da223cf24c97bc7d225e25015924, State: Initialized, Role: FOLLOWER
I20260709 12:13:53.254528 23497 tablet_bootstrap.cc:654] T b3e2bbccfb7f4da8baf42735151ff804 P 3a9a63ca97694ebdb84bca730762d735: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:53.255362 23496 consensus_queue.cc:260] T d2afee7aeea24f85b4bfecc49efcf841 P 9ba0da223cf24c97bc7d225e25015924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:53.256243 23498 ts_tablet_manager.cc:1434] T d34300c6c4f2447182942fb5ab8cc3c4 P 2904b089bdb249b78950db76f4a70e9f: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 12:13:53.257341 23121 catalog_manager.cc:5697] T d55aba14f62b41538fdb710117d67580 P 3a9a63ca97694ebdb84bca730762d735 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131). New cstate: current_term: 1 leader_uuid: "3a9a63ca97694ebdb84bca730762d735" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:53.268929 23498 tablet_bootstrap.cc:492] T 92d63c0c6ef9452797da238708c39275 P 2904b089bdb249b78950db76f4a70e9f: Bootstrap starting.
I20260709 12:13:53.275321 23496 ts_tablet_manager.cc:1434] T d2afee7aeea24f85b4bfecc49efcf841 P 9ba0da223cf24c97bc7d225e25015924: Time spent starting tablet: real 0.035s	user 0.005s	sys 0.004s
I20260709 12:13:53.276038 23498 tablet_bootstrap.cc:654] T 92d63c0c6ef9452797da238708c39275 P 2904b089bdb249b78950db76f4a70e9f: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:53.280166 23496 tablet_bootstrap.cc:492] T 8e5b2401420b4a25a6457b667110f778 P 9ba0da223cf24c97bc7d225e25015924: Bootstrap starting.
I20260709 12:13:53.284714 23595 raft_consensus.cc:493] T d34300c6c4f2447182942fb5ab8cc3c4 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:53.285486 23595 raft_consensus.cc:515] T d34300c6c4f2447182942fb5ab8cc3c4 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:53.287621 23498 tablet_bootstrap.cc:492] T 92d63c0c6ef9452797da238708c39275 P 2904b089bdb249b78950db76f4a70e9f: No bootstrap required, opened a new log
I20260709 12:13:53.287554 23496 tablet_bootstrap.cc:654] T 8e5b2401420b4a25a6457b667110f778 P 9ba0da223cf24c97bc7d225e25015924: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:53.290230 23226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34300c6c4f2447182942fb5ab8cc3c4" candidate_uuid: "9ba0da223cf24c97bc7d225e25015924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "288a46a90f26471584043331107dc0dd" is_pre_election: true
I20260709 12:13:53.291033 23226 raft_consensus.cc:2468] T d34300c6c4f2447182942fb5ab8cc3c4 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ba0da223cf24c97bc7d225e25015924 in term 0.
I20260709 12:13:53.291298 23298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34300c6c4f2447182942fb5ab8cc3c4" candidate_uuid: "9ba0da223cf24c97bc7d225e25015924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2904b089bdb249b78950db76f4a70e9f" is_pre_election: true
I20260709 12:13:53.291663 23664 raft_consensus.cc:493] T 92d63c0c6ef9452797da238708c39275 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:53.292081 23298 raft_consensus.cc:2468] T d34300c6c4f2447182942fb5ab8cc3c4 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ba0da223cf24c97bc7d225e25015924 in term 0.
I20260709 12:13:53.292207 23664 raft_consensus.cc:515] T 92d63c0c6ef9452797da238708c39275 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:53.291105 23595 leader_election.cc:290] T d34300c6c4f2447182942fb5ab8cc3c4 P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 288a46a90f26471584043331107dc0dd (127.12.174.129:46159), 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789)
I20260709 12:13:53.293514 23415 leader_election.cc:304] T d34300c6c4f2447182942fb5ab8cc3c4 P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2904b089bdb249b78950db76f4a70e9f, 9ba0da223cf24c97bc7d225e25015924; no voters: 
I20260709 12:13:53.294452 23595 raft_consensus.cc:2804] T d34300c6c4f2447182942fb5ab8cc3c4 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:53.294574 23664 leader_election.cc:290] T 92d63c0c6ef9452797da238708c39275 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 288a46a90f26471584043331107dc0dd (127.12.174.129:46159), 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789)
I20260709 12:13:53.294866 23595 raft_consensus.cc:493] T d34300c6c4f2447182942fb5ab8cc3c4 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:53.295243 23595 raft_consensus.cc:3060] T d34300c6c4f2447182942fb5ab8cc3c4 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:53.297621 23227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92d63c0c6ef9452797da238708c39275" candidate_uuid: "3a9a63ca97694ebdb84bca730762d735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "288a46a90f26471584043331107dc0dd" is_pre_election: true
I20260709 12:13:53.299077 23298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92d63c0c6ef9452797da238708c39275" candidate_uuid: "3a9a63ca97694ebdb84bca730762d735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2904b089bdb249b78950db76f4a70e9f" is_pre_election: true
W20260709 12:13:53.300638 23341 leader_election.cc:343] T 92d63c0c6ef9452797da238708c39275 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:13:53.302107 23342 leader_election.cc:343] T 92d63c0c6ef9452797da238708c39275 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:53.304378 23342 leader_election.cc:304] T 92d63c0c6ef9452797da238708c39275 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3a9a63ca97694ebdb84bca730762d735; no voters: 288a46a90f26471584043331107dc0dd, 2904b089bdb249b78950db76f4a70e9f
I20260709 12:13:53.304550 23595 raft_consensus.cc:515] T d34300c6c4f2447182942fb5ab8cc3c4 P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:53.305295 23663 raft_consensus.cc:2749] T 92d63c0c6ef9452797da238708c39275 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:53.288319 23498 ts_tablet_manager.cc:1403] T 92d63c0c6ef9452797da238708c39275 P 2904b089bdb249b78950db76f4a70e9f: Time spent bootstrapping tablet: real 0.020s	user 0.008s	sys 0.008s
I20260709 12:13:53.309151 23226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34300c6c4f2447182942fb5ab8cc3c4" candidate_uuid: "9ba0da223cf24c97bc7d225e25015924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "288a46a90f26471584043331107dc0dd"
I20260709 12:13:53.309448 23298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d34300c6c4f2447182942fb5ab8cc3c4" candidate_uuid: "9ba0da223cf24c97bc7d225e25015924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2904b089bdb249b78950db76f4a70e9f"
I20260709 12:13:53.309866 23226 raft_consensus.cc:3060] T d34300c6c4f2447182942fb5ab8cc3c4 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:53.310154 23298 raft_consensus.cc:3060] T d34300c6c4f2447182942fb5ab8cc3c4 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:53.311115 23497 tablet_bootstrap.cc:492] T b3e2bbccfb7f4da8baf42735151ff804 P 3a9a63ca97694ebdb84bca730762d735: No bootstrap required, opened a new log
I20260709 12:13:53.311715 23497 ts_tablet_manager.cc:1403] T b3e2bbccfb7f4da8baf42735151ff804 P 3a9a63ca97694ebdb84bca730762d735: Time spent bootstrapping tablet: real 0.064s	user 0.023s	sys 0.028s
I20260709 12:13:53.312598 23495 tablet_bootstrap.cc:492] T b1533753456b445991715da5158c921b P 288a46a90f26471584043331107dc0dd: No bootstrap required, opened a new log
I20260709 12:13:53.313169 23495 ts_tablet_manager.cc:1403] T b1533753456b445991715da5158c921b P 288a46a90f26471584043331107dc0dd: Time spent bootstrapping tablet: real 0.078s	user 0.006s	sys 0.006s
I20260709 12:13:53.315038 23497 raft_consensus.cc:359] T b3e2bbccfb7f4da8baf42735151ff804 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:53.315888 23497 raft_consensus.cc:385] T b3e2bbccfb7f4da8baf42735151ff804 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:53.316124 23495 raft_consensus.cc:359] T b1533753456b445991715da5158c921b P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:53.316859 23495 raft_consensus.cc:385] T b1533753456b445991715da5158c921b P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:53.317137 23495 raft_consensus.cc:740] T b1533753456b445991715da5158c921b P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 288a46a90f26471584043331107dc0dd, State: Initialized, Role: FOLLOWER
I20260709 12:13:53.316166 23497 raft_consensus.cc:740] T b3e2bbccfb7f4da8baf42735151ff804 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a9a63ca97694ebdb84bca730762d735, State: Initialized, Role: FOLLOWER
I20260709 12:13:53.318712 23497 consensus_queue.cc:260] T b3e2bbccfb7f4da8baf42735151ff804 P 3a9a63ca97694ebdb84bca730762d735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:53.319123 23226 raft_consensus.cc:2468] T d34300c6c4f2447182942fb5ab8cc3c4 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ba0da223cf24c97bc7d225e25015924 in term 1.
I20260709 12:13:53.320963 23416 leader_election.cc:304] T d34300c6c4f2447182942fb5ab8cc3c4 P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 288a46a90f26471584043331107dc0dd, 9ba0da223cf24c97bc7d225e25015924; no voters: 
I20260709 12:13:53.321558 23298 raft_consensus.cc:2468] T d34300c6c4f2447182942fb5ab8cc3c4 P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ba0da223cf24c97bc7d225e25015924 in term 1.
I20260709 12:13:53.322050 23496 tablet_bootstrap.cc:492] T 8e5b2401420b4a25a6457b667110f778 P 9ba0da223cf24c97bc7d225e25015924: No bootstrap required, opened a new log
I20260709 12:13:53.309448 23498 raft_consensus.cc:359] T 92d63c0c6ef9452797da238708c39275 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:53.321935 23651 raft_consensus.cc:2804] T d34300c6c4f2447182942fb5ab8cc3c4 P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:53.323460 23595 leader_election.cc:290] T d34300c6c4f2447182942fb5ab8cc3c4 P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 1 election: Requested vote from peers 288a46a90f26471584043331107dc0dd (127.12.174.129:46159), 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789)
I20260709 12:13:53.323594 23651 raft_consensus.cc:697] T d34300c6c4f2447182942fb5ab8cc3c4 P 9ba0da223cf24c97bc7d225e25015924 [term 1 LEADER]: Becoming Leader. State: Replica: 9ba0da223cf24c97bc7d225e25015924, State: Running, Role: LEADER
I20260709 12:13:53.323213 23495 consensus_queue.cc:260] T b1533753456b445991715da5158c921b P 288a46a90f26471584043331107dc0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:53.323283 23498 raft_consensus.cc:385] T 92d63c0c6ef9452797da238708c39275 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:53.325042 23664 raft_consensus.cc:493] T b3e2bbccfb7f4da8baf42735151ff804 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:53.325564 23498 raft_consensus.cc:740] T 92d63c0c6ef9452797da238708c39275 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2904b089bdb249b78950db76f4a70e9f, State: Initialized, Role: FOLLOWER
I20260709 12:13:53.324551 23651 consensus_queue.cc:237] T d34300c6c4f2447182942fb5ab8cc3c4 P 9ba0da223cf24c97bc7d225e25015924 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:53.326622 23498 consensus_queue.cc:260] T 92d63c0c6ef9452797da238708c39275 P 2904b089bdb249b78950db76f4a70e9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:53.328972 23498 ts_tablet_manager.cc:1434] T 92d63c0c6ef9452797da238708c39275 P 2904b089bdb249b78950db76f4a70e9f: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.001s
I20260709 12:13:53.325918 23664 raft_consensus.cc:515] T b3e2bbccfb7f4da8baf42735151ff804 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:53.331653 23664 leader_election.cc:290] T b3e2bbccfb7f4da8baf42735151ff804 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 288a46a90f26471584043331107dc0dd (127.12.174.129:46159), 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789)
I20260709 12:13:53.334542 23542 raft_consensus.cc:493] T b1533753456b445991715da5158c921b P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:53.334853 23496 ts_tablet_manager.cc:1403] T 8e5b2401420b4a25a6457b667110f778 P 9ba0da223cf24c97bc7d225e25015924: Time spent bootstrapping tablet: real 0.055s	user 0.010s	sys 0.003s
I20260709 12:13:53.335144 23542 raft_consensus.cc:515] T b1533753456b445991715da5158c921b P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:53.337402 23542 leader_election.cc:290] T b1533753456b445991715da5158c921b P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081), 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789)
I20260709 12:13:53.338272 23450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1533753456b445991715da5158c921b" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba0da223cf24c97bc7d225e25015924" is_pre_election: true
I20260709 12:13:53.339028 23450 raft_consensus.cc:2468] T b1533753456b445991715da5158c921b P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 288a46a90f26471584043331107dc0dd in term 0.
I20260709 12:13:53.324584 23497 ts_tablet_manager.cc:1434] T b3e2bbccfb7f4da8baf42735151ff804 P 3a9a63ca97694ebdb84bca730762d735: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.004s
I20260709 12:13:53.339552 23498 tablet_bootstrap.cc:492] T 8e5b2401420b4a25a6457b667110f778 P 2904b089bdb249b78950db76f4a70e9f: Bootstrap starting.
I20260709 12:13:53.340333 23191 leader_election.cc:304] T b1533753456b445991715da5158c921b P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 288a46a90f26471584043331107dc0dd, 9ba0da223cf24c97bc7d225e25015924; no voters: 
I20260709 12:13:53.338136 23496 raft_consensus.cc:359] T 8e5b2401420b4a25a6457b667110f778 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:53.341457 23496 raft_consensus.cc:385] T 8e5b2401420b4a25a6457b667110f778 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:53.341789 23496 raft_consensus.cc:740] T 8e5b2401420b4a25a6457b667110f778 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ba0da223cf24c97bc7d225e25015924, State: Initialized, Role: FOLLOWER
I20260709 12:13:53.342576 23300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1533753456b445991715da5158c921b" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2904b089bdb249b78950db76f4a70e9f" is_pre_election: true
I20260709 12:13:53.342449 23496 consensus_queue.cc:260] T 8e5b2401420b4a25a6457b667110f778 P 9ba0da223cf24c97bc7d225e25015924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:53.343236 23300 raft_consensus.cc:2468] T b1533753456b445991715da5158c921b P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 288a46a90f26471584043331107dc0dd in term 0.
I20260709 12:13:53.344810 23496 ts_tablet_manager.cc:1434] T 8e5b2401420b4a25a6457b667110f778 P 9ba0da223cf24c97bc7d225e25015924: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:13:53.346053 23664 raft_consensus.cc:493] T a2f2a063cf2b4190826d81b2dcbf7709 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:53.339568 23495 ts_tablet_manager.cc:1434] T b1533753456b445991715da5158c921b P 288a46a90f26471584043331107dc0dd: Time spent starting tablet: real 0.026s	user 0.004s	sys 0.004s
I20260709 12:13:53.347679 23664 raft_consensus.cc:515] T a2f2a063cf2b4190826d81b2dcbf7709 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:53.348672 23495 tablet_bootstrap.cc:492] T c3ac99f9dbb24693b97d3994ceb65955 P 288a46a90f26471584043331107dc0dd: Bootstrap starting.
I20260709 12:13:53.349301 23542 raft_consensus.cc:2804] T b1533753456b445991715da5158c921b P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:53.349792 23542 raft_consensus.cc:493] T b1533753456b445991715da5158c921b P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:53.350152 23542 raft_consensus.cc:3060] T b1533753456b445991715da5158c921b P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:53.345927 23496 tablet_bootstrap.cc:492] T 05b49011442c4131a4ac3c55feed5409 P 9ba0da223cf24c97bc7d225e25015924: Bootstrap starting.
I20260709 12:13:53.347067 23497 tablet_bootstrap.cc:492] T 8e5b2401420b4a25a6457b667110f778 P 3a9a63ca97694ebdb84bca730762d735: Bootstrap starting.
I20260709 12:13:53.352813 23450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f2a063cf2b4190826d81b2dcbf7709" candidate_uuid: "3a9a63ca97694ebdb84bca730762d735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba0da223cf24c97bc7d225e25015924" is_pre_election: true
I20260709 12:13:53.353538 23450 raft_consensus.cc:2468] T a2f2a063cf2b4190826d81b2dcbf7709 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a9a63ca97694ebdb84bca730762d735 in term 0.
I20260709 12:13:53.352411 23664 leader_election.cc:290] T a2f2a063cf2b4190826d81b2dcbf7709 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081), 288a46a90f26471584043331107dc0dd (127.12.174.129:46159)
I20260709 12:13:53.346920 23498 tablet_bootstrap.cc:654] T 8e5b2401420b4a25a6457b667110f778 P 2904b089bdb249b78950db76f4a70e9f: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:53.352329 23227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f2a063cf2b4190826d81b2dcbf7709" candidate_uuid: "3a9a63ca97694ebdb84bca730762d735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "288a46a90f26471584043331107dc0dd" is_pre_election: true
I20260709 12:13:53.355581 23227 raft_consensus.cc:2468] T a2f2a063cf2b4190826d81b2dcbf7709 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a9a63ca97694ebdb84bca730762d735 in term 0.
I20260709 12:13:53.357264 23342 leader_election.cc:304] T a2f2a063cf2b4190826d81b2dcbf7709 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 288a46a90f26471584043331107dc0dd, 3a9a63ca97694ebdb84bca730762d735; no voters: 
I20260709 12:13:53.358111 23664 raft_consensus.cc:2804] T a2f2a063cf2b4190826d81b2dcbf7709 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:53.358501 23664 raft_consensus.cc:493] T a2f2a063cf2b4190826d81b2dcbf7709 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:53.358812 23664 raft_consensus.cc:3060] T a2f2a063cf2b4190826d81b2dcbf7709 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:53.360240 23497 tablet_bootstrap.cc:654] T 8e5b2401420b4a25a6457b667110f778 P 3a9a63ca97694ebdb84bca730762d735: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:53.362053 23663 raft_consensus.cc:493] T c3ac99f9dbb24693b97d3994ceb65955 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:53.362563 23663 raft_consensus.cc:515] T c3ac99f9dbb24693b97d3994ceb65955 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:53.364816 23663 leader_election.cc:290] T c3ac99f9dbb24693b97d3994ceb65955 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 288a46a90f26471584043331107dc0dd (127.12.174.129:46159), 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789)
I20260709 12:13:53.365712 23227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ac99f9dbb24693b97d3994ceb65955" candidate_uuid: "3a9a63ca97694ebdb84bca730762d735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "288a46a90f26471584043331107dc0dd" is_pre_election: true
I20260709 12:13:53.366474 23300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ac99f9dbb24693b97d3994ceb65955" candidate_uuid: "3a9a63ca97694ebdb84bca730762d735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2904b089bdb249b78950db76f4a70e9f" is_pre_election: true
I20260709 12:13:53.367184 23300 raft_consensus.cc:2468] T c3ac99f9dbb24693b97d3994ceb65955 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a9a63ca97694ebdb84bca730762d735 in term 0.
I20260709 12:13:53.366696 23495 tablet_bootstrap.cc:654] T c3ac99f9dbb24693b97d3994ceb65955 P 288a46a90f26471584043331107dc0dd: Neither blocks nor log segments found. Creating new log.
W20260709 12:13:53.367561 23342 leader_election.cc:343] T c3ac99f9dbb24693b97d3994ceb65955 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:53.345695 23125 catalog_manager.cc:5697] T d34300c6c4f2447182942fb5ab8cc3c4 P 9ba0da223cf24c97bc7d225e25015924 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132). New cstate: current_term: 1 leader_uuid: "9ba0da223cf24c97bc7d225e25015924" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:53.368640 23341 leader_election.cc:304] T c3ac99f9dbb24693b97d3994ceb65955 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2904b089bdb249b78950db76f4a70e9f, 3a9a63ca97694ebdb84bca730762d735; no voters: 288a46a90f26471584043331107dc0dd
I20260709 12:13:53.370116 23663 raft_consensus.cc:2804] T c3ac99f9dbb24693b97d3994ceb65955 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:53.370497 23663 raft_consensus.cc:493] T c3ac99f9dbb24693b97d3994ceb65955 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:53.370867 23663 raft_consensus.cc:3060] T c3ac99f9dbb24693b97d3994ceb65955 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:53.382369 23495 tablet_bootstrap.cc:492] T c3ac99f9dbb24693b97d3994ceb65955 P 288a46a90f26471584043331107dc0dd: No bootstrap required, opened a new log
I20260709 12:13:53.383133 23495 ts_tablet_manager.cc:1403] T c3ac99f9dbb24693b97d3994ceb65955 P 288a46a90f26471584043331107dc0dd: Time spent bootstrapping tablet: real 0.035s	user 0.016s	sys 0.002s
I20260709 12:13:53.333846 23226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e2bbccfb7f4da8baf42735151ff804" candidate_uuid: "3a9a63ca97694ebdb84bca730762d735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "288a46a90f26471584043331107dc0dd" is_pre_election: true
I20260709 12:13:53.385139 23664 raft_consensus.cc:515] T a2f2a063cf2b4190826d81b2dcbf7709 P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:53.393920 23663 raft_consensus.cc:515] T c3ac99f9dbb24693b97d3994ceb65955 P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:53.370515 23497 tablet_bootstrap.cc:492] T 8e5b2401420b4a25a6457b667110f778 P 3a9a63ca97694ebdb84bca730762d735: No bootstrap required, opened a new log
I20260709 12:13:53.388018 23298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e2bbccfb7f4da8baf42735151ff804" candidate_uuid: "3a9a63ca97694ebdb84bca730762d735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2904b089bdb249b78950db76f4a70e9f" is_pre_election: true
I20260709 12:13:53.392757 23496 tablet_bootstrap.cc:654] T 05b49011442c4131a4ac3c55feed5409 P 9ba0da223cf24c97bc7d225e25015924: Neither blocks nor log segments found. Creating new log.
W20260709 12:13:53.389397 23342 leader_election.cc:343] T b3e2bbccfb7f4da8baf42735151ff804 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:53.386197 23495 raft_consensus.cc:359] T c3ac99f9dbb24693b97d3994ceb65955 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:53.397549 23495 raft_consensus.cc:385] T c3ac99f9dbb24693b97d3994ceb65955 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:53.397894 23495 raft_consensus.cc:740] T c3ac99f9dbb24693b97d3994ceb65955 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 288a46a90f26471584043331107dc0dd, State: Initialized, Role: FOLLOWER
I20260709 12:13:53.398605 23495 consensus_queue.cc:260] T c3ac99f9dbb24693b97d3994ceb65955 P 288a46a90f26471584043331107dc0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:53.399140 23227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ac99f9dbb24693b97d3994ceb65955" candidate_uuid: "3a9a63ca97694ebdb84bca730762d735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "288a46a90f26471584043331107dc0dd"
I20260709 12:13:53.396162 23663 leader_election.cc:290] T c3ac99f9dbb24693b97d3994ceb65955 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 election: Requested vote from peers 288a46a90f26471584043331107dc0dd (127.12.174.129:46159), 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789)
I20260709 12:13:53.399857 23226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f2a063cf2b4190826d81b2dcbf7709" candidate_uuid: "3a9a63ca97694ebdb84bca730762d735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "288a46a90f26471584043331107dc0dd"
I20260709 12:13:53.399951 23227 raft_consensus.cc:3060] T c3ac99f9dbb24693b97d3994ceb65955 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:53.400545 23226 raft_consensus.cc:3060] T a2f2a063cf2b4190826d81b2dcbf7709 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:13:53.401041 23341 leader_election.cc:343] T b3e2bbccfb7f4da8baf42735151ff804 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:53.401777 23341 leader_election.cc:304] T b3e2bbccfb7f4da8baf42735151ff804 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3a9a63ca97694ebdb84bca730762d735; no voters: 288a46a90f26471584043331107dc0dd, 2904b089bdb249b78950db76f4a70e9f
I20260709 12:13:53.402607 23663 raft_consensus.cc:2749] T b3e2bbccfb7f4da8baf42735151ff804 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:53.403698 23300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ac99f9dbb24693b97d3994ceb65955" candidate_uuid: "3a9a63ca97694ebdb84bca730762d735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2904b089bdb249b78950db76f4a70e9f"
I20260709 12:13:53.404366 23300 raft_consensus.cc:3060] T c3ac99f9dbb24693b97d3994ceb65955 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:53.395227 23664 leader_election.cc:290] T a2f2a063cf2b4190826d81b2dcbf7709 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 election: Requested vote from peers 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081), 288a46a90f26471584043331107dc0dd (127.12.174.129:46159)
I20260709 12:13:53.408102 23495 ts_tablet_manager.cc:1434] T c3ac99f9dbb24693b97d3994ceb65955 P 288a46a90f26471584043331107dc0dd: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.000s
I20260709 12:13:53.395228 23498 tablet_bootstrap.cc:492] T 8e5b2401420b4a25a6457b667110f778 P 2904b089bdb249b78950db76f4a70e9f: No bootstrap required, opened a new log
I20260709 12:13:53.400120 23450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f2a063cf2b4190826d81b2dcbf7709" candidate_uuid: "3a9a63ca97694ebdb84bca730762d735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba0da223cf24c97bc7d225e25015924"
I20260709 12:13:53.410104 23498 ts_tablet_manager.cc:1403] T 8e5b2401420b4a25a6457b667110f778 P 2904b089bdb249b78950db76f4a70e9f: Time spent bootstrapping tablet: real 0.071s	user 0.010s	sys 0.003s
I20260709 12:13:53.411909 23450 raft_consensus.cc:3060] T a2f2a063cf2b4190826d81b2dcbf7709 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:53.409250 23495 tablet_bootstrap.cc:492] T d2afee7aeea24f85b4bfecc49efcf841 P 288a46a90f26471584043331107dc0dd: Bootstrap starting.
I20260709 12:13:53.396173 23497 ts_tablet_manager.cc:1403] T 8e5b2401420b4a25a6457b667110f778 P 3a9a63ca97694ebdb84bca730762d735: Time spent bootstrapping tablet: real 0.049s	user 0.013s	sys 0.000s
I20260709 12:13:53.419624 23495 tablet_bootstrap.cc:654] T d2afee7aeea24f85b4bfecc49efcf841 P 288a46a90f26471584043331107dc0dd: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:53.419730 23497 raft_consensus.cc:359] T 8e5b2401420b4a25a6457b667110f778 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:53.420639 23497 raft_consensus.cc:385] T 8e5b2401420b4a25a6457b667110f778 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:53.422983 23227 raft_consensus.cc:2468] T c3ac99f9dbb24693b97d3994ceb65955 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a9a63ca97694ebdb84bca730762d735 in term 1.
I20260709 12:13:53.420941 23497 raft_consensus.cc:740] T 8e5b2401420b4a25a6457b667110f778 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a9a63ca97694ebdb84bca730762d735, State: Initialized, Role: FOLLOWER
I20260709 12:13:53.413374 23498 raft_consensus.cc:359] T 8e5b2401420b4a25a6457b667110f778 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:53.424916 23300 raft_consensus.cc:2468] T c3ac99f9dbb24693b97d3994ceb65955 P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a9a63ca97694ebdb84bca730762d735 in term 1.
I20260709 12:13:53.425336 23498 raft_consensus.cc:385] T 8e5b2401420b4a25a6457b667110f778 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:53.432044 23498 raft_consensus.cc:740] T 8e5b2401420b4a25a6457b667110f778 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2904b089bdb249b78950db76f4a70e9f, State: Initialized, Role: FOLLOWER
I20260709 12:13:53.432911 23498 consensus_queue.cc:260] T 8e5b2401420b4a25a6457b667110f778 P 2904b089bdb249b78950db76f4a70e9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:53.426448 23664 consensus_queue.cc:1048] T 0411013dc7c347ada4fd2c2a0cf134bd P 3a9a63ca97694ebdb84bca730762d735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:53.425045 23342 leader_election.cc:304] T c3ac99f9dbb24693b97d3994ceb65955 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 288a46a90f26471584043331107dc0dd, 3a9a63ca97694ebdb84bca730762d735; no voters: 
I20260709 12:13:53.434894 23664 raft_consensus.cc:2804] T c3ac99f9dbb24693b97d3994ceb65955 P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:53.425071 23497 consensus_queue.cc:260] T 8e5b2401420b4a25a6457b667110f778 P 3a9a63ca97694ebdb84bca730762d735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:53.435374 23498 ts_tablet_manager.cc:1434] T 8e5b2401420b4a25a6457b667110f778 P 2904b089bdb249b78950db76f4a70e9f: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.000s
I20260709 12:13:53.437119 23497 ts_tablet_manager.cc:1434] T 8e5b2401420b4a25a6457b667110f778 P 3a9a63ca97694ebdb84bca730762d735: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 12:13:53.438184 23497 tablet_bootstrap.cc:492] T fec017d49ead425fbd037e7d1d238e5b P 3a9a63ca97694ebdb84bca730762d735: Bootstrap starting.
I20260709 12:13:53.392762 23542 raft_consensus.cc:515] T b1533753456b445991715da5158c921b P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:53.435403 23664 raft_consensus.cc:697] T c3ac99f9dbb24693b97d3994ceb65955 P 3a9a63ca97694ebdb84bca730762d735 [term 1 LEADER]: Becoming Leader. State: Replica: 3a9a63ca97694ebdb84bca730762d735, State: Running, Role: LEADER
I20260709 12:13:53.443197 23594 raft_consensus.cc:493] T 8e5b2401420b4a25a6457b667110f778 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:53.443728 23594 raft_consensus.cc:515] T 8e5b2401420b4a25a6457b667110f778 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:53.446177 23594 leader_election.cc:290] T 8e5b2401420b4a25a6457b667110f778 P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789), 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061)
I20260709 12:13:53.447702 23542 leader_election.cc:290] T b1533753456b445991715da5158c921b P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 1 election: Requested vote from peers 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081), 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789)
I20260709 12:13:53.427695 23450 raft_consensus.cc:2468] T a2f2a063cf2b4190826d81b2dcbf7709 P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a9a63ca97694ebdb84bca730762d735 in term 1.
I20260709 12:13:53.449355 23340 leader_election.cc:304] T a2f2a063cf2b4190826d81b2dcbf7709 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a9a63ca97694ebdb84bca730762d735, 9ba0da223cf24c97bc7d225e25015924; no voters: 
I20260709 12:13:53.450304 23668 raft_consensus.cc:2804] T a2f2a063cf2b4190826d81b2dcbf7709 P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:53.450790 23668 raft_consensus.cc:697] T a2f2a063cf2b4190826d81b2dcbf7709 P 3a9a63ca97694ebdb84bca730762d735 [term 1 LEADER]: Becoming Leader. State: Replica: 3a9a63ca97694ebdb84bca730762d735, State: Running, Role: LEADER
I20260709 12:13:53.451776 23668 consensus_queue.cc:237] T a2f2a063cf2b4190826d81b2dcbf7709 P 3a9a63ca97694ebdb84bca730762d735 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:53.454394 23449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1533753456b445991715da5158c921b" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba0da223cf24c97bc7d225e25015924"
I20260709 12:13:53.455060 23449 raft_consensus.cc:3060] T b1533753456b445991715da5158c921b P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:53.458545 23298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5b2401420b4a25a6457b667110f778" candidate_uuid: "9ba0da223cf24c97bc7d225e25015924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2904b089bdb249b78950db76f4a70e9f" is_pre_election: true
I20260709 12:13:53.459372 23298 raft_consensus.cc:2468] T 8e5b2401420b4a25a6457b667110f778 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ba0da223cf24c97bc7d225e25015924 in term 0.
I20260709 12:13:53.461138 23415 leader_election.cc:304] T 8e5b2401420b4a25a6457b667110f778 P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2904b089bdb249b78950db76f4a70e9f, 9ba0da223cf24c97bc7d225e25015924; no voters: 
I20260709 12:13:53.462301 23375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5b2401420b4a25a6457b667110f778" candidate_uuid: "9ba0da223cf24c97bc7d225e25015924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a9a63ca97694ebdb84bca730762d735" is_pre_election: true
I20260709 12:13:53.463095 23375 raft_consensus.cc:2468] T 8e5b2401420b4a25a6457b667110f778 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ba0da223cf24c97bc7d225e25015924 in term 0.
I20260709 12:13:53.461464 23663 consensus_queue.cc:1048] T 0411013dc7c347ada4fd2c2a0cf134bd P 3a9a63ca97694ebdb84bca730762d735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:13:53.465118 23594 raft_consensus.cc:2804] T 8e5b2401420b4a25a6457b667110f778 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:53.465613 23594 raft_consensus.cc:493] T 8e5b2401420b4a25a6457b667110f778 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:53.465998 23594 raft_consensus.cc:3060] T 8e5b2401420b4a25a6457b667110f778 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:53.443605 23664 consensus_queue.cc:237] T c3ac99f9dbb24693b97d3994ceb65955 P 3a9a63ca97694ebdb84bca730762d735 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:53.468477 23595 raft_consensus.cc:493] T d2afee7aeea24f85b4bfecc49efcf841 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:53.450954 23302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1533753456b445991715da5158c921b" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2904b089bdb249b78950db76f4a70e9f"
I20260709 12:13:53.469696 23302 raft_consensus.cc:3060] T b1533753456b445991715da5158c921b P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:53.469208 23595 raft_consensus.cc:515] T d2afee7aeea24f85b4bfecc49efcf841 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:53.471892 23595 leader_election.cc:290] T d2afee7aeea24f85b4bfecc49efcf841 P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061), 288a46a90f26471584043331107dc0dd (127.12.174.129:46159)
I20260709 12:13:53.431510 23495 tablet_bootstrap.cc:492] T d2afee7aeea24f85b4bfecc49efcf841 P 288a46a90f26471584043331107dc0dd: No bootstrap required, opened a new log
I20260709 12:13:53.476342 23495 ts_tablet_manager.cc:1403] T d2afee7aeea24f85b4bfecc49efcf841 P 288a46a90f26471584043331107dc0dd: Time spent bootstrapping tablet: real 0.067s	user 0.013s	sys 0.000s
I20260709 12:13:53.433346 23226 raft_consensus.cc:2468] T a2f2a063cf2b4190826d81b2dcbf7709 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a9a63ca97694ebdb84bca730762d735 in term 1.
I20260709 12:13:53.477342 23498 tablet_bootstrap.cc:492] T b3e2bbccfb7f4da8baf42735151ff804 P 2904b089bdb249b78950db76f4a70e9f: Bootstrap starting.
I20260709 12:13:53.474049 23227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2afee7aeea24f85b4bfecc49efcf841" candidate_uuid: "9ba0da223cf24c97bc7d225e25015924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "288a46a90f26471584043331107dc0dd" is_pre_election: true
I20260709 12:13:53.492400 23375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2afee7aeea24f85b4bfecc49efcf841" candidate_uuid: "9ba0da223cf24c97bc7d225e25015924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a9a63ca97694ebdb84bca730762d735" is_pre_election: true
I20260709 12:13:53.496759 23375 raft_consensus.cc:2468] T d2afee7aeea24f85b4bfecc49efcf841 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ba0da223cf24c97bc7d225e25015924 in term 0.
I20260709 12:13:53.498360 23415 leader_election.cc:304] T d2afee7aeea24f85b4bfecc49efcf841 P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a9a63ca97694ebdb84bca730762d735, 9ba0da223cf24c97bc7d225e25015924; no voters: 
I20260709 12:13:53.499647 23595 raft_consensus.cc:2804] T d2afee7aeea24f85b4bfecc49efcf841 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:53.500137 23595 raft_consensus.cc:493] T d2afee7aeea24f85b4bfecc49efcf841 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:53.500500 23595 raft_consensus.cc:3060] T d2afee7aeea24f85b4bfecc49efcf841 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:53.524518 23651 consensus_queue.cc:1048] T 525cb2c0e02b473bba2e7025f5765db2 P 9ba0da223cf24c97bc7d225e25015924 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:53.554244 23497 tablet_bootstrap.cc:654] T fec017d49ead425fbd037e7d1d238e5b P 3a9a63ca97694ebdb84bca730762d735: Neither blocks nor log segments found. Creating new log.
W20260709 12:13:53.555784 23416 leader_election.cc:343] T d2afee7aeea24f85b4bfecc49efcf841 P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:13:53.556425 23341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:45789, user_credentials={real_user=slave}} blocked reactor thread for 43506.1us
I20260709 12:13:53.571136 23495 raft_consensus.cc:359] T d2afee7aeea24f85b4bfecc49efcf841 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:53.574046 23495 raft_consensus.cc:385] T d2afee7aeea24f85b4bfecc49efcf841 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:53.574433 23495 raft_consensus.cc:740] T d2afee7aeea24f85b4bfecc49efcf841 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 288a46a90f26471584043331107dc0dd, State: Initialized, Role: FOLLOWER
I20260709 12:13:53.576431 23498 tablet_bootstrap.cc:654] T b3e2bbccfb7f4da8baf42735151ff804 P 2904b089bdb249b78950db76f4a70e9f: Neither blocks nor log segments found. Creating new log.
W20260709 12:13:53.577986 23342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:46159, user_credentials={real_user=slave}} blocked reactor thread for 86164.2us
I20260709 12:13:53.575269 23495 consensus_queue.cc:260] T d2afee7aeea24f85b4bfecc49efcf841 P 288a46a90f26471584043331107dc0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:53.579591 23594 raft_consensus.cc:515] T 8e5b2401420b4a25a6457b667110f778 P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:53.582023 23594 leader_election.cc:290] T 8e5b2401420b4a25a6457b667110f778 P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 1 election: Requested vote from peers 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789), 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061)
I20260709 12:13:53.585230 23497 tablet_bootstrap.cc:492] T fec017d49ead425fbd037e7d1d238e5b P 3a9a63ca97694ebdb84bca730762d735: No bootstrap required, opened a new log
I20260709 12:13:53.585922 23497 ts_tablet_manager.cc:1403] T fec017d49ead425fbd037e7d1d238e5b P 3a9a63ca97694ebdb84bca730762d735: Time spent bootstrapping tablet: real 0.148s	user 0.013s	sys 0.014s
I20260709 12:13:53.589834 23298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5b2401420b4a25a6457b667110f778" candidate_uuid: "9ba0da223cf24c97bc7d225e25015924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2904b089bdb249b78950db76f4a70e9f"
I20260709 12:13:53.590946 23298 raft_consensus.cc:3060] T 8e5b2401420b4a25a6457b667110f778 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:53.595232 23595 raft_consensus.cc:515] T d2afee7aeea24f85b4bfecc49efcf841 P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:53.595790 23663 consensus_queue.cc:1048] T d55aba14f62b41538fdb710117d67580 P 3a9a63ca97694ebdb84bca730762d735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:53.600200 23227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2afee7aeea24f85b4bfecc49efcf841" candidate_uuid: "9ba0da223cf24c97bc7d225e25015924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "288a46a90f26471584043331107dc0dd"
I20260709 12:13:53.600464 23496 tablet_bootstrap.cc:492] T 05b49011442c4131a4ac3c55feed5409 P 9ba0da223cf24c97bc7d225e25015924: No bootstrap required, opened a new log
I20260709 12:13:53.601431 23496 ts_tablet_manager.cc:1403] T 05b49011442c4131a4ac3c55feed5409 P 9ba0da223cf24c97bc7d225e25015924: Time spent bootstrapping tablet: real 0.256s	user 0.032s	sys 0.048s
I20260709 12:13:53.608415 23497 raft_consensus.cc:359] T fec017d49ead425fbd037e7d1d238e5b P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:53.609267 23497 raft_consensus.cc:385] T fec017d49ead425fbd037e7d1d238e5b P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:53.609565 23497 raft_consensus.cc:740] T fec017d49ead425fbd037e7d1d238e5b P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a9a63ca97694ebdb84bca730762d735, State: Initialized, Role: FOLLOWER
I20260709 12:13:53.611428 23496 raft_consensus.cc:359] T 05b49011442c4131a4ac3c55feed5409 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:53.612227 23496 raft_consensus.cc:385] T 05b49011442c4131a4ac3c55feed5409 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:53.612524 23496 raft_consensus.cc:740] T 05b49011442c4131a4ac3c55feed5409 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ba0da223cf24c97bc7d225e25015924, State: Initialized, Role: FOLLOWER
I20260709 12:13:53.597894 23595 leader_election.cc:290] T d2afee7aeea24f85b4bfecc49efcf841 P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 1 election: Requested vote from peers 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061), 288a46a90f26471584043331107dc0dd (127.12.174.129:46159)
I20260709 12:13:53.616410 23496 consensus_queue.cc:260] T 05b49011442c4131a4ac3c55feed5409 P 9ba0da223cf24c97bc7d225e25015924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:53.619236 23497 consensus_queue.cc:260] T fec017d49ead425fbd037e7d1d238e5b P 3a9a63ca97694ebdb84bca730762d735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:53.619568 23125 catalog_manager.cc:5697] T c3ac99f9dbb24693b97d3994ceb65955 P 3a9a63ca97694ebdb84bca730762d735 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131). New cstate: current_term: 1 leader_uuid: "3a9a63ca97694ebdb84bca730762d735" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:53.621611 23125 catalog_manager.cc:5697] T a2f2a063cf2b4190826d81b2dcbf7709 P 3a9a63ca97694ebdb84bca730762d735 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131). New cstate: current_term: 1 leader_uuid: "3a9a63ca97694ebdb84bca730762d735" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:53.622557 23497 ts_tablet_manager.cc:1434] T fec017d49ead425fbd037e7d1d238e5b P 3a9a63ca97694ebdb84bca730762d735: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.000s
I20260709 12:13:53.624735 23497 tablet_bootstrap.cc:492] T 919076caf9f94cd8b631ea3e60dc3593 P 3a9a63ca97694ebdb84bca730762d735: Bootstrap starting.
I20260709 12:13:53.626233 23375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5b2401420b4a25a6457b667110f778" candidate_uuid: "9ba0da223cf24c97bc7d225e25015924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a9a63ca97694ebdb84bca730762d735"
I20260709 12:13:53.626900 23375 raft_consensus.cc:3060] T 8e5b2401420b4a25a6457b667110f778 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:53.630535 23496 ts_tablet_manager.cc:1434] T 05b49011442c4131a4ac3c55feed5409 P 9ba0da223cf24c97bc7d225e25015924: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.001s
I20260709 12:13:53.634680 23374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2afee7aeea24f85b4bfecc49efcf841" candidate_uuid: "9ba0da223cf24c97bc7d225e25015924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a9a63ca97694ebdb84bca730762d735"
I20260709 12:13:53.635453 23374 raft_consensus.cc:3060] T d2afee7aeea24f85b4bfecc49efcf841 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:53.644618 23374 raft_consensus.cc:2468] T d2afee7aeea24f85b4bfecc49efcf841 P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ba0da223cf24c97bc7d225e25015924 in term 1.
I20260709 12:13:53.650362 23496 tablet_bootstrap.cc:492] T 919076caf9f94cd8b631ea3e60dc3593 P 9ba0da223cf24c97bc7d225e25015924: Bootstrap starting.
I20260709 12:13:53.654435 23298 raft_consensus.cc:2468] T 8e5b2401420b4a25a6457b667110f778 P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ba0da223cf24c97bc7d225e25015924 in term 1.
I20260709 12:13:53.655992 23415 leader_election.cc:304] T 8e5b2401420b4a25a6457b667110f778 P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2904b089bdb249b78950db76f4a70e9f, 9ba0da223cf24c97bc7d225e25015924; no voters: 
I20260709 12:13:53.656572 23375 raft_consensus.cc:2468] T 8e5b2401420b4a25a6457b667110f778 P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ba0da223cf24c97bc7d225e25015924 in term 1.
I20260709 12:13:53.657109 23594 raft_consensus.cc:2804] T 8e5b2401420b4a25a6457b667110f778 P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:53.659574 23415 leader_election.cc:304] T d2afee7aeea24f85b4bfecc49efcf841 P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a9a63ca97694ebdb84bca730762d735, 9ba0da223cf24c97bc7d225e25015924; no voters: 
I20260709 12:13:53.688019 23594 raft_consensus.cc:697] T 8e5b2401420b4a25a6457b667110f778 P 9ba0da223cf24c97bc7d225e25015924 [term 1 LEADER]: Becoming Leader. State: Replica: 9ba0da223cf24c97bc7d225e25015924, State: Running, Role: LEADER
I20260709 12:13:53.688571 23726 raft_consensus.cc:2804] T d2afee7aeea24f85b4bfecc49efcf841 P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:53.659516 23497 tablet_bootstrap.cc:654] T 919076caf9f94cd8b631ea3e60dc3593 P 3a9a63ca97694ebdb84bca730762d735: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:53.689047 23594 consensus_queue.cc:237] T 8e5b2401420b4a25a6457b667110f778 P 9ba0da223cf24c97bc7d225e25015924 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:53.689110 23726 raft_consensus.cc:697] T d2afee7aeea24f85b4bfecc49efcf841 P 9ba0da223cf24c97bc7d225e25015924 [term 1 LEADER]: Becoming Leader. State: Replica: 9ba0da223cf24c97bc7d225e25015924, State: Running, Role: LEADER
I20260709 12:13:53.690791 23726 consensus_queue.cc:237] T d2afee7aeea24f85b4bfecc49efcf841 P 9ba0da223cf24c97bc7d225e25015924 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:53.661342 23668 raft_consensus.cc:493] T fec017d49ead425fbd037e7d1d238e5b P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:53.694325 23668 raft_consensus.cc:515] T fec017d49ead425fbd037e7d1d238e5b P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:53.696707 23668 leader_election.cc:290] T fec017d49ead425fbd037e7d1d238e5b P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789), 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081)
I20260709 12:13:53.697422 23583 raft_consensus.cc:493] T 92d63c0c6ef9452797da238708c39275 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:53.698097 23583 raft_consensus.cc:515] T 92d63c0c6ef9452797da238708c39275 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:53.666261 23496 tablet_bootstrap.cc:654] T 919076caf9f94cd8b631ea3e60dc3593 P 9ba0da223cf24c97bc7d225e25015924: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:53.673605 23495 ts_tablet_manager.cc:1434] T d2afee7aeea24f85b4bfecc49efcf841 P 288a46a90f26471584043331107dc0dd: Time spent starting tablet: real 0.197s	user 0.007s	sys 0.005s
I20260709 12:13:53.676249 23302 raft_consensus.cc:2468] T b1533753456b445991715da5158c921b P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 288a46a90f26471584043331107dc0dd in term 1.
I20260709 12:13:53.679177 23664 consensus_queue.cc:1048] T d55aba14f62b41538fdb710117d67580 P 3a9a63ca97694ebdb84bca730762d735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:53.625460 23449 raft_consensus.cc:2468] T b1533753456b445991715da5158c921b P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 288a46a90f26471584043331107dc0dd in term 1.
I20260709 12:13:53.687291 23498 tablet_bootstrap.cc:492] T b3e2bbccfb7f4da8baf42735151ff804 P 2904b089bdb249b78950db76f4a70e9f: No bootstrap required, opened a new log
I20260709 12:13:53.665879 23227 raft_consensus.cc:3060] T d2afee7aeea24f85b4bfecc49efcf841 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:53.705245 23498 ts_tablet_manager.cc:1403] T b3e2bbccfb7f4da8baf42735151ff804 P 2904b089bdb249b78950db76f4a70e9f: Time spent bootstrapping tablet: real 0.268s	user 0.022s	sys 0.010s
I20260709 12:13:53.705874 23192 leader_election.cc:304] T b1533753456b445991715da5158c921b P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 288a46a90f26471584043331107dc0dd, 2904b089bdb249b78950db76f4a70e9f; no voters: 
I20260709 12:13:53.708325 23638 raft_consensus.cc:2804] T b1533753456b445991715da5158c921b P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:53.708587 23498 raft_consensus.cc:359] T b3e2bbccfb7f4da8baf42735151ff804 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:53.709403 23498 raft_consensus.cc:385] T b3e2bbccfb7f4da8baf42735151ff804 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:53.709681 23498 raft_consensus.cc:740] T b3e2bbccfb7f4da8baf42735151ff804 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2904b089bdb249b78950db76f4a70e9f, State: Initialized, Role: FOLLOWER
I20260709 12:13:53.710530 23638 raft_consensus.cc:697] T b1533753456b445991715da5158c921b P 288a46a90f26471584043331107dc0dd [term 1 LEADER]: Becoming Leader. State: Replica: 288a46a90f26471584043331107dc0dd, State: Running, Role: LEADER
I20260709 12:13:53.711099 23498 consensus_queue.cc:260] T b3e2bbccfb7f4da8baf42735151ff804 P 2904b089bdb249b78950db76f4a70e9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:53.711467 23638 consensus_queue.cc:237] T b1533753456b445991715da5158c921b P 288a46a90f26471584043331107dc0dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
W20260709 12:13:53.701028 23173 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:13:53.703619 23495 tablet_bootstrap.cc:492] T 92d63c0c6ef9452797da238708c39275 P 288a46a90f26471584043331107dc0dd: Bootstrap starting.
I20260709 12:13:53.731945 23497 tablet_bootstrap.cc:492] T 919076caf9f94cd8b631ea3e60dc3593 P 3a9a63ca97694ebdb84bca730762d735: No bootstrap required, opened a new log
I20260709 12:13:53.732780 23497 ts_tablet_manager.cc:1403] T 919076caf9f94cd8b631ea3e60dc3593 P 3a9a63ca97694ebdb84bca730762d735: Time spent bootstrapping tablet: real 0.108s	user 0.012s	sys 0.000s
I20260709 12:13:53.777552 23496 tablet_bootstrap.cc:492] T 919076caf9f94cd8b631ea3e60dc3593 P 9ba0da223cf24c97bc7d225e25015924: No bootstrap required, opened a new log
I20260709 12:13:53.778388 23496 ts_tablet_manager.cc:1403] T 919076caf9f94cd8b631ea3e60dc3593 P 9ba0da223cf24c97bc7d225e25015924: Time spent bootstrapping tablet: real 0.128s	user 0.008s	sys 0.022s
W20260709 12:13:53.755970 23415 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:40061, user_credentials={real_user=slave}} blocked reactor thread for 66691.9us
I20260709 12:13:53.786167 23498 ts_tablet_manager.cc:1434] T b3e2bbccfb7f4da8baf42735151ff804 P 2904b089bdb249b78950db76f4a70e9f: Time spent starting tablet: real 0.081s	user 0.013s	sys 0.003s
I20260709 12:13:53.787375 23498 tablet_bootstrap.cc:492] T 05b49011442c4131a4ac3c55feed5409 P 2904b089bdb249b78950db76f4a70e9f: Bootstrap starting.
I20260709 12:13:53.779575 23632 raft_consensus.cc:493] T 5959fc0b70884d699725fb8d560e5de5 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9ba0da223cf24c97bc7d225e25015924)
I20260709 12:13:53.781137 23300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec017d49ead425fbd037e7d1d238e5b" candidate_uuid: "3a9a63ca97694ebdb84bca730762d735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2904b089bdb249b78950db76f4a70e9f" is_pre_election: true
I20260709 12:13:53.801574 23496 raft_consensus.cc:359] T 919076caf9f94cd8b631ea3e60dc3593 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:53.807718 23496 raft_consensus.cc:385] T 919076caf9f94cd8b631ea3e60dc3593 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:53.808506 23496 raft_consensus.cc:740] T 919076caf9f94cd8b631ea3e60dc3593 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ba0da223cf24c97bc7d225e25015924, State: Initialized, Role: FOLLOWER
I20260709 12:13:53.813907 23583 leader_election.cc:290] T 92d63c0c6ef9452797da238708c39275 P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 288a46a90f26471584043331107dc0dd (127.12.174.129:46159), 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061)
I20260709 12:13:53.801481 23449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec017d49ead425fbd037e7d1d238e5b" candidate_uuid: "3a9a63ca97694ebdb84bca730762d735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba0da223cf24c97bc7d225e25015924" is_pre_election: true
I20260709 12:13:53.823022 23496 consensus_queue.cc:260] T 919076caf9f94cd8b631ea3e60dc3593 P 9ba0da223cf24c97bc7d225e25015924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:53.807305 23632 raft_consensus.cc:515] T 5959fc0b70884d699725fb8d560e5de5 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:53.806000 23728 consensus_queue.cc:1048] T 525cb2c0e02b473bba2e7025f5765db2 P 9ba0da223cf24c97bc7d225e25015924 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.025s
I20260709 12:13:53.838131 23594 consensus_queue.cc:1048] T d34300c6c4f2447182942fb5ab8cc3c4 P 9ba0da223cf24c97bc7d225e25015924 [LEADER]: Connected to new peer: Peer: permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:53.844274 23375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92d63c0c6ef9452797da238708c39275" candidate_uuid: "2904b089bdb249b78950db76f4a70e9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a9a63ca97694ebdb84bca730762d735" is_pre_election: true
I20260709 12:13:53.845245 23375 raft_consensus.cc:2468] T 92d63c0c6ef9452797da238708c39275 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2904b089bdb249b78950db76f4a70e9f in term 0.
W20260709 12:13:53.824779 23192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:40061, user_credentials={real_user=slave}} blocked reactor thread for 52571.1us
I20260709 12:13:53.854466 23498 tablet_bootstrap.cc:654] T 05b49011442c4131a4ac3c55feed5409 P 2904b089bdb249b78950db76f4a70e9f: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:53.855935 23496 ts_tablet_manager.cc:1434] T 919076caf9f94cd8b631ea3e60dc3593 P 9ba0da223cf24c97bc7d225e25015924: Time spent starting tablet: real 0.077s	user 0.008s	sys 0.002s
I20260709 12:13:53.858407 23496 tablet_bootstrap.cc:492] T fec017d49ead425fbd037e7d1d238e5b P 9ba0da223cf24c97bc7d225e25015924: Bootstrap starting.
I20260709 12:13:53.862140 23497 raft_consensus.cc:359] T 919076caf9f94cd8b631ea3e60dc3593 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:53.862777 23497 raft_consensus.cc:385] T 919076caf9f94cd8b631ea3e60dc3593 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:53.862996 23497 raft_consensus.cc:740] T 919076caf9f94cd8b631ea3e60dc3593 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a9a63ca97694ebdb84bca730762d735, State: Initialized, Role: FOLLOWER
I20260709 12:13:53.863564 23497 consensus_queue.cc:260] T 919076caf9f94cd8b631ea3e60dc3593 P 3a9a63ca97694ebdb84bca730762d735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:53.870421 23121 catalog_manager.cc:5697] T 8e5b2401420b4a25a6457b667110f778 P 9ba0da223cf24c97bc7d225e25015924 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132). New cstate: current_term: 1 leader_uuid: "9ba0da223cf24c97bc7d225e25015924" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } health_report { overall_health: HEALTHY } } }
W20260709 12:13:53.854521 23341 leader_election.cc:343] T fec017d49ead425fbd037e7d1d238e5b P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:53.876144 23632 leader_election.cc:290] T 5959fc0b70884d699725fb8d560e5de5 P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081), 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789)
I20260709 12:13:53.880316 23651 consensus_queue.cc:1048] T d34300c6c4f2447182942fb5ab8cc3c4 P 9ba0da223cf24c97bc7d225e25015924 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:53.883029 23446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5959fc0b70884d699725fb8d560e5de5" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ba0da223cf24c97bc7d225e25015924" is_pre_election: true
I20260709 12:13:53.883867 23446 raft_consensus.cc:2468] T 5959fc0b70884d699725fb8d560e5de5 P 9ba0da223cf24c97bc7d225e25015924 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 288a46a90f26471584043331107dc0dd in term 2.
W20260709 12:13:53.885407 23340 leader_election.cc:343] T fec017d49ead425fbd037e7d1d238e5b P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:53.885965 23340 leader_election.cc:304] T fec017d49ead425fbd037e7d1d238e5b P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3a9a63ca97694ebdb84bca730762d735; no voters: 2904b089bdb249b78950db76f4a70e9f, 9ba0da223cf24c97bc7d225e25015924
I20260709 12:13:53.887828 23664 raft_consensus.cc:2749] T fec017d49ead425fbd037e7d1d238e5b P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:53.886030 23267 leader_election.cc:304] T 92d63c0c6ef9452797da238708c39275 P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2904b089bdb249b78950db76f4a70e9f, 3a9a63ca97694ebdb84bca730762d735; no voters: 
I20260709 12:13:53.892977 23583 raft_consensus.cc:2804] T 92d63c0c6ef9452797da238708c39275 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:53.893416 23583 raft_consensus.cc:493] T 92d63c0c6ef9452797da238708c39275 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:53.893770 23583 raft_consensus.cc:3060] T 92d63c0c6ef9452797da238708c39275 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:53.897277 23227 raft_consensus.cc:2468] T d2afee7aeea24f85b4bfecc49efcf841 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ba0da223cf24c97bc7d225e25015924 in term 1.
I20260709 12:13:53.907404 23191 leader_election.cc:304] T 5959fc0b70884d699725fb8d560e5de5 P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 288a46a90f26471584043331107dc0dd, 9ba0da223cf24c97bc7d225e25015924; no voters: 
I20260709 12:13:53.909746 23497 ts_tablet_manager.cc:1434] T 919076caf9f94cd8b631ea3e60dc3593 P 3a9a63ca97694ebdb84bca730762d735: Time spent starting tablet: real 0.177s	user 0.010s	sys 0.000s
I20260709 12:13:53.910396 23495 tablet_bootstrap.cc:654] T 92d63c0c6ef9452797da238708c39275 P 288a46a90f26471584043331107dc0dd: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:53.913385 23497 tablet_bootstrap.cc:492] T d85273afe57c4f35bb72827d1c5879eb P 3a9a63ca97694ebdb84bca730762d735: Bootstrap starting.
I20260709 12:13:53.919410 23226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92d63c0c6ef9452797da238708c39275" candidate_uuid: "2904b089bdb249b78950db76f4a70e9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "288a46a90f26471584043331107dc0dd" is_pre_election: true
I20260709 12:13:53.912070 23542 consensus_queue.cc:1048] T 859d30d8c3fb4a499256ffad6dc2d1cd P 288a46a90f26471584043331107dc0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 12:13:53.914497 23737 raft_consensus.cc:2804] T 5959fc0b70884d699725fb8d560e5de5 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:53.928984 23737 raft_consensus.cc:493] T 5959fc0b70884d699725fb8d560e5de5 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9ba0da223cf24c97bc7d225e25015924)
I20260709 12:13:53.929467 23737 raft_consensus.cc:3060] T 5959fc0b70884d699725fb8d560e5de5 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:53.931270 23302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5959fc0b70884d699725fb8d560e5de5" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2904b089bdb249b78950db76f4a70e9f" is_pre_election: true
I20260709 12:13:53.932228 23302 raft_consensus.cc:2393] T 5959fc0b70884d699725fb8d560e5de5 P 2904b089bdb249b78950db76f4a70e9f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 288a46a90f26471584043331107dc0dd in current term 2: Already voted for candidate 2904b089bdb249b78950db76f4a70e9f in this term.
I20260709 12:13:53.934257 23638 consensus_queue.cc:1048] T 859d30d8c3fb4a499256ffad6dc2d1cd P 288a46a90f26471584043331107dc0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:53.935230 23664 raft_consensus.cc:493] T 919076caf9f94cd8b631ea3e60dc3593 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:53.935848 23664 raft_consensus.cc:515] T 919076caf9f94cd8b631ea3e60dc3593 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:53.938478 23664 leader_election.cc:290] T 919076caf9f94cd8b631ea3e60dc3593 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081), 288a46a90f26471584043331107dc0dd (127.12.174.129:46159)
I20260709 12:13:53.939845 23223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "919076caf9f94cd8b631ea3e60dc3593" candidate_uuid: "3a9a63ca97694ebdb84bca730762d735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "288a46a90f26471584043331107dc0dd" is_pre_election: true
W20260709 12:13:53.941921 23268 leader_election.cc:343] T 92d63c0c6ef9452797da238708c39275 P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:13:53.942011 23342 leader_election.cc:343] T 919076caf9f94cd8b631ea3e60dc3593 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:53.952481 23448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "919076caf9f94cd8b631ea3e60dc3593" candidate_uuid: "3a9a63ca97694ebdb84bca730762d735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba0da223cf24c97bc7d225e25015924" is_pre_election: true
I20260709 12:13:53.953388 23448 raft_consensus.cc:2468] T 919076caf9f94cd8b631ea3e60dc3593 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a9a63ca97694ebdb84bca730762d735 in term 0.
I20260709 12:13:53.956784 23737 raft_consensus.cc:515] T 5959fc0b70884d699725fb8d560e5de5 P 288a46a90f26471584043331107dc0dd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:53.959232 23737 leader_election.cc:290] T 5959fc0b70884d699725fb8d560e5de5 P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 2 election: Requested vote from peers 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081), 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789)
I20260709 12:13:53.959885 23340 leader_election.cc:304] T 919076caf9f94cd8b631ea3e60dc3593 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3a9a63ca97694ebdb84bca730762d735, 9ba0da223cf24c97bc7d225e25015924; no voters: 288a46a90f26471584043331107dc0dd
I20260709 12:13:53.960433 23448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5959fc0b70884d699725fb8d560e5de5" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ba0da223cf24c97bc7d225e25015924"
I20260709 12:13:53.961251 23533 raft_consensus.cc:2804] T 919076caf9f94cd8b631ea3e60dc3593 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:53.961627 23734 raft_consensus.cc:493] T b3e2bbccfb7f4da8baf42735151ff804 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:53.961771 23533 raft_consensus.cc:493] T 919076caf9f94cd8b631ea3e60dc3593 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:53.962282 23734 raft_consensus.cc:515] T b3e2bbccfb7f4da8baf42735151ff804 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:53.962862 23533 raft_consensus.cc:3060] T 919076caf9f94cd8b631ea3e60dc3593 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:53.967403 23668 consensus_queue.cc:1048] T c3ac99f9dbb24693b97d3994ceb65955 P 3a9a63ca97694ebdb84bca730762d735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:53.968042 23298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5959fc0b70884d699725fb8d560e5de5" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2904b089bdb249b78950db76f4a70e9f"
I20260709 12:13:53.968931 23298 raft_consensus.cc:2393] T 5959fc0b70884d699725fb8d560e5de5 P 2904b089bdb249b78950db76f4a70e9f [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 288a46a90f26471584043331107dc0dd in current term 2: Already voted for candidate 2904b089bdb249b78950db76f4a70e9f in this term.
I20260709 12:13:53.971457 23583 raft_consensus.cc:515] T 92d63c0c6ef9452797da238708c39275 P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:53.974007 23734 leader_election.cc:290] T b3e2bbccfb7f4da8baf42735151ff804 P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 288a46a90f26471584043331107dc0dd (127.12.174.129:46159), 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061)
I20260709 12:13:53.976100 23663 consensus_queue.cc:1048] T c3ac99f9dbb24693b97d3994ceb65955 P 3a9a63ca97694ebdb84bca730762d735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:53.976424 23224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e2bbccfb7f4da8baf42735151ff804" candidate_uuid: "2904b089bdb249b78950db76f4a70e9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "288a46a90f26471584043331107dc0dd" is_pre_election: true
I20260709 12:13:53.977913 23374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e2bbccfb7f4da8baf42735151ff804" candidate_uuid: "2904b089bdb249b78950db76f4a70e9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a9a63ca97694ebdb84bca730762d735" is_pre_election: true
I20260709 12:13:54.008018 23595 raft_consensus.cc:493] T 05b49011442c4131a4ac3c55feed5409 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:54.011873 23125 catalog_manager.cc:5697] T d2afee7aeea24f85b4bfecc49efcf841 P 9ba0da223cf24c97bc7d225e25015924 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132). New cstate: current_term: 1 leader_uuid: "9ba0da223cf24c97bc7d225e25015924" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:54.000923 23374 raft_consensus.cc:2468] T b3e2bbccfb7f4da8baf42735151ff804 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2904b089bdb249b78950db76f4a70e9f in term 0.
I20260709 12:13:54.027786 23448 raft_consensus.cc:2468] T 5959fc0b70884d699725fb8d560e5de5 P 9ba0da223cf24c97bc7d225e25015924 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 288a46a90f26471584043331107dc0dd in term 2.
I20260709 12:13:54.016552 23595 raft_consensus.cc:515] T 05b49011442c4131a4ac3c55feed5409 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:54.030129 23595 leader_election.cc:290] T 05b49011442c4131a4ac3c55feed5409 P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 288a46a90f26471584043331107dc0dd (127.12.174.129:46159), 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789)
W20260709 12:13:54.021405 23268 leader_election.cc:343] T b3e2bbccfb7f4da8baf42735151ff804 P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:54.032305 23495 tablet_bootstrap.cc:492] T 92d63c0c6ef9452797da238708c39275 P 288a46a90f26471584043331107dc0dd: No bootstrap required, opened a new log
I20260709 12:13:54.033061 23495 ts_tablet_manager.cc:1403] T 92d63c0c6ef9452797da238708c39275 P 288a46a90f26471584043331107dc0dd: Time spent bootstrapping tablet: real 0.331s	user 0.012s	sys 0.013s
I20260709 12:13:54.033295 23267 leader_election.cc:304] T b3e2bbccfb7f4da8baf42735151ff804 P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2904b089bdb249b78950db76f4a70e9f, 3a9a63ca97694ebdb84bca730762d735; no voters: 288a46a90f26471584043331107dc0dd
I20260709 12:13:54.037776 23495 raft_consensus.cc:359] T 92d63c0c6ef9452797da238708c39275 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:54.038859 23583 leader_election.cc:290] T 92d63c0c6ef9452797da238708c39275 P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 1 election: Requested vote from peers 288a46a90f26471584043331107dc0dd (127.12.174.129:46159), 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061)
I20260709 12:13:54.038154 23299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b49011442c4131a4ac3c55feed5409" candidate_uuid: "9ba0da223cf24c97bc7d225e25015924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2904b089bdb249b78950db76f4a70e9f" is_pre_election: true
I20260709 12:13:54.044433 23495 raft_consensus.cc:385] T 92d63c0c6ef9452797da238708c39275 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:54.046506 23495 raft_consensus.cc:740] T 92d63c0c6ef9452797da238708c39275 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 288a46a90f26471584043331107dc0dd, State: Initialized, Role: FOLLOWER
I20260709 12:13:54.047144 23495 consensus_queue.cc:260] T 92d63c0c6ef9452797da238708c39275 P 288a46a90f26471584043331107dc0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:54.048591 23664 consensus_queue.cc:1048] T a2f2a063cf2b4190826d81b2dcbf7709 P 3a9a63ca97694ebdb84bca730762d735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 12:13:54.050185 23734 raft_consensus.cc:2804] T b3e2bbccfb7f4da8baf42735151ff804 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:54.058706 23734 raft_consensus.cc:493] T b3e2bbccfb7f4da8baf42735151ff804 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:54.065152 23734 raft_consensus.cc:3060] T b3e2bbccfb7f4da8baf42735151ff804 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:54.065420 23497 tablet_bootstrap.cc:654] T d85273afe57c4f35bb72827d1c5879eb P 3a9a63ca97694ebdb84bca730762d735: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:54.071238 23374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92d63c0c6ef9452797da238708c39275" candidate_uuid: "2904b089bdb249b78950db76f4a70e9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a9a63ca97694ebdb84bca730762d735"
I20260709 12:13:54.072053 23374 raft_consensus.cc:3060] T 92d63c0c6ef9452797da238708c39275 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:54.072408 23191 leader_election.cc:304] T 5959fc0b70884d699725fb8d560e5de5 P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 288a46a90f26471584043331107dc0dd, 9ba0da223cf24c97bc7d225e25015924; no voters: 2904b089bdb249b78950db76f4a70e9f
I20260709 12:13:54.074013 23638 raft_consensus.cc:2804] T 5959fc0b70884d699725fb8d560e5de5 P 288a46a90f26471584043331107dc0dd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:54.074546 23638 raft_consensus.cc:697] T 5959fc0b70884d699725fb8d560e5de5 P 288a46a90f26471584043331107dc0dd [term 2 LEADER]: Becoming Leader. State: Replica: 288a46a90f26471584043331107dc0dd, State: Running, Role: LEADER
I20260709 12:13:54.075449 23638 consensus_queue.cc:237] T 5959fc0b70884d699725fb8d560e5de5 P 288a46a90f26471584043331107dc0dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
W20260709 12:13:54.075443 23415 leader_election.cc:343] T 05b49011442c4131a4ac3c55feed5409 P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:54.078272 23224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b49011442c4131a4ac3c55feed5409" candidate_uuid: "9ba0da223cf24c97bc7d225e25015924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "288a46a90f26471584043331107dc0dd" is_pre_election: true
W20260709 12:13:54.082638 23416 leader_election.cc:343] T 05b49011442c4131a4ac3c55feed5409 P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:54.083209 23416 leader_election.cc:304] T 05b49011442c4131a4ac3c55feed5409 P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ba0da223cf24c97bc7d225e25015924; no voters: 288a46a90f26471584043331107dc0dd, 2904b089bdb249b78950db76f4a70e9f
I20260709 12:13:54.084666 23595 raft_consensus.cc:2749] T 05b49011442c4131a4ac3c55feed5409 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:54.085464 23224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92d63c0c6ef9452797da238708c39275" candidate_uuid: "2904b089bdb249b78950db76f4a70e9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "288a46a90f26471584043331107dc0dd"
I20260709 12:13:54.086318 23224 raft_consensus.cc:3060] T 92d63c0c6ef9452797da238708c39275 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:54.041662 23533 raft_consensus.cc:515] T 919076caf9f94cd8b631ea3e60dc3593 P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:54.091439 23496 tablet_bootstrap.cc:654] T fec017d49ead425fbd037e7d1d238e5b P 9ba0da223cf24c97bc7d225e25015924: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:54.095539 23495 ts_tablet_manager.cc:1434] T 92d63c0c6ef9452797da238708c39275 P 288a46a90f26471584043331107dc0dd: Time spent starting tablet: real 0.062s	user 0.009s	sys 0.001s
I20260709 12:13:54.096971 23495 tablet_bootstrap.cc:492] T b3e2bbccfb7f4da8baf42735151ff804 P 288a46a90f26471584043331107dc0dd: Bootstrap starting.
I20260709 12:13:54.104043 23124 catalog_manager.cc:5697] T b1533753456b445991715da5158c921b P 288a46a90f26471584043331107dc0dd reported cstate change: term changed from 0 to 1, leader changed from <none> to 288a46a90f26471584043331107dc0dd (127.12.174.129). New cstate: current_term: 1 leader_uuid: "288a46a90f26471584043331107dc0dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:54.115931 23498 tablet_bootstrap.cc:492] T 05b49011442c4131a4ac3c55feed5409 P 2904b089bdb249b78950db76f4a70e9f: No bootstrap required, opened a new log
I20260709 12:13:54.116840 23498 ts_tablet_manager.cc:1403] T 05b49011442c4131a4ac3c55feed5409 P 2904b089bdb249b78950db76f4a70e9f: Time spent bootstrapping tablet: real 0.330s	user 0.027s	sys 0.023s
I20260709 12:13:54.136013 23374 raft_consensus.cc:2468] T 92d63c0c6ef9452797da238708c39275 P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2904b089bdb249b78950db76f4a70e9f in term 1.
I20260709 12:13:54.143033 23267 leader_election.cc:304] T 92d63c0c6ef9452797da238708c39275 P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2904b089bdb249b78950db76f4a70e9f, 3a9a63ca97694ebdb84bca730762d735; no voters: 
I20260709 12:13:54.144277 23663 consensus_queue.cc:1048] T a2f2a063cf2b4190826d81b2dcbf7709 P 3a9a63ca97694ebdb84bca730762d735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:54.146551 23738 raft_consensus.cc:2804] T 92d63c0c6ef9452797da238708c39275 P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:54.147118 23738 raft_consensus.cc:697] T 92d63c0c6ef9452797da238708c39275 P 2904b089bdb249b78950db76f4a70e9f [term 1 LEADER]: Becoming Leader. State: Replica: 2904b089bdb249b78950db76f4a70e9f, State: Running, Role: LEADER
I20260709 12:13:54.148053 23738 consensus_queue.cc:237] T 92d63c0c6ef9452797da238708c39275 P 2904b089bdb249b78950db76f4a70e9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:54.106669 23734 raft_consensus.cc:515] T b3e2bbccfb7f4da8baf42735151ff804 P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:54.152907 23495 tablet_bootstrap.cc:654] T b3e2bbccfb7f4da8baf42735151ff804 P 288a46a90f26471584043331107dc0dd: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:54.160497 23533 leader_election.cc:290] T 919076caf9f94cd8b631ea3e60dc3593 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 election: Requested vote from peers 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081), 288a46a90f26471584043331107dc0dd (127.12.174.129:46159)
I20260709 12:13:54.172382 23226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "919076caf9f94cd8b631ea3e60dc3593" candidate_uuid: "3a9a63ca97694ebdb84bca730762d735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "288a46a90f26471584043331107dc0dd"
I20260709 12:13:54.168852 23450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "919076caf9f94cd8b631ea3e60dc3593" candidate_uuid: "3a9a63ca97694ebdb84bca730762d735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba0da223cf24c97bc7d225e25015924"
I20260709 12:13:54.174026 23450 raft_consensus.cc:3060] T 919076caf9f94cd8b631ea3e60dc3593 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:13:54.179369 23342 leader_election.cc:343] T 919076caf9f94cd8b631ea3e60dc3593 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:54.199651 23497 tablet_bootstrap.cc:492] T d85273afe57c4f35bb72827d1c5879eb P 3a9a63ca97694ebdb84bca730762d735: No bootstrap required, opened a new log
I20260709 12:13:54.200519 23497 ts_tablet_manager.cc:1403] T d85273afe57c4f35bb72827d1c5879eb P 3a9a63ca97694ebdb84bca730762d735: Time spent bootstrapping tablet: real 0.290s	user 0.011s	sys 0.012s
I20260709 12:13:54.206374 23498 raft_consensus.cc:359] T 05b49011442c4131a4ac3c55feed5409 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:54.207266 23498 raft_consensus.cc:385] T 05b49011442c4131a4ac3c55feed5409 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:54.207582 23498 raft_consensus.cc:740] T 05b49011442c4131a4ac3c55feed5409 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2904b089bdb249b78950db76f4a70e9f, State: Initialized, Role: FOLLOWER
I20260709 12:13:54.210739 23498 consensus_queue.cc:260] T 05b49011442c4131a4ac3c55feed5409 P 2904b089bdb249b78950db76f4a70e9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:54.212581 23498 ts_tablet_manager.cc:1434] T 05b49011442c4131a4ac3c55feed5409 P 2904b089bdb249b78950db76f4a70e9f: Time spent starting tablet: real 0.095s	user 0.001s	sys 0.007s
I20260709 12:13:54.214377 23224 raft_consensus.cc:2468] T 92d63c0c6ef9452797da238708c39275 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2904b089bdb249b78950db76f4a70e9f in term 1.
I20260709 12:13:54.216668 23498 tablet_bootstrap.cc:492] T fec017d49ead425fbd037e7d1d238e5b P 2904b089bdb249b78950db76f4a70e9f: Bootstrap starting.
I20260709 12:13:54.217129 23595 consensus_queue.cc:1048] T 8e5b2401420b4a25a6457b667110f778 P 9ba0da223cf24c97bc7d225e25015924 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:54.224236 23498 tablet_bootstrap.cc:654] T fec017d49ead425fbd037e7d1d238e5b P 2904b089bdb249b78950db76f4a70e9f: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:54.224098 23542 consensus_queue.cc:1048] T b1533753456b445991715da5158c921b P 288a46a90f26471584043331107dc0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 12:13:54.240272 23124 catalog_manager.cc:5697] T 5959fc0b70884d699725fb8d560e5de5 P 288a46a90f26471584043331107dc0dd reported cstate change: term changed from 1 to 2, leader changed from 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132) to 288a46a90f26471584043331107dc0dd (127.12.174.129). New cstate: current_term: 2 leader_uuid: "288a46a90f26471584043331107dc0dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:54.221562 23450 raft_consensus.cc:2468] T 919076caf9f94cd8b631ea3e60dc3593 P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a9a63ca97694ebdb84bca730762d735 in term 1.
I20260709 12:13:54.252686 23542 consensus_queue.cc:1048] T b1533753456b445991715da5158c921b P 288a46a90f26471584043331107dc0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:54.262643 23726 consensus_queue.cc:1048] T d2afee7aeea24f85b4bfecc49efcf841 P 9ba0da223cf24c97bc7d225e25015924 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:54.265652 23728 consensus_queue.cc:1048] T d2afee7aeea24f85b4bfecc49efcf841 P 9ba0da223cf24c97bc7d225e25015924 [LEADER]: Connected to new peer: Peer: permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:54.270102 23728 consensus_queue.cc:1048] T 8e5b2401420b4a25a6457b667110f778 P 9ba0da223cf24c97bc7d225e25015924 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:13:54.272500 23751 log.cc:927] Time spent T 5959fc0b70884d699725fb8d560e5de5 P 288a46a90f26471584043331107dc0dd: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 12:13:54.292445 23374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e2bbccfb7f4da8baf42735151ff804" candidate_uuid: "2904b089bdb249b78950db76f4a70e9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a9a63ca97694ebdb84bca730762d735"
I20260709 12:13:54.292773 23227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e2bbccfb7f4da8baf42735151ff804" candidate_uuid: "2904b089bdb249b78950db76f4a70e9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "288a46a90f26471584043331107dc0dd"
I20260709 12:13:54.293205 23734 leader_election.cc:290] T b3e2bbccfb7f4da8baf42735151ff804 P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 1 election: Requested vote from peers 288a46a90f26471584043331107dc0dd (127.12.174.129:46159), 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061)
I20260709 12:13:54.299208 23374 raft_consensus.cc:3060] T b3e2bbccfb7f4da8baf42735151ff804 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:54.300488 23495 tablet_bootstrap.cc:492] T b3e2bbccfb7f4da8baf42735151ff804 P 288a46a90f26471584043331107dc0dd: No bootstrap required, opened a new log
I20260709 12:13:54.301122 23495 ts_tablet_manager.cc:1403] T b3e2bbccfb7f4da8baf42735151ff804 P 288a46a90f26471584043331107dc0dd: Time spent bootstrapping tablet: real 0.204s	user 0.017s	sys 0.015s
I20260709 12:13:54.307266 23498 tablet_bootstrap.cc:492] T fec017d49ead425fbd037e7d1d238e5b P 2904b089bdb249b78950db76f4a70e9f: No bootstrap required, opened a new log
I20260709 12:13:54.308061 23498 ts_tablet_manager.cc:1403] T fec017d49ead425fbd037e7d1d238e5b P 2904b089bdb249b78950db76f4a70e9f: Time spent bootstrapping tablet: real 0.095s	user 0.027s	sys 0.026s
I20260709 12:13:54.311614 23498 raft_consensus.cc:359] T fec017d49ead425fbd037e7d1d238e5b P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:54.312469 23498 raft_consensus.cc:385] T fec017d49ead425fbd037e7d1d238e5b P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:54.312723 23498 raft_consensus.cc:740] T fec017d49ead425fbd037e7d1d238e5b P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2904b089bdb249b78950db76f4a70e9f, State: Initialized, Role: FOLLOWER
I20260709 12:13:54.313025 23738 raft_consensus.cc:493] T 5959fc0b70884d699725fb8d560e5de5 P 2904b089bdb249b78950db76f4a70e9f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:54.313460 23498 consensus_queue.cc:260] T fec017d49ead425fbd037e7d1d238e5b P 2904b089bdb249b78950db76f4a70e9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:54.313558 23738 raft_consensus.cc:515] T 5959fc0b70884d699725fb8d560e5de5 P 2904b089bdb249b78950db76f4a70e9f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:54.321125 23498 ts_tablet_manager.cc:1434] T fec017d49ead425fbd037e7d1d238e5b P 2904b089bdb249b78950db76f4a70e9f: Time spent starting tablet: real 0.013s	user 0.010s	sys 0.000s
I20260709 12:13:54.322574 23498 tablet_bootstrap.cc:492] T 94b9ff7f93dc4114b7c59ecfc0fcc9a7 P 2904b089bdb249b78950db76f4a70e9f: Bootstrap starting.
I20260709 12:13:54.337862 23496 tablet_bootstrap.cc:492] T fec017d49ead425fbd037e7d1d238e5b P 9ba0da223cf24c97bc7d225e25015924: No bootstrap required, opened a new log
I20260709 12:13:54.338429 23496 ts_tablet_manager.cc:1403] T fec017d49ead425fbd037e7d1d238e5b P 9ba0da223cf24c97bc7d225e25015924: Time spent bootstrapping tablet: real 0.481s	user 0.017s	sys 0.034s
W20260709 12:13:54.334515 23268 leader_election.cc:343] T b3e2bbccfb7f4da8baf42735151ff804 P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:54.339740 23497 raft_consensus.cc:359] T d85273afe57c4f35bb72827d1c5879eb P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:54.340811 23497 raft_consensus.cc:385] T d85273afe57c4f35bb72827d1c5879eb P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:54.341143 23497 raft_consensus.cc:740] T d85273afe57c4f35bb72827d1c5879eb P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a9a63ca97694ebdb84bca730762d735, State: Initialized, Role: FOLLOWER
I20260709 12:13:54.341974 23497 consensus_queue.cc:260] T d85273afe57c4f35bb72827d1c5879eb P 3a9a63ca97694ebdb84bca730762d735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:54.344545 23449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5959fc0b70884d699725fb8d560e5de5" candidate_uuid: "2904b089bdb249b78950db76f4a70e9f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ba0da223cf24c97bc7d225e25015924" is_pre_election: true
I20260709 12:13:54.345352 23449 raft_consensus.cc:2468] T 5959fc0b70884d699725fb8d560e5de5 P 9ba0da223cf24c97bc7d225e25015924 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2904b089bdb249b78950db76f4a70e9f in term 2.
I20260709 12:13:54.330449 23340 leader_election.cc:304] T 919076caf9f94cd8b631ea3e60dc3593 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3a9a63ca97694ebdb84bca730762d735, 9ba0da223cf24c97bc7d225e25015924; no voters: 288a46a90f26471584043331107dc0dd
I20260709 12:13:54.345597 23495 raft_consensus.cc:359] T b3e2bbccfb7f4da8baf42735151ff804 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:54.350555 23495 raft_consensus.cc:385] T b3e2bbccfb7f4da8baf42735151ff804 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:54.335851 23738 leader_election.cc:290] T 5959fc0b70884d699725fb8d560e5de5 P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081), 288a46a90f26471584043331107dc0dd (127.12.174.129:46159)
I20260709 12:13:54.352478 23497 ts_tablet_manager.cc:1434] T d85273afe57c4f35bb72827d1c5879eb P 3a9a63ca97694ebdb84bca730762d735: Time spent starting tablet: real 0.152s	user 0.000s	sys 0.007s
I20260709 12:13:54.353721 23497 tablet_bootstrap.cc:492] T 7754f065b43946f0a3aca8a75cb61273 P 3a9a63ca97694ebdb84bca730762d735: Bootstrap starting.
I20260709 12:13:54.350713 23227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5959fc0b70884d699725fb8d560e5de5" candidate_uuid: "2904b089bdb249b78950db76f4a70e9f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "288a46a90f26471584043331107dc0dd" is_pre_election: true
I20260709 12:13:54.356271 23495 raft_consensus.cc:740] T b3e2bbccfb7f4da8baf42735151ff804 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 288a46a90f26471584043331107dc0dd, State: Initialized, Role: FOLLOWER
I20260709 12:13:54.357226 23495 consensus_queue.cc:260] T b3e2bbccfb7f4da8baf42735151ff804 P 288a46a90f26471584043331107dc0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:54.350612 23266 leader_election.cc:304] T 5959fc0b70884d699725fb8d560e5de5 P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2904b089bdb249b78950db76f4a70e9f, 9ba0da223cf24c97bc7d225e25015924; no voters: 
I20260709 12:13:54.358796 23738 raft_consensus.cc:2804] T 5959fc0b70884d699725fb8d560e5de5 P 2904b089bdb249b78950db76f4a70e9f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:13:54.359242 23738 raft_consensus.cc:493] T 5959fc0b70884d699725fb8d560e5de5 P 2904b089bdb249b78950db76f4a70e9f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:54.359608 23738 raft_consensus.cc:3060] T 5959fc0b70884d699725fb8d560e5de5 P 2904b089bdb249b78950db76f4a70e9f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:54.365239 23496 raft_consensus.cc:359] T fec017d49ead425fbd037e7d1d238e5b P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:54.368860 23496 raft_consensus.cc:385] T fec017d49ead425fbd037e7d1d238e5b P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:54.369151 23496 raft_consensus.cc:740] T fec017d49ead425fbd037e7d1d238e5b P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ba0da223cf24c97bc7d225e25015924, State: Initialized, Role: FOLLOWER
W20260709 12:13:54.370837 23340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:46081, user_credentials={real_user=slave}} blocked reactor thread for 46727.1us
I20260709 12:13:54.371007 23668 raft_consensus.cc:2804] T 919076caf9f94cd8b631ea3e60dc3593 P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:54.372673 23668 raft_consensus.cc:697] T 919076caf9f94cd8b631ea3e60dc3593 P 3a9a63ca97694ebdb84bca730762d735 [term 1 LEADER]: Becoming Leader. State: Replica: 3a9a63ca97694ebdb84bca730762d735, State: Running, Role: LEADER
I20260709 12:13:54.373642 23668 consensus_queue.cc:237] T 919076caf9f94cd8b631ea3e60dc3593 P 3a9a63ca97694ebdb84bca730762d735 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:54.376750 23374 raft_consensus.cc:2468] T b3e2bbccfb7f4da8baf42735151ff804 P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2904b089bdb249b78950db76f4a70e9f in term 1.
I20260709 12:13:54.379168 23495 ts_tablet_manager.cc:1434] T b3e2bbccfb7f4da8baf42735151ff804 P 288a46a90f26471584043331107dc0dd: Time spent starting tablet: real 0.078s	user 0.009s	sys 0.001s
I20260709 12:13:54.380394 23495 tablet_bootstrap.cc:492] T 05b49011442c4131a4ac3c55feed5409 P 288a46a90f26471584043331107dc0dd: Bootstrap starting.
I20260709 12:13:54.383585 23267 leader_election.cc:304] T b3e2bbccfb7f4da8baf42735151ff804 P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2904b089bdb249b78950db76f4a70e9f, 3a9a63ca97694ebdb84bca730762d735; no voters: 288a46a90f26471584043331107dc0dd
I20260709 12:13:54.387068 23734 raft_consensus.cc:2804] T b3e2bbccfb7f4da8baf42735151ff804 P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:54.391124 23734 raft_consensus.cc:697] T b3e2bbccfb7f4da8baf42735151ff804 P 2904b089bdb249b78950db76f4a70e9f [term 1 LEADER]: Becoming Leader. State: Replica: 2904b089bdb249b78950db76f4a70e9f, State: Running, Role: LEADER
I20260709 12:13:54.395726 23734 consensus_queue.cc:237] T b3e2bbccfb7f4da8baf42735151ff804 P 2904b089bdb249b78950db76f4a70e9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:54.409552 23497 tablet_bootstrap.cc:654] T 7754f065b43946f0a3aca8a75cb61273 P 3a9a63ca97694ebdb84bca730762d735: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:54.387777 23738 raft_consensus.cc:515] T 5959fc0b70884d699725fb8d560e5de5 P 2904b089bdb249b78950db76f4a70e9f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:54.393882 23496 consensus_queue.cc:260] T fec017d49ead425fbd037e7d1d238e5b P 9ba0da223cf24c97bc7d225e25015924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:54.419202 23498 tablet_bootstrap.cc:654] T 94b9ff7f93dc4114b7c59ecfc0fcc9a7 P 2904b089bdb249b78950db76f4a70e9f: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:54.423349 23495 tablet_bootstrap.cc:654] T 05b49011442c4131a4ac3c55feed5409 P 288a46a90f26471584043331107dc0dd: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:54.424367 23733 raft_consensus.cc:493] T fec017d49ead425fbd037e7d1d238e5b P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:54.424980 23733 raft_consensus.cc:515] T fec017d49ead425fbd037e7d1d238e5b P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:54.427513 23496 ts_tablet_manager.cc:1434] T fec017d49ead425fbd037e7d1d238e5b P 9ba0da223cf24c97bc7d225e25015924: Time spent starting tablet: real 0.089s	user 0.008s	sys 0.001s
I20260709 12:13:54.428925 23227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5959fc0b70884d699725fb8d560e5de5" candidate_uuid: "2904b089bdb249b78950db76f4a70e9f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "288a46a90f26471584043331107dc0dd"
I20260709 12:13:54.430490 23448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5959fc0b70884d699725fb8d560e5de5" candidate_uuid: "2904b089bdb249b78950db76f4a70e9f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ba0da223cf24c97bc7d225e25015924"
I20260709 12:13:54.431244 23448 raft_consensus.cc:3060] T 5959fc0b70884d699725fb8d560e5de5 P 9ba0da223cf24c97bc7d225e25015924 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:54.434305 23374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec017d49ead425fbd037e7d1d238e5b" candidate_uuid: "2904b089bdb249b78950db76f4a70e9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a9a63ca97694ebdb84bca730762d735" is_pre_election: true
I20260709 12:13:54.440626 23450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec017d49ead425fbd037e7d1d238e5b" candidate_uuid: "2904b089bdb249b78950db76f4a70e9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba0da223cf24c97bc7d225e25015924" is_pre_election: true
I20260709 12:13:54.443967 23733 leader_election.cc:290] T fec017d49ead425fbd037e7d1d238e5b P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061), 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081)
I20260709 12:13:54.444018 23450 raft_consensus.cc:2468] T fec017d49ead425fbd037e7d1d238e5b P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2904b089bdb249b78950db76f4a70e9f in term 0.
I20260709 12:13:54.427378 23738 leader_election.cc:290] T 5959fc0b70884d699725fb8d560e5de5 P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 3 election: Requested vote from peers 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081), 288a46a90f26471584043331107dc0dd (127.12.174.129:46159)
I20260709 12:13:54.445547 23266 leader_election.cc:304] T fec017d49ead425fbd037e7d1d238e5b P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2904b089bdb249b78950db76f4a70e9f, 9ba0da223cf24c97bc7d225e25015924; no voters: 
I20260709 12:13:54.445658 23374 raft_consensus.cc:2468] T fec017d49ead425fbd037e7d1d238e5b P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2904b089bdb249b78950db76f4a70e9f in term 0.
I20260709 12:13:54.446534 23738 raft_consensus.cc:2804] T fec017d49ead425fbd037e7d1d238e5b P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:54.446947 23738 raft_consensus.cc:493] T fec017d49ead425fbd037e7d1d238e5b P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:54.447278 23738 raft_consensus.cc:3060] T fec017d49ead425fbd037e7d1d238e5b P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:54.455452 23122 catalog_manager.cc:5697] T 92d63c0c6ef9452797da238708c39275 P 2904b089bdb249b78950db76f4a70e9f reported cstate change: term changed from 0 to 1, leader changed from <none> to 2904b089bdb249b78950db76f4a70e9f (127.12.174.130). New cstate: current_term: 1 leader_uuid: "2904b089bdb249b78950db76f4a70e9f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:54.460659 23738 raft_consensus.cc:515] T fec017d49ead425fbd037e7d1d238e5b P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:54.443248 23496 tablet_bootstrap.cc:492] T 7754f065b43946f0a3aca8a75cb61273 P 9ba0da223cf24c97bc7d225e25015924: Bootstrap starting.
I20260709 12:13:54.471824 23448 raft_consensus.cc:2468] T 5959fc0b70884d699725fb8d560e5de5 P 9ba0da223cf24c97bc7d225e25015924 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2904b089bdb249b78950db76f4a70e9f in term 3.
I20260709 12:13:54.473587 23266 leader_election.cc:304] T 5959fc0b70884d699725fb8d560e5de5 P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2904b089bdb249b78950db76f4a70e9f, 9ba0da223cf24c97bc7d225e25015924; no voters: 288a46a90f26471584043331107dc0dd
I20260709 12:13:54.475168 23734 raft_consensus.cc:2804] T 5959fc0b70884d699725fb8d560e5de5 P 2904b089bdb249b78950db76f4a70e9f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:54.476027 23734 raft_consensus.cc:697] T 5959fc0b70884d699725fb8d560e5de5 P 2904b089bdb249b78950db76f4a70e9f [term 3 LEADER]: Becoming Leader. State: Replica: 2904b089bdb249b78950db76f4a70e9f, State: Running, Role: LEADER
I20260709 12:13:54.477061 23496 tablet_bootstrap.cc:654] T 7754f065b43946f0a3aca8a75cb61273 P 9ba0da223cf24c97bc7d225e25015924: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:54.477005 23734 consensus_queue.cc:237] T 5959fc0b70884d699725fb8d560e5de5 P 2904b089bdb249b78950db76f4a70e9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:54.482304 23374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec017d49ead425fbd037e7d1d238e5b" candidate_uuid: "2904b089bdb249b78950db76f4a70e9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a9a63ca97694ebdb84bca730762d735"
I20260709 12:13:54.483130 23374 raft_consensus.cc:3060] T fec017d49ead425fbd037e7d1d238e5b P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:54.491375 23738 leader_election.cc:290] T fec017d49ead425fbd037e7d1d238e5b P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 1 election: Requested vote from peers 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061), 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081)
I20260709 12:13:54.492080 23450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fec017d49ead425fbd037e7d1d238e5b" candidate_uuid: "2904b089bdb249b78950db76f4a70e9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba0da223cf24c97bc7d225e25015924"
I20260709 12:13:54.497028 23450 raft_consensus.cc:3060] T fec017d49ead425fbd037e7d1d238e5b P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:54.501997 23374 raft_consensus.cc:2468] T fec017d49ead425fbd037e7d1d238e5b P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2904b089bdb249b78950db76f4a70e9f in term 1.
I20260709 12:13:54.503682 23267 leader_election.cc:304] T fec017d49ead425fbd037e7d1d238e5b P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2904b089bdb249b78950db76f4a70e9f, 3a9a63ca97694ebdb84bca730762d735; no voters: 
I20260709 12:13:54.505481 23733 raft_consensus.cc:2804] T fec017d49ead425fbd037e7d1d238e5b P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:54.506031 23733 raft_consensus.cc:697] T fec017d49ead425fbd037e7d1d238e5b P 2904b089bdb249b78950db76f4a70e9f [term 1 LEADER]: Becoming Leader. State: Replica: 2904b089bdb249b78950db76f4a70e9f, State: Running, Role: LEADER
I20260709 12:13:54.506915 23733 consensus_queue.cc:237] T fec017d49ead425fbd037e7d1d238e5b P 2904b089bdb249b78950db76f4a70e9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:54.516089 23450 raft_consensus.cc:2468] T fec017d49ead425fbd037e7d1d238e5b P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2904b089bdb249b78950db76f4a70e9f in term 1.
I20260709 12:13:54.504106 23738 raft_consensus.cc:493] T 05b49011442c4131a4ac3c55feed5409 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:54.521620 23738 raft_consensus.cc:515] T 05b49011442c4131a4ac3c55feed5409 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:54.525159 23224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b49011442c4131a4ac3c55feed5409" candidate_uuid: "2904b089bdb249b78950db76f4a70e9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "288a46a90f26471584043331107dc0dd" is_pre_election: true
W20260709 12:13:54.526964 23268 leader_election.cc:343] T 05b49011442c4131a4ac3c55feed5409 P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:54.523947 23738 leader_election.cc:290] T 05b49011442c4131a4ac3c55feed5409 P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081), 288a46a90f26471584043331107dc0dd (127.12.174.129:46159)
I20260709 12:13:54.531998 23448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b49011442c4131a4ac3c55feed5409" candidate_uuid: "2904b089bdb249b78950db76f4a70e9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba0da223cf24c97bc7d225e25015924" is_pre_election: true
I20260709 12:13:54.532756 23448 raft_consensus.cc:2468] T 05b49011442c4131a4ac3c55feed5409 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2904b089bdb249b78950db76f4a70e9f in term 0.
I20260709 12:13:54.534682 23123 catalog_manager.cc:5697] T 919076caf9f94cd8b631ea3e60dc3593 P 3a9a63ca97694ebdb84bca730762d735 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131). New cstate: current_term: 1 leader_uuid: "3a9a63ca97694ebdb84bca730762d735" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:54.535887 23497 tablet_bootstrap.cc:492] T 7754f065b43946f0a3aca8a75cb61273 P 3a9a63ca97694ebdb84bca730762d735: No bootstrap required, opened a new log
I20260709 12:13:54.536572 23497 ts_tablet_manager.cc:1403] T 7754f065b43946f0a3aca8a75cb61273 P 3a9a63ca97694ebdb84bca730762d735: Time spent bootstrapping tablet: real 0.183s	user 0.029s	sys 0.049s
I20260709 12:13:54.537096 23266 leader_election.cc:304] T 05b49011442c4131a4ac3c55feed5409 P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2904b089bdb249b78950db76f4a70e9f, 9ba0da223cf24c97bc7d225e25015924; no voters: 288a46a90f26471584043331107dc0dd
I20260709 12:13:54.538731 23738 raft_consensus.cc:2804] T 05b49011442c4131a4ac3c55feed5409 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:54.539248 23738 raft_consensus.cc:493] T 05b49011442c4131a4ac3c55feed5409 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:54.539829 23738 raft_consensus.cc:3060] T 05b49011442c4131a4ac3c55feed5409 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:54.539902 23497 raft_consensus.cc:359] T 7754f065b43946f0a3aca8a75cb61273 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:54.540813 23497 raft_consensus.cc:385] T 7754f065b43946f0a3aca8a75cb61273 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:54.541087 23497 raft_consensus.cc:740] T 7754f065b43946f0a3aca8a75cb61273 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a9a63ca97694ebdb84bca730762d735, State: Initialized, Role: FOLLOWER
I20260709 12:13:54.541920 23497 consensus_queue.cc:260] T 7754f065b43946f0a3aca8a75cb61273 P 3a9a63ca97694ebdb84bca730762d735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:54.544296 23497 ts_tablet_manager.cc:1434] T 7754f065b43946f0a3aca8a75cb61273 P 3a9a63ca97694ebdb84bca730762d735: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:13:54.545461 23497 tablet_bootstrap.cc:492] T ec2c01c273894e73b6a2ab39e0132286 P 3a9a63ca97694ebdb84bca730762d735: Bootstrap starting.
I20260709 12:13:54.550312 23495 tablet_bootstrap.cc:492] T 05b49011442c4131a4ac3c55feed5409 P 288a46a90f26471584043331107dc0dd: No bootstrap required, opened a new log
I20260709 12:13:54.552207 23495 ts_tablet_manager.cc:1403] T 05b49011442c4131a4ac3c55feed5409 P 288a46a90f26471584043331107dc0dd: Time spent bootstrapping tablet: real 0.172s	user 0.013s	sys 0.009s
I20260709 12:13:54.556244 23495 raft_consensus.cc:359] T 05b49011442c4131a4ac3c55feed5409 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:54.557668 23497 tablet_bootstrap.cc:654] T ec2c01c273894e73b6a2ab39e0132286 P 3a9a63ca97694ebdb84bca730762d735: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:54.558214 23668 raft_consensus.cc:493] T 7754f065b43946f0a3aca8a75cb61273 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:54.561781 23668 raft_consensus.cc:515] T 7754f065b43946f0a3aca8a75cb61273 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:54.564574 23668 leader_election.cc:290] T 7754f065b43946f0a3aca8a75cb61273 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081), 288a46a90f26471584043331107dc0dd (127.12.174.129:46159)
I20260709 12:13:54.561220 23495 raft_consensus.cc:385] T 05b49011442c4131a4ac3c55feed5409 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:54.566061 23495 raft_consensus.cc:740] T 05b49011442c4131a4ac3c55feed5409 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 288a46a90f26471584043331107dc0dd, State: Initialized, Role: FOLLOWER
I20260709 12:13:54.566457 23450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7754f065b43946f0a3aca8a75cb61273" candidate_uuid: "3a9a63ca97694ebdb84bca730762d735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba0da223cf24c97bc7d225e25015924" is_pre_election: true
I20260709 12:13:54.566962 23495 consensus_queue.cc:260] T 05b49011442c4131a4ac3c55feed5409 P 288a46a90f26471584043331107dc0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:54.579507 23638 raft_consensus.cc:493] T 05b49011442c4131a4ac3c55feed5409 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:54.568241 23340 leader_election.cc:343] T 7754f065b43946f0a3aca8a75cb61273 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:54.580154 23638 raft_consensus.cc:515] T 05b49011442c4131a4ac3c55feed5409 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:54.588403 23638 leader_election.cc:290] T 05b49011442c4131a4ac3c55feed5409 P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081), 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789)
I20260709 12:13:54.572683 23738 raft_consensus.cc:515] T 05b49011442c4131a4ac3c55feed5409 P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:54.592293 23450 raft_consensus.cc:1240] T 5959fc0b70884d699725fb8d560e5de5 P 9ba0da223cf24c97bc7d225e25015924 [term 3 FOLLOWER]: Rejecting Update request from peer 288a46a90f26471584043331107dc0dd for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:54.590173 23302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b49011442c4131a4ac3c55feed5409" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2904b089bdb249b78950db76f4a70e9f" is_pre_election: true
I20260709 12:13:54.582152 23224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7754f065b43946f0a3aca8a75cb61273" candidate_uuid: "3a9a63ca97694ebdb84bca730762d735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "288a46a90f26471584043331107dc0dd" is_pre_election: true
I20260709 12:13:54.599635 23632 consensus_queue.cc:1059] T 5959fc0b70884d699725fb8d560e5de5 P 288a46a90f26471584043331107dc0dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:54.600734 23632 raft_consensus.cc:3055] T 5959fc0b70884d699725fb8d560e5de5 P 288a46a90f26471584043331107dc0dd [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:54.601126 23632 raft_consensus.cc:740] T 5959fc0b70884d699725fb8d560e5de5 P 288a46a90f26471584043331107dc0dd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 288a46a90f26471584043331107dc0dd, State: Running, Role: LEADER
W20260709 12:13:54.601086 23342 leader_election.cc:343] T 7754f065b43946f0a3aca8a75cb61273 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:54.602448 23342 leader_election.cc:304] T 7754f065b43946f0a3aca8a75cb61273 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3a9a63ca97694ebdb84bca730762d735; no voters: 288a46a90f26471584043331107dc0dd, 9ba0da223cf24c97bc7d225e25015924
I20260709 12:13:54.602239 23632 consensus_queue.cc:260] T 5959fc0b70884d699725fb8d560e5de5 P 288a46a90f26471584043331107dc0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:54.604061 23632 raft_consensus.cc:3060] T 5959fc0b70884d699725fb8d560e5de5 P 288a46a90f26471584043331107dc0dd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:54.605305 23450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b49011442c4131a4ac3c55feed5409" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba0da223cf24c97bc7d225e25015924" is_pre_election: true
I20260709 12:13:54.606048 23450 raft_consensus.cc:2468] T 05b49011442c4131a4ac3c55feed5409 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 288a46a90f26471584043331107dc0dd in term 0.
I20260709 12:13:54.605928 23668 raft_consensus.cc:2749] T 7754f065b43946f0a3aca8a75cb61273 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:54.604053 23302 raft_consensus.cc:2393] T 05b49011442c4131a4ac3c55feed5409 P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 288a46a90f26471584043331107dc0dd in current term 1: Already voted for candidate 2904b089bdb249b78950db76f4a70e9f in this term.
I20260709 12:13:54.606966 23496 tablet_bootstrap.cc:492] T 7754f065b43946f0a3aca8a75cb61273 P 9ba0da223cf24c97bc7d225e25015924: No bootstrap required, opened a new log
I20260709 12:13:54.609714 23496 ts_tablet_manager.cc:1403] T 7754f065b43946f0a3aca8a75cb61273 P 9ba0da223cf24c97bc7d225e25015924: Time spent bootstrapping tablet: real 0.167s	user 0.017s	sys 0.024s
I20260709 12:13:54.613286 23498 tablet_bootstrap.cc:492] T 94b9ff7f93dc4114b7c59ecfc0fcc9a7 P 2904b089bdb249b78950db76f4a70e9f: No bootstrap required, opened a new log
I20260709 12:13:54.608352 23191 leader_election.cc:304] T 05b49011442c4131a4ac3c55feed5409 P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 288a46a90f26471584043331107dc0dd, 9ba0da223cf24c97bc7d225e25015924; no voters: 
I20260709 12:13:54.615283 23495 ts_tablet_manager.cc:1434] T 05b49011442c4131a4ac3c55feed5409 P 288a46a90f26471584043331107dc0dd: Time spent starting tablet: real 0.062s	user 0.008s	sys 0.000s
I20260709 12:13:54.615486 23638 raft_consensus.cc:2804] T 05b49011442c4131a4ac3c55feed5409 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:54.617555 23638 raft_consensus.cc:493] T 05b49011442c4131a4ac3c55feed5409 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:54.618610 23638 raft_consensus.cc:3060] T 05b49011442c4131a4ac3c55feed5409 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:54.621563 23224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b49011442c4131a4ac3c55feed5409" candidate_uuid: "2904b089bdb249b78950db76f4a70e9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "288a46a90f26471584043331107dc0dd"
I20260709 12:13:54.616753 23450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b49011442c4131a4ac3c55feed5409" candidate_uuid: "2904b089bdb249b78950db76f4a70e9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba0da223cf24c97bc7d225e25015924"
I20260709 12:13:54.618054 23495 tablet_bootstrap.cc:492] T 919076caf9f94cd8b631ea3e60dc3593 P 288a46a90f26471584043331107dc0dd: Bootstrap starting.
I20260709 12:13:54.622746 23450 raft_consensus.cc:3060] T 05b49011442c4131a4ac3c55feed5409 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:54.616350 23738 leader_election.cc:290] T 05b49011442c4131a4ac3c55feed5409 P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 1 election: Requested vote from peers 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081), 288a46a90f26471584043331107dc0dd (127.12.174.129:46159)
I20260709 12:13:54.622974 23498 ts_tablet_manager.cc:1403] T 94b9ff7f93dc4114b7c59ecfc0fcc9a7 P 2904b089bdb249b78950db76f4a70e9f: Time spent bootstrapping tablet: real 0.301s	user 0.018s	sys 0.003s
I20260709 12:13:54.621563 23497 tablet_bootstrap.cc:492] T ec2c01c273894e73b6a2ab39e0132286 P 3a9a63ca97694ebdb84bca730762d735: No bootstrap required, opened a new log
I20260709 12:13:54.631369 23497 ts_tablet_manager.cc:1403] T ec2c01c273894e73b6a2ab39e0132286 P 3a9a63ca97694ebdb84bca730762d735: Time spent bootstrapping tablet: real 0.086s	user 0.018s	sys 0.023s
I20260709 12:13:54.632620 23450 raft_consensus.cc:2468] T 05b49011442c4131a4ac3c55feed5409 P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2904b089bdb249b78950db76f4a70e9f in term 1.
I20260709 12:13:54.630105 23498 raft_consensus.cc:359] T 94b9ff7f93dc4114b7c59ecfc0fcc9a7 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:54.634183 23498 raft_consensus.cc:385] T 94b9ff7f93dc4114b7c59ecfc0fcc9a7 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:54.634455 23498 raft_consensus.cc:740] T 94b9ff7f93dc4114b7c59ecfc0fcc9a7 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2904b089bdb249b78950db76f4a70e9f, State: Initialized, Role: FOLLOWER
I20260709 12:13:54.634647 23299 raft_consensus.cc:1240] T 5959fc0b70884d699725fb8d560e5de5 P 2904b089bdb249b78950db76f4a70e9f [term 3 LEADER]: Rejecting Update request from peer 288a46a90f26471584043331107dc0dd for earlier term 2. Current term is 3. Ops: []
I20260709 12:13:54.634886 23266 leader_election.cc:304] T 05b49011442c4131a4ac3c55feed5409 P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2904b089bdb249b78950db76f4a70e9f, 9ba0da223cf24c97bc7d225e25015924; no voters: 
I20260709 12:13:54.636082 23498 consensus_queue.cc:260] T 94b9ff7f93dc4114b7c59ecfc0fcc9a7 P 2904b089bdb249b78950db76f4a70e9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:54.638643 23497 raft_consensus.cc:359] T ec2c01c273894e73b6a2ab39e0132286 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:54.639318 23497 raft_consensus.cc:385] T ec2c01c273894e73b6a2ab39e0132286 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:54.639536 23497 raft_consensus.cc:740] T ec2c01c273894e73b6a2ab39e0132286 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a9a63ca97694ebdb84bca730762d735, State: Initialized, Role: FOLLOWER
I20260709 12:13:54.640235 23497 consensus_queue.cc:260] T ec2c01c273894e73b6a2ab39e0132286 P 3a9a63ca97694ebdb84bca730762d735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:54.640878 23738 raft_consensus.cc:2804] T 05b49011442c4131a4ac3c55feed5409 P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:54.641439 23738 raft_consensus.cc:697] T 05b49011442c4131a4ac3c55feed5409 P 2904b089bdb249b78950db76f4a70e9f [term 1 LEADER]: Becoming Leader. State: Replica: 2904b089bdb249b78950db76f4a70e9f, State: Running, Role: LEADER
I20260709 12:13:54.642539 23497 ts_tablet_manager.cc:1434] T ec2c01c273894e73b6a2ab39e0132286 P 3a9a63ca97694ebdb84bca730762d735: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.001s
I20260709 12:13:54.642370 23738 consensus_queue.cc:237] T 05b49011442c4131a4ac3c55feed5409 P 2904b089bdb249b78950db76f4a70e9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:54.643954 23497 tablet_bootstrap.cc:492] T 94b9ff7f93dc4114b7c59ecfc0fcc9a7 P 3a9a63ca97694ebdb84bca730762d735: Bootstrap starting.
I20260709 12:13:54.649780 23497 tablet_bootstrap.cc:654] T 94b9ff7f93dc4114b7c59ecfc0fcc9a7 P 3a9a63ca97694ebdb84bca730762d735: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:54.653008 23638 raft_consensus.cc:515] T 05b49011442c4131a4ac3c55feed5409 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:54.652544 23123 catalog_manager.cc:5697] T b3e2bbccfb7f4da8baf42735151ff804 P 2904b089bdb249b78950db76f4a70e9f reported cstate change: term changed from 0 to 1, leader changed from <none> to 2904b089bdb249b78950db76f4a70e9f (127.12.174.130). New cstate: current_term: 1 leader_uuid: "2904b089bdb249b78950db76f4a70e9f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:54.664161 23224 raft_consensus.cc:2393] T 05b49011442c4131a4ac3c55feed5409 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2904b089bdb249b78950db76f4a70e9f in current term 1: Already voted for candidate 288a46a90f26471584043331107dc0dd in this term.
I20260709 12:13:54.657627 23498 ts_tablet_manager.cc:1434] T 94b9ff7f93dc4114b7c59ecfc0fcc9a7 P 2904b089bdb249b78950db76f4a70e9f: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.001s
I20260709 12:13:54.666504 23498 tablet_bootstrap.cc:492] T ec2c01c273894e73b6a2ab39e0132286 P 2904b089bdb249b78950db76f4a70e9f: Bootstrap starting.
I20260709 12:13:54.674817 23498 tablet_bootstrap.cc:654] T ec2c01c273894e73b6a2ab39e0132286 P 2904b089bdb249b78950db76f4a70e9f: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:54.675729 23738 consensus_queue.cc:1048] T 92d63c0c6ef9452797da238708c39275 P 2904b089bdb249b78950db76f4a70e9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:54.677911 23638 leader_election.cc:290] T 05b49011442c4131a4ac3c55feed5409 P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 1 election: Requested vote from peers 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081), 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789)
I20260709 12:13:54.679407 23496 raft_consensus.cc:359] T 7754f065b43946f0a3aca8a75cb61273 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:54.686328 23496 raft_consensus.cc:385] T 7754f065b43946f0a3aca8a75cb61273 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:54.686690 23496 raft_consensus.cc:740] T 7754f065b43946f0a3aca8a75cb61273 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ba0da223cf24c97bc7d225e25015924, State: Initialized, Role: FOLLOWER
I20260709 12:13:54.687666 23496 consensus_queue.cc:260] T 7754f065b43946f0a3aca8a75cb61273 P 9ba0da223cf24c97bc7d225e25015924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:54.680015 23450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b49011442c4131a4ac3c55feed5409" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba0da223cf24c97bc7d225e25015924"
I20260709 12:13:54.689085 23450 raft_consensus.cc:2393] T 05b49011442c4131a4ac3c55feed5409 P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 288a46a90f26471584043331107dc0dd in current term 1: Already voted for candidate 2904b089bdb249b78950db76f4a70e9f in this term.
I20260709 12:13:54.688099 23123 catalog_manager.cc:5697] T fec017d49ead425fbd037e7d1d238e5b P 2904b089bdb249b78950db76f4a70e9f reported cstate change: term changed from 0 to 1, leader changed from <none> to 2904b089bdb249b78950db76f4a70e9f (127.12.174.130). New cstate: current_term: 1 leader_uuid: "2904b089bdb249b78950db76f4a70e9f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:54.682916 23299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b49011442c4131a4ac3c55feed5409" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2904b089bdb249b78950db76f4a70e9f"
I20260709 12:13:54.693349 23192 leader_election.cc:304] T 05b49011442c4131a4ac3c55feed5409 P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 288a46a90f26471584043331107dc0dd; no voters: 2904b089bdb249b78950db76f4a70e9f, 9ba0da223cf24c97bc7d225e25015924
I20260709 12:13:54.684787 23497 tablet_bootstrap.cc:492] T 94b9ff7f93dc4114b7c59ecfc0fcc9a7 P 3a9a63ca97694ebdb84bca730762d735: No bootstrap required, opened a new log
I20260709 12:13:54.695065 23496 ts_tablet_manager.cc:1434] T 7754f065b43946f0a3aca8a75cb61273 P 9ba0da223cf24c97bc7d225e25015924: Time spent starting tablet: real 0.085s	user 0.004s	sys 0.003s
I20260709 12:13:54.695169 23497 ts_tablet_manager.cc:1403] T 94b9ff7f93dc4114b7c59ecfc0fcc9a7 P 3a9a63ca97694ebdb84bca730762d735: Time spent bootstrapping tablet: real 0.051s	user 0.012s	sys 0.014s
I20260709 12:13:54.696384 23496 tablet_bootstrap.cc:492] T 9f2438f73a8e4760b7b37c5330853b72 P 9ba0da223cf24c97bc7d225e25015924: Bootstrap starting.
I20260709 12:13:54.696990 23632 raft_consensus.cc:2749] T 05b49011442c4131a4ac3c55feed5409 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:13:54.690323 23123 catalog_manager.cc:5697] T 5959fc0b70884d699725fb8d560e5de5 P 2904b089bdb249b78950db76f4a70e9f reported cstate change: term changed from 2 to 3, leader changed from 288a46a90f26471584043331107dc0dd (127.12.174.129) to 2904b089bdb249b78950db76f4a70e9f (127.12.174.130). New cstate: current_term: 3 leader_uuid: "2904b089bdb249b78950db76f4a70e9f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:54.701370 23497 raft_consensus.cc:359] T 94b9ff7f93dc4114b7c59ecfc0fcc9a7 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:54.702615 23497 raft_consensus.cc:385] T 94b9ff7f93dc4114b7c59ecfc0fcc9a7 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:54.702903 23497 raft_consensus.cc:740] T 94b9ff7f93dc4114b7c59ecfc0fcc9a7 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a9a63ca97694ebdb84bca730762d735, State: Initialized, Role: FOLLOWER
I20260709 12:13:54.703625 23497 consensus_queue.cc:260] T 94b9ff7f93dc4114b7c59ecfc0fcc9a7 P 3a9a63ca97694ebdb84bca730762d735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:54.684684 23495 tablet_bootstrap.cc:654] T 919076caf9f94cd8b631ea3e60dc3593 P 288a46a90f26471584043331107dc0dd: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:54.706215 23497 ts_tablet_manager.cc:1434] T 94b9ff7f93dc4114b7c59ecfc0fcc9a7 P 3a9a63ca97694ebdb84bca730762d735: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.002s
I20260709 12:13:54.707311 23497 tablet_bootstrap.cc:492] T ac88d753a9f84b22adbe65cbc15d5109 P 3a9a63ca97694ebdb84bca730762d735: Bootstrap starting.
I20260709 12:13:54.705523 23734 consensus_queue.cc:1048] T 92d63c0c6ef9452797da238708c39275 P 2904b089bdb249b78950db76f4a70e9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:54.717542 23496 tablet_bootstrap.cc:654] T 9f2438f73a8e4760b7b37c5330853b72 P 9ba0da223cf24c97bc7d225e25015924: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:54.730265 23122 catalog_manager.cc:5697] T 05b49011442c4131a4ac3c55feed5409 P 2904b089bdb249b78950db76f4a70e9f reported cstate change: term changed from 0 to 1, leader changed from <none> to 2904b089bdb249b78950db76f4a70e9f (127.12.174.130). New cstate: current_term: 1 leader_uuid: "2904b089bdb249b78950db76f4a70e9f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:54.736370 23497 tablet_bootstrap.cc:654] T ac88d753a9f84b22adbe65cbc15d5109 P 3a9a63ca97694ebdb84bca730762d735: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:54.740692 23495 tablet_bootstrap.cc:492] T 919076caf9f94cd8b631ea3e60dc3593 P 288a46a90f26471584043331107dc0dd: No bootstrap required, opened a new log
I20260709 12:13:54.741269 23495 ts_tablet_manager.cc:1403] T 919076caf9f94cd8b631ea3e60dc3593 P 288a46a90f26471584043331107dc0dd: Time spent bootstrapping tablet: real 0.124s	user 0.009s	sys 0.002s
I20260709 12:13:54.754043 23495 raft_consensus.cc:359] T 919076caf9f94cd8b631ea3e60dc3593 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:54.755074 23495 raft_consensus.cc:385] T 919076caf9f94cd8b631ea3e60dc3593 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:54.755363 23495 raft_consensus.cc:740] T 919076caf9f94cd8b631ea3e60dc3593 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 288a46a90f26471584043331107dc0dd, State: Initialized, Role: FOLLOWER
I20260709 12:13:54.756299 23495 consensus_queue.cc:260] T 919076caf9f94cd8b631ea3e60dc3593 P 288a46a90f26471584043331107dc0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:54.760679 23495 ts_tablet_manager.cc:1434] T 919076caf9f94cd8b631ea3e60dc3593 P 288a46a90f26471584043331107dc0dd: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.003s
I20260709 12:13:54.761865 23495 tablet_bootstrap.cc:492] T 9f2438f73a8e4760b7b37c5330853b72 P 288a46a90f26471584043331107dc0dd: Bootstrap starting.
I20260709 12:13:54.761884 23498 tablet_bootstrap.cc:492] T ec2c01c273894e73b6a2ab39e0132286 P 2904b089bdb249b78950db76f4a70e9f: No bootstrap required, opened a new log
I20260709 12:13:54.774376 23498 ts_tablet_manager.cc:1403] T ec2c01c273894e73b6a2ab39e0132286 P 2904b089bdb249b78950db76f4a70e9f: Time spent bootstrapping tablet: real 0.108s	user 0.014s	sys 0.016s
I20260709 12:13:54.778789 23495 tablet_bootstrap.cc:654] T 9f2438f73a8e4760b7b37c5330853b72 P 288a46a90f26471584043331107dc0dd: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:54.786221 23496 tablet_bootstrap.cc:492] T 9f2438f73a8e4760b7b37c5330853b72 P 9ba0da223cf24c97bc7d225e25015924: No bootstrap required, opened a new log
I20260709 12:13:54.787431 23496 ts_tablet_manager.cc:1403] T 9f2438f73a8e4760b7b37c5330853b72 P 9ba0da223cf24c97bc7d225e25015924: Time spent bootstrapping tablet: real 0.091s	user 0.012s	sys 0.007s
W20260709 12:13:54.788491 23173 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:13:54.777680 23498 raft_consensus.cc:359] T ec2c01c273894e73b6a2ab39e0132286 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:54.790675 23498 raft_consensus.cc:385] T ec2c01c273894e73b6a2ab39e0132286 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:54.790917 23498 raft_consensus.cc:740] T ec2c01c273894e73b6a2ab39e0132286 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2904b089bdb249b78950db76f4a70e9f, State: Initialized, Role: FOLLOWER
I20260709 12:13:54.791611 23498 consensus_queue.cc:260] T ec2c01c273894e73b6a2ab39e0132286 P 2904b089bdb249b78950db76f4a70e9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:54.795145 23495 tablet_bootstrap.cc:492] T 9f2438f73a8e4760b7b37c5330853b72 P 288a46a90f26471584043331107dc0dd: No bootstrap required, opened a new log
I20260709 12:13:54.795778 23495 ts_tablet_manager.cc:1403] T 9f2438f73a8e4760b7b37c5330853b72 P 288a46a90f26471584043331107dc0dd: Time spent bootstrapping tablet: real 0.034s	user 0.013s	sys 0.005s
I20260709 12:13:54.799431 23498 ts_tablet_manager.cc:1434] T ec2c01c273894e73b6a2ab39e0132286 P 2904b089bdb249b78950db76f4a70e9f: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.001s
I20260709 12:13:54.799803 23495 raft_consensus.cc:359] T 9f2438f73a8e4760b7b37c5330853b72 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:54.800647 23495 raft_consensus.cc:385] T 9f2438f73a8e4760b7b37c5330853b72 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:54.800973 23495 raft_consensus.cc:740] T 9f2438f73a8e4760b7b37c5330853b72 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 288a46a90f26471584043331107dc0dd, State: Initialized, Role: FOLLOWER
I20260709 12:13:54.802278 23498 tablet_bootstrap.cc:492] T d85273afe57c4f35bb72827d1c5879eb P 2904b089bdb249b78950db76f4a70e9f: Bootstrap starting.
I20260709 12:13:54.802724 23497 tablet_bootstrap.cc:492] T ac88d753a9f84b22adbe65cbc15d5109 P 3a9a63ca97694ebdb84bca730762d735: No bootstrap required, opened a new log
I20260709 12:13:54.803299 23497 ts_tablet_manager.cc:1403] T ac88d753a9f84b22adbe65cbc15d5109 P 3a9a63ca97694ebdb84bca730762d735: Time spent bootstrapping tablet: real 0.096s	user 0.019s	sys 0.008s
I20260709 12:13:54.801905 23495 consensus_queue.cc:260] T 9f2438f73a8e4760b7b37c5330853b72 P 288a46a90f26471584043331107dc0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:54.806424 23497 raft_consensus.cc:359] T ac88d753a9f84b22adbe65cbc15d5109 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:54.807340 23496 raft_consensus.cc:359] T 9f2438f73a8e4760b7b37c5330853b72 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:54.808277 23668 raft_consensus.cc:493] T d85273afe57c4f35bb72827d1c5879eb P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:54.808892 23668 raft_consensus.cc:515] T d85273afe57c4f35bb72827d1c5879eb P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:54.810559 23498 tablet_bootstrap.cc:654] T d85273afe57c4f35bb72827d1c5879eb P 2904b089bdb249b78950db76f4a70e9f: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:54.808594 23495 ts_tablet_manager.cc:1434] T 9f2438f73a8e4760b7b37c5330853b72 P 288a46a90f26471584043331107dc0dd: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.001s
I20260709 12:13:54.811966 23495 tablet_bootstrap.cc:492] T 7754f065b43946f0a3aca8a75cb61273 P 288a46a90f26471584043331107dc0dd: Bootstrap starting.
I20260709 12:13:54.814210 23299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d85273afe57c4f35bb72827d1c5879eb" candidate_uuid: "3a9a63ca97694ebdb84bca730762d735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2904b089bdb249b78950db76f4a70e9f" is_pre_election: true
I20260709 12:13:54.815672 23664 raft_consensus.cc:493] T ec2c01c273894e73b6a2ab39e0132286 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:54.816239 23664 raft_consensus.cc:515] T ec2c01c273894e73b6a2ab39e0132286 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:54.818513 23664 leader_election.cc:290] T ec2c01c273894e73b6a2ab39e0132286 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 288a46a90f26471584043331107dc0dd (127.12.174.129:46159), 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789)
I20260709 12:13:54.821385 23224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d85273afe57c4f35bb72827d1c5879eb" candidate_uuid: "3a9a63ca97694ebdb84bca730762d735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "288a46a90f26471584043331107dc0dd" is_pre_election: true
I20260709 12:13:54.821697 23227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2c01c273894e73b6a2ab39e0132286" candidate_uuid: "3a9a63ca97694ebdb84bca730762d735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "288a46a90f26471584043331107dc0dd" is_pre_election: true
W20260709 12:13:54.823673 23342 leader_election.cc:343] T d85273afe57c4f35bb72827d1c5879eb P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:54.824344 23299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2c01c273894e73b6a2ab39e0132286" candidate_uuid: "3a9a63ca97694ebdb84bca730762d735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2904b089bdb249b78950db76f4a70e9f" is_pre_election: true
I20260709 12:13:54.825280 23299 raft_consensus.cc:2468] T ec2c01c273894e73b6a2ab39e0132286 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a9a63ca97694ebdb84bca730762d735 in term 0.
W20260709 12:13:54.825546 23341 leader_election.cc:343] T d85273afe57c4f35bb72827d1c5879eb P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:13:54.824543 23342 leader_election.cc:343] T ec2c01c273894e73b6a2ab39e0132286 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:54.827167 23668 leader_election.cc:290] T d85273afe57c4f35bb72827d1c5879eb P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 288a46a90f26471584043331107dc0dd (127.12.174.129:46159), 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789)
I20260709 12:13:54.827821 23496 raft_consensus.cc:385] T 9f2438f73a8e4760b7b37c5330853b72 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:54.825328 23632 raft_consensus.cc:493] T b3e2bbccfb7f4da8baf42735151ff804 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:54.829761 23632 raft_consensus.cc:515] T b3e2bbccfb7f4da8baf42735151ff804 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:54.832351 23632 leader_election.cc:290] T b3e2bbccfb7f4da8baf42735151ff804 P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789), 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061)
I20260709 12:13:54.833555 23299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e2bbccfb7f4da8baf42735151ff804" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2904b089bdb249b78950db76f4a70e9f" is_pre_election: true
I20260709 12:13:54.834343 23375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e2bbccfb7f4da8baf42735151ff804" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a9a63ca97694ebdb84bca730762d735" is_pre_election: true
I20260709 12:13:54.835121 23495 tablet_bootstrap.cc:654] T 7754f065b43946f0a3aca8a75cb61273 P 288a46a90f26471584043331107dc0dd: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:54.835263 23375 raft_consensus.cc:2393] T b3e2bbccfb7f4da8baf42735151ff804 P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 288a46a90f26471584043331107dc0dd in current term 1: Already voted for candidate 2904b089bdb249b78950db76f4a70e9f in this term.
I20260709 12:13:54.836870 23192 leader_election.cc:304] T b3e2bbccfb7f4da8baf42735151ff804 P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 288a46a90f26471584043331107dc0dd; no voters: 2904b089bdb249b78950db76f4a70e9f, 3a9a63ca97694ebdb84bca730762d735
I20260709 12:13:54.839200 23632 raft_consensus.cc:3060] T b3e2bbccfb7f4da8baf42735151ff804 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:54.839857 23341 leader_election.cc:304] T d85273afe57c4f35bb72827d1c5879eb P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3a9a63ca97694ebdb84bca730762d735; no voters: 288a46a90f26471584043331107dc0dd, 2904b089bdb249b78950db76f4a70e9f
I20260709 12:13:54.841485 23341 leader_election.cc:304] T ec2c01c273894e73b6a2ab39e0132286 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2904b089bdb249b78950db76f4a70e9f, 3a9a63ca97694ebdb84bca730762d735; no voters: 288a46a90f26471584043331107dc0dd
I20260709 12:13:54.842142 23663 raft_consensus.cc:2749] T d85273afe57c4f35bb72827d1c5879eb P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:54.843043 23663 raft_consensus.cc:2804] T ec2c01c273894e73b6a2ab39e0132286 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:54.843448 23663 raft_consensus.cc:493] T ec2c01c273894e73b6a2ab39e0132286 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:54.843806 23663 raft_consensus.cc:3060] T ec2c01c273894e73b6a2ab39e0132286 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:54.848523 23496 raft_consensus.cc:740] T 9f2438f73a8e4760b7b37c5330853b72 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ba0da223cf24c97bc7d225e25015924, State: Initialized, Role: FOLLOWER
I20260709 12:13:54.850353 23495 tablet_bootstrap.cc:492] T 7754f065b43946f0a3aca8a75cb61273 P 288a46a90f26471584043331107dc0dd: No bootstrap required, opened a new log
I20260709 12:13:54.851025 23495 ts_tablet_manager.cc:1403] T 7754f065b43946f0a3aca8a75cb61273 P 288a46a90f26471584043331107dc0dd: Time spent bootstrapping tablet: real 0.039s	user 0.018s	sys 0.000s
I20260709 12:13:54.854296 23495 raft_consensus.cc:359] T 7754f065b43946f0a3aca8a75cb61273 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:54.855141 23495 raft_consensus.cc:385] T 7754f065b43946f0a3aca8a75cb61273 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:54.855430 23495 raft_consensus.cc:740] T 7754f065b43946f0a3aca8a75cb61273 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 288a46a90f26471584043331107dc0dd, State: Initialized, Role: FOLLOWER
I20260709 12:13:54.856302 23495 consensus_queue.cc:260] T 7754f065b43946f0a3aca8a75cb61273 P 288a46a90f26471584043331107dc0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:54.858948 23495 ts_tablet_manager.cc:1434] T 7754f065b43946f0a3aca8a75cb61273 P 288a46a90f26471584043331107dc0dd: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:13:54.854162 23496 consensus_queue.cc:260] T 9f2438f73a8e4760b7b37c5330853b72 P 9ba0da223cf24c97bc7d225e25015924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:54.862450 23495 tablet_bootstrap.cc:492] T 9a21be1df2964860b89acefd66f6fbde P 288a46a90f26471584043331107dc0dd: Bootstrap starting.
I20260709 12:13:54.865232 23496 ts_tablet_manager.cc:1434] T 9f2438f73a8e4760b7b37c5330853b72 P 9ba0da223cf24c97bc7d225e25015924: Time spent starting tablet: real 0.077s	user 0.007s	sys 0.000s
I20260709 12:13:54.807314 23497 raft_consensus.cc:385] T ac88d753a9f84b22adbe65cbc15d5109 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:54.866127 23497 raft_consensus.cc:740] T ac88d753a9f84b22adbe65cbc15d5109 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a9a63ca97694ebdb84bca730762d735, State: Initialized, Role: FOLLOWER
I20260709 12:13:54.867017 23497 consensus_queue.cc:260] T ac88d753a9f84b22adbe65cbc15d5109 P 3a9a63ca97694ebdb84bca730762d735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:54.868615 23496 tablet_bootstrap.cc:492] T 94b9ff7f93dc4114b7c59ecfc0fcc9a7 P 9ba0da223cf24c97bc7d225e25015924: Bootstrap starting.
I20260709 12:13:54.870891 23497 ts_tablet_manager.cc:1434] T ac88d753a9f84b22adbe65cbc15d5109 P 3a9a63ca97694ebdb84bca730762d735: Time spent starting tablet: real 0.067s	user 0.007s	sys 0.000s
I20260709 12:13:54.872058 23497 tablet_bootstrap.cc:492] T 96f1bc9b220f49d5845c08249cb6a44f P 3a9a63ca97694ebdb84bca730762d735: Bootstrap starting.
I20260709 12:13:54.876045 23495 tablet_bootstrap.cc:654] T 9a21be1df2964860b89acefd66f6fbde P 288a46a90f26471584043331107dc0dd: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:54.878794 23497 tablet_bootstrap.cc:654] T 96f1bc9b220f49d5845c08249cb6a44f P 3a9a63ca97694ebdb84bca730762d735: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:54.884660 23498 tablet_bootstrap.cc:492] T d85273afe57c4f35bb72827d1c5879eb P 2904b089bdb249b78950db76f4a70e9f: No bootstrap required, opened a new log
I20260709 12:13:54.884836 23497 tablet_bootstrap.cc:492] T 96f1bc9b220f49d5845c08249cb6a44f P 3a9a63ca97694ebdb84bca730762d735: No bootstrap required, opened a new log
I20260709 12:13:54.885428 23498 ts_tablet_manager.cc:1403] T d85273afe57c4f35bb72827d1c5879eb P 2904b089bdb249b78950db76f4a70e9f: Time spent bootstrapping tablet: real 0.084s	user 0.023s	sys 0.019s
I20260709 12:13:54.885453 23497 ts_tablet_manager.cc:1403] T 96f1bc9b220f49d5845c08249cb6a44f P 3a9a63ca97694ebdb84bca730762d735: Time spent bootstrapping tablet: real 0.014s	user 0.012s	sys 0.000s
I20260709 12:13:54.890058 23497 raft_consensus.cc:359] T 96f1bc9b220f49d5845c08249cb6a44f P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:54.890897 23497 raft_consensus.cc:385] T 96f1bc9b220f49d5845c08249cb6a44f P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:54.891171 23497 raft_consensus.cc:740] T 96f1bc9b220f49d5845c08249cb6a44f P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a9a63ca97694ebdb84bca730762d735, State: Initialized, Role: FOLLOWER
I20260709 12:13:54.892086 23497 consensus_queue.cc:260] T 96f1bc9b220f49d5845c08249cb6a44f P 3a9a63ca97694ebdb84bca730762d735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:54.894560 23638 raft_consensus.cc:493] T 7754f065b43946f0a3aca8a75cb61273 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:54.894755 23497 ts_tablet_manager.cc:1434] T 96f1bc9b220f49d5845c08249cb6a44f P 3a9a63ca97694ebdb84bca730762d735: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:13:54.896248 23497 tablet_bootstrap.cc:492] T 27166b782a5049198cccb3e5905acbc7 P 3a9a63ca97694ebdb84bca730762d735: Bootstrap starting.
I20260709 12:13:54.889667 23498 raft_consensus.cc:359] T d85273afe57c4f35bb72827d1c5879eb P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:54.901989 23498 raft_consensus.cc:385] T d85273afe57c4f35bb72827d1c5879eb P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:54.901964 23638 raft_consensus.cc:515] T 7754f065b43946f0a3aca8a75cb61273 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:54.902624 23497 tablet_bootstrap.cc:654] T 27166b782a5049198cccb3e5905acbc7 P 3a9a63ca97694ebdb84bca730762d735: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:54.902639 23498 raft_consensus.cc:740] T d85273afe57c4f35bb72827d1c5879eb P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2904b089bdb249b78950db76f4a70e9f, State: Initialized, Role: FOLLOWER
I20260709 12:13:54.906443 23498 consensus_queue.cc:260] T d85273afe57c4f35bb72827d1c5879eb P 2904b089bdb249b78950db76f4a70e9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:54.908819 23375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7754f065b43946f0a3aca8a75cb61273" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a9a63ca97694ebdb84bca730762d735" is_pre_election: true
I20260709 12:13:54.909901 23375 raft_consensus.cc:2468] T 7754f065b43946f0a3aca8a75cb61273 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 288a46a90f26471584043331107dc0dd in term 0.
I20260709 12:13:54.911631 23192 leader_election.cc:304] T 7754f065b43946f0a3aca8a75cb61273 P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 288a46a90f26471584043331107dc0dd, 3a9a63ca97694ebdb84bca730762d735; no voters: 
I20260709 12:13:54.913964 23516 raft_consensus.cc:2804] T 7754f065b43946f0a3aca8a75cb61273 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:54.914471 23516 raft_consensus.cc:493] T 7754f065b43946f0a3aca8a75cb61273 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:54.914824 23516 raft_consensus.cc:3060] T 7754f065b43946f0a3aca8a75cb61273 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:54.918154 23733 consensus_queue.cc:1048] T fec017d49ead425fbd037e7d1d238e5b P 2904b089bdb249b78950db76f4a70e9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:54.922963 23638 leader_election.cc:290] T 7754f065b43946f0a3aca8a75cb61273 P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061), 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081)
I20260709 12:13:54.924167 23450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7754f065b43946f0a3aca8a75cb61273" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba0da223cf24c97bc7d225e25015924" is_pre_election: true
I20260709 12:13:54.924889 23450 raft_consensus.cc:2468] T 7754f065b43946f0a3aca8a75cb61273 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 288a46a90f26471584043331107dc0dd in term 0.
I20260709 12:13:54.931404 23516 raft_consensus.cc:515] T 7754f065b43946f0a3aca8a75cb61273 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:54.935485 23376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7754f065b43946f0a3aca8a75cb61273" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a9a63ca97694ebdb84bca730762d735"
I20260709 12:13:54.936264 23376 raft_consensus.cc:3060] T 7754f065b43946f0a3aca8a75cb61273 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:54.948936 23738 consensus_queue.cc:1048] T fec017d49ead425fbd037e7d1d238e5b P 2904b089bdb249b78950db76f4a70e9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:54.953497 23224 raft_consensus.cc:3060] T 919076caf9f94cd8b631ea3e60dc3593 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:54.971721 23663 raft_consensus.cc:515] T ec2c01c273894e73b6a2ab39e0132286 P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:54.977602 23583 consensus_queue.cc:1048] T b3e2bbccfb7f4da8baf42735151ff804 P 2904b089bdb249b78950db76f4a70e9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:54.995208 23498 ts_tablet_manager.cc:1434] T d85273afe57c4f35bb72827d1c5879eb P 2904b089bdb249b78950db76f4a70e9f: Time spent starting tablet: real 0.109s	user 0.007s	sys 0.000s
I20260709 12:13:54.995837 23664 consensus_queue.cc:1048] T 919076caf9f94cd8b631ea3e60dc3593 P 3a9a63ca97694ebdb84bca730762d735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:55.036372 23498 tablet_bootstrap.cc:492] T 9a21be1df2964860b89acefd66f6fbde P 2904b089bdb249b78950db76f4a70e9f: Bootstrap starting.
I20260709 12:13:55.018646 23737 raft_consensus.cc:493] T 9f2438f73a8e4760b7b37c5330853b72 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:55.018971 23226 raft_consensus.cc:1275] T 5959fc0b70884d699725fb8d560e5de5 P 288a46a90f26471584043331107dc0dd [term 3 FOLLOWER]: Refusing update from remote peer 2904b089bdb249b78950db76f4a70e9f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:13:55.008939 23738 raft_consensus.cc:493] T 94b9ff7f93dc4114b7c59ecfc0fcc9a7 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:55.039455 23738 raft_consensus.cc:515] T 94b9ff7f93dc4114b7c59ecfc0fcc9a7 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:55.042586 23664 raft_consensus.cc:493] T ac88d753a9f84b22adbe65cbc15d5109 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:55.043210 23664 raft_consensus.cc:515] T ac88d753a9f84b22adbe65cbc15d5109 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:55.044498 23638 raft_consensus.cc:493] T 919076caf9f94cd8b631ea3e60dc3593 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:55.045045 23638 raft_consensus.cc:515] T 919076caf9f94cd8b631ea3e60dc3593 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:55.046485 23664 leader_election.cc:290] T ac88d753a9f84b22adbe65cbc15d5109 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789), 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081)
I20260709 12:13:55.047497 23302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac88d753a9f84b22adbe65cbc15d5109" candidate_uuid: "3a9a63ca97694ebdb84bca730762d735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2904b089bdb249b78950db76f4a70e9f" is_pre_election: true
W20260709 12:13:55.049263 23341 leader_election.cc:343] T ac88d753a9f84b22adbe65cbc15d5109 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:55.050148 23446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac88d753a9f84b22adbe65cbc15d5109" candidate_uuid: "3a9a63ca97694ebdb84bca730762d735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba0da223cf24c97bc7d225e25015924" is_pre_election: true
I20260709 12:13:55.050247 23374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b9ff7f93dc4114b7c59ecfc0fcc9a7" candidate_uuid: "2904b089bdb249b78950db76f4a70e9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a9a63ca97694ebdb84bca730762d735" is_pre_election: true
I20260709 12:13:55.051198 23374 raft_consensus.cc:2468] T 94b9ff7f93dc4114b7c59ecfc0fcc9a7 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2904b089bdb249b78950db76f4a70e9f in term 0.
I20260709 12:13:55.038908 23226 pending_rounds.cc:85] T 5959fc0b70884d699725fb8d560e5de5 P 288a46a90f26471584043331107dc0dd: Aborting all ops after (but not including) 1
I20260709 12:13:55.038380 23737 raft_consensus.cc:515] T 9f2438f73a8e4760b7b37c5330853b72 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:55.052142 23226 pending_rounds.cc:107] T 5959fc0b70884d699725fb8d560e5de5 P 288a46a90f26471584043331107dc0dd: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:13:55.051914 23446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "919076caf9f94cd8b631ea3e60dc3593" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba0da223cf24c97bc7d225e25015924" is_pre_election: true
I20260709 12:13:55.052624 23226 raft_consensus.cc:2889] T 5959fc0b70884d699725fb8d560e5de5 P 288a46a90f26471584043331107dc0dd [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:13:55.040503 23495 tablet_bootstrap.cc:492] T 9a21be1df2964860b89acefd66f6fbde P 288a46a90f26471584043331107dc0dd: No bootstrap required, opened a new log
I20260709 12:13:55.054085 23495 ts_tablet_manager.cc:1403] T 9a21be1df2964860b89acefd66f6fbde P 288a46a90f26471584043331107dc0dd: Time spent bootstrapping tablet: real 0.192s	user 0.058s	sys 0.094s
I20260709 12:13:55.054414 23737 leader_election.cc:290] T 9f2438f73a8e4760b7b37c5330853b72 P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081), 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789)
I20260709 12:13:55.055454 23446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f2438f73a8e4760b7b37c5330853b72" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba0da223cf24c97bc7d225e25015924" is_pre_election: true
I20260709 12:13:55.055975 23733 consensus_queue.cc:1048] T 05b49011442c4131a4ac3c55feed5409 P 2904b089bdb249b78950db76f4a70e9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:55.056200 23446 raft_consensus.cc:2468] T 9f2438f73a8e4760b7b37c5330853b72 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 288a46a90f26471584043331107dc0dd in term 0.
I20260709 12:13:55.057404 23495 raft_consensus.cc:359] T 9a21be1df2964860b89acefd66f6fbde P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:55.058259 23495 raft_consensus.cc:385] T 9a21be1df2964860b89acefd66f6fbde P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:55.058444 23191 leader_election.cc:304] T 9f2438f73a8e4760b7b37c5330853b72 P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 288a46a90f26471584043331107dc0dd, 9ba0da223cf24c97bc7d225e25015924; no voters: 
I20260709 12:13:55.050367 23638 leader_election.cc:290] T 919076caf9f94cd8b631ea3e60dc3593 P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061), 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081)
I20260709 12:13:55.060135 23638 raft_consensus.cc:2804] T 9f2438f73a8e4760b7b37c5330853b72 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:55.060316 23446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b9ff7f93dc4114b7c59ecfc0fcc9a7" candidate_uuid: "2904b089bdb249b78950db76f4a70e9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba0da223cf24c97bc7d225e25015924" is_pre_election: true
I20260709 12:13:55.057521 23733 consensus_queue.cc:1048] T 5959fc0b70884d699725fb8d560e5de5 P 2904b089bdb249b78950db76f4a70e9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 12:13:55.060482 23738 leader_election.cc:290] T 94b9ff7f93dc4114b7c59ecfc0fcc9a7 P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061), 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081)
W20260709 12:13:55.062076 23266 leader_election.cc:343] T 94b9ff7f93dc4114b7c59ecfc0fcc9a7 P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:55.067298 23495 raft_consensus.cc:740] T 9a21be1df2964860b89acefd66f6fbde P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 288a46a90f26471584043331107dc0dd, State: Initialized, Role: FOLLOWER
I20260709 12:13:55.071107 23446 raft_consensus.cc:1275] T 5959fc0b70884d699725fb8d560e5de5 P 9ba0da223cf24c97bc7d225e25015924 [term 3 FOLLOWER]: Refusing update from remote peer 2904b089bdb249b78950db76f4a70e9f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:13:55.073642 23738 consensus_queue.cc:1048] T 5959fc0b70884d699725fb8d560e5de5 P 2904b089bdb249b78950db76f4a70e9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:13:55.060585 23638 raft_consensus.cc:493] T 9f2438f73a8e4760b7b37c5330853b72 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:55.069089 23495 consensus_queue.cc:260] T 9a21be1df2964860b89acefd66f6fbde P 288a46a90f26471584043331107dc0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:55.077188 23632 raft_consensus.cc:2749] T b3e2bbccfb7f4da8baf42735151ff804 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:55.082618 23299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f2438f73a8e4760b7b37c5330853b72" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2904b089bdb249b78950db76f4a70e9f" is_pre_election: true
W20260709 12:13:55.086704 23340 leader_election.cc:343] T ac88d753a9f84b22adbe65cbc15d5109 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:55.102710 23340 leader_election.cc:304] T ac88d753a9f84b22adbe65cbc15d5109 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3a9a63ca97694ebdb84bca730762d735; no voters: 2904b089bdb249b78950db76f4a70e9f, 9ba0da223cf24c97bc7d225e25015924
I20260709 12:13:55.087044 23267 leader_election.cc:304] T 94b9ff7f93dc4114b7c59ecfc0fcc9a7 P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2904b089bdb249b78950db76f4a70e9f, 3a9a63ca97694ebdb84bca730762d735; no voters: 9ba0da223cf24c97bc7d225e25015924
I20260709 12:13:55.097355 23495 ts_tablet_manager.cc:1434] T 9a21be1df2964860b89acefd66f6fbde P 288a46a90f26471584043331107dc0dd: Time spent starting tablet: real 0.043s	user 0.006s	sys 0.000s
W20260709 12:13:55.106071 23192 leader_election.cc:343] T 9f2438f73a8e4760b7b37c5330853b72 P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:55.107553 23495 tablet_bootstrap.cc:492] T ec2c01c273894e73b6a2ab39e0132286 P 288a46a90f26471584043331107dc0dd: Bootstrap starting.
I20260709 12:13:55.109700 23376 raft_consensus.cc:2468] T 7754f065b43946f0a3aca8a75cb61273 P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 288a46a90f26471584043331107dc0dd in term 1.
I20260709 12:13:55.111907 23192 leader_election.cc:304] T 7754f065b43946f0a3aca8a75cb61273 P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 288a46a90f26471584043331107dc0dd, 3a9a63ca97694ebdb84bca730762d735; no voters: 
I20260709 12:13:55.114002 23542 raft_consensus.cc:2804] T 7754f065b43946f0a3aca8a75cb61273 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:55.114576 23542 raft_consensus.cc:697] T 7754f065b43946f0a3aca8a75cb61273 P 288a46a90f26471584043331107dc0dd [term 1 LEADER]: Becoming Leader. State: Replica: 288a46a90f26471584043331107dc0dd, State: Running, Role: LEADER
I20260709 12:13:55.115648 23542 consensus_queue.cc:237] T 7754f065b43946f0a3aca8a75cb61273 P 288a46a90f26471584043331107dc0dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:55.118268 23498 tablet_bootstrap.cc:654] T 9a21be1df2964860b89acefd66f6fbde P 2904b089bdb249b78950db76f4a70e9f: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:55.133119 23495 tablet_bootstrap.cc:654] T ec2c01c273894e73b6a2ab39e0132286 P 288a46a90f26471584043331107dc0dd: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:55.138777 23668 raft_consensus.cc:2749] T ac88d753a9f84b22adbe65cbc15d5109 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:55.139111 23498 tablet_bootstrap.cc:492] T 9a21be1df2964860b89acefd66f6fbde P 2904b089bdb249b78950db76f4a70e9f: No bootstrap required, opened a new log
I20260709 12:13:55.142416 23734 raft_consensus.cc:2804] T 94b9ff7f93dc4114b7c59ecfc0fcc9a7 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:55.161612 23734 raft_consensus.cc:493] T 94b9ff7f93dc4114b7c59ecfc0fcc9a7 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:55.161716 23498 ts_tablet_manager.cc:1403] T 9a21be1df2964860b89acefd66f6fbde P 2904b089bdb249b78950db76f4a70e9f: Time spent bootstrapping tablet: real 0.126s	user 0.012s	sys 0.001s
I20260709 12:13:55.162147 23734 raft_consensus.cc:3060] T 94b9ff7f93dc4114b7c59ecfc0fcc9a7 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:55.143332 23663 leader_election.cc:290] T ec2c01c273894e73b6a2ab39e0132286 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 election: Requested vote from peers 288a46a90f26471584043331107dc0dd (127.12.174.129:46159), 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789)
I20260709 12:13:55.149621 23299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2c01c273894e73b6a2ab39e0132286" candidate_uuid: "3a9a63ca97694ebdb84bca730762d735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2904b089bdb249b78950db76f4a70e9f"
W20260709 12:13:55.150082 23268 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:46159, user_credentials={real_user=slave}} blocked reactor thread for 44680.9us
I20260709 12:13:55.150185 23801 consensus_queue.cc:1048] T b3e2bbccfb7f4da8baf42735151ff804 P 2904b089bdb249b78950db76f4a70e9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:55.151024 23733 consensus_queue.cc:1048] T 05b49011442c4131a4ac3c55feed5409 P 2904b089bdb249b78950db76f4a70e9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:13:55.151886 23340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:46081, user_credentials={real_user=slave}} blocked reactor thread for 65231.7us
I20260709 12:13:55.083514 23638 raft_consensus.cc:3060] T 9f2438f73a8e4760b7b37c5330853b72 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:55.083922 23374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "919076caf9f94cd8b631ea3e60dc3593" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a9a63ca97694ebdb84bca730762d735" is_pre_election: true
W20260709 12:13:55.098295 23415 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:40061, user_credentials={real_user=slave}} blocked reactor thread for 117500us
I20260709 12:13:55.154127 23664 consensus_queue.cc:1048] T 919076caf9f94cd8b631ea3e60dc3593 P 3a9a63ca97694ebdb84bca730762d735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:55.158135 23516 leader_election.cc:290] T 7754f065b43946f0a3aca8a75cb61273 P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 1 election: Requested vote from peers 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061), 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081)
W20260709 12:13:55.158823 23342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:46159, user_credentials={real_user=slave}} blocked reactor thread for 45059.7us
I20260709 12:13:55.158893 23450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7754f065b43946f0a3aca8a75cb61273" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba0da223cf24c97bc7d225e25015924"
I20260709 12:13:55.137517 23496 tablet_bootstrap.cc:654] T 94b9ff7f93dc4114b7c59ecfc0fcc9a7 P 9ba0da223cf24c97bc7d225e25015924: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:55.165223 23498 raft_consensus.cc:359] T 9a21be1df2964860b89acefd66f6fbde P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:55.174278 23299 raft_consensus.cc:3060] T ec2c01c273894e73b6a2ab39e0132286 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:55.176570 23734 raft_consensus.cc:515] T 94b9ff7f93dc4114b7c59ecfc0fcc9a7 P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:55.185878 23450 raft_consensus.cc:3060] T 7754f065b43946f0a3aca8a75cb61273 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:55.187150 23498 raft_consensus.cc:385] T 9a21be1df2964860b89acefd66f6fbde P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:55.191699 23498 raft_consensus.cc:740] T 9a21be1df2964860b89acefd66f6fbde P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2904b089bdb249b78950db76f4a70e9f, State: Initialized, Role: FOLLOWER
I20260709 12:13:55.196791 23125 catalog_manager.cc:5697] T 7754f065b43946f0a3aca8a75cb61273 P 288a46a90f26471584043331107dc0dd reported cstate change: term changed from 0 to 1, leader changed from <none> to 288a46a90f26471584043331107dc0dd (127.12.174.129). New cstate: current_term: 1 leader_uuid: "288a46a90f26471584043331107dc0dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:55.198401 23498 consensus_queue.cc:260] T 9a21be1df2964860b89acefd66f6fbde P 2904b089bdb249b78950db76f4a70e9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:55.201123 23498 ts_tablet_manager.cc:1434] T 9a21be1df2964860b89acefd66f6fbde P 2904b089bdb249b78950db76f4a70e9f: Time spent starting tablet: real 0.039s	user 0.006s	sys 0.000s
I20260709 12:13:55.193689 23734 leader_election.cc:290] T 94b9ff7f93dc4114b7c59ecfc0fcc9a7 P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 1 election: Requested vote from peers 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061), 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081)
I20260709 12:13:55.202287 23498 tablet_bootstrap.cc:492] T 9f2438f73a8e4760b7b37c5330853b72 P 2904b089bdb249b78950db76f4a70e9f: Bootstrap starting.
I20260709 12:13:55.207015 23227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2c01c273894e73b6a2ab39e0132286" candidate_uuid: "3a9a63ca97694ebdb84bca730762d735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "288a46a90f26471584043331107dc0dd"
W20260709 12:13:55.208966 23342 leader_election.cc:343] T ec2c01c273894e73b6a2ab39e0132286 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:55.213187 23374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b9ff7f93dc4114b7c59ecfc0fcc9a7" candidate_uuid: "2904b089bdb249b78950db76f4a70e9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a9a63ca97694ebdb84bca730762d735"
I20260709 12:13:55.213913 23374 raft_consensus.cc:3060] T 94b9ff7f93dc4114b7c59ecfc0fcc9a7 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:55.215059 23495 tablet_bootstrap.cc:492] T ec2c01c273894e73b6a2ab39e0132286 P 288a46a90f26471584043331107dc0dd: No bootstrap required, opened a new log
I20260709 12:13:55.215739 23495 ts_tablet_manager.cc:1403] T ec2c01c273894e73b6a2ab39e0132286 P 288a46a90f26471584043331107dc0dd: Time spent bootstrapping tablet: real 0.108s	user 0.010s	sys 0.007s
I20260709 12:13:55.219439 23447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b9ff7f93dc4114b7c59ecfc0fcc9a7" candidate_uuid: "2904b089bdb249b78950db76f4a70e9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba0da223cf24c97bc7d225e25015924"
W20260709 12:13:55.225406 23266 leader_election.cc:343] T 94b9ff7f93dc4114b7c59ecfc0fcc9a7 P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:55.230530 23450 raft_consensus.cc:2468] T 7754f065b43946f0a3aca8a75cb61273 P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 288a46a90f26471584043331107dc0dd in term 1.
I20260709 12:13:55.248173 23497 tablet_bootstrap.cc:492] T 27166b782a5049198cccb3e5905acbc7 P 3a9a63ca97694ebdb84bca730762d735: No bootstrap required, opened a new log
I20260709 12:13:55.248849 23497 ts_tablet_manager.cc:1403] T 27166b782a5049198cccb3e5905acbc7 P 3a9a63ca97694ebdb84bca730762d735: Time spent bootstrapping tablet: real 0.353s	user 0.019s	sys 0.119s
I20260709 12:13:55.254266 23374 raft_consensus.cc:2468] T 94b9ff7f93dc4114b7c59ecfc0fcc9a7 P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2904b089bdb249b78950db76f4a70e9f in term 1.
I20260709 12:13:55.264724 23495 raft_consensus.cc:359] T ec2c01c273894e73b6a2ab39e0132286 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:55.266588 23495 raft_consensus.cc:385] T ec2c01c273894e73b6a2ab39e0132286 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:55.266975 23495 raft_consensus.cc:740] T ec2c01c273894e73b6a2ab39e0132286 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 288a46a90f26471584043331107dc0dd, State: Initialized, Role: FOLLOWER
I20260709 12:13:55.268987 23495 consensus_queue.cc:260] T ec2c01c273894e73b6a2ab39e0132286 P 288a46a90f26471584043331107dc0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:55.271631 23495 ts_tablet_manager.cc:1434] T ec2c01c273894e73b6a2ab39e0132286 P 288a46a90f26471584043331107dc0dd: Time spent starting tablet: real 0.056s	user 0.007s	sys 0.001s
I20260709 12:13:55.272879 23495 tablet_bootstrap.cc:492] T d85273afe57c4f35bb72827d1c5879eb P 288a46a90f26471584043331107dc0dd: Bootstrap starting.
I20260709 12:13:55.270797 23497 raft_consensus.cc:359] T 27166b782a5049198cccb3e5905acbc7 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:55.273792 23497 raft_consensus.cc:385] T 27166b782a5049198cccb3e5905acbc7 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:55.275151 23668 raft_consensus.cc:493] T 96f1bc9b220f49d5845c08249cb6a44f P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:55.275848 23668 raft_consensus.cc:515] T 96f1bc9b220f49d5845c08249cb6a44f P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:55.278218 23668 leader_election.cc:290] T 96f1bc9b220f49d5845c08249cb6a44f P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081), 288a46a90f26471584043331107dc0dd (127.12.174.129:46159)
I20260709 12:13:55.268162 23498 tablet_bootstrap.cc:654] T 9f2438f73a8e4760b7b37c5330853b72 P 2904b089bdb249b78950db76f4a70e9f: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:55.280568 23495 tablet_bootstrap.cc:654] T d85273afe57c4f35bb72827d1c5879eb P 288a46a90f26471584043331107dc0dd: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:55.281008 23497 raft_consensus.cc:740] T 27166b782a5049198cccb3e5905acbc7 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a9a63ca97694ebdb84bca730762d735, State: Initialized, Role: FOLLOWER
I20260709 12:13:55.288698 23447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96f1bc9b220f49d5845c08249cb6a44f" candidate_uuid: "3a9a63ca97694ebdb84bca730762d735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba0da223cf24c97bc7d225e25015924" is_pre_election: true
I20260709 12:13:55.286018 23497 consensus_queue.cc:260] T 27166b782a5049198cccb3e5905acbc7 P 3a9a63ca97694ebdb84bca730762d735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:55.235834 23192 leader_election.cc:304] T 919076caf9f94cd8b631ea3e60dc3593 P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 288a46a90f26471584043331107dc0dd; no voters: 3a9a63ca97694ebdb84bca730762d735, 9ba0da223cf24c97bc7d225e25015924
W20260709 12:13:55.294929 23192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:40061, user_credentials={real_user=slave}} blocked reactor thread for 63435.1us
W20260709 12:13:55.302554 23340 leader_election.cc:343] T 96f1bc9b220f49d5845c08249cb6a44f P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:55.302575 23497 ts_tablet_manager.cc:1434] T 27166b782a5049198cccb3e5905acbc7 P 3a9a63ca97694ebdb84bca730762d735: Time spent starting tablet: real 0.053s	user 0.012s	sys 0.000s
I20260709 12:13:55.304597 23497 tablet_bootstrap.cc:492] T 8bed7e0b2b804500b4898a175fba3ebe P 3a9a63ca97694ebdb84bca730762d735: Bootstrap starting.
I20260709 12:13:55.286003 23267 leader_election.cc:304] T 94b9ff7f93dc4114b7c59ecfc0fcc9a7 P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2904b089bdb249b78950db76f4a70e9f, 3a9a63ca97694ebdb84bca730762d735; no voters: 9ba0da223cf24c97bc7d225e25015924
I20260709 12:13:55.314308 23638 raft_consensus.cc:515] T 9f2438f73a8e4760b7b37c5330853b72 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:55.329282 23733 raft_consensus.cc:2804] T 94b9ff7f93dc4114b7c59ecfc0fcc9a7 P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:55.338034 23734 raft_consensus.cc:493] T d85273afe57c4f35bb72827d1c5879eb P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:55.343930 23796 raft_consensus.cc:2749] T 919076caf9f94cd8b631ea3e60dc3593 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:55.358268 23223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96f1bc9b220f49d5845c08249cb6a44f" candidate_uuid: "3a9a63ca97694ebdb84bca730762d735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "288a46a90f26471584043331107dc0dd" is_pre_election: true
I20260709 12:13:55.359813 23734 raft_consensus.cc:515] T d85273afe57c4f35bb72827d1c5879eb P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:55.362356 23734 leader_election.cc:290] T d85273afe57c4f35bb72827d1c5879eb P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 288a46a90f26471584043331107dc0dd (127.12.174.129:46159), 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061)
W20260709 12:13:55.374823 23342 leader_election.cc:343] T 96f1bc9b220f49d5845c08249cb6a44f P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:55.376175 23226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d85273afe57c4f35bb72827d1c5879eb" candidate_uuid: "2904b089bdb249b78950db76f4a70e9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "288a46a90f26471584043331107dc0dd" is_pre_election: true
I20260709 12:13:55.380800 23733 raft_consensus.cc:697] T 94b9ff7f93dc4114b7c59ecfc0fcc9a7 P 2904b089bdb249b78950db76f4a70e9f [term 1 LEADER]: Becoming Leader. State: Replica: 2904b089bdb249b78950db76f4a70e9f, State: Running, Role: LEADER
I20260709 12:13:55.402163 23495 tablet_bootstrap.cc:492] T d85273afe57c4f35bb72827d1c5879eb P 288a46a90f26471584043331107dc0dd: No bootstrap required, opened a new log
I20260709 12:13:55.402709 23495 ts_tablet_manager.cc:1403] T d85273afe57c4f35bb72827d1c5879eb P 288a46a90f26471584043331107dc0dd: Time spent bootstrapping tablet: real 0.130s	user 0.011s	sys 0.014s
I20260709 12:13:55.406116 23375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d85273afe57c4f35bb72827d1c5879eb" candidate_uuid: "2904b089bdb249b78950db76f4a70e9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a9a63ca97694ebdb84bca730762d735" is_pre_election: true
I20260709 12:13:55.406855 23375 raft_consensus.cc:2468] T d85273afe57c4f35bb72827d1c5879eb P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2904b089bdb249b78950db76f4a70e9f in term 0.
I20260709 12:13:55.395747 23796 raft_consensus.cc:493] T 9a21be1df2964860b89acefd66f6fbde P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:55.389668 23342 leader_election.cc:304] T 96f1bc9b220f49d5845c08249cb6a44f P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3a9a63ca97694ebdb84bca730762d735; no voters: 288a46a90f26471584043331107dc0dd, 9ba0da223cf24c97bc7d225e25015924
I20260709 12:13:55.413290 23497 tablet_bootstrap.cc:654] T 8bed7e0b2b804500b4898a175fba3ebe P 3a9a63ca97694ebdb84bca730762d735: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:55.417501 23300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f2438f73a8e4760b7b37c5330853b72" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2904b089bdb249b78950db76f4a70e9f"
W20260709 12:13:55.419364 23192 leader_election.cc:343] T 9f2438f73a8e4760b7b37c5330853b72 P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:55.423422 23498 tablet_bootstrap.cc:492] T 9f2438f73a8e4760b7b37c5330853b72 P 2904b089bdb249b78950db76f4a70e9f: No bootstrap required, opened a new log
I20260709 12:13:55.424119 23663 raft_consensus.cc:2749] T 96f1bc9b220f49d5845c08249cb6a44f P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:13:55.424256 23268 leader_election.cc:343] T d85273afe57c4f35bb72827d1c5879eb P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:55.422209 23638 leader_election.cc:290] T 9f2438f73a8e4760b7b37c5330853b72 P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 1 election: Requested vote from peers 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081), 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789)
I20260709 12:13:55.408169 23299 raft_consensus.cc:2468] T ec2c01c273894e73b6a2ab39e0132286 P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a9a63ca97694ebdb84bca730762d735 in term 1.
W20260709 12:13:55.423300 23803 log.cc:927] Time spent T 05b49011442c4131a4ac3c55feed5409 P 9ba0da223cf24c97bc7d225e25015924: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
W20260709 12:13:55.425530 23342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:46159, user_credentials={real_user=slave}} blocked reactor thread for 52624.7us
I20260709 12:13:55.411013 23796 raft_consensus.cc:515] T 9a21be1df2964860b89acefd66f6fbde P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:55.424288 23496 tablet_bootstrap.cc:492] T 94b9ff7f93dc4114b7c59ecfc0fcc9a7 P 9ba0da223cf24c97bc7d225e25015924: No bootstrap required, opened a new log
I20260709 12:13:55.427929 23498 ts_tablet_manager.cc:1403] T 9f2438f73a8e4760b7b37c5330853b72 P 2904b089bdb249b78950db76f4a70e9f: Time spent bootstrapping tablet: real 0.226s	user 0.011s	sys 0.013s
I20260709 12:13:55.433691 23495 raft_consensus.cc:359] T d85273afe57c4f35bb72827d1c5879eb P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:55.435963 23496 ts_tablet_manager.cc:1403] T 94b9ff7f93dc4114b7c59ecfc0fcc9a7 P 9ba0da223cf24c97bc7d225e25015924: Time spent bootstrapping tablet: real 0.568s	user 0.019s	sys 0.001s
I20260709 12:13:55.435932 23495 raft_consensus.cc:385] T d85273afe57c4f35bb72827d1c5879eb P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:55.436738 23495 raft_consensus.cc:740] T d85273afe57c4f35bb72827d1c5879eb P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 288a46a90f26471584043331107dc0dd, State: Initialized, Role: FOLLOWER
I20260709 12:13:55.438448 23495 consensus_queue.cc:260] T d85273afe57c4f35bb72827d1c5879eb P 288a46a90f26471584043331107dc0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:55.443624 23498 raft_consensus.cc:359] T 9f2438f73a8e4760b7b37c5330853b72 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:55.444545 23498 raft_consensus.cc:385] T 9f2438f73a8e4760b7b37c5330853b72 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:55.444880 23498 raft_consensus.cc:740] T 9f2438f73a8e4760b7b37c5330853b72 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2904b089bdb249b78950db76f4a70e9f, State: Initialized, Role: FOLLOWER
I20260709 12:13:55.437801 23448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f2438f73a8e4760b7b37c5330853b72" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba0da223cf24c97bc7d225e25015924"
I20260709 12:13:55.447531 23498 consensus_queue.cc:260] T 9f2438f73a8e4760b7b37c5330853b72 P 2904b089bdb249b78950db76f4a70e9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:55.452531 23448 raft_consensus.cc:3060] T 9f2438f73a8e4760b7b37c5330853b72 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:55.462731 23495 ts_tablet_manager.cc:1434] T d85273afe57c4f35bb72827d1c5879eb P 288a46a90f26471584043331107dc0dd: Time spent starting tablet: real 0.060s	user 0.006s	sys 0.002s
I20260709 12:13:55.468070 23495 tablet_bootstrap.cc:492] T 96f1bc9b220f49d5845c08249cb6a44f P 288a46a90f26471584043331107dc0dd: Bootstrap starting.
I20260709 12:13:55.467795 23796 leader_election.cc:290] T 9a21be1df2964860b89acefd66f6fbde P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081), 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789)
I20260709 12:13:55.472278 23496 raft_consensus.cc:359] T 94b9ff7f93dc4114b7c59ecfc0fcc9a7 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:55.473090 23496 raft_consensus.cc:385] T 94b9ff7f93dc4114b7c59ecfc0fcc9a7 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:55.473441 23496 raft_consensus.cc:740] T 94b9ff7f93dc4114b7c59ecfc0fcc9a7 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ba0da223cf24c97bc7d225e25015924, State: Initialized, Role: FOLLOWER
I20260709 12:13:55.474033 23446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a21be1df2964860b89acefd66f6fbde" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba0da223cf24c97bc7d225e25015924" is_pre_election: true
I20260709 12:13:55.475560 23267 leader_election.cc:304] T d85273afe57c4f35bb72827d1c5879eb P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2904b089bdb249b78950db76f4a70e9f, 3a9a63ca97694ebdb84bca730762d735; no voters: 288a46a90f26471584043331107dc0dd
W20260709 12:13:55.476787 23191 leader_election.cc:343] T 9a21be1df2964860b89acefd66f6fbde P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:55.472981 23498 ts_tablet_manager.cc:1434] T 9f2438f73a8e4760b7b37c5330853b72 P 2904b089bdb249b78950db76f4a70e9f: Time spent starting tablet: real 0.037s	user 0.005s	sys 0.001s
I20260709 12:13:55.478891 23498 tablet_bootstrap.cc:492] T 27166b782a5049198cccb3e5905acbc7 P 2904b089bdb249b78950db76f4a70e9f: Bootstrap starting.
I20260709 12:13:55.434892 23733 consensus_queue.cc:237] T 94b9ff7f93dc4114b7c59ecfc0fcc9a7 P 2904b089bdb249b78950db76f4a70e9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:55.485018 23496 consensus_queue.cc:260] T 94b9ff7f93dc4114b7c59ecfc0fcc9a7 P 9ba0da223cf24c97bc7d225e25015924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
W20260709 12:13:55.486322 23267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:40061, user_credentials={real_user=slave}} blocked reactor thread for 60106.9us
I20260709 12:13:55.491199 23341 leader_election.cc:304] T ec2c01c273894e73b6a2ab39e0132286 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2904b089bdb249b78950db76f4a70e9f, 3a9a63ca97694ebdb84bca730762d735; no voters: 288a46a90f26471584043331107dc0dd
I20260709 12:13:55.492189 23663 raft_consensus.cc:2804] T ec2c01c273894e73b6a2ab39e0132286 P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:55.492904 23663 raft_consensus.cc:697] T ec2c01c273894e73b6a2ab39e0132286 P 3a9a63ca97694ebdb84bca730762d735 [term 1 LEADER]: Becoming Leader. State: Replica: 3a9a63ca97694ebdb84bca730762d735, State: Running, Role: LEADER
I20260709 12:13:55.494134 23663 consensus_queue.cc:237] T ec2c01c273894e73b6a2ab39e0132286 P 3a9a63ca97694ebdb84bca730762d735 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:55.495304 23497 tablet_bootstrap.cc:492] T 8bed7e0b2b804500b4898a175fba3ebe P 3a9a63ca97694ebdb84bca730762d735: No bootstrap required, opened a new log
I20260709 12:13:55.495963 23497 ts_tablet_manager.cc:1403] T 8bed7e0b2b804500b4898a175fba3ebe P 3a9a63ca97694ebdb84bca730762d735: Time spent bootstrapping tablet: real 0.192s	user 0.016s	sys 0.001s
I20260709 12:13:55.499325 23497 raft_consensus.cc:359] T 8bed7e0b2b804500b4898a175fba3ebe P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:55.500109 23497 raft_consensus.cc:385] T 8bed7e0b2b804500b4898a175fba3ebe P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:55.500416 23497 raft_consensus.cc:740] T 8bed7e0b2b804500b4898a175fba3ebe P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a9a63ca97694ebdb84bca730762d735, State: Initialized, Role: FOLLOWER
I20260709 12:13:55.500272 23498 tablet_bootstrap.cc:654] T 27166b782a5049198cccb3e5905acbc7 P 2904b089bdb249b78950db76f4a70e9f: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:55.500468 23496 ts_tablet_manager.cc:1434] T 94b9ff7f93dc4114b7c59ecfc0fcc9a7 P 9ba0da223cf24c97bc7d225e25015924: Time spent starting tablet: real 0.064s	user 0.005s	sys 0.002s
I20260709 12:13:55.481564 23738 raft_consensus.cc:2804] T d85273afe57c4f35bb72827d1c5879eb P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:55.501909 23738 raft_consensus.cc:493] T d85273afe57c4f35bb72827d1c5879eb P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:55.502286 23738 raft_consensus.cc:3060] T d85273afe57c4f35bb72827d1c5879eb P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:55.506660 23495 tablet_bootstrap.cc:654] T 96f1bc9b220f49d5845c08249cb6a44f P 288a46a90f26471584043331107dc0dd: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:55.509373 23496 tablet_bootstrap.cc:492] T 96f1bc9b220f49d5845c08249cb6a44f P 9ba0da223cf24c97bc7d225e25015924: Bootstrap starting.
I20260709 12:13:55.513417 23497 consensus_queue.cc:260] T 8bed7e0b2b804500b4898a175fba3ebe P 3a9a63ca97694ebdb84bca730762d735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:55.514963 23299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a21be1df2964860b89acefd66f6fbde" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2904b089bdb249b78950db76f4a70e9f" is_pre_election: true
I20260709 12:13:55.524785 23299 raft_consensus.cc:2468] T 9a21be1df2964860b89acefd66f6fbde P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 288a46a90f26471584043331107dc0dd in term 0.
I20260709 12:13:55.520747 23638 raft_consensus.cc:493] T ec2c01c273894e73b6a2ab39e0132286 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:55.526443 23192 leader_election.cc:304] T 9a21be1df2964860b89acefd66f6fbde P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 288a46a90f26471584043331107dc0dd, 2904b089bdb249b78950db76f4a70e9f; no voters: 9ba0da223cf24c97bc7d225e25015924
I20260709 12:13:55.526742 23638 raft_consensus.cc:515] T ec2c01c273894e73b6a2ab39e0132286 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:55.529078 23638 leader_election.cc:290] T ec2c01c273894e73b6a2ab39e0132286 P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789), 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061)
I20260709 12:13:55.531917 23302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2c01c273894e73b6a2ab39e0132286" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2904b089bdb249b78950db76f4a70e9f" is_pre_election: true
I20260709 12:13:55.532944 23302 raft_consensus.cc:2393] T ec2c01c273894e73b6a2ab39e0132286 P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 288a46a90f26471584043331107dc0dd in current term 1: Already voted for candidate 3a9a63ca97694ebdb84bca730762d735 in this term.
I20260709 12:13:55.529163 23737 raft_consensus.cc:2804] T 9a21be1df2964860b89acefd66f6fbde P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:55.534598 23448 raft_consensus.cc:2468] T 9f2438f73a8e4760b7b37c5330853b72 P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 288a46a90f26471584043331107dc0dd in term 1.
I20260709 12:13:55.535283 23737 raft_consensus.cc:493] T 9a21be1df2964860b89acefd66f6fbde P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:55.535778 23737 raft_consensus.cc:3060] T 9a21be1df2964860b89acefd66f6fbde P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:55.540313 23191 leader_election.cc:304] T 9f2438f73a8e4760b7b37c5330853b72 P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 288a46a90f26471584043331107dc0dd, 9ba0da223cf24c97bc7d225e25015924; no voters: 2904b089bdb249b78950db76f4a70e9f
I20260709 12:13:55.541921 23632 raft_consensus.cc:2804] T 9f2438f73a8e4760b7b37c5330853b72 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:55.542551 23632 raft_consensus.cc:697] T 9f2438f73a8e4760b7b37c5330853b72 P 288a46a90f26471584043331107dc0dd [term 1 LEADER]: Becoming Leader. State: Replica: 288a46a90f26471584043331107dc0dd, State: Running, Role: LEADER
I20260709 12:13:55.543658 23632 consensus_queue.cc:237] T 9f2438f73a8e4760b7b37c5330853b72 P 288a46a90f26471584043331107dc0dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:55.553179 23374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec2c01c273894e73b6a2ab39e0132286" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a9a63ca97694ebdb84bca730762d735" is_pre_election: true
I20260709 12:13:55.556928 23124 catalog_manager.cc:5697] T ec2c01c273894e73b6a2ab39e0132286 P 3a9a63ca97694ebdb84bca730762d735 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131). New cstate: current_term: 1 leader_uuid: "3a9a63ca97694ebdb84bca730762d735" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:55.561636 23497 ts_tablet_manager.cc:1434] T 8bed7e0b2b804500b4898a175fba3ebe P 3a9a63ca97694ebdb84bca730762d735: Time spent starting tablet: real 0.065s	user 0.010s	sys 0.000s
I20260709 12:13:55.555224 23192 leader_election.cc:304] T ec2c01c273894e73b6a2ab39e0132286 P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 288a46a90f26471584043331107dc0dd; no voters: 2904b089bdb249b78950db76f4a70e9f, 3a9a63ca97694ebdb84bca730762d735
I20260709 12:13:55.564966 23497 tablet_bootstrap.cc:492] T 6efb52601755488885a8baf030e7fae9 P 3a9a63ca97694ebdb84bca730762d735: Bootstrap starting.
I20260709 12:13:55.571094 23796 raft_consensus.cc:3060] T ec2c01c273894e73b6a2ab39e0132286 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:55.574646 23737 raft_consensus.cc:515] T 9a21be1df2964860b89acefd66f6fbde P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:55.580834 23738 raft_consensus.cc:515] T d85273afe57c4f35bb72827d1c5879eb P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:55.594748 23738 leader_election.cc:290] T d85273afe57c4f35bb72827d1c5879eb P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 1 election: Requested vote from peers 288a46a90f26471584043331107dc0dd (127.12.174.129:46159), 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061)
I20260709 12:13:55.596761 23375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d85273afe57c4f35bb72827d1c5879eb" candidate_uuid: "2904b089bdb249b78950db76f4a70e9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a9a63ca97694ebdb84bca730762d735"
I20260709 12:13:55.597559 23375 raft_consensus.cc:3060] T d85273afe57c4f35bb72827d1c5879eb P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:55.598121 23224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d85273afe57c4f35bb72827d1c5879eb" candidate_uuid: "2904b089bdb249b78950db76f4a70e9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "288a46a90f26471584043331107dc0dd"
I20260709 12:13:55.599072 23224 raft_consensus.cc:3060] T d85273afe57c4f35bb72827d1c5879eb P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:55.601048 23498 tablet_bootstrap.cc:492] T 27166b782a5049198cccb3e5905acbc7 P 2904b089bdb249b78950db76f4a70e9f: No bootstrap required, opened a new log
I20260709 12:13:55.601711 23498 ts_tablet_manager.cc:1403] T 27166b782a5049198cccb3e5905acbc7 P 2904b089bdb249b78950db76f4a70e9f: Time spent bootstrapping tablet: real 0.123s	user 0.021s	sys 0.030s
I20260709 12:13:55.605291 23516 consensus_queue.cc:1048] T 7754f065b43946f0a3aca8a75cb61273 P 288a46a90f26471584043331107dc0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:55.612579 23663 raft_consensus.cc:493] T 27166b782a5049198cccb3e5905acbc7 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:55.613195 23663 raft_consensus.cc:515] T 27166b782a5049198cccb3e5905acbc7 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:55.614740 23125 catalog_manager.cc:5697] T 94b9ff7f93dc4114b7c59ecfc0fcc9a7 P 2904b089bdb249b78950db76f4a70e9f reported cstate change: term changed from 0 to 1, leader changed from <none> to 2904b089bdb249b78950db76f4a70e9f (127.12.174.130). New cstate: current_term: 1 leader_uuid: "2904b089bdb249b78950db76f4a70e9f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:55.616107 23737 leader_election.cc:290] T 9a21be1df2964860b89acefd66f6fbde P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 1 election: Requested vote from peers 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081), 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789)
I20260709 12:13:55.619932 23663 leader_election.cc:290] T 27166b782a5049198cccb3e5905acbc7 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 288a46a90f26471584043331107dc0dd (127.12.174.129:46159), 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789)
I20260709 12:13:55.620158 23448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a21be1df2964860b89acefd66f6fbde" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba0da223cf24c97bc7d225e25015924"
I20260709 12:13:55.621615 23498 raft_consensus.cc:359] T 27166b782a5049198cccb3e5905acbc7 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
W20260709 12:13:55.622107 23191 leader_election.cc:343] T 9a21be1df2964860b89acefd66f6fbde P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:55.622462 23498 raft_consensus.cc:385] T 27166b782a5049198cccb3e5905acbc7 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:55.622829 23498 raft_consensus.cc:740] T 27166b782a5049198cccb3e5905acbc7 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2904b089bdb249b78950db76f4a70e9f, State: Initialized, Role: FOLLOWER
I20260709 12:13:55.623716 23498 consensus_queue.cc:260] T 27166b782a5049198cccb3e5905acbc7 P 2904b089bdb249b78950db76f4a70e9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:55.625622 23302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a21be1df2964860b89acefd66f6fbde" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2904b089bdb249b78950db76f4a70e9f"
I20260709 12:13:55.626108 23498 ts_tablet_manager.cc:1434] T 27166b782a5049198cccb3e5905acbc7 P 2904b089bdb249b78950db76f4a70e9f: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.000s
I20260709 12:13:55.626433 23302 raft_consensus.cc:3060] T 9a21be1df2964860b89acefd66f6fbde P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:55.627518 23498 tablet_bootstrap.cc:492] T ac88d753a9f84b22adbe65cbc15d5109 P 2904b089bdb249b78950db76f4a70e9f: Bootstrap starting.
I20260709 12:13:55.630194 23300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27166b782a5049198cccb3e5905acbc7" candidate_uuid: "3a9a63ca97694ebdb84bca730762d735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2904b089bdb249b78950db76f4a70e9f" is_pre_election: true
I20260709 12:13:55.631146 23300 raft_consensus.cc:2468] T 27166b782a5049198cccb3e5905acbc7 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a9a63ca97694ebdb84bca730762d735 in term 0.
I20260709 12:13:55.631721 23495 tablet_bootstrap.cc:492] T 96f1bc9b220f49d5845c08249cb6a44f P 288a46a90f26471584043331107dc0dd: No bootstrap required, opened a new log
I20260709 12:13:55.632404 23495 ts_tablet_manager.cc:1403] T 96f1bc9b220f49d5845c08249cb6a44f P 288a46a90f26471584043331107dc0dd: Time spent bootstrapping tablet: real 0.165s	user 0.018s	sys 0.023s
I20260709 12:13:55.632755 23341 leader_election.cc:304] T 27166b782a5049198cccb3e5905acbc7 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2904b089bdb249b78950db76f4a70e9f, 3a9a63ca97694ebdb84bca730762d735; no voters: 
I20260709 12:13:55.633029 23227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27166b782a5049198cccb3e5905acbc7" candidate_uuid: "3a9a63ca97694ebdb84bca730762d735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "288a46a90f26471584043331107dc0dd" is_pre_election: true
I20260709 12:13:55.633813 23663 raft_consensus.cc:2804] T 27166b782a5049198cccb3e5905acbc7 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:55.634208 23663 raft_consensus.cc:493] T 27166b782a5049198cccb3e5905acbc7 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:55.634626 23663 raft_consensus.cc:3060] T 27166b782a5049198cccb3e5905acbc7 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:13:55.635808 23342 leader_election.cc:343] T 27166b782a5049198cccb3e5905acbc7 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:55.657603 23496 tablet_bootstrap.cc:654] T 96f1bc9b220f49d5845c08249cb6a44f P 9ba0da223cf24c97bc7d225e25015924: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:55.662633 23497 tablet_bootstrap.cc:654] T 6efb52601755488885a8baf030e7fae9 P 3a9a63ca97694ebdb84bca730762d735: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:55.669057 23495 raft_consensus.cc:359] T 96f1bc9b220f49d5845c08249cb6a44f P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:55.669667 23638 consensus_queue.cc:1048] T 7754f065b43946f0a3aca8a75cb61273 P 288a46a90f26471584043331107dc0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:55.670029 23495 raft_consensus.cc:385] T 96f1bc9b220f49d5845c08249cb6a44f P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:55.670471 23495 raft_consensus.cc:740] T 96f1bc9b220f49d5845c08249cb6a44f P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 288a46a90f26471584043331107dc0dd, State: Initialized, Role: FOLLOWER
I20260709 12:13:55.673465 23224 raft_consensus.cc:2468] T d85273afe57c4f35bb72827d1c5879eb P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2904b089bdb249b78950db76f4a70e9f in term 1.
I20260709 12:13:55.664477 23498 tablet_bootstrap.cc:654] T ac88d753a9f84b22adbe65cbc15d5109 P 2904b089bdb249b78950db76f4a70e9f: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:55.671491 23495 consensus_queue.cc:260] T 96f1bc9b220f49d5845c08249cb6a44f P 288a46a90f26471584043331107dc0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:55.681154 23495 ts_tablet_manager.cc:1434] T 96f1bc9b220f49d5845c08249cb6a44f P 288a46a90f26471584043331107dc0dd: Time spent starting tablet: real 0.048s	user 0.012s	sys 0.000s
I20260709 12:13:55.680486 23124 catalog_manager.cc:5697] T 9f2438f73a8e4760b7b37c5330853b72 P 288a46a90f26471584043331107dc0dd reported cstate change: term changed from 0 to 1, leader changed from <none> to 288a46a90f26471584043331107dc0dd (127.12.174.129). New cstate: current_term: 1 leader_uuid: "288a46a90f26471584043331107dc0dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:55.682420 23268 leader_election.cc:304] T d85273afe57c4f35bb72827d1c5879eb P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 288a46a90f26471584043331107dc0dd, 2904b089bdb249b78950db76f4a70e9f; no voters: 
I20260709 12:13:55.684602 23738 raft_consensus.cc:2804] T d85273afe57c4f35bb72827d1c5879eb P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:55.685125 23738 raft_consensus.cc:697] T d85273afe57c4f35bb72827d1c5879eb P 2904b089bdb249b78950db76f4a70e9f [term 1 LEADER]: Becoming Leader. State: Replica: 2904b089bdb249b78950db76f4a70e9f, State: Running, Role: LEADER
I20260709 12:13:55.685992 23738 consensus_queue.cc:237] T d85273afe57c4f35bb72827d1c5879eb P 2904b089bdb249b78950db76f4a70e9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:55.694026 23796 raft_consensus.cc:2749] T ec2c01c273894e73b6a2ab39e0132286 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:55.699859 23495 tablet_bootstrap.cc:492] T 27166b782a5049198cccb3e5905acbc7 P 288a46a90f26471584043331107dc0dd: Bootstrap starting.
I20260709 12:13:55.688235 23302 raft_consensus.cc:2468] T 9a21be1df2964860b89acefd66f6fbde P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 288a46a90f26471584043331107dc0dd in term 1.
I20260709 12:13:55.707396 23192 leader_election.cc:304] T 9a21be1df2964860b89acefd66f6fbde P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 288a46a90f26471584043331107dc0dd, 2904b089bdb249b78950db76f4a70e9f; no voters: 9ba0da223cf24c97bc7d225e25015924
I20260709 12:13:55.709988 23632 raft_consensus.cc:2804] T 9a21be1df2964860b89acefd66f6fbde P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:55.710534 23632 raft_consensus.cc:697] T 9a21be1df2964860b89acefd66f6fbde P 288a46a90f26471584043331107dc0dd [term 1 LEADER]: Becoming Leader. State: Replica: 288a46a90f26471584043331107dc0dd, State: Running, Role: LEADER
I20260709 12:13:55.711387 23632 consensus_queue.cc:237] T 9a21be1df2964860b89acefd66f6fbde P 288a46a90f26471584043331107dc0dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:55.718629 23495 tablet_bootstrap.cc:654] T 27166b782a5049198cccb3e5905acbc7 P 288a46a90f26471584043331107dc0dd: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:55.720721 23497 tablet_bootstrap.cc:492] T 6efb52601755488885a8baf030e7fae9 P 3a9a63ca97694ebdb84bca730762d735: No bootstrap required, opened a new log
I20260709 12:13:55.721264 23497 ts_tablet_manager.cc:1403] T 6efb52601755488885a8baf030e7fae9 P 3a9a63ca97694ebdb84bca730762d735: Time spent bootstrapping tablet: real 0.157s	user 0.012s	sys 0.011s
I20260709 12:13:55.746289 23663 raft_consensus.cc:515] T 27166b782a5049198cccb3e5905acbc7 P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:55.751624 23498 tablet_bootstrap.cc:492] T ac88d753a9f84b22adbe65cbc15d5109 P 2904b089bdb249b78950db76f4a70e9f: No bootstrap required, opened a new log
I20260709 12:13:55.752279 23498 ts_tablet_manager.cc:1403] T ac88d753a9f84b22adbe65cbc15d5109 P 2904b089bdb249b78950db76f4a70e9f: Time spent bootstrapping tablet: real 0.125s	user 0.013s	sys 0.012s
I20260709 12:13:55.760978 23224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27166b782a5049198cccb3e5905acbc7" candidate_uuid: "3a9a63ca97694ebdb84bca730762d735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "288a46a90f26471584043331107dc0dd"
I20260709 12:13:55.764019 23497 raft_consensus.cc:359] T 6efb52601755488885a8baf030e7fae9 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:55.764940 23497 raft_consensus.cc:385] T 6efb52601755488885a8baf030e7fae9 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:55.765235 23497 raft_consensus.cc:740] T 6efb52601755488885a8baf030e7fae9 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a9a63ca97694ebdb84bca730762d735, State: Initialized, Role: FOLLOWER
I20260709 12:13:55.765537 23498 raft_consensus.cc:359] T ac88d753a9f84b22adbe65cbc15d5109 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
W20260709 12:13:55.767336 23342 leader_election.cc:343] T 27166b782a5049198cccb3e5905acbc7 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:55.766391 23498 raft_consensus.cc:385] T ac88d753a9f84b22adbe65cbc15d5109 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:55.768939 23498 raft_consensus.cc:740] T ac88d753a9f84b22adbe65cbc15d5109 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2904b089bdb249b78950db76f4a70e9f, State: Initialized, Role: FOLLOWER
I20260709 12:13:55.766031 23497 consensus_queue.cc:260] T 6efb52601755488885a8baf030e7fae9 P 3a9a63ca97694ebdb84bca730762d735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:55.768541 23123 catalog_manager.cc:5697] T d85273afe57c4f35bb72827d1c5879eb P 2904b089bdb249b78950db76f4a70e9f reported cstate change: term changed from 0 to 1, leader changed from <none> to 2904b089bdb249b78950db76f4a70e9f (127.12.174.130). New cstate: current_term: 1 leader_uuid: "2904b089bdb249b78950db76f4a70e9f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:55.769572 23498 consensus_queue.cc:260] T ac88d753a9f84b22adbe65cbc15d5109 P 2904b089bdb249b78950db76f4a70e9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:55.774583 23497 ts_tablet_manager.cc:1434] T 6efb52601755488885a8baf030e7fae9 P 3a9a63ca97694ebdb84bca730762d735: Time spent starting tablet: real 0.053s	user 0.008s	sys 0.000s
I20260709 12:13:55.776801 23375 raft_consensus.cc:2468] T d85273afe57c4f35bb72827d1c5879eb P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2904b089bdb249b78950db76f4a70e9f in term 1.
I20260709 12:13:55.785207 23498 ts_tablet_manager.cc:1434] T ac88d753a9f84b22adbe65cbc15d5109 P 2904b089bdb249b78950db76f4a70e9f: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.000s
I20260709 12:13:55.786504 23498 tablet_bootstrap.cc:492] T 45e4fb3889cc4d23bab3929c3fdd731e P 2904b089bdb249b78950db76f4a70e9f: Bootstrap starting.
I20260709 12:13:55.786774 23300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27166b782a5049198cccb3e5905acbc7" candidate_uuid: "3a9a63ca97694ebdb84bca730762d735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2904b089bdb249b78950db76f4a70e9f"
I20260709 12:13:55.788038 23300 raft_consensus.cc:3060] T 27166b782a5049198cccb3e5905acbc7 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:55.790004 23583 raft_consensus.cc:493] T ac88d753a9f84b22adbe65cbc15d5109 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:55.790612 23583 raft_consensus.cc:515] T ac88d753a9f84b22adbe65cbc15d5109 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:55.792510 23583 leader_election.cc:290] T ac88d753a9f84b22adbe65cbc15d5109 P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061), 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081)
I20260709 12:13:55.793848 23446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac88d753a9f84b22adbe65cbc15d5109" candidate_uuid: "2904b089bdb249b78950db76f4a70e9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba0da223cf24c97bc7d225e25015924" is_pre_election: true
W20260709 12:13:55.797792 23266 leader_election.cc:343] T ac88d753a9f84b22adbe65cbc15d5109 P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:55.800113 23498 tablet_bootstrap.cc:654] T 45e4fb3889cc4d23bab3929c3fdd731e P 2904b089bdb249b78950db76f4a70e9f: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:55.781910 23663 leader_election.cc:290] T 27166b782a5049198cccb3e5905acbc7 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 election: Requested vote from peers 288a46a90f26471584043331107dc0dd (127.12.174.129:46159), 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789)
I20260709 12:13:55.811046 23375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac88d753a9f84b22adbe65cbc15d5109" candidate_uuid: "2904b089bdb249b78950db76f4a70e9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a9a63ca97694ebdb84bca730762d735" is_pre_election: true
I20260709 12:13:55.811900 23375 raft_consensus.cc:2468] T ac88d753a9f84b22adbe65cbc15d5109 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2904b089bdb249b78950db76f4a70e9f in term 0.
I20260709 12:13:55.813213 23267 leader_election.cc:304] T ac88d753a9f84b22adbe65cbc15d5109 P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2904b089bdb249b78950db76f4a70e9f, 3a9a63ca97694ebdb84bca730762d735; no voters: 9ba0da223cf24c97bc7d225e25015924
I20260709 12:13:55.814740 23583 raft_consensus.cc:2804] T ac88d753a9f84b22adbe65cbc15d5109 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:55.815212 23583 raft_consensus.cc:493] T ac88d753a9f84b22adbe65cbc15d5109 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:55.815595 23583 raft_consensus.cc:3060] T ac88d753a9f84b22adbe65cbc15d5109 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:55.817581 23300 raft_consensus.cc:2468] T 27166b782a5049198cccb3e5905acbc7 P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a9a63ca97694ebdb84bca730762d735 in term 1.
I20260709 12:13:55.813186 23796 raft_consensus.cc:493] T 96f1bc9b220f49d5845c08249cb6a44f P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:55.823040 23796 raft_consensus.cc:515] T 96f1bc9b220f49d5845c08249cb6a44f P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:55.823518 23341 leader_election.cc:304] T 27166b782a5049198cccb3e5905acbc7 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2904b089bdb249b78950db76f4a70e9f, 3a9a63ca97694ebdb84bca730762d735; no voters: 288a46a90f26471584043331107dc0dd
I20260709 12:13:55.825624 23733 raft_consensus.cc:493] T 9f2438f73a8e4760b7b37c5330853b72 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:55.826273 23733 raft_consensus.cc:515] T 9f2438f73a8e4760b7b37c5330853b72 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:55.829463 23733 leader_election.cc:290] T 9f2438f73a8e4760b7b37c5330853b72 P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081), 288a46a90f26471584043331107dc0dd (127.12.174.129:46159)
I20260709 12:13:55.829829 23583 raft_consensus.cc:515] T ac88d753a9f84b22adbe65cbc15d5109 P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:55.825543 23668 raft_consensus.cc:2804] T 27166b782a5049198cccb3e5905acbc7 P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:55.834268 23668 raft_consensus.cc:697] T 27166b782a5049198cccb3e5905acbc7 P 3a9a63ca97694ebdb84bca730762d735 [term 1 LEADER]: Becoming Leader. State: Replica: 3a9a63ca97694ebdb84bca730762d735, State: Running, Role: LEADER
I20260709 12:13:55.835269 23668 consensus_queue.cc:237] T 27166b782a5049198cccb3e5905acbc7 P 3a9a63ca97694ebdb84bca730762d735 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:55.836421 23448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f2438f73a8e4760b7b37c5330853b72" candidate_uuid: "2904b089bdb249b78950db76f4a70e9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba0da223cf24c97bc7d225e25015924" is_pre_election: true
I20260709 12:13:55.837455 23448 raft_consensus.cc:2393] T 9f2438f73a8e4760b7b37c5330853b72 P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2904b089bdb249b78950db76f4a70e9f in current term 1: Already voted for candidate 288a46a90f26471584043331107dc0dd in this term.
I20260709 12:13:55.838176 23583 leader_election.cc:290] T ac88d753a9f84b22adbe65cbc15d5109 P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 1 election: Requested vote from peers 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061), 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081)
I20260709 12:13:55.839527 23123 catalog_manager.cc:5697] T 9a21be1df2964860b89acefd66f6fbde P 288a46a90f26471584043331107dc0dd reported cstate change: term changed from 0 to 1, leader changed from <none> to 288a46a90f26471584043331107dc0dd (127.12.174.129). New cstate: current_term: 1 leader_uuid: "288a46a90f26471584043331107dc0dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:55.843577 23796 leader_election.cc:290] T 96f1bc9b220f49d5845c08249cb6a44f P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061), 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081)
I20260709 12:13:55.844077 23448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac88d753a9f84b22adbe65cbc15d5109" candidate_uuid: "2904b089bdb249b78950db76f4a70e9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba0da223cf24c97bc7d225e25015924"
W20260709 12:13:55.845880 23266 leader_election.cc:343] T ac88d753a9f84b22adbe65cbc15d5109 P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:55.851799 23496 tablet_bootstrap.cc:492] T 96f1bc9b220f49d5845c08249cb6a44f P 9ba0da223cf24c97bc7d225e25015924: No bootstrap required, opened a new log
I20260709 12:13:55.852481 23496 ts_tablet_manager.cc:1403] T 96f1bc9b220f49d5845c08249cb6a44f P 9ba0da223cf24c97bc7d225e25015924: Time spent bootstrapping tablet: real 0.343s	user 0.033s	sys 0.010s
I20260709 12:13:55.853199 23227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f2438f73a8e4760b7b37c5330853b72" candidate_uuid: "2904b089bdb249b78950db76f4a70e9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "288a46a90f26471584043331107dc0dd" is_pre_election: true
I20260709 12:13:55.855600 23268 leader_election.cc:304] T 9f2438f73a8e4760b7b37c5330853b72 P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2904b089bdb249b78950db76f4a70e9f; no voters: 288a46a90f26471584043331107dc0dd, 9ba0da223cf24c97bc7d225e25015924
I20260709 12:13:55.855531 23496 raft_consensus.cc:359] T 96f1bc9b220f49d5845c08249cb6a44f P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:55.858450 23496 raft_consensus.cc:385] T 96f1bc9b220f49d5845c08249cb6a44f P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:55.858841 23496 raft_consensus.cc:740] T 96f1bc9b220f49d5845c08249cb6a44f P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ba0da223cf24c97bc7d225e25015924, State: Initialized, Role: FOLLOWER
I20260709 12:13:55.859656 23496 consensus_queue.cc:260] T 96f1bc9b220f49d5845c08249cb6a44f P 9ba0da223cf24c97bc7d225e25015924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:55.862412 23496 ts_tablet_manager.cc:1434] T 96f1bc9b220f49d5845c08249cb6a44f P 9ba0da223cf24c97bc7d225e25015924: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.001s
I20260709 12:13:55.857980 23733 raft_consensus.cc:3060] T 9f2438f73a8e4760b7b37c5330853b72 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:55.870858 23496 tablet_bootstrap.cc:492] T ac88d753a9f84b22adbe65cbc15d5109 P 9ba0da223cf24c97bc7d225e25015924: Bootstrap starting.
I20260709 12:13:55.874486 23668 raft_consensus.cc:493] T 6efb52601755488885a8baf030e7fae9 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:55.876744 23495 tablet_bootstrap.cc:492] T 27166b782a5049198cccb3e5905acbc7 P 288a46a90f26471584043331107dc0dd: No bootstrap required, opened a new log
I20260709 12:13:55.884371 23663 raft_consensus.cc:493] T 8bed7e0b2b804500b4898a175fba3ebe P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:55.885042 23663 raft_consensus.cc:515] T 8bed7e0b2b804500b4898a175fba3ebe P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:55.887450 23663 leader_election.cc:290] T 8bed7e0b2b804500b4898a175fba3ebe P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081), 288a46a90f26471584043331107dc0dd (127.12.174.129:46159)
I20260709 12:13:55.888056 23495 ts_tablet_manager.cc:1403] T 27166b782a5049198cccb3e5905acbc7 P 288a46a90f26471584043331107dc0dd: Time spent bootstrapping tablet: real 0.199s	user 0.022s	sys 0.006s
I20260709 12:13:55.891260 23224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bed7e0b2b804500b4898a175fba3ebe" candidate_uuid: "3a9a63ca97694ebdb84bca730762d735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "288a46a90f26471584043331107dc0dd" is_pre_election: true
I20260709 12:13:55.893989 23733 raft_consensus.cc:2749] T 9f2438f73a8e4760b7b37c5330853b72 P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:55.875191 23668 raft_consensus.cc:515] T 6efb52601755488885a8baf030e7fae9 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:55.896649 23495 raft_consensus.cc:359] T 27166b782a5049198cccb3e5905acbc7 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:55.903899 23495 raft_consensus.cc:385] T 27166b782a5049198cccb3e5905acbc7 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:55.904332 23495 raft_consensus.cc:740] T 27166b782a5049198cccb3e5905acbc7 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 288a46a90f26471584043331107dc0dd, State: Initialized, Role: FOLLOWER
I20260709 12:13:55.877571 23498 tablet_bootstrap.cc:492] T 45e4fb3889cc4d23bab3929c3fdd731e P 2904b089bdb249b78950db76f4a70e9f: No bootstrap required, opened a new log
I20260709 12:13:55.905864 23498 ts_tablet_manager.cc:1403] T 45e4fb3889cc4d23bab3929c3fdd731e P 2904b089bdb249b78950db76f4a70e9f: Time spent bootstrapping tablet: real 0.120s	user 0.017s	sys 0.006s
I20260709 12:13:55.899991 23496 tablet_bootstrap.cc:654] T ac88d753a9f84b22adbe65cbc15d5109 P 9ba0da223cf24c97bc7d225e25015924: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:55.900373 23376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac88d753a9f84b22adbe65cbc15d5109" candidate_uuid: "2904b089bdb249b78950db76f4a70e9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a9a63ca97694ebdb84bca730762d735"
I20260709 12:13:55.906509 23376 raft_consensus.cc:3060] T ac88d753a9f84b22adbe65cbc15d5109 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:55.907569 23663 consensus_queue.cc:1048] T ec2c01c273894e73b6a2ab39e0132286 P 3a9a63ca97694ebdb84bca730762d735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:55.900496 23374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96f1bc9b220f49d5845c08249cb6a44f" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a9a63ca97694ebdb84bca730762d735" is_pre_election: true
I20260709 12:13:55.905303 23495 consensus_queue.cc:260] T 27166b782a5049198cccb3e5905acbc7 P 288a46a90f26471584043331107dc0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:55.911110 23497 tablet_bootstrap.cc:492] T bed12810020c4496969b723bcdd4b4ec P 3a9a63ca97694ebdb84bca730762d735: Bootstrap starting.
I20260709 12:13:55.920094 23374 raft_consensus.cc:2468] T 96f1bc9b220f49d5845c08249cb6a44f P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 288a46a90f26471584043331107dc0dd in term 0.
I20260709 12:13:55.932163 23495 ts_tablet_manager.cc:1434] T 27166b782a5049198cccb3e5905acbc7 P 288a46a90f26471584043331107dc0dd: Time spent starting tablet: real 0.043s	user 0.005s	sys 0.001s
I20260709 12:13:55.933547 23495 tablet_bootstrap.cc:492] T 45e4fb3889cc4d23bab3929c3fdd731e P 288a46a90f26471584043331107dc0dd: Bootstrap starting.
I20260709 12:13:55.936920 23796 consensus_queue.cc:1048] T 9f2438f73a8e4760b7b37c5330853b72 P 288a46a90f26471584043331107dc0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:55.929250 23376 raft_consensus.cc:2468] T ac88d753a9f84b22adbe65cbc15d5109 P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2904b089bdb249b78950db76f4a70e9f in term 1.
I20260709 12:13:55.939411 23267 leader_election.cc:304] T ac88d753a9f84b22adbe65cbc15d5109 P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2904b089bdb249b78950db76f4a70e9f, 3a9a63ca97694ebdb84bca730762d735; no voters: 9ba0da223cf24c97bc7d225e25015924
I20260709 12:13:55.941076 23733 raft_consensus.cc:2804] T ac88d753a9f84b22adbe65cbc15d5109 P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:55.941696 23733 raft_consensus.cc:697] T ac88d753a9f84b22adbe65cbc15d5109 P 2904b089bdb249b78950db76f4a70e9f [term 1 LEADER]: Becoming Leader. State: Replica: 2904b089bdb249b78950db76f4a70e9f, State: Running, Role: LEADER
I20260709 12:13:55.943231 23733 consensus_queue.cc:237] T ac88d753a9f84b22adbe65cbc15d5109 P 2904b089bdb249b78950db76f4a70e9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:55.923187 23498 raft_consensus.cc:359] T 45e4fb3889cc4d23bab3929c3fdd731e P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:55.924137 23668 leader_election.cc:290] T 6efb52601755488885a8baf030e7fae9 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 288a46a90f26471584043331107dc0dd (127.12.174.129:46159), 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789)
I20260709 12:13:55.927034 23300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6efb52601755488885a8baf030e7fae9" candidate_uuid: "3a9a63ca97694ebdb84bca730762d735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2904b089bdb249b78950db76f4a70e9f" is_pre_election: true
I20260709 12:13:55.951218 23498 raft_consensus.cc:385] T 45e4fb3889cc4d23bab3929c3fdd731e P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:55.951650 23498 raft_consensus.cc:740] T 45e4fb3889cc4d23bab3929c3fdd731e P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2904b089bdb249b78950db76f4a70e9f, State: Initialized, Role: FOLLOWER
W20260709 12:13:55.922701 23342 leader_election.cc:343] T 8bed7e0b2b804500b4898a175fba3ebe P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:55.953787 23495 tablet_bootstrap.cc:654] T 45e4fb3889cc4d23bab3929c3fdd731e P 288a46a90f26471584043331107dc0dd: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:55.954077 23224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6efb52601755488885a8baf030e7fae9" candidate_uuid: "3a9a63ca97694ebdb84bca730762d735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "288a46a90f26471584043331107dc0dd" is_pre_election: true
W20260709 12:13:55.960214 23342 leader_election.cc:343] T 6efb52601755488885a8baf030e7fae9 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:13:55.961027 23341 leader_election.cc:343] T 6efb52601755488885a8baf030e7fae9 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:55.961545 23341 leader_election.cc:304] T 6efb52601755488885a8baf030e7fae9 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3a9a63ca97694ebdb84bca730762d735; no voters: 288a46a90f26471584043331107dc0dd, 2904b089bdb249b78950db76f4a70e9f
I20260709 12:13:55.963551 23800 raft_consensus.cc:2749] T 6efb52601755488885a8baf030e7fae9 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:55.963739 23583 consensus_queue.cc:1048] T 94b9ff7f93dc4114b7c59ecfc0fcc9a7 P 2904b089bdb249b78950db76f4a70e9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:55.954885 23192 leader_election.cc:304] T 96f1bc9b220f49d5845c08249cb6a44f P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 288a46a90f26471584043331107dc0dd, 3a9a63ca97694ebdb84bca730762d735; no voters: 
I20260709 12:13:55.958307 23446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96f1bc9b220f49d5845c08249cb6a44f" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba0da223cf24c97bc7d225e25015924" is_pre_election: true
I20260709 12:13:55.966288 23446 raft_consensus.cc:2468] T 96f1bc9b220f49d5845c08249cb6a44f P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 288a46a90f26471584043331107dc0dd in term 0.
I20260709 12:13:55.966480 23737 raft_consensus.cc:2804] T 96f1bc9b220f49d5845c08249cb6a44f P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:55.967052 23737 raft_consensus.cc:493] T 96f1bc9b220f49d5845c08249cb6a44f P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:55.967411 23737 raft_consensus.cc:3060] T 96f1bc9b220f49d5845c08249cb6a44f P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:55.966547 23791 raft_consensus.cc:493] T 94b9ff7f93dc4114b7c59ecfc0fcc9a7 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:55.970567 23791 raft_consensus.cc:515] T 94b9ff7f93dc4114b7c59ecfc0fcc9a7 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:55.972931 23495 tablet_bootstrap.cc:492] T 45e4fb3889cc4d23bab3929c3fdd731e P 288a46a90f26471584043331107dc0dd: No bootstrap required, opened a new log
I20260709 12:13:55.973551 23495 ts_tablet_manager.cc:1403] T 45e4fb3889cc4d23bab3929c3fdd731e P 288a46a90f26471584043331107dc0dd: Time spent bootstrapping tablet: real 0.040s	user 0.005s	sys 0.009s
I20260709 12:13:55.974694 23791 leader_election.cc:290] T 94b9ff7f93dc4114b7c59ecfc0fcc9a7 P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789), 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061)
I20260709 12:13:55.974256 23300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b9ff7f93dc4114b7c59ecfc0fcc9a7" candidate_uuid: "9ba0da223cf24c97bc7d225e25015924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2904b089bdb249b78950db76f4a70e9f" is_pre_election: true
I20260709 12:13:55.956842 23498 consensus_queue.cc:260] T 45e4fb3889cc4d23bab3929c3fdd731e P 2904b089bdb249b78950db76f4a70e9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:55.978036 23376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b9ff7f93dc4114b7c59ecfc0fcc9a7" candidate_uuid: "9ba0da223cf24c97bc7d225e25015924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a9a63ca97694ebdb84bca730762d735" is_pre_election: true
I20260709 12:13:55.980383 23415 leader_election.cc:304] T 94b9ff7f93dc4114b7c59ecfc0fcc9a7 P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ba0da223cf24c97bc7d225e25015924; no voters: 2904b089bdb249b78950db76f4a70e9f, 3a9a63ca97694ebdb84bca730762d735
I20260709 12:13:55.980686 23800 consensus_queue.cc:1048] T ec2c01c273894e73b6a2ab39e0132286 P 3a9a63ca97694ebdb84bca730762d735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:55.981937 23791 raft_consensus.cc:2749] T 94b9ff7f93dc4114b7c59ecfc0fcc9a7 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:55.987635 23498 ts_tablet_manager.cc:1434] T 45e4fb3889cc4d23bab3929c3fdd731e P 2904b089bdb249b78950db76f4a70e9f: Time spent starting tablet: real 0.081s	user 0.008s	sys 0.000s
I20260709 12:13:55.989748 23497 tablet_bootstrap.cc:654] T bed12810020c4496969b723bcdd4b4ec P 3a9a63ca97694ebdb84bca730762d735: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:55.991798 23498 tablet_bootstrap.cc:492] T 6efb52601755488885a8baf030e7fae9 P 2904b089bdb249b78950db76f4a70e9f: Bootstrap starting.
I20260709 12:13:55.994349 23495 raft_consensus.cc:359] T 45e4fb3889cc4d23bab3929c3fdd731e P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:55.995148 23495 raft_consensus.cc:385] T 45e4fb3889cc4d23bab3929c3fdd731e P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:55.995431 23495 raft_consensus.cc:740] T 45e4fb3889cc4d23bab3929c3fdd731e P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 288a46a90f26471584043331107dc0dd, State: Initialized, Role: FOLLOWER
I20260709 12:13:55.996305 23495 consensus_queue.cc:260] T 45e4fb3889cc4d23bab3929c3fdd731e P 288a46a90f26471584043331107dc0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:56.003106 23495 ts_tablet_manager.cc:1434] T 45e4fb3889cc4d23bab3929c3fdd731e P 288a46a90f26471584043331107dc0dd: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.001s
I20260709 12:13:56.004774 23495 tablet_bootstrap.cc:492] T 8bed7e0b2b804500b4898a175fba3ebe P 288a46a90f26471584043331107dc0dd: Bootstrap starting.
I20260709 12:13:56.012600 23737 raft_consensus.cc:515] T 96f1bc9b220f49d5845c08249cb6a44f P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:56.013196 23125 catalog_manager.cc:5697] T 27166b782a5049198cccb3e5905acbc7 P 3a9a63ca97694ebdb84bca730762d735 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131). New cstate: current_term: 1 leader_uuid: "3a9a63ca97694ebdb84bca730762d735" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:56.068396 23632 consensus_queue.cc:1048] T 9f2438f73a8e4760b7b37c5330853b72 P 288a46a90f26471584043331107dc0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:56.099180 23498 tablet_bootstrap.cc:654] T 6efb52601755488885a8baf030e7fae9 P 2904b089bdb249b78950db76f4a70e9f: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:56.101476 23496 tablet_bootstrap.cc:492] T ac88d753a9f84b22adbe65cbc15d5109 P 9ba0da223cf24c97bc7d225e25015924: No bootstrap required, opened a new log
I20260709 12:13:56.102209 23496 ts_tablet_manager.cc:1403] T ac88d753a9f84b22adbe65cbc15d5109 P 9ba0da223cf24c97bc7d225e25015924: Time spent bootstrapping tablet: real 0.232s	user 0.024s	sys 0.022s
I20260709 12:13:56.109267 23125 catalog_manager.cc:5697] T ac88d753a9f84b22adbe65cbc15d5109 P 2904b089bdb249b78950db76f4a70e9f reported cstate change: term changed from 0 to 1, leader changed from <none> to 2904b089bdb249b78950db76f4a70e9f (127.12.174.130). New cstate: current_term: 1 leader_uuid: "2904b089bdb249b78950db76f4a70e9f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:56.111425 23496 raft_consensus.cc:359] T ac88d753a9f84b22adbe65cbc15d5109 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:56.112408 23496 raft_consensus.cc:385] T ac88d753a9f84b22adbe65cbc15d5109 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:56.112637 23496 raft_consensus.cc:740] T ac88d753a9f84b22adbe65cbc15d5109 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ba0da223cf24c97bc7d225e25015924, State: Initialized, Role: FOLLOWER
I20260709 12:13:56.113293 23496 consensus_queue.cc:260] T ac88d753a9f84b22adbe65cbc15d5109 P 9ba0da223cf24c97bc7d225e25015924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:56.115065 23446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bed7e0b2b804500b4898a175fba3ebe" candidate_uuid: "3a9a63ca97694ebdb84bca730762d735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba0da223cf24c97bc7d225e25015924" is_pre_election: true
I20260709 12:13:56.122359 23448 raft_consensus.cc:3060] T 94b9ff7f93dc4114b7c59ecfc0fcc9a7 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:56.131585 23496 ts_tablet_manager.cc:1434] T ac88d753a9f84b22adbe65cbc15d5109 P 9ba0da223cf24c97bc7d225e25015924: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.001s
I20260709 12:13:56.134734 23496 tablet_bootstrap.cc:492] T 9a21be1df2964860b89acefd66f6fbde P 9ba0da223cf24c97bc7d225e25015924: Bootstrap starting.
I20260709 12:13:56.139138 23497 tablet_bootstrap.cc:492] T bed12810020c4496969b723bcdd4b4ec P 3a9a63ca97694ebdb84bca730762d735: No bootstrap required, opened a new log
I20260709 12:13:56.139853 23497 ts_tablet_manager.cc:1403] T bed12810020c4496969b723bcdd4b4ec P 3a9a63ca97694ebdb84bca730762d735: Time spent bootstrapping tablet: real 0.229s	user 0.010s	sys 0.006s
I20260709 12:13:56.145066 23497 raft_consensus.cc:359] T bed12810020c4496969b723bcdd4b4ec P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:56.145874 23497 raft_consensus.cc:385] T bed12810020c4496969b723bcdd4b4ec P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:56.146171 23497 raft_consensus.cc:740] T bed12810020c4496969b723bcdd4b4ec P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a9a63ca97694ebdb84bca730762d735, State: Initialized, Role: FOLLOWER
I20260709 12:13:56.146938 23497 consensus_queue.cc:260] T bed12810020c4496969b723bcdd4b4ec P 3a9a63ca97694ebdb84bca730762d735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:56.149122 23497 ts_tablet_manager.cc:1434] T bed12810020c4496969b723bcdd4b4ec P 3a9a63ca97694ebdb84bca730762d735: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.002s
I20260709 12:13:56.150224 23497 tablet_bootstrap.cc:492] T 4a007ebead5a454bb48d9784a624f5b8 P 3a9a63ca97694ebdb84bca730762d735: Bootstrap starting.
W20260709 12:13:56.147516 23831 log.cc:927] Time spent T ac88d753a9f84b22adbe65cbc15d5109 P 2904b089bdb249b78950db76f4a70e9f: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 12:13:56.153239 23737 leader_election.cc:290] T 96f1bc9b220f49d5845c08249cb6a44f P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 1 election: Requested vote from peers 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061), 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081)
I20260709 12:13:56.154592 23495 tablet_bootstrap.cc:654] T 8bed7e0b2b804500b4898a175fba3ebe P 288a46a90f26471584043331107dc0dd: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:56.166893 23497 tablet_bootstrap.cc:654] T 4a007ebead5a454bb48d9784a624f5b8 P 3a9a63ca97694ebdb84bca730762d735: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:56.167716 23375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96f1bc9b220f49d5845c08249cb6a44f" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a9a63ca97694ebdb84bca730762d735"
W20260709 12:13:56.171690 23340 leader_election.cc:343] T 8bed7e0b2b804500b4898a175fba3ebe P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:56.169914 23733 consensus_queue.cc:1048] T 94b9ff7f93dc4114b7c59ecfc0fcc9a7 P 2904b089bdb249b78950db76f4a70e9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:56.173525 23375 raft_consensus.cc:3060] T 96f1bc9b220f49d5845c08249cb6a44f P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:56.211643 23495 tablet_bootstrap.cc:492] T 8bed7e0b2b804500b4898a175fba3ebe P 288a46a90f26471584043331107dc0dd: No bootstrap required, opened a new log
I20260709 12:13:56.216540 23495 ts_tablet_manager.cc:1403] T 8bed7e0b2b804500b4898a175fba3ebe P 288a46a90f26471584043331107dc0dd: Time spent bootstrapping tablet: real 0.212s	user 0.018s	sys 0.011s
I20260709 12:13:56.219560 23450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96f1bc9b220f49d5845c08249cb6a44f" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba0da223cf24c97bc7d225e25015924"
I20260709 12:13:56.220377 23450 raft_consensus.cc:3060] T 96f1bc9b220f49d5845c08249cb6a44f P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:56.231523 23496 tablet_bootstrap.cc:654] T 9a21be1df2964860b89acefd66f6fbde P 9ba0da223cf24c97bc7d225e25015924: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:56.234751 23495 raft_consensus.cc:359] T 8bed7e0b2b804500b4898a175fba3ebe P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:56.235586 23495 raft_consensus.cc:385] T 8bed7e0b2b804500b4898a175fba3ebe P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:56.235852 23495 raft_consensus.cc:740] T 8bed7e0b2b804500b4898a175fba3ebe P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 288a46a90f26471584043331107dc0dd, State: Initialized, Role: FOLLOWER
I20260709 12:13:56.236600 23495 consensus_queue.cc:260] T 8bed7e0b2b804500b4898a175fba3ebe P 288a46a90f26471584043331107dc0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:56.238894 23495 ts_tablet_manager.cc:1434] T 8bed7e0b2b804500b4898a175fba3ebe P 288a46a90f26471584043331107dc0dd: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 12:13:56.239948 23495 tablet_bootstrap.cc:492] T 6efb52601755488885a8baf030e7fae9 P 288a46a90f26471584043331107dc0dd: Bootstrap starting.
I20260709 12:13:56.254158 23375 raft_consensus.cc:2468] T 96f1bc9b220f49d5845c08249cb6a44f P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 288a46a90f26471584043331107dc0dd in term 1.
I20260709 12:13:56.254976 23733 raft_consensus.cc:493] T 45e4fb3889cc4d23bab3929c3fdd731e P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:56.255489 23495 tablet_bootstrap.cc:654] T 6efb52601755488885a8baf030e7fae9 P 288a46a90f26471584043331107dc0dd: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:56.255995 23737 consensus_queue.cc:1048] T 9a21be1df2964860b89acefd66f6fbde P 288a46a90f26471584043331107dc0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:56.255529 23733 raft_consensus.cc:515] T 45e4fb3889cc4d23bab3929c3fdd731e P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
W20260709 12:13:56.273080 23191 consensus_peers.cc:597] T 9a21be1df2964860b89acefd66f6fbde P 288a46a90f26471584043331107dc0dd -> Peer 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081): Couldn't send request to peer 9ba0da223cf24c97bc7d225e25015924. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:56.187547 23340 leader_election.cc:304] T 8bed7e0b2b804500b4898a175fba3ebe P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3a9a63ca97694ebdb84bca730762d735; no voters: 288a46a90f26471584043331107dc0dd, 9ba0da223cf24c97bc7d225e25015924
I20260709 12:13:56.282428 23450 raft_consensus.cc:2468] T 96f1bc9b220f49d5845c08249cb6a44f P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 288a46a90f26471584043331107dc0dd in term 1.
I20260709 12:13:56.287057 23840 raft_consensus.cc:2749] T 8bed7e0b2b804500b4898a175fba3ebe P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:13:56.292167 23340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:46081, user_credentials={real_user=slave}} blocked reactor thread for 120510us
I20260709 12:13:56.305995 23497 tablet_bootstrap.cc:492] T 4a007ebead5a454bb48d9784a624f5b8 P 3a9a63ca97694ebdb84bca730762d735: No bootstrap required, opened a new log
I20260709 12:13:56.306844 23497 ts_tablet_manager.cc:1403] T 4a007ebead5a454bb48d9784a624f5b8 P 3a9a63ca97694ebdb84bca730762d735: Time spent bootstrapping tablet: real 0.157s	user 0.062s	sys 0.034s
I20260709 12:13:56.327780 23632 raft_consensus.cc:493] T 8bed7e0b2b804500b4898a175fba3ebe P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:56.332798 23192 leader_election.cc:304] T 96f1bc9b220f49d5845c08249cb6a44f P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 288a46a90f26471584043331107dc0dd, 3a9a63ca97694ebdb84bca730762d735; no voters: 
I20260709 12:13:56.335091 23796 raft_consensus.cc:2804] T 96f1bc9b220f49d5845c08249cb6a44f P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:56.335700 23796 raft_consensus.cc:697] T 96f1bc9b220f49d5845c08249cb6a44f P 288a46a90f26471584043331107dc0dd [term 1 LEADER]: Becoming Leader. State: Replica: 288a46a90f26471584043331107dc0dd, State: Running, Role: LEADER
I20260709 12:13:56.336616 23796 consensus_queue.cc:237] T 96f1bc9b220f49d5845c08249cb6a44f P 288a46a90f26471584043331107dc0dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:56.342345 23448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e4fb3889cc4d23bab3929c3fdd731e" candidate_uuid: "2904b089bdb249b78950db76f4a70e9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba0da223cf24c97bc7d225e25015924" is_pre_election: true
W20260709 12:13:56.344995 23266 leader_election.cc:343] T 45e4fb3889cc4d23bab3929c3fdd731e P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:56.346467 23733 leader_election.cc:290] T 45e4fb3889cc4d23bab3929c3fdd731e P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081), 288a46a90f26471584043331107dc0dd (127.12.174.129:46159)
I20260709 12:13:56.384667 23737 raft_consensus.cc:493] T 45e4fb3889cc4d23bab3929c3fdd731e P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:56.386442 23737 raft_consensus.cc:515] T 45e4fb3889cc4d23bab3929c3fdd731e P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:56.405215 23638 raft_consensus.cc:493] T 27166b782a5049198cccb3e5905acbc7 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:56.406018 23638 raft_consensus.cc:515] T 27166b782a5049198cccb3e5905acbc7 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
W20260709 12:13:56.446859 23268 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:46159, user_credentials={real_user=slave}} blocked reactor thread for 236063us
I20260709 12:13:56.470530 23810 consensus_queue.cc:1048] T d85273afe57c4f35bb72827d1c5879eb P 2904b089bdb249b78950db76f4a70e9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:56.485374 23495 tablet_bootstrap.cc:492] T 6efb52601755488885a8baf030e7fae9 P 288a46a90f26471584043331107dc0dd: No bootstrap required, opened a new log
I20260709 12:13:56.486156 23495 ts_tablet_manager.cc:1403] T 6efb52601755488885a8baf030e7fae9 P 288a46a90f26471584043331107dc0dd: Time spent bootstrapping tablet: real 0.246s	user 0.067s	sys 0.053s
I20260709 12:13:56.486550 23737 leader_election.cc:290] T 45e4fb3889cc4d23bab3929c3fdd731e P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081), 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789)
I20260709 12:13:56.488243 23638 leader_election.cc:290] T 27166b782a5049198cccb3e5905acbc7 P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789), 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061)
I20260709 12:13:56.488763 23498 tablet_bootstrap.cc:492] T 6efb52601755488885a8baf030e7fae9 P 2904b089bdb249b78950db76f4a70e9f: No bootstrap required, opened a new log
I20260709 12:13:56.488013 23632 raft_consensus.cc:515] T 8bed7e0b2b804500b4898a175fba3ebe P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:56.489373 23498 ts_tablet_manager.cc:1403] T 6efb52601755488885a8baf030e7fae9 P 2904b089bdb249b78950db76f4a70e9f: Time spent bootstrapping tablet: real 0.500s	user 0.066s	sys 0.053s
W20260709 12:13:56.487166 23191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:46081, user_credentials={real_user=slave}} blocked reactor thread for 146494us
W20260709 12:13:56.490625 23173 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:13:56.491596 23450 raft_consensus.cc:3060] T ac88d753a9f84b22adbe65cbc15d5109 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:56.495219 23498 raft_consensus.cc:359] T 6efb52601755488885a8baf030e7fae9 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:56.496039 23498 raft_consensus.cc:385] T 6efb52601755488885a8baf030e7fae9 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:56.496322 23498 raft_consensus.cc:740] T 6efb52601755488885a8baf030e7fae9 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2904b089bdb249b78950db76f4a70e9f, State: Initialized, Role: FOLLOWER
I20260709 12:13:56.497275 23498 consensus_queue.cc:260] T 6efb52601755488885a8baf030e7fae9 P 2904b089bdb249b78950db76f4a70e9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:56.499033 23498 ts_tablet_manager.cc:1434] T 6efb52601755488885a8baf030e7fae9 P 2904b089bdb249b78950db76f4a70e9f: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:13:56.500083 23498 tablet_bootstrap.cc:492] T 558b91ca6fe3461da7eb4a1344ec14fc P 2904b089bdb249b78950db76f4a70e9f: Bootstrap starting.
I20260709 12:13:56.502825 23302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e4fb3889cc4d23bab3929c3fdd731e" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2904b089bdb249b78950db76f4a70e9f" is_pre_election: true
I20260709 12:13:56.503690 23302 raft_consensus.cc:2468] T 45e4fb3889cc4d23bab3929c3fdd731e P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 288a46a90f26471584043331107dc0dd in term 0.
I20260709 12:13:56.506513 23498 tablet_bootstrap.cc:654] T 558b91ca6fe3461da7eb4a1344ec14fc P 2904b089bdb249b78950db76f4a70e9f: Neither blocks nor log segments found. Creating new log.
W20260709 12:13:56.509856 23415 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:45789, user_credentials={real_user=slave}} blocked reactor thread for 204845us
I20260709 12:13:56.510141 23632 leader_election.cc:290] T 8bed7e0b2b804500b4898a175fba3ebe P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061), 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081)
I20260709 12:13:56.522804 23302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27166b782a5049198cccb3e5905acbc7" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2904b089bdb249b78950db76f4a70e9f" is_pre_election: true
I20260709 12:13:56.575232 23192 leader_election.cc:304] T 45e4fb3889cc4d23bab3929c3fdd731e P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 288a46a90f26471584043331107dc0dd, 2904b089bdb249b78950db76f4a70e9f; no voters: 
I20260709 12:13:56.576013 23302 raft_consensus.cc:2393] T 27166b782a5049198cccb3e5905acbc7 P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 288a46a90f26471584043331107dc0dd in current term 1: Already voted for candidate 3a9a63ca97694ebdb84bca730762d735 in this term.
I20260709 12:13:56.578274 23516 raft_consensus.cc:2804] T 45e4fb3889cc4d23bab3929c3fdd731e P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:56.578871 23516 raft_consensus.cc:493] T 45e4fb3889cc4d23bab3929c3fdd731e P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:56.579286 23516 raft_consensus.cc:3060] T 45e4fb3889cc4d23bab3929c3fdd731e P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:56.582437 23222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e4fb3889cc4d23bab3929c3fdd731e" candidate_uuid: "2904b089bdb249b78950db76f4a70e9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "288a46a90f26471584043331107dc0dd" is_pre_election: true
I20260709 12:13:56.590982 23450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e4fb3889cc4d23bab3929c3fdd731e" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba0da223cf24c97bc7d225e25015924" is_pre_election: true
I20260709 12:13:56.530066 23846 consensus_queue.cc:1048] T ac88d753a9f84b22adbe65cbc15d5109 P 2904b089bdb249b78950db76f4a70e9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:56.610327 23810 consensus_queue.cc:1048] T ac88d753a9f84b22adbe65cbc15d5109 P 2904b089bdb249b78950db76f4a70e9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:56.539460 23497 raft_consensus.cc:359] T 4a007ebead5a454bb48d9784a624f5b8 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:56.547677 23728 raft_consensus.cc:493] T ac88d753a9f84b22adbe65cbc15d5109 P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:56.548614 23800 consensus_queue.cc:1048] T 27166b782a5049198cccb3e5905acbc7 P 3a9a63ca97694ebdb84bca730762d735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:56.618096 23497 raft_consensus.cc:385] T 4a007ebead5a454bb48d9784a624f5b8 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:56.618523 23497 raft_consensus.cc:740] T 4a007ebead5a454bb48d9784a624f5b8 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a9a63ca97694ebdb84bca730762d735, State: Initialized, Role: FOLLOWER
I20260709 12:13:56.557687 23376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27166b782a5049198cccb3e5905acbc7" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a9a63ca97694ebdb84bca730762d735" is_pre_election: true
I20260709 12:13:56.560031 23373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bed7e0b2b804500b4898a175fba3ebe" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a9a63ca97694ebdb84bca730762d735" is_pre_election: true
I20260709 12:13:56.619284 23497 consensus_queue.cc:260] T 4a007ebead5a454bb48d9784a624f5b8 P 3a9a63ca97694ebdb84bca730762d735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:56.619892 23373 raft_consensus.cc:2468] T 8bed7e0b2b804500b4898a175fba3ebe P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 288a46a90f26471584043331107dc0dd in term 0.
I20260709 12:13:56.562825 23840 raft_consensus.cc:493] T bed12810020c4496969b723bcdd4b4ec P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:56.620762 23728 raft_consensus.cc:515] T ac88d753a9f84b22adbe65cbc15d5109 P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:56.568287 23496 tablet_bootstrap.cc:492] T 9a21be1df2964860b89acefd66f6fbde P 9ba0da223cf24c97bc7d225e25015924: No bootstrap required, opened a new log
I20260709 12:13:56.571355 23122 catalog_manager.cc:5697] T 96f1bc9b220f49d5845c08249cb6a44f P 288a46a90f26471584043331107dc0dd reported cstate change: term changed from 0 to 1, leader changed from <none> to 288a46a90f26471584043331107dc0dd (127.12.174.129). New cstate: current_term: 1 leader_uuid: "288a46a90f26471584043331107dc0dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } health_report { overall_health: HEALTHY } } }
W20260709 12:13:56.598863 23191 leader_election.cc:343] T 45e4fb3889cc4d23bab3929c3fdd731e P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:56.599694 23448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bed7e0b2b804500b4898a175fba3ebe" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba0da223cf24c97bc7d225e25015924" is_pre_election: true
I20260709 12:13:56.620914 23840 raft_consensus.cc:515] T bed12810020c4496969b723bcdd4b4ec P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:56.571017 23223 raft_consensus.cc:3060] T 27166b782a5049198cccb3e5905acbc7 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:56.626624 23192 leader_election.cc:304] T 27166b782a5049198cccb3e5905acbc7 P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 288a46a90f26471584043331107dc0dd; no voters: 2904b089bdb249b78950db76f4a70e9f, 3a9a63ca97694ebdb84bca730762d735
I20260709 12:13:56.628443 23192 leader_election.cc:304] T 8bed7e0b2b804500b4898a175fba3ebe P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 288a46a90f26471584043331107dc0dd, 3a9a63ca97694ebdb84bca730762d735; no voters: 
I20260709 12:13:56.629876 23796 raft_consensus.cc:2804] T 8bed7e0b2b804500b4898a175fba3ebe P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:56.630460 23796 raft_consensus.cc:493] T 8bed7e0b2b804500b4898a175fba3ebe P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:56.631541 23840 leader_election.cc:290] T bed12810020c4496969b723bcdd4b4ec P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081), 288a46a90f26471584043331107dc0dd (127.12.174.129:46159)
I20260709 12:13:56.623394 23728 leader_election.cc:290] T ac88d753a9f84b22adbe65cbc15d5109 P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789), 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061)
I20260709 12:13:56.635372 23224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed12810020c4496969b723bcdd4b4ec" candidate_uuid: "3a9a63ca97694ebdb84bca730762d735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "288a46a90f26471584043331107dc0dd" is_pre_election: true
I20260709 12:13:56.640024 23738 consensus_queue.cc:1048] T d85273afe57c4f35bb72827d1c5879eb P 2904b089bdb249b78950db76f4a70e9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:56.640965 23638 raft_consensus.cc:2749] T 27166b782a5049198cccb3e5905acbc7 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:56.646183 23496 ts_tablet_manager.cc:1403] T 9a21be1df2964860b89acefd66f6fbde P 9ba0da223cf24c97bc7d225e25015924: Time spent bootstrapping tablet: real 0.514s	user 0.017s	sys 0.002s
I20260709 12:13:56.650873 23498 tablet_bootstrap.cc:492] T 558b91ca6fe3461da7eb4a1344ec14fc P 2904b089bdb249b78950db76f4a70e9f: No bootstrap required, opened a new log
I20260709 12:13:56.650656 23840 consensus_queue.cc:1048] T 27166b782a5049198cccb3e5905acbc7 P 3a9a63ca97694ebdb84bca730762d735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:56.651441 23498 ts_tablet_manager.cc:1403] T 558b91ca6fe3461da7eb4a1344ec14fc P 2904b089bdb249b78950db76f4a70e9f: Time spent bootstrapping tablet: real 0.152s	user 0.063s	sys 0.065s
W20260709 12:13:56.652630 23342 leader_election.cc:343] T bed12810020c4496969b723bcdd4b4ec P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:56.614684 23495 raft_consensus.cc:359] T 6efb52601755488885a8baf030e7fae9 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:56.654217 23495 raft_consensus.cc:385] T 6efb52601755488885a8baf030e7fae9 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:56.654659 23495 raft_consensus.cc:740] T 6efb52601755488885a8baf030e7fae9 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 288a46a90f26471584043331107dc0dd, State: Initialized, Role: FOLLOWER
I20260709 12:13:56.655498 23498 raft_consensus.cc:359] T 558b91ca6fe3461da7eb4a1344ec14fc P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:56.656349 23498 raft_consensus.cc:385] T 558b91ca6fe3461da7eb4a1344ec14fc P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:56.642652 23796 raft_consensus.cc:3060] T 8bed7e0b2b804500b4898a175fba3ebe P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:56.656656 23498 raft_consensus.cc:740] T 558b91ca6fe3461da7eb4a1344ec14fc P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2904b089bdb249b78950db76f4a70e9f, State: Initialized, Role: FOLLOWER
I20260709 12:13:56.655789 23495 consensus_queue.cc:260] T 6efb52601755488885a8baf030e7fae9 P 288a46a90f26471584043331107dc0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:56.657509 23498 consensus_queue.cc:260] T 558b91ca6fe3461da7eb4a1344ec14fc P 2904b089bdb249b78950db76f4a70e9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:56.659003 23495 ts_tablet_manager.cc:1434] T 6efb52601755488885a8baf030e7fae9 P 288a46a90f26471584043331107dc0dd: Time spent starting tablet: real 0.173s	user 0.009s	sys 0.003s
I20260709 12:13:56.660167 23498 ts_tablet_manager.cc:1434] T 558b91ca6fe3461da7eb4a1344ec14fc P 2904b089bdb249b78950db76f4a70e9f: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:13:56.660707 23516 raft_consensus.cc:515] T 45e4fb3889cc4d23bab3929c3fdd731e P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:56.665804 23222 raft_consensus.cc:2393] T 45e4fb3889cc4d23bab3929c3fdd731e P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2904b089bdb249b78950db76f4a70e9f in current term 1: Already voted for candidate 288a46a90f26471584043331107dc0dd in this term.
I20260709 12:13:56.667665 23497 ts_tablet_manager.cc:1434] T 4a007ebead5a454bb48d9784a624f5b8 P 3a9a63ca97694ebdb84bca730762d735: Time spent starting tablet: real 0.360s	user 0.022s	sys 0.009s
I20260709 12:13:56.669018 23497 tablet_bootstrap.cc:492] T 28d6ea7193094e8186a5394f3e7ef0b4 P 3a9a63ca97694ebdb84bca730762d735: Bootstrap starting.
I20260709 12:13:56.661326 23498 tablet_bootstrap.cc:492] T 4a007ebead5a454bb48d9784a624f5b8 P 2904b089bdb249b78950db76f4a70e9f: Bootstrap starting.
I20260709 12:13:56.678886 23498 tablet_bootstrap.cc:654] T 4a007ebead5a454bb48d9784a624f5b8 P 2904b089bdb249b78950db76f4a70e9f: Neither blocks nor log segments found. Creating new log.
W20260709 12:13:56.679322 23191 leader_election.cc:343] T 8bed7e0b2b804500b4898a175fba3ebe P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:56.660171 23495 tablet_bootstrap.cc:492] T 558b91ca6fe3461da7eb4a1344ec14fc P 288a46a90f26471584043331107dc0dd: Bootstrap starting.
I20260709 12:13:56.687466 23446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed12810020c4496969b723bcdd4b4ec" candidate_uuid: "3a9a63ca97694ebdb84bca730762d735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba0da223cf24c97bc7d225e25015924" is_pre_election: true
I20260709 12:13:56.683967 23516 leader_election.cc:290] T 45e4fb3889cc4d23bab3929c3fdd731e P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 1 election: Requested vote from peers 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081), 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789)
I20260709 12:13:56.702601 23448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e4fb3889cc4d23bab3929c3fdd731e" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba0da223cf24c97bc7d225e25015924"
W20260709 12:13:56.705376 23191 leader_election.cc:343] T 45e4fb3889cc4d23bab3929c3fdd731e P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:56.710253 23497 tablet_bootstrap.cc:654] T 28d6ea7193094e8186a5394f3e7ef0b4 P 3a9a63ca97694ebdb84bca730762d735: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:56.680430 23268 leader_election.cc:304] T 45e4fb3889cc4d23bab3929c3fdd731e P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2904b089bdb249b78950db76f4a70e9f; no voters: 288a46a90f26471584043331107dc0dd, 9ba0da223cf24c97bc7d225e25015924
W20260709 12:13:56.681005 23415 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:40061, user_credentials={real_user=slave}} blocked reactor thread for 62329.1us
I20260709 12:13:56.716104 23496 raft_consensus.cc:359] T 9a21be1df2964860b89acefd66f6fbde P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:56.723587 23496 raft_consensus.cc:385] T 9a21be1df2964860b89acefd66f6fbde P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:56.723948 23496 raft_consensus.cc:740] T 9a21be1df2964860b89acefd66f6fbde P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ba0da223cf24c97bc7d225e25015924, State: Initialized, Role: FOLLOWER
I20260709 12:13:56.726784 23496 consensus_queue.cc:260] T 9a21be1df2964860b89acefd66f6fbde P 9ba0da223cf24c97bc7d225e25015924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:56.713557 23300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e4fb3889cc4d23bab3929c3fdd731e" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2904b089bdb249b78950db76f4a70e9f"
I20260709 12:13:56.719437 23810 raft_consensus.cc:3060] T 45e4fb3889cc4d23bab3929c3fdd731e P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:13:56.740121 23268 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:46159, user_credentials={real_user=slave}} blocked reactor thread for 59776us
I20260709 12:13:56.745182 23496 ts_tablet_manager.cc:1434] T 9a21be1df2964860b89acefd66f6fbde P 9ba0da223cf24c97bc7d225e25015924: Time spent starting tablet: real 0.098s	user 0.006s	sys 0.002s
I20260709 12:13:56.746433 23496 tablet_bootstrap.cc:492] T 45e4fb3889cc4d23bab3929c3fdd731e P 9ba0da223cf24c97bc7d225e25015924: Bootstrap starting.
I20260709 12:13:56.747246 23446 raft_consensus.cc:3060] T 9a21be1df2964860b89acefd66f6fbde P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:56.752516 23796 raft_consensus.cc:515] T 8bed7e0b2b804500b4898a175fba3ebe P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:56.755623 23496 tablet_bootstrap.cc:654] T 45e4fb3889cc4d23bab3929c3fdd731e P 9ba0da223cf24c97bc7d225e25015924: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:56.759568 23373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac88d753a9f84b22adbe65cbc15d5109" candidate_uuid: "9ba0da223cf24c97bc7d225e25015924" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a9a63ca97694ebdb84bca730762d735" is_pre_election: true
I20260709 12:13:56.762458 23302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac88d753a9f84b22adbe65cbc15d5109" candidate_uuid: "9ba0da223cf24c97bc7d225e25015924" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2904b089bdb249b78950db76f4a70e9f" is_pre_election: true
I20260709 12:13:56.774878 23495 tablet_bootstrap.cc:654] T 558b91ca6fe3461da7eb4a1344ec14fc P 288a46a90f26471584043331107dc0dd: Neither blocks nor log segments found. Creating new log.
W20260709 12:13:56.800505 23340 leader_election.cc:343] T bed12810020c4496969b723bcdd4b4ec P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:56.801090 23340 leader_election.cc:304] T bed12810020c4496969b723bcdd4b4ec P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3a9a63ca97694ebdb84bca730762d735; no voters: 288a46a90f26471584043331107dc0dd, 9ba0da223cf24c97bc7d225e25015924
I20260709 12:13:56.805210 23668 raft_consensus.cc:2749] T bed12810020c4496969b723bcdd4b4ec P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:56.823254 23373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bed7e0b2b804500b4898a175fba3ebe" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a9a63ca97694ebdb84bca730762d735"
I20260709 12:13:56.824018 23373 raft_consensus.cc:3060] T 8bed7e0b2b804500b4898a175fba3ebe P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:56.830154 23498 tablet_bootstrap.cc:492] T 4a007ebead5a454bb48d9784a624f5b8 P 2904b089bdb249b78950db76f4a70e9f: No bootstrap required, opened a new log
I20260709 12:13:56.830798 23498 ts_tablet_manager.cc:1403] T 4a007ebead5a454bb48d9784a624f5b8 P 2904b089bdb249b78950db76f4a70e9f: Time spent bootstrapping tablet: real 0.170s	user 0.015s	sys 0.005s
I20260709 12:13:56.839694 23796 leader_election.cc:290] T 8bed7e0b2b804500b4898a175fba3ebe P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 1 election: Requested vote from peers 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061), 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081)
I20260709 12:13:56.840915 23415 leader_election.cc:304] T ac88d753a9f84b22adbe65cbc15d5109 P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ba0da223cf24c97bc7d225e25015924; no voters: 2904b089bdb249b78950db76f4a70e9f, 3a9a63ca97694ebdb84bca730762d735
I20260709 12:13:56.844193 23445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bed7e0b2b804500b4898a175fba3ebe" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba0da223cf24c97bc7d225e25015924"
I20260709 12:13:56.846757 23728 raft_consensus.cc:2749] T ac88d753a9f84b22adbe65cbc15d5109 P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:56.854784 23810 raft_consensus.cc:2749] T 45e4fb3889cc4d23bab3929c3fdd731e P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:56.864022 23300 raft_consensus.cc:2468] T 45e4fb3889cc4d23bab3929c3fdd731e P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 288a46a90f26471584043331107dc0dd in term 1.
W20260709 12:13:56.874120 23191 leader_election.cc:343] T 8bed7e0b2b804500b4898a175fba3ebe P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:56.874990 23192 leader_election.cc:304] T 45e4fb3889cc4d23bab3929c3fdd731e P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 288a46a90f26471584043331107dc0dd, 2904b089bdb249b78950db76f4a70e9f; no voters: 9ba0da223cf24c97bc7d225e25015924
I20260709 12:13:56.877632 23796 raft_consensus.cc:2804] T 45e4fb3889cc4d23bab3929c3fdd731e P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:56.878206 23796 raft_consensus.cc:697] T 45e4fb3889cc4d23bab3929c3fdd731e P 288a46a90f26471584043331107dc0dd [term 1 LEADER]: Becoming Leader. State: Replica: 288a46a90f26471584043331107dc0dd, State: Running, Role: LEADER
I20260709 12:13:56.889048 23373 raft_consensus.cc:2468] T 8bed7e0b2b804500b4898a175fba3ebe P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 288a46a90f26471584043331107dc0dd in term 1.
W20260709 12:13:56.905525 23268 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:46159, user_credentials={real_user=slave}} blocked reactor thread for 79880.9us
W20260709 12:13:56.910028 23415 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:40061, user_credentials={real_user=slave}} blocked reactor thread for 65241.3us
I20260709 12:13:56.889084 23796 consensus_queue.cc:237] T 45e4fb3889cc4d23bab3929c3fdd731e P 288a46a90f26471584043331107dc0dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:56.922330 23496 tablet_bootstrap.cc:492] T 45e4fb3889cc4d23bab3929c3fdd731e P 9ba0da223cf24c97bc7d225e25015924: No bootstrap required, opened a new log
I20260709 12:13:56.922933 23496 ts_tablet_manager.cc:1403] T 45e4fb3889cc4d23bab3929c3fdd731e P 9ba0da223cf24c97bc7d225e25015924: Time spent bootstrapping tablet: real 0.177s	user 0.011s	sys 0.018s
I20260709 12:13:56.913465 23192 leader_election.cc:304] T 8bed7e0b2b804500b4898a175fba3ebe P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 288a46a90f26471584043331107dc0dd, 3a9a63ca97694ebdb84bca730762d735; no voters: 9ba0da223cf24c97bc7d225e25015924
I20260709 12:13:56.926910 23497 tablet_bootstrap.cc:492] T 28d6ea7193094e8186a5394f3e7ef0b4 P 3a9a63ca97694ebdb84bca730762d735: No bootstrap required, opened a new log
I20260709 12:13:56.927496 23497 ts_tablet_manager.cc:1403] T 28d6ea7193094e8186a5394f3e7ef0b4 P 3a9a63ca97694ebdb84bca730762d735: Time spent bootstrapping tablet: real 0.259s	user 0.029s	sys 0.009s
I20260709 12:13:56.928633 23498 raft_consensus.cc:359] T 4a007ebead5a454bb48d9784a624f5b8 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:56.929404 23498 raft_consensus.cc:385] T 4a007ebead5a454bb48d9784a624f5b8 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:56.930101 23496 raft_consensus.cc:359] T 45e4fb3889cc4d23bab3929c3fdd731e P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:56.931375 23496 raft_consensus.cc:385] T 45e4fb3889cc4d23bab3929c3fdd731e P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:56.931659 23496 raft_consensus.cc:740] T 45e4fb3889cc4d23bab3929c3fdd731e P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ba0da223cf24c97bc7d225e25015924, State: Initialized, Role: FOLLOWER
I20260709 12:13:56.932334 23516 raft_consensus.cc:2804] T 8bed7e0b2b804500b4898a175fba3ebe P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:56.932866 23516 raft_consensus.cc:697] T 8bed7e0b2b804500b4898a175fba3ebe P 288a46a90f26471584043331107dc0dd [term 1 LEADER]: Becoming Leader. State: Replica: 288a46a90f26471584043331107dc0dd, State: Running, Role: LEADER
I20260709 12:13:56.929677 23498 raft_consensus.cc:740] T 4a007ebead5a454bb48d9784a624f5b8 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2904b089bdb249b78950db76f4a70e9f, State: Initialized, Role: FOLLOWER
I20260709 12:13:56.934490 23516 consensus_queue.cc:237] T 8bed7e0b2b804500b4898a175fba3ebe P 288a46a90f26471584043331107dc0dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:56.934265 23498 consensus_queue.cc:260] T 4a007ebead5a454bb48d9784a624f5b8 P 2904b089bdb249b78950db76f4a70e9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:56.939450 23496 consensus_queue.cc:260] T 45e4fb3889cc4d23bab3929c3fdd731e P 9ba0da223cf24c97bc7d225e25015924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:56.940501 23874 raft_consensus.cc:493] T 6efb52601755488885a8baf030e7fae9 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:56.942499 23874 raft_consensus.cc:515] T 6efb52601755488885a8baf030e7fae9 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:56.944020 23498 ts_tablet_manager.cc:1434] T 4a007ebead5a454bb48d9784a624f5b8 P 2904b089bdb249b78950db76f4a70e9f: Time spent starting tablet: real 0.113s	user 0.006s	sys 0.001s
I20260709 12:13:56.941431 23496 ts_tablet_manager.cc:1434] T 45e4fb3889cc4d23bab3929c3fdd731e P 9ba0da223cf24c97bc7d225e25015924: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.000s
I20260709 12:13:56.945037 23498 tablet_bootstrap.cc:492] T 2eb2c8089ce14124aed9a5d834cd0522 P 2904b089bdb249b78950db76f4a70e9f: Bootstrap starting.
I20260709 12:13:56.946063 23874 leader_election.cc:290] T 6efb52601755488885a8baf030e7fae9 P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 288a46a90f26471584043331107dc0dd (127.12.174.129:46159), 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061)
I20260709 12:13:56.946578 23638 consensus_queue.cc:1048] T 96f1bc9b220f49d5845c08249cb6a44f P 288a46a90f26471584043331107dc0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:56.949159 23496 tablet_bootstrap.cc:492] T 8bed7e0b2b804500b4898a175fba3ebe P 9ba0da223cf24c97bc7d225e25015924: Bootstrap starting.
I20260709 12:13:56.949630 23375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6efb52601755488885a8baf030e7fae9" candidate_uuid: "2904b089bdb249b78950db76f4a70e9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a9a63ca97694ebdb84bca730762d735" is_pre_election: true
I20260709 12:13:56.951870 23495 tablet_bootstrap.cc:492] T 558b91ca6fe3461da7eb4a1344ec14fc P 288a46a90f26471584043331107dc0dd: No bootstrap required, opened a new log
I20260709 12:13:56.961906 23495 ts_tablet_manager.cc:1403] T 558b91ca6fe3461da7eb4a1344ec14fc P 288a46a90f26471584043331107dc0dd: Time spent bootstrapping tablet: real 0.302s	user 0.015s	sys 0.028s
I20260709 12:13:56.962975 23375 raft_consensus.cc:2468] T 6efb52601755488885a8baf030e7fae9 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2904b089bdb249b78950db76f4a70e9f in term 0.
I20260709 12:13:56.963493 23224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6efb52601755488885a8baf030e7fae9" candidate_uuid: "2904b089bdb249b78950db76f4a70e9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "288a46a90f26471584043331107dc0dd" is_pre_election: true
I20260709 12:13:56.964157 23224 raft_consensus.cc:2468] T 6efb52601755488885a8baf030e7fae9 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2904b089bdb249b78950db76f4a70e9f in term 0.
I20260709 12:13:56.964444 23267 leader_election.cc:304] T 6efb52601755488885a8baf030e7fae9 P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2904b089bdb249b78950db76f4a70e9f, 3a9a63ca97694ebdb84bca730762d735; no voters: 
I20260709 12:13:56.964797 23495 raft_consensus.cc:359] T 558b91ca6fe3461da7eb4a1344ec14fc P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:56.965481 23495 raft_consensus.cc:385] T 558b91ca6fe3461da7eb4a1344ec14fc P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:56.965775 23495 raft_consensus.cc:740] T 558b91ca6fe3461da7eb4a1344ec14fc P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 288a46a90f26471584043331107dc0dd, State: Initialized, Role: FOLLOWER
I20260709 12:13:56.965499 23498 tablet_bootstrap.cc:654] T 2eb2c8089ce14124aed9a5d834cd0522 P 2904b089bdb249b78950db76f4a70e9f: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:56.966598 23495 consensus_queue.cc:260] T 558b91ca6fe3461da7eb4a1344ec14fc P 288a46a90f26471584043331107dc0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:56.972198 23497 raft_consensus.cc:359] T 28d6ea7193094e8186a5394f3e7ef0b4 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:56.973013 23497 raft_consensus.cc:385] T 28d6ea7193094e8186a5394f3e7ef0b4 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:56.973284 23497 raft_consensus.cc:740] T 28d6ea7193094e8186a5394f3e7ef0b4 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a9a63ca97694ebdb84bca730762d735, State: Initialized, Role: FOLLOWER
I20260709 12:13:56.975373 23497 consensus_queue.cc:260] T 28d6ea7193094e8186a5394f3e7ef0b4 P 3a9a63ca97694ebdb84bca730762d735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:56.979056 23495 ts_tablet_manager.cc:1434] T 558b91ca6fe3461da7eb4a1344ec14fc P 288a46a90f26471584043331107dc0dd: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 12:13:56.980264 23495 tablet_bootstrap.cc:492] T bed12810020c4496969b723bcdd4b4ec P 288a46a90f26471584043331107dc0dd: Bootstrap starting.
I20260709 12:13:56.991937 23497 ts_tablet_manager.cc:1434] T 28d6ea7193094e8186a5394f3e7ef0b4 P 3a9a63ca97694ebdb84bca730762d735: Time spent starting tablet: real 0.064s	user 0.005s	sys 0.003s
I20260709 12:13:57.004868 23496 tablet_bootstrap.cc:654] T 8bed7e0b2b804500b4898a175fba3ebe P 9ba0da223cf24c97bc7d225e25015924: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:57.007453 23497 tablet_bootstrap.cc:492] T 2eb2c8089ce14124aed9a5d834cd0522 P 3a9a63ca97694ebdb84bca730762d735: Bootstrap starting.
I20260709 12:13:56.982036 23874 raft_consensus.cc:2804] T 6efb52601755488885a8baf030e7fae9 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:57.009538 23495 tablet_bootstrap.cc:654] T bed12810020c4496969b723bcdd4b4ec P 288a46a90f26471584043331107dc0dd: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:57.010120 23874 raft_consensus.cc:493] T 6efb52601755488885a8baf030e7fae9 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:57.013616 23874 raft_consensus.cc:3060] T 6efb52601755488885a8baf030e7fae9 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:57.021930 23663 raft_consensus.cc:493] T 4a007ebead5a454bb48d9784a624f5b8 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:57.022456 23663 raft_consensus.cc:515] T 4a007ebead5a454bb48d9784a624f5b8 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:57.024645 23663 leader_election.cc:290] T 4a007ebead5a454bb48d9784a624f5b8 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789), 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081)
I20260709 12:13:57.021503 23846 raft_consensus.cc:493] T 4a007ebead5a454bb48d9784a624f5b8 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:57.030529 23846 raft_consensus.cc:515] T 4a007ebead5a454bb48d9784a624f5b8 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:57.034509 23810 raft_consensus.cc:493] T 558b91ca6fe3461da7eb4a1344ec14fc P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:57.035084 23446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a007ebead5a454bb48d9784a624f5b8" candidate_uuid: "3a9a63ca97694ebdb84bca730762d735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba0da223cf24c97bc7d225e25015924" is_pre_election: true
I20260709 12:13:57.035372 23810 raft_consensus.cc:515] T 558b91ca6fe3461da7eb4a1344ec14fc P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:57.035951 23516 consensus_queue.cc:1048] T 96f1bc9b220f49d5845c08249cb6a44f P 288a46a90f26471584043331107dc0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:13:57.040915 23300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a007ebead5a454bb48d9784a624f5b8" candidate_uuid: "3a9a63ca97694ebdb84bca730762d735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2904b089bdb249b78950db76f4a70e9f" is_pre_election: true
I20260709 12:13:57.041597 23300 raft_consensus.cc:2468] T 4a007ebead5a454bb48d9784a624f5b8 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a9a63ca97694ebdb84bca730762d735 in term 0.
I20260709 12:13:57.042723 23447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "558b91ca6fe3461da7eb4a1344ec14fc" candidate_uuid: "2904b089bdb249b78950db76f4a70e9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba0da223cf24c97bc7d225e25015924" is_pre_election: true
W20260709 12:13:57.044333 23266 leader_election.cc:343] T 558b91ca6fe3461da7eb4a1344ec14fc P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:57.045703 23341 leader_election.cc:304] T 4a007ebead5a454bb48d9784a624f5b8 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2904b089bdb249b78950db76f4a70e9f, 3a9a63ca97694ebdb84bca730762d735; no voters: 
I20260709 12:13:57.046804 23870 raft_consensus.cc:2804] T 4a007ebead5a454bb48d9784a624f5b8 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:57.047161 23870 raft_consensus.cc:493] T 4a007ebead5a454bb48d9784a624f5b8 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:57.059286 23874 raft_consensus.cc:515] T 6efb52601755488885a8baf030e7fae9 P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:57.056237 23870 raft_consensus.cc:3060] T 4a007ebead5a454bb48d9784a624f5b8 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:57.063598 23846 leader_election.cc:290] T 4a007ebead5a454bb48d9784a624f5b8 P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061), 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081)
I20260709 12:13:57.065297 23447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a007ebead5a454bb48d9784a624f5b8" candidate_uuid: "2904b089bdb249b78950db76f4a70e9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba0da223cf24c97bc7d225e25015924" is_pre_election: true
W20260709 12:13:57.066977 23266 leader_election.cc:343] T 4a007ebead5a454bb48d9784a624f5b8 P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:13:57.053634 23340 leader_election.cc:343] T 4a007ebead5a454bb48d9784a624f5b8 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:57.067761 23810 leader_election.cc:290] T 558b91ca6fe3461da7eb4a1344ec14fc P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081), 288a46a90f26471584043331107dc0dd (127.12.174.129:46159)
I20260709 12:13:57.077178 23224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "558b91ca6fe3461da7eb4a1344ec14fc" candidate_uuid: "2904b089bdb249b78950db76f4a70e9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "288a46a90f26471584043331107dc0dd" is_pre_election: true
I20260709 12:13:57.079042 23224 raft_consensus.cc:2468] T 558b91ca6fe3461da7eb4a1344ec14fc P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2904b089bdb249b78950db76f4a70e9f in term 0.
I20260709 12:13:57.080121 23374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a007ebead5a454bb48d9784a624f5b8" candidate_uuid: "2904b089bdb249b78950db76f4a70e9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a9a63ca97694ebdb84bca730762d735" is_pre_election: true
I20260709 12:13:57.082484 23496 tablet_bootstrap.cc:492] T 8bed7e0b2b804500b4898a175fba3ebe P 9ba0da223cf24c97bc7d225e25015924: No bootstrap required, opened a new log
I20260709 12:13:57.083047 23496 ts_tablet_manager.cc:1403] T 8bed7e0b2b804500b4898a175fba3ebe P 9ba0da223cf24c97bc7d225e25015924: Time spent bootstrapping tablet: real 0.134s	user 0.009s	sys 0.007s
I20260709 12:13:57.082690 23268 leader_election.cc:304] T 558b91ca6fe3461da7eb4a1344ec14fc P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 288a46a90f26471584043331107dc0dd, 2904b089bdb249b78950db76f4a70e9f; no voters: 9ba0da223cf24c97bc7d225e25015924
I20260709 12:13:57.087282 23496 raft_consensus.cc:359] T 8bed7e0b2b804500b4898a175fba3ebe P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:57.088083 23496 raft_consensus.cc:385] T 8bed7e0b2b804500b4898a175fba3ebe P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:57.093456 23496 raft_consensus.cc:740] T 8bed7e0b2b804500b4898a175fba3ebe P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ba0da223cf24c97bc7d225e25015924, State: Initialized, Role: FOLLOWER
I20260709 12:13:57.095021 23496 consensus_queue.cc:260] T 8bed7e0b2b804500b4898a175fba3ebe P 9ba0da223cf24c97bc7d225e25015924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:57.086737 23810 raft_consensus.cc:2804] T 558b91ca6fe3461da7eb4a1344ec14fc P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:57.099169 23122 catalog_manager.cc:5697] T 8bed7e0b2b804500b4898a175fba3ebe P 288a46a90f26471584043331107dc0dd reported cstate change: term changed from 0 to 1, leader changed from <none> to 288a46a90f26471584043331107dc0dd (127.12.174.129). New cstate: current_term: 1 leader_uuid: "288a46a90f26471584043331107dc0dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:57.101809 23122 catalog_manager.cc:5697] T 45e4fb3889cc4d23bab3929c3fdd731e P 288a46a90f26471584043331107dc0dd reported cstate change: term changed from 0 to 1, leader changed from <none> to 288a46a90f26471584043331107dc0dd (127.12.174.129). New cstate: current_term: 1 leader_uuid: "288a46a90f26471584043331107dc0dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:57.104080 23496 ts_tablet_manager.cc:1434] T 8bed7e0b2b804500b4898a175fba3ebe P 9ba0da223cf24c97bc7d225e25015924: Time spent starting tablet: real 0.021s	user 0.009s	sys 0.000s
I20260709 12:13:57.102656 23810 raft_consensus.cc:493] T 558b91ca6fe3461da7eb4a1344ec14fc P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:57.106730 23810 raft_consensus.cc:3060] T 558b91ca6fe3461da7eb4a1344ec14fc P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:57.108392 23496 tablet_bootstrap.cc:492] T 4a007ebead5a454bb48d9784a624f5b8 P 9ba0da223cf24c97bc7d225e25015924: Bootstrap starting.
I20260709 12:13:57.123600 23865 raft_consensus.cc:493] T 45e4fb3889cc4d23bab3929c3fdd731e P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:57.124217 23865 raft_consensus.cc:515] T 45e4fb3889cc4d23bab3929c3fdd731e P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:57.127485 23224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e4fb3889cc4d23bab3929c3fdd731e" candidate_uuid: "9ba0da223cf24c97bc7d225e25015924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "288a46a90f26471584043331107dc0dd" is_pre_election: true
I20260709 12:13:57.128650 23496 tablet_bootstrap.cc:654] T 4a007ebead5a454bb48d9784a624f5b8 P 9ba0da223cf24c97bc7d225e25015924: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:57.131937 23497 tablet_bootstrap.cc:654] T 2eb2c8089ce14124aed9a5d834cd0522 P 3a9a63ca97694ebdb84bca730762d735: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:57.132427 23300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e4fb3889cc4d23bab3929c3fdd731e" candidate_uuid: "9ba0da223cf24c97bc7d225e25015924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2904b089bdb249b78950db76f4a70e9f" is_pre_election: true
I20260709 12:13:57.133260 23300 raft_consensus.cc:2393] T 45e4fb3889cc4d23bab3929c3fdd731e P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ba0da223cf24c97bc7d225e25015924 in current term 1: Already voted for candidate 288a46a90f26471584043331107dc0dd in this term.
I20260709 12:13:57.135084 23415 leader_election.cc:304] T 45e4fb3889cc4d23bab3929c3fdd731e P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ba0da223cf24c97bc7d225e25015924; no voters: 288a46a90f26471584043331107dc0dd, 2904b089bdb249b78950db76f4a70e9f
I20260709 12:13:57.135361 23498 tablet_bootstrap.cc:492] T 2eb2c8089ce14124aed9a5d834cd0522 P 2904b089bdb249b78950db76f4a70e9f: No bootstrap required, opened a new log
I20260709 12:13:57.135911 23498 ts_tablet_manager.cc:1403] T 2eb2c8089ce14124aed9a5d834cd0522 P 2904b089bdb249b78950db76f4a70e9f: Time spent bootstrapping tablet: real 0.191s	user 0.015s	sys 0.005s
I20260709 12:13:57.136713 23849 raft_consensus.cc:3060] T 45e4fb3889cc4d23bab3929c3fdd731e P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:57.136049 23865 leader_election.cc:290] T 45e4fb3889cc4d23bab3929c3fdd731e P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 288a46a90f26471584043331107dc0dd (127.12.174.129:46159), 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789)
I20260709 12:13:57.125388 23810 raft_consensus.cc:515] T 558b91ca6fe3461da7eb4a1344ec14fc P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:57.175679 23874 leader_election.cc:290] T 6efb52601755488885a8baf030e7fae9 P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 1 election: Requested vote from peers 288a46a90f26471584043331107dc0dd (127.12.174.129:46159), 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061)
I20260709 12:13:57.174772 23870 raft_consensus.cc:515] T 4a007ebead5a454bb48d9784a624f5b8 P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:57.177795 23870 leader_election.cc:290] T 4a007ebead5a454bb48d9784a624f5b8 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 election: Requested vote from peers 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789), 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081)
I20260709 12:13:57.178660 23374 raft_consensus.cc:2393] T 4a007ebead5a454bb48d9784a624f5b8 P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2904b089bdb249b78950db76f4a70e9f in current term 1: Already voted for candidate 3a9a63ca97694ebdb84bca730762d735 in this term.
I20260709 12:13:57.179019 23224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6efb52601755488885a8baf030e7fae9" candidate_uuid: "2904b089bdb249b78950db76f4a70e9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "288a46a90f26471584043331107dc0dd"
I20260709 12:13:57.179637 23224 raft_consensus.cc:3060] T 6efb52601755488885a8baf030e7fae9 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:57.181996 23267 leader_election.cc:304] T 4a007ebead5a454bb48d9784a624f5b8 P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2904b089bdb249b78950db76f4a70e9f; no voters: 3a9a63ca97694ebdb84bca730762d735, 9ba0da223cf24c97bc7d225e25015924
I20260709 12:13:57.183689 23498 raft_consensus.cc:359] T 2eb2c8089ce14124aed9a5d834cd0522 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:57.184427 23498 raft_consensus.cc:385] T 2eb2c8089ce14124aed9a5d834cd0522 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:57.184686 23498 raft_consensus.cc:740] T 2eb2c8089ce14124aed9a5d834cd0522 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2904b089bdb249b78950db76f4a70e9f, State: Initialized, Role: FOLLOWER
I20260709 12:13:57.185547 23498 consensus_queue.cc:260] T 2eb2c8089ce14124aed9a5d834cd0522 P 2904b089bdb249b78950db76f4a70e9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:57.186511 23447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a007ebead5a454bb48d9784a624f5b8" candidate_uuid: "3a9a63ca97694ebdb84bca730762d735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba0da223cf24c97bc7d225e25015924"
I20260709 12:13:57.186753 23583 raft_consensus.cc:3060] T 4a007ebead5a454bb48d9784a624f5b8 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:57.187718 23374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6efb52601755488885a8baf030e7fae9" candidate_uuid: "2904b089bdb249b78950db76f4a70e9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a9a63ca97694ebdb84bca730762d735"
I20260709 12:13:57.187716 23498 ts_tablet_manager.cc:1434] T 2eb2c8089ce14124aed9a5d834cd0522 P 2904b089bdb249b78950db76f4a70e9f: Time spent starting tablet: real 0.052s	user 0.006s	sys 0.000s
W20260709 12:13:57.189134 23340 leader_election.cc:343] T 4a007ebead5a454bb48d9784a624f5b8 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:57.189370 23374 raft_consensus.cc:3060] T 6efb52601755488885a8baf030e7fae9 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:57.191282 23300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a007ebead5a454bb48d9784a624f5b8" candidate_uuid: "3a9a63ca97694ebdb84bca730762d735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2904b089bdb249b78950db76f4a70e9f"
I20260709 12:13:57.196076 23849 raft_consensus.cc:2749] T 45e4fb3889cc4d23bab3929c3fdd731e P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:57.201285 23495 tablet_bootstrap.cc:492] T bed12810020c4496969b723bcdd4b4ec P 288a46a90f26471584043331107dc0dd: No bootstrap required, opened a new log
I20260709 12:13:57.202028 23495 ts_tablet_manager.cc:1403] T bed12810020c4496969b723bcdd4b4ec P 288a46a90f26471584043331107dc0dd: Time spent bootstrapping tablet: real 0.222s	user 0.018s	sys 0.004s
I20260709 12:13:57.205197 23497 tablet_bootstrap.cc:492] T 2eb2c8089ce14124aed9a5d834cd0522 P 3a9a63ca97694ebdb84bca730762d735: No bootstrap required, opened a new log
I20260709 12:13:57.206066 23496 tablet_bootstrap.cc:492] T 4a007ebead5a454bb48d9784a624f5b8 P 9ba0da223cf24c97bc7d225e25015924: No bootstrap required, opened a new log
I20260709 12:13:57.206650 23496 ts_tablet_manager.cc:1403] T 4a007ebead5a454bb48d9784a624f5b8 P 9ba0da223cf24c97bc7d225e25015924: Time spent bootstrapping tablet: real 0.102s	user 0.018s	sys 0.005s
I20260709 12:13:57.207067 23495 raft_consensus.cc:359] T bed12810020c4496969b723bcdd4b4ec P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:57.207820 23495 raft_consensus.cc:385] T bed12810020c4496969b723bcdd4b4ec P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:57.208213 23495 raft_consensus.cc:740] T bed12810020c4496969b723bcdd4b4ec P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 288a46a90f26471584043331107dc0dd, State: Initialized, Role: FOLLOWER
I20260709 12:13:57.209062 23495 consensus_queue.cc:260] T bed12810020c4496969b723bcdd4b4ec P 288a46a90f26471584043331107dc0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:57.201622 23583 raft_consensus.cc:2749] T 4a007ebead5a454bb48d9784a624f5b8 P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:57.211884 23497 ts_tablet_manager.cc:1403] T 2eb2c8089ce14124aed9a5d834cd0522 P 3a9a63ca97694ebdb84bca730762d735: Time spent bootstrapping tablet: real 0.215s	user 0.017s	sys 0.006s
I20260709 12:13:57.214828 23224 raft_consensus.cc:2468] T 6efb52601755488885a8baf030e7fae9 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2904b089bdb249b78950db76f4a70e9f in term 1.
I20260709 12:13:57.217697 23497 raft_consensus.cc:359] T 2eb2c8089ce14124aed9a5d834cd0522 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:57.218626 23497 raft_consensus.cc:385] T 2eb2c8089ce14124aed9a5d834cd0522 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:57.218914 23497 raft_consensus.cc:740] T 2eb2c8089ce14124aed9a5d834cd0522 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a9a63ca97694ebdb84bca730762d735, State: Initialized, Role: FOLLOWER
I20260709 12:13:57.221306 23300 raft_consensus.cc:2468] T 4a007ebead5a454bb48d9784a624f5b8 P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a9a63ca97694ebdb84bca730762d735 in term 1.
I20260709 12:13:57.223249 23341 leader_election.cc:304] T 4a007ebead5a454bb48d9784a624f5b8 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2904b089bdb249b78950db76f4a70e9f, 3a9a63ca97694ebdb84bca730762d735; no voters: 9ba0da223cf24c97bc7d225e25015924
I20260709 12:13:57.225132 23870 raft_consensus.cc:2804] T 4a007ebead5a454bb48d9784a624f5b8 P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:57.209794 23496 raft_consensus.cc:359] T 4a007ebead5a454bb48d9784a624f5b8 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:57.226344 23870 raft_consensus.cc:697] T 4a007ebead5a454bb48d9784a624f5b8 P 3a9a63ca97694ebdb84bca730762d735 [term 1 LEADER]: Becoming Leader. State: Replica: 3a9a63ca97694ebdb84bca730762d735, State: Running, Role: LEADER
I20260709 12:13:57.226872 23497 consensus_queue.cc:260] T 2eb2c8089ce14124aed9a5d834cd0522 P 3a9a63ca97694ebdb84bca730762d735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:57.226465 23496 raft_consensus.cc:385] T 4a007ebead5a454bb48d9784a624f5b8 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:57.228046 23496 raft_consensus.cc:740] T 4a007ebead5a454bb48d9784a624f5b8 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ba0da223cf24c97bc7d225e25015924, State: Initialized, Role: FOLLOWER
I20260709 12:13:57.229146 23496 consensus_queue.cc:260] T 4a007ebead5a454bb48d9784a624f5b8 P 9ba0da223cf24c97bc7d225e25015924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:57.231648 23496 ts_tablet_manager.cc:1434] T 4a007ebead5a454bb48d9784a624f5b8 P 9ba0da223cf24c97bc7d225e25015924: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.000s
I20260709 12:13:57.232816 23374 raft_consensus.cc:2468] T 6efb52601755488885a8baf030e7fae9 P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2904b089bdb249b78950db76f4a70e9f in term 1.
I20260709 12:13:57.233824 23497 ts_tablet_manager.cc:1434] T 2eb2c8089ce14124aed9a5d834cd0522 P 3a9a63ca97694ebdb84bca730762d735: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.003s
I20260709 12:13:57.234926 23497 tablet_bootstrap.cc:492] T e0352fa4cf674ba8b7d1a0239bcf76e8 P 3a9a63ca97694ebdb84bca730762d735: Bootstrap starting.
I20260709 12:13:57.236779 23498 tablet_bootstrap.cc:492] T 28d6ea7193094e8186a5394f3e7ef0b4 P 2904b089bdb249b78950db76f4a70e9f: Bootstrap starting.
I20260709 12:13:57.240942 23445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "558b91ca6fe3461da7eb4a1344ec14fc" candidate_uuid: "2904b089bdb249b78950db76f4a70e9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba0da223cf24c97bc7d225e25015924"
W20260709 12:13:57.247484 23266 leader_election.cc:343] T 558b91ca6fe3461da7eb4a1344ec14fc P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:57.237623 23496 tablet_bootstrap.cc:492] T 28d6ea7193094e8186a5394f3e7ef0b4 P 9ba0da223cf24c97bc7d225e25015924: Bootstrap starting.
I20260709 12:13:57.247888 23267 leader_election.cc:304] T 6efb52601755488885a8baf030e7fae9 P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2904b089bdb249b78950db76f4a70e9f, 3a9a63ca97694ebdb84bca730762d735; no voters: 
I20260709 12:13:57.249403 23846 raft_consensus.cc:2804] T 6efb52601755488885a8baf030e7fae9 P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:57.249967 23846 raft_consensus.cc:697] T 6efb52601755488885a8baf030e7fae9 P 2904b089bdb249b78950db76f4a70e9f [term 1 LEADER]: Becoming Leader. State: Replica: 2904b089bdb249b78950db76f4a70e9f, State: Running, Role: LEADER
I20260709 12:13:57.250865 23846 consensus_queue.cc:237] T 6efb52601755488885a8baf030e7fae9 P 2904b089bdb249b78950db76f4a70e9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:57.254961 23810 leader_election.cc:290] T 558b91ca6fe3461da7eb4a1344ec14fc P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 1 election: Requested vote from peers 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081), 288a46a90f26471584043331107dc0dd (127.12.174.129:46159)
I20260709 12:13:57.229694 23870 consensus_queue.cc:237] T 4a007ebead5a454bb48d9784a624f5b8 P 3a9a63ca97694ebdb84bca730762d735 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:57.258109 23227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "558b91ca6fe3461da7eb4a1344ec14fc" candidate_uuid: "2904b089bdb249b78950db76f4a70e9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "288a46a90f26471584043331107dc0dd"
I20260709 12:13:57.258812 23227 raft_consensus.cc:3060] T 558b91ca6fe3461da7eb4a1344ec14fc P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:57.241253 23497 tablet_bootstrap.cc:654] T e0352fa4cf674ba8b7d1a0239bcf76e8 P 3a9a63ca97694ebdb84bca730762d735: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:57.267974 23496 tablet_bootstrap.cc:654] T 28d6ea7193094e8186a5394f3e7ef0b4 P 9ba0da223cf24c97bc7d225e25015924: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:57.275224 23495 ts_tablet_manager.cc:1434] T bed12810020c4496969b723bcdd4b4ec P 288a46a90f26471584043331107dc0dd: Time spent starting tablet: real 0.071s	user 0.006s	sys 0.000s
I20260709 12:13:57.276412 23495 tablet_bootstrap.cc:492] T 3ad2f373a67b4c9cbb2183c2c73eb3e5 P 288a46a90f26471584043331107dc0dd: Bootstrap starting.
I20260709 12:13:57.281746 23498 tablet_bootstrap.cc:654] T 28d6ea7193094e8186a5394f3e7ef0b4 P 2904b089bdb249b78950db76f4a70e9f: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:57.284178 23497 tablet_bootstrap.cc:492] T e0352fa4cf674ba8b7d1a0239bcf76e8 P 3a9a63ca97694ebdb84bca730762d735: No bootstrap required, opened a new log
I20260709 12:13:57.290246 23497 ts_tablet_manager.cc:1403] T e0352fa4cf674ba8b7d1a0239bcf76e8 P 3a9a63ca97694ebdb84bca730762d735: Time spent bootstrapping tablet: real 0.056s	user 0.012s	sys 0.001s
I20260709 12:13:57.293382 23497 raft_consensus.cc:359] T e0352fa4cf674ba8b7d1a0239bcf76e8 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:57.297941 23497 raft_consensus.cc:385] T e0352fa4cf674ba8b7d1a0239bcf76e8 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:57.298372 23497 raft_consensus.cc:740] T e0352fa4cf674ba8b7d1a0239bcf76e8 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a9a63ca97694ebdb84bca730762d735, State: Initialized, Role: FOLLOWER
I20260709 12:13:57.299213 23497 consensus_queue.cc:260] T e0352fa4cf674ba8b7d1a0239bcf76e8 P 3a9a63ca97694ebdb84bca730762d735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:57.301899 23497 ts_tablet_manager.cc:1434] T e0352fa4cf674ba8b7d1a0239bcf76e8 P 3a9a63ca97694ebdb84bca730762d735: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:13:57.301244 23122 catalog_manager.cc:5697] T 4a007ebead5a454bb48d9784a624f5b8 P 3a9a63ca97694ebdb84bca730762d735 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131). New cstate: current_term: 1 leader_uuid: "3a9a63ca97694ebdb84bca730762d735" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:57.317724 23497 tablet_bootstrap.cc:492] T 9485b864470548f28810d4c52cc89850 P 3a9a63ca97694ebdb84bca730762d735: Bootstrap starting.
I20260709 12:13:57.303498 23496 tablet_bootstrap.cc:492] T 28d6ea7193094e8186a5394f3e7ef0b4 P 9ba0da223cf24c97bc7d225e25015924: No bootstrap required, opened a new log
I20260709 12:13:57.319219 23496 ts_tablet_manager.cc:1403] T 28d6ea7193094e8186a5394f3e7ef0b4 P 9ba0da223cf24c97bc7d225e25015924: Time spent bootstrapping tablet: real 0.082s	user 0.012s	sys 0.000s
I20260709 12:13:57.319458 23124 catalog_manager.cc:5697] T 6efb52601755488885a8baf030e7fae9 P 2904b089bdb249b78950db76f4a70e9f reported cstate change: term changed from 0 to 1, leader changed from <none> to 2904b089bdb249b78950db76f4a70e9f (127.12.174.130). New cstate: current_term: 1 leader_uuid: "2904b089bdb249b78950db76f4a70e9f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:57.324481 23497 tablet_bootstrap.cc:654] T 9485b864470548f28810d4c52cc89850 P 3a9a63ca97694ebdb84bca730762d735: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:57.325398 23496 raft_consensus.cc:359] T 28d6ea7193094e8186a5394f3e7ef0b4 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:57.326176 23496 raft_consensus.cc:385] T 28d6ea7193094e8186a5394f3e7ef0b4 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:57.330179 23496 raft_consensus.cc:740] T 28d6ea7193094e8186a5394f3e7ef0b4 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ba0da223cf24c97bc7d225e25015924, State: Initialized, Role: FOLLOWER
I20260709 12:13:57.306187 23495 tablet_bootstrap.cc:654] T 3ad2f373a67b4c9cbb2183c2c73eb3e5 P 288a46a90f26471584043331107dc0dd: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:57.309296 23227 raft_consensus.cc:2468] T 558b91ca6fe3461da7eb4a1344ec14fc P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2904b089bdb249b78950db76f4a70e9f in term 1.
I20260709 12:13:57.336572 23496 consensus_queue.cc:260] T 28d6ea7193094e8186a5394f3e7ef0b4 P 9ba0da223cf24c97bc7d225e25015924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:57.338136 23268 leader_election.cc:304] T 558b91ca6fe3461da7eb4a1344ec14fc P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 288a46a90f26471584043331107dc0dd, 2904b089bdb249b78950db76f4a70e9f; no voters: 9ba0da223cf24c97bc7d225e25015924
I20260709 12:13:57.339636 23874 raft_consensus.cc:2804] T 558b91ca6fe3461da7eb4a1344ec14fc P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:57.340154 23874 raft_consensus.cc:697] T 558b91ca6fe3461da7eb4a1344ec14fc P 2904b089bdb249b78950db76f4a70e9f [term 1 LEADER]: Becoming Leader. State: Replica: 2904b089bdb249b78950db76f4a70e9f, State: Running, Role: LEADER
I20260709 12:13:57.341074 23874 consensus_queue.cc:237] T 558b91ca6fe3461da7eb4a1344ec14fc P 2904b089bdb249b78950db76f4a70e9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:57.347110 23846 raft_consensus.cc:493] T 2eb2c8089ce14124aed9a5d834cd0522 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:57.347681 23846 raft_consensus.cc:515] T 2eb2c8089ce14124aed9a5d834cd0522 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:57.350719 23846 leader_election.cc:290] T 2eb2c8089ce14124aed9a5d834cd0522 P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 288a46a90f26471584043331107dc0dd (127.12.174.129:46159), 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061)
I20260709 12:13:57.351482 23374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb2c8089ce14124aed9a5d834cd0522" candidate_uuid: "2904b089bdb249b78950db76f4a70e9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a9a63ca97694ebdb84bca730762d735" is_pre_election: true
I20260709 12:13:57.352205 23374 raft_consensus.cc:2468] T 2eb2c8089ce14124aed9a5d834cd0522 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2904b089bdb249b78950db76f4a70e9f in term 0.
I20260709 12:13:57.352869 23497 tablet_bootstrap.cc:492] T 9485b864470548f28810d4c52cc89850 P 3a9a63ca97694ebdb84bca730762d735: No bootstrap required, opened a new log
I20260709 12:13:57.353446 23267 leader_election.cc:304] T 2eb2c8089ce14124aed9a5d834cd0522 P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2904b089bdb249b78950db76f4a70e9f, 3a9a63ca97694ebdb84bca730762d735; no voters: 
I20260709 12:13:57.353446 23497 ts_tablet_manager.cc:1403] T 9485b864470548f28810d4c52cc89850 P 3a9a63ca97694ebdb84bca730762d735: Time spent bootstrapping tablet: real 0.036s	user 0.013s	sys 0.000s
I20260709 12:13:57.358500 23870 raft_consensus.cc:493] T 28d6ea7193094e8186a5394f3e7ef0b4 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:57.359007 23870 raft_consensus.cc:515] T 28d6ea7193094e8186a5394f3e7ef0b4 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:57.360648 23810 raft_consensus.cc:2804] T 2eb2c8089ce14124aed9a5d834cd0522 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:57.361101 23810 raft_consensus.cc:493] T 2eb2c8089ce14124aed9a5d834cd0522 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:57.361198 23870 leader_election.cc:290] T 28d6ea7193094e8186a5394f3e7ef0b4 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789), 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081)
I20260709 12:13:57.361482 23810 raft_consensus.cc:3060] T 2eb2c8089ce14124aed9a5d834cd0522 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:57.362819 23445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d6ea7193094e8186a5394f3e7ef0b4" candidate_uuid: "3a9a63ca97694ebdb84bca730762d735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba0da223cf24c97bc7d225e25015924" is_pre_election: true
I20260709 12:13:57.363512 23445 raft_consensus.cc:2468] T 28d6ea7193094e8186a5394f3e7ef0b4 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a9a63ca97694ebdb84bca730762d735 in term 0.
I20260709 12:13:57.364867 23340 leader_election.cc:304] T 28d6ea7193094e8186a5394f3e7ef0b4 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a9a63ca97694ebdb84bca730762d735, 9ba0da223cf24c97bc7d225e25015924; no voters: 
I20260709 12:13:57.365850 23875 raft_consensus.cc:2804] T 28d6ea7193094e8186a5394f3e7ef0b4 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:57.362838 23302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d6ea7193094e8186a5394f3e7ef0b4" candidate_uuid: "3a9a63ca97694ebdb84bca730762d735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2904b089bdb249b78950db76f4a70e9f" is_pre_election: true
I20260709 12:13:57.366072 23497 raft_consensus.cc:359] T 9485b864470548f28810d4c52cc89850 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:57.366868 23497 raft_consensus.cc:385] T 9485b864470548f28810d4c52cc89850 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:57.367264 23875 raft_consensus.cc:493] T 28d6ea7193094e8186a5394f3e7ef0b4 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:57.367619 23875 raft_consensus.cc:3060] T 28d6ea7193094e8186a5394f3e7ef0b4 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:13:57.367753 23341 leader_election.cc:343] T 28d6ea7193094e8186a5394f3e7ef0b4 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:57.375573 23227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb2c8089ce14124aed9a5d834cd0522" candidate_uuid: "2904b089bdb249b78950db76f4a70e9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "288a46a90f26471584043331107dc0dd" is_pre_election: true
I20260709 12:13:57.369552 23810 raft_consensus.cc:515] T 2eb2c8089ce14124aed9a5d834cd0522 P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
W20260709 12:13:57.378471 23268 leader_election.cc:343] T 2eb2c8089ce14124aed9a5d834cd0522 P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:57.367154 23497 raft_consensus.cc:740] T 9485b864470548f28810d4c52cc89850 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a9a63ca97694ebdb84bca730762d735, State: Initialized, Role: FOLLOWER
I20260709 12:13:57.380875 23227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb2c8089ce14124aed9a5d834cd0522" candidate_uuid: "2904b089bdb249b78950db76f4a70e9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "288a46a90f26471584043331107dc0dd"
I20260709 12:13:57.381150 23497 consensus_queue.cc:260] T 9485b864470548f28810d4c52cc89850 P 3a9a63ca97694ebdb84bca730762d735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
W20260709 12:13:57.382495 23268 leader_election.cc:343] T 2eb2c8089ce14124aed9a5d834cd0522 P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:57.383596 23810 leader_election.cc:290] T 2eb2c8089ce14124aed9a5d834cd0522 P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 1 election: Requested vote from peers 288a46a90f26471584043331107dc0dd (127.12.174.129:46159), 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061)
I20260709 12:13:57.386101 23495 tablet_bootstrap.cc:492] T 3ad2f373a67b4c9cbb2183c2c73eb3e5 P 288a46a90f26471584043331107dc0dd: No bootstrap required, opened a new log
I20260709 12:13:57.388644 23495 ts_tablet_manager.cc:1403] T 3ad2f373a67b4c9cbb2183c2c73eb3e5 P 288a46a90f26471584043331107dc0dd: Time spent bootstrapping tablet: real 0.112s	user 0.013s	sys 0.002s
I20260709 12:13:57.390125 23374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb2c8089ce14124aed9a5d834cd0522" candidate_uuid: "2904b089bdb249b78950db76f4a70e9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a9a63ca97694ebdb84bca730762d735"
I20260709 12:13:57.390771 23374 raft_consensus.cc:3060] T 2eb2c8089ce14124aed9a5d834cd0522 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:57.383724 23497 ts_tablet_manager.cc:1434] T 9485b864470548f28810d4c52cc89850 P 3a9a63ca97694ebdb84bca730762d735: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.000s
I20260709 12:13:57.380178 23496 ts_tablet_manager.cc:1434] T 28d6ea7193094e8186a5394f3e7ef0b4 P 9ba0da223cf24c97bc7d225e25015924: Time spent starting tablet: real 0.061s	user 0.007s	sys 0.000s
I20260709 12:13:57.396041 23495 raft_consensus.cc:359] T 3ad2f373a67b4c9cbb2183c2c73eb3e5 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:57.399659 23495 raft_consensus.cc:385] T 3ad2f373a67b4c9cbb2183c2c73eb3e5 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:57.400123 23495 raft_consensus.cc:740] T 3ad2f373a67b4c9cbb2183c2c73eb3e5 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 288a46a90f26471584043331107dc0dd, State: Initialized, Role: FOLLOWER
I20260709 12:13:57.386086 23498 tablet_bootstrap.cc:492] T 28d6ea7193094e8186a5394f3e7ef0b4 P 2904b089bdb249b78950db76f4a70e9f: No bootstrap required, opened a new log
I20260709 12:13:57.401069 23498 ts_tablet_manager.cc:1403] T 28d6ea7193094e8186a5394f3e7ef0b4 P 2904b089bdb249b78950db76f4a70e9f: Time spent bootstrapping tablet: real 0.165s	user 0.023s	sys 0.000s
I20260709 12:13:57.401157 23495 consensus_queue.cc:260] T 3ad2f373a67b4c9cbb2183c2c73eb3e5 P 288a46a90f26471584043331107dc0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:57.399748 23497 tablet_bootstrap.cc:492] T 0f7747f7dcab4d6da9caf82c35717552 P 3a9a63ca97694ebdb84bca730762d735: Bootstrap starting.
I20260709 12:13:57.398589 23496 tablet_bootstrap.cc:492] T bed12810020c4496969b723bcdd4b4ec P 9ba0da223cf24c97bc7d225e25015924: Bootstrap starting.
I20260709 12:13:57.405680 23495 ts_tablet_manager.cc:1434] T 3ad2f373a67b4c9cbb2183c2c73eb3e5 P 288a46a90f26471584043331107dc0dd: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 12:13:57.406853 23495 tablet_bootstrap.cc:492] T 2eb2c8089ce14124aed9a5d834cd0522 P 288a46a90f26471584043331107dc0dd: Bootstrap starting.
I20260709 12:13:57.432806 23875 raft_consensus.cc:515] T 28d6ea7193094e8186a5394f3e7ef0b4 P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:57.436146 23302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d6ea7193094e8186a5394f3e7ef0b4" candidate_uuid: "3a9a63ca97694ebdb84bca730762d735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2904b089bdb249b78950db76f4a70e9f"
W20260709 12:13:57.437798 23341 leader_election.cc:343] T 28d6ea7193094e8186a5394f3e7ef0b4 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:57.439210 23498 raft_consensus.cc:359] T 28d6ea7193094e8186a5394f3e7ef0b4 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:57.440057 23498 raft_consensus.cc:385] T 28d6ea7193094e8186a5394f3e7ef0b4 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:57.440349 23498 raft_consensus.cc:740] T 28d6ea7193094e8186a5394f3e7ef0b4 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2904b089bdb249b78950db76f4a70e9f, State: Initialized, Role: FOLLOWER
I20260709 12:13:57.441200 23737 consensus_queue.cc:1048] T 45e4fb3889cc4d23bab3929c3fdd731e P 288a46a90f26471584043331107dc0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:57.441778 23496 tablet_bootstrap.cc:654] T bed12810020c4496969b723bcdd4b4ec P 9ba0da223cf24c97bc7d225e25015924: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:57.444842 23495 tablet_bootstrap.cc:654] T 2eb2c8089ce14124aed9a5d834cd0522 P 288a46a90f26471584043331107dc0dd: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:57.446959 23122 catalog_manager.cc:5697] T 558b91ca6fe3461da7eb4a1344ec14fc P 2904b089bdb249b78950db76f4a70e9f reported cstate change: term changed from 0 to 1, leader changed from <none> to 2904b089bdb249b78950db76f4a70e9f (127.12.174.130). New cstate: current_term: 1 leader_uuid: "2904b089bdb249b78950db76f4a70e9f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:57.456507 23445 raft_consensus.cc:3060] T 8bed7e0b2b804500b4898a175fba3ebe P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:57.461874 23498 consensus_queue.cc:260] T 28d6ea7193094e8186a5394f3e7ef0b4 P 2904b089bdb249b78950db76f4a70e9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:57.463795 23498 ts_tablet_manager.cc:1434] T 28d6ea7193094e8186a5394f3e7ef0b4 P 2904b089bdb249b78950db76f4a70e9f: Time spent starting tablet: real 0.032s	user 0.005s	sys 0.000s
I20260709 12:13:57.465404 23497 tablet_bootstrap.cc:654] T 0f7747f7dcab4d6da9caf82c35717552 P 3a9a63ca97694ebdb84bca730762d735: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:57.468884 23737 consensus_queue.cc:1048] T 45e4fb3889cc4d23bab3929c3fdd731e P 288a46a90f26471584043331107dc0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:57.471561 23737 consensus_queue.cc:1048] T 8bed7e0b2b804500b4898a175fba3ebe P 288a46a90f26471584043331107dc0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:57.472327 23870 raft_consensus.cc:493] T e0352fa4cf674ba8b7d1a0239bcf76e8 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:57.472946 23870 raft_consensus.cc:515] T e0352fa4cf674ba8b7d1a0239bcf76e8 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:57.477138 23495 tablet_bootstrap.cc:492] T 2eb2c8089ce14124aed9a5d834cd0522 P 288a46a90f26471584043331107dc0dd: No bootstrap required, opened a new log
I20260709 12:13:57.477902 23495 ts_tablet_manager.cc:1403] T 2eb2c8089ce14124aed9a5d834cd0522 P 288a46a90f26471584043331107dc0dd: Time spent bootstrapping tablet: real 0.071s	user 0.011s	sys 0.003s
I20260709 12:13:57.481038 23737 raft_consensus.cc:493] T bed12810020c4496969b723bcdd4b4ec P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:57.481588 23737 raft_consensus.cc:515] T bed12810020c4496969b723bcdd4b4ec P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:57.484716 23376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed12810020c4496969b723bcdd4b4ec" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a9a63ca97694ebdb84bca730762d735" is_pre_election: true
I20260709 12:13:57.485483 23376 raft_consensus.cc:2468] T bed12810020c4496969b723bcdd4b4ec P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 288a46a90f26471584043331107dc0dd in term 0.
I20260709 12:13:57.487057 23192 leader_election.cc:304] T bed12810020c4496969b723bcdd4b4ec P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 288a46a90f26471584043331107dc0dd, 3a9a63ca97694ebdb84bca730762d735; no voters: 
I20260709 12:13:57.484709 23498 tablet_bootstrap.cc:492] T 3ad2f373a67b4c9cbb2183c2c73eb3e5 P 2904b089bdb249b78950db76f4a70e9f: Bootstrap starting.
I20260709 12:13:57.487912 23796 raft_consensus.cc:2804] T bed12810020c4496969b723bcdd4b4ec P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:57.488687 23796 raft_consensus.cc:493] T bed12810020c4496969b723bcdd4b4ec P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:57.489043 23796 raft_consensus.cc:3060] T bed12810020c4496969b723bcdd4b4ec P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:57.490324 23445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed12810020c4496969b723bcdd4b4ec" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba0da223cf24c97bc7d225e25015924" is_pre_election: true
I20260709 12:13:57.491312 23737 leader_election.cc:290] T bed12810020c4496969b723bcdd4b4ec P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061), 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081)
W20260709 12:13:57.491955 23191 leader_election.cc:343] T bed12810020c4496969b723bcdd4b4ec P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:57.494892 23227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0352fa4cf674ba8b7d1a0239bcf76e8" candidate_uuid: "3a9a63ca97694ebdb84bca730762d735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "288a46a90f26471584043331107dc0dd" is_pre_election: true
I20260709 12:13:57.499990 23447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0352fa4cf674ba8b7d1a0239bcf76e8" candidate_uuid: "3a9a63ca97694ebdb84bca730762d735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba0da223cf24c97bc7d225e25015924" is_pre_election: true
W20260709 12:13:57.498292 23342 leader_election.cc:343] T e0352fa4cf674ba8b7d1a0239bcf76e8 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:57.502688 23870 leader_election.cc:290] T e0352fa4cf674ba8b7d1a0239bcf76e8 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081), 288a46a90f26471584043331107dc0dd (127.12.174.129:46159)
I20260709 12:13:57.497797 23495 raft_consensus.cc:359] T 2eb2c8089ce14124aed9a5d834cd0522 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:57.507177 23495 raft_consensus.cc:385] T 2eb2c8089ce14124aed9a5d834cd0522 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:57.507529 23495 raft_consensus.cc:740] T 2eb2c8089ce14124aed9a5d834cd0522 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 288a46a90f26471584043331107dc0dd, State: Initialized, Role: FOLLOWER
W20260709 12:13:57.507898 23340 leader_election.cc:343] T e0352fa4cf674ba8b7d1a0239bcf76e8 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:57.508261 23495 consensus_queue.cc:260] T 2eb2c8089ce14124aed9a5d834cd0522 P 288a46a90f26471584043331107dc0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:57.510643 23340 leader_election.cc:304] T e0352fa4cf674ba8b7d1a0239bcf76e8 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3a9a63ca97694ebdb84bca730762d735; no voters: 288a46a90f26471584043331107dc0dd, 9ba0da223cf24c97bc7d225e25015924
I20260709 12:13:57.512255 23663 raft_consensus.cc:2749] T e0352fa4cf674ba8b7d1a0239bcf76e8 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:57.517884 23495 ts_tablet_manager.cc:1434] T 2eb2c8089ce14124aed9a5d834cd0522 P 288a46a90f26471584043331107dc0dd: Time spent starting tablet: real 0.040s	user 0.008s	sys 0.000s
I20260709 12:13:57.519066 23495 tablet_bootstrap.cc:492] T e0352fa4cf674ba8b7d1a0239bcf76e8 P 288a46a90f26471584043331107dc0dd: Bootstrap starting.
I20260709 12:13:57.521960 23796 raft_consensus.cc:515] T bed12810020c4496969b723bcdd4b4ec P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:57.525377 23796 leader_election.cc:290] T bed12810020c4496969b723bcdd4b4ec P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 1 election: Requested vote from peers 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061), 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081)
I20260709 12:13:57.526739 23445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed12810020c4496969b723bcdd4b4ec" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba0da223cf24c97bc7d225e25015924"
I20260709 12:13:57.529500 23516 raft_consensus.cc:493] T 3ad2f373a67b4c9cbb2183c2c73eb3e5 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:57.529986 23875 leader_election.cc:290] T 28d6ea7193094e8186a5394f3e7ef0b4 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 election: Requested vote from peers 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789), 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081)
I20260709 12:13:57.531076 23376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed12810020c4496969b723bcdd4b4ec" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a9a63ca97694ebdb84bca730762d735"
I20260709 12:13:57.564543 23376 raft_consensus.cc:3060] T bed12810020c4496969b723bcdd4b4ec P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:57.564152 23516 raft_consensus.cc:515] T 3ad2f373a67b4c9cbb2183c2c73eb3e5 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:57.534876 23737 consensus_queue.cc:1048] T 8bed7e0b2b804500b4898a175fba3ebe P 288a46a90f26471584043331107dc0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:57.533504 23447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d6ea7193094e8186a5394f3e7ef0b4" candidate_uuid: "3a9a63ca97694ebdb84bca730762d735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba0da223cf24c97bc7d225e25015924"
I20260709 12:13:57.566548 23447 raft_consensus.cc:3060] T 28d6ea7193094e8186a5394f3e7ef0b4 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:57.566960 23516 leader_election.cc:290] T 3ad2f373a67b4c9cbb2183c2c73eb3e5 P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081), 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789)
I20260709 12:13:57.544351 23374 raft_consensus.cc:2468] T 2eb2c8089ce14124aed9a5d834cd0522 P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2904b089bdb249b78950db76f4a70e9f in term 1.
I20260709 12:13:57.571215 23267 leader_election.cc:304] T 2eb2c8089ce14124aed9a5d834cd0522 P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2904b089bdb249b78950db76f4a70e9f, 3a9a63ca97694ebdb84bca730762d735; no voters: 288a46a90f26471584043331107dc0dd
I20260709 12:13:57.573387 23874 raft_consensus.cc:2804] T 2eb2c8089ce14124aed9a5d834cd0522 P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:57.574097 23874 raft_consensus.cc:697] T 2eb2c8089ce14124aed9a5d834cd0522 P 2904b089bdb249b78950db76f4a70e9f [term 1 LEADER]: Becoming Leader. State: Replica: 2904b089bdb249b78950db76f4a70e9f, State: Running, Role: LEADER
I20260709 12:13:57.575004 23874 consensus_queue.cc:237] T 2eb2c8089ce14124aed9a5d834cd0522 P 2904b089bdb249b78950db76f4a70e9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:57.580428 23300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad2f373a67b4c9cbb2183c2c73eb3e5" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2904b089bdb249b78950db76f4a70e9f" is_pre_election: true
W20260709 12:13:57.586460 23192 leader_election.cc:343] T 3ad2f373a67b4c9cbb2183c2c73eb3e5 P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:57.595619 23447 raft_consensus.cc:2468] T 28d6ea7193094e8186a5394f3e7ef0b4 P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a9a63ca97694ebdb84bca730762d735 in term 1.
I20260709 12:13:57.546495 23496 tablet_bootstrap.cc:492] T bed12810020c4496969b723bcdd4b4ec P 9ba0da223cf24c97bc7d225e25015924: No bootstrap required, opened a new log
I20260709 12:13:57.549577 23495 tablet_bootstrap.cc:654] T e0352fa4cf674ba8b7d1a0239bcf76e8 P 288a46a90f26471584043331107dc0dd: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:57.599036 23496 ts_tablet_manager.cc:1403] T bed12810020c4496969b723bcdd4b4ec P 9ba0da223cf24c97bc7d225e25015924: Time spent bootstrapping tablet: real 0.201s	user 0.013s	sys 0.000s
I20260709 12:13:57.600368 23340 leader_election.cc:304] T 28d6ea7193094e8186a5394f3e7ef0b4 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3a9a63ca97694ebdb84bca730762d735, 9ba0da223cf24c97bc7d225e25015924; no voters: 2904b089bdb249b78950db76f4a70e9f
I20260709 12:13:57.601318 23849 raft_consensus.cc:493] T 4a007ebead5a454bb48d9784a624f5b8 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:57.601629 23870 raft_consensus.cc:2804] T 28d6ea7193094e8186a5394f3e7ef0b4 P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:57.602336 23870 raft_consensus.cc:697] T 28d6ea7193094e8186a5394f3e7ef0b4 P 3a9a63ca97694ebdb84bca730762d735 [term 1 LEADER]: Becoming Leader. State: Replica: 3a9a63ca97694ebdb84bca730762d735, State: Running, Role: LEADER
I20260709 12:13:57.601934 23849 raft_consensus.cc:515] T 4a007ebead5a454bb48d9784a624f5b8 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:57.603262 23870 consensus_queue.cc:237] T 28d6ea7193094e8186a5394f3e7ef0b4 P 3a9a63ca97694ebdb84bca730762d735 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:57.605636 23300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a007ebead5a454bb48d9784a624f5b8" candidate_uuid: "9ba0da223cf24c97bc7d225e25015924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2904b089bdb249b78950db76f4a70e9f" is_pre_election: true
I20260709 12:13:57.551447 23497 tablet_bootstrap.cc:492] T 0f7747f7dcab4d6da9caf82c35717552 P 3a9a63ca97694ebdb84bca730762d735: No bootstrap required, opened a new log
I20260709 12:13:57.606566 23300 raft_consensus.cc:2393] T 4a007ebead5a454bb48d9784a624f5b8 P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ba0da223cf24c97bc7d225e25015924 in current term 1: Already voted for candidate 3a9a63ca97694ebdb84bca730762d735 in this term.
I20260709 12:13:57.607005 23376 raft_consensus.cc:2468] T bed12810020c4496969b723bcdd4b4ec P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 288a46a90f26471584043331107dc0dd in term 1.
I20260709 12:13:57.611563 23192 leader_election.cc:304] T bed12810020c4496969b723bcdd4b4ec P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 288a46a90f26471584043331107dc0dd, 3a9a63ca97694ebdb84bca730762d735; no voters: 
I20260709 12:13:57.612635 23737 raft_consensus.cc:2804] T bed12810020c4496969b723bcdd4b4ec P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:57.611629 23496 raft_consensus.cc:359] T bed12810020c4496969b723bcdd4b4ec P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:57.613186 23737 raft_consensus.cc:697] T bed12810020c4496969b723bcdd4b4ec P 288a46a90f26471584043331107dc0dd [term 1 LEADER]: Becoming Leader. State: Replica: 288a46a90f26471584043331107dc0dd, State: Running, Role: LEADER
I20260709 12:13:57.608534 23375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a007ebead5a454bb48d9784a624f5b8" candidate_uuid: "9ba0da223cf24c97bc7d225e25015924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a9a63ca97694ebdb84bca730762d735" is_pre_election: true
I20260709 12:13:57.609808 23849 leader_election.cc:290] T 4a007ebead5a454bb48d9784a624f5b8 P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789), 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061)
I20260709 12:13:57.607101 23497 ts_tablet_manager.cc:1403] T 0f7747f7dcab4d6da9caf82c35717552 P 3a9a63ca97694ebdb84bca730762d735: Time spent bootstrapping tablet: real 0.208s	user 0.012s	sys 0.001s
I20260709 12:13:57.618949 23415 leader_election.cc:304] T 4a007ebead5a454bb48d9784a624f5b8 P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ba0da223cf24c97bc7d225e25015924; no voters: 2904b089bdb249b78950db76f4a70e9f, 3a9a63ca97694ebdb84bca730762d735
I20260709 12:13:57.619676 23496 raft_consensus.cc:385] T bed12810020c4496969b723bcdd4b4ec P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:57.618657 23737 consensus_queue.cc:237] T bed12810020c4496969b723bcdd4b4ec P 288a46a90f26471584043331107dc0dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:57.621281 23496 raft_consensus.cc:740] T bed12810020c4496969b723bcdd4b4ec P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ba0da223cf24c97bc7d225e25015924, State: Initialized, Role: FOLLOWER
I20260709 12:13:57.620957 23497 raft_consensus.cc:359] T 0f7747f7dcab4d6da9caf82c35717552 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:57.627358 23495 tablet_bootstrap.cc:492] T e0352fa4cf674ba8b7d1a0239bcf76e8 P 288a46a90f26471584043331107dc0dd: No bootstrap required, opened a new log
I20260709 12:13:57.621541 23849 raft_consensus.cc:3060] T 4a007ebead5a454bb48d9784a624f5b8 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:57.647071 23495 ts_tablet_manager.cc:1403] T e0352fa4cf674ba8b7d1a0239bcf76e8 P 288a46a90f26471584043331107dc0dd: Time spent bootstrapping tablet: real 0.128s	user 0.013s	sys 0.003s
I20260709 12:13:57.646725 23496 consensus_queue.cc:260] T bed12810020c4496969b723bcdd4b4ec P 9ba0da223cf24c97bc7d225e25015924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:57.646219 23497 raft_consensus.cc:385] T 0f7747f7dcab4d6da9caf82c35717552 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:57.648252 23497 raft_consensus.cc:740] T 0f7747f7dcab4d6da9caf82c35717552 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a9a63ca97694ebdb84bca730762d735, State: Initialized, Role: FOLLOWER
I20260709 12:13:57.649492 23900 raft_consensus.cc:493] T 2eb2c8089ce14124aed9a5d834cd0522 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:57.650108 23900 raft_consensus.cc:515] T 2eb2c8089ce14124aed9a5d834cd0522 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:57.650620 23496 ts_tablet_manager.cc:1434] T bed12810020c4496969b723bcdd4b4ec P 9ba0da223cf24c97bc7d225e25015924: Time spent starting tablet: real 0.050s	user 0.014s	sys 0.004s
I20260709 12:13:57.651895 23496 tablet_bootstrap.cc:492] T 558b91ca6fe3461da7eb4a1344ec14fc P 9ba0da223cf24c97bc7d225e25015924: Bootstrap starting.
I20260709 12:13:57.652377 23900 leader_election.cc:290] T 2eb2c8089ce14124aed9a5d834cd0522 P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789), 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061)
I20260709 12:13:57.654371 23375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb2c8089ce14124aed9a5d834cd0522" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a9a63ca97694ebdb84bca730762d735" is_pre_election: true
I20260709 12:13:57.655228 23375 raft_consensus.cc:2393] T 2eb2c8089ce14124aed9a5d834cd0522 P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 288a46a90f26471584043331107dc0dd in current term 1: Already voted for candidate 2904b089bdb249b78950db76f4a70e9f in this term.
I20260709 12:13:57.658169 23496 tablet_bootstrap.cc:654] T 558b91ca6fe3461da7eb4a1344ec14fc P 9ba0da223cf24c97bc7d225e25015924: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:57.660391 23302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb2c8089ce14124aed9a5d834cd0522" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2904b089bdb249b78950db76f4a70e9f" is_pre_election: true
I20260709 12:13:57.660755 23497 consensus_queue.cc:260] T 0f7747f7dcab4d6da9caf82c35717552 P 3a9a63ca97694ebdb84bca730762d735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:57.662284 23192 leader_election.cc:304] T 2eb2c8089ce14124aed9a5d834cd0522 P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 288a46a90f26471584043331107dc0dd; no voters: 2904b089bdb249b78950db76f4a70e9f, 3a9a63ca97694ebdb84bca730762d735
I20260709 12:13:57.663861 23900 raft_consensus.cc:3060] T 2eb2c8089ce14124aed9a5d834cd0522 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:13:57.665259 23191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.132:46081, user_credentials={real_user=slave}} blocked reactor thread for 122540us
I20260709 12:13:57.666972 23447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad2f373a67b4c9cbb2183c2c73eb3e5" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba0da223cf24c97bc7d225e25015924" is_pre_election: true
I20260709 12:13:57.666846 23123 catalog_manager.cc:5697] T 28d6ea7193094e8186a5394f3e7ef0b4 P 3a9a63ca97694ebdb84bca730762d735 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131). New cstate: current_term: 1 leader_uuid: "3a9a63ca97694ebdb84bca730762d735" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } health_report { overall_health: UNKNOWN } } }
W20260709 12:13:57.668826 23191 leader_election.cc:343] T bed12810020c4496969b723bcdd4b4ec P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:13:57.680884 23191 leader_election.cc:343] T 3ad2f373a67b4c9cbb2183c2c73eb3e5 P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:57.681414 23191 leader_election.cc:304] T 3ad2f373a67b4c9cbb2183c2c73eb3e5 P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 288a46a90f26471584043331107dc0dd; no voters: 2904b089bdb249b78950db76f4a70e9f, 9ba0da223cf24c97bc7d225e25015924
I20260709 12:13:57.688223 23495 raft_consensus.cc:359] T e0352fa4cf674ba8b7d1a0239bcf76e8 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:57.689174 23495 raft_consensus.cc:385] T e0352fa4cf674ba8b7d1a0239bcf76e8 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:57.691679 23865 raft_consensus.cc:493] T bed12810020c4496969b723bcdd4b4ec P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:57.711011 23865 raft_consensus.cc:515] T bed12810020c4496969b723bcdd4b4ec P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:57.713713 23865 leader_election.cc:290] T bed12810020c4496969b723bcdd4b4ec P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061), 288a46a90f26471584043331107dc0dd (127.12.174.129:46159)
I20260709 12:13:57.693104 23497 ts_tablet_manager.cc:1434] T 0f7747f7dcab4d6da9caf82c35717552 P 3a9a63ca97694ebdb84bca730762d735: Time spent starting tablet: real 0.075s	user 0.008s	sys 0.000s
I20260709 12:13:57.717763 23497 tablet_bootstrap.cc:492] T 54a02c3fbc0b4807998d018f9c2ecbc3 P 3a9a63ca97694ebdb84bca730762d735: Bootstrap starting.
I20260709 12:13:57.719650 23495 raft_consensus.cc:740] T e0352fa4cf674ba8b7d1a0239bcf76e8 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 288a46a90f26471584043331107dc0dd, State: Initialized, Role: FOLLOWER
I20260709 12:13:57.722314 23495 consensus_queue.cc:260] T e0352fa4cf674ba8b7d1a0239bcf76e8 P 288a46a90f26471584043331107dc0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:57.722347 23375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed12810020c4496969b723bcdd4b4ec" candidate_uuid: "9ba0da223cf24c97bc7d225e25015924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a9a63ca97694ebdb84bca730762d735" is_pre_election: true
I20260709 12:13:57.725955 23375 raft_consensus.cc:2393] T bed12810020c4496969b723bcdd4b4ec P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ba0da223cf24c97bc7d225e25015924 in current term 1: Already voted for candidate 288a46a90f26471584043331107dc0dd in this term.
I20260709 12:13:57.721258 23849 raft_consensus.cc:2749] T 4a007ebead5a454bb48d9784a624f5b8 P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:57.710160 23911 raft_consensus.cc:2749] T 3ad2f373a67b4c9cbb2183c2c73eb3e5 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:57.735453 23496 tablet_bootstrap.cc:492] T 558b91ca6fe3461da7eb4a1344ec14fc P 9ba0da223cf24c97bc7d225e25015924: No bootstrap required, opened a new log
I20260709 12:13:57.739291 23496 ts_tablet_manager.cc:1403] T 558b91ca6fe3461da7eb4a1344ec14fc P 9ba0da223cf24c97bc7d225e25015924: Time spent bootstrapping tablet: real 0.088s	user 0.029s	sys 0.037s
I20260709 12:13:57.744774 23495 ts_tablet_manager.cc:1434] T e0352fa4cf674ba8b7d1a0239bcf76e8 P 288a46a90f26471584043331107dc0dd: Time spent starting tablet: real 0.097s	user 0.005s	sys 0.003s
I20260709 12:13:57.746856 23495 tablet_bootstrap.cc:492] T 0f7747f7dcab4d6da9caf82c35717552 P 288a46a90f26471584043331107dc0dd: Bootstrap starting.
I20260709 12:13:57.752277 23498 tablet_bootstrap.cc:654] T 3ad2f373a67b4c9cbb2183c2c73eb3e5 P 2904b089bdb249b78950db76f4a70e9f: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:57.753309 23900 raft_consensus.cc:2749] T 2eb2c8089ce14124aed9a5d834cd0522 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:57.738621 23497 tablet_bootstrap.cc:654] T 54a02c3fbc0b4807998d018f9c2ecbc3 P 3a9a63ca97694ebdb84bca730762d735: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:57.764192 23495 tablet_bootstrap.cc:654] T 0f7747f7dcab4d6da9caf82c35717552 P 288a46a90f26471584043331107dc0dd: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:57.750278 23496 raft_consensus.cc:359] T 558b91ca6fe3461da7eb4a1344ec14fc P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:57.765049 23496 raft_consensus.cc:385] T 558b91ca6fe3461da7eb4a1344ec14fc P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:57.765420 23496 raft_consensus.cc:740] T 558b91ca6fe3461da7eb4a1344ec14fc P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ba0da223cf24c97bc7d225e25015924, State: Initialized, Role: FOLLOWER
W20260709 12:13:57.766360 23266 consensus_peers.cc:597] T 558b91ca6fe3461da7eb4a1344ec14fc P 2904b089bdb249b78950db76f4a70e9f -> Peer 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081): Couldn't send request to peer 9ba0da223cf24c97bc7d225e25015924. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:57.766812 23497 tablet_bootstrap.cc:492] T 54a02c3fbc0b4807998d018f9c2ecbc3 P 3a9a63ca97694ebdb84bca730762d735: No bootstrap required, opened a new log
I20260709 12:13:57.772289 23496 consensus_queue.cc:260] T 558b91ca6fe3461da7eb4a1344ec14fc P 9ba0da223cf24c97bc7d225e25015924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:57.779055 23497 ts_tablet_manager.cc:1403] T 54a02c3fbc0b4807998d018f9c2ecbc3 P 3a9a63ca97694ebdb84bca730762d735: Time spent bootstrapping tablet: real 0.062s	user 0.013s	sys 0.000s
I20260709 12:13:57.780571 23496 ts_tablet_manager.cc:1434] T 558b91ca6fe3461da7eb4a1344ec14fc P 9ba0da223cf24c97bc7d225e25015924: Time spent starting tablet: real 0.040s	user 0.006s	sys 0.000s
I20260709 12:13:57.773689 23874 consensus_queue.cc:1048] T 6efb52601755488885a8baf030e7fae9 P 2904b089bdb249b78950db76f4a70e9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:57.782632 23840 consensus_queue.cc:1048] T 4a007ebead5a454bb48d9784a624f5b8 P 3a9a63ca97694ebdb84bca730762d735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:57.783573 23497 raft_consensus.cc:359] T 54a02c3fbc0b4807998d018f9c2ecbc3 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:57.784319 23497 raft_consensus.cc:385] T 54a02c3fbc0b4807998d018f9c2ecbc3 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:57.783442 23496 tablet_bootstrap.cc:492] T e0352fa4cf674ba8b7d1a0239bcf76e8 P 9ba0da223cf24c97bc7d225e25015924: Bootstrap starting.
I20260709 12:13:57.787919 23840 raft_consensus.cc:493] T 0f7747f7dcab4d6da9caf82c35717552 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:57.788585 23840 raft_consensus.cc:515] T 0f7747f7dcab4d6da9caf82c35717552 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:57.791391 23840 leader_election.cc:290] T 0f7747f7dcab4d6da9caf82c35717552 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 288a46a90f26471584043331107dc0dd (127.12.174.129:46159), 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789)
I20260709 12:13:57.795732 23227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed12810020c4496969b723bcdd4b4ec" candidate_uuid: "9ba0da223cf24c97bc7d225e25015924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "288a46a90f26471584043331107dc0dd" is_pre_election: true
I20260709 12:13:57.791114 23125 catalog_manager.cc:5697] T 2eb2c8089ce14124aed9a5d834cd0522 P 2904b089bdb249b78950db76f4a70e9f reported cstate change: term changed from 0 to 1, leader changed from <none> to 2904b089bdb249b78950db76f4a70e9f (127.12.174.130). New cstate: current_term: 1 leader_uuid: "2904b089bdb249b78950db76f4a70e9f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:57.784649 23497 raft_consensus.cc:740] T 54a02c3fbc0b4807998d018f9c2ecbc3 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a9a63ca97694ebdb84bca730762d735, State: Initialized, Role: FOLLOWER
I20260709 12:13:57.813611 23497 consensus_queue.cc:260] T 54a02c3fbc0b4807998d018f9c2ecbc3 P 3a9a63ca97694ebdb84bca730762d735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:57.816898 23497 ts_tablet_manager.cc:1434] T 54a02c3fbc0b4807998d018f9c2ecbc3 P 3a9a63ca97694ebdb84bca730762d735: Time spent starting tablet: real 0.037s	user 0.007s	sys 0.000s
I20260709 12:13:57.822011 23416 leader_election.cc:304] T bed12810020c4496969b723bcdd4b4ec P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ba0da223cf24c97bc7d225e25015924; no voters: 288a46a90f26471584043331107dc0dd, 3a9a63ca97694ebdb84bca730762d735
I20260709 12:13:57.822292 23840 consensus_queue.cc:1048] T 4a007ebead5a454bb48d9784a624f5b8 P 3a9a63ca97694ebdb84bca730762d735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:57.823155 23495 tablet_bootstrap.cc:492] T 0f7747f7dcab4d6da9caf82c35717552 P 288a46a90f26471584043331107dc0dd: No bootstrap required, opened a new log
I20260709 12:13:57.823554 23849 raft_consensus.cc:3060] T bed12810020c4496969b723bcdd4b4ec P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:57.823827 23495 ts_tablet_manager.cc:1403] T 0f7747f7dcab4d6da9caf82c35717552 P 288a46a90f26471584043331107dc0dd: Time spent bootstrapping tablet: real 0.077s	user 0.009s	sys 0.009s
I20260709 12:13:57.827448 23495 raft_consensus.cc:359] T 0f7747f7dcab4d6da9caf82c35717552 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:57.828284 23495 raft_consensus.cc:385] T 0f7747f7dcab4d6da9caf82c35717552 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:57.828557 23495 raft_consensus.cc:740] T 0f7747f7dcab4d6da9caf82c35717552 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 288a46a90f26471584043331107dc0dd, State: Initialized, Role: FOLLOWER
I20260709 12:13:57.829222 23495 consensus_queue.cc:260] T 0f7747f7dcab4d6da9caf82c35717552 P 288a46a90f26471584043331107dc0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:57.830559 23840 raft_consensus.cc:493] T 9485b864470548f28810d4c52cc89850 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:57.831148 23840 raft_consensus.cc:515] T 9485b864470548f28810d4c52cc89850 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:57.831983 23495 ts_tablet_manager.cc:1434] T 0f7747f7dcab4d6da9caf82c35717552 P 288a46a90f26471584043331107dc0dd: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:13:57.833143 23495 tablet_bootstrap.cc:492] T e3d86fc25f7146c9b1af99387a07bdec P 288a46a90f26471584043331107dc0dd: Bootstrap starting.
I20260709 12:13:57.834272 23840 leader_election.cc:290] T 9485b864470548f28810d4c52cc89850 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789), 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081)
I20260709 12:13:57.835951 23450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9485b864470548f28810d4c52cc89850" candidate_uuid: "3a9a63ca97694ebdb84bca730762d735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba0da223cf24c97bc7d225e25015924" is_pre_election: true
I20260709 12:13:57.838091 23496 tablet_bootstrap.cc:654] T e0352fa4cf674ba8b7d1a0239bcf76e8 P 9ba0da223cf24c97bc7d225e25015924: Neither blocks nor log segments found. Creating new log.
W20260709 12:13:57.838532 23340 leader_election.cc:343] T 9485b864470548f28810d4c52cc89850 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:57.841220 23302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7747f7dcab4d6da9caf82c35717552" candidate_uuid: "3a9a63ca97694ebdb84bca730762d735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2904b089bdb249b78950db76f4a70e9f" is_pre_election: true
I20260709 12:13:57.839600 23495 tablet_bootstrap.cc:654] T e3d86fc25f7146c9b1af99387a07bdec P 288a46a90f26471584043331107dc0dd: Neither blocks nor log segments found. Creating new log.
W20260709 12:13:57.845012 23192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:40061, user_credentials={real_user=slave}} blocked reactor thread for 43991.4us
I20260709 12:13:57.855532 23849 raft_consensus.cc:2749] T bed12810020c4496969b723bcdd4b4ec P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:57.858821 23497 tablet_bootstrap.cc:492] T 27202f3dd66a42a3832a9cc25ba6e3e5 P 3a9a63ca97694ebdb84bca730762d735: Bootstrap starting.
I20260709 12:13:57.862412 23299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9485b864470548f28810d4c52cc89850" candidate_uuid: "3a9a63ca97694ebdb84bca730762d735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2904b089bdb249b78950db76f4a70e9f" is_pre_election: true
I20260709 12:13:57.873816 23227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7747f7dcab4d6da9caf82c35717552" candidate_uuid: "3a9a63ca97694ebdb84bca730762d735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "288a46a90f26471584043331107dc0dd" is_pre_election: true
I20260709 12:13:57.873533 23122 catalog_manager.cc:5697] T bed12810020c4496969b723bcdd4b4ec P 288a46a90f26471584043331107dc0dd reported cstate change: term changed from 0 to 1, leader changed from <none> to 288a46a90f26471584043331107dc0dd (127.12.174.129). New cstate: current_term: 1 leader_uuid: "288a46a90f26471584043331107dc0dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:57.874576 23227 raft_consensus.cc:2468] T 0f7747f7dcab4d6da9caf82c35717552 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a9a63ca97694ebdb84bca730762d735 in term 0.
I20260709 12:13:57.879894 23497 tablet_bootstrap.cc:654] T 27202f3dd66a42a3832a9cc25ba6e3e5 P 3a9a63ca97694ebdb84bca730762d735: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:57.870743 23910 raft_consensus.cc:493] T e0352fa4cf674ba8b7d1a0239bcf76e8 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:57.884425 23910 raft_consensus.cc:515] T e0352fa4cf674ba8b7d1a0239bcf76e8 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
W20260709 12:13:57.870201 23341 leader_election.cc:343] T 0f7747f7dcab4d6da9caf82c35717552 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:13:57.887775 23341 leader_election.cc:343] T 9485b864470548f28810d4c52cc89850 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:57.888268 23341 leader_election.cc:304] T 9485b864470548f28810d4c52cc89850 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3a9a63ca97694ebdb84bca730762d735; no voters: 2904b089bdb249b78950db76f4a70e9f, 9ba0da223cf24c97bc7d225e25015924
I20260709 12:13:57.890918 23663 raft_consensus.cc:2749] T 9485b864470548f28810d4c52cc89850 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:57.904299 23342 leader_election.cc:304] T 0f7747f7dcab4d6da9caf82c35717552 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 288a46a90f26471584043331107dc0dd, 3a9a63ca97694ebdb84bca730762d735; no voters: 2904b089bdb249b78950db76f4a70e9f
I20260709 12:13:57.906279 23875 raft_consensus.cc:2804] T 0f7747f7dcab4d6da9caf82c35717552 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:57.906713 23875 raft_consensus.cc:493] T 0f7747f7dcab4d6da9caf82c35717552 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:57.907058 23875 raft_consensus.cc:3060] T 0f7747f7dcab4d6da9caf82c35717552 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:57.919440 23583 raft_consensus.cc:493] T 28d6ea7193094e8186a5394f3e7ef0b4 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:57.946561 23910 leader_election.cc:290] T e0352fa4cf674ba8b7d1a0239bcf76e8 P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061), 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081)
I20260709 12:13:57.948740 23875 raft_consensus.cc:515] T 0f7747f7dcab4d6da9caf82c35717552 P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:57.949939 23374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0352fa4cf674ba8b7d1a0239bcf76e8" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a9a63ca97694ebdb84bca730762d735" is_pre_election: true
I20260709 12:13:57.950678 23374 raft_consensus.cc:2468] T e0352fa4cf674ba8b7d1a0239bcf76e8 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 288a46a90f26471584043331107dc0dd in term 0.
I20260709 12:13:57.951887 23450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0352fa4cf674ba8b7d1a0239bcf76e8" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba0da223cf24c97bc7d225e25015924" is_pre_election: true
I20260709 12:13:57.940508 23583 raft_consensus.cc:515] T 28d6ea7193094e8186a5394f3e7ef0b4 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:57.965655 23875 leader_election.cc:290] T 0f7747f7dcab4d6da9caf82c35717552 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 election: Requested vote from peers 288a46a90f26471584043331107dc0dd (127.12.174.129:46159), 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789)
I20260709 12:13:57.928638 23846 consensus_queue.cc:1048] T 6efb52601755488885a8baf030e7fae9 P 2904b089bdb249b78950db76f4a70e9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 12:13:57.967257 23192 leader_election.cc:304] T e0352fa4cf674ba8b7d1a0239bcf76e8 P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 288a46a90f26471584043331107dc0dd, 3a9a63ca97694ebdb84bca730762d735; no voters: 
W20260709 12:13:57.979764 23191 leader_election.cc:343] T e0352fa4cf674ba8b7d1a0239bcf76e8 P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:57.992954 23912 raft_consensus.cc:2804] T e0352fa4cf674ba8b7d1a0239bcf76e8 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:58.009604 23583 leader_election.cc:290] T 28d6ea7193094e8186a5394f3e7ef0b4 P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061), 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081)
I20260709 12:13:58.012730 23496 tablet_bootstrap.cc:492] T e0352fa4cf674ba8b7d1a0239bcf76e8 P 9ba0da223cf24c97bc7d225e25015924: No bootstrap required, opened a new log
W20260709 12:13:58.012981 23173 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:13:58.008863 23912 raft_consensus.cc:493] T e0352fa4cf674ba8b7d1a0239bcf76e8 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:58.014566 23912 raft_consensus.cc:3060] T e0352fa4cf674ba8b7d1a0239bcf76e8 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:58.014963 23224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7747f7dcab4d6da9caf82c35717552" candidate_uuid: "3a9a63ca97694ebdb84bca730762d735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "288a46a90f26471584043331107dc0dd"
I20260709 12:13:58.015682 23224 raft_consensus.cc:3060] T 0f7747f7dcab4d6da9caf82c35717552 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:58.016598 23374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d6ea7193094e8186a5394f3e7ef0b4" candidate_uuid: "2904b089bdb249b78950db76f4a70e9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a9a63ca97694ebdb84bca730762d735" is_pre_election: true
I20260709 12:13:58.020021 23496 ts_tablet_manager.cc:1403] T e0352fa4cf674ba8b7d1a0239bcf76e8 P 9ba0da223cf24c97bc7d225e25015924: Time spent bootstrapping tablet: real 0.238s	user 0.011s	sys 0.011s
I20260709 12:13:58.029712 23498 tablet_bootstrap.cc:492] T 3ad2f373a67b4c9cbb2183c2c73eb3e5 P 2904b089bdb249b78950db76f4a70e9f: No bootstrap required, opened a new log
I20260709 12:13:58.030069 23495 tablet_bootstrap.cc:492] T e3d86fc25f7146c9b1af99387a07bdec P 288a46a90f26471584043331107dc0dd: No bootstrap required, opened a new log
I20260709 12:13:58.030368 23498 ts_tablet_manager.cc:1403] T 3ad2f373a67b4c9cbb2183c2c73eb3e5 P 2904b089bdb249b78950db76f4a70e9f: Time spent bootstrapping tablet: real 0.546s	user 0.026s	sys 0.020s
I20260709 12:13:58.030547 23495 ts_tablet_manager.cc:1403] T e3d86fc25f7146c9b1af99387a07bdec P 288a46a90f26471584043331107dc0dd: Time spent bootstrapping tablet: real 0.198s	user 0.017s	sys 0.008s
I20260709 12:13:58.031225 23299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7747f7dcab4d6da9caf82c35717552" candidate_uuid: "3a9a63ca97694ebdb84bca730762d735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2904b089bdb249b78950db76f4a70e9f"
I20260709 12:13:58.036343 23446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28d6ea7193094e8186a5394f3e7ef0b4" candidate_uuid: "2904b089bdb249b78950db76f4a70e9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba0da223cf24c97bc7d225e25015924" is_pre_election: true
I20260709 12:13:58.037364 23446 raft_consensus.cc:2393] T 28d6ea7193094e8186a5394f3e7ef0b4 P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2904b089bdb249b78950db76f4a70e9f in current term 1: Already voted for candidate 3a9a63ca97694ebdb84bca730762d735 in this term.
I20260709 12:13:58.040292 23266 leader_election.cc:304] T 28d6ea7193094e8186a5394f3e7ef0b4 P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2904b089bdb249b78950db76f4a70e9f; no voters: 3a9a63ca97694ebdb84bca730762d735, 9ba0da223cf24c97bc7d225e25015924
W20260709 12:13:58.041260 23191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:46081, user_credentials={real_user=slave}} blocked reactor thread for 69738.1us
W20260709 12:13:58.049081 23341 leader_election.cc:343] T 0f7747f7dcab4d6da9caf82c35717552 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:58.050438 23496 raft_consensus.cc:359] T e0352fa4cf674ba8b7d1a0239bcf76e8 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:58.051281 23496 raft_consensus.cc:385] T e0352fa4cf674ba8b7d1a0239bcf76e8 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:58.051580 23496 raft_consensus.cc:740] T e0352fa4cf674ba8b7d1a0239bcf76e8 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ba0da223cf24c97bc7d225e25015924, State: Initialized, Role: FOLLOWER
I20260709 12:13:58.052141 23498 raft_consensus.cc:359] T 3ad2f373a67b4c9cbb2183c2c73eb3e5 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:58.052940 23498 raft_consensus.cc:385] T 3ad2f373a67b4c9cbb2183c2c73eb3e5 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:58.053208 23498 raft_consensus.cc:740] T 3ad2f373a67b4c9cbb2183c2c73eb3e5 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2904b089bdb249b78950db76f4a70e9f, State: Initialized, Role: FOLLOWER
I20260709 12:13:58.053589 23874 raft_consensus.cc:3060] T 28d6ea7193094e8186a5394f3e7ef0b4 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:58.056860 23498 consensus_queue.cc:260] T 3ad2f373a67b4c9cbb2183c2c73eb3e5 P 2904b089bdb249b78950db76f4a70e9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:58.052291 23496 consensus_queue.cc:260] T e0352fa4cf674ba8b7d1a0239bcf76e8 P 9ba0da223cf24c97bc7d225e25015924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:58.064746 23496 ts_tablet_manager.cc:1434] T e0352fa4cf674ba8b7d1a0239bcf76e8 P 9ba0da223cf24c97bc7d225e25015924: Time spent starting tablet: real 0.044s	user 0.006s	sys 0.001s
I20260709 12:13:58.065923 23496 tablet_bootstrap.cc:492] T 3ad2f373a67b4c9cbb2183c2c73eb3e5 P 9ba0da223cf24c97bc7d225e25015924: Bootstrap starting.
I20260709 12:13:58.068497 23498 ts_tablet_manager.cc:1434] T 3ad2f373a67b4c9cbb2183c2c73eb3e5 P 2904b089bdb249b78950db76f4a70e9f: Time spent starting tablet: real 0.038s	user 0.007s	sys 0.000s
I20260709 12:13:58.069579 23846 consensus_queue.cc:1048] T 2eb2c8089ce14124aed9a5d834cd0522 P 2904b089bdb249b78950db76f4a70e9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:58.115134 23874 raft_consensus.cc:2749] T 28d6ea7193094e8186a5394f3e7ef0b4 P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:58.116048 23498 tablet_bootstrap.cc:492] T 9485b864470548f28810d4c52cc89850 P 2904b089bdb249b78950db76f4a70e9f: Bootstrap starting.
I20260709 12:13:58.115989 23846 consensus_queue.cc:1048] T 2eb2c8089ce14124aed9a5d834cd0522 P 2904b089bdb249b78950db76f4a70e9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:58.117902 23929 consensus_queue.cc:1048] T 558b91ca6fe3461da7eb4a1344ec14fc P 2904b089bdb249b78950db76f4a70e9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:58.123672 23498 tablet_bootstrap.cc:654] T 9485b864470548f28810d4c52cc89850 P 2904b089bdb249b78950db76f4a70e9f: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:58.151046 23497 tablet_bootstrap.cc:492] T 27202f3dd66a42a3832a9cc25ba6e3e5 P 3a9a63ca97694ebdb84bca730762d735: No bootstrap required, opened a new log
I20260709 12:13:58.151728 23497 ts_tablet_manager.cc:1403] T 27202f3dd66a42a3832a9cc25ba6e3e5 P 3a9a63ca97694ebdb84bca730762d735: Time spent bootstrapping tablet: real 0.293s	user 0.014s	sys 0.012s
I20260709 12:13:58.154050 23912 raft_consensus.cc:515] T e0352fa4cf674ba8b7d1a0239bcf76e8 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:58.152616 23849 raft_consensus.cc:493] T 558b91ca6fe3461da7eb4a1344ec14fc P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:58.196092 23583 raft_consensus.cc:493] T 3ad2f373a67b4c9cbb2183c2c73eb3e5 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:58.173198 23870 raft_consensus.cc:493] T 54a02c3fbc0b4807998d018f9c2ecbc3 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:58.196687 23583 raft_consensus.cc:515] T 3ad2f373a67b4c9cbb2183c2c73eb3e5 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:58.197201 23870 raft_consensus.cc:515] T 54a02c3fbc0b4807998d018f9c2ecbc3 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:58.199411 23870 leader_election.cc:290] T 54a02c3fbc0b4807998d018f9c2ecbc3 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081), 288a46a90f26471584043331107dc0dd (127.12.174.129:46159)
I20260709 12:13:58.202648 23446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0352fa4cf674ba8b7d1a0239bcf76e8" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba0da223cf24c97bc7d225e25015924"
I20260709 12:13:58.203326 23446 raft_consensus.cc:3060] T e0352fa4cf674ba8b7d1a0239bcf76e8 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:58.191954 23912 leader_election.cc:290] T e0352fa4cf674ba8b7d1a0239bcf76e8 P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 1 election: Requested vote from peers 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061), 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081)
I20260709 12:13:58.208464 23450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a02c3fbc0b4807998d018f9c2ecbc3" candidate_uuid: "3a9a63ca97694ebdb84bca730762d735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba0da223cf24c97bc7d225e25015924" is_pre_election: true
I20260709 12:13:58.197432 23376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0352fa4cf674ba8b7d1a0239bcf76e8" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a9a63ca97694ebdb84bca730762d735"
I20260709 12:13:58.209630 23376 raft_consensus.cc:3060] T e0352fa4cf674ba8b7d1a0239bcf76e8 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:13:58.210537 23340 leader_election.cc:343] T 54a02c3fbc0b4807998d018f9c2ecbc3 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:58.181530 23849 raft_consensus.cc:515] T 558b91ca6fe3461da7eb4a1344ec14fc P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:58.227741 23583 leader_election.cc:290] T 3ad2f373a67b4c9cbb2183c2c73eb3e5 P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081), 288a46a90f26471584043331107dc0dd (127.12.174.129:46159)
I20260709 12:13:58.228927 23849 leader_election.cc:290] T 558b91ca6fe3461da7eb4a1344ec14fc P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 288a46a90f26471584043331107dc0dd (127.12.174.129:46159), 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789)
I20260709 12:13:58.229255 23663 consensus_queue.cc:1048] T 28d6ea7193094e8186a5394f3e7ef0b4 P 3a9a63ca97694ebdb84bca730762d735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:58.230830 23495 raft_consensus.cc:359] T e3d86fc25f7146c9b1af99387a07bdec P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:58.231592 23495 raft_consensus.cc:385] T e3d86fc25f7146c9b1af99387a07bdec P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:58.231863 23495 raft_consensus.cc:740] T e3d86fc25f7146c9b1af99387a07bdec P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 288a46a90f26471584043331107dc0dd, State: Initialized, Role: FOLLOWER
I20260709 12:13:58.171507 23224 raft_consensus.cc:2468] T 0f7747f7dcab4d6da9caf82c35717552 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a9a63ca97694ebdb84bca730762d735 in term 1.
I20260709 12:13:58.242954 23445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad2f373a67b4c9cbb2183c2c73eb3e5" candidate_uuid: "2904b089bdb249b78950db76f4a70e9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba0da223cf24c97bc7d225e25015924" is_pre_election: true
I20260709 12:13:58.244443 23495 consensus_queue.cc:260] T e3d86fc25f7146c9b1af99387a07bdec P 288a46a90f26471584043331107dc0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:58.246227 23495 ts_tablet_manager.cc:1434] T e3d86fc25f7146c9b1af99387a07bdec P 288a46a90f26471584043331107dc0dd: Time spent starting tablet: real 0.206s	user 0.004s	sys 0.003s
I20260709 12:13:58.250496 23226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a02c3fbc0b4807998d018f9c2ecbc3" candidate_uuid: "3a9a63ca97694ebdb84bca730762d735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "288a46a90f26471584043331107dc0dd" is_pre_election: true
I20260709 12:13:58.253381 23221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "558b91ca6fe3461da7eb4a1344ec14fc" candidate_uuid: "9ba0da223cf24c97bc7d225e25015924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "288a46a90f26471584043331107dc0dd" is_pre_election: true
W20260709 12:13:58.259711 23266 leader_election.cc:343] T 3ad2f373a67b4c9cbb2183c2c73eb3e5 P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:58.263870 23496 tablet_bootstrap.cc:654] T 3ad2f373a67b4c9cbb2183c2c73eb3e5 P 9ba0da223cf24c97bc7d225e25015924: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:58.267665 23446 raft_consensus.cc:2468] T e0352fa4cf674ba8b7d1a0239bcf76e8 P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 288a46a90f26471584043331107dc0dd in term 1.
I20260709 12:13:58.268594 23226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad2f373a67b4c9cbb2183c2c73eb3e5" candidate_uuid: "2904b089bdb249b78950db76f4a70e9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "288a46a90f26471584043331107dc0dd" is_pre_election: true
I20260709 12:13:58.269292 23226 raft_consensus.cc:2468] T 3ad2f373a67b4c9cbb2183c2c73eb3e5 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2904b089bdb249b78950db76f4a70e9f in term 0.
I20260709 12:13:58.271108 23191 leader_election.cc:304] T e0352fa4cf674ba8b7d1a0239bcf76e8 P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 288a46a90f26471584043331107dc0dd, 9ba0da223cf24c97bc7d225e25015924; no voters: 
I20260709 12:13:58.272048 23912 raft_consensus.cc:2804] T e0352fa4cf674ba8b7d1a0239bcf76e8 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:58.272529 23912 raft_consensus.cc:697] T e0352fa4cf674ba8b7d1a0239bcf76e8 P 288a46a90f26471584043331107dc0dd [term 1 LEADER]: Becoming Leader. State: Replica: 288a46a90f26471584043331107dc0dd, State: Running, Role: LEADER
I20260709 12:13:58.274334 23268 leader_election.cc:304] T 3ad2f373a67b4c9cbb2183c2c73eb3e5 P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 288a46a90f26471584043331107dc0dd, 2904b089bdb249b78950db76f4a70e9f; no voters: 9ba0da223cf24c97bc7d225e25015924
I20260709 12:13:58.274653 23796 consensus_queue.cc:1048] T bed12810020c4496969b723bcdd4b4ec P 288a46a90f26471584043331107dc0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:58.273615 23912 consensus_queue.cc:237] T e0352fa4cf674ba8b7d1a0239bcf76e8 P 288a46a90f26471584043331107dc0dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:58.276964 23846 raft_consensus.cc:2804] T 3ad2f373a67b4c9cbb2183c2c73eb3e5 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:58.277321 23846 raft_consensus.cc:493] T 3ad2f373a67b4c9cbb2183c2c73eb3e5 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:58.277524 23495 tablet_bootstrap.cc:492] T 54a02c3fbc0b4807998d018f9c2ecbc3 P 288a46a90f26471584043331107dc0dd: Bootstrap starting.
I20260709 12:13:58.277638 23846 raft_consensus.cc:3060] T 3ad2f373a67b4c9cbb2183c2c73eb3e5 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:13:58.282941 23192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:45789, user_credentials={real_user=slave}} blocked reactor thread for 46928.5us
W20260709 12:13:58.282688 23342 leader_election.cc:343] T 54a02c3fbc0b4807998d018f9c2ecbc3 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:58.285122 23342 leader_election.cc:304] T 54a02c3fbc0b4807998d018f9c2ecbc3 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3a9a63ca97694ebdb84bca730762d735; no voters: 288a46a90f26471584043331107dc0dd, 9ba0da223cf24c97bc7d225e25015924
I20260709 12:13:58.301319 23342 leader_election.cc:304] T 0f7747f7dcab4d6da9caf82c35717552 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 288a46a90f26471584043331107dc0dd, 3a9a63ca97694ebdb84bca730762d735; no voters: 2904b089bdb249b78950db76f4a70e9f
I20260709 12:13:58.287588 23840 raft_consensus.cc:2749] T 54a02c3fbc0b4807998d018f9c2ecbc3 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:58.313678 23875 raft_consensus.cc:2804] T 0f7747f7dcab4d6da9caf82c35717552 P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:58.302356 23900 consensus_queue.cc:1048] T bed12810020c4496969b723bcdd4b4ec P 288a46a90f26471584043331107dc0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.025s
I20260709 12:13:58.337347 23302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "558b91ca6fe3461da7eb4a1344ec14fc" candidate_uuid: "9ba0da223cf24c97bc7d225e25015924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2904b089bdb249b78950db76f4a70e9f" is_pre_election: true
I20260709 12:13:58.352557 23415 leader_election.cc:304] T 558b91ca6fe3461da7eb4a1344ec14fc P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ba0da223cf24c97bc7d225e25015924; no voters: 288a46a90f26471584043331107dc0dd, 2904b089bdb249b78950db76f4a70e9f
I20260709 12:13:58.362236 23450 raft_consensus.cc:3060] T 558b91ca6fe3461da7eb4a1344ec14fc P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:58.363384 23910 raft_consensus.cc:493] T e3d86fc25f7146c9b1af99387a07bdec P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:58.363865 23910 raft_consensus.cc:515] T e3d86fc25f7146c9b1af99387a07bdec P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:58.366575 23910 leader_election.cc:290] T e3d86fc25f7146c9b1af99387a07bdec P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081), 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789)
I20260709 12:13:58.367098 23446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d86fc25f7146c9b1af99387a07bdec" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba0da223cf24c97bc7d225e25015924" is_pre_election: true
I20260709 12:13:58.342126 23875 raft_consensus.cc:697] T 0f7747f7dcab4d6da9caf82c35717552 P 3a9a63ca97694ebdb84bca730762d735 [term 1 LEADER]: Becoming Leader. State: Replica: 3a9a63ca97694ebdb84bca730762d735, State: Running, Role: LEADER
I20260709 12:13:58.367933 23299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d86fc25f7146c9b1af99387a07bdec" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2904b089bdb249b78950db76f4a70e9f" is_pre_election: true
I20260709 12:13:58.361621 23495 tablet_bootstrap.cc:654] T 54a02c3fbc0b4807998d018f9c2ecbc3 P 288a46a90f26471584043331107dc0dd: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:58.370457 23497 raft_consensus.cc:359] T 27202f3dd66a42a3832a9cc25ba6e3e5 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:58.382437 23497 raft_consensus.cc:385] T 27202f3dd66a42a3832a9cc25ba6e3e5 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:58.382794 23497 raft_consensus.cc:740] T 27202f3dd66a42a3832a9cc25ba6e3e5 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a9a63ca97694ebdb84bca730762d735, State: Initialized, Role: FOLLOWER
I20260709 12:13:58.383656 23497 consensus_queue.cc:260] T 27202f3dd66a42a3832a9cc25ba6e3e5 P 3a9a63ca97694ebdb84bca730762d735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:58.392253 23498 tablet_bootstrap.cc:492] T 9485b864470548f28810d4c52cc89850 P 2904b089bdb249b78950db76f4a70e9f: No bootstrap required, opened a new log
I20260709 12:13:58.392905 23498 ts_tablet_manager.cc:1403] T 9485b864470548f28810d4c52cc89850 P 2904b089bdb249b78950db76f4a70e9f: Time spent bootstrapping tablet: real 0.285s	user 0.037s	sys 0.038s
W20260709 12:13:58.391305 23191 leader_election.cc:343] T e3d86fc25f7146c9b1af99387a07bdec P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:58.406428 23376 raft_consensus.cc:2468] T e0352fa4cf674ba8b7d1a0239bcf76e8 P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 288a46a90f26471584043331107dc0dd in term 1.
I20260709 12:13:58.407128 23875 consensus_queue.cc:237] T 0f7747f7dcab4d6da9caf82c35717552 P 3a9a63ca97694ebdb84bca730762d735 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
W20260709 12:13:58.416335 23192 leader_election.cc:343] T e3d86fc25f7146c9b1af99387a07bdec P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:58.416829 23192 leader_election.cc:304] T e3d86fc25f7146c9b1af99387a07bdec P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 288a46a90f26471584043331107dc0dd; no voters: 2904b089bdb249b78950db76f4a70e9f, 9ba0da223cf24c97bc7d225e25015924
I20260709 12:13:58.417045 23497 ts_tablet_manager.cc:1434] T 27202f3dd66a42a3832a9cc25ba6e3e5 P 3a9a63ca97694ebdb84bca730762d735: Time spent starting tablet: real 0.265s	user 0.003s	sys 0.005s
I20260709 12:13:58.418098 23497 tablet_bootstrap.cc:492] T b90be1e04a3443e989951ea6bc45ed2f P 3a9a63ca97694ebdb84bca730762d735: Bootstrap starting.
I20260709 12:13:58.426139 23496 tablet_bootstrap.cc:492] T 3ad2f373a67b4c9cbb2183c2c73eb3e5 P 9ba0da223cf24c97bc7d225e25015924: No bootstrap required, opened a new log
I20260709 12:13:58.428324 23496 ts_tablet_manager.cc:1403] T 3ad2f373a67b4c9cbb2183c2c73eb3e5 P 9ba0da223cf24c97bc7d225e25015924: Time spent bootstrapping tablet: real 0.363s	user 0.017s	sys 0.011s
I20260709 12:13:58.419389 23913 raft_consensus.cc:2749] T e3d86fc25f7146c9b1af99387a07bdec P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:58.448490 23498 raft_consensus.cc:359] T 9485b864470548f28810d4c52cc89850 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:58.449429 23498 raft_consensus.cc:385] T 9485b864470548f28810d4c52cc89850 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:58.450008 23498 raft_consensus.cc:740] T 9485b864470548f28810d4c52cc89850 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2904b089bdb249b78950db76f4a70e9f, State: Initialized, Role: FOLLOWER
I20260709 12:13:58.450672 23498 consensus_queue.cc:260] T 9485b864470548f28810d4c52cc89850 P 2904b089bdb249b78950db76f4a70e9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:58.490372 23846 raft_consensus.cc:515] T 3ad2f373a67b4c9cbb2183c2c73eb3e5 P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:58.508006 23498 ts_tablet_manager.cc:1434] T 9485b864470548f28810d4c52cc89850 P 2904b089bdb249b78950db76f4a70e9f: Time spent starting tablet: real 0.115s	user 0.004s	sys 0.002s
I20260709 12:13:58.509573 23498 tablet_bootstrap.cc:492] T 0f7747f7dcab4d6da9caf82c35717552 P 2904b089bdb249b78950db76f4a70e9f: Bootstrap starting.
I20260709 12:13:58.520361 23497 tablet_bootstrap.cc:654] T b90be1e04a3443e989951ea6bc45ed2f P 3a9a63ca97694ebdb84bca730762d735: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:58.558919 23496 raft_consensus.cc:359] T 3ad2f373a67b4c9cbb2183c2c73eb3e5 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:58.560168 23496 raft_consensus.cc:385] T 3ad2f373a67b4c9cbb2183c2c73eb3e5 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:58.560523 23496 raft_consensus.cc:740] T 3ad2f373a67b4c9cbb2183c2c73eb3e5 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ba0da223cf24c97bc7d225e25015924, State: Initialized, Role: FOLLOWER
I20260709 12:13:58.561362 23496 consensus_queue.cc:260] T 3ad2f373a67b4c9cbb2183c2c73eb3e5 P 9ba0da223cf24c97bc7d225e25015924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:58.569600 23496 ts_tablet_manager.cc:1434] T 3ad2f373a67b4c9cbb2183c2c73eb3e5 P 9ba0da223cf24c97bc7d225e25015924: Time spent starting tablet: real 0.141s	user 0.008s	sys 0.000s
I20260709 12:13:58.572576 23447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad2f373a67b4c9cbb2183c2c73eb3e5" candidate_uuid: "2904b089bdb249b78950db76f4a70e9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba0da223cf24c97bc7d225e25015924"
I20260709 12:13:58.588137 23447 raft_consensus.cc:3060] T 3ad2f373a67b4c9cbb2183c2c73eb3e5 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:58.576867 23846 leader_election.cc:290] T 3ad2f373a67b4c9cbb2183c2c73eb3e5 P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 1 election: Requested vote from peers 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081), 288a46a90f26471584043331107dc0dd (127.12.174.129:46159)
I20260709 12:13:58.594666 23495 tablet_bootstrap.cc:492] T 54a02c3fbc0b4807998d018f9c2ecbc3 P 288a46a90f26471584043331107dc0dd: No bootstrap required, opened a new log
I20260709 12:13:58.595284 23495 ts_tablet_manager.cc:1403] T 54a02c3fbc0b4807998d018f9c2ecbc3 P 288a46a90f26471584043331107dc0dd: Time spent bootstrapping tablet: real 0.318s	user 0.008s	sys 0.019s
I20260709 12:13:58.598085 23496 tablet_bootstrap.cc:492] T 9485b864470548f28810d4c52cc89850 P 9ba0da223cf24c97bc7d225e25015924: Bootstrap starting.
I20260709 12:13:58.615718 23495 raft_consensus.cc:359] T 54a02c3fbc0b4807998d018f9c2ecbc3 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:58.616420 23495 raft_consensus.cc:385] T 54a02c3fbc0b4807998d018f9c2ecbc3 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:58.616642 23495 raft_consensus.cc:740] T 54a02c3fbc0b4807998d018f9c2ecbc3 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 288a46a90f26471584043331107dc0dd, State: Initialized, Role: FOLLOWER
I20260709 12:13:58.636627 23223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad2f373a67b4c9cbb2183c2c73eb3e5" candidate_uuid: "2904b089bdb249b78950db76f4a70e9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "288a46a90f26471584043331107dc0dd"
I20260709 12:13:58.637593 23223 raft_consensus.cc:3060] T 3ad2f373a67b4c9cbb2183c2c73eb3e5 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:58.644099 23496 tablet_bootstrap.cc:654] T 9485b864470548f28810d4c52cc89850 P 9ba0da223cf24c97bc7d225e25015924: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:58.655767 23124 catalog_manager.cc:5697] T e0352fa4cf674ba8b7d1a0239bcf76e8 P 288a46a90f26471584043331107dc0dd reported cstate change: term changed from 0 to 1, leader changed from <none> to 288a46a90f26471584043331107dc0dd (127.12.174.129). New cstate: current_term: 1 leader_uuid: "288a46a90f26471584043331107dc0dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:58.658634 23495 consensus_queue.cc:260] T 54a02c3fbc0b4807998d018f9c2ecbc3 P 288a46a90f26471584043331107dc0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:58.678406 23498 tablet_bootstrap.cc:654] T 0f7747f7dcab4d6da9caf82c35717552 P 2904b089bdb249b78950db76f4a70e9f: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:58.680536 23122 catalog_manager.cc:5697] T 0f7747f7dcab4d6da9caf82c35717552 P 3a9a63ca97694ebdb84bca730762d735 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131). New cstate: current_term: 1 leader_uuid: "3a9a63ca97694ebdb84bca730762d735" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:58.691380 23495 ts_tablet_manager.cc:1434] T 54a02c3fbc0b4807998d018f9c2ecbc3 P 288a46a90f26471584043331107dc0dd: Time spent starting tablet: real 0.096s	user 0.006s	sys 0.003s
I20260709 12:13:58.699301 23497 tablet_bootstrap.cc:492] T b90be1e04a3443e989951ea6bc45ed2f P 3a9a63ca97694ebdb84bca730762d735: No bootstrap required, opened a new log
I20260709 12:13:58.702147 23497 ts_tablet_manager.cc:1403] T b90be1e04a3443e989951ea6bc45ed2f P 3a9a63ca97694ebdb84bca730762d735: Time spent bootstrapping tablet: real 0.284s	user 0.014s	sys 0.002s
I20260709 12:13:58.678411 23447 raft_consensus.cc:2468] T 3ad2f373a67b4c9cbb2183c2c73eb3e5 P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2904b089bdb249b78950db76f4a70e9f in term 1.
I20260709 12:13:58.706646 23495 tablet_bootstrap.cc:492] T 509296352dfa43369c2637f89e917301 P 288a46a90f26471584043331107dc0dd: Bootstrap starting.
I20260709 12:13:58.708549 23497 raft_consensus.cc:359] T b90be1e04a3443e989951ea6bc45ed2f P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:58.709285 23497 raft_consensus.cc:385] T b90be1e04a3443e989951ea6bc45ed2f P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:58.709503 23497 raft_consensus.cc:740] T b90be1e04a3443e989951ea6bc45ed2f P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a9a63ca97694ebdb84bca730762d735, State: Initialized, Role: FOLLOWER
I20260709 12:13:58.711509 23497 consensus_queue.cc:260] T b90be1e04a3443e989951ea6bc45ed2f P 3a9a63ca97694ebdb84bca730762d735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
W20260709 12:13:58.713610 23267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:40061, user_credentials={real_user=slave}} blocked reactor thread for 365836us
I20260709 12:13:58.721432 23495 tablet_bootstrap.cc:654] T 509296352dfa43369c2637f89e917301 P 288a46a90f26471584043331107dc0dd: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:58.730602 23497 ts_tablet_manager.cc:1434] T b90be1e04a3443e989951ea6bc45ed2f P 3a9a63ca97694ebdb84bca730762d735: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.001s
I20260709 12:13:58.734683 23496 tablet_bootstrap.cc:492] T 9485b864470548f28810d4c52cc89850 P 9ba0da223cf24c97bc7d225e25015924: No bootstrap required, opened a new log
I20260709 12:13:58.735378 23496 ts_tablet_manager.cc:1403] T 9485b864470548f28810d4c52cc89850 P 9ba0da223cf24c97bc7d225e25015924: Time spent bootstrapping tablet: real 0.138s	user 0.024s	sys 0.017s
I20260709 12:13:58.730476 23875 raft_consensus.cc:493] T b90be1e04a3443e989951ea6bc45ed2f P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:58.738194 23875 raft_consensus.cc:515] T b90be1e04a3443e989951ea6bc45ed2f P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:58.742146 23266 leader_election.cc:304] T 3ad2f373a67b4c9cbb2183c2c73eb3e5 P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2904b089bdb249b78950db76f4a70e9f, 9ba0da223cf24c97bc7d225e25015924; no voters: 
I20260709 12:13:58.748056 23497 tablet_bootstrap.cc:492] T 509296352dfa43369c2637f89e917301 P 3a9a63ca97694ebdb84bca730762d735: Bootstrap starting.
I20260709 12:13:58.752835 23947 raft_consensus.cc:2804] T 3ad2f373a67b4c9cbb2183c2c73eb3e5 P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:58.742478 23938 raft_consensus.cc:2749] T 558b91ca6fe3461da7eb4a1344ec14fc P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:58.770571 23583 raft_consensus.cc:493] T 9485b864470548f28810d4c52cc89850 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:58.774060 23919 consensus_queue.cc:1048] T 28d6ea7193094e8186a5394f3e7ef0b4 P 3a9a63ca97694ebdb84bca730762d735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.020s
I20260709 12:13:58.771899 23583 raft_consensus.cc:515] T 9485b864470548f28810d4c52cc89850 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:58.778033 23583 leader_election.cc:290] T 9485b864470548f28810d4c52cc89850 P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061), 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081)
I20260709 12:13:58.778157 23497 tablet_bootstrap.cc:654] T 509296352dfa43369c2637f89e917301 P 3a9a63ca97694ebdb84bca730762d735: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:58.779429 23374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9485b864470548f28810d4c52cc89850" candidate_uuid: "2904b089bdb249b78950db76f4a70e9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a9a63ca97694ebdb84bca730762d735" is_pre_election: true
I20260709 12:13:58.780124 23374 raft_consensus.cc:2468] T 9485b864470548f28810d4c52cc89850 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2904b089bdb249b78950db76f4a70e9f in term 0.
I20260709 12:13:58.785528 23947 raft_consensus.cc:697] T 3ad2f373a67b4c9cbb2183c2c73eb3e5 P 2904b089bdb249b78950db76f4a70e9f [term 1 LEADER]: Becoming Leader. State: Replica: 2904b089bdb249b78950db76f4a70e9f, State: Running, Role: LEADER
I20260709 12:13:58.786389 23875 leader_election.cc:290] T b90be1e04a3443e989951ea6bc45ed2f P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 288a46a90f26471584043331107dc0dd (127.12.174.129:46159), 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789)
I20260709 12:13:58.786603 23947 consensus_queue.cc:237] T 3ad2f373a67b4c9cbb2183c2c73eb3e5 P 2904b089bdb249b78950db76f4a70e9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:58.789409 23301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90be1e04a3443e989951ea6bc45ed2f" candidate_uuid: "3a9a63ca97694ebdb84bca730762d735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2904b089bdb249b78950db76f4a70e9f" is_pre_election: true
W20260709 12:13:58.792819 23341 leader_election.cc:343] T b90be1e04a3443e989951ea6bc45ed2f P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:58.790287 23221 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90be1e04a3443e989951ea6bc45ed2f" candidate_uuid: "3a9a63ca97694ebdb84bca730762d735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "288a46a90f26471584043331107dc0dd" is_pre_election: true
W20260709 12:13:58.803436 23342 leader_election.cc:343] T b90be1e04a3443e989951ea6bc45ed2f P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:58.803964 23342 leader_election.cc:304] T b90be1e04a3443e989951ea6bc45ed2f P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3a9a63ca97694ebdb84bca730762d735; no voters: 288a46a90f26471584043331107dc0dd, 2904b089bdb249b78950db76f4a70e9f
I20260709 12:13:58.805028 23496 raft_consensus.cc:359] T 9485b864470548f28810d4c52cc89850 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:58.807499 23496 raft_consensus.cc:385] T 9485b864470548f28810d4c52cc89850 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:58.807833 23496 raft_consensus.cc:740] T 9485b864470548f28810d4c52cc89850 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ba0da223cf24c97bc7d225e25015924, State: Initialized, Role: FOLLOWER
I20260709 12:13:58.808714 23496 consensus_queue.cc:260] T 9485b864470548f28810d4c52cc89850 P 9ba0da223cf24c97bc7d225e25015924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:58.811136 23496 ts_tablet_manager.cc:1434] T 9485b864470548f28810d4c52cc89850 P 9ba0da223cf24c97bc7d225e25015924: Time spent starting tablet: real 0.075s	user 0.007s	sys 0.000s
I20260709 12:13:58.812258 23496 tablet_bootstrap.cc:492] T e3d86fc25f7146c9b1af99387a07bdec P 9ba0da223cf24c97bc7d225e25015924: Bootstrap starting.
I20260709 12:13:58.805806 23910 consensus_queue.cc:1048] T e0352fa4cf674ba8b7d1a0239bcf76e8 P 288a46a90f26471584043331107dc0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:58.814848 23912 consensus_queue.cc:1048] T e0352fa4cf674ba8b7d1a0239bcf76e8 P 288a46a90f26471584043331107dc0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:58.816706 23267 leader_election.cc:304] T 9485b864470548f28810d4c52cc89850 P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2904b089bdb249b78950db76f4a70e9f, 3a9a63ca97694ebdb84bca730762d735; no voters: 
I20260709 12:13:58.817679 23870 raft_consensus.cc:2749] T b90be1e04a3443e989951ea6bc45ed2f P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:58.820652 23446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9485b864470548f28810d4c52cc89850" candidate_uuid: "2904b089bdb249b78950db76f4a70e9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba0da223cf24c97bc7d225e25015924" is_pre_election: true
I20260709 12:13:58.822990 23583 raft_consensus.cc:2804] T 9485b864470548f28810d4c52cc89850 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:58.823451 23583 raft_consensus.cc:493] T 9485b864470548f28810d4c52cc89850 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:58.823933 23583 raft_consensus.cc:3060] T 9485b864470548f28810d4c52cc89850 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:58.821514 23446 raft_consensus.cc:2468] T 9485b864470548f28810d4c52cc89850 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2904b089bdb249b78950db76f4a70e9f in term 0.
I20260709 12:13:58.843541 23223 raft_consensus.cc:2468] T 3ad2f373a67b4c9cbb2183c2c73eb3e5 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2904b089bdb249b78950db76f4a70e9f in term 1.
I20260709 12:13:58.871884 23583 raft_consensus.cc:515] T 9485b864470548f28810d4c52cc89850 P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:58.876816 23840 raft_consensus.cc:493] T 27202f3dd66a42a3832a9cc25ba6e3e5 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:58.877487 23840 raft_consensus.cc:515] T 27202f3dd66a42a3832a9cc25ba6e3e5 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:58.881867 23497 tablet_bootstrap.cc:492] T 509296352dfa43369c2637f89e917301 P 3a9a63ca97694ebdb84bca730762d735: No bootstrap required, opened a new log
I20260709 12:13:58.882514 23497 ts_tablet_manager.cc:1403] T 509296352dfa43369c2637f89e917301 P 3a9a63ca97694ebdb84bca730762d735: Time spent bootstrapping tablet: real 0.135s	user 0.016s	sys 0.005s
I20260709 12:13:58.883347 23840 leader_election.cc:290] T 27202f3dd66a42a3832a9cc25ba6e3e5 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789), 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081)
I20260709 12:13:58.889312 23299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27202f3dd66a42a3832a9cc25ba6e3e5" candidate_uuid: "3a9a63ca97694ebdb84bca730762d735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2904b089bdb249b78950db76f4a70e9f" is_pre_election: true
I20260709 12:13:58.889958 23448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27202f3dd66a42a3832a9cc25ba6e3e5" candidate_uuid: "3a9a63ca97694ebdb84bca730762d735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba0da223cf24c97bc7d225e25015924" is_pre_election: true
W20260709 12:13:58.891034 23341 leader_election.cc:343] T 27202f3dd66a42a3832a9cc25ba6e3e5 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:58.900935 23375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9485b864470548f28810d4c52cc89850" candidate_uuid: "2904b089bdb249b78950db76f4a70e9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a9a63ca97694ebdb84bca730762d735"
I20260709 12:13:58.901855 23375 raft_consensus.cc:3060] T 9485b864470548f28810d4c52cc89850 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:13:58.903471 23340 leader_election.cc:343] T 27202f3dd66a42a3832a9cc25ba6e3e5 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:58.904102 23340 leader_election.cc:304] T 27202f3dd66a42a3832a9cc25ba6e3e5 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3a9a63ca97694ebdb84bca730762d735; no voters: 2904b089bdb249b78950db76f4a70e9f, 9ba0da223cf24c97bc7d225e25015924
I20260709 12:13:58.907425 23840 raft_consensus.cc:2749] T 27202f3dd66a42a3832a9cc25ba6e3e5 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:58.917451 23583 leader_election.cc:290] T 9485b864470548f28810d4c52cc89850 P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 1 election: Requested vote from peers 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061), 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081)
I20260709 12:13:58.915608 23497 raft_consensus.cc:359] T 509296352dfa43369c2637f89e917301 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:58.914983 23496 tablet_bootstrap.cc:654] T e3d86fc25f7146c9b1af99387a07bdec P 9ba0da223cf24c97bc7d225e25015924: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:58.920174 23497 raft_consensus.cc:385] T 509296352dfa43369c2637f89e917301 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:58.920653 23497 raft_consensus.cc:740] T 509296352dfa43369c2637f89e917301 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a9a63ca97694ebdb84bca730762d735, State: Initialized, Role: FOLLOWER
I20260709 12:13:58.926676 23448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9485b864470548f28810d4c52cc89850" candidate_uuid: "2904b089bdb249b78950db76f4a70e9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba0da223cf24c97bc7d225e25015924"
I20260709 12:13:58.927479 23448 raft_consensus.cc:3060] T 9485b864470548f28810d4c52cc89850 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:58.934226 23497 consensus_queue.cc:260] T 509296352dfa43369c2637f89e917301 P 3a9a63ca97694ebdb84bca730762d735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:58.938314 23497 ts_tablet_manager.cc:1434] T 509296352dfa43369c2637f89e917301 P 3a9a63ca97694ebdb84bca730762d735: Time spent starting tablet: real 0.055s	user 0.008s	sys 0.001s
I20260709 12:13:58.988517 23870 raft_consensus.cc:493] T 509296352dfa43369c2637f89e917301 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:13:58.991969 23962 log.cc:927] Time spent T e0352fa4cf674ba8b7d1a0239bcf76e8 P 3a9a63ca97694ebdb84bca730762d735: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 12:13:58.995841 23915 raft_consensus.cc:493] T 54a02c3fbc0b4807998d018f9c2ecbc3 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:58.996587 23915 raft_consensus.cc:515] T 54a02c3fbc0b4807998d018f9c2ecbc3 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:58.989380 23870 raft_consensus.cc:515] T 509296352dfa43369c2637f89e917301 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:59.004886 23495 tablet_bootstrap.cc:492] T 509296352dfa43369c2637f89e917301 P 288a46a90f26471584043331107dc0dd: No bootstrap required, opened a new log
I20260709 12:13:59.005878 23495 ts_tablet_manager.cc:1403] T 509296352dfa43369c2637f89e917301 P 288a46a90f26471584043331107dc0dd: Time spent bootstrapping tablet: real 0.299s	user 0.016s	sys 0.005s
I20260709 12:13:59.050132 23870 leader_election.cc:290] T 509296352dfa43369c2637f89e917301 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081), 288a46a90f26471584043331107dc0dd (127.12.174.129:46159)
I20260709 12:13:59.051105 23915 leader_election.cc:290] T 54a02c3fbc0b4807998d018f9c2ecbc3 P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061), 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081)
I20260709 12:13:59.052091 23495 raft_consensus.cc:359] T 509296352dfa43369c2637f89e917301 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:59.052896 23495 raft_consensus.cc:385] T 509296352dfa43369c2637f89e917301 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:59.053188 23495 raft_consensus.cc:740] T 509296352dfa43369c2637f89e917301 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 288a46a90f26471584043331107dc0dd, State: Initialized, Role: FOLLOWER
I20260709 12:13:59.055296 23375 raft_consensus.cc:2468] T 9485b864470548f28810d4c52cc89850 P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2904b089bdb249b78950db76f4a70e9f in term 1.
I20260709 12:13:59.057375 23498 tablet_bootstrap.cc:492] T 0f7747f7dcab4d6da9caf82c35717552 P 2904b089bdb249b78950db76f4a70e9f: No bootstrap required, opened a new log
I20260709 12:13:59.058104 23498 ts_tablet_manager.cc:1403] T 0f7747f7dcab4d6da9caf82c35717552 P 2904b089bdb249b78950db76f4a70e9f: Time spent bootstrapping tablet: real 0.549s	user 0.039s	sys 0.081s
I20260709 12:13:59.061690 23495 consensus_queue.cc:260] T 509296352dfa43369c2637f89e917301 P 288a46a90f26471584043331107dc0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:59.062143 23267 leader_election.cc:304] T 9485b864470548f28810d4c52cc89850 P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2904b089bdb249b78950db76f4a70e9f, 3a9a63ca97694ebdb84bca730762d735; no voters: 
I20260709 12:13:59.063333 23583 raft_consensus.cc:2804] T 9485b864470548f28810d4c52cc89850 P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:59.064260 23583 raft_consensus.cc:697] T 9485b864470548f28810d4c52cc89850 P 2904b089bdb249b78950db76f4a70e9f [term 1 LEADER]: Becoming Leader. State: Replica: 2904b089bdb249b78950db76f4a70e9f, State: Running, Role: LEADER
I20260709 12:13:59.065111 23583 consensus_queue.cc:237] T 9485b864470548f28810d4c52cc89850 P 2904b089bdb249b78950db76f4a70e9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:13:59.069772 23447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509296352dfa43369c2637f89e917301" candidate_uuid: "3a9a63ca97694ebdb84bca730762d735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba0da223cf24c97bc7d225e25015924" is_pre_election: true
W20260709 12:13:59.071341 23340 leader_election.cc:343] T 509296352dfa43369c2637f89e917301 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:59.071460 23448 raft_consensus.cc:2468] T 9485b864470548f28810d4c52cc89850 P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2904b089bdb249b78950db76f4a70e9f in term 1.
W20260709 12:13:59.077811 23341 consensus_peers.cc:597] T 0f7747f7dcab4d6da9caf82c35717552 P 3a9a63ca97694ebdb84bca730762d735 -> Peer 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789): Couldn't send request to peer 2904b089bdb249b78950db76f4a70e9f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:59.103051 23191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.132:46081, user_credentials={real_user=slave}} blocked reactor thread for 108587us
I20260709 12:13:59.067513 23498 raft_consensus.cc:359] T 0f7747f7dcab4d6da9caf82c35717552 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:59.113260 23498 raft_consensus.cc:385] T 0f7747f7dcab4d6da9caf82c35717552 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:59.113674 23498 raft_consensus.cc:740] T 0f7747f7dcab4d6da9caf82c35717552 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2904b089bdb249b78950db76f4a70e9f, State: Initialized, Role: FOLLOWER
I20260709 12:13:59.115715 23495 ts_tablet_manager.cc:1434] T 509296352dfa43369c2637f89e917301 P 288a46a90f26471584043331107dc0dd: Time spent starting tablet: real 0.109s	user 0.010s	sys 0.000s
I20260709 12:13:59.121011 23496 tablet_bootstrap.cc:492] T e3d86fc25f7146c9b1af99387a07bdec P 9ba0da223cf24c97bc7d225e25015924: No bootstrap required, opened a new log
I20260709 12:13:59.127138 23222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509296352dfa43369c2637f89e917301" candidate_uuid: "3a9a63ca97694ebdb84bca730762d735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "288a46a90f26471584043331107dc0dd" is_pre_election: true
I20260709 12:13:59.127997 23222 raft_consensus.cc:2468] T 509296352dfa43369c2637f89e917301 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a9a63ca97694ebdb84bca730762d735 in term 0.
I20260709 12:13:59.131398 23374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a02c3fbc0b4807998d018f9c2ecbc3" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a9a63ca97694ebdb84bca730762d735" is_pre_election: true
I20260709 12:13:59.132220 23374 raft_consensus.cc:2468] T 54a02c3fbc0b4807998d018f9c2ecbc3 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 288a46a90f26471584043331107dc0dd in term 0.
I20260709 12:13:59.134552 23495 tablet_bootstrap.cc:492] T b2fd9ee7ac0c442481f7e173874a8d00 P 288a46a90f26471584043331107dc0dd: Bootstrap starting.
I20260709 12:13:59.135396 23447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a02c3fbc0b4807998d018f9c2ecbc3" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba0da223cf24c97bc7d225e25015924" is_pre_election: true
I20260709 12:13:59.118784 23498 consensus_queue.cc:260] T 0f7747f7dcab4d6da9caf82c35717552 P 2904b089bdb249b78950db76f4a70e9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:59.140498 23496 ts_tablet_manager.cc:1403] T e3d86fc25f7146c9b1af99387a07bdec P 9ba0da223cf24c97bc7d225e25015924: Time spent bootstrapping tablet: real 0.310s	user 0.012s	sys 0.014s
I20260709 12:13:59.147102 23498 ts_tablet_manager.cc:1434] T 0f7747f7dcab4d6da9caf82c35717552 P 2904b089bdb249b78950db76f4a70e9f: Time spent starting tablet: real 0.088s	user 0.007s	sys 0.000s
I20260709 12:13:59.148298 23498 tablet_bootstrap.cc:492] T e3d86fc25f7146c9b1af99387a07bdec P 2904b089bdb249b78950db76f4a70e9f: Bootstrap starting.
I20260709 12:13:59.156630 23968 consensus_queue.cc:1048] T 0f7747f7dcab4d6da9caf82c35717552 P 3a9a63ca97694ebdb84bca730762d735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:59.160275 23192 leader_election.cc:304] T 54a02c3fbc0b4807998d018f9c2ecbc3 P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 288a46a90f26471584043331107dc0dd, 3a9a63ca97694ebdb84bca730762d735; no voters: 
I20260709 12:13:59.162644 23910 raft_consensus.cc:2804] T 54a02c3fbc0b4807998d018f9c2ecbc3 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:59.163087 23910 raft_consensus.cc:493] T 54a02c3fbc0b4807998d018f9c2ecbc3 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:59.163409 23910 raft_consensus.cc:3060] T 54a02c3fbc0b4807998d018f9c2ecbc3 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:59.169484 23123 catalog_manager.cc:5697] T 3ad2f373a67b4c9cbb2183c2c73eb3e5 P 2904b089bdb249b78950db76f4a70e9f reported cstate change: term changed from 0 to 1, leader changed from <none> to 2904b089bdb249b78950db76f4a70e9f (127.12.174.130). New cstate: current_term: 1 leader_uuid: "2904b089bdb249b78950db76f4a70e9f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:59.171577 23123 catalog_manager.cc:5697] T 9485b864470548f28810d4c52cc89850 P 2904b089bdb249b78950db76f4a70e9f reported cstate change: term changed from 0 to 1, leader changed from <none> to 2904b089bdb249b78950db76f4a70e9f (127.12.174.130). New cstate: current_term: 1 leader_uuid: "2904b089bdb249b78950db76f4a70e9f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:59.179240 23495 tablet_bootstrap.cc:654] T b2fd9ee7ac0c442481f7e173874a8d00 P 288a46a90f26471584043331107dc0dd: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:59.190660 23342 leader_election.cc:304] T 509296352dfa43369c2637f89e917301 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 288a46a90f26471584043331107dc0dd, 3a9a63ca97694ebdb84bca730762d735; no voters: 9ba0da223cf24c97bc7d225e25015924
I20260709 12:13:59.183807 23496 raft_consensus.cc:359] T e3d86fc25f7146c9b1af99387a07bdec P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:59.192364 23496 raft_consensus.cc:385] T e3d86fc25f7146c9b1af99387a07bdec P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:59.192798 23496 raft_consensus.cc:740] T e3d86fc25f7146c9b1af99387a07bdec P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ba0da223cf24c97bc7d225e25015924, State: Initialized, Role: FOLLOWER
I20260709 12:13:59.196599 23919 raft_consensus.cc:2804] T 509296352dfa43369c2637f89e917301 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:59.197063 23919 raft_consensus.cc:493] T 509296352dfa43369c2637f89e917301 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:59.197413 23919 raft_consensus.cc:3060] T 509296352dfa43369c2637f89e917301 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:59.198282 23496 consensus_queue.cc:260] T e3d86fc25f7146c9b1af99387a07bdec P 9ba0da223cf24c97bc7d225e25015924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
W20260709 12:13:59.202740 23191 leader_election.cc:343] T 54a02c3fbc0b4807998d018f9c2ecbc3 P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:59.218828 23919 raft_consensus.cc:515] T 509296352dfa43369c2637f89e917301 P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:59.221886 23448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509296352dfa43369c2637f89e917301" candidate_uuid: "3a9a63ca97694ebdb84bca730762d735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba0da223cf24c97bc7d225e25015924"
W20260709 12:13:59.223270 23340 leader_election.cc:343] T 509296352dfa43369c2637f89e917301 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:59.226619 23910 raft_consensus.cc:515] T 54a02c3fbc0b4807998d018f9c2ecbc3 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:59.228958 23910 leader_election.cc:290] T 54a02c3fbc0b4807998d018f9c2ecbc3 P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 1 election: Requested vote from peers 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061), 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081)
I20260709 12:13:59.210145 23498 tablet_bootstrap.cc:654] T e3d86fc25f7146c9b1af99387a07bdec P 2904b089bdb249b78950db76f4a70e9f: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:59.234292 23447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a02c3fbc0b4807998d018f9c2ecbc3" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba0da223cf24c97bc7d225e25015924"
I20260709 12:13:59.236135 23496 ts_tablet_manager.cc:1434] T e3d86fc25f7146c9b1af99387a07bdec P 9ba0da223cf24c97bc7d225e25015924: Time spent starting tablet: real 0.093s	user 0.006s	sys 0.002s
I20260709 12:13:59.237316 23496 tablet_bootstrap.cc:492] T 54a02c3fbc0b4807998d018f9c2ecbc3 P 9ba0da223cf24c97bc7d225e25015924: Bootstrap starting.
I20260709 12:13:59.214087 23495 tablet_bootstrap.cc:492] T b2fd9ee7ac0c442481f7e173874a8d00 P 288a46a90f26471584043331107dc0dd: No bootstrap required, opened a new log
W20260709 12:13:59.241711 23191 leader_election.cc:343] T 54a02c3fbc0b4807998d018f9c2ecbc3 P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:59.242311 23495 ts_tablet_manager.cc:1403] T b2fd9ee7ac0c442481f7e173874a8d00 P 288a46a90f26471584043331107dc0dd: Time spent bootstrapping tablet: real 0.126s	user 0.013s	sys 0.000s
I20260709 12:13:59.246101 23495 raft_consensus.cc:359] T b2fd9ee7ac0c442481f7e173874a8d00 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:59.257138 23375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a02c3fbc0b4807998d018f9c2ecbc3" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a9a63ca97694ebdb84bca730762d735"
I20260709 12:13:59.258656 23375 raft_consensus.cc:3060] T 54a02c3fbc0b4807998d018f9c2ecbc3 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:59.261144 23583 raft_consensus.cc:493] T 0f7747f7dcab4d6da9caf82c35717552 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:59.261821 23874 consensus_queue.cc:1048] T 3ad2f373a67b4c9cbb2183c2c73eb3e5 P 2904b089bdb249b78950db76f4a70e9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:59.261188 23222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509296352dfa43369c2637f89e917301" candidate_uuid: "3a9a63ca97694ebdb84bca730762d735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "288a46a90f26471584043331107dc0dd"
I20260709 12:13:59.263159 23222 raft_consensus.cc:3060] T 509296352dfa43369c2637f89e917301 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:59.261807 23583 raft_consensus.cc:515] T 0f7747f7dcab4d6da9caf82c35717552 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:59.257089 23919 leader_election.cc:290] T 509296352dfa43369c2637f89e917301 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 election: Requested vote from peers 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081), 288a46a90f26471584043331107dc0dd (127.12.174.129:46159)
I20260709 12:13:59.274271 23375 raft_consensus.cc:2468] T 54a02c3fbc0b4807998d018f9c2ecbc3 P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 288a46a90f26471584043331107dc0dd in term 1.
I20260709 12:13:59.273303 23498 tablet_bootstrap.cc:492] T e3d86fc25f7146c9b1af99387a07bdec P 2904b089bdb249b78950db76f4a70e9f: No bootstrap required, opened a new log
I20260709 12:13:59.275715 23222 raft_consensus.cc:2468] T 509296352dfa43369c2637f89e917301 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a9a63ca97694ebdb84bca730762d735 in term 1.
I20260709 12:13:59.275748 23498 ts_tablet_manager.cc:1403] T e3d86fc25f7146c9b1af99387a07bdec P 2904b089bdb249b78950db76f4a70e9f: Time spent bootstrapping tablet: real 0.128s	user 0.005s	sys 0.008s
I20260709 12:13:59.276852 23583 leader_election.cc:290] T 0f7747f7dcab4d6da9caf82c35717552 P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 288a46a90f26471584043331107dc0dd (127.12.174.129:46159), 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061)
I20260709 12:13:59.277674 23224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7747f7dcab4d6da9caf82c35717552" candidate_uuid: "2904b089bdb249b78950db76f4a70e9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "288a46a90f26471584043331107dc0dd" is_pre_election: true
I20260709 12:13:59.278309 23375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7747f7dcab4d6da9caf82c35717552" candidate_uuid: "2904b089bdb249b78950db76f4a70e9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a9a63ca97694ebdb84bca730762d735" is_pre_election: true
I20260709 12:13:59.279639 23342 leader_election.cc:304] T 509296352dfa43369c2637f89e917301 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 288a46a90f26471584043331107dc0dd, 3a9a63ca97694ebdb84bca730762d735; no voters: 9ba0da223cf24c97bc7d225e25015924
I20260709 12:13:59.281577 23498 raft_consensus.cc:359] T e3d86fc25f7146c9b1af99387a07bdec P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:59.246866 23495 raft_consensus.cc:385] T b2fd9ee7ac0c442481f7e173874a8d00 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:59.282737 23495 raft_consensus.cc:740] T b2fd9ee7ac0c442481f7e173874a8d00 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 288a46a90f26471584043331107dc0dd, State: Initialized, Role: FOLLOWER
I20260709 12:13:59.283107 23927 raft_consensus.cc:2804] T 509296352dfa43369c2637f89e917301 P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:59.283588 23192 leader_election.cc:304] T 54a02c3fbc0b4807998d018f9c2ecbc3 P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 288a46a90f26471584043331107dc0dd, 3a9a63ca97694ebdb84bca730762d735; no voters: 9ba0da223cf24c97bc7d225e25015924
I20260709 12:13:59.283671 23495 consensus_queue.cc:260] T b2fd9ee7ac0c442481f7e173874a8d00 P 288a46a90f26471584043331107dc0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:59.283679 23927 raft_consensus.cc:697] T 509296352dfa43369c2637f89e917301 P 3a9a63ca97694ebdb84bca730762d735 [term 1 LEADER]: Becoming Leader. State: Replica: 3a9a63ca97694ebdb84bca730762d735, State: Running, Role: LEADER
I20260709 12:13:59.285089 23969 raft_consensus.cc:2804] T 54a02c3fbc0b4807998d018f9c2ecbc3 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:59.285627 23969 raft_consensus.cc:697] T 54a02c3fbc0b4807998d018f9c2ecbc3 P 288a46a90f26471584043331107dc0dd [term 1 LEADER]: Becoming Leader. State: Replica: 288a46a90f26471584043331107dc0dd, State: Running, Role: LEADER
I20260709 12:13:59.285461 23927 consensus_queue.cc:237] T 509296352dfa43369c2637f89e917301 P 3a9a63ca97694ebdb84bca730762d735 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:59.287248 23496 tablet_bootstrap.cc:654] T 54a02c3fbc0b4807998d018f9c2ecbc3 P 9ba0da223cf24c97bc7d225e25015924: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:59.286769 23969 consensus_queue.cc:237] T 54a02c3fbc0b4807998d018f9c2ecbc3 P 288a46a90f26471584043331107dc0dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:59.289783 23267 leader_election.cc:304] T 0f7747f7dcab4d6da9caf82c35717552 P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2904b089bdb249b78950db76f4a70e9f; no voters: 288a46a90f26471584043331107dc0dd, 3a9a63ca97694ebdb84bca730762d735
I20260709 12:13:59.291180 23874 raft_consensus.cc:2749] T 0f7747f7dcab4d6da9caf82c35717552 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:59.296236 23810 consensus_queue.cc:1048] T 3ad2f373a67b4c9cbb2183c2c73eb3e5 P 2904b089bdb249b78950db76f4a70e9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:59.296608 23495 ts_tablet_manager.cc:1434] T b2fd9ee7ac0c442481f7e173874a8d00 P 288a46a90f26471584043331107dc0dd: Time spent starting tablet: real 0.054s	user 0.006s	sys 0.000s
I20260709 12:13:59.299518 23495 tablet_bootstrap.cc:492] T b90be1e04a3443e989951ea6bc45ed2f P 288a46a90f26471584043331107dc0dd: Bootstrap starting.
I20260709 12:13:59.300158 23498 raft_consensus.cc:385] T e3d86fc25f7146c9b1af99387a07bdec P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:59.307973 23498 raft_consensus.cc:740] T e3d86fc25f7146c9b1af99387a07bdec P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2904b089bdb249b78950db76f4a70e9f, State: Initialized, Role: FOLLOWER
I20260709 12:13:59.310611 23498 consensus_queue.cc:260] T e3d86fc25f7146c9b1af99387a07bdec P 2904b089bdb249b78950db76f4a70e9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:59.318558 23498 ts_tablet_manager.cc:1434] T e3d86fc25f7146c9b1af99387a07bdec P 2904b089bdb249b78950db76f4a70e9f: Time spent starting tablet: real 0.042s	user 0.006s	sys 0.001s
I20260709 12:13:59.321880 23498 tablet_bootstrap.cc:492] T b90be1e04a3443e989951ea6bc45ed2f P 2904b089bdb249b78950db76f4a70e9f: Bootstrap starting.
I20260709 12:13:59.373827 23495 tablet_bootstrap.cc:654] T b90be1e04a3443e989951ea6bc45ed2f P 288a46a90f26471584043331107dc0dd: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:59.396689 23498 tablet_bootstrap.cc:654] T b90be1e04a3443e989951ea6bc45ed2f P 2904b089bdb249b78950db76f4a70e9f: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:59.490217 23496 tablet_bootstrap.cc:492] T 54a02c3fbc0b4807998d018f9c2ecbc3 P 9ba0da223cf24c97bc7d225e25015924: No bootstrap required, opened a new log
I20260709 12:13:59.490569 23952 raft_consensus.cc:493] T e3d86fc25f7146c9b1af99387a07bdec P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:59.491423 23496 ts_tablet_manager.cc:1403] T 54a02c3fbc0b4807998d018f9c2ecbc3 P 9ba0da223cf24c97bc7d225e25015924: Time spent bootstrapping tablet: real 0.254s	user 0.027s	sys 0.022s
I20260709 12:13:59.491940 23952 raft_consensus.cc:515] T e3d86fc25f7146c9b1af99387a07bdec P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:59.529502 23226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d86fc25f7146c9b1af99387a07bdec" candidate_uuid: "9ba0da223cf24c97bc7d225e25015924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "288a46a90f26471584043331107dc0dd" is_pre_election: true
I20260709 12:13:59.531051 23226 raft_consensus.cc:2468] T e3d86fc25f7146c9b1af99387a07bdec P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ba0da223cf24c97bc7d225e25015924 in term 0.
I20260709 12:13:59.536815 23498 tablet_bootstrap.cc:492] T b90be1e04a3443e989951ea6bc45ed2f P 2904b089bdb249b78950db76f4a70e9f: No bootstrap required, opened a new log
I20260709 12:13:59.546986 23299 raft_consensus.cc:3060] T 0f7747f7dcab4d6da9caf82c35717552 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:59.609611 23810 consensus_queue.cc:1048] T 9485b864470548f28810d4c52cc89850 P 2904b089bdb249b78950db76f4a70e9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.026s
I20260709 12:13:59.615446 23929 consensus_queue.cc:1048] T 9485b864470548f28810d4c52cc89850 P 2904b089bdb249b78950db76f4a70e9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:59.618372 23498 ts_tablet_manager.cc:1403] T b90be1e04a3443e989951ea6bc45ed2f P 2904b089bdb249b78950db76f4a70e9f: Time spent bootstrapping tablet: real 0.297s	user 0.011s	sys 0.015s
I20260709 12:13:59.622339 23496 raft_consensus.cc:359] T 54a02c3fbc0b4807998d018f9c2ecbc3 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:59.642351 23496 raft_consensus.cc:385] T 54a02c3fbc0b4807998d018f9c2ecbc3 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:59.642812 23496 raft_consensus.cc:740] T 54a02c3fbc0b4807998d018f9c2ecbc3 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ba0da223cf24c97bc7d225e25015924, State: Initialized, Role: FOLLOWER
I20260709 12:13:59.655452 23498 raft_consensus.cc:359] T b90be1e04a3443e989951ea6bc45ed2f P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:59.658497 23498 raft_consensus.cc:385] T b90be1e04a3443e989951ea6bc45ed2f P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:59.658913 23498 raft_consensus.cc:740] T b90be1e04a3443e989951ea6bc45ed2f P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2904b089bdb249b78950db76f4a70e9f, State: Initialized, Role: FOLLOWER
W20260709 12:13:59.661873 23981 log.cc:927] Time spent T 3ad2f373a67b4c9cbb2183c2c73eb3e5 P 288a46a90f26471584043331107dc0dd: Append to log took a long time: real 0.151s	user 0.000s	sys 0.001s
I20260709 12:13:59.620930 23952 leader_election.cc:290] T e3d86fc25f7146c9b1af99387a07bdec P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 288a46a90f26471584043331107dc0dd (127.12.174.129:46159), 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789)
I20260709 12:13:59.672775 23123 catalog_manager.cc:5697] T 54a02c3fbc0b4807998d018f9c2ecbc3 P 288a46a90f26471584043331107dc0dd reported cstate change: term changed from 0 to 1, leader changed from <none> to 288a46a90f26471584043331107dc0dd (127.12.174.129). New cstate: current_term: 1 leader_uuid: "288a46a90f26471584043331107dc0dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } health_report { overall_health: HEALTHY } } }
W20260709 12:13:59.685698 23416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:46159, user_credentials={real_user=slave}} blocked reactor thread for 79140us
I20260709 12:13:59.687410 23416 leader_election.cc:304] T e3d86fc25f7146c9b1af99387a07bdec P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 288a46a90f26471584043331107dc0dd, 9ba0da223cf24c97bc7d225e25015924; no voters: 
I20260709 12:13:59.706260 23947 raft_consensus.cc:493] T e3d86fc25f7146c9b1af99387a07bdec P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:59.707008 23947 raft_consensus.cc:515] T e3d86fc25f7146c9b1af99387a07bdec P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:59.718488 23495 tablet_bootstrap.cc:492] T b90be1e04a3443e989951ea6bc45ed2f P 288a46a90f26471584043331107dc0dd: No bootstrap required, opened a new log
I20260709 12:13:59.719483 23495 ts_tablet_manager.cc:1403] T b90be1e04a3443e989951ea6bc45ed2f P 288a46a90f26471584043331107dc0dd: Time spent bootstrapping tablet: real 0.420s	user 0.032s	sys 0.031s
I20260709 12:13:59.724676 23495 raft_consensus.cc:359] T b90be1e04a3443e989951ea6bc45ed2f P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:59.725600 23495 raft_consensus.cc:385] T b90be1e04a3443e989951ea6bc45ed2f P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:59.725922 23495 raft_consensus.cc:740] T b90be1e04a3443e989951ea6bc45ed2f P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 288a46a90f26471584043331107dc0dd, State: Initialized, Role: FOLLOWER
I20260709 12:13:59.726645 23495 consensus_queue.cc:260] T b90be1e04a3443e989951ea6bc45ed2f P 288a46a90f26471584043331107dc0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:59.729300 23495 ts_tablet_manager.cc:1434] T b90be1e04a3443e989951ea6bc45ed2f P 288a46a90f26471584043331107dc0dd: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 12:13:59.726455 23496 consensus_queue.cc:260] T 54a02c3fbc0b4807998d018f9c2ecbc3 P 9ba0da223cf24c97bc7d225e25015924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:13:59.729153 23938 raft_consensus.cc:2804] T e3d86fc25f7146c9b1af99387a07bdec P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:59.741511 23498 consensus_queue.cc:260] T b90be1e04a3443e989951ea6bc45ed2f P 2904b089bdb249b78950db76f4a70e9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:59.746913 23930 raft_consensus.cc:493] T b90be1e04a3443e989951ea6bc45ed2f P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:59.749373 23930 raft_consensus.cc:515] T b90be1e04a3443e989951ea6bc45ed2f P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:13:59.752741 23947 leader_election.cc:290] T e3d86fc25f7146c9b1af99387a07bdec P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081), 288a46a90f26471584043331107dc0dd (127.12.174.129:46159)
I20260709 12:13:59.741125 23938 raft_consensus.cc:493] T e3d86fc25f7146c9b1af99387a07bdec P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:59.768474 23226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d86fc25f7146c9b1af99387a07bdec" candidate_uuid: "2904b089bdb249b78950db76f4a70e9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "288a46a90f26471584043331107dc0dd" is_pre_election: true
I20260709 12:13:59.768556 23498 ts_tablet_manager.cc:1434] T b90be1e04a3443e989951ea6bc45ed2f P 2904b089bdb249b78950db76f4a70e9f: Time spent starting tablet: real 0.134s	user 0.012s	sys 0.006s
I20260709 12:13:59.779923 23298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d86fc25f7146c9b1af99387a07bdec" candidate_uuid: "9ba0da223cf24c97bc7d225e25015924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2904b089bdb249b78950db76f4a70e9f" is_pre_election: true
I20260709 12:13:59.780968 23298 raft_consensus.cc:2468] T e3d86fc25f7146c9b1af99387a07bdec P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ba0da223cf24c97bc7d225e25015924 in term 0.
I20260709 12:13:59.787793 23498 tablet_bootstrap.cc:492] T 27202f3dd66a42a3832a9cc25ba6e3e5 P 2904b089bdb249b78950db76f4a70e9f: Bootstrap starting.
I20260709 12:13:59.789656 23450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d86fc25f7146c9b1af99387a07bdec" candidate_uuid: "2904b089bdb249b78950db76f4a70e9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba0da223cf24c97bc7d225e25015924" is_pre_election: true
I20260709 12:13:59.769694 23938 raft_consensus.cc:3060] T e3d86fc25f7146c9b1af99387a07bdec P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:59.769465 23226 raft_consensus.cc:2468] T e3d86fc25f7146c9b1af99387a07bdec P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2904b089bdb249b78950db76f4a70e9f in term 0.
I20260709 12:13:59.799860 23496 ts_tablet_manager.cc:1434] T 54a02c3fbc0b4807998d018f9c2ecbc3 P 9ba0da223cf24c97bc7d225e25015924: Time spent starting tablet: real 0.308s	user 0.015s	sys 0.001s
I20260709 12:13:59.819293 23930 leader_election.cc:290] T b90be1e04a3443e989951ea6bc45ed2f P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 288a46a90f26471584043331107dc0dd (127.12.174.129:46159), 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061)
I20260709 12:13:59.860427 23268 leader_election.cc:304] T e3d86fc25f7146c9b1af99387a07bdec P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 288a46a90f26471584043331107dc0dd, 2904b089bdb249b78950db76f4a70e9f; no voters: 
I20260709 12:13:59.861407 23227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90be1e04a3443e989951ea6bc45ed2f" candidate_uuid: "2904b089bdb249b78950db76f4a70e9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "288a46a90f26471584043331107dc0dd" is_pre_election: true
I20260709 12:13:59.861924 23372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90be1e04a3443e989951ea6bc45ed2f" candidate_uuid: "2904b089bdb249b78950db76f4a70e9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a9a63ca97694ebdb84bca730762d735" is_pre_election: true
I20260709 12:13:59.862325 23227 raft_consensus.cc:2468] T b90be1e04a3443e989951ea6bc45ed2f P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2904b089bdb249b78950db76f4a70e9f in term 0.
I20260709 12:13:59.862994 23372 raft_consensus.cc:2468] T b90be1e04a3443e989951ea6bc45ed2f P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2904b089bdb249b78950db76f4a70e9f in term 0.
I20260709 12:13:59.865406 23991 raft_consensus.cc:2804] T e3d86fc25f7146c9b1af99387a07bdec P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:59.865948 23991 raft_consensus.cc:493] T e3d86fc25f7146c9b1af99387a07bdec P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:59.866291 23991 raft_consensus.cc:3060] T e3d86fc25f7146c9b1af99387a07bdec P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:59.867973 23267 leader_election.cc:304] T b90be1e04a3443e989951ea6bc45ed2f P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2904b089bdb249b78950db76f4a70e9f, 3a9a63ca97694ebdb84bca730762d735; no voters: 
I20260709 12:13:59.869095 23444 raft_consensus.cc:3060] T 54a02c3fbc0b4807998d018f9c2ecbc3 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:59.869874 23947 raft_consensus.cc:2804] T b90be1e04a3443e989951ea6bc45ed2f P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:59.870339 23947 raft_consensus.cc:493] T b90be1e04a3443e989951ea6bc45ed2f P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:59.870847 23947 raft_consensus.cc:3060] T b90be1e04a3443e989951ea6bc45ed2f P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:13:59.871141 23340 consensus_peers.cc:597] T 509296352dfa43369c2637f89e917301 P 3a9a63ca97694ebdb84bca730762d735 -> Peer 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081): Couldn't send request to peer 9ba0da223cf24c97bc7d225e25015924. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:59.872073 23496 tablet_bootstrap.cc:492] T 27202f3dd66a42a3832a9cc25ba6e3e5 P 9ba0da223cf24c97bc7d225e25015924: Bootstrap starting.
I20260709 12:13:59.879745 23910 raft_consensus.cc:493] T b2fd9ee7ac0c442481f7e173874a8d00 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:59.880482 23910 raft_consensus.cc:515] T b2fd9ee7ac0c442481f7e173874a8d00 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:59.882946 23910 leader_election.cc:290] T b2fd9ee7ac0c442481f7e173874a8d00 P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081), 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789)
I20260709 12:13:59.912757 23448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2fd9ee7ac0c442481f7e173874a8d00" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba0da223cf24c97bc7d225e25015924" is_pre_election: true
I20260709 12:13:59.917940 23302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2fd9ee7ac0c442481f7e173874a8d00" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2904b089bdb249b78950db76f4a70e9f" is_pre_election: true
I20260709 12:13:59.928893 23938 raft_consensus.cc:515] T e3d86fc25f7146c9b1af99387a07bdec P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:59.930614 23450 raft_consensus.cc:2393] T e3d86fc25f7146c9b1af99387a07bdec P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2904b089bdb249b78950db76f4a70e9f in current term 1: Already voted for candidate 9ba0da223cf24c97bc7d225e25015924 in this term.
I20260709 12:13:59.934875 23498 tablet_bootstrap.cc:654] T 27202f3dd66a42a3832a9cc25ba6e3e5 P 2904b089bdb249b78950db76f4a70e9f: Neither blocks nor log segments found. Creating new log.
W20260709 12:13:59.954679 23191 leader_election.cc:343] T b2fd9ee7ac0c442481f7e173874a8d00 P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:59.955031 23927 consensus_queue.cc:1048] T 509296352dfa43369c2637f89e917301 P 3a9a63ca97694ebdb84bca730762d735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:59.959141 23991 raft_consensus.cc:515] T e3d86fc25f7146c9b1af99387a07bdec P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:13:59.962618 23983 raft_consensus.cc:493] T 54a02c3fbc0b4807998d018f9c2ecbc3 P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:59.963155 23938 leader_election.cc:290] T e3d86fc25f7146c9b1af99387a07bdec P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 1 election: Requested vote from peers 288a46a90f26471584043331107dc0dd (127.12.174.129:46159), 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789)
I20260709 12:13:59.963297 23983 raft_consensus.cc:515] T 54a02c3fbc0b4807998d018f9c2ecbc3 P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
W20260709 12:13:59.965831 23192 leader_election.cc:343] T b2fd9ee7ac0c442481f7e173874a8d00 P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:59.967032 23191 leader_election.cc:304] T b2fd9ee7ac0c442481f7e173874a8d00 P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 288a46a90f26471584043331107dc0dd; no voters: 2904b089bdb249b78950db76f4a70e9f, 9ba0da223cf24c97bc7d225e25015924
I20260709 12:13:59.959000 23496 tablet_bootstrap.cc:654] T 27202f3dd66a42a3832a9cc25ba6e3e5 P 9ba0da223cf24c97bc7d225e25015924: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:59.981509 23444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d86fc25f7146c9b1af99387a07bdec" candidate_uuid: "2904b089bdb249b78950db76f4a70e9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba0da223cf24c97bc7d225e25015924"
I20260709 12:13:59.987093 23223 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d86fc25f7146c9b1af99387a07bdec" candidate_uuid: "9ba0da223cf24c97bc7d225e25015924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "288a46a90f26471584043331107dc0dd"
I20260709 12:13:59.988025 23223 raft_consensus.cc:3060] T e3d86fc25f7146c9b1af99387a07bdec P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:13:59.994709 23173 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:13:59.998135 23991 leader_election.cc:290] T e3d86fc25f7146c9b1af99387a07bdec P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 1 election: Requested vote from peers 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081), 288a46a90f26471584043331107dc0dd (127.12.174.129:46159)
I20260709 12:14:00.011461 23983 leader_election.cc:290] T 54a02c3fbc0b4807998d018f9c2ecbc3 P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061), 288a46a90f26471584043331107dc0dd (127.12.174.129:46159)
I20260709 12:14:00.014808 23224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a02c3fbc0b4807998d018f9c2ecbc3" candidate_uuid: "9ba0da223cf24c97bc7d225e25015924" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "288a46a90f26471584043331107dc0dd" is_pre_election: true
I20260709 12:14:00.037829 23444 raft_consensus.cc:2393] T e3d86fc25f7146c9b1af99387a07bdec P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2904b089bdb249b78950db76f4a70e9f in current term 1: Already voted for candidate 9ba0da223cf24c97bc7d225e25015924 in this term.
I20260709 12:14:00.035908 23947 raft_consensus.cc:515] T b90be1e04a3443e989951ea6bc45ed2f P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:14:00.049901 23223 raft_consensus.cc:2468] T e3d86fc25f7146c9b1af99387a07bdec P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ba0da223cf24c97bc7d225e25015924 in term 1.
I20260709 12:14:00.052618 23299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d86fc25f7146c9b1af99387a07bdec" candidate_uuid: "9ba0da223cf24c97bc7d225e25015924" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2904b089bdb249b78950db76f4a70e9f"
I20260709 12:14:00.053025 23416 leader_election.cc:304] T e3d86fc25f7146c9b1af99387a07bdec P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 288a46a90f26471584043331107dc0dd, 9ba0da223cf24c97bc7d225e25015924; no voters: 
I20260709 12:14:00.054497 23299 raft_consensus.cc:2393] T e3d86fc25f7146c9b1af99387a07bdec P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ba0da223cf24c97bc7d225e25015924 in current term 1: Already voted for candidate 2904b089bdb249b78950db76f4a70e9f in this term.
I20260709 12:14:00.056838 23952 raft_consensus.cc:2804] T e3d86fc25f7146c9b1af99387a07bdec P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:00.057489 23952 raft_consensus.cc:697] T e3d86fc25f7146c9b1af99387a07bdec P 9ba0da223cf24c97bc7d225e25015924 [term 1 LEADER]: Becoming Leader. State: Replica: 9ba0da223cf24c97bc7d225e25015924, State: Running, Role: LEADER
I20260709 12:14:00.057969 23374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a02c3fbc0b4807998d018f9c2ecbc3" candidate_uuid: "9ba0da223cf24c97bc7d225e25015924" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a9a63ca97694ebdb84bca730762d735" is_pre_election: true
I20260709 12:14:00.059404 23374 raft_consensus.cc:2468] T 54a02c3fbc0b4807998d018f9c2ecbc3 P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ba0da223cf24c97bc7d225e25015924 in term 1.
W20260709 12:14:00.059571 23191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:46081, user_credentials={real_user=slave}} blocked reactor thread for 136217us
I20260709 12:14:00.062043 23900 raft_consensus.cc:2749] T b2fd9ee7ac0c442481f7e173874a8d00 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:14:00.062786 23192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:45789, user_credentials={real_user=slave}} blocked reactor thread for 122684us
I20260709 12:14:00.076951 23952 consensus_queue.cc:237] T e3d86fc25f7146c9b1af99387a07bdec P 9ba0da223cf24c97bc7d225e25015924 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:14:00.083071 23125 catalog_manager.cc:5697] T 509296352dfa43369c2637f89e917301 P 3a9a63ca97694ebdb84bca730762d735 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131). New cstate: current_term: 1 leader_uuid: "3a9a63ca97694ebdb84bca730762d735" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:00.090940 23222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3d86fc25f7146c9b1af99387a07bdec" candidate_uuid: "2904b089bdb249b78950db76f4a70e9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "288a46a90f26471584043331107dc0dd"
I20260709 12:14:00.094683 23222 raft_consensus.cc:2393] T e3d86fc25f7146c9b1af99387a07bdec P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2904b089bdb249b78950db76f4a70e9f in current term 1: Already voted for candidate 9ba0da223cf24c97bc7d225e25015924 in this term.
W20260709 12:14:00.092695 23994 log.cc:927] Time spent T 9485b864470548f28810d4c52cc89850 P 9ba0da223cf24c97bc7d225e25015924: Append to log took a long time: real 0.179s	user 0.003s	sys 0.000s
I20260709 12:14:00.128093 23375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90be1e04a3443e989951ea6bc45ed2f" candidate_uuid: "2904b089bdb249b78950db76f4a70e9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a9a63ca97694ebdb84bca730762d735"
I20260709 12:14:00.128897 23375 raft_consensus.cc:3060] T b90be1e04a3443e989951ea6bc45ed2f P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:00.159024 23910 consensus_queue.cc:1048] T 54a02c3fbc0b4807998d018f9c2ecbc3 P 288a46a90f26471584043331107dc0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:00.147257 23947 leader_election.cc:290] T b90be1e04a3443e989951ea6bc45ed2f P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 1 election: Requested vote from peers 288a46a90f26471584043331107dc0dd (127.12.174.129:46159), 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061)
I20260709 12:14:00.176196 23268 leader_election.cc:304] T e3d86fc25f7146c9b1af99387a07bdec P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2904b089bdb249b78950db76f4a70e9f; no voters: 288a46a90f26471584043331107dc0dd, 9ba0da223cf24c97bc7d225e25015924
I20260709 12:14:00.177989 23929 raft_consensus.cc:2749] T e3d86fc25f7146c9b1af99387a07bdec P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:14:00.161962 23913 consensus_queue.cc:1048] T 54a02c3fbc0b4807998d018f9c2ecbc3 P 288a46a90f26471584043331107dc0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:00.198076 23375 raft_consensus.cc:2468] T b90be1e04a3443e989951ea6bc45ed2f P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2904b089bdb249b78950db76f4a70e9f in term 1.
I20260709 12:14:00.199298 23267 leader_election.cc:304] T b90be1e04a3443e989951ea6bc45ed2f P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2904b089bdb249b78950db76f4a70e9f, 3a9a63ca97694ebdb84bca730762d735; no voters: 
I20260709 12:14:00.194905 23222 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90be1e04a3443e989951ea6bc45ed2f" candidate_uuid: "2904b089bdb249b78950db76f4a70e9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "288a46a90f26471584043331107dc0dd"
I20260709 12:14:00.202059 23222 raft_consensus.cc:3060] T b90be1e04a3443e989951ea6bc45ed2f P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:00.207615 23496 tablet_bootstrap.cc:492] T 27202f3dd66a42a3832a9cc25ba6e3e5 P 9ba0da223cf24c97bc7d225e25015924: No bootstrap required, opened a new log
I20260709 12:14:00.208384 23496 ts_tablet_manager.cc:1403] T 27202f3dd66a42a3832a9cc25ba6e3e5 P 9ba0da223cf24c97bc7d225e25015924: Time spent bootstrapping tablet: real 0.337s	user 0.016s	sys 0.014s
I20260709 12:14:00.216284 23496 raft_consensus.cc:359] T 27202f3dd66a42a3832a9cc25ba6e3e5 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:14:00.217332 23496 raft_consensus.cc:385] T 27202f3dd66a42a3832a9cc25ba6e3e5 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:00.217648 23496 raft_consensus.cc:740] T 27202f3dd66a42a3832a9cc25ba6e3e5 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ba0da223cf24c97bc7d225e25015924, State: Initialized, Role: FOLLOWER
I20260709 12:14:00.218436 23930 raft_consensus.cc:2804] T b90be1e04a3443e989951ea6bc45ed2f P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:00.230939 23498 tablet_bootstrap.cc:492] T 27202f3dd66a42a3832a9cc25ba6e3e5 P 2904b089bdb249b78950db76f4a70e9f: No bootstrap required, opened a new log
I20260709 12:14:00.231639 23498 ts_tablet_manager.cc:1403] T 27202f3dd66a42a3832a9cc25ba6e3e5 P 2904b089bdb249b78950db76f4a70e9f: Time spent bootstrapping tablet: real 0.444s	user 0.020s	sys 0.012s
I20260709 12:14:00.245918 23496 consensus_queue.cc:260] T 27202f3dd66a42a3832a9cc25ba6e3e5 P 9ba0da223cf24c97bc7d225e25015924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:14:00.257864 23498 raft_consensus.cc:359] T 27202f3dd66a42a3832a9cc25ba6e3e5 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:14:00.259670 23415 leader_election.cc:304] T 54a02c3fbc0b4807998d018f9c2ecbc3 P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3a9a63ca97694ebdb84bca730762d735, 9ba0da223cf24c97bc7d225e25015924; no voters: 288a46a90f26471584043331107dc0dd
I20260709 12:14:00.233156 23930 raft_consensus.cc:697] T b90be1e04a3443e989951ea6bc45ed2f P 2904b089bdb249b78950db76f4a70e9f [term 1 LEADER]: Becoming Leader. State: Replica: 2904b089bdb249b78950db76f4a70e9f, State: Running, Role: LEADER
I20260709 12:14:00.294518 23222 raft_consensus.cc:2468] T b90be1e04a3443e989951ea6bc45ed2f P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2904b089bdb249b78950db76f4a70e9f in term 1.
I20260709 12:14:00.330047 23930 consensus_queue.cc:237] T b90be1e04a3443e989951ea6bc45ed2f P 2904b089bdb249b78950db76f4a70e9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:14:00.329048 23498 raft_consensus.cc:385] T 27202f3dd66a42a3832a9cc25ba6e3e5 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:00.331347 23498 raft_consensus.cc:740] T 27202f3dd66a42a3832a9cc25ba6e3e5 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2904b089bdb249b78950db76f4a70e9f, State: Initialized, Role: FOLLOWER
I20260709 12:14:00.332471 23498 consensus_queue.cc:260] T 27202f3dd66a42a3832a9cc25ba6e3e5 P 2904b089bdb249b78950db76f4a70e9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
W20260709 12:14:00.338770 23415 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:40061, user_credentials={real_user=slave}} blocked reactor thread for 192278us
W20260709 12:14:00.340018 23416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:46159, user_credentials={real_user=slave}} blocked reactor thread for 54002.2us
W20260709 12:14:00.341933 23192 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:45789, user_credentials={real_user=slave}} blocked reactor thread for 114885us
I20260709 12:14:00.348001 24000 raft_consensus.cc:2804] T 54a02c3fbc0b4807998d018f9c2ecbc3 P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:00.348555 24000 raft_consensus.cc:493] T 54a02c3fbc0b4807998d018f9c2ecbc3 P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:00.348889 24000 raft_consensus.cc:3060] T 54a02c3fbc0b4807998d018f9c2ecbc3 P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:00.377947 23496 ts_tablet_manager.cc:1434] T 27202f3dd66a42a3832a9cc25ba6e3e5 P 9ba0da223cf24c97bc7d225e25015924: Time spent starting tablet: real 0.169s	user 0.013s	sys 0.000s
I20260709 12:14:00.416468 23583 raft_consensus.cc:493] T 27202f3dd66a42a3832a9cc25ba6e3e5 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:00.417040 23583 raft_consensus.cc:515] T 27202f3dd66a42a3832a9cc25ba6e3e5 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:14:00.419101 23583 leader_election.cc:290] T 27202f3dd66a42a3832a9cc25ba6e3e5 P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061), 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081)
I20260709 12:14:00.418854 23124 catalog_manager.cc:5697] T e3d86fc25f7146c9b1af99387a07bdec P 9ba0da223cf24c97bc7d225e25015924 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132). New cstate: current_term: 1 leader_uuid: "9ba0da223cf24c97bc7d225e25015924" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:00.420840 23375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27202f3dd66a42a3832a9cc25ba6e3e5" candidate_uuid: "2904b089bdb249b78950db76f4a70e9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a9a63ca97694ebdb84bca730762d735" is_pre_election: true
I20260709 12:14:00.421092 23442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27202f3dd66a42a3832a9cc25ba6e3e5" candidate_uuid: "2904b089bdb249b78950db76f4a70e9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba0da223cf24c97bc7d225e25015924" is_pre_election: true
I20260709 12:14:00.421711 23375 raft_consensus.cc:2468] T 27202f3dd66a42a3832a9cc25ba6e3e5 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2904b089bdb249b78950db76f4a70e9f in term 0.
I20260709 12:14:00.423457 23442 raft_consensus.cc:2468] T 27202f3dd66a42a3832a9cc25ba6e3e5 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2904b089bdb249b78950db76f4a70e9f in term 0.
I20260709 12:14:00.426440 23266 leader_election.cc:304] T 27202f3dd66a42a3832a9cc25ba6e3e5 P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2904b089bdb249b78950db76f4a70e9f, 9ba0da223cf24c97bc7d225e25015924; no voters: 
I20260709 12:14:00.429776 23874 raft_consensus.cc:2804] T 27202f3dd66a42a3832a9cc25ba6e3e5 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:00.430207 23874 raft_consensus.cc:493] T 27202f3dd66a42a3832a9cc25ba6e3e5 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:00.430532 23874 raft_consensus.cc:3060] T 27202f3dd66a42a3832a9cc25ba6e3e5 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:00.434594 24000 raft_consensus.cc:515] T 54a02c3fbc0b4807998d018f9c2ecbc3 P 9ba0da223cf24c97bc7d225e25015924 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:14:00.436188 23447 raft_consensus.cc:1240] T 54a02c3fbc0b4807998d018f9c2ecbc3 P 9ba0da223cf24c97bc7d225e25015924 [term 2 FOLLOWER]: Rejecting Update request from peer 288a46a90f26471584043331107dc0dd for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 12:14:00.437912 23371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a02c3fbc0b4807998d018f9c2ecbc3" candidate_uuid: "9ba0da223cf24c97bc7d225e25015924" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a9a63ca97694ebdb84bca730762d735"
I20260709 12:14:00.440102 23913 consensus_queue.cc:1059] T 54a02c3fbc0b4807998d018f9c2ecbc3 P 288a46a90f26471584043331107dc0dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:00.441327 24011 raft_consensus.cc:3055] T 54a02c3fbc0b4807998d018f9c2ecbc3 P 288a46a90f26471584043331107dc0dd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:00.441810 24011 raft_consensus.cc:740] T 54a02c3fbc0b4807998d018f9c2ecbc3 P 288a46a90f26471584043331107dc0dd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 288a46a90f26471584043331107dc0dd, State: Running, Role: LEADER
I20260709 12:14:00.442814 24011 consensus_queue.cc:260] T 54a02c3fbc0b4807998d018f9c2ecbc3 P 288a46a90f26471584043331107dc0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:14:00.444211 24011 raft_consensus.cc:3060] T 54a02c3fbc0b4807998d018f9c2ecbc3 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:00.445044 24000 leader_election.cc:290] T 54a02c3fbc0b4807998d018f9c2ecbc3 P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 2 election: Requested vote from peers 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061), 288a46a90f26471584043331107dc0dd (127.12.174.129:46159)
I20260709 12:14:00.447023 23874 raft_consensus.cc:515] T 27202f3dd66a42a3832a9cc25ba6e3e5 P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:14:00.448323 23224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a02c3fbc0b4807998d018f9c2ecbc3" candidate_uuid: "9ba0da223cf24c97bc7d225e25015924" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "288a46a90f26471584043331107dc0dd"
I20260709 12:14:00.450141 23371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27202f3dd66a42a3832a9cc25ba6e3e5" candidate_uuid: "2904b089bdb249b78950db76f4a70e9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a9a63ca97694ebdb84bca730762d735"
I20260709 12:14:00.450858 23371 raft_consensus.cc:3060] T 27202f3dd66a42a3832a9cc25ba6e3e5 P 3a9a63ca97694ebdb84bca730762d735 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:00.429423 23123 catalog_manager.cc:5697] T b90be1e04a3443e989951ea6bc45ed2f P 2904b089bdb249b78950db76f4a70e9f reported cstate change: term changed from 0 to 1, leader changed from <none> to 2904b089bdb249b78950db76f4a70e9f (127.12.174.130). New cstate: current_term: 1 leader_uuid: "2904b089bdb249b78950db76f4a70e9f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:00.453401 23496 tablet_bootstrap.cc:492] T 509296352dfa43369c2637f89e917301 P 9ba0da223cf24c97bc7d225e25015924: Bootstrap starting.
I20260709 12:14:00.453863 23498 ts_tablet_manager.cc:1434] T 27202f3dd66a42a3832a9cc25ba6e3e5 P 2904b089bdb249b78950db76f4a70e9f: Time spent starting tablet: real 0.222s	user 0.006s	sys 0.005s
I20260709 12:14:00.475018 23498 tablet_bootstrap.cc:492] T b2fd9ee7ac0c442481f7e173874a8d00 P 2904b089bdb249b78950db76f4a70e9f: Bootstrap starting.
I20260709 12:14:00.499816 23874 leader_election.cc:290] T 27202f3dd66a42a3832a9cc25ba6e3e5 P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 1 election: Requested vote from peers 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061), 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081)
I20260709 12:14:00.502494 23983 consensus_queue.cc:1048] T e3d86fc25f7146c9b1af99387a07bdec P 9ba0da223cf24c97bc7d225e25015924 [LEADER]: Connected to new peer: Peer: permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:00.482079 23371 raft_consensus.cc:2468] T 27202f3dd66a42a3832a9cc25ba6e3e5 P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2904b089bdb249b78950db76f4a70e9f in term 1.
I20260709 12:14:00.505373 23267 leader_election.cc:304] T 27202f3dd66a42a3832a9cc25ba6e3e5 P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2904b089bdb249b78950db76f4a70e9f, 3a9a63ca97694ebdb84bca730762d735; no voters: 
I20260709 12:14:00.506237 23583 raft_consensus.cc:2804] T 27202f3dd66a42a3832a9cc25ba6e3e5 P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:00.506690 23583 raft_consensus.cc:697] T 27202f3dd66a42a3832a9cc25ba6e3e5 P 2904b089bdb249b78950db76f4a70e9f [term 1 LEADER]: Becoming Leader. State: Replica: 2904b089bdb249b78950db76f4a70e9f, State: Running, Role: LEADER
I20260709 12:14:00.507511 23583 consensus_queue.cc:237] T 27202f3dd66a42a3832a9cc25ba6e3e5 P 2904b089bdb249b78950db76f4a70e9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:14:00.510515 23442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27202f3dd66a42a3832a9cc25ba6e3e5" candidate_uuid: "2904b089bdb249b78950db76f4a70e9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba0da223cf24c97bc7d225e25015924"
I20260709 12:14:00.511237 23442 raft_consensus.cc:3060] T 27202f3dd66a42a3832a9cc25ba6e3e5 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:00.522181 23224 raft_consensus.cc:2410] T 54a02c3fbc0b4807998d018f9c2ecbc3 P 288a46a90f26471584043331107dc0dd [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ba0da223cf24c97bc7d225e25015924 for term 2 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260709 12:14:00.547333 24000 consensus_queue.cc:1048] T e3d86fc25f7146c9b1af99387a07bdec P 9ba0da223cf24c97bc7d225e25015924 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:14:00.547797 23192 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:14:00.548661 23496 tablet_bootstrap.cc:654] T 509296352dfa43369c2637f89e917301 P 9ba0da223cf24c97bc7d225e25015924: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:00.550242 23498 tablet_bootstrap.cc:654] T b2fd9ee7ac0c442481f7e173874a8d00 P 2904b089bdb249b78950db76f4a70e9f: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:00.556164 23416 leader_election.cc:304] T 54a02c3fbc0b4807998d018f9c2ecbc3 P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ba0da223cf24c97bc7d225e25015924; no voters: 288a46a90f26471584043331107dc0dd, 3a9a63ca97694ebdb84bca730762d735
I20260709 12:14:00.558166 24000 raft_consensus.cc:2749] T 54a02c3fbc0b4807998d018f9c2ecbc3 P 9ba0da223cf24c97bc7d225e25015924 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:14:00.563409 23442 raft_consensus.cc:2468] T 27202f3dd66a42a3832a9cc25ba6e3e5 P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2904b089bdb249b78950db76f4a70e9f in term 1.
W20260709 12:14:00.564532 23342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:46159, user_credentials={real_user=slave}} blocked reactor thread for 121892us
I20260709 12:14:00.589144 23498 tablet_bootstrap.cc:492] T b2fd9ee7ac0c442481f7e173874a8d00 P 2904b089bdb249b78950db76f4a70e9f: No bootstrap required, opened a new log
I20260709 12:14:00.589960 23498 ts_tablet_manager.cc:1403] T b2fd9ee7ac0c442481f7e173874a8d00 P 2904b089bdb249b78950db76f4a70e9f: Time spent bootstrapping tablet: real 0.122s	user 0.007s	sys 0.007s
I20260709 12:14:00.598650 23498 raft_consensus.cc:359] T b2fd9ee7ac0c442481f7e173874a8d00 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:14:00.610718 23498 raft_consensus.cc:385] T b2fd9ee7ac0c442481f7e173874a8d00 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:00.611675 23498 raft_consensus.cc:740] T b2fd9ee7ac0c442481f7e173874a8d00 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2904b089bdb249b78950db76f4a70e9f, State: Initialized, Role: FOLLOWER
I20260709 12:14:00.613996 23498 consensus_queue.cc:260] T b2fd9ee7ac0c442481f7e173874a8d00 P 2904b089bdb249b78950db76f4a70e9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:14:00.618052 23498 ts_tablet_manager.cc:1434] T b2fd9ee7ac0c442481f7e173874a8d00 P 2904b089bdb249b78950db76f4a70e9f: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.001s
I20260709 12:14:00.620869 23496 tablet_bootstrap.cc:492] T 509296352dfa43369c2637f89e917301 P 9ba0da223cf24c97bc7d225e25015924: No bootstrap required, opened a new log
I20260709 12:14:00.627918 23125 catalog_manager.cc:5697] T 27202f3dd66a42a3832a9cc25ba6e3e5 P 2904b089bdb249b78950db76f4a70e9f reported cstate change: term changed from 0 to 1, leader changed from <none> to 2904b089bdb249b78950db76f4a70e9f (127.12.174.130). New cstate: current_term: 1 leader_uuid: "2904b089bdb249b78950db76f4a70e9f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:00.636951 23496 ts_tablet_manager.cc:1403] T 509296352dfa43369c2637f89e917301 P 9ba0da223cf24c97bc7d225e25015924: Time spent bootstrapping tablet: real 0.231s	user 0.013s	sys 0.009s
I20260709 12:14:00.667872 23496 raft_consensus.cc:359] T 509296352dfa43369c2637f89e917301 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:14:00.668653 23496 raft_consensus.cc:385] T 509296352dfa43369c2637f89e917301 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:00.668928 23496 raft_consensus.cc:740] T 509296352dfa43369c2637f89e917301 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ba0da223cf24c97bc7d225e25015924, State: Initialized, Role: FOLLOWER
I20260709 12:14:00.669780 23496 consensus_queue.cc:260] T 509296352dfa43369c2637f89e917301 P 9ba0da223cf24c97bc7d225e25015924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:14:00.673332 23496 ts_tablet_manager.cc:1434] T 509296352dfa43369c2637f89e917301 P 9ba0da223cf24c97bc7d225e25015924: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.001s
I20260709 12:14:00.674628 23496 tablet_bootstrap.cc:492] T b2fd9ee7ac0c442481f7e173874a8d00 P 9ba0da223cf24c97bc7d225e25015924: Bootstrap starting.
I20260709 12:14:00.682613 23496 tablet_bootstrap.cc:654] T b2fd9ee7ac0c442481f7e173874a8d00 P 9ba0da223cf24c97bc7d225e25015924: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:00.697873 23496 tablet_bootstrap.cc:492] T b2fd9ee7ac0c442481f7e173874a8d00 P 9ba0da223cf24c97bc7d225e25015924: No bootstrap required, opened a new log
I20260709 12:14:00.698438 23496 ts_tablet_manager.cc:1403] T b2fd9ee7ac0c442481f7e173874a8d00 P 9ba0da223cf24c97bc7d225e25015924: Time spent bootstrapping tablet: real 0.024s	user 0.014s	sys 0.008s
I20260709 12:14:00.701260 23496 raft_consensus.cc:359] T b2fd9ee7ac0c442481f7e173874a8d00 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:14:00.701880 23496 raft_consensus.cc:385] T b2fd9ee7ac0c442481f7e173874a8d00 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:00.702090 23496 raft_consensus.cc:740] T b2fd9ee7ac0c442481f7e173874a8d00 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ba0da223cf24c97bc7d225e25015924, State: Initialized, Role: FOLLOWER
I20260709 12:14:00.702737 23496 consensus_queue.cc:260] T b2fd9ee7ac0c442481f7e173874a8d00 P 9ba0da223cf24c97bc7d225e25015924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:14:00.704752 23496 ts_tablet_manager.cc:1434] T b2fd9ee7ac0c442481f7e173874a8d00 P 9ba0da223cf24c97bc7d225e25015924: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:14:00.709758 23447 raft_consensus.cc:3060] T 509296352dfa43369c2637f89e917301 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:00.749718 23874 raft_consensus.cc:493] T b2fd9ee7ac0c442481f7e173874a8d00 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:00.750406 23874 raft_consensus.cc:515] T b2fd9ee7ac0c442481f7e173874a8d00 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:14:00.753753 23874 leader_election.cc:290] T b2fd9ee7ac0c442481f7e173874a8d00 P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081), 288a46a90f26471584043331107dc0dd (127.12.174.129:46159)
I20260709 12:14:00.754077 23227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2fd9ee7ac0c442481f7e173874a8d00" candidate_uuid: "2904b089bdb249b78950db76f4a70e9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "288a46a90f26471584043331107dc0dd" is_pre_election: true
I20260709 12:14:00.755044 23447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2fd9ee7ac0c442481f7e173874a8d00" candidate_uuid: "2904b089bdb249b78950db76f4a70e9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba0da223cf24c97bc7d225e25015924" is_pre_election: true
I20260709 12:14:00.755856 23447 raft_consensus.cc:2468] T b2fd9ee7ac0c442481f7e173874a8d00 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2904b089bdb249b78950db76f4a70e9f in term 0.
I20260709 12:14:00.754834 23227 raft_consensus.cc:2468] T b2fd9ee7ac0c442481f7e173874a8d00 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2904b089bdb249b78950db76f4a70e9f in term 0.
I20260709 12:14:00.757800 23266 leader_election.cc:304] T b2fd9ee7ac0c442481f7e173874a8d00 P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2904b089bdb249b78950db76f4a70e9f, 9ba0da223cf24c97bc7d225e25015924; no voters: 
I20260709 12:14:00.758677 23874 raft_consensus.cc:2804] T b2fd9ee7ac0c442481f7e173874a8d00 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:00.759068 23874 raft_consensus.cc:493] T b2fd9ee7ac0c442481f7e173874a8d00 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:00.759327 23874 raft_consensus.cc:3060] T b2fd9ee7ac0c442481f7e173874a8d00 P 2904b089bdb249b78950db76f4a70e9f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:00.767637 23874 raft_consensus.cc:515] T b2fd9ee7ac0c442481f7e173874a8d00 P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:14:00.769598 23874 leader_election.cc:290] T b2fd9ee7ac0c442481f7e173874a8d00 P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 1 election: Requested vote from peers 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081), 288a46a90f26471584043331107dc0dd (127.12.174.129:46159)
I20260709 12:14:00.770411 23447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2fd9ee7ac0c442481f7e173874a8d00" candidate_uuid: "2904b089bdb249b78950db76f4a70e9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ba0da223cf24c97bc7d225e25015924"
I20260709 12:14:00.770548 23227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2fd9ee7ac0c442481f7e173874a8d00" candidate_uuid: "2904b089bdb249b78950db76f4a70e9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "288a46a90f26471584043331107dc0dd"
I20260709 12:14:00.771073 23447 raft_consensus.cc:3060] T b2fd9ee7ac0c442481f7e173874a8d00 P 9ba0da223cf24c97bc7d225e25015924 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:00.771108 23227 raft_consensus.cc:3060] T b2fd9ee7ac0c442481f7e173874a8d00 P 288a46a90f26471584043331107dc0dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:00.778656 23227 raft_consensus.cc:2468] T b2fd9ee7ac0c442481f7e173874a8d00 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2904b089bdb249b78950db76f4a70e9f in term 1.
I20260709 12:14:00.779065 23447 raft_consensus.cc:2468] T b2fd9ee7ac0c442481f7e173874a8d00 P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2904b089bdb249b78950db76f4a70e9f in term 1.
I20260709 12:14:00.779908 23268 leader_election.cc:304] T b2fd9ee7ac0c442481f7e173874a8d00 P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 288a46a90f26471584043331107dc0dd, 2904b089bdb249b78950db76f4a70e9f; no voters: 
I20260709 12:14:00.780761 23874 raft_consensus.cc:2804] T b2fd9ee7ac0c442481f7e173874a8d00 P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:00.781275 23874 raft_consensus.cc:697] T b2fd9ee7ac0c442481f7e173874a8d00 P 2904b089bdb249b78950db76f4a70e9f [term 1 LEADER]: Becoming Leader. State: Replica: 2904b089bdb249b78950db76f4a70e9f, State: Running, Role: LEADER
I20260709 12:14:00.782188 23874 consensus_queue.cc:237] T b2fd9ee7ac0c442481f7e173874a8d00 P 2904b089bdb249b78950db76f4a70e9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:14:00.786967 23874 consensus_queue.cc:1048] T b90be1e04a3443e989951ea6bc45ed2f P 2904b089bdb249b78950db76f4a70e9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:00.794044 23125 catalog_manager.cc:5697] T b2fd9ee7ac0c442481f7e173874a8d00 P 2904b089bdb249b78950db76f4a70e9f reported cstate change: term changed from 0 to 1, leader changed from <none> to 2904b089bdb249b78950db76f4a70e9f (127.12.174.130). New cstate: current_term: 1 leader_uuid: "2904b089bdb249b78950db76f4a70e9f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:00.799221 23874 consensus_queue.cc:1048] T b90be1e04a3443e989951ea6bc45ed2f P 2904b089bdb249b78950db76f4a70e9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:01.057140 23583 consensus_queue.cc:1048] T 27202f3dd66a42a3832a9cc25ba6e3e5 P 2904b089bdb249b78950db76f4a70e9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:01.078418 23874 consensus_queue.cc:1048] T 27202f3dd66a42a3832a9cc25ba6e3e5 P 2904b089bdb249b78950db76f4a70e9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:01.220592 23874 consensus_queue.cc:1048] T b2fd9ee7ac0c442481f7e173874a8d00 P 2904b089bdb249b78950db76f4a70e9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:01.234970 23874 consensus_queue.cc:1048] T b2fd9ee7ac0c442481f7e173874a8d00 P 2904b089bdb249b78950db76f4a70e9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:01.654838 12986 tablet_server.cc:179] TabletServer@127.12.174.129:0 shutting down...
W20260709 12:14:01.660182 23268 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 124 similar messages]
W20260709 12:14:01.664786 23268 consensus_peers.cc:597] T 3ad2f373a67b4c9cbb2183c2c73eb3e5 P 2904b089bdb249b78950db76f4a70e9f -> Peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Couldn't send request to peer 288a46a90f26471584043331107dc0dd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:01.692968 23416 consensus_peers.cc:597] T 00335dfad3394f0c9689c0df8500bc9e P 9ba0da223cf24c97bc7d225e25015924 -> Peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Couldn't send request to peer 288a46a90f26471584043331107dc0dd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:01.699088 23268 consensus_peers.cc:597] T 6626b442492c47849fd3c907d1c12f3e P 2904b089bdb249b78950db76f4a70e9f -> Peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Couldn't send request to peer 288a46a90f26471584043331107dc0dd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:01.708896 12986 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:14:01.710144 12986 tablet_replica.cc:333] T b90be1e04a3443e989951ea6bc45ed2f P 288a46a90f26471584043331107dc0dd: stopping tablet replica
I20260709 12:14:01.711174 12986 raft_consensus.cc:2243] T b90be1e04a3443e989951ea6bc45ed2f P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 12:14:01.711458 23268 consensus_peers.cc:597] T d85273afe57c4f35bb72827d1c5879eb P 2904b089bdb249b78950db76f4a70e9f -> Peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Couldn't send request to peer 288a46a90f26471584043331107dc0dd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:01.711788 12986 raft_consensus.cc:2272] T b90be1e04a3443e989951ea6bc45ed2f P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:01.719348 12986 tablet_replica.cc:333] T b2fd9ee7ac0c442481f7e173874a8d00 P 288a46a90f26471584043331107dc0dd: stopping tablet replica
I20260709 12:14:01.720508 12986 raft_consensus.cc:2243] T b2fd9ee7ac0c442481f7e173874a8d00 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:01.721160 12986 raft_consensus.cc:2272] T b2fd9ee7ac0c442481f7e173874a8d00 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:01.719282 23268 consensus_peers.cc:597] T 6d7d1c502ee24072a41a2a55cfc3a5fa P 2904b089bdb249b78950db76f4a70e9f -> Peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Couldn't send request to peer 288a46a90f26471584043331107dc0dd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:01.724700 24017 raft_consensus.cc:493] T 54a02c3fbc0b4807998d018f9c2ecbc3 P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 288a46a90f26471584043331107dc0dd)
I20260709 12:14:01.725153 12986 tablet_replica.cc:333] T 54a02c3fbc0b4807998d018f9c2ecbc3 P 288a46a90f26471584043331107dc0dd: stopping tablet replica
I20260709 12:14:01.725508 24017 raft_consensus.cc:515] T 54a02c3fbc0b4807998d018f9c2ecbc3 P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:14:01.726382 12986 raft_consensus.cc:2243] T 54a02c3fbc0b4807998d018f9c2ecbc3 P 288a46a90f26471584043331107dc0dd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:01.726999 12986 pending_rounds.cc:70] T 54a02c3fbc0b4807998d018f9c2ecbc3 P 288a46a90f26471584043331107dc0dd: Trying to abort 1 pending ops.
I20260709 12:14:01.727638 12986 pending_rounds.cc:77] T 54a02c3fbc0b4807998d018f9c2ecbc3 P 288a46a90f26471584043331107dc0dd: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305622484129886208 op_type: NO_OP noop_request { }
I20260709 12:14:01.728080 12986 raft_consensus.cc:2889] T 54a02c3fbc0b4807998d018f9c2ecbc3 P 288a46a90f26471584043331107dc0dd [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:14:01.729560 12986 raft_consensus.cc:2272] T 54a02c3fbc0b4807998d018f9c2ecbc3 P 288a46a90f26471584043331107dc0dd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:01.729130 24017 leader_election.cc:290] T 54a02c3fbc0b4807998d018f9c2ecbc3 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081), 288a46a90f26471584043331107dc0dd (127.12.174.129:46159)
I20260709 12:14:01.729984 23443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a02c3fbc0b4807998d018f9c2ecbc3" candidate_uuid: "3a9a63ca97694ebdb84bca730762d735" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ba0da223cf24c97bc7d225e25015924" is_pre_election: true
I20260709 12:14:01.730916 23443 raft_consensus.cc:2393] T 54a02c3fbc0b4807998d018f9c2ecbc3 P 9ba0da223cf24c97bc7d225e25015924 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3a9a63ca97694ebdb84bca730762d735 in current term 2: Already voted for candidate 9ba0da223cf24c97bc7d225e25015924 in this term.
I20260709 12:14:01.733847 12986 tablet_replica.cc:333] T bed12810020c4496969b723bcdd4b4ec P 288a46a90f26471584043331107dc0dd: stopping tablet replica
I20260709 12:14:01.734798 12986 raft_consensus.cc:2243] T bed12810020c4496969b723bcdd4b4ec P 288a46a90f26471584043331107dc0dd [term 1 LEADER]: Raft consensus shutting down.
W20260709 12:14:01.735771 23268 consensus_peers.cc:597] T b90be1e04a3443e989951ea6bc45ed2f P 2904b089bdb249b78950db76f4a70e9f -> Peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Couldn't send request to peer 288a46a90f26471584043331107dc0dd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:01.735922 12986 raft_consensus.cc:2272] T bed12810020c4496969b723bcdd4b4ec P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:01.736521 23342 consensus_peers.cc:597] T ec2c01c273894e73b6a2ab39e0132286 P 3a9a63ca97694ebdb84bca730762d735 -> Peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Couldn't send request to peer 288a46a90f26471584043331107dc0dd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:01.739357 12986 tablet_replica.cc:333] T 558b91ca6fe3461da7eb4a1344ec14fc P 288a46a90f26471584043331107dc0dd: stopping tablet replica
I20260709 12:14:01.740232 12986 raft_consensus.cc:2243] T 558b91ca6fe3461da7eb4a1344ec14fc P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:01.740787 12986 raft_consensus.cc:2272] T 558b91ca6fe3461da7eb4a1344ec14fc P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:01.740856 23342 consensus_peers.cc:597] T 509296352dfa43369c2637f89e917301 P 3a9a63ca97694ebdb84bca730762d735 -> Peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Couldn't send request to peer 288a46a90f26471584043331107dc0dd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:01.745592 12986 tablet_replica.cc:333] T 6efb52601755488885a8baf030e7fae9 P 288a46a90f26471584043331107dc0dd: stopping tablet replica
I20260709 12:14:01.746747 12986 raft_consensus.cc:2243] T 6efb52601755488885a8baf030e7fae9 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 12:14:01.741546 23342 leader_election.cc:336] T 54a02c3fbc0b4807998d018f9c2ecbc3 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:01.747418 12986 raft_consensus.cc:2272] T 6efb52601755488885a8baf030e7fae9 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:01.748057 23342 leader_election.cc:304] T 54a02c3fbc0b4807998d018f9c2ecbc3 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3a9a63ca97694ebdb84bca730762d735; no voters: 288a46a90f26471584043331107dc0dd, 9ba0da223cf24c97bc7d225e25015924
I20260709 12:14:01.748860 24017 raft_consensus.cc:3060] T 54a02c3fbc0b4807998d018f9c2ecbc3 P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:01.751089 12986 tablet_replica.cc:333] T 8bed7e0b2b804500b4898a175fba3ebe P 288a46a90f26471584043331107dc0dd: stopping tablet replica
I20260709 12:14:01.752115 12986 raft_consensus.cc:2243] T 8bed7e0b2b804500b4898a175fba3ebe P 288a46a90f26471584043331107dc0dd [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:01.753355 12986 raft_consensus.cc:2272] T 8bed7e0b2b804500b4898a175fba3ebe P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:01.756387 12986 tablet_replica.cc:333] T 7754f065b43946f0a3aca8a75cb61273 P 288a46a90f26471584043331107dc0dd: stopping tablet replica
I20260709 12:14:01.757318 12986 raft_consensus.cc:2243] T 7754f065b43946f0a3aca8a75cb61273 P 288a46a90f26471584043331107dc0dd [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:01.758553 12986 raft_consensus.cc:2272] T 7754f065b43946f0a3aca8a75cb61273 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:01.761958 12986 tablet_replica.cc:333] T 2eb2c8089ce14124aed9a5d834cd0522 P 288a46a90f26471584043331107dc0dd: stopping tablet replica
I20260709 12:14:01.762992 12986 raft_consensus.cc:2243] T 2eb2c8089ce14124aed9a5d834cd0522 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:01.763603 12986 raft_consensus.cc:2272] T 2eb2c8089ce14124aed9a5d834cd0522 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:01.764071 23268 consensus_peers.cc:597] T 6efb52601755488885a8baf030e7fae9 P 2904b089bdb249b78950db76f4a70e9f -> Peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Couldn't send request to peer 288a46a90f26471584043331107dc0dd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:01.765137 23268 consensus_peers.cc:597] T 05b49011442c4131a4ac3c55feed5409 P 2904b089bdb249b78950db76f4a70e9f -> Peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Couldn't send request to peer 288a46a90f26471584043331107dc0dd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:01.766541 23268 consensus_peers.cc:597] T 5959fc0b70884d699725fb8d560e5de5 P 2904b089bdb249b78950db76f4a70e9f -> Peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Couldn't send request to peer 288a46a90f26471584043331107dc0dd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:01.767103 12986 tablet_replica.cc:333] T 919076caf9f94cd8b631ea3e60dc3593 P 288a46a90f26471584043331107dc0dd: stopping tablet replica
I20260709 12:14:01.768210 12986 raft_consensus.cc:2243] T 919076caf9f94cd8b631ea3e60dc3593 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:01.768844 12986 raft_consensus.cc:2272] T 919076caf9f94cd8b631ea3e60dc3593 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:01.772617 12986 tablet_replica.cc:333] T 05b49011442c4131a4ac3c55feed5409 P 288a46a90f26471584043331107dc0dd: stopping tablet replica
W20260709 12:14:01.772912 23416 consensus_peers.cc:597] T d2afee7aeea24f85b4bfecc49efcf841 P 9ba0da223cf24c97bc7d225e25015924 -> Peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Couldn't send request to peer 288a46a90f26471584043331107dc0dd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:01.773684 12986 raft_consensus.cc:2243] T 05b49011442c4131a4ac3c55feed5409 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:01.763019 24017 raft_consensus.cc:2749] T 54a02c3fbc0b4807998d018f9c2ecbc3 P 3a9a63ca97694ebdb84bca730762d735 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:01.774502 12986 raft_consensus.cc:2272] T 05b49011442c4131a4ac3c55feed5409 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:01.777680 12986 tablet_replica.cc:333] T 99bc4210d0b44dd282a5bf7606d122af P 288a46a90f26471584043331107dc0dd: stopping tablet replica
I20260709 12:14:01.778435 12986 raft_consensus.cc:2243] T 99bc4210d0b44dd282a5bf7606d122af P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:01.778926 12986 raft_consensus.cc:2272] T 99bc4210d0b44dd282a5bf7606d122af P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:01.781603 12986 tablet_replica.cc:333] T b3e2bbccfb7f4da8baf42735151ff804 P 288a46a90f26471584043331107dc0dd: stopping tablet replica
I20260709 12:14:01.782307 12986 raft_consensus.cc:2243] T b3e2bbccfb7f4da8baf42735151ff804 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:01.782810 12986 raft_consensus.cc:2272] T b3e2bbccfb7f4da8baf42735151ff804 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:01.785550 12986 tablet_replica.cc:333] T 27166b782a5049198cccb3e5905acbc7 P 288a46a90f26471584043331107dc0dd: stopping tablet replica
I20260709 12:14:01.786281 12986 raft_consensus.cc:2243] T 27166b782a5049198cccb3e5905acbc7 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:01.786849 12986 raft_consensus.cc:2272] T 27166b782a5049198cccb3e5905acbc7 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:01.789106 12986 tablet_replica.cc:333] T d2afee7aeea24f85b4bfecc49efcf841 P 288a46a90f26471584043331107dc0dd: stopping tablet replica
I20260709 12:14:01.789808 12986 raft_consensus.cc:2243] T d2afee7aeea24f85b4bfecc49efcf841 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:01.790351 12986 raft_consensus.cc:2272] T d2afee7aeea24f85b4bfecc49efcf841 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:01.792546 12986 tablet_replica.cc:333] T c3ac99f9dbb24693b97d3994ceb65955 P 288a46a90f26471584043331107dc0dd: stopping tablet replica
I20260709 12:14:01.793155 12986 raft_consensus.cc:2243] T c3ac99f9dbb24693b97d3994ceb65955 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:01.793617 12986 raft_consensus.cc:2272] T c3ac99f9dbb24693b97d3994ceb65955 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:01.795953 12986 tablet_replica.cc:333] T 45e4fb3889cc4d23bab3929c3fdd731e P 288a46a90f26471584043331107dc0dd: stopping tablet replica
I20260709 12:14:01.796638 12986 raft_consensus.cc:2243] T 45e4fb3889cc4d23bab3929c3fdd731e P 288a46a90f26471584043331107dc0dd [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:01.797564 12986 raft_consensus.cc:2272] T 45e4fb3889cc4d23bab3929c3fdd731e P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:01.800323 12986 tablet_replica.cc:333] T b1533753456b445991715da5158c921b P 288a46a90f26471584043331107dc0dd: stopping tablet replica
I20260709 12:14:01.801172 12986 raft_consensus.cc:2243] T b1533753456b445991715da5158c921b P 288a46a90f26471584043331107dc0dd [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:01.802315 12986 raft_consensus.cc:2272] T b1533753456b445991715da5158c921b P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:01.802902 23342 consensus_peers.cc:597] T 0f7747f7dcab4d6da9caf82c35717552 P 3a9a63ca97694ebdb84bca730762d735 -> Peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Couldn't send request to peer 288a46a90f26471584043331107dc0dd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:01.805282 12986 tablet_replica.cc:333] T 509296352dfa43369c2637f89e917301 P 288a46a90f26471584043331107dc0dd: stopping tablet replica
I20260709 12:14:01.807557 12986 raft_consensus.cc:2243] T 509296352dfa43369c2637f89e917301 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:01.808218 12986 raft_consensus.cc:2272] T 509296352dfa43369c2637f89e917301 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:01.811247 12986 tablet_replica.cc:333] T e3d86fc25f7146c9b1af99387a07bdec P 288a46a90f26471584043331107dc0dd: stopping tablet replica
I20260709 12:14:01.812177 12986 raft_consensus.cc:2243] T e3d86fc25f7146c9b1af99387a07bdec P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:01.812718 12986 raft_consensus.cc:2272] T e3d86fc25f7146c9b1af99387a07bdec P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:01.815565 12986 tablet_replica.cc:333] T 0646c3e87a184cd19184ff12695392a7 P 288a46a90f26471584043331107dc0dd: stopping tablet replica
I20260709 12:14:01.816725 12986 raft_consensus.cc:2243] T 0646c3e87a184cd19184ff12695392a7 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:01.817296 12986 raft_consensus.cc:2272] T 0646c3e87a184cd19184ff12695392a7 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:01.820219 12986 tablet_replica.cc:333] T c1c10ca2f5924b7eb5422f0aee2f85c3 P 288a46a90f26471584043331107dc0dd: stopping tablet replica
I20260709 12:14:01.821053 12986 raft_consensus.cc:2243] T c1c10ca2f5924b7eb5422f0aee2f85c3 P 288a46a90f26471584043331107dc0dd [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:01.822358 12986 raft_consensus.cc:2272] T c1c10ca2f5924b7eb5422f0aee2f85c3 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:01.825479 23268 consensus_peers.cc:597] T 92d63c0c6ef9452797da238708c39275 P 2904b089bdb249b78950db76f4a70e9f -> Peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Couldn't send request to peer 288a46a90f26471584043331107dc0dd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:01.825456 12986 tablet_replica.cc:333] T d55aba14f62b41538fdb710117d67580 P 288a46a90f26471584043331107dc0dd: stopping tablet replica
I20260709 12:14:01.827016 12986 raft_consensus.cc:2243] T d55aba14f62b41538fdb710117d67580 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:01.827564 12986 raft_consensus.cc:2272] T d55aba14f62b41538fdb710117d67580 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:01.830762 12986 tablet_replica.cc:333] T 509f7e554df04f83aeffd51ec07607d5 P 288a46a90f26471584043331107dc0dd: stopping tablet replica
I20260709 12:14:01.831686 12986 raft_consensus.cc:2243] T 509f7e554df04f83aeffd51ec07607d5 P 288a46a90f26471584043331107dc0dd [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:01.832922 12986 raft_consensus.cc:2272] T 509f7e554df04f83aeffd51ec07607d5 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:01.836067 12986 tablet_replica.cc:333] T 0f7747f7dcab4d6da9caf82c35717552 P 288a46a90f26471584043331107dc0dd: stopping tablet replica
I20260709 12:14:01.836687 12986 raft_consensus.cc:2243] T 0f7747f7dcab4d6da9caf82c35717552 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:01.837145 12986 raft_consensus.cc:2272] T 0f7747f7dcab4d6da9caf82c35717552 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:01.839291 12986 tablet_replica.cc:333] T e0352fa4cf674ba8b7d1a0239bcf76e8 P 288a46a90f26471584043331107dc0dd: stopping tablet replica
I20260709 12:14:01.839874 12986 raft_consensus.cc:2243] T e0352fa4cf674ba8b7d1a0239bcf76e8 P 288a46a90f26471584043331107dc0dd [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:01.840777 12986 raft_consensus.cc:2272] T e0352fa4cf674ba8b7d1a0239bcf76e8 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:01.843019 12986 tablet_replica.cc:333] T 92d63c0c6ef9452797da238708c39275 P 288a46a90f26471584043331107dc0dd: stopping tablet replica
I20260709 12:14:01.843631 12986 raft_consensus.cc:2243] T 92d63c0c6ef9452797da238708c39275 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:01.844084 12986 raft_consensus.cc:2272] T 92d63c0c6ef9452797da238708c39275 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:01.846187 12986 tablet_replica.cc:333] T 00335dfad3394f0c9689c0df8500bc9e P 288a46a90f26471584043331107dc0dd: stopping tablet replica
I20260709 12:14:01.846881 12986 raft_consensus.cc:2243] T 00335dfad3394f0c9689c0df8500bc9e P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:01.847380 12986 raft_consensus.cc:2272] T 00335dfad3394f0c9689c0df8500bc9e P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:01.850674 12986 tablet_replica.cc:333] T d85273afe57c4f35bb72827d1c5879eb P 288a46a90f26471584043331107dc0dd: stopping tablet replica
W20260709 12:14:01.851002 23342 consensus_peers.cc:597] T 0646c3e87a184cd19184ff12695392a7 P 3a9a63ca97694ebdb84bca730762d735 -> Peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Couldn't send request to peer 288a46a90f26471584043331107dc0dd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:01.851527 12986 raft_consensus.cc:2243] T d85273afe57c4f35bb72827d1c5879eb P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:01.852226 12986 raft_consensus.cc:2272] T d85273afe57c4f35bb72827d1c5879eb P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:01.854928 12986 tablet_replica.cc:333] T 8da66c3ab79d468dbfd36407c51d423a P 288a46a90f26471584043331107dc0dd: stopping tablet replica
I20260709 12:14:01.855576 12986 raft_consensus.cc:2243] T 8da66c3ab79d468dbfd36407c51d423a P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:01.856073 12986 raft_consensus.cc:2272] T 8da66c3ab79d468dbfd36407c51d423a P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:01.858449 12986 tablet_replica.cc:333] T 8771e0b5070c49c589f276c793f87727 P 288a46a90f26471584043331107dc0dd: stopping tablet replica
I20260709 12:14:01.859115 12986 raft_consensus.cc:2243] T 8771e0b5070c49c589f276c793f87727 P 288a46a90f26471584043331107dc0dd [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:01.860180 12986 raft_consensus.cc:2272] T 8771e0b5070c49c589f276c793f87727 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:01.863077 12986 tablet_replica.cc:333] T 96f1bc9b220f49d5845c08249cb6a44f P 288a46a90f26471584043331107dc0dd: stopping tablet replica
I20260709 12:14:01.863677 12986 raft_consensus.cc:2243] T 96f1bc9b220f49d5845c08249cb6a44f P 288a46a90f26471584043331107dc0dd [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:01.864593 12986 raft_consensus.cc:2272] T 96f1bc9b220f49d5845c08249cb6a44f P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:01.866772 12986 tablet_replica.cc:333] T 6626b442492c47849fd3c907d1c12f3e P 288a46a90f26471584043331107dc0dd: stopping tablet replica
I20260709 12:14:01.867604 12986 raft_consensus.cc:2243] T 6626b442492c47849fd3c907d1c12f3e P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:01.868091 12986 raft_consensus.cc:2272] T 6626b442492c47849fd3c907d1c12f3e P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:01.870522 12986 tablet_replica.cc:333] T 859d30d8c3fb4a499256ffad6dc2d1cd P 288a46a90f26471584043331107dc0dd: stopping tablet replica
I20260709 12:14:01.871119 12986 raft_consensus.cc:2243] T 859d30d8c3fb4a499256ffad6dc2d1cd P 288a46a90f26471584043331107dc0dd [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:01.872053 12986 raft_consensus.cc:2272] T 859d30d8c3fb4a499256ffad6dc2d1cd P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:01.874505 12986 tablet_replica.cc:333] T 3ad2f373a67b4c9cbb2183c2c73eb3e5 P 288a46a90f26471584043331107dc0dd: stopping tablet replica
I20260709 12:14:01.875097 12986 raft_consensus.cc:2243] T 3ad2f373a67b4c9cbb2183c2c73eb3e5 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:01.875569 12986 raft_consensus.cc:2272] T 3ad2f373a67b4c9cbb2183c2c73eb3e5 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:01.878064 12986 tablet_replica.cc:333] T ec2c01c273894e73b6a2ab39e0132286 P 288a46a90f26471584043331107dc0dd: stopping tablet replica
W20260709 12:14:01.878088 23342 consensus_peers.cc:597] T c3ac99f9dbb24693b97d3994ceb65955 P 3a9a63ca97694ebdb84bca730762d735 -> Peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Couldn't send request to peer 288a46a90f26471584043331107dc0dd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:01.878759 12986 raft_consensus.cc:2243] T ec2c01c273894e73b6a2ab39e0132286 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:01.879257 12986 raft_consensus.cc:2272] T ec2c01c273894e73b6a2ab39e0132286 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:01.881630 12986 tablet_replica.cc:333] T 5959fc0b70884d699725fb8d560e5de5 P 288a46a90f26471584043331107dc0dd: stopping tablet replica
I20260709 12:14:01.882256 12986 raft_consensus.cc:2243] T 5959fc0b70884d699725fb8d560e5de5 P 288a46a90f26471584043331107dc0dd [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:01.882817 12986 raft_consensus.cc:2272] T 5959fc0b70884d699725fb8d560e5de5 P 288a46a90f26471584043331107dc0dd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:01.885100 12986 tablet_replica.cc:333] T 9f2438f73a8e4760b7b37c5330853b72 P 288a46a90f26471584043331107dc0dd: stopping tablet replica
I20260709 12:14:01.885916 12986 raft_consensus.cc:2243] T 9f2438f73a8e4760b7b37c5330853b72 P 288a46a90f26471584043331107dc0dd [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:01.886920 12986 raft_consensus.cc:2272] T 9f2438f73a8e4760b7b37c5330853b72 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:01.889084 12986 tablet_replica.cc:333] T 6d7d1c502ee24072a41a2a55cfc3a5fa P 288a46a90f26471584043331107dc0dd: stopping tablet replica
I20260709 12:14:01.889672 12986 raft_consensus.cc:2243] T 6d7d1c502ee24072a41a2a55cfc3a5fa P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:01.890264 12986 raft_consensus.cc:2272] T 6d7d1c502ee24072a41a2a55cfc3a5fa P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:01.892620 12986 tablet_replica.cc:333] T 87c5024fe7274811b9598e504f3963a7 P 288a46a90f26471584043331107dc0dd: stopping tablet replica
I20260709 12:14:01.893213 12986 raft_consensus.cc:2243] T 87c5024fe7274811b9598e504f3963a7 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:01.893668 12986 raft_consensus.cc:2272] T 87c5024fe7274811b9598e504f3963a7 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:01.896526 12986 tablet_replica.cc:333] T d34300c6c4f2447182942fb5ab8cc3c4 P 288a46a90f26471584043331107dc0dd: stopping tablet replica
W20260709 12:14:01.896522 23342 consensus_peers.cc:597] T 27166b782a5049198cccb3e5905acbc7 P 3a9a63ca97694ebdb84bca730762d735 -> Peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Couldn't send request to peer 288a46a90f26471584043331107dc0dd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:01.897704 12986 raft_consensus.cc:2243] T d34300c6c4f2447182942fb5ab8cc3c4 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:01.898370 12986 raft_consensus.cc:2272] T d34300c6c4f2447182942fb5ab8cc3c4 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:01.902598 12986 tablet_replica.cc:333] T ac854957ad6246c6b123638cfafeacd4 P 288a46a90f26471584043331107dc0dd: stopping tablet replica
I20260709 12:14:01.903491 12986 raft_consensus.cc:2243] T ac854957ad6246c6b123638cfafeacd4 P 288a46a90f26471584043331107dc0dd [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:01.904693 12986 raft_consensus.cc:2272] T ac854957ad6246c6b123638cfafeacd4 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:01.907280 12986 tablet_replica.cc:333] T 9a21be1df2964860b89acefd66f6fbde P 288a46a90f26471584043331107dc0dd: stopping tablet replica
I20260709 12:14:01.908004 12986 raft_consensus.cc:2243] T 9a21be1df2964860b89acefd66f6fbde P 288a46a90f26471584043331107dc0dd [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:01.908974 12986 raft_consensus.cc:2272] T 9a21be1df2964860b89acefd66f6fbde P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:01.911156 12986 tablet_replica.cc:333] T a2f2a063cf2b4190826d81b2dcbf7709 P 288a46a90f26471584043331107dc0dd: stopping tablet replica
I20260709 12:14:01.911746 12986 raft_consensus.cc:2243] T a2f2a063cf2b4190826d81b2dcbf7709 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:01.912285 12986 raft_consensus.cc:2272] T a2f2a063cf2b4190826d81b2dcbf7709 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:01.914510 12986 tablet_replica.cc:333] T b1a6e82689a84e36949e5efca6592772 P 288a46a90f26471584043331107dc0dd: stopping tablet replica
I20260709 12:14:01.915030 12986 raft_consensus.cc:2243] T b1a6e82689a84e36949e5efca6592772 P 288a46a90f26471584043331107dc0dd [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:01.916292 12986 raft_consensus.cc:2272] T b1a6e82689a84e36949e5efca6592772 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:01.925849 23342 consensus_peers.cc:597] T 99bc4210d0b44dd282a5bf7606d122af P 3a9a63ca97694ebdb84bca730762d735 -> Peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Couldn't send request to peer 288a46a90f26471584043331107dc0dd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:01.930887 23342 consensus_peers.cc:597] T d55aba14f62b41538fdb710117d67580 P 3a9a63ca97694ebdb84bca730762d735 -> Peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Couldn't send request to peer 288a46a90f26471584043331107dc0dd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:01.948602 23268 consensus_peers.cc:597] T 2eb2c8089ce14124aed9a5d834cd0522 P 2904b089bdb249b78950db76f4a70e9f -> Peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Couldn't send request to peer 288a46a90f26471584043331107dc0dd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:01.960479 23416 consensus_peers.cc:597] T d34300c6c4f2447182942fb5ab8cc3c4 P 9ba0da223cf24c97bc7d225e25015924 -> Peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Couldn't send request to peer 288a46a90f26471584043331107dc0dd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:01.980288 23268 consensus_peers.cc:597] T b3e2bbccfb7f4da8baf42735151ff804 P 2904b089bdb249b78950db76f4a70e9f -> Peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Couldn't send request to peer 288a46a90f26471584043331107dc0dd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:01.986272 23342 consensus_peers.cc:597] T a2f2a063cf2b4190826d81b2dcbf7709 P 3a9a63ca97694ebdb84bca730762d735 -> Peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Couldn't send request to peer 288a46a90f26471584043331107dc0dd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:02.010099 12986 tablet_server.cc:196] TabletServer@127.12.174.129:0 shutdown complete.
W20260709 12:14:02.023092 23268 consensus_peers.cc:597] T 558b91ca6fe3461da7eb4a1344ec14fc P 2904b089bdb249b78950db76f4a70e9f -> Peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Couldn't send request to peer 288a46a90f26471584043331107dc0dd. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:46159: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:02.039834 23416 consensus_peers.cc:597] T 8da66c3ab79d468dbfd36407c51d423a P 9ba0da223cf24c97bc7d225e25015924 -> Peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Couldn't send request to peer 288a46a90f26471584043331107dc0dd. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:46159: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:02.063280 23342 consensus_peers.cc:597] T 919076caf9f94cd8b631ea3e60dc3593 P 3a9a63ca97694ebdb84bca730762d735 -> Peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Couldn't send request to peer 288a46a90f26471584043331107dc0dd. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:46159: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:02.072611 23268 consensus_peers.cc:597] T 87c5024fe7274811b9598e504f3963a7 P 2904b089bdb249b78950db76f4a70e9f -> Peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Couldn't send request to peer 288a46a90f26471584043331107dc0dd. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:46159: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:02.094170 23416 consensus_peers.cc:597] T e3d86fc25f7146c9b1af99387a07bdec P 9ba0da223cf24c97bc7d225e25015924 -> Peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Couldn't send request to peer 288a46a90f26471584043331107dc0dd. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:46159: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:02.132434 12986 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:14:02.146047 24041 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:02.147300 24042 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:14:02.169479 23987 raft_consensus.cc:493] T 54a02c3fbc0b4807998d018f9c2ecbc3 P 9ba0da223cf24c97bc7d225e25015924 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:02.170199 23987 raft_consensus.cc:515] T 54a02c3fbc0b4807998d018f9c2ecbc3 P 9ba0da223cf24c97bc7d225e25015924 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
W20260709 12:14:02.174268 23268 consensus_peers.cc:597] T b2fd9ee7ac0c442481f7e173874a8d00 P 2904b089bdb249b78950db76f4a70e9f -> Peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Couldn't send request to peer 288a46a90f26471584043331107dc0dd. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:46159: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:02.177119 23374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a02c3fbc0b4807998d018f9c2ecbc3" candidate_uuid: "9ba0da223cf24c97bc7d225e25015924" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a9a63ca97694ebdb84bca730762d735" is_pre_election: true
I20260709 12:14:02.178117 23374 raft_consensus.cc:2410] T 54a02c3fbc0b4807998d018f9c2ecbc3 P 3a9a63ca97694ebdb84bca730762d735 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ba0da223cf24c97bc7d225e25015924 for term 3 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
W20260709 12:14:02.189437 23416 leader_election.cc:336] T 54a02c3fbc0b4807998d018f9c2ecbc3 P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Network error: Client connection negotiation failed: client connection to 127.12.174.129:46159: connect: Connection refused (error 111)
I20260709 12:14:02.190060 23416 leader_election.cc:304] T 54a02c3fbc0b4807998d018f9c2ecbc3 P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ba0da223cf24c97bc7d225e25015924; no voters: 288a46a90f26471584043331107dc0dd, 3a9a63ca97694ebdb84bca730762d735
I20260709 12:14:02.190954 24037 raft_consensus.cc:2749] T 54a02c3fbc0b4807998d018f9c2ecbc3 P 9ba0da223cf24c97bc7d225e25015924 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:02.195145 23987 leader_election.cc:290] T 54a02c3fbc0b4807998d018f9c2ecbc3 P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061), 288a46a90f26471584043331107dc0dd (127.12.174.129:46159)
W20260709 12:14:02.220136 24044 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:14:02.220809 12986 server_base.cc:1061] running on GCE node
I20260709 12:14:02.226325 12986 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:14:02.226711 12986 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:14:02.226926 12986 hybrid_clock.cc:648] HybridClock initialized: now 1783599242226904 us; error 0 us; skew 500 ppm
I20260709 12:14:02.227558 12986 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:14:02.251518 12986 webserver.cc:533] Webserver started at http://127.12.174.129:35747/ using document root <none> and password file <none>
I20260709 12:14:02.252425 12986 fs_manager.cc:362] Metadata directory not provided
I20260709 12:14:02.252748 12986 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 12:14:02.258872 12986 fs_manager.cc:714] Time spent opening directory manager: real 0.004s	user 0.000s	sys 0.004s
I20260709 12:14:02.271078 24049 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:02.272120 12986 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 12:14:02.272511 12986 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598886212958-12986-0/minicluster-data/ts-0-root
uuid: "288a46a90f26471584043331107dc0dd"
format_stamp: "Formatted at 2026-07-09 12:13:46 on dist-test-slave-9q7n"
I20260709 12:14:02.272979 12986 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598886212958-12986-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598886212958-12986-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598886212958-12986-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:14:02.288623 12986 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:14:02.290548 12986 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:14:02.299431 12986 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:14:02.315183 24056 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
I20260709 12:14:02.671958 12986 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 12:14:02.672286 12986 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.358s	user 0.007s	sys 0.003s
I20260709 12:14:02.672603 12986 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 12:14:02.679148 24056 tablet_bootstrap.cc:492] T 99bc4210d0b44dd282a5bf7606d122af P 288a46a90f26471584043331107dc0dd: Bootstrap starting.
I20260709 12:14:02.693146 24056 tablet_bootstrap.cc:492] T 99bc4210d0b44dd282a5bf7606d122af P 288a46a90f26471584043331107dc0dd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:02.694196 24056 tablet_bootstrap.cc:492] T 99bc4210d0b44dd282a5bf7606d122af P 288a46a90f26471584043331107dc0dd: Bootstrap complete.
I20260709 12:14:02.694887 24056 ts_tablet_manager.cc:1403] T 99bc4210d0b44dd282a5bf7606d122af P 288a46a90f26471584043331107dc0dd: Time spent bootstrapping tablet: real 0.016s	user 0.010s	sys 0.004s
I20260709 12:14:02.697633 24056 raft_consensus.cc:359] T 99bc4210d0b44dd282a5bf7606d122af P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:14:02.698328 24056 raft_consensus.cc:740] T 99bc4210d0b44dd282a5bf7606d122af P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 288a46a90f26471584043331107dc0dd, State: Initialized, Role: FOLLOWER
I20260709 12:14:02.699018 24056 consensus_queue.cc:260] T 99bc4210d0b44dd282a5bf7606d122af P 288a46a90f26471584043331107dc0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:14:02.701860 24056 ts_tablet_manager.cc:1434] T 99bc4210d0b44dd282a5bf7606d122af P 288a46a90f26471584043331107dc0dd: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:14:02.702534 24056 tablet_bootstrap.cc:492] T 00335dfad3394f0c9689c0df8500bc9e P 288a46a90f26471584043331107dc0dd: Bootstrap starting.
I20260709 12:14:02.714300 24056 tablet_bootstrap.cc:492] T 00335dfad3394f0c9689c0df8500bc9e P 288a46a90f26471584043331107dc0dd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:02.715305 24056 tablet_bootstrap.cc:492] T 00335dfad3394f0c9689c0df8500bc9e P 288a46a90f26471584043331107dc0dd: Bootstrap complete.
I20260709 12:14:02.716034 24056 ts_tablet_manager.cc:1403] T 00335dfad3394f0c9689c0df8500bc9e P 288a46a90f26471584043331107dc0dd: Time spent bootstrapping tablet: real 0.014s	user 0.011s	sys 0.000s
I20260709 12:14:02.719098 24056 raft_consensus.cc:359] T 00335dfad3394f0c9689c0df8500bc9e P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:14:02.719821 24056 raft_consensus.cc:740] T 00335dfad3394f0c9689c0df8500bc9e P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 288a46a90f26471584043331107dc0dd, State: Initialized, Role: FOLLOWER
I20260709 12:14:02.720590 24056 consensus_queue.cc:260] T 00335dfad3394f0c9689c0df8500bc9e P 288a46a90f26471584043331107dc0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:14:02.722468 24056 ts_tablet_manager.cc:1434] T 00335dfad3394f0c9689c0df8500bc9e P 288a46a90f26471584043331107dc0dd: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:14:02.723259 24056 tablet_bootstrap.cc:492] T 0646c3e87a184cd19184ff12695392a7 P 288a46a90f26471584043331107dc0dd: Bootstrap starting.
I20260709 12:14:02.740365 24056 tablet_bootstrap.cc:492] T 0646c3e87a184cd19184ff12695392a7 P 288a46a90f26471584043331107dc0dd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:02.741307 24056 tablet_bootstrap.cc:492] T 0646c3e87a184cd19184ff12695392a7 P 288a46a90f26471584043331107dc0dd: Bootstrap complete.
I20260709 12:14:02.742136 24056 ts_tablet_manager.cc:1403] T 0646c3e87a184cd19184ff12695392a7 P 288a46a90f26471584043331107dc0dd: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.008s
I20260709 12:14:02.745183 24056 raft_consensus.cc:359] T 0646c3e87a184cd19184ff12695392a7 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:14:02.745963 24056 raft_consensus.cc:740] T 0646c3e87a184cd19184ff12695392a7 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 288a46a90f26471584043331107dc0dd, State: Initialized, Role: FOLLOWER
I20260709 12:14:02.746665 24056 consensus_queue.cc:260] T 0646c3e87a184cd19184ff12695392a7 P 288a46a90f26471584043331107dc0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:14:02.748684 24056 ts_tablet_manager.cc:1434] T 0646c3e87a184cd19184ff12695392a7 P 288a46a90f26471584043331107dc0dd: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:14:02.749514 24056 tablet_bootstrap.cc:492] T c1c10ca2f5924b7eb5422f0aee2f85c3 P 288a46a90f26471584043331107dc0dd: Bootstrap starting.
I20260709 12:14:02.755098 24017 raft_consensus.cc:493] T 7754f065b43946f0a3aca8a75cb61273 P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 288a46a90f26471584043331107dc0dd)
I20260709 12:14:02.755734 24017 raft_consensus.cc:515] T 7754f065b43946f0a3aca8a75cb61273 P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:14:02.759105 23443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7754f065b43946f0a3aca8a75cb61273" candidate_uuid: "3a9a63ca97694ebdb84bca730762d735" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ba0da223cf24c97bc7d225e25015924" is_pre_election: true
I20260709 12:14:02.762774 24017 leader_election.cc:290] T 7754f065b43946f0a3aca8a75cb61273 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081), 288a46a90f26471584043331107dc0dd (127.12.174.129:46159)
W20260709 12:14:02.763881 23342 leader_election.cc:336] T 7754f065b43946f0a3aca8a75cb61273 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Network error: Client connection negotiation failed: client connection to 127.12.174.129:46159: connect: Connection refused (error 111)
I20260709 12:14:02.764384 23342 leader_election.cc:304] T 7754f065b43946f0a3aca8a75cb61273 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3a9a63ca97694ebdb84bca730762d735; no voters: 288a46a90f26471584043331107dc0dd, 9ba0da223cf24c97bc7d225e25015924
I20260709 12:14:02.765129 24017 raft_consensus.cc:2749] T 7754f065b43946f0a3aca8a75cb61273 P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:02.766952 24056 tablet_bootstrap.cc:492] T c1c10ca2f5924b7eb5422f0aee2f85c3 P 288a46a90f26471584043331107dc0dd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:02.767838 24056 tablet_bootstrap.cc:492] T c1c10ca2f5924b7eb5422f0aee2f85c3 P 288a46a90f26471584043331107dc0dd: Bootstrap complete.
I20260709 12:14:02.768486 24056 ts_tablet_manager.cc:1403] T c1c10ca2f5924b7eb5422f0aee2f85c3 P 288a46a90f26471584043331107dc0dd: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.004s
I20260709 12:14:02.771315 24056 raft_consensus.cc:359] T c1c10ca2f5924b7eb5422f0aee2f85c3 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:14:02.771945 24056 raft_consensus.cc:740] T c1c10ca2f5924b7eb5422f0aee2f85c3 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 288a46a90f26471584043331107dc0dd, State: Initialized, Role: FOLLOWER
I20260709 12:14:02.772575 24056 consensus_queue.cc:260] T c1c10ca2f5924b7eb5422f0aee2f85c3 P 288a46a90f26471584043331107dc0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:14:02.774286 24056 ts_tablet_manager.cc:1434] T c1c10ca2f5924b7eb5422f0aee2f85c3 P 288a46a90f26471584043331107dc0dd: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:14:02.775111 24056 tablet_bootstrap.cc:492] T d2afee7aeea24f85b4bfecc49efcf841 P 288a46a90f26471584043331107dc0dd: Bootstrap starting.
I20260709 12:14:02.785218 24017 raft_consensus.cc:493] T 8bed7e0b2b804500b4898a175fba3ebe P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 288a46a90f26471584043331107dc0dd)
I20260709 12:14:02.785897 24017 raft_consensus.cc:515] T 8bed7e0b2b804500b4898a175fba3ebe P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:14:02.789395 24056 tablet_bootstrap.cc:492] T d2afee7aeea24f85b4bfecc49efcf841 P 288a46a90f26471584043331107dc0dd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:02.789804 23443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bed7e0b2b804500b4898a175fba3ebe" candidate_uuid: "3a9a63ca97694ebdb84bca730762d735" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ba0da223cf24c97bc7d225e25015924" is_pre_election: true
I20260709 12:14:02.790671 24056 tablet_bootstrap.cc:492] T d2afee7aeea24f85b4bfecc49efcf841 P 288a46a90f26471584043331107dc0dd: Bootstrap complete.
I20260709 12:14:02.791501 24056 ts_tablet_manager.cc:1403] T d2afee7aeea24f85b4bfecc49efcf841 P 288a46a90f26471584043331107dc0dd: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.004s
I20260709 12:14:02.792383 24012 raft_consensus.cc:493] T bed12810020c4496969b723bcdd4b4ec P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 288a46a90f26471584043331107dc0dd)
I20260709 12:14:02.792965 24012 raft_consensus.cc:515] T bed12810020c4496969b723bcdd4b4ec P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:14:02.794559 24056 raft_consensus.cc:359] T d2afee7aeea24f85b4bfecc49efcf841 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:14:02.795342 24056 raft_consensus.cc:740] T d2afee7aeea24f85b4bfecc49efcf841 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 288a46a90f26471584043331107dc0dd, State: Initialized, Role: FOLLOWER
I20260709 12:14:02.796159 24056 consensus_queue.cc:260] T d2afee7aeea24f85b4bfecc49efcf841 P 288a46a90f26471584043331107dc0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:14:02.798090 24012 leader_election.cc:290] T bed12810020c4496969b723bcdd4b4ec P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081), 288a46a90f26471584043331107dc0dd (127.12.174.129:46159)
I20260709 12:14:02.798292 24056 ts_tablet_manager.cc:1434] T d2afee7aeea24f85b4bfecc49efcf841 P 288a46a90f26471584043331107dc0dd: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:14:02.799275 24017 leader_election.cc:290] T 8bed7e0b2b804500b4898a175fba3ebe P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081), 288a46a90f26471584043331107dc0dd (127.12.174.129:46159)
I20260709 12:14:02.799296 24056 tablet_bootstrap.cc:492] T 3ad2f373a67b4c9cbb2183c2c73eb3e5 P 288a46a90f26471584043331107dc0dd: Bootstrap starting.
I20260709 12:14:02.799749 23443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed12810020c4496969b723bcdd4b4ec" candidate_uuid: "3a9a63ca97694ebdb84bca730762d735" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ba0da223cf24c97bc7d225e25015924" is_pre_election: true
I20260709 12:14:02.801101 24037 raft_consensus.cc:493] T e0352fa4cf674ba8b7d1a0239bcf76e8 P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 288a46a90f26471584043331107dc0dd)
I20260709 12:14:02.801632 24037 raft_consensus.cc:515] T e0352fa4cf674ba8b7d1a0239bcf76e8 P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:14:02.803840 24037 leader_election.cc:290] T e0352fa4cf674ba8b7d1a0239bcf76e8 P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061), 288a46a90f26471584043331107dc0dd (127.12.174.129:46159)
I20260709 12:14:02.805414 23375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0352fa4cf674ba8b7d1a0239bcf76e8" candidate_uuid: "9ba0da223cf24c97bc7d225e25015924" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3a9a63ca97694ebdb84bca730762d735" is_pre_election: true
W20260709 12:14:02.806979 23342 leader_election.cc:336] T 8bed7e0b2b804500b4898a175fba3ebe P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Network error: Client connection negotiation failed: client connection to 127.12.174.129:46159: connect: Connection refused (error 111)
I20260709 12:14:02.807480 23342 leader_election.cc:304] T 8bed7e0b2b804500b4898a175fba3ebe P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3a9a63ca97694ebdb84bca730762d735; no voters: 288a46a90f26471584043331107dc0dd, 9ba0da223cf24c97bc7d225e25015924
W20260709 12:14:02.808660 23416 leader_election.cc:336] T e0352fa4cf674ba8b7d1a0239bcf76e8 P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Network error: Client connection negotiation failed: client connection to 127.12.174.129:46159: connect: Connection refused (error 111)
I20260709 12:14:02.809173 23416 leader_election.cc:304] T e0352fa4cf674ba8b7d1a0239bcf76e8 P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ba0da223cf24c97bc7d225e25015924; no voters: 288a46a90f26471584043331107dc0dd, 3a9a63ca97694ebdb84bca730762d735
I20260709 12:14:02.810009 24037 raft_consensus.cc:2749] T e0352fa4cf674ba8b7d1a0239bcf76e8 P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:14:02.814930 23342 leader_election.cc:336] T bed12810020c4496969b723bcdd4b4ec P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Network error: Client connection negotiation failed: client connection to 127.12.174.129:46159: connect: Connection refused (error 111)
I20260709 12:14:02.815522 23342 leader_election.cc:304] T bed12810020c4496969b723bcdd4b4ec P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3a9a63ca97694ebdb84bca730762d735; no voters: 288a46a90f26471584043331107dc0dd, 9ba0da223cf24c97bc7d225e25015924
I20260709 12:14:02.816320 24012 raft_consensus.cc:2749] T 8bed7e0b2b804500b4898a175fba3ebe P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:02.816601 24037 raft_consensus.cc:493] T 8bed7e0b2b804500b4898a175fba3ebe P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 288a46a90f26471584043331107dc0dd)
I20260709 12:14:02.817070 24012 raft_consensus.cc:2749] T bed12810020c4496969b723bcdd4b4ec P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:02.817204 24037 raft_consensus.cc:515] T 8bed7e0b2b804500b4898a175fba3ebe P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:14:02.819660 24037 leader_election.cc:290] T 8bed7e0b2b804500b4898a175fba3ebe P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061), 288a46a90f26471584043331107dc0dd (127.12.174.129:46159)
I20260709 12:14:02.821266 23371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bed7e0b2b804500b4898a175fba3ebe" candidate_uuid: "9ba0da223cf24c97bc7d225e25015924" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3a9a63ca97694ebdb84bca730762d735" is_pre_election: true
I20260709 12:14:02.822082 23371 raft_consensus.cc:2468] T 8bed7e0b2b804500b4898a175fba3ebe P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ba0da223cf24c97bc7d225e25015924 in term 1.
I20260709 12:14:02.823644 23415 leader_election.cc:304] T 8bed7e0b2b804500b4898a175fba3ebe P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a9a63ca97694ebdb84bca730762d735, 9ba0da223cf24c97bc7d225e25015924; no voters: 
I20260709 12:14:02.824484 24037 raft_consensus.cc:2804] T 8bed7e0b2b804500b4898a175fba3ebe P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:02.824877 24037 raft_consensus.cc:493] T 8bed7e0b2b804500b4898a175fba3ebe P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 288a46a90f26471584043331107dc0dd)
I20260709 12:14:02.825220 24037 raft_consensus.cc:3060] T 8bed7e0b2b804500b4898a175fba3ebe P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:02.836730 23952 raft_consensus.cc:493] T 9f2438f73a8e4760b7b37c5330853b72 P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 288a46a90f26471584043331107dc0dd)
I20260709 12:14:02.837495 23952 raft_consensus.cc:515] T 9f2438f73a8e4760b7b37c5330853b72 P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:14:02.837960 23987 raft_consensus.cc:493] T 7754f065b43946f0a3aca8a75cb61273 P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 288a46a90f26471584043331107dc0dd)
I20260709 12:14:02.838629 23987 raft_consensus.cc:515] T 7754f065b43946f0a3aca8a75cb61273 P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:14:02.840575 23987 leader_election.cc:290] T 7754f065b43946f0a3aca8a75cb61273 P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061), 288a46a90f26471584043331107dc0dd (127.12.174.129:46159)
I20260709 12:14:02.842206 24056 tablet_bootstrap.cc:492] T 3ad2f373a67b4c9cbb2183c2c73eb3e5 P 288a46a90f26471584043331107dc0dd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:02.843264 24056 tablet_bootstrap.cc:492] T 3ad2f373a67b4c9cbb2183c2c73eb3e5 P 288a46a90f26471584043331107dc0dd: Bootstrap complete.
I20260709 12:14:02.843264 23374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7754f065b43946f0a3aca8a75cb61273" candidate_uuid: "9ba0da223cf24c97bc7d225e25015924" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3a9a63ca97694ebdb84bca730762d735" is_pre_election: true
I20260709 12:14:02.843972 24056 ts_tablet_manager.cc:1403] T 3ad2f373a67b4c9cbb2183c2c73eb3e5 P 288a46a90f26471584043331107dc0dd: Time spent bootstrapping tablet: real 0.045s	user 0.019s	sys 0.004s
I20260709 12:14:02.844086 23374 raft_consensus.cc:2468] T 7754f065b43946f0a3aca8a75cb61273 P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ba0da223cf24c97bc7d225e25015924 in term 1.
I20260709 12:14:02.846374 23415 leader_election.cc:304] T 7754f065b43946f0a3aca8a75cb61273 P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a9a63ca97694ebdb84bca730762d735, 9ba0da223cf24c97bc7d225e25015924; no voters: 
I20260709 12:14:02.842355 23298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f2438f73a8e4760b7b37c5330853b72" candidate_uuid: "9ba0da223cf24c97bc7d225e25015924" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2904b089bdb249b78950db76f4a70e9f" is_pre_election: true
I20260709 12:14:02.847004 24056 raft_consensus.cc:359] T 3ad2f373a67b4c9cbb2183c2c73eb3e5 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:14:02.847867 24056 raft_consensus.cc:740] T 3ad2f373a67b4c9cbb2183c2c73eb3e5 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 288a46a90f26471584043331107dc0dd, State: Initialized, Role: FOLLOWER
I20260709 12:14:02.850276 23987 raft_consensus.cc:2804] T 7754f065b43946f0a3aca8a75cb61273 P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:02.849998 24056 consensus_queue.cc:260] T 3ad2f373a67b4c9cbb2183c2c73eb3e5 P 288a46a90f26471584043331107dc0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:14:02.839824 23952 leader_election.cc:290] T 9f2438f73a8e4760b7b37c5330853b72 P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 288a46a90f26471584043331107dc0dd (127.12.174.129:46159), 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789)
W20260709 12:14:02.851047 23416 leader_election.cc:336] T 8bed7e0b2b804500b4898a175fba3ebe P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Network error: Client connection negotiation failed: client connection to 127.12.174.129:46159: connect: Connection refused (error 111)
I20260709 12:14:02.853374 24056 ts_tablet_manager.cc:1434] T 3ad2f373a67b4c9cbb2183c2c73eb3e5 P 288a46a90f26471584043331107dc0dd: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:14:02.854440 24056 tablet_bootstrap.cc:492] T b1a6e82689a84e36949e5efca6592772 P 288a46a90f26471584043331107dc0dd: Bootstrap starting.
W20260709 12:14:02.855747 23416 leader_election.cc:336] T 9f2438f73a8e4760b7b37c5330853b72 P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Network error: Client connection negotiation failed: client connection to 127.12.174.129:46159: connect: Connection refused (error 111)
I20260709 12:14:02.856228 23416 leader_election.cc:304] T 9f2438f73a8e4760b7b37c5330853b72 P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ba0da223cf24c97bc7d225e25015924; no voters: 288a46a90f26471584043331107dc0dd, 2904b089bdb249b78950db76f4a70e9f
I20260709 12:14:02.856976 23952 raft_consensus.cc:2749] T 9f2438f73a8e4760b7b37c5330853b72 P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:14:02.859210 23416 leader_election.cc:336] T 7754f065b43946f0a3aca8a75cb61273 P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Network error: Client connection negotiation failed: client connection to 127.12.174.129:46159: connect: Connection refused (error 111)
I20260709 12:14:02.851063 23987 raft_consensus.cc:493] T 7754f065b43946f0a3aca8a75cb61273 P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 288a46a90f26471584043331107dc0dd)
I20260709 12:14:02.863004 23987 raft_consensus.cc:3060] T 7754f065b43946f0a3aca8a75cb61273 P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:02.856307 24037 raft_consensus.cc:515] T 8bed7e0b2b804500b4898a175fba3ebe P 9ba0da223cf24c97bc7d225e25015924 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:14:02.868726 23925 raft_consensus.cc:493] T b1533753456b445991715da5158c921b P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 288a46a90f26471584043331107dc0dd)
I20260709 12:14:02.869037 23374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bed7e0b2b804500b4898a175fba3ebe" candidate_uuid: "9ba0da223cf24c97bc7d225e25015924" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3a9a63ca97694ebdb84bca730762d735"
I20260709 12:14:02.869350 23925 raft_consensus.cc:515] T b1533753456b445991715da5158c921b P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:14:02.872727 23925 leader_election.cc:290] T b1533753456b445991715da5158c921b P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081), 288a46a90f26471584043331107dc0dd (127.12.174.129:46159)
I20260709 12:14:02.873140 23443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1533753456b445991715da5158c921b" candidate_uuid: "2904b089bdb249b78950db76f4a70e9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ba0da223cf24c97bc7d225e25015924" is_pre_election: true
I20260709 12:14:02.869858 23374 raft_consensus.cc:3060] T 8bed7e0b2b804500b4898a175fba3ebe P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:02.879319 24037 leader_election.cc:290] T 8bed7e0b2b804500b4898a175fba3ebe P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 2 election: Requested vote from peers 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061), 288a46a90f26471584043331107dc0dd (127.12.174.129:46159)
I20260709 12:14:02.880491 23987 raft_consensus.cc:515] T 7754f065b43946f0a3aca8a75cb61273 P 9ba0da223cf24c97bc7d225e25015924 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:14:02.884008 23371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7754f065b43946f0a3aca8a75cb61273" candidate_uuid: "9ba0da223cf24c97bc7d225e25015924" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3a9a63ca97694ebdb84bca730762d735"
W20260709 12:14:02.884485 23268 leader_election.cc:336] T b1533753456b445991715da5158c921b P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Network error: Client connection negotiation failed: client connection to 127.12.174.129:46159: connect: Connection refused (error 111)
I20260709 12:14:02.884766 23371 raft_consensus.cc:3060] T 7754f065b43946f0a3aca8a75cb61273 P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:02.890856 23268 leader_election.cc:304] T b1533753456b445991715da5158c921b P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2904b089bdb249b78950db76f4a70e9f; no voters: 288a46a90f26471584043331107dc0dd, 9ba0da223cf24c97bc7d225e25015924
I20260709 12:14:02.892210 23987 leader_election.cc:290] T 7754f065b43946f0a3aca8a75cb61273 P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 2 election: Requested vote from peers 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061), 288a46a90f26471584043331107dc0dd (127.12.174.129:46159)
I20260709 12:14:02.894340 23583 raft_consensus.cc:2749] T b1533753456b445991715da5158c921b P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:02.897981 23371 raft_consensus.cc:2468] T 7754f065b43946f0a3aca8a75cb61273 P 3a9a63ca97694ebdb84bca730762d735 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ba0da223cf24c97bc7d225e25015924 in term 2.
I20260709 12:14:02.900185 23415 leader_election.cc:304] T 7754f065b43946f0a3aca8a75cb61273 P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a9a63ca97694ebdb84bca730762d735, 9ba0da223cf24c97bc7d225e25015924; no voters: 
I20260709 12:14:02.903009 23987 raft_consensus.cc:2804] T 7754f065b43946f0a3aca8a75cb61273 P 9ba0da223cf24c97bc7d225e25015924 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:02.903707 24056 tablet_bootstrap.cc:492] T b1a6e82689a84e36949e5efca6592772 P 288a46a90f26471584043331107dc0dd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:02.903738 23987 raft_consensus.cc:697] T 7754f065b43946f0a3aca8a75cb61273 P 9ba0da223cf24c97bc7d225e25015924 [term 2 LEADER]: Becoming Leader. State: Replica: 9ba0da223cf24c97bc7d225e25015924, State: Running, Role: LEADER
I20260709 12:14:02.904924 23987 consensus_queue.cc:237] T 7754f065b43946f0a3aca8a75cb61273 P 9ba0da223cf24c97bc7d225e25015924 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:14:02.905658 24056 tablet_bootstrap.cc:492] T b1a6e82689a84e36949e5efca6592772 P 288a46a90f26471584043331107dc0dd: Bootstrap complete.
I20260709 12:14:02.906455 24056 ts_tablet_manager.cc:1403] T b1a6e82689a84e36949e5efca6592772 P 288a46a90f26471584043331107dc0dd: Time spent bootstrapping tablet: real 0.052s	user 0.023s	sys 0.021s
I20260709 12:14:02.909479 24056 raft_consensus.cc:359] T b1a6e82689a84e36949e5efca6592772 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:14:02.910274 24056 raft_consensus.cc:740] T b1a6e82689a84e36949e5efca6592772 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 288a46a90f26471584043331107dc0dd, State: Initialized, Role: FOLLOWER
I20260709 12:14:02.911190 24056 consensus_queue.cc:260] T b1a6e82689a84e36949e5efca6592772 P 288a46a90f26471584043331107dc0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:14:02.915050 24056 ts_tablet_manager.cc:1434] T b1a6e82689a84e36949e5efca6592772 P 288a46a90f26471584043331107dc0dd: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.002s
I20260709 12:14:02.916067 24056 tablet_bootstrap.cc:492] T 558b91ca6fe3461da7eb4a1344ec14fc P 288a46a90f26471584043331107dc0dd: Bootstrap starting.
I20260709 12:14:02.917531 23583 raft_consensus.cc:493] T 9a21be1df2964860b89acefd66f6fbde P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 288a46a90f26471584043331107dc0dd)
I20260709 12:14:02.918072 23583 raft_consensus.cc:515] T 9a21be1df2964860b89acefd66f6fbde P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:14:02.920085 23583 leader_election.cc:290] T 9a21be1df2964860b89acefd66f6fbde P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081), 288a46a90f26471584043331107dc0dd (127.12.174.129:46159)
I20260709 12:14:02.921811 23443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a21be1df2964860b89acefd66f6fbde" candidate_uuid: "2904b089bdb249b78950db76f4a70e9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ba0da223cf24c97bc7d225e25015924" is_pre_election: true
I20260709 12:14:02.931384 23374 raft_consensus.cc:2468] T 8bed7e0b2b804500b4898a175fba3ebe P 3a9a63ca97694ebdb84bca730762d735 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ba0da223cf24c97bc7d225e25015924 in term 2.
I20260709 12:14:02.932866 23415 leader_election.cc:304] T 8bed7e0b2b804500b4898a175fba3ebe P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a9a63ca97694ebdb84bca730762d735, 9ba0da223cf24c97bc7d225e25015924; no voters: 
I20260709 12:14:02.934633 24037 raft_consensus.cc:2804] T 8bed7e0b2b804500b4898a175fba3ebe P 9ba0da223cf24c97bc7d225e25015924 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:02.935175 24037 raft_consensus.cc:697] T 8bed7e0b2b804500b4898a175fba3ebe P 9ba0da223cf24c97bc7d225e25015924 [term 2 LEADER]: Becoming Leader. State: Replica: 9ba0da223cf24c97bc7d225e25015924, State: Running, Role: LEADER
I20260709 12:14:02.936007 24037 consensus_queue.cc:237] T 8bed7e0b2b804500b4898a175fba3ebe P 9ba0da223cf24c97bc7d225e25015924 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:14:02.949801 24056 tablet_bootstrap.cc:492] T 558b91ca6fe3461da7eb4a1344ec14fc P 288a46a90f26471584043331107dc0dd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:02.950877 24056 tablet_bootstrap.cc:492] T 558b91ca6fe3461da7eb4a1344ec14fc P 288a46a90f26471584043331107dc0dd: Bootstrap complete.
W20260709 12:14:02.947744 23268 leader_election.cc:336] T 9a21be1df2964860b89acefd66f6fbde P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Network error: Client connection negotiation failed: client connection to 127.12.174.129:46159: connect: Connection refused (error 111)
I20260709 12:14:02.951603 24056 ts_tablet_manager.cc:1403] T 558b91ca6fe3461da7eb4a1344ec14fc P 288a46a90f26471584043331107dc0dd: Time spent bootstrapping tablet: real 0.036s	user 0.014s	sys 0.008s
I20260709 12:14:02.957876 24056 raft_consensus.cc:359] T 558b91ca6fe3461da7eb4a1344ec14fc P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:14:02.958604 24056 raft_consensus.cc:740] T 558b91ca6fe3461da7eb4a1344ec14fc P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 288a46a90f26471584043331107dc0dd, State: Initialized, Role: FOLLOWER
I20260709 12:14:02.960788 24056 consensus_queue.cc:260] T 558b91ca6fe3461da7eb4a1344ec14fc P 288a46a90f26471584043331107dc0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:14:02.964164 24056 ts_tablet_manager.cc:1434] T 558b91ca6fe3461da7eb4a1344ec14fc P 288a46a90f26471584043331107dc0dd: Time spent starting tablet: real 0.012s	user 0.012s	sys 0.000s
I20260709 12:14:02.965009 24056 tablet_bootstrap.cc:492] T 9f2438f73a8e4760b7b37c5330853b72 P 288a46a90f26471584043331107dc0dd: Bootstrap starting.
I20260709 12:14:02.972662 23268 leader_election.cc:304] T 9a21be1df2964860b89acefd66f6fbde P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2904b089bdb249b78950db76f4a70e9f; no voters: 288a46a90f26471584043331107dc0dd, 9ba0da223cf24c97bc7d225e25015924
I20260709 12:14:02.976025 23991 raft_consensus.cc:2749] T 9a21be1df2964860b89acefd66f6fbde P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:02.978228 23122 catalog_manager.cc:5697] T 7754f065b43946f0a3aca8a75cb61273 P 9ba0da223cf24c97bc7d225e25015924 reported cstate change: term changed from 1 to 2, leader changed from 288a46a90f26471584043331107dc0dd (127.12.174.129) to 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132). New cstate: current_term: 2 leader_uuid: "9ba0da223cf24c97bc7d225e25015924" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } health_report { overall_health: UNKNOWN } } }
W20260709 12:14:02.979534 23416 leader_election.cc:336] T 8bed7e0b2b804500b4898a175fba3ebe P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Network error: Client connection negotiation failed: client connection to 127.12.174.129:46159: connect: Connection refused (error 111)
I20260709 12:14:02.981254 24015 raft_consensus.cc:493] T 509f7e554df04f83aeffd51ec07607d5 P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 288a46a90f26471584043331107dc0dd)
I20260709 12:14:02.984772 24015 raft_consensus.cc:515] T 509f7e554df04f83aeffd51ec07607d5 P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:14:02.987043 23952 raft_consensus.cc:493] T b1533753456b445991715da5158c921b P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 288a46a90f26471584043331107dc0dd)
I20260709 12:14:02.987212 24015 leader_election.cc:290] T 509f7e554df04f83aeffd51ec07607d5 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081), 288a46a90f26471584043331107dc0dd (127.12.174.129:46159)
I20260709 12:14:02.987640 23952 raft_consensus.cc:515] T b1533753456b445991715da5158c921b P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:14:02.990860 23443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509f7e554df04f83aeffd51ec07607d5" candidate_uuid: "3a9a63ca97694ebdb84bca730762d735" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ba0da223cf24c97bc7d225e25015924" is_pre_election: true
I20260709 12:14:02.991477 23991 raft_consensus.cc:493] T ac854957ad6246c6b123638cfafeacd4 P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 288a46a90f26471584043331107dc0dd)
I20260709 12:14:02.992089 23991 raft_consensus.cc:515] T ac854957ad6246c6b123638cfafeacd4 P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:14:02.994258 24056 tablet_bootstrap.cc:492] T 9f2438f73a8e4760b7b37c5330853b72 P 288a46a90f26471584043331107dc0dd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:02.994405 23991 leader_election.cc:290] T ac854957ad6246c6b123638cfafeacd4 P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081), 288a46a90f26471584043331107dc0dd (127.12.174.129:46159)
I20260709 12:14:02.995288 24056 tablet_bootstrap.cc:492] T 9f2438f73a8e4760b7b37c5330853b72 P 288a46a90f26471584043331107dc0dd: Bootstrap complete.
I20260709 12:14:02.996033 24056 ts_tablet_manager.cc:1403] T 9f2438f73a8e4760b7b37c5330853b72 P 288a46a90f26471584043331107dc0dd: Time spent bootstrapping tablet: real 0.031s	user 0.013s	sys 0.011s
I20260709 12:14:02.997332 23443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac854957ad6246c6b123638cfafeacd4" candidate_uuid: "2904b089bdb249b78950db76f4a70e9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ba0da223cf24c97bc7d225e25015924" is_pre_election: true
I20260709 12:14:02.998795 23298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1533753456b445991715da5158c921b" candidate_uuid: "9ba0da223cf24c97bc7d225e25015924" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2904b089bdb249b78950db76f4a70e9f" is_pre_election: true
I20260709 12:14:02.998898 23952 leader_election.cc:290] T b1533753456b445991715da5158c921b P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 288a46a90f26471584043331107dc0dd (127.12.174.129:46159), 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789)
I20260709 12:14:02.999524 23298 raft_consensus.cc:2468] T b1533753456b445991715da5158c921b P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ba0da223cf24c97bc7d225e25015924 in term 1.
I20260709 12:14:03.000983 24056 raft_consensus.cc:359] T 9f2438f73a8e4760b7b37c5330853b72 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:14:03.001773 24056 raft_consensus.cc:740] T 9f2438f73a8e4760b7b37c5330853b72 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 288a46a90f26471584043331107dc0dd, State: Initialized, Role: FOLLOWER
I20260709 12:14:03.001765 23415 leader_election.cc:304] T b1533753456b445991715da5158c921b P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2904b089bdb249b78950db76f4a70e9f, 9ba0da223cf24c97bc7d225e25015924; no voters: 
I20260709 12:14:03.002799 24056 consensus_queue.cc:260] T 9f2438f73a8e4760b7b37c5330853b72 P 288a46a90f26471584043331107dc0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:14:03.003767 23952 raft_consensus.cc:2804] T b1533753456b445991715da5158c921b P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:03.004184 23952 raft_consensus.cc:493] T b1533753456b445991715da5158c921b P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 288a46a90f26471584043331107dc0dd)
I20260709 12:14:03.004580 23952 raft_consensus.cc:3060] T b1533753456b445991715da5158c921b P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:03.005254 24056 ts_tablet_manager.cc:1434] T 9f2438f73a8e4760b7b37c5330853b72 P 288a46a90f26471584043331107dc0dd: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:14:03.006240 24056 tablet_bootstrap.cc:492] T 2eb2c8089ce14124aed9a5d834cd0522 P 288a46a90f26471584043331107dc0dd: Bootstrap starting.
W20260709 12:14:03.016176 23268 leader_election.cc:336] T ac854957ad6246c6b123638cfafeacd4 P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Network error: Client connection negotiation failed: client connection to 127.12.174.129:46159: connect: Connection refused (error 111)
W20260709 12:14:03.018210 23342 leader_election.cc:336] T 509f7e554df04f83aeffd51ec07607d5 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Network error: Client connection negotiation failed: client connection to 127.12.174.129:46159: connect: Connection refused (error 111)
I20260709 12:14:03.022608 23342 leader_election.cc:304] T 509f7e554df04f83aeffd51ec07607d5 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3a9a63ca97694ebdb84bca730762d735; no voters: 288a46a90f26471584043331107dc0dd, 9ba0da223cf24c97bc7d225e25015924
I20260709 12:14:03.023104 23268 leader_election.cc:304] T ac854957ad6246c6b123638cfafeacd4 P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2904b089bdb249b78950db76f4a70e9f; no voters: 288a46a90f26471584043331107dc0dd, 9ba0da223cf24c97bc7d225e25015924
I20260709 12:14:03.020985 12986 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 12:14:03.023438 24015 raft_consensus.cc:2749] T 509f7e554df04f83aeffd51ec07607d5 P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:03.026394 24012 raft_consensus.cc:493] T e0352fa4cf674ba8b7d1a0239bcf76e8 P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 288a46a90f26471584043331107dc0dd)
I20260709 12:14:03.026692 12986 ts_tablet_manager.cc:595] Time spent register tablets: real 0.354s	user 0.294s	sys 0.000s
I20260709 12:14:03.027012 24012 raft_consensus.cc:515] T e0352fa4cf674ba8b7d1a0239bcf76e8 P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:14:03.027400 24056 tablet_bootstrap.cc:492] T 2eb2c8089ce14124aed9a5d834cd0522 P 288a46a90f26471584043331107dc0dd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:03.028585 24056 tablet_bootstrap.cc:492] T 2eb2c8089ce14124aed9a5d834cd0522 P 288a46a90f26471584043331107dc0dd: Bootstrap complete.
I20260709 12:14:03.029318 24056 ts_tablet_manager.cc:1403] T 2eb2c8089ce14124aed9a5d834cd0522 P 288a46a90f26471584043331107dc0dd: Time spent bootstrapping tablet: real 0.023s	user 0.013s	sys 0.008s
I20260709 12:14:03.029467 24012 leader_election.cc:290] T e0352fa4cf674ba8b7d1a0239bcf76e8 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081), 288a46a90f26471584043331107dc0dd (127.12.174.129:46159)
W20260709 12:14:03.018610 23416 leader_election.cc:336] T 7754f065b43946f0a3aca8a75cb61273 P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Network error: Client connection negotiation failed: client connection to 127.12.174.129:46159: connect: Connection refused (error 111)
I20260709 12:14:03.031473 23443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0352fa4cf674ba8b7d1a0239bcf76e8" candidate_uuid: "3a9a63ca97694ebdb84bca730762d735" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ba0da223cf24c97bc7d225e25015924" is_pre_election: true
I20260709 12:14:03.032152 23443 raft_consensus.cc:2468] T e0352fa4cf674ba8b7d1a0239bcf76e8 P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a9a63ca97694ebdb84bca730762d735 in term 1.
I20260709 12:14:03.032205 24056 raft_consensus.cc:359] T 2eb2c8089ce14124aed9a5d834cd0522 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:14:03.032953 24056 raft_consensus.cc:740] T 2eb2c8089ce14124aed9a5d834cd0522 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 288a46a90f26471584043331107dc0dd, State: Initialized, Role: FOLLOWER
I20260709 12:14:03.033543 23340 leader_election.cc:304] T e0352fa4cf674ba8b7d1a0239bcf76e8 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a9a63ca97694ebdb84bca730762d735, 9ba0da223cf24c97bc7d225e25015924; no voters: 
I20260709 12:14:03.033806 24056 consensus_queue.cc:260] T 2eb2c8089ce14124aed9a5d834cd0522 P 288a46a90f26471584043331107dc0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:14:03.034950 24012 raft_consensus.cc:2804] T e0352fa4cf674ba8b7d1a0239bcf76e8 P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:03.035386 24012 raft_consensus.cc:493] T e0352fa4cf674ba8b7d1a0239bcf76e8 P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 288a46a90f26471584043331107dc0dd)
I20260709 12:14:03.035760 24012 raft_consensus.cc:3060] T e0352fa4cf674ba8b7d1a0239bcf76e8 P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:03.036290 24056 ts_tablet_manager.cc:1434] T 2eb2c8089ce14124aed9a5d834cd0522 P 288a46a90f26471584043331107dc0dd: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:14:03.037245 24056 tablet_bootstrap.cc:492] T 859d30d8c3fb4a499256ffad6dc2d1cd P 288a46a90f26471584043331107dc0dd: Bootstrap starting.
I20260709 12:14:03.043804 23583 raft_consensus.cc:2749] T ac854957ad6246c6b123638cfafeacd4 P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:03.050659 23987 raft_consensus.cc:493] T 96f1bc9b220f49d5845c08249cb6a44f P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 288a46a90f26471584043331107dc0dd)
I20260709 12:14:03.053241 23987 raft_consensus.cc:515] T 96f1bc9b220f49d5845c08249cb6a44f P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:14:03.059296 23987 leader_election.cc:290] T 96f1bc9b220f49d5845c08249cb6a44f P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061), 288a46a90f26471584043331107dc0dd (127.12.174.129:46159)
W20260709 12:14:03.055964 23342 leader_election.cc:336] T e0352fa4cf674ba8b7d1a0239bcf76e8 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Network error: Client connection negotiation failed: client connection to 127.12.174.129:46159: connect: Connection refused (error 111)
I20260709 12:14:03.059676 23122 catalog_manager.cc:5697] T 8bed7e0b2b804500b4898a175fba3ebe P 9ba0da223cf24c97bc7d225e25015924 reported cstate change: term changed from 1 to 2, leader changed from 288a46a90f26471584043331107dc0dd (127.12.174.129) to 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132). New cstate: current_term: 2 leader_uuid: "9ba0da223cf24c97bc7d225e25015924" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:03.059489 23374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96f1bc9b220f49d5845c08249cb6a44f" candidate_uuid: "9ba0da223cf24c97bc7d225e25015924" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3a9a63ca97694ebdb84bca730762d735" is_pre_election: true
W20260709 12:14:03.055779 23416 leader_election.cc:336] T b1533753456b445991715da5158c921b P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Network error: Client connection negotiation failed: client connection to 127.12.174.129:46159: connect: Connection refused (error 111)
I20260709 12:14:03.062490 24056 tablet_bootstrap.cc:492] T 859d30d8c3fb4a499256ffad6dc2d1cd P 288a46a90f26471584043331107dc0dd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:03.063830 24056 tablet_bootstrap.cc:492] T 859d30d8c3fb4a499256ffad6dc2d1cd P 288a46a90f26471584043331107dc0dd: Bootstrap complete.
I20260709 12:14:03.064873 24056 ts_tablet_manager.cc:1403] T 859d30d8c3fb4a499256ffad6dc2d1cd P 288a46a90f26471584043331107dc0dd: Time spent bootstrapping tablet: real 0.028s	user 0.023s	sys 0.001s
I20260709 12:14:03.067330 24015 raft_consensus.cc:493] T 8771e0b5070c49c589f276c793f87727 P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 288a46a90f26471584043331107dc0dd)
I20260709 12:14:03.067656 23952 raft_consensus.cc:515] T b1533753456b445991715da5158c921b P 9ba0da223cf24c97bc7d225e25015924 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:14:03.068408 24056 raft_consensus.cc:359] T 859d30d8c3fb4a499256ffad6dc2d1cd P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:14:03.068645 24015 raft_consensus.cc:515] T 8771e0b5070c49c589f276c793f87727 P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:14:03.078713 24015 leader_election.cc:290] T 8771e0b5070c49c589f276c793f87727 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 288a46a90f26471584043331107dc0dd (127.12.174.129:46159), 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789)
I20260709 12:14:03.079700 23299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1533753456b445991715da5158c921b" candidate_uuid: "9ba0da223cf24c97bc7d225e25015924" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2904b089bdb249b78950db76f4a70e9f"
I20260709 12:14:03.080348 23299 raft_consensus.cc:3060] T b1533753456b445991715da5158c921b P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:03.081286 24015 raft_consensus.cc:493] T c1c10ca2f5924b7eb5422f0aee2f85c3 P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 288a46a90f26471584043331107dc0dd)
I20260709 12:14:03.081873 24015 raft_consensus.cc:515] T c1c10ca2f5924b7eb5422f0aee2f85c3 P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:14:03.084041 24015 leader_election.cc:290] T c1c10ca2f5924b7eb5422f0aee2f85c3 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 288a46a90f26471584043331107dc0dd (127.12.174.129:46159), 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789)
I20260709 12:14:03.084870 23298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8771e0b5070c49c589f276c793f87727" candidate_uuid: "3a9a63ca97694ebdb84bca730762d735" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2904b089bdb249b78950db76f4a70e9f" is_pre_election: true
I20260709 12:14:03.085412 23300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c10ca2f5924b7eb5422f0aee2f85c3" candidate_uuid: "3a9a63ca97694ebdb84bca730762d735" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2904b089bdb249b78950db76f4a70e9f" is_pre_election: true
I20260709 12:14:03.088209 24056 raft_consensus.cc:740] T 859d30d8c3fb4a499256ffad6dc2d1cd P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 288a46a90f26471584043331107dc0dd, State: Initialized, Role: FOLLOWER
I20260709 12:14:03.088083 23987 raft_consensus.cc:493] T 45e4fb3889cc4d23bab3929c3fdd731e P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 288a46a90f26471584043331107dc0dd)
I20260709 12:14:03.089187 23987 raft_consensus.cc:515] T 45e4fb3889cc4d23bab3929c3fdd731e P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:14:03.089437 24056 consensus_queue.cc:260] T 859d30d8c3fb4a499256ffad6dc2d1cd P 288a46a90f26471584043331107dc0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:14:03.092097 24056 ts_tablet_manager.cc:1434] T 859d30d8c3fb4a499256ffad6dc2d1cd P 288a46a90f26471584043331107dc0dd: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.000s
I20260709 12:14:03.093114 24056 tablet_bootstrap.cc:492] T b1533753456b445991715da5158c921b P 288a46a90f26471584043331107dc0dd: Bootstrap starting.
I20260709 12:14:03.094625 23987 leader_election.cc:290] T 45e4fb3889cc4d23bab3929c3fdd731e P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 288a46a90f26471584043331107dc0dd (127.12.174.129:46159), 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789)
I20260709 12:14:03.095892 23300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e4fb3889cc4d23bab3929c3fdd731e" candidate_uuid: "9ba0da223cf24c97bc7d225e25015924" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2904b089bdb249b78950db76f4a70e9f" is_pre_election: true
I20260709 12:14:03.073424 24012 raft_consensus.cc:515] T e0352fa4cf674ba8b7d1a0239bcf76e8 P 3a9a63ca97694ebdb84bca730762d735 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
W20260709 12:14:03.101701 23416 leader_election.cc:336] T 96f1bc9b220f49d5845c08249cb6a44f P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Network error: Client connection negotiation failed: client connection to 127.12.174.129:46159: connect: Connection refused (error 111)
I20260709 12:14:03.104453 23443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0352fa4cf674ba8b7d1a0239bcf76e8" candidate_uuid: "3a9a63ca97694ebdb84bca730762d735" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ba0da223cf24c97bc7d225e25015924"
I20260709 12:14:03.105175 23443 raft_consensus.cc:3060] T e0352fa4cf674ba8b7d1a0239bcf76e8 P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:03.105226 24012 leader_election.cc:290] T e0352fa4cf674ba8b7d1a0239bcf76e8 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 2 election: Requested vote from peers 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081), 288a46a90f26471584043331107dc0dd (127.12.174.129:46159)
I20260709 12:14:03.106093 23416 leader_election.cc:304] T 96f1bc9b220f49d5845c08249cb6a44f P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ba0da223cf24c97bc7d225e25015924; no voters: 288a46a90f26471584043331107dc0dd, 3a9a63ca97694ebdb84bca730762d735
I20260709 12:14:03.106977 23987 raft_consensus.cc:2749] T 96f1bc9b220f49d5845c08249cb6a44f P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:14:03.104496 23342 leader_election.cc:336] T 8771e0b5070c49c589f276c793f87727 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Network error: Client connection negotiation failed: client connection to 127.12.174.129:46159: connect: Connection refused (error 111)
I20260709 12:14:03.114562 23342 leader_election.cc:304] T 8771e0b5070c49c589f276c793f87727 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3a9a63ca97694ebdb84bca730762d735; no voters: 288a46a90f26471584043331107dc0dd, 2904b089bdb249b78950db76f4a70e9f
I20260709 12:14:03.115361 24015 raft_consensus.cc:2749] T 8771e0b5070c49c589f276c793f87727 P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:14:03.116775 23342 leader_election.cc:336] T c1c10ca2f5924b7eb5422f0aee2f85c3 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Network error: Client connection negotiation failed: client connection to 127.12.174.129:46159: connect: Connection refused (error 111)
I20260709 12:14:03.117451 23342 leader_election.cc:304] T c1c10ca2f5924b7eb5422f0aee2f85c3 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3a9a63ca97694ebdb84bca730762d735; no voters: 288a46a90f26471584043331107dc0dd, 2904b089bdb249b78950db76f4a70e9f
I20260709 12:14:03.118326 24015 raft_consensus.cc:2749] T c1c10ca2f5924b7eb5422f0aee2f85c3 P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:14:03.124598 23342 leader_election.cc:336] T e0352fa4cf674ba8b7d1a0239bcf76e8 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Network error: Client connection negotiation failed: client connection to 127.12.174.129:46159: connect: Connection refused (error 111)
I20260709 12:14:03.129909 23987 raft_consensus.cc:493] T b1a6e82689a84e36949e5efca6592772 P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 288a46a90f26471584043331107dc0dd)
I20260709 12:14:03.130647 23952 leader_election.cc:290] T b1533753456b445991715da5158c921b P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 2 election: Requested vote from peers 288a46a90f26471584043331107dc0dd (127.12.174.129:46159), 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789)
I20260709 12:14:03.130913 23987 raft_consensus.cc:515] T b1a6e82689a84e36949e5efca6592772 P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:14:03.131462 23299 raft_consensus.cc:2468] T b1533753456b445991715da5158c921b P 2904b089bdb249b78950db76f4a70e9f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ba0da223cf24c97bc7d225e25015924 in term 2.
I20260709 12:14:03.136250 23415 leader_election.cc:304] T b1533753456b445991715da5158c921b P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2904b089bdb249b78950db76f4a70e9f, 9ba0da223cf24c97bc7d225e25015924; no voters: 
I20260709 12:14:03.137696 23952 raft_consensus.cc:2804] T b1533753456b445991715da5158c921b P 9ba0da223cf24c97bc7d225e25015924 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:03.138372 23952 raft_consensus.cc:697] T b1533753456b445991715da5158c921b P 9ba0da223cf24c97bc7d225e25015924 [term 2 LEADER]: Becoming Leader. State: Replica: 9ba0da223cf24c97bc7d225e25015924, State: Running, Role: LEADER
I20260709 12:14:03.139459 23952 consensus_queue.cc:237] T b1533753456b445991715da5158c921b P 9ba0da223cf24c97bc7d225e25015924 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:14:03.134358 23443 raft_consensus.cc:2468] T e0352fa4cf674ba8b7d1a0239bcf76e8 P 9ba0da223cf24c97bc7d225e25015924 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a9a63ca97694ebdb84bca730762d735 in term 2.
I20260709 12:14:03.151825 23340 leader_election.cc:304] T e0352fa4cf674ba8b7d1a0239bcf76e8 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3a9a63ca97694ebdb84bca730762d735, 9ba0da223cf24c97bc7d225e25015924; no voters: 288a46a90f26471584043331107dc0dd
I20260709 12:14:03.152721 23987 leader_election.cc:290] T b1a6e82689a84e36949e5efca6592772 P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 288a46a90f26471584043331107dc0dd (127.12.174.129:46159), 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061)
I20260709 12:14:03.153273 24015 raft_consensus.cc:2804] T e0352fa4cf674ba8b7d1a0239bcf76e8 P 3a9a63ca97694ebdb84bca730762d735 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:03.153925 24015 raft_consensus.cc:697] T e0352fa4cf674ba8b7d1a0239bcf76e8 P 3a9a63ca97694ebdb84bca730762d735 [term 2 LEADER]: Becoming Leader. State: Replica: 3a9a63ca97694ebdb84bca730762d735, State: Running, Role: LEADER
I20260709 12:14:03.154943 24015 consensus_queue.cc:237] T e0352fa4cf674ba8b7d1a0239bcf76e8 P 3a9a63ca97694ebdb84bca730762d735 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:14:03.157145 23374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1a6e82689a84e36949e5efca6592772" candidate_uuid: "9ba0da223cf24c97bc7d225e25015924" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3a9a63ca97694ebdb84bca730762d735" is_pre_election: true
I20260709 12:14:03.188848 23952 raft_consensus.cc:493] T 509f7e554df04f83aeffd51ec07607d5 P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 288a46a90f26471584043331107dc0dd)
I20260709 12:14:03.202785 23987 raft_consensus.cc:493] T bed12810020c4496969b723bcdd4b4ec P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 288a46a90f26471584043331107dc0dd)
I20260709 12:14:03.205575 23987 raft_consensus.cc:515] T bed12810020c4496969b723bcdd4b4ec P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:14:03.207926 23987 leader_election.cc:290] T bed12810020c4496969b723bcdd4b4ec P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061), 288a46a90f26471584043331107dc0dd (127.12.174.129:46159)
I20260709 12:14:03.210305 23374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed12810020c4496969b723bcdd4b4ec" candidate_uuid: "9ba0da223cf24c97bc7d225e25015924" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3a9a63ca97694ebdb84bca730762d735" is_pre_election: true
I20260709 12:14:03.211475 23374 raft_consensus.cc:2468] T bed12810020c4496969b723bcdd4b4ec P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ba0da223cf24c97bc7d225e25015924 in term 1.
I20260709 12:14:03.214452 23122 catalog_manager.cc:5697] T b1533753456b445991715da5158c921b P 9ba0da223cf24c97bc7d225e25015924 reported cstate change: term changed from 1 to 2, leader changed from 288a46a90f26471584043331107dc0dd (127.12.174.129) to 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132). New cstate: current_term: 2 leader_uuid: "9ba0da223cf24c97bc7d225e25015924" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:03.213234 23415 leader_election.cc:304] T bed12810020c4496969b723bcdd4b4ec P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a9a63ca97694ebdb84bca730762d735, 9ba0da223cf24c97bc7d225e25015924; no voters: 
W20260709 12:14:03.209338 23416 leader_election.cc:336] T b1533753456b445991715da5158c921b P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Network error: Client connection negotiation failed: client connection to 127.12.174.129:46159: connect: Connection refused (error 111)
W20260709 12:14:03.223768 23416 leader_election.cc:336] T 45e4fb3889cc4d23bab3929c3fdd731e P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Network error: Client connection negotiation failed: client connection to 127.12.174.129:46159: connect: Connection refused (error 111)
I20260709 12:14:03.208499 23987 raft_consensus.cc:493] T 9a21be1df2964860b89acefd66f6fbde P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 288a46a90f26471584043331107dc0dd)
I20260709 12:14:03.213896 23991 raft_consensus.cc:493] T 45e4fb3889cc4d23bab3929c3fdd731e P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 288a46a90f26471584043331107dc0dd)
I20260709 12:14:03.230527 23991 raft_consensus.cc:515] T 45e4fb3889cc4d23bab3929c3fdd731e P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:14:03.231220 24056 tablet_bootstrap.cc:492] T b1533753456b445991715da5158c921b P 288a46a90f26471584043331107dc0dd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:03.232373 24056 tablet_bootstrap.cc:492] T b1533753456b445991715da5158c921b P 288a46a90f26471584043331107dc0dd: Bootstrap complete.
I20260709 12:14:03.233142 24056 ts_tablet_manager.cc:1403] T b1533753456b445991715da5158c921b P 288a46a90f26471584043331107dc0dd: Time spent bootstrapping tablet: real 0.140s	user 0.029s	sys 0.046s
I20260709 12:14:03.228145 23416 leader_election.cc:304] T 45e4fb3889cc4d23bab3929c3fdd731e P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ba0da223cf24c97bc7d225e25015924; no voters: 288a46a90f26471584043331107dc0dd, 2904b089bdb249b78950db76f4a70e9f
I20260709 12:14:03.220981 23952 raft_consensus.cc:515] T 509f7e554df04f83aeffd51ec07607d5 P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:14:03.233063 23991 leader_election.cc:290] T 45e4fb3889cc4d23bab3929c3fdd731e P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081), 288a46a90f26471584043331107dc0dd (127.12.174.129:46159)
I20260709 12:14:03.254622 24056 raft_consensus.cc:359] T b1533753456b445991715da5158c921b P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:14:03.255569 24056 raft_consensus.cc:740] T b1533753456b445991715da5158c921b P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 288a46a90f26471584043331107dc0dd, State: Initialized, Role: FOLLOWER
I20260709 12:14:03.256520 24056 consensus_queue.cc:260] T b1533753456b445991715da5158c921b P 288a46a90f26471584043331107dc0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:14:03.257035 24037 raft_consensus.cc:2804] T bed12810020c4496969b723bcdd4b4ec P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:03.257980 23925 raft_consensus.cc:493] T 8771e0b5070c49c589f276c793f87727 P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 288a46a90f26471584043331107dc0dd)
I20260709 12:14:03.258538 23925 raft_consensus.cc:515] T 8771e0b5070c49c589f276c793f87727 P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:14:03.259326 24056 ts_tablet_manager.cc:1434] T b1533753456b445991715da5158c921b P 288a46a90f26471584043331107dc0dd: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 12:14:03.260313 24056 tablet_bootstrap.cc:492] T d55aba14f62b41538fdb710117d67580 P 288a46a90f26471584043331107dc0dd: Bootstrap starting.
I20260709 12:14:03.262884 23374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8771e0b5070c49c589f276c793f87727" candidate_uuid: "2904b089bdb249b78950db76f4a70e9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3a9a63ca97694ebdb84bca730762d735" is_pre_election: true
I20260709 12:14:03.263712 23374 raft_consensus.cc:2468] T 8771e0b5070c49c589f276c793f87727 P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2904b089bdb249b78950db76f4a70e9f in term 1.
I20260709 12:14:03.265249 23267 leader_election.cc:304] T 8771e0b5070c49c589f276c793f87727 P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2904b089bdb249b78950db76f4a70e9f, 3a9a63ca97694ebdb84bca730762d735; no voters: 
I20260709 12:14:03.257556 24037 raft_consensus.cc:493] T bed12810020c4496969b723bcdd4b4ec P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 288a46a90f26471584043331107dc0dd)
W20260709 12:14:03.275424 23266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.132:46081, user_credentials={real_user=slave}} blocked reactor thread for 89073.7us
I20260709 12:14:03.233086 23987 raft_consensus.cc:515] T 9a21be1df2964860b89acefd66f6fbde P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:14:03.292459 23447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e4fb3889cc4d23bab3929c3fdd731e" candidate_uuid: "2904b089bdb249b78950db76f4a70e9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ba0da223cf24c97bc7d225e25015924" is_pre_election: true
I20260709 12:14:03.293282 23447 raft_consensus.cc:2468] T 45e4fb3889cc4d23bab3929c3fdd731e P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2904b089bdb249b78950db76f4a70e9f in term 1.
I20260709 12:14:03.268774 23925 leader_election.cc:290] T 8771e0b5070c49c589f276c793f87727 P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 288a46a90f26471584043331107dc0dd (127.12.174.129:46159), 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061)
I20260709 12:14:03.277215 23991 raft_consensus.cc:2804] T 8771e0b5070c49c589f276c793f87727 P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:14:03.299356 23415 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.131:40061, user_credentials={real_user=slave}} blocked reactor thread for 86243.9us
I20260709 12:14:03.292333 24037 raft_consensus.cc:3060] T bed12810020c4496969b723bcdd4b4ec P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:03.275552 24012 raft_consensus.cc:493] T 96f1bc9b220f49d5845c08249cb6a44f P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 288a46a90f26471584043331107dc0dd)
I20260709 12:14:03.306394 23583 raft_consensus.cc:493] T 9f2438f73a8e4760b7b37c5330853b72 P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 288a46a90f26471584043331107dc0dd)
I20260709 12:14:03.300141 23991 raft_consensus.cc:493] T 8771e0b5070c49c589f276c793f87727 P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 288a46a90f26471584043331107dc0dd)
I20260709 12:14:03.307047 23583 raft_consensus.cc:515] T 9f2438f73a8e4760b7b37c5330853b72 P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
W20260709 12:14:03.310911 23416 leader_election.cc:336] T b1a6e82689a84e36949e5efca6592772 P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Network error: Client connection negotiation failed: client connection to 127.12.174.129:46159: connect: Connection refused (error 111)
I20260709 12:14:03.311486 23416 leader_election.cc:304] T b1a6e82689a84e36949e5efca6592772 P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ba0da223cf24c97bc7d225e25015924; no voters: 288a46a90f26471584043331107dc0dd, 3a9a63ca97694ebdb84bca730762d735
I20260709 12:14:03.315860 23987 leader_election.cc:290] T 9a21be1df2964860b89acefd66f6fbde P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 288a46a90f26471584043331107dc0dd (127.12.174.129:46159), 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789)
I20260709 12:14:03.322091 23991 raft_consensus.cc:3060] T 8771e0b5070c49c589f276c793f87727 P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:03.324939 23583 leader_election.cc:290] T 9f2438f73a8e4760b7b37c5330853b72 P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081), 288a46a90f26471584043331107dc0dd (127.12.174.129:46159)
I20260709 12:14:03.326834 24086 raft_consensus.cc:493] T ac854957ad6246c6b123638cfafeacd4 P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 288a46a90f26471584043331107dc0dd)
I20260709 12:14:03.327448 24086 raft_consensus.cc:515] T ac854957ad6246c6b123638cfafeacd4 P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:14:03.333557 23583 raft_consensus.cc:493] T c1c10ca2f5924b7eb5422f0aee2f85c3 P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 288a46a90f26471584043331107dc0dd)
I20260709 12:14:03.334206 23583 raft_consensus.cc:515] T c1c10ca2f5924b7eb5422f0aee2f85c3 P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:14:03.327914 23952 leader_election.cc:290] T 509f7e554df04f83aeffd51ec07607d5 P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061), 288a46a90f26471584043331107dc0dd (127.12.174.129:46159)
W20260709 12:14:03.332656 23268 leader_election.cc:336] T 45e4fb3889cc4d23bab3929c3fdd731e P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Network error: Client connection negotiation failed: client connection to 127.12.174.129:46159: connect: Connection refused (error 111)
I20260709 12:14:03.323763 24083 raft_consensus.cc:2749] T 45e4fb3889cc4d23bab3929c3fdd731e P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:03.346808 24091 raft_consensus.cc:2749] T b1a6e82689a84e36949e5efca6592772 P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:14:03.347294 23268 leader_election.cc:336] T 8771e0b5070c49c589f276c793f87727 P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Network error: Client connection negotiation failed: client connection to 127.12.174.129:46159: connect: Connection refused (error 111)
I20260709 12:14:03.348615 23583 leader_election.cc:290] T c1c10ca2f5924b7eb5422f0aee2f85c3 P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 288a46a90f26471584043331107dc0dd (127.12.174.129:46159), 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061)
I20260709 12:14:03.351806 24017 raft_consensus.cc:493] T b1a6e82689a84e36949e5efca6592772 P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 288a46a90f26471584043331107dc0dd)
I20260709 12:14:03.352523 24017 raft_consensus.cc:515] T b1a6e82689a84e36949e5efca6592772 P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
W20260709 12:14:03.353688 23268 leader_election.cc:336] T 9f2438f73a8e4760b7b37c5330853b72 P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Network error: Client connection negotiation failed: client connection to 127.12.174.129:46159: connect: Connection refused (error 111)
I20260709 12:14:03.354727 24017 leader_election.cc:290] T b1a6e82689a84e36949e5efca6592772 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 288a46a90f26471584043331107dc0dd (127.12.174.129:46159), 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081)
I20260709 12:14:03.322342 24012 raft_consensus.cc:515] T 96f1bc9b220f49d5845c08249cb6a44f P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:14:03.347139 24086 leader_election.cc:290] T ac854957ad6246c6b123638cfafeacd4 P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789), 288a46a90f26471584043331107dc0dd (127.12.174.129:46159)
W20260709 12:14:03.371367 23268 leader_election.cc:336] T c1c10ca2f5924b7eb5422f0aee2f85c3 P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Network error: Client connection negotiation failed: client connection to 127.12.174.129:46159: connect: Connection refused (error 111)
I20260709 12:14:03.372946 23122 catalog_manager.cc:5697] T e0352fa4cf674ba8b7d1a0239bcf76e8 P 3a9a63ca97694ebdb84bca730762d735 reported cstate change: term changed from 1 to 2, leader changed from 288a46a90f26471584043331107dc0dd (127.12.174.129) to 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131). New cstate: current_term: 2 leader_uuid: "3a9a63ca97694ebdb84bca730762d735" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:03.380228 23991 raft_consensus.cc:515] T 8771e0b5070c49c589f276c793f87727 P 2904b089bdb249b78950db76f4a70e9f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:14:03.383942 23266 leader_election.cc:304] T 45e4fb3889cc4d23bab3929c3fdd731e P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2904b089bdb249b78950db76f4a70e9f, 9ba0da223cf24c97bc7d225e25015924; no voters: 288a46a90f26471584043331107dc0dd
I20260709 12:14:03.385289 24084 raft_consensus.cc:2804] T 45e4fb3889cc4d23bab3929c3fdd731e P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:03.385718 24084 raft_consensus.cc:493] T 45e4fb3889cc4d23bab3929c3fdd731e P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 288a46a90f26471584043331107dc0dd)
I20260709 12:14:03.386117 24084 raft_consensus.cc:3060] T 45e4fb3889cc4d23bab3929c3fdd731e P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:03.386479 24037 raft_consensus.cc:515] T bed12810020c4496969b723bcdd4b4ec P 9ba0da223cf24c97bc7d225e25015924 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:14:03.392813 23299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a21be1df2964860b89acefd66f6fbde" candidate_uuid: "9ba0da223cf24c97bc7d225e25015924" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2904b089bdb249b78950db76f4a70e9f" is_pre_election: true
I20260709 12:14:03.393587 23299 raft_consensus.cc:2468] T 9a21be1df2964860b89acefd66f6fbde P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ba0da223cf24c97bc7d225e25015924 in term 1.
W20260709 12:14:03.393782 23416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:46159, user_credentials={real_user=slave}} blocked reactor thread for 82842.8us
I20260709 12:14:03.391032 23443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f2438f73a8e4760b7b37c5330853b72" candidate_uuid: "2904b089bdb249b78950db76f4a70e9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ba0da223cf24c97bc7d225e25015924" is_pre_election: true
I20260709 12:14:03.394888 23443 raft_consensus.cc:2468] T 9f2438f73a8e4760b7b37c5330853b72 P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2904b089bdb249b78950db76f4a70e9f in term 1.
I20260709 12:14:03.396719 24012 leader_election.cc:290] T 96f1bc9b220f49d5845c08249cb6a44f P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081), 288a46a90f26471584043331107dc0dd (127.12.174.129:46159)
I20260709 12:14:03.402238 23952 raft_consensus.cc:493] T 859d30d8c3fb4a499256ffad6dc2d1cd P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 288a46a90f26471584043331107dc0dd)
I20260709 12:14:03.402952 23952 raft_consensus.cc:515] T 859d30d8c3fb4a499256ffad6dc2d1cd P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
W20260709 12:14:03.403098 23416 leader_election.cc:336] T bed12810020c4496969b723bcdd4b4ec P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Network error: Client connection negotiation failed: client connection to 127.12.174.129:46159: connect: Connection refused (error 111)
I20260709 12:14:03.401432 23991 leader_election.cc:290] T 8771e0b5070c49c589f276c793f87727 P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 2 election: Requested vote from peers 288a46a90f26471584043331107dc0dd (127.12.174.129:46159), 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061)
I20260709 12:14:03.405134 23952 leader_election.cc:290] T 859d30d8c3fb4a499256ffad6dc2d1cd P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 288a46a90f26471584043331107dc0dd (127.12.174.129:46159), 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789)
I20260709 12:14:03.411824 23415 leader_election.cc:304] T 9a21be1df2964860b89acefd66f6fbde P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2904b089bdb249b78950db76f4a70e9f, 9ba0da223cf24c97bc7d225e25015924; no voters: 
I20260709 12:14:03.421820 24100 raft_consensus.cc:493] T 859d30d8c3fb4a499256ffad6dc2d1cd P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 288a46a90f26471584043331107dc0dd)
I20260709 12:14:03.425678 23374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509f7e554df04f83aeffd51ec07607d5" candidate_uuid: "9ba0da223cf24c97bc7d225e25015924" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3a9a63ca97694ebdb84bca730762d735" is_pre_election: true
I20260709 12:14:03.426627 23374 raft_consensus.cc:2468] T 509f7e554df04f83aeffd51ec07607d5 P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ba0da223cf24c97bc7d225e25015924 in term 1.
I20260709 12:14:03.422220 23300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac854957ad6246c6b123638cfafeacd4" candidate_uuid: "9ba0da223cf24c97bc7d225e25015924" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2904b089bdb249b78950db76f4a70e9f" is_pre_election: true
I20260709 12:14:03.434051 23300 raft_consensus.cc:2468] T ac854957ad6246c6b123638cfafeacd4 P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ba0da223cf24c97bc7d225e25015924 in term 1.
I20260709 12:14:03.432716 23266 leader_election.cc:304] T 9f2438f73a8e4760b7b37c5330853b72 P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2904b089bdb249b78950db76f4a70e9f, 9ba0da223cf24c97bc7d225e25015924; no voters: 288a46a90f26471584043331107dc0dd
I20260709 12:14:03.437296 24087 raft_consensus.cc:2804] T 9f2438f73a8e4760b7b37c5330853b72 P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:03.437834 24087 raft_consensus.cc:493] T 9f2438f73a8e4760b7b37c5330853b72 P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 288a46a90f26471584043331107dc0dd)
I20260709 12:14:03.438218 24087 raft_consensus.cc:3060] T 9f2438f73a8e4760b7b37c5330853b72 P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:14:03.438941 23416 leader_election.cc:336] T 9a21be1df2964860b89acefd66f6fbde P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Network error: Client connection negotiation failed: client connection to 127.12.174.129:46159: connect: Connection refused (error 111)
I20260709 12:14:03.439791 23443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1a6e82689a84e36949e5efca6592772" candidate_uuid: "3a9a63ca97694ebdb84bca730762d735" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ba0da223cf24c97bc7d225e25015924" is_pre_election: true
W20260709 12:14:03.439947 23416 leader_election.cc:336] T 509f7e554df04f83aeffd51ec07607d5 P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Network error: Client connection negotiation failed: client connection to 127.12.174.129:46159: connect: Connection refused (error 111)
W20260709 12:14:03.440634 23416 leader_election.cc:336] T ac854957ad6246c6b123638cfafeacd4 P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Network error: Client connection negotiation failed: client connection to 127.12.174.129:46159: connect: Connection refused (error 111)
W20260709 12:14:03.441655 23416 consensus_peers.cc:597] T 8bed7e0b2b804500b4898a175fba3ebe P 9ba0da223cf24c97bc7d225e25015924 -> Peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Couldn't send request to peer 288a46a90f26471584043331107dc0dd. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:46159: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:03.430023 24100 raft_consensus.cc:515] T 859d30d8c3fb4a499256ffad6dc2d1cd P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:14:03.445011 24100 leader_election.cc:290] T 859d30d8c3fb4a499256ffad6dc2d1cd P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081), 288a46a90f26471584043331107dc0dd (127.12.174.129:46159)
W20260709 12:14:03.447484 23416 leader_election.cc:336] T 859d30d8c3fb4a499256ffad6dc2d1cd P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Network error: Client connection negotiation failed: client connection to 127.12.174.129:46159: connect: Connection refused (error 111)
I20260709 12:14:03.424144 23442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96f1bc9b220f49d5845c08249cb6a44f" candidate_uuid: "3a9a63ca97694ebdb84bca730762d735" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ba0da223cf24c97bc7d225e25015924" is_pre_election: true
I20260709 12:14:03.450266 23371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c10ca2f5924b7eb5422f0aee2f85c3" candidate_uuid: "2904b089bdb249b78950db76f4a70e9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3a9a63ca97694ebdb84bca730762d735" is_pre_election: true
W20260709 12:14:03.451047 23268 leader_election.cc:336] T 8771e0b5070c49c589f276c793f87727 P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Network error: Client connection negotiation failed: client connection to 127.12.174.129:46159: connect: Connection refused (error 111)
I20260709 12:14:03.451349 23371 raft_consensus.cc:2468] T c1c10ca2f5924b7eb5422f0aee2f85c3 P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2904b089bdb249b78950db76f4a70e9f in term 1.
I20260709 12:14:03.440605 23443 raft_consensus.cc:2468] T b1a6e82689a84e36949e5efca6592772 P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a9a63ca97694ebdb84bca730762d735 in term 1.
I20260709 12:14:03.450392 23442 raft_consensus.cc:2468] T 96f1bc9b220f49d5845c08249cb6a44f P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a9a63ca97694ebdb84bca730762d735 in term 1.
I20260709 12:14:03.453560 24037 leader_election.cc:290] T bed12810020c4496969b723bcdd4b4ec P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 2 election: Requested vote from peers 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061), 288a46a90f26471584043331107dc0dd (127.12.174.129:46159)
I20260709 12:14:03.430265 23952 raft_consensus.cc:2804] T 9a21be1df2964860b89acefd66f6fbde P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:03.466056 23952 raft_consensus.cc:493] T 9a21be1df2964860b89acefd66f6fbde P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 288a46a90f26471584043331107dc0dd)
I20260709 12:14:03.466602 23952 raft_consensus.cc:3060] T 9a21be1df2964860b89acefd66f6fbde P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:14:03.466926 23416 leader_election.cc:336] T bed12810020c4496969b723bcdd4b4ec P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Network error: Client connection negotiation failed: client connection to 127.12.174.129:46159: connect: Connection refused (error 111)
I20260709 12:14:03.468400 23446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859d30d8c3fb4a499256ffad6dc2d1cd" candidate_uuid: "2904b089bdb249b78950db76f4a70e9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ba0da223cf24c97bc7d225e25015924" is_pre_election: true
I20260709 12:14:03.469208 23446 raft_consensus.cc:2468] T 859d30d8c3fb4a499256ffad6dc2d1cd P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2904b089bdb249b78950db76f4a70e9f in term 1.
I20260709 12:14:03.462910 23375 raft_consensus.cc:1275] T 7754f065b43946f0a3aca8a75cb61273 P 3a9a63ca97694ebdb84bca730762d735 [term 2 FOLLOWER]: Refusing update from remote peer 9ba0da223cf24c97bc7d225e25015924: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:03.464848 23372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8771e0b5070c49c589f276c793f87727" candidate_uuid: "2904b089bdb249b78950db76f4a70e9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3a9a63ca97694ebdb84bca730762d735"
I20260709 12:14:03.470922 23372 raft_consensus.cc:3060] T 8771e0b5070c49c589f276c793f87727 P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:03.471403 23299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859d30d8c3fb4a499256ffad6dc2d1cd" candidate_uuid: "9ba0da223cf24c97bc7d225e25015924" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2904b089bdb249b78950db76f4a70e9f" is_pre_election: true
I20260709 12:14:03.472110 23299 raft_consensus.cc:2468] T 859d30d8c3fb4a499256ffad6dc2d1cd P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ba0da223cf24c97bc7d225e25015924 in term 1.
I20260709 12:14:03.474442 23266 leader_election.cc:304] T 859d30d8c3fb4a499256ffad6dc2d1cd P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2904b089bdb249b78950db76f4a70e9f, 9ba0da223cf24c97bc7d225e25015924; no voters: 
I20260709 12:14:03.474897 23415 leader_election.cc:304] T 509f7e554df04f83aeffd51ec07607d5 P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3a9a63ca97694ebdb84bca730762d735, 9ba0da223cf24c97bc7d225e25015924; no voters: 288a46a90f26471584043331107dc0dd
I20260709 12:14:03.477136 24095 raft_consensus.cc:2804] T 859d30d8c3fb4a499256ffad6dc2d1cd P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:03.477578 24095 raft_consensus.cc:493] T 859d30d8c3fb4a499256ffad6dc2d1cd P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 288a46a90f26471584043331107dc0dd)
I20260709 12:14:03.477964 24095 raft_consensus.cc:3060] T 859d30d8c3fb4a499256ffad6dc2d1cd P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:14:03.476550 23342 leader_election.cc:336] T b1a6e82689a84e36949e5efca6592772 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Network error: Client connection negotiation failed: client connection to 127.12.174.129:46159: connect: Connection refused (error 111)
I20260709 12:14:03.479686 24083 raft_consensus.cc:2804] T 509f7e554df04f83aeffd51ec07607d5 P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:03.480173 24083 raft_consensus.cc:493] T 509f7e554df04f83aeffd51ec07607d5 P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 288a46a90f26471584043331107dc0dd)
I20260709 12:14:03.480633 24083 raft_consensus.cc:3060] T 509f7e554df04f83aeffd51ec07607d5 P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:03.481848 23415 leader_election.cc:304] T ac854957ad6246c6b123638cfafeacd4 P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2904b089bdb249b78950db76f4a70e9f, 9ba0da223cf24c97bc7d225e25015924; no voters: 288a46a90f26471584043331107dc0dd
I20260709 12:14:03.482543 23375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bed12810020c4496969b723bcdd4b4ec" candidate_uuid: "9ba0da223cf24c97bc7d225e25015924" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3a9a63ca97694ebdb84bca730762d735"
I20260709 12:14:03.482733 24037 raft_consensus.cc:2804] T ac854957ad6246c6b123638cfafeacd4 P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:03.483336 24037 raft_consensus.cc:493] T ac854957ad6246c6b123638cfafeacd4 P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 288a46a90f26471584043331107dc0dd)
I20260709 12:14:03.483963 24037 raft_consensus.cc:3060] T ac854957ad6246c6b123638cfafeacd4 P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:03.480301 24086 consensus_queue.cc:1048] T 7754f065b43946f0a3aca8a75cb61273 P 9ba0da223cf24c97bc7d225e25015924 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:03.483196 23375 raft_consensus.cc:3060] T bed12810020c4496969b723bcdd4b4ec P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:03.493067 24037 raft_consensus.cc:515] T ac854957ad6246c6b123638cfafeacd4 P 9ba0da223cf24c97bc7d225e25015924 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:14:03.495338 24037 leader_election.cc:290] T ac854957ad6246c6b123638cfafeacd4 P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 2 election: Requested vote from peers 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789), 288a46a90f26471584043331107dc0dd (127.12.174.129:46159)
I20260709 12:14:03.498816 23415 leader_election.cc:304] T 859d30d8c3fb4a499256ffad6dc2d1cd P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2904b089bdb249b78950db76f4a70e9f, 9ba0da223cf24c97bc7d225e25015924; no voters: 288a46a90f26471584043331107dc0dd
W20260709 12:14:03.498976 23268 leader_election.cc:336] T 859d30d8c3fb4a499256ffad6dc2d1cd P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Network error: Client connection negotiation failed: client connection to 127.12.174.129:46159: connect: Connection refused (error 111)
I20260709 12:14:03.503873 23372 raft_consensus.cc:2468] T 8771e0b5070c49c589f276c793f87727 P 3a9a63ca97694ebdb84bca730762d735 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2904b089bdb249b78950db76f4a70e9f in term 2.
I20260709 12:14:03.508358 24037 raft_consensus.cc:2804] T 859d30d8c3fb4a499256ffad6dc2d1cd P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:14:03.503993 23416 consensus_peers.cc:597] T 7754f065b43946f0a3aca8a75cb61273 P 9ba0da223cf24c97bc7d225e25015924 -> Peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Couldn't send request to peer 288a46a90f26471584043331107dc0dd. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:46159: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:03.508626 24056 tablet_bootstrap.cc:492] T d55aba14f62b41538fdb710117d67580 P 288a46a90f26471584043331107dc0dd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:03.518132 24056 tablet_bootstrap.cc:492] T d55aba14f62b41538fdb710117d67580 P 288a46a90f26471584043331107dc0dd: Bootstrap complete.
I20260709 12:14:03.518903 24056 ts_tablet_manager.cc:1403] T d55aba14f62b41538fdb710117d67580 P 288a46a90f26471584043331107dc0dd: Time spent bootstrapping tablet: real 0.259s	user 0.016s	sys 0.012s
W20260709 12:14:03.511143 23342 leader_election.cc:336] T 96f1bc9b220f49d5845c08249cb6a44f P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Network error: Client connection negotiation failed: client connection to 127.12.174.129:46159: connect: Connection refused (error 111)
I20260709 12:14:03.521454 24095 raft_consensus.cc:515] T 859d30d8c3fb4a499256ffad6dc2d1cd P 2904b089bdb249b78950db76f4a70e9f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:14:03.510962 23299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac854957ad6246c6b123638cfafeacd4" candidate_uuid: "9ba0da223cf24c97bc7d225e25015924" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2904b089bdb249b78950db76f4a70e9f"
W20260709 12:14:03.513988 23416 leader_election.cc:336] T ac854957ad6246c6b123638cfafeacd4 P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Network error: Client connection negotiation failed: client connection to 127.12.174.129:46159: connect: Connection refused (error 111)
I20260709 12:14:03.523890 23299 raft_consensus.cc:3060] T ac854957ad6246c6b123638cfafeacd4 P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:03.515091 23267 leader_election.cc:304] T c1c10ca2f5924b7eb5422f0aee2f85c3 P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2904b089bdb249b78950db76f4a70e9f, 3a9a63ca97694ebdb84bca730762d735; no voters: 288a46a90f26471584043331107dc0dd
I20260709 12:14:03.525578 23267 leader_election.cc:304] T 8771e0b5070c49c589f276c793f87727 P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2904b089bdb249b78950db76f4a70e9f, 3a9a63ca97694ebdb84bca730762d735; no voters: 288a46a90f26471584043331107dc0dd
I20260709 12:14:03.526378 23991 raft_consensus.cc:2804] T c1c10ca2f5924b7eb5422f0aee2f85c3 P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:03.526813 23991 raft_consensus.cc:493] T c1c10ca2f5924b7eb5422f0aee2f85c3 P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 288a46a90f26471584043331107dc0dd)
I20260709 12:14:03.527174 23991 raft_consensus.cc:3060] T c1c10ca2f5924b7eb5422f0aee2f85c3 P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:03.529263 23374 raft_consensus.cc:1275] T 8bed7e0b2b804500b4898a175fba3ebe P 3a9a63ca97694ebdb84bca730762d735 [term 2 FOLLOWER]: Refusing update from remote peer 9ba0da223cf24c97bc7d225e25015924: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:03.527272 24083 raft_consensus.cc:515] T 509f7e554df04f83aeffd51ec07607d5 P 9ba0da223cf24c97bc7d225e25015924 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:14:03.532151 23925 raft_consensus.cc:2804] T 8771e0b5070c49c589f276c793f87727 P 2904b089bdb249b78950db76f4a70e9f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:03.532711 23925 raft_consensus.cc:697] T 8771e0b5070c49c589f276c793f87727 P 2904b089bdb249b78950db76f4a70e9f [term 2 LEADER]: Becoming Leader. State: Replica: 2904b089bdb249b78950db76f4a70e9f, State: Running, Role: LEADER
I20260709 12:14:03.533608 23925 consensus_queue.cc:237] T 8771e0b5070c49c589f276c793f87727 P 2904b089bdb249b78950db76f4a70e9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:14:03.534287 24097 consensus_queue.cc:1048] T 8bed7e0b2b804500b4898a175fba3ebe P 9ba0da223cf24c97bc7d225e25015924 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:14:03.535382 24083 leader_election.cc:290] T 509f7e554df04f83aeffd51ec07607d5 P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 2 election: Requested vote from peers 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061), 288a46a90f26471584043331107dc0dd (127.12.174.129:46159)
I20260709 12:14:03.537303 23299 raft_consensus.cc:2468] T ac854957ad6246c6b123638cfafeacd4 P 2904b089bdb249b78950db76f4a70e9f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ba0da223cf24c97bc7d225e25015924 in term 2.
I20260709 12:14:03.542913 23374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "509f7e554df04f83aeffd51ec07607d5" candidate_uuid: "9ba0da223cf24c97bc7d225e25015924" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3a9a63ca97694ebdb84bca730762d735"
I20260709 12:14:03.543629 23374 raft_consensus.cc:3060] T 509f7e554df04f83aeffd51ec07607d5 P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:03.551061 23340 leader_election.cc:304] T 96f1bc9b220f49d5845c08249cb6a44f P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3a9a63ca97694ebdb84bca730762d735, 9ba0da223cf24c97bc7d225e25015924; no voters: 288a46a90f26471584043331107dc0dd
I20260709 12:14:03.556031 24101 raft_consensus.cc:2804] T 96f1bc9b220f49d5845c08249cb6a44f P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:03.551800 24084 raft_consensus.cc:515] T 45e4fb3889cc4d23bab3929c3fdd731e P 2904b089bdb249b78950db76f4a70e9f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
W20260709 12:14:03.553095 23416 leader_election.cc:336] T 509f7e554df04f83aeffd51ec07607d5 P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Network error: Client connection negotiation failed: client connection to 127.12.174.129:46159: connect: Connection refused (error 111)
I20260709 12:14:03.556352 23340 leader_election.cc:304] T b1a6e82689a84e36949e5efca6592772 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3a9a63ca97694ebdb84bca730762d735, 9ba0da223cf24c97bc7d225e25015924; no voters: 288a46a90f26471584043331107dc0dd
I20260709 12:14:03.572285 24012 raft_consensus.cc:2804] T b1a6e82689a84e36949e5efca6592772 P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:03.573072 24012 raft_consensus.cc:493] T b1a6e82689a84e36949e5efca6592772 P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 288a46a90f26471584043331107dc0dd)
I20260709 12:14:03.574862 24012 raft_consensus.cc:3060] T b1a6e82689a84e36949e5efca6592772 P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:03.511850 24087 raft_consensus.cc:515] T 9f2438f73a8e4760b7b37c5330853b72 P 2904b089bdb249b78950db76f4a70e9f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:14:03.516883 23375 raft_consensus.cc:2468] T bed12810020c4496969b723bcdd4b4ec P 3a9a63ca97694ebdb84bca730762d735 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ba0da223cf24c97bc7d225e25015924 in term 2.
I20260709 12:14:03.513406 23952 raft_consensus.cc:515] T 9a21be1df2964860b89acefd66f6fbde P 9ba0da223cf24c97bc7d225e25015924 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
W20260709 12:14:03.581454 23342 consensus_peers.cc:597] T e0352fa4cf674ba8b7d1a0239bcf76e8 P 3a9a63ca97694ebdb84bca730762d735 -> Peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Couldn't send request to peer 288a46a90f26471584043331107dc0dd. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:46159: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:03.583165 23952 leader_election.cc:290] T 9a21be1df2964860b89acefd66f6fbde P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 2 election: Requested vote from peers 288a46a90f26471584043331107dc0dd (127.12.174.129:46159), 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789)
I20260709 12:14:03.508937 24037 raft_consensus.cc:493] T 859d30d8c3fb4a499256ffad6dc2d1cd P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 288a46a90f26471584043331107dc0dd)
I20260709 12:14:03.584810 24037 raft_consensus.cc:3060] T 859d30d8c3fb4a499256ffad6dc2d1cd P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:03.566934 23122 catalog_manager.cc:5697] T 8771e0b5070c49c589f276c793f87727 P 2904b089bdb249b78950db76f4a70e9f reported cstate change: term changed from 1 to 2, leader changed from 288a46a90f26471584043331107dc0dd (127.12.174.129) to 2904b089bdb249b78950db76f4a70e9f (127.12.174.130). New cstate: current_term: 2 leader_uuid: "2904b089bdb249b78950db76f4a70e9f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:03.556516 24101 raft_consensus.cc:493] T 96f1bc9b220f49d5845c08249cb6a44f P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 288a46a90f26471584043331107dc0dd)
I20260709 12:14:03.590576 24101 raft_consensus.cc:3060] T 96f1bc9b220f49d5845c08249cb6a44f P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:03.591163 23299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a21be1df2964860b89acefd66f6fbde" candidate_uuid: "9ba0da223cf24c97bc7d225e25015924" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2904b089bdb249b78950db76f4a70e9f"
I20260709 12:14:03.591832 23299 raft_consensus.cc:3060] T 9a21be1df2964860b89acefd66f6fbde P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:14:03.596909 23416 consensus_peers.cc:597] T b1533753456b445991715da5158c921b P 9ba0da223cf24c97bc7d225e25015924 -> Peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Couldn't send request to peer 288a46a90f26471584043331107dc0dd. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:46159: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:03.565181 24056 raft_consensus.cc:359] T d55aba14f62b41538fdb710117d67580 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:14:03.604882 24056 raft_consensus.cc:740] T d55aba14f62b41538fdb710117d67580 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 288a46a90f26471584043331107dc0dd, State: Initialized, Role: FOLLOWER
I20260709 12:14:03.607647 24056 consensus_queue.cc:260] T d55aba14f62b41538fdb710117d67580 P 288a46a90f26471584043331107dc0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
W20260709 12:14:03.617110 23416 leader_election.cc:336] T 9a21be1df2964860b89acefd66f6fbde P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Network error: Client connection negotiation failed: client connection to 127.12.174.129:46159: connect: Connection refused (error 111)
I20260709 12:14:03.605767 24087 leader_election.cc:290] T 9f2438f73a8e4760b7b37c5330853b72 P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 2 election: Requested vote from peers 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081), 288a46a90f26471584043331107dc0dd (127.12.174.129:46159)
I20260709 12:14:03.610464 23415 leader_election.cc:304] T bed12810020c4496969b723bcdd4b4ec P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3a9a63ca97694ebdb84bca730762d735, 9ba0da223cf24c97bc7d225e25015924; no voters: 288a46a90f26471584043331107dc0dd
I20260709 12:14:03.615988 23446 raft_consensus.cc:1275] T e0352fa4cf674ba8b7d1a0239bcf76e8 P 9ba0da223cf24c97bc7d225e25015924 [term 2 FOLLOWER]: Refusing update from remote peer 3a9a63ca97694ebdb84bca730762d735: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:03.606344 23991 raft_consensus.cc:515] T c1c10ca2f5924b7eb5422f0aee2f85c3 P 2904b089bdb249b78950db76f4a70e9f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:14:03.632227 24101 raft_consensus.cc:515] T 96f1bc9b220f49d5845c08249cb6a44f P 3a9a63ca97694ebdb84bca730762d735 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:14:03.632438 24097 raft_consensus.cc:2804] T bed12810020c4496969b723bcdd4b4ec P 9ba0da223cf24c97bc7d225e25015924 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:03.634968 24097 raft_consensus.cc:697] T bed12810020c4496969b723bcdd4b4ec P 9ba0da223cf24c97bc7d225e25015924 [term 2 LEADER]: Becoming Leader. State: Replica: 9ba0da223cf24c97bc7d225e25015924, State: Running, Role: LEADER
I20260709 12:14:03.635672 23991 leader_election.cc:290] T c1c10ca2f5924b7eb5422f0aee2f85c3 P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 2 election: Requested vote from peers 288a46a90f26471584043331107dc0dd (127.12.174.129:46159), 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061)
I20260709 12:14:03.636000 24097 consensus_queue.cc:237] T bed12810020c4496969b723bcdd4b4ec P 9ba0da223cf24c97bc7d225e25015924 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:14:03.636812 24103 consensus_queue.cc:1048] T e0352fa4cf674ba8b7d1a0239bcf76e8 P 3a9a63ca97694ebdb84bca730762d735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:14:03.642642 24101 leader_election.cc:290] T 96f1bc9b220f49d5845c08249cb6a44f P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 2 election: Requested vote from peers 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081), 288a46a90f26471584043331107dc0dd (127.12.174.129:46159)
W20260709 12:14:03.617798 23268 leader_election.cc:336] T 9f2438f73a8e4760b7b37c5330853b72 P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Network error: Client connection negotiation failed: client connection to 127.12.174.129:46159: connect: Connection refused (error 111)
I20260709 12:14:03.620412 23299 raft_consensus.cc:2468] T 9a21be1df2964860b89acefd66f6fbde P 2904b089bdb249b78950db76f4a70e9f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ba0da223cf24c97bc7d225e25015924 in term 2.
I20260709 12:14:03.623361 24056 ts_tablet_manager.cc:1434] T d55aba14f62b41538fdb710117d67580 P 288a46a90f26471584043331107dc0dd: Time spent starting tablet: real 0.104s	user 0.007s	sys 0.001s
I20260709 12:14:03.620925 23374 raft_consensus.cc:2468] T 509f7e554df04f83aeffd51ec07607d5 P 3a9a63ca97694ebdb84bca730762d735 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ba0da223cf24c97bc7d225e25015924 in term 2.
I20260709 12:14:03.647449 24056 tablet_bootstrap.cc:492] T 6626b442492c47849fd3c907d1c12f3e P 288a46a90f26471584043331107dc0dd: Bootstrap starting.
W20260709 12:14:03.649341 23342 leader_election.cc:336] T 96f1bc9b220f49d5845c08249cb6a44f P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Network error: Client connection negotiation failed: client connection to 127.12.174.129:46159: connect: Connection refused (error 111)
I20260709 12:14:03.635831 24037 raft_consensus.cc:515] T 859d30d8c3fb4a499256ffad6dc2d1cd P 9ba0da223cf24c97bc7d225e25015924 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:14:03.651649 23443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96f1bc9b220f49d5845c08249cb6a44f" candidate_uuid: "3a9a63ca97694ebdb84bca730762d735" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ba0da223cf24c97bc7d225e25015924"
I20260709 12:14:03.652415 23443 raft_consensus.cc:3060] T 96f1bc9b220f49d5845c08249cb6a44f P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:03.652488 23374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c10ca2f5924b7eb5422f0aee2f85c3" candidate_uuid: "2904b089bdb249b78950db76f4a70e9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3a9a63ca97694ebdb84bca730762d735"
I20260709 12:14:03.653177 23374 raft_consensus.cc:3060] T c1c10ca2f5924b7eb5422f0aee2f85c3 P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:03.653632 24037 leader_election.cc:290] T 859d30d8c3fb4a499256ffad6dc2d1cd P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 2 election: Requested vote from peers 288a46a90f26471584043331107dc0dd (127.12.174.129:46159), 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789)
I20260709 12:14:03.662554 24095 leader_election.cc:290] T 859d30d8c3fb4a499256ffad6dc2d1cd P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 2 election: Requested vote from peers 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081), 288a46a90f26471584043331107dc0dd (127.12.174.129:46159)
I20260709 12:14:03.665881 23444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f2438f73a8e4760b7b37c5330853b72" candidate_uuid: "2904b089bdb249b78950db76f4a70e9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ba0da223cf24c97bc7d225e25015924"
I20260709 12:14:03.666800 23444 raft_consensus.cc:3060] T 9f2438f73a8e4760b7b37c5330853b72 P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:03.669690 23446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e4fb3889cc4d23bab3929c3fdd731e" candidate_uuid: "2904b089bdb249b78950db76f4a70e9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ba0da223cf24c97bc7d225e25015924"
I20260709 12:14:03.670642 23446 raft_consensus.cc:3060] T 45e4fb3889cc4d23bab3929c3fdd731e P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:03.668938 23442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859d30d8c3fb4a499256ffad6dc2d1cd" candidate_uuid: "2904b089bdb249b78950db76f4a70e9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ba0da223cf24c97bc7d225e25015924"
I20260709 12:14:03.671689 23442 raft_consensus.cc:2393] T 859d30d8c3fb4a499256ffad6dc2d1cd P 9ba0da223cf24c97bc7d225e25015924 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 2904b089bdb249b78950db76f4a70e9f in current term 2: Already voted for candidate 9ba0da223cf24c97bc7d225e25015924 in this term.
I20260709 12:14:03.668251 23374 raft_consensus.cc:2468] T c1c10ca2f5924b7eb5422f0aee2f85c3 P 3a9a63ca97694ebdb84bca730762d735 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2904b089bdb249b78950db76f4a70e9f in term 2.
I20260709 12:14:03.677681 23267 leader_election.cc:304] T c1c10ca2f5924b7eb5422f0aee2f85c3 P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2904b089bdb249b78950db76f4a70e9f, 3a9a63ca97694ebdb84bca730762d735; no voters: 
I20260709 12:14:03.678825 23991 raft_consensus.cc:2804] T c1c10ca2f5924b7eb5422f0aee2f85c3 P 2904b089bdb249b78950db76f4a70e9f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:03.679365 23991 raft_consensus.cc:697] T c1c10ca2f5924b7eb5422f0aee2f85c3 P 2904b089bdb249b78950db76f4a70e9f [term 2 LEADER]: Becoming Leader. State: Replica: 2904b089bdb249b78950db76f4a70e9f, State: Running, Role: LEADER
I20260709 12:14:03.680289 23991 consensus_queue.cc:237] T c1c10ca2f5924b7eb5422f0aee2f85c3 P 2904b089bdb249b78950db76f4a70e9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:14:03.682417 23444 raft_consensus.cc:2468] T 9f2438f73a8e4760b7b37c5330853b72 P 9ba0da223cf24c97bc7d225e25015924 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2904b089bdb249b78950db76f4a70e9f in term 2.
I20260709 12:14:03.685088 23266 leader_election.cc:304] T 9f2438f73a8e4760b7b37c5330853b72 P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2904b089bdb249b78950db76f4a70e9f, 9ba0da223cf24c97bc7d225e25015924; no voters: 288a46a90f26471584043331107dc0dd
I20260709 12:14:03.686065 24087 raft_consensus.cc:2804] T 9f2438f73a8e4760b7b37c5330853b72 P 2904b089bdb249b78950db76f4a70e9f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:03.686584 24087 raft_consensus.cc:697] T 9f2438f73a8e4760b7b37c5330853b72 P 2904b089bdb249b78950db76f4a70e9f [term 2 LEADER]: Becoming Leader. State: Replica: 2904b089bdb249b78950db76f4a70e9f, State: Running, Role: LEADER
I20260709 12:14:03.687451 24087 consensus_queue.cc:237] T 9f2438f73a8e4760b7b37c5330853b72 P 2904b089bdb249b78950db76f4a70e9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:14:03.689293 24084 leader_election.cc:290] T 45e4fb3889cc4d23bab3929c3fdd731e P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 2 election: Requested vote from peers 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081), 288a46a90f26471584043331107dc0dd (127.12.174.129:46159)
I20260709 12:14:03.691936 23415 leader_election.cc:304] T 509f7e554df04f83aeffd51ec07607d5 P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3a9a63ca97694ebdb84bca730762d735, 9ba0da223cf24c97bc7d225e25015924; no voters: 288a46a90f26471584043331107dc0dd
I20260709 12:14:03.692569 23122 catalog_manager.cc:5697] T bed12810020c4496969b723bcdd4b4ec P 9ba0da223cf24c97bc7d225e25015924 reported cstate change: term changed from 1 to 2, leader changed from 288a46a90f26471584043331107dc0dd (127.12.174.129) to 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132). New cstate: current_term: 2 leader_uuid: "9ba0da223cf24c97bc7d225e25015924" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:03.698647 23415 leader_election.cc:304] T ac854957ad6246c6b123638cfafeacd4 P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2904b089bdb249b78950db76f4a70e9f, 9ba0da223cf24c97bc7d225e25015924; no voters: 288a46a90f26471584043331107dc0dd
I20260709 12:14:03.698650 24097 raft_consensus.cc:2804] T 509f7e554df04f83aeffd51ec07607d5 P 9ba0da223cf24c97bc7d225e25015924 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:03.699648 23952 raft_consensus.cc:2804] T ac854957ad6246c6b123638cfafeacd4 P 9ba0da223cf24c97bc7d225e25015924 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:03.700168 24097 raft_consensus.cc:697] T 509f7e554df04f83aeffd51ec07607d5 P 9ba0da223cf24c97bc7d225e25015924 [term 2 LEADER]: Becoming Leader. State: Replica: 9ba0da223cf24c97bc7d225e25015924, State: Running, Role: LEADER
I20260709 12:14:03.700515 23952 raft_consensus.cc:697] T ac854957ad6246c6b123638cfafeacd4 P 9ba0da223cf24c97bc7d225e25015924 [term 2 LEADER]: Becoming Leader. State: Replica: 9ba0da223cf24c97bc7d225e25015924, State: Running, Role: LEADER
I20260709 12:14:03.701269 24097 consensus_queue.cc:237] T 509f7e554df04f83aeffd51ec07607d5 P 9ba0da223cf24c97bc7d225e25015924 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:14:03.701761 23952 consensus_queue.cc:237] T ac854957ad6246c6b123638cfafeacd4 P 9ba0da223cf24c97bc7d225e25015924 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:14:03.695125 23443 raft_consensus.cc:2468] T 96f1bc9b220f49d5845c08249cb6a44f P 9ba0da223cf24c97bc7d225e25015924 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a9a63ca97694ebdb84bca730762d735 in term 2.
I20260709 12:14:03.708863 23340 leader_election.cc:304] T 96f1bc9b220f49d5845c08249cb6a44f P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3a9a63ca97694ebdb84bca730762d735, 9ba0da223cf24c97bc7d225e25015924; no voters: 288a46a90f26471584043331107dc0dd
W20260709 12:14:03.708642 23268 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:46159, user_credentials={real_user=slave}} blocked reactor thread for 60996.3us
I20260709 12:14:03.710896 24099 raft_consensus.cc:2804] T 96f1bc9b220f49d5845c08249cb6a44f P 3a9a63ca97694ebdb84bca730762d735 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:03.711443 24099 raft_consensus.cc:697] T 96f1bc9b220f49d5845c08249cb6a44f P 3a9a63ca97694ebdb84bca730762d735 [term 2 LEADER]: Becoming Leader. State: Replica: 3a9a63ca97694ebdb84bca730762d735, State: Running, Role: LEADER
I20260709 12:14:03.712369 24099 consensus_queue.cc:237] T 96f1bc9b220f49d5845c08249cb6a44f P 3a9a63ca97694ebdb84bca730762d735 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:14:03.628578 24012 raft_consensus.cc:515] T b1a6e82689a84e36949e5efca6592772 P 3a9a63ca97694ebdb84bca730762d735 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
W20260709 12:14:03.721794 23416 leader_election.cc:336] T 859d30d8c3fb4a499256ffad6dc2d1cd P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Network error: Client connection negotiation failed: client connection to 127.12.174.129:46159: connect: Connection refused (error 111)
I20260709 12:14:03.730024 23415 leader_election.cc:304] T 9a21be1df2964860b89acefd66f6fbde P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2904b089bdb249b78950db76f4a70e9f, 9ba0da223cf24c97bc7d225e25015924; no voters: 288a46a90f26471584043331107dc0dd
W20260709 12:14:03.731668 23342 leader_election.cc:336] T b1a6e82689a84e36949e5efca6592772 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Network error: Client connection negotiation failed: client connection to 127.12.174.129:46159: connect: Connection refused (error 111)
I20260709 12:14:03.733445 24012 leader_election.cc:290] T b1a6e82689a84e36949e5efca6592772 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 2 election: Requested vote from peers 288a46a90f26471584043331107dc0dd (127.12.174.129:46159), 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081)
I20260709 12:14:03.734797 23444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1a6e82689a84e36949e5efca6592772" candidate_uuid: "3a9a63ca97694ebdb84bca730762d735" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ba0da223cf24c97bc7d225e25015924"
I20260709 12:14:03.735531 23444 raft_consensus.cc:3060] T b1a6e82689a84e36949e5efca6592772 P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:03.738482 24037 raft_consensus.cc:2804] T 9a21be1df2964860b89acefd66f6fbde P 9ba0da223cf24c97bc7d225e25015924 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:03.732403 23446 raft_consensus.cc:2468] T 45e4fb3889cc4d23bab3929c3fdd731e P 9ba0da223cf24c97bc7d225e25015924 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2904b089bdb249b78950db76f4a70e9f in term 2.
W20260709 12:14:03.839183 23416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:46159, user_credentials={real_user=slave}} blocked reactor thread for 89339.1us
W20260709 12:14:03.844697 23268 leader_election.cc:336] T c1c10ca2f5924b7eb5422f0aee2f85c3 P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Network error: Client connection negotiation failed: client connection to 127.12.174.129:46159: connect: Connection refused (error 111)
I20260709 12:14:03.845317 23266 leader_election.cc:304] T 45e4fb3889cc4d23bab3929c3fdd731e P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2904b089bdb249b78950db76f4a70e9f, 9ba0da223cf24c97bc7d225e25015924; no voters: 
I20260709 12:14:03.737962 24101 raft_consensus.cc:493] T 54a02c3fbc0b4807998d018f9c2ecbc3 P 3a9a63ca97694ebdb84bca730762d735 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:03.933668 24101 raft_consensus.cc:515] T 54a02c3fbc0b4807998d018f9c2ecbc3 P 3a9a63ca97694ebdb84bca730762d735 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:14:03.867599 24059 raft_consensus.cc:493] T 99bc4210d0b44dd282a5bf7606d122af P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:03.936015 23266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.132:46081, user_credentials={real_user=slave}} blocked reactor thread for 180872us
I20260709 12:14:03.936643 24059 raft_consensus.cc:515] T 99bc4210d0b44dd282a5bf7606d122af P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:14:03.939519 24059 leader_election.cc:290] T 99bc4210d0b44dd282a5bf7606d122af P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061), 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081)
I20260709 12:14:03.940114 24059 raft_consensus.cc:493] T c1c10ca2f5924b7eb5422f0aee2f85c3 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:03.940609 24059 raft_consensus.cc:515] T c1c10ca2f5924b7eb5422f0aee2f85c3 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:14:03.868898 24037 raft_consensus.cc:697] T 9a21be1df2964860b89acefd66f6fbde P 9ba0da223cf24c97bc7d225e25015924 [term 2 LEADER]: Becoming Leader. State: Replica: 9ba0da223cf24c97bc7d225e25015924, State: Running, Role: LEADER
I20260709 12:14:03.943480 24037 consensus_queue.cc:237] T 9a21be1df2964860b89acefd66f6fbde P 9ba0da223cf24c97bc7d225e25015924 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:14:03.878391 23444 raft_consensus.cc:2468] T b1a6e82689a84e36949e5efca6592772 P 9ba0da223cf24c97bc7d225e25015924 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a9a63ca97694ebdb84bca730762d735 in term 2.
I20260709 12:14:03.873688 23122 catalog_manager.cc:5697] T 96f1bc9b220f49d5845c08249cb6a44f P 3a9a63ca97694ebdb84bca730762d735 reported cstate change: term changed from 1 to 2, leader changed from 288a46a90f26471584043331107dc0dd (127.12.174.129) to 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131). New cstate: current_term: 2 leader_uuid: "3a9a63ca97694ebdb84bca730762d735" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:03.884671 24056 tablet_bootstrap.cc:492] T 6626b442492c47849fd3c907d1c12f3e P 288a46a90f26471584043331107dc0dd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:03.890131 23124 catalog_manager.cc:5697] T c1c10ca2f5924b7eb5422f0aee2f85c3 P 2904b089bdb249b78950db76f4a70e9f reported cstate change: term changed from 1 to 2, leader changed from 288a46a90f26471584043331107dc0dd (127.12.174.129) to 2904b089bdb249b78950db76f4a70e9f (127.12.174.130). New cstate: current_term: 2 leader_uuid: "2904b089bdb249b78950db76f4a70e9f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:03.948143 24056 tablet_bootstrap.cc:492] T 6626b442492c47849fd3c907d1c12f3e P 288a46a90f26471584043331107dc0dd: Bootstrap complete.
I20260709 12:14:03.948943 24056 ts_tablet_manager.cc:1403] T 6626b442492c47849fd3c907d1c12f3e P 288a46a90f26471584043331107dc0dd: Time spent bootstrapping tablet: real 0.304s	user 0.018s	sys 0.005s
I20260709 12:14:03.892755 23300 raft_consensus.cc:1275] T b1533753456b445991715da5158c921b P 2904b089bdb249b78950db76f4a70e9f [term 2 FOLLOWER]: Refusing update from remote peer 9ba0da223cf24c97bc7d225e25015924: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:03.892985 23298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859d30d8c3fb4a499256ffad6dc2d1cd" candidate_uuid: "9ba0da223cf24c97bc7d225e25015924" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2904b089bdb249b78950db76f4a70e9f"
I20260709 12:14:03.950847 23298 raft_consensus.cc:2393] T 859d30d8c3fb4a499256ffad6dc2d1cd P 2904b089bdb249b78950db76f4a70e9f [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ba0da223cf24c97bc7d225e25015924 in current term 2: Already voted for candidate 2904b089bdb249b78950db76f4a70e9f in this term.
W20260709 12:14:03.951227 23268 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:46159, user_credentials={real_user=slave}} blocked reactor thread for 106556us
I20260709 12:14:03.955876 24056 raft_consensus.cc:359] T 6626b442492c47849fd3c907d1c12f3e P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:14:03.956856 24056 raft_consensus.cc:740] T 6626b442492c47849fd3c907d1c12f3e P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 288a46a90f26471584043331107dc0dd, State: Initialized, Role: FOLLOWER
I20260709 12:14:03.962529 23415 leader_election.cc:304] T 859d30d8c3fb4a499256ffad6dc2d1cd P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ba0da223cf24c97bc7d225e25015924; no voters: 288a46a90f26471584043331107dc0dd, 2904b089bdb249b78950db76f4a70e9f
I20260709 12:14:03.963256 23987 consensus_queue.cc:1048] T b1533753456b445991715da5158c921b P 9ba0da223cf24c97bc7d225e25015924 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:03.963593 24096 raft_consensus.cc:2749] T 859d30d8c3fb4a499256ffad6dc2d1cd P 9ba0da223cf24c97bc7d225e25015924 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:14:03.936182 24101 leader_election.cc:290] T 54a02c3fbc0b4807998d018f9c2ecbc3 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081), 288a46a90f26471584043331107dc0dd (127.12.174.129:46159)
I20260709 12:14:03.979013 23125 catalog_manager.cc:5697] T 509f7e554df04f83aeffd51ec07607d5 P 9ba0da223cf24c97bc7d225e25015924 reported cstate change: term changed from 1 to 2, leader changed from 288a46a90f26471584043331107dc0dd (127.12.174.129) to 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132). New cstate: current_term: 2 leader_uuid: "9ba0da223cf24c97bc7d225e25015924" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:03.980966 23125 catalog_manager.cc:5697] T ac854957ad6246c6b123638cfafeacd4 P 9ba0da223cf24c97bc7d225e25015924 reported cstate change: term changed from 1 to 2, leader changed from 288a46a90f26471584043331107dc0dd (127.12.174.129) to 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132). New cstate: current_term: 2 leader_uuid: "9ba0da223cf24c97bc7d225e25015924" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:03.995575 24059 leader_election.cc:290] T c1c10ca2f5924b7eb5422f0aee2f85c3 P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789), 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061)
W20260709 12:14:03.995577 23342 leader_election.cc:336] T 54a02c3fbc0b4807998d018f9c2ecbc3 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Network error: Client connection negotiation failed: client connection to 127.12.174.129:46159: connect: Connection refused (error 111)
I20260709 12:14:03.936129 23925 raft_consensus.cc:2804] T 45e4fb3889cc4d23bab3929c3fdd731e P 2904b089bdb249b78950db76f4a70e9f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:04.005095 23925 raft_consensus.cc:697] T 45e4fb3889cc4d23bab3929c3fdd731e P 2904b089bdb249b78950db76f4a70e9f [term 2 LEADER]: Becoming Leader. State: Replica: 2904b089bdb249b78950db76f4a70e9f, State: Running, Role: LEADER
I20260709 12:14:04.006265 23925 consensus_queue.cc:237] T 45e4fb3889cc4d23bab3929c3fdd731e P 2904b089bdb249b78950db76f4a70e9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:14:03.962339 24056 consensus_queue.cc:260] T 6626b442492c47849fd3c907d1c12f3e P 288a46a90f26471584043331107dc0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:14:04.016119 24056 ts_tablet_manager.cc:1434] T 6626b442492c47849fd3c907d1c12f3e P 288a46a90f26471584043331107dc0dd: Time spent starting tablet: real 0.067s	user 0.007s	sys 0.000s
I20260709 12:14:04.017113 24056 tablet_bootstrap.cc:492] T 27166b782a5049198cccb3e5905acbc7 P 288a46a90f26471584043331107dc0dd: Bootstrap starting.
I20260709 12:14:04.020231 23340 leader_election.cc:304] T b1a6e82689a84e36949e5efca6592772 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3a9a63ca97694ebdb84bca730762d735, 9ba0da223cf24c97bc7d225e25015924; no voters: 288a46a90f26471584043331107dc0dd
I20260709 12:14:04.020380 23446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a02c3fbc0b4807998d018f9c2ecbc3" candidate_uuid: "3a9a63ca97694ebdb84bca730762d735" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ba0da223cf24c97bc7d225e25015924" is_pre_election: true
I20260709 12:14:04.021270 23446 raft_consensus.cc:2468] T 54a02c3fbc0b4807998d018f9c2ecbc3 P 9ba0da223cf24c97bc7d225e25015924 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a9a63ca97694ebdb84bca730762d735 in term 2.
I20260709 12:14:04.022744 23374 raft_consensus.cc:1275] T 8771e0b5070c49c589f276c793f87727 P 3a9a63ca97694ebdb84bca730762d735 [term 2 FOLLOWER]: Refusing update from remote peer 2904b089bdb249b78950db76f4a70e9f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:04.023535 24101 raft_consensus.cc:2804] T b1a6e82689a84e36949e5efca6592772 P 3a9a63ca97694ebdb84bca730762d735 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:04.024108 24101 raft_consensus.cc:697] T b1a6e82689a84e36949e5efca6592772 P 3a9a63ca97694ebdb84bca730762d735 [term 2 LEADER]: Becoming Leader. State: Replica: 3a9a63ca97694ebdb84bca730762d735, State: Running, Role: LEADER
I20260709 12:14:04.025122 24101 consensus_queue.cc:237] T b1a6e82689a84e36949e5efca6592772 P 3a9a63ca97694ebdb84bca730762d735 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
W20260709 12:14:04.080571 23268 consensus_peers.cc:597] T 8771e0b5070c49c589f276c793f87727 P 2904b089bdb249b78950db76f4a70e9f -> Peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Couldn't send request to peer 288a46a90f26471584043331107dc0dd. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:46159: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:04.082437 23268 leader_election.cc:336] T 859d30d8c3fb4a499256ffad6dc2d1cd P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Network error: Client connection negotiation failed: client connection to 127.12.174.129:46159: connect: Connection refused (error 111)
I20260709 12:14:04.083950 23268 leader_election.cc:304] T 859d30d8c3fb4a499256ffad6dc2d1cd P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2904b089bdb249b78950db76f4a70e9f; no voters: 288a46a90f26471584043331107dc0dd, 9ba0da223cf24c97bc7d225e25015924
I20260709 12:14:04.087826 23340 leader_election.cc:304] T 54a02c3fbc0b4807998d018f9c2ecbc3 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3a9a63ca97694ebdb84bca730762d735, 9ba0da223cf24c97bc7d225e25015924; no voters: 288a46a90f26471584043331107dc0dd
W20260709 12:14:04.094602 23268 leader_election.cc:336] T 45e4fb3889cc4d23bab3929c3fdd731e P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Network error: Client connection negotiation failed: client connection to 127.12.174.129:46159: connect: Connection refused (error 111)
I20260709 12:14:04.096894 24017 raft_consensus.cc:2804] T 54a02c3fbc0b4807998d018f9c2ecbc3 P 3a9a63ca97694ebdb84bca730762d735 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:04.097429 24017 raft_consensus.cc:493] T 54a02c3fbc0b4807998d018f9c2ecbc3 P 3a9a63ca97694ebdb84bca730762d735 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:04.097869 24017 raft_consensus.cc:3060] T 54a02c3fbc0b4807998d018f9c2ecbc3 P 3a9a63ca97694ebdb84bca730762d735 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:04.099539 23991 raft_consensus.cc:2749] T 859d30d8c3fb4a499256ffad6dc2d1cd P 2904b089bdb249b78950db76f4a70e9f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:14:04.101584 23125 catalog_manager.cc:5697] T 9a21be1df2964860b89acefd66f6fbde P 9ba0da223cf24c97bc7d225e25015924 reported cstate change: term changed from 1 to 2, leader changed from 288a46a90f26471584043331107dc0dd (127.12.174.129) to 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132). New cstate: current_term: 2 leader_uuid: "9ba0da223cf24c97bc7d225e25015924" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:04.095911 24095 consensus_queue.cc:1048] T 8771e0b5070c49c589f276c793f87727 P 2904b089bdb249b78950db76f4a70e9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 12:14:04.122287 23122 catalog_manager.cc:5697] T 9f2438f73a8e4760b7b37c5330853b72 P 2904b089bdb249b78950db76f4a70e9f reported cstate change: term changed from 1 to 2, leader changed from 288a46a90f26471584043331107dc0dd (127.12.174.129) to 2904b089bdb249b78950db76f4a70e9f (127.12.174.130). New cstate: current_term: 2 leader_uuid: "2904b089bdb249b78950db76f4a70e9f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } health_report { overall_health: HEALTHY } } }
W20260709 12:14:04.142939 23416 consensus_peers.cc:597] T bed12810020c4496969b723bcdd4b4ec P 9ba0da223cf24c97bc7d225e25015924 -> Peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Couldn't send request to peer 288a46a90f26471584043331107dc0dd. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:46159: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:04.150543 24146 raft_consensus.cc:493] T 558b91ca6fe3461da7eb4a1344ec14fc P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:04.150655 23444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bc4210d0b44dd282a5bf7606d122af" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ba0da223cf24c97bc7d225e25015924" is_pre_election: true
I20260709 12:14:04.155207 24059 raft_consensus.cc:493] T 3ad2f373a67b4c9cbb2183c2c73eb3e5 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:04.153648 24146 raft_consensus.cc:515] T 558b91ca6fe3461da7eb4a1344ec14fc P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:14:04.155774 24059 raft_consensus.cc:515] T 3ad2f373a67b4c9cbb2183c2c73eb3e5 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:14:04.157919 24059 leader_election.cc:290] T 3ad2f373a67b4c9cbb2183c2c73eb3e5 P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081), 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789)
I20260709 12:14:04.161120 23444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "558b91ca6fe3461da7eb4a1344ec14fc" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ba0da223cf24c97bc7d225e25015924" is_pre_election: true
I20260709 12:14:04.161682 23124 catalog_manager.cc:5697] T b1a6e82689a84e36949e5efca6592772 P 3a9a63ca97694ebdb84bca730762d735 reported cstate change: term changed from 1 to 2, leader changed from 288a46a90f26471584043331107dc0dd (127.12.174.129) to 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131). New cstate: current_term: 2 leader_uuid: "3a9a63ca97694ebdb84bca730762d735" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:04.162540 24056 tablet_bootstrap.cc:492] T 27166b782a5049198cccb3e5905acbc7 P 288a46a90f26471584043331107dc0dd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:04.163134 24146 leader_election.cc:290] T 558b91ca6fe3461da7eb4a1344ec14fc P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081), 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789)
I20260709 12:14:04.163825 24056 tablet_bootstrap.cc:492] T 27166b782a5049198cccb3e5905acbc7 P 288a46a90f26471584043331107dc0dd: Bootstrap complete.
I20260709 12:14:04.164628 24056 ts_tablet_manager.cc:1403] T 27166b782a5049198cccb3e5905acbc7 P 288a46a90f26471584043331107dc0dd: Time spent bootstrapping tablet: real 0.148s	user 0.020s	sys 0.000s
I20260709 12:14:04.162456 23447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad2f373a67b4c9cbb2183c2c73eb3e5" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ba0da223cf24c97bc7d225e25015924" is_pre_election: true
I20260709 12:14:04.169512 23298 raft_consensus.cc:1275] T ac854957ad6246c6b123638cfafeacd4 P 2904b089bdb249b78950db76f4a70e9f [term 2 FOLLOWER]: Refusing update from remote peer 9ba0da223cf24c97bc7d225e25015924: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:14:04.170603 23267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:40061, user_credentials={real_user=slave}} blocked reactor thread for 80556.1us
I20260709 12:14:04.172300 23374 raft_consensus.cc:1275] T bed12810020c4496969b723bcdd4b4ec P 3a9a63ca97694ebdb84bca730762d735 [term 2 FOLLOWER]: Refusing update from remote peer 9ba0da223cf24c97bc7d225e25015924: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:04.171523 24056 raft_consensus.cc:359] T 27166b782a5049198cccb3e5905acbc7 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:14:04.179297 24056 raft_consensus.cc:740] T 27166b782a5049198cccb3e5905acbc7 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 288a46a90f26471584043331107dc0dd, State: Initialized, Role: FOLLOWER
I20260709 12:14:04.180155 24056 consensus_queue.cc:260] T 27166b782a5049198cccb3e5905acbc7 P 288a46a90f26471584043331107dc0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:14:04.182511 24017 raft_consensus.cc:515] T 54a02c3fbc0b4807998d018f9c2ecbc3 P 3a9a63ca97694ebdb84bca730762d735 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:14:04.173631 24037 consensus_queue.cc:1048] T ac854957ad6246c6b123638cfafeacd4 P 9ba0da223cf24c97bc7d225e25015924 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 12:14:04.186897 23446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a02c3fbc0b4807998d018f9c2ecbc3" candidate_uuid: "3a9a63ca97694ebdb84bca730762d735" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ba0da223cf24c97bc7d225e25015924"
I20260709 12:14:04.187551 23446 raft_consensus.cc:3060] T 54a02c3fbc0b4807998d018f9c2ecbc3 P 9ba0da223cf24c97bc7d225e25015924 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:04.192328 24017 leader_election.cc:290] T 54a02c3fbc0b4807998d018f9c2ecbc3 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 3 election: Requested vote from peers 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081), 288a46a90f26471584043331107dc0dd (127.12.174.129:46159)
W20260709 12:14:04.196017 23342 consensus_peers.cc:597] T 96f1bc9b220f49d5845c08249cb6a44f P 3a9a63ca97694ebdb84bca730762d735 -> Peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Couldn't send request to peer 288a46a90f26471584043331107dc0dd. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:46159: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:04.201404 24056 ts_tablet_manager.cc:1434] T 27166b782a5049198cccb3e5905acbc7 P 288a46a90f26471584043331107dc0dd: Time spent starting tablet: real 0.036s	user 0.009s	sys 0.000s
I20260709 12:14:04.202515 24056 tablet_bootstrap.cc:492] T d85273afe57c4f35bb72827d1c5879eb P 288a46a90f26471584043331107dc0dd: Bootstrap starting.
I20260709 12:14:04.205526 24146 raft_consensus.cc:493] T 0646c3e87a184cd19184ff12695392a7 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:04.206158 24146 raft_consensus.cc:515] T 0646c3e87a184cd19184ff12695392a7 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:14:04.208307 24146 leader_election.cc:290] T 0646c3e87a184cd19184ff12695392a7 P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789), 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061)
I20260709 12:14:04.216058 24146 raft_consensus.cc:493] T 00335dfad3394f0c9689c0df8500bc9e P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:04.216688 24146 raft_consensus.cc:515] T 00335dfad3394f0c9689c0df8500bc9e P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:14:04.221597 23447 raft_consensus.cc:1275] T 96f1bc9b220f49d5845c08249cb6a44f P 9ba0da223cf24c97bc7d225e25015924 [term 2 FOLLOWER]: Refusing update from remote peer 3a9a63ca97694ebdb84bca730762d735: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:04.226349 24146 leader_election.cc:290] T 00335dfad3394f0c9689c0df8500bc9e P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081), 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789)
I20260709 12:14:04.227672 24099 consensus_queue.cc:1048] T 96f1bc9b220f49d5845c08249cb6a44f P 3a9a63ca97694ebdb84bca730762d735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:14:04.229974 23375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c10ca2f5924b7eb5422f0aee2f85c3" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3a9a63ca97694ebdb84bca730762d735" is_pre_election: true
I20260709 12:14:04.230822 23375 raft_consensus.cc:2393] T c1c10ca2f5924b7eb5422f0aee2f85c3 P 3a9a63ca97694ebdb84bca730762d735 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 288a46a90f26471584043331107dc0dd in current term 2: Already voted for candidate 2904b089bdb249b78950db76f4a70e9f in this term.
I20260709 12:14:04.231937 23371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0646c3e87a184cd19184ff12695392a7" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3a9a63ca97694ebdb84bca730762d735" is_pre_election: true
W20260709 12:14:04.236267 23416 consensus_peers.cc:597] T 509f7e554df04f83aeffd51ec07607d5 P 9ba0da223cf24c97bc7d225e25015924 -> Peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Couldn't send request to peer 288a46a90f26471584043331107dc0dd. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:46159: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:04.238174 23447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00335dfad3394f0c9689c0df8500bc9e" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ba0da223cf24c97bc7d225e25015924" is_pre_election: true
I20260709 12:14:04.210146 23446 raft_consensus.cc:2468] T 54a02c3fbc0b4807998d018f9c2ecbc3 P 9ba0da223cf24c97bc7d225e25015924 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a9a63ca97694ebdb84bca730762d735 in term 3.
I20260709 12:14:04.240856 23340 leader_election.cc:304] T 54a02c3fbc0b4807998d018f9c2ecbc3 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a9a63ca97694ebdb84bca730762d735, 9ba0da223cf24c97bc7d225e25015924; no voters: 
I20260709 12:14:04.240871 23374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bc4210d0b44dd282a5bf7606d122af" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3a9a63ca97694ebdb84bca730762d735" is_pre_election: true
W20260709 12:14:04.247464 23268 consensus_peers.cc:597] T 9f2438f73a8e4760b7b37c5330853b72 P 2904b089bdb249b78950db76f4a70e9f -> Peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Couldn't send request to peer 288a46a90f26471584043331107dc0dd. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:46159: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:04.245484 24015 raft_consensus.cc:2804] T 54a02c3fbc0b4807998d018f9c2ecbc3 P 3a9a63ca97694ebdb84bca730762d735 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:04.248839 24015 raft_consensus.cc:697] T 54a02c3fbc0b4807998d018f9c2ecbc3 P 3a9a63ca97694ebdb84bca730762d735 [term 3 LEADER]: Becoming Leader. State: Replica: 3a9a63ca97694ebdb84bca730762d735, State: Running, Role: LEADER
I20260709 12:14:04.249786 24015 consensus_queue.cc:237] T 54a02c3fbc0b4807998d018f9c2ecbc3 P 3a9a63ca97694ebdb84bca730762d735 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
W20260709 12:14:04.252183 23342 leader_election.cc:336] T 54a02c3fbc0b4807998d018f9c2ecbc3 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Network error: Client connection negotiation failed: client connection to 127.12.174.129:46159: connect: Connection refused (error 111)
I20260709 12:14:04.252607 23372 raft_consensus.cc:1275] T 509f7e554df04f83aeffd51ec07607d5 P 3a9a63ca97694ebdb84bca730762d735 [term 2 FOLLOWER]: Refusing update from remote peer 9ba0da223cf24c97bc7d225e25015924: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:04.198948 24037 consensus_queue.cc:1048] T bed12810020c4496969b723bcdd4b4ec P 9ba0da223cf24c97bc7d225e25015924 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
I20260709 12:14:04.261036 24052 leader_election.cc:304] T 99bc4210d0b44dd282a5bf7606d122af P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 288a46a90f26471584043331107dc0dd; no voters: 3a9a63ca97694ebdb84bca730762d735, 9ba0da223cf24c97bc7d225e25015924
I20260709 12:14:04.262585 24146 raft_consensus.cc:2749] T 99bc4210d0b44dd282a5bf7606d122af P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:04.255880 24096 consensus_queue.cc:1048] T 509f7e554df04f83aeffd51ec07607d5 P 9ba0da223cf24c97bc7d225e25015924 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
W20260709 12:14:04.274652 23268 consensus_peers.cc:597] T 5959fc0b70884d699725fb8d560e5de5 P 2904b089bdb249b78950db76f4a70e9f -> Peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Couldn't send request to peer 288a46a90f26471584043331107dc0dd. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:46159: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:04.275311 23268 consensus_peers.cc:597] T 92d63c0c6ef9452797da238708c39275 P 2904b089bdb249b78950db76f4a70e9f -> Peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Couldn't send request to peer 288a46a90f26471584043331107dc0dd. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:46159: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:04.275714 23268 consensus_peers.cc:597] T c1c10ca2f5924b7eb5422f0aee2f85c3 P 2904b089bdb249b78950db76f4a70e9f -> Peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Couldn't send request to peer 288a46a90f26471584043331107dc0dd. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:46159: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:04.276141 23268 consensus_peers.cc:597] T 6d7d1c502ee24072a41a2a55cfc3a5fa P 2904b089bdb249b78950db76f4a70e9f -> Peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Couldn't send request to peer 288a46a90f26471584043331107dc0dd. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:46159: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:04.276957 23342 consensus_peers.cc:597] T ec2c01c273894e73b6a2ab39e0132286 P 3a9a63ca97694ebdb84bca730762d735 -> Peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Couldn't send request to peer 288a46a90f26471584043331107dc0dd. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:46159: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:04.287539 23416 consensus_peers.cc:597] T ac854957ad6246c6b123638cfafeacd4 P 9ba0da223cf24c97bc7d225e25015924 -> Peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Couldn't send request to peer 288a46a90f26471584043331107dc0dd. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:46159: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:04.291730 23375 raft_consensus.cc:1275] T c1c10ca2f5924b7eb5422f0aee2f85c3 P 3a9a63ca97694ebdb84bca730762d735 [term 2 FOLLOWER]: Refusing update from remote peer 2904b089bdb249b78950db76f4a70e9f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:04.307498 24146 raft_consensus.cc:493] T 859d30d8c3fb4a499256ffad6dc2d1cd P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:04.308136 24146 raft_consensus.cc:515] T 859d30d8c3fb4a499256ffad6dc2d1cd P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:14:04.310537 23122 catalog_manager.cc:5697] T 45e4fb3889cc4d23bab3929c3fdd731e P 2904b089bdb249b78950db76f4a70e9f reported cstate change: term changed from 1 to 2, leader changed from 288a46a90f26471584043331107dc0dd (127.12.174.129) to 2904b089bdb249b78950db76f4a70e9f (127.12.174.130). New cstate: current_term: 2 leader_uuid: "2904b089bdb249b78950db76f4a70e9f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:04.313993 23444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859d30d8c3fb4a499256ffad6dc2d1cd" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ba0da223cf24c97bc7d225e25015924" is_pre_election: true
I20260709 12:14:04.314929 23444 raft_consensus.cc:2393] T 859d30d8c3fb4a499256ffad6dc2d1cd P 9ba0da223cf24c97bc7d225e25015924 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 288a46a90f26471584043331107dc0dd in current term 2: Already voted for candidate 9ba0da223cf24c97bc7d225e25015924 in this term.
I20260709 12:14:04.316552 24146 leader_election.cc:290] T 859d30d8c3fb4a499256ffad6dc2d1cd P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081), 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789)
I20260709 12:14:04.318488 23925 consensus_queue.cc:1048] T c1c10ca2f5924b7eb5422f0aee2f85c3 P 2904b089bdb249b78950db76f4a70e9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:04.327512 23300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c10ca2f5924b7eb5422f0aee2f85c3" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2904b089bdb249b78950db76f4a70e9f" is_pre_election: true
I20260709 12:14:04.340250 23298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad2f373a67b4c9cbb2183c2c73eb3e5" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2904b089bdb249b78950db76f4a70e9f" is_pre_election: true
I20260709 12:14:04.340423 23300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "558b91ca6fe3461da7eb4a1344ec14fc" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2904b089bdb249b78950db76f4a70e9f" is_pre_election: true
I20260709 12:14:04.341456 24052 leader_election.cc:304] T c1c10ca2f5924b7eb5422f0aee2f85c3 P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 288a46a90f26471584043331107dc0dd; no voters: 2904b089bdb249b78950db76f4a70e9f, 3a9a63ca97694ebdb84bca730762d735
I20260709 12:14:04.341830 23302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00335dfad3394f0c9689c0df8500bc9e" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2904b089bdb249b78950db76f4a70e9f" is_pre_election: true
I20260709 12:14:04.342362 23301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859d30d8c3fb4a499256ffad6dc2d1cd" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2904b089bdb249b78950db76f4a70e9f" is_pre_election: true
I20260709 12:14:04.343015 24146 raft_consensus.cc:3060] T c1c10ca2f5924b7eb5422f0aee2f85c3 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:04.343592 23299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0646c3e87a184cd19184ff12695392a7" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2904b089bdb249b78950db76f4a70e9f" is_pre_election: true
I20260709 12:14:04.347088 23444 raft_consensus.cc:1275] T 9f2438f73a8e4760b7b37c5330853b72 P 9ba0da223cf24c97bc7d225e25015924 [term 2 FOLLOWER]: Refusing update from remote peer 2904b089bdb249b78950db76f4a70e9f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:04.343233 23301 raft_consensus.cc:2393] T 859d30d8c3fb4a499256ffad6dc2d1cd P 2904b089bdb249b78950db76f4a70e9f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 288a46a90f26471584043331107dc0dd in current term 2: Already voted for candidate 2904b089bdb249b78950db76f4a70e9f in this term.
I20260709 12:14:04.348188 24052 leader_election.cc:304] T 3ad2f373a67b4c9cbb2183c2c73eb3e5 P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 288a46a90f26471584043331107dc0dd; no voters: 2904b089bdb249b78950db76f4a70e9f, 9ba0da223cf24c97bc7d225e25015924
W20260709 12:14:04.343335 23342 consensus_peers.cc:597] T d55aba14f62b41538fdb710117d67580 P 3a9a63ca97694ebdb84bca730762d735 -> Peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Couldn't send request to peer 288a46a90f26471584043331107dc0dd. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:46159: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:04.352916 24100 consensus_queue.cc:1048] T 9f2438f73a8e4760b7b37c5330853b72 P 2904b089bdb249b78950db76f4a70e9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:14:04.359237 23268 consensus_peers.cc:597] T b3e2bbccfb7f4da8baf42735151ff804 P 2904b089bdb249b78950db76f4a70e9f -> Peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Couldn't send request to peer 288a46a90f26471584043331107dc0dd. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:46159: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:04.351672 24059 raft_consensus.cc:493] T 9f2438f73a8e4760b7b37c5330853b72 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:14:04.407666 23342 consensus_peers.cc:597] T 27166b782a5049198cccb3e5905acbc7 P 3a9a63ca97694ebdb84bca730762d735 -> Peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Couldn't send request to peer 288a46a90f26471584043331107dc0dd. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:46159: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:04.408419 23342 consensus_peers.cc:597] T 0f7747f7dcab4d6da9caf82c35717552 P 3a9a63ca97694ebdb84bca730762d735 -> Peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Couldn't send request to peer 288a46a90f26471584043331107dc0dd. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:46159: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:04.387916 24059 raft_consensus.cc:515] T 9f2438f73a8e4760b7b37c5330853b72 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
W20260709 12:14:04.411108 23268 consensus_peers.cc:597] T 6626b442492c47849fd3c907d1c12f3e P 2904b089bdb249b78950db76f4a70e9f -> Peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Couldn't send request to peer 288a46a90f26471584043331107dc0dd. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:46159: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:04.426666 23268 consensus_peers.cc:597] T 3ad2f373a67b4c9cbb2183c2c73eb3e5 P 2904b089bdb249b78950db76f4a70e9f -> Peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Couldn't send request to peer 288a46a90f26471584043331107dc0dd. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:46159: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:04.436329 23124 catalog_manager.cc:5697] T 54a02c3fbc0b4807998d018f9c2ecbc3 P 3a9a63ca97694ebdb84bca730762d735 reported cstate change: term changed from 1 to 3, leader changed from 288a46a90f26471584043331107dc0dd (127.12.174.129) to 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131). New cstate: current_term: 3 leader_uuid: "3a9a63ca97694ebdb84bca730762d735" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:04.442495 23447 raft_consensus.cc:1275] T 45e4fb3889cc4d23bab3929c3fdd731e P 9ba0da223cf24c97bc7d225e25015924 [term 2 FOLLOWER]: Refusing update from remote peer 2904b089bdb249b78950db76f4a70e9f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:04.447588 23583 consensus_queue.cc:1048] T 45e4fb3889cc4d23bab3929c3fdd731e P 2904b089bdb249b78950db76f4a70e9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:14:04.454495 24146 raft_consensus.cc:2749] T c1c10ca2f5924b7eb5422f0aee2f85c3 P 288a46a90f26471584043331107dc0dd [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:04.463546 24176 raft_consensus.cc:493] T b1a6e82689a84e36949e5efca6592772 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:04.463922 24175 raft_consensus.cc:2749] T 3ad2f373a67b4c9cbb2183c2c73eb3e5 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:04.464193 24176 raft_consensus.cc:515] T b1a6e82689a84e36949e5efca6592772 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
W20260709 12:14:04.470682 23342 consensus_peers.cc:597] T 0646c3e87a184cd19184ff12695392a7 P 3a9a63ca97694ebdb84bca730762d735 -> Peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Couldn't send request to peer 288a46a90f26471584043331107dc0dd. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:46159: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:04.463940 23301 raft_consensus.cc:1275] T 9a21be1df2964860b89acefd66f6fbde P 2904b089bdb249b78950db76f4a70e9f [term 2 FOLLOWER]: Refusing update from remote peer 9ba0da223cf24c97bc7d225e25015924: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:14:04.471340 23342 consensus_peers.cc:597] T 99bc4210d0b44dd282a5bf7606d122af P 3a9a63ca97694ebdb84bca730762d735 -> Peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Couldn't send request to peer 288a46a90f26471584043331107dc0dd. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:46159: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:04.472805 24059 leader_election.cc:290] T 9f2438f73a8e4760b7b37c5330853b72 P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081), 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789)
W20260709 12:14:04.475160 23342 consensus_peers.cc:597] T b1a6e82689a84e36949e5efca6592772 P 3a9a63ca97694ebdb84bca730762d735 -> Peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Couldn't send request to peer 288a46a90f26471584043331107dc0dd. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:46159: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:04.475697 23342 consensus_peers.cc:597] T c3ac99f9dbb24693b97d3994ceb65955 P 3a9a63ca97694ebdb84bca730762d735 -> Peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Couldn't send request to peer 288a46a90f26471584043331107dc0dd. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:46159: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:04.484843 23446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f2438f73a8e4760b7b37c5330853b72" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ba0da223cf24c97bc7d225e25015924" is_pre_election: true
I20260709 12:14:04.486284 24056 tablet_bootstrap.cc:492] T d85273afe57c4f35bb72827d1c5879eb P 288a46a90f26471584043331107dc0dd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:04.504195 24056 tablet_bootstrap.cc:492] T d85273afe57c4f35bb72827d1c5879eb P 288a46a90f26471584043331107dc0dd: Bootstrap complete.
I20260709 12:14:04.505215 24056 ts_tablet_manager.cc:1403] T d85273afe57c4f35bb72827d1c5879eb P 288a46a90f26471584043331107dc0dd: Time spent bootstrapping tablet: real 0.303s	user 0.013s	sys 0.014s
W20260709 12:14:04.513329 23416 consensus_peers.cc:597] T d34300c6c4f2447182942fb5ab8cc3c4 P 9ba0da223cf24c97bc7d225e25015924 -> Peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Couldn't send request to peer 288a46a90f26471584043331107dc0dd. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:46159: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:04.526625 23268 consensus_peers.cc:597] T d85273afe57c4f35bb72827d1c5879eb P 2904b089bdb249b78950db76f4a70e9f -> Peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Couldn't send request to peer 288a46a90f26471584043331107dc0dd. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:46159: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:04.509105 24083 consensus_queue.cc:1048] T 9a21be1df2964860b89acefd66f6fbde P 9ba0da223cf24c97bc7d225e25015924 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 12:14:04.539584 24176 leader_election.cc:290] T b1a6e82689a84e36949e5efca6592772 P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061), 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081)
I20260709 12:14:04.531227 24059 raft_consensus.cc:493] T d2afee7aeea24f85b4bfecc49efcf841 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:04.542230 24059 raft_consensus.cc:515] T d2afee7aeea24f85b4bfecc49efcf841 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:14:04.543712 23447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1a6e82689a84e36949e5efca6592772" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ba0da223cf24c97bc7d225e25015924" is_pre_election: true
I20260709 12:14:04.544548 24059 leader_election.cc:290] T d2afee7aeea24f85b4bfecc49efcf841 P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061), 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081)
I20260709 12:14:04.544281 24056 raft_consensus.cc:359] T d85273afe57c4f35bb72827d1c5879eb P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:14:04.545032 24056 raft_consensus.cc:740] T d85273afe57c4f35bb72827d1c5879eb P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 288a46a90f26471584043331107dc0dd, State: Initialized, Role: FOLLOWER
I20260709 12:14:04.544689 23447 raft_consensus.cc:2393] T b1a6e82689a84e36949e5efca6592772 P 9ba0da223cf24c97bc7d225e25015924 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 288a46a90f26471584043331107dc0dd in current term 2: Already voted for candidate 3a9a63ca97694ebdb84bca730762d735 in this term.
I20260709 12:14:04.545804 24056 consensus_queue.cc:260] T d85273afe57c4f35bb72827d1c5879eb P 288a46a90f26471584043331107dc0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
W20260709 12:14:04.499267 24052 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:45789, user_credentials={real_user=slave}} blocked reactor thread for 150408us
I20260709 12:14:04.559701 24056 ts_tablet_manager.cc:1434] T d85273afe57c4f35bb72827d1c5879eb P 288a46a90f26471584043331107dc0dd: Time spent starting tablet: real 0.054s	user 0.008s	sys 0.001s
W20260709 12:14:04.562572 23268 consensus_peers.cc:597] T 2eb2c8089ce14124aed9a5d834cd0522 P 2904b089bdb249b78950db76f4a70e9f -> Peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Couldn't send request to peer 288a46a90f26471584043331107dc0dd. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:46159: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:04.660705 23340 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.132:46081, user_credentials={real_user=slave}} blocked reactor thread for 87492.8us
W20260709 12:14:04.670584 24177 log.cc:927] Time spent T 9f2438f73a8e4760b7b37c5330853b72 P 9ba0da223cf24c97bc7d225e25015924: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 12:14:04.671576 24056 tablet_bootstrap.cc:492] T 05b49011442c4131a4ac3c55feed5409 P 288a46a90f26471584043331107dc0dd: Bootstrap starting.
I20260709 12:14:04.664897 23442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2afee7aeea24f85b4bfecc49efcf841" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ba0da223cf24c97bc7d225e25015924" is_pre_election: true
I20260709 12:14:04.578871 24052 leader_election.cc:304] T 558b91ca6fe3461da7eb4a1344ec14fc P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 288a46a90f26471584043331107dc0dd; no voters: 2904b089bdb249b78950db76f4a70e9f, 9ba0da223cf24c97bc7d225e25015924
I20260709 12:14:04.691217 24059 raft_consensus.cc:2749] T 558b91ca6fe3461da7eb4a1344ec14fc P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:14:04.698616 23266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.132:46081, user_credentials={real_user=slave}} blocked reactor thread for 47369.2us
W20260709 12:14:04.697898 24052 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:45789, user_credentials={real_user=slave}} blocked reactor thread for 129440us
I20260709 12:14:04.715348 24052 leader_election.cc:304] T 00335dfad3394f0c9689c0df8500bc9e P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 288a46a90f26471584043331107dc0dd; no voters: 2904b089bdb249b78950db76f4a70e9f, 9ba0da223cf24c97bc7d225e25015924
I20260709 12:14:04.717193 24176 raft_consensus.cc:2749] T 00335dfad3394f0c9689c0df8500bc9e P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:04.718919 23443 raft_consensus.cc:1275] T b1a6e82689a84e36949e5efca6592772 P 9ba0da223cf24c97bc7d225e25015924 [term 2 FOLLOWER]: Refusing update from remote peer 3a9a63ca97694ebdb84bca730762d735: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:04.710095 24059 raft_consensus.cc:493] T b1533753456b445991715da5158c921b P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:04.718856 24052 leader_election.cc:304] T 0646c3e87a184cd19184ff12695392a7 P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 288a46a90f26471584043331107dc0dd; no voters: 2904b089bdb249b78950db76f4a70e9f, 3a9a63ca97694ebdb84bca730762d735
W20260709 12:14:04.757257 23416 consensus_peers.cc:597] T 9a21be1df2964860b89acefd66f6fbde P 9ba0da223cf24c97bc7d225e25015924 -> Peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Couldn't send request to peer 288a46a90f26471584043331107dc0dd. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:46159: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:04.757965 23416 consensus_peers.cc:597] T d2afee7aeea24f85b4bfecc49efcf841 P 9ba0da223cf24c97bc7d225e25015924 -> Peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Couldn't send request to peer 288a46a90f26471584043331107dc0dd. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:46159: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:04.767624 24101 consensus_queue.cc:1048] T b1a6e82689a84e36949e5efca6592772 P 3a9a63ca97694ebdb84bca730762d735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:14:04.739239 24176 raft_consensus.cc:2749] T 0646c3e87a184cd19184ff12695392a7 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:14:04.788862 23416 consensus_peers.cc:597] T 8da66c3ab79d468dbfd36407c51d423a P 9ba0da223cf24c97bc7d225e25015924 -> Peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Couldn't send request to peer 288a46a90f26471584043331107dc0dd. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:46159: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:04.735440 24059 raft_consensus.cc:515] T b1533753456b445991715da5158c921b P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:14:04.792284 24059 leader_election.cc:290] T b1533753456b445991715da5158c921b P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081), 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789)
W20260709 12:14:04.774945 23415 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:40061, user_credentials={real_user=slave}} blocked reactor thread for 109023us
W20260709 12:14:04.765617 24052 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:45789, user_credentials={real_user=slave}} blocked reactor thread for 46865.1us
W20260709 12:14:04.793646 23342 consensus_peers.cc:597] T 509296352dfa43369c2637f89e917301 P 3a9a63ca97694ebdb84bca730762d735 -> Peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Couldn't send request to peer 288a46a90f26471584043331107dc0dd. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:46159: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:04.796657 24052 leader_election.cc:304] T 859d30d8c3fb4a499256ffad6dc2d1cd P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 288a46a90f26471584043331107dc0dd; no voters: 2904b089bdb249b78950db76f4a70e9f, 9ba0da223cf24c97bc7d225e25015924
I20260709 12:14:04.821569 24059 raft_consensus.cc:493] T 2eb2c8089ce14124aed9a5d834cd0522 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:04.822362 24059 raft_consensus.cc:515] T 2eb2c8089ce14124aed9a5d834cd0522 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:14:04.872931 24059 leader_election.cc:290] T 2eb2c8089ce14124aed9a5d834cd0522 P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789), 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061)
I20260709 12:14:04.819377 23444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1533753456b445991715da5158c921b" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ba0da223cf24c97bc7d225e25015924" is_pre_election: true
I20260709 12:14:04.876752 23374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2afee7aeea24f85b4bfecc49efcf841" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3a9a63ca97694ebdb84bca730762d735" is_pre_election: true
W20260709 12:14:04.879076 23342 consensus_peers.cc:597] T 919076caf9f94cd8b631ea3e60dc3593 P 3a9a63ca97694ebdb84bca730762d735 -> Peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Couldn't send request to peer 288a46a90f26471584043331107dc0dd. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:46159: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:04.882579 23342 consensus_peers.cc:597] T a2f2a063cf2b4190826d81b2dcbf7709 P 3a9a63ca97694ebdb84bca730762d735 -> Peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Couldn't send request to peer 288a46a90f26471584043331107dc0dd. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:46159: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:04.826632 24176 raft_consensus.cc:3060] T 859d30d8c3fb4a499256ffad6dc2d1cd P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:14:04.895422 23342 consensus_peers.cc:597] T 54a02c3fbc0b4807998d018f9c2ecbc3 P 3a9a63ca97694ebdb84bca730762d735 -> Peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Couldn't send request to peer 288a46a90f26471584043331107dc0dd. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:46159: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:04.901691 23415 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:45789, user_credentials={real_user=slave}} blocked reactor thread for 81722us
I20260709 12:14:04.916378 23374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb2c8089ce14124aed9a5d834cd0522" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3a9a63ca97694ebdb84bca730762d735" is_pre_election: true
I20260709 12:14:04.929062 23442 raft_consensus.cc:1275] T 54a02c3fbc0b4807998d018f9c2ecbc3 P 9ba0da223cf24c97bc7d225e25015924 [term 3 FOLLOWER]: Refusing update from remote peer 3a9a63ca97694ebdb84bca730762d735: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:14:04.930450 24052 leader_election.cc:304] T d2afee7aeea24f85b4bfecc49efcf841 P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 288a46a90f26471584043331107dc0dd; no voters: 3a9a63ca97694ebdb84bca730762d735, 9ba0da223cf24c97bc7d225e25015924
I20260709 12:14:04.933524 24059 raft_consensus.cc:2749] T d2afee7aeea24f85b4bfecc49efcf841 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:04.941637 24017 consensus_queue.cc:1048] T 54a02c3fbc0b4807998d018f9c2ecbc3 P 3a9a63ca97694ebdb84bca730762d735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:04.972867 24056 tablet_bootstrap.cc:492] T 05b49011442c4131a4ac3c55feed5409 P 288a46a90f26471584043331107dc0dd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:05.009840 24176 raft_consensus.cc:2749] T 859d30d8c3fb4a499256ffad6dc2d1cd P 288a46a90f26471584043331107dc0dd [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:05.014290 24056 tablet_bootstrap.cc:492] T 05b49011442c4131a4ac3c55feed5409 P 288a46a90f26471584043331107dc0dd: Bootstrap complete.
I20260709 12:14:05.015584 24056 ts_tablet_manager.cc:1403] T 05b49011442c4131a4ac3c55feed5409 P 288a46a90f26471584043331107dc0dd: Time spent bootstrapping tablet: real 0.347s	user 0.019s	sys 0.004s
W20260709 12:14:05.020483 23268 consensus_peers.cc:597] T 6efb52601755488885a8baf030e7fae9 P 2904b089bdb249b78950db76f4a70e9f -> Peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Couldn't send request to peer 288a46a90f26471584043331107dc0dd. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:46159: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:05.021889 23268 consensus_peers.cc:597] T b2fd9ee7ac0c442481f7e173874a8d00 P 2904b089bdb249b78950db76f4a70e9f -> Peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Couldn't send request to peer 288a46a90f26471584043331107dc0dd. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:46159: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:05.024662 23268 consensus_peers.cc:597] T 05b49011442c4131a4ac3c55feed5409 P 2904b089bdb249b78950db76f4a70e9f -> Peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Couldn't send request to peer 288a46a90f26471584043331107dc0dd. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:46159: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:05.030195 23301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f2438f73a8e4760b7b37c5330853b72" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2904b089bdb249b78950db76f4a70e9f" is_pre_election: true
I20260709 12:14:05.031951 23301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1533753456b445991715da5158c921b" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2904b089bdb249b78950db76f4a70e9f" is_pre_election: true
I20260709 12:14:05.033277 23376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1a6e82689a84e36949e5efca6592772" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3a9a63ca97694ebdb84bca730762d735" is_pre_election: true
I20260709 12:14:05.042047 24052 leader_election.cc:304] T b1a6e82689a84e36949e5efca6592772 P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 288a46a90f26471584043331107dc0dd; no voters: 3a9a63ca97694ebdb84bca730762d735, 9ba0da223cf24c97bc7d225e25015924
I20260709 12:14:05.033684 23301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb2c8089ce14124aed9a5d834cd0522" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2904b089bdb249b78950db76f4a70e9f" is_pre_election: true
W20260709 12:14:05.036334 23268 consensus_peers.cc:597] T 45e4fb3889cc4d23bab3929c3fdd731e P 2904b089bdb249b78950db76f4a70e9f -> Peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Couldn't send request to peer 288a46a90f26471584043331107dc0dd. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:46159: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:05.049634 23268 consensus_peers.cc:597] T 87c5024fe7274811b9598e504f3963a7 P 2904b089bdb249b78950db76f4a70e9f -> Peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Couldn't send request to peer 288a46a90f26471584043331107dc0dd. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:46159: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:05.064589 24052 leader_election.cc:304] T 9f2438f73a8e4760b7b37c5330853b72 P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 288a46a90f26471584043331107dc0dd; no voters: 2904b089bdb249b78950db76f4a70e9f, 9ba0da223cf24c97bc7d225e25015924
I20260709 12:14:05.066052 24059 raft_consensus.cc:2749] T 9f2438f73a8e4760b7b37c5330853b72 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:05.064586 24176 raft_consensus.cc:3060] T b1a6e82689a84e36949e5efca6592772 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:14:05.067644 23416 consensus_peers.cc:597] T 00335dfad3394f0c9689c0df8500bc9e P 9ba0da223cf24c97bc7d225e25015924 -> Peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Couldn't send request to peer 288a46a90f26471584043331107dc0dd. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:46159: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:05.075703 24056 raft_consensus.cc:359] T 05b49011442c4131a4ac3c55feed5409 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:14:05.081288 24056 raft_consensus.cc:740] T 05b49011442c4131a4ac3c55feed5409 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 288a46a90f26471584043331107dc0dd, State: Initialized, Role: FOLLOWER
W20260709 12:14:05.088762 23416 consensus_peers.cc:597] T e3d86fc25f7146c9b1af99387a07bdec P 9ba0da223cf24c97bc7d225e25015924 -> Peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Couldn't send request to peer 288a46a90f26471584043331107dc0dd. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:46159: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:05.086815 24056 consensus_queue.cc:260] T 05b49011442c4131a4ac3c55feed5409 P 288a46a90f26471584043331107dc0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:14:05.097376 24052 leader_election.cc:304] T b1533753456b445991715da5158c921b P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 288a46a90f26471584043331107dc0dd; no voters: 2904b089bdb249b78950db76f4a70e9f, 9ba0da223cf24c97bc7d225e25015924
I20260709 12:14:05.098413 24059 raft_consensus.cc:2749] T b1533753456b445991715da5158c921b P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:14:05.099627 24056 ts_tablet_manager.cc:1434] T 05b49011442c4131a4ac3c55feed5409 P 288a46a90f26471584043331107dc0dd: Time spent starting tablet: real 0.084s	user 0.009s	sys 0.000s
I20260709 12:14:05.100782 24056 tablet_bootstrap.cc:492] T 509296352dfa43369c2637f89e917301 P 288a46a90f26471584043331107dc0dd: Bootstrap starting.
I20260709 12:14:05.102810 24052 leader_election.cc:304] T 2eb2c8089ce14124aed9a5d834cd0522 P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 288a46a90f26471584043331107dc0dd; no voters: 2904b089bdb249b78950db76f4a70e9f, 3a9a63ca97694ebdb84bca730762d735
I20260709 12:14:05.103725 24059 raft_consensus.cc:2749] T 2eb2c8089ce14124aed9a5d834cd0522 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:14:05.110828 23266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.132:46081, user_credentials={real_user=slave}} blocked reactor thread for 55174.7us
I20260709 12:14:05.124243 24176 raft_consensus.cc:2749] T b1a6e82689a84e36949e5efca6592772 P 288a46a90f26471584043331107dc0dd [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:14:05.126945 23268 consensus_peers.cc:597] T 558b91ca6fe3461da7eb4a1344ec14fc P 2904b089bdb249b78950db76f4a70e9f -> Peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Couldn't send request to peer 288a46a90f26471584043331107dc0dd. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:46159: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:05.127442 23268 consensus_peers.cc:597] T b90be1e04a3443e989951ea6bc45ed2f P 2904b089bdb249b78950db76f4a70e9f -> Peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Couldn't send request to peer 288a46a90f26471584043331107dc0dd. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:46159: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:05.134274 23267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:40061, user_credentials={real_user=slave}} blocked reactor thread for 78097.2us
I20260709 12:14:05.172103 24211 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.174.129:46159 every 8 connection(s)
I20260709 12:14:05.173290 24056 tablet_bootstrap.cc:492] T 509296352dfa43369c2637f89e917301 P 288a46a90f26471584043331107dc0dd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:05.174466 24056 tablet_bootstrap.cc:492] T 509296352dfa43369c2637f89e917301 P 288a46a90f26471584043331107dc0dd: Bootstrap complete.
I20260709 12:14:05.175204 24056 ts_tablet_manager.cc:1403] T 509296352dfa43369c2637f89e917301 P 288a46a90f26471584043331107dc0dd: Time spent bootstrapping tablet: real 0.075s	user 0.026s	sys 0.000s
I20260709 12:14:05.177726 24056 raft_consensus.cc:359] T 509296352dfa43369c2637f89e917301 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:14:05.178362 24056 raft_consensus.cc:740] T 509296352dfa43369c2637f89e917301 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 288a46a90f26471584043331107dc0dd, State: Initialized, Role: FOLLOWER
I20260709 12:14:05.179018 12986 rpc_server.cc:307] RPC server started. Bound to: 127.12.174.129:46159
I20260709 12:14:05.178995 24056 consensus_queue.cc:260] T 509296352dfa43369c2637f89e917301 P 288a46a90f26471584043331107dc0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:14:05.181202 24056 ts_tablet_manager.cc:1434] T 509296352dfa43369c2637f89e917301 P 288a46a90f26471584043331107dc0dd: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:14:05.182065 24056 tablet_bootstrap.cc:492] T 7754f065b43946f0a3aca8a75cb61273 P 288a46a90f26471584043331107dc0dd: Bootstrap starting.
I20260709 12:14:05.209405 24139 raft_consensus.cc:3060] T b1533753456b445991715da5158c921b P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:05.228945 24056 tablet_bootstrap.cc:492] T 7754f065b43946f0a3aca8a75cb61273 P 288a46a90f26471584043331107dc0dd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:05.230098 24056 tablet_bootstrap.cc:492] T 7754f065b43946f0a3aca8a75cb61273 P 288a46a90f26471584043331107dc0dd: Bootstrap complete.
I20260709 12:14:05.230887 24056 ts_tablet_manager.cc:1403] T 7754f065b43946f0a3aca8a75cb61273 P 288a46a90f26471584043331107dc0dd: Time spent bootstrapping tablet: real 0.049s	user 0.027s	sys 0.002s
I20260709 12:14:05.236058 24056 raft_consensus.cc:359] T 7754f065b43946f0a3aca8a75cb61273 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:14:05.236987 24056 raft_consensus.cc:740] T 7754f065b43946f0a3aca8a75cb61273 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 288a46a90f26471584043331107dc0dd, State: Initialized, Role: FOLLOWER
I20260709 12:14:05.237828 24056 consensus_queue.cc:260] T 7754f065b43946f0a3aca8a75cb61273 P 288a46a90f26471584043331107dc0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:14:05.239617 24056 ts_tablet_manager.cc:1434] T 7754f065b43946f0a3aca8a75cb61273 P 288a46a90f26471584043331107dc0dd: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:14:05.240602 24056 tablet_bootstrap.cc:492] T 45e4fb3889cc4d23bab3929c3fdd731e P 288a46a90f26471584043331107dc0dd: Bootstrap starting.
I20260709 12:14:05.249033 24214 heartbeater.cc:344] Connected to a master server at 127.12.174.190:35723
I20260709 12:14:05.249636 24214 heartbeater.cc:461] Registering TS with master...
I20260709 12:14:05.250782 24214 heartbeater.cc:507] Master 127.12.174.190:35723 requested a full tablet report, sending...
I20260709 12:14:05.250660 24141 raft_consensus.cc:3060] T 9f2438f73a8e4760b7b37c5330853b72 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:05.282449 24056 tablet_bootstrap.cc:492] T 45e4fb3889cc4d23bab3929c3fdd731e P 288a46a90f26471584043331107dc0dd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:05.283536 24056 tablet_bootstrap.cc:492] T 45e4fb3889cc4d23bab3929c3fdd731e P 288a46a90f26471584043331107dc0dd: Bootstrap complete.
I20260709 12:14:05.284317 24056 ts_tablet_manager.cc:1403] T 45e4fb3889cc4d23bab3929c3fdd731e P 288a46a90f26471584043331107dc0dd: Time spent bootstrapping tablet: real 0.044s	user 0.017s	sys 0.008s
I20260709 12:14:05.286819 23125 ts_manager.cc:194] Re-registered known tserver with Master: 288a46a90f26471584043331107dc0dd (127.12.174.129:46159)
I20260709 12:14:05.287174 24056 raft_consensus.cc:359] T 45e4fb3889cc4d23bab3929c3fdd731e P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:14:05.288055 24056 raft_consensus.cc:740] T 45e4fb3889cc4d23bab3929c3fdd731e P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 288a46a90f26471584043331107dc0dd, State: Initialized, Role: FOLLOWER
I20260709 12:14:05.288893 24056 consensus_queue.cc:260] T 45e4fb3889cc4d23bab3929c3fdd731e P 288a46a90f26471584043331107dc0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:14:05.291584 24056 ts_tablet_manager.cc:1434] T 45e4fb3889cc4d23bab3929c3fdd731e P 288a46a90f26471584043331107dc0dd: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:14:05.292538 24056 tablet_bootstrap.cc:492] T d34300c6c4f2447182942fb5ab8cc3c4 P 288a46a90f26471584043331107dc0dd: Bootstrap starting.
I20260709 12:14:05.308446 24056 tablet_bootstrap.cc:492] T d34300c6c4f2447182942fb5ab8cc3c4 P 288a46a90f26471584043331107dc0dd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:05.309283 24056 tablet_bootstrap.cc:492] T d34300c6c4f2447182942fb5ab8cc3c4 P 288a46a90f26471584043331107dc0dd: Bootstrap complete.
I20260709 12:14:05.310029 24056 ts_tablet_manager.cc:1403] T d34300c6c4f2447182942fb5ab8cc3c4 P 288a46a90f26471584043331107dc0dd: Time spent bootstrapping tablet: real 0.018s	user 0.012s	sys 0.003s
I20260709 12:14:05.312747 24056 raft_consensus.cc:359] T d34300c6c4f2447182942fb5ab8cc3c4 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:14:05.313611 24056 raft_consensus.cc:740] T d34300c6c4f2447182942fb5ab8cc3c4 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 288a46a90f26471584043331107dc0dd, State: Initialized, Role: FOLLOWER
I20260709 12:14:05.314465 24056 consensus_queue.cc:260] T d34300c6c4f2447182942fb5ab8cc3c4 P 288a46a90f26471584043331107dc0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:14:05.316322 24056 ts_tablet_manager.cc:1434] T d34300c6c4f2447182942fb5ab8cc3c4 P 288a46a90f26471584043331107dc0dd: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:14:05.317087 24056 tablet_bootstrap.cc:492] T ac854957ad6246c6b123638cfafeacd4 P 288a46a90f26471584043331107dc0dd: Bootstrap starting.
I20260709 12:14:05.329833 23125 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38402
I20260709 12:14:05.335515 24056 tablet_bootstrap.cc:492] T ac854957ad6246c6b123638cfafeacd4 P 288a46a90f26471584043331107dc0dd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:05.336711 24214 heartbeater.cc:499] Master 127.12.174.190:35723 was elected leader, sending a full tablet report...
I20260709 12:14:05.336767 24056 tablet_bootstrap.cc:492] T ac854957ad6246c6b123638cfafeacd4 P 288a46a90f26471584043331107dc0dd: Bootstrap complete.
I20260709 12:14:05.338145 24056 ts_tablet_manager.cc:1403] T ac854957ad6246c6b123638cfafeacd4 P 288a46a90f26471584043331107dc0dd: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.008s
I20260709 12:14:05.341179 24056 raft_consensus.cc:359] T ac854957ad6246c6b123638cfafeacd4 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:14:05.341853 24056 raft_consensus.cc:740] T ac854957ad6246c6b123638cfafeacd4 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 288a46a90f26471584043331107dc0dd, State: Initialized, Role: FOLLOWER
I20260709 12:14:05.342646 24056 consensus_queue.cc:260] T ac854957ad6246c6b123638cfafeacd4 P 288a46a90f26471584043331107dc0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:14:05.344655 24056 ts_tablet_manager.cc:1434] T ac854957ad6246c6b123638cfafeacd4 P 288a46a90f26471584043331107dc0dd: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:14:05.345440 24056 tablet_bootstrap.cc:492] T 87c5024fe7274811b9598e504f3963a7 P 288a46a90f26471584043331107dc0dd: Bootstrap starting.
I20260709 12:14:05.362447 24056 tablet_bootstrap.cc:492] T 87c5024fe7274811b9598e504f3963a7 P 288a46a90f26471584043331107dc0dd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:05.363667 24056 tablet_bootstrap.cc:492] T 87c5024fe7274811b9598e504f3963a7 P 288a46a90f26471584043331107dc0dd: Bootstrap complete.
I20260709 12:14:05.364703 24056 ts_tablet_manager.cc:1403] T 87c5024fe7274811b9598e504f3963a7 P 288a46a90f26471584043331107dc0dd: Time spent bootstrapping tablet: real 0.019s	user 0.016s	sys 0.000s
I20260709 12:14:05.367977 24056 raft_consensus.cc:359] T 87c5024fe7274811b9598e504f3963a7 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:14:05.368974 24056 raft_consensus.cc:740] T 87c5024fe7274811b9598e504f3963a7 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 288a46a90f26471584043331107dc0dd, State: Initialized, Role: FOLLOWER
I20260709 12:14:05.369728 24056 consensus_queue.cc:260] T 87c5024fe7274811b9598e504f3963a7 P 288a46a90f26471584043331107dc0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:14:05.372047 24056 ts_tablet_manager.cc:1434] T 87c5024fe7274811b9598e504f3963a7 P 288a46a90f26471584043331107dc0dd: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:14:05.372963 24056 tablet_bootstrap.cc:492] T 8771e0b5070c49c589f276c793f87727 P 288a46a90f26471584043331107dc0dd: Bootstrap starting.
I20260709 12:14:05.378698 24141 raft_consensus.cc:3060] T 45e4fb3889cc4d23bab3929c3fdd731e P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:05.391253 24056 tablet_bootstrap.cc:492] T 8771e0b5070c49c589f276c793f87727 P 288a46a90f26471584043331107dc0dd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:05.392328 24056 tablet_bootstrap.cc:492] T 8771e0b5070c49c589f276c793f87727 P 288a46a90f26471584043331107dc0dd: Bootstrap complete.
I20260709 12:14:05.393090 24056 ts_tablet_manager.cc:1403] T 8771e0b5070c49c589f276c793f87727 P 288a46a90f26471584043331107dc0dd: Time spent bootstrapping tablet: real 0.020s	user 0.016s	sys 0.001s
I20260709 12:14:05.395987 24056 raft_consensus.cc:359] T 8771e0b5070c49c589f276c793f87727 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:14:05.397985 24056 raft_consensus.cc:740] T 8771e0b5070c49c589f276c793f87727 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 288a46a90f26471584043331107dc0dd, State: Initialized, Role: FOLLOWER
I20260709 12:14:05.398694 24056 consensus_queue.cc:260] T 8771e0b5070c49c589f276c793f87727 P 288a46a90f26471584043331107dc0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:14:05.401031 24056 ts_tablet_manager.cc:1434] T 8771e0b5070c49c589f276c793f87727 P 288a46a90f26471584043331107dc0dd: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 12:14:05.402068 24056 tablet_bootstrap.cc:492] T ec2c01c273894e73b6a2ab39e0132286 P 288a46a90f26471584043331107dc0dd: Bootstrap starting.
I20260709 12:14:05.429803 24056 tablet_bootstrap.cc:492] T ec2c01c273894e73b6a2ab39e0132286 P 288a46a90f26471584043331107dc0dd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:05.430878 24056 tablet_bootstrap.cc:492] T ec2c01c273894e73b6a2ab39e0132286 P 288a46a90f26471584043331107dc0dd: Bootstrap complete.
I20260709 12:14:05.431635 24056 ts_tablet_manager.cc:1403] T ec2c01c273894e73b6a2ab39e0132286 P 288a46a90f26471584043331107dc0dd: Time spent bootstrapping tablet: real 0.030s	user 0.014s	sys 0.012s
I20260709 12:14:05.434543 24056 raft_consensus.cc:359] T ec2c01c273894e73b6a2ab39e0132286 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:14:05.435366 24056 raft_consensus.cc:740] T ec2c01c273894e73b6a2ab39e0132286 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 288a46a90f26471584043331107dc0dd, State: Initialized, Role: FOLLOWER
I20260709 12:14:05.436106 24056 consensus_queue.cc:260] T ec2c01c273894e73b6a2ab39e0132286 P 288a46a90f26471584043331107dc0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:14:05.438411 24056 ts_tablet_manager.cc:1434] T ec2c01c273894e73b6a2ab39e0132286 P 288a46a90f26471584043331107dc0dd: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:14:05.439347 24056 tablet_bootstrap.cc:492] T 54a02c3fbc0b4807998d018f9c2ecbc3 P 288a46a90f26471584043331107dc0dd: Bootstrap starting.
I20260709 12:14:05.456873 24056 tablet_bootstrap.cc:492] T 54a02c3fbc0b4807998d018f9c2ecbc3 P 288a46a90f26471584043331107dc0dd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 12:14:05.458004 24056 tablet_bootstrap.cc:492] T 54a02c3fbc0b4807998d018f9c2ecbc3 P 288a46a90f26471584043331107dc0dd: Bootstrap complete.
I20260709 12:14:05.458707 24056 ts_tablet_manager.cc:1403] T 54a02c3fbc0b4807998d018f9c2ecbc3 P 288a46a90f26471584043331107dc0dd: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.007s
I20260709 12:14:05.460943 24056 raft_consensus.cc:359] T 54a02c3fbc0b4807998d018f9c2ecbc3 P 288a46a90f26471584043331107dc0dd [term 2 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:14:05.461726 24056 raft_consensus.cc:740] T 54a02c3fbc0b4807998d018f9c2ecbc3 P 288a46a90f26471584043331107dc0dd [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 288a46a90f26471584043331107dc0dd, State: Initialized, Role: FOLLOWER
I20260709 12:14:05.462453 24056 consensus_queue.cc:260] T 54a02c3fbc0b4807998d018f9c2ecbc3 P 288a46a90f26471584043331107dc0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:14:05.464118 24056 ts_tablet_manager.cc:1434] T 54a02c3fbc0b4807998d018f9c2ecbc3 P 288a46a90f26471584043331107dc0dd: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.001s
I20260709 12:14:05.464920 24056 tablet_bootstrap.cc:492] T 9a21be1df2964860b89acefd66f6fbde P 288a46a90f26471584043331107dc0dd: Bootstrap starting.
I20260709 12:14:05.479547 24056 tablet_bootstrap.cc:492] T 9a21be1df2964860b89acefd66f6fbde P 288a46a90f26471584043331107dc0dd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:05.480427 24056 tablet_bootstrap.cc:492] T 9a21be1df2964860b89acefd66f6fbde P 288a46a90f26471584043331107dc0dd: Bootstrap complete.
I20260709 12:14:05.481112 24056 ts_tablet_manager.cc:1403] T 9a21be1df2964860b89acefd66f6fbde P 288a46a90f26471584043331107dc0dd: Time spent bootstrapping tablet: real 0.016s	user 0.013s	sys 0.000s
I20260709 12:14:05.483335 24056 raft_consensus.cc:359] T 9a21be1df2964860b89acefd66f6fbde P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:14:05.483891 24056 raft_consensus.cc:740] T 9a21be1df2964860b89acefd66f6fbde P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 288a46a90f26471584043331107dc0dd, State: Initialized, Role: FOLLOWER
I20260709 12:14:05.484516 24056 consensus_queue.cc:260] T 9a21be1df2964860b89acefd66f6fbde P 288a46a90f26471584043331107dc0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:14:05.486605 24056 ts_tablet_manager.cc:1434] T 9a21be1df2964860b89acefd66f6fbde P 288a46a90f26471584043331107dc0dd: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 12:14:05.487711 24056 tablet_bootstrap.cc:492] T 8da66c3ab79d468dbfd36407c51d423a P 288a46a90f26471584043331107dc0dd: Bootstrap starting.
I20260709 12:14:05.528860 24138 raft_consensus.cc:3060] T 7754f065b43946f0a3aca8a75cb61273 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:05.532543 24056 tablet_bootstrap.cc:492] T 8da66c3ab79d468dbfd36407c51d423a P 288a46a90f26471584043331107dc0dd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:05.533854 24056 tablet_bootstrap.cc:492] T 8da66c3ab79d468dbfd36407c51d423a P 288a46a90f26471584043331107dc0dd: Bootstrap complete.
I20260709 12:14:05.534896 24056 ts_tablet_manager.cc:1403] T 8da66c3ab79d468dbfd36407c51d423a P 288a46a90f26471584043331107dc0dd: Time spent bootstrapping tablet: real 0.047s	user 0.022s	sys 0.023s
I20260709 12:14:05.538514 24056 raft_consensus.cc:359] T 8da66c3ab79d468dbfd36407c51d423a P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:14:05.539412 24056 raft_consensus.cc:740] T 8da66c3ab79d468dbfd36407c51d423a P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 288a46a90f26471584043331107dc0dd, State: Initialized, Role: FOLLOWER
I20260709 12:14:05.540426 24056 consensus_queue.cc:260] T 8da66c3ab79d468dbfd36407c51d423a P 288a46a90f26471584043331107dc0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:14:05.542685 24141 raft_consensus.cc:3060] T 9a21be1df2964860b89acefd66f6fbde P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:05.543041 24056 ts_tablet_manager.cc:1434] T 8da66c3ab79d468dbfd36407c51d423a P 288a46a90f26471584043331107dc0dd: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:14:05.544173 24056 tablet_bootstrap.cc:492] T b90be1e04a3443e989951ea6bc45ed2f P 288a46a90f26471584043331107dc0dd: Bootstrap starting.
I20260709 12:14:05.550338 24183 raft_consensus.cc:493] T 859d30d8c3fb4a499256ffad6dc2d1cd P 9ba0da223cf24c97bc7d225e25015924 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:05.551079 24183 raft_consensus.cc:515] T 859d30d8c3fb4a499256ffad6dc2d1cd P 9ba0da223cf24c97bc7d225e25015924 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:14:05.555817 23301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859d30d8c3fb4a499256ffad6dc2d1cd" candidate_uuid: "9ba0da223cf24c97bc7d225e25015924" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2904b089bdb249b78950db76f4a70e9f" is_pre_election: true
I20260709 12:14:05.556569 23301 raft_consensus.cc:2468] T 859d30d8c3fb4a499256ffad6dc2d1cd P 2904b089bdb249b78950db76f4a70e9f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ba0da223cf24c97bc7d225e25015924 in term 2.
I20260709 12:14:05.558138 23415 leader_election.cc:304] T 859d30d8c3fb4a499256ffad6dc2d1cd P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2904b089bdb249b78950db76f4a70e9f, 9ba0da223cf24c97bc7d225e25015924; no voters: 
I20260709 12:14:05.559010 24037 raft_consensus.cc:2804] T 859d30d8c3fb4a499256ffad6dc2d1cd P 9ba0da223cf24c97bc7d225e25015924 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:05.559394 24037 raft_consensus.cc:493] T 859d30d8c3fb4a499256ffad6dc2d1cd P 9ba0da223cf24c97bc7d225e25015924 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:05.559461 24183 leader_election.cc:290] T 859d30d8c3fb4a499256ffad6dc2d1cd P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 288a46a90f26471584043331107dc0dd (127.12.174.129:46159), 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789)
I20260709 12:14:05.559808 24037 raft_consensus.cc:3060] T 859d30d8c3fb4a499256ffad6dc2d1cd P 9ba0da223cf24c97bc7d225e25015924 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:05.616070 24139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859d30d8c3fb4a499256ffad6dc2d1cd" candidate_uuid: "9ba0da223cf24c97bc7d225e25015924" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "288a46a90f26471584043331107dc0dd" is_pre_election: true
I20260709 12:14:05.645236 24056 tablet_bootstrap.cc:492] T b90be1e04a3443e989951ea6bc45ed2f P 288a46a90f26471584043331107dc0dd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:05.646519 24056 tablet_bootstrap.cc:492] T b90be1e04a3443e989951ea6bc45ed2f P 288a46a90f26471584043331107dc0dd: Bootstrap complete.
I20260709 12:14:05.647262 24056 ts_tablet_manager.cc:1403] T b90be1e04a3443e989951ea6bc45ed2f P 288a46a90f26471584043331107dc0dd: Time spent bootstrapping tablet: real 0.103s	user 0.024s	sys 0.051s
I20260709 12:14:05.650535 24056 raft_consensus.cc:359] T b90be1e04a3443e989951ea6bc45ed2f P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:14:05.651302 24056 raft_consensus.cc:740] T b90be1e04a3443e989951ea6bc45ed2f P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 288a46a90f26471584043331107dc0dd, State: Initialized, Role: FOLLOWER
I20260709 12:14:05.653118 24139 raft_consensus.cc:2468] T 859d30d8c3fb4a499256ffad6dc2d1cd P 288a46a90f26471584043331107dc0dd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ba0da223cf24c97bc7d225e25015924 in term 2.
I20260709 12:14:05.652196 24056 consensus_queue.cc:260] T b90be1e04a3443e989951ea6bc45ed2f P 288a46a90f26471584043331107dc0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:14:05.664348 24056 ts_tablet_manager.cc:1434] T b90be1e04a3443e989951ea6bc45ed2f P 288a46a90f26471584043331107dc0dd: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 12:14:05.665309 24056 tablet_bootstrap.cc:492] T 8bed7e0b2b804500b4898a175fba3ebe P 288a46a90f26471584043331107dc0dd: Bootstrap starting.
I20260709 12:14:05.665640 24037 raft_consensus.cc:515] T 859d30d8c3fb4a499256ffad6dc2d1cd P 9ba0da223cf24c97bc7d225e25015924 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:14:05.672523 24139 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859d30d8c3fb4a499256ffad6dc2d1cd" candidate_uuid: "9ba0da223cf24c97bc7d225e25015924" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "288a46a90f26471584043331107dc0dd"
I20260709 12:14:05.673234 24139 raft_consensus.cc:3060] T 859d30d8c3fb4a499256ffad6dc2d1cd P 288a46a90f26471584043331107dc0dd [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:14:05.694316 23341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:45789, user_credentials={real_user=slave}} blocked reactor thread for 66613.6us
I20260709 12:14:05.698325 24141 raft_consensus.cc:3060] T 8771e0b5070c49c589f276c793f87727 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:05.701108 24056 tablet_bootstrap.cc:492] T 8bed7e0b2b804500b4898a175fba3ebe P 288a46a90f26471584043331107dc0dd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:05.694509 24139 raft_consensus.cc:2468] T 859d30d8c3fb4a499256ffad6dc2d1cd P 288a46a90f26471584043331107dc0dd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ba0da223cf24c97bc7d225e25015924 in term 3.
I20260709 12:14:05.704249 24056 tablet_bootstrap.cc:492] T 8bed7e0b2b804500b4898a175fba3ebe P 288a46a90f26471584043331107dc0dd: Bootstrap complete.
I20260709 12:14:05.705113 24056 ts_tablet_manager.cc:1403] T 8bed7e0b2b804500b4898a175fba3ebe P 288a46a90f26471584043331107dc0dd: Time spent bootstrapping tablet: real 0.040s	user 0.016s	sys 0.003s
I20260709 12:14:05.705245 23416 leader_election.cc:304] T 859d30d8c3fb4a499256ffad6dc2d1cd P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 288a46a90f26471584043331107dc0dd, 9ba0da223cf24c97bc7d225e25015924; no voters: 
I20260709 12:14:05.707710 23301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859d30d8c3fb4a499256ffad6dc2d1cd" candidate_uuid: "9ba0da223cf24c97bc7d225e25015924" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2904b089bdb249b78950db76f4a70e9f"
I20260709 12:14:05.708532 23301 raft_consensus.cc:3060] T 859d30d8c3fb4a499256ffad6dc2d1cd P 2904b089bdb249b78950db76f4a70e9f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:05.709781 24183 raft_consensus.cc:2804] T 859d30d8c3fb4a499256ffad6dc2d1cd P 9ba0da223cf24c97bc7d225e25015924 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:05.713160 24183 raft_consensus.cc:697] T 859d30d8c3fb4a499256ffad6dc2d1cd P 9ba0da223cf24c97bc7d225e25015924 [term 3 LEADER]: Becoming Leader. State: Replica: 9ba0da223cf24c97bc7d225e25015924, State: Running, Role: LEADER
I20260709 12:14:05.714229 24183 consensus_queue.cc:237] T 859d30d8c3fb4a499256ffad6dc2d1cd P 9ba0da223cf24c97bc7d225e25015924 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:14:05.705230 24037 leader_election.cc:290] T 859d30d8c3fb4a499256ffad6dc2d1cd P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 3 election: Requested vote from peers 288a46a90f26471584043331107dc0dd (127.12.174.129:46159), 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789)
I20260709 12:14:05.730422 24056 raft_consensus.cc:359] T 8bed7e0b2b804500b4898a175fba3ebe P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:14:05.731349 24056 raft_consensus.cc:740] T 8bed7e0b2b804500b4898a175fba3ebe P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 288a46a90f26471584043331107dc0dd, State: Initialized, Role: FOLLOWER
I20260709 12:14:05.732331 24056 consensus_queue.cc:260] T 8bed7e0b2b804500b4898a175fba3ebe P 288a46a90f26471584043331107dc0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:14:05.746433 24056 ts_tablet_manager.cc:1434] T 8bed7e0b2b804500b4898a175fba3ebe P 288a46a90f26471584043331107dc0dd: Time spent starting tablet: real 0.041s	user 0.006s	sys 0.003s
I20260709 12:14:05.749262 24056 tablet_bootstrap.cc:492] T b2fd9ee7ac0c442481f7e173874a8d00 P 288a46a90f26471584043331107dc0dd: Bootstrap starting.
W20260709 12:14:05.843345 23267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:40061, user_credentials={real_user=slave}} blocked reactor thread for 45960.6us
I20260709 12:14:05.882141 23301 raft_consensus.cc:2468] T 859d30d8c3fb4a499256ffad6dc2d1cd P 2904b089bdb249b78950db76f4a70e9f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ba0da223cf24c97bc7d225e25015924 in term 3.
I20260709 12:14:05.876993 23124 catalog_manager.cc:5697] T 859d30d8c3fb4a499256ffad6dc2d1cd P 9ba0da223cf24c97bc7d225e25015924 reported cstate change: term changed from 1 to 3, leader changed from 288a46a90f26471584043331107dc0dd (127.12.174.129) to 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132). New cstate: current_term: 3 leader_uuid: "9ba0da223cf24c97bc7d225e25015924" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } health_report { overall_health: UNKNOWN } } }
W20260709 12:14:05.897466 23415 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:40061, user_credentials={real_user=slave}} blocked reactor thread for 57808.8us
I20260709 12:14:05.922559 24138 raft_consensus.cc:3060] T ac854957ad6246c6b123638cfafeacd4 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:05.976917 24139 raft_consensus.cc:3060] T 54a02c3fbc0b4807998d018f9c2ecbc3 P 288a46a90f26471584043331107dc0dd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:05.995316 24135 raft_consensus.cc:3060] T 8bed7e0b2b804500b4898a175fba3ebe P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:06.037583 24056 tablet_bootstrap.cc:492] T b2fd9ee7ac0c442481f7e173874a8d00 P 288a46a90f26471584043331107dc0dd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:06.040702 24056 tablet_bootstrap.cc:492] T b2fd9ee7ac0c442481f7e173874a8d00 P 288a46a90f26471584043331107dc0dd: Bootstrap complete.
I20260709 12:14:06.041523 24056 ts_tablet_manager.cc:1403] T b2fd9ee7ac0c442481f7e173874a8d00 P 288a46a90f26471584043331107dc0dd: Time spent bootstrapping tablet: real 0.293s	user 0.017s	sys 0.007s
I20260709 12:14:06.056010 24056 raft_consensus.cc:359] T b2fd9ee7ac0c442481f7e173874a8d00 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:14:06.056787 24056 raft_consensus.cc:740] T b2fd9ee7ac0c442481f7e173874a8d00 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 288a46a90f26471584043331107dc0dd, State: Initialized, Role: FOLLOWER
I20260709 12:14:06.057533 24056 consensus_queue.cc:260] T b2fd9ee7ac0c442481f7e173874a8d00 P 288a46a90f26471584043331107dc0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:14:06.060032 24056 ts_tablet_manager.cc:1434] T b2fd9ee7ac0c442481f7e173874a8d00 P 288a46a90f26471584043331107dc0dd: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 12:14:06.063567 24056 tablet_bootstrap.cc:492] T 919076caf9f94cd8b631ea3e60dc3593 P 288a46a90f26471584043331107dc0dd: Bootstrap starting.
I20260709 12:14:06.096058 24056 tablet_bootstrap.cc:492] T 919076caf9f94cd8b631ea3e60dc3593 P 288a46a90f26471584043331107dc0dd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:06.097177 24056 tablet_bootstrap.cc:492] T 919076caf9f94cd8b631ea3e60dc3593 P 288a46a90f26471584043331107dc0dd: Bootstrap complete.
I20260709 12:14:06.098081 24056 ts_tablet_manager.cc:1403] T 919076caf9f94cd8b631ea3e60dc3593 P 288a46a90f26471584043331107dc0dd: Time spent bootstrapping tablet: real 0.035s	user 0.020s	sys 0.004s
I20260709 12:14:06.100183 24056 raft_consensus.cc:359] T 919076caf9f94cd8b631ea3e60dc3593 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:14:06.100744 24056 raft_consensus.cc:740] T 919076caf9f94cd8b631ea3e60dc3593 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 288a46a90f26471584043331107dc0dd, State: Initialized, Role: FOLLOWER
I20260709 12:14:06.101317 24056 consensus_queue.cc:260] T 919076caf9f94cd8b631ea3e60dc3593 P 288a46a90f26471584043331107dc0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:14:06.103286 24056 ts_tablet_manager.cc:1434] T 919076caf9f94cd8b631ea3e60dc3593 P 288a46a90f26471584043331107dc0dd: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:14:06.104189 24056 tablet_bootstrap.cc:492] T 0f7747f7dcab4d6da9caf82c35717552 P 288a46a90f26471584043331107dc0dd: Bootstrap starting.
I20260709 12:14:06.120227 24056 tablet_bootstrap.cc:492] T 0f7747f7dcab4d6da9caf82c35717552 P 288a46a90f26471584043331107dc0dd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:06.121125 24056 tablet_bootstrap.cc:492] T 0f7747f7dcab4d6da9caf82c35717552 P 288a46a90f26471584043331107dc0dd: Bootstrap complete.
I20260709 12:14:06.121826 24056 ts_tablet_manager.cc:1403] T 0f7747f7dcab4d6da9caf82c35717552 P 288a46a90f26471584043331107dc0dd: Time spent bootstrapping tablet: real 0.018s	user 0.017s	sys 0.000s
I20260709 12:14:06.124349 24056 raft_consensus.cc:359] T 0f7747f7dcab4d6da9caf82c35717552 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:14:06.125074 24056 raft_consensus.cc:740] T 0f7747f7dcab4d6da9caf82c35717552 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 288a46a90f26471584043331107dc0dd, State: Initialized, Role: FOLLOWER
I20260709 12:14:06.125725 24056 consensus_queue.cc:260] T 0f7747f7dcab4d6da9caf82c35717552 P 288a46a90f26471584043331107dc0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:14:06.127766 24056 ts_tablet_manager.cc:1434] T 0f7747f7dcab4d6da9caf82c35717552 P 288a46a90f26471584043331107dc0dd: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:14:06.129495 24056 tablet_bootstrap.cc:492] T 6efb52601755488885a8baf030e7fae9 P 288a46a90f26471584043331107dc0dd: Bootstrap starting.
I20260709 12:14:06.150040 24056 tablet_bootstrap.cc:492] T 6efb52601755488885a8baf030e7fae9 P 288a46a90f26471584043331107dc0dd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:06.151026 24056 tablet_bootstrap.cc:492] T 6efb52601755488885a8baf030e7fae9 P 288a46a90f26471584043331107dc0dd: Bootstrap complete.
I20260709 12:14:06.152388 24056 ts_tablet_manager.cc:1403] T 6efb52601755488885a8baf030e7fae9 P 288a46a90f26471584043331107dc0dd: Time spent bootstrapping tablet: real 0.023s	user 0.016s	sys 0.001s
I20260709 12:14:06.155423 24056 raft_consensus.cc:359] T 6efb52601755488885a8baf030e7fae9 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:14:06.156185 24056 raft_consensus.cc:740] T 6efb52601755488885a8baf030e7fae9 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 288a46a90f26471584043331107dc0dd, State: Initialized, Role: FOLLOWER
I20260709 12:14:06.156908 24056 consensus_queue.cc:260] T 6efb52601755488885a8baf030e7fae9 P 288a46a90f26471584043331107dc0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:14:06.158201 23301 raft_consensus.cc:1275] T 859d30d8c3fb4a499256ffad6dc2d1cd P 2904b089bdb249b78950db76f4a70e9f [term 3 FOLLOWER]: Refusing update from remote peer 9ba0da223cf24c97bc7d225e25015924: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:14:06.159652 24056 ts_tablet_manager.cc:1434] T 6efb52601755488885a8baf030e7fae9 P 288a46a90f26471584043331107dc0dd: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:14:06.159957 24097 consensus_queue.cc:1048] T 859d30d8c3fb4a499256ffad6dc2d1cd P 9ba0da223cf24c97bc7d225e25015924 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:06.161123 24056 tablet_bootstrap.cc:492] T 6d7d1c502ee24072a41a2a55cfc3a5fa P 288a46a90f26471584043331107dc0dd: Bootstrap starting.
I20260709 12:14:06.195250 24056 tablet_bootstrap.cc:492] T 6d7d1c502ee24072a41a2a55cfc3a5fa P 288a46a90f26471584043331107dc0dd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:06.201795 24056 tablet_bootstrap.cc:492] T 6d7d1c502ee24072a41a2a55cfc3a5fa P 288a46a90f26471584043331107dc0dd: Bootstrap complete.
I20260709 12:14:06.202693 24056 ts_tablet_manager.cc:1403] T 6d7d1c502ee24072a41a2a55cfc3a5fa P 288a46a90f26471584043331107dc0dd: Time spent bootstrapping tablet: real 0.042s	user 0.026s	sys 0.003s
I20260709 12:14:06.205894 24056 raft_consensus.cc:359] T 6d7d1c502ee24072a41a2a55cfc3a5fa P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:14:06.206722 24056 raft_consensus.cc:740] T 6d7d1c502ee24072a41a2a55cfc3a5fa P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 288a46a90f26471584043331107dc0dd, State: Initialized, Role: FOLLOWER
I20260709 12:14:06.207465 24056 consensus_queue.cc:260] T 6d7d1c502ee24072a41a2a55cfc3a5fa P 288a46a90f26471584043331107dc0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:14:06.209959 24056 ts_tablet_manager.cc:1434] T 6d7d1c502ee24072a41a2a55cfc3a5fa P 288a46a90f26471584043331107dc0dd: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:14:06.212414 24135 raft_consensus.cc:1275] T 859d30d8c3fb4a499256ffad6dc2d1cd P 288a46a90f26471584043331107dc0dd [term 3 FOLLOWER]: Refusing update from remote peer 9ba0da223cf24c97bc7d225e25015924: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:14:06.213006 24056 tablet_bootstrap.cc:492] T c3ac99f9dbb24693b97d3994ceb65955 P 288a46a90f26471584043331107dc0dd: Bootstrap starting.
I20260709 12:14:06.222483 24238 consensus_queue.cc:1048] T 859d30d8c3fb4a499256ffad6dc2d1cd P 9ba0da223cf24c97bc7d225e25015924 [LEADER]: Connected to new peer: Peer: permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:14:06.243464 24056 tablet_bootstrap.cc:492] T c3ac99f9dbb24693b97d3994ceb65955 P 288a46a90f26471584043331107dc0dd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:06.244503 24056 tablet_bootstrap.cc:492] T c3ac99f9dbb24693b97d3994ceb65955 P 288a46a90f26471584043331107dc0dd: Bootstrap complete.
I20260709 12:14:06.245287 24056 ts_tablet_manager.cc:1403] T c3ac99f9dbb24693b97d3994ceb65955 P 288a46a90f26471584043331107dc0dd: Time spent bootstrapping tablet: real 0.033s	user 0.014s	sys 0.007s
I20260709 12:14:06.248211 24056 raft_consensus.cc:359] T c3ac99f9dbb24693b97d3994ceb65955 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:14:06.248957 24056 raft_consensus.cc:740] T c3ac99f9dbb24693b97d3994ceb65955 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 288a46a90f26471584043331107dc0dd, State: Initialized, Role: FOLLOWER
I20260709 12:14:06.249810 24056 consensus_queue.cc:260] T c3ac99f9dbb24693b97d3994ceb65955 P 288a46a90f26471584043331107dc0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:14:06.252142 24056 ts_tablet_manager.cc:1434] T c3ac99f9dbb24693b97d3994ceb65955 P 288a46a90f26471584043331107dc0dd: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.003s
I20260709 12:14:06.253077 24056 tablet_bootstrap.cc:492] T 509f7e554df04f83aeffd51ec07607d5 P 288a46a90f26471584043331107dc0dd: Bootstrap starting.
I20260709 12:14:06.275169 24056 tablet_bootstrap.cc:492] T 509f7e554df04f83aeffd51ec07607d5 P 288a46a90f26471584043331107dc0dd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:06.276225 24056 tablet_bootstrap.cc:492] T 509f7e554df04f83aeffd51ec07607d5 P 288a46a90f26471584043331107dc0dd: Bootstrap complete.
I20260709 12:14:06.276942 24056 ts_tablet_manager.cc:1403] T 509f7e554df04f83aeffd51ec07607d5 P 288a46a90f26471584043331107dc0dd: Time spent bootstrapping tablet: real 0.024s	user 0.016s	sys 0.004s
I20260709 12:14:06.280956 24056 raft_consensus.cc:359] T 509f7e554df04f83aeffd51ec07607d5 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:14:06.281790 24056 raft_consensus.cc:740] T 509f7e554df04f83aeffd51ec07607d5 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 288a46a90f26471584043331107dc0dd, State: Initialized, Role: FOLLOWER
I20260709 12:14:06.282642 24056 consensus_queue.cc:260] T 509f7e554df04f83aeffd51ec07607d5 P 288a46a90f26471584043331107dc0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:14:06.284536 24056 ts_tablet_manager.cc:1434] T 509f7e554df04f83aeffd51ec07607d5 P 288a46a90f26471584043331107dc0dd: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:14:06.285382 24056 tablet_bootstrap.cc:492] T 92d63c0c6ef9452797da238708c39275 P 288a46a90f26471584043331107dc0dd: Bootstrap starting.
W20260709 12:14:06.285627 23342 consensus_peers.cc:597] T e0352fa4cf674ba8b7d1a0239bcf76e8 P 3a9a63ca97694ebdb84bca730762d735 -> Peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Couldn't send request to peer 288a46a90f26471584043331107dc0dd. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:06.303306 24056 tablet_bootstrap.cc:492] T 92d63c0c6ef9452797da238708c39275 P 288a46a90f26471584043331107dc0dd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:06.304204 24056 tablet_bootstrap.cc:492] T 92d63c0c6ef9452797da238708c39275 P 288a46a90f26471584043331107dc0dd: Bootstrap complete.
I20260709 12:14:06.304890 24056 ts_tablet_manager.cc:1403] T 92d63c0c6ef9452797da238708c39275 P 288a46a90f26471584043331107dc0dd: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.003s
I20260709 12:14:06.307368 24056 raft_consensus.cc:359] T 92d63c0c6ef9452797da238708c39275 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:14:06.307920 24056 raft_consensus.cc:740] T 92d63c0c6ef9452797da238708c39275 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 288a46a90f26471584043331107dc0dd, State: Initialized, Role: FOLLOWER
I20260709 12:14:06.308521 24056 consensus_queue.cc:260] T 92d63c0c6ef9452797da238708c39275 P 288a46a90f26471584043331107dc0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:14:06.309873 24056 ts_tablet_manager.cc:1434] T 92d63c0c6ef9452797da238708c39275 P 288a46a90f26471584043331107dc0dd: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 12:14:06.310719 24056 tablet_bootstrap.cc:492] T 5959fc0b70884d699725fb8d560e5de5 P 288a46a90f26471584043331107dc0dd: Bootstrap starting.
I20260709 12:14:06.335042 24056 tablet_bootstrap.cc:492] T 5959fc0b70884d699725fb8d560e5de5 P 288a46a90f26471584043331107dc0dd: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=1 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:06.336110 24056 tablet_bootstrap.cc:492] T 5959fc0b70884d699725fb8d560e5de5 P 288a46a90f26471584043331107dc0dd: Bootstrap complete.
I20260709 12:14:06.336805 24056 ts_tablet_manager.cc:1403] T 5959fc0b70884d699725fb8d560e5de5 P 288a46a90f26471584043331107dc0dd: Time spent bootstrapping tablet: real 0.026s	user 0.018s	sys 0.004s
I20260709 12:14:06.339079 24056 raft_consensus.cc:359] T 5959fc0b70884d699725fb8d560e5de5 P 288a46a90f26471584043331107dc0dd [term 3 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:14:06.339793 24056 raft_consensus.cc:740] T 5959fc0b70884d699725fb8d560e5de5 P 288a46a90f26471584043331107dc0dd [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: 288a46a90f26471584043331107dc0dd, State: Initialized, Role: FOLLOWER
I20260709 12:14:06.340541 24056 consensus_queue.cc:260] T 5959fc0b70884d699725fb8d560e5de5 P 288a46a90f26471584043331107dc0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:14:06.342993 24056 ts_tablet_manager.cc:1434] T 5959fc0b70884d699725fb8d560e5de5 P 288a46a90f26471584043331107dc0dd: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:14:06.344426 24056 tablet_bootstrap.cc:492] T a2f2a063cf2b4190826d81b2dcbf7709 P 288a46a90f26471584043331107dc0dd: Bootstrap starting.
W20260709 12:14:06.357910 23342 consensus_peers.cc:597] T 96f1bc9b220f49d5845c08249cb6a44f P 3a9a63ca97694ebdb84bca730762d735 -> Peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Couldn't send request to peer 288a46a90f26471584043331107dc0dd. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:14:06.360553 24056 tablet_bootstrap.cc:492] T a2f2a063cf2b4190826d81b2dcbf7709 P 288a46a90f26471584043331107dc0dd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:06.361789 24056 tablet_bootstrap.cc:492] T a2f2a063cf2b4190826d81b2dcbf7709 P 288a46a90f26471584043331107dc0dd: Bootstrap complete.
I20260709 12:14:06.362536 24056 ts_tablet_manager.cc:1403] T a2f2a063cf2b4190826d81b2dcbf7709 P 288a46a90f26471584043331107dc0dd: Time spent bootstrapping tablet: real 0.018s	user 0.017s	sys 0.000s
I20260709 12:14:06.364723 24056 raft_consensus.cc:359] T a2f2a063cf2b4190826d81b2dcbf7709 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:14:06.365268 24056 raft_consensus.cc:740] T a2f2a063cf2b4190826d81b2dcbf7709 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 288a46a90f26471584043331107dc0dd, State: Initialized, Role: FOLLOWER
I20260709 12:14:06.365972 24056 consensus_queue.cc:260] T a2f2a063cf2b4190826d81b2dcbf7709 P 288a46a90f26471584043331107dc0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:14:06.368129 24056 ts_tablet_manager.cc:1434] T a2f2a063cf2b4190826d81b2dcbf7709 P 288a46a90f26471584043331107dc0dd: Time spent starting tablet: real 0.005s	user 0.001s	sys 0.003s
I20260709 12:14:06.369447 24056 tablet_bootstrap.cc:492] T 96f1bc9b220f49d5845c08249cb6a44f P 288a46a90f26471584043331107dc0dd: Bootstrap starting.
I20260709 12:14:06.385694 24056 tablet_bootstrap.cc:492] T 96f1bc9b220f49d5845c08249cb6a44f P 288a46a90f26471584043331107dc0dd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:06.389585 24056 tablet_bootstrap.cc:492] T 96f1bc9b220f49d5845c08249cb6a44f P 288a46a90f26471584043331107dc0dd: Bootstrap complete.
I20260709 12:14:06.390444 24056 ts_tablet_manager.cc:1403] T 96f1bc9b220f49d5845c08249cb6a44f P 288a46a90f26471584043331107dc0dd: Time spent bootstrapping tablet: real 0.021s	user 0.017s	sys 0.000s
I20260709 12:14:06.393103 24056 raft_consensus.cc:359] T 96f1bc9b220f49d5845c08249cb6a44f P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:14:06.394652 24056 raft_consensus.cc:740] T 96f1bc9b220f49d5845c08249cb6a44f P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 288a46a90f26471584043331107dc0dd, State: Initialized, Role: FOLLOWER
I20260709 12:14:06.395360 24056 consensus_queue.cc:260] T 96f1bc9b220f49d5845c08249cb6a44f P 288a46a90f26471584043331107dc0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:14:06.397846 24056 ts_tablet_manager.cc:1434] T 96f1bc9b220f49d5845c08249cb6a44f P 288a46a90f26471584043331107dc0dd: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 12:14:06.399814 24056 tablet_bootstrap.cc:492] T bed12810020c4496969b723bcdd4b4ec P 288a46a90f26471584043331107dc0dd: Bootstrap starting.
I20260709 12:14:06.415560 24056 tablet_bootstrap.cc:492] T bed12810020c4496969b723bcdd4b4ec P 288a46a90f26471584043331107dc0dd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:06.416564 24056 tablet_bootstrap.cc:492] T bed12810020c4496969b723bcdd4b4ec P 288a46a90f26471584043331107dc0dd: Bootstrap complete.
I20260709 12:14:06.417333 24056 ts_tablet_manager.cc:1403] T bed12810020c4496969b723bcdd4b4ec P 288a46a90f26471584043331107dc0dd: Time spent bootstrapping tablet: real 0.018s	user 0.014s	sys 0.000s
I20260709 12:14:06.420197 24056 raft_consensus.cc:359] T bed12810020c4496969b723bcdd4b4ec P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:14:06.420972 24056 raft_consensus.cc:740] T bed12810020c4496969b723bcdd4b4ec P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 288a46a90f26471584043331107dc0dd, State: Initialized, Role: FOLLOWER
I20260709 12:14:06.421829 24056 consensus_queue.cc:260] T bed12810020c4496969b723bcdd4b4ec P 288a46a90f26471584043331107dc0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:14:06.424412 24056 ts_tablet_manager.cc:1434] T bed12810020c4496969b723bcdd4b4ec P 288a46a90f26471584043331107dc0dd: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:14:06.425570 24056 tablet_bootstrap.cc:492] T e3d86fc25f7146c9b1af99387a07bdec P 288a46a90f26471584043331107dc0dd: Bootstrap starting.
I20260709 12:14:06.446417 24056 tablet_bootstrap.cc:492] T e3d86fc25f7146c9b1af99387a07bdec P 288a46a90f26471584043331107dc0dd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:06.447510 24056 tablet_bootstrap.cc:492] T e3d86fc25f7146c9b1af99387a07bdec P 288a46a90f26471584043331107dc0dd: Bootstrap complete.
I20260709 12:14:06.448226 24056 ts_tablet_manager.cc:1403] T e3d86fc25f7146c9b1af99387a07bdec P 288a46a90f26471584043331107dc0dd: Time spent bootstrapping tablet: real 0.023s	user 0.010s	sys 0.008s
I20260709 12:14:06.451035 24056 raft_consensus.cc:359] T e3d86fc25f7146c9b1af99387a07bdec P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:14:06.451772 24056 raft_consensus.cc:740] T e3d86fc25f7146c9b1af99387a07bdec P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 288a46a90f26471584043331107dc0dd, State: Initialized, Role: FOLLOWER
I20260709 12:14:06.453152 24056 consensus_queue.cc:260] T e3d86fc25f7146c9b1af99387a07bdec P 288a46a90f26471584043331107dc0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:14:06.455472 24056 ts_tablet_manager.cc:1434] T e3d86fc25f7146c9b1af99387a07bdec P 288a46a90f26471584043331107dc0dd: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:14:06.456676 24056 tablet_bootstrap.cc:492] T b3e2bbccfb7f4da8baf42735151ff804 P 288a46a90f26471584043331107dc0dd: Bootstrap starting.
I20260709 12:14:06.471424 24056 tablet_bootstrap.cc:492] T b3e2bbccfb7f4da8baf42735151ff804 P 288a46a90f26471584043331107dc0dd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:06.472355 24056 tablet_bootstrap.cc:492] T b3e2bbccfb7f4da8baf42735151ff804 P 288a46a90f26471584043331107dc0dd: Bootstrap complete.
I20260709 12:14:06.473004 24056 ts_tablet_manager.cc:1403] T b3e2bbccfb7f4da8baf42735151ff804 P 288a46a90f26471584043331107dc0dd: Time spent bootstrapping tablet: real 0.017s	user 0.009s	sys 0.004s
I20260709 12:14:06.475575 24056 raft_consensus.cc:359] T b3e2bbccfb7f4da8baf42735151ff804 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:14:06.476114 24056 raft_consensus.cc:740] T b3e2bbccfb7f4da8baf42735151ff804 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 288a46a90f26471584043331107dc0dd, State: Initialized, Role: FOLLOWER
I20260709 12:14:06.476706 24056 consensus_queue.cc:260] T b3e2bbccfb7f4da8baf42735151ff804 P 288a46a90f26471584043331107dc0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:14:06.478761 24056 ts_tablet_manager.cc:1434] T b3e2bbccfb7f4da8baf42735151ff804 P 288a46a90f26471584043331107dc0dd: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:14:06.480356 24056 tablet_bootstrap.cc:492] T e0352fa4cf674ba8b7d1a0239bcf76e8 P 288a46a90f26471584043331107dc0dd: Bootstrap starting.
I20260709 12:14:06.495000 24056 tablet_bootstrap.cc:492] T e0352fa4cf674ba8b7d1a0239bcf76e8 P 288a46a90f26471584043331107dc0dd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:06.495965 24056 tablet_bootstrap.cc:492] T e0352fa4cf674ba8b7d1a0239bcf76e8 P 288a46a90f26471584043331107dc0dd: Bootstrap complete.
I20260709 12:14:06.496702 24056 ts_tablet_manager.cc:1403] T e0352fa4cf674ba8b7d1a0239bcf76e8 P 288a46a90f26471584043331107dc0dd: Time spent bootstrapping tablet: real 0.017s	user 0.009s	sys 0.004s
I20260709 12:14:06.499666 24056 raft_consensus.cc:359] T e0352fa4cf674ba8b7d1a0239bcf76e8 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:14:06.500330 24056 raft_consensus.cc:740] T e0352fa4cf674ba8b7d1a0239bcf76e8 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 288a46a90f26471584043331107dc0dd, State: Initialized, Role: FOLLOWER
I20260709 12:14:06.500928 24056 consensus_queue.cc:260] T e0352fa4cf674ba8b7d1a0239bcf76e8 P 288a46a90f26471584043331107dc0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:14:06.503204 24056 ts_tablet_manager.cc:1434] T e0352fa4cf674ba8b7d1a0239bcf76e8 P 288a46a90f26471584043331107dc0dd: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:14:06.519848 24138 raft_consensus.cc:3060] T 509f7e554df04f83aeffd51ec07607d5 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:06.769804 24138 raft_consensus.cc:3060] T e0352fa4cf674ba8b7d1a0239bcf76e8 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:06.778386 24139 raft_consensus.cc:3060] T 96f1bc9b220f49d5845c08249cb6a44f P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:06.994817 24138 raft_consensus.cc:3060] T bed12810020c4496969b723bcdd4b4ec P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:15.206780 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:15.268441 23301 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "18f5de2825814c38a0bd15d4c962dbef"
dest_uuid: "2904b089bdb249b78950db76f4a70e9f"
mode: GRACEFUL
new_leader_uuid: "3a9a63ca97694ebdb84bca730762d735"
 from {username='slave'} at 127.0.0.1:46914
I20260709 12:14:15.269358 23301 raft_consensus.cc:606] T 18f5de2825814c38a0bd15d4c962dbef P 2904b089bdb249b78950db76f4a70e9f [term 1 LEADER]: Received request to transfer leadership to TS 3a9a63ca97694ebdb84bca730762d735
I20260709 12:14:15.272027 23301 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2eb2c8089ce14124aed9a5d834cd0522"
dest_uuid: "2904b089bdb249b78950db76f4a70e9f"
mode: GRACEFUL
new_leader_uuid: "288a46a90f26471584043331107dc0dd"
 from {username='slave'} at 127.0.0.1:46914
I20260709 12:14:15.272480 23301 raft_consensus.cc:606] T 2eb2c8089ce14124aed9a5d834cd0522 P 2904b089bdb249b78950db76f4a70e9f [term 1 LEADER]: Received request to transfer leadership to TS 288a46a90f26471584043331107dc0dd
I20260709 12:14:15.274575 23301 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "45e4fb3889cc4d23bab3929c3fdd731e"
dest_uuid: "2904b089bdb249b78950db76f4a70e9f"
mode: GRACEFUL
new_leader_uuid: "288a46a90f26471584043331107dc0dd"
 from {username='slave'} at 127.0.0.1:46914
I20260709 12:14:15.274998 23301 raft_consensus.cc:606] T 45e4fb3889cc4d23bab3929c3fdd731e P 2904b089bdb249b78950db76f4a70e9f [term 2 LEADER]: Received request to transfer leadership to TS 288a46a90f26471584043331107dc0dd
I20260709 12:14:15.286018 23450 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7754f065b43946f0a3aca8a75cb61273"
dest_uuid: "9ba0da223cf24c97bc7d225e25015924"
mode: GRACEFUL
new_leader_uuid: "288a46a90f26471584043331107dc0dd"
 from {username='slave'} at 127.0.0.1:34156
I20260709 12:14:15.286556 23450 raft_consensus.cc:606] T 7754f065b43946f0a3aca8a75cb61273 P 9ba0da223cf24c97bc7d225e25015924 [term 2 LEADER]: Received request to transfer leadership to TS 288a46a90f26471584043331107dc0dd
I20260709 12:14:15.289574 23301 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8771e0b5070c49c589f276c793f87727"
dest_uuid: "2904b089bdb249b78950db76f4a70e9f"
mode: GRACEFUL
new_leader_uuid: "288a46a90f26471584043331107dc0dd"
 from {username='slave'} at 127.0.0.1:46914
I20260709 12:14:15.290084 23301 raft_consensus.cc:606] T 8771e0b5070c49c589f276c793f87727 P 2904b089bdb249b78950db76f4a70e9f [term 2 LEADER]: Received request to transfer leadership to TS 288a46a90f26471584043331107dc0dd
I20260709 12:14:15.301724 23370 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "99bc4210d0b44dd282a5bf7606d122af"
dest_uuid: "3a9a63ca97694ebdb84bca730762d735"
mode: GRACEFUL
new_leader_uuid: "288a46a90f26471584043331107dc0dd"
 from {username='slave'} at 127.0.0.1:48412
I20260709 12:14:15.302295 23370 raft_consensus.cc:606] T 99bc4210d0b44dd282a5bf7606d122af P 3a9a63ca97694ebdb84bca730762d735 [term 1 LEADER]: Received request to transfer leadership to TS 288a46a90f26471584043331107dc0dd
I20260709 12:14:15.304903 23301 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9f2438f73a8e4760b7b37c5330853b72"
dest_uuid: "2904b089bdb249b78950db76f4a70e9f"
mode: GRACEFUL
new_leader_uuid: "288a46a90f26471584043331107dc0dd"
 from {username='slave'} at 127.0.0.1:46914
I20260709 12:14:15.305474 23301 raft_consensus.cc:606] T 9f2438f73a8e4760b7b37c5330853b72 P 2904b089bdb249b78950db76f4a70e9f [term 2 LEADER]: Received request to transfer leadership to TS 288a46a90f26471584043331107dc0dd
I20260709 12:14:15.306990 12986 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 7
I20260709 12:14:15.308772 12986 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:15.309896 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:15.324343 24304 raft_consensus.cc:993] T 8771e0b5070c49c589f276c793f87727 P 2904b089bdb249b78950db76f4a70e9f: : Instructing follower 288a46a90f26471584043331107dc0dd to start an election
I20260709 12:14:15.325133 24306 raft_consensus.cc:1081] T 8771e0b5070c49c589f276c793f87727 P 2904b089bdb249b78950db76f4a70e9f [term 2 LEADER]: Signalling peer 288a46a90f26471584043331107dc0dd to start an election
I20260709 12:14:15.327064 24139 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8771e0b5070c49c589f276c793f87727"
dest_uuid: "288a46a90f26471584043331107dc0dd"
 from {username='slave'} at 127.0.0.1:49066
I20260709 12:14:15.327775 24139 raft_consensus.cc:493] T 8771e0b5070c49c589f276c793f87727 P 288a46a90f26471584043331107dc0dd [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:15.328245 24139 raft_consensus.cc:3060] T 8771e0b5070c49c589f276c793f87727 P 288a46a90f26471584043331107dc0dd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:15.338311 24139 raft_consensus.cc:515] T 8771e0b5070c49c589f276c793f87727 P 288a46a90f26471584043331107dc0dd [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:14:15.340799 24139 leader_election.cc:290] T 8771e0b5070c49c589f276c793f87727 P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 3 election: Requested vote from peers 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789), 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061)
I20260709 12:14:15.342202 23301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8771e0b5070c49c589f276c793f87727" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2904b089bdb249b78950db76f4a70e9f"
I20260709 12:14:15.343091 23301 raft_consensus.cc:3055] T 8771e0b5070c49c589f276c793f87727 P 2904b089bdb249b78950db76f4a70e9f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:15.343403 23301 raft_consensus.cc:740] T 8771e0b5070c49c589f276c793f87727 P 2904b089bdb249b78950db76f4a70e9f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2904b089bdb249b78950db76f4a70e9f, State: Running, Role: LEADER
I20260709 12:14:15.343524 23370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8771e0b5070c49c589f276c793f87727" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3a9a63ca97694ebdb84bca730762d735"
I20260709 12:14:15.344362 23301 consensus_queue.cc:260] T 8771e0b5070c49c589f276c793f87727 P 2904b089bdb249b78950db76f4a70e9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:14:15.346098 23301 raft_consensus.cc:3060] T 8771e0b5070c49c589f276c793f87727 P 2904b089bdb249b78950db76f4a70e9f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:15.344540 23370 raft_consensus.cc:3060] T 8771e0b5070c49c589f276c793f87727 P 3a9a63ca97694ebdb84bca730762d735 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:15.360670 24290 raft_consensus.cc:993] T 45e4fb3889cc4d23bab3929c3fdd731e P 2904b089bdb249b78950db76f4a70e9f: : Instructing follower 288a46a90f26471584043331107dc0dd to start an election
I20260709 12:14:15.360735 23301 raft_consensus.cc:2468] T 8771e0b5070c49c589f276c793f87727 P 2904b089bdb249b78950db76f4a70e9f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 288a46a90f26471584043331107dc0dd in term 3.
I20260709 12:14:15.362331 24304 raft_consensus.cc:1081] T 45e4fb3889cc4d23bab3929c3fdd731e P 2904b089bdb249b78950db76f4a70e9f [term 2 LEADER]: Signalling peer 288a46a90f26471584043331107dc0dd to start an election
I20260709 12:14:15.364362 24052 leader_election.cc:304] T 8771e0b5070c49c589f276c793f87727 P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 288a46a90f26471584043331107dc0dd, 2904b089bdb249b78950db76f4a70e9f; no voters: 
I20260709 12:14:15.366568 24304 raft_consensus.cc:993] T 18f5de2825814c38a0bd15d4c962dbef P 2904b089bdb249b78950db76f4a70e9f: : Instructing follower 3a9a63ca97694ebdb84bca730762d735 to start an election
I20260709 12:14:15.367187 24304 raft_consensus.cc:1081] T 18f5de2825814c38a0bd15d4c962dbef P 2904b089bdb249b78950db76f4a70e9f [term 1 LEADER]: Signalling peer 3a9a63ca97694ebdb84bca730762d735 to start an election
I20260709 12:14:15.368234 23370 raft_consensus.cc:2468] T 8771e0b5070c49c589f276c793f87727 P 3a9a63ca97694ebdb84bca730762d735 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 288a46a90f26471584043331107dc0dd in term 3.
I20260709 12:14:15.369393 23372 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "18f5de2825814c38a0bd15d4c962dbef"
dest_uuid: "3a9a63ca97694ebdb84bca730762d735"
 from {username='slave'} at 127.0.0.1:33500
I20260709 12:14:15.370110 23372 raft_consensus.cc:493] T 18f5de2825814c38a0bd15d4c962dbef P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:15.370465 23372 raft_consensus.cc:3060] T 18f5de2825814c38a0bd15d4c962dbef P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:15.370415 24139 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "45e4fb3889cc4d23bab3929c3fdd731e"
dest_uuid: "288a46a90f26471584043331107dc0dd"
 from {username='slave'} at 127.0.0.1:49066
I20260709 12:14:15.371315 24139 raft_consensus.cc:493] T 45e4fb3889cc4d23bab3929c3fdd731e P 288a46a90f26471584043331107dc0dd [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:15.371765 24139 raft_consensus.cc:3060] T 45e4fb3889cc4d23bab3929c3fdd731e P 288a46a90f26471584043331107dc0dd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:15.372237 24313 raft_consensus.cc:2804] T 8771e0b5070c49c589f276c793f87727 P 288a46a90f26471584043331107dc0dd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:15.373809 24313 raft_consensus.cc:697] T 8771e0b5070c49c589f276c793f87727 P 288a46a90f26471584043331107dc0dd [term 3 LEADER]: Becoming Leader. State: Replica: 288a46a90f26471584043331107dc0dd, State: Running, Role: LEADER
I20260709 12:14:15.375419 24313 consensus_queue.cc:237] T 8771e0b5070c49c589f276c793f87727 P 288a46a90f26471584043331107dc0dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:14:15.379290 24139 raft_consensus.cc:515] T 45e4fb3889cc4d23bab3929c3fdd731e P 288a46a90f26471584043331107dc0dd [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:14:15.380436 23372 raft_consensus.cc:515] T 18f5de2825814c38a0bd15d4c962dbef P 3a9a63ca97694ebdb84bca730762d735 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:14:15.383934 24139 leader_election.cc:290] T 45e4fb3889cc4d23bab3929c3fdd731e P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 3 election: Requested vote from peers 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081), 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789)
I20260709 12:14:15.384132 23446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e4fb3889cc4d23bab3929c3fdd731e" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9ba0da223cf24c97bc7d225e25015924"
I20260709 12:14:15.384739 23446 raft_consensus.cc:3060] T 45e4fb3889cc4d23bab3929c3fdd731e P 9ba0da223cf24c97bc7d225e25015924 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:15.388239 23301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e4fb3889cc4d23bab3929c3fdd731e" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2904b089bdb249b78950db76f4a70e9f"
I20260709 12:14:15.436264 23301 raft_consensus.cc:3055] T 45e4fb3889cc4d23bab3929c3fdd731e P 2904b089bdb249b78950db76f4a70e9f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:15.436674 23301 raft_consensus.cc:740] T 45e4fb3889cc4d23bab3929c3fdd731e P 2904b089bdb249b78950db76f4a70e9f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2904b089bdb249b78950db76f4a70e9f, State: Running, Role: LEADER
I20260709 12:14:15.438292 23372 leader_election.cc:290] T 18f5de2825814c38a0bd15d4c962dbef P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 2 election: Requested vote from peers 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789), 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081)
I20260709 12:14:15.441555 23124 catalog_manager.cc:5697] T 8771e0b5070c49c589f276c793f87727 P 288a46a90f26471584043331107dc0dd reported cstate change: term changed from 2 to 3, leader changed from 2904b089bdb249b78950db76f4a70e9f (127.12.174.130) to 288a46a90f26471584043331107dc0dd (127.12.174.129). New cstate: current_term: 3 leader_uuid: "288a46a90f26471584043331107dc0dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:15.447103 23450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f5de2825814c38a0bd15d4c962dbef" candidate_uuid: "3a9a63ca97694ebdb84bca730762d735" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9ba0da223cf24c97bc7d225e25015924"
I20260709 12:14:15.447785 23450 raft_consensus.cc:3060] T 18f5de2825814c38a0bd15d4c962dbef P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:15.454540 23299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f5de2825814c38a0bd15d4c962dbef" candidate_uuid: "3a9a63ca97694ebdb84bca730762d735" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2904b089bdb249b78950db76f4a70e9f"
I20260709 12:14:15.455344 23299 raft_consensus.cc:3055] T 18f5de2825814c38a0bd15d4c962dbef P 2904b089bdb249b78950db76f4a70e9f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:15.455641 23299 raft_consensus.cc:740] T 18f5de2825814c38a0bd15d4c962dbef P 2904b089bdb249b78950db76f4a70e9f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2904b089bdb249b78950db76f4a70e9f, State: Running, Role: LEADER
I20260709 12:14:15.456009 23301 consensus_queue.cc:260] T 45e4fb3889cc4d23bab3929c3fdd731e P 2904b089bdb249b78950db76f4a70e9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:14:15.456858 23450 raft_consensus.cc:2468] T 18f5de2825814c38a0bd15d4c962dbef P 9ba0da223cf24c97bc7d225e25015924 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a9a63ca97694ebdb84bca730762d735 in term 2.
I20260709 12:14:15.457494 23301 raft_consensus.cc:3060] T 45e4fb3889cc4d23bab3929c3fdd731e P 2904b089bdb249b78950db76f4a70e9f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:15.461078 23299 consensus_queue.cc:260] T 18f5de2825814c38a0bd15d4c962dbef P 2904b089bdb249b78950db76f4a70e9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:14:15.445379 23446 raft_consensus.cc:2468] T 45e4fb3889cc4d23bab3929c3fdd731e P 9ba0da223cf24c97bc7d225e25015924 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 288a46a90f26471584043331107dc0dd in term 3.
I20260709 12:14:15.463018 23299 raft_consensus.cc:3060] T 18f5de2825814c38a0bd15d4c962dbef P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:15.474645 24051 leader_election.cc:304] T 45e4fb3889cc4d23bab3929c3fdd731e P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 288a46a90f26471584043331107dc0dd, 9ba0da223cf24c97bc7d225e25015924; no voters: 
I20260709 12:14:15.475816 24313 raft_consensus.cc:2804] T 45e4fb3889cc4d23bab3929c3fdd731e P 288a46a90f26471584043331107dc0dd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:15.476634 24313 raft_consensus.cc:697] T 45e4fb3889cc4d23bab3929c3fdd731e P 288a46a90f26471584043331107dc0dd [term 3 LEADER]: Becoming Leader. State: Replica: 288a46a90f26471584043331107dc0dd, State: Running, Role: LEADER
I20260709 12:14:15.477929 24313 consensus_queue.cc:237] T 45e4fb3889cc4d23bab3929c3fdd731e P 288a46a90f26471584043331107dc0dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
W20260709 12:14:15.490568 23342 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:46159, user_credentials={real_user=slave}} blocked reactor thread for 103047us
I20260709 12:14:15.492807 23301 raft_consensus.cc:2468] T 45e4fb3889cc4d23bab3929c3fdd731e P 2904b089bdb249b78950db76f4a70e9f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 288a46a90f26471584043331107dc0dd in term 3.
I20260709 12:14:15.511183 23340 leader_election.cc:304] T 18f5de2825814c38a0bd15d4c962dbef P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a9a63ca97694ebdb84bca730762d735, 9ba0da223cf24c97bc7d225e25015924; no voters: 
I20260709 12:14:15.512477 24235 raft_consensus.cc:2804] T 18f5de2825814c38a0bd15d4c962dbef P 3a9a63ca97694ebdb84bca730762d735 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:15.513000 24235 raft_consensus.cc:697] T 18f5de2825814c38a0bd15d4c962dbef P 3a9a63ca97694ebdb84bca730762d735 [term 2 LEADER]: Becoming Leader. State: Replica: 3a9a63ca97694ebdb84bca730762d735, State: Running, Role: LEADER
I20260709 12:14:15.513938 24235 consensus_queue.cc:237] T 18f5de2825814c38a0bd15d4c962dbef P 3a9a63ca97694ebdb84bca730762d735 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
W20260709 12:14:15.521358 23267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:40061, user_credentials={real_user=slave}} blocked reactor thread for 66752.5us
W20260709 12:14:15.526831 23416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:46159, user_credentials={real_user=slave}} blocked reactor thread for 51826.2us
I20260709 12:14:15.528287 23299 raft_consensus.cc:2468] T 18f5de2825814c38a0bd15d4c962dbef P 2904b089bdb249b78950db76f4a70e9f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a9a63ca97694ebdb84bca730762d735 in term 2.
I20260709 12:14:15.550952 23125 catalog_manager.cc:5697] T 18f5de2825814c38a0bd15d4c962dbef P 3a9a63ca97694ebdb84bca730762d735 reported cstate change: term changed from 1 to 2, leader changed from 2904b089bdb249b78950db76f4a70e9f (127.12.174.130) to 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131). New cstate: current_term: 2 leader_uuid: "3a9a63ca97694ebdb84bca730762d735" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:15.560079 23124 catalog_manager.cc:5697] T 45e4fb3889cc4d23bab3929c3fdd731e P 288a46a90f26471584043331107dc0dd reported cstate change: term changed from 2 to 3, leader changed from 2904b089bdb249b78950db76f4a70e9f (127.12.174.130) to 288a46a90f26471584043331107dc0dd (127.12.174.129). New cstate: current_term: 3 leader_uuid: "288a46a90f26471584043331107dc0dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:15.581799 24303 raft_consensus.cc:993] T 7754f065b43946f0a3aca8a75cb61273 P 9ba0da223cf24c97bc7d225e25015924: : Instructing follower 288a46a90f26471584043331107dc0dd to start an election
I20260709 12:14:15.582284 24303 raft_consensus.cc:1081] T 7754f065b43946f0a3aca8a75cb61273 P 9ba0da223cf24c97bc7d225e25015924 [term 2 LEADER]: Signalling peer 288a46a90f26471584043331107dc0dd to start an election
I20260709 12:14:15.583887 24139 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7754f065b43946f0a3aca8a75cb61273"
dest_uuid: "288a46a90f26471584043331107dc0dd"
 from {username='slave'} at 127.0.0.1:49078
I20260709 12:14:15.584353 24139 raft_consensus.cc:493] T 7754f065b43946f0a3aca8a75cb61273 P 288a46a90f26471584043331107dc0dd [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:15.584653 24139 raft_consensus.cc:3060] T 7754f065b43946f0a3aca8a75cb61273 P 288a46a90f26471584043331107dc0dd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:15.590746 24316 raft_consensus.cc:993] T 99bc4210d0b44dd282a5bf7606d122af P 3a9a63ca97694ebdb84bca730762d735: : Instructing follower 288a46a90f26471584043331107dc0dd to start an election
I20260709 12:14:15.591337 24235 raft_consensus.cc:1081] T 99bc4210d0b44dd282a5bf7606d122af P 3a9a63ca97694ebdb84bca730762d735 [term 1 LEADER]: Signalling peer 288a46a90f26471584043331107dc0dd to start an election
I20260709 12:14:15.592947 24130 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "99bc4210d0b44dd282a5bf7606d122af"
dest_uuid: "288a46a90f26471584043331107dc0dd"
 from {username='slave'} at 127.0.0.1:49088
I20260709 12:14:15.593474 24130 raft_consensus.cc:493] T 99bc4210d0b44dd282a5bf7606d122af P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:15.593385 24139 raft_consensus.cc:515] T 7754f065b43946f0a3aca8a75cb61273 P 288a46a90f26471584043331107dc0dd [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:14:15.593945 24130 raft_consensus.cc:3060] T 99bc4210d0b44dd282a5bf7606d122af P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:15.596000 24139 leader_election.cc:290] T 7754f065b43946f0a3aca8a75cb61273 P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 3 election: Requested vote from peers 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061), 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081)
I20260709 12:14:15.596999 23372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7754f065b43946f0a3aca8a75cb61273" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3a9a63ca97694ebdb84bca730762d735"
I20260709 12:14:15.597684 23372 raft_consensus.cc:3060] T 7754f065b43946f0a3aca8a75cb61273 P 3a9a63ca97694ebdb84bca730762d735 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:15.602293 24130 raft_consensus.cc:515] T 99bc4210d0b44dd282a5bf7606d122af P 288a46a90f26471584043331107dc0dd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:14:15.597007 23447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7754f065b43946f0a3aca8a75cb61273" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9ba0da223cf24c97bc7d225e25015924"
I20260709 12:14:15.603654 23447 raft_consensus.cc:3055] T 7754f065b43946f0a3aca8a75cb61273 P 9ba0da223cf24c97bc7d225e25015924 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:15.604002 23447 raft_consensus.cc:740] T 7754f065b43946f0a3aca8a75cb61273 P 9ba0da223cf24c97bc7d225e25015924 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9ba0da223cf24c97bc7d225e25015924, State: Running, Role: LEADER
I20260709 12:14:15.604074 23372 raft_consensus.cc:2468] T 7754f065b43946f0a3aca8a75cb61273 P 3a9a63ca97694ebdb84bca730762d735 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 288a46a90f26471584043331107dc0dd in term 3.
I20260709 12:14:15.605175 23370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bc4210d0b44dd282a5bf7606d122af" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3a9a63ca97694ebdb84bca730762d735"
I20260709 12:14:15.605490 24052 leader_election.cc:304] T 7754f065b43946f0a3aca8a75cb61273 P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 288a46a90f26471584043331107dc0dd, 3a9a63ca97694ebdb84bca730762d735; no voters: 
I20260709 12:14:15.604926 23447 consensus_queue.cc:260] T 7754f065b43946f0a3aca8a75cb61273 P 9ba0da223cf24c97bc7d225e25015924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:14:15.605867 23370 raft_consensus.cc:3055] T 99bc4210d0b44dd282a5bf7606d122af P 3a9a63ca97694ebdb84bca730762d735 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:15.606261 23370 raft_consensus.cc:740] T 99bc4210d0b44dd282a5bf7606d122af P 3a9a63ca97694ebdb84bca730762d735 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3a9a63ca97694ebdb84bca730762d735, State: Running, Role: LEADER
I20260709 12:14:15.606638 24130 leader_election.cc:290] T 99bc4210d0b44dd282a5bf7606d122af P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 2 election: Requested vote from peers 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061), 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081)
I20260709 12:14:15.607092 23370 consensus_queue.cc:260] T 99bc4210d0b44dd282a5bf7606d122af P 3a9a63ca97694ebdb84bca730762d735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:14:15.607622 23446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99bc4210d0b44dd282a5bf7606d122af" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9ba0da223cf24c97bc7d225e25015924"
I20260709 12:14:15.608402 23370 raft_consensus.cc:3060] T 99bc4210d0b44dd282a5bf7606d122af P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:15.608502 23446 raft_consensus.cc:3060] T 99bc4210d0b44dd282a5bf7606d122af P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:15.607591 24313 raft_consensus.cc:2804] T 7754f065b43946f0a3aca8a75cb61273 P 288a46a90f26471584043331107dc0dd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:15.610059 24313 raft_consensus.cc:697] T 7754f065b43946f0a3aca8a75cb61273 P 288a46a90f26471584043331107dc0dd [term 3 LEADER]: Becoming Leader. State: Replica: 288a46a90f26471584043331107dc0dd, State: Running, Role: LEADER
I20260709 12:14:15.610991 23447 raft_consensus.cc:3060] T 7754f065b43946f0a3aca8a75cb61273 P 9ba0da223cf24c97bc7d225e25015924 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:15.611066 24313 consensus_queue.cc:237] T 7754f065b43946f0a3aca8a75cb61273 P 288a46a90f26471584043331107dc0dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:14:15.618219 23446 raft_consensus.cc:2468] T 99bc4210d0b44dd282a5bf7606d122af P 9ba0da223cf24c97bc7d225e25015924 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 288a46a90f26471584043331107dc0dd in term 2.
I20260709 12:14:15.619700 24051 leader_election.cc:304] T 99bc4210d0b44dd282a5bf7606d122af P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 288a46a90f26471584043331107dc0dd, 9ba0da223cf24c97bc7d225e25015924; no voters: 
I20260709 12:14:15.620750 24314 raft_consensus.cc:2804] T 99bc4210d0b44dd282a5bf7606d122af P 288a46a90f26471584043331107dc0dd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:15.625509 23447 raft_consensus.cc:2468] T 7754f065b43946f0a3aca8a75cb61273 P 9ba0da223cf24c97bc7d225e25015924 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 288a46a90f26471584043331107dc0dd in term 3.
I20260709 12:14:15.628186 24314 raft_consensus.cc:697] T 99bc4210d0b44dd282a5bf7606d122af P 288a46a90f26471584043331107dc0dd [term 2 LEADER]: Becoming Leader. State: Replica: 288a46a90f26471584043331107dc0dd, State: Running, Role: LEADER
I20260709 12:14:15.629419 24314 consensus_queue.cc:237] T 99bc4210d0b44dd282a5bf7606d122af P 288a46a90f26471584043331107dc0dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:14:15.637424 23124 catalog_manager.cc:5697] T 7754f065b43946f0a3aca8a75cb61273 P 288a46a90f26471584043331107dc0dd reported cstate change: term changed from 2 to 3, leader changed from 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132) to 288a46a90f26471584043331107dc0dd (127.12.174.129). New cstate: current_term: 3 leader_uuid: "288a46a90f26471584043331107dc0dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:15.640558 23370 raft_consensus.cc:2468] T 99bc4210d0b44dd282a5bf7606d122af P 3a9a63ca97694ebdb84bca730762d735 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 288a46a90f26471584043331107dc0dd in term 2.
I20260709 12:14:15.646293 24304 raft_consensus.cc:993] T 2eb2c8089ce14124aed9a5d834cd0522 P 2904b089bdb249b78950db76f4a70e9f: : Instructing follower 288a46a90f26471584043331107dc0dd to start an election
I20260709 12:14:15.646970 24318 raft_consensus.cc:1081] T 2eb2c8089ce14124aed9a5d834cd0522 P 2904b089bdb249b78950db76f4a70e9f [term 1 LEADER]: Signalling peer 288a46a90f26471584043331107dc0dd to start an election
I20260709 12:14:15.648777 24139 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2eb2c8089ce14124aed9a5d834cd0522"
dest_uuid: "288a46a90f26471584043331107dc0dd"
 from {username='slave'} at 127.0.0.1:49066
I20260709 12:14:15.649278 24139 raft_consensus.cc:493] T 2eb2c8089ce14124aed9a5d834cd0522 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:15.649591 24139 raft_consensus.cc:3060] T 2eb2c8089ce14124aed9a5d834cd0522 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:15.657320 24304 raft_consensus.cc:993] T 9f2438f73a8e4760b7b37c5330853b72 P 2904b089bdb249b78950db76f4a70e9f: : Instructing follower 288a46a90f26471584043331107dc0dd to start an election
I20260709 12:14:15.658051 24304 raft_consensus.cc:1081] T 9f2438f73a8e4760b7b37c5330853b72 P 2904b089bdb249b78950db76f4a70e9f [term 2 LEADER]: Signalling peer 288a46a90f26471584043331107dc0dd to start an election
I20260709 12:14:15.660024 24138 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9f2438f73a8e4760b7b37c5330853b72"
dest_uuid: "288a46a90f26471584043331107dc0dd"
 from {username='slave'} at 127.0.0.1:49066
I20260709 12:14:15.660629 24138 raft_consensus.cc:493] T 9f2438f73a8e4760b7b37c5330853b72 P 288a46a90f26471584043331107dc0dd [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:15.661010 24138 raft_consensus.cc:3060] T 9f2438f73a8e4760b7b37c5330853b72 P 288a46a90f26471584043331107dc0dd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:15.672695 23124 catalog_manager.cc:5697] T 99bc4210d0b44dd282a5bf7606d122af P 288a46a90f26471584043331107dc0dd reported cstate change: term changed from 1 to 2, leader changed from 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131) to 288a46a90f26471584043331107dc0dd (127.12.174.129). New cstate: current_term: 2 leader_uuid: "288a46a90f26471584043331107dc0dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:15.675751 24139 raft_consensus.cc:515] T 2eb2c8089ce14124aed9a5d834cd0522 P 288a46a90f26471584043331107dc0dd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:14:15.677518 24139 leader_election.cc:290] T 2eb2c8089ce14124aed9a5d834cd0522 P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 2 election: Requested vote from peers 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789), 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061)
I20260709 12:14:15.673614 24138 raft_consensus.cc:515] T 9f2438f73a8e4760b7b37c5330853b72 P 288a46a90f26471584043331107dc0dd [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:14:15.678707 23372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb2c8089ce14124aed9a5d834cd0522" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3a9a63ca97694ebdb84bca730762d735"
I20260709 12:14:15.678920 23299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eb2c8089ce14124aed9a5d834cd0522" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2904b089bdb249b78950db76f4a70e9f"
I20260709 12:14:15.679400 23372 raft_consensus.cc:3060] T 2eb2c8089ce14124aed9a5d834cd0522 P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:15.679724 23299 raft_consensus.cc:3055] T 2eb2c8089ce14124aed9a5d834cd0522 P 2904b089bdb249b78950db76f4a70e9f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:15.680085 23299 raft_consensus.cc:740] T 2eb2c8089ce14124aed9a5d834cd0522 P 2904b089bdb249b78950db76f4a70e9f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2904b089bdb249b78950db76f4a70e9f, State: Running, Role: LEADER
I20260709 12:14:15.681104 24138 leader_election.cc:290] T 9f2438f73a8e4760b7b37c5330853b72 P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 3 election: Requested vote from peers 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081), 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789)
I20260709 12:14:15.680927 23299 consensus_queue.cc:260] T 2eb2c8089ce14124aed9a5d834cd0522 P 2904b089bdb249b78950db76f4a70e9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:14:15.683292 23301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f2438f73a8e4760b7b37c5330853b72" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2904b089bdb249b78950db76f4a70e9f"
I20260709 12:14:15.684021 23301 raft_consensus.cc:3055] T 9f2438f73a8e4760b7b37c5330853b72 P 2904b089bdb249b78950db76f4a70e9f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:15.684309 23301 raft_consensus.cc:740] T 9f2438f73a8e4760b7b37c5330853b72 P 2904b089bdb249b78950db76f4a70e9f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2904b089bdb249b78950db76f4a70e9f, State: Running, Role: LEADER
I20260709 12:14:15.685298 23301 consensus_queue.cc:260] T 9f2438f73a8e4760b7b37c5330853b72 P 2904b089bdb249b78950db76f4a70e9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:14:15.685632 23446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f2438f73a8e4760b7b37c5330853b72" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9ba0da223cf24c97bc7d225e25015924"
I20260709 12:14:15.686404 23446 raft_consensus.cc:3060] T 9f2438f73a8e4760b7b37c5330853b72 P 9ba0da223cf24c97bc7d225e25015924 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:15.682744 23299 raft_consensus.cc:3060] T 2eb2c8089ce14124aed9a5d834cd0522 P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:15.690748 23372 raft_consensus.cc:2468] T 2eb2c8089ce14124aed9a5d834cd0522 P 3a9a63ca97694ebdb84bca730762d735 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 288a46a90f26471584043331107dc0dd in term 2.
I20260709 12:14:15.686537 23301 raft_consensus.cc:3060] T 9f2438f73a8e4760b7b37c5330853b72 P 2904b089bdb249b78950db76f4a70e9f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:15.692075 24052 leader_election.cc:304] T 2eb2c8089ce14124aed9a5d834cd0522 P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 288a46a90f26471584043331107dc0dd, 3a9a63ca97694ebdb84bca730762d735; no voters: 
I20260709 12:14:15.692996 24314 raft_consensus.cc:2804] T 2eb2c8089ce14124aed9a5d834cd0522 P 288a46a90f26471584043331107dc0dd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:15.693470 24314 raft_consensus.cc:697] T 2eb2c8089ce14124aed9a5d834cd0522 P 288a46a90f26471584043331107dc0dd [term 2 LEADER]: Becoming Leader. State: Replica: 288a46a90f26471584043331107dc0dd, State: Running, Role: LEADER
I20260709 12:14:15.694620 23446 raft_consensus.cc:2468] T 9f2438f73a8e4760b7b37c5330853b72 P 9ba0da223cf24c97bc7d225e25015924 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 288a46a90f26471584043331107dc0dd in term 3.
I20260709 12:14:15.694420 24314 consensus_queue.cc:237] T 2eb2c8089ce14124aed9a5d834cd0522 P 288a46a90f26471584043331107dc0dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:14:15.696769 24051 leader_election.cc:304] T 9f2438f73a8e4760b7b37c5330853b72 P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 288a46a90f26471584043331107dc0dd, 9ba0da223cf24c97bc7d225e25015924; no voters: 
I20260709 12:14:15.698083 24313 raft_consensus.cc:2804] T 9f2438f73a8e4760b7b37c5330853b72 P 288a46a90f26471584043331107dc0dd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:15.698644 24313 raft_consensus.cc:697] T 9f2438f73a8e4760b7b37c5330853b72 P 288a46a90f26471584043331107dc0dd [term 3 LEADER]: Becoming Leader. State: Replica: 288a46a90f26471584043331107dc0dd, State: Running, Role: LEADER
I20260709 12:14:15.699672 24313 consensus_queue.cc:237] T 9f2438f73a8e4760b7b37c5330853b72 P 288a46a90f26471584043331107dc0dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:14:15.711171 23301 raft_consensus.cc:2468] T 9f2438f73a8e4760b7b37c5330853b72 P 2904b089bdb249b78950db76f4a70e9f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 288a46a90f26471584043331107dc0dd in term 3.
I20260709 12:14:15.715206 23299 raft_consensus.cc:2468] T 2eb2c8089ce14124aed9a5d834cd0522 P 2904b089bdb249b78950db76f4a70e9f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 288a46a90f26471584043331107dc0dd in term 2.
I20260709 12:14:15.726604 23124 catalog_manager.cc:5697] T 2eb2c8089ce14124aed9a5d834cd0522 P 288a46a90f26471584043331107dc0dd reported cstate change: term changed from 1 to 2, leader changed from 2904b089bdb249b78950db76f4a70e9f (127.12.174.130) to 288a46a90f26471584043331107dc0dd (127.12.174.129). New cstate: current_term: 2 leader_uuid: "288a46a90f26471584043331107dc0dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:15.728037 23124 catalog_manager.cc:5697] T 9f2438f73a8e4760b7b37c5330853b72 P 288a46a90f26471584043331107dc0dd reported cstate change: term changed from 2 to 3, leader changed from 2904b089bdb249b78950db76f4a70e9f (127.12.174.130) to 288a46a90f26471584043331107dc0dd (127.12.174.129). New cstate: current_term: 3 leader_uuid: "288a46a90f26471584043331107dc0dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:15.783309 23299 raft_consensus.cc:1275] T 8771e0b5070c49c589f276c793f87727 P 2904b089bdb249b78950db76f4a70e9f [term 3 FOLLOWER]: Refusing update from remote peer 288a46a90f26471584043331107dc0dd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:15.784740 24313 consensus_queue.cc:1048] T 8771e0b5070c49c589f276c793f87727 P 288a46a90f26471584043331107dc0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:15.795507 23372 raft_consensus.cc:1275] T 8771e0b5070c49c589f276c793f87727 P 3a9a63ca97694ebdb84bca730762d735 [term 3 FOLLOWER]: Refusing update from remote peer 288a46a90f26471584043331107dc0dd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:15.797806 24314 consensus_queue.cc:1048] T 8771e0b5070c49c589f276c793f87727 P 288a46a90f26471584043331107dc0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:15.999385 23446 raft_consensus.cc:1275] T 18f5de2825814c38a0bd15d4c962dbef P 9ba0da223cf24c97bc7d225e25015924 [term 2 FOLLOWER]: Refusing update from remote peer 3a9a63ca97694ebdb84bca730762d735: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:15.999389 23447 raft_consensus.cc:1275] T 45e4fb3889cc4d23bab3929c3fdd731e P 9ba0da223cf24c97bc7d225e25015924 [term 3 FOLLOWER]: Refusing update from remote peer 288a46a90f26471584043331107dc0dd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:16.000962 24235 consensus_queue.cc:1048] T 18f5de2825814c38a0bd15d4c962dbef P 3a9a63ca97694ebdb84bca730762d735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:16.001230 24313 consensus_queue.cc:1048] T 45e4fb3889cc4d23bab3929c3fdd731e P 288a46a90f26471584043331107dc0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:14:16.026222 23299 raft_consensus.cc:1275] T 45e4fb3889cc4d23bab3929c3fdd731e P 2904b089bdb249b78950db76f4a70e9f [term 3 FOLLOWER]: Refusing update from remote peer 288a46a90f26471584043331107dc0dd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:16.028389 24327 consensus_queue.cc:1048] T 45e4fb3889cc4d23bab3929c3fdd731e P 288a46a90f26471584043331107dc0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:14:16.046166 23301 raft_consensus.cc:1275] T 18f5de2825814c38a0bd15d4c962dbef P 2904b089bdb249b78950db76f4a70e9f [term 2 FOLLOWER]: Refusing update from remote peer 3a9a63ca97694ebdb84bca730762d735: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:16.049629 24341 consensus_queue.cc:1048] T 18f5de2825814c38a0bd15d4c962dbef P 3a9a63ca97694ebdb84bca730762d735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:14:16.072188 23447 raft_consensus.cc:1275] T 7754f065b43946f0a3aca8a75cb61273 P 9ba0da223cf24c97bc7d225e25015924 [term 3 FOLLOWER]: Refusing update from remote peer 288a46a90f26471584043331107dc0dd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:16.076933 24327 consensus_queue.cc:1048] T 7754f065b43946f0a3aca8a75cb61273 P 288a46a90f26471584043331107dc0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:14:16.089088 23372 raft_consensus.cc:1275] T 7754f065b43946f0a3aca8a75cb61273 P 3a9a63ca97694ebdb84bca730762d735 [term 3 FOLLOWER]: Refusing update from remote peer 288a46a90f26471584043331107dc0dd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:16.092113 24314 consensus_queue.cc:1048] T 7754f065b43946f0a3aca8a75cb61273 P 288a46a90f26471584043331107dc0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:16.110047 23299 raft_consensus.cc:1275] T 9f2438f73a8e4760b7b37c5330853b72 P 2904b089bdb249b78950db76f4a70e9f [term 3 FOLLOWER]: Refusing update from remote peer 288a46a90f26471584043331107dc0dd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:16.112423 24314 consensus_queue.cc:1048] T 9f2438f73a8e4760b7b37c5330853b72 P 288a46a90f26471584043331107dc0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:14:16.140194 23302 raft_consensus.cc:1275] T 2eb2c8089ce14124aed9a5d834cd0522 P 2904b089bdb249b78950db76f4a70e9f [term 2 FOLLOWER]: Refusing update from remote peer 288a46a90f26471584043331107dc0dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:16.153299 24327 consensus_queue.cc:1048] T 2eb2c8089ce14124aed9a5d834cd0522 P 288a46a90f26471584043331107dc0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:14:16.155309 23447 raft_consensus.cc:1275] T 9f2438f73a8e4760b7b37c5330853b72 P 9ba0da223cf24c97bc7d225e25015924 [term 3 FOLLOWER]: Refusing update from remote peer 288a46a90f26471584043331107dc0dd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:16.158396 24313 consensus_queue.cc:1048] T 9f2438f73a8e4760b7b37c5330853b72 P 288a46a90f26471584043331107dc0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:16.161214 23447 raft_consensus.cc:1275] T 99bc4210d0b44dd282a5bf7606d122af P 9ba0da223cf24c97bc7d225e25015924 [term 2 FOLLOWER]: Refusing update from remote peer 288a46a90f26471584043331107dc0dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:16.165081 24314 consensus_queue.cc:1048] T 99bc4210d0b44dd282a5bf7606d122af P 288a46a90f26471584043331107dc0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:14:16.203651 23374 raft_consensus.cc:1275] T 2eb2c8089ce14124aed9a5d834cd0522 P 3a9a63ca97694ebdb84bca730762d735 [term 2 FOLLOWER]: Refusing update from remote peer 288a46a90f26471584043331107dc0dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:16.206147 23374 raft_consensus.cc:1275] T 99bc4210d0b44dd282a5bf7606d122af P 3a9a63ca97694ebdb84bca730762d735 [term 2 FOLLOWER]: Refusing update from remote peer 288a46a90f26471584043331107dc0dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:16.211822 24347 consensus_queue.cc:1048] T 2eb2c8089ce14124aed9a5d834cd0522 P 288a46a90f26471584043331107dc0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:14:16.215137 24313 consensus_queue.cc:1048] T 99bc4210d0b44dd282a5bf7606d122af P 288a46a90f26471584043331107dc0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:14:16.358417 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:16.404160 23374 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "27166b782a5049198cccb3e5905acbc7"
dest_uuid: "3a9a63ca97694ebdb84bca730762d735"
mode: GRACEFUL
new_leader_uuid: "288a46a90f26471584043331107dc0dd"
 from {username='slave'} at 127.0.0.1:48412
I20260709 12:14:16.404881 23374 raft_consensus.cc:606] T 27166b782a5049198cccb3e5905acbc7 P 3a9a63ca97694ebdb84bca730762d735 [term 1 LEADER]: Received request to transfer leadership to TS 288a46a90f26471584043331107dc0dd
I20260709 12:14:16.407454 23302 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "27202f3dd66a42a3832a9cc25ba6e3e5"
dest_uuid: "2904b089bdb249b78950db76f4a70e9f"
mode: GRACEFUL
new_leader_uuid: "9ba0da223cf24c97bc7d225e25015924"
 from {username='slave'} at 127.0.0.1:46914
I20260709 12:14:16.408054 23302 raft_consensus.cc:606] T 27202f3dd66a42a3832a9cc25ba6e3e5 P 2904b089bdb249b78950db76f4a70e9f [term 1 LEADER]: Received request to transfer leadership to TS 9ba0da223cf24c97bc7d225e25015924
I20260709 12:14:16.410552 23302 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3ad2f373a67b4c9cbb2183c2c73eb3e5"
dest_uuid: "2904b089bdb249b78950db76f4a70e9f"
mode: GRACEFUL
new_leader_uuid: "288a46a90f26471584043331107dc0dd"
 from {username='slave'} at 127.0.0.1:46914
I20260709 12:14:16.411031 23302 raft_consensus.cc:606] T 3ad2f373a67b4c9cbb2183c2c73eb3e5 P 2904b089bdb249b78950db76f4a70e9f [term 1 LEADER]: Received request to transfer leadership to TS 288a46a90f26471584043331107dc0dd
I20260709 12:14:16.413295 23302 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5959fc0b70884d699725fb8d560e5de5"
dest_uuid: "2904b089bdb249b78950db76f4a70e9f"
mode: GRACEFUL
new_leader_uuid: "288a46a90f26471584043331107dc0dd"
 from {username='slave'} at 127.0.0.1:46914
I20260709 12:14:16.413784 23302 raft_consensus.cc:606] T 5959fc0b70884d699725fb8d560e5de5 P 2904b089bdb249b78950db76f4a70e9f [term 3 LEADER]: Received request to transfer leadership to TS 288a46a90f26471584043331107dc0dd
I20260709 12:14:16.416095 23302 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6d7d1c502ee24072a41a2a55cfc3a5fa"
dest_uuid: "2904b089bdb249b78950db76f4a70e9f"
mode: GRACEFUL
new_leader_uuid: "288a46a90f26471584043331107dc0dd"
 from {username='slave'} at 127.0.0.1:46914
I20260709 12:14:16.416671 23302 raft_consensus.cc:606] T 6d7d1c502ee24072a41a2a55cfc3a5fa P 2904b089bdb249b78950db76f4a70e9f [term 1 LEADER]: Received request to transfer leadership to TS 288a46a90f26471584043331107dc0dd
I20260709 12:14:16.419281 23302 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "87c5024fe7274811b9598e504f3963a7"
dest_uuid: "2904b089bdb249b78950db76f4a70e9f"
mode: GRACEFUL
new_leader_uuid: "288a46a90f26471584043331107dc0dd"
 from {username='slave'} at 127.0.0.1:46914
I20260709 12:14:16.419885 23302 raft_consensus.cc:606] T 87c5024fe7274811b9598e504f3963a7 P 2904b089bdb249b78950db76f4a70e9f [term 1 LEADER]: Received request to transfer leadership to TS 288a46a90f26471584043331107dc0dd
I20260709 12:14:16.421326 24306 raft_consensus.cc:993] T 27202f3dd66a42a3832a9cc25ba6e3e5 P 2904b089bdb249b78950db76f4a70e9f: : Instructing follower 9ba0da223cf24c97bc7d225e25015924 to start an election
I20260709 12:14:16.421998 24306 raft_consensus.cc:1081] T 27202f3dd66a42a3832a9cc25ba6e3e5 P 2904b089bdb249b78950db76f4a70e9f [term 1 LEADER]: Signalling peer 9ba0da223cf24c97bc7d225e25015924 to start an election
I20260709 12:14:16.422668 23442 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8e5b2401420b4a25a6457b667110f778"
dest_uuid: "9ba0da223cf24c97bc7d225e25015924"
mode: GRACEFUL
new_leader_uuid: "2904b089bdb249b78950db76f4a70e9f"
 from {username='slave'} at 127.0.0.1:34156
I20260709 12:14:16.423307 23442 raft_consensus.cc:606] T 8e5b2401420b4a25a6457b667110f778 P 9ba0da223cf24c97bc7d225e25015924 [term 1 LEADER]: Received request to transfer leadership to TS 2904b089bdb249b78950db76f4a70e9f
I20260709 12:14:16.424006 23447 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "27202f3dd66a42a3832a9cc25ba6e3e5"
dest_uuid: "9ba0da223cf24c97bc7d225e25015924"
 from {username='slave'} at 127.0.0.1:48112
I20260709 12:14:16.424611 23447 raft_consensus.cc:493] T 27202f3dd66a42a3832a9cc25ba6e3e5 P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:16.424664 12986 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 7
I20260709 12:14:16.424947 23447 raft_consensus.cc:3060] T 27202f3dd66a42a3832a9cc25ba6e3e5 P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:16.426329 12986 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:16.427122 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:16.432134 23447 raft_consensus.cc:515] T 27202f3dd66a42a3832a9cc25ba6e3e5 P 9ba0da223cf24c97bc7d225e25015924 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:14:16.438114 23447 leader_election.cc:290] T 27202f3dd66a42a3832a9cc25ba6e3e5 P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 2 election: Requested vote from peers 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789), 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061)
I20260709 12:14:16.439296 23370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27202f3dd66a42a3832a9cc25ba6e3e5" candidate_uuid: "9ba0da223cf24c97bc7d225e25015924" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3a9a63ca97694ebdb84bca730762d735"
I20260709 12:14:16.439178 23302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27202f3dd66a42a3832a9cc25ba6e3e5" candidate_uuid: "9ba0da223cf24c97bc7d225e25015924" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2904b089bdb249b78950db76f4a70e9f"
I20260709 12:14:16.440040 23370 raft_consensus.cc:3060] T 27202f3dd66a42a3832a9cc25ba6e3e5 P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:16.440161 23302 raft_consensus.cc:3055] T 27202f3dd66a42a3832a9cc25ba6e3e5 P 2904b089bdb249b78950db76f4a70e9f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:16.440606 23302 raft_consensus.cc:740] T 27202f3dd66a42a3832a9cc25ba6e3e5 P 2904b089bdb249b78950db76f4a70e9f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2904b089bdb249b78950db76f4a70e9f, State: Running, Role: LEADER
I20260709 12:14:16.441401 23302 consensus_queue.cc:260] T 27202f3dd66a42a3832a9cc25ba6e3e5 P 2904b089bdb249b78950db76f4a70e9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:14:16.442795 23302 raft_consensus.cc:3060] T 27202f3dd66a42a3832a9cc25ba6e3e5 P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:16.446223 23370 raft_consensus.cc:2468] T 27202f3dd66a42a3832a9cc25ba6e3e5 P 3a9a63ca97694ebdb84bca730762d735 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ba0da223cf24c97bc7d225e25015924 in term 2.
I20260709 12:14:16.447428 23415 leader_election.cc:304] T 27202f3dd66a42a3832a9cc25ba6e3e5 P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a9a63ca97694ebdb84bca730762d735, 9ba0da223cf24c97bc7d225e25015924; no voters: 
I20260709 12:14:16.448208 24303 raft_consensus.cc:2804] T 27202f3dd66a42a3832a9cc25ba6e3e5 P 9ba0da223cf24c97bc7d225e25015924 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:16.448616 24303 raft_consensus.cc:697] T 27202f3dd66a42a3832a9cc25ba6e3e5 P 9ba0da223cf24c97bc7d225e25015924 [term 2 LEADER]: Becoming Leader. State: Replica: 9ba0da223cf24c97bc7d225e25015924, State: Running, Role: LEADER
I20260709 12:14:16.449458 24303 consensus_queue.cc:237] T 27202f3dd66a42a3832a9cc25ba6e3e5 P 9ba0da223cf24c97bc7d225e25015924 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:14:16.451118 23302 raft_consensus.cc:2468] T 27202f3dd66a42a3832a9cc25ba6e3e5 P 2904b089bdb249b78950db76f4a70e9f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ba0da223cf24c97bc7d225e25015924 in term 2.
I20260709 12:14:16.463815 23122 catalog_manager.cc:5697] T 27202f3dd66a42a3832a9cc25ba6e3e5 P 9ba0da223cf24c97bc7d225e25015924 reported cstate change: term changed from 1 to 2, leader changed from 2904b089bdb249b78950db76f4a70e9f (127.12.174.130) to 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132). New cstate: current_term: 2 leader_uuid: "9ba0da223cf24c97bc7d225e25015924" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:16.500988 24306 raft_consensus.cc:993] T 87c5024fe7274811b9598e504f3963a7 P 2904b089bdb249b78950db76f4a70e9f: : Instructing follower 288a46a90f26471584043331107dc0dd to start an election
I20260709 12:14:16.501448 24318 raft_consensus.cc:1081] T 87c5024fe7274811b9598e504f3963a7 P 2904b089bdb249b78950db76f4a70e9f [term 1 LEADER]: Signalling peer 288a46a90f26471584043331107dc0dd to start an election
I20260709 12:14:16.503149 24139 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "87c5024fe7274811b9598e504f3963a7"
dest_uuid: "288a46a90f26471584043331107dc0dd"
 from {username='slave'} at 127.0.0.1:49066
I20260709 12:14:16.503687 24139 raft_consensus.cc:493] T 87c5024fe7274811b9598e504f3963a7 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:16.504041 24139 raft_consensus.cc:3060] T 87c5024fe7274811b9598e504f3963a7 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:16.511446 24139 raft_consensus.cc:515] T 87c5024fe7274811b9598e504f3963a7 P 288a46a90f26471584043331107dc0dd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:14:16.513161 24139 leader_election.cc:290] T 87c5024fe7274811b9598e504f3963a7 P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 2 election: Requested vote from peers 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081), 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789)
I20260709 12:14:16.514195 23302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87c5024fe7274811b9598e504f3963a7" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2904b089bdb249b78950db76f4a70e9f"
I20260709 12:14:16.514972 23302 raft_consensus.cc:3055] T 87c5024fe7274811b9598e504f3963a7 P 2904b089bdb249b78950db76f4a70e9f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:16.514393 23442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87c5024fe7274811b9598e504f3963a7" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9ba0da223cf24c97bc7d225e25015924"
I20260709 12:14:16.515317 23302 raft_consensus.cc:740] T 87c5024fe7274811b9598e504f3963a7 P 2904b089bdb249b78950db76f4a70e9f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2904b089bdb249b78950db76f4a70e9f, State: Running, Role: LEADER
I20260709 12:14:16.515596 23442 raft_consensus.cc:3060] T 87c5024fe7274811b9598e504f3963a7 P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:16.516273 23302 consensus_queue.cc:260] T 87c5024fe7274811b9598e504f3963a7 P 2904b089bdb249b78950db76f4a70e9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:14:16.517319 23302 raft_consensus.cc:3060] T 87c5024fe7274811b9598e504f3963a7 P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:16.524298 23442 raft_consensus.cc:2468] T 87c5024fe7274811b9598e504f3963a7 P 9ba0da223cf24c97bc7d225e25015924 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 288a46a90f26471584043331107dc0dd in term 2.
I20260709 12:14:16.525815 23302 raft_consensus.cc:2468] T 87c5024fe7274811b9598e504f3963a7 P 2904b089bdb249b78950db76f4a70e9f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 288a46a90f26471584043331107dc0dd in term 2.
I20260709 12:14:16.526042 24051 leader_election.cc:304] T 87c5024fe7274811b9598e504f3963a7 P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 288a46a90f26471584043331107dc0dd, 9ba0da223cf24c97bc7d225e25015924; no voters: 
I20260709 12:14:16.526997 24313 raft_consensus.cc:2804] T 87c5024fe7274811b9598e504f3963a7 P 288a46a90f26471584043331107dc0dd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:16.527374 24313 raft_consensus.cc:697] T 87c5024fe7274811b9598e504f3963a7 P 288a46a90f26471584043331107dc0dd [term 2 LEADER]: Becoming Leader. State: Replica: 288a46a90f26471584043331107dc0dd, State: Running, Role: LEADER
I20260709 12:14:16.528213 24313 consensus_queue.cc:237] T 87c5024fe7274811b9598e504f3963a7 P 288a46a90f26471584043331107dc0dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:14:16.540095 23122 catalog_manager.cc:5697] T 87c5024fe7274811b9598e504f3963a7 P 288a46a90f26471584043331107dc0dd reported cstate change: term changed from 1 to 2, leader changed from 2904b089bdb249b78950db76f4a70e9f (127.12.174.130) to 288a46a90f26471584043331107dc0dd (127.12.174.129). New cstate: current_term: 2 leader_uuid: "288a46a90f26471584043331107dc0dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:16.634752 24306 raft_consensus.cc:993] T 5959fc0b70884d699725fb8d560e5de5 P 2904b089bdb249b78950db76f4a70e9f: : Instructing follower 288a46a90f26471584043331107dc0dd to start an election
I20260709 12:14:16.635321 24318 raft_consensus.cc:1081] T 5959fc0b70884d699725fb8d560e5de5 P 2904b089bdb249b78950db76f4a70e9f [term 3 LEADER]: Signalling peer 288a46a90f26471584043331107dc0dd to start an election
I20260709 12:14:16.636919 24139 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5959fc0b70884d699725fb8d560e5de5"
dest_uuid: "288a46a90f26471584043331107dc0dd"
 from {username='slave'} at 127.0.0.1:49066
I20260709 12:14:16.637523 24139 raft_consensus.cc:493] T 5959fc0b70884d699725fb8d560e5de5 P 288a46a90f26471584043331107dc0dd [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:16.638038 24139 raft_consensus.cc:3060] T 5959fc0b70884d699725fb8d560e5de5 P 288a46a90f26471584043331107dc0dd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:16.646458 24139 raft_consensus.cc:515] T 5959fc0b70884d699725fb8d560e5de5 P 288a46a90f26471584043331107dc0dd [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:14:16.653072 24139 leader_election.cc:290] T 5959fc0b70884d699725fb8d560e5de5 P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 4 election: Requested vote from peers 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081), 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789)
I20260709 12:14:16.654757 23299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5959fc0b70884d699725fb8d560e5de5" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "2904b089bdb249b78950db76f4a70e9f"
I20260709 12:14:16.655516 23299 raft_consensus.cc:3055] T 5959fc0b70884d699725fb8d560e5de5 P 2904b089bdb249b78950db76f4a70e9f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:16.655875 23299 raft_consensus.cc:740] T 5959fc0b70884d699725fb8d560e5de5 P 2904b089bdb249b78950db76f4a70e9f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2904b089bdb249b78950db76f4a70e9f, State: Running, Role: LEADER
I20260709 12:14:16.656845 23299 consensus_queue.cc:260] T 5959fc0b70884d699725fb8d560e5de5 P 2904b089bdb249b78950db76f4a70e9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:14:16.659688 23299 raft_consensus.cc:3060] T 5959fc0b70884d699725fb8d560e5de5 P 2904b089bdb249b78950db76f4a70e9f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:16.660324 23442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5959fc0b70884d699725fb8d560e5de5" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "9ba0da223cf24c97bc7d225e25015924"
I20260709 12:14:16.661058 23442 raft_consensus.cc:3060] T 5959fc0b70884d699725fb8d560e5de5 P 9ba0da223cf24c97bc7d225e25015924 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:16.668690 24306 raft_consensus.cc:993] T 3ad2f373a67b4c9cbb2183c2c73eb3e5 P 2904b089bdb249b78950db76f4a70e9f: : Instructing follower 288a46a90f26471584043331107dc0dd to start an election
I20260709 12:14:16.669361 24318 raft_consensus.cc:1081] T 3ad2f373a67b4c9cbb2183c2c73eb3e5 P 2904b089bdb249b78950db76f4a70e9f [term 1 LEADER]: Signalling peer 288a46a90f26471584043331107dc0dd to start an election
I20260709 12:14:16.669618 23299 raft_consensus.cc:2468] T 5959fc0b70884d699725fb8d560e5de5 P 2904b089bdb249b78950db76f4a70e9f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 288a46a90f26471584043331107dc0dd in term 4.
I20260709 12:14:16.671432 24139 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3ad2f373a67b4c9cbb2183c2c73eb3e5"
dest_uuid: "288a46a90f26471584043331107dc0dd"
 from {username='slave'} at 127.0.0.1:49066
I20260709 12:14:16.671937 24052 leader_election.cc:304] T 5959fc0b70884d699725fb8d560e5de5 P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 288a46a90f26471584043331107dc0dd, 2904b089bdb249b78950db76f4a70e9f; no voters: 
I20260709 12:14:16.672581 24139 raft_consensus.cc:493] T 3ad2f373a67b4c9cbb2183c2c73eb3e5 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:16.673032 24139 raft_consensus.cc:3060] T 3ad2f373a67b4c9cbb2183c2c73eb3e5 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:16.673509 23442 raft_consensus.cc:2468] T 5959fc0b70884d699725fb8d560e5de5 P 9ba0da223cf24c97bc7d225e25015924 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 288a46a90f26471584043331107dc0dd in term 4.
I20260709 12:14:16.673377 24313 raft_consensus.cc:2804] T 5959fc0b70884d699725fb8d560e5de5 P 288a46a90f26471584043331107dc0dd [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:14:16.674522 24313 raft_consensus.cc:697] T 5959fc0b70884d699725fb8d560e5de5 P 288a46a90f26471584043331107dc0dd [term 4 LEADER]: Becoming Leader. State: Replica: 288a46a90f26471584043331107dc0dd, State: Running, Role: LEADER
I20260709 12:14:16.675381 24313 consensus_queue.cc:237] T 5959fc0b70884d699725fb8d560e5de5 P 288a46a90f26471584043331107dc0dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:14:16.680058 24303 raft_consensus.cc:993] T 8e5b2401420b4a25a6457b667110f778 P 9ba0da223cf24c97bc7d225e25015924: : Instructing follower 2904b089bdb249b78950db76f4a70e9f to start an election
I20260709 12:14:16.680697 24303 raft_consensus.cc:1081] T 8e5b2401420b4a25a6457b667110f778 P 9ba0da223cf24c97bc7d225e25015924 [term 1 LEADER]: Signalling peer 2904b089bdb249b78950db76f4a70e9f to start an election
I20260709 12:14:16.683256 24139 raft_consensus.cc:515] T 3ad2f373a67b4c9cbb2183c2c73eb3e5 P 288a46a90f26471584043331107dc0dd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:14:16.685011 23299 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8e5b2401420b4a25a6457b667110f778"
dest_uuid: "2904b089bdb249b78950db76f4a70e9f"
 from {username='slave'} at 127.0.0.1:33422
I20260709 12:14:16.686641 24306 raft_consensus.cc:993] T 6d7d1c502ee24072a41a2a55cfc3a5fa P 2904b089bdb249b78950db76f4a70e9f: : Instructing follower 288a46a90f26471584043331107dc0dd to start an election
I20260709 12:14:16.689189 23299 raft_consensus.cc:493] T 8e5b2401420b4a25a6457b667110f778 P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:16.689728 23299 raft_consensus.cc:3060] T 8e5b2401420b4a25a6457b667110f778 P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:16.689271 24306 raft_consensus.cc:1081] T 6d7d1c502ee24072a41a2a55cfc3a5fa P 2904b089bdb249b78950db76f4a70e9f [term 1 LEADER]: Signalling peer 288a46a90f26471584043331107dc0dd to start an election
I20260709 12:14:16.693346 24139 leader_election.cc:290] T 3ad2f373a67b4c9cbb2183c2c73eb3e5 P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 2 election: Requested vote from peers 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081), 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789)
I20260709 12:14:16.694437 23442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad2f373a67b4c9cbb2183c2c73eb3e5" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9ba0da223cf24c97bc7d225e25015924"
I20260709 12:14:16.695151 23442 raft_consensus.cc:3060] T 3ad2f373a67b4c9cbb2183c2c73eb3e5 P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:16.688305 23122 catalog_manager.cc:5697] T 5959fc0b70884d699725fb8d560e5de5 P 288a46a90f26471584043331107dc0dd reported cstate change: term changed from 3 to 4, leader changed from 2904b089bdb249b78950db76f4a70e9f (127.12.174.130) to 288a46a90f26471584043331107dc0dd (127.12.174.129). New cstate: current_term: 4 leader_uuid: "288a46a90f26471584043331107dc0dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:16.699199 24139 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6d7d1c502ee24072a41a2a55cfc3a5fa"
dest_uuid: "288a46a90f26471584043331107dc0dd"
 from {username='slave'} at 127.0.0.1:49066
I20260709 12:14:16.699836 24139 raft_consensus.cc:493] T 6d7d1c502ee24072a41a2a55cfc3a5fa P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:16.700215 24139 raft_consensus.cc:3060] T 6d7d1c502ee24072a41a2a55cfc3a5fa P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:16.704011 23299 raft_consensus.cc:515] T 8e5b2401420b4a25a6457b667110f778 P 2904b089bdb249b78950db76f4a70e9f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:14:16.705250 23302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad2f373a67b4c9cbb2183c2c73eb3e5" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2904b089bdb249b78950db76f4a70e9f"
I20260709 12:14:16.705952 23302 raft_consensus.cc:3055] T 3ad2f373a67b4c9cbb2183c2c73eb3e5 P 2904b089bdb249b78950db76f4a70e9f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:16.706235 23302 raft_consensus.cc:740] T 3ad2f373a67b4c9cbb2183c2c73eb3e5 P 2904b089bdb249b78950db76f4a70e9f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2904b089bdb249b78950db76f4a70e9f, State: Running, Role: LEADER
I20260709 12:14:16.707021 23302 consensus_queue.cc:260] T 3ad2f373a67b4c9cbb2183c2c73eb3e5 P 2904b089bdb249b78950db76f4a70e9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:14:16.707857 23299 leader_election.cc:290] T 8e5b2401420b4a25a6457b667110f778 P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 2 election: Requested vote from peers 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061), 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081)
I20260709 12:14:16.708402 23302 raft_consensus.cc:3060] T 3ad2f373a67b4c9cbb2183c2c73eb3e5 P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:16.708114 23446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5b2401420b4a25a6457b667110f778" candidate_uuid: "2904b089bdb249b78950db76f4a70e9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9ba0da223cf24c97bc7d225e25015924"
I20260709 12:14:16.710170 23374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5b2401420b4a25a6457b667110f778" candidate_uuid: "2904b089bdb249b78950db76f4a70e9f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3a9a63ca97694ebdb84bca730762d735"
I20260709 12:14:16.710821 23374 raft_consensus.cc:3060] T 8e5b2401420b4a25a6457b667110f778 P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:16.710342 23446 raft_consensus.cc:3055] T 8e5b2401420b4a25a6457b667110f778 P 9ba0da223cf24c97bc7d225e25015924 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:16.713421 23442 raft_consensus.cc:2468] T 3ad2f373a67b4c9cbb2183c2c73eb3e5 P 9ba0da223cf24c97bc7d225e25015924 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 288a46a90f26471584043331107dc0dd in term 2.
I20260709 12:14:16.713670 23446 raft_consensus.cc:740] T 8e5b2401420b4a25a6457b667110f778 P 9ba0da223cf24c97bc7d225e25015924 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9ba0da223cf24c97bc7d225e25015924, State: Running, Role: LEADER
I20260709 12:14:16.714570 23446 consensus_queue.cc:260] T 8e5b2401420b4a25a6457b667110f778 P 9ba0da223cf24c97bc7d225e25015924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:14:16.716342 24051 leader_election.cc:304] T 3ad2f373a67b4c9cbb2183c2c73eb3e5 P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 288a46a90f26471584043331107dc0dd, 9ba0da223cf24c97bc7d225e25015924; no voters: 
I20260709 12:14:16.717813 24313 raft_consensus.cc:2804] T 3ad2f373a67b4c9cbb2183c2c73eb3e5 P 288a46a90f26471584043331107dc0dd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:16.717952 23446 raft_consensus.cc:3060] T 8e5b2401420b4a25a6457b667110f778 P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:16.718400 24313 raft_consensus.cc:697] T 3ad2f373a67b4c9cbb2183c2c73eb3e5 P 288a46a90f26471584043331107dc0dd [term 2 LEADER]: Becoming Leader. State: Replica: 288a46a90f26471584043331107dc0dd, State: Running, Role: LEADER
I20260709 12:14:16.719311 24313 consensus_queue.cc:237] T 3ad2f373a67b4c9cbb2183c2c73eb3e5 P 288a46a90f26471584043331107dc0dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:14:16.720844 24139 raft_consensus.cc:515] T 6d7d1c502ee24072a41a2a55cfc3a5fa P 288a46a90f26471584043331107dc0dd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:14:16.725214 23370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d7d1c502ee24072a41a2a55cfc3a5fa" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3a9a63ca97694ebdb84bca730762d735"
I20260709 12:14:16.725399 23302 raft_consensus.cc:2468] T 3ad2f373a67b4c9cbb2183c2c73eb3e5 P 2904b089bdb249b78950db76f4a70e9f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 288a46a90f26471584043331107dc0dd in term 2.
I20260709 12:14:16.725293 23299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d7d1c502ee24072a41a2a55cfc3a5fa" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2904b089bdb249b78950db76f4a70e9f"
I20260709 12:14:16.726432 23299 raft_consensus.cc:3055] T 6d7d1c502ee24072a41a2a55cfc3a5fa P 2904b089bdb249b78950db76f4a70e9f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:16.732183 23299 raft_consensus.cc:740] T 6d7d1c502ee24072a41a2a55cfc3a5fa P 2904b089bdb249b78950db76f4a70e9f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2904b089bdb249b78950db76f4a70e9f, State: Running, Role: LEADER
I20260709 12:14:16.733068 23299 consensus_queue.cc:260] T 6d7d1c502ee24072a41a2a55cfc3a5fa P 2904b089bdb249b78950db76f4a70e9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:14:16.734272 23299 raft_consensus.cc:3060] T 6d7d1c502ee24072a41a2a55cfc3a5fa P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:16.735553 23446 raft_consensus.cc:2468] T 8e5b2401420b4a25a6457b667110f778 P 9ba0da223cf24c97bc7d225e25015924 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2904b089bdb249b78950db76f4a70e9f in term 2.
I20260709 12:14:16.726704 23370 raft_consensus.cc:3060] T 6d7d1c502ee24072a41a2a55cfc3a5fa P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:16.742293 23266 leader_election.cc:304] T 8e5b2401420b4a25a6457b667110f778 P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2904b089bdb249b78950db76f4a70e9f, 9ba0da223cf24c97bc7d225e25015924; no voters: 
I20260709 12:14:16.744060 24359 raft_consensus.cc:2804] T 8e5b2401420b4a25a6457b667110f778 P 2904b089bdb249b78950db76f4a70e9f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:16.744796 24359 raft_consensus.cc:697] T 8e5b2401420b4a25a6457b667110f778 P 2904b089bdb249b78950db76f4a70e9f [term 2 LEADER]: Becoming Leader. State: Replica: 2904b089bdb249b78950db76f4a70e9f, State: Running, Role: LEADER
I20260709 12:14:16.735595 23122 catalog_manager.cc:5697] T 3ad2f373a67b4c9cbb2183c2c73eb3e5 P 288a46a90f26471584043331107dc0dd reported cstate change: term changed from 1 to 2, leader changed from 2904b089bdb249b78950db76f4a70e9f (127.12.174.130) to 288a46a90f26471584043331107dc0dd (127.12.174.129). New cstate: current_term: 2 leader_uuid: "288a46a90f26471584043331107dc0dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:16.746361 23374 raft_consensus.cc:2468] T 8e5b2401420b4a25a6457b667110f778 P 3a9a63ca97694ebdb84bca730762d735 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2904b089bdb249b78950db76f4a70e9f in term 2.
I20260709 12:14:16.745666 24359 consensus_queue.cc:237] T 8e5b2401420b4a25a6457b667110f778 P 2904b089bdb249b78950db76f4a70e9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:14:16.726141 24139 leader_election.cc:290] T 6d7d1c502ee24072a41a2a55cfc3a5fa P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 2 election: Requested vote from peers 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789), 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061)
I20260709 12:14:16.760015 23299 raft_consensus.cc:2468] T 6d7d1c502ee24072a41a2a55cfc3a5fa P 2904b089bdb249b78950db76f4a70e9f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 288a46a90f26471584043331107dc0dd in term 2.
I20260709 12:14:16.767442 23370 raft_consensus.cc:2468] T 6d7d1c502ee24072a41a2a55cfc3a5fa P 3a9a63ca97694ebdb84bca730762d735 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 288a46a90f26471584043331107dc0dd in term 2.
I20260709 12:14:16.783660 24052 leader_election.cc:304] T 6d7d1c502ee24072a41a2a55cfc3a5fa P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 288a46a90f26471584043331107dc0dd, 2904b089bdb249b78950db76f4a70e9f; no voters: 
I20260709 12:14:16.784893 24327 raft_consensus.cc:2804] T 6d7d1c502ee24072a41a2a55cfc3a5fa P 288a46a90f26471584043331107dc0dd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:16.785429 24327 raft_consensus.cc:697] T 6d7d1c502ee24072a41a2a55cfc3a5fa P 288a46a90f26471584043331107dc0dd [term 2 LEADER]: Becoming Leader. State: Replica: 288a46a90f26471584043331107dc0dd, State: Running, Role: LEADER
I20260709 12:14:16.786391 24327 consensus_queue.cc:237] T 6d7d1c502ee24072a41a2a55cfc3a5fa P 288a46a90f26471584043331107dc0dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:14:16.780356 23122 catalog_manager.cc:5697] T 8e5b2401420b4a25a6457b667110f778 P 2904b089bdb249b78950db76f4a70e9f reported cstate change: term changed from 1 to 2, leader changed from 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132) to 2904b089bdb249b78950db76f4a70e9f (127.12.174.130). New cstate: current_term: 2 leader_uuid: "2904b089bdb249b78950db76f4a70e9f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:16.803057 23122 catalog_manager.cc:5697] T 6d7d1c502ee24072a41a2a55cfc3a5fa P 288a46a90f26471584043331107dc0dd reported cstate change: term changed from 1 to 2, leader changed from 2904b089bdb249b78950db76f4a70e9f (127.12.174.130) to 288a46a90f26471584043331107dc0dd (127.12.174.129). New cstate: current_term: 2 leader_uuid: "288a46a90f26471584043331107dc0dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:16.839210 23370 raft_consensus.cc:1275] T 27202f3dd66a42a3832a9cc25ba6e3e5 P 3a9a63ca97694ebdb84bca730762d735 [term 2 FOLLOWER]: Refusing update from remote peer 9ba0da223cf24c97bc7d225e25015924: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:16.840572 24362 consensus_queue.cc:1048] T 27202f3dd66a42a3832a9cc25ba6e3e5 P 9ba0da223cf24c97bc7d225e25015924 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:16.851760 23299 raft_consensus.cc:1275] T 27202f3dd66a42a3832a9cc25ba6e3e5 P 2904b089bdb249b78950db76f4a70e9f [term 2 FOLLOWER]: Refusing update from remote peer 9ba0da223cf24c97bc7d225e25015924: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:16.856657 24362 consensus_queue.cc:1048] T 27202f3dd66a42a3832a9cc25ba6e3e5 P 9ba0da223cf24c97bc7d225e25015924 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:16.887204 24235 raft_consensus.cc:993] T 27166b782a5049198cccb3e5905acbc7 P 3a9a63ca97694ebdb84bca730762d735: : Instructing follower 288a46a90f26471584043331107dc0dd to start an election
I20260709 12:14:16.887881 24340 raft_consensus.cc:1081] T 27166b782a5049198cccb3e5905acbc7 P 3a9a63ca97694ebdb84bca730762d735 [term 1 LEADER]: Signalling peer 288a46a90f26471584043331107dc0dd to start an election
I20260709 12:14:16.889583 24139 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "27166b782a5049198cccb3e5905acbc7"
dest_uuid: "288a46a90f26471584043331107dc0dd"
 from {username='slave'} at 127.0.0.1:49088
I20260709 12:14:16.890172 24139 raft_consensus.cc:493] T 27166b782a5049198cccb3e5905acbc7 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:16.890489 24139 raft_consensus.cc:3060] T 27166b782a5049198cccb3e5905acbc7 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:16.899490 24139 raft_consensus.cc:515] T 27166b782a5049198cccb3e5905acbc7 P 288a46a90f26471584043331107dc0dd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:14:16.901520 24139 leader_election.cc:290] T 27166b782a5049198cccb3e5905acbc7 P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 2 election: Requested vote from peers 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789), 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061)
I20260709 12:14:16.902846 23299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27166b782a5049198cccb3e5905acbc7" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2904b089bdb249b78950db76f4a70e9f"
I20260709 12:14:16.903501 23299 raft_consensus.cc:3060] T 27166b782a5049198cccb3e5905acbc7 P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:16.903756 23370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27166b782a5049198cccb3e5905acbc7" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3a9a63ca97694ebdb84bca730762d735"
I20260709 12:14:16.904343 23370 raft_consensus.cc:3055] T 27166b782a5049198cccb3e5905acbc7 P 3a9a63ca97694ebdb84bca730762d735 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:16.904660 23370 raft_consensus.cc:740] T 27166b782a5049198cccb3e5905acbc7 P 3a9a63ca97694ebdb84bca730762d735 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3a9a63ca97694ebdb84bca730762d735, State: Running, Role: LEADER
I20260709 12:14:16.905483 23370 consensus_queue.cc:260] T 27166b782a5049198cccb3e5905acbc7 P 3a9a63ca97694ebdb84bca730762d735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:14:16.906749 23370 raft_consensus.cc:3060] T 27166b782a5049198cccb3e5905acbc7 P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:16.910380 23299 raft_consensus.cc:2468] T 27166b782a5049198cccb3e5905acbc7 P 2904b089bdb249b78950db76f4a70e9f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 288a46a90f26471584043331107dc0dd in term 2.
I20260709 12:14:16.911693 24052 leader_election.cc:304] T 27166b782a5049198cccb3e5905acbc7 P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 288a46a90f26471584043331107dc0dd, 2904b089bdb249b78950db76f4a70e9f; no voters: 
I20260709 12:14:16.912552 24327 raft_consensus.cc:2804] T 27166b782a5049198cccb3e5905acbc7 P 288a46a90f26471584043331107dc0dd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:16.913049 24327 raft_consensus.cc:697] T 27166b782a5049198cccb3e5905acbc7 P 288a46a90f26471584043331107dc0dd [term 2 LEADER]: Becoming Leader. State: Replica: 288a46a90f26471584043331107dc0dd, State: Running, Role: LEADER
I20260709 12:14:16.914028 24327 consensus_queue.cc:237] T 27166b782a5049198cccb3e5905acbc7 P 288a46a90f26471584043331107dc0dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:14:16.916754 23442 raft_consensus.cc:1275] T 87c5024fe7274811b9598e504f3963a7 P 9ba0da223cf24c97bc7d225e25015924 [term 2 FOLLOWER]: Refusing update from remote peer 288a46a90f26471584043331107dc0dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:16.916754 23299 raft_consensus.cc:1275] T 87c5024fe7274811b9598e504f3963a7 P 2904b089bdb249b78950db76f4a70e9f [term 2 FOLLOWER]: Refusing update from remote peer 288a46a90f26471584043331107dc0dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:16.918361 24347 consensus_queue.cc:1048] T 87c5024fe7274811b9598e504f3963a7 P 288a46a90f26471584043331107dc0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:16.923450 23370 raft_consensus.cc:2468] T 27166b782a5049198cccb3e5905acbc7 P 3a9a63ca97694ebdb84bca730762d735 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 288a46a90f26471584043331107dc0dd in term 2.
I20260709 12:14:16.924083 24347 consensus_queue.cc:1048] T 87c5024fe7274811b9598e504f3963a7 P 288a46a90f26471584043331107dc0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:16.947862 23125 catalog_manager.cc:5697] T 27166b782a5049198cccb3e5905acbc7 P 288a46a90f26471584043331107dc0dd reported cstate change: term changed from 1 to 2, leader changed from 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131) to 288a46a90f26471584043331107dc0dd (127.12.174.129). New cstate: current_term: 2 leader_uuid: "288a46a90f26471584043331107dc0dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:17.221521 23301 raft_consensus.cc:1275] T 3ad2f373a67b4c9cbb2183c2c73eb3e5 P 2904b089bdb249b78950db76f4a70e9f [term 2 FOLLOWER]: Refusing update from remote peer 288a46a90f26471584043331107dc0dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:17.223541 24372 consensus_queue.cc:1048] T 3ad2f373a67b4c9cbb2183c2c73eb3e5 P 288a46a90f26471584043331107dc0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:17.225226 23301 raft_consensus.cc:1275] T 5959fc0b70884d699725fb8d560e5de5 P 2904b089bdb249b78950db76f4a70e9f [term 4 FOLLOWER]: Refusing update from remote peer 288a46a90f26471584043331107dc0dd: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:14:17.226711 24372 consensus_queue.cc:1048] T 5959fc0b70884d699725fb8d560e5de5 P 288a46a90f26471584043331107dc0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:17.240391 23442 raft_consensus.cc:1275] T 3ad2f373a67b4c9cbb2183c2c73eb3e5 P 9ba0da223cf24c97bc7d225e25015924 [term 2 FOLLOWER]: Refusing update from remote peer 288a46a90f26471584043331107dc0dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:17.242810 24313 consensus_queue.cc:1048] T 3ad2f373a67b4c9cbb2183c2c73eb3e5 P 288a46a90f26471584043331107dc0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:17.245277 23446 raft_consensus.cc:1275] T 5959fc0b70884d699725fb8d560e5de5 P 9ba0da223cf24c97bc7d225e25015924 [term 4 FOLLOWER]: Refusing update from remote peer 288a46a90f26471584043331107dc0dd: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:14:17.250836 24327 consensus_queue.cc:1048] T 5959fc0b70884d699725fb8d560e5de5 P 288a46a90f26471584043331107dc0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:17.313526 23446 raft_consensus.cc:1275] T 8e5b2401420b4a25a6457b667110f778 P 9ba0da223cf24c97bc7d225e25015924 [term 2 FOLLOWER]: Refusing update from remote peer 2904b089bdb249b78950db76f4a70e9f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:17.315455 24318 consensus_queue.cc:1048] T 8e5b2401420b4a25a6457b667110f778 P 2904b089bdb249b78950db76f4a70e9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:14:17.330082 23374 raft_consensus.cc:1275] T 8e5b2401420b4a25a6457b667110f778 P 3a9a63ca97694ebdb84bca730762d735 [term 2 FOLLOWER]: Refusing update from remote peer 2904b089bdb249b78950db76f4a70e9f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:17.332789 24359 consensus_queue.cc:1048] T 8e5b2401420b4a25a6457b667110f778 P 2904b089bdb249b78950db76f4a70e9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:17.342638 23299 raft_consensus.cc:1275] T 6d7d1c502ee24072a41a2a55cfc3a5fa P 2904b089bdb249b78950db76f4a70e9f [term 2 FOLLOWER]: Refusing update from remote peer 288a46a90f26471584043331107dc0dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:17.344483 24347 consensus_queue.cc:1048] T 6d7d1c502ee24072a41a2a55cfc3a5fa P 288a46a90f26471584043331107dc0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:17.369328 23374 raft_consensus.cc:1275] T 6d7d1c502ee24072a41a2a55cfc3a5fa P 3a9a63ca97694ebdb84bca730762d735 [term 2 FOLLOWER]: Refusing update from remote peer 288a46a90f26471584043331107dc0dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:17.371541 24372 consensus_queue.cc:1048] T 6d7d1c502ee24072a41a2a55cfc3a5fa P 288a46a90f26471584043331107dc0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:17.463398 23374 raft_consensus.cc:1275] T 27166b782a5049198cccb3e5905acbc7 P 3a9a63ca97694ebdb84bca730762d735 [term 2 FOLLOWER]: Refusing update from remote peer 288a46a90f26471584043331107dc0dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:17.465126 24327 consensus_queue.cc:1048] T 27166b782a5049198cccb3e5905acbc7 P 288a46a90f26471584043331107dc0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:17.465539 23299 raft_consensus.cc:1275] T 27166b782a5049198cccb3e5905acbc7 P 2904b089bdb249b78950db76f4a70e9f [term 2 FOLLOWER]: Refusing update from remote peer 288a46a90f26471584043331107dc0dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:17.467088 24327 consensus_queue.cc:1048] T 27166b782a5049198cccb3e5905acbc7 P 288a46a90f26471584043331107dc0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:17.481016 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:17.542356 23374 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "18f5de2825814c38a0bd15d4c962dbef"
dest_uuid: "3a9a63ca97694ebdb84bca730762d735"
mode: GRACEFUL
new_leader_uuid: "2904b089bdb249b78950db76f4a70e9f"
 from {username='slave'} at 127.0.0.1:48412
I20260709 12:14:17.543077 23374 raft_consensus.cc:606] T 18f5de2825814c38a0bd15d4c962dbef P 3a9a63ca97694ebdb84bca730762d735 [term 2 LEADER]: Received request to transfer leadership to TS 2904b089bdb249b78950db76f4a70e9f
I20260709 12:14:17.546105 23446 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b1533753456b445991715da5158c921b"
dest_uuid: "9ba0da223cf24c97bc7d225e25015924"
mode: GRACEFUL
new_leader_uuid: "288a46a90f26471584043331107dc0dd"
 from {username='slave'} at 127.0.0.1:34156
I20260709 12:14:17.546640 23446 raft_consensus.cc:606] T b1533753456b445991715da5158c921b P 9ba0da223cf24c97bc7d225e25015924 [term 2 LEADER]: Received request to transfer leadership to TS 288a46a90f26471584043331107dc0dd
I20260709 12:14:17.549337 23299 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d85273afe57c4f35bb72827d1c5879eb"
dest_uuid: "2904b089bdb249b78950db76f4a70e9f"
mode: GRACEFUL
new_leader_uuid: "288a46a90f26471584043331107dc0dd"
 from {username='slave'} at 127.0.0.1:46914
I20260709 12:14:17.550166 23299 raft_consensus.cc:606] T d85273afe57c4f35bb72827d1c5879eb P 2904b089bdb249b78950db76f4a70e9f [term 1 LEADER]: Received request to transfer leadership to TS 288a46a90f26471584043331107dc0dd
I20260709 12:14:17.551529 12986 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:14:17.554551 12986 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:17.555472 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:17.632755 24382 raft_consensus.cc:993] T b1533753456b445991715da5158c921b P 9ba0da223cf24c97bc7d225e25015924: : Instructing follower 288a46a90f26471584043331107dc0dd to start an election
I20260709 12:14:17.633395 24362 raft_consensus.cc:1081] T b1533753456b445991715da5158c921b P 9ba0da223cf24c97bc7d225e25015924 [term 2 LEADER]: Signalling peer 288a46a90f26471584043331107dc0dd to start an election
I20260709 12:14:17.635025 24138 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b1533753456b445991715da5158c921b"
dest_uuid: "288a46a90f26471584043331107dc0dd"
 from {username='slave'} at 127.0.0.1:49078
I20260709 12:14:17.635663 24138 raft_consensus.cc:493] T b1533753456b445991715da5158c921b P 288a46a90f26471584043331107dc0dd [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:17.636059 24138 raft_consensus.cc:3060] T b1533753456b445991715da5158c921b P 288a46a90f26471584043331107dc0dd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:17.642645 24138 raft_consensus.cc:515] T b1533753456b445991715da5158c921b P 288a46a90f26471584043331107dc0dd [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:14:17.644382 24138 leader_election.cc:290] T b1533753456b445991715da5158c921b P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 3 election: Requested vote from peers 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081), 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789)
I20260709 12:14:17.645470 23299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1533753456b445991715da5158c921b" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2904b089bdb249b78950db76f4a70e9f"
I20260709 12:14:17.646241 23299 raft_consensus.cc:3060] T b1533753456b445991715da5158c921b P 2904b089bdb249b78950db76f4a70e9f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:17.645464 23446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1533753456b445991715da5158c921b" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9ba0da223cf24c97bc7d225e25015924"
I20260709 12:14:17.651435 23446 raft_consensus.cc:3055] T b1533753456b445991715da5158c921b P 9ba0da223cf24c97bc7d225e25015924 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:17.651773 23446 raft_consensus.cc:740] T b1533753456b445991715da5158c921b P 9ba0da223cf24c97bc7d225e25015924 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9ba0da223cf24c97bc7d225e25015924, State: Running, Role: LEADER
I20260709 12:14:17.652684 23446 consensus_queue.cc:260] T b1533753456b445991715da5158c921b P 9ba0da223cf24c97bc7d225e25015924 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:14:17.654166 23446 raft_consensus.cc:3060] T b1533753456b445991715da5158c921b P 9ba0da223cf24c97bc7d225e25015924 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:17.654969 23299 raft_consensus.cc:2468] T b1533753456b445991715da5158c921b P 2904b089bdb249b78950db76f4a70e9f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 288a46a90f26471584043331107dc0dd in term 3.
I20260709 12:14:17.656553 24052 leader_election.cc:304] T b1533753456b445991715da5158c921b P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 288a46a90f26471584043331107dc0dd, 2904b089bdb249b78950db76f4a70e9f; no voters: 
I20260709 12:14:17.657436 24372 raft_consensus.cc:2804] T b1533753456b445991715da5158c921b P 288a46a90f26471584043331107dc0dd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:17.657909 24372 raft_consensus.cc:697] T b1533753456b445991715da5158c921b P 288a46a90f26471584043331107dc0dd [term 3 LEADER]: Becoming Leader. State: Replica: 288a46a90f26471584043331107dc0dd, State: Running, Role: LEADER
I20260709 12:14:17.659251 24372 consensus_queue.cc:237] T b1533753456b445991715da5158c921b P 288a46a90f26471584043331107dc0dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:14:17.663688 23446 raft_consensus.cc:2468] T b1533753456b445991715da5158c921b P 9ba0da223cf24c97bc7d225e25015924 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 288a46a90f26471584043331107dc0dd in term 3.
I20260709 12:14:17.677723 23124 catalog_manager.cc:5697] T b1533753456b445991715da5158c921b P 288a46a90f26471584043331107dc0dd reported cstate change: term changed from 2 to 3, leader changed from 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132) to 288a46a90f26471584043331107dc0dd (127.12.174.129). New cstate: current_term: 3 leader_uuid: "288a46a90f26471584043331107dc0dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:17.723914 24385 raft_consensus.cc:993] T 18f5de2825814c38a0bd15d4c962dbef P 3a9a63ca97694ebdb84bca730762d735: : Instructing follower 2904b089bdb249b78950db76f4a70e9f to start an election
I20260709 12:14:17.724462 24340 raft_consensus.cc:1081] T 18f5de2825814c38a0bd15d4c962dbef P 3a9a63ca97694ebdb84bca730762d735 [term 2 LEADER]: Signalling peer 2904b089bdb249b78950db76f4a70e9f to start an election
I20260709 12:14:17.726132 23299 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "18f5de2825814c38a0bd15d4c962dbef"
dest_uuid: "2904b089bdb249b78950db76f4a70e9f"
 from {username='slave'} at 127.0.0.1:33418
I20260709 12:14:17.726641 23299 raft_consensus.cc:493] T 18f5de2825814c38a0bd15d4c962dbef P 2904b089bdb249b78950db76f4a70e9f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:17.726954 23299 raft_consensus.cc:3060] T 18f5de2825814c38a0bd15d4c962dbef P 2904b089bdb249b78950db76f4a70e9f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:17.732926 23299 raft_consensus.cc:515] T 18f5de2825814c38a0bd15d4c962dbef P 2904b089bdb249b78950db76f4a70e9f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:14:17.735291 23299 leader_election.cc:290] T 18f5de2825814c38a0bd15d4c962dbef P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 3 election: Requested vote from peers 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061), 9ba0da223cf24c97bc7d225e25015924 (127.12.174.132:46081)
I20260709 12:14:17.735842 23446 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f5de2825814c38a0bd15d4c962dbef" candidate_uuid: "2904b089bdb249b78950db76f4a70e9f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9ba0da223cf24c97bc7d225e25015924"
I20260709 12:14:17.735858 23374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18f5de2825814c38a0bd15d4c962dbef" candidate_uuid: "2904b089bdb249b78950db76f4a70e9f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3a9a63ca97694ebdb84bca730762d735"
I20260709 12:14:17.736560 23446 raft_consensus.cc:3060] T 18f5de2825814c38a0bd15d4c962dbef P 9ba0da223cf24c97bc7d225e25015924 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:17.736689 23374 raft_consensus.cc:3055] T 18f5de2825814c38a0bd15d4c962dbef P 3a9a63ca97694ebdb84bca730762d735 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:17.737125 23374 raft_consensus.cc:740] T 18f5de2825814c38a0bd15d4c962dbef P 3a9a63ca97694ebdb84bca730762d735 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3a9a63ca97694ebdb84bca730762d735, State: Running, Role: LEADER
I20260709 12:14:17.737767 23374 consensus_queue.cc:260] T 18f5de2825814c38a0bd15d4c962dbef P 3a9a63ca97694ebdb84bca730762d735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:14:17.738786 23374 raft_consensus.cc:3060] T 18f5de2825814c38a0bd15d4c962dbef P 3a9a63ca97694ebdb84bca730762d735 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:17.742559 23446 raft_consensus.cc:2468] T 18f5de2825814c38a0bd15d4c962dbef P 9ba0da223cf24c97bc7d225e25015924 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2904b089bdb249b78950db76f4a70e9f in term 3.
I20260709 12:14:17.743976 23266 leader_election.cc:304] T 18f5de2825814c38a0bd15d4c962dbef P 2904b089bdb249b78950db76f4a70e9f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2904b089bdb249b78950db76f4a70e9f, 9ba0da223cf24c97bc7d225e25015924; no voters: 
I20260709 12:14:17.744856 24318 raft_consensus.cc:2804] T 18f5de2825814c38a0bd15d4c962dbef P 2904b089bdb249b78950db76f4a70e9f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:17.745296 23374 raft_consensus.cc:2468] T 18f5de2825814c38a0bd15d4c962dbef P 3a9a63ca97694ebdb84bca730762d735 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2904b089bdb249b78950db76f4a70e9f in term 3.
I20260709 12:14:17.745348 24318 raft_consensus.cc:697] T 18f5de2825814c38a0bd15d4c962dbef P 2904b089bdb249b78950db76f4a70e9f [term 3 LEADER]: Becoming Leader. State: Replica: 2904b089bdb249b78950db76f4a70e9f, State: Running, Role: LEADER
I20260709 12:14:17.746444 24318 consensus_queue.cc:237] T 18f5de2825814c38a0bd15d4c962dbef P 2904b089bdb249b78950db76f4a70e9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } }
I20260709 12:14:17.757074 23124 catalog_manager.cc:5697] T 18f5de2825814c38a0bd15d4c962dbef P 2904b089bdb249b78950db76f4a70e9f reported cstate change: term changed from 2 to 3, leader changed from 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131) to 2904b089bdb249b78950db76f4a70e9f (127.12.174.130). New cstate: current_term: 3 leader_uuid: "2904b089bdb249b78950db76f4a70e9f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:17.958233 24359 raft_consensus.cc:993] T d85273afe57c4f35bb72827d1c5879eb P 2904b089bdb249b78950db76f4a70e9f: : Instructing follower 288a46a90f26471584043331107dc0dd to start an election
I20260709 12:14:17.958817 24318 raft_consensus.cc:1081] T d85273afe57c4f35bb72827d1c5879eb P 2904b089bdb249b78950db76f4a70e9f [term 1 LEADER]: Signalling peer 288a46a90f26471584043331107dc0dd to start an election
I20260709 12:14:17.960543 24138 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d85273afe57c4f35bb72827d1c5879eb"
dest_uuid: "288a46a90f26471584043331107dc0dd"
 from {username='slave'} at 127.0.0.1:49066
I20260709 12:14:17.961138 24138 raft_consensus.cc:493] T d85273afe57c4f35bb72827d1c5879eb P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:17.961517 24138 raft_consensus.cc:3060] T d85273afe57c4f35bb72827d1c5879eb P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:17.969276 24138 raft_consensus.cc:515] T d85273afe57c4f35bb72827d1c5879eb P 288a46a90f26471584043331107dc0dd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:14:17.971133 24138 leader_election.cc:290] T d85273afe57c4f35bb72827d1c5879eb P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 2 election: Requested vote from peers 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789), 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061)
I20260709 12:14:17.971936 23301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d85273afe57c4f35bb72827d1c5879eb" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2904b089bdb249b78950db76f4a70e9f"
I20260709 12:14:17.972312 23374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d85273afe57c4f35bb72827d1c5879eb" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3a9a63ca97694ebdb84bca730762d735"
I20260709 12:14:17.972671 23301 raft_consensus.cc:3055] T d85273afe57c4f35bb72827d1c5879eb P 2904b089bdb249b78950db76f4a70e9f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:17.972944 23374 raft_consensus.cc:3060] T d85273afe57c4f35bb72827d1c5879eb P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:17.973035 23301 raft_consensus.cc:740] T d85273afe57c4f35bb72827d1c5879eb P 2904b089bdb249b78950db76f4a70e9f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2904b089bdb249b78950db76f4a70e9f, State: Running, Role: LEADER
I20260709 12:14:17.974030 23301 consensus_queue.cc:260] T d85273afe57c4f35bb72827d1c5879eb P 2904b089bdb249b78950db76f4a70e9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:14:17.975349 23301 raft_consensus.cc:3060] T d85273afe57c4f35bb72827d1c5879eb P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:17.981886 23374 raft_consensus.cc:2468] T d85273afe57c4f35bb72827d1c5879eb P 3a9a63ca97694ebdb84bca730762d735 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 288a46a90f26471584043331107dc0dd in term 2.
I20260709 12:14:17.983247 23301 raft_consensus.cc:2468] T d85273afe57c4f35bb72827d1c5879eb P 2904b089bdb249b78950db76f4a70e9f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 288a46a90f26471584043331107dc0dd in term 2.
I20260709 12:14:17.983515 24052 leader_election.cc:304] T d85273afe57c4f35bb72827d1c5879eb P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 288a46a90f26471584043331107dc0dd, 3a9a63ca97694ebdb84bca730762d735; no voters: 
I20260709 12:14:17.984390 24327 raft_consensus.cc:2804] T d85273afe57c4f35bb72827d1c5879eb P 288a46a90f26471584043331107dc0dd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:17.984890 24327 raft_consensus.cc:697] T d85273afe57c4f35bb72827d1c5879eb P 288a46a90f26471584043331107dc0dd [term 2 LEADER]: Becoming Leader. State: Replica: 288a46a90f26471584043331107dc0dd, State: Running, Role: LEADER
I20260709 12:14:17.985860 24327 consensus_queue.cc:237] T d85273afe57c4f35bb72827d1c5879eb P 288a46a90f26471584043331107dc0dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:14:17.999881 23124 catalog_manager.cc:5697] T d85273afe57c4f35bb72827d1c5879eb P 288a46a90f26471584043331107dc0dd reported cstate change: term changed from 1 to 2, leader changed from 2904b089bdb249b78950db76f4a70e9f (127.12.174.130) to 288a46a90f26471584043331107dc0dd (127.12.174.129). New cstate: current_term: 2 leader_uuid: "288a46a90f26471584043331107dc0dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:18.174165 23301 raft_consensus.cc:1275] T b1533753456b445991715da5158c921b P 2904b089bdb249b78950db76f4a70e9f [term 3 FOLLOWER]: Refusing update from remote peer 288a46a90f26471584043331107dc0dd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:18.175599 23446 raft_consensus.cc:1275] T b1533753456b445991715da5158c921b P 9ba0da223cf24c97bc7d225e25015924 [term 3 FOLLOWER]: Refusing update from remote peer 288a46a90f26471584043331107dc0dd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:18.177249 24372 consensus_queue.cc:1048] T b1533753456b445991715da5158c921b P 288a46a90f26471584043331107dc0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:18.182176 24372 consensus_queue.cc:1048] T b1533753456b445991715da5158c921b P 288a46a90f26471584043331107dc0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:18.228618 23446 raft_consensus.cc:1275] T 18f5de2825814c38a0bd15d4c962dbef P 9ba0da223cf24c97bc7d225e25015924 [term 3 FOLLOWER]: Refusing update from remote peer 2904b089bdb249b78950db76f4a70e9f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:18.230479 24318 consensus_queue.cc:1048] T 18f5de2825814c38a0bd15d4c962dbef P 2904b089bdb249b78950db76f4a70e9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:18.255173 23370 raft_consensus.cc:1275] T 18f5de2825814c38a0bd15d4c962dbef P 3a9a63ca97694ebdb84bca730762d735 [term 3 FOLLOWER]: Refusing update from remote peer 2904b089bdb249b78950db76f4a70e9f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:18.257068 24359 consensus_queue.cc:1048] T 18f5de2825814c38a0bd15d4c962dbef P 2904b089bdb249b78950db76f4a70e9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:18.430302 23370 raft_consensus.cc:1275] T d85273afe57c4f35bb72827d1c5879eb P 3a9a63ca97694ebdb84bca730762d735 [term 2 FOLLOWER]: Refusing update from remote peer 288a46a90f26471584043331107dc0dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:18.431530 24327 consensus_queue.cc:1048] T d85273afe57c4f35bb72827d1c5879eb P 288a46a90f26471584043331107dc0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:18.442649 23301 raft_consensus.cc:1275] T d85273afe57c4f35bb72827d1c5879eb P 2904b089bdb249b78950db76f4a70e9f [term 2 FOLLOWER]: Refusing update from remote peer 288a46a90f26471584043331107dc0dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:18.446707 24327 consensus_queue.cc:1048] T d85273afe57c4f35bb72827d1c5879eb P 288a46a90f26471584043331107dc0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:14:18.599100 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:18.641242 23301 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c1c10ca2f5924b7eb5422f0aee2f85c3"
dest_uuid: "2904b089bdb249b78950db76f4a70e9f"
mode: GRACEFUL
new_leader_uuid: "288a46a90f26471584043331107dc0dd"
 from {username='slave'} at 127.0.0.1:46914
I20260709 12:14:18.642083 23301 raft_consensus.cc:606] T c1c10ca2f5924b7eb5422f0aee2f85c3 P 2904b089bdb249b78950db76f4a70e9f [term 2 LEADER]: Received request to transfer leadership to TS 288a46a90f26471584043331107dc0dd
I20260709 12:14:18.644006 12986 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:14:18.646160 12986 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:18.646965 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:18.716492 24318 raft_consensus.cc:993] T c1c10ca2f5924b7eb5422f0aee2f85c3 P 2904b089bdb249b78950db76f4a70e9f: : Instructing follower 288a46a90f26471584043331107dc0dd to start an election
I20260709 12:14:18.717033 24318 raft_consensus.cc:1081] T c1c10ca2f5924b7eb5422f0aee2f85c3 P 2904b089bdb249b78950db76f4a70e9f [term 2 LEADER]: Signalling peer 288a46a90f26471584043331107dc0dd to start an election
I20260709 12:14:18.719944 24139 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c1c10ca2f5924b7eb5422f0aee2f85c3"
dest_uuid: "288a46a90f26471584043331107dc0dd"
 from {username='slave'} at 127.0.0.1:49066
I20260709 12:14:18.720574 24139 raft_consensus.cc:493] T c1c10ca2f5924b7eb5422f0aee2f85c3 P 288a46a90f26471584043331107dc0dd [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:18.720921 24139 raft_consensus.cc:3060] T c1c10ca2f5924b7eb5422f0aee2f85c3 P 288a46a90f26471584043331107dc0dd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:18.729532 24139 raft_consensus.cc:515] T c1c10ca2f5924b7eb5422f0aee2f85c3 P 288a46a90f26471584043331107dc0dd [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:14:18.731427 24139 leader_election.cc:290] T c1c10ca2f5924b7eb5422f0aee2f85c3 P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 3 election: Requested vote from peers 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789), 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061)
I20260709 12:14:18.733180 23301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c10ca2f5924b7eb5422f0aee2f85c3" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2904b089bdb249b78950db76f4a70e9f"
I20260709 12:14:18.734004 23301 raft_consensus.cc:3055] T c1c10ca2f5924b7eb5422f0aee2f85c3 P 2904b089bdb249b78950db76f4a70e9f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:18.734519 23301 raft_consensus.cc:740] T c1c10ca2f5924b7eb5422f0aee2f85c3 P 2904b089bdb249b78950db76f4a70e9f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2904b089bdb249b78950db76f4a70e9f, State: Running, Role: LEADER
I20260709 12:14:18.733870 23374 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c10ca2f5924b7eb5422f0aee2f85c3" candidate_uuid: "288a46a90f26471584043331107dc0dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3a9a63ca97694ebdb84bca730762d735"
I20260709 12:14:18.735539 23301 consensus_queue.cc:260] T c1c10ca2f5924b7eb5422f0aee2f85c3 P 2904b089bdb249b78950db76f4a70e9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:14:18.736233 23374 raft_consensus.cc:3060] T c1c10ca2f5924b7eb5422f0aee2f85c3 P 3a9a63ca97694ebdb84bca730762d735 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:18.736753 23301 raft_consensus.cc:3060] T c1c10ca2f5924b7eb5422f0aee2f85c3 P 2904b089bdb249b78950db76f4a70e9f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:18.745517 23301 raft_consensus.cc:2468] T c1c10ca2f5924b7eb5422f0aee2f85c3 P 2904b089bdb249b78950db76f4a70e9f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 288a46a90f26471584043331107dc0dd in term 3.
I20260709 12:14:18.747125 23374 raft_consensus.cc:2468] T c1c10ca2f5924b7eb5422f0aee2f85c3 P 3a9a63ca97694ebdb84bca730762d735 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 288a46a90f26471584043331107dc0dd in term 3.
I20260709 12:14:18.747335 24052 leader_election.cc:304] T c1c10ca2f5924b7eb5422f0aee2f85c3 P 288a46a90f26471584043331107dc0dd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 288a46a90f26471584043331107dc0dd, 2904b089bdb249b78950db76f4a70e9f; no voters: 
I20260709 12:14:18.748445 24347 raft_consensus.cc:2804] T c1c10ca2f5924b7eb5422f0aee2f85c3 P 288a46a90f26471584043331107dc0dd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:18.748957 24347 raft_consensus.cc:697] T c1c10ca2f5924b7eb5422f0aee2f85c3 P 288a46a90f26471584043331107dc0dd [term 3 LEADER]: Becoming Leader. State: Replica: 288a46a90f26471584043331107dc0dd, State: Running, Role: LEADER
I20260709 12:14:18.749955 24347 consensus_queue.cc:237] T c1c10ca2f5924b7eb5422f0aee2f85c3 P 288a46a90f26471584043331107dc0dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
I20260709 12:14:18.762903 23122 catalog_manager.cc:5697] T c1c10ca2f5924b7eb5422f0aee2f85c3 P 288a46a90f26471584043331107dc0dd reported cstate change: term changed from 2 to 3, leader changed from 2904b089bdb249b78950db76f4a70e9f (127.12.174.130) to 288a46a90f26471584043331107dc0dd (127.12.174.129). New cstate: current_term: 3 leader_uuid: "288a46a90f26471584043331107dc0dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:19.154268 23370 raft_consensus.cc:1275] T c1c10ca2f5924b7eb5422f0aee2f85c3 P 3a9a63ca97694ebdb84bca730762d735 [term 3 FOLLOWER]: Refusing update from remote peer 288a46a90f26471584043331107dc0dd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:19.156684 24327 consensus_queue.cc:1048] T c1c10ca2f5924b7eb5422f0aee2f85c3 P 288a46a90f26471584043331107dc0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:19.174552 23299 raft_consensus.cc:1275] T c1c10ca2f5924b7eb5422f0aee2f85c3 P 2904b089bdb249b78950db76f4a70e9f [term 3 FOLLOWER]: Refusing update from remote peer 288a46a90f26471584043331107dc0dd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:19.180399 24347 consensus_queue.cc:1048] T c1c10ca2f5924b7eb5422f0aee2f85c3 P 288a46a90f26471584043331107dc0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:19.691244 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:19.759013 12986 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:14:19.760838 12986 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:19.762020 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:19.814834 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:19.854590 12986 tablet_server.cc:179] TabletServer@127.12.174.129:46159 shutting down...
W20260709 12:14:19.870723 23342 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 281 similar messages]
W20260709 12:14:19.876560 23342 consensus_peers.cc:597] T 54a02c3fbc0b4807998d018f9c2ecbc3 P 3a9a63ca97694ebdb84bca730762d735 -> Peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Couldn't send request to peer 288a46a90f26471584043331107dc0dd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:19.893177 23268 consensus_peers.cc:597] T 05b49011442c4131a4ac3c55feed5409 P 2904b089bdb249b78950db76f4a70e9f -> Peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Couldn't send request to peer 288a46a90f26471584043331107dc0dd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:19.895396 12986 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:14:19.896965 12986 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:19.898460 12986 raft_consensus.cc:2243] T bed12810020c4496969b723bcdd4b4ec P 288a46a90f26471584043331107dc0dd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:19.899408 12986 raft_consensus.cc:2272] T bed12810020c4496969b723bcdd4b4ec P 288a46a90f26471584043331107dc0dd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:19.903899 12986 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:19.905095 12986 raft_consensus.cc:2243] T 509f7e554df04f83aeffd51ec07607d5 P 288a46a90f26471584043331107dc0dd [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 12:14:19.905344 23342 consensus_peers.cc:597] T 509296352dfa43369c2637f89e917301 P 3a9a63ca97694ebdb84bca730762d735 -> Peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Couldn't send request to peer 288a46a90f26471584043331107dc0dd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:19.905726 12986 raft_consensus.cc:2272] T 509f7e554df04f83aeffd51ec07607d5 P 288a46a90f26471584043331107dc0dd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:19.910602 12986 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:19.912953 12986 raft_consensus.cc:2243] T c3ac99f9dbb24693b97d3994ceb65955 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:19.913787 12986 raft_consensus.cc:2272] T c3ac99f9dbb24693b97d3994ceb65955 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:19.916081 23268 consensus_peers.cc:597] T 6626b442492c47849fd3c907d1c12f3e P 2904b089bdb249b78950db76f4a70e9f -> Peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Couldn't send request to peer 288a46a90f26471584043331107dc0dd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:19.917834 12986 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:19.919350 12986 raft_consensus.cc:2243] T 6efb52601755488885a8baf030e7fae9 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:19.920068 12986 raft_consensus.cc:2272] T 6efb52601755488885a8baf030e7fae9 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:19.924767 12986 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:19.926033 12986 raft_consensus.cc:2243] T b2fd9ee7ac0c442481f7e173874a8d00 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:19.926966 12986 raft_consensus.cc:2272] T b2fd9ee7ac0c442481f7e173874a8d00 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:19.931152 12986 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:19.932418 12986 raft_consensus.cc:2243] T 8bed7e0b2b804500b4898a175fba3ebe P 288a46a90f26471584043331107dc0dd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:19.933244 12986 raft_consensus.cc:2272] T 8bed7e0b2b804500b4898a175fba3ebe P 288a46a90f26471584043331107dc0dd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:19.937659 12986 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:19.938763 12986 raft_consensus.cc:2243] T b90be1e04a3443e989951ea6bc45ed2f P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:19.939265 12986 raft_consensus.cc:2272] T b90be1e04a3443e989951ea6bc45ed2f P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:19.943076 12986 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:19.944429 12986 raft_consensus.cc:2243] T a2f2a063cf2b4190826d81b2dcbf7709 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:19.945099 12986 raft_consensus.cc:2272] T a2f2a063cf2b4190826d81b2dcbf7709 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:19.948717 12986 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:19.949770 12986 raft_consensus.cc:2243] T 9a21be1df2964860b89acefd66f6fbde P 288a46a90f26471584043331107dc0dd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:19.950567 12986 raft_consensus.cc:2272] T 9a21be1df2964860b89acefd66f6fbde P 288a46a90f26471584043331107dc0dd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:19.953531 12986 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:19.954227 12986 raft_consensus.cc:2243] T 54a02c3fbc0b4807998d018f9c2ecbc3 P 288a46a90f26471584043331107dc0dd [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:19.954747 12986 raft_consensus.cc:2272] T 54a02c3fbc0b4807998d018f9c2ecbc3 P 288a46a90f26471584043331107dc0dd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:19.957314 12986 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:19.958024 12986 raft_consensus.cc:2243] T 8771e0b5070c49c589f276c793f87727 P 288a46a90f26471584043331107dc0dd [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:14:19.959151 12986 raft_consensus.cc:2272] T 8771e0b5070c49c589f276c793f87727 P 288a46a90f26471584043331107dc0dd [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:19.961712 23268 consensus_peers.cc:597] T 6efb52601755488885a8baf030e7fae9 P 2904b089bdb249b78950db76f4a70e9f -> Peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Couldn't send request to peer 288a46a90f26471584043331107dc0dd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:19.962244 12986 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:19.963044 12986 raft_consensus.cc:2243] T d34300c6c4f2447182942fb5ab8cc3c4 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:19.963536 12986 raft_consensus.cc:2272] T d34300c6c4f2447182942fb5ab8cc3c4 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:19.966625 12986 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:19.967657 12986 raft_consensus.cc:2243] T 87c5024fe7274811b9598e504f3963a7 P 288a46a90f26471584043331107dc0dd [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:19.969069 12986 raft_consensus.cc:2272] T 87c5024fe7274811b9598e504f3963a7 P 288a46a90f26471584043331107dc0dd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:19.973066 12986 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:19.974174 12986 raft_consensus.cc:2243] T ac854957ad6246c6b123638cfafeacd4 P 288a46a90f26471584043331107dc0dd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:19.974813 12986 raft_consensus.cc:2272] T ac854957ad6246c6b123638cfafeacd4 P 288a46a90f26471584043331107dc0dd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:19.978351 12986 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:19.979231 12986 raft_consensus.cc:2243] T b1533753456b445991715da5158c921b P 288a46a90f26471584043331107dc0dd [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:14:19.980665 12986 raft_consensus.cc:2272] T b1533753456b445991715da5158c921b P 288a46a90f26471584043331107dc0dd [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:19.982024 23342 consensus_peers.cc:597] T e0352fa4cf674ba8b7d1a0239bcf76e8 P 3a9a63ca97694ebdb84bca730762d735 -> Peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Couldn't send request to peer 288a46a90f26471584043331107dc0dd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:19.983873 12986 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:19.984705 12986 raft_consensus.cc:2243] T 45e4fb3889cc4d23bab3929c3fdd731e P 288a46a90f26471584043331107dc0dd [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:14:19.985710 12986 raft_consensus.cc:2272] T 45e4fb3889cc4d23bab3929c3fdd731e P 288a46a90f26471584043331107dc0dd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:19.988370 12986 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:19.989135 12986 raft_consensus.cc:2243] T 7754f065b43946f0a3aca8a75cb61273 P 288a46a90f26471584043331107dc0dd [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:14:19.990262 12986 raft_consensus.cc:2272] T 7754f065b43946f0a3aca8a75cb61273 P 288a46a90f26471584043331107dc0dd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:19.993178 12986 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:19.993942 12986 raft_consensus.cc:2243] T 8da66c3ab79d468dbfd36407c51d423a P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:19.994414 12986 raft_consensus.cc:2272] T 8da66c3ab79d468dbfd36407c51d423a P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:19.997036 12986 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:19.997779 12986 raft_consensus.cc:2243] T d85273afe57c4f35bb72827d1c5879eb P 288a46a90f26471584043331107dc0dd [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:19.998755 12986 raft_consensus.cc:2272] T d85273afe57c4f35bb72827d1c5879eb P 288a46a90f26471584043331107dc0dd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.002620 12986 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:20.003659 12986 raft_consensus.cc:2243] T d2afee7aeea24f85b4bfecc49efcf841 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:20.004372 12986 raft_consensus.cc:2272] T d2afee7aeea24f85b4bfecc49efcf841 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:20.005364 23416 consensus_peers.cc:597] T ac854957ad6246c6b123638cfafeacd4 P 9ba0da223cf24c97bc7d225e25015924 -> Peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Couldn't send request to peer 288a46a90f26471584043331107dc0dd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:20.008570 12986 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:20.009869 12986 raft_consensus.cc:2243] T 27166b782a5049198cccb3e5905acbc7 P 288a46a90f26471584043331107dc0dd [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:20.011329 12986 raft_consensus.cc:2272] T 27166b782a5049198cccb3e5905acbc7 P 288a46a90f26471584043331107dc0dd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.015224 12986 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:20.016377 12986 raft_consensus.cc:2243] T e3d86fc25f7146c9b1af99387a07bdec P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:20.016983 12986 raft_consensus.cc:2272] T e3d86fc25f7146c9b1af99387a07bdec P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.020260 12986 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:20.020949 12986 raft_consensus.cc:2243] T 0646c3e87a184cd19184ff12695392a7 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:20.021418 12986 raft_consensus.cc:2272] T 0646c3e87a184cd19184ff12695392a7 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.025048 12986 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:20.025841 12986 raft_consensus.cc:2243] T 509296352dfa43369c2637f89e917301 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:20.026377 12986 raft_consensus.cc:2272] T 509296352dfa43369c2637f89e917301 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.029171 12986 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:20.030010 12986 raft_consensus.cc:2243] T 859d30d8c3fb4a499256ffad6dc2d1cd P 288a46a90f26471584043331107dc0dd [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:20.030622 12986 raft_consensus.cc:2272] T 859d30d8c3fb4a499256ffad6dc2d1cd P 288a46a90f26471584043331107dc0dd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.033283 12986 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:20.033957 12986 raft_consensus.cc:2243] T 05b49011442c4131a4ac3c55feed5409 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:20.034497 12986 raft_consensus.cc:2272] T 05b49011442c4131a4ac3c55feed5409 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.036883 12986 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:20.037858 12986 raft_consensus.cc:2243] T 919076caf9f94cd8b631ea3e60dc3593 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:20.038480 12986 raft_consensus.cc:2272] T 919076caf9f94cd8b631ea3e60dc3593 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:20.041321 23342 consensus_peers.cc:597] T b1a6e82689a84e36949e5efca6592772 P 3a9a63ca97694ebdb84bca730762d735 -> Peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Couldn't send request to peer 288a46a90f26471584043331107dc0dd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:20.041399 12986 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:20.042448 12986 raft_consensus.cc:2243] T 2eb2c8089ce14124aed9a5d834cd0522 P 288a46a90f26471584043331107dc0dd [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:20.043525 12986 raft_consensus.cc:2272] T 2eb2c8089ce14124aed9a5d834cd0522 P 288a46a90f26471584043331107dc0dd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.046180 12986 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:20.046897 12986 raft_consensus.cc:2243] T c1c10ca2f5924b7eb5422f0aee2f85c3 P 288a46a90f26471584043331107dc0dd [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:14:20.047859 12986 raft_consensus.cc:2272] T c1c10ca2f5924b7eb5422f0aee2f85c3 P 288a46a90f26471584043331107dc0dd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.051007 12986 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:20.051736 12986 raft_consensus.cc:2243] T d55aba14f62b41538fdb710117d67580 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:20.052241 12986 raft_consensus.cc:2272] T d55aba14f62b41538fdb710117d67580 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.054879 12986 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:20.055491 12986 raft_consensus.cc:2243] T 6d7d1c502ee24072a41a2a55cfc3a5fa P 288a46a90f26471584043331107dc0dd [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:20.056483 12986 raft_consensus.cc:2272] T 6d7d1c502ee24072a41a2a55cfc3a5fa P 288a46a90f26471584043331107dc0dd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.059440 12986 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:20.060299 12986 raft_consensus.cc:2243] T 9f2438f73a8e4760b7b37c5330853b72 P 288a46a90f26471584043331107dc0dd [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:14:20.061620 12986 raft_consensus.cc:2272] T 9f2438f73a8e4760b7b37c5330853b72 P 288a46a90f26471584043331107dc0dd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.065066 12986 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:20.065913 12986 raft_consensus.cc:2243] T 558b91ca6fe3461da7eb4a1344ec14fc P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:20.066479 12986 raft_consensus.cc:2272] T 558b91ca6fe3461da7eb4a1344ec14fc P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:20.068888 23342 consensus_peers.cc:597] T 919076caf9f94cd8b631ea3e60dc3593 P 3a9a63ca97694ebdb84bca730762d735 -> Peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Couldn't send request to peer 288a46a90f26471584043331107dc0dd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:20.070202 12986 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:20.071143 12986 raft_consensus.cc:2243] T b1a6e82689a84e36949e5efca6592772 P 288a46a90f26471584043331107dc0dd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:20.071777 12986 raft_consensus.cc:2272] T b1a6e82689a84e36949e5efca6592772 P 288a46a90f26471584043331107dc0dd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.074539 12986 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:20.075327 12986 raft_consensus.cc:2243] T 5959fc0b70884d699725fb8d560e5de5 P 288a46a90f26471584043331107dc0dd [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:14:20.076597 12986 raft_consensus.cc:2272] T 5959fc0b70884d699725fb8d560e5de5 P 288a46a90f26471584043331107dc0dd [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:20.078270 23416 consensus_peers.cc:597] T bed12810020c4496969b723bcdd4b4ec P 9ba0da223cf24c97bc7d225e25015924 -> Peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Couldn't send request to peer 288a46a90f26471584043331107dc0dd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:20.079947 12986 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:20.080865 12986 raft_consensus.cc:2243] T ec2c01c273894e73b6a2ab39e0132286 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:20.081285 12986 raft_consensus.cc:2272] T ec2c01c273894e73b6a2ab39e0132286 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.083815 12986 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:20.084438 12986 raft_consensus.cc:2243] T 3ad2f373a67b4c9cbb2183c2c73eb3e5 P 288a46a90f26471584043331107dc0dd [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:20.085345 12986 raft_consensus.cc:2272] T 3ad2f373a67b4c9cbb2183c2c73eb3e5 P 288a46a90f26471584043331107dc0dd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.087826 12986 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:20.088559 12986 raft_consensus.cc:2243] T e0352fa4cf674ba8b7d1a0239bcf76e8 P 288a46a90f26471584043331107dc0dd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:20.089131 12986 raft_consensus.cc:2272] T e0352fa4cf674ba8b7d1a0239bcf76e8 P 288a46a90f26471584043331107dc0dd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.091801 12986 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:20.092391 12986 raft_consensus.cc:2243] T 92d63c0c6ef9452797da238708c39275 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:20.092805 12986 raft_consensus.cc:2272] T 92d63c0c6ef9452797da238708c39275 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.095270 12986 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:20.095799 12986 raft_consensus.cc:2243] T 0f7747f7dcab4d6da9caf82c35717552 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:20.096238 12986 raft_consensus.cc:2272] T 0f7747f7dcab4d6da9caf82c35717552 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.099125 12986 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:20.099887 12986 raft_consensus.cc:2243] T 00335dfad3394f0c9689c0df8500bc9e P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:20.100530 12986 raft_consensus.cc:2272] T 00335dfad3394f0c9689c0df8500bc9e P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.103366 12986 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:20.103941 12986 raft_consensus.cc:2243] T 96f1bc9b220f49d5845c08249cb6a44f P 288a46a90f26471584043331107dc0dd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:20.104411 12986 raft_consensus.cc:2272] T 96f1bc9b220f49d5845c08249cb6a44f P 288a46a90f26471584043331107dc0dd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.106835 12986 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:20.107339 12986 raft_consensus.cc:2243] T 6626b442492c47849fd3c907d1c12f3e P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:20.107765 12986 raft_consensus.cc:2272] T 6626b442492c47849fd3c907d1c12f3e P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.110296 12986 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:20.110809 12986 raft_consensus.cc:2243] T b3e2bbccfb7f4da8baf42735151ff804 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:20.111199 12986 raft_consensus.cc:2272] T b3e2bbccfb7f4da8baf42735151ff804 P 288a46a90f26471584043331107dc0dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.113598 12986 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:20.114117 12986 raft_consensus.cc:2243] T 99bc4210d0b44dd282a5bf7606d122af P 288a46a90f26471584043331107dc0dd [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:20.115094 12986 raft_consensus.cc:2272] T 99bc4210d0b44dd282a5bf7606d122af P 288a46a90f26471584043331107dc0dd [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:20.129964 23342 consensus_peers.cc:597] T a2f2a063cf2b4190826d81b2dcbf7709 P 3a9a63ca97694ebdb84bca730762d735 -> Peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Couldn't send request to peer 288a46a90f26471584043331107dc0dd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:20.147186 23416 consensus_peers.cc:597] T d2afee7aeea24f85b4bfecc49efcf841 P 9ba0da223cf24c97bc7d225e25015924 -> Peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Couldn't send request to peer 288a46a90f26471584043331107dc0dd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:20.153083 23416 consensus_peers.cc:597] T 509f7e554df04f83aeffd51ec07607d5 P 9ba0da223cf24c97bc7d225e25015924 -> Peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Couldn't send request to peer 288a46a90f26471584043331107dc0dd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:20.162755 23268 consensus_peers.cc:597] T 558b91ca6fe3461da7eb4a1344ec14fc P 2904b089bdb249b78950db76f4a70e9f -> Peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Couldn't send request to peer 288a46a90f26471584043331107dc0dd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:20.165841 23416 consensus_peers.cc:597] T 9a21be1df2964860b89acefd66f6fbde P 9ba0da223cf24c97bc7d225e25015924 -> Peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Couldn't send request to peer 288a46a90f26471584043331107dc0dd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:20.181460 23416 consensus_peers.cc:597] T 00335dfad3394f0c9689c0df8500bc9e P 9ba0da223cf24c97bc7d225e25015924 -> Peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Couldn't send request to peer 288a46a90f26471584043331107dc0dd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:20.183108 23268 consensus_peers.cc:597] T b3e2bbccfb7f4da8baf42735151ff804 P 2904b089bdb249b78950db76f4a70e9f -> Peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Couldn't send request to peer 288a46a90f26471584043331107dc0dd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:20.190701 23416 consensus_peers.cc:597] T 8bed7e0b2b804500b4898a175fba3ebe P 9ba0da223cf24c97bc7d225e25015924 -> Peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Couldn't send request to peer 288a46a90f26471584043331107dc0dd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:20.193615 23416 consensus_peers.cc:597] T d34300c6c4f2447182942fb5ab8cc3c4 P 9ba0da223cf24c97bc7d225e25015924 -> Peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Couldn't send request to peer 288a46a90f26471584043331107dc0dd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:20.217422 12986 tablet_server.cc:196] TabletServer@127.12.174.129:46159 shutdown complete.
W20260709 12:14:20.229928 23268 consensus_peers.cc:597] T b90be1e04a3443e989951ea6bc45ed2f P 2904b089bdb249b78950db76f4a70e9f -> Peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Couldn't send request to peer 288a46a90f26471584043331107dc0dd. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:46159: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:20.273723 23342 consensus_peers.cc:597] T 0f7747f7dcab4d6da9caf82c35717552 P 3a9a63ca97694ebdb84bca730762d735 -> Peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Couldn't send request to peer 288a46a90f26471584043331107dc0dd. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:46159: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:20.279389 23342 consensus_peers.cc:597] T 0646c3e87a184cd19184ff12695392a7 P 3a9a63ca97694ebdb84bca730762d735 -> Peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Couldn't send request to peer 288a46a90f26471584043331107dc0dd. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:46159: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:20.290124 23342 consensus_peers.cc:597] T ec2c01c273894e73b6a2ab39e0132286 P 3a9a63ca97694ebdb84bca730762d735 -> Peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Couldn't send request to peer 288a46a90f26471584043331107dc0dd. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:46159: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:20.290238 23416 consensus_peers.cc:597] T 859d30d8c3fb4a499256ffad6dc2d1cd P 9ba0da223cf24c97bc7d225e25015924 -> Peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Couldn't send request to peer 288a46a90f26471584043331107dc0dd. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:46159: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:20.290699 23342 consensus_peers.cc:597] T 96f1bc9b220f49d5845c08249cb6a44f P 3a9a63ca97694ebdb84bca730762d735 -> Peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Couldn't send request to peer 288a46a90f26471584043331107dc0dd. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:46159: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:20.291177 23342 consensus_peers.cc:597] T c3ac99f9dbb24693b97d3994ceb65955 P 3a9a63ca97694ebdb84bca730762d735 -> Peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Couldn't send request to peer 288a46a90f26471584043331107dc0dd. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:46159: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:20.293503 23268 consensus_peers.cc:597] T 92d63c0c6ef9452797da238708c39275 P 2904b089bdb249b78950db76f4a70e9f -> Peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Couldn't send request to peer 288a46a90f26471584043331107dc0dd. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:46159: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:20.297055 23342 consensus_peers.cc:597] T d55aba14f62b41538fdb710117d67580 P 3a9a63ca97694ebdb84bca730762d735 -> Peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Couldn't send request to peer 288a46a90f26471584043331107dc0dd. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:46159: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:20.330060 23416 consensus_peers.cc:597] T 8da66c3ab79d468dbfd36407c51d423a P 9ba0da223cf24c97bc7d225e25015924 -> Peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Couldn't send request to peer 288a46a90f26471584043331107dc0dd. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:46159: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:20.340358 23268 consensus_peers.cc:597] T b2fd9ee7ac0c442481f7e173874a8d00 P 2904b089bdb249b78950db76f4a70e9f -> Peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Couldn't send request to peer 288a46a90f26471584043331107dc0dd. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:46159: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:20.343624 12986 tablet_server.cc:179] TabletServer@127.12.174.130:0 shutting down...
W20260709 12:14:20.347501 23416 consensus_peers.cc:597] T e3d86fc25f7146c9b1af99387a07bdec P 9ba0da223cf24c97bc7d225e25015924 -> Peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Couldn't send request to peer 288a46a90f26471584043331107dc0dd. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:46159: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:20.381781 23341 consensus_peers.cc:597] T 28d6ea7193094e8186a5394f3e7ef0b4 P 3a9a63ca97694ebdb84bca730762d735 -> Peer 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789): Couldn't send request to peer 2904b089bdb249b78950db76f4a70e9f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:20.388130 23415 consensus_peers.cc:597] T ac854957ad6246c6b123638cfafeacd4 P 9ba0da223cf24c97bc7d225e25015924 -> Peer 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789): Couldn't send request to peer 2904b089bdb249b78950db76f4a70e9f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:20.390740 23415 consensus_peers.cc:597] T 00f9b2ddcf6e4a9bacf4a30c16a88765 P 9ba0da223cf24c97bc7d225e25015924 -> Peer 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789): Couldn't send request to peer 2904b089bdb249b78950db76f4a70e9f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:20.397109 23415 consensus_peers.cc:597] T eeda1df5d1624932a606c0a80e69d33a P 9ba0da223cf24c97bc7d225e25015924 -> Peer 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789): Couldn't send request to peer 2904b089bdb249b78950db76f4a70e9f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:20.414824 23341 consensus_peers.cc:597] T ec2c01c273894e73b6a2ab39e0132286 P 3a9a63ca97694ebdb84bca730762d735 -> Peer 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789): Couldn't send request to peer 2904b089bdb249b78950db76f4a70e9f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:20.415086 12986 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:14:20.418999 12986 tablet_replica.cc:333] T b2fd9ee7ac0c442481f7e173874a8d00 P 2904b089bdb249b78950db76f4a70e9f: stopping tablet replica
W20260709 12:14:20.419696 23415 consensus_peers.cc:597] T e3d86fc25f7146c9b1af99387a07bdec P 9ba0da223cf24c97bc7d225e25015924 -> Peer 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789): Couldn't send request to peer 2904b089bdb249b78950db76f4a70e9f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:20.420277 12986 raft_consensus.cc:2243] T b2fd9ee7ac0c442481f7e173874a8d00 P 2904b089bdb249b78950db76f4a70e9f [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:20.421613 12986 raft_consensus.cc:2272] T b2fd9ee7ac0c442481f7e173874a8d00 P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.427803 12986 tablet_replica.cc:333] T b90be1e04a3443e989951ea6bc45ed2f P 2904b089bdb249b78950db76f4a70e9f: stopping tablet replica
I20260709 12:14:20.428604 12986 raft_consensus.cc:2243] T b90be1e04a3443e989951ea6bc45ed2f P 2904b089bdb249b78950db76f4a70e9f [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:20.430083 12986 raft_consensus.cc:2272] T b90be1e04a3443e989951ea6bc45ed2f P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.433241 12986 tablet_replica.cc:333] T 9485b864470548f28810d4c52cc89850 P 2904b089bdb249b78950db76f4a70e9f: stopping tablet replica
I20260709 12:14:20.434207 12986 raft_consensus.cc:2243] T 9485b864470548f28810d4c52cc89850 P 2904b089bdb249b78950db76f4a70e9f [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:20.435477 12986 raft_consensus.cc:2272] T 9485b864470548f28810d4c52cc89850 P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.438789 12986 tablet_replica.cc:333] T 2eb2c8089ce14124aed9a5d834cd0522 P 2904b089bdb249b78950db76f4a70e9f: stopping tablet replica
I20260709 12:14:20.440016 12986 raft_consensus.cc:2243] T 2eb2c8089ce14124aed9a5d834cd0522 P 2904b089bdb249b78950db76f4a70e9f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:20.440721 12986 raft_consensus.cc:2272] T 2eb2c8089ce14124aed9a5d834cd0522 P 2904b089bdb249b78950db76f4a70e9f [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:20.442830 23341 consensus_peers.cc:597] T 0411013dc7c347ada4fd2c2a0cf134bd P 3a9a63ca97694ebdb84bca730762d735 -> Peer 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789): Couldn't send request to peer 2904b089bdb249b78950db76f4a70e9f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:20.444005 12986 tablet_replica.cc:333] T 558b91ca6fe3461da7eb4a1344ec14fc P 2904b089bdb249b78950db76f4a70e9f: stopping tablet replica
I20260709 12:14:20.445016 12986 raft_consensus.cc:2243] T 558b91ca6fe3461da7eb4a1344ec14fc P 2904b089bdb249b78950db76f4a70e9f [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:20.446278 12986 raft_consensus.cc:2272] T 558b91ca6fe3461da7eb4a1344ec14fc P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.449508 12986 tablet_replica.cc:333] T 6efb52601755488885a8baf030e7fae9 P 2904b089bdb249b78950db76f4a70e9f: stopping tablet replica
I20260709 12:14:20.450533 12986 raft_consensus.cc:2243] T 6efb52601755488885a8baf030e7fae9 P 2904b089bdb249b78950db76f4a70e9f [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:20.451545 12986 raft_consensus.cc:2272] T 6efb52601755488885a8baf030e7fae9 P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.454025 12986 tablet_replica.cc:333] T 27166b782a5049198cccb3e5905acbc7 P 2904b089bdb249b78950db76f4a70e9f: stopping tablet replica
I20260709 12:14:20.454653 12986 raft_consensus.cc:2243] T 27166b782a5049198cccb3e5905acbc7 P 2904b089bdb249b78950db76f4a70e9f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:20.455134 12986 raft_consensus.cc:2272] T 27166b782a5049198cccb3e5905acbc7 P 2904b089bdb249b78950db76f4a70e9f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.457444 12986 tablet_replica.cc:333] T 9a21be1df2964860b89acefd66f6fbde P 2904b089bdb249b78950db76f4a70e9f: stopping tablet replica
I20260709 12:14:20.458148 12986 raft_consensus.cc:2243] T 9a21be1df2964860b89acefd66f6fbde P 2904b089bdb249b78950db76f4a70e9f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:20.458763 12986 raft_consensus.cc:2272] T 9a21be1df2964860b89acefd66f6fbde P 2904b089bdb249b78950db76f4a70e9f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.461721 12986 tablet_replica.cc:333] T 27202f3dd66a42a3832a9cc25ba6e3e5 P 2904b089bdb249b78950db76f4a70e9f: stopping tablet replica
I20260709 12:14:20.462430 12986 raft_consensus.cc:2243] T 27202f3dd66a42a3832a9cc25ba6e3e5 P 2904b089bdb249b78950db76f4a70e9f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:20.462891 12986 raft_consensus.cc:2272] T 27202f3dd66a42a3832a9cc25ba6e3e5 P 2904b089bdb249b78950db76f4a70e9f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.465167 12986 tablet_replica.cc:333] T d85273afe57c4f35bb72827d1c5879eb P 2904b089bdb249b78950db76f4a70e9f: stopping tablet replica
I20260709 12:14:20.465951 12986 raft_consensus.cc:2243] T d85273afe57c4f35bb72827d1c5879eb P 2904b089bdb249b78950db76f4a70e9f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:20.466421 12986 raft_consensus.cc:2272] T d85273afe57c4f35bb72827d1c5879eb P 2904b089bdb249b78950db76f4a70e9f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.468730 12986 tablet_replica.cc:333] T fec017d49ead425fbd037e7d1d238e5b P 2904b089bdb249b78950db76f4a70e9f: stopping tablet replica
I20260709 12:14:20.469352 12986 raft_consensus.cc:2243] T fec017d49ead425fbd037e7d1d238e5b P 2904b089bdb249b78950db76f4a70e9f [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:20.470285 12986 raft_consensus.cc:2272] T fec017d49ead425fbd037e7d1d238e5b P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.473097 12986 tablet_replica.cc:333] T 05b49011442c4131a4ac3c55feed5409 P 2904b089bdb249b78950db76f4a70e9f: stopping tablet replica
I20260709 12:14:20.473928 12986 raft_consensus.cc:2243] T 05b49011442c4131a4ac3c55feed5409 P 2904b089bdb249b78950db76f4a70e9f [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:20.475065 12986 raft_consensus.cc:2272] T 05b49011442c4131a4ac3c55feed5409 P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.477465 12986 tablet_replica.cc:333] T 0f7747f7dcab4d6da9caf82c35717552 P 2904b089bdb249b78950db76f4a70e9f: stopping tablet replica
I20260709 12:14:20.478118 12986 raft_consensus.cc:2243] T 0f7747f7dcab4d6da9caf82c35717552 P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:20.478617 12986 raft_consensus.cc:2272] T 0f7747f7dcab4d6da9caf82c35717552 P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.480823 12986 tablet_replica.cc:333] T 00335dfad3394f0c9689c0df8500bc9e P 2904b089bdb249b78950db76f4a70e9f: stopping tablet replica
I20260709 12:14:20.481477 12986 raft_consensus.cc:2243] T 00335dfad3394f0c9689c0df8500bc9e P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:20.481993 12986 raft_consensus.cc:2272] T 00335dfad3394f0c9689c0df8500bc9e P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.484246 12986 tablet_replica.cc:333] T 92d63c0c6ef9452797da238708c39275 P 2904b089bdb249b78950db76f4a70e9f: stopping tablet replica
I20260709 12:14:20.484836 12986 raft_consensus.cc:2243] T 92d63c0c6ef9452797da238708c39275 P 2904b089bdb249b78950db76f4a70e9f [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:20.485718 12986 raft_consensus.cc:2272] T 92d63c0c6ef9452797da238708c39275 P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.487828 12986 tablet_replica.cc:333] T b3e2bbccfb7f4da8baf42735151ff804 P 2904b089bdb249b78950db76f4a70e9f: stopping tablet replica
I20260709 12:14:20.488432 12986 raft_consensus.cc:2243] T b3e2bbccfb7f4da8baf42735151ff804 P 2904b089bdb249b78950db76f4a70e9f [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:20.489305 12986 raft_consensus.cc:2272] T b3e2bbccfb7f4da8baf42735151ff804 P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.491851 12986 tablet_replica.cc:333] T 525cb2c0e02b473bba2e7025f5765db2 P 2904b089bdb249b78950db76f4a70e9f: stopping tablet replica
I20260709 12:14:20.492647 12986 raft_consensus.cc:2243] T 525cb2c0e02b473bba2e7025f5765db2 P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:20.493101 12986 raft_consensus.cc:2272] T 525cb2c0e02b473bba2e7025f5765db2 P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.495693 12986 tablet_replica.cc:333] T c3ac99f9dbb24693b97d3994ceb65955 P 2904b089bdb249b78950db76f4a70e9f: stopping tablet replica
I20260709 12:14:20.496362 12986 raft_consensus.cc:2243] T c3ac99f9dbb24693b97d3994ceb65955 P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:20.496953 12986 raft_consensus.cc:2272] T c3ac99f9dbb24693b97d3994ceb65955 P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.499114 12986 tablet_replica.cc:333] T 28d6ea7193094e8186a5394f3e7ef0b4 P 2904b089bdb249b78950db76f4a70e9f: stopping tablet replica
I20260709 12:14:20.499671 12986 raft_consensus.cc:2243] T 28d6ea7193094e8186a5394f3e7ef0b4 P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:20.500099 12986 raft_consensus.cc:2272] T 28d6ea7193094e8186a5394f3e7ef0b4 P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.502682 12986 tablet_replica.cc:333] T 45e4fb3889cc4d23bab3929c3fdd731e P 2904b089bdb249b78950db76f4a70e9f: stopping tablet replica
I20260709 12:14:20.503266 12986 raft_consensus.cc:2243] T 45e4fb3889cc4d23bab3929c3fdd731e P 2904b089bdb249b78950db76f4a70e9f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:20.503727 12986 raft_consensus.cc:2272] T 45e4fb3889cc4d23bab3929c3fdd731e P 2904b089bdb249b78950db76f4a70e9f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.506019 12986 tablet_replica.cc:333] T b1533753456b445991715da5158c921b P 2904b089bdb249b78950db76f4a70e9f: stopping tablet replica
I20260709 12:14:20.506762 12986 raft_consensus.cc:2243] T b1533753456b445991715da5158c921b P 2904b089bdb249b78950db76f4a70e9f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:20.507205 12986 raft_consensus.cc:2272] T b1533753456b445991715da5158c921b P 2904b089bdb249b78950db76f4a70e9f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.509443 12986 tablet_replica.cc:333] T 94b9ff7f93dc4114b7c59ecfc0fcc9a7 P 2904b089bdb249b78950db76f4a70e9f: stopping tablet replica
I20260709 12:14:20.510123 12986 raft_consensus.cc:2243] T 94b9ff7f93dc4114b7c59ecfc0fcc9a7 P 2904b089bdb249b78950db76f4a70e9f [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:20.511021 12986 raft_consensus.cc:2272] T 94b9ff7f93dc4114b7c59ecfc0fcc9a7 P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.513334 12986 tablet_replica.cc:333] T 00f9b2ddcf6e4a9bacf4a30c16a88765 P 2904b089bdb249b78950db76f4a70e9f: stopping tablet replica
I20260709 12:14:20.514020 12986 raft_consensus.cc:2243] T 00f9b2ddcf6e4a9bacf4a30c16a88765 P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:20.514547 12986 raft_consensus.cc:2272] T 00f9b2ddcf6e4a9bacf4a30c16a88765 P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.516856 12986 tablet_replica.cc:333] T 859d30d8c3fb4a499256ffad6dc2d1cd P 2904b089bdb249b78950db76f4a70e9f: stopping tablet replica
I20260709 12:14:20.517524 12986 raft_consensus.cc:2243] T 859d30d8c3fb4a499256ffad6dc2d1cd P 2904b089bdb249b78950db76f4a70e9f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:20.518057 12986 raft_consensus.cc:2272] T 859d30d8c3fb4a499256ffad6dc2d1cd P 2904b089bdb249b78950db76f4a70e9f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.520224 12986 tablet_replica.cc:333] T 18f5de2825814c38a0bd15d4c962dbef P 2904b089bdb249b78950db76f4a70e9f: stopping tablet replica
I20260709 12:14:20.520813 12986 raft_consensus.cc:2243] T 18f5de2825814c38a0bd15d4c962dbef P 2904b089bdb249b78950db76f4a70e9f [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:14:20.521895 12986 raft_consensus.cc:2272] T 18f5de2825814c38a0bd15d4c962dbef P 2904b089bdb249b78950db76f4a70e9f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.524510 12986 tablet_replica.cc:333] T 3ad2f373a67b4c9cbb2183c2c73eb3e5 P 2904b089bdb249b78950db76f4a70e9f: stopping tablet replica
I20260709 12:14:20.525235 12986 raft_consensus.cc:2243] T 3ad2f373a67b4c9cbb2183c2c73eb3e5 P 2904b089bdb249b78950db76f4a70e9f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:20.525861 12986 raft_consensus.cc:2272] T 3ad2f373a67b4c9cbb2183c2c73eb3e5 P 2904b089bdb249b78950db76f4a70e9f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.528811 12986 tablet_replica.cc:333] T ec2c01c273894e73b6a2ab39e0132286 P 2904b089bdb249b78950db76f4a70e9f: stopping tablet replica
I20260709 12:14:20.529721 12986 raft_consensus.cc:2243] T ec2c01c273894e73b6a2ab39e0132286 P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:20.530290 12986 raft_consensus.cc:2272] T ec2c01c273894e73b6a2ab39e0132286 P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.533272 12986 tablet_replica.cc:333] T 5959fc0b70884d699725fb8d560e5de5 P 2904b089bdb249b78950db76f4a70e9f: stopping tablet replica
I20260709 12:14:20.534224 12986 raft_consensus.cc:2243] T 5959fc0b70884d699725fb8d560e5de5 P 2904b089bdb249b78950db76f4a70e9f [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:20.534818 12986 raft_consensus.cc:2272] T 5959fc0b70884d699725fb8d560e5de5 P 2904b089bdb249b78950db76f4a70e9f [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.537806 12986 tablet_replica.cc:333] T ac88d753a9f84b22adbe65cbc15d5109 P 2904b089bdb249b78950db76f4a70e9f: stopping tablet replica
I20260709 12:14:20.538422 12986 raft_consensus.cc:2243] T ac88d753a9f84b22adbe65cbc15d5109 P 2904b089bdb249b78950db76f4a70e9f [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:20.539522 12986 raft_consensus.cc:2272] T ac88d753a9f84b22adbe65cbc15d5109 P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.542050 12986 tablet_replica.cc:333] T 0411013dc7c347ada4fd2c2a0cf134bd P 2904b089bdb249b78950db76f4a70e9f: stopping tablet replica
I20260709 12:14:20.542690 12986 raft_consensus.cc:2243] T 0411013dc7c347ada4fd2c2a0cf134bd P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:20.543181 12986 raft_consensus.cc:2272] T 0411013dc7c347ada4fd2c2a0cf134bd P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.545331 12986 tablet_replica.cc:333] T 8e5b2401420b4a25a6457b667110f778 P 2904b089bdb249b78950db76f4a70e9f: stopping tablet replica
I20260709 12:14:20.546160 12986 raft_consensus.cc:2243] T 8e5b2401420b4a25a6457b667110f778 P 2904b089bdb249b78950db76f4a70e9f [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:20.547286 12986 raft_consensus.cc:2272] T 8e5b2401420b4a25a6457b667110f778 P 2904b089bdb249b78950db76f4a70e9f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.549919 12986 tablet_replica.cc:333] T eeda1df5d1624932a606c0a80e69d33a P 2904b089bdb249b78950db76f4a70e9f: stopping tablet replica
I20260709 12:14:20.550477 12986 raft_consensus.cc:2243] T eeda1df5d1624932a606c0a80e69d33a P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:20.550931 12986 raft_consensus.cc:2272] T eeda1df5d1624932a606c0a80e69d33a P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.553009 12986 tablet_replica.cc:333] T ac854957ad6246c6b123638cfafeacd4 P 2904b089bdb249b78950db76f4a70e9f: stopping tablet replica
I20260709 12:14:20.553627 12986 raft_consensus.cc:2243] T ac854957ad6246c6b123638cfafeacd4 P 2904b089bdb249b78950db76f4a70e9f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:20.554103 12986 raft_consensus.cc:2272] T ac854957ad6246c6b123638cfafeacd4 P 2904b089bdb249b78950db76f4a70e9f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.556397 12986 tablet_replica.cc:333] T 8771e0b5070c49c589f276c793f87727 P 2904b089bdb249b78950db76f4a70e9f: stopping tablet replica
I20260709 12:14:20.557096 12986 raft_consensus.cc:2243] T 8771e0b5070c49c589f276c793f87727 P 2904b089bdb249b78950db76f4a70e9f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:20.557555 12986 raft_consensus.cc:2272] T 8771e0b5070c49c589f276c793f87727 P 2904b089bdb249b78950db76f4a70e9f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.559677 12986 tablet_replica.cc:333] T 6626b442492c47849fd3c907d1c12f3e P 2904b089bdb249b78950db76f4a70e9f: stopping tablet replica
I20260709 12:14:20.560257 12986 raft_consensus.cc:2243] T 6626b442492c47849fd3c907d1c12f3e P 2904b089bdb249b78950db76f4a70e9f [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:20.561136 12986 raft_consensus.cc:2272] T 6626b442492c47849fd3c907d1c12f3e P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.563300 12986 tablet_replica.cc:333] T e3d86fc25f7146c9b1af99387a07bdec P 2904b089bdb249b78950db76f4a70e9f: stopping tablet replica
I20260709 12:14:20.563862 12986 raft_consensus.cc:2243] T e3d86fc25f7146c9b1af99387a07bdec P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:20.564312 12986 raft_consensus.cc:2272] T e3d86fc25f7146c9b1af99387a07bdec P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.566453 12986 tablet_replica.cc:333] T 0646c3e87a184cd19184ff12695392a7 P 2904b089bdb249b78950db76f4a70e9f: stopping tablet replica
I20260709 12:14:20.567066 12986 raft_consensus.cc:2243] T 0646c3e87a184cd19184ff12695392a7 P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:20.567513 12986 raft_consensus.cc:2272] T 0646c3e87a184cd19184ff12695392a7 P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.569634 12986 tablet_replica.cc:333] T 4a007ebead5a454bb48d9784a624f5b8 P 2904b089bdb249b78950db76f4a70e9f: stopping tablet replica
I20260709 12:14:20.570180 12986 raft_consensus.cc:2243] T 4a007ebead5a454bb48d9784a624f5b8 P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:20.570597 12986 raft_consensus.cc:2272] T 4a007ebead5a454bb48d9784a624f5b8 P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.572882 12986 tablet_replica.cc:333] T 138c2e6a55da4600a6318719808815ec P 2904b089bdb249b78950db76f4a70e9f: stopping tablet replica
I20260709 12:14:20.573642 12986 raft_consensus.cc:2243] T 138c2e6a55da4600a6318719808815ec P 2904b089bdb249b78950db76f4a70e9f [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:20.574837 12986 raft_consensus.cc:2272] T 138c2e6a55da4600a6318719808815ec P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.577606 12986 tablet_replica.cc:333] T d34300c6c4f2447182942fb5ab8cc3c4 P 2904b089bdb249b78950db76f4a70e9f: stopping tablet replica
I20260709 12:14:20.578382 12986 raft_consensus.cc:2243] T d34300c6c4f2447182942fb5ab8cc3c4 P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:20.578896 12986 raft_consensus.cc:2272] T d34300c6c4f2447182942fb5ab8cc3c4 P 2904b089bdb249b78950db76f4a70e9f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.581979 12986 tablet_replica.cc:333] T 87c5024fe7274811b9598e504f3963a7 P 2904b089bdb249b78950db76f4a70e9f: stopping tablet replica
I20260709 12:14:20.582643 12986 raft_consensus.cc:2243] T 87c5024fe7274811b9598e504f3963a7 P 2904b089bdb249b78950db76f4a70e9f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:20.583149 12986 raft_consensus.cc:2272] T 87c5024fe7274811b9598e504f3963a7 P 2904b089bdb249b78950db76f4a70e9f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.585244 12986 tablet_replica.cc:333] T 9f2438f73a8e4760b7b37c5330853b72 P 2904b089bdb249b78950db76f4a70e9f: stopping tablet replica
I20260709 12:14:20.585701 12986 raft_consensus.cc:2243] T 9f2438f73a8e4760b7b37c5330853b72 P 2904b089bdb249b78950db76f4a70e9f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:20.586174 12986 raft_consensus.cc:2272] T 9f2438f73a8e4760b7b37c5330853b72 P 2904b089bdb249b78950db76f4a70e9f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.588292 12986 tablet_replica.cc:333] T 6d7d1c502ee24072a41a2a55cfc3a5fa P 2904b089bdb249b78950db76f4a70e9f: stopping tablet replica
I20260709 12:14:20.588737 12986 raft_consensus.cc:2243] T 6d7d1c502ee24072a41a2a55cfc3a5fa P 2904b089bdb249b78950db76f4a70e9f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:20.589161 12986 raft_consensus.cc:2272] T 6d7d1c502ee24072a41a2a55cfc3a5fa P 2904b089bdb249b78950db76f4a70e9f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.592013 12986 tablet_replica.cc:333] T c1c10ca2f5924b7eb5422f0aee2f85c3 P 2904b089bdb249b78950db76f4a70e9f: stopping tablet replica
I20260709 12:14:20.592667 12986 raft_consensus.cc:2243] T c1c10ca2f5924b7eb5422f0aee2f85c3 P 2904b089bdb249b78950db76f4a70e9f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:20.593226 12986 raft_consensus.cc:2272] T c1c10ca2f5924b7eb5422f0aee2f85c3 P 2904b089bdb249b78950db76f4a70e9f [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:20.653095 23341 consensus_peers.cc:597] T c3ac99f9dbb24693b97d3994ceb65955 P 3a9a63ca97694ebdb84bca730762d735 -> Peer 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789): Couldn't send request to peer 2904b089bdb249b78950db76f4a70e9f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:20.681267 23415 consensus_peers.cc:597] T d34300c6c4f2447182942fb5ab8cc3c4 P 9ba0da223cf24c97bc7d225e25015924 -> Peer 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789): Couldn't send request to peer 2904b089bdb249b78950db76f4a70e9f. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.130:45789: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:20.683545 12986 tablet_server.cc:196] TabletServer@127.12.174.130:0 shutdown complete.
W20260709 12:14:20.694923 23341 consensus_peers.cc:597] T 4a007ebead5a454bb48d9784a624f5b8 P 3a9a63ca97694ebdb84bca730762d735 -> Peer 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789): Couldn't send request to peer 2904b089bdb249b78950db76f4a70e9f. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.130:45789: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:20.739476 23415 consensus_peers.cc:597] T 00335dfad3394f0c9689c0df8500bc9e P 9ba0da223cf24c97bc7d225e25015924 -> Peer 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789): Couldn't send request to peer 2904b089bdb249b78950db76f4a70e9f. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.130:45789: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:20.743604 23341 consensus_peers.cc:597] T 0646c3e87a184cd19184ff12695392a7 P 3a9a63ca97694ebdb84bca730762d735 -> Peer 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789): Couldn't send request to peer 2904b089bdb249b78950db76f4a70e9f. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.130:45789: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:20.760723 23415 consensus_peers.cc:597] T 9a21be1df2964860b89acefd66f6fbde P 9ba0da223cf24c97bc7d225e25015924 -> Peer 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789): Couldn't send request to peer 2904b089bdb249b78950db76f4a70e9f. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.130:45789: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:20.793118 12986 tablet_server.cc:179] TabletServer@127.12.174.131:0 shutting down...
W20260709 12:14:20.800173 23415 consensus_peers.cc:597] T 859d30d8c3fb4a499256ffad6dc2d1cd P 9ba0da223cf24c97bc7d225e25015924 -> Peer 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789): Couldn't send request to peer 2904b089bdb249b78950db76f4a70e9f. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.130:45789: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:20.824113 23415 consensus_peers.cc:597] T 8da66c3ab79d468dbfd36407c51d423a P 9ba0da223cf24c97bc7d225e25015924 -> Peer 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061): Couldn't send request to peer 3a9a63ca97694ebdb84bca730762d735. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:20.841511 23415 consensus_peers.cc:597] T 509f7e554df04f83aeffd51ec07607d5 P 9ba0da223cf24c97bc7d225e25015924 -> Peer 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061): Couldn't send request to peer 3a9a63ca97694ebdb84bca730762d735. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:20.885102 23415 consensus_peers.cc:597] T bed12810020c4496969b723bcdd4b4ec P 9ba0da223cf24c97bc7d225e25015924 -> Peer 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061): Couldn't send request to peer 3a9a63ca97694ebdb84bca730762d735. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:20.887374 23415 consensus_peers.cc:597] T 525cb2c0e02b473bba2e7025f5765db2 P 9ba0da223cf24c97bc7d225e25015924 -> Peer 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789): Couldn't send request to peer 2904b089bdb249b78950db76f4a70e9f. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.130:45789: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:20.893694 23415 consensus_peers.cc:597] T 27202f3dd66a42a3832a9cc25ba6e3e5 P 9ba0da223cf24c97bc7d225e25015924 -> Peer 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789): Couldn't send request to peer 2904b089bdb249b78950db76f4a70e9f. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.130:45789: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:20.896554 23415 consensus_peers.cc:597] T d2afee7aeea24f85b4bfecc49efcf841 P 9ba0da223cf24c97bc7d225e25015924 -> Peer 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061): Couldn't send request to peer 3a9a63ca97694ebdb84bca730762d735. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:20.910162 12986 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:14:20.911135 12986 tablet_replica.cc:333] T b90be1e04a3443e989951ea6bc45ed2f P 3a9a63ca97694ebdb84bca730762d735: stopping tablet replica
I20260709 12:14:20.912092 12986 raft_consensus.cc:2243] T b90be1e04a3443e989951ea6bc45ed2f P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 12:14:20.912518 23341 consensus_peers.cc:597] T 0f7747f7dcab4d6da9caf82c35717552 P 3a9a63ca97694ebdb84bca730762d735 -> Peer 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789): Couldn't send request to peer 2904b089bdb249b78950db76f4a70e9f. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.130:45789: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:20.912669 12986 raft_consensus.cc:2272] T b90be1e04a3443e989951ea6bc45ed2f P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.915109 12986 tablet_replica.cc:333] T 54a02c3fbc0b4807998d018f9c2ecbc3 P 3a9a63ca97694ebdb84bca730762d735: stopping tablet replica
I20260709 12:14:20.915908 12986 raft_consensus.cc:2243] T 54a02c3fbc0b4807998d018f9c2ecbc3 P 3a9a63ca97694ebdb84bca730762d735 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:14:20.916754 12986 raft_consensus.cc:2272] T 54a02c3fbc0b4807998d018f9c2ecbc3 P 3a9a63ca97694ebdb84bca730762d735 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.919471 12986 tablet_replica.cc:333] T 9485b864470548f28810d4c52cc89850 P 3a9a63ca97694ebdb84bca730762d735: stopping tablet replica
I20260709 12:14:20.920295 12986 raft_consensus.cc:2243] T 9485b864470548f28810d4c52cc89850 P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:20.920857 12986 raft_consensus.cc:2272] T 9485b864470548f28810d4c52cc89850 P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.923010 12986 tablet_replica.cc:333] T 28d6ea7193094e8186a5394f3e7ef0b4 P 3a9a63ca97694ebdb84bca730762d735: stopping tablet replica
I20260709 12:14:20.923625 12986 raft_consensus.cc:2243] T 28d6ea7193094e8186a5394f3e7ef0b4 P 3a9a63ca97694ebdb84bca730762d735 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:20.924407 12986 raft_consensus.cc:2272] T 28d6ea7193094e8186a5394f3e7ef0b4 P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.926846 12986 tablet_replica.cc:333] T 6efb52601755488885a8baf030e7fae9 P 3a9a63ca97694ebdb84bca730762d735: stopping tablet replica
I20260709 12:14:20.927713 12986 raft_consensus.cc:2243] T 6efb52601755488885a8baf030e7fae9 P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:20.928264 12986 raft_consensus.cc:2272] T 6efb52601755488885a8baf030e7fae9 P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.931242 12986 tablet_replica.cc:333] T 8bed7e0b2b804500b4898a175fba3ebe P 3a9a63ca97694ebdb84bca730762d735: stopping tablet replica
I20260709 12:14:20.932083 12986 raft_consensus.cc:2243] T 8bed7e0b2b804500b4898a175fba3ebe P 3a9a63ca97694ebdb84bca730762d735 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:20.932654 12986 raft_consensus.cc:2272] T 8bed7e0b2b804500b4898a175fba3ebe P 3a9a63ca97694ebdb84bca730762d735 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.935091 12986 tablet_replica.cc:333] T ec2c01c273894e73b6a2ab39e0132286 P 3a9a63ca97694ebdb84bca730762d735: stopping tablet replica
I20260709 12:14:20.935678 12986 raft_consensus.cc:2243] T ec2c01c273894e73b6a2ab39e0132286 P 3a9a63ca97694ebdb84bca730762d735 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:20.936578 12986 raft_consensus.cc:2272] T ec2c01c273894e73b6a2ab39e0132286 P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.938614 12986 tablet_replica.cc:333] T 7754f065b43946f0a3aca8a75cb61273 P 3a9a63ca97694ebdb84bca730762d735: stopping tablet replica
I20260709 12:14:20.939163 12986 raft_consensus.cc:2243] T 7754f065b43946f0a3aca8a75cb61273 P 3a9a63ca97694ebdb84bca730762d735 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:20.939556 12986 raft_consensus.cc:2272] T 7754f065b43946f0a3aca8a75cb61273 P 3a9a63ca97694ebdb84bca730762d735 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.941619 12986 tablet_replica.cc:333] T 2eb2c8089ce14124aed9a5d834cd0522 P 3a9a63ca97694ebdb84bca730762d735: stopping tablet replica
I20260709 12:14:20.942200 12986 raft_consensus.cc:2243] T 2eb2c8089ce14124aed9a5d834cd0522 P 3a9a63ca97694ebdb84bca730762d735 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:20.942612 12986 raft_consensus.cc:2272] T 2eb2c8089ce14124aed9a5d834cd0522 P 3a9a63ca97694ebdb84bca730762d735 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.944563 12986 tablet_replica.cc:333] T 919076caf9f94cd8b631ea3e60dc3593 P 3a9a63ca97694ebdb84bca730762d735: stopping tablet replica
I20260709 12:14:20.945109 12986 raft_consensus.cc:2243] T 919076caf9f94cd8b631ea3e60dc3593 P 3a9a63ca97694ebdb84bca730762d735 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:20.945940 12986 raft_consensus.cc:2272] T 919076caf9f94cd8b631ea3e60dc3593 P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.947996 12986 tablet_replica.cc:333] T fec017d49ead425fbd037e7d1d238e5b P 3a9a63ca97694ebdb84bca730762d735: stopping tablet replica
I20260709 12:14:20.948529 12986 raft_consensus.cc:2243] T fec017d49ead425fbd037e7d1d238e5b P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:20.948894 12986 raft_consensus.cc:2272] T fec017d49ead425fbd037e7d1d238e5b P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.950907 12986 tablet_replica.cc:333] T a2f2a063cf2b4190826d81b2dcbf7709 P 3a9a63ca97694ebdb84bca730762d735: stopping tablet replica
I20260709 12:14:20.951445 12986 raft_consensus.cc:2243] T a2f2a063cf2b4190826d81b2dcbf7709 P 3a9a63ca97694ebdb84bca730762d735 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:20.952267 12986 raft_consensus.cc:2272] T a2f2a063cf2b4190826d81b2dcbf7709 P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.954337 12986 tablet_replica.cc:333] T 27166b782a5049198cccb3e5905acbc7 P 3a9a63ca97694ebdb84bca730762d735: stopping tablet replica
I20260709 12:14:20.954888 12986 raft_consensus.cc:2243] T 27166b782a5049198cccb3e5905acbc7 P 3a9a63ca97694ebdb84bca730762d735 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:20.955281 12986 raft_consensus.cc:2272] T 27166b782a5049198cccb3e5905acbc7 P 3a9a63ca97694ebdb84bca730762d735 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.957302 12986 tablet_replica.cc:333] T d2afee7aeea24f85b4bfecc49efcf841 P 3a9a63ca97694ebdb84bca730762d735: stopping tablet replica
I20260709 12:14:20.957847 12986 raft_consensus.cc:2243] T d2afee7aeea24f85b4bfecc49efcf841 P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:20.958244 12986 raft_consensus.cc:2272] T d2afee7aeea24f85b4bfecc49efcf841 P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.960098 12986 tablet_replica.cc:333] T c3ac99f9dbb24693b97d3994ceb65955 P 3a9a63ca97694ebdb84bca730762d735: stopping tablet replica
I20260709 12:14:20.960595 12986 raft_consensus.cc:2243] T c3ac99f9dbb24693b97d3994ceb65955 P 3a9a63ca97694ebdb84bca730762d735 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:20.961385 12986 raft_consensus.cc:2272] T c3ac99f9dbb24693b97d3994ceb65955 P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.963382 12986 tablet_replica.cc:333] T 99bc4210d0b44dd282a5bf7606d122af P 3a9a63ca97694ebdb84bca730762d735: stopping tablet replica
I20260709 12:14:20.963901 12986 raft_consensus.cc:2243] T 99bc4210d0b44dd282a5bf7606d122af P 3a9a63ca97694ebdb84bca730762d735 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:20.964310 12986 raft_consensus.cc:2272] T 99bc4210d0b44dd282a5bf7606d122af P 3a9a63ca97694ebdb84bca730762d735 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.966463 12986 tablet_replica.cc:333] T b3e2bbccfb7f4da8baf42735151ff804 P 3a9a63ca97694ebdb84bca730762d735: stopping tablet replica
I20260709 12:14:20.966975 12986 raft_consensus.cc:2243] T b3e2bbccfb7f4da8baf42735151ff804 P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:20.967360 12986 raft_consensus.cc:2272] T b3e2bbccfb7f4da8baf42735151ff804 P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.969458 12986 tablet_replica.cc:333] T 525cb2c0e02b473bba2e7025f5765db2 P 3a9a63ca97694ebdb84bca730762d735: stopping tablet replica
I20260709 12:14:20.970023 12986 raft_consensus.cc:2243] T 525cb2c0e02b473bba2e7025f5765db2 P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:20.970412 12986 raft_consensus.cc:2272] T 525cb2c0e02b473bba2e7025f5765db2 P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.972471 12986 tablet_replica.cc:333] T ac88d753a9f84b22adbe65cbc15d5109 P 3a9a63ca97694ebdb84bca730762d735: stopping tablet replica
I20260709 12:14:20.973048 12986 raft_consensus.cc:2243] T ac88d753a9f84b22adbe65cbc15d5109 P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:20.973448 12986 raft_consensus.cc:2272] T ac88d753a9f84b22adbe65cbc15d5109 P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.975464 12986 tablet_replica.cc:333] T 0411013dc7c347ada4fd2c2a0cf134bd P 3a9a63ca97694ebdb84bca730762d735: stopping tablet replica
I20260709 12:14:20.976011 12986 raft_consensus.cc:2243] T 0411013dc7c347ada4fd2c2a0cf134bd P 3a9a63ca97694ebdb84bca730762d735 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:20.976837 12986 raft_consensus.cc:2272] T 0411013dc7c347ada4fd2c2a0cf134bd P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.979089 12986 tablet_replica.cc:333] T 94b9ff7f93dc4114b7c59ecfc0fcc9a7 P 3a9a63ca97694ebdb84bca730762d735: stopping tablet replica
I20260709 12:14:20.978853 24385 raft_consensus.cc:493] T 8771e0b5070c49c589f276c793f87727 P 3a9a63ca97694ebdb84bca730762d735 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 288a46a90f26471584043331107dc0dd)
I20260709 12:14:20.980012 12986 raft_consensus.cc:2243] T 94b9ff7f93dc4114b7c59ecfc0fcc9a7 P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:20.980746 12986 raft_consensus.cc:2272] T 94b9ff7f93dc4114b7c59ecfc0fcc9a7 P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.979965 24385 raft_consensus.cc:515] T 8771e0b5070c49c589f276c793f87727 P 3a9a63ca97694ebdb84bca730762d735 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } } peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } }
W20260709 12:14:20.983043 23415 consensus_peers.cc:597] T 8bed7e0b2b804500b4898a175fba3ebe P 9ba0da223cf24c97bc7d225e25015924 -> Peer 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061): Couldn't send request to peer 3a9a63ca97694ebdb84bca730762d735. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:20.983633 12986 tablet_replica.cc:333] T 00f9b2ddcf6e4a9bacf4a30c16a88765 P 3a9a63ca97694ebdb84bca730762d735: stopping tablet replica
I20260709 12:14:20.983678 24385 leader_election.cc:290] T 8771e0b5070c49c589f276c793f87727 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 288a46a90f26471584043331107dc0dd (127.12.174.129:46159), 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789)
I20260709 12:14:20.984535 12986 raft_consensus.cc:2243] T 00f9b2ddcf6e4a9bacf4a30c16a88765 P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:20.985137 12986 raft_consensus.cc:2272] T 00f9b2ddcf6e4a9bacf4a30c16a88765 P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.987624 12986 tablet_replica.cc:333] T 8e5b2401420b4a25a6457b667110f778 P 3a9a63ca97694ebdb84bca730762d735: stopping tablet replica
W20260709 12:14:20.987854 23342 leader_election.cc:336] T 8771e0b5070c49c589f276c793f87727 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Network error: Client connection negotiation failed: client connection to 127.12.174.129:46159: connect: Connection refused (error 111)
W20260709 12:14:20.988468 23341 leader_election.cc:336] T 8771e0b5070c49c589f276c793f87727 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789): Network error: Client connection negotiation failed: client connection to 127.12.174.130:45789: connect: Connection refused (error 111)
I20260709 12:14:20.988497 12986 raft_consensus.cc:2243] T 8e5b2401420b4a25a6457b667110f778 P 3a9a63ca97694ebdb84bca730762d735 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:20.988971 23341 leader_election.cc:304] T 8771e0b5070c49c589f276c793f87727 P 3a9a63ca97694ebdb84bca730762d735 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3a9a63ca97694ebdb84bca730762d735; no voters: 288a46a90f26471584043331107dc0dd, 2904b089bdb249b78950db76f4a70e9f
I20260709 12:14:20.989295 12986 raft_consensus.cc:2272] T 8e5b2401420b4a25a6457b667110f778 P 3a9a63ca97694ebdb84bca730762d735 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.989773 24385 raft_consensus.cc:2749] T 8771e0b5070c49c589f276c793f87727 P 3a9a63ca97694ebdb84bca730762d735 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:20.992261 12986 tablet_replica.cc:333] T c1c10ca2f5924b7eb5422f0aee2f85c3 P 3a9a63ca97694ebdb84bca730762d735: stopping tablet replica
W20260709 12:14:20.992795 23415 consensus_peers.cc:597] T 525cb2c0e02b473bba2e7025f5765db2 P 9ba0da223cf24c97bc7d225e25015924 -> Peer 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061): Couldn't send request to peer 3a9a63ca97694ebdb84bca730762d735. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:20.993242 12986 raft_consensus.cc:2243] T c1c10ca2f5924b7eb5422f0aee2f85c3 P 3a9a63ca97694ebdb84bca730762d735 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:20.993868 12986 raft_consensus.cc:2272] T c1c10ca2f5924b7eb5422f0aee2f85c3 P 3a9a63ca97694ebdb84bca730762d735 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.996155 12986 tablet_replica.cc:333] T d55aba14f62b41538fdb710117d67580 P 3a9a63ca97694ebdb84bca730762d735: stopping tablet replica
I20260709 12:14:20.996747 12986 raft_consensus.cc:2243] T d55aba14f62b41538fdb710117d67580 P 3a9a63ca97694ebdb84bca730762d735 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:20.997597 12986 raft_consensus.cc:2272] T d55aba14f62b41538fdb710117d67580 P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:20.999689 12986 tablet_replica.cc:333] T eeda1df5d1624932a606c0a80e69d33a P 3a9a63ca97694ebdb84bca730762d735: stopping tablet replica
I20260709 12:14:21.000296 12986 raft_consensus.cc:2243] T eeda1df5d1624932a606c0a80e69d33a P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:21.000730 12986 raft_consensus.cc:2272] T eeda1df5d1624932a606c0a80e69d33a P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:21.003500 12986 tablet_replica.cc:333] T 509f7e554df04f83aeffd51ec07607d5 P 3a9a63ca97694ebdb84bca730762d735: stopping tablet replica
I20260709 12:14:21.004204 12986 raft_consensus.cc:2243] T 509f7e554df04f83aeffd51ec07607d5 P 3a9a63ca97694ebdb84bca730762d735 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:21.004786 12986 raft_consensus.cc:2272] T 509f7e554df04f83aeffd51ec07607d5 P 3a9a63ca97694ebdb84bca730762d735 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:21.007161 12986 tablet_replica.cc:333] T 8771e0b5070c49c589f276c793f87727 P 3a9a63ca97694ebdb84bca730762d735: stopping tablet replica
I20260709 12:14:21.007771 12986 raft_consensus.cc:2243] T 8771e0b5070c49c589f276c793f87727 P 3a9a63ca97694ebdb84bca730762d735 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:21.008203 12986 raft_consensus.cc:2272] T 8771e0b5070c49c589f276c793f87727 P 3a9a63ca97694ebdb84bca730762d735 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:21.010180 12986 tablet_replica.cc:333] T 96f1bc9b220f49d5845c08249cb6a44f P 3a9a63ca97694ebdb84bca730762d735: stopping tablet replica
I20260709 12:14:21.010746 12986 raft_consensus.cc:2243] T 96f1bc9b220f49d5845c08249cb6a44f P 3a9a63ca97694ebdb84bca730762d735 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:21.011577 12986 raft_consensus.cc:2272] T 96f1bc9b220f49d5845c08249cb6a44f P 3a9a63ca97694ebdb84bca730762d735 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:21.013939 12986 tablet_replica.cc:333] T 6626b442492c47849fd3c907d1c12f3e P 3a9a63ca97694ebdb84bca730762d735: stopping tablet replica
I20260709 12:14:21.014524 12986 raft_consensus.cc:2243] T 6626b442492c47849fd3c907d1c12f3e P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:21.015017 12986 raft_consensus.cc:2272] T 6626b442492c47849fd3c907d1c12f3e P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:21.017416 12986 tablet_replica.cc:333] T 27202f3dd66a42a3832a9cc25ba6e3e5 P 3a9a63ca97694ebdb84bca730762d735: stopping tablet replica
I20260709 12:14:21.017997 12986 raft_consensus.cc:2243] T 27202f3dd66a42a3832a9cc25ba6e3e5 P 3a9a63ca97694ebdb84bca730762d735 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:21.018452 12986 raft_consensus.cc:2272] T 27202f3dd66a42a3832a9cc25ba6e3e5 P 3a9a63ca97694ebdb84bca730762d735 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:21.020721 12986 tablet_replica.cc:333] T d85273afe57c4f35bb72827d1c5879eb P 3a9a63ca97694ebdb84bca730762d735: stopping tablet replica
I20260709 12:14:21.021411 12986 raft_consensus.cc:2243] T d85273afe57c4f35bb72827d1c5879eb P 3a9a63ca97694ebdb84bca730762d735 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:21.021986 12986 raft_consensus.cc:2272] T d85273afe57c4f35bb72827d1c5879eb P 3a9a63ca97694ebdb84bca730762d735 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:21.024124 12986 tablet_replica.cc:333] T 8da66c3ab79d468dbfd36407c51d423a P 3a9a63ca97694ebdb84bca730762d735: stopping tablet replica
I20260709 12:14:21.024715 12986 raft_consensus.cc:2243] T 8da66c3ab79d468dbfd36407c51d423a P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:21.025166 12986 raft_consensus.cc:2272] T 8da66c3ab79d468dbfd36407c51d423a P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:21.027485 12986 tablet_replica.cc:333] T 6d7d1c502ee24072a41a2a55cfc3a5fa P 3a9a63ca97694ebdb84bca730762d735: stopping tablet replica
I20260709 12:14:21.028077 12986 raft_consensus.cc:2243] T 6d7d1c502ee24072a41a2a55cfc3a5fa P 3a9a63ca97694ebdb84bca730762d735 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:21.028555 12986 raft_consensus.cc:2272] T 6d7d1c502ee24072a41a2a55cfc3a5fa P 3a9a63ca97694ebdb84bca730762d735 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:21.030875 12986 tablet_replica.cc:333] T 509296352dfa43369c2637f89e917301 P 3a9a63ca97694ebdb84bca730762d735: stopping tablet replica
I20260709 12:14:21.031447 12986 raft_consensus.cc:2243] T 509296352dfa43369c2637f89e917301 P 3a9a63ca97694ebdb84bca730762d735 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:21.032328 12986 raft_consensus.cc:2272] T 509296352dfa43369c2637f89e917301 P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:21.034628 12986 tablet_replica.cc:333] T 0646c3e87a184cd19184ff12695392a7 P 3a9a63ca97694ebdb84bca730762d735: stopping tablet replica
I20260709 12:14:21.035215 12986 raft_consensus.cc:2243] T 0646c3e87a184cd19184ff12695392a7 P 3a9a63ca97694ebdb84bca730762d735 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:21.036180 12986 raft_consensus.cc:2272] T 0646c3e87a184cd19184ff12695392a7 P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:21.038806 12986 tablet_replica.cc:333] T 4a007ebead5a454bb48d9784a624f5b8 P 3a9a63ca97694ebdb84bca730762d735: stopping tablet replica
I20260709 12:14:21.039557 12986 raft_consensus.cc:2243] T 4a007ebead5a454bb48d9784a624f5b8 P 3a9a63ca97694ebdb84bca730762d735 [term 1 LEADER]: Raft consensus shutting down.
W20260709 12:14:21.040303 23415 consensus_peers.cc:597] T 00f9b2ddcf6e4a9bacf4a30c16a88765 P 9ba0da223cf24c97bc7d225e25015924 -> Peer 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061): Couldn't send request to peer 3a9a63ca97694ebdb84bca730762d735. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:21.040808 12986 raft_consensus.cc:2272] T 4a007ebead5a454bb48d9784a624f5b8 P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:21.043619 12986 tablet_replica.cc:333] T bed12810020c4496969b723bcdd4b4ec P 3a9a63ca97694ebdb84bca730762d735: stopping tablet replica
I20260709 12:14:21.044232 12986 raft_consensus.cc:2243] T bed12810020c4496969b723bcdd4b4ec P 3a9a63ca97694ebdb84bca730762d735 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:21.044739 12986 raft_consensus.cc:2272] T bed12810020c4496969b723bcdd4b4ec P 3a9a63ca97694ebdb84bca730762d735 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:21.046988 12986 tablet_replica.cc:333] T 138c2e6a55da4600a6318719808815ec P 3a9a63ca97694ebdb84bca730762d735: stopping tablet replica
I20260709 12:14:21.047618 12986 raft_consensus.cc:2243] T 138c2e6a55da4600a6318719808815ec P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:21.048071 12986 raft_consensus.cc:2272] T 138c2e6a55da4600a6318719808815ec P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:21.050386 12986 tablet_replica.cc:333] T 0f7747f7dcab4d6da9caf82c35717552 P 3a9a63ca97694ebdb84bca730762d735: stopping tablet replica
I20260709 12:14:21.050941 12986 raft_consensus.cc:2243] T 0f7747f7dcab4d6da9caf82c35717552 P 3a9a63ca97694ebdb84bca730762d735 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:21.051852 12986 raft_consensus.cc:2272] T 0f7747f7dcab4d6da9caf82c35717552 P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:21.054174 12986 tablet_replica.cc:333] T e0352fa4cf674ba8b7d1a0239bcf76e8 P 3a9a63ca97694ebdb84bca730762d735: stopping tablet replica
I20260709 12:14:21.054714 12986 raft_consensus.cc:2243] T e0352fa4cf674ba8b7d1a0239bcf76e8 P 3a9a63ca97694ebdb84bca730762d735 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:21.055567 12986 raft_consensus.cc:2272] T e0352fa4cf674ba8b7d1a0239bcf76e8 P 3a9a63ca97694ebdb84bca730762d735 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:21.058182 12986 tablet_replica.cc:333] T 92d63c0c6ef9452797da238708c39275 P 3a9a63ca97694ebdb84bca730762d735: stopping tablet replica
I20260709 12:14:21.058696 12986 raft_consensus.cc:2243] T 92d63c0c6ef9452797da238708c39275 P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:21.059115 12986 raft_consensus.cc:2272] T 92d63c0c6ef9452797da238708c39275 P 3a9a63ca97694ebdb84bca730762d735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:21.061197 12986 tablet_replica.cc:333] T b1a6e82689a84e36949e5efca6592772 P 3a9a63ca97694ebdb84bca730762d735: stopping tablet replica
I20260709 12:14:21.061857 12986 raft_consensus.cc:2243] T b1a6e82689a84e36949e5efca6592772 P 3a9a63ca97694ebdb84bca730762d735 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:21.062685 12986 raft_consensus.cc:2272] T b1a6e82689a84e36949e5efca6592772 P 3a9a63ca97694ebdb84bca730762d735 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:21.064281 24362 raft_consensus.cc:493] T 45e4fb3889cc4d23bab3929c3fdd731e P 9ba0da223cf24c97bc7d225e25015924 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 288a46a90f26471584043331107dc0dd)
I20260709 12:14:21.064867 24362 raft_consensus.cc:515] T 45e4fb3889cc4d23bab3929c3fdd731e P 9ba0da223cf24c97bc7d225e25015924 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:14:21.065255 12986 tablet_replica.cc:333] T 18f5de2825814c38a0bd15d4c962dbef P 3a9a63ca97694ebdb84bca730762d735: stopping tablet replica
I20260709 12:14:21.065985 12986 raft_consensus.cc:2243] T 18f5de2825814c38a0bd15d4c962dbef P 3a9a63ca97694ebdb84bca730762d735 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:21.066481 12986 raft_consensus.cc:2272] T 18f5de2825814c38a0bd15d4c962dbef P 3a9a63ca97694ebdb84bca730762d735 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:21.066905 24362 leader_election.cc:290] T 45e4fb3889cc4d23bab3929c3fdd731e P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 288a46a90f26471584043331107dc0dd (127.12.174.129:46159), 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789)
W20260709 12:14:21.071034 23416 leader_election.cc:336] T 45e4fb3889cc4d23bab3929c3fdd731e P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Network error: Client connection negotiation failed: client connection to 127.12.174.129:46159: connect: Connection refused (error 111)
W20260709 12:14:21.071633 23415 leader_election.cc:336] T 45e4fb3889cc4d23bab3929c3fdd731e P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789): Network error: Client connection negotiation failed: client connection to 127.12.174.130:45789: connect: Connection refused (error 111)
I20260709 12:14:21.072048 23415 leader_election.cc:304] T 45e4fb3889cc4d23bab3929c3fdd731e P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ba0da223cf24c97bc7d225e25015924; no voters: 288a46a90f26471584043331107dc0dd, 2904b089bdb249b78950db76f4a70e9f
I20260709 12:14:21.072713 24362 raft_consensus.cc:2749] T 45e4fb3889cc4d23bab3929c3fdd731e P 9ba0da223cf24c97bc7d225e25015924 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:14:21.098287 23415 consensus_peers.cc:597] T eeda1df5d1624932a606c0a80e69d33a P 9ba0da223cf24c97bc7d225e25015924 -> Peer 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061): Couldn't send request to peer 3a9a63ca97694ebdb84bca730762d735. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:21.129262 23415 consensus_peers.cc:597] T 27202f3dd66a42a3832a9cc25ba6e3e5 P 9ba0da223cf24c97bc7d225e25015924 -> Peer 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061): Couldn't send request to peer 3a9a63ca97694ebdb84bca730762d735. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:21.143635 24362 raft_consensus.cc:493] T b1533753456b445991715da5158c921b P 9ba0da223cf24c97bc7d225e25015924 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 288a46a90f26471584043331107dc0dd)
I20260709 12:14:21.144284 24362 raft_consensus.cc:515] T b1533753456b445991715da5158c921b P 9ba0da223cf24c97bc7d225e25015924 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:14:21.147060 24362 leader_election.cc:290] T b1533753456b445991715da5158c921b P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 288a46a90f26471584043331107dc0dd (127.12.174.129:46159), 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789)
I20260709 12:14:21.150677 12986 tablet_server.cc:196] TabletServer@127.12.174.131:0 shutdown complete.
W20260709 12:14:21.151002 23416 leader_election.cc:336] T b1533753456b445991715da5158c921b P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Network error: Client connection negotiation failed: client connection to 127.12.174.129:46159: connect: Connection refused (error 111)
W20260709 12:14:21.152791 23415 leader_election.cc:336] T b1533753456b445991715da5158c921b P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789): Network error: Client connection negotiation failed: client connection to 127.12.174.130:45789: connect: Connection refused (error 111)
I20260709 12:14:21.153550 23415 leader_election.cc:304] T b1533753456b445991715da5158c921b P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ba0da223cf24c97bc7d225e25015924; no voters: 288a46a90f26471584043331107dc0dd, 2904b089bdb249b78950db76f4a70e9f
I20260709 12:14:21.154299 24362 raft_consensus.cc:2749] T b1533753456b445991715da5158c921b P 9ba0da223cf24c97bc7d225e25015924 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:21.167761 24362 raft_consensus.cc:493] T 9f2438f73a8e4760b7b37c5330853b72 P 9ba0da223cf24c97bc7d225e25015924 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 288a46a90f26471584043331107dc0dd)
I20260709 12:14:21.168399 24362 raft_consensus.cc:515] T 9f2438f73a8e4760b7b37c5330853b72 P 9ba0da223cf24c97bc7d225e25015924 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:14:21.171304 24362 leader_election.cc:290] T 9f2438f73a8e4760b7b37c5330853b72 P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 288a46a90f26471584043331107dc0dd (127.12.174.129:46159), 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789)
W20260709 12:14:21.177846 23415 leader_election.cc:336] T 9f2438f73a8e4760b7b37c5330853b72 P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789): Network error: Client connection negotiation failed: client connection to 127.12.174.130:45789: connect: Connection refused (error 111)
W20260709 12:14:21.190645 23416 leader_election.cc:336] T 9f2438f73a8e4760b7b37c5330853b72 P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Network error: Client connection negotiation failed: client connection to 127.12.174.129:46159: connect: Connection refused (error 111)
I20260709 12:14:21.191305 23416 leader_election.cc:304] T 9f2438f73a8e4760b7b37c5330853b72 P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ba0da223cf24c97bc7d225e25015924; no voters: 288a46a90f26471584043331107dc0dd, 2904b089bdb249b78950db76f4a70e9f
I20260709 12:14:21.192339 24425 raft_consensus.cc:2749] T 9f2438f73a8e4760b7b37c5330853b72 P 9ba0da223cf24c97bc7d225e25015924 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:14:21.207086 24429 raft_consensus.cc:493] T 3ad2f373a67b4c9cbb2183c2c73eb3e5 P 9ba0da223cf24c97bc7d225e25015924 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 288a46a90f26471584043331107dc0dd)
I20260709 12:14:21.207213 24425 raft_consensus.cc:493] T 87c5024fe7274811b9598e504f3963a7 P 9ba0da223cf24c97bc7d225e25015924 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 288a46a90f26471584043331107dc0dd)
I20260709 12:14:21.207831 24429 raft_consensus.cc:515] T 3ad2f373a67b4c9cbb2183c2c73eb3e5 P 9ba0da223cf24c97bc7d225e25015924 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:14:21.207842 24425 raft_consensus.cc:515] T 87c5024fe7274811b9598e504f3963a7 P 9ba0da223cf24c97bc7d225e25015924 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:14:21.210757 24425 leader_election.cc:290] T 87c5024fe7274811b9598e504f3963a7 P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 288a46a90f26471584043331107dc0dd (127.12.174.129:46159), 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789)
I20260709 12:14:21.211366 24429 leader_election.cc:290] T 3ad2f373a67b4c9cbb2183c2c73eb3e5 P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 288a46a90f26471584043331107dc0dd (127.12.174.129:46159), 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789)
W20260709 12:14:21.215780 23416 leader_election.cc:336] T 87c5024fe7274811b9598e504f3963a7 P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Network error: Client connection negotiation failed: client connection to 127.12.174.129:46159: connect: Connection refused (error 111)
W20260709 12:14:21.216367 23416 leader_election.cc:336] T 3ad2f373a67b4c9cbb2183c2c73eb3e5 P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Network error: Client connection negotiation failed: client connection to 127.12.174.129:46159: connect: Connection refused (error 111)
W20260709 12:14:21.216841 23415 leader_election.cc:336] T 3ad2f373a67b4c9cbb2183c2c73eb3e5 P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789): Network error: Client connection negotiation failed: client connection to 127.12.174.130:45789: connect: Connection refused (error 111)
I20260709 12:14:21.217249 23415 leader_election.cc:304] T 3ad2f373a67b4c9cbb2183c2c73eb3e5 P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ba0da223cf24c97bc7d225e25015924; no voters: 288a46a90f26471584043331107dc0dd, 2904b089bdb249b78950db76f4a70e9f
I20260709 12:14:21.218016 24429 raft_consensus.cc:2749] T 3ad2f373a67b4c9cbb2183c2c73eb3e5 P 9ba0da223cf24c97bc7d225e25015924 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:14:21.218169 23415 leader_election.cc:336] T 87c5024fe7274811b9598e504f3963a7 P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789): Network error: Client connection negotiation failed: client connection to 127.12.174.130:45789: connect: Connection refused (error 111)
I20260709 12:14:21.218704 23415 leader_election.cc:304] T 87c5024fe7274811b9598e504f3963a7 P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ba0da223cf24c97bc7d225e25015924; no voters: 288a46a90f26471584043331107dc0dd, 2904b089bdb249b78950db76f4a70e9f
I20260709 12:14:21.219359 24429 raft_consensus.cc:2749] T 87c5024fe7274811b9598e504f3963a7 P 9ba0da223cf24c97bc7d225e25015924 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:21.253158 12986 tablet_server.cc:179] TabletServer@127.12.174.132:0 shutting down...
I20260709 12:14:21.299183 12986 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:14:21.300177 12986 tablet_replica.cc:333] T b2fd9ee7ac0c442481f7e173874a8d00 P 9ba0da223cf24c97bc7d225e25015924: stopping tablet replica
I20260709 12:14:21.301106 12986 raft_consensus.cc:2243] T b2fd9ee7ac0c442481f7e173874a8d00 P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:21.301690 12986 raft_consensus.cc:2272] T b2fd9ee7ac0c442481f7e173874a8d00 P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:21.304412 12986 tablet_replica.cc:333] T 54a02c3fbc0b4807998d018f9c2ecbc3 P 9ba0da223cf24c97bc7d225e25015924: stopping tablet replica
I20260709 12:14:21.305222 12986 raft_consensus.cc:2243] T 54a02c3fbc0b4807998d018f9c2ecbc3 P 9ba0da223cf24c97bc7d225e25015924 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:21.305727 12986 raft_consensus.cc:2272] T 54a02c3fbc0b4807998d018f9c2ecbc3 P 9ba0da223cf24c97bc7d225e25015924 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:21.308429 12986 tablet_replica.cc:333] T 509296352dfa43369c2637f89e917301 P 9ba0da223cf24c97bc7d225e25015924: stopping tablet replica
I20260709 12:14:21.309077 12986 raft_consensus.cc:2243] T 509296352dfa43369c2637f89e917301 P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:21.309516 12986 raft_consensus.cc:2272] T 509296352dfa43369c2637f89e917301 P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:21.310298 24425 raft_consensus.cc:493] T 5959fc0b70884d699725fb8d560e5de5 P 9ba0da223cf24c97bc7d225e25015924 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 288a46a90f26471584043331107dc0dd)
I20260709 12:14:21.310853 24425 raft_consensus.cc:515] T 5959fc0b70884d699725fb8d560e5de5 P 9ba0da223cf24c97bc7d225e25015924 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } } peers { permanent_uuid: "2904b089bdb249b78950db76f4a70e9f" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 45789 } }
I20260709 12:14:21.312633 12986 tablet_replica.cc:333] T e3d86fc25f7146c9b1af99387a07bdec P 9ba0da223cf24c97bc7d225e25015924: stopping tablet replica
I20260709 12:14:21.313386 24425 leader_election.cc:290] T 5959fc0b70884d699725fb8d560e5de5 P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 288a46a90f26471584043331107dc0dd (127.12.174.129:46159), 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789)
I20260709 12:14:21.313766 12986 raft_consensus.cc:2243] T e3d86fc25f7146c9b1af99387a07bdec P 9ba0da223cf24c97bc7d225e25015924 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:21.316054 12986 raft_consensus.cc:2272] T e3d86fc25f7146c9b1af99387a07bdec P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:21.318939 23416 leader_election.cc:336] T 5959fc0b70884d699725fb8d560e5de5 P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Network error: Client connection negotiation failed: client connection to 127.12.174.129:46159: connect: Connection refused (error 111)
I20260709 12:14:21.319629 12986 tablet_replica.cc:333] T 9485b864470548f28810d4c52cc89850 P 9ba0da223cf24c97bc7d225e25015924: stopping tablet replica
W20260709 12:14:21.319698 23415 leader_election.cc:336] T 5959fc0b70884d699725fb8d560e5de5 P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 2904b089bdb249b78950db76f4a70e9f (127.12.174.130:45789): Network error: Client connection negotiation failed: client connection to 127.12.174.130:45789: connect: Connection refused (error 111)
I20260709 12:14:21.320308 23415 leader_election.cc:304] T 5959fc0b70884d699725fb8d560e5de5 P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ba0da223cf24c97bc7d225e25015924; no voters: 288a46a90f26471584043331107dc0dd, 2904b089bdb249b78950db76f4a70e9f
I20260709 12:14:21.320751 12986 raft_consensus.cc:2243] T 9485b864470548f28810d4c52cc89850 P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:21.320999 24425 raft_consensus.cc:2749] T 5959fc0b70884d699725fb8d560e5de5 P 9ba0da223cf24c97bc7d225e25015924 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:14:21.321451 12986 raft_consensus.cc:2272] T 9485b864470548f28810d4c52cc89850 P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:21.324455 12986 tablet_replica.cc:333] T 558b91ca6fe3461da7eb4a1344ec14fc P 9ba0da223cf24c97bc7d225e25015924: stopping tablet replica
I20260709 12:14:21.325142 12986 raft_consensus.cc:2243] T 558b91ca6fe3461da7eb4a1344ec14fc P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:21.325861 12986 raft_consensus.cc:2272] T 558b91ca6fe3461da7eb4a1344ec14fc P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:21.328624 12986 tablet_replica.cc:333] T 8bed7e0b2b804500b4898a175fba3ebe P 9ba0da223cf24c97bc7d225e25015924: stopping tablet replica
I20260709 12:14:21.329592 12986 raft_consensus.cc:2243] T 8bed7e0b2b804500b4898a175fba3ebe P 9ba0da223cf24c97bc7d225e25015924 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:21.330796 12986 raft_consensus.cc:2272] T 8bed7e0b2b804500b4898a175fba3ebe P 9ba0da223cf24c97bc7d225e25015924 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:21.333968 12986 tablet_replica.cc:333] T 96f1bc9b220f49d5845c08249cb6a44f P 9ba0da223cf24c97bc7d225e25015924: stopping tablet replica
I20260709 12:14:21.334825 12986 raft_consensus.cc:2243] T 96f1bc9b220f49d5845c08249cb6a44f P 9ba0da223cf24c97bc7d225e25015924 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:21.335386 12986 raft_consensus.cc:2272] T 96f1bc9b220f49d5845c08249cb6a44f P 9ba0da223cf24c97bc7d225e25015924 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:21.338004 12986 tablet_replica.cc:333] T 9f2438f73a8e4760b7b37c5330853b72 P 9ba0da223cf24c97bc7d225e25015924: stopping tablet replica
I20260709 12:14:21.338646 12986 raft_consensus.cc:2243] T 9f2438f73a8e4760b7b37c5330853b72 P 9ba0da223cf24c97bc7d225e25015924 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:21.339128 12986 raft_consensus.cc:2272] T 9f2438f73a8e4760b7b37c5330853b72 P 9ba0da223cf24c97bc7d225e25015924 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:21.341392 12986 tablet_replica.cc:333] T 7754f065b43946f0a3aca8a75cb61273 P 9ba0da223cf24c97bc7d225e25015924: stopping tablet replica
I20260709 12:14:21.342074 12986 raft_consensus.cc:2243] T 7754f065b43946f0a3aca8a75cb61273 P 9ba0da223cf24c97bc7d225e25015924 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:21.342535 12986 raft_consensus.cc:2272] T 7754f065b43946f0a3aca8a75cb61273 P 9ba0da223cf24c97bc7d225e25015924 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:21.343235 24425 raft_consensus.cc:493] T 99bc4210d0b44dd282a5bf7606d122af P 9ba0da223cf24c97bc7d225e25015924 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 288a46a90f26471584043331107dc0dd)
I20260709 12:14:21.343750 24425 raft_consensus.cc:515] T 99bc4210d0b44dd282a5bf7606d122af P 9ba0da223cf24c97bc7d225e25015924 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9a63ca97694ebdb84bca730762d735" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 40061 } } peers { permanent_uuid: "9ba0da223cf24c97bc7d225e25015924" member_type: VOTER last_known_addr { host: "127.12.174.132" port: 46081 } } peers { permanent_uuid: "288a46a90f26471584043331107dc0dd" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 46159 } }
I20260709 12:14:21.345243 12986 tablet_replica.cc:333] T fec017d49ead425fbd037e7d1d238e5b P 9ba0da223cf24c97bc7d225e25015924: stopping tablet replica
I20260709 12:14:21.346304 12986 raft_consensus.cc:2243] T fec017d49ead425fbd037e7d1d238e5b P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:21.346161 24425 leader_election.cc:290] T 99bc4210d0b44dd282a5bf7606d122af P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061), 288a46a90f26471584043331107dc0dd (127.12.174.129:46159)
I20260709 12:14:21.347025 12986 raft_consensus.cc:2272] T fec017d49ead425fbd037e7d1d238e5b P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:21.350049 12986 tablet_replica.cc:333] T 919076caf9f94cd8b631ea3e60dc3593 P 9ba0da223cf24c97bc7d225e25015924: stopping tablet replica
W20260709 12:14:21.350476 23415 leader_election.cc:336] T 99bc4210d0b44dd282a5bf7606d122af P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 3a9a63ca97694ebdb84bca730762d735 (127.12.174.131:40061): Network error: Client connection negotiation failed: client connection to 127.12.174.131:40061: connect: Connection refused (error 111)
I20260709 12:14:21.350777 12986 raft_consensus.cc:2243] T 919076caf9f94cd8b631ea3e60dc3593 P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 12:14:21.351189 23416 leader_election.cc:336] T 99bc4210d0b44dd282a5bf7606d122af P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 288a46a90f26471584043331107dc0dd (127.12.174.129:46159): Network error: Client connection negotiation failed: client connection to 127.12.174.129:46159: connect: Connection refused (error 111)
I20260709 12:14:21.351639 12986 raft_consensus.cc:2272] T 919076caf9f94cd8b631ea3e60dc3593 P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:21.351606 23416 leader_election.cc:304] T 99bc4210d0b44dd282a5bf7606d122af P 9ba0da223cf24c97bc7d225e25015924 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ba0da223cf24c97bc7d225e25015924; no voters: 288a46a90f26471584043331107dc0dd, 3a9a63ca97694ebdb84bca730762d735
I20260709 12:14:21.352375 24425 raft_consensus.cc:2749] T 99bc4210d0b44dd282a5bf7606d122af P 9ba0da223cf24c97bc7d225e25015924 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:14:21.354370 12986 tablet_replica.cc:333] T 05b49011442c4131a4ac3c55feed5409 P 9ba0da223cf24c97bc7d225e25015924: stopping tablet replica
I20260709 12:14:21.355103 12986 raft_consensus.cc:2243] T 05b49011442c4131a4ac3c55feed5409 P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:21.355587 12986 raft_consensus.cc:2272] T 05b49011442c4131a4ac3c55feed5409 P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:21.357856 12986 tablet_replica.cc:333] T d2afee7aeea24f85b4bfecc49efcf841 P 9ba0da223cf24c97bc7d225e25015924: stopping tablet replica
I20260709 12:14:21.358487 12986 raft_consensus.cc:2243] T d2afee7aeea24f85b4bfecc49efcf841 P 9ba0da223cf24c97bc7d225e25015924 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:21.359447 12986 raft_consensus.cc:2272] T d2afee7aeea24f85b4bfecc49efcf841 P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:21.361542 12986 tablet_replica.cc:333] T 87c5024fe7274811b9598e504f3963a7 P 9ba0da223cf24c97bc7d225e25015924: stopping tablet replica
I20260709 12:14:21.362188 12986 raft_consensus.cc:2243] T 87c5024fe7274811b9598e504f3963a7 P 9ba0da223cf24c97bc7d225e25015924 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:21.362630 12986 raft_consensus.cc:2272] T 87c5024fe7274811b9598e504f3963a7 P 9ba0da223cf24c97bc7d225e25015924 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:21.364874 12986 tablet_replica.cc:333] T d34300c6c4f2447182942fb5ab8cc3c4 P 9ba0da223cf24c97bc7d225e25015924: stopping tablet replica
I20260709 12:14:21.365474 12986 raft_consensus.cc:2243] T d34300c6c4f2447182942fb5ab8cc3c4 P 9ba0da223cf24c97bc7d225e25015924 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:21.366395 12986 raft_consensus.cc:2272] T d34300c6c4f2447182942fb5ab8cc3c4 P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:21.368585 12986 tablet_replica.cc:333] T 525cb2c0e02b473bba2e7025f5765db2 P 9ba0da223cf24c97bc7d225e25015924: stopping tablet replica
I20260709 12:14:21.369211 12986 raft_consensus.cc:2243] T 525cb2c0e02b473bba2e7025f5765db2 P 9ba0da223cf24c97bc7d225e25015924 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:21.370152 12986 raft_consensus.cc:2272] T 525cb2c0e02b473bba2e7025f5765db2 P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:21.372267 12986 tablet_replica.cc:333] T 28d6ea7193094e8186a5394f3e7ef0b4 P 9ba0da223cf24c97bc7d225e25015924: stopping tablet replica
I20260709 12:14:21.372924 12986 raft_consensus.cc:2243] T 28d6ea7193094e8186a5394f3e7ef0b4 P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:21.373376 12986 raft_consensus.cc:2272] T 28d6ea7193094e8186a5394f3e7ef0b4 P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:21.375597 12986 tablet_replica.cc:333] T 45e4fb3889cc4d23bab3929c3fdd731e P 9ba0da223cf24c97bc7d225e25015924: stopping tablet replica
I20260709 12:14:21.376219 12986 raft_consensus.cc:2243] T 45e4fb3889cc4d23bab3929c3fdd731e P 9ba0da223cf24c97bc7d225e25015924 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:21.376793 12986 raft_consensus.cc:2272] T 45e4fb3889cc4d23bab3929c3fdd731e P 9ba0da223cf24c97bc7d225e25015924 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:21.379623 12986 tablet_replica.cc:333] T b1533753456b445991715da5158c921b P 9ba0da223cf24c97bc7d225e25015924: stopping tablet replica
I20260709 12:14:21.380268 12986 raft_consensus.cc:2243] T b1533753456b445991715da5158c921b P 9ba0da223cf24c97bc7d225e25015924 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:21.380834 12986 raft_consensus.cc:2272] T b1533753456b445991715da5158c921b P 9ba0da223cf24c97bc7d225e25015924 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:21.383250 12986 tablet_replica.cc:333] T 94b9ff7f93dc4114b7c59ecfc0fcc9a7 P 9ba0da223cf24c97bc7d225e25015924: stopping tablet replica
I20260709 12:14:21.384075 12986 raft_consensus.cc:2243] T 94b9ff7f93dc4114b7c59ecfc0fcc9a7 P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:21.384656 12986 raft_consensus.cc:2272] T 94b9ff7f93dc4114b7c59ecfc0fcc9a7 P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:21.387446 12986 tablet_replica.cc:333] T 00f9b2ddcf6e4a9bacf4a30c16a88765 P 9ba0da223cf24c97bc7d225e25015924: stopping tablet replica
I20260709 12:14:21.388175 12986 raft_consensus.cc:2243] T 00f9b2ddcf6e4a9bacf4a30c16a88765 P 9ba0da223cf24c97bc7d225e25015924 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:21.389043 12986 raft_consensus.cc:2272] T 00f9b2ddcf6e4a9bacf4a30c16a88765 P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:21.391515 12986 tablet_replica.cc:333] T 8e5b2401420b4a25a6457b667110f778 P 9ba0da223cf24c97bc7d225e25015924: stopping tablet replica
I20260709 12:14:21.392113 12986 raft_consensus.cc:2243] T 8e5b2401420b4a25a6457b667110f778 P 9ba0da223cf24c97bc7d225e25015924 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:21.392582 12986 raft_consensus.cc:2272] T 8e5b2401420b4a25a6457b667110f778 P 9ba0da223cf24c97bc7d225e25015924 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:21.394757 12986 tablet_replica.cc:333] T d55aba14f62b41538fdb710117d67580 P 9ba0da223cf24c97bc7d225e25015924: stopping tablet replica
I20260709 12:14:21.395305 12986 raft_consensus.cc:2243] T d55aba14f62b41538fdb710117d67580 P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:21.395713 12986 raft_consensus.cc:2272] T d55aba14f62b41538fdb710117d67580 P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:21.397710 12986 tablet_replica.cc:333] T ac854957ad6246c6b123638cfafeacd4 P 9ba0da223cf24c97bc7d225e25015924: stopping tablet replica
I20260709 12:14:21.398489 12986 raft_consensus.cc:2243] T ac854957ad6246c6b123638cfafeacd4 P 9ba0da223cf24c97bc7d225e25015924 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:21.399701 12986 raft_consensus.cc:2272] T ac854957ad6246c6b123638cfafeacd4 P 9ba0da223cf24c97bc7d225e25015924 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:21.402549 12986 tablet_replica.cc:333] T eeda1df5d1624932a606c0a80e69d33a P 9ba0da223cf24c97bc7d225e25015924: stopping tablet replica
I20260709 12:14:21.403271 12986 raft_consensus.cc:2243] T eeda1df5d1624932a606c0a80e69d33a P 9ba0da223cf24c97bc7d225e25015924 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:21.404304 12986 raft_consensus.cc:2272] T eeda1df5d1624932a606c0a80e69d33a P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:21.406755 12986 tablet_replica.cc:333] T 509f7e554df04f83aeffd51ec07607d5 P 9ba0da223cf24c97bc7d225e25015924: stopping tablet replica
I20260709 12:14:21.407843 12986 raft_consensus.cc:2243] T 509f7e554df04f83aeffd51ec07607d5 P 9ba0da223cf24c97bc7d225e25015924 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:21.408901 12986 raft_consensus.cc:2272] T 509f7e554df04f83aeffd51ec07607d5 P 9ba0da223cf24c97bc7d225e25015924 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:21.411530 12986 tablet_replica.cc:333] T ac88d753a9f84b22adbe65cbc15d5109 P 9ba0da223cf24c97bc7d225e25015924: stopping tablet replica
I20260709 12:14:21.412376 12986 raft_consensus.cc:2243] T ac88d753a9f84b22adbe65cbc15d5109 P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:21.412945 12986 raft_consensus.cc:2272] T ac88d753a9f84b22adbe65cbc15d5109 P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:21.415577 12986 tablet_replica.cc:333] T 0411013dc7c347ada4fd2c2a0cf134bd P 9ba0da223cf24c97bc7d225e25015924: stopping tablet replica
I20260709 12:14:21.416234 12986 raft_consensus.cc:2243] T 0411013dc7c347ada4fd2c2a0cf134bd P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:21.416714 12986 raft_consensus.cc:2272] T 0411013dc7c347ada4fd2c2a0cf134bd P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:21.419054 12986 tablet_replica.cc:333] T e0352fa4cf674ba8b7d1a0239bcf76e8 P 9ba0da223cf24c97bc7d225e25015924: stopping tablet replica
I20260709 12:14:21.419659 12986 raft_consensus.cc:2243] T e0352fa4cf674ba8b7d1a0239bcf76e8 P 9ba0da223cf24c97bc7d225e25015924 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:21.420166 12986 raft_consensus.cc:2272] T e0352fa4cf674ba8b7d1a0239bcf76e8 P 9ba0da223cf24c97bc7d225e25015924 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:21.422457 12986 tablet_replica.cc:333] T 00335dfad3394f0c9689c0df8500bc9e P 9ba0da223cf24c97bc7d225e25015924: stopping tablet replica
I20260709 12:14:21.423084 12986 raft_consensus.cc:2243] T 00335dfad3394f0c9689c0df8500bc9e P 9ba0da223cf24c97bc7d225e25015924 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:21.423928 12986 raft_consensus.cc:2272] T 00335dfad3394f0c9689c0df8500bc9e P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:21.426079 12986 tablet_replica.cc:333] T 27202f3dd66a42a3832a9cc25ba6e3e5 P 9ba0da223cf24c97bc7d225e25015924: stopping tablet replica
I20260709 12:14:21.426661 12986 raft_consensus.cc:2243] T 27202f3dd66a42a3832a9cc25ba6e3e5 P 9ba0da223cf24c97bc7d225e25015924 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:21.427567 12986 raft_consensus.cc:2272] T 27202f3dd66a42a3832a9cc25ba6e3e5 P 9ba0da223cf24c97bc7d225e25015924 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:21.429701 12986 tablet_replica.cc:333] T 8da66c3ab79d468dbfd36407c51d423a P 9ba0da223cf24c97bc7d225e25015924: stopping tablet replica
I20260709 12:14:21.430390 12986 raft_consensus.cc:2243] T 8da66c3ab79d468dbfd36407c51d423a P 9ba0da223cf24c97bc7d225e25015924 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:21.431207 12986 raft_consensus.cc:2272] T 8da66c3ab79d468dbfd36407c51d423a P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:21.433451 12986 tablet_replica.cc:333] T 99bc4210d0b44dd282a5bf7606d122af P 9ba0da223cf24c97bc7d225e25015924: stopping tablet replica
I20260709 12:14:21.434063 12986 raft_consensus.cc:2243] T 99bc4210d0b44dd282a5bf7606d122af P 9ba0da223cf24c97bc7d225e25015924 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:21.434484 12986 raft_consensus.cc:2272] T 99bc4210d0b44dd282a5bf7606d122af P 9ba0da223cf24c97bc7d225e25015924 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:21.436543 12986 tablet_replica.cc:333] T 859d30d8c3fb4a499256ffad6dc2d1cd P 9ba0da223cf24c97bc7d225e25015924: stopping tablet replica
I20260709 12:14:21.437120 12986 raft_consensus.cc:2243] T 859d30d8c3fb4a499256ffad6dc2d1cd P 9ba0da223cf24c97bc7d225e25015924 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:14:21.437968 12986 raft_consensus.cc:2272] T 859d30d8c3fb4a499256ffad6dc2d1cd P 9ba0da223cf24c97bc7d225e25015924 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:21.440021 12986 tablet_replica.cc:333] T 18f5de2825814c38a0bd15d4c962dbef P 9ba0da223cf24c97bc7d225e25015924: stopping tablet replica
I20260709 12:14:21.440529 12986 raft_consensus.cc:2243] T 18f5de2825814c38a0bd15d4c962dbef P 9ba0da223cf24c97bc7d225e25015924 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:21.441027 12986 raft_consensus.cc:2272] T 18f5de2825814c38a0bd15d4c962dbef P 9ba0da223cf24c97bc7d225e25015924 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:21.443161 12986 tablet_replica.cc:333] T 3ad2f373a67b4c9cbb2183c2c73eb3e5 P 9ba0da223cf24c97bc7d225e25015924: stopping tablet replica
I20260709 12:14:21.443665 12986 raft_consensus.cc:2243] T 3ad2f373a67b4c9cbb2183c2c73eb3e5 P 9ba0da223cf24c97bc7d225e25015924 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:21.444141 12986 raft_consensus.cc:2272] T 3ad2f373a67b4c9cbb2183c2c73eb3e5 P 9ba0da223cf24c97bc7d225e25015924 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:21.446329 12986 tablet_replica.cc:333] T 5959fc0b70884d699725fb8d560e5de5 P 9ba0da223cf24c97bc7d225e25015924: stopping tablet replica
I20260709 12:14:21.446867 12986 raft_consensus.cc:2243] T 5959fc0b70884d699725fb8d560e5de5 P 9ba0da223cf24c97bc7d225e25015924 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:21.447315 12986 raft_consensus.cc:2272] T 5959fc0b70884d699725fb8d560e5de5 P 9ba0da223cf24c97bc7d225e25015924 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:21.449424 12986 tablet_replica.cc:333] T bed12810020c4496969b723bcdd4b4ec P 9ba0da223cf24c97bc7d225e25015924: stopping tablet replica
I20260709 12:14:21.449991 12986 raft_consensus.cc:2243] T bed12810020c4496969b723bcdd4b4ec P 9ba0da223cf24c97bc7d225e25015924 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:21.450887 12986 raft_consensus.cc:2272] T bed12810020c4496969b723bcdd4b4ec P 9ba0da223cf24c97bc7d225e25015924 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:21.453140 12986 tablet_replica.cc:333] T 4a007ebead5a454bb48d9784a624f5b8 P 9ba0da223cf24c97bc7d225e25015924: stopping tablet replica
I20260709 12:14:21.453662 12986 raft_consensus.cc:2243] T 4a007ebead5a454bb48d9784a624f5b8 P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:21.454103 12986 raft_consensus.cc:2272] T 4a007ebead5a454bb48d9784a624f5b8 P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:21.456065 12986 tablet_replica.cc:333] T 138c2e6a55da4600a6318719808815ec P 9ba0da223cf24c97bc7d225e25015924: stopping tablet replica
I20260709 12:14:21.456563 12986 raft_consensus.cc:2243] T 138c2e6a55da4600a6318719808815ec P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:21.457011 12986 raft_consensus.cc:2272] T 138c2e6a55da4600a6318719808815ec P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:21.459064 12986 tablet_replica.cc:333] T b1a6e82689a84e36949e5efca6592772 P 9ba0da223cf24c97bc7d225e25015924: stopping tablet replica
I20260709 12:14:21.459589 12986 raft_consensus.cc:2243] T b1a6e82689a84e36949e5efca6592772 P 9ba0da223cf24c97bc7d225e25015924 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:21.460013 12986 raft_consensus.cc:2272] T b1a6e82689a84e36949e5efca6592772 P 9ba0da223cf24c97bc7d225e25015924 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:21.462206 12986 tablet_replica.cc:333] T 9a21be1df2964860b89acefd66f6fbde P 9ba0da223cf24c97bc7d225e25015924: stopping tablet replica
I20260709 12:14:21.462677 12986 raft_consensus.cc:2243] T 9a21be1df2964860b89acefd66f6fbde P 9ba0da223cf24c97bc7d225e25015924 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:21.463491 12986 raft_consensus.cc:2272] T 9a21be1df2964860b89acefd66f6fbde P 9ba0da223cf24c97bc7d225e25015924 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:21.465597 12986 tablet_replica.cc:333] T a2f2a063cf2b4190826d81b2dcbf7709 P 9ba0da223cf24c97bc7d225e25015924: stopping tablet replica
I20260709 12:14:21.466071 12986 raft_consensus.cc:2243] T a2f2a063cf2b4190826d81b2dcbf7709 P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:21.466470 12986 raft_consensus.cc:2272] T a2f2a063cf2b4190826d81b2dcbf7709 P 9ba0da223cf24c97bc7d225e25015924 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:21.538008 12986 tablet_server.cc:196] TabletServer@127.12.174.132:0 shutdown complete.
I20260709 12:14:21.618486 12986 master.cc:562] Master@127.12.174.190:35723 shutting down...
I20260709 12:14:21.643421 12986 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 8590568173a443959894f885fddb0e86 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:21.644090 12986 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 8590568173a443959894f885fddb0e86 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:21.644428 12986 tablet_replica.cc:333] T 00000000000000000000000000000000 P 8590568173a443959894f885fddb0e86: stopping tablet replica
I20260709 12:14:21.667937 12986 master.cc:584] Master@127.12.174.190:35723 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (35806 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 12:14:21.759184 12986 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.12.174.190:42177
I20260709 12:14:21.760571 12986 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:14:21.767800 24431 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:21.767795 24432 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:21.769549 24434 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:14:21.770212 12986 server_base.cc:1061] running on GCE node
I20260709 12:14:21.771415 12986 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:14:21.771618 12986 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:14:21.771770 12986 hybrid_clock.cc:648] HybridClock initialized: now 1783599261771749 us; error 0 us; skew 500 ppm
I20260709 12:14:21.772398 12986 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:14:21.775415 12986 webserver.cc:533] Webserver started at http://127.12.174.190:34361/ using document root <none> and password file <none>
I20260709 12:14:21.775979 12986 fs_manager.cc:362] Metadata directory not provided
I20260709 12:14:21.776168 12986 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:14:21.776440 12986 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:14:21.777964 12986 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598886212958-12986-0/minicluster-data/master-0-root/instance:
uuid: "eccac11d14a94b45877dace4a2d57a4b"
format_stamp: "Formatted at 2026-07-09 12:14:21 on dist-test-slave-9q7n"
I20260709 12:14:21.783185 12986 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:14:21.786953 24439 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:21.787810 12986 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 12:14:21.788100 12986 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598886212958-12986-0/minicluster-data/master-0-root
uuid: "eccac11d14a94b45877dace4a2d57a4b"
format_stamp: "Formatted at 2026-07-09 12:14:21 on dist-test-slave-9q7n"
I20260709 12:14:21.788379 12986 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598886212958-12986-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598886212958-12986-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598886212958-12986-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:14:21.799779 12986 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:14:21.801153 12986 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:14:21.844344 12986 rpc_server.cc:307] RPC server started. Bound to: 127.12.174.190:42177
I20260709 12:14:21.844499 24490 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.174.190:42177 every 8 connection(s)
I20260709 12:14:21.848834 24491 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:21.862633 24491 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eccac11d14a94b45877dace4a2d57a4b: Bootstrap starting.
I20260709 12:14:21.868330 24491 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P eccac11d14a94b45877dace4a2d57a4b: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:21.873342 24491 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eccac11d14a94b45877dace4a2d57a4b: No bootstrap required, opened a new log
I20260709 12:14:21.875967 24491 raft_consensus.cc:359] T 00000000000000000000000000000000 P eccac11d14a94b45877dace4a2d57a4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eccac11d14a94b45877dace4a2d57a4b" member_type: VOTER }
I20260709 12:14:21.876518 24491 raft_consensus.cc:385] T 00000000000000000000000000000000 P eccac11d14a94b45877dace4a2d57a4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:21.876807 24491 raft_consensus.cc:740] T 00000000000000000000000000000000 P eccac11d14a94b45877dace4a2d57a4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eccac11d14a94b45877dace4a2d57a4b, State: Initialized, Role: FOLLOWER
I20260709 12:14:21.877569 24491 consensus_queue.cc:260] T 00000000000000000000000000000000 P eccac11d14a94b45877dace4a2d57a4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eccac11d14a94b45877dace4a2d57a4b" member_type: VOTER }
I20260709 12:14:21.878190 24491 raft_consensus.cc:399] T 00000000000000000000000000000000 P eccac11d14a94b45877dace4a2d57a4b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:14:21.878502 24491 raft_consensus.cc:493] T 00000000000000000000000000000000 P eccac11d14a94b45877dace4a2d57a4b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:14:21.878831 24491 raft_consensus.cc:3060] T 00000000000000000000000000000000 P eccac11d14a94b45877dace4a2d57a4b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:21.884711 24491 raft_consensus.cc:515] T 00000000000000000000000000000000 P eccac11d14a94b45877dace4a2d57a4b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eccac11d14a94b45877dace4a2d57a4b" member_type: VOTER }
I20260709 12:14:21.885298 24491 leader_election.cc:304] T 00000000000000000000000000000000 P eccac11d14a94b45877dace4a2d57a4b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: eccac11d14a94b45877dace4a2d57a4b; no voters: 
I20260709 12:14:21.886560 24491 leader_election.cc:290] T 00000000000000000000000000000000 P eccac11d14a94b45877dace4a2d57a4b [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:14:21.887004 24494 raft_consensus.cc:2804] T 00000000000000000000000000000000 P eccac11d14a94b45877dace4a2d57a4b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:21.888489 24494 raft_consensus.cc:697] T 00000000000000000000000000000000 P eccac11d14a94b45877dace4a2d57a4b [term 1 LEADER]: Becoming Leader. State: Replica: eccac11d14a94b45877dace4a2d57a4b, State: Running, Role: LEADER
I20260709 12:14:21.889153 24494 consensus_queue.cc:237] T 00000000000000000000000000000000 P eccac11d14a94b45877dace4a2d57a4b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eccac11d14a94b45877dace4a2d57a4b" member_type: VOTER }
I20260709 12:14:21.889834 24491 sys_catalog.cc:565] T 00000000000000000000000000000000 P eccac11d14a94b45877dace4a2d57a4b [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:14:21.893716 24496 sys_catalog.cc:455] T 00000000000000000000000000000000 P eccac11d14a94b45877dace4a2d57a4b [sys.catalog]: SysCatalogTable state changed. Reason: New leader eccac11d14a94b45877dace4a2d57a4b. Latest consensus state: current_term: 1 leader_uuid: "eccac11d14a94b45877dace4a2d57a4b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eccac11d14a94b45877dace4a2d57a4b" member_type: VOTER } }
I20260709 12:14:21.894611 24496 sys_catalog.cc:458] T 00000000000000000000000000000000 P eccac11d14a94b45877dace4a2d57a4b [sys.catalog]: This master's current role is: LEADER
I20260709 12:14:21.893942 24495 sys_catalog.cc:455] T 00000000000000000000000000000000 P eccac11d14a94b45877dace4a2d57a4b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "eccac11d14a94b45877dace4a2d57a4b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eccac11d14a94b45877dace4a2d57a4b" member_type: VOTER } }
I20260709 12:14:21.895637 24495 sys_catalog.cc:458] T 00000000000000000000000000000000 P eccac11d14a94b45877dace4a2d57a4b [sys.catalog]: This master's current role is: LEADER
I20260709 12:14:21.899040 24500 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:14:21.907143 24500 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:14:21.909343 12986 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:14:21.917662 24500 catalog_manager.cc:1383] Generated new cluster ID: 2676f1355bda470fa0980cc1157e2765
I20260709 12:14:21.918043 24500 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:14:21.942175 24500 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:14:21.943639 24500 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:14:21.960740 24500 catalog_manager.cc:6070] T 00000000000000000000000000000000 P eccac11d14a94b45877dace4a2d57a4b: Generated new TSK 0
I20260709 12:14:21.961488 24500 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:14:21.976747 12986 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:14:21.983583 24512 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:21.984297 24513 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:21.987862 24515 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:14:21.989302 12986 server_base.cc:1061] running on GCE node
I20260709 12:14:21.990479 12986 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:14:21.990688 12986 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:14:21.990857 12986 hybrid_clock.cc:648] HybridClock initialized: now 1783599261990838 us; error 0 us; skew 500 ppm
I20260709 12:14:21.991488 12986 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:14:21.994357 12986 webserver.cc:533] Webserver started at http://127.12.174.129:41811/ using document root <none> and password file <none>
I20260709 12:14:21.994988 12986 fs_manager.cc:362] Metadata directory not provided
I20260709 12:14:21.995183 12986 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:14:21.995482 12986 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:14:21.996754 12986 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598886212958-12986-0/minicluster-data/ts-0-root/instance:
uuid: "19a6c50a7452432c9b7065686d247915"
format_stamp: "Formatted at 2026-07-09 12:14:21 on dist-test-slave-9q7n"
I20260709 12:14:22.002135 12986 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.003s	sys 0.004s
I20260709 12:14:22.006649 24520 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:22.007787 12986 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.002s
I20260709 12:14:22.008145 12986 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598886212958-12986-0/minicluster-data/ts-0-root
uuid: "19a6c50a7452432c9b7065686d247915"
format_stamp: "Formatted at 2026-07-09 12:14:21 on dist-test-slave-9q7n"
I20260709 12:14:22.008448 12986 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598886212958-12986-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598886212958-12986-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598886212958-12986-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:14:22.034528 12986 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:14:22.035951 12986 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:14:22.037555 12986 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:14:22.040035 12986 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:14:22.040241 12986 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:22.040480 12986 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:14:22.040648 12986 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:22.087954 12986 rpc_server.cc:307] RPC server started. Bound to: 127.12.174.129:34253
I20260709 12:14:22.088128 24582 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.174.129:34253 every 8 connection(s)
I20260709 12:14:22.093480 12986 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:14:22.100955 24587 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:22.102306 24588 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:22.104483 24590 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:14:22.105525 12986 server_base.cc:1061] running on GCE node
I20260709 12:14:22.106843 12986 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:14:22.107148 12986 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:14:22.107367 12986 hybrid_clock.cc:648] HybridClock initialized: now 1783599262107342 us; error 0 us; skew 500 ppm
I20260709 12:14:22.108134 12986 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:14:22.110038 24583 heartbeater.cc:344] Connected to a master server at 127.12.174.190:42177
I20260709 12:14:22.110517 24583 heartbeater.cc:461] Registering TS with master...
I20260709 12:14:22.111191 12986 webserver.cc:533] Webserver started at http://127.12.174.130:34711/ using document root <none> and password file <none>
I20260709 12:14:22.111541 24583 heartbeater.cc:507] Master 127.12.174.190:42177 requested a full tablet report, sending...
I20260709 12:14:22.111974 12986 fs_manager.cc:362] Metadata directory not provided
I20260709 12:14:22.112290 12986 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:14:22.112628 12986 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:14:22.114266 24456 ts_manager.cc:194] Registered new tserver with Master: 19a6c50a7452432c9b7065686d247915 (127.12.174.129:34253)
I20260709 12:14:22.114404 12986 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598886212958-12986-0/minicluster-data/ts-1-root/instance:
uuid: "0957f3414e96411c846439294d91692a"
format_stamp: "Formatted at 2026-07-09 12:14:22 on dist-test-slave-9q7n"
I20260709 12:14:22.116302 24456 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56058
I20260709 12:14:22.120059 12986 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:14:22.124296 24595 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:22.125216 12986 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 12:14:22.125564 12986 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598886212958-12986-0/minicluster-data/ts-1-root
uuid: "0957f3414e96411c846439294d91692a"
format_stamp: "Formatted at 2026-07-09 12:14:22 on dist-test-slave-9q7n"
I20260709 12:14:22.125921 12986 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598886212958-12986-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598886212958-12986-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598886212958-12986-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:14:22.148664 12986 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:14:22.150074 12986 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:14:22.151690 12986 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:14:22.154148 12986 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:14:22.154371 12986 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:22.154623 12986 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:14:22.154786 12986 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:22.200071 12986 rpc_server.cc:307] RPC server started. Bound to: 127.12.174.130:32819
I20260709 12:14:22.200212 24657 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.174.130:32819 every 8 connection(s)
I20260709 12:14:22.205328 12986 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:14:22.213647 24661 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:22.216228 24662 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:14:22.216879 12986 server_base.cc:1061] running on GCE node
W20260709 12:14:22.217944 24664 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:14:22.218942 24658 heartbeater.cc:344] Connected to a master server at 127.12.174.190:42177
I20260709 12:14:22.219010 12986 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:14:22.219406 12986 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:14:22.219481 24658 heartbeater.cc:461] Registering TS with master...
I20260709 12:14:22.219677 12986 hybrid_clock.cc:648] HybridClock initialized: now 1783599262219652 us; error 0 us; skew 500 ppm
I20260709 12:14:22.220537 12986 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:14:22.220558 24658 heartbeater.cc:507] Master 127.12.174.190:42177 requested a full tablet report, sending...
I20260709 12:14:22.223289 24456 ts_manager.cc:194] Registered new tserver with Master: 0957f3414e96411c846439294d91692a (127.12.174.130:32819)
I20260709 12:14:22.223543 12986 webserver.cc:533] Webserver started at http://127.12.174.131:40727/ using document root <none> and password file <none>
I20260709 12:14:22.224177 12986 fs_manager.cc:362] Metadata directory not provided
I20260709 12:14:22.224359 12986 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:14:22.224619 12986 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:14:22.224967 24456 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56072
I20260709 12:14:22.225975 12986 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598886212958-12986-0/minicluster-data/ts-2-root/instance:
uuid: "9f3fb800959647df959d2842e69114e4"
format_stamp: "Formatted at 2026-07-09 12:14:22 on dist-test-slave-9q7n"
I20260709 12:14:22.231774 12986 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.001s	sys 0.004s
I20260709 12:14:22.236475 24669 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:22.237390 12986 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 12:14:22.237704 12986 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598886212958-12986-0/minicluster-data/ts-2-root
uuid: "9f3fb800959647df959d2842e69114e4"
format_stamp: "Formatted at 2026-07-09 12:14:22 on dist-test-slave-9q7n"
I20260709 12:14:22.238174 12986 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598886212958-12986-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598886212958-12986-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598886212958-12986-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:14:22.259835 12986 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:14:22.261237 12986 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:14:22.262998 12986 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:14:22.265756 12986 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:14:22.265985 12986 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.001s	sys 0.000s
I20260709 12:14:22.266270 12986 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:14:22.266420 12986 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:22.313724 12986 rpc_server.cc:307] RPC server started. Bound to: 127.12.174.131:41945
I20260709 12:14:22.313913 24731 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.174.131:41945 every 8 connection(s)
I20260709 12:14:22.330440 24732 heartbeater.cc:344] Connected to a master server at 127.12.174.190:42177
I20260709 12:14:22.330926 24732 heartbeater.cc:461] Registering TS with master...
I20260709 12:14:22.331748 24732 heartbeater.cc:507] Master 127.12.174.190:42177 requested a full tablet report, sending...
I20260709 12:14:22.333858 24456 ts_manager.cc:194] Registered new tserver with Master: 9f3fb800959647df959d2842e69114e4 (127.12.174.131:41945)
I20260709 12:14:22.334743 12986 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.017516362s
I20260709 12:14:22.335371 24456 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56088
I20260709 12:14:22.363327 24456 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56100:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:14:22.366570 24456 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:14:22.461315 24697 tablet_service.cc:1511] Processing CreateTablet for tablet 424a5cb2ff61499abadd789493f7875f (DEFAULT_TABLE table=test-workload [id=25cd7a455cca44d788d03653447315ef]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:14:22.463086 24697 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 424a5cb2ff61499abadd789493f7875f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:22.466766 24548 tablet_service.cc:1511] Processing CreateTablet for tablet 424a5cb2ff61499abadd789493f7875f (DEFAULT_TABLE table=test-workload [id=25cd7a455cca44d788d03653447315ef]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:14:22.468354 24548 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 424a5cb2ff61499abadd789493f7875f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:22.469555 24696 tablet_service.cc:1511] Processing CreateTablet for tablet 1070a1e186974febba3e1d8dc0dbb32e (DEFAULT_TABLE table=test-workload [id=25cd7a455cca44d788d03653447315ef]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:14:22.471150 24696 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1070a1e186974febba3e1d8dc0dbb32e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:22.474905 24620 tablet_service.cc:1511] Processing CreateTablet for tablet fc07ceaa7eb544aeacd41a465a8bf0f8 (DEFAULT_TABLE table=test-workload [id=25cd7a455cca44d788d03653447315ef]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:14:22.476590 24620 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc07ceaa7eb544aeacd41a465a8bf0f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:22.476125 24547 tablet_service.cc:1511] Processing CreateTablet for tablet 1070a1e186974febba3e1d8dc0dbb32e (DEFAULT_TABLE table=test-workload [id=25cd7a455cca44d788d03653447315ef]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:14:22.478344 24547 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1070a1e186974febba3e1d8dc0dbb32e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:22.479019 24546 tablet_service.cc:1511] Processing CreateTablet for tablet 600a4e0a0ca6400fb4ca416228dc31b7 (DEFAULT_TABLE table=test-workload [id=25cd7a455cca44d788d03653447315ef]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:14:22.480558 24546 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 600a4e0a0ca6400fb4ca416228dc31b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:22.480898 24694 tablet_service.cc:1511] Processing CreateTablet for tablet fc07ceaa7eb544aeacd41a465a8bf0f8 (DEFAULT_TABLE table=test-workload [id=25cd7a455cca44d788d03653447315ef]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:14:22.482477 24694 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc07ceaa7eb544aeacd41a465a8bf0f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:22.483045 24695 tablet_service.cc:1511] Processing CreateTablet for tablet 600a4e0a0ca6400fb4ca416228dc31b7 (DEFAULT_TABLE table=test-workload [id=25cd7a455cca44d788d03653447315ef]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:14:22.484603 24695 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 600a4e0a0ca6400fb4ca416228dc31b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:22.486760 24693 tablet_service.cc:1511] Processing CreateTablet for tablet 87f7daeaf8314cce8015910ee7085627 (DEFAULT_TABLE table=test-workload [id=25cd7a455cca44d788d03653447315ef]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:14:22.488281 24693 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87f7daeaf8314cce8015910ee7085627. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:22.491040 24692 tablet_service.cc:1511] Processing CreateTablet for tablet ea42bf8b2c8446bb8cf72377bdc2db72 (DEFAULT_TABLE table=test-workload [id=25cd7a455cca44d788d03653447315ef]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:14:22.491506 24545 tablet_service.cc:1511] Processing CreateTablet for tablet fc07ceaa7eb544aeacd41a465a8bf0f8 (DEFAULT_TABLE table=test-workload [id=25cd7a455cca44d788d03653447315ef]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:14:22.492636 24692 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea42bf8b2c8446bb8cf72377bdc2db72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:22.493197 24545 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc07ceaa7eb544aeacd41a465a8bf0f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:22.495020 24621 tablet_service.cc:1511] Processing CreateTablet for tablet 600a4e0a0ca6400fb4ca416228dc31b7 (DEFAULT_TABLE table=test-workload [id=25cd7a455cca44d788d03653447315ef]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:14:22.496611 24621 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 600a4e0a0ca6400fb4ca416228dc31b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:22.496793 24544 tablet_service.cc:1511] Processing CreateTablet for tablet 87f7daeaf8314cce8015910ee7085627 (DEFAULT_TABLE table=test-workload [id=25cd7a455cca44d788d03653447315ef]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:14:22.498299 24544 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87f7daeaf8314cce8015910ee7085627. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:22.498965 24623 tablet_service.cc:1511] Processing CreateTablet for tablet 424a5cb2ff61499abadd789493f7875f (DEFAULT_TABLE table=test-workload [id=25cd7a455cca44d788d03653447315ef]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:14:22.500447 24623 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 424a5cb2ff61499abadd789493f7875f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:22.503057 24691 tablet_service.cc:1511] Processing CreateTablet for tablet 39fa67f2dd5541f68cfaff5e37b65376 (DEFAULT_TABLE table=test-workload [id=25cd7a455cca44d788d03653447315ef]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:14:22.503522 24543 tablet_service.cc:1511] Processing CreateTablet for tablet ea42bf8b2c8446bb8cf72377bdc2db72 (DEFAULT_TABLE table=test-workload [id=25cd7a455cca44d788d03653447315ef]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:14:22.504647 24691 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39fa67f2dd5541f68cfaff5e37b65376. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:22.505007 24543 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea42bf8b2c8446bb8cf72377bdc2db72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:22.507071 24622 tablet_service.cc:1511] Processing CreateTablet for tablet 1070a1e186974febba3e1d8dc0dbb32e (DEFAULT_TABLE table=test-workload [id=25cd7a455cca44d788d03653447315ef]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:14:22.508047 24542 tablet_service.cc:1511] Processing CreateTablet for tablet 39fa67f2dd5541f68cfaff5e37b65376 (DEFAULT_TABLE table=test-workload [id=25cd7a455cca44d788d03653447315ef]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:14:22.508649 24622 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1070a1e186974febba3e1d8dc0dbb32e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:22.510365 24690 tablet_service.cc:1511] Processing CreateTablet for tablet 7193d4ca686648169964ddb1468a3799 (DEFAULT_TABLE table=test-workload [id=25cd7a455cca44d788d03653447315ef]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:14:22.514633 24542 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39fa67f2dd5541f68cfaff5e37b65376. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:22.515230 24619 tablet_service.cc:1511] Processing CreateTablet for tablet 87f7daeaf8314cce8015910ee7085627 (DEFAULT_TABLE table=test-workload [id=25cd7a455cca44d788d03653447315ef]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:14:22.516878 24619 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87f7daeaf8314cce8015910ee7085627. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:22.519381 24690 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7193d4ca686648169964ddb1468a3799. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:22.519671 24618 tablet_service.cc:1511] Processing CreateTablet for tablet ea42bf8b2c8446bb8cf72377bdc2db72 (DEFAULT_TABLE table=test-workload [id=25cd7a455cca44d788d03653447315ef]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:14:22.521365 24618 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea42bf8b2c8446bb8cf72377bdc2db72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:22.525758 24689 tablet_service.cc:1511] Processing CreateTablet for tablet 47f98adb81f3471f92fb1acba914760c (DEFAULT_TABLE table=test-workload [id=25cd7a455cca44d788d03653447315ef]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:14:22.527382 24689 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47f98adb81f3471f92fb1acba914760c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:22.532905 24688 tablet_service.cc:1511] Processing CreateTablet for tablet aba98af27ae743c7996a5ebd5c0d2780 (DEFAULT_TABLE table=test-workload [id=25cd7a455cca44d788d03653447315ef]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:14:22.534643 24688 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aba98af27ae743c7996a5ebd5c0d2780. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:22.541846 24748 tablet_bootstrap.cc:492] T 1070a1e186974febba3e1d8dc0dbb32e P 9f3fb800959647df959d2842e69114e4: Bootstrap starting.
I20260709 12:14:22.546936 24615 tablet_service.cc:1511] Processing CreateTablet for tablet 47f98adb81f3471f92fb1acba914760c (DEFAULT_TABLE table=test-workload [id=25cd7a455cca44d788d03653447315ef]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:14:22.548087 24541 tablet_service.cc:1511] Processing CreateTablet for tablet 7193d4ca686648169964ddb1468a3799 (DEFAULT_TABLE table=test-workload [id=25cd7a455cca44d788d03653447315ef]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:14:22.548607 24615 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47f98adb81f3471f92fb1acba914760c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:22.549624 24541 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7193d4ca686648169964ddb1468a3799. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:22.551028 24614 tablet_service.cc:1511] Processing CreateTablet for tablet aba98af27ae743c7996a5ebd5c0d2780 (DEFAULT_TABLE table=test-workload [id=25cd7a455cca44d788d03653447315ef]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:14:22.542631 24617 tablet_service.cc:1511] Processing CreateTablet for tablet 39fa67f2dd5541f68cfaff5e37b65376 (DEFAULT_TABLE table=test-workload [id=25cd7a455cca44d788d03653447315ef]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:14:22.544764 24616 tablet_service.cc:1511] Processing CreateTablet for tablet 7193d4ca686648169964ddb1468a3799 (DEFAULT_TABLE table=test-workload [id=25cd7a455cca44d788d03653447315ef]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:14:22.558174 24614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aba98af27ae743c7996a5ebd5c0d2780. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:22.559599 24540 tablet_service.cc:1511] Processing CreateTablet for tablet 47f98adb81f3471f92fb1acba914760c (DEFAULT_TABLE table=test-workload [id=25cd7a455cca44d788d03653447315ef]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:14:22.561228 24540 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47f98adb81f3471f92fb1acba914760c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:22.561233 24616 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7193d4ca686648169964ddb1468a3799. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:22.562541 24617 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39fa67f2dd5541f68cfaff5e37b65376. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:22.556433 24748 tablet_bootstrap.cc:654] T 1070a1e186974febba3e1d8dc0dbb32e P 9f3fb800959647df959d2842e69114e4: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:22.567723 24539 tablet_service.cc:1511] Processing CreateTablet for tablet aba98af27ae743c7996a5ebd5c0d2780 (DEFAULT_TABLE table=test-workload [id=25cd7a455cca44d788d03653447315ef]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:14:22.569308 24539 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aba98af27ae743c7996a5ebd5c0d2780. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:22.735543 24747 tablet_bootstrap.cc:492] T 600a4e0a0ca6400fb4ca416228dc31b7 P 19a6c50a7452432c9b7065686d247915: Bootstrap starting.
I20260709 12:14:22.755442 24748 tablet_bootstrap.cc:492] T 1070a1e186974febba3e1d8dc0dbb32e P 9f3fb800959647df959d2842e69114e4: No bootstrap required, opened a new log
I20260709 12:14:22.756166 24748 ts_tablet_manager.cc:1403] T 1070a1e186974febba3e1d8dc0dbb32e P 9f3fb800959647df959d2842e69114e4: Time spent bootstrapping tablet: real 0.215s	user 0.074s	sys 0.102s
I20260709 12:14:22.759654 24748 raft_consensus.cc:359] T 1070a1e186974febba3e1d8dc0dbb32e P 9f3fb800959647df959d2842e69114e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:22.760485 24748 raft_consensus.cc:385] T 1070a1e186974febba3e1d8dc0dbb32e P 9f3fb800959647df959d2842e69114e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:22.760798 24748 raft_consensus.cc:740] T 1070a1e186974febba3e1d8dc0dbb32e P 9f3fb800959647df959d2842e69114e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f3fb800959647df959d2842e69114e4, State: Initialized, Role: FOLLOWER
I20260709 12:14:22.764834 24750 tablet_bootstrap.cc:492] T 87f7daeaf8314cce8015910ee7085627 P 0957f3414e96411c846439294d91692a: Bootstrap starting.
I20260709 12:14:22.771267 24747 tablet_bootstrap.cc:654] T 600a4e0a0ca6400fb4ca416228dc31b7 P 19a6c50a7452432c9b7065686d247915: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:22.774073 24750 tablet_bootstrap.cc:654] T 87f7daeaf8314cce8015910ee7085627 P 0957f3414e96411c846439294d91692a: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:22.778060 24748 consensus_queue.cc:260] T 1070a1e186974febba3e1d8dc0dbb32e P 9f3fb800959647df959d2842e69114e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:22.790452 24750 tablet_bootstrap.cc:492] T 87f7daeaf8314cce8015910ee7085627 P 0957f3414e96411c846439294d91692a: No bootstrap required, opened a new log
I20260709 12:14:22.791131 24750 ts_tablet_manager.cc:1403] T 87f7daeaf8314cce8015910ee7085627 P 0957f3414e96411c846439294d91692a: Time spent bootstrapping tablet: real 0.027s	user 0.017s	sys 0.002s
I20260709 12:14:22.795531 24750 raft_consensus.cc:359] T 87f7daeaf8314cce8015910ee7085627 P 0957f3414e96411c846439294d91692a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:22.796324 24750 raft_consensus.cc:385] T 87f7daeaf8314cce8015910ee7085627 P 0957f3414e96411c846439294d91692a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:22.796638 24750 raft_consensus.cc:740] T 87f7daeaf8314cce8015910ee7085627 P 0957f3414e96411c846439294d91692a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0957f3414e96411c846439294d91692a, State: Initialized, Role: FOLLOWER
I20260709 12:14:22.797588 24750 consensus_queue.cc:260] T 87f7daeaf8314cce8015910ee7085627 P 0957f3414e96411c846439294d91692a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:22.807291 24750 ts_tablet_manager.cc:1434] T 87f7daeaf8314cce8015910ee7085627 P 0957f3414e96411c846439294d91692a: Time spent starting tablet: real 0.016s	user 0.009s	sys 0.005s
I20260709 12:14:22.808351 24658 heartbeater.cc:499] Master 127.12.174.190:42177 was elected leader, sending a full tablet report...
I20260709 12:14:22.818766 24750 tablet_bootstrap.cc:492] T 7193d4ca686648169964ddb1468a3799 P 0957f3414e96411c846439294d91692a: Bootstrap starting.
I20260709 12:14:22.826100 24750 tablet_bootstrap.cc:654] T 7193d4ca686648169964ddb1468a3799 P 0957f3414e96411c846439294d91692a: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:22.831918 24732 heartbeater.cc:499] Master 127.12.174.190:42177 was elected leader, sending a full tablet report...
I20260709 12:14:22.847138 24750 tablet_bootstrap.cc:492] T 7193d4ca686648169964ddb1468a3799 P 0957f3414e96411c846439294d91692a: No bootstrap required, opened a new log
I20260709 12:14:22.847298 24748 ts_tablet_manager.cc:1434] T 1070a1e186974febba3e1d8dc0dbb32e P 9f3fb800959647df959d2842e69114e4: Time spent starting tablet: real 0.091s	user 0.013s	sys 0.021s
I20260709 12:14:22.848047 24750 ts_tablet_manager.cc:1403] T 7193d4ca686648169964ddb1468a3799 P 0957f3414e96411c846439294d91692a: Time spent bootstrapping tablet: real 0.030s	user 0.015s	sys 0.004s
I20260709 12:14:22.848857 24748 tablet_bootstrap.cc:492] T 424a5cb2ff61499abadd789493f7875f P 9f3fb800959647df959d2842e69114e4: Bootstrap starting.
I20260709 12:14:22.852571 24750 raft_consensus.cc:359] T 7193d4ca686648169964ddb1468a3799 P 0957f3414e96411c846439294d91692a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:22.853379 24750 raft_consensus.cc:385] T 7193d4ca686648169964ddb1468a3799 P 0957f3414e96411c846439294d91692a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:22.853722 24750 raft_consensus.cc:740] T 7193d4ca686648169964ddb1468a3799 P 0957f3414e96411c846439294d91692a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0957f3414e96411c846439294d91692a, State: Initialized, Role: FOLLOWER
I20260709 12:14:22.854753 24750 consensus_queue.cc:260] T 7193d4ca686648169964ddb1468a3799 P 0957f3414e96411c846439294d91692a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:22.861821 24747 tablet_bootstrap.cc:492] T 600a4e0a0ca6400fb4ca416228dc31b7 P 19a6c50a7452432c9b7065686d247915: No bootstrap required, opened a new log
I20260709 12:14:22.862596 24747 ts_tablet_manager.cc:1403] T 600a4e0a0ca6400fb4ca416228dc31b7 P 19a6c50a7452432c9b7065686d247915: Time spent bootstrapping tablet: real 0.149s	user 0.027s	sys 0.014s
I20260709 12:14:22.862752 24748 tablet_bootstrap.cc:654] T 424a5cb2ff61499abadd789493f7875f P 9f3fb800959647df959d2842e69114e4: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:22.866154 24747 raft_consensus.cc:359] T 600a4e0a0ca6400fb4ca416228dc31b7 P 19a6c50a7452432c9b7065686d247915 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:22.867154 24747 raft_consensus.cc:385] T 600a4e0a0ca6400fb4ca416228dc31b7 P 19a6c50a7452432c9b7065686d247915 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:22.867481 24747 raft_consensus.cc:740] T 600a4e0a0ca6400fb4ca416228dc31b7 P 19a6c50a7452432c9b7065686d247915 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19a6c50a7452432c9b7065686d247915, State: Initialized, Role: FOLLOWER
I20260709 12:14:22.867904 24750 ts_tablet_manager.cc:1434] T 7193d4ca686648169964ddb1468a3799 P 0957f3414e96411c846439294d91692a: Time spent starting tablet: real 0.019s	user 0.009s	sys 0.000s
I20260709 12:14:22.868587 24747 consensus_queue.cc:260] T 600a4e0a0ca6400fb4ca416228dc31b7 P 19a6c50a7452432c9b7065686d247915 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:22.869259 24750 tablet_bootstrap.cc:492] T aba98af27ae743c7996a5ebd5c0d2780 P 0957f3414e96411c846439294d91692a: Bootstrap starting.
I20260709 12:14:22.877187 24750 tablet_bootstrap.cc:654] T aba98af27ae743c7996a5ebd5c0d2780 P 0957f3414e96411c846439294d91692a: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:22.880357 24583 heartbeater.cc:499] Master 127.12.174.190:42177 was elected leader, sending a full tablet report...
I20260709 12:14:22.881785 24748 tablet_bootstrap.cc:492] T 424a5cb2ff61499abadd789493f7875f P 9f3fb800959647df959d2842e69114e4: No bootstrap required, opened a new log
I20260709 12:14:22.882380 24747 ts_tablet_manager.cc:1434] T 600a4e0a0ca6400fb4ca416228dc31b7 P 19a6c50a7452432c9b7065686d247915: Time spent starting tablet: real 0.019s	user 0.015s	sys 0.004s
I20260709 12:14:22.882467 24748 ts_tablet_manager.cc:1403] T 424a5cb2ff61499abadd789493f7875f P 9f3fb800959647df959d2842e69114e4: Time spent bootstrapping tablet: real 0.034s	user 0.012s	sys 0.013s
I20260709 12:14:22.885001 24747 tablet_bootstrap.cc:492] T aba98af27ae743c7996a5ebd5c0d2780 P 19a6c50a7452432c9b7065686d247915: Bootstrap starting.
I20260709 12:14:22.886008 24750 tablet_bootstrap.cc:492] T aba98af27ae743c7996a5ebd5c0d2780 P 0957f3414e96411c846439294d91692a: No bootstrap required, opened a new log
I20260709 12:14:22.886656 24750 ts_tablet_manager.cc:1403] T aba98af27ae743c7996a5ebd5c0d2780 P 0957f3414e96411c846439294d91692a: Time spent bootstrapping tablet: real 0.018s	user 0.009s	sys 0.005s
I20260709 12:14:22.886977 24748 raft_consensus.cc:359] T 424a5cb2ff61499abadd789493f7875f P 9f3fb800959647df959d2842e69114e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } } peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } }
I20260709 12:14:22.887821 24748 raft_consensus.cc:385] T 424a5cb2ff61499abadd789493f7875f P 9f3fb800959647df959d2842e69114e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:22.888142 24748 raft_consensus.cc:740] T 424a5cb2ff61499abadd789493f7875f P 9f3fb800959647df959d2842e69114e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f3fb800959647df959d2842e69114e4, State: Initialized, Role: FOLLOWER
I20260709 12:14:22.889151 24748 consensus_queue.cc:260] T 424a5cb2ff61499abadd789493f7875f P 9f3fb800959647df959d2842e69114e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } } peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } }
I20260709 12:14:22.890216 24750 raft_consensus.cc:359] T aba98af27ae743c7996a5ebd5c0d2780 P 0957f3414e96411c846439294d91692a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:22.891188 24750 raft_consensus.cc:385] T aba98af27ae743c7996a5ebd5c0d2780 P 0957f3414e96411c846439294d91692a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:22.891497 24750 raft_consensus.cc:740] T aba98af27ae743c7996a5ebd5c0d2780 P 0957f3414e96411c846439294d91692a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0957f3414e96411c846439294d91692a, State: Initialized, Role: FOLLOWER
I20260709 12:14:22.892302 24750 consensus_queue.cc:260] T aba98af27ae743c7996a5ebd5c0d2780 P 0957f3414e96411c846439294d91692a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:22.894719 24750 ts_tablet_manager.cc:1434] T aba98af27ae743c7996a5ebd5c0d2780 P 0957f3414e96411c846439294d91692a: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:14:22.895900 24750 tablet_bootstrap.cc:492] T ea42bf8b2c8446bb8cf72377bdc2db72 P 0957f3414e96411c846439294d91692a: Bootstrap starting.
I20260709 12:14:22.898038 24754 raft_consensus.cc:493] T 87f7daeaf8314cce8015910ee7085627 P 0957f3414e96411c846439294d91692a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:22.898591 24748 ts_tablet_manager.cc:1434] T 424a5cb2ff61499abadd789493f7875f P 9f3fb800959647df959d2842e69114e4: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.001s
I20260709 12:14:22.899976 24748 tablet_bootstrap.cc:492] T 7193d4ca686648169964ddb1468a3799 P 9f3fb800959647df959d2842e69114e4: Bootstrap starting.
I20260709 12:14:22.898671 24754 raft_consensus.cc:515] T 87f7daeaf8314cce8015910ee7085627 P 0957f3414e96411c846439294d91692a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:22.903391 24750 tablet_bootstrap.cc:654] T ea42bf8b2c8446bb8cf72377bdc2db72 P 0957f3414e96411c846439294d91692a: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:22.905380 24747 tablet_bootstrap.cc:654] T aba98af27ae743c7996a5ebd5c0d2780 P 19a6c50a7452432c9b7065686d247915: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:22.907615 24748 tablet_bootstrap.cc:654] T 7193d4ca686648169964ddb1468a3799 P 9f3fb800959647df959d2842e69114e4: Neither blocks nor log segments found. Creating new log.
W20260709 12:14:22.908258 24504 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:14:22.922441 24754 leader_election.cc:290] T 87f7daeaf8314cce8015910ee7085627 P 0957f3414e96411c846439294d91692a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 19a6c50a7452432c9b7065686d247915 (127.12.174.129:34253), 9f3fb800959647df959d2842e69114e4 (127.12.174.131:41945)
W20260709 12:14:22.955009 24659 tablet.cc:2406] T 7193d4ca686648169964ddb1468a3799 P 0957f3414e96411c846439294d91692a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:14:22.974560 24748 tablet_bootstrap.cc:492] T 7193d4ca686648169964ddb1468a3799 P 9f3fb800959647df959d2842e69114e4: No bootstrap required, opened a new log
I20260709 12:14:22.975370 24748 ts_tablet_manager.cc:1403] T 7193d4ca686648169964ddb1468a3799 P 9f3fb800959647df959d2842e69114e4: Time spent bootstrapping tablet: real 0.076s	user 0.027s	sys 0.030s
I20260709 12:14:22.979315 24748 raft_consensus.cc:359] T 7193d4ca686648169964ddb1468a3799 P 9f3fb800959647df959d2842e69114e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:22.980275 24748 raft_consensus.cc:385] T 7193d4ca686648169964ddb1468a3799 P 9f3fb800959647df959d2842e69114e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:22.980609 24748 raft_consensus.cc:740] T 7193d4ca686648169964ddb1468a3799 P 9f3fb800959647df959d2842e69114e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f3fb800959647df959d2842e69114e4, State: Initialized, Role: FOLLOWER
I20260709 12:14:22.981670 24707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f7daeaf8314cce8015910ee7085627" candidate_uuid: "0957f3414e96411c846439294d91692a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f3fb800959647df959d2842e69114e4" is_pre_election: true
I20260709 12:14:22.984261 24747 tablet_bootstrap.cc:492] T aba98af27ae743c7996a5ebd5c0d2780 P 19a6c50a7452432c9b7065686d247915: No bootstrap required, opened a new log
I20260709 12:14:22.984921 24747 ts_tablet_manager.cc:1403] T aba98af27ae743c7996a5ebd5c0d2780 P 19a6c50a7452432c9b7065686d247915: Time spent bootstrapping tablet: real 0.100s	user 0.025s	sys 0.031s
I20260709 12:14:22.986212 24748 consensus_queue.cc:260] T 7193d4ca686648169964ddb1468a3799 P 9f3fb800959647df959d2842e69114e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:22.988649 24750 tablet_bootstrap.cc:492] T ea42bf8b2c8446bb8cf72377bdc2db72 P 0957f3414e96411c846439294d91692a: No bootstrap required, opened a new log
I20260709 12:14:22.988308 24747 raft_consensus.cc:359] T aba98af27ae743c7996a5ebd5c0d2780 P 19a6c50a7452432c9b7065686d247915 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:22.988809 24748 ts_tablet_manager.cc:1434] T 7193d4ca686648169964ddb1468a3799 P 9f3fb800959647df959d2842e69114e4: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.001s
I20260709 12:14:22.989168 24747 raft_consensus.cc:385] T aba98af27ae743c7996a5ebd5c0d2780 P 19a6c50a7452432c9b7065686d247915 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:22.989287 24750 ts_tablet_manager.cc:1403] T ea42bf8b2c8446bb8cf72377bdc2db72 P 0957f3414e96411c846439294d91692a: Time spent bootstrapping tablet: real 0.094s	user 0.037s	sys 0.054s
I20260709 12:14:22.989555 24747 raft_consensus.cc:740] T aba98af27ae743c7996a5ebd5c0d2780 P 19a6c50a7452432c9b7065686d247915 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19a6c50a7452432c9b7065686d247915, State: Initialized, Role: FOLLOWER
W20260709 12:14:22.984668 24596 leader_election.cc:343] T 87f7daeaf8314cce8015910ee7085627 P 0957f3414e96411c846439294d91692a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9f3fb800959647df959d2842e69114e4 (127.12.174.131:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:22.990595 24747 consensus_queue.cc:260] T aba98af27ae743c7996a5ebd5c0d2780 P 19a6c50a7452432c9b7065686d247915 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:22.991586 24748 tablet_bootstrap.cc:492] T 47f98adb81f3471f92fb1acba914760c P 9f3fb800959647df959d2842e69114e4: Bootstrap starting.
I20260709 12:14:22.993283 24747 ts_tablet_manager.cc:1434] T aba98af27ae743c7996a5ebd5c0d2780 P 19a6c50a7452432c9b7065686d247915: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.001s
I20260709 12:14:22.992936 24750 raft_consensus.cc:359] T ea42bf8b2c8446bb8cf72377bdc2db72 P 0957f3414e96411c846439294d91692a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:22.993815 24750 raft_consensus.cc:385] T ea42bf8b2c8446bb8cf72377bdc2db72 P 0957f3414e96411c846439294d91692a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:22.994148 24750 raft_consensus.cc:740] T ea42bf8b2c8446bb8cf72377bdc2db72 P 0957f3414e96411c846439294d91692a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0957f3414e96411c846439294d91692a, State: Initialized, Role: FOLLOWER
I20260709 12:14:22.994516 24747 tablet_bootstrap.cc:492] T ea42bf8b2c8446bb8cf72377bdc2db72 P 19a6c50a7452432c9b7065686d247915: Bootstrap starting.
I20260709 12:14:22.995023 24750 consensus_queue.cc:260] T ea42bf8b2c8446bb8cf72377bdc2db72 P 0957f3414e96411c846439294d91692a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:22.999785 24748 tablet_bootstrap.cc:654] T 47f98adb81f3471f92fb1acba914760c P 9f3fb800959647df959d2842e69114e4: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:23.001156 24750 ts_tablet_manager.cc:1434] T ea42bf8b2c8446bb8cf72377bdc2db72 P 0957f3414e96411c846439294d91692a: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:14:23.002533 24750 tablet_bootstrap.cc:492] T fc07ceaa7eb544aeacd41a465a8bf0f8 P 0957f3414e96411c846439294d91692a: Bootstrap starting.
I20260709 12:14:23.002784 24747 tablet_bootstrap.cc:654] T ea42bf8b2c8446bb8cf72377bdc2db72 P 19a6c50a7452432c9b7065686d247915: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:23.012456 24748 tablet_bootstrap.cc:492] T 47f98adb81f3471f92fb1acba914760c P 9f3fb800959647df959d2842e69114e4: No bootstrap required, opened a new log
I20260709 12:14:23.013108 24748 ts_tablet_manager.cc:1403] T 47f98adb81f3471f92fb1acba914760c P 9f3fb800959647df959d2842e69114e4: Time spent bootstrapping tablet: real 0.022s	user 0.009s	sys 0.009s
I20260709 12:14:23.014803 24558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f7daeaf8314cce8015910ee7085627" candidate_uuid: "0957f3414e96411c846439294d91692a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19a6c50a7452432c9b7065686d247915" is_pre_election: true
W20260709 12:14:23.016866 24598 leader_election.cc:343] T 87f7daeaf8314cce8015910ee7085627 P 0957f3414e96411c846439294d91692a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 19a6c50a7452432c9b7065686d247915 (127.12.174.129:34253): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:23.017417 24598 leader_election.cc:304] T 87f7daeaf8314cce8015910ee7085627 P 0957f3414e96411c846439294d91692a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0957f3414e96411c846439294d91692a; no voters: 19a6c50a7452432c9b7065686d247915, 9f3fb800959647df959d2842e69114e4
I20260709 12:14:23.018348 24754 raft_consensus.cc:2749] T 87f7daeaf8314cce8015910ee7085627 P 0957f3414e96411c846439294d91692a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:23.016461 24748 raft_consensus.cc:359] T 47f98adb81f3471f92fb1acba914760c P 9f3fb800959647df959d2842e69114e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:23.019759 24748 raft_consensus.cc:385] T 47f98adb81f3471f92fb1acba914760c P 9f3fb800959647df959d2842e69114e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:23.020084 24748 raft_consensus.cc:740] T 47f98adb81f3471f92fb1acba914760c P 9f3fb800959647df959d2842e69114e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f3fb800959647df959d2842e69114e4, State: Initialized, Role: FOLLOWER
I20260709 12:14:23.020356 24747 tablet_bootstrap.cc:492] T ea42bf8b2c8446bb8cf72377bdc2db72 P 19a6c50a7452432c9b7065686d247915: No bootstrap required, opened a new log
I20260709 12:14:23.020390 24750 tablet_bootstrap.cc:654] T fc07ceaa7eb544aeacd41a465a8bf0f8 P 0957f3414e96411c846439294d91692a: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:23.021073 24747 ts_tablet_manager.cc:1403] T ea42bf8b2c8446bb8cf72377bdc2db72 P 19a6c50a7452432c9b7065686d247915: Time spent bootstrapping tablet: real 0.027s	user 0.021s	sys 0.005s
I20260709 12:14:23.020967 24748 consensus_queue.cc:260] T 47f98adb81f3471f92fb1acba914760c P 9f3fb800959647df959d2842e69114e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:23.023978 24748 ts_tablet_manager.cc:1434] T 47f98adb81f3471f92fb1acba914760c P 9f3fb800959647df959d2842e69114e4: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.001s
I20260709 12:14:23.025089 24748 tablet_bootstrap.cc:492] T 600a4e0a0ca6400fb4ca416228dc31b7 P 9f3fb800959647df959d2842e69114e4: Bootstrap starting.
I20260709 12:14:23.024627 24747 raft_consensus.cc:359] T ea42bf8b2c8446bb8cf72377bdc2db72 P 19a6c50a7452432c9b7065686d247915 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:23.027293 24747 raft_consensus.cc:385] T ea42bf8b2c8446bb8cf72377bdc2db72 P 19a6c50a7452432c9b7065686d247915 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:23.027750 24747 raft_consensus.cc:740] T ea42bf8b2c8446bb8cf72377bdc2db72 P 19a6c50a7452432c9b7065686d247915 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19a6c50a7452432c9b7065686d247915, State: Initialized, Role: FOLLOWER
I20260709 12:14:23.028836 24747 consensus_queue.cc:260] T ea42bf8b2c8446bb8cf72377bdc2db72 P 19a6c50a7452432c9b7065686d247915 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:23.031488 24747 ts_tablet_manager.cc:1434] T ea42bf8b2c8446bb8cf72377bdc2db72 P 19a6c50a7452432c9b7065686d247915: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.003s
I20260709 12:14:23.033725 24748 tablet_bootstrap.cc:654] T 600a4e0a0ca6400fb4ca416228dc31b7 P 9f3fb800959647df959d2842e69114e4: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:23.035881 24750 tablet_bootstrap.cc:492] T fc07ceaa7eb544aeacd41a465a8bf0f8 P 0957f3414e96411c846439294d91692a: No bootstrap required, opened a new log
I20260709 12:14:23.036546 24750 ts_tablet_manager.cc:1403] T fc07ceaa7eb544aeacd41a465a8bf0f8 P 0957f3414e96411c846439294d91692a: Time spent bootstrapping tablet: real 0.034s	user 0.011s	sys 0.011s
I20260709 12:14:23.038092 24747 tablet_bootstrap.cc:492] T 39fa67f2dd5541f68cfaff5e37b65376 P 19a6c50a7452432c9b7065686d247915: Bootstrap starting.
I20260709 12:14:23.040169 24750 raft_consensus.cc:359] T fc07ceaa7eb544aeacd41a465a8bf0f8 P 0957f3414e96411c846439294d91692a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:23.041105 24750 raft_consensus.cc:385] T fc07ceaa7eb544aeacd41a465a8bf0f8 P 0957f3414e96411c846439294d91692a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:23.041465 24750 raft_consensus.cc:740] T fc07ceaa7eb544aeacd41a465a8bf0f8 P 0957f3414e96411c846439294d91692a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0957f3414e96411c846439294d91692a, State: Initialized, Role: FOLLOWER
I20260709 12:14:23.042418 24750 consensus_queue.cc:260] T fc07ceaa7eb544aeacd41a465a8bf0f8 P 0957f3414e96411c846439294d91692a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:23.046593 24747 tablet_bootstrap.cc:654] T 39fa67f2dd5541f68cfaff5e37b65376 P 19a6c50a7452432c9b7065686d247915: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:23.048357 24750 ts_tablet_manager.cc:1434] T fc07ceaa7eb544aeacd41a465a8bf0f8 P 0957f3414e96411c846439294d91692a: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.003s
I20260709 12:14:23.049755 24750 tablet_bootstrap.cc:492] T 424a5cb2ff61499abadd789493f7875f P 0957f3414e96411c846439294d91692a: Bootstrap starting.
I20260709 12:14:23.051848 24752 raft_consensus.cc:493] T 424a5cb2ff61499abadd789493f7875f P 9f3fb800959647df959d2842e69114e4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:23.052574 24752 raft_consensus.cc:515] T 424a5cb2ff61499abadd789493f7875f P 9f3fb800959647df959d2842e69114e4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } } peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } }
I20260709 12:14:23.057390 24750 tablet_bootstrap.cc:654] T 424a5cb2ff61499abadd789493f7875f P 0957f3414e96411c846439294d91692a: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:23.057861 24752 leader_election.cc:290] T 424a5cb2ff61499abadd789493f7875f P 9f3fb800959647df959d2842e69114e4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 19a6c50a7452432c9b7065686d247915 (127.12.174.129:34253), 0957f3414e96411c846439294d91692a (127.12.174.130:32819)
I20260709 12:14:23.070895 24748 tablet_bootstrap.cc:492] T 600a4e0a0ca6400fb4ca416228dc31b7 P 9f3fb800959647df959d2842e69114e4: No bootstrap required, opened a new log
I20260709 12:14:23.071636 24748 ts_tablet_manager.cc:1403] T 600a4e0a0ca6400fb4ca416228dc31b7 P 9f3fb800959647df959d2842e69114e4: Time spent bootstrapping tablet: real 0.047s	user 0.016s	sys 0.015s
I20260709 12:14:23.075379 24747 tablet_bootstrap.cc:492] T 39fa67f2dd5541f68cfaff5e37b65376 P 19a6c50a7452432c9b7065686d247915: No bootstrap required, opened a new log
I20260709 12:14:23.076073 24747 ts_tablet_manager.cc:1403] T 39fa67f2dd5541f68cfaff5e37b65376 P 19a6c50a7452432c9b7065686d247915: Time spent bootstrapping tablet: real 0.038s	user 0.018s	sys 0.012s
I20260709 12:14:23.075891 24748 raft_consensus.cc:359] T 600a4e0a0ca6400fb4ca416228dc31b7 P 9f3fb800959647df959d2842e69114e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:23.076803 24748 raft_consensus.cc:385] T 600a4e0a0ca6400fb4ca416228dc31b7 P 9f3fb800959647df959d2842e69114e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:23.077143 24748 raft_consensus.cc:740] T 600a4e0a0ca6400fb4ca416228dc31b7 P 9f3fb800959647df959d2842e69114e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f3fb800959647df959d2842e69114e4, State: Initialized, Role: FOLLOWER
I20260709 12:14:23.075379 24750 tablet_bootstrap.cc:492] T 424a5cb2ff61499abadd789493f7875f P 0957f3414e96411c846439294d91692a: No bootstrap required, opened a new log
I20260709 12:14:23.078118 24748 consensus_queue.cc:260] T 600a4e0a0ca6400fb4ca416228dc31b7 P 9f3fb800959647df959d2842e69114e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:23.079221 24633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424a5cb2ff61499abadd789493f7875f" candidate_uuid: "9f3fb800959647df959d2842e69114e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0957f3414e96411c846439294d91692a" is_pre_election: true
I20260709 12:14:23.079742 24747 raft_consensus.cc:359] T 39fa67f2dd5541f68cfaff5e37b65376 P 19a6c50a7452432c9b7065686d247915 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:23.080520 24747 raft_consensus.cc:385] T 39fa67f2dd5541f68cfaff5e37b65376 P 19a6c50a7452432c9b7065686d247915 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:23.080837 24747 raft_consensus.cc:740] T 39fa67f2dd5541f68cfaff5e37b65376 P 19a6c50a7452432c9b7065686d247915 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19a6c50a7452432c9b7065686d247915, State: Initialized, Role: FOLLOWER
I20260709 12:14:23.078254 24750 ts_tablet_manager.cc:1403] T 424a5cb2ff61499abadd789493f7875f P 0957f3414e96411c846439294d91692a: Time spent bootstrapping tablet: real 0.029s	user 0.013s	sys 0.002s
I20260709 12:14:23.081656 24747 consensus_queue.cc:260] T 39fa67f2dd5541f68cfaff5e37b65376 P 19a6c50a7452432c9b7065686d247915 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:23.082051 24558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424a5cb2ff61499abadd789493f7875f" candidate_uuid: "9f3fb800959647df959d2842e69114e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19a6c50a7452432c9b7065686d247915" is_pre_election: true
W20260709 12:14:23.083561 24671 leader_election.cc:343] T 424a5cb2ff61499abadd789493f7875f P 9f3fb800959647df959d2842e69114e4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0957f3414e96411c846439294d91692a (127.12.174.130:32819): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:14:23.085074 24672 leader_election.cc:343] T 424a5cb2ff61499abadd789493f7875f P 9f3fb800959647df959d2842e69114e4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 19a6c50a7452432c9b7065686d247915 (127.12.174.129:34253): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:23.085599 24672 leader_election.cc:304] T 424a5cb2ff61499abadd789493f7875f P 9f3fb800959647df959d2842e69114e4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f3fb800959647df959d2842e69114e4; no voters: 0957f3414e96411c846439294d91692a, 19a6c50a7452432c9b7065686d247915
I20260709 12:14:23.086997 24752 raft_consensus.cc:2749] T 424a5cb2ff61499abadd789493f7875f P 9f3fb800959647df959d2842e69114e4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:23.087091 24747 ts_tablet_manager.cc:1434] T 39fa67f2dd5541f68cfaff5e37b65376 P 19a6c50a7452432c9b7065686d247915: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:14:23.088498 24747 tablet_bootstrap.cc:492] T 87f7daeaf8314cce8015910ee7085627 P 19a6c50a7452432c9b7065686d247915: Bootstrap starting.
I20260709 12:14:23.089052 24750 raft_consensus.cc:359] T 424a5cb2ff61499abadd789493f7875f P 0957f3414e96411c846439294d91692a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } } peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } }
I20260709 12:14:23.090317 24750 raft_consensus.cc:385] T 424a5cb2ff61499abadd789493f7875f P 0957f3414e96411c846439294d91692a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:23.090790 24750 raft_consensus.cc:740] T 424a5cb2ff61499abadd789493f7875f P 0957f3414e96411c846439294d91692a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0957f3414e96411c846439294d91692a, State: Initialized, Role: FOLLOWER
I20260709 12:14:23.090382 24748 ts_tablet_manager.cc:1434] T 600a4e0a0ca6400fb4ca416228dc31b7 P 9f3fb800959647df959d2842e69114e4: Time spent starting tablet: real 0.018s	user 0.009s	sys 0.001s
I20260709 12:14:23.092057 24750 consensus_queue.cc:260] T 424a5cb2ff61499abadd789493f7875f P 0957f3414e96411c846439294d91692a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } } peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } }
I20260709 12:14:23.094244 24752 raft_consensus.cc:493] T 600a4e0a0ca6400fb4ca416228dc31b7 P 9f3fb800959647df959d2842e69114e4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:23.094985 24752 raft_consensus.cc:515] T 600a4e0a0ca6400fb4ca416228dc31b7 P 9f3fb800959647df959d2842e69114e4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:23.098888 24633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600a4e0a0ca6400fb4ca416228dc31b7" candidate_uuid: "9f3fb800959647df959d2842e69114e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0957f3414e96411c846439294d91692a" is_pre_election: true
I20260709 12:14:23.099689 24747 tablet_bootstrap.cc:654] T 87f7daeaf8314cce8015910ee7085627 P 19a6c50a7452432c9b7065686d247915: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:23.100407 24752 leader_election.cc:290] T 600a4e0a0ca6400fb4ca416228dc31b7 P 9f3fb800959647df959d2842e69114e4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 19a6c50a7452432c9b7065686d247915 (127.12.174.129:34253), 0957f3414e96411c846439294d91692a (127.12.174.130:32819)
I20260709 12:14:23.101289 24558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600a4e0a0ca6400fb4ca416228dc31b7" candidate_uuid: "9f3fb800959647df959d2842e69114e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19a6c50a7452432c9b7065686d247915" is_pre_election: true
I20260709 12:14:23.102176 24558 raft_consensus.cc:2468] T 600a4e0a0ca6400fb4ca416228dc31b7 P 19a6c50a7452432c9b7065686d247915 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f3fb800959647df959d2842e69114e4 in term 0.
W20260709 12:14:23.103394 24671 leader_election.cc:343] T 600a4e0a0ca6400fb4ca416228dc31b7 P 9f3fb800959647df959d2842e69114e4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0957f3414e96411c846439294d91692a (127.12.174.130:32819): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:23.104416 24750 ts_tablet_manager.cc:1434] T 424a5cb2ff61499abadd789493f7875f P 0957f3414e96411c846439294d91692a: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.000s
I20260709 12:14:23.104848 24672 leader_election.cc:304] T 600a4e0a0ca6400fb4ca416228dc31b7 P 9f3fb800959647df959d2842e69114e4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 19a6c50a7452432c9b7065686d247915, 9f3fb800959647df959d2842e69114e4; no voters: 0957f3414e96411c846439294d91692a
I20260709 12:14:23.106371 24752 raft_consensus.cc:2804] T 600a4e0a0ca6400fb4ca416228dc31b7 P 9f3fb800959647df959d2842e69114e4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:23.106664 24748 tablet_bootstrap.cc:492] T aba98af27ae743c7996a5ebd5c0d2780 P 9f3fb800959647df959d2842e69114e4: Bootstrap starting.
I20260709 12:14:23.106815 24752 raft_consensus.cc:493] T 600a4e0a0ca6400fb4ca416228dc31b7 P 9f3fb800959647df959d2842e69114e4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:23.107565 24750 tablet_bootstrap.cc:492] T 39fa67f2dd5541f68cfaff5e37b65376 P 0957f3414e96411c846439294d91692a: Bootstrap starting.
I20260709 12:14:23.108250 24752 raft_consensus.cc:3060] T 600a4e0a0ca6400fb4ca416228dc31b7 P 9f3fb800959647df959d2842e69114e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:23.115639 24748 tablet_bootstrap.cc:654] T aba98af27ae743c7996a5ebd5c0d2780 P 9f3fb800959647df959d2842e69114e4: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:23.116040 24747 tablet_bootstrap.cc:492] T 87f7daeaf8314cce8015910ee7085627 P 19a6c50a7452432c9b7065686d247915: No bootstrap required, opened a new log
I20260709 12:14:23.116674 24747 ts_tablet_manager.cc:1403] T 87f7daeaf8314cce8015910ee7085627 P 19a6c50a7452432c9b7065686d247915: Time spent bootstrapping tablet: real 0.028s	user 0.013s	sys 0.004s
I20260709 12:14:23.118172 24750 tablet_bootstrap.cc:654] T 39fa67f2dd5541f68cfaff5e37b65376 P 0957f3414e96411c846439294d91692a: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:23.118320 24752 raft_consensus.cc:515] T 600a4e0a0ca6400fb4ca416228dc31b7 P 9f3fb800959647df959d2842e69114e4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:23.120289 24747 raft_consensus.cc:359] T 87f7daeaf8314cce8015910ee7085627 P 19a6c50a7452432c9b7065686d247915 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:23.121245 24747 raft_consensus.cc:385] T 87f7daeaf8314cce8015910ee7085627 P 19a6c50a7452432c9b7065686d247915 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:23.121567 24747 raft_consensus.cc:740] T 87f7daeaf8314cce8015910ee7085627 P 19a6c50a7452432c9b7065686d247915 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19a6c50a7452432c9b7065686d247915, State: Initialized, Role: FOLLOWER
I20260709 12:14:23.122123 24558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600a4e0a0ca6400fb4ca416228dc31b7" candidate_uuid: "9f3fb800959647df959d2842e69114e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19a6c50a7452432c9b7065686d247915"
I20260709 12:14:23.122869 24558 raft_consensus.cc:3060] T 600a4e0a0ca6400fb4ca416228dc31b7 P 19a6c50a7452432c9b7065686d247915 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:23.122541 24747 consensus_queue.cc:260] T 87f7daeaf8314cce8015910ee7085627 P 19a6c50a7452432c9b7065686d247915 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:23.125231 24747 ts_tablet_manager.cc:1434] T 87f7daeaf8314cce8015910ee7085627 P 19a6c50a7452432c9b7065686d247915: Time spent starting tablet: real 0.008s	user 0.000s	sys 0.008s
I20260709 12:14:23.126545 24747 tablet_bootstrap.cc:492] T 47f98adb81f3471f92fb1acba914760c P 19a6c50a7452432c9b7065686d247915: Bootstrap starting.
I20260709 12:14:23.133667 24747 tablet_bootstrap.cc:654] T 47f98adb81f3471f92fb1acba914760c P 19a6c50a7452432c9b7065686d247915: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:23.140472 24633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600a4e0a0ca6400fb4ca416228dc31b7" candidate_uuid: "9f3fb800959647df959d2842e69114e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0957f3414e96411c846439294d91692a"
W20260709 12:14:23.142719 24671 leader_election.cc:343] T 600a4e0a0ca6400fb4ca416228dc31b7 P 9f3fb800959647df959d2842e69114e4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0957f3414e96411c846439294d91692a (127.12.174.130:32819): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:23.143714 24752 leader_election.cc:290] T 600a4e0a0ca6400fb4ca416228dc31b7 P 9f3fb800959647df959d2842e69114e4 [CANDIDATE]: Term 1 election: Requested vote from peers 19a6c50a7452432c9b7065686d247915 (127.12.174.129:34253), 0957f3414e96411c846439294d91692a (127.12.174.130:32819)
I20260709 12:14:23.146618 24752 raft_consensus.cc:493] T 1070a1e186974febba3e1d8dc0dbb32e P 9f3fb800959647df959d2842e69114e4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:23.147199 24752 raft_consensus.cc:515] T 1070a1e186974febba3e1d8dc0dbb32e P 9f3fb800959647df959d2842e69114e4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:23.151333 24557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1070a1e186974febba3e1d8dc0dbb32e" candidate_uuid: "9f3fb800959647df959d2842e69114e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19a6c50a7452432c9b7065686d247915" is_pre_election: true
W20260709 12:14:23.153472 24672 leader_election.cc:343] T 1070a1e186974febba3e1d8dc0dbb32e P 9f3fb800959647df959d2842e69114e4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 19a6c50a7452432c9b7065686d247915 (127.12.174.129:34253): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:23.157119 24558 raft_consensus.cc:2468] T 600a4e0a0ca6400fb4ca416228dc31b7 P 19a6c50a7452432c9b7065686d247915 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f3fb800959647df959d2842e69114e4 in term 1.
I20260709 12:14:23.161711 24633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1070a1e186974febba3e1d8dc0dbb32e" candidate_uuid: "9f3fb800959647df959d2842e69114e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0957f3414e96411c846439294d91692a" is_pre_election: true
W20260709 12:14:23.164029 24671 leader_election.cc:343] T 1070a1e186974febba3e1d8dc0dbb32e P 9f3fb800959647df959d2842e69114e4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0957f3414e96411c846439294d91692a (127.12.174.130:32819): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:23.164649 24671 leader_election.cc:304] T 1070a1e186974febba3e1d8dc0dbb32e P 9f3fb800959647df959d2842e69114e4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f3fb800959647df959d2842e69114e4; no voters: 0957f3414e96411c846439294d91692a, 19a6c50a7452432c9b7065686d247915
I20260709 12:14:23.166280 24775 raft_consensus.cc:2749] T 1070a1e186974febba3e1d8dc0dbb32e P 9f3fb800959647df959d2842e69114e4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:23.168306 24672 leader_election.cc:304] T 600a4e0a0ca6400fb4ca416228dc31b7 P 9f3fb800959647df959d2842e69114e4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 19a6c50a7452432c9b7065686d247915, 9f3fb800959647df959d2842e69114e4; no voters: 0957f3414e96411c846439294d91692a
I20260709 12:14:23.174381 24775 raft_consensus.cc:2804] T 600a4e0a0ca6400fb4ca416228dc31b7 P 9f3fb800959647df959d2842e69114e4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:23.175019 24775 raft_consensus.cc:697] T 600a4e0a0ca6400fb4ca416228dc31b7 P 9f3fb800959647df959d2842e69114e4 [term 1 LEADER]: Becoming Leader. State: Replica: 9f3fb800959647df959d2842e69114e4, State: Running, Role: LEADER
I20260709 12:14:23.176052 24775 consensus_queue.cc:237] T 600a4e0a0ca6400fb4ca416228dc31b7 P 9f3fb800959647df959d2842e69114e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:23.178221 24752 leader_election.cc:290] T 1070a1e186974febba3e1d8dc0dbb32e P 9f3fb800959647df959d2842e69114e4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 19a6c50a7452432c9b7065686d247915 (127.12.174.129:34253), 0957f3414e96411c846439294d91692a (127.12.174.130:32819)
I20260709 12:14:23.187325 24748 tablet_bootstrap.cc:492] T aba98af27ae743c7996a5ebd5c0d2780 P 9f3fb800959647df959d2842e69114e4: No bootstrap required, opened a new log
I20260709 12:14:23.187886 24747 tablet_bootstrap.cc:492] T 47f98adb81f3471f92fb1acba914760c P 19a6c50a7452432c9b7065686d247915: No bootstrap required, opened a new log
I20260709 12:14:23.187930 24748 ts_tablet_manager.cc:1403] T aba98af27ae743c7996a5ebd5c0d2780 P 9f3fb800959647df959d2842e69114e4: Time spent bootstrapping tablet: real 0.082s	user 0.029s	sys 0.037s
I20260709 12:14:23.188594 24747 ts_tablet_manager.cc:1403] T 47f98adb81f3471f92fb1acba914760c P 19a6c50a7452432c9b7065686d247915: Time spent bootstrapping tablet: real 0.062s	user 0.028s	sys 0.034s
I20260709 12:14:23.189266 24750 tablet_bootstrap.cc:492] T 39fa67f2dd5541f68cfaff5e37b65376 P 0957f3414e96411c846439294d91692a: No bootstrap required, opened a new log
I20260709 12:14:23.189893 24750 ts_tablet_manager.cc:1403] T 39fa67f2dd5541f68cfaff5e37b65376 P 0957f3414e96411c846439294d91692a: Time spent bootstrapping tablet: real 0.083s	user 0.037s	sys 0.034s
I20260709 12:14:23.192446 24747 raft_consensus.cc:359] T 47f98adb81f3471f92fb1acba914760c P 19a6c50a7452432c9b7065686d247915 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:23.193389 24750 raft_consensus.cc:359] T 39fa67f2dd5541f68cfaff5e37b65376 P 0957f3414e96411c846439294d91692a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:23.192468 24748 raft_consensus.cc:359] T aba98af27ae743c7996a5ebd5c0d2780 P 9f3fb800959647df959d2842e69114e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:23.194496 24750 raft_consensus.cc:385] T 39fa67f2dd5541f68cfaff5e37b65376 P 0957f3414e96411c846439294d91692a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:23.194602 24748 raft_consensus.cc:385] T aba98af27ae743c7996a5ebd5c0d2780 P 9f3fb800959647df959d2842e69114e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:23.194944 24750 raft_consensus.cc:740] T 39fa67f2dd5541f68cfaff5e37b65376 P 0957f3414e96411c846439294d91692a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0957f3414e96411c846439294d91692a, State: Initialized, Role: FOLLOWER
I20260709 12:14:23.195066 24748 raft_consensus.cc:740] T aba98af27ae743c7996a5ebd5c0d2780 P 9f3fb800959647df959d2842e69114e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f3fb800959647df959d2842e69114e4, State: Initialized, Role: FOLLOWER
I20260709 12:14:23.193400 24747 raft_consensus.cc:385] T 47f98adb81f3471f92fb1acba914760c P 19a6c50a7452432c9b7065686d247915 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:23.196503 24747 raft_consensus.cc:740] T 47f98adb81f3471f92fb1acba914760c P 19a6c50a7452432c9b7065686d247915 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19a6c50a7452432c9b7065686d247915, State: Initialized, Role: FOLLOWER
I20260709 12:14:23.196161 24750 consensus_queue.cc:260] T 39fa67f2dd5541f68cfaff5e37b65376 P 0957f3414e96411c846439294d91692a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:23.195977 24748 consensus_queue.cc:260] T aba98af27ae743c7996a5ebd5c0d2780 P 9f3fb800959647df959d2842e69114e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:23.197708 24747 consensus_queue.cc:260] T 47f98adb81f3471f92fb1acba914760c P 19a6c50a7452432c9b7065686d247915 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:23.200430 24747 ts_tablet_manager.cc:1434] T 47f98adb81f3471f92fb1acba914760c P 19a6c50a7452432c9b7065686d247915: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.004s
I20260709 12:14:23.201707 24747 tablet_bootstrap.cc:492] T 1070a1e186974febba3e1d8dc0dbb32e P 19a6c50a7452432c9b7065686d247915: Bootstrap starting.
I20260709 12:14:23.202278 24750 ts_tablet_manager.cc:1434] T 39fa67f2dd5541f68cfaff5e37b65376 P 0957f3414e96411c846439294d91692a: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.001s
I20260709 12:14:23.201824 24456 catalog_manager.cc:5697] T 600a4e0a0ca6400fb4ca416228dc31b7 P 9f3fb800959647df959d2842e69114e4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9f3fb800959647df959d2842e69114e4 (127.12.174.131). New cstate: current_term: 1 leader_uuid: "9f3fb800959647df959d2842e69114e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:23.203516 24750 tablet_bootstrap.cc:492] T 47f98adb81f3471f92fb1acba914760c P 0957f3414e96411c846439294d91692a: Bootstrap starting.
I20260709 12:14:23.210793 24747 tablet_bootstrap.cc:654] T 1070a1e186974febba3e1d8dc0dbb32e P 19a6c50a7452432c9b7065686d247915: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:23.218632 24750 tablet_bootstrap.cc:654] T 47f98adb81f3471f92fb1acba914760c P 0957f3414e96411c846439294d91692a: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:23.220937 24775 raft_consensus.cc:493] T 47f98adb81f3471f92fb1acba914760c P 9f3fb800959647df959d2842e69114e4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:23.221640 24775 raft_consensus.cc:515] T 47f98adb81f3471f92fb1acba914760c P 9f3fb800959647df959d2842e69114e4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:23.222100 24754 raft_consensus.cc:493] T aba98af27ae743c7996a5ebd5c0d2780 P 0957f3414e96411c846439294d91692a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:23.222936 24754 raft_consensus.cc:515] T aba98af27ae743c7996a5ebd5c0d2780 P 0957f3414e96411c846439294d91692a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:23.224426 24775 leader_election.cc:290] T 47f98adb81f3471f92fb1acba914760c P 9f3fb800959647df959d2842e69114e4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 19a6c50a7452432c9b7065686d247915 (127.12.174.129:34253), 0957f3414e96411c846439294d91692a (127.12.174.130:32819)
I20260709 12:14:23.225317 24748 ts_tablet_manager.cc:1434] T aba98af27ae743c7996a5ebd5c0d2780 P 9f3fb800959647df959d2842e69114e4: Time spent starting tablet: real 0.037s	user 0.009s	sys 0.000s
I20260709 12:14:23.226058 24747 tablet_bootstrap.cc:492] T 1070a1e186974febba3e1d8dc0dbb32e P 19a6c50a7452432c9b7065686d247915: No bootstrap required, opened a new log
I20260709 12:14:23.226555 24748 tablet_bootstrap.cc:492] T ea42bf8b2c8446bb8cf72377bdc2db72 P 9f3fb800959647df959d2842e69114e4: Bootstrap starting.
I20260709 12:14:23.226704 24747 ts_tablet_manager.cc:1403] T 1070a1e186974febba3e1d8dc0dbb32e P 19a6c50a7452432c9b7065686d247915: Time spent bootstrapping tablet: real 0.025s	user 0.012s	sys 0.009s
I20260709 12:14:23.227118 24558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba98af27ae743c7996a5ebd5c0d2780" candidate_uuid: "0957f3414e96411c846439294d91692a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19a6c50a7452432c9b7065686d247915" is_pre_election: true
I20260709 12:14:23.227875 24558 raft_consensus.cc:2468] T aba98af27ae743c7996a5ebd5c0d2780 P 19a6c50a7452432c9b7065686d247915 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0957f3414e96411c846439294d91692a in term 0.
I20260709 12:14:23.230420 24633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f98adb81f3471f92fb1acba914760c" candidate_uuid: "9f3fb800959647df959d2842e69114e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0957f3414e96411c846439294d91692a" is_pre_election: true
I20260709 12:14:23.230643 24747 raft_consensus.cc:359] T 1070a1e186974febba3e1d8dc0dbb32e P 19a6c50a7452432c9b7065686d247915 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:23.231634 24747 raft_consensus.cc:385] T 1070a1e186974febba3e1d8dc0dbb32e P 19a6c50a7452432c9b7065686d247915 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:23.232056 24747 raft_consensus.cc:740] T 1070a1e186974febba3e1d8dc0dbb32e P 19a6c50a7452432c9b7065686d247915 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19a6c50a7452432c9b7065686d247915, State: Initialized, Role: FOLLOWER
I20260709 12:14:23.231962 24707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba98af27ae743c7996a5ebd5c0d2780" candidate_uuid: "0957f3414e96411c846439294d91692a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f3fb800959647df959d2842e69114e4" is_pre_election: true
I20260709 12:14:23.232867 24707 raft_consensus.cc:2468] T aba98af27ae743c7996a5ebd5c0d2780 P 9f3fb800959647df959d2842e69114e4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0957f3414e96411c846439294d91692a in term 0.
I20260709 12:14:23.234925 24598 leader_election.cc:304] T aba98af27ae743c7996a5ebd5c0d2780 P 0957f3414e96411c846439294d91692a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0957f3414e96411c846439294d91692a, 19a6c50a7452432c9b7065686d247915; no voters: 
I20260709 12:14:23.235363 24748 tablet_bootstrap.cc:654] T ea42bf8b2c8446bb8cf72377bdc2db72 P 9f3fb800959647df959d2842e69114e4: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:23.234826 24747 consensus_queue.cc:260] T 1070a1e186974febba3e1d8dc0dbb32e P 19a6c50a7452432c9b7065686d247915 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
W20260709 12:14:23.236917 24671 leader_election.cc:343] T 47f98adb81f3471f92fb1acba914760c P 9f3fb800959647df959d2842e69114e4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0957f3414e96411c846439294d91692a (127.12.174.130:32819): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:23.237922 24558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f98adb81f3471f92fb1acba914760c" candidate_uuid: "9f3fb800959647df959d2842e69114e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19a6c50a7452432c9b7065686d247915" is_pre_election: true
I20260709 12:14:23.238159 24747 ts_tablet_manager.cc:1434] T 1070a1e186974febba3e1d8dc0dbb32e P 19a6c50a7452432c9b7065686d247915: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.001s
I20260709 12:14:23.238703 24558 raft_consensus.cc:2468] T 47f98adb81f3471f92fb1acba914760c P 19a6c50a7452432c9b7065686d247915 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f3fb800959647df959d2842e69114e4 in term 0.
I20260709 12:14:23.239491 24747 tablet_bootstrap.cc:492] T fc07ceaa7eb544aeacd41a465a8bf0f8 P 19a6c50a7452432c9b7065686d247915: Bootstrap starting.
I20260709 12:14:23.240262 24672 leader_election.cc:304] T 47f98adb81f3471f92fb1acba914760c P 9f3fb800959647df959d2842e69114e4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 19a6c50a7452432c9b7065686d247915, 9f3fb800959647df959d2842e69114e4; no voters: 0957f3414e96411c846439294d91692a
I20260709 12:14:23.241278 24775 raft_consensus.cc:2804] T 47f98adb81f3471f92fb1acba914760c P 9f3fb800959647df959d2842e69114e4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:23.225212 24754 leader_election.cc:290] T aba98af27ae743c7996a5ebd5c0d2780 P 0957f3414e96411c846439294d91692a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 19a6c50a7452432c9b7065686d247915 (127.12.174.129:34253), 9f3fb800959647df959d2842e69114e4 (127.12.174.131:41945)
I20260709 12:14:23.241779 24775 raft_consensus.cc:493] T 47f98adb81f3471f92fb1acba914760c P 9f3fb800959647df959d2842e69114e4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:23.242333 24754 raft_consensus.cc:2804] T aba98af27ae743c7996a5ebd5c0d2780 P 0957f3414e96411c846439294d91692a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:23.242340 24775 raft_consensus.cc:3060] T 47f98adb81f3471f92fb1acba914760c P 9f3fb800959647df959d2842e69114e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:23.242981 24754 raft_consensus.cc:493] T aba98af27ae743c7996a5ebd5c0d2780 P 0957f3414e96411c846439294d91692a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:23.243402 24754 raft_consensus.cc:3060] T aba98af27ae743c7996a5ebd5c0d2780 P 0957f3414e96411c846439294d91692a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:23.248399 24747 tablet_bootstrap.cc:654] T fc07ceaa7eb544aeacd41a465a8bf0f8 P 19a6c50a7452432c9b7065686d247915: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:23.253607 24775 raft_consensus.cc:515] T 47f98adb81f3471f92fb1acba914760c P 9f3fb800959647df959d2842e69114e4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:23.257685 24558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f98adb81f3471f92fb1acba914760c" candidate_uuid: "9f3fb800959647df959d2842e69114e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19a6c50a7452432c9b7065686d247915"
I20260709 12:14:23.258492 24558 raft_consensus.cc:3060] T 47f98adb81f3471f92fb1acba914760c P 19a6c50a7452432c9b7065686d247915 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:23.260483 24775 leader_election.cc:290] T 47f98adb81f3471f92fb1acba914760c P 9f3fb800959647df959d2842e69114e4 [CANDIDATE]: Term 1 election: Requested vote from peers 19a6c50a7452432c9b7065686d247915 (127.12.174.129:34253), 0957f3414e96411c846439294d91692a (127.12.174.130:32819)
I20260709 12:14:23.261377 24747 tablet_bootstrap.cc:492] T fc07ceaa7eb544aeacd41a465a8bf0f8 P 19a6c50a7452432c9b7065686d247915: No bootstrap required, opened a new log
I20260709 12:14:23.261804 24633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f98adb81f3471f92fb1acba914760c" candidate_uuid: "9f3fb800959647df959d2842e69114e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0957f3414e96411c846439294d91692a"
I20260709 12:14:23.262070 24747 ts_tablet_manager.cc:1403] T fc07ceaa7eb544aeacd41a465a8bf0f8 P 19a6c50a7452432c9b7065686d247915: Time spent bootstrapping tablet: real 0.023s	user 0.020s	sys 0.000s
W20260709 12:14:23.263409 24671 leader_election.cc:343] T 47f98adb81f3471f92fb1acba914760c P 9f3fb800959647df959d2842e69114e4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0957f3414e96411c846439294d91692a (127.12.174.130:32819): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:23.264820 24757 raft_consensus.cc:493] T 39fa67f2dd5541f68cfaff5e37b65376 P 19a6c50a7452432c9b7065686d247915 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:23.265494 24757 raft_consensus.cc:515] T 39fa67f2dd5541f68cfaff5e37b65376 P 19a6c50a7452432c9b7065686d247915 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:23.265588 24747 raft_consensus.cc:359] T fc07ceaa7eb544aeacd41a465a8bf0f8 P 19a6c50a7452432c9b7065686d247915 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:23.266659 24747 raft_consensus.cc:385] T fc07ceaa7eb544aeacd41a465a8bf0f8 P 19a6c50a7452432c9b7065686d247915 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:23.267030 24747 raft_consensus.cc:740] T fc07ceaa7eb544aeacd41a465a8bf0f8 P 19a6c50a7452432c9b7065686d247915 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19a6c50a7452432c9b7065686d247915, State: Initialized, Role: FOLLOWER
I20260709 12:14:23.268006 24747 consensus_queue.cc:260] T fc07ceaa7eb544aeacd41a465a8bf0f8 P 19a6c50a7452432c9b7065686d247915 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:23.270887 24757 leader_election.cc:290] T 39fa67f2dd5541f68cfaff5e37b65376 P 19a6c50a7452432c9b7065686d247915 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0957f3414e96411c846439294d91692a (127.12.174.130:32819), 9f3fb800959647df959d2842e69114e4 (127.12.174.131:41945)
I20260709 12:14:23.274744 24748 tablet_bootstrap.cc:492] T ea42bf8b2c8446bb8cf72377bdc2db72 P 9f3fb800959647df959d2842e69114e4: No bootstrap required, opened a new log
I20260709 12:14:23.275540 24748 ts_tablet_manager.cc:1403] T ea42bf8b2c8446bb8cf72377bdc2db72 P 9f3fb800959647df959d2842e69114e4: Time spent bootstrapping tablet: real 0.049s	user 0.016s	sys 0.004s
I20260709 12:14:23.281198 24789 raft_consensus.cc:493] T ea42bf8b2c8446bb8cf72377bdc2db72 P 0957f3414e96411c846439294d91692a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:23.282028 24789 raft_consensus.cc:515] T ea42bf8b2c8446bb8cf72377bdc2db72 P 0957f3414e96411c846439294d91692a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:23.285632 24748 raft_consensus.cc:359] T ea42bf8b2c8446bb8cf72377bdc2db72 P 9f3fb800959647df959d2842e69114e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:23.286109 24707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea42bf8b2c8446bb8cf72377bdc2db72" candidate_uuid: "0957f3414e96411c846439294d91692a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f3fb800959647df959d2842e69114e4" is_pre_election: true
I20260709 12:14:23.286960 24783 raft_consensus.cc:493] T 7193d4ca686648169964ddb1468a3799 P 0957f3414e96411c846439294d91692a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:23.287674 24783 raft_consensus.cc:515] T 7193d4ca686648169964ddb1468a3799 P 0957f3414e96411c846439294d91692a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:23.290649 24748 raft_consensus.cc:385] T ea42bf8b2c8446bb8cf72377bdc2db72 P 9f3fb800959647df959d2842e69114e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:23.291471 24789 leader_election.cc:290] T ea42bf8b2c8446bb8cf72377bdc2db72 P 0957f3414e96411c846439294d91692a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 19a6c50a7452432c9b7065686d247915 (127.12.174.129:34253), 9f3fb800959647df959d2842e69114e4 (127.12.174.131:41945)
I20260709 12:14:23.291110 24748 raft_consensus.cc:740] T ea42bf8b2c8446bb8cf72377bdc2db72 P 9f3fb800959647df959d2842e69114e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f3fb800959647df959d2842e69114e4, State: Initialized, Role: FOLLOWER
I20260709 12:14:23.293501 24748 consensus_queue.cc:260] T ea42bf8b2c8446bb8cf72377bdc2db72 P 9f3fb800959647df959d2842e69114e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:23.294812 24707 raft_consensus.cc:2468] T ea42bf8b2c8446bb8cf72377bdc2db72 P 9f3fb800959647df959d2842e69114e4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0957f3414e96411c846439294d91692a in term 0.
I20260709 12:14:23.298558 24596 leader_election.cc:304] T ea42bf8b2c8446bb8cf72377bdc2db72 P 0957f3414e96411c846439294d91692a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0957f3414e96411c846439294d91692a, 9f3fb800959647df959d2842e69114e4; no voters: 
I20260709 12:14:23.299752 24789 raft_consensus.cc:2804] T ea42bf8b2c8446bb8cf72377bdc2db72 P 0957f3414e96411c846439294d91692a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:23.300182 24789 raft_consensus.cc:493] T ea42bf8b2c8446bb8cf72377bdc2db72 P 0957f3414e96411c846439294d91692a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:23.300535 24789 raft_consensus.cc:3060] T ea42bf8b2c8446bb8cf72377bdc2db72 P 0957f3414e96411c846439294d91692a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:23.300953 24748 ts_tablet_manager.cc:1434] T ea42bf8b2c8446bb8cf72377bdc2db72 P 9f3fb800959647df959d2842e69114e4: Time spent starting tablet: real 0.025s	user 0.009s	sys 0.000s
I20260709 12:14:23.302330 24748 tablet_bootstrap.cc:492] T fc07ceaa7eb544aeacd41a465a8bf0f8 P 9f3fb800959647df959d2842e69114e4: Bootstrap starting.
W20260709 12:14:23.291733 24598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:34253, user_credentials={real_user=slave}} blocked reactor thread for 56910.3us
I20260709 12:14:23.311100 24557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea42bf8b2c8446bb8cf72377bdc2db72" candidate_uuid: "0957f3414e96411c846439294d91692a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19a6c50a7452432c9b7065686d247915" is_pre_election: true
I20260709 12:14:23.311981 24557 raft_consensus.cc:2468] T ea42bf8b2c8446bb8cf72377bdc2db72 P 19a6c50a7452432c9b7065686d247915 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0957f3414e96411c846439294d91692a in term 0.
I20260709 12:14:23.313488 24748 tablet_bootstrap.cc:654] T fc07ceaa7eb544aeacd41a465a8bf0f8 P 9f3fb800959647df959d2842e69114e4: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:23.317214 24789 raft_consensus.cc:515] T ea42bf8b2c8446bb8cf72377bdc2db72 P 0957f3414e96411c846439294d91692a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:23.325138 24557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea42bf8b2c8446bb8cf72377bdc2db72" candidate_uuid: "0957f3414e96411c846439294d91692a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19a6c50a7452432c9b7065686d247915"
I20260709 12:14:23.326009 24557 raft_consensus.cc:3060] T ea42bf8b2c8446bb8cf72377bdc2db72 P 19a6c50a7452432c9b7065686d247915 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:23.328472 24707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea42bf8b2c8446bb8cf72377bdc2db72" candidate_uuid: "0957f3414e96411c846439294d91692a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f3fb800959647df959d2842e69114e4"
I20260709 12:14:23.328317 24789 leader_election.cc:290] T ea42bf8b2c8446bb8cf72377bdc2db72 P 0957f3414e96411c846439294d91692a [CANDIDATE]: Term 1 election: Requested vote from peers 19a6c50a7452432c9b7065686d247915 (127.12.174.129:34253), 9f3fb800959647df959d2842e69114e4 (127.12.174.131:41945)
I20260709 12:14:23.329332 24707 raft_consensus.cc:3060] T ea42bf8b2c8446bb8cf72377bdc2db72 P 9f3fb800959647df959d2842e69114e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:23.329818 24789 raft_consensus.cc:493] T fc07ceaa7eb544aeacd41a465a8bf0f8 P 0957f3414e96411c846439294d91692a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:23.332995 24789 raft_consensus.cc:515] T fc07ceaa7eb544aeacd41a465a8bf0f8 P 0957f3414e96411c846439294d91692a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:23.336647 24556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07ceaa7eb544aeacd41a465a8bf0f8" candidate_uuid: "0957f3414e96411c846439294d91692a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19a6c50a7452432c9b7065686d247915" is_pre_election: true
I20260709 12:14:23.337599 24556 raft_consensus.cc:2468] T fc07ceaa7eb544aeacd41a465a8bf0f8 P 19a6c50a7452432c9b7065686d247915 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0957f3414e96411c846439294d91692a in term 0.
I20260709 12:14:23.339751 24598 leader_election.cc:304] T fc07ceaa7eb544aeacd41a465a8bf0f8 P 0957f3414e96411c846439294d91692a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0957f3414e96411c846439294d91692a, 19a6c50a7452432c9b7065686d247915; no voters: 
I20260709 12:14:23.340924 24706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07ceaa7eb544aeacd41a465a8bf0f8" candidate_uuid: "0957f3414e96411c846439294d91692a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f3fb800959647df959d2842e69114e4" is_pre_election: true
I20260709 12:14:23.341674 24789 leader_election.cc:290] T fc07ceaa7eb544aeacd41a465a8bf0f8 P 0957f3414e96411c846439294d91692a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 19a6c50a7452432c9b7065686d247915 (127.12.174.129:34253), 9f3fb800959647df959d2842e69114e4 (127.12.174.131:41945)
I20260709 12:14:23.340888 24707 raft_consensus.cc:2468] T ea42bf8b2c8446bb8cf72377bdc2db72 P 9f3fb800959647df959d2842e69114e4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0957f3414e96411c846439294d91692a in term 1.
W20260709 12:14:23.342916 24596 leader_election.cc:343] T fc07ceaa7eb544aeacd41a465a8bf0f8 P 0957f3414e96411c846439294d91692a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9f3fb800959647df959d2842e69114e4 (127.12.174.131:41945): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:23.344151 24596 leader_election.cc:304] T ea42bf8b2c8446bb8cf72377bdc2db72 P 0957f3414e96411c846439294d91692a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0957f3414e96411c846439294d91692a, 9f3fb800959647df959d2842e69114e4; no voters: 
I20260709 12:14:23.345885 24789 raft_consensus.cc:2804] T fc07ceaa7eb544aeacd41a465a8bf0f8 P 0957f3414e96411c846439294d91692a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:23.346402 24789 raft_consensus.cc:493] T fc07ceaa7eb544aeacd41a465a8bf0f8 P 0957f3414e96411c846439294d91692a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:23.346753 24790 raft_consensus.cc:2804] T ea42bf8b2c8446bb8cf72377bdc2db72 P 0957f3414e96411c846439294d91692a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:23.346755 24789 raft_consensus.cc:3060] T fc07ceaa7eb544aeacd41a465a8bf0f8 P 0957f3414e96411c846439294d91692a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:23.349643 24748 tablet_bootstrap.cc:492] T fc07ceaa7eb544aeacd41a465a8bf0f8 P 9f3fb800959647df959d2842e69114e4: No bootstrap required, opened a new log
I20260709 12:14:23.349815 24633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39fa67f2dd5541f68cfaff5e37b65376" candidate_uuid: "19a6c50a7452432c9b7065686d247915" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0957f3414e96411c846439294d91692a" is_pre_election: true
I20260709 12:14:23.350270 24748 ts_tablet_manager.cc:1403] T fc07ceaa7eb544aeacd41a465a8bf0f8 P 9f3fb800959647df959d2842e69114e4: Time spent bootstrapping tablet: real 0.048s	user 0.024s	sys 0.000s
I20260709 12:14:23.350731 24633 raft_consensus.cc:2468] T 39fa67f2dd5541f68cfaff5e37b65376 P 0957f3414e96411c846439294d91692a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19a6c50a7452432c9b7065686d247915 in term 0.
I20260709 12:14:23.352358 24522 leader_election.cc:304] T 39fa67f2dd5541f68cfaff5e37b65376 P 19a6c50a7452432c9b7065686d247915 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0957f3414e96411c846439294d91692a, 19a6c50a7452432c9b7065686d247915; no voters: 
I20260709 12:14:23.353364 24757 raft_consensus.cc:2804] T 39fa67f2dd5541f68cfaff5e37b65376 P 19a6c50a7452432c9b7065686d247915 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:23.353971 24757 raft_consensus.cc:493] T 39fa67f2dd5541f68cfaff5e37b65376 P 19a6c50a7452432c9b7065686d247915 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:23.353809 24748 raft_consensus.cc:359] T fc07ceaa7eb544aeacd41a465a8bf0f8 P 9f3fb800959647df959d2842e69114e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:23.354547 24757 raft_consensus.cc:3060] T 39fa67f2dd5541f68cfaff5e37b65376 P 19a6c50a7452432c9b7065686d247915 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:23.354682 24748 raft_consensus.cc:385] T fc07ceaa7eb544aeacd41a465a8bf0f8 P 9f3fb800959647df959d2842e69114e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:23.355067 24748 raft_consensus.cc:740] T fc07ceaa7eb544aeacd41a465a8bf0f8 P 9f3fb800959647df959d2842e69114e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f3fb800959647df959d2842e69114e4, State: Initialized, Role: FOLLOWER
I20260709 12:14:23.356083 24748 consensus_queue.cc:260] T fc07ceaa7eb544aeacd41a465a8bf0f8 P 9f3fb800959647df959d2842e69114e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:23.359052 24748 ts_tablet_manager.cc:1434] T fc07ceaa7eb544aeacd41a465a8bf0f8 P 9f3fb800959647df959d2842e69114e4: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:14:23.360095 24775 raft_consensus.cc:493] T 7193d4ca686648169964ddb1468a3799 P 9f3fb800959647df959d2842e69114e4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:23.360888 24775 raft_consensus.cc:515] T 7193d4ca686648169964ddb1468a3799 P 9f3fb800959647df959d2842e69114e4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:23.364493 24775 leader_election.cc:290] T 7193d4ca686648169964ddb1468a3799 P 9f3fb800959647df959d2842e69114e4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 19a6c50a7452432c9b7065686d247915 (127.12.174.129:34253), 0957f3414e96411c846439294d91692a (127.12.174.130:32819)
I20260709 12:14:23.365049 24556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7193d4ca686648169964ddb1468a3799" candidate_uuid: "9f3fb800959647df959d2842e69114e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19a6c50a7452432c9b7065686d247915" is_pre_election: true
W20260709 12:14:23.367069 24672 leader_election.cc:343] T 7193d4ca686648169964ddb1468a3799 P 9f3fb800959647df959d2842e69114e4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 19a6c50a7452432c9b7065686d247915 (127.12.174.129:34253): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:23.365053 24633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7193d4ca686648169964ddb1468a3799" candidate_uuid: "9f3fb800959647df959d2842e69114e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0957f3414e96411c846439294d91692a" is_pre_election: true
I20260709 12:14:23.368712 24633 raft_consensus.cc:2468] T 7193d4ca686648169964ddb1468a3799 P 0957f3414e96411c846439294d91692a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f3fb800959647df959d2842e69114e4 in term 0.
I20260709 12:14:23.360359 24748 tablet_bootstrap.cc:492] T 39fa67f2dd5541f68cfaff5e37b65376 P 9f3fb800959647df959d2842e69114e4: Bootstrap starting.
I20260709 12:14:23.370467 24671 leader_election.cc:304] T 7193d4ca686648169964ddb1468a3799 P 9f3fb800959647df959d2842e69114e4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0957f3414e96411c846439294d91692a, 9f3fb800959647df959d2842e69114e4; no voters: 19a6c50a7452432c9b7065686d247915
I20260709 12:14:23.372464 24775 raft_consensus.cc:2804] T 7193d4ca686648169964ddb1468a3799 P 9f3fb800959647df959d2842e69114e4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:23.373147 24775 raft_consensus.cc:493] T 7193d4ca686648169964ddb1468a3799 P 9f3fb800959647df959d2842e69114e4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:23.373539 24775 raft_consensus.cc:3060] T 7193d4ca686648169964ddb1468a3799 P 9f3fb800959647df959d2842e69114e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:23.376590 24557 raft_consensus.cc:2468] T ea42bf8b2c8446bb8cf72377bdc2db72 P 19a6c50a7452432c9b7065686d247915 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0957f3414e96411c846439294d91692a in term 1.
I20260709 12:14:23.380086 24789 raft_consensus.cc:515] T fc07ceaa7eb544aeacd41a465a8bf0f8 P 0957f3414e96411c846439294d91692a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:23.382560 24754 raft_consensus.cc:515] T aba98af27ae743c7996a5ebd5c0d2780 P 0957f3414e96411c846439294d91692a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:23.385862 24707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07ceaa7eb544aeacd41a465a8bf0f8" candidate_uuid: "0957f3414e96411c846439294d91692a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f3fb800959647df959d2842e69114e4"
I20260709 12:14:23.386890 24783 leader_election.cc:290] T 7193d4ca686648169964ddb1468a3799 P 0957f3414e96411c846439294d91692a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 19a6c50a7452432c9b7065686d247915 (127.12.174.129:34253), 9f3fb800959647df959d2842e69114e4 (127.12.174.131:41945)
I20260709 12:14:23.386730 24555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba98af27ae743c7996a5ebd5c0d2780" candidate_uuid: "0957f3414e96411c846439294d91692a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19a6c50a7452432c9b7065686d247915"
I20260709 12:14:23.387636 24555 raft_consensus.cc:3060] T aba98af27ae743c7996a5ebd5c0d2780 P 19a6c50a7452432c9b7065686d247915 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:23.388674 24554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7193d4ca686648169964ddb1468a3799" candidate_uuid: "0957f3414e96411c846439294d91692a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19a6c50a7452432c9b7065686d247915" is_pre_election: true
I20260709 12:14:23.389869 24705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7193d4ca686648169964ddb1468a3799" candidate_uuid: "0957f3414e96411c846439294d91692a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f3fb800959647df959d2842e69114e4" is_pre_election: true
W20260709 12:14:23.390647 24598 leader_election.cc:343] T 7193d4ca686648169964ddb1468a3799 P 0957f3414e96411c846439294d91692a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 19a6c50a7452432c9b7065686d247915 (127.12.174.129:34253): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:23.386806 24707 raft_consensus.cc:3060] T fc07ceaa7eb544aeacd41a465a8bf0f8 P 9f3fb800959647df959d2842e69114e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:23.394451 24556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07ceaa7eb544aeacd41a465a8bf0f8" candidate_uuid: "0957f3414e96411c846439294d91692a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19a6c50a7452432c9b7065686d247915"
I20260709 12:14:23.395280 24556 raft_consensus.cc:3060] T fc07ceaa7eb544aeacd41a465a8bf0f8 P 19a6c50a7452432c9b7065686d247915 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:23.396375 24790 raft_consensus.cc:697] T ea42bf8b2c8446bb8cf72377bdc2db72 P 0957f3414e96411c846439294d91692a [term 1 LEADER]: Becoming Leader. State: Replica: 0957f3414e96411c846439294d91692a, State: Running, Role: LEADER
I20260709 12:14:23.397398 24790 consensus_queue.cc:237] T ea42bf8b2c8446bb8cf72377bdc2db72 P 0957f3414e96411c846439294d91692a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:23.388557 24706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba98af27ae743c7996a5ebd5c0d2780" candidate_uuid: "0957f3414e96411c846439294d91692a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f3fb800959647df959d2842e69114e4"
I20260709 12:14:23.398638 24706 raft_consensus.cc:3060] T aba98af27ae743c7996a5ebd5c0d2780 P 9f3fb800959647df959d2842e69114e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:23.400846 24555 raft_consensus.cc:2468] T aba98af27ae743c7996a5ebd5c0d2780 P 19a6c50a7452432c9b7065686d247915 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0957f3414e96411c846439294d91692a in term 1.
I20260709 12:14:23.317466 24558 raft_consensus.cc:2468] T 47f98adb81f3471f92fb1acba914760c P 19a6c50a7452432c9b7065686d247915 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f3fb800959647df959d2842e69114e4 in term 1.
I20260709 12:14:23.402792 24598 leader_election.cc:304] T aba98af27ae743c7996a5ebd5c0d2780 P 0957f3414e96411c846439294d91692a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0957f3414e96411c846439294d91692a, 19a6c50a7452432c9b7065686d247915; no voters: 
I20260709 12:14:23.403884 24783 raft_consensus.cc:2804] T aba98af27ae743c7996a5ebd5c0d2780 P 0957f3414e96411c846439294d91692a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:23.404119 24672 leader_election.cc:304] T 47f98adb81f3471f92fb1acba914760c P 9f3fb800959647df959d2842e69114e4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 19a6c50a7452432c9b7065686d247915, 9f3fb800959647df959d2842e69114e4; no voters: 0957f3414e96411c846439294d91692a
I20260709 12:14:23.404505 24783 raft_consensus.cc:697] T aba98af27ae743c7996a5ebd5c0d2780 P 0957f3414e96411c846439294d91692a [term 1 LEADER]: Becoming Leader. State: Replica: 0957f3414e96411c846439294d91692a, State: Running, Role: LEADER
I20260709 12:14:23.405709 24777 raft_consensus.cc:2804] T 47f98adb81f3471f92fb1acba914760c P 9f3fb800959647df959d2842e69114e4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:23.380901 24757 raft_consensus.cc:515] T 39fa67f2dd5541f68cfaff5e37b65376 P 19a6c50a7452432c9b7065686d247915 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:23.406383 24747 ts_tablet_manager.cc:1434] T fc07ceaa7eb544aeacd41a465a8bf0f8 P 19a6c50a7452432c9b7065686d247915: Time spent starting tablet: real 0.144s	user 0.048s	sys 0.065s
I20260709 12:14:23.408545 24747 tablet_bootstrap.cc:492] T 7193d4ca686648169964ddb1468a3799 P 19a6c50a7452432c9b7065686d247915: Bootstrap starting.
I20260709 12:14:23.409348 24633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39fa67f2dd5541f68cfaff5e37b65376" candidate_uuid: "19a6c50a7452432c9b7065686d247915" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0957f3414e96411c846439294d91692a"
I20260709 12:14:23.406442 24777 raft_consensus.cc:697] T 47f98adb81f3471f92fb1acba914760c P 9f3fb800959647df959d2842e69114e4 [term 1 LEADER]: Becoming Leader. State: Replica: 9f3fb800959647df959d2842e69114e4, State: Running, Role: LEADER
I20260709 12:14:23.410256 24633 raft_consensus.cc:3060] T 39fa67f2dd5541f68cfaff5e37b65376 P 0957f3414e96411c846439294d91692a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:23.410820 24777 consensus_queue.cc:237] T 47f98adb81f3471f92fb1acba914760c P 9f3fb800959647df959d2842e69114e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:23.415505 24747 tablet_bootstrap.cc:654] T 7193d4ca686648169964ddb1468a3799 P 19a6c50a7452432c9b7065686d247915: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:23.416162 24750 tablet_bootstrap.cc:492] T 47f98adb81f3471f92fb1acba914760c P 0957f3414e96411c846439294d91692a: No bootstrap required, opened a new log
I20260709 12:14:23.416728 24750 ts_tablet_manager.cc:1403] T 47f98adb81f3471f92fb1acba914760c P 0957f3414e96411c846439294d91692a: Time spent bootstrapping tablet: real 0.213s	user 0.067s	sys 0.066s
I20260709 12:14:23.418895 24757 leader_election.cc:290] T 39fa67f2dd5541f68cfaff5e37b65376 P 19a6c50a7452432c9b7065686d247915 [CANDIDATE]: Term 1 election: Requested vote from peers 0957f3414e96411c846439294d91692a (127.12.174.130:32819), 9f3fb800959647df959d2842e69114e4 (127.12.174.131:41945)
I20260709 12:14:23.420076 24750 raft_consensus.cc:359] T 47f98adb81f3471f92fb1acba914760c P 0957f3414e96411c846439294d91692a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:23.420852 24748 tablet_bootstrap.cc:654] T 39fa67f2dd5541f68cfaff5e37b65376 P 9f3fb800959647df959d2842e69114e4: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:23.421831 24783 consensus_queue.cc:237] T aba98af27ae743c7996a5ebd5c0d2780 P 0957f3414e96411c846439294d91692a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:23.428215 24750 raft_consensus.cc:385] T 47f98adb81f3471f92fb1acba914760c P 0957f3414e96411c846439294d91692a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:23.428612 24750 raft_consensus.cc:740] T 47f98adb81f3471f92fb1acba914760c P 0957f3414e96411c846439294d91692a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0957f3414e96411c846439294d91692a, State: Initialized, Role: FOLLOWER
I20260709 12:14:23.429661 24750 consensus_queue.cc:260] T 47f98adb81f3471f92fb1acba914760c P 0957f3414e96411c846439294d91692a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:23.430509 24633 raft_consensus.cc:2468] T 39fa67f2dd5541f68cfaff5e37b65376 P 0957f3414e96411c846439294d91692a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19a6c50a7452432c9b7065686d247915 in term 1.
I20260709 12:14:23.432279 24522 leader_election.cc:304] T 39fa67f2dd5541f68cfaff5e37b65376 P 19a6c50a7452432c9b7065686d247915 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0957f3414e96411c846439294d91692a, 19a6c50a7452432c9b7065686d247915; no voters: 
I20260709 12:14:23.432317 24750 ts_tablet_manager.cc:1434] T 47f98adb81f3471f92fb1acba914760c P 0957f3414e96411c846439294d91692a: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.000s
I20260709 12:14:23.433473 24757 raft_consensus.cc:2804] T 39fa67f2dd5541f68cfaff5e37b65376 P 19a6c50a7452432c9b7065686d247915 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:23.434160 24757 raft_consensus.cc:697] T 39fa67f2dd5541f68cfaff5e37b65376 P 19a6c50a7452432c9b7065686d247915 [term 1 LEADER]: Becoming Leader. State: Replica: 19a6c50a7452432c9b7065686d247915, State: Running, Role: LEADER
I20260709 12:14:23.434466 24750 tablet_bootstrap.cc:492] T 600a4e0a0ca6400fb4ca416228dc31b7 P 0957f3414e96411c846439294d91692a: Bootstrap starting.
I20260709 12:14:23.435182 24757 consensus_queue.cc:237] T 39fa67f2dd5541f68cfaff5e37b65376 P 19a6c50a7452432c9b7065686d247915 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:23.406683 24754 leader_election.cc:290] T aba98af27ae743c7996a5ebd5c0d2780 P 0957f3414e96411c846439294d91692a [CANDIDATE]: Term 1 election: Requested vote from peers 19a6c50a7452432c9b7065686d247915 (127.12.174.129:34253), 9f3fb800959647df959d2842e69114e4 (127.12.174.131:41945)
I20260709 12:14:23.441046 24789 leader_election.cc:290] T fc07ceaa7eb544aeacd41a465a8bf0f8 P 0957f3414e96411c846439294d91692a [CANDIDATE]: Term 1 election: Requested vote from peers 19a6c50a7452432c9b7065686d247915 (127.12.174.129:34253), 9f3fb800959647df959d2842e69114e4 (127.12.174.131:41945)
I20260709 12:14:23.442404 24750 tablet_bootstrap.cc:654] T 600a4e0a0ca6400fb4ca416228dc31b7 P 0957f3414e96411c846439294d91692a: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:23.433478 24775 raft_consensus.cc:515] T 7193d4ca686648169964ddb1468a3799 P 9f3fb800959647df959d2842e69114e4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:23.448447 24705 raft_consensus.cc:2393] T 7193d4ca686648169964ddb1468a3799 P 9f3fb800959647df959d2842e69114e4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0957f3414e96411c846439294d91692a in current term 1: Already voted for candidate 9f3fb800959647df959d2842e69114e4 in this term.
I20260709 12:14:23.450760 24596 leader_election.cc:304] T 7193d4ca686648169964ddb1468a3799 P 0957f3414e96411c846439294d91692a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0957f3414e96411c846439294d91692a; no voters: 19a6c50a7452432c9b7065686d247915, 9f3fb800959647df959d2842e69114e4
I20260709 12:14:23.452178 24775 leader_election.cc:290] T 7193d4ca686648169964ddb1468a3799 P 9f3fb800959647df959d2842e69114e4 [CANDIDATE]: Term 1 election: Requested vote from peers 19a6c50a7452432c9b7065686d247915 (127.12.174.129:34253), 0957f3414e96411c846439294d91692a (127.12.174.130:32819)
I20260709 12:14:23.452383 24748 tablet_bootstrap.cc:492] T 39fa67f2dd5541f68cfaff5e37b65376 P 9f3fb800959647df959d2842e69114e4: No bootstrap required, opened a new log
I20260709 12:14:23.453152 24748 ts_tablet_manager.cc:1403] T 39fa67f2dd5541f68cfaff5e37b65376 P 9f3fb800959647df959d2842e69114e4: Time spent bootstrapping tablet: real 0.093s	user 0.017s	sys 0.000s
I20260709 12:14:23.454825 24633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7193d4ca686648169964ddb1468a3799" candidate_uuid: "9f3fb800959647df959d2842e69114e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0957f3414e96411c846439294d91692a"
I20260709 12:14:23.456007 24783 raft_consensus.cc:3060] T 7193d4ca686648169964ddb1468a3799 P 0957f3414e96411c846439294d91692a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:23.437083 24706 raft_consensus.cc:2468] T aba98af27ae743c7996a5ebd5c0d2780 P 9f3fb800959647df959d2842e69114e4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0957f3414e96411c846439294d91692a in term 1.
I20260709 12:14:23.454828 24555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7193d4ca686648169964ddb1468a3799" candidate_uuid: "9f3fb800959647df959d2842e69114e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19a6c50a7452432c9b7065686d247915"
I20260709 12:14:23.458909 24748 raft_consensus.cc:359] T 39fa67f2dd5541f68cfaff5e37b65376 P 9f3fb800959647df959d2842e69114e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:23.459712 24748 raft_consensus.cc:385] T 39fa67f2dd5541f68cfaff5e37b65376 P 9f3fb800959647df959d2842e69114e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:23.453543 24707 raft_consensus.cc:2468] T fc07ceaa7eb544aeacd41a465a8bf0f8 P 9f3fb800959647df959d2842e69114e4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0957f3414e96411c846439294d91692a in term 1.
I20260709 12:14:23.460011 24748 raft_consensus.cc:740] T 39fa67f2dd5541f68cfaff5e37b65376 P 9f3fb800959647df959d2842e69114e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f3fb800959647df959d2842e69114e4, State: Initialized, Role: FOLLOWER
I20260709 12:14:23.459849 24750 tablet_bootstrap.cc:492] T 600a4e0a0ca6400fb4ca416228dc31b7 P 0957f3414e96411c846439294d91692a: No bootstrap required, opened a new log
I20260709 12:14:23.460917 24750 ts_tablet_manager.cc:1403] T 600a4e0a0ca6400fb4ca416228dc31b7 P 0957f3414e96411c846439294d91692a: Time spent bootstrapping tablet: real 0.027s	user 0.013s	sys 0.002s
I20260709 12:14:23.464138 24747 tablet_bootstrap.cc:492] T 7193d4ca686648169964ddb1468a3799 P 19a6c50a7452432c9b7065686d247915: No bootstrap required, opened a new log
I20260709 12:14:23.464771 24747 ts_tablet_manager.cc:1403] T 7193d4ca686648169964ddb1468a3799 P 19a6c50a7452432c9b7065686d247915: Time spent bootstrapping tablet: real 0.056s	user 0.019s	sys 0.026s
I20260709 12:14:23.466305 24596 leader_election.cc:304] T fc07ceaa7eb544aeacd41a465a8bf0f8 P 0957f3414e96411c846439294d91692a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0957f3414e96411c846439294d91692a, 9f3fb800959647df959d2842e69114e4; no voters: 
W20260709 12:14:23.460281 24672 leader_election.cc:343] T 7193d4ca686648169964ddb1468a3799 P 9f3fb800959647df959d2842e69114e4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 19a6c50a7452432c9b7065686d247915 (127.12.174.129:34253): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:23.467300 24790 raft_consensus.cc:2804] T fc07ceaa7eb544aeacd41a465a8bf0f8 P 0957f3414e96411c846439294d91692a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:23.467746 24747 raft_consensus.cc:359] T 7193d4ca686648169964ddb1468a3799 P 19a6c50a7452432c9b7065686d247915 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:23.468591 24747 raft_consensus.cc:385] T 7193d4ca686648169964ddb1468a3799 P 19a6c50a7452432c9b7065686d247915 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:23.468890 24747 raft_consensus.cc:740] T 7193d4ca686648169964ddb1468a3799 P 19a6c50a7452432c9b7065686d247915 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19a6c50a7452432c9b7065686d247915, State: Initialized, Role: FOLLOWER
I20260709 12:14:23.469762 24747 consensus_queue.cc:260] T 7193d4ca686648169964ddb1468a3799 P 19a6c50a7452432c9b7065686d247915 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:23.471570 24556 raft_consensus.cc:2468] T fc07ceaa7eb544aeacd41a465a8bf0f8 P 19a6c50a7452432c9b7065686d247915 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0957f3414e96411c846439294d91692a in term 1.
I20260709 12:14:23.471921 24747 ts_tablet_manager.cc:1434] T 7193d4ca686648169964ddb1468a3799 P 19a6c50a7452432c9b7065686d247915: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:14:23.473066 24747 tablet_bootstrap.cc:492] T 424a5cb2ff61499abadd789493f7875f P 19a6c50a7452432c9b7065686d247915: Bootstrap starting.
I20260709 12:14:23.467851 24790 raft_consensus.cc:697] T fc07ceaa7eb544aeacd41a465a8bf0f8 P 0957f3414e96411c846439294d91692a [term 1 LEADER]: Becoming Leader. State: Replica: 0957f3414e96411c846439294d91692a, State: Running, Role: LEADER
I20260709 12:14:23.475395 24707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39fa67f2dd5541f68cfaff5e37b65376" candidate_uuid: "19a6c50a7452432c9b7065686d247915" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f3fb800959647df959d2842e69114e4" is_pre_election: true
I20260709 12:14:23.472261 24456 catalog_manager.cc:5697] T 47f98adb81f3471f92fb1acba914760c P 9f3fb800959647df959d2842e69114e4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9f3fb800959647df959d2842e69114e4 (127.12.174.131). New cstate: current_term: 1 leader_uuid: "9f3fb800959647df959d2842e69114e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:23.484087 24790 consensus_queue.cc:237] T fc07ceaa7eb544aeacd41a465a8bf0f8 P 0957f3414e96411c846439294d91692a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:23.475428 24706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39fa67f2dd5541f68cfaff5e37b65376" candidate_uuid: "19a6c50a7452432c9b7065686d247915" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f3fb800959647df959d2842e69114e4"
I20260709 12:14:23.481891 24750 raft_consensus.cc:359] T 600a4e0a0ca6400fb4ca416228dc31b7 P 0957f3414e96411c846439294d91692a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:23.474525 24748 consensus_queue.cc:260] T 39fa67f2dd5541f68cfaff5e37b65376 P 9f3fb800959647df959d2842e69114e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:23.487069 24750 raft_consensus.cc:385] T 600a4e0a0ca6400fb4ca416228dc31b7 P 0957f3414e96411c846439294d91692a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:23.487432 24750 raft_consensus.cc:740] T 600a4e0a0ca6400fb4ca416228dc31b7 P 0957f3414e96411c846439294d91692a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0957f3414e96411c846439294d91692a, State: Initialized, Role: FOLLOWER
I20260709 12:14:23.489554 24707 raft_consensus.cc:2468] T 39fa67f2dd5541f68cfaff5e37b65376 P 9f3fb800959647df959d2842e69114e4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19a6c50a7452432c9b7065686d247915 in term 0.
I20260709 12:14:23.495231 24748 ts_tablet_manager.cc:1434] T 39fa67f2dd5541f68cfaff5e37b65376 P 9f3fb800959647df959d2842e69114e4: Time spent starting tablet: real 0.042s	user 0.007s	sys 0.000s
I20260709 12:14:23.496228 24748 tablet_bootstrap.cc:492] T 87f7daeaf8314cce8015910ee7085627 P 9f3fb800959647df959d2842e69114e4: Bootstrap starting.
I20260709 12:14:23.497255 24747 tablet_bootstrap.cc:654] T 424a5cb2ff61499abadd789493f7875f P 19a6c50a7452432c9b7065686d247915: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:23.500731 24783 raft_consensus.cc:2749] T 7193d4ca686648169964ddb1468a3799 P 0957f3414e96411c846439294d91692a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:23.501214 24750 consensus_queue.cc:260] T 600a4e0a0ca6400fb4ca416228dc31b7 P 0957f3414e96411c846439294d91692a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:23.503791 24750 ts_tablet_manager.cc:1434] T 600a4e0a0ca6400fb4ca416228dc31b7 P 0957f3414e96411c846439294d91692a: Time spent starting tablet: real 0.042s	user 0.006s	sys 0.000s
I20260709 12:14:23.504900 24750 tablet_bootstrap.cc:492] T 1070a1e186974febba3e1d8dc0dbb32e P 0957f3414e96411c846439294d91692a: Bootstrap starting.
I20260709 12:14:23.510228 24453 catalog_manager.cc:5697] T ea42bf8b2c8446bb8cf72377bdc2db72 P 0957f3414e96411c846439294d91692a reported cstate change: term changed from 0 to 1, leader changed from <none> to 0957f3414e96411c846439294d91692a (127.12.174.130). New cstate: current_term: 1 leader_uuid: "0957f3414e96411c846439294d91692a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:23.513094 24748 tablet_bootstrap.cc:654] T 87f7daeaf8314cce8015910ee7085627 P 9f3fb800959647df959d2842e69114e4: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:23.523353 24750 tablet_bootstrap.cc:654] T 1070a1e186974febba3e1d8dc0dbb32e P 0957f3414e96411c846439294d91692a: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:23.523847 24455 catalog_manager.cc:5697] T 39fa67f2dd5541f68cfaff5e37b65376 P 19a6c50a7452432c9b7065686d247915 reported cstate change: term changed from 0 to 1, leader changed from <none> to 19a6c50a7452432c9b7065686d247915 (127.12.174.129). New cstate: current_term: 1 leader_uuid: "19a6c50a7452432c9b7065686d247915" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:23.532788 24747 tablet_bootstrap.cc:492] T 424a5cb2ff61499abadd789493f7875f P 19a6c50a7452432c9b7065686d247915: No bootstrap required, opened a new log
I20260709 12:14:23.533577 24747 ts_tablet_manager.cc:1403] T 424a5cb2ff61499abadd789493f7875f P 19a6c50a7452432c9b7065686d247915: Time spent bootstrapping tablet: real 0.061s	user 0.010s	sys 0.007s
I20260709 12:14:23.537263 24747 raft_consensus.cc:359] T 424a5cb2ff61499abadd789493f7875f P 19a6c50a7452432c9b7065686d247915 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } } peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } }
I20260709 12:14:23.538123 24747 raft_consensus.cc:385] T 424a5cb2ff61499abadd789493f7875f P 19a6c50a7452432c9b7065686d247915 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:23.538482 24747 raft_consensus.cc:740] T 424a5cb2ff61499abadd789493f7875f P 19a6c50a7452432c9b7065686d247915 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19a6c50a7452432c9b7065686d247915, State: Initialized, Role: FOLLOWER
I20260709 12:14:23.539525 24747 consensus_queue.cc:260] T 424a5cb2ff61499abadd789493f7875f P 19a6c50a7452432c9b7065686d247915 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } } peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } }
I20260709 12:14:23.542019 24747 ts_tablet_manager.cc:1434] T 424a5cb2ff61499abadd789493f7875f P 19a6c50a7452432c9b7065686d247915: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:14:23.544337 24633 raft_consensus.cc:2468] T 7193d4ca686648169964ddb1468a3799 P 0957f3414e96411c846439294d91692a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f3fb800959647df959d2842e69114e4 in term 1.
I20260709 12:14:23.546197 24748 tablet_bootstrap.cc:492] T 87f7daeaf8314cce8015910ee7085627 P 9f3fb800959647df959d2842e69114e4: No bootstrap required, opened a new log
I20260709 12:14:23.544373 24453 catalog_manager.cc:5697] T aba98af27ae743c7996a5ebd5c0d2780 P 0957f3414e96411c846439294d91692a reported cstate change: term changed from 0 to 1, leader changed from <none> to 0957f3414e96411c846439294d91692a (127.12.174.130). New cstate: current_term: 1 leader_uuid: "0957f3414e96411c846439294d91692a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:23.547605 24748 ts_tablet_manager.cc:1403] T 87f7daeaf8314cce8015910ee7085627 P 9f3fb800959647df959d2842e69114e4: Time spent bootstrapping tablet: real 0.052s	user 0.018s	sys 0.005s
I20260709 12:14:23.549707 24750 tablet_bootstrap.cc:492] T 1070a1e186974febba3e1d8dc0dbb32e P 0957f3414e96411c846439294d91692a: No bootstrap required, opened a new log
I20260709 12:14:23.550381 24750 ts_tablet_manager.cc:1403] T 1070a1e186974febba3e1d8dc0dbb32e P 0957f3414e96411c846439294d91692a: Time spent bootstrapping tablet: real 0.046s	user 0.020s	sys 0.007s
I20260709 12:14:23.550343 24748 raft_consensus.cc:359] T 87f7daeaf8314cce8015910ee7085627 P 9f3fb800959647df959d2842e69114e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:23.551034 24748 raft_consensus.cc:385] T 87f7daeaf8314cce8015910ee7085627 P 9f3fb800959647df959d2842e69114e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:23.551290 24748 raft_consensus.cc:740] T 87f7daeaf8314cce8015910ee7085627 P 9f3fb800959647df959d2842e69114e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f3fb800959647df959d2842e69114e4, State: Initialized, Role: FOLLOWER
I20260709 12:14:23.552219 24748 consensus_queue.cc:260] T 87f7daeaf8314cce8015910ee7085627 P 9f3fb800959647df959d2842e69114e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:23.552594 24671 leader_election.cc:304] T 7193d4ca686648169964ddb1468a3799 P 9f3fb800959647df959d2842e69114e4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0957f3414e96411c846439294d91692a, 9f3fb800959647df959d2842e69114e4; no voters: 19a6c50a7452432c9b7065686d247915
I20260709 12:14:23.553822 24750 raft_consensus.cc:359] T 1070a1e186974febba3e1d8dc0dbb32e P 0957f3414e96411c846439294d91692a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:23.554256 24777 raft_consensus.cc:2804] T 7193d4ca686648169964ddb1468a3799 P 9f3fb800959647df959d2842e69114e4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:23.554629 24750 raft_consensus.cc:385] T 1070a1e186974febba3e1d8dc0dbb32e P 0957f3414e96411c846439294d91692a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:23.554836 24748 ts_tablet_manager.cc:1434] T 87f7daeaf8314cce8015910ee7085627 P 9f3fb800959647df959d2842e69114e4: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:14:23.554801 24777 raft_consensus.cc:697] T 7193d4ca686648169964ddb1468a3799 P 9f3fb800959647df959d2842e69114e4 [term 1 LEADER]: Becoming Leader. State: Replica: 9f3fb800959647df959d2842e69114e4, State: Running, Role: LEADER
I20260709 12:14:23.555011 24750 raft_consensus.cc:740] T 1070a1e186974febba3e1d8dc0dbb32e P 0957f3414e96411c846439294d91692a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0957f3414e96411c846439294d91692a, State: Initialized, Role: FOLLOWER
I20260709 12:14:23.556061 24750 consensus_queue.cc:260] T 1070a1e186974febba3e1d8dc0dbb32e P 0957f3414e96411c846439294d91692a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:23.556124 24777 consensus_queue.cc:237] T 7193d4ca686648169964ddb1468a3799 P 9f3fb800959647df959d2842e69114e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:23.558539 24750 ts_tablet_manager.cc:1434] T 1070a1e186974febba3e1d8dc0dbb32e P 0957f3414e96411c846439294d91692a: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:14:23.558518 24453 catalog_manager.cc:5697] T fc07ceaa7eb544aeacd41a465a8bf0f8 P 0957f3414e96411c846439294d91692a reported cstate change: term changed from 0 to 1, leader changed from <none> to 0957f3414e96411c846439294d91692a (127.12.174.130). New cstate: current_term: 1 leader_uuid: "0957f3414e96411c846439294d91692a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:23.563941 24790 raft_consensus.cc:493] T 424a5cb2ff61499abadd789493f7875f P 0957f3414e96411c846439294d91692a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:23.565009 24790 raft_consensus.cc:515] T 424a5cb2ff61499abadd789493f7875f P 0957f3414e96411c846439294d91692a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } } peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } }
I20260709 12:14:23.567364 24790 leader_election.cc:290] T 424a5cb2ff61499abadd789493f7875f P 0957f3414e96411c846439294d91692a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9f3fb800959647df959d2842e69114e4 (127.12.174.131:41945), 19a6c50a7452432c9b7065686d247915 (127.12.174.129:34253)
I20260709 12:14:23.568545 24707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424a5cb2ff61499abadd789493f7875f" candidate_uuid: "0957f3414e96411c846439294d91692a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f3fb800959647df959d2842e69114e4" is_pre_election: true
I20260709 12:14:23.569073 24556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424a5cb2ff61499abadd789493f7875f" candidate_uuid: "0957f3414e96411c846439294d91692a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19a6c50a7452432c9b7065686d247915" is_pre_election: true
I20260709 12:14:23.569375 24707 raft_consensus.cc:2468] T 424a5cb2ff61499abadd789493f7875f P 9f3fb800959647df959d2842e69114e4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0957f3414e96411c846439294d91692a in term 0.
I20260709 12:14:23.570254 24556 raft_consensus.cc:2468] T 424a5cb2ff61499abadd789493f7875f P 19a6c50a7452432c9b7065686d247915 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0957f3414e96411c846439294d91692a in term 0.
I20260709 12:14:23.571659 24598 leader_election.cc:304] T 424a5cb2ff61499abadd789493f7875f P 0957f3414e96411c846439294d91692a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0957f3414e96411c846439294d91692a, 19a6c50a7452432c9b7065686d247915; no voters: 
I20260709 12:14:23.572571 24790 raft_consensus.cc:2804] T 424a5cb2ff61499abadd789493f7875f P 0957f3414e96411c846439294d91692a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:23.572952 24790 raft_consensus.cc:493] T 424a5cb2ff61499abadd789493f7875f P 0957f3414e96411c846439294d91692a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:23.573274 24790 raft_consensus.cc:3060] T 424a5cb2ff61499abadd789493f7875f P 0957f3414e96411c846439294d91692a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:23.584120 24454 catalog_manager.cc:5697] T 7193d4ca686648169964ddb1468a3799 P 9f3fb800959647df959d2842e69114e4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9f3fb800959647df959d2842e69114e4 (127.12.174.131). New cstate: current_term: 1 leader_uuid: "9f3fb800959647df959d2842e69114e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:23.585326 24790 raft_consensus.cc:515] T 424a5cb2ff61499abadd789493f7875f P 0957f3414e96411c846439294d91692a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } } peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } }
I20260709 12:14:23.588320 24790 leader_election.cc:290] T 424a5cb2ff61499abadd789493f7875f P 0957f3414e96411c846439294d91692a [CANDIDATE]: Term 1 election: Requested vote from peers 9f3fb800959647df959d2842e69114e4 (127.12.174.131:41945), 19a6c50a7452432c9b7065686d247915 (127.12.174.129:34253)
I20260709 12:14:23.588367 24707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424a5cb2ff61499abadd789493f7875f" candidate_uuid: "0957f3414e96411c846439294d91692a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f3fb800959647df959d2842e69114e4"
I20260709 12:14:23.588550 24556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424a5cb2ff61499abadd789493f7875f" candidate_uuid: "0957f3414e96411c846439294d91692a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19a6c50a7452432c9b7065686d247915"
I20260709 12:14:23.589082 24707 raft_consensus.cc:3060] T 424a5cb2ff61499abadd789493f7875f P 9f3fb800959647df959d2842e69114e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:23.589258 24556 raft_consensus.cc:3060] T 424a5cb2ff61499abadd789493f7875f P 19a6c50a7452432c9b7065686d247915 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:23.596079 24757 raft_consensus.cc:493] T 87f7daeaf8314cce8015910ee7085627 P 19a6c50a7452432c9b7065686d247915 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:23.596783 24757 raft_consensus.cc:515] T 87f7daeaf8314cce8015910ee7085627 P 19a6c50a7452432c9b7065686d247915 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:23.597587 24556 raft_consensus.cc:2468] T 424a5cb2ff61499abadd789493f7875f P 19a6c50a7452432c9b7065686d247915 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0957f3414e96411c846439294d91692a in term 1.
I20260709 12:14:23.598237 24707 raft_consensus.cc:2468] T 424a5cb2ff61499abadd789493f7875f P 9f3fb800959647df959d2842e69114e4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0957f3414e96411c846439294d91692a in term 1.
I20260709 12:14:23.599128 24757 leader_election.cc:290] T 87f7daeaf8314cce8015910ee7085627 P 19a6c50a7452432c9b7065686d247915 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0957f3414e96411c846439294d91692a (127.12.174.130:32819), 9f3fb800959647df959d2842e69114e4 (127.12.174.131:41945)
I20260709 12:14:23.599524 24596 leader_election.cc:304] T 424a5cb2ff61499abadd789493f7875f P 0957f3414e96411c846439294d91692a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0957f3414e96411c846439294d91692a, 9f3fb800959647df959d2842e69114e4; no voters: 
I20260709 12:14:23.600387 24707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f7daeaf8314cce8015910ee7085627" candidate_uuid: "19a6c50a7452432c9b7065686d247915" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f3fb800959647df959d2842e69114e4" is_pre_election: true
I20260709 12:14:23.600399 24633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f7daeaf8314cce8015910ee7085627" candidate_uuid: "19a6c50a7452432c9b7065686d247915" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0957f3414e96411c846439294d91692a" is_pre_election: true
I20260709 12:14:23.601264 24707 raft_consensus.cc:2468] T 87f7daeaf8314cce8015910ee7085627 P 9f3fb800959647df959d2842e69114e4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19a6c50a7452432c9b7065686d247915 in term 0.
I20260709 12:14:23.601322 24633 raft_consensus.cc:2468] T 87f7daeaf8314cce8015910ee7085627 P 0957f3414e96411c846439294d91692a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19a6c50a7452432c9b7065686d247915 in term 0.
I20260709 12:14:23.602923 24521 leader_election.cc:304] T 87f7daeaf8314cce8015910ee7085627 P 19a6c50a7452432c9b7065686d247915 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19a6c50a7452432c9b7065686d247915, 9f3fb800959647df959d2842e69114e4; no voters: 
I20260709 12:14:23.603605 24790 raft_consensus.cc:2804] T 424a5cb2ff61499abadd789493f7875f P 0957f3414e96411c846439294d91692a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:23.604157 24790 raft_consensus.cc:697] T 424a5cb2ff61499abadd789493f7875f P 0957f3414e96411c846439294d91692a [term 1 LEADER]: Becoming Leader. State: Replica: 0957f3414e96411c846439294d91692a, State: Running, Role: LEADER
I20260709 12:14:23.604271 24757 raft_consensus.cc:2804] T 87f7daeaf8314cce8015910ee7085627 P 19a6c50a7452432c9b7065686d247915 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:23.604733 24757 raft_consensus.cc:493] T 87f7daeaf8314cce8015910ee7085627 P 19a6c50a7452432c9b7065686d247915 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:23.605108 24757 raft_consensus.cc:3060] T 87f7daeaf8314cce8015910ee7085627 P 19a6c50a7452432c9b7065686d247915 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:23.605134 24790 consensus_queue.cc:237] T 424a5cb2ff61499abadd789493f7875f P 0957f3414e96411c846439294d91692a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } } peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } }
I20260709 12:14:23.612928 24757 raft_consensus.cc:515] T 87f7daeaf8314cce8015910ee7085627 P 19a6c50a7452432c9b7065686d247915 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:23.614820 24757 leader_election.cc:290] T 87f7daeaf8314cce8015910ee7085627 P 19a6c50a7452432c9b7065686d247915 [CANDIDATE]: Term 1 election: Requested vote from peers 0957f3414e96411c846439294d91692a (127.12.174.130:32819), 9f3fb800959647df959d2842e69114e4 (127.12.174.131:41945)
I20260709 12:14:23.614692 24454 catalog_manager.cc:5697] T 424a5cb2ff61499abadd789493f7875f P 0957f3414e96411c846439294d91692a reported cstate change: term changed from 0 to 1, leader changed from <none> to 0957f3414e96411c846439294d91692a (127.12.174.130). New cstate: current_term: 1 leader_uuid: "0957f3414e96411c846439294d91692a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:23.615917 24633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f7daeaf8314cce8015910ee7085627" candidate_uuid: "19a6c50a7452432c9b7065686d247915" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0957f3414e96411c846439294d91692a"
I20260709 12:14:23.615983 24707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f7daeaf8314cce8015910ee7085627" candidate_uuid: "19a6c50a7452432c9b7065686d247915" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f3fb800959647df959d2842e69114e4"
I20260709 12:14:23.616632 24633 raft_consensus.cc:3060] T 87f7daeaf8314cce8015910ee7085627 P 0957f3414e96411c846439294d91692a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:23.617036 24707 raft_consensus.cc:3060] T 87f7daeaf8314cce8015910ee7085627 P 9f3fb800959647df959d2842e69114e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:23.624495 24633 raft_consensus.cc:2468] T 87f7daeaf8314cce8015910ee7085627 P 0957f3414e96411c846439294d91692a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19a6c50a7452432c9b7065686d247915 in term 1.
I20260709 12:14:23.625352 24707 raft_consensus.cc:2468] T 87f7daeaf8314cce8015910ee7085627 P 9f3fb800959647df959d2842e69114e4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19a6c50a7452432c9b7065686d247915 in term 1.
I20260709 12:14:23.625948 24632 raft_consensus.cc:3060] T 600a4e0a0ca6400fb4ca416228dc31b7 P 0957f3414e96411c846439294d91692a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:23.626036 24522 leader_election.cc:304] T 87f7daeaf8314cce8015910ee7085627 P 19a6c50a7452432c9b7065686d247915 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0957f3414e96411c846439294d91692a, 19a6c50a7452432c9b7065686d247915; no voters: 
I20260709 12:14:23.627537 24757 raft_consensus.cc:2804] T 87f7daeaf8314cce8015910ee7085627 P 19a6c50a7452432c9b7065686d247915 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:23.628914 24757 raft_consensus.cc:697] T 87f7daeaf8314cce8015910ee7085627 P 19a6c50a7452432c9b7065686d247915 [term 1 LEADER]: Becoming Leader. State: Replica: 19a6c50a7452432c9b7065686d247915, State: Running, Role: LEADER
I20260709 12:14:23.629657 24757 consensus_queue.cc:237] T 87f7daeaf8314cce8015910ee7085627 P 19a6c50a7452432c9b7065686d247915 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:23.633822 24790 raft_consensus.cc:493] T 600a4e0a0ca6400fb4ca416228dc31b7 P 0957f3414e96411c846439294d91692a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:23.634503 24790 raft_consensus.cc:515] T 600a4e0a0ca6400fb4ca416228dc31b7 P 0957f3414e96411c846439294d91692a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:23.635157 24777 consensus_queue.cc:1048] T 600a4e0a0ca6400fb4ca416228dc31b7 P 9f3fb800959647df959d2842e69114e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:23.639020 24790 leader_election.cc:290] T 600a4e0a0ca6400fb4ca416228dc31b7 P 0957f3414e96411c846439294d91692a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 19a6c50a7452432c9b7065686d247915 (127.12.174.129:34253), 9f3fb800959647df959d2842e69114e4 (127.12.174.131:41945)
I20260709 12:14:23.640213 24556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600a4e0a0ca6400fb4ca416228dc31b7" candidate_uuid: "0957f3414e96411c846439294d91692a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19a6c50a7452432c9b7065686d247915" is_pre_election: true
I20260709 12:14:23.638669 24454 catalog_manager.cc:5697] T 87f7daeaf8314cce8015910ee7085627 P 19a6c50a7452432c9b7065686d247915 reported cstate change: term changed from 0 to 1, leader changed from <none> to 19a6c50a7452432c9b7065686d247915 (127.12.174.129). New cstate: current_term: 1 leader_uuid: "19a6c50a7452432c9b7065686d247915" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:23.640853 24707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600a4e0a0ca6400fb4ca416228dc31b7" candidate_uuid: "0957f3414e96411c846439294d91692a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f3fb800959647df959d2842e69114e4" is_pre_election: true
I20260709 12:14:23.640951 24556 raft_consensus.cc:2468] T 600a4e0a0ca6400fb4ca416228dc31b7 P 19a6c50a7452432c9b7065686d247915 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0957f3414e96411c846439294d91692a in term 1.
I20260709 12:14:23.642684 24598 leader_election.cc:304] T 600a4e0a0ca6400fb4ca416228dc31b7 P 0957f3414e96411c846439294d91692a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0957f3414e96411c846439294d91692a, 19a6c50a7452432c9b7065686d247915; no voters: 9f3fb800959647df959d2842e69114e4
I20260709 12:14:23.644181 24790 raft_consensus.cc:2804] T 600a4e0a0ca6400fb4ca416228dc31b7 P 0957f3414e96411c846439294d91692a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:23.644555 24790 raft_consensus.cc:493] T 600a4e0a0ca6400fb4ca416228dc31b7 P 0957f3414e96411c846439294d91692a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9f3fb800959647df959d2842e69114e4)
I20260709 12:14:23.645028 24790 raft_consensus.cc:3060] T 600a4e0a0ca6400fb4ca416228dc31b7 P 0957f3414e96411c846439294d91692a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:23.652181 24777 consensus_queue.cc:1048] T 600a4e0a0ca6400fb4ca416228dc31b7 P 9f3fb800959647df959d2842e69114e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:23.658277 24790 raft_consensus.cc:515] T 600a4e0a0ca6400fb4ca416228dc31b7 P 0957f3414e96411c846439294d91692a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:23.658701 24757 raft_consensus.cc:493] T 1070a1e186974febba3e1d8dc0dbb32e P 19a6c50a7452432c9b7065686d247915 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:23.659596 24757 raft_consensus.cc:515] T 1070a1e186974febba3e1d8dc0dbb32e P 19a6c50a7452432c9b7065686d247915 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:23.660485 24632 raft_consensus.cc:1240] T 600a4e0a0ca6400fb4ca416228dc31b7 P 0957f3414e96411c846439294d91692a [term 2 FOLLOWER]: Rejecting Update request from peer 9f3fb800959647df959d2842e69114e4 for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:23.661136 24790 leader_election.cc:290] T 600a4e0a0ca6400fb4ca416228dc31b7 P 0957f3414e96411c846439294d91692a [CANDIDATE]: Term 2 election: Requested vote from peers 19a6c50a7452432c9b7065686d247915 (127.12.174.129:34253), 9f3fb800959647df959d2842e69114e4 (127.12.174.131:41945)
I20260709 12:14:23.662240 24757 leader_election.cc:290] T 1070a1e186974febba3e1d8dc0dbb32e P 19a6c50a7452432c9b7065686d247915 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0957f3414e96411c846439294d91692a (127.12.174.130:32819), 9f3fb800959647df959d2842e69114e4 (127.12.174.131:41945)
I20260709 12:14:23.664575 24707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600a4e0a0ca6400fb4ca416228dc31b7" candidate_uuid: "0957f3414e96411c846439294d91692a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9f3fb800959647df959d2842e69114e4"
I20260709 12:14:23.664921 24556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600a4e0a0ca6400fb4ca416228dc31b7" candidate_uuid: "0957f3414e96411c846439294d91692a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "19a6c50a7452432c9b7065686d247915"
I20260709 12:14:23.664921 24706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1070a1e186974febba3e1d8dc0dbb32e" candidate_uuid: "19a6c50a7452432c9b7065686d247915" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f3fb800959647df959d2842e69114e4" is_pre_election: true
I20260709 12:14:23.666517 24706 raft_consensus.cc:2468] T 1070a1e186974febba3e1d8dc0dbb32e P 9f3fb800959647df959d2842e69114e4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19a6c50a7452432c9b7065686d247915 in term 0.
I20260709 12:14:23.666781 24596 leader_election.cc:304] T 600a4e0a0ca6400fb4ca416228dc31b7 P 0957f3414e96411c846439294d91692a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0957f3414e96411c846439294d91692a; no voters: 19a6c50a7452432c9b7065686d247915, 9f3fb800959647df959d2842e69114e4
I20260709 12:14:23.667881 24777 consensus_queue.cc:1059] T 600a4e0a0ca6400fb4ca416228dc31b7 P 9f3fb800959647df959d2842e69114e4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:23.668067 24790 raft_consensus.cc:2749] T 600a4e0a0ca6400fb4ca416228dc31b7 P 0957f3414e96411c846439294d91692a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:14:23.668129 24521 leader_election.cc:304] T 1070a1e186974febba3e1d8dc0dbb32e P 19a6c50a7452432c9b7065686d247915 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19a6c50a7452432c9b7065686d247915, 9f3fb800959647df959d2842e69114e4; no voters: 
I20260709 12:14:23.668788 24777 raft_consensus.cc:3055] T 600a4e0a0ca6400fb4ca416228dc31b7 P 9f3fb800959647df959d2842e69114e4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:23.669173 24632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1070a1e186974febba3e1d8dc0dbb32e" candidate_uuid: "19a6c50a7452432c9b7065686d247915" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0957f3414e96411c846439294d91692a" is_pre_election: true
I20260709 12:14:23.669139 24777 raft_consensus.cc:740] T 600a4e0a0ca6400fb4ca416228dc31b7 P 9f3fb800959647df959d2842e69114e4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9f3fb800959647df959d2842e69114e4, State: Running, Role: LEADER
I20260709 12:14:23.670027 24632 raft_consensus.cc:2468] T 1070a1e186974febba3e1d8dc0dbb32e P 0957f3414e96411c846439294d91692a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19a6c50a7452432c9b7065686d247915 in term 0.
I20260709 12:14:23.669382 24786 raft_consensus.cc:2804] T 1070a1e186974febba3e1d8dc0dbb32e P 19a6c50a7452432c9b7065686d247915 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:23.670476 24777 consensus_queue.cc:260] T 600a4e0a0ca6400fb4ca416228dc31b7 P 9f3fb800959647df959d2842e69114e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:23.671001 24786 raft_consensus.cc:493] T 1070a1e186974febba3e1d8dc0dbb32e P 19a6c50a7452432c9b7065686d247915 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:23.671392 24786 raft_consensus.cc:3060] T 1070a1e186974febba3e1d8dc0dbb32e P 19a6c50a7452432c9b7065686d247915 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:23.671864 24777 raft_consensus.cc:3060] T 600a4e0a0ca6400fb4ca416228dc31b7 P 9f3fb800959647df959d2842e69114e4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:23.678964 24786 raft_consensus.cc:515] T 1070a1e186974febba3e1d8dc0dbb32e P 19a6c50a7452432c9b7065686d247915 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:23.681041 24786 leader_election.cc:290] T 1070a1e186974febba3e1d8dc0dbb32e P 19a6c50a7452432c9b7065686d247915 [CANDIDATE]: Term 1 election: Requested vote from peers 0957f3414e96411c846439294d91692a (127.12.174.130:32819), 9f3fb800959647df959d2842e69114e4 (127.12.174.131:41945)
I20260709 12:14:23.681942 24632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1070a1e186974febba3e1d8dc0dbb32e" candidate_uuid: "19a6c50a7452432c9b7065686d247915" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0957f3414e96411c846439294d91692a"
I20260709 12:14:23.682175 24706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1070a1e186974febba3e1d8dc0dbb32e" candidate_uuid: "19a6c50a7452432c9b7065686d247915" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f3fb800959647df959d2842e69114e4"
I20260709 12:14:23.682544 24632 raft_consensus.cc:3060] T 1070a1e186974febba3e1d8dc0dbb32e P 0957f3414e96411c846439294d91692a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:23.682717 24706 raft_consensus.cc:3060] T 1070a1e186974febba3e1d8dc0dbb32e P 9f3fb800959647df959d2842e69114e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:23.689483 24706 raft_consensus.cc:2468] T 1070a1e186974febba3e1d8dc0dbb32e P 9f3fb800959647df959d2842e69114e4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19a6c50a7452432c9b7065686d247915 in term 1.
I20260709 12:14:23.689692 24632 raft_consensus.cc:2468] T 1070a1e186974febba3e1d8dc0dbb32e P 0957f3414e96411c846439294d91692a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19a6c50a7452432c9b7065686d247915 in term 1.
I20260709 12:14:23.690729 24521 leader_election.cc:304] T 1070a1e186974febba3e1d8dc0dbb32e P 19a6c50a7452432c9b7065686d247915 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19a6c50a7452432c9b7065686d247915, 9f3fb800959647df959d2842e69114e4; no voters: 
I20260709 12:14:23.691605 24786 raft_consensus.cc:2804] T 1070a1e186974febba3e1d8dc0dbb32e P 19a6c50a7452432c9b7065686d247915 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:23.692003 24786 raft_consensus.cc:697] T 1070a1e186974febba3e1d8dc0dbb32e P 19a6c50a7452432c9b7065686d247915 [term 1 LEADER]: Becoming Leader. State: Replica: 19a6c50a7452432c9b7065686d247915, State: Running, Role: LEADER
I20260709 12:14:23.692817 24786 consensus_queue.cc:237] T 1070a1e186974febba3e1d8dc0dbb32e P 19a6c50a7452432c9b7065686d247915 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:23.699999 24456 catalog_manager.cc:5697] T 1070a1e186974febba3e1d8dc0dbb32e P 19a6c50a7452432c9b7065686d247915 reported cstate change: term changed from 0 to 1, leader changed from <none> to 19a6c50a7452432c9b7065686d247915 (127.12.174.129). New cstate: current_term: 1 leader_uuid: "19a6c50a7452432c9b7065686d247915" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:23.803499 12986 ts_manager.cc:295] Set tserver state for 19a6c50a7452432c9b7065686d247915 to MAINTENANCE_MODE
I20260709 12:14:23.804385 12986 tablet_server.cc:179] TabletServer@127.12.174.129:0 shutting down...
I20260709 12:14:23.817970 24790 raft_consensus.cc:493] T 47f98adb81f3471f92fb1acba914760c P 0957f3414e96411c846439294d91692a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:23.818879 24790 raft_consensus.cc:515] T 47f98adb81f3471f92fb1acba914760c P 0957f3414e96411c846439294d91692a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:23.821095 24790 leader_election.cc:290] T 47f98adb81f3471f92fb1acba914760c P 0957f3414e96411c846439294d91692a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 19a6c50a7452432c9b7065686d247915 (127.12.174.129:34253), 9f3fb800959647df959d2842e69114e4 (127.12.174.131:41945)
I20260709 12:14:23.823184 24706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47f98adb81f3471f92fb1acba914760c" candidate_uuid: "0957f3414e96411c846439294d91692a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f3fb800959647df959d2842e69114e4" is_pre_election: true
I20260709 12:14:23.825943 12986 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 12:14:23.825917 24598 leader_election.cc:336] T 47f98adb81f3471f92fb1acba914760c P 0957f3414e96411c846439294d91692a [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer 19a6c50a7452432c9b7065686d247915 (127.12.174.129:34253): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:14:23.826534 24598 leader_election.cc:304] T 47f98adb81f3471f92fb1acba914760c P 0957f3414e96411c846439294d91692a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0957f3414e96411c846439294d91692a; no voters: 19a6c50a7452432c9b7065686d247915, 9f3fb800959647df959d2842e69114e4
I20260709 12:14:23.827212 12986 tablet_replica.cc:333] T fc07ceaa7eb544aeacd41a465a8bf0f8 P 19a6c50a7452432c9b7065686d247915: stopping tablet replica
I20260709 12:14:23.828054 24790 raft_consensus.cc:2749] T 47f98adb81f3471f92fb1acba914760c P 0957f3414e96411c846439294d91692a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:23.828233 12986 raft_consensus.cc:2243] T fc07ceaa7eb544aeacd41a465a8bf0f8 P 19a6c50a7452432c9b7065686d247915 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:23.828801 12986 raft_consensus.cc:2272] T fc07ceaa7eb544aeacd41a465a8bf0f8 P 19a6c50a7452432c9b7065686d247915 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:23.830935 12986 tablet_replica.cc:333] T 47f98adb81f3471f92fb1acba914760c P 19a6c50a7452432c9b7065686d247915: stopping tablet replica
I20260709 12:14:23.831632 12986 raft_consensus.cc:2243] T 47f98adb81f3471f92fb1acba914760c P 19a6c50a7452432c9b7065686d247915 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:23.832150 12986 raft_consensus.cc:2272] T 47f98adb81f3471f92fb1acba914760c P 19a6c50a7452432c9b7065686d247915 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:23.834939 12986 tablet_replica.cc:333] T 424a5cb2ff61499abadd789493f7875f P 19a6c50a7452432c9b7065686d247915: stopping tablet replica
I20260709 12:14:23.835754 12986 raft_consensus.cc:2243] T 424a5cb2ff61499abadd789493f7875f P 19a6c50a7452432c9b7065686d247915 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:23.836287 12986 raft_consensus.cc:2272] T 424a5cb2ff61499abadd789493f7875f P 19a6c50a7452432c9b7065686d247915 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:23.838814 12986 tablet_replica.cc:333] T 1070a1e186974febba3e1d8dc0dbb32e P 19a6c50a7452432c9b7065686d247915: stopping tablet replica
I20260709 12:14:23.839414 12986 raft_consensus.cc:2243] T 1070a1e186974febba3e1d8dc0dbb32e P 19a6c50a7452432c9b7065686d247915 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:23.840090 12986 pending_rounds.cc:70] T 1070a1e186974febba3e1d8dc0dbb32e P 19a6c50a7452432c9b7065686d247915: Trying to abort 1 pending ops.
I20260709 12:14:23.840274 12986 pending_rounds.cc:77] T 1070a1e186974febba3e1d8dc0dbb32e P 19a6c50a7452432c9b7065686d247915: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305622584093233152 op_type: NO_OP noop_request { }
I20260709 12:14:23.840600 12986 raft_consensus.cc:2889] T 1070a1e186974febba3e1d8dc0dbb32e P 19a6c50a7452432c9b7065686d247915 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:14:23.840862 12986 raft_consensus.cc:2272] T 1070a1e186974febba3e1d8dc0dbb32e P 19a6c50a7452432c9b7065686d247915 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:23.843411 12986 tablet_replica.cc:333] T 87f7daeaf8314cce8015910ee7085627 P 19a6c50a7452432c9b7065686d247915: stopping tablet replica
I20260709 12:14:23.844179 12986 raft_consensus.cc:2243] T 87f7daeaf8314cce8015910ee7085627 P 19a6c50a7452432c9b7065686d247915 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:23.844839 12986 pending_rounds.cc:70] T 87f7daeaf8314cce8015910ee7085627 P 19a6c50a7452432c9b7065686d247915: Trying to abort 1 pending ops.
I20260709 12:14:23.845036 12986 pending_rounds.cc:77] T 87f7daeaf8314cce8015910ee7085627 P 19a6c50a7452432c9b7065686d247915: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305622583834710016 op_type: NO_OP noop_request { }
I20260709 12:14:23.845302 12986 raft_consensus.cc:2889] T 87f7daeaf8314cce8015910ee7085627 P 19a6c50a7452432c9b7065686d247915 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:14:23.845611 12986 raft_consensus.cc:2272] T 87f7daeaf8314cce8015910ee7085627 P 19a6c50a7452432c9b7065686d247915 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:23.848290 12986 tablet_replica.cc:333] T 7193d4ca686648169964ddb1468a3799 P 19a6c50a7452432c9b7065686d247915: stopping tablet replica
I20260709 12:14:23.849067 12986 raft_consensus.cc:2243] T 7193d4ca686648169964ddb1468a3799 P 19a6c50a7452432c9b7065686d247915 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:23.849481 12986 raft_consensus.cc:2272] T 7193d4ca686648169964ddb1468a3799 P 19a6c50a7452432c9b7065686d247915 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:23.851737 12986 tablet_replica.cc:333] T 39fa67f2dd5541f68cfaff5e37b65376 P 19a6c50a7452432c9b7065686d247915: stopping tablet replica
I20260709 12:14:23.852332 12986 raft_consensus.cc:2243] T 39fa67f2dd5541f68cfaff5e37b65376 P 19a6c50a7452432c9b7065686d247915 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:23.853021 12986 pending_rounds.cc:70] T 39fa67f2dd5541f68cfaff5e37b65376 P 19a6c50a7452432c9b7065686d247915: Trying to abort 1 pending ops.
I20260709 12:14:23.853204 12986 pending_rounds.cc:77] T 39fa67f2dd5541f68cfaff5e37b65376 P 19a6c50a7452432c9b7065686d247915: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305622583065993216 op_type: NO_OP noop_request { }
I20260709 12:14:23.853442 12986 raft_consensus.cc:2889] T 39fa67f2dd5541f68cfaff5e37b65376 P 19a6c50a7452432c9b7065686d247915 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:14:23.853691 12986 raft_consensus.cc:2272] T 39fa67f2dd5541f68cfaff5e37b65376 P 19a6c50a7452432c9b7065686d247915 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:23.856182 12986 tablet_replica.cc:333] T ea42bf8b2c8446bb8cf72377bdc2db72 P 19a6c50a7452432c9b7065686d247915: stopping tablet replica
I20260709 12:14:23.856760 12986 raft_consensus.cc:2243] T ea42bf8b2c8446bb8cf72377bdc2db72 P 19a6c50a7452432c9b7065686d247915 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:23.857118 12986 raft_consensus.cc:2272] T ea42bf8b2c8446bb8cf72377bdc2db72 P 19a6c50a7452432c9b7065686d247915 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:23.859050 12986 tablet_replica.cc:333] T aba98af27ae743c7996a5ebd5c0d2780 P 19a6c50a7452432c9b7065686d247915: stopping tablet replica
I20260709 12:14:23.859592 12986 raft_consensus.cc:2243] T aba98af27ae743c7996a5ebd5c0d2780 P 19a6c50a7452432c9b7065686d247915 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:23.859957 12986 raft_consensus.cc:2272] T aba98af27ae743c7996a5ebd5c0d2780 P 19a6c50a7452432c9b7065686d247915 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:23.861773 12986 tablet_replica.cc:333] T 600a4e0a0ca6400fb4ca416228dc31b7 P 19a6c50a7452432c9b7065686d247915: stopping tablet replica
I20260709 12:14:23.862241 12986 raft_consensus.cc:2243] T 600a4e0a0ca6400fb4ca416228dc31b7 P 19a6c50a7452432c9b7065686d247915 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:23.862632 12986 raft_consensus.cc:2272] T 600a4e0a0ca6400fb4ca416228dc31b7 P 19a6c50a7452432c9b7065686d247915 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:23.884970 12986 tablet_server.cc:196] TabletServer@127.12.174.129:0 shutdown complete.
W20260709 12:14:23.889423 24598 consensus_peers.cc:597] T aba98af27ae743c7996a5ebd5c0d2780 P 0957f3414e96411c846439294d91692a -> Peer 19a6c50a7452432c9b7065686d247915 (127.12.174.129:34253): Couldn't send request to peer 19a6c50a7452432c9b7065686d247915. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:34253: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:23.909443 24504 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:14:23.932922 24632 raft_consensus.cc:3060] T 47f98adb81f3471f92fb1acba914760c P 0957f3414e96411c846439294d91692a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:23.941004 24777 consensus_queue.cc:1048] T 47f98adb81f3471f92fb1acba914760c P 9f3fb800959647df959d2842e69114e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:14:23.958262 24672 consensus_peers.cc:597] T 47f98adb81f3471f92fb1acba914760c P 9f3fb800959647df959d2842e69114e4 -> Peer 19a6c50a7452432c9b7065686d247915 (127.12.174.129:34253): Couldn't send request to peer 19a6c50a7452432c9b7065686d247915. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:34253: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:23.998039 24790 consensus_queue.cc:1048] T ea42bf8b2c8446bb8cf72377bdc2db72 P 0957f3414e96411c846439294d91692a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:14:24.004001 24598 consensus_peers.cc:597] T ea42bf8b2c8446bb8cf72377bdc2db72 P 0957f3414e96411c846439294d91692a -> Peer 19a6c50a7452432c9b7065686d247915 (127.12.174.129:34253): Couldn't send request to peer 19a6c50a7452432c9b7065686d247915. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:34253: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:24.028115 24820 consensus_queue.cc:1048] T aba98af27ae743c7996a5ebd5c0d2780 P 0957f3414e96411c846439294d91692a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:24.046540 24783 consensus_queue.cc:1048] T fc07ceaa7eb544aeacd41a465a8bf0f8 P 0957f3414e96411c846439294d91692a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:14:24.061571 24598 consensus_peers.cc:597] T fc07ceaa7eb544aeacd41a465a8bf0f8 P 0957f3414e96411c846439294d91692a -> Peer 19a6c50a7452432c9b7065686d247915 (127.12.174.129:34253): Couldn't send request to peer 19a6c50a7452432c9b7065686d247915. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:34253: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:24.075728 24598 consensus_peers.cc:597] T 424a5cb2ff61499abadd789493f7875f P 0957f3414e96411c846439294d91692a -> Peer 19a6c50a7452432c9b7065686d247915 (127.12.174.129:34253): Couldn't send request to peer 19a6c50a7452432c9b7065686d247915. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:34253: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:24.097613 24672 consensus_peers.cc:597] T 7193d4ca686648169964ddb1468a3799 P 9f3fb800959647df959d2842e69114e4 -> Peer 19a6c50a7452432c9b7065686d247915 (127.12.174.129:34253): Couldn't send request to peer 19a6c50a7452432c9b7065686d247915. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:34253: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:24.139865 24752 consensus_queue.cc:1048] T 7193d4ca686648169964ddb1468a3799 P 9f3fb800959647df959d2842e69114e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:24.170405 24783 consensus_queue.cc:1048] T 424a5cb2ff61499abadd789493f7875f P 0957f3414e96411c846439294d91692a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:14:24.904569 24598 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.174.129:34253: connect: Connection refused (error 111) [suppressed 140 similar messages]
W20260709 12:14:24.910532 24504 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:14:25.035065 24752 raft_consensus.cc:493] T 39fa67f2dd5541f68cfaff5e37b65376 P 9f3fb800959647df959d2842e69114e4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:25.035667 24752 raft_consensus.cc:515] T 39fa67f2dd5541f68cfaff5e37b65376 P 9f3fb800959647df959d2842e69114e4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:25.037675 24752 leader_election.cc:290] T 39fa67f2dd5541f68cfaff5e37b65376 P 9f3fb800959647df959d2842e69114e4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 19a6c50a7452432c9b7065686d247915 (127.12.174.129:34253), 0957f3414e96411c846439294d91692a (127.12.174.130:32819)
I20260709 12:14:25.039022 24632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39fa67f2dd5541f68cfaff5e37b65376" candidate_uuid: "9f3fb800959647df959d2842e69114e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0957f3414e96411c846439294d91692a" is_pre_election: true
I20260709 12:14:25.040014 24632 raft_consensus.cc:2393] T 39fa67f2dd5541f68cfaff5e37b65376 P 0957f3414e96411c846439294d91692a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f3fb800959647df959d2842e69114e4 in current term 1: Already voted for candidate 19a6c50a7452432c9b7065686d247915 in this term.
W20260709 12:14:25.041726 24672 leader_election.cc:336] T 39fa67f2dd5541f68cfaff5e37b65376 P 9f3fb800959647df959d2842e69114e4 [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer 19a6c50a7452432c9b7065686d247915 (127.12.174.129:34253): Network error: Client connection negotiation failed: client connection to 127.12.174.129:34253: connect: Connection refused (error 111)
I20260709 12:14:25.042135 24672 leader_election.cc:304] T 39fa67f2dd5541f68cfaff5e37b65376 P 9f3fb800959647df959d2842e69114e4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f3fb800959647df959d2842e69114e4; no voters: 0957f3414e96411c846439294d91692a, 19a6c50a7452432c9b7065686d247915
I20260709 12:14:25.042737 24752 raft_consensus.cc:3060] T 39fa67f2dd5541f68cfaff5e37b65376 P 9f3fb800959647df959d2842e69114e4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:25.049160 24752 raft_consensus.cc:2749] T 39fa67f2dd5541f68cfaff5e37b65376 P 9f3fb800959647df959d2842e69114e4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:25.103479 24823 raft_consensus.cc:493] T 39fa67f2dd5541f68cfaff5e37b65376 P 0957f3414e96411c846439294d91692a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:25.104064 24823 raft_consensus.cc:515] T 39fa67f2dd5541f68cfaff5e37b65376 P 0957f3414e96411c846439294d91692a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:25.105937 24823 leader_election.cc:290] T 39fa67f2dd5541f68cfaff5e37b65376 P 0957f3414e96411c846439294d91692a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 19a6c50a7452432c9b7065686d247915 (127.12.174.129:34253), 9f3fb800959647df959d2842e69114e4 (127.12.174.131:41945)
I20260709 12:14:25.106959 24706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39fa67f2dd5541f68cfaff5e37b65376" candidate_uuid: "0957f3414e96411c846439294d91692a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f3fb800959647df959d2842e69114e4" is_pre_election: true
I20260709 12:14:25.107589 24706 raft_consensus.cc:2468] T 39fa67f2dd5541f68cfaff5e37b65376 P 9f3fb800959647df959d2842e69114e4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0957f3414e96411c846439294d91692a in term 1.
I20260709 12:14:25.108760 24596 leader_election.cc:304] T 39fa67f2dd5541f68cfaff5e37b65376 P 0957f3414e96411c846439294d91692a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0957f3414e96411c846439294d91692a, 9f3fb800959647df959d2842e69114e4; no voters: 
I20260709 12:14:25.109452 24823 raft_consensus.cc:2804] T 39fa67f2dd5541f68cfaff5e37b65376 P 0957f3414e96411c846439294d91692a [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:14:25.109495 24598 leader_election.cc:336] T 39fa67f2dd5541f68cfaff5e37b65376 P 0957f3414e96411c846439294d91692a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 19a6c50a7452432c9b7065686d247915 (127.12.174.129:34253): Network error: Client connection negotiation failed: client connection to 127.12.174.129:34253: connect: Connection refused (error 111)
I20260709 12:14:25.109807 24823 raft_consensus.cc:493] T 39fa67f2dd5541f68cfaff5e37b65376 P 0957f3414e96411c846439294d91692a [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:25.110139 24823 raft_consensus.cc:3060] T 39fa67f2dd5541f68cfaff5e37b65376 P 0957f3414e96411c846439294d91692a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:25.116010 24823 raft_consensus.cc:515] T 39fa67f2dd5541f68cfaff5e37b65376 P 0957f3414e96411c846439294d91692a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:25.117780 24823 leader_election.cc:290] T 39fa67f2dd5541f68cfaff5e37b65376 P 0957f3414e96411c846439294d91692a [CANDIDATE]: Term 2 election: Requested vote from peers 19a6c50a7452432c9b7065686d247915 (127.12.174.129:34253), 9f3fb800959647df959d2842e69114e4 (127.12.174.131:41945)
I20260709 12:14:25.118959 24706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39fa67f2dd5541f68cfaff5e37b65376" candidate_uuid: "0957f3414e96411c846439294d91692a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f3fb800959647df959d2842e69114e4"
I20260709 12:14:25.119611 24706 raft_consensus.cc:3060] T 39fa67f2dd5541f68cfaff5e37b65376 P 9f3fb800959647df959d2842e69114e4 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:14:25.121279 24598 leader_election.cc:336] T 39fa67f2dd5541f68cfaff5e37b65376 P 0957f3414e96411c846439294d91692a [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 19a6c50a7452432c9b7065686d247915 (127.12.174.129:34253): Network error: Client connection negotiation failed: client connection to 127.12.174.129:34253: connect: Connection refused (error 111)
I20260709 12:14:25.125473 24706 raft_consensus.cc:2468] T 39fa67f2dd5541f68cfaff5e37b65376 P 9f3fb800959647df959d2842e69114e4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0957f3414e96411c846439294d91692a in term 2.
I20260709 12:14:25.126508 24596 leader_election.cc:304] T 39fa67f2dd5541f68cfaff5e37b65376 P 0957f3414e96411c846439294d91692a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0957f3414e96411c846439294d91692a, 9f3fb800959647df959d2842e69114e4; no voters: 19a6c50a7452432c9b7065686d247915
I20260709 12:14:25.127166 24823 raft_consensus.cc:2804] T 39fa67f2dd5541f68cfaff5e37b65376 P 0957f3414e96411c846439294d91692a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:25.127569 24823 raft_consensus.cc:697] T 39fa67f2dd5541f68cfaff5e37b65376 P 0957f3414e96411c846439294d91692a [term 2 LEADER]: Becoming Leader. State: Replica: 0957f3414e96411c846439294d91692a, State: Running, Role: LEADER
I20260709 12:14:25.128346 24823 consensus_queue.cc:237] T 39fa67f2dd5541f68cfaff5e37b65376 P 0957f3414e96411c846439294d91692a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:25.136078 24456 catalog_manager.cc:5697] T 39fa67f2dd5541f68cfaff5e37b65376 P 0957f3414e96411c846439294d91692a reported cstate change: term changed from 1 to 2, leader changed from 19a6c50a7452432c9b7065686d247915 (127.12.174.129) to 0957f3414e96411c846439294d91692a (127.12.174.130). New cstate: current_term: 2 leader_uuid: "0957f3414e96411c846439294d91692a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:25.216504 24752 raft_consensus.cc:493] T 1070a1e186974febba3e1d8dc0dbb32e P 9f3fb800959647df959d2842e69114e4 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:25.217051 24752 raft_consensus.cc:515] T 1070a1e186974febba3e1d8dc0dbb32e P 9f3fb800959647df959d2842e69114e4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:25.218797 24752 leader_election.cc:290] T 1070a1e186974febba3e1d8dc0dbb32e P 9f3fb800959647df959d2842e69114e4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 19a6c50a7452432c9b7065686d247915 (127.12.174.129:34253), 0957f3414e96411c846439294d91692a (127.12.174.130:32819)
I20260709 12:14:25.219944 24632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1070a1e186974febba3e1d8dc0dbb32e" candidate_uuid: "9f3fb800959647df959d2842e69114e4" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0957f3414e96411c846439294d91692a" is_pre_election: true
I20260709 12:14:25.220649 24632 raft_consensus.cc:2468] T 1070a1e186974febba3e1d8dc0dbb32e P 0957f3414e96411c846439294d91692a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f3fb800959647df959d2842e69114e4 in term 1.
I20260709 12:14:25.221614 24671 leader_election.cc:304] T 1070a1e186974febba3e1d8dc0dbb32e P 9f3fb800959647df959d2842e69114e4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0957f3414e96411c846439294d91692a, 9f3fb800959647df959d2842e69114e4; no voters: 
I20260709 12:14:25.222318 24752 raft_consensus.cc:2804] T 1070a1e186974febba3e1d8dc0dbb32e P 9f3fb800959647df959d2842e69114e4 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:14:25.222339 24672 leader_election.cc:336] T 1070a1e186974febba3e1d8dc0dbb32e P 9f3fb800959647df959d2842e69114e4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 19a6c50a7452432c9b7065686d247915 (127.12.174.129:34253): Network error: Client connection negotiation failed: client connection to 127.12.174.129:34253: connect: Connection refused (error 111)
I20260709 12:14:25.222685 24752 raft_consensus.cc:493] T 1070a1e186974febba3e1d8dc0dbb32e P 9f3fb800959647df959d2842e69114e4 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:25.222994 24752 raft_consensus.cc:3060] T 1070a1e186974febba3e1d8dc0dbb32e P 9f3fb800959647df959d2842e69114e4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:25.229768 24752 raft_consensus.cc:515] T 1070a1e186974febba3e1d8dc0dbb32e P 9f3fb800959647df959d2842e69114e4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:25.231629 24752 leader_election.cc:290] T 1070a1e186974febba3e1d8dc0dbb32e P 9f3fb800959647df959d2842e69114e4 [CANDIDATE]: Term 2 election: Requested vote from peers 19a6c50a7452432c9b7065686d247915 (127.12.174.129:34253), 0957f3414e96411c846439294d91692a (127.12.174.130:32819)
I20260709 12:14:25.232673 24632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1070a1e186974febba3e1d8dc0dbb32e" candidate_uuid: "9f3fb800959647df959d2842e69114e4" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0957f3414e96411c846439294d91692a"
I20260709 12:14:25.233320 24632 raft_consensus.cc:3060] T 1070a1e186974febba3e1d8dc0dbb32e P 0957f3414e96411c846439294d91692a [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:14:25.234827 24672 leader_election.cc:336] T 1070a1e186974febba3e1d8dc0dbb32e P 9f3fb800959647df959d2842e69114e4 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 19a6c50a7452432c9b7065686d247915 (127.12.174.129:34253): Network error: Client connection negotiation failed: client connection to 127.12.174.129:34253: connect: Connection refused (error 111)
I20260709 12:14:25.238727 24632 raft_consensus.cc:2468] T 1070a1e186974febba3e1d8dc0dbb32e P 0957f3414e96411c846439294d91692a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f3fb800959647df959d2842e69114e4 in term 2.
I20260709 12:14:25.239825 24671 leader_election.cc:304] T 1070a1e186974febba3e1d8dc0dbb32e P 9f3fb800959647df959d2842e69114e4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0957f3414e96411c846439294d91692a, 9f3fb800959647df959d2842e69114e4; no voters: 19a6c50a7452432c9b7065686d247915
I20260709 12:14:25.240540 24752 raft_consensus.cc:2804] T 1070a1e186974febba3e1d8dc0dbb32e P 9f3fb800959647df959d2842e69114e4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:25.240924 24752 raft_consensus.cc:697] T 1070a1e186974febba3e1d8dc0dbb32e P 9f3fb800959647df959d2842e69114e4 [term 2 LEADER]: Becoming Leader. State: Replica: 9f3fb800959647df959d2842e69114e4, State: Running, Role: LEADER
I20260709 12:14:25.241672 24752 consensus_queue.cc:237] T 1070a1e186974febba3e1d8dc0dbb32e P 9f3fb800959647df959d2842e69114e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:25.248577 24456 catalog_manager.cc:5697] T 1070a1e186974febba3e1d8dc0dbb32e P 9f3fb800959647df959d2842e69114e4 reported cstate change: term changed from 1 to 2, leader changed from 19a6c50a7452432c9b7065686d247915 (127.12.174.129) to 9f3fb800959647df959d2842e69114e4 (127.12.174.131). New cstate: current_term: 2 leader_uuid: "9f3fb800959647df959d2842e69114e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:25.329010 24752 raft_consensus.cc:493] T 600a4e0a0ca6400fb4ca416228dc31b7 P 9f3fb800959647df959d2842e69114e4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:25.329668 24752 raft_consensus.cc:515] T 600a4e0a0ca6400fb4ca416228dc31b7 P 9f3fb800959647df959d2842e69114e4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:25.331530 24752 leader_election.cc:290] T 600a4e0a0ca6400fb4ca416228dc31b7 P 9f3fb800959647df959d2842e69114e4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 19a6c50a7452432c9b7065686d247915 (127.12.174.129:34253), 0957f3414e96411c846439294d91692a (127.12.174.130:32819)
I20260709 12:14:25.332813 24632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600a4e0a0ca6400fb4ca416228dc31b7" candidate_uuid: "9f3fb800959647df959d2842e69114e4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0957f3414e96411c846439294d91692a" is_pre_election: true
I20260709 12:14:25.333539 24632 raft_consensus.cc:2468] T 600a4e0a0ca6400fb4ca416228dc31b7 P 0957f3414e96411c846439294d91692a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f3fb800959647df959d2842e69114e4 in term 2.
I20260709 12:14:25.334626 24671 leader_election.cc:304] T 600a4e0a0ca6400fb4ca416228dc31b7 P 9f3fb800959647df959d2842e69114e4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0957f3414e96411c846439294d91692a, 9f3fb800959647df959d2842e69114e4; no voters: 
I20260709 12:14:25.335408 24752 raft_consensus.cc:2804] T 600a4e0a0ca6400fb4ca416228dc31b7 P 9f3fb800959647df959d2842e69114e4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:14:25.335704 24752 raft_consensus.cc:493] T 600a4e0a0ca6400fb4ca416228dc31b7 P 9f3fb800959647df959d2842e69114e4 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:25.336054 24752 raft_consensus.cc:3060] T 600a4e0a0ca6400fb4ca416228dc31b7 P 9f3fb800959647df959d2842e69114e4 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:14:25.336092 24672 leader_election.cc:336] T 600a4e0a0ca6400fb4ca416228dc31b7 P 9f3fb800959647df959d2842e69114e4 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 19a6c50a7452432c9b7065686d247915 (127.12.174.129:34253): Network error: Client connection negotiation failed: client connection to 127.12.174.129:34253: connect: Connection refused (error 111)
I20260709 12:14:25.342058 24752 raft_consensus.cc:515] T 600a4e0a0ca6400fb4ca416228dc31b7 P 9f3fb800959647df959d2842e69114e4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:25.343688 24752 leader_election.cc:290] T 600a4e0a0ca6400fb4ca416228dc31b7 P 9f3fb800959647df959d2842e69114e4 [CANDIDATE]: Term 3 election: Requested vote from peers 19a6c50a7452432c9b7065686d247915 (127.12.174.129:34253), 0957f3414e96411c846439294d91692a (127.12.174.130:32819)
I20260709 12:14:25.344738 24632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600a4e0a0ca6400fb4ca416228dc31b7" candidate_uuid: "9f3fb800959647df959d2842e69114e4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0957f3414e96411c846439294d91692a"
I20260709 12:14:25.345340 24632 raft_consensus.cc:3060] T 600a4e0a0ca6400fb4ca416228dc31b7 P 0957f3414e96411c846439294d91692a [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:14:25.347052 24672 leader_election.cc:336] T 600a4e0a0ca6400fb4ca416228dc31b7 P 9f3fb800959647df959d2842e69114e4 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 19a6c50a7452432c9b7065686d247915 (127.12.174.129:34253): Network error: Client connection negotiation failed: client connection to 127.12.174.129:34253: connect: Connection refused (error 111)
I20260709 12:14:25.350956 24632 raft_consensus.cc:2468] T 600a4e0a0ca6400fb4ca416228dc31b7 P 0957f3414e96411c846439294d91692a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f3fb800959647df959d2842e69114e4 in term 3.
I20260709 12:14:25.351984 24671 leader_election.cc:304] T 600a4e0a0ca6400fb4ca416228dc31b7 P 9f3fb800959647df959d2842e69114e4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0957f3414e96411c846439294d91692a, 9f3fb800959647df959d2842e69114e4; no voters: 19a6c50a7452432c9b7065686d247915
I20260709 12:14:25.352663 24752 raft_consensus.cc:2804] T 600a4e0a0ca6400fb4ca416228dc31b7 P 9f3fb800959647df959d2842e69114e4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:25.353114 24752 raft_consensus.cc:697] T 600a4e0a0ca6400fb4ca416228dc31b7 P 9f3fb800959647df959d2842e69114e4 [term 3 LEADER]: Becoming Leader. State: Replica: 9f3fb800959647df959d2842e69114e4, State: Running, Role: LEADER
I20260709 12:14:25.353935 24752 consensus_queue.cc:237] T 600a4e0a0ca6400fb4ca416228dc31b7 P 9f3fb800959647df959d2842e69114e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:25.360939 24456 catalog_manager.cc:5697] T 600a4e0a0ca6400fb4ca416228dc31b7 P 9f3fb800959647df959d2842e69114e4 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "9f3fb800959647df959d2842e69114e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:25.565258 24752 raft_consensus.cc:493] T 87f7daeaf8314cce8015910ee7085627 P 9f3fb800959647df959d2842e69114e4 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:25.565821 24752 raft_consensus.cc:515] T 87f7daeaf8314cce8015910ee7085627 P 9f3fb800959647df959d2842e69114e4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:25.567631 24752 leader_election.cc:290] T 87f7daeaf8314cce8015910ee7085627 P 9f3fb800959647df959d2842e69114e4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 19a6c50a7452432c9b7065686d247915 (127.12.174.129:34253), 0957f3414e96411c846439294d91692a (127.12.174.130:32819)
I20260709 12:14:25.568753 24632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f7daeaf8314cce8015910ee7085627" candidate_uuid: "9f3fb800959647df959d2842e69114e4" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0957f3414e96411c846439294d91692a" is_pre_election: true
I20260709 12:14:25.569479 24632 raft_consensus.cc:2468] T 87f7daeaf8314cce8015910ee7085627 P 0957f3414e96411c846439294d91692a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f3fb800959647df959d2842e69114e4 in term 1.
I20260709 12:14:25.570478 24671 leader_election.cc:304] T 87f7daeaf8314cce8015910ee7085627 P 9f3fb800959647df959d2842e69114e4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0957f3414e96411c846439294d91692a, 9f3fb800959647df959d2842e69114e4; no voters: 
I20260709 12:14:25.571138 24752 raft_consensus.cc:2804] T 87f7daeaf8314cce8015910ee7085627 P 9f3fb800959647df959d2842e69114e4 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:14:25.571139 24672 leader_election.cc:336] T 87f7daeaf8314cce8015910ee7085627 P 9f3fb800959647df959d2842e69114e4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 19a6c50a7452432c9b7065686d247915 (127.12.174.129:34253): Network error: Client connection negotiation failed: client connection to 127.12.174.129:34253: connect: Connection refused (error 111)
I20260709 12:14:25.571496 24752 raft_consensus.cc:493] T 87f7daeaf8314cce8015910ee7085627 P 9f3fb800959647df959d2842e69114e4 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:25.571810 24752 raft_consensus.cc:3060] T 87f7daeaf8314cce8015910ee7085627 P 9f3fb800959647df959d2842e69114e4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:25.577790 24752 raft_consensus.cc:515] T 87f7daeaf8314cce8015910ee7085627 P 9f3fb800959647df959d2842e69114e4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:25.579430 24752 leader_election.cc:290] T 87f7daeaf8314cce8015910ee7085627 P 9f3fb800959647df959d2842e69114e4 [CANDIDATE]: Term 2 election: Requested vote from peers 19a6c50a7452432c9b7065686d247915 (127.12.174.129:34253), 0957f3414e96411c846439294d91692a (127.12.174.130:32819)
I20260709 12:14:25.580585 24632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f7daeaf8314cce8015910ee7085627" candidate_uuid: "9f3fb800959647df959d2842e69114e4" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0957f3414e96411c846439294d91692a"
I20260709 12:14:25.581248 24632 raft_consensus.cc:3060] T 87f7daeaf8314cce8015910ee7085627 P 0957f3414e96411c846439294d91692a [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:14:25.583173 24672 leader_election.cc:336] T 87f7daeaf8314cce8015910ee7085627 P 9f3fb800959647df959d2842e69114e4 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 19a6c50a7452432c9b7065686d247915 (127.12.174.129:34253): Network error: Client connection negotiation failed: client connection to 127.12.174.129:34253: connect: Connection refused (error 111)
I20260709 12:14:25.588312 24632 raft_consensus.cc:2468] T 87f7daeaf8314cce8015910ee7085627 P 0957f3414e96411c846439294d91692a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f3fb800959647df959d2842e69114e4 in term 2.
I20260709 12:14:25.589370 24671 leader_election.cc:304] T 87f7daeaf8314cce8015910ee7085627 P 9f3fb800959647df959d2842e69114e4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0957f3414e96411c846439294d91692a, 9f3fb800959647df959d2842e69114e4; no voters: 19a6c50a7452432c9b7065686d247915
I20260709 12:14:25.590152 24752 raft_consensus.cc:2804] T 87f7daeaf8314cce8015910ee7085627 P 9f3fb800959647df959d2842e69114e4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:25.590548 24752 raft_consensus.cc:697] T 87f7daeaf8314cce8015910ee7085627 P 9f3fb800959647df959d2842e69114e4 [term 2 LEADER]: Becoming Leader. State: Replica: 9f3fb800959647df959d2842e69114e4, State: Running, Role: LEADER
I20260709 12:14:25.591244 24752 consensus_queue.cc:237] T 87f7daeaf8314cce8015910ee7085627 P 9f3fb800959647df959d2842e69114e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:25.598806 24456 catalog_manager.cc:5697] T 87f7daeaf8314cce8015910ee7085627 P 9f3fb800959647df959d2842e69114e4 reported cstate change: term changed from 1 to 2, leader changed from 19a6c50a7452432c9b7065686d247915 (127.12.174.129) to 9f3fb800959647df959d2842e69114e4 (127.12.174.131). New cstate: current_term: 2 leader_uuid: "9f3fb800959647df959d2842e69114e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:25.670539 24706 raft_consensus.cc:1275] T 39fa67f2dd5541f68cfaff5e37b65376 P 9f3fb800959647df959d2842e69114e4 [term 2 FOLLOWER]: Refusing update from remote peer 0957f3414e96411c846439294d91692a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:14:25.672012 24823 consensus_queue.cc:1048] T 39fa67f2dd5541f68cfaff5e37b65376 P 0957f3414e96411c846439294d91692a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:14:25.684341 24672 consensus_peers.cc:597] T 1070a1e186974febba3e1d8dc0dbb32e P 9f3fb800959647df959d2842e69114e4 -> Peer 19a6c50a7452432c9b7065686d247915 (127.12.174.129:34253): Couldn't send request to peer 19a6c50a7452432c9b7065686d247915. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:34253: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:25.688476 24632 raft_consensus.cc:1275] T 1070a1e186974febba3e1d8dc0dbb32e P 0957f3414e96411c846439294d91692a [term 2 FOLLOWER]: Refusing update from remote peer 9f3fb800959647df959d2842e69114e4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:14:25.692878 24752 consensus_queue.cc:1048] T 1070a1e186974febba3e1d8dc0dbb32e P 9f3fb800959647df959d2842e69114e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:14:25.695518 24598 consensus_peers.cc:597] T 39fa67f2dd5541f68cfaff5e37b65376 P 0957f3414e96411c846439294d91692a -> Peer 19a6c50a7452432c9b7065686d247915 (127.12.174.129:34253): Couldn't send request to peer 19a6c50a7452432c9b7065686d247915. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:34253: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:25.824221 24672 consensus_peers.cc:597] T 600a4e0a0ca6400fb4ca416228dc31b7 P 9f3fb800959647df959d2842e69114e4 -> Peer 19a6c50a7452432c9b7065686d247915 (127.12.174.129:34253): Couldn't send request to peer 19a6c50a7452432c9b7065686d247915. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:34253: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:14:25.911654 24504 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:14:25.940452 24632 raft_consensus.cc:1275] T 600a4e0a0ca6400fb4ca416228dc31b7 P 0957f3414e96411c846439294d91692a [term 3 FOLLOWER]: Refusing update from remote peer 9f3fb800959647df959d2842e69114e4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:14:25.941884 24752 consensus_queue.cc:1048] T 600a4e0a0ca6400fb4ca416228dc31b7 P 9f3fb800959647df959d2842e69114e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:14:26.058652 24672 consensus_peers.cc:597] T 87f7daeaf8314cce8015910ee7085627 P 9f3fb800959647df959d2842e69114e4 -> Peer 19a6c50a7452432c9b7065686d247915 (127.12.174.129:34253): Couldn't send request to peer 19a6c50a7452432c9b7065686d247915. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:34253: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:26.135262 24632 raft_consensus.cc:1275] T 87f7daeaf8314cce8015910ee7085627 P 0957f3414e96411c846439294d91692a [term 2 FOLLOWER]: Refusing update from remote peer 9f3fb800959647df959d2842e69114e4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:14:26.136595 24832 consensus_queue.cc:1048] T 87f7daeaf8314cce8015910ee7085627 P 9f3fb800959647df959d2842e69114e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:14:26.321651 24598 consensus_peers.cc:597] T ea42bf8b2c8446bb8cf72377bdc2db72 P 0957f3414e96411c846439294d91692a -> Peer 19a6c50a7452432c9b7065686d247915 (127.12.174.129:34253): Couldn't send request to peer 19a6c50a7452432c9b7065686d247915. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:34253: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:26.407532 24598 consensus_peers.cc:597] T aba98af27ae743c7996a5ebd5c0d2780 P 0957f3414e96411c846439294d91692a -> Peer 19a6c50a7452432c9b7065686d247915 (127.12.174.129:34253): Couldn't send request to peer 19a6c50a7452432c9b7065686d247915. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:34253: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:26.617568 24672 consensus_peers.cc:597] T 47f98adb81f3471f92fb1acba914760c P 9f3fb800959647df959d2842e69114e4 -> Peer 19a6c50a7452432c9b7065686d247915 (127.12.174.129:34253): Couldn't send request to peer 19a6c50a7452432c9b7065686d247915. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:34253: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:26.652287 24598 consensus_peers.cc:597] T fc07ceaa7eb544aeacd41a465a8bf0f8 P 0957f3414e96411c846439294d91692a -> Peer 19a6c50a7452432c9b7065686d247915 (127.12.174.129:34253): Couldn't send request to peer 19a6c50a7452432c9b7065686d247915. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:34253: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:26.692150 24672 consensus_peers.cc:597] T 7193d4ca686648169964ddb1468a3799 P 9f3fb800959647df959d2842e69114e4 -> Peer 19a6c50a7452432c9b7065686d247915 (127.12.174.129:34253): Couldn't send request to peer 19a6c50a7452432c9b7065686d247915. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:34253: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:26.732771 24598 consensus_peers.cc:597] T 424a5cb2ff61499abadd789493f7875f P 0957f3414e96411c846439294d91692a -> Peer 19a6c50a7452432c9b7065686d247915 (127.12.174.129:34253): Couldn't send request to peer 19a6c50a7452432c9b7065686d247915. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:34253: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:26.912982 24504 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:14:27.914206 24504 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:14:27.925146 24598 consensus_peers.cc:597] T 39fa67f2dd5541f68cfaff5e37b65376 P 0957f3414e96411c846439294d91692a -> Peer 19a6c50a7452432c9b7065686d247915 (127.12.174.129:34253): Couldn't send request to peer 19a6c50a7452432c9b7065686d247915. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:34253: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:28.150987 24672 consensus_peers.cc:597] T 600a4e0a0ca6400fb4ca416228dc31b7 P 9f3fb800959647df959d2842e69114e4 -> Peer 19a6c50a7452432c9b7065686d247915 (127.12.174.129:34253): Couldn't send request to peer 19a6c50a7452432c9b7065686d247915. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:34253: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:28.162873 24672 consensus_peers.cc:597] T 1070a1e186974febba3e1d8dc0dbb32e P 9f3fb800959647df959d2842e69114e4 -> Peer 19a6c50a7452432c9b7065686d247915 (127.12.174.129:34253): Couldn't send request to peer 19a6c50a7452432c9b7065686d247915. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:34253: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:28.647821 24672 consensus_peers.cc:597] T 87f7daeaf8314cce8015910ee7085627 P 9f3fb800959647df959d2842e69114e4 -> Peer 19a6c50a7452432c9b7065686d247915 (127.12.174.129:34253): Couldn't send request to peer 19a6c50a7452432c9b7065686d247915. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:34253: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:14:28.776701 24598 consensus_peers.cc:597] T aba98af27ae743c7996a5ebd5c0d2780 P 0957f3414e96411c846439294d91692a -> Peer 19a6c50a7452432c9b7065686d247915 (127.12.174.129:34253): Couldn't send request to peer 19a6c50a7452432c9b7065686d247915. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:34253: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:14:28.908344 12986 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:14:28.915413 24846 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:28.915479 24504 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:14:28.915512 24847 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:28.919078 24849 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:14:28.919936 12986 server_base.cc:1061] running on GCE node
I20260709 12:14:28.921173 12986 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:14:28.921409 12986 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:14:28.921589 12986 hybrid_clock.cc:648] HybridClock initialized: now 1783599268921567 us; error 0 us; skew 500 ppm
I20260709 12:14:28.922171 12986 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
W20260709 12:14:28.922807 24598 consensus_peers.cc:597] T ea42bf8b2c8446bb8cf72377bdc2db72 P 0957f3414e96411c846439294d91692a -> Peer 19a6c50a7452432c9b7065686d247915 (127.12.174.129:34253): Couldn't send request to peer 19a6c50a7452432c9b7065686d247915. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:34253: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:14:28.924762 12986 webserver.cc:533] Webserver started at http://127.12.174.129:41811/ using document root <none> and password file <none>
I20260709 12:14:28.925366 12986 fs_manager.cc:362] Metadata directory not provided
I20260709 12:14:28.925556 12986 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 12:14:28.929661 12986 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.001s	sys 0.002s
I20260709 12:14:28.933773 24854 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:28.934723 12986 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:14:28.935046 12986 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598886212958-12986-0/minicluster-data/ts-0-root
uuid: "19a6c50a7452432c9b7065686d247915"
format_stamp: "Formatted at 2026-07-09 12:14:21 on dist-test-slave-9q7n"
I20260709 12:14:28.935341 12986 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598886212958-12986-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598886212958-12986-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598886212958-12986-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:14:28.945066 12986 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:14:28.946266 12986 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:14:28.947824 12986 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:14:28.951749 24861 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
W20260709 12:14:28.978766 24598 consensus_peers.cc:597] T 424a5cb2ff61499abadd789493f7875f P 0957f3414e96411c846439294d91692a -> Peer 19a6c50a7452432c9b7065686d247915 (127.12.174.129:34253): Couldn't send request to peer 19a6c50a7452432c9b7065686d247915. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:34253: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:14:29.018342 12986 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 12:14:29.018786 12986 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.068s	user 0.001s	sys 0.002s
I20260709 12:14:29.019124 12986 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
I20260709 12:14:29.025360 24861 tablet_bootstrap.cc:492] T fc07ceaa7eb544aeacd41a465a8bf0f8 P 19a6c50a7452432c9b7065686d247915: Bootstrap starting.
I20260709 12:14:29.038062 24861 tablet_bootstrap.cc:492] T fc07ceaa7eb544aeacd41a465a8bf0f8 P 19a6c50a7452432c9b7065686d247915: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:29.038940 24861 tablet_bootstrap.cc:492] T fc07ceaa7eb544aeacd41a465a8bf0f8 P 19a6c50a7452432c9b7065686d247915: Bootstrap complete.
I20260709 12:14:29.039765 24861 ts_tablet_manager.cc:1403] T fc07ceaa7eb544aeacd41a465a8bf0f8 P 19a6c50a7452432c9b7065686d247915: Time spent bootstrapping tablet: real 0.015s	user 0.012s	sys 0.000s
I20260709 12:14:29.042642 24861 raft_consensus.cc:359] T fc07ceaa7eb544aeacd41a465a8bf0f8 P 19a6c50a7452432c9b7065686d247915 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:29.043467 24861 raft_consensus.cc:740] T fc07ceaa7eb544aeacd41a465a8bf0f8 P 19a6c50a7452432c9b7065686d247915 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19a6c50a7452432c9b7065686d247915, State: Initialized, Role: FOLLOWER
W20260709 12:14:29.043486 24672 consensus_peers.cc:597] T 47f98adb81f3471f92fb1acba914760c P 9f3fb800959647df959d2842e69114e4 -> Peer 19a6c50a7452432c9b7065686d247915 (127.12.174.129:34253): Couldn't send request to peer 19a6c50a7452432c9b7065686d247915. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:34253: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:14:29.044440 24861 consensus_queue.cc:260] T fc07ceaa7eb544aeacd41a465a8bf0f8 P 19a6c50a7452432c9b7065686d247915 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:29.047194 24861 ts_tablet_manager.cc:1434] T fc07ceaa7eb544aeacd41a465a8bf0f8 P 19a6c50a7452432c9b7065686d247915: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.002s
I20260709 12:14:29.047967 24861 tablet_bootstrap.cc:492] T 87f7daeaf8314cce8015910ee7085627 P 19a6c50a7452432c9b7065686d247915: Bootstrap starting.
I20260709 12:14:29.060928 24861 tablet_bootstrap.cc:492] T 87f7daeaf8314cce8015910ee7085627 P 19a6c50a7452432c9b7065686d247915: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 12:14:29.061841 24861 tablet_bootstrap.cc:492] T 87f7daeaf8314cce8015910ee7085627 P 19a6c50a7452432c9b7065686d247915: Bootstrap complete.
I20260709 12:14:29.062451 24861 ts_tablet_manager.cc:1403] T 87f7daeaf8314cce8015910ee7085627 P 19a6c50a7452432c9b7065686d247915: Time spent bootstrapping tablet: real 0.015s	user 0.013s	sys 0.000s
I20260709 12:14:29.064814 24861 raft_consensus.cc:359] T 87f7daeaf8314cce8015910ee7085627 P 19a6c50a7452432c9b7065686d247915 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:29.065665 24861 raft_consensus.cc:740] T 87f7daeaf8314cce8015910ee7085627 P 19a6c50a7452432c9b7065686d247915 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19a6c50a7452432c9b7065686d247915, State: Initialized, Role: FOLLOWER
I20260709 12:14:29.066543 24861 consensus_queue.cc:260] T 87f7daeaf8314cce8015910ee7085627 P 19a6c50a7452432c9b7065686d247915 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:29.068397 24861 ts_tablet_manager.cc:1434] T 87f7daeaf8314cce8015910ee7085627 P 19a6c50a7452432c9b7065686d247915: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:14:29.069180 24861 tablet_bootstrap.cc:492] T 424a5cb2ff61499abadd789493f7875f P 19a6c50a7452432c9b7065686d247915: Bootstrap starting.
I20260709 12:14:29.072963 12986 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 12:14:29.073326 12986 ts_tablet_manager.cc:595] Time spent register tablets: real 0.054s	user 0.051s	sys 0.000s
I20260709 12:14:29.082300 24861 tablet_bootstrap.cc:492] T 424a5cb2ff61499abadd789493f7875f P 19a6c50a7452432c9b7065686d247915: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:29.083398 24861 tablet_bootstrap.cc:492] T 424a5cb2ff61499abadd789493f7875f P 19a6c50a7452432c9b7065686d247915: Bootstrap complete.
I20260709 12:14:29.084147 24861 ts_tablet_manager.cc:1403] T 424a5cb2ff61499abadd789493f7875f P 19a6c50a7452432c9b7065686d247915: Time spent bootstrapping tablet: real 0.015s	user 0.012s	sys 0.000s
I20260709 12:14:29.086777 24861 raft_consensus.cc:359] T 424a5cb2ff61499abadd789493f7875f P 19a6c50a7452432c9b7065686d247915 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } } peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } }
I20260709 12:14:29.087448 24861 raft_consensus.cc:740] T 424a5cb2ff61499abadd789493f7875f P 19a6c50a7452432c9b7065686d247915 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19a6c50a7452432c9b7065686d247915, State: Initialized, Role: FOLLOWER
I20260709 12:14:29.088284 24861 consensus_queue.cc:260] T 424a5cb2ff61499abadd789493f7875f P 19a6c50a7452432c9b7065686d247915 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } } peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } }
I20260709 12:14:29.090708 24861 ts_tablet_manager.cc:1434] T 424a5cb2ff61499abadd789493f7875f P 19a6c50a7452432c9b7065686d247915: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:14:29.091801 24861 tablet_bootstrap.cc:492] T 7193d4ca686648169964ddb1468a3799 P 19a6c50a7452432c9b7065686d247915: Bootstrap starting.
I20260709 12:14:29.127904 24861 tablet_bootstrap.cc:492] T 7193d4ca686648169964ddb1468a3799 P 19a6c50a7452432c9b7065686d247915: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:29.128784 24861 tablet_bootstrap.cc:492] T 7193d4ca686648169964ddb1468a3799 P 19a6c50a7452432c9b7065686d247915: Bootstrap complete.
I20260709 12:14:29.129413 24861 ts_tablet_manager.cc:1403] T 7193d4ca686648169964ddb1468a3799 P 19a6c50a7452432c9b7065686d247915: Time spent bootstrapping tablet: real 0.038s	user 0.018s	sys 0.009s
I20260709 12:14:29.131445 24861 raft_consensus.cc:359] T 7193d4ca686648169964ddb1468a3799 P 19a6c50a7452432c9b7065686d247915 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:29.132009 24861 raft_consensus.cc:385] T 7193d4ca686648169964ddb1468a3799 P 19a6c50a7452432c9b7065686d247915 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:29.132241 24861 raft_consensus.cc:740] T 7193d4ca686648169964ddb1468a3799 P 19a6c50a7452432c9b7065686d247915 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19a6c50a7452432c9b7065686d247915, State: Initialized, Role: FOLLOWER
I20260709 12:14:29.132790 24861 consensus_queue.cc:260] T 7193d4ca686648169964ddb1468a3799 P 19a6c50a7452432c9b7065686d247915 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:29.134549 24861 ts_tablet_manager.cc:1434] T 7193d4ca686648169964ddb1468a3799 P 19a6c50a7452432c9b7065686d247915: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:14:29.135244 24861 tablet_bootstrap.cc:492] T 600a4e0a0ca6400fb4ca416228dc31b7 P 19a6c50a7452432c9b7065686d247915: Bootstrap starting.
I20260709 12:14:29.148470 24861 tablet_bootstrap.cc:492] T 600a4e0a0ca6400fb4ca416228dc31b7 P 19a6c50a7452432c9b7065686d247915: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:29.149362 24861 tablet_bootstrap.cc:492] T 600a4e0a0ca6400fb4ca416228dc31b7 P 19a6c50a7452432c9b7065686d247915: Bootstrap complete.
I20260709 12:14:29.150000 24861 ts_tablet_manager.cc:1403] T 600a4e0a0ca6400fb4ca416228dc31b7 P 19a6c50a7452432c9b7065686d247915: Time spent bootstrapping tablet: real 0.015s	user 0.010s	sys 0.004s
I20260709 12:14:29.151885 24861 raft_consensus.cc:359] T 600a4e0a0ca6400fb4ca416228dc31b7 P 19a6c50a7452432c9b7065686d247915 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:29.152419 24861 raft_consensus.cc:740] T 600a4e0a0ca6400fb4ca416228dc31b7 P 19a6c50a7452432c9b7065686d247915 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19a6c50a7452432c9b7065686d247915, State: Initialized, Role: FOLLOWER
I20260709 12:14:29.153151 24861 consensus_queue.cc:260] T 600a4e0a0ca6400fb4ca416228dc31b7 P 19a6c50a7452432c9b7065686d247915 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:29.154626 24861 ts_tablet_manager.cc:1434] T 600a4e0a0ca6400fb4ca416228dc31b7 P 19a6c50a7452432c9b7065686d247915: Time spent starting tablet: real 0.004s	user 0.000s	sys 0.004s
I20260709 12:14:29.155381 24861 tablet_bootstrap.cc:492] T ea42bf8b2c8446bb8cf72377bdc2db72 P 19a6c50a7452432c9b7065686d247915: Bootstrap starting.
I20260709 12:14:29.169987 24861 tablet_bootstrap.cc:492] T ea42bf8b2c8446bb8cf72377bdc2db72 P 19a6c50a7452432c9b7065686d247915: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:29.170759 24861 tablet_bootstrap.cc:492] T ea42bf8b2c8446bb8cf72377bdc2db72 P 19a6c50a7452432c9b7065686d247915: Bootstrap complete.
I20260709 12:14:29.171382 24861 ts_tablet_manager.cc:1403] T ea42bf8b2c8446bb8cf72377bdc2db72 P 19a6c50a7452432c9b7065686d247915: Time spent bootstrapping tablet: real 0.016s	user 0.012s	sys 0.002s
I20260709 12:14:29.173301 12986 rpc_server.cc:307] RPC server started. Bound to: 127.12.174.129:34253
I20260709 12:14:29.173442 24924 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.174.129:34253 every 8 connection(s)
I20260709 12:14:29.173509 24861 raft_consensus.cc:359] T ea42bf8b2c8446bb8cf72377bdc2db72 P 19a6c50a7452432c9b7065686d247915 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:29.174376 24863 raft_consensus.cc:493] T 7193d4ca686648169964ddb1468a3799 P 19a6c50a7452432c9b7065686d247915 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:29.174515 24861 raft_consensus.cc:740] T ea42bf8b2c8446bb8cf72377bdc2db72 P 19a6c50a7452432c9b7065686d247915 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19a6c50a7452432c9b7065686d247915, State: Initialized, Role: FOLLOWER
I20260709 12:14:29.175022 24863 raft_consensus.cc:515] T 7193d4ca686648169964ddb1468a3799 P 19a6c50a7452432c9b7065686d247915 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:29.175385 24861 consensus_queue.cc:260] T ea42bf8b2c8446bb8cf72377bdc2db72 P 19a6c50a7452432c9b7065686d247915 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:29.178279 24861 ts_tablet_manager.cc:1434] T ea42bf8b2c8446bb8cf72377bdc2db72 P 19a6c50a7452432c9b7065686d247915: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 12:14:29.179261 24861 tablet_bootstrap.cc:492] T 1070a1e186974febba3e1d8dc0dbb32e P 19a6c50a7452432c9b7065686d247915: Bootstrap starting.
I20260709 12:14:29.192689 24863 leader_election.cc:290] T 7193d4ca686648169964ddb1468a3799 P 19a6c50a7452432c9b7065686d247915 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0957f3414e96411c846439294d91692a (127.12.174.130:32819), 9f3fb800959647df959d2842e69114e4 (127.12.174.131:41945)
I20260709 12:14:29.204653 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:29.215912 24861 tablet_bootstrap.cc:492] T 1070a1e186974febba3e1d8dc0dbb32e P 19a6c50a7452432c9b7065686d247915: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 12:14:29.217801 24861 tablet_bootstrap.cc:492] T 1070a1e186974febba3e1d8dc0dbb32e P 19a6c50a7452432c9b7065686d247915: Bootstrap complete.
I20260709 12:14:29.218302 24633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7193d4ca686648169964ddb1468a3799" candidate_uuid: "19a6c50a7452432c9b7065686d247915" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0957f3414e96411c846439294d91692a" is_pre_election: true
I20260709 12:14:29.218693 24861 ts_tablet_manager.cc:1403] T 1070a1e186974febba3e1d8dc0dbb32e P 19a6c50a7452432c9b7065686d247915: Time spent bootstrapping tablet: real 0.040s	user 0.012s	sys 0.010s
I20260709 12:14:29.223217 24707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7193d4ca686648169964ddb1468a3799" candidate_uuid: "19a6c50a7452432c9b7065686d247915" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f3fb800959647df959d2842e69114e4" is_pre_election: true
I20260709 12:14:29.222783 24861 raft_consensus.cc:359] T 1070a1e186974febba3e1d8dc0dbb32e P 19a6c50a7452432c9b7065686d247915 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:29.224330 24861 raft_consensus.cc:740] T 1070a1e186974febba3e1d8dc0dbb32e P 19a6c50a7452432c9b7065686d247915 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19a6c50a7452432c9b7065686d247915, State: Initialized, Role: FOLLOWER
I20260709 12:14:29.225157 24861 consensus_queue.cc:260] T 1070a1e186974febba3e1d8dc0dbb32e P 19a6c50a7452432c9b7065686d247915 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:29.225466 24855 leader_election.cc:304] T 7193d4ca686648169964ddb1468a3799 P 19a6c50a7452432c9b7065686d247915 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19a6c50a7452432c9b7065686d247915; no voters: 0957f3414e96411c846439294d91692a, 9f3fb800959647df959d2842e69114e4
I20260709 12:14:29.226819 24863 raft_consensus.cc:2749] T 7193d4ca686648169964ddb1468a3799 P 19a6c50a7452432c9b7065686d247915 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:29.227619 24926 heartbeater.cc:344] Connected to a master server at 127.12.174.190:42177
I20260709 12:14:29.227896 24861 ts_tablet_manager.cc:1434] T 1070a1e186974febba3e1d8dc0dbb32e P 19a6c50a7452432c9b7065686d247915: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:14:29.228379 24926 heartbeater.cc:461] Registering TS with master...
I20260709 12:14:29.228874 24861 tablet_bootstrap.cc:492] T 47f98adb81f3471f92fb1acba914760c P 19a6c50a7452432c9b7065686d247915: Bootstrap starting.
I20260709 12:14:29.229434 24926 heartbeater.cc:507] Master 127.12.174.190:42177 requested a full tablet report, sending...
I20260709 12:14:29.238734 24456 ts_manager.cc:194] Re-registered known tserver with Master: 19a6c50a7452432c9b7065686d247915 (127.12.174.129:34253)
I20260709 12:14:29.249451 24861 tablet_bootstrap.cc:492] T 47f98adb81f3471f92fb1acba914760c P 19a6c50a7452432c9b7065686d247915: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:29.250913 24861 tablet_bootstrap.cc:492] T 47f98adb81f3471f92fb1acba914760c P 19a6c50a7452432c9b7065686d247915: Bootstrap complete.
I20260709 12:14:29.251708 24456 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56110
I20260709 12:14:29.252115 24861 ts_tablet_manager.cc:1403] T 47f98adb81f3471f92fb1acba914760c P 19a6c50a7452432c9b7065686d247915: Time spent bootstrapping tablet: real 0.023s	user 0.015s	sys 0.004s
I20260709 12:14:29.254065 24707 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "600a4e0a0ca6400fb4ca416228dc31b7"
dest_uuid: "9f3fb800959647df959d2842e69114e4"
mode: GRACEFUL
new_leader_uuid: "0957f3414e96411c846439294d91692a"
 from {username='slave'} at 127.0.0.1:35324
I20260709 12:14:29.254935 24707 raft_consensus.cc:606] T 600a4e0a0ca6400fb4ca416228dc31b7 P 9f3fb800959647df959d2842e69114e4 [term 3 LEADER]: Received request to transfer leadership to TS 0957f3414e96411c846439294d91692a
I20260709 12:14:29.255535 24861 raft_consensus.cc:359] T 47f98adb81f3471f92fb1acba914760c P 19a6c50a7452432c9b7065686d247915 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:29.256098 24926 heartbeater.cc:499] Master 127.12.174.190:42177 was elected leader, sending a full tablet report...
I20260709 12:14:29.256417 24861 raft_consensus.cc:740] T 47f98adb81f3471f92fb1acba914760c P 19a6c50a7452432c9b7065686d247915 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19a6c50a7452432c9b7065686d247915, State: Initialized, Role: FOLLOWER
I20260709 12:14:29.257195 24861 consensus_queue.cc:260] T 47f98adb81f3471f92fb1acba914760c P 19a6c50a7452432c9b7065686d247915 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:29.259975 24861 ts_tablet_manager.cc:1434] T 47f98adb81f3471f92fb1acba914760c P 19a6c50a7452432c9b7065686d247915: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:14:29.261041 24861 tablet_bootstrap.cc:492] T 39fa67f2dd5541f68cfaff5e37b65376 P 19a6c50a7452432c9b7065686d247915: Bootstrap starting.
I20260709 12:14:29.271222 24633 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aba98af27ae743c7996a5ebd5c0d2780"
dest_uuid: "0957f3414e96411c846439294d91692a"
mode: GRACEFUL
new_leader_uuid: "9f3fb800959647df959d2842e69114e4"
 from {username='slave'} at 127.0.0.1:45866
I20260709 12:14:29.271791 24633 raft_consensus.cc:606] T aba98af27ae743c7996a5ebd5c0d2780 P 0957f3414e96411c846439294d91692a [term 1 LEADER]: Received request to transfer leadership to TS 9f3fb800959647df959d2842e69114e4
I20260709 12:14:29.273065 12986 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:14:29.273705 12986 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:29.274569 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:29.276778 24861 tablet_bootstrap.cc:492] T 39fa67f2dd5541f68cfaff5e37b65376 P 19a6c50a7452432c9b7065686d247915: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 12:14:29.277984 24861 tablet_bootstrap.cc:492] T 39fa67f2dd5541f68cfaff5e37b65376 P 19a6c50a7452432c9b7065686d247915: Bootstrap complete.
I20260709 12:14:29.278728 24861 ts_tablet_manager.cc:1403] T 39fa67f2dd5541f68cfaff5e37b65376 P 19a6c50a7452432c9b7065686d247915: Time spent bootstrapping tablet: real 0.018s	user 0.017s	sys 0.000s
I20260709 12:14:29.281599 24861 raft_consensus.cc:359] T 39fa67f2dd5541f68cfaff5e37b65376 P 19a6c50a7452432c9b7065686d247915 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:29.282661 24861 raft_consensus.cc:740] T 39fa67f2dd5541f68cfaff5e37b65376 P 19a6c50a7452432c9b7065686d247915 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19a6c50a7452432c9b7065686d247915, State: Initialized, Role: FOLLOWER
I20260709 12:14:29.283687 24861 consensus_queue.cc:260] T 39fa67f2dd5541f68cfaff5e37b65376 P 19a6c50a7452432c9b7065686d247915 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:29.286237 24861 ts_tablet_manager.cc:1434] T 39fa67f2dd5541f68cfaff5e37b65376 P 19a6c50a7452432c9b7065686d247915: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:14:29.287238 24861 tablet_bootstrap.cc:492] T aba98af27ae743c7996a5ebd5c0d2780 P 19a6c50a7452432c9b7065686d247915: Bootstrap starting.
I20260709 12:14:29.292471 24898 raft_consensus.cc:3060] T 1070a1e186974febba3e1d8dc0dbb32e P 19a6c50a7452432c9b7065686d247915 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:29.292853 24897 raft_consensus.cc:3060] T 7193d4ca686648169964ddb1468a3799 P 19a6c50a7452432c9b7065686d247915 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:29.304148 24898 pending_rounds.cc:85] T 1070a1e186974febba3e1d8dc0dbb32e P 19a6c50a7452432c9b7065686d247915: Aborting all ops after (but not including) 0
I20260709 12:14:29.304797 24898 pending_rounds.cc:107] T 1070a1e186974febba3e1d8dc0dbb32e P 19a6c50a7452432c9b7065686d247915: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 12:14:29.305214 24898 raft_consensus.cc:2889] T 1070a1e186974febba3e1d8dc0dbb32e P 19a6c50a7452432c9b7065686d247915 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:29.319717 24837 raft_consensus.cc:993] T aba98af27ae743c7996a5ebd5c0d2780 P 0957f3414e96411c846439294d91692a: : Instructing follower 9f3fb800959647df959d2842e69114e4 to start an election
I20260709 12:14:29.320326 24945 raft_consensus.cc:1081] T aba98af27ae743c7996a5ebd5c0d2780 P 0957f3414e96411c846439294d91692a [term 1 LEADER]: Signalling peer 9f3fb800959647df959d2842e69114e4 to start an election
I20260709 12:14:29.322340 24707 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aba98af27ae743c7996a5ebd5c0d2780"
dest_uuid: "9f3fb800959647df959d2842e69114e4"
 from {username='slave'} at 127.0.0.1:35296
I20260709 12:14:29.322973 24707 raft_consensus.cc:493] T aba98af27ae743c7996a5ebd5c0d2780 P 9f3fb800959647df959d2842e69114e4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:29.323323 24707 raft_consensus.cc:3060] T aba98af27ae743c7996a5ebd5c0d2780 P 9f3fb800959647df959d2842e69114e4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:29.332882 24707 raft_consensus.cc:515] T aba98af27ae743c7996a5ebd5c0d2780 P 9f3fb800959647df959d2842e69114e4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:29.337132 24896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba98af27ae743c7996a5ebd5c0d2780" candidate_uuid: "9f3fb800959647df959d2842e69114e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "19a6c50a7452432c9b7065686d247915"
I20260709 12:14:29.339010 24707 leader_election.cc:290] T aba98af27ae743c7996a5ebd5c0d2780 P 9f3fb800959647df959d2842e69114e4 [CANDIDATE]: Term 2 election: Requested vote from peers 19a6c50a7452432c9b7065686d247915 (127.12.174.129:34253), 0957f3414e96411c846439294d91692a (127.12.174.130:32819)
I20260709 12:14:29.340004 24633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba98af27ae743c7996a5ebd5c0d2780" candidate_uuid: "9f3fb800959647df959d2842e69114e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0957f3414e96411c846439294d91692a"
I20260709 12:14:29.339661 24861 tablet_bootstrap.cc:492] T aba98af27ae743c7996a5ebd5c0d2780 P 19a6c50a7452432c9b7065686d247915: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:14:29.340770 24633 raft_consensus.cc:3055] T aba98af27ae743c7996a5ebd5c0d2780 P 0957f3414e96411c846439294d91692a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:29.341264 24633 raft_consensus.cc:740] T aba98af27ae743c7996a5ebd5c0d2780 P 0957f3414e96411c846439294d91692a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0957f3414e96411c846439294d91692a, State: Running, Role: LEADER
I20260709 12:14:29.341573 24861 tablet_bootstrap.cc:492] T aba98af27ae743c7996a5ebd5c0d2780 P 19a6c50a7452432c9b7065686d247915: Bootstrap complete.
I20260709 12:14:29.342621 24861 ts_tablet_manager.cc:1403] T aba98af27ae743c7996a5ebd5c0d2780 P 19a6c50a7452432c9b7065686d247915: Time spent bootstrapping tablet: real 0.056s	user 0.028s	sys 0.020s
I20260709 12:14:29.342319 24633 consensus_queue.cc:260] T aba98af27ae743c7996a5ebd5c0d2780 P 0957f3414e96411c846439294d91692a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:29.343950 24633 raft_consensus.cc:3060] T aba98af27ae743c7996a5ebd5c0d2780 P 0957f3414e96411c846439294d91692a [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:14:29.343920 24672 leader_election.cc:343] T aba98af27ae743c7996a5ebd5c0d2780 P 9f3fb800959647df959d2842e69114e4 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 19a6c50a7452432c9b7065686d247915 (127.12.174.129:34253): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:29.345522 24861 raft_consensus.cc:359] T aba98af27ae743c7996a5ebd5c0d2780 P 19a6c50a7452432c9b7065686d247915 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:29.346155 24861 raft_consensus.cc:740] T aba98af27ae743c7996a5ebd5c0d2780 P 19a6c50a7452432c9b7065686d247915 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19a6c50a7452432c9b7065686d247915, State: Initialized, Role: FOLLOWER
I20260709 12:14:29.346876 24861 consensus_queue.cc:260] T aba98af27ae743c7996a5ebd5c0d2780 P 19a6c50a7452432c9b7065686d247915 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:29.348605 24861 ts_tablet_manager.cc:1434] T aba98af27ae743c7996a5ebd5c0d2780 P 19a6c50a7452432c9b7065686d247915: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 12:14:29.353679 24633 raft_consensus.cc:2468] T aba98af27ae743c7996a5ebd5c0d2780 P 0957f3414e96411c846439294d91692a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f3fb800959647df959d2842e69114e4 in term 2.
I20260709 12:14:29.355252 24671 leader_election.cc:304] T aba98af27ae743c7996a5ebd5c0d2780 P 9f3fb800959647df959d2842e69114e4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0957f3414e96411c846439294d91692a, 9f3fb800959647df959d2842e69114e4; no voters: 19a6c50a7452432c9b7065686d247915
I20260709 12:14:29.356174 24752 raft_consensus.cc:2804] T aba98af27ae743c7996a5ebd5c0d2780 P 9f3fb800959647df959d2842e69114e4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:29.357496 24752 raft_consensus.cc:697] T aba98af27ae743c7996a5ebd5c0d2780 P 9f3fb800959647df959d2842e69114e4 [term 2 LEADER]: Becoming Leader. State: Replica: 9f3fb800959647df959d2842e69114e4, State: Running, Role: LEADER
I20260709 12:14:29.358294 24752 consensus_queue.cc:237] T aba98af27ae743c7996a5ebd5c0d2780 P 9f3fb800959647df959d2842e69114e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:29.365710 24456 catalog_manager.cc:5697] T aba98af27ae743c7996a5ebd5c0d2780 P 9f3fb800959647df959d2842e69114e4 reported cstate change: term changed from 1 to 2, leader changed from 0957f3414e96411c846439294d91692a (127.12.174.130) to 9f3fb800959647df959d2842e69114e4 (127.12.174.131). New cstate: current_term: 2 leader_uuid: "9f3fb800959647df959d2842e69114e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:29.427119 24896 raft_consensus.cc:3060] T 39fa67f2dd5541f68cfaff5e37b65376 P 19a6c50a7452432c9b7065686d247915 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:29.434127 24896 pending_rounds.cc:85] T 39fa67f2dd5541f68cfaff5e37b65376 P 19a6c50a7452432c9b7065686d247915: Aborting all ops after (but not including) 0
I20260709 12:14:29.434386 24896 pending_rounds.cc:107] T 39fa67f2dd5541f68cfaff5e37b65376 P 19a6c50a7452432c9b7065686d247915: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 12:14:29.434616 24896 raft_consensus.cc:2889] T 39fa67f2dd5541f68cfaff5e37b65376 P 19a6c50a7452432c9b7065686d247915 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:29.622803 24896 raft_consensus.cc:3060] T 600a4e0a0ca6400fb4ca416228dc31b7 P 19a6c50a7452432c9b7065686d247915 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:14:29.652303 24947 raft_consensus.cc:993] T 600a4e0a0ca6400fb4ca416228dc31b7 P 9f3fb800959647df959d2842e69114e4: : Instructing follower 0957f3414e96411c846439294d91692a to start an election
I20260709 12:14:29.653131 24752 raft_consensus.cc:1081] T 600a4e0a0ca6400fb4ca416228dc31b7 P 9f3fb800959647df959d2842e69114e4 [term 3 LEADER]: Signalling peer 0957f3414e96411c846439294d91692a to start an election
I20260709 12:14:29.654980 24633 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "600a4e0a0ca6400fb4ca416228dc31b7"
dest_uuid: "0957f3414e96411c846439294d91692a"
 from {username='slave'} at 127.0.0.1:45844
I20260709 12:14:29.655625 24633 raft_consensus.cc:493] T 600a4e0a0ca6400fb4ca416228dc31b7 P 0957f3414e96411c846439294d91692a [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:29.655997 24633 raft_consensus.cc:3060] T 600a4e0a0ca6400fb4ca416228dc31b7 P 0957f3414e96411c846439294d91692a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:29.665086 24633 raft_consensus.cc:515] T 600a4e0a0ca6400fb4ca416228dc31b7 P 0957f3414e96411c846439294d91692a [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:29.667511 24633 leader_election.cc:290] T 600a4e0a0ca6400fb4ca416228dc31b7 P 0957f3414e96411c846439294d91692a [CANDIDATE]: Term 4 election: Requested vote from peers 19a6c50a7452432c9b7065686d247915 (127.12.174.129:34253), 9f3fb800959647df959d2842e69114e4 (127.12.174.131:41945)
I20260709 12:14:29.669094 24896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600a4e0a0ca6400fb4ca416228dc31b7" candidate_uuid: "0957f3414e96411c846439294d91692a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "19a6c50a7452432c9b7065686d247915"
I20260709 12:14:29.669131 24707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600a4e0a0ca6400fb4ca416228dc31b7" candidate_uuid: "0957f3414e96411c846439294d91692a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "9f3fb800959647df959d2842e69114e4"
I20260709 12:14:29.669894 24896 raft_consensus.cc:3060] T 600a4e0a0ca6400fb4ca416228dc31b7 P 19a6c50a7452432c9b7065686d247915 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:29.669981 24707 raft_consensus.cc:3055] T 600a4e0a0ca6400fb4ca416228dc31b7 P 9f3fb800959647df959d2842e69114e4 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:29.670605 24707 raft_consensus.cc:740] T 600a4e0a0ca6400fb4ca416228dc31b7 P 9f3fb800959647df959d2842e69114e4 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9f3fb800959647df959d2842e69114e4, State: Running, Role: LEADER
I20260709 12:14:29.672397 24707 consensus_queue.cc:260] T 600a4e0a0ca6400fb4ca416228dc31b7 P 9f3fb800959647df959d2842e69114e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:29.674569 24707 raft_consensus.cc:3060] T 600a4e0a0ca6400fb4ca416228dc31b7 P 9f3fb800959647df959d2842e69114e4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:29.680733 24896 raft_consensus.cc:2468] T 600a4e0a0ca6400fb4ca416228dc31b7 P 19a6c50a7452432c9b7065686d247915 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0957f3414e96411c846439294d91692a in term 4.
I20260709 12:14:29.682783 24598 leader_election.cc:304] T 600a4e0a0ca6400fb4ca416228dc31b7 P 0957f3414e96411c846439294d91692a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0957f3414e96411c846439294d91692a, 19a6c50a7452432c9b7065686d247915; no voters: 
I20260709 12:14:29.684126 24945 raft_consensus.cc:2804] T 600a4e0a0ca6400fb4ca416228dc31b7 P 0957f3414e96411c846439294d91692a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:14:29.684685 24945 raft_consensus.cc:697] T 600a4e0a0ca6400fb4ca416228dc31b7 P 0957f3414e96411c846439294d91692a [term 4 LEADER]: Becoming Leader. State: Replica: 0957f3414e96411c846439294d91692a, State: Running, Role: LEADER
I20260709 12:14:29.686184 24896 raft_consensus.cc:3060] T 87f7daeaf8314cce8015910ee7085627 P 19a6c50a7452432c9b7065686d247915 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:29.686161 24945 consensus_queue.cc:237] T 600a4e0a0ca6400fb4ca416228dc31b7 P 0957f3414e96411c846439294d91692a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:29.697413 24896 pending_rounds.cc:85] T 87f7daeaf8314cce8015910ee7085627 P 19a6c50a7452432c9b7065686d247915: Aborting all ops after (but not including) 0
I20260709 12:14:29.698005 24896 pending_rounds.cc:107] T 87f7daeaf8314cce8015910ee7085627 P 19a6c50a7452432c9b7065686d247915: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 12:14:29.698737 24896 raft_consensus.cc:2889] T 87f7daeaf8314cce8015910ee7085627 P 19a6c50a7452432c9b7065686d247915 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:14:29.697999 24707 raft_consensus.cc:2468] T 600a4e0a0ca6400fb4ca416228dc31b7 P 9f3fb800959647df959d2842e69114e4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0957f3414e96411c846439294d91692a in term 4.
I20260709 12:14:29.706739 24456 catalog_manager.cc:5697] T 600a4e0a0ca6400fb4ca416228dc31b7 P 0957f3414e96411c846439294d91692a reported cstate change: term changed from 3 to 4, leader changed from 9f3fb800959647df959d2842e69114e4 (127.12.174.131) to 0957f3414e96411c846439294d91692a (127.12.174.130). New cstate: current_term: 4 leader_uuid: "0957f3414e96411c846439294d91692a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:29.772388 24633 raft_consensus.cc:1275] T aba98af27ae743c7996a5ebd5c0d2780 P 0957f3414e96411c846439294d91692a [term 2 FOLLOWER]: Refusing update from remote peer 9f3fb800959647df959d2842e69114e4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:29.773801 24947 consensus_queue.cc:1048] T aba98af27ae743c7996a5ebd5c0d2780 P 9f3fb800959647df959d2842e69114e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:14:29.786968 24896 raft_consensus.cc:3060] T aba98af27ae743c7996a5ebd5c0d2780 P 19a6c50a7452432c9b7065686d247915 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:29.795979 24896 raft_consensus.cc:1275] T aba98af27ae743c7996a5ebd5c0d2780 P 19a6c50a7452432c9b7065686d247915 [term 2 FOLLOWER]: Refusing update from remote peer 9f3fb800959647df959d2842e69114e4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:29.797255 24947 consensus_queue.cc:1048] T aba98af27ae743c7996a5ebd5c0d2780 P 9f3fb800959647df959d2842e69114e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:14:29.916844 24504 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:14:30.224815 24707 raft_consensus.cc:1275] T 600a4e0a0ca6400fb4ca416228dc31b7 P 9f3fb800959647df959d2842e69114e4 [term 4 FOLLOWER]: Refusing update from remote peer 0957f3414e96411c846439294d91692a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:14:30.226516 24960 consensus_queue.cc:1048] T 600a4e0a0ca6400fb4ca416228dc31b7 P 0957f3414e96411c846439294d91692a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:30.229035 24896 raft_consensus.cc:1275] T 600a4e0a0ca6400fb4ca416228dc31b7 P 19a6c50a7452432c9b7065686d247915 [term 4 FOLLOWER]: Refusing update from remote peer 0957f3414e96411c846439294d91692a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:14:30.230527 24837 consensus_queue.cc:1048] T 600a4e0a0ca6400fb4ca416228dc31b7 P 0957f3414e96411c846439294d91692a [LEADER]: Connected to new peer: Peer: permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:30.287264 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:30.297247 24707 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1070a1e186974febba3e1d8dc0dbb32e"
dest_uuid: "9f3fb800959647df959d2842e69114e4"
mode: GRACEFUL
new_leader_uuid: "0957f3414e96411c846439294d91692a"
 from {username='slave'} at 127.0.0.1:35324
I20260709 12:14:30.297830 24707 raft_consensus.cc:606] T 1070a1e186974febba3e1d8dc0dbb32e P 9f3fb800959647df959d2842e69114e4 [term 2 LEADER]: Received request to transfer leadership to TS 0957f3414e96411c846439294d91692a
I20260709 12:14:30.300431 24633 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "600a4e0a0ca6400fb4ca416228dc31b7"
dest_uuid: "0957f3414e96411c846439294d91692a"
mode: GRACEFUL
new_leader_uuid: "9f3fb800959647df959d2842e69114e4"
 from {username='slave'} at 127.0.0.1:45866
I20260709 12:14:30.300967 24633 raft_consensus.cc:606] T 600a4e0a0ca6400fb4ca416228dc31b7 P 0957f3414e96411c846439294d91692a [term 4 LEADER]: Received request to transfer leadership to TS 9f3fb800959647df959d2842e69114e4
I20260709 12:14:30.302217 12986 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:14:30.302728 12986 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:30.303498 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:30.712954 24960 raft_consensus.cc:993] T 600a4e0a0ca6400fb4ca416228dc31b7 P 0957f3414e96411c846439294d91692a: : Instructing follower 9f3fb800959647df959d2842e69114e4 to start an election
I20260709 12:14:30.713439 24945 raft_consensus.cc:1081] T 600a4e0a0ca6400fb4ca416228dc31b7 P 0957f3414e96411c846439294d91692a [term 4 LEADER]: Signalling peer 9f3fb800959647df959d2842e69114e4 to start an election
I20260709 12:14:30.714954 24707 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "600a4e0a0ca6400fb4ca416228dc31b7"
dest_uuid: "9f3fb800959647df959d2842e69114e4"
 from {username='slave'} at 127.0.0.1:35296
I20260709 12:14:30.715415 24707 raft_consensus.cc:493] T 600a4e0a0ca6400fb4ca416228dc31b7 P 9f3fb800959647df959d2842e69114e4 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:30.715679 24707 raft_consensus.cc:3060] T 600a4e0a0ca6400fb4ca416228dc31b7 P 9f3fb800959647df959d2842e69114e4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:30.723788 24707 raft_consensus.cc:515] T 600a4e0a0ca6400fb4ca416228dc31b7 P 9f3fb800959647df959d2842e69114e4 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:30.725935 24707 leader_election.cc:290] T 600a4e0a0ca6400fb4ca416228dc31b7 P 9f3fb800959647df959d2842e69114e4 [CANDIDATE]: Term 5 election: Requested vote from peers 19a6c50a7452432c9b7065686d247915 (127.12.174.129:34253), 0957f3414e96411c846439294d91692a (127.12.174.130:32819)
I20260709 12:14:30.726636 24896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600a4e0a0ca6400fb4ca416228dc31b7" candidate_uuid: "9f3fb800959647df959d2842e69114e4" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "19a6c50a7452432c9b7065686d247915"
I20260709 12:14:30.727329 24632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600a4e0a0ca6400fb4ca416228dc31b7" candidate_uuid: "9f3fb800959647df959d2842e69114e4" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "0957f3414e96411c846439294d91692a"
I20260709 12:14:30.727475 24896 raft_consensus.cc:3060] T 600a4e0a0ca6400fb4ca416228dc31b7 P 19a6c50a7452432c9b7065686d247915 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:30.728061 24632 raft_consensus.cc:3055] T 600a4e0a0ca6400fb4ca416228dc31b7 P 0957f3414e96411c846439294d91692a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:30.728401 24632 raft_consensus.cc:740] T 600a4e0a0ca6400fb4ca416228dc31b7 P 0957f3414e96411c846439294d91692a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0957f3414e96411c846439294d91692a, State: Running, Role: LEADER
I20260709 12:14:30.729343 24632 consensus_queue.cc:260] T 600a4e0a0ca6400fb4ca416228dc31b7 P 0957f3414e96411c846439294d91692a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:30.730832 24632 raft_consensus.cc:3060] T 600a4e0a0ca6400fb4ca416228dc31b7 P 0957f3414e96411c846439294d91692a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:30.736883 24896 raft_consensus.cc:2468] T 600a4e0a0ca6400fb4ca416228dc31b7 P 19a6c50a7452432c9b7065686d247915 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f3fb800959647df959d2842e69114e4 in term 5.
I20260709 12:14:30.738493 24672 leader_election.cc:304] T 600a4e0a0ca6400fb4ca416228dc31b7 P 9f3fb800959647df959d2842e69114e4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19a6c50a7452432c9b7065686d247915, 9f3fb800959647df959d2842e69114e4; no voters: 
I20260709 12:14:30.739362 24962 raft_consensus.cc:2804] T 600a4e0a0ca6400fb4ca416228dc31b7 P 9f3fb800959647df959d2842e69114e4 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:30.739845 24962 raft_consensus.cc:697] T 600a4e0a0ca6400fb4ca416228dc31b7 P 9f3fb800959647df959d2842e69114e4 [term 5 LEADER]: Becoming Leader. State: Replica: 9f3fb800959647df959d2842e69114e4, State: Running, Role: LEADER
I20260709 12:14:30.740675 24962 consensus_queue.cc:237] T 600a4e0a0ca6400fb4ca416228dc31b7 P 9f3fb800959647df959d2842e69114e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:30.741848 24632 raft_consensus.cc:2468] T 600a4e0a0ca6400fb4ca416228dc31b7 P 0957f3414e96411c846439294d91692a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f3fb800959647df959d2842e69114e4 in term 5.
I20260709 12:14:30.748238 24454 catalog_manager.cc:5697] T 600a4e0a0ca6400fb4ca416228dc31b7 P 9f3fb800959647df959d2842e69114e4 reported cstate change: term changed from 4 to 5, leader changed from 0957f3414e96411c846439294d91692a (127.12.174.130) to 9f3fb800959647df959d2842e69114e4 (127.12.174.131). New cstate: current_term: 5 leader_uuid: "9f3fb800959647df959d2842e69114e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:30.840399 24947 raft_consensus.cc:993] T 1070a1e186974febba3e1d8dc0dbb32e P 9f3fb800959647df959d2842e69114e4: : Instructing follower 0957f3414e96411c846439294d91692a to start an election
I20260709 12:14:30.840874 24962 raft_consensus.cc:1081] T 1070a1e186974febba3e1d8dc0dbb32e P 9f3fb800959647df959d2842e69114e4 [term 2 LEADER]: Signalling peer 0957f3414e96411c846439294d91692a to start an election
I20260709 12:14:30.842507 24632 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1070a1e186974febba3e1d8dc0dbb32e"
dest_uuid: "0957f3414e96411c846439294d91692a"
 from {username='slave'} at 127.0.0.1:45844
I20260709 12:14:30.843039 24632 raft_consensus.cc:493] T 1070a1e186974febba3e1d8dc0dbb32e P 0957f3414e96411c846439294d91692a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:30.843343 24632 raft_consensus.cc:3060] T 1070a1e186974febba3e1d8dc0dbb32e P 0957f3414e96411c846439294d91692a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:30.850154 24632 raft_consensus.cc:515] T 1070a1e186974febba3e1d8dc0dbb32e P 0957f3414e96411c846439294d91692a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:30.852068 24632 leader_election.cc:290] T 1070a1e186974febba3e1d8dc0dbb32e P 0957f3414e96411c846439294d91692a [CANDIDATE]: Term 3 election: Requested vote from peers 19a6c50a7452432c9b7065686d247915 (127.12.174.129:34253), 9f3fb800959647df959d2842e69114e4 (127.12.174.131:41945)
I20260709 12:14:30.853107 24896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1070a1e186974febba3e1d8dc0dbb32e" candidate_uuid: "0957f3414e96411c846439294d91692a" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "19a6c50a7452432c9b7065686d247915"
I20260709 12:14:30.853293 24707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1070a1e186974febba3e1d8dc0dbb32e" candidate_uuid: "0957f3414e96411c846439294d91692a" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "9f3fb800959647df959d2842e69114e4"
I20260709 12:14:30.853823 24896 raft_consensus.cc:3060] T 1070a1e186974febba3e1d8dc0dbb32e P 19a6c50a7452432c9b7065686d247915 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:30.853961 24707 raft_consensus.cc:3055] T 1070a1e186974febba3e1d8dc0dbb32e P 9f3fb800959647df959d2842e69114e4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:30.854368 24707 raft_consensus.cc:740] T 1070a1e186974febba3e1d8dc0dbb32e P 9f3fb800959647df959d2842e69114e4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9f3fb800959647df959d2842e69114e4, State: Running, Role: LEADER
I20260709 12:14:30.855193 24707 consensus_queue.cc:260] T 1070a1e186974febba3e1d8dc0dbb32e P 9f3fb800959647df959d2842e69114e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:30.856304 24707 raft_consensus.cc:3060] T 1070a1e186974febba3e1d8dc0dbb32e P 9f3fb800959647df959d2842e69114e4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:30.860958 24896 raft_consensus.cc:2468] T 1070a1e186974febba3e1d8dc0dbb32e P 19a6c50a7452432c9b7065686d247915 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0957f3414e96411c846439294d91692a in term 3.
I20260709 12:14:30.862473 24598 leader_election.cc:304] T 1070a1e186974febba3e1d8dc0dbb32e P 0957f3414e96411c846439294d91692a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0957f3414e96411c846439294d91692a, 19a6c50a7452432c9b7065686d247915; no voters: 
I20260709 12:14:30.863219 24945 raft_consensus.cc:2804] T 1070a1e186974febba3e1d8dc0dbb32e P 0957f3414e96411c846439294d91692a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:30.863641 24945 raft_consensus.cc:697] T 1070a1e186974febba3e1d8dc0dbb32e P 0957f3414e96411c846439294d91692a [term 3 LEADER]: Becoming Leader. State: Replica: 0957f3414e96411c846439294d91692a, State: Running, Role: LEADER
I20260709 12:14:30.863963 24707 raft_consensus.cc:2468] T 1070a1e186974febba3e1d8dc0dbb32e P 9f3fb800959647df959d2842e69114e4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0957f3414e96411c846439294d91692a in term 3.
I20260709 12:14:30.864655 24945 consensus_queue.cc:237] T 1070a1e186974febba3e1d8dc0dbb32e P 0957f3414e96411c846439294d91692a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:30.873481 24454 catalog_manager.cc:5697] T 1070a1e186974febba3e1d8dc0dbb32e P 0957f3414e96411c846439294d91692a reported cstate change: term changed from 2 to 3, leader changed from 9f3fb800959647df959d2842e69114e4 (127.12.174.131) to 0957f3414e96411c846439294d91692a (127.12.174.130). New cstate: current_term: 3 leader_uuid: "0957f3414e96411c846439294d91692a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } health_report { overall_health: UNKNOWN } } }
W20260709 12:14:30.917863 24504 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:14:31.220870 24897 raft_consensus.cc:1275] T 600a4e0a0ca6400fb4ca416228dc31b7 P 19a6c50a7452432c9b7065686d247915 [term 5 FOLLOWER]: Refusing update from remote peer 9f3fb800959647df959d2842e69114e4: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:14:31.222540 24962 consensus_queue.cc:1048] T 600a4e0a0ca6400fb4ca416228dc31b7 P 9f3fb800959647df959d2842e69114e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:14:31.232964 24632 raft_consensus.cc:1275] T 600a4e0a0ca6400fb4ca416228dc31b7 P 0957f3414e96411c846439294d91692a [term 5 FOLLOWER]: Refusing update from remote peer 9f3fb800959647df959d2842e69114e4: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:14:31.234938 24975 consensus_queue.cc:1048] T 600a4e0a0ca6400fb4ca416228dc31b7 P 9f3fb800959647df959d2842e69114e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:14:31.310467 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:31.318338 24707 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7193d4ca686648169964ddb1468a3799"
dest_uuid: "9f3fb800959647df959d2842e69114e4"
mode: GRACEFUL
new_leader_uuid: "0957f3414e96411c846439294d91692a"
 from {username='slave'} at 127.0.0.1:35324
I20260709 12:14:31.319165 24707 raft_consensus.cc:606] T 7193d4ca686648169964ddb1468a3799 P 9f3fb800959647df959d2842e69114e4 [term 1 LEADER]: Received request to transfer leadership to TS 0957f3414e96411c846439294d91692a
I20260709 12:14:31.321069 24897 raft_consensus.cc:1275] T 1070a1e186974febba3e1d8dc0dbb32e P 19a6c50a7452432c9b7065686d247915 [term 3 FOLLOWER]: Refusing update from remote peer 0957f3414e96411c846439294d91692a: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:14:31.322132 24632 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fc07ceaa7eb544aeacd41a465a8bf0f8"
dest_uuid: "0957f3414e96411c846439294d91692a"
mode: GRACEFUL
new_leader_uuid: "9f3fb800959647df959d2842e69114e4"
 from {username='slave'} at 127.0.0.1:45866
I20260709 12:14:31.322811 24632 raft_consensus.cc:606] T fc07ceaa7eb544aeacd41a465a8bf0f8 P 0957f3414e96411c846439294d91692a [term 1 LEADER]: Received request to transfer leadership to TS 9f3fb800959647df959d2842e69114e4
I20260709 12:14:31.322589 24945 consensus_queue.cc:1048] T 1070a1e186974febba3e1d8dc0dbb32e P 0957f3414e96411c846439294d91692a [LEADER]: Connected to new peer: Peer: permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:14:31.324635 12986 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:14:31.325277 12986 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:31.326095 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:31.336261 24707 raft_consensus.cc:1275] T 1070a1e186974febba3e1d8dc0dbb32e P 9f3fb800959647df959d2842e69114e4 [term 3 FOLLOWER]: Refusing update from remote peer 0957f3414e96411c846439294d91692a: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:14:31.338768 24945 consensus_queue.cc:1048] T 1070a1e186974febba3e1d8dc0dbb32e P 0957f3414e96411c846439294d91692a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:14:31.392786 24980 raft_consensus.cc:993] T fc07ceaa7eb544aeacd41a465a8bf0f8 P 0957f3414e96411c846439294d91692a: : Instructing follower 9f3fb800959647df959d2842e69114e4 to start an election
I20260709 12:14:31.393301 24960 raft_consensus.cc:1081] T fc07ceaa7eb544aeacd41a465a8bf0f8 P 0957f3414e96411c846439294d91692a [term 1 LEADER]: Signalling peer 9f3fb800959647df959d2842e69114e4 to start an election
I20260709 12:14:31.395017 24707 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fc07ceaa7eb544aeacd41a465a8bf0f8"
dest_uuid: "9f3fb800959647df959d2842e69114e4"
 from {username='slave'} at 127.0.0.1:35296
I20260709 12:14:31.395536 24707 raft_consensus.cc:493] T fc07ceaa7eb544aeacd41a465a8bf0f8 P 9f3fb800959647df959d2842e69114e4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:31.395812 24707 raft_consensus.cc:3060] T fc07ceaa7eb544aeacd41a465a8bf0f8 P 9f3fb800959647df959d2842e69114e4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:31.402944 24707 raft_consensus.cc:515] T fc07ceaa7eb544aeacd41a465a8bf0f8 P 9f3fb800959647df959d2842e69114e4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:31.405164 24707 leader_election.cc:290] T fc07ceaa7eb544aeacd41a465a8bf0f8 P 9f3fb800959647df959d2842e69114e4 [CANDIDATE]: Term 2 election: Requested vote from peers 19a6c50a7452432c9b7065686d247915 (127.12.174.129:34253), 0957f3414e96411c846439294d91692a (127.12.174.130:32819)
I20260709 12:14:31.405932 24897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07ceaa7eb544aeacd41a465a8bf0f8" candidate_uuid: "9f3fb800959647df959d2842e69114e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "19a6c50a7452432c9b7065686d247915"
I20260709 12:14:31.406409 24632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc07ceaa7eb544aeacd41a465a8bf0f8" candidate_uuid: "9f3fb800959647df959d2842e69114e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0957f3414e96411c846439294d91692a"
I20260709 12:14:31.406848 24897 raft_consensus.cc:3060] T fc07ceaa7eb544aeacd41a465a8bf0f8 P 19a6c50a7452432c9b7065686d247915 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:31.407196 24632 raft_consensus.cc:3055] T fc07ceaa7eb544aeacd41a465a8bf0f8 P 0957f3414e96411c846439294d91692a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:31.407584 24632 raft_consensus.cc:740] T fc07ceaa7eb544aeacd41a465a8bf0f8 P 0957f3414e96411c846439294d91692a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0957f3414e96411c846439294d91692a, State: Running, Role: LEADER
I20260709 12:14:31.408627 24632 consensus_queue.cc:260] T fc07ceaa7eb544aeacd41a465a8bf0f8 P 0957f3414e96411c846439294d91692a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:31.410367 24632 raft_consensus.cc:3060] T fc07ceaa7eb544aeacd41a465a8bf0f8 P 0957f3414e96411c846439294d91692a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:31.417647 24897 raft_consensus.cc:2468] T fc07ceaa7eb544aeacd41a465a8bf0f8 P 19a6c50a7452432c9b7065686d247915 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f3fb800959647df959d2842e69114e4 in term 2.
I20260709 12:14:31.419343 24672 leader_election.cc:304] T fc07ceaa7eb544aeacd41a465a8bf0f8 P 9f3fb800959647df959d2842e69114e4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19a6c50a7452432c9b7065686d247915, 9f3fb800959647df959d2842e69114e4; no voters: 
I20260709 12:14:31.419675 24632 raft_consensus.cc:2468] T fc07ceaa7eb544aeacd41a465a8bf0f8 P 0957f3414e96411c846439294d91692a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f3fb800959647df959d2842e69114e4 in term 2.
I20260709 12:14:31.420120 24975 raft_consensus.cc:2804] T fc07ceaa7eb544aeacd41a465a8bf0f8 P 9f3fb800959647df959d2842e69114e4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:31.420612 24975 raft_consensus.cc:697] T fc07ceaa7eb544aeacd41a465a8bf0f8 P 9f3fb800959647df959d2842e69114e4 [term 2 LEADER]: Becoming Leader. State: Replica: 9f3fb800959647df959d2842e69114e4, State: Running, Role: LEADER
I20260709 12:14:31.421567 24975 consensus_queue.cc:237] T fc07ceaa7eb544aeacd41a465a8bf0f8 P 9f3fb800959647df959d2842e69114e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:31.430148 24456 catalog_manager.cc:5697] T fc07ceaa7eb544aeacd41a465a8bf0f8 P 9f3fb800959647df959d2842e69114e4 reported cstate change: term changed from 1 to 2, leader changed from 0957f3414e96411c846439294d91692a (127.12.174.130) to 9f3fb800959647df959d2842e69114e4 (127.12.174.131). New cstate: current_term: 2 leader_uuid: "9f3fb800959647df959d2842e69114e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:31.432108 24962 raft_consensus.cc:993] T 7193d4ca686648169964ddb1468a3799 P 9f3fb800959647df959d2842e69114e4: : Instructing follower 0957f3414e96411c846439294d91692a to start an election
I20260709 12:14:31.432693 24975 raft_consensus.cc:1081] T 7193d4ca686648169964ddb1468a3799 P 9f3fb800959647df959d2842e69114e4 [term 1 LEADER]: Signalling peer 0957f3414e96411c846439294d91692a to start an election
I20260709 12:14:31.434770 24632 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7193d4ca686648169964ddb1468a3799"
dest_uuid: "0957f3414e96411c846439294d91692a"
 from {username='slave'} at 127.0.0.1:45844
I20260709 12:14:31.435505 24632 raft_consensus.cc:493] T 7193d4ca686648169964ddb1468a3799 P 0957f3414e96411c846439294d91692a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:31.435846 24632 raft_consensus.cc:3060] T 7193d4ca686648169964ddb1468a3799 P 0957f3414e96411c846439294d91692a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:31.445046 24632 raft_consensus.cc:515] T 7193d4ca686648169964ddb1468a3799 P 0957f3414e96411c846439294d91692a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:31.447443 24632 leader_election.cc:290] T 7193d4ca686648169964ddb1468a3799 P 0957f3414e96411c846439294d91692a [CANDIDATE]: Term 2 election: Requested vote from peers 19a6c50a7452432c9b7065686d247915 (127.12.174.129:34253), 9f3fb800959647df959d2842e69114e4 (127.12.174.131:41945)
I20260709 12:14:31.448100 24897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7193d4ca686648169964ddb1468a3799" candidate_uuid: "0957f3414e96411c846439294d91692a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "19a6c50a7452432c9b7065686d247915"
I20260709 12:14:31.448192 24706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7193d4ca686648169964ddb1468a3799" candidate_uuid: "0957f3414e96411c846439294d91692a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9f3fb800959647df959d2842e69114e4"
I20260709 12:14:31.449040 24897 raft_consensus.cc:3060] T 7193d4ca686648169964ddb1468a3799 P 19a6c50a7452432c9b7065686d247915 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:31.449137 24706 raft_consensus.cc:3055] T 7193d4ca686648169964ddb1468a3799 P 9f3fb800959647df959d2842e69114e4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:31.449638 24706 raft_consensus.cc:740] T 7193d4ca686648169964ddb1468a3799 P 9f3fb800959647df959d2842e69114e4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9f3fb800959647df959d2842e69114e4, State: Running, Role: LEADER
I20260709 12:14:31.450636 24706 consensus_queue.cc:260] T 7193d4ca686648169964ddb1468a3799 P 9f3fb800959647df959d2842e69114e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:31.452491 24706 raft_consensus.cc:3060] T 7193d4ca686648169964ddb1468a3799 P 9f3fb800959647df959d2842e69114e4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:31.456480 24897 raft_consensus.cc:2468] T 7193d4ca686648169964ddb1468a3799 P 19a6c50a7452432c9b7065686d247915 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0957f3414e96411c846439294d91692a in term 2.
I20260709 12:14:31.458039 24598 leader_election.cc:304] T 7193d4ca686648169964ddb1468a3799 P 0957f3414e96411c846439294d91692a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0957f3414e96411c846439294d91692a, 19a6c50a7452432c9b7065686d247915; no voters: 
I20260709 12:14:31.459053 24960 raft_consensus.cc:2804] T 7193d4ca686648169964ddb1468a3799 P 0957f3414e96411c846439294d91692a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:31.459604 24960 raft_consensus.cc:697] T 7193d4ca686648169964ddb1468a3799 P 0957f3414e96411c846439294d91692a [term 2 LEADER]: Becoming Leader. State: Replica: 0957f3414e96411c846439294d91692a, State: Running, Role: LEADER
I20260709 12:14:31.459846 24706 raft_consensus.cc:2468] T 7193d4ca686648169964ddb1468a3799 P 9f3fb800959647df959d2842e69114e4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0957f3414e96411c846439294d91692a in term 2.
I20260709 12:14:31.460634 24960 consensus_queue.cc:237] T 7193d4ca686648169964ddb1468a3799 P 0957f3414e96411c846439294d91692a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:31.469278 24456 catalog_manager.cc:5697] T 7193d4ca686648169964ddb1468a3799 P 0957f3414e96411c846439294d91692a reported cstate change: term changed from 1 to 2, leader changed from 9f3fb800959647df959d2842e69114e4 (127.12.174.131) to 0957f3414e96411c846439294d91692a (127.12.174.130). New cstate: current_term: 2 leader_uuid: "0957f3414e96411c846439294d91692a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:31.806421 24897 raft_consensus.cc:1275] T fc07ceaa7eb544aeacd41a465a8bf0f8 P 19a6c50a7452432c9b7065686d247915 [term 2 FOLLOWER]: Refusing update from remote peer 9f3fb800959647df959d2842e69114e4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:31.807780 24975 consensus_queue.cc:1048] T fc07ceaa7eb544aeacd41a465a8bf0f8 P 9f3fb800959647df959d2842e69114e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:31.821558 24632 raft_consensus.cc:1275] T fc07ceaa7eb544aeacd41a465a8bf0f8 P 0957f3414e96411c846439294d91692a [term 2 FOLLOWER]: Refusing update from remote peer 9f3fb800959647df959d2842e69114e4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:31.824296 24975 consensus_queue.cc:1048] T fc07ceaa7eb544aeacd41a465a8bf0f8 P 9f3fb800959647df959d2842e69114e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:31.914412 24706 raft_consensus.cc:1275] T 7193d4ca686648169964ddb1468a3799 P 9f3fb800959647df959d2842e69114e4 [term 2 FOLLOWER]: Refusing update from remote peer 0957f3414e96411c846439294d91692a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:31.916078 24960 consensus_queue.cc:1048] T 7193d4ca686648169964ddb1468a3799 P 0957f3414e96411c846439294d91692a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:14:31.918915 24504 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:14:31.926776 24897 raft_consensus.cc:1275] T 7193d4ca686648169964ddb1468a3799 P 19a6c50a7452432c9b7065686d247915 [term 2 FOLLOWER]: Refusing update from remote peer 0957f3414e96411c846439294d91692a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:31.931401 24992 consensus_queue.cc:1048] T 7193d4ca686648169964ddb1468a3799 P 0957f3414e96411c846439294d91692a [LEADER]: Connected to new peer: Peer: permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:32.336429 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:32.345285 24632 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1070a1e186974febba3e1d8dc0dbb32e"
dest_uuid: "0957f3414e96411c846439294d91692a"
mode: GRACEFUL
new_leader_uuid: "9f3fb800959647df959d2842e69114e4"
 from {username='slave'} at 127.0.0.1:45866
I20260709 12:14:32.346083 24632 raft_consensus.cc:606] T 1070a1e186974febba3e1d8dc0dbb32e P 0957f3414e96411c846439294d91692a [term 3 LEADER]: Received request to transfer leadership to TS 9f3fb800959647df959d2842e69114e4
I20260709 12:14:32.349519 24706 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "600a4e0a0ca6400fb4ca416228dc31b7"
dest_uuid: "9f3fb800959647df959d2842e69114e4"
mode: GRACEFUL
new_leader_uuid: "0957f3414e96411c846439294d91692a"
 from {username='slave'} at 127.0.0.1:35324
I20260709 12:14:32.350108 24706 raft_consensus.cc:606] T 600a4e0a0ca6400fb4ca416228dc31b7 P 9f3fb800959647df959d2842e69114e4 [term 5 LEADER]: Received request to transfer leadership to TS 0957f3414e96411c846439294d91692a
I20260709 12:14:32.351428 12986 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:14:32.352038 12986 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:32.352660 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:32.734879 24994 raft_consensus.cc:993] T 600a4e0a0ca6400fb4ca416228dc31b7 P 9f3fb800959647df959d2842e69114e4: : Instructing follower 0957f3414e96411c846439294d91692a to start an election
I20260709 12:14:32.735381 24995 raft_consensus.cc:1081] T 600a4e0a0ca6400fb4ca416228dc31b7 P 9f3fb800959647df959d2842e69114e4 [term 5 LEADER]: Signalling peer 0957f3414e96411c846439294d91692a to start an election
I20260709 12:14:32.737020 24632 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "600a4e0a0ca6400fb4ca416228dc31b7"
dest_uuid: "0957f3414e96411c846439294d91692a"
 from {username='slave'} at 127.0.0.1:45844
I20260709 12:14:32.737530 24632 raft_consensus.cc:493] T 600a4e0a0ca6400fb4ca416228dc31b7 P 0957f3414e96411c846439294d91692a [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:32.737833 24632 raft_consensus.cc:3060] T 600a4e0a0ca6400fb4ca416228dc31b7 P 0957f3414e96411c846439294d91692a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:32.744309 24632 raft_consensus.cc:515] T 600a4e0a0ca6400fb4ca416228dc31b7 P 0957f3414e96411c846439294d91692a [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:32.746012 24632 leader_election.cc:290] T 600a4e0a0ca6400fb4ca416228dc31b7 P 0957f3414e96411c846439294d91692a [CANDIDATE]: Term 6 election: Requested vote from peers 19a6c50a7452432c9b7065686d247915 (127.12.174.129:34253), 9f3fb800959647df959d2842e69114e4 (127.12.174.131:41945)
I20260709 12:14:32.747274 24706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600a4e0a0ca6400fb4ca416228dc31b7" candidate_uuid: "0957f3414e96411c846439294d91692a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "9f3fb800959647df959d2842e69114e4"
I20260709 12:14:32.747262 24897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600a4e0a0ca6400fb4ca416228dc31b7" candidate_uuid: "0957f3414e96411c846439294d91692a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "19a6c50a7452432c9b7065686d247915"
I20260709 12:14:32.748173 24706 raft_consensus.cc:3055] T 600a4e0a0ca6400fb4ca416228dc31b7 P 9f3fb800959647df959d2842e69114e4 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:14:32.748227 24897 raft_consensus.cc:3060] T 600a4e0a0ca6400fb4ca416228dc31b7 P 19a6c50a7452432c9b7065686d247915 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:32.748656 24706 raft_consensus.cc:740] T 600a4e0a0ca6400fb4ca416228dc31b7 P 9f3fb800959647df959d2842e69114e4 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9f3fb800959647df959d2842e69114e4, State: Running, Role: LEADER
I20260709 12:14:32.749619 24706 consensus_queue.cc:260] T 600a4e0a0ca6400fb4ca416228dc31b7 P 9f3fb800959647df959d2842e69114e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:32.751060 24706 raft_consensus.cc:3060] T 600a4e0a0ca6400fb4ca416228dc31b7 P 9f3fb800959647df959d2842e69114e4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:14:32.757302 24897 raft_consensus.cc:2468] T 600a4e0a0ca6400fb4ca416228dc31b7 P 19a6c50a7452432c9b7065686d247915 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0957f3414e96411c846439294d91692a in term 6.
I20260709 12:14:32.758931 24598 leader_election.cc:304] T 600a4e0a0ca6400fb4ca416228dc31b7 P 0957f3414e96411c846439294d91692a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0957f3414e96411c846439294d91692a, 19a6c50a7452432c9b7065686d247915; no voters: 
I20260709 12:14:32.759302 24706 raft_consensus.cc:2468] T 600a4e0a0ca6400fb4ca416228dc31b7 P 9f3fb800959647df959d2842e69114e4 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0957f3414e96411c846439294d91692a in term 6.
I20260709 12:14:32.759718 24992 raft_consensus.cc:2804] T 600a4e0a0ca6400fb4ca416228dc31b7 P 0957f3414e96411c846439294d91692a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:14:32.760224 24992 raft_consensus.cc:697] T 600a4e0a0ca6400fb4ca416228dc31b7 P 0957f3414e96411c846439294d91692a [term 6 LEADER]: Becoming Leader. State: Replica: 0957f3414e96411c846439294d91692a, State: Running, Role: LEADER
I20260709 12:14:32.761137 24992 consensus_queue.cc:237] T 600a4e0a0ca6400fb4ca416228dc31b7 P 0957f3414e96411c846439294d91692a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:32.768482 24456 catalog_manager.cc:5697] T 600a4e0a0ca6400fb4ca416228dc31b7 P 0957f3414e96411c846439294d91692a reported cstate change: term changed from 5 to 6, leader changed from 9f3fb800959647df959d2842e69114e4 (127.12.174.131) to 0957f3414e96411c846439294d91692a (127.12.174.130). New cstate: current_term: 6 leader_uuid: "0957f3414e96411c846439294d91692a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:32.857508 24997 raft_consensus.cc:993] T 1070a1e186974febba3e1d8dc0dbb32e P 0957f3414e96411c846439294d91692a: : Instructing follower 9f3fb800959647df959d2842e69114e4 to start an election
I20260709 12:14:32.858198 24992 raft_consensus.cc:1081] T 1070a1e186974febba3e1d8dc0dbb32e P 0957f3414e96411c846439294d91692a [term 3 LEADER]: Signalling peer 9f3fb800959647df959d2842e69114e4 to start an election
I20260709 12:14:32.859745 24706 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1070a1e186974febba3e1d8dc0dbb32e"
dest_uuid: "9f3fb800959647df959d2842e69114e4"
 from {username='slave'} at 127.0.0.1:35296
I20260709 12:14:32.860270 24706 raft_consensus.cc:493] T 1070a1e186974febba3e1d8dc0dbb32e P 9f3fb800959647df959d2842e69114e4 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:32.860597 24706 raft_consensus.cc:3060] T 1070a1e186974febba3e1d8dc0dbb32e P 9f3fb800959647df959d2842e69114e4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:32.868566 24706 raft_consensus.cc:515] T 1070a1e186974febba3e1d8dc0dbb32e P 9f3fb800959647df959d2842e69114e4 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:32.870795 24706 leader_election.cc:290] T 1070a1e186974febba3e1d8dc0dbb32e P 9f3fb800959647df959d2842e69114e4 [CANDIDATE]: Term 4 election: Requested vote from peers 19a6c50a7452432c9b7065686d247915 (127.12.174.129:34253), 0957f3414e96411c846439294d91692a (127.12.174.130:32819)
I20260709 12:14:32.871614 24897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1070a1e186974febba3e1d8dc0dbb32e" candidate_uuid: "9f3fb800959647df959d2842e69114e4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "19a6c50a7452432c9b7065686d247915"
I20260709 12:14:32.871884 24632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1070a1e186974febba3e1d8dc0dbb32e" candidate_uuid: "9f3fb800959647df959d2842e69114e4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "0957f3414e96411c846439294d91692a"
I20260709 12:14:32.872380 24897 raft_consensus.cc:3060] T 1070a1e186974febba3e1d8dc0dbb32e P 19a6c50a7452432c9b7065686d247915 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:32.872468 24632 raft_consensus.cc:3055] T 1070a1e186974febba3e1d8dc0dbb32e P 0957f3414e96411c846439294d91692a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:14:32.872875 24632 raft_consensus.cc:740] T 1070a1e186974febba3e1d8dc0dbb32e P 0957f3414e96411c846439294d91692a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0957f3414e96411c846439294d91692a, State: Running, Role: LEADER
I20260709 12:14:32.873759 24632 consensus_queue.cc:260] T 1070a1e186974febba3e1d8dc0dbb32e P 0957f3414e96411c846439294d91692a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:32.875136 24632 raft_consensus.cc:3060] T 1070a1e186974febba3e1d8dc0dbb32e P 0957f3414e96411c846439294d91692a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:14:32.881240 24897 raft_consensus.cc:2468] T 1070a1e186974febba3e1d8dc0dbb32e P 19a6c50a7452432c9b7065686d247915 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f3fb800959647df959d2842e69114e4 in term 4.
I20260709 12:14:32.882807 24672 leader_election.cc:304] T 1070a1e186974febba3e1d8dc0dbb32e P 9f3fb800959647df959d2842e69114e4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19a6c50a7452432c9b7065686d247915, 9f3fb800959647df959d2842e69114e4; no voters: 
I20260709 12:14:32.883296 24632 raft_consensus.cc:2468] T 1070a1e186974febba3e1d8dc0dbb32e P 0957f3414e96411c846439294d91692a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f3fb800959647df959d2842e69114e4 in term 4.
I20260709 12:14:32.883634 24994 raft_consensus.cc:2804] T 1070a1e186974febba3e1d8dc0dbb32e P 9f3fb800959647df959d2842e69114e4 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:14:32.884212 24994 raft_consensus.cc:697] T 1070a1e186974febba3e1d8dc0dbb32e P 9f3fb800959647df959d2842e69114e4 [term 4 LEADER]: Becoming Leader. State: Replica: 9f3fb800959647df959d2842e69114e4, State: Running, Role: LEADER
I20260709 12:14:32.885066 24994 consensus_queue.cc:237] T 1070a1e186974febba3e1d8dc0dbb32e P 9f3fb800959647df959d2842e69114e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:32.893990 24456 catalog_manager.cc:5697] T 1070a1e186974febba3e1d8dc0dbb32e P 9f3fb800959647df959d2842e69114e4 reported cstate change: term changed from 3 to 4, leader changed from 0957f3414e96411c846439294d91692a (127.12.174.130) to 9f3fb800959647df959d2842e69114e4 (127.12.174.131). New cstate: current_term: 4 leader_uuid: "9f3fb800959647df959d2842e69114e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } health_report { overall_health: HEALTHY } } }
W20260709 12:14:32.920248 24504 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:14:33.189285 24706 raft_consensus.cc:1275] T 600a4e0a0ca6400fb4ca416228dc31b7 P 9f3fb800959647df959d2842e69114e4 [term 6 FOLLOWER]: Refusing update from remote peer 0957f3414e96411c846439294d91692a: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:14:33.190812 24992 consensus_queue.cc:1048] T 600a4e0a0ca6400fb4ca416228dc31b7 P 0957f3414e96411c846439294d91692a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:14:33.201184 24897 raft_consensus.cc:1275] T 600a4e0a0ca6400fb4ca416228dc31b7 P 19a6c50a7452432c9b7065686d247915 [term 6 FOLLOWER]: Refusing update from remote peer 0957f3414e96411c846439294d91692a: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:14:33.203151 25006 consensus_queue.cc:1048] T 600a4e0a0ca6400fb4ca416228dc31b7 P 0957f3414e96411c846439294d91692a [LEADER]: Connected to new peer: Peer: permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:14:33.361598 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:33.369398 24706 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1070a1e186974febba3e1d8dc0dbb32e"
dest_uuid: "9f3fb800959647df959d2842e69114e4"
mode: GRACEFUL
new_leader_uuid: "0957f3414e96411c846439294d91692a"
 from {username='slave'} at 127.0.0.1:35324
I20260709 12:14:33.370025 24706 raft_consensus.cc:606] T 1070a1e186974febba3e1d8dc0dbb32e P 9f3fb800959647df959d2842e69114e4 [term 4 LEADER]: Received request to transfer leadership to TS 0957f3414e96411c846439294d91692a
I20260709 12:14:33.373013 24632 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "600a4e0a0ca6400fb4ca416228dc31b7"
dest_uuid: "0957f3414e96411c846439294d91692a"
mode: GRACEFUL
new_leader_uuid: "9f3fb800959647df959d2842e69114e4"
 from {username='slave'} at 127.0.0.1:45866
I20260709 12:14:33.373660 24632 raft_consensus.cc:606] T 600a4e0a0ca6400fb4ca416228dc31b7 P 0957f3414e96411c846439294d91692a [term 6 LEADER]: Received request to transfer leadership to TS 9f3fb800959647df959d2842e69114e4
I20260709 12:14:33.375293 12986 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:14:33.376106 12986 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:33.376811 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:33.442698 24897 raft_consensus.cc:1275] T 1070a1e186974febba3e1d8dc0dbb32e P 19a6c50a7452432c9b7065686d247915 [term 4 FOLLOWER]: Refusing update from remote peer 9f3fb800959647df959d2842e69114e4: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:14:33.444170 24994 consensus_queue.cc:1048] T 1070a1e186974febba3e1d8dc0dbb32e P 9f3fb800959647df959d2842e69114e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:33.453980 24632 raft_consensus.cc:1275] T 1070a1e186974febba3e1d8dc0dbb32e P 0957f3414e96411c846439294d91692a [term 4 FOLLOWER]: Refusing update from remote peer 9f3fb800959647df959d2842e69114e4: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:14:33.455847 25013 consensus_queue.cc:1048] T 1070a1e186974febba3e1d8dc0dbb32e P 9f3fb800959647df959d2842e69114e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:33.465430 25012 raft_consensus.cc:993] T 1070a1e186974febba3e1d8dc0dbb32e P 9f3fb800959647df959d2842e69114e4: : Instructing follower 0957f3414e96411c846439294d91692a to start an election
I20260709 12:14:33.465971 25013 raft_consensus.cc:1081] T 1070a1e186974febba3e1d8dc0dbb32e P 9f3fb800959647df959d2842e69114e4 [term 4 LEADER]: Signalling peer 0957f3414e96411c846439294d91692a to start an election
I20260709 12:14:33.467727 24632 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1070a1e186974febba3e1d8dc0dbb32e"
dest_uuid: "0957f3414e96411c846439294d91692a"
 from {username='slave'} at 127.0.0.1:45844
I20260709 12:14:33.468349 24632 raft_consensus.cc:493] T 1070a1e186974febba3e1d8dc0dbb32e P 0957f3414e96411c846439294d91692a [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:33.468752 24632 raft_consensus.cc:3060] T 1070a1e186974febba3e1d8dc0dbb32e P 0957f3414e96411c846439294d91692a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:33.477257 24632 raft_consensus.cc:515] T 1070a1e186974febba3e1d8dc0dbb32e P 0957f3414e96411c846439294d91692a [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:33.479139 24632 leader_election.cc:290] T 1070a1e186974febba3e1d8dc0dbb32e P 0957f3414e96411c846439294d91692a [CANDIDATE]: Term 5 election: Requested vote from peers 19a6c50a7452432c9b7065686d247915 (127.12.174.129:34253), 9f3fb800959647df959d2842e69114e4 (127.12.174.131:41945)
I20260709 12:14:33.480041 24897 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1070a1e186974febba3e1d8dc0dbb32e" candidate_uuid: "0957f3414e96411c846439294d91692a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "19a6c50a7452432c9b7065686d247915"
I20260709 12:14:33.480296 24706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1070a1e186974febba3e1d8dc0dbb32e" candidate_uuid: "0957f3414e96411c846439294d91692a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "9f3fb800959647df959d2842e69114e4"
I20260709 12:14:33.480680 24897 raft_consensus.cc:3060] T 1070a1e186974febba3e1d8dc0dbb32e P 19a6c50a7452432c9b7065686d247915 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:33.480891 24706 raft_consensus.cc:3055] T 1070a1e186974febba3e1d8dc0dbb32e P 9f3fb800959647df959d2842e69114e4 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:14:33.481261 24706 raft_consensus.cc:740] T 1070a1e186974febba3e1d8dc0dbb32e P 9f3fb800959647df959d2842e69114e4 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9f3fb800959647df959d2842e69114e4, State: Running, Role: LEADER
I20260709 12:14:33.482045 24706 consensus_queue.cc:260] T 1070a1e186974febba3e1d8dc0dbb32e P 9f3fb800959647df959d2842e69114e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:33.483145 24706 raft_consensus.cc:3060] T 1070a1e186974febba3e1d8dc0dbb32e P 9f3fb800959647df959d2842e69114e4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:14:33.488585 24897 raft_consensus.cc:2468] T 1070a1e186974febba3e1d8dc0dbb32e P 19a6c50a7452432c9b7065686d247915 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0957f3414e96411c846439294d91692a in term 5.
I20260709 12:14:33.488880 24706 raft_consensus.cc:2468] T 1070a1e186974febba3e1d8dc0dbb32e P 9f3fb800959647df959d2842e69114e4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0957f3414e96411c846439294d91692a in term 5.
I20260709 12:14:33.490091 24598 leader_election.cc:304] T 1070a1e186974febba3e1d8dc0dbb32e P 0957f3414e96411c846439294d91692a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0957f3414e96411c846439294d91692a, 19a6c50a7452432c9b7065686d247915; no voters: 
I20260709 12:14:33.490867 25006 raft_consensus.cc:2804] T 1070a1e186974febba3e1d8dc0dbb32e P 0957f3414e96411c846439294d91692a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:14:33.491343 25006 raft_consensus.cc:697] T 1070a1e186974febba3e1d8dc0dbb32e P 0957f3414e96411c846439294d91692a [term 5 LEADER]: Becoming Leader. State: Replica: 0957f3414e96411c846439294d91692a, State: Running, Role: LEADER
I20260709 12:14:33.492120 25006 consensus_queue.cc:237] T 1070a1e186974febba3e1d8dc0dbb32e P 0957f3414e96411c846439294d91692a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:33.498941 24456 catalog_manager.cc:5697] T 1070a1e186974febba3e1d8dc0dbb32e P 0957f3414e96411c846439294d91692a reported cstate change: term changed from 4 to 5, leader changed from 9f3fb800959647df959d2842e69114e4 (127.12.174.131) to 0957f3414e96411c846439294d91692a (127.12.174.130). New cstate: current_term: 5 leader_uuid: "0957f3414e96411c846439294d91692a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:33.766057 24997 raft_consensus.cc:993] T 600a4e0a0ca6400fb4ca416228dc31b7 P 0957f3414e96411c846439294d91692a: : Instructing follower 9f3fb800959647df959d2842e69114e4 to start an election
I20260709 12:14:33.766521 25006 raft_consensus.cc:1081] T 600a4e0a0ca6400fb4ca416228dc31b7 P 0957f3414e96411c846439294d91692a [term 6 LEADER]: Signalling peer 9f3fb800959647df959d2842e69114e4 to start an election
I20260709 12:14:33.768098 24706 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "600a4e0a0ca6400fb4ca416228dc31b7"
dest_uuid: "9f3fb800959647df959d2842e69114e4"
 from {username='slave'} at 127.0.0.1:35296
I20260709 12:14:33.768595 24706 raft_consensus.cc:493] T 600a4e0a0ca6400fb4ca416228dc31b7 P 9f3fb800959647df959d2842e69114e4 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:33.768877 24706 raft_consensus.cc:3060] T 600a4e0a0ca6400fb4ca416228dc31b7 P 9f3fb800959647df959d2842e69114e4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:33.774390 24706 raft_consensus.cc:515] T 600a4e0a0ca6400fb4ca416228dc31b7 P 9f3fb800959647df959d2842e69114e4 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:33.776351 24706 leader_election.cc:290] T 600a4e0a0ca6400fb4ca416228dc31b7 P 9f3fb800959647df959d2842e69114e4 [CANDIDATE]: Term 7 election: Requested vote from peers 19a6c50a7452432c9b7065686d247915 (127.12.174.129:34253), 0957f3414e96411c846439294d91692a (127.12.174.130:32819)
I20260709 12:14:33.777228 24896 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600a4e0a0ca6400fb4ca416228dc31b7" candidate_uuid: "9f3fb800959647df959d2842e69114e4" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: true dest_uuid: "19a6c50a7452432c9b7065686d247915"
I20260709 12:14:33.777465 24632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600a4e0a0ca6400fb4ca416228dc31b7" candidate_uuid: "9f3fb800959647df959d2842e69114e4" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: true dest_uuid: "0957f3414e96411c846439294d91692a"
I20260709 12:14:33.777925 24896 raft_consensus.cc:3060] T 600a4e0a0ca6400fb4ca416228dc31b7 P 19a6c50a7452432c9b7065686d247915 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:33.778079 24632 raft_consensus.cc:3055] T 600a4e0a0ca6400fb4ca416228dc31b7 P 0957f3414e96411c846439294d91692a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:14:33.778439 24632 raft_consensus.cc:740] T 600a4e0a0ca6400fb4ca416228dc31b7 P 0957f3414e96411c846439294d91692a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0957f3414e96411c846439294d91692a, State: Running, Role: LEADER
I20260709 12:14:33.779104 24632 consensus_queue.cc:260] T 600a4e0a0ca6400fb4ca416228dc31b7 P 0957f3414e96411c846439294d91692a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:33.780115 24632 raft_consensus.cc:3060] T 600a4e0a0ca6400fb4ca416228dc31b7 P 0957f3414e96411c846439294d91692a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:14:33.784682 24896 raft_consensus.cc:2468] T 600a4e0a0ca6400fb4ca416228dc31b7 P 19a6c50a7452432c9b7065686d247915 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f3fb800959647df959d2842e69114e4 in term 7.
I20260709 12:14:33.786041 24632 raft_consensus.cc:2468] T 600a4e0a0ca6400fb4ca416228dc31b7 P 0957f3414e96411c846439294d91692a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f3fb800959647df959d2842e69114e4 in term 7.
I20260709 12:14:33.786085 24672 leader_election.cc:304] T 600a4e0a0ca6400fb4ca416228dc31b7 P 9f3fb800959647df959d2842e69114e4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19a6c50a7452432c9b7065686d247915, 9f3fb800959647df959d2842e69114e4; no voters: 
I20260709 12:14:33.787210 25013 raft_consensus.cc:2804] T 600a4e0a0ca6400fb4ca416228dc31b7 P 9f3fb800959647df959d2842e69114e4 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:14:33.787739 25013 raft_consensus.cc:697] T 600a4e0a0ca6400fb4ca416228dc31b7 P 9f3fb800959647df959d2842e69114e4 [term 7 LEADER]: Becoming Leader. State: Replica: 9f3fb800959647df959d2842e69114e4, State: Running, Role: LEADER
I20260709 12:14:33.788636 25013 consensus_queue.cc:237] T 600a4e0a0ca6400fb4ca416228dc31b7 P 9f3fb800959647df959d2842e69114e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } }
I20260709 12:14:33.795542 24456 catalog_manager.cc:5697] T 600a4e0a0ca6400fb4ca416228dc31b7 P 9f3fb800959647df959d2842e69114e4 reported cstate change: term changed from 6 to 7, leader changed from 0957f3414e96411c846439294d91692a (127.12.174.130) to 9f3fb800959647df959d2842e69114e4 (127.12.174.131). New cstate: current_term: 7 leader_uuid: "9f3fb800959647df959d2842e69114e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:33.881037 24896 raft_consensus.cc:1275] T 1070a1e186974febba3e1d8dc0dbb32e P 19a6c50a7452432c9b7065686d247915 [term 5 FOLLOWER]: Refusing update from remote peer 0957f3414e96411c846439294d91692a: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:14:33.882679 25006 consensus_queue.cc:1048] T 1070a1e186974febba3e1d8dc0dbb32e P 0957f3414e96411c846439294d91692a [LEADER]: Connected to new peer: Peer: permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:14:33.890641 24706 raft_consensus.cc:1275] T 1070a1e186974febba3e1d8dc0dbb32e P 9f3fb800959647df959d2842e69114e4 [term 5 FOLLOWER]: Refusing update from remote peer 0957f3414e96411c846439294d91692a: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:14:33.892581 24992 consensus_queue.cc:1048] T 1070a1e186974febba3e1d8dc0dbb32e P 0957f3414e96411c846439294d91692a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f3fb800959647df959d2842e69114e4" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 41945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:14:33.921430 24504 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:14:34.192698 24632 raft_consensus.cc:1275] T 600a4e0a0ca6400fb4ca416228dc31b7 P 0957f3414e96411c846439294d91692a [term 7 FOLLOWER]: Refusing update from remote peer 9f3fb800959647df959d2842e69114e4: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:14:34.194129 25013 consensus_queue.cc:1048] T 600a4e0a0ca6400fb4ca416228dc31b7 P 9f3fb800959647df959d2842e69114e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0957f3414e96411c846439294d91692a" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 32819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:14:34.205209 24897 raft_consensus.cc:1275] T 600a4e0a0ca6400fb4ca416228dc31b7 P 19a6c50a7452432c9b7065686d247915 [term 7 FOLLOWER]: Refusing update from remote peer 9f3fb800959647df959d2842e69114e4: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:14:34.206766 25013 consensus_queue.cc:1048] T 600a4e0a0ca6400fb4ca416228dc31b7 P 9f3fb800959647df959d2842e69114e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19a6c50a7452432c9b7065686d247915" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:14:34.383914 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:34.424352 12986 tablet_server.cc:179] TabletServer@127.12.174.129:34253 shutting down...
W20260709 12:14:34.429979 24598 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 90 similar messages]
W20260709 12:14:34.434336 24598 consensus_peers.cc:597] T 1070a1e186974febba3e1d8dc0dbb32e P 0957f3414e96411c846439294d91692a -> Peer 19a6c50a7452432c9b7065686d247915 (127.12.174.129:34253): Couldn't send request to peer 19a6c50a7452432c9b7065686d247915. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:34.460840 12986 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:14:34.461908 12986 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:34.463140 12986 raft_consensus.cc:2243] T aba98af27ae743c7996a5ebd5c0d2780 P 19a6c50a7452432c9b7065686d247915 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:34.463821 12986 raft_consensus.cc:2272] T aba98af27ae743c7996a5ebd5c0d2780 P 19a6c50a7452432c9b7065686d247915 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:34.467195 12986 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:34.468099 12986 raft_consensus.cc:2243] T 47f98adb81f3471f92fb1acba914760c P 19a6c50a7452432c9b7065686d247915 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:34.468676 12986 raft_consensus.cc:2272] T 47f98adb81f3471f92fb1acba914760c P 19a6c50a7452432c9b7065686d247915 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:34.471649 12986 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:34.472347 12986 raft_consensus.cc:2243] T ea42bf8b2c8446bb8cf72377bdc2db72 P 19a6c50a7452432c9b7065686d247915 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:34.472879 12986 raft_consensus.cc:2272] T ea42bf8b2c8446bb8cf72377bdc2db72 P 19a6c50a7452432c9b7065686d247915 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:34.475801 12986 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:34.476493 12986 raft_consensus.cc:2243] T 600a4e0a0ca6400fb4ca416228dc31b7 P 19a6c50a7452432c9b7065686d247915 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:34.476992 12986 raft_consensus.cc:2272] T 600a4e0a0ca6400fb4ca416228dc31b7 P 19a6c50a7452432c9b7065686d247915 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:34.480327 12986 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:34.481065 12986 raft_consensus.cc:2243] T 39fa67f2dd5541f68cfaff5e37b65376 P 19a6c50a7452432c9b7065686d247915 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:34.481583 12986 raft_consensus.cc:2272] T 39fa67f2dd5541f68cfaff5e37b65376 P 19a6c50a7452432c9b7065686d247915 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:34.484153 12986 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:34.484788 12986 raft_consensus.cc:2243] T 7193d4ca686648169964ddb1468a3799 P 19a6c50a7452432c9b7065686d247915 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:34.485374 12986 raft_consensus.cc:2272] T 7193d4ca686648169964ddb1468a3799 P 19a6c50a7452432c9b7065686d247915 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:34.488087 12986 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:34.488679 12986 raft_consensus.cc:2243] T 1070a1e186974febba3e1d8dc0dbb32e P 19a6c50a7452432c9b7065686d247915 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:34.489187 12986 raft_consensus.cc:2272] T 1070a1e186974febba3e1d8dc0dbb32e P 19a6c50a7452432c9b7065686d247915 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:34.492513 12986 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:34.493148 12986 raft_consensus.cc:2243] T 87f7daeaf8314cce8015910ee7085627 P 19a6c50a7452432c9b7065686d247915 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:34.493623 12986 raft_consensus.cc:2272] T 87f7daeaf8314cce8015910ee7085627 P 19a6c50a7452432c9b7065686d247915 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:34.496053 12986 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:34.496613 12986 raft_consensus.cc:2243] T 424a5cb2ff61499abadd789493f7875f P 19a6c50a7452432c9b7065686d247915 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:34.497113 12986 raft_consensus.cc:2272] T 424a5cb2ff61499abadd789493f7875f P 19a6c50a7452432c9b7065686d247915 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:34.499766 12986 tablet_replica.cc:333] stopping tablet replica
I20260709 12:14:34.500357 12986 raft_consensus.cc:2243] T fc07ceaa7eb544aeacd41a465a8bf0f8 P 19a6c50a7452432c9b7065686d247915 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:34.500841 12986 raft_consensus.cc:2272] T fc07ceaa7eb544aeacd41a465a8bf0f8 P 19a6c50a7452432c9b7065686d247915 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:34.508586 24672 consensus_peers.cc:597] T fc07ceaa7eb544aeacd41a465a8bf0f8 P 9f3fb800959647df959d2842e69114e4 -> Peer 19a6c50a7452432c9b7065686d247915 (127.12.174.129:34253): Couldn't send request to peer 19a6c50a7452432c9b7065686d247915. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:34.537329 12986 tablet_server.cc:196] TabletServer@127.12.174.129:34253 shutdown complete.
I20260709 12:14:34.570546 12986 tablet_server.cc:179] TabletServer@127.12.174.130:0 shutting down...
I20260709 12:14:34.599831 12986 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 12:14:34.600108 24671 consensus_peers.cc:597] T 600a4e0a0ca6400fb4ca416228dc31b7 P 9f3fb800959647df959d2842e69114e4 -> Peer 0957f3414e96411c846439294d91692a (127.12.174.130:32819): Couldn't send request to peer 0957f3414e96411c846439294d91692a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:34.600666 12986 tablet_replica.cc:333] T 600a4e0a0ca6400fb4ca416228dc31b7 P 0957f3414e96411c846439294d91692a: stopping tablet replica
I20260709 12:14:34.601579 12986 raft_consensus.cc:2243] T 600a4e0a0ca6400fb4ca416228dc31b7 P 0957f3414e96411c846439294d91692a [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:34.602149 12986 raft_consensus.cc:2272] T 600a4e0a0ca6400fb4ca416228dc31b7 P 0957f3414e96411c846439294d91692a [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:34.605350 12986 tablet_replica.cc:333] T 47f98adb81f3471f92fb1acba914760c P 0957f3414e96411c846439294d91692a: stopping tablet replica
I20260709 12:14:34.606135 12986 raft_consensus.cc:2243] T 47f98adb81f3471f92fb1acba914760c P 0957f3414e96411c846439294d91692a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:34.606649 12986 raft_consensus.cc:2272] T 47f98adb81f3471f92fb1acba914760c P 0957f3414e96411c846439294d91692a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:34.609293 12986 tablet_replica.cc:333] T fc07ceaa7eb544aeacd41a465a8bf0f8 P 0957f3414e96411c846439294d91692a: stopping tablet replica
I20260709 12:14:34.609963 12986 raft_consensus.cc:2243] T fc07ceaa7eb544aeacd41a465a8bf0f8 P 0957f3414e96411c846439294d91692a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:34.610589 12986 raft_consensus.cc:2272] T fc07ceaa7eb544aeacd41a465a8bf0f8 P 0957f3414e96411c846439294d91692a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:34.613125 12986 tablet_replica.cc:333] T aba98af27ae743c7996a5ebd5c0d2780 P 0957f3414e96411c846439294d91692a: stopping tablet replica
I20260709 12:14:34.613817 12986 raft_consensus.cc:2243] T aba98af27ae743c7996a5ebd5c0d2780 P 0957f3414e96411c846439294d91692a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:34.614331 12986 raft_consensus.cc:2272] T aba98af27ae743c7996a5ebd5c0d2780 P 0957f3414e96411c846439294d91692a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:34.616731 12986 tablet_replica.cc:333] T 39fa67f2dd5541f68cfaff5e37b65376 P 0957f3414e96411c846439294d91692a: stopping tablet replica
I20260709 12:14:34.617398 12986 raft_consensus.cc:2243] T 39fa67f2dd5541f68cfaff5e37b65376 P 0957f3414e96411c846439294d91692a [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:34.618384 12986 raft_consensus.cc:2272] T 39fa67f2dd5541f68cfaff5e37b65376 P 0957f3414e96411c846439294d91692a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:34.620929 12986 tablet_replica.cc:333] T 7193d4ca686648169964ddb1468a3799 P 0957f3414e96411c846439294d91692a: stopping tablet replica
I20260709 12:14:34.621603 12986 raft_consensus.cc:2243] T 7193d4ca686648169964ddb1468a3799 P 0957f3414e96411c846439294d91692a [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:34.622529 12986 raft_consensus.cc:2272] T 7193d4ca686648169964ddb1468a3799 P 0957f3414e96411c846439294d91692a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:34.624986 12986 tablet_replica.cc:333] T ea42bf8b2c8446bb8cf72377bdc2db72 P 0957f3414e96411c846439294d91692a: stopping tablet replica
I20260709 12:14:34.625536 12986 raft_consensus.cc:2243] T ea42bf8b2c8446bb8cf72377bdc2db72 P 0957f3414e96411c846439294d91692a [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:34.626446 12986 raft_consensus.cc:2272] T ea42bf8b2c8446bb8cf72377bdc2db72 P 0957f3414e96411c846439294d91692a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:34.628870 12986 tablet_replica.cc:333] T 1070a1e186974febba3e1d8dc0dbb32e P 0957f3414e96411c846439294d91692a: stopping tablet replica
I20260709 12:14:34.629446 12986 raft_consensus.cc:2243] T 1070a1e186974febba3e1d8dc0dbb32e P 0957f3414e96411c846439294d91692a [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:14:34.630324 12986 raft_consensus.cc:2272] T 1070a1e186974febba3e1d8dc0dbb32e P 0957f3414e96411c846439294d91692a [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:34.633344 12986 tablet_replica.cc:333] T 424a5cb2ff61499abadd789493f7875f P 0957f3414e96411c846439294d91692a: stopping tablet replica
I20260709 12:14:34.633984 12986 raft_consensus.cc:2243] T 424a5cb2ff61499abadd789493f7875f P 0957f3414e96411c846439294d91692a [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:34.634891 12986 raft_consensus.cc:2272] T 424a5cb2ff61499abadd789493f7875f P 0957f3414e96411c846439294d91692a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:34.637236 12986 tablet_replica.cc:333] T 87f7daeaf8314cce8015910ee7085627 P 0957f3414e96411c846439294d91692a: stopping tablet replica
I20260709 12:14:34.637756 12986 raft_consensus.cc:2243] T 87f7daeaf8314cce8015910ee7085627 P 0957f3414e96411c846439294d91692a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:34.638250 12986 raft_consensus.cc:2272] T 87f7daeaf8314cce8015910ee7085627 P 0957f3414e96411c846439294d91692a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:34.673768 12986 tablet_server.cc:196] TabletServer@127.12.174.130:0 shutdown complete.
I20260709 12:14:34.703783 12986 tablet_server.cc:179] TabletServer@127.12.174.131:0 shutting down...
W20260709 12:14:34.712771 24671 consensus_peers.cc:597] T 47f98adb81f3471f92fb1acba914760c P 9f3fb800959647df959d2842e69114e4 -> Peer 0957f3414e96411c846439294d91692a (127.12.174.130:32819): Couldn't send request to peer 0957f3414e96411c846439294d91692a. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.130:32819: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:34.731565 12986 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:14:34.732441 12986 tablet_replica.cc:333] T fc07ceaa7eb544aeacd41a465a8bf0f8 P 9f3fb800959647df959d2842e69114e4: stopping tablet replica
I20260709 12:14:34.733290 12986 raft_consensus.cc:2243] T fc07ceaa7eb544aeacd41a465a8bf0f8 P 9f3fb800959647df959d2842e69114e4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:34.734313 12986 raft_consensus.cc:2272] T fc07ceaa7eb544aeacd41a465a8bf0f8 P 9f3fb800959647df959d2842e69114e4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:34.737032 12986 tablet_replica.cc:333] T ea42bf8b2c8446bb8cf72377bdc2db72 P 9f3fb800959647df959d2842e69114e4: stopping tablet replica
I20260709 12:14:34.737893 12986 raft_consensus.cc:2243] T ea42bf8b2c8446bb8cf72377bdc2db72 P 9f3fb800959647df959d2842e69114e4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:34.738492 12986 raft_consensus.cc:2272] T ea42bf8b2c8446bb8cf72377bdc2db72 P 9f3fb800959647df959d2842e69114e4 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:34.741202 24672 consensus_peers.cc:597] T 87f7daeaf8314cce8015910ee7085627 P 9f3fb800959647df959d2842e69114e4 -> Peer 19a6c50a7452432c9b7065686d247915 (127.12.174.129:34253): Couldn't send request to peer 19a6c50a7452432c9b7065686d247915. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:34253: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:34.741861 12986 tablet_replica.cc:333] T aba98af27ae743c7996a5ebd5c0d2780 P 9f3fb800959647df959d2842e69114e4: stopping tablet replica
I20260709 12:14:34.742591 12986 raft_consensus.cc:2243] T aba98af27ae743c7996a5ebd5c0d2780 P 9f3fb800959647df959d2842e69114e4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:34.743451 12986 raft_consensus.cc:2272] T aba98af27ae743c7996a5ebd5c0d2780 P 9f3fb800959647df959d2842e69114e4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:34.746210 12986 tablet_replica.cc:333] T 47f98adb81f3471f92fb1acba914760c P 9f3fb800959647df959d2842e69114e4: stopping tablet replica
I20260709 12:14:34.747241 12986 raft_consensus.cc:2243] T 47f98adb81f3471f92fb1acba914760c P 9f3fb800959647df959d2842e69114e4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:34.748255 12986 raft_consensus.cc:2272] T 47f98adb81f3471f92fb1acba914760c P 9f3fb800959647df959d2842e69114e4 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:14:34.750591 24672 consensus_peers.cc:597] T 600a4e0a0ca6400fb4ca416228dc31b7 P 9f3fb800959647df959d2842e69114e4 -> Peer 19a6c50a7452432c9b7065686d247915 (127.12.174.129:34253): Couldn't send request to peer 19a6c50a7452432c9b7065686d247915. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:34253: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:34.751463 12986 tablet_replica.cc:333] T 600a4e0a0ca6400fb4ca416228dc31b7 P 9f3fb800959647df959d2842e69114e4: stopping tablet replica
I20260709 12:14:34.752182 12986 raft_consensus.cc:2243] T 600a4e0a0ca6400fb4ca416228dc31b7 P 9f3fb800959647df959d2842e69114e4 [term 7 LEADER]: Raft consensus shutting down.
I20260709 12:14:34.753072 12986 raft_consensus.cc:2272] T 600a4e0a0ca6400fb4ca416228dc31b7 P 9f3fb800959647df959d2842e69114e4 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:34.756479 12986 tablet_replica.cc:333] T 39fa67f2dd5541f68cfaff5e37b65376 P 9f3fb800959647df959d2842e69114e4: stopping tablet replica
I20260709 12:14:34.757124 12986 raft_consensus.cc:2243] T 39fa67f2dd5541f68cfaff5e37b65376 P 9f3fb800959647df959d2842e69114e4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:34.757613 12986 raft_consensus.cc:2272] T 39fa67f2dd5541f68cfaff5e37b65376 P 9f3fb800959647df959d2842e69114e4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:34.759893 12986 tablet_replica.cc:333] T 7193d4ca686648169964ddb1468a3799 P 9f3fb800959647df959d2842e69114e4: stopping tablet replica
I20260709 12:14:34.760432 12986 raft_consensus.cc:2243] T 7193d4ca686648169964ddb1468a3799 P 9f3fb800959647df959d2842e69114e4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:34.760838 12986 raft_consensus.cc:2272] T 7193d4ca686648169964ddb1468a3799 P 9f3fb800959647df959d2842e69114e4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:34.763042 12986 tablet_replica.cc:333] T 87f7daeaf8314cce8015910ee7085627 P 9f3fb800959647df959d2842e69114e4: stopping tablet replica
I20260709 12:14:34.763581 12986 raft_consensus.cc:2243] T 87f7daeaf8314cce8015910ee7085627 P 9f3fb800959647df959d2842e69114e4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:34.764635 12986 raft_consensus.cc:2272] T 87f7daeaf8314cce8015910ee7085627 P 9f3fb800959647df959d2842e69114e4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:34.767082 12986 tablet_replica.cc:333] T 424a5cb2ff61499abadd789493f7875f P 9f3fb800959647df959d2842e69114e4: stopping tablet replica
I20260709 12:14:34.767657 12986 raft_consensus.cc:2243] T 424a5cb2ff61499abadd789493f7875f P 9f3fb800959647df959d2842e69114e4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:34.768095 12986 raft_consensus.cc:2272] T 424a5cb2ff61499abadd789493f7875f P 9f3fb800959647df959d2842e69114e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:34.770561 12986 tablet_replica.cc:333] T 1070a1e186974febba3e1d8dc0dbb32e P 9f3fb800959647df959d2842e69114e4: stopping tablet replica
I20260709 12:14:34.771037 12986 raft_consensus.cc:2243] T 1070a1e186974febba3e1d8dc0dbb32e P 9f3fb800959647df959d2842e69114e4 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:34.771484 12986 raft_consensus.cc:2272] T 1070a1e186974febba3e1d8dc0dbb32e P 9f3fb800959647df959d2842e69114e4 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:34.807811 12986 tablet_server.cc:196] TabletServer@127.12.174.131:0 shutdown complete.
I20260709 12:14:34.837232 12986 master.cc:562] Master@127.12.174.190:42177 shutting down...
I20260709 12:14:34.862059 12986 raft_consensus.cc:2243] T 00000000000000000000000000000000 P eccac11d14a94b45877dace4a2d57a4b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:34.862684 12986 raft_consensus.cc:2272] T 00000000000000000000000000000000 P eccac11d14a94b45877dace4a2d57a4b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:34.863030 12986 tablet_replica.cc:333] T 00000000000000000000000000000000 P eccac11d14a94b45877dace4a2d57a4b: stopping tablet replica
I20260709 12:14:34.883813 12986 master.cc:584] Master@127.12.174.190:42177 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (13174 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 12:14:34.933495 12986 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.12.174.190:35103
I20260709 12:14:34.934813 12986 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:14:34.940855 25029 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:34.940984 25028 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:34.943651 25031 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:14:34.944471 12986 server_base.cc:1061] running on GCE node
I20260709 12:14:34.945430 12986 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:14:34.945629 12986 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:14:34.945801 12986 hybrid_clock.cc:648] HybridClock initialized: now 1783599274945771 us; error 0 us; skew 500 ppm
I20260709 12:14:34.946394 12986 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:14:34.948959 12986 webserver.cc:533] Webserver started at http://127.12.174.190:38361/ using document root <none> and password file <none>
I20260709 12:14:34.949532 12986 fs_manager.cc:362] Metadata directory not provided
I20260709 12:14:34.949723 12986 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:14:34.950039 12986 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:14:34.951339 12986 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598886212958-12986-0/minicluster-data/master-0-root/instance:
uuid: "c5dfceea27184016b735edef976d4e39"
format_stamp: "Formatted at 2026-07-09 12:14:34 on dist-test-slave-9q7n"
I20260709 12:14:34.956327 12986 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.002s
I20260709 12:14:34.960207 25036 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:34.961078 12986 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:14:34.961356 12986 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598886212958-12986-0/minicluster-data/master-0-root
uuid: "c5dfceea27184016b735edef976d4e39"
format_stamp: "Formatted at 2026-07-09 12:14:34 on dist-test-slave-9q7n"
I20260709 12:14:34.961648 12986 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598886212958-12986-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598886212958-12986-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598886212958-12986-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:14:34.982416 12986 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:14:34.983747 12986 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:14:35.028239 12986 rpc_server.cc:307] RPC server started. Bound to: 127.12.174.190:35103
I20260709 12:14:35.028415 25087 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.174.190:35103 every 8 connection(s)
I20260709 12:14:35.032824 25088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:35.047288 25088 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c5dfceea27184016b735edef976d4e39: Bootstrap starting.
I20260709 12:14:35.053015 25088 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c5dfceea27184016b735edef976d4e39: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:35.058092 25088 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c5dfceea27184016b735edef976d4e39: No bootstrap required, opened a new log
I20260709 12:14:35.060631 25088 raft_consensus.cc:359] T 00000000000000000000000000000000 P c5dfceea27184016b735edef976d4e39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5dfceea27184016b735edef976d4e39" member_type: VOTER }
I20260709 12:14:35.061064 25088 raft_consensus.cc:385] T 00000000000000000000000000000000 P c5dfceea27184016b735edef976d4e39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:35.061252 25088 raft_consensus.cc:740] T 00000000000000000000000000000000 P c5dfceea27184016b735edef976d4e39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5dfceea27184016b735edef976d4e39, State: Initialized, Role: FOLLOWER
I20260709 12:14:35.061902 25088 consensus_queue.cc:260] T 00000000000000000000000000000000 P c5dfceea27184016b735edef976d4e39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5dfceea27184016b735edef976d4e39" member_type: VOTER }
I20260709 12:14:35.062388 25088 raft_consensus.cc:399] T 00000000000000000000000000000000 P c5dfceea27184016b735edef976d4e39 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:14:35.062590 25088 raft_consensus.cc:493] T 00000000000000000000000000000000 P c5dfceea27184016b735edef976d4e39 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:14:35.062803 25088 raft_consensus.cc:3060] T 00000000000000000000000000000000 P c5dfceea27184016b735edef976d4e39 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:35.069118 25088 raft_consensus.cc:515] T 00000000000000000000000000000000 P c5dfceea27184016b735edef976d4e39 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5dfceea27184016b735edef976d4e39" member_type: VOTER }
I20260709 12:14:35.069712 25088 leader_election.cc:304] T 00000000000000000000000000000000 P c5dfceea27184016b735edef976d4e39 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c5dfceea27184016b735edef976d4e39; no voters: 
I20260709 12:14:35.070998 25088 leader_election.cc:290] T 00000000000000000000000000000000 P c5dfceea27184016b735edef976d4e39 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:14:35.071487 25091 raft_consensus.cc:2804] T 00000000000000000000000000000000 P c5dfceea27184016b735edef976d4e39 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:35.073056 25091 raft_consensus.cc:697] T 00000000000000000000000000000000 P c5dfceea27184016b735edef976d4e39 [term 1 LEADER]: Becoming Leader. State: Replica: c5dfceea27184016b735edef976d4e39, State: Running, Role: LEADER
I20260709 12:14:35.073854 25091 consensus_queue.cc:237] T 00000000000000000000000000000000 P c5dfceea27184016b735edef976d4e39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5dfceea27184016b735edef976d4e39" member_type: VOTER }
I20260709 12:14:35.074216 25088 sys_catalog.cc:565] T 00000000000000000000000000000000 P c5dfceea27184016b735edef976d4e39 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:14:35.079231 25093 sys_catalog.cc:455] T 00000000000000000000000000000000 P c5dfceea27184016b735edef976d4e39 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c5dfceea27184016b735edef976d4e39. Latest consensus state: current_term: 1 leader_uuid: "c5dfceea27184016b735edef976d4e39" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5dfceea27184016b735edef976d4e39" member_type: VOTER } }
I20260709 12:14:35.080077 25093 sys_catalog.cc:458] T 00000000000000000000000000000000 P c5dfceea27184016b735edef976d4e39 [sys.catalog]: This master's current role is: LEADER
I20260709 12:14:35.080086 25092 sys_catalog.cc:455] T 00000000000000000000000000000000 P c5dfceea27184016b735edef976d4e39 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c5dfceea27184016b735edef976d4e39" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5dfceea27184016b735edef976d4e39" member_type: VOTER } }
I20260709 12:14:35.082437 25099 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:14:35.082444 25092 sys_catalog.cc:458] T 00000000000000000000000000000000 P c5dfceea27184016b735edef976d4e39 [sys.catalog]: This master's current role is: LEADER
I20260709 12:14:35.089195 25099 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:14:35.093585 12986 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:14:35.099838 25099 catalog_manager.cc:1383] Generated new cluster ID: 680c423ebe2d45cb952c19f722afedbc
I20260709 12:14:35.100206 25099 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:14:35.117043 25099 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:14:35.118580 25099 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:14:35.135376 25099 catalog_manager.cc:6070] T 00000000000000000000000000000000 P c5dfceea27184016b735edef976d4e39: Generated new TSK 0
I20260709 12:14:35.136096 25099 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:14:35.161368 12986 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:14:35.168227 25109 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:35.169541 25110 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:35.171232 25112 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:14:35.171973 12986 server_base.cc:1061] running on GCE node
I20260709 12:14:35.172940 12986 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:14:35.173138 12986 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:14:35.173264 12986 hybrid_clock.cc:648] HybridClock initialized: now 1783599275173251 us; error 0 us; skew 500 ppm
I20260709 12:14:35.173875 12986 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:14:35.176644 12986 webserver.cc:533] Webserver started at http://127.12.174.129:34695/ using document root <none> and password file <none>
I20260709 12:14:35.177181 12986 fs_manager.cc:362] Metadata directory not provided
I20260709 12:14:35.177340 12986 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:14:35.177567 12986 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:14:35.178799 12986 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598886212958-12986-0/minicluster-data/ts-0-root/instance:
uuid: "fc7521eed4d2442b8ef186e049d4066a"
format_stamp: "Formatted at 2026-07-09 12:14:35 on dist-test-slave-9q7n"
I20260709 12:14:35.184096 12986 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:14:35.188009 25117 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:35.188832 12986 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 12:14:35.189153 12986 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598886212958-12986-0/minicluster-data/ts-0-root
uuid: "fc7521eed4d2442b8ef186e049d4066a"
format_stamp: "Formatted at 2026-07-09 12:14:35 on dist-test-slave-9q7n"
I20260709 12:14:35.189450 12986 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598886212958-12986-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598886212958-12986-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598886212958-12986-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:14:35.208110 12986 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:14:35.209532 12986 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:14:35.211253 12986 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:14:35.213855 12986 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:14:35.214073 12986 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:35.214296 12986 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:14:35.214473 12986 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:35.261174 12986 rpc_server.cc:307] RPC server started. Bound to: 127.12.174.129:34155
I20260709 12:14:35.261291 25179 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.174.129:34155 every 8 connection(s)
I20260709 12:14:35.266790 12986 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:14:35.274168 25184 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:35.274677 25185 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:14:35.277859 12986 server_base.cc:1061] running on GCE node
W20260709 12:14:35.277823 25187 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:14:35.279637 12986 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:14:35.279874 12986 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:14:35.280097 12986 hybrid_clock.cc:648] HybridClock initialized: now 1783599275280073 us; error 0 us; skew 500 ppm
I20260709 12:14:35.280784 25180 heartbeater.cc:344] Connected to a master server at 127.12.174.190:35103
I20260709 12:14:35.280830 12986 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:14:35.281293 25180 heartbeater.cc:461] Registering TS with master...
I20260709 12:14:35.282315 25180 heartbeater.cc:507] Master 127.12.174.190:35103 requested a full tablet report, sending...
I20260709 12:14:35.283747 12986 webserver.cc:533] Webserver started at http://127.12.174.130:40749/ using document root <none> and password file <none>
I20260709 12:14:35.284370 12986 fs_manager.cc:362] Metadata directory not provided
I20260709 12:14:35.284575 12986 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:14:35.284832 12986 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:14:35.284731 25053 ts_manager.cc:194] Registered new tserver with Master: fc7521eed4d2442b8ef186e049d4066a (127.12.174.129:34155)
I20260709 12:14:35.286412 12986 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598886212958-12986-0/minicluster-data/ts-1-root/instance:
uuid: "e36ce9c75f594ca7a7f3b05364492a6d"
format_stamp: "Formatted at 2026-07-09 12:14:35 on dist-test-slave-9q7n"
I20260709 12:14:35.287036 25053 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55212
I20260709 12:14:35.291821 12986 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:14:35.295984 25192 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:35.296904 12986 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 12:14:35.297207 12986 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598886212958-12986-0/minicluster-data/ts-1-root
uuid: "e36ce9c75f594ca7a7f3b05364492a6d"
format_stamp: "Formatted at 2026-07-09 12:14:35 on dist-test-slave-9q7n"
I20260709 12:14:35.297473 12986 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598886212958-12986-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598886212958-12986-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598886212958-12986-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:14:35.319679 12986 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:14:35.320991 12986 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:14:35.322692 12986 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:14:35.325168 12986 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:14:35.325369 12986 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:35.325642 12986 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:14:35.325826 12986 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260709 12:14:35.371707 12986 rpc_server.cc:307] RPC server started. Bound to: 127.12.174.130:33439
I20260709 12:14:35.371811 25254 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.174.130:33439 every 8 connection(s)
I20260709 12:14:35.377159 12986 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:14:35.385319 25258 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:35.387151 25259 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:14:35.388763 12986 server_base.cc:1061] running on GCE node
W20260709 12:14:35.389000 25261 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:14:35.390177 12986 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:14:35.390484 12986 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:14:35.390697 12986 hybrid_clock.cc:648] HybridClock initialized: now 1783599275390678 us; error 0 us; skew 500 ppm
I20260709 12:14:35.391422 12986 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:14:35.391971 25255 heartbeater.cc:344] Connected to a master server at 127.12.174.190:35103
I20260709 12:14:35.392478 25255 heartbeater.cc:461] Registering TS with master...
I20260709 12:14:35.393383 25255 heartbeater.cc:507] Master 127.12.174.190:35103 requested a full tablet report, sending...
I20260709 12:14:35.394928 12986 webserver.cc:533] Webserver started at http://127.12.174.131:44021/ using document root <none> and password file <none>
I20260709 12:14:35.395648 12986 fs_manager.cc:362] Metadata directory not provided
I20260709 12:14:35.395900 12986 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:14:35.395957 25053 ts_manager.cc:194] Registered new tserver with Master: e36ce9c75f594ca7a7f3b05364492a6d (127.12.174.130:33439)
I20260709 12:14:35.396260 12986 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:14:35.398077 12986 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598886212958-12986-0/minicluster-data/ts-2-root/instance:
uuid: "f6bda747ed164edc92da287bd74bfe09"
format_stamp: "Formatted at 2026-07-09 12:14:35 on dist-test-slave-9q7n"
I20260709 12:14:35.398094 25053 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55218
I20260709 12:14:35.403411 12986 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.000s	sys 0.004s
I20260709 12:14:35.407450 25266 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:35.408316 12986 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 12:14:35.408655 12986 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598886212958-12986-0/minicluster-data/ts-2-root
uuid: "f6bda747ed164edc92da287bd74bfe09"
format_stamp: "Formatted at 2026-07-09 12:14:35 on dist-test-slave-9q7n"
I20260709 12:14:35.408949 12986 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598886212958-12986-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598886212958-12986-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598886212958-12986-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:14:35.443980 12986 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:14:35.445305 12986 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:14:35.447237 12986 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:14:35.449817 12986 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:14:35.450045 12986 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:35.450304 12986 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:14:35.450464 12986 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:35.498780 12986 rpc_server.cc:307] RPC server started. Bound to: 127.12.174.131:38155
I20260709 12:14:35.498979 25328 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.174.131:38155 every 8 connection(s)
I20260709 12:14:35.514568 25329 heartbeater.cc:344] Connected to a master server at 127.12.174.190:35103
I20260709 12:14:35.515103 25329 heartbeater.cc:461] Registering TS with master...
I20260709 12:14:35.515992 25329 heartbeater.cc:507] Master 127.12.174.190:35103 requested a full tablet report, sending...
I20260709 12:14:35.518200 25053 ts_manager.cc:194] Registered new tserver with Master: f6bda747ed164edc92da287bd74bfe09 (127.12.174.131:38155)
I20260709 12:14:35.519333 12986 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016654727s
I20260709 12:14:35.520202 25053 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55234
I20260709 12:14:35.547956 25053 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55236:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:14:35.550354 25053 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:14:35.610562 25220 tablet_service.cc:1511] Processing CreateTablet for tablet 0f3f10dc1540463da3ee13fb25421fb4 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=e79d8aef43aa4ff3b3dd5f61ade09e95]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:14:35.613965 25145 tablet_service.cc:1511] Processing CreateTablet for tablet 0f3f10dc1540463da3ee13fb25421fb4 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=e79d8aef43aa4ff3b3dd5f61ade09e95]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:14:35.614358 25144 tablet_service.cc:1511] Processing CreateTablet for tablet aba6f0e01aed4f529d4095e920aa6db3 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=e79d8aef43aa4ff3b3dd5f61ade09e95]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:14:35.610731 25219 tablet_service.cc:1511] Processing CreateTablet for tablet aba6f0e01aed4f529d4095e920aa6db3 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=e79d8aef43aa4ff3b3dd5f61ade09e95]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:14:35.615720 25144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aba6f0e01aed4f529d4095e920aa6db3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:35.616384 25145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f3f10dc1540463da3ee13fb25421fb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:35.616364 25219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aba6f0e01aed4f529d4095e920aa6db3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:35.619658 25220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f3f10dc1540463da3ee13fb25421fb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:35.637706 25294 tablet_service.cc:1511] Processing CreateTablet for tablet 0f3f10dc1540463da3ee13fb25421fb4 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=e79d8aef43aa4ff3b3dd5f61ade09e95]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:14:35.639448 25294 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f3f10dc1540463da3ee13fb25421fb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:35.645151 25293 tablet_service.cc:1511] Processing CreateTablet for tablet aba6f0e01aed4f529d4095e920aa6db3 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=e79d8aef43aa4ff3b3dd5f61ade09e95]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:14:35.646757 25293 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aba6f0e01aed4f529d4095e920aa6db3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:35.662065 25345 tablet_bootstrap.cc:492] T 0f3f10dc1540463da3ee13fb25421fb4 P fc7521eed4d2442b8ef186e049d4066a: Bootstrap starting.
I20260709 12:14:35.671571 25345 tablet_bootstrap.cc:654] T 0f3f10dc1540463da3ee13fb25421fb4 P fc7521eed4d2442b8ef186e049d4066a: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:35.676618 25344 tablet_bootstrap.cc:492] T 0f3f10dc1540463da3ee13fb25421fb4 P e36ce9c75f594ca7a7f3b05364492a6d: Bootstrap starting.
I20260709 12:14:35.678020 25346 tablet_bootstrap.cc:492] T aba6f0e01aed4f529d4095e920aa6db3 P f6bda747ed164edc92da287bd74bfe09: Bootstrap starting.
I20260709 12:14:35.684077 25345 tablet_bootstrap.cc:492] T 0f3f10dc1540463da3ee13fb25421fb4 P fc7521eed4d2442b8ef186e049d4066a: No bootstrap required, opened a new log
I20260709 12:14:35.684830 25344 tablet_bootstrap.cc:654] T 0f3f10dc1540463da3ee13fb25421fb4 P e36ce9c75f594ca7a7f3b05364492a6d: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:35.684894 25345 ts_tablet_manager.cc:1403] T 0f3f10dc1540463da3ee13fb25421fb4 P fc7521eed4d2442b8ef186e049d4066a: Time spent bootstrapping tablet: real 0.023s	user 0.013s	sys 0.009s
I20260709 12:14:35.688366 25346 tablet_bootstrap.cc:654] T aba6f0e01aed4f529d4095e920aa6db3 P f6bda747ed164edc92da287bd74bfe09: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:35.688839 25345 raft_consensus.cc:359] T 0f3f10dc1540463da3ee13fb25421fb4 P fc7521eed4d2442b8ef186e049d4066a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36ce9c75f594ca7a7f3b05364492a6d" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 33439 } } peers { permanent_uuid: "fc7521eed4d2442b8ef186e049d4066a" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34155 } } peers { permanent_uuid: "f6bda747ed164edc92da287bd74bfe09" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 38155 } }
I20260709 12:14:35.689760 25345 raft_consensus.cc:385] T 0f3f10dc1540463da3ee13fb25421fb4 P fc7521eed4d2442b8ef186e049d4066a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:35.690054 25344 tablet_bootstrap.cc:492] T 0f3f10dc1540463da3ee13fb25421fb4 P e36ce9c75f594ca7a7f3b05364492a6d: No bootstrap required, opened a new log
I20260709 12:14:35.690090 25345 raft_consensus.cc:740] T 0f3f10dc1540463da3ee13fb25421fb4 P fc7521eed4d2442b8ef186e049d4066a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc7521eed4d2442b8ef186e049d4066a, State: Initialized, Role: FOLLOWER
I20260709 12:14:35.690608 25344 ts_tablet_manager.cc:1403] T 0f3f10dc1540463da3ee13fb25421fb4 P e36ce9c75f594ca7a7f3b05364492a6d: Time spent bootstrapping tablet: real 0.014s	user 0.005s	sys 0.008s
I20260709 12:14:35.691267 25345 consensus_queue.cc:260] T 0f3f10dc1540463da3ee13fb25421fb4 P fc7521eed4d2442b8ef186e049d4066a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36ce9c75f594ca7a7f3b05364492a6d" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 33439 } } peers { permanent_uuid: "fc7521eed4d2442b8ef186e049d4066a" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34155 } } peers { permanent_uuid: "f6bda747ed164edc92da287bd74bfe09" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 38155 } }
I20260709 12:14:35.694331 25180 heartbeater.cc:499] Master 127.12.174.190:35103 was elected leader, sending a full tablet report...
I20260709 12:14:35.693918 25344 raft_consensus.cc:359] T 0f3f10dc1540463da3ee13fb25421fb4 P e36ce9c75f594ca7a7f3b05364492a6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36ce9c75f594ca7a7f3b05364492a6d" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 33439 } } peers { permanent_uuid: "fc7521eed4d2442b8ef186e049d4066a" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34155 } } peers { permanent_uuid: "f6bda747ed164edc92da287bd74bfe09" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 38155 } }
I20260709 12:14:35.694839 25344 raft_consensus.cc:385] T 0f3f10dc1540463da3ee13fb25421fb4 P e36ce9c75f594ca7a7f3b05364492a6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:35.694957 25345 ts_tablet_manager.cc:1434] T 0f3f10dc1540463da3ee13fb25421fb4 P fc7521eed4d2442b8ef186e049d4066a: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 12:14:35.695196 25344 raft_consensus.cc:740] T 0f3f10dc1540463da3ee13fb25421fb4 P e36ce9c75f594ca7a7f3b05364492a6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e36ce9c75f594ca7a7f3b05364492a6d, State: Initialized, Role: FOLLOWER
I20260709 12:14:35.696167 25344 consensus_queue.cc:260] T 0f3f10dc1540463da3ee13fb25421fb4 P e36ce9c75f594ca7a7f3b05364492a6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36ce9c75f594ca7a7f3b05364492a6d" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 33439 } } peers { permanent_uuid: "fc7521eed4d2442b8ef186e049d4066a" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34155 } } peers { permanent_uuid: "f6bda747ed164edc92da287bd74bfe09" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 38155 } }
I20260709 12:14:35.697543 25345 tablet_bootstrap.cc:492] T aba6f0e01aed4f529d4095e920aa6db3 P fc7521eed4d2442b8ef186e049d4066a: Bootstrap starting.
I20260709 12:14:35.702333 25346 tablet_bootstrap.cc:492] T aba6f0e01aed4f529d4095e920aa6db3 P f6bda747ed164edc92da287bd74bfe09: No bootstrap required, opened a new log
I20260709 12:14:35.703002 25346 ts_tablet_manager.cc:1403] T aba6f0e01aed4f529d4095e920aa6db3 P f6bda747ed164edc92da287bd74bfe09: Time spent bootstrapping tablet: real 0.026s	user 0.009s	sys 0.012s
I20260709 12:14:35.705160 25255 heartbeater.cc:499] Master 127.12.174.190:35103 was elected leader, sending a full tablet report...
I20260709 12:14:35.706406 25346 raft_consensus.cc:359] T aba6f0e01aed4f529d4095e920aa6db3 P f6bda747ed164edc92da287bd74bfe09 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc7521eed4d2442b8ef186e049d4066a" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34155 } } peers { permanent_uuid: "e36ce9c75f594ca7a7f3b05364492a6d" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 33439 } } peers { permanent_uuid: "f6bda747ed164edc92da287bd74bfe09" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 38155 } }
I20260709 12:14:35.706879 25345 tablet_bootstrap.cc:654] T aba6f0e01aed4f529d4095e920aa6db3 P fc7521eed4d2442b8ef186e049d4066a: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:35.707118 25346 raft_consensus.cc:385] T aba6f0e01aed4f529d4095e920aa6db3 P f6bda747ed164edc92da287bd74bfe09 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:35.707508 25346 raft_consensus.cc:740] T aba6f0e01aed4f529d4095e920aa6db3 P f6bda747ed164edc92da287bd74bfe09 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6bda747ed164edc92da287bd74bfe09, State: Initialized, Role: FOLLOWER
I20260709 12:14:35.708359 25346 consensus_queue.cc:260] T aba6f0e01aed4f529d4095e920aa6db3 P f6bda747ed164edc92da287bd74bfe09 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc7521eed4d2442b8ef186e049d4066a" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34155 } } peers { permanent_uuid: "e36ce9c75f594ca7a7f3b05364492a6d" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 33439 } } peers { permanent_uuid: "f6bda747ed164edc92da287bd74bfe09" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 38155 } }
I20260709 12:14:35.712123 25344 ts_tablet_manager.cc:1434] T 0f3f10dc1540463da3ee13fb25421fb4 P e36ce9c75f594ca7a7f3b05364492a6d: Time spent starting tablet: real 0.021s	user 0.009s	sys 0.000s
I20260709 12:14:35.713697 25344 tablet_bootstrap.cc:492] T aba6f0e01aed4f529d4095e920aa6db3 P e36ce9c75f594ca7a7f3b05364492a6d: Bootstrap starting.
I20260709 12:14:35.718364 25351 raft_consensus.cc:493] T 0f3f10dc1540463da3ee13fb25421fb4 P e36ce9c75f594ca7a7f3b05364492a6d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:35.719188 25351 raft_consensus.cc:515] T 0f3f10dc1540463da3ee13fb25421fb4 P e36ce9c75f594ca7a7f3b05364492a6d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36ce9c75f594ca7a7f3b05364492a6d" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 33439 } } peers { permanent_uuid: "fc7521eed4d2442b8ef186e049d4066a" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34155 } } peers { permanent_uuid: "f6bda747ed164edc92da287bd74bfe09" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 38155 } }
I20260709 12:14:35.723755 25346 ts_tablet_manager.cc:1434] T aba6f0e01aed4f529d4095e920aa6db3 P f6bda747ed164edc92da287bd74bfe09: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.015s
I20260709 12:14:35.725036 25329 heartbeater.cc:499] Master 127.12.174.190:35103 was elected leader, sending a full tablet report...
I20260709 12:14:35.726171 25344 tablet_bootstrap.cc:654] T aba6f0e01aed4f529d4095e920aa6db3 P e36ce9c75f594ca7a7f3b05364492a6d: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:35.736323 25346 tablet_bootstrap.cc:492] T 0f3f10dc1540463da3ee13fb25421fb4 P f6bda747ed164edc92da287bd74bfe09: Bootstrap starting.
I20260709 12:14:35.744676 25346 tablet_bootstrap.cc:654] T 0f3f10dc1540463da3ee13fb25421fb4 P f6bda747ed164edc92da287bd74bfe09: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:35.748425 25344 tablet_bootstrap.cc:492] T aba6f0e01aed4f529d4095e920aa6db3 P e36ce9c75f594ca7a7f3b05364492a6d: No bootstrap required, opened a new log
I20260709 12:14:35.749117 25344 ts_tablet_manager.cc:1403] T aba6f0e01aed4f529d4095e920aa6db3 P e36ce9c75f594ca7a7f3b05364492a6d: Time spent bootstrapping tablet: real 0.036s	user 0.008s	sys 0.009s
I20260709 12:14:35.753330 25345 tablet_bootstrap.cc:492] T aba6f0e01aed4f529d4095e920aa6db3 P fc7521eed4d2442b8ef186e049d4066a: No bootstrap required, opened a new log
I20260709 12:14:35.756160 25345 ts_tablet_manager.cc:1403] T aba6f0e01aed4f529d4095e920aa6db3 P fc7521eed4d2442b8ef186e049d4066a: Time spent bootstrapping tablet: real 0.059s	user 0.020s	sys 0.007s
I20260709 12:14:35.757474 25155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f10dc1540463da3ee13fb25421fb4" candidate_uuid: "e36ce9c75f594ca7a7f3b05364492a6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc7521eed4d2442b8ef186e049d4066a" is_pre_election: true
I20260709 12:14:35.758517 25155 raft_consensus.cc:2468] T 0f3f10dc1540463da3ee13fb25421fb4 P fc7521eed4d2442b8ef186e049d4066a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e36ce9c75f594ca7a7f3b05364492a6d in term 0.
I20260709 12:14:35.760689 25193 leader_election.cc:304] T 0f3f10dc1540463da3ee13fb25421fb4 P e36ce9c75f594ca7a7f3b05364492a6d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e36ce9c75f594ca7a7f3b05364492a6d, fc7521eed4d2442b8ef186e049d4066a; no voters: 
I20260709 12:14:35.764185 25344 raft_consensus.cc:359] T aba6f0e01aed4f529d4095e920aa6db3 P e36ce9c75f594ca7a7f3b05364492a6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc7521eed4d2442b8ef186e049d4066a" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34155 } } peers { permanent_uuid: "e36ce9c75f594ca7a7f3b05364492a6d" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 33439 } } peers { permanent_uuid: "f6bda747ed164edc92da287bd74bfe09" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 38155 } }
I20260709 12:14:35.765175 25344 raft_consensus.cc:385] T aba6f0e01aed4f529d4095e920aa6db3 P e36ce9c75f594ca7a7f3b05364492a6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:35.766880 25351 leader_election.cc:290] T 0f3f10dc1540463da3ee13fb25421fb4 P e36ce9c75f594ca7a7f3b05364492a6d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc7521eed4d2442b8ef186e049d4066a (127.12.174.129:34155), f6bda747ed164edc92da287bd74bfe09 (127.12.174.131:38155)
I20260709 12:14:35.765486 25344 raft_consensus.cc:740] T aba6f0e01aed4f529d4095e920aa6db3 P e36ce9c75f594ca7a7f3b05364492a6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e36ce9c75f594ca7a7f3b05364492a6d, State: Initialized, Role: FOLLOWER
I20260709 12:14:35.767709 25351 raft_consensus.cc:2804] T 0f3f10dc1540463da3ee13fb25421fb4 P e36ce9c75f594ca7a7f3b05364492a6d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:35.768388 25351 raft_consensus.cc:493] T 0f3f10dc1540463da3ee13fb25421fb4 P e36ce9c75f594ca7a7f3b05364492a6d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:35.768837 25351 raft_consensus.cc:3060] T 0f3f10dc1540463da3ee13fb25421fb4 P e36ce9c75f594ca7a7f3b05364492a6d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:35.768463 25344 consensus_queue.cc:260] T aba6f0e01aed4f529d4095e920aa6db3 P e36ce9c75f594ca7a7f3b05364492a6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc7521eed4d2442b8ef186e049d4066a" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34155 } } peers { permanent_uuid: "e36ce9c75f594ca7a7f3b05364492a6d" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 33439 } } peers { permanent_uuid: "f6bda747ed164edc92da287bd74bfe09" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 38155 } }
I20260709 12:14:35.767719 25345 raft_consensus.cc:359] T aba6f0e01aed4f529d4095e920aa6db3 P fc7521eed4d2442b8ef186e049d4066a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc7521eed4d2442b8ef186e049d4066a" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34155 } } peers { permanent_uuid: "e36ce9c75f594ca7a7f3b05364492a6d" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 33439 } } peers { permanent_uuid: "f6bda747ed164edc92da287bd74bfe09" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 38155 } }
I20260709 12:14:35.770220 25345 raft_consensus.cc:385] T aba6f0e01aed4f529d4095e920aa6db3 P fc7521eed4d2442b8ef186e049d4066a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:35.770548 25345 raft_consensus.cc:740] T aba6f0e01aed4f529d4095e920aa6db3 P fc7521eed4d2442b8ef186e049d4066a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc7521eed4d2442b8ef186e049d4066a, State: Initialized, Role: FOLLOWER
I20260709 12:14:35.771342 25344 ts_tablet_manager.cc:1434] T aba6f0e01aed4f529d4095e920aa6db3 P e36ce9c75f594ca7a7f3b05364492a6d: Time spent starting tablet: real 0.022s	user 0.004s	sys 0.004s
I20260709 12:14:35.772663 25346 tablet_bootstrap.cc:492] T 0f3f10dc1540463da3ee13fb25421fb4 P f6bda747ed164edc92da287bd74bfe09: No bootstrap required, opened a new log
I20260709 12:14:35.773386 25346 ts_tablet_manager.cc:1403] T 0f3f10dc1540463da3ee13fb25421fb4 P f6bda747ed164edc92da287bd74bfe09: Time spent bootstrapping tablet: real 0.037s	user 0.022s	sys 0.014s
I20260709 12:14:35.773978 25345 consensus_queue.cc:260] T aba6f0e01aed4f529d4095e920aa6db3 P fc7521eed4d2442b8ef186e049d4066a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc7521eed4d2442b8ef186e049d4066a" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34155 } } peers { permanent_uuid: "e36ce9c75f594ca7a7f3b05364492a6d" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 33439 } } peers { permanent_uuid: "f6bda747ed164edc92da287bd74bfe09" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 38155 } }
I20260709 12:14:35.777304 25346 raft_consensus.cc:359] T 0f3f10dc1540463da3ee13fb25421fb4 P f6bda747ed164edc92da287bd74bfe09 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36ce9c75f594ca7a7f3b05364492a6d" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 33439 } } peers { permanent_uuid: "fc7521eed4d2442b8ef186e049d4066a" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34155 } } peers { permanent_uuid: "f6bda747ed164edc92da287bd74bfe09" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 38155 } }
I20260709 12:14:35.778306 25346 raft_consensus.cc:385] T 0f3f10dc1540463da3ee13fb25421fb4 P f6bda747ed164edc92da287bd74bfe09 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:35.778712 25345 ts_tablet_manager.cc:1434] T aba6f0e01aed4f529d4095e920aa6db3 P fc7521eed4d2442b8ef186e049d4066a: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.000s
I20260709 12:14:35.778719 25346 raft_consensus.cc:740] T 0f3f10dc1540463da3ee13fb25421fb4 P f6bda747ed164edc92da287bd74bfe09 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6bda747ed164edc92da287bd74bfe09, State: Initialized, Role: FOLLOWER
I20260709 12:14:35.781163 25346 consensus_queue.cc:260] T 0f3f10dc1540463da3ee13fb25421fb4 P f6bda747ed164edc92da287bd74bfe09 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36ce9c75f594ca7a7f3b05364492a6d" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 33439 } } peers { permanent_uuid: "fc7521eed4d2442b8ef186e049d4066a" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34155 } } peers { permanent_uuid: "f6bda747ed164edc92da287bd74bfe09" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 38155 } }
I20260709 12:14:35.782167 25351 raft_consensus.cc:515] T 0f3f10dc1540463da3ee13fb25421fb4 P e36ce9c75f594ca7a7f3b05364492a6d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36ce9c75f594ca7a7f3b05364492a6d" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 33439 } } peers { permanent_uuid: "fc7521eed4d2442b8ef186e049d4066a" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34155 } } peers { permanent_uuid: "f6bda747ed164edc92da287bd74bfe09" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 38155 } }
I20260709 12:14:35.782460 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f10dc1540463da3ee13fb25421fb4" candidate_uuid: "e36ce9c75f594ca7a7f3b05364492a6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6bda747ed164edc92da287bd74bfe09" is_pre_election: true
I20260709 12:14:35.783294 25304 raft_consensus.cc:2468] T 0f3f10dc1540463da3ee13fb25421fb4 P f6bda747ed164edc92da287bd74bfe09 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e36ce9c75f594ca7a7f3b05364492a6d in term 0.
I20260709 12:14:35.783910 25346 ts_tablet_manager.cc:1434] T 0f3f10dc1540463da3ee13fb25421fb4 P f6bda747ed164edc92da287bd74bfe09: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:14:35.784566 25351 leader_election.cc:290] T 0f3f10dc1540463da3ee13fb25421fb4 P e36ce9c75f594ca7a7f3b05364492a6d [CANDIDATE]: Term 1 election: Requested vote from peers fc7521eed4d2442b8ef186e049d4066a (127.12.174.129:34155), f6bda747ed164edc92da287bd74bfe09 (127.12.174.131:38155)
I20260709 12:14:35.787114 25155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f10dc1540463da3ee13fb25421fb4" candidate_uuid: "e36ce9c75f594ca7a7f3b05364492a6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc7521eed4d2442b8ef186e049d4066a"
I20260709 12:14:35.787575 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f10dc1540463da3ee13fb25421fb4" candidate_uuid: "e36ce9c75f594ca7a7f3b05364492a6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6bda747ed164edc92da287bd74bfe09"
I20260709 12:14:35.787945 25155 raft_consensus.cc:3060] T 0f3f10dc1540463da3ee13fb25421fb4 P fc7521eed4d2442b8ef186e049d4066a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:35.788167 25304 raft_consensus.cc:3060] T 0f3f10dc1540463da3ee13fb25421fb4 P f6bda747ed164edc92da287bd74bfe09 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:35.796729 25304 raft_consensus.cc:2468] T 0f3f10dc1540463da3ee13fb25421fb4 P f6bda747ed164edc92da287bd74bfe09 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e36ce9c75f594ca7a7f3b05364492a6d in term 1.
I20260709 12:14:35.798220 25155 raft_consensus.cc:2468] T 0f3f10dc1540463da3ee13fb25421fb4 P fc7521eed4d2442b8ef186e049d4066a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e36ce9c75f594ca7a7f3b05364492a6d in term 1.
I20260709 12:14:35.798224 25193 leader_election.cc:304] T 0f3f10dc1540463da3ee13fb25421fb4 P e36ce9c75f594ca7a7f3b05364492a6d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e36ce9c75f594ca7a7f3b05364492a6d, f6bda747ed164edc92da287bd74bfe09; no voters: 
I20260709 12:14:35.799697 25357 raft_consensus.cc:2804] T 0f3f10dc1540463da3ee13fb25421fb4 P e36ce9c75f594ca7a7f3b05364492a6d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:35.800284 25357 raft_consensus.cc:697] T 0f3f10dc1540463da3ee13fb25421fb4 P e36ce9c75f594ca7a7f3b05364492a6d [term 1 LEADER]: Becoming Leader. State: Replica: e36ce9c75f594ca7a7f3b05364492a6d, State: Running, Role: LEADER
I20260709 12:14:35.801224 25357 consensus_queue.cc:237] T 0f3f10dc1540463da3ee13fb25421fb4 P e36ce9c75f594ca7a7f3b05364492a6d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36ce9c75f594ca7a7f3b05364492a6d" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 33439 } } peers { permanent_uuid: "fc7521eed4d2442b8ef186e049d4066a" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34155 } } peers { permanent_uuid: "f6bda747ed164edc92da287bd74bfe09" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 38155 } }
I20260709 12:14:35.810897 25051 catalog_manager.cc:5697] T 0f3f10dc1540463da3ee13fb25421fb4 P e36ce9c75f594ca7a7f3b05364492a6d reported cstate change: term changed from 0 to 1, leader changed from <none> to e36ce9c75f594ca7a7f3b05364492a6d (127.12.174.130). New cstate: current_term: 1 leader_uuid: "e36ce9c75f594ca7a7f3b05364492a6d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36ce9c75f594ca7a7f3b05364492a6d" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 33439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc7521eed4d2442b8ef186e049d4066a" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6bda747ed164edc92da287bd74bfe09" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 38155 } health_report { overall_health: UNKNOWN } } }
W20260709 12:14:36.088671 25101 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:14:36.191642 25350 raft_consensus.cc:493] T aba6f0e01aed4f529d4095e920aa6db3 P fc7521eed4d2442b8ef186e049d4066a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:36.192283 25350 raft_consensus.cc:515] T aba6f0e01aed4f529d4095e920aa6db3 P fc7521eed4d2442b8ef186e049d4066a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc7521eed4d2442b8ef186e049d4066a" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34155 } } peers { permanent_uuid: "e36ce9c75f594ca7a7f3b05364492a6d" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 33439 } } peers { permanent_uuid: "f6bda747ed164edc92da287bd74bfe09" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 38155 } }
I20260709 12:14:36.192619 25352 raft_consensus.cc:493] T aba6f0e01aed4f529d4095e920aa6db3 P f6bda747ed164edc92da287bd74bfe09 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:36.193235 25352 raft_consensus.cc:515] T aba6f0e01aed4f529d4095e920aa6db3 P f6bda747ed164edc92da287bd74bfe09 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc7521eed4d2442b8ef186e049d4066a" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34155 } } peers { permanent_uuid: "e36ce9c75f594ca7a7f3b05364492a6d" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 33439 } } peers { permanent_uuid: "f6bda747ed164edc92da287bd74bfe09" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 38155 } }
I20260709 12:14:36.195920 25352 leader_election.cc:290] T aba6f0e01aed4f529d4095e920aa6db3 P f6bda747ed164edc92da287bd74bfe09 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc7521eed4d2442b8ef186e049d4066a (127.12.174.129:34155), e36ce9c75f594ca7a7f3b05364492a6d (127.12.174.130:33439)
I20260709 12:14:36.197419 25350 leader_election.cc:290] T aba6f0e01aed4f529d4095e920aa6db3 P fc7521eed4d2442b8ef186e049d4066a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e36ce9c75f594ca7a7f3b05364492a6d (127.12.174.130:33439), f6bda747ed164edc92da287bd74bfe09 (127.12.174.131:38155)
I20260709 12:14:36.204792 25357 raft_consensus.cc:493] T aba6f0e01aed4f529d4095e920aa6db3 P e36ce9c75f594ca7a7f3b05364492a6d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:36.205453 25357 raft_consensus.cc:515] T aba6f0e01aed4f529d4095e920aa6db3 P e36ce9c75f594ca7a7f3b05364492a6d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc7521eed4d2442b8ef186e049d4066a" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34155 } } peers { permanent_uuid: "e36ce9c75f594ca7a7f3b05364492a6d" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 33439 } } peers { permanent_uuid: "f6bda747ed164edc92da287bd74bfe09" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 38155 } }
I20260709 12:14:36.207876 25357 leader_election.cc:290] T aba6f0e01aed4f529d4095e920aa6db3 P e36ce9c75f594ca7a7f3b05364492a6d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc7521eed4d2442b8ef186e049d4066a (127.12.174.129:34155), f6bda747ed164edc92da287bd74bfe09 (127.12.174.131:38155)
I20260709 12:14:36.208736 25155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba6f0e01aed4f529d4095e920aa6db3" candidate_uuid: "e36ce9c75f594ca7a7f3b05364492a6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc7521eed4d2442b8ef186e049d4066a" is_pre_election: true
I20260709 12:14:36.209524 25155 raft_consensus.cc:2468] T aba6f0e01aed4f529d4095e920aa6db3 P fc7521eed4d2442b8ef186e049d4066a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e36ce9c75f594ca7a7f3b05364492a6d in term 0.
I20260709 12:14:36.211947 25193 leader_election.cc:304] T aba6f0e01aed4f529d4095e920aa6db3 P e36ce9c75f594ca7a7f3b05364492a6d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e36ce9c75f594ca7a7f3b05364492a6d, fc7521eed4d2442b8ef186e049d4066a; no voters: 
I20260709 12:14:36.213217 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba6f0e01aed4f529d4095e920aa6db3" candidate_uuid: "fc7521eed4d2442b8ef186e049d4066a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e36ce9c75f594ca7a7f3b05364492a6d" is_pre_election: true
I20260709 12:14:36.213470 25351 consensus_queue.cc:1048] T 0f3f10dc1540463da3ee13fb25421fb4 P e36ce9c75f594ca7a7f3b05364492a6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6bda747ed164edc92da287bd74bfe09" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 38155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:36.214082 25230 raft_consensus.cc:2468] T aba6f0e01aed4f529d4095e920aa6db3 P e36ce9c75f594ca7a7f3b05364492a6d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc7521eed4d2442b8ef186e049d4066a in term 0.
I20260709 12:14:36.214916 25357 raft_consensus.cc:2804] T aba6f0e01aed4f529d4095e920aa6db3 P e36ce9c75f594ca7a7f3b05364492a6d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:36.215580 25121 leader_election.cc:304] T aba6f0e01aed4f529d4095e920aa6db3 P fc7521eed4d2442b8ef186e049d4066a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e36ce9c75f594ca7a7f3b05364492a6d, fc7521eed4d2442b8ef186e049d4066a; no voters: 
I20260709 12:14:36.215287 25155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba6f0e01aed4f529d4095e920aa6db3" candidate_uuid: "f6bda747ed164edc92da287bd74bfe09" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc7521eed4d2442b8ef186e049d4066a" is_pre_election: true
I20260709 12:14:36.216399 25155 raft_consensus.cc:2468] T aba6f0e01aed4f529d4095e920aa6db3 P fc7521eed4d2442b8ef186e049d4066a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6bda747ed164edc92da287bd74bfe09 in term 0.
I20260709 12:14:36.215358 25357 raft_consensus.cc:493] T aba6f0e01aed4f529d4095e920aa6db3 P e36ce9c75f594ca7a7f3b05364492a6d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:36.217029 25357 raft_consensus.cc:3060] T aba6f0e01aed4f529d4095e920aa6db3 P e36ce9c75f594ca7a7f3b05364492a6d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:36.216775 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba6f0e01aed4f529d4095e920aa6db3" candidate_uuid: "e36ce9c75f594ca7a7f3b05364492a6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6bda747ed164edc92da287bd74bfe09" is_pre_election: true
I20260709 12:14:36.217728 25267 leader_election.cc:304] T aba6f0e01aed4f529d4095e920aa6db3 P f6bda747ed164edc92da287bd74bfe09 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f6bda747ed164edc92da287bd74bfe09, fc7521eed4d2442b8ef186e049d4066a; no voters: 
I20260709 12:14:36.217115 25350 raft_consensus.cc:2804] T aba6f0e01aed4f529d4095e920aa6db3 P fc7521eed4d2442b8ef186e049d4066a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:36.218577 25350 raft_consensus.cc:493] T aba6f0e01aed4f529d4095e920aa6db3 P fc7521eed4d2442b8ef186e049d4066a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:36.218962 25350 raft_consensus.cc:3060] T aba6f0e01aed4f529d4095e920aa6db3 P fc7521eed4d2442b8ef186e049d4066a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:36.217917 25304 raft_consensus.cc:2468] T aba6f0e01aed4f529d4095e920aa6db3 P f6bda747ed164edc92da287bd74bfe09 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e36ce9c75f594ca7a7f3b05364492a6d in term 0.
I20260709 12:14:36.221467 25352 raft_consensus.cc:2804] T aba6f0e01aed4f529d4095e920aa6db3 P f6bda747ed164edc92da287bd74bfe09 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:36.223809 25352 raft_consensus.cc:493] T aba6f0e01aed4f529d4095e920aa6db3 P f6bda747ed164edc92da287bd74bfe09 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:36.224277 25352 raft_consensus.cc:3060] T aba6f0e01aed4f529d4095e920aa6db3 P f6bda747ed164edc92da287bd74bfe09 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:36.229209 25357 raft_consensus.cc:515] T aba6f0e01aed4f529d4095e920aa6db3 P e36ce9c75f594ca7a7f3b05364492a6d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc7521eed4d2442b8ef186e049d4066a" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34155 } } peers { permanent_uuid: "e36ce9c75f594ca7a7f3b05364492a6d" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 33439 } } peers { permanent_uuid: "f6bda747ed164edc92da287bd74bfe09" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 38155 } }
I20260709 12:14:36.231855 25357 leader_election.cc:290] T aba6f0e01aed4f529d4095e920aa6db3 P e36ce9c75f594ca7a7f3b05364492a6d [CANDIDATE]: Term 1 election: Requested vote from peers fc7521eed4d2442b8ef186e049d4066a (127.12.174.129:34155), f6bda747ed164edc92da287bd74bfe09 (127.12.174.131:38155)
I20260709 12:14:36.234623 25155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba6f0e01aed4f529d4095e920aa6db3" candidate_uuid: "e36ce9c75f594ca7a7f3b05364492a6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc7521eed4d2442b8ef186e049d4066a"
I20260709 12:14:36.235750 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba6f0e01aed4f529d4095e920aa6db3" candidate_uuid: "e36ce9c75f594ca7a7f3b05364492a6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6bda747ed164edc92da287bd74bfe09"
I20260709 12:14:36.236778 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba6f0e01aed4f529d4095e920aa6db3" candidate_uuid: "f6bda747ed164edc92da287bd74bfe09" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e36ce9c75f594ca7a7f3b05364492a6d" is_pre_election: true
I20260709 12:14:36.237600 25230 raft_consensus.cc:2393] T aba6f0e01aed4f529d4095e920aa6db3 P e36ce9c75f594ca7a7f3b05364492a6d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6bda747ed164edc92da287bd74bfe09 in current term 1: Already voted for candidate e36ce9c75f594ca7a7f3b05364492a6d in this term.
I20260709 12:14:36.239145 25352 raft_consensus.cc:515] T aba6f0e01aed4f529d4095e920aa6db3 P f6bda747ed164edc92da287bd74bfe09 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc7521eed4d2442b8ef186e049d4066a" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34155 } } peers { permanent_uuid: "e36ce9c75f594ca7a7f3b05364492a6d" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 33439 } } peers { permanent_uuid: "f6bda747ed164edc92da287bd74bfe09" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 38155 } }
I20260709 12:14:36.240401 25304 raft_consensus.cc:2393] T aba6f0e01aed4f529d4095e920aa6db3 P f6bda747ed164edc92da287bd74bfe09 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e36ce9c75f594ca7a7f3b05364492a6d in current term 1: Already voted for candidate f6bda747ed164edc92da287bd74bfe09 in this term.
I20260709 12:14:36.241535 25352 leader_election.cc:290] T aba6f0e01aed4f529d4095e920aa6db3 P f6bda747ed164edc92da287bd74bfe09 [CANDIDATE]: Term 1 election: Requested vote from peers fc7521eed4d2442b8ef186e049d4066a (127.12.174.129:34155), e36ce9c75f594ca7a7f3b05364492a6d (127.12.174.130:33439)
I20260709 12:14:36.243548 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba6f0e01aed4f529d4095e920aa6db3" candidate_uuid: "f6bda747ed164edc92da287bd74bfe09" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e36ce9c75f594ca7a7f3b05364492a6d"
I20260709 12:14:36.245157 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba6f0e01aed4f529d4095e920aa6db3" candidate_uuid: "fc7521eed4d2442b8ef186e049d4066a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6bda747ed164edc92da287bd74bfe09" is_pre_election: true
I20260709 12:14:36.246383 25230 raft_consensus.cc:2393] T aba6f0e01aed4f529d4095e920aa6db3 P e36ce9c75f594ca7a7f3b05364492a6d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f6bda747ed164edc92da287bd74bfe09 in current term 1: Already voted for candidate e36ce9c75f594ca7a7f3b05364492a6d in this term.
I20260709 12:14:36.244591 25154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba6f0e01aed4f529d4095e920aa6db3" candidate_uuid: "f6bda747ed164edc92da287bd74bfe09" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc7521eed4d2442b8ef186e049d4066a"
I20260709 12:14:36.247148 25303 raft_consensus.cc:2393] T aba6f0e01aed4f529d4095e920aa6db3 P f6bda747ed164edc92da287bd74bfe09 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc7521eed4d2442b8ef186e049d4066a in current term 1: Already voted for candidate f6bda747ed164edc92da287bd74bfe09 in this term.
I20260709 12:14:36.249684 25350 raft_consensus.cc:515] T aba6f0e01aed4f529d4095e920aa6db3 P fc7521eed4d2442b8ef186e049d4066a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc7521eed4d2442b8ef186e049d4066a" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34155 } } peers { permanent_uuid: "e36ce9c75f594ca7a7f3b05364492a6d" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 33439 } } peers { permanent_uuid: "f6bda747ed164edc92da287bd74bfe09" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 38155 } }
I20260709 12:14:36.251040 25155 raft_consensus.cc:2393] T aba6f0e01aed4f529d4095e920aa6db3 P fc7521eed4d2442b8ef186e049d4066a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e36ce9c75f594ca7a7f3b05364492a6d in current term 1: Already voted for candidate fc7521eed4d2442b8ef186e049d4066a in this term.
I20260709 12:14:36.252094 25270 leader_election.cc:304] T aba6f0e01aed4f529d4095e920aa6db3 P f6bda747ed164edc92da287bd74bfe09 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6bda747ed164edc92da287bd74bfe09; no voters: e36ce9c75f594ca7a7f3b05364492a6d, fc7521eed4d2442b8ef186e049d4066a
I20260709 12:14:36.253700 25193 leader_election.cc:304] T aba6f0e01aed4f529d4095e920aa6db3 P e36ce9c75f594ca7a7f3b05364492a6d [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e36ce9c75f594ca7a7f3b05364492a6d; no voters: f6bda747ed164edc92da287bd74bfe09, fc7521eed4d2442b8ef186e049d4066a
I20260709 12:14:36.254084 25350 leader_election.cc:290] T aba6f0e01aed4f529d4095e920aa6db3 P fc7521eed4d2442b8ef186e049d4066a [CANDIDATE]: Term 1 election: Requested vote from peers e36ce9c75f594ca7a7f3b05364492a6d (127.12.174.130:33439), f6bda747ed164edc92da287bd74bfe09 (127.12.174.131:38155)
I20260709 12:14:36.254807 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba6f0e01aed4f529d4095e920aa6db3" candidate_uuid: "fc7521eed4d2442b8ef186e049d4066a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e36ce9c75f594ca7a7f3b05364492a6d"
I20260709 12:14:36.255699 25230 raft_consensus.cc:2393] T aba6f0e01aed4f529d4095e920aa6db3 P e36ce9c75f594ca7a7f3b05364492a6d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate fc7521eed4d2442b8ef186e049d4066a in current term 1: Already voted for candidate e36ce9c75f594ca7a7f3b05364492a6d in this term.
I20260709 12:14:36.256408 25351 consensus_queue.cc:1048] T 0f3f10dc1540463da3ee13fb25421fb4 P e36ce9c75f594ca7a7f3b05364492a6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc7521eed4d2442b8ef186e049d4066a" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:36.257930 25351 raft_consensus.cc:2749] T aba6f0e01aed4f529d4095e920aa6db3 P e36ce9c75f594ca7a7f3b05364492a6d [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:14:36.259393 25304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba6f0e01aed4f529d4095e920aa6db3" candidate_uuid: "fc7521eed4d2442b8ef186e049d4066a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6bda747ed164edc92da287bd74bfe09"
I20260709 12:14:36.259347 25365 raft_consensus.cc:2749] T aba6f0e01aed4f529d4095e920aa6db3 P f6bda747ed164edc92da287bd74bfe09 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:14:36.261221 25304 raft_consensus.cc:2393] T aba6f0e01aed4f529d4095e920aa6db3 P f6bda747ed164edc92da287bd74bfe09 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate fc7521eed4d2442b8ef186e049d4066a in current term 1: Already voted for candidate f6bda747ed164edc92da287bd74bfe09 in this term.
I20260709 12:14:36.263319 25118 leader_election.cc:304] T aba6f0e01aed4f529d4095e920aa6db3 P fc7521eed4d2442b8ef186e049d4066a [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc7521eed4d2442b8ef186e049d4066a; no voters: e36ce9c75f594ca7a7f3b05364492a6d, f6bda747ed164edc92da287bd74bfe09
I20260709 12:14:36.264678 25350 raft_consensus.cc:2749] T aba6f0e01aed4f529d4095e920aa6db3 P fc7521eed4d2442b8ef186e049d4066a [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 12:14:37.091431 25101 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:14:37.793813 25372 raft_consensus.cc:493] T aba6f0e01aed4f529d4095e920aa6db3 P f6bda747ed164edc92da287bd74bfe09 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:37.794449 25372 raft_consensus.cc:515] T aba6f0e01aed4f529d4095e920aa6db3 P f6bda747ed164edc92da287bd74bfe09 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc7521eed4d2442b8ef186e049d4066a" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34155 } } peers { permanent_uuid: "e36ce9c75f594ca7a7f3b05364492a6d" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 33439 } } peers { permanent_uuid: "f6bda747ed164edc92da287bd74bfe09" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 38155 } }
I20260709 12:14:37.796691 25372 leader_election.cc:290] T aba6f0e01aed4f529d4095e920aa6db3 P f6bda747ed164edc92da287bd74bfe09 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc7521eed4d2442b8ef186e049d4066a (127.12.174.129:34155), e36ce9c75f594ca7a7f3b05364492a6d (127.12.174.130:33439)
I20260709 12:14:37.797605 25155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba6f0e01aed4f529d4095e920aa6db3" candidate_uuid: "f6bda747ed164edc92da287bd74bfe09" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc7521eed4d2442b8ef186e049d4066a" is_pre_election: true
I20260709 12:14:37.797773 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba6f0e01aed4f529d4095e920aa6db3" candidate_uuid: "f6bda747ed164edc92da287bd74bfe09" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e36ce9c75f594ca7a7f3b05364492a6d" is_pre_election: true
I20260709 12:14:37.798377 25155 raft_consensus.cc:2468] T aba6f0e01aed4f529d4095e920aa6db3 P fc7521eed4d2442b8ef186e049d4066a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6bda747ed164edc92da287bd74bfe09 in term 1.
I20260709 12:14:37.798460 25230 raft_consensus.cc:2468] T aba6f0e01aed4f529d4095e920aa6db3 P e36ce9c75f594ca7a7f3b05364492a6d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6bda747ed164edc92da287bd74bfe09 in term 1.
I20260709 12:14:37.799592 25267 leader_election.cc:304] T aba6f0e01aed4f529d4095e920aa6db3 P f6bda747ed164edc92da287bd74bfe09 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f6bda747ed164edc92da287bd74bfe09, fc7521eed4d2442b8ef186e049d4066a; no voters: 
I20260709 12:14:37.800349 25372 raft_consensus.cc:2804] T aba6f0e01aed4f529d4095e920aa6db3 P f6bda747ed164edc92da287bd74bfe09 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:37.800721 25372 raft_consensus.cc:493] T aba6f0e01aed4f529d4095e920aa6db3 P f6bda747ed164edc92da287bd74bfe09 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:37.800985 25372 raft_consensus.cc:3060] T aba6f0e01aed4f529d4095e920aa6db3 P f6bda747ed164edc92da287bd74bfe09 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:37.808077 25372 raft_consensus.cc:515] T aba6f0e01aed4f529d4095e920aa6db3 P f6bda747ed164edc92da287bd74bfe09 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc7521eed4d2442b8ef186e049d4066a" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34155 } } peers { permanent_uuid: "e36ce9c75f594ca7a7f3b05364492a6d" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 33439 } } peers { permanent_uuid: "f6bda747ed164edc92da287bd74bfe09" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 38155 } }
I20260709 12:14:37.810032 25372 leader_election.cc:290] T aba6f0e01aed4f529d4095e920aa6db3 P f6bda747ed164edc92da287bd74bfe09 [CANDIDATE]: Term 2 election: Requested vote from peers fc7521eed4d2442b8ef186e049d4066a (127.12.174.129:34155), e36ce9c75f594ca7a7f3b05364492a6d (127.12.174.130:33439)
I20260709 12:14:37.810998 25155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba6f0e01aed4f529d4095e920aa6db3" candidate_uuid: "f6bda747ed164edc92da287bd74bfe09" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc7521eed4d2442b8ef186e049d4066a"
I20260709 12:14:37.811290 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba6f0e01aed4f529d4095e920aa6db3" candidate_uuid: "f6bda747ed164edc92da287bd74bfe09" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e36ce9c75f594ca7a7f3b05364492a6d"
I20260709 12:14:37.811648 25155 raft_consensus.cc:3060] T aba6f0e01aed4f529d4095e920aa6db3 P fc7521eed4d2442b8ef186e049d4066a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:37.811944 25230 raft_consensus.cc:3060] T aba6f0e01aed4f529d4095e920aa6db3 P e36ce9c75f594ca7a7f3b05364492a6d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:37.818440 25155 raft_consensus.cc:2468] T aba6f0e01aed4f529d4095e920aa6db3 P fc7521eed4d2442b8ef186e049d4066a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6bda747ed164edc92da287bd74bfe09 in term 2.
I20260709 12:14:37.819451 25230 raft_consensus.cc:2468] T aba6f0e01aed4f529d4095e920aa6db3 P e36ce9c75f594ca7a7f3b05364492a6d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6bda747ed164edc92da287bd74bfe09 in term 2.
I20260709 12:14:37.819896 25267 leader_election.cc:304] T aba6f0e01aed4f529d4095e920aa6db3 P f6bda747ed164edc92da287bd74bfe09 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f6bda747ed164edc92da287bd74bfe09, fc7521eed4d2442b8ef186e049d4066a; no voters: 
I20260709 12:14:37.820837 25372 raft_consensus.cc:2804] T aba6f0e01aed4f529d4095e920aa6db3 P f6bda747ed164edc92da287bd74bfe09 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:37.822021 25372 raft_consensus.cc:697] T aba6f0e01aed4f529d4095e920aa6db3 P f6bda747ed164edc92da287bd74bfe09 [term 2 LEADER]: Becoming Leader. State: Replica: f6bda747ed164edc92da287bd74bfe09, State: Running, Role: LEADER
I20260709 12:14:37.822942 25372 consensus_queue.cc:237] T aba6f0e01aed4f529d4095e920aa6db3 P f6bda747ed164edc92da287bd74bfe09 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc7521eed4d2442b8ef186e049d4066a" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34155 } } peers { permanent_uuid: "e36ce9c75f594ca7a7f3b05364492a6d" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 33439 } } peers { permanent_uuid: "f6bda747ed164edc92da287bd74bfe09" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 38155 } }
I20260709 12:14:37.830658 25053 catalog_manager.cc:5697] T aba6f0e01aed4f529d4095e920aa6db3 P f6bda747ed164edc92da287bd74bfe09 reported cstate change: term changed from 0 to 2, leader changed from <none> to f6bda747ed164edc92da287bd74bfe09 (127.12.174.131). New cstate: current_term: 2 leader_uuid: "f6bda747ed164edc92da287bd74bfe09" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc7521eed4d2442b8ef186e049d4066a" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e36ce9c75f594ca7a7f3b05364492a6d" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 33439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6bda747ed164edc92da287bd74bfe09" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 38155 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:38.258472 25155 raft_consensus.cc:1275] T aba6f0e01aed4f529d4095e920aa6db3 P fc7521eed4d2442b8ef186e049d4066a [term 2 FOLLOWER]: Refusing update from remote peer f6bda747ed164edc92da287bd74bfe09: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:14:38.260016 25372 consensus_queue.cc:1048] T aba6f0e01aed4f529d4095e920aa6db3 P f6bda747ed164edc92da287bd74bfe09 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc7521eed4d2442b8ef186e049d4066a" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:38.277714 25230 raft_consensus.cc:1275] T aba6f0e01aed4f529d4095e920aa6db3 P e36ce9c75f594ca7a7f3b05364492a6d [term 2 FOLLOWER]: Refusing update from remote peer f6bda747ed164edc92da287bd74bfe09: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:14:38.279836 25372 consensus_queue.cc:1048] T aba6f0e01aed4f529d4095e920aa6db3 P f6bda747ed164edc92da287bd74bfe09 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e36ce9c75f594ca7a7f3b05364492a6d" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 33439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:38.302327 25053 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55244:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:14:38.304505 25053 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:14:38.331977 25145 tablet_service.cc:1511] Processing CreateTablet for tablet 4d593b40df004d61b9fa278d58fceb1f (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=43d54a7d5c5c4a19bd528e1877c5dd92]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:14:38.333535 25145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d593b40df004d61b9fa278d58fceb1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:38.333220 25220 tablet_service.cc:1511] Processing CreateTablet for tablet 4d593b40df004d61b9fa278d58fceb1f (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=43d54a7d5c5c4a19bd528e1877c5dd92]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:14:38.334726 25220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d593b40df004d61b9fa278d58fceb1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:38.335007 25293 tablet_service.cc:1511] Processing CreateTablet for tablet 4d593b40df004d61b9fa278d58fceb1f (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=43d54a7d5c5c4a19bd528e1877c5dd92]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:14:38.336462 25293 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d593b40df004d61b9fa278d58fceb1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:38.338522 25219 tablet_service.cc:1511] Processing CreateTablet for tablet b32bf4896acc4050b931c386949bd737 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=43d54a7d5c5c4a19bd528e1877c5dd92]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:14:38.339923 25144 tablet_service.cc:1511] Processing CreateTablet for tablet b32bf4896acc4050b931c386949bd737 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=43d54a7d5c5c4a19bd528e1877c5dd92]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:14:38.341473 25144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b32bf4896acc4050b931c386949bd737. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:38.340000 25219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b32bf4896acc4050b931c386949bd737. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:38.347680 25294 tablet_service.cc:1511] Processing CreateTablet for tablet b32bf4896acc4050b931c386949bd737 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=43d54a7d5c5c4a19bd528e1877c5dd92]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:14:38.349222 25294 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b32bf4896acc4050b931c386949bd737. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:38.371176 25393 tablet_bootstrap.cc:492] T 4d593b40df004d61b9fa278d58fceb1f P f6bda747ed164edc92da287bd74bfe09: Bootstrap starting.
I20260709 12:14:38.382568 25392 tablet_bootstrap.cc:492] T 4d593b40df004d61b9fa278d58fceb1f P e36ce9c75f594ca7a7f3b05364492a6d: Bootstrap starting.
I20260709 12:14:38.383018 25393 tablet_bootstrap.cc:654] T 4d593b40df004d61b9fa278d58fceb1f P f6bda747ed164edc92da287bd74bfe09: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:38.392508 25392 tablet_bootstrap.cc:654] T 4d593b40df004d61b9fa278d58fceb1f P e36ce9c75f594ca7a7f3b05364492a6d: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:38.395028 25394 tablet_bootstrap.cc:492] T 4d593b40df004d61b9fa278d58fceb1f P fc7521eed4d2442b8ef186e049d4066a: Bootstrap starting.
I20260709 12:14:38.403193 25394 tablet_bootstrap.cc:654] T 4d593b40df004d61b9fa278d58fceb1f P fc7521eed4d2442b8ef186e049d4066a: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:38.407202 25392 tablet_bootstrap.cc:492] T 4d593b40df004d61b9fa278d58fceb1f P e36ce9c75f594ca7a7f3b05364492a6d: No bootstrap required, opened a new log
I20260709 12:14:38.407364 25393 tablet_bootstrap.cc:492] T 4d593b40df004d61b9fa278d58fceb1f P f6bda747ed164edc92da287bd74bfe09: No bootstrap required, opened a new log
I20260709 12:14:38.407898 25392 ts_tablet_manager.cc:1403] T 4d593b40df004d61b9fa278d58fceb1f P e36ce9c75f594ca7a7f3b05364492a6d: Time spent bootstrapping tablet: real 0.027s	user 0.007s	sys 0.015s
I20260709 12:14:38.407977 25393 ts_tablet_manager.cc:1403] T 4d593b40df004d61b9fa278d58fceb1f P f6bda747ed164edc92da287bd74bfe09: Time spent bootstrapping tablet: real 0.037s	user 0.013s	sys 0.009s
I20260709 12:14:38.409933 25394 tablet_bootstrap.cc:492] T 4d593b40df004d61b9fa278d58fceb1f P fc7521eed4d2442b8ef186e049d4066a: No bootstrap required, opened a new log
I20260709 12:14:38.410557 25394 ts_tablet_manager.cc:1403] T 4d593b40df004d61b9fa278d58fceb1f P fc7521eed4d2442b8ef186e049d4066a: Time spent bootstrapping tablet: real 0.016s	user 0.013s	sys 0.002s
I20260709 12:14:38.411340 25393 raft_consensus.cc:359] T 4d593b40df004d61b9fa278d58fceb1f P f6bda747ed164edc92da287bd74bfe09 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc7521eed4d2442b8ef186e049d4066a" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34155 } } peers { permanent_uuid: "e36ce9c75f594ca7a7f3b05364492a6d" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 33439 } } peers { permanent_uuid: "f6bda747ed164edc92da287bd74bfe09" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 38155 } }
I20260709 12:14:38.412005 25393 raft_consensus.cc:385] T 4d593b40df004d61b9fa278d58fceb1f P f6bda747ed164edc92da287bd74bfe09 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:38.411720 25392 raft_consensus.cc:359] T 4d593b40df004d61b9fa278d58fceb1f P e36ce9c75f594ca7a7f3b05364492a6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc7521eed4d2442b8ef186e049d4066a" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34155 } } peers { permanent_uuid: "e36ce9c75f594ca7a7f3b05364492a6d" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 33439 } } peers { permanent_uuid: "f6bda747ed164edc92da287bd74bfe09" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 38155 } }
I20260709 12:14:38.412292 25393 raft_consensus.cc:740] T 4d593b40df004d61b9fa278d58fceb1f P f6bda747ed164edc92da287bd74bfe09 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6bda747ed164edc92da287bd74bfe09, State: Initialized, Role: FOLLOWER
I20260709 12:14:38.412626 25392 raft_consensus.cc:385] T 4d593b40df004d61b9fa278d58fceb1f P e36ce9c75f594ca7a7f3b05364492a6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:38.413003 25392 raft_consensus.cc:740] T 4d593b40df004d61b9fa278d58fceb1f P e36ce9c75f594ca7a7f3b05364492a6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e36ce9c75f594ca7a7f3b05364492a6d, State: Initialized, Role: FOLLOWER
I20260709 12:14:38.413287 25393 consensus_queue.cc:260] T 4d593b40df004d61b9fa278d58fceb1f P f6bda747ed164edc92da287bd74bfe09 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc7521eed4d2442b8ef186e049d4066a" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34155 } } peers { permanent_uuid: "e36ce9c75f594ca7a7f3b05364492a6d" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 33439 } } peers { permanent_uuid: "f6bda747ed164edc92da287bd74bfe09" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 38155 } }
I20260709 12:14:38.414013 25394 raft_consensus.cc:359] T 4d593b40df004d61b9fa278d58fceb1f P fc7521eed4d2442b8ef186e049d4066a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc7521eed4d2442b8ef186e049d4066a" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34155 } } peers { permanent_uuid: "e36ce9c75f594ca7a7f3b05364492a6d" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 33439 } } peers { permanent_uuid: "f6bda747ed164edc92da287bd74bfe09" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 38155 } }
I20260709 12:14:38.414115 25392 consensus_queue.cc:260] T 4d593b40df004d61b9fa278d58fceb1f P e36ce9c75f594ca7a7f3b05364492a6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc7521eed4d2442b8ef186e049d4066a" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34155 } } peers { permanent_uuid: "e36ce9c75f594ca7a7f3b05364492a6d" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 33439 } } peers { permanent_uuid: "f6bda747ed164edc92da287bd74bfe09" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 38155 } }
I20260709 12:14:38.414989 25394 raft_consensus.cc:385] T 4d593b40df004d61b9fa278d58fceb1f P fc7521eed4d2442b8ef186e049d4066a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:38.416793 25393 ts_tablet_manager.cc:1434] T 4d593b40df004d61b9fa278d58fceb1f P f6bda747ed164edc92da287bd74bfe09: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:14:38.416833 25392 ts_tablet_manager.cc:1434] T 4d593b40df004d61b9fa278d58fceb1f P e36ce9c75f594ca7a7f3b05364492a6d: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:14:38.417459 25394 raft_consensus.cc:740] T 4d593b40df004d61b9fa278d58fceb1f P fc7521eed4d2442b8ef186e049d4066a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc7521eed4d2442b8ef186e049d4066a, State: Initialized, Role: FOLLOWER
I20260709 12:14:38.418120 25393 tablet_bootstrap.cc:492] T b32bf4896acc4050b931c386949bd737 P f6bda747ed164edc92da287bd74bfe09: Bootstrap starting.
I20260709 12:14:38.418622 25394 consensus_queue.cc:260] T 4d593b40df004d61b9fa278d58fceb1f P fc7521eed4d2442b8ef186e049d4066a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc7521eed4d2442b8ef186e049d4066a" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34155 } } peers { permanent_uuid: "e36ce9c75f594ca7a7f3b05364492a6d" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 33439 } } peers { permanent_uuid: "f6bda747ed164edc92da287bd74bfe09" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 38155 } }
I20260709 12:14:38.419534 25392 tablet_bootstrap.cc:492] T b32bf4896acc4050b931c386949bd737 P e36ce9c75f594ca7a7f3b05364492a6d: Bootstrap starting.
I20260709 12:14:38.424158 25394 ts_tablet_manager.cc:1434] T 4d593b40df004d61b9fa278d58fceb1f P fc7521eed4d2442b8ef186e049d4066a: Time spent starting tablet: real 0.013s	user 0.002s	sys 0.005s
I20260709 12:14:38.425539 25394 tablet_bootstrap.cc:492] T b32bf4896acc4050b931c386949bd737 P fc7521eed4d2442b8ef186e049d4066a: Bootstrap starting.
I20260709 12:14:38.426419 25393 tablet_bootstrap.cc:654] T b32bf4896acc4050b931c386949bd737 P f6bda747ed164edc92da287bd74bfe09: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:38.427295 25392 tablet_bootstrap.cc:654] T b32bf4896acc4050b931c386949bd737 P e36ce9c75f594ca7a7f3b05364492a6d: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:38.447485 25394 tablet_bootstrap.cc:654] T b32bf4896acc4050b931c386949bd737 P fc7521eed4d2442b8ef186e049d4066a: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:38.451179 25392 tablet_bootstrap.cc:492] T b32bf4896acc4050b931c386949bd737 P e36ce9c75f594ca7a7f3b05364492a6d: No bootstrap required, opened a new log
I20260709 12:14:38.451799 25393 tablet_bootstrap.cc:492] T b32bf4896acc4050b931c386949bd737 P f6bda747ed164edc92da287bd74bfe09: No bootstrap required, opened a new log
I20260709 12:14:38.451828 25392 ts_tablet_manager.cc:1403] T b32bf4896acc4050b931c386949bd737 P e36ce9c75f594ca7a7f3b05364492a6d: Time spent bootstrapping tablet: real 0.033s	user 0.023s	sys 0.007s
I20260709 12:14:38.452621 25393 ts_tablet_manager.cc:1403] T b32bf4896acc4050b931c386949bd737 P f6bda747ed164edc92da287bd74bfe09: Time spent bootstrapping tablet: real 0.035s	user 0.014s	sys 0.020s
I20260709 12:14:38.453959 25394 tablet_bootstrap.cc:492] T b32bf4896acc4050b931c386949bd737 P fc7521eed4d2442b8ef186e049d4066a: No bootstrap required, opened a new log
I20260709 12:14:38.454546 25394 ts_tablet_manager.cc:1403] T b32bf4896acc4050b931c386949bd737 P fc7521eed4d2442b8ef186e049d4066a: Time spent bootstrapping tablet: real 0.029s	user 0.006s	sys 0.008s
I20260709 12:14:38.455431 25393 raft_consensus.cc:359] T b32bf4896acc4050b931c386949bd737 P f6bda747ed164edc92da287bd74bfe09 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc7521eed4d2442b8ef186e049d4066a" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34155 } } peers { permanent_uuid: "e36ce9c75f594ca7a7f3b05364492a6d" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 33439 } } peers { permanent_uuid: "f6bda747ed164edc92da287bd74bfe09" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 38155 } }
I20260709 12:14:38.456079 25393 raft_consensus.cc:385] T b32bf4896acc4050b931c386949bd737 P f6bda747ed164edc92da287bd74bfe09 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:38.456552 25393 raft_consensus.cc:740] T b32bf4896acc4050b931c386949bd737 P f6bda747ed164edc92da287bd74bfe09 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6bda747ed164edc92da287bd74bfe09, State: Initialized, Role: FOLLOWER
I20260709 12:14:38.455993 25392 raft_consensus.cc:359] T b32bf4896acc4050b931c386949bd737 P e36ce9c75f594ca7a7f3b05364492a6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc7521eed4d2442b8ef186e049d4066a" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34155 } } peers { permanent_uuid: "e36ce9c75f594ca7a7f3b05364492a6d" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 33439 } } peers { permanent_uuid: "f6bda747ed164edc92da287bd74bfe09" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 38155 } }
I20260709 12:14:38.456987 25392 raft_consensus.cc:385] T b32bf4896acc4050b931c386949bd737 P e36ce9c75f594ca7a7f3b05364492a6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:38.457327 25392 raft_consensus.cc:740] T b32bf4896acc4050b931c386949bd737 P e36ce9c75f594ca7a7f3b05364492a6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e36ce9c75f594ca7a7f3b05364492a6d, State: Initialized, Role: FOLLOWER
I20260709 12:14:38.457317 25393 consensus_queue.cc:260] T b32bf4896acc4050b931c386949bd737 P f6bda747ed164edc92da287bd74bfe09 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc7521eed4d2442b8ef186e049d4066a" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34155 } } peers { permanent_uuid: "e36ce9c75f594ca7a7f3b05364492a6d" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 33439 } } peers { permanent_uuid: "f6bda747ed164edc92da287bd74bfe09" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 38155 } }
I20260709 12:14:38.457891 25394 raft_consensus.cc:359] T b32bf4896acc4050b931c386949bd737 P fc7521eed4d2442b8ef186e049d4066a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc7521eed4d2442b8ef186e049d4066a" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34155 } } peers { permanent_uuid: "e36ce9c75f594ca7a7f3b05364492a6d" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 33439 } } peers { permanent_uuid: "f6bda747ed164edc92da287bd74bfe09" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 38155 } }
I20260709 12:14:38.458390 25392 consensus_queue.cc:260] T b32bf4896acc4050b931c386949bd737 P e36ce9c75f594ca7a7f3b05364492a6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc7521eed4d2442b8ef186e049d4066a" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34155 } } peers { permanent_uuid: "e36ce9c75f594ca7a7f3b05364492a6d" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 33439 } } peers { permanent_uuid: "f6bda747ed164edc92da287bd74bfe09" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 38155 } }
I20260709 12:14:38.459849 25394 raft_consensus.cc:385] T b32bf4896acc4050b931c386949bd737 P fc7521eed4d2442b8ef186e049d4066a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:38.459542 25393 ts_tablet_manager.cc:1434] T b32bf4896acc4050b931c386949bd737 P f6bda747ed164edc92da287bd74bfe09: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:14:38.460173 25394 raft_consensus.cc:740] T b32bf4896acc4050b931c386949bd737 P fc7521eed4d2442b8ef186e049d4066a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc7521eed4d2442b8ef186e049d4066a, State: Initialized, Role: FOLLOWER
I20260709 12:14:38.461030 25394 consensus_queue.cc:260] T b32bf4896acc4050b931c386949bd737 P fc7521eed4d2442b8ef186e049d4066a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc7521eed4d2442b8ef186e049d4066a" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34155 } } peers { permanent_uuid: "e36ce9c75f594ca7a7f3b05364492a6d" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 33439 } } peers { permanent_uuid: "f6bda747ed164edc92da287bd74bfe09" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 38155 } }
I20260709 12:14:38.462531 25392 ts_tablet_manager.cc:1434] T b32bf4896acc4050b931c386949bd737 P e36ce9c75f594ca7a7f3b05364492a6d: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:14:38.463457 25394 ts_tablet_manager.cc:1434] T b32bf4896acc4050b931c386949bd737 P fc7521eed4d2442b8ef186e049d4066a: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.004s
I20260709 12:14:38.492475 25372 raft_consensus.cc:493] T 4d593b40df004d61b9fa278d58fceb1f P f6bda747ed164edc92da287bd74bfe09 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:38.493084 25372 raft_consensus.cc:515] T 4d593b40df004d61b9fa278d58fceb1f P f6bda747ed164edc92da287bd74bfe09 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc7521eed4d2442b8ef186e049d4066a" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34155 } } peers { permanent_uuid: "e36ce9c75f594ca7a7f3b05364492a6d" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 33439 } } peers { permanent_uuid: "f6bda747ed164edc92da287bd74bfe09" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 38155 } }
I20260709 12:14:38.494933 25372 leader_election.cc:290] T 4d593b40df004d61b9fa278d58fceb1f P f6bda747ed164edc92da287bd74bfe09 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc7521eed4d2442b8ef186e049d4066a (127.12.174.129:34155), e36ce9c75f594ca7a7f3b05364492a6d (127.12.174.130:33439)
I20260709 12:14:38.495754 25155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d593b40df004d61b9fa278d58fceb1f" candidate_uuid: "f6bda747ed164edc92da287bd74bfe09" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc7521eed4d2442b8ef186e049d4066a" is_pre_election: true
I20260709 12:14:38.496069 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d593b40df004d61b9fa278d58fceb1f" candidate_uuid: "f6bda747ed164edc92da287bd74bfe09" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e36ce9c75f594ca7a7f3b05364492a6d" is_pre_election: true
I20260709 12:14:38.496397 25155 raft_consensus.cc:2468] T 4d593b40df004d61b9fa278d58fceb1f P fc7521eed4d2442b8ef186e049d4066a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6bda747ed164edc92da287bd74bfe09 in term 0.
I20260709 12:14:38.496706 25230 raft_consensus.cc:2468] T 4d593b40df004d61b9fa278d58fceb1f P e36ce9c75f594ca7a7f3b05364492a6d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6bda747ed164edc92da287bd74bfe09 in term 0.
I20260709 12:14:38.497468 25267 leader_election.cc:304] T 4d593b40df004d61b9fa278d58fceb1f P f6bda747ed164edc92da287bd74bfe09 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f6bda747ed164edc92da287bd74bfe09, fc7521eed4d2442b8ef186e049d4066a; no voters: 
I20260709 12:14:38.498323 25372 raft_consensus.cc:2804] T 4d593b40df004d61b9fa278d58fceb1f P f6bda747ed164edc92da287bd74bfe09 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:38.498647 25372 raft_consensus.cc:493] T 4d593b40df004d61b9fa278d58fceb1f P f6bda747ed164edc92da287bd74bfe09 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:38.498917 25372 raft_consensus.cc:3060] T 4d593b40df004d61b9fa278d58fceb1f P f6bda747ed164edc92da287bd74bfe09 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:38.505602 25372 raft_consensus.cc:515] T 4d593b40df004d61b9fa278d58fceb1f P f6bda747ed164edc92da287bd74bfe09 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc7521eed4d2442b8ef186e049d4066a" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34155 } } peers { permanent_uuid: "e36ce9c75f594ca7a7f3b05364492a6d" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 33439 } } peers { permanent_uuid: "f6bda747ed164edc92da287bd74bfe09" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 38155 } }
I20260709 12:14:38.506778 25379 raft_consensus.cc:493] T b32bf4896acc4050b931c386949bd737 P fc7521eed4d2442b8ef186e049d4066a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:38.507558 25372 leader_election.cc:290] T 4d593b40df004d61b9fa278d58fceb1f P f6bda747ed164edc92da287bd74bfe09 [CANDIDATE]: Term 1 election: Requested vote from peers fc7521eed4d2442b8ef186e049d4066a (127.12.174.129:34155), e36ce9c75f594ca7a7f3b05364492a6d (127.12.174.130:33439)
I20260709 12:14:38.507367 25379 raft_consensus.cc:515] T b32bf4896acc4050b931c386949bd737 P fc7521eed4d2442b8ef186e049d4066a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc7521eed4d2442b8ef186e049d4066a" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34155 } } peers { permanent_uuid: "e36ce9c75f594ca7a7f3b05364492a6d" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 33439 } } peers { permanent_uuid: "f6bda747ed164edc92da287bd74bfe09" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 38155 } }
I20260709 12:14:38.508641 25155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d593b40df004d61b9fa278d58fceb1f" candidate_uuid: "f6bda747ed164edc92da287bd74bfe09" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc7521eed4d2442b8ef186e049d4066a"
I20260709 12:14:38.508700 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d593b40df004d61b9fa278d58fceb1f" candidate_uuid: "f6bda747ed164edc92da287bd74bfe09" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e36ce9c75f594ca7a7f3b05364492a6d"
I20260709 12:14:38.509512 25155 raft_consensus.cc:3060] T 4d593b40df004d61b9fa278d58fceb1f P fc7521eed4d2442b8ef186e049d4066a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:38.509596 25230 raft_consensus.cc:3060] T 4d593b40df004d61b9fa278d58fceb1f P e36ce9c75f594ca7a7f3b05364492a6d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:38.510053 25379 leader_election.cc:290] T b32bf4896acc4050b931c386949bd737 P fc7521eed4d2442b8ef186e049d4066a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e36ce9c75f594ca7a7f3b05364492a6d (127.12.174.130:33439), f6bda747ed164edc92da287bd74bfe09 (127.12.174.131:38155)
I20260709 12:14:38.510969 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32bf4896acc4050b931c386949bd737" candidate_uuid: "fc7521eed4d2442b8ef186e049d4066a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e36ce9c75f594ca7a7f3b05364492a6d" is_pre_election: true
I20260709 12:14:38.511708 25229 raft_consensus.cc:2468] T b32bf4896acc4050b931c386949bd737 P e36ce9c75f594ca7a7f3b05364492a6d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc7521eed4d2442b8ef186e049d4066a in term 0.
I20260709 12:14:38.512055 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32bf4896acc4050b931c386949bd737" candidate_uuid: "fc7521eed4d2442b8ef186e049d4066a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6bda747ed164edc92da287bd74bfe09" is_pre_election: true
I20260709 12:14:38.512770 25303 raft_consensus.cc:2468] T b32bf4896acc4050b931c386949bd737 P f6bda747ed164edc92da287bd74bfe09 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc7521eed4d2442b8ef186e049d4066a in term 0.
I20260709 12:14:38.512957 25121 leader_election.cc:304] T b32bf4896acc4050b931c386949bd737 P fc7521eed4d2442b8ef186e049d4066a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e36ce9c75f594ca7a7f3b05364492a6d, fc7521eed4d2442b8ef186e049d4066a; no voters: 
I20260709 12:14:38.514075 25379 raft_consensus.cc:2804] T b32bf4896acc4050b931c386949bd737 P fc7521eed4d2442b8ef186e049d4066a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:38.514487 25379 raft_consensus.cc:493] T b32bf4896acc4050b931c386949bd737 P fc7521eed4d2442b8ef186e049d4066a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:38.514838 25379 raft_consensus.cc:3060] T b32bf4896acc4050b931c386949bd737 P fc7521eed4d2442b8ef186e049d4066a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:38.519297 25230 raft_consensus.cc:2468] T 4d593b40df004d61b9fa278d58fceb1f P e36ce9c75f594ca7a7f3b05364492a6d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6bda747ed164edc92da287bd74bfe09 in term 1.
I20260709 12:14:38.520853 25270 leader_election.cc:304] T 4d593b40df004d61b9fa278d58fceb1f P f6bda747ed164edc92da287bd74bfe09 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e36ce9c75f594ca7a7f3b05364492a6d, f6bda747ed164edc92da287bd74bfe09; no voters: 
I20260709 12:14:38.521833 25372 raft_consensus.cc:2804] T 4d593b40df004d61b9fa278d58fceb1f P f6bda747ed164edc92da287bd74bfe09 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:38.521880 25155 raft_consensus.cc:2468] T 4d593b40df004d61b9fa278d58fceb1f P fc7521eed4d2442b8ef186e049d4066a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6bda747ed164edc92da287bd74bfe09 in term 1.
I20260709 12:14:38.522483 25372 raft_consensus.cc:697] T 4d593b40df004d61b9fa278d58fceb1f P f6bda747ed164edc92da287bd74bfe09 [term 1 LEADER]: Becoming Leader. State: Replica: f6bda747ed164edc92da287bd74bfe09, State: Running, Role: LEADER
I20260709 12:14:38.523277 25379 raft_consensus.cc:515] T b32bf4896acc4050b931c386949bd737 P fc7521eed4d2442b8ef186e049d4066a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc7521eed4d2442b8ef186e049d4066a" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34155 } } peers { permanent_uuid: "e36ce9c75f594ca7a7f3b05364492a6d" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 33439 } } peers { permanent_uuid: "f6bda747ed164edc92da287bd74bfe09" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 38155 } }
I20260709 12:14:38.523525 25372 consensus_queue.cc:237] T 4d593b40df004d61b9fa278d58fceb1f P f6bda747ed164edc92da287bd74bfe09 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc7521eed4d2442b8ef186e049d4066a" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34155 } } peers { permanent_uuid: "e36ce9c75f594ca7a7f3b05364492a6d" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 33439 } } peers { permanent_uuid: "f6bda747ed164edc92da287bd74bfe09" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 38155 } }
I20260709 12:14:38.525635 25379 leader_election.cc:290] T b32bf4896acc4050b931c386949bd737 P fc7521eed4d2442b8ef186e049d4066a [CANDIDATE]: Term 1 election: Requested vote from peers e36ce9c75f594ca7a7f3b05364492a6d (127.12.174.130:33439), f6bda747ed164edc92da287bd74bfe09 (127.12.174.131:38155)
I20260709 12:14:38.526345 25230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32bf4896acc4050b931c386949bd737" candidate_uuid: "fc7521eed4d2442b8ef186e049d4066a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e36ce9c75f594ca7a7f3b05364492a6d"
I20260709 12:14:38.526932 25230 raft_consensus.cc:3060] T b32bf4896acc4050b931c386949bd737 P e36ce9c75f594ca7a7f3b05364492a6d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:38.526780 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32bf4896acc4050b931c386949bd737" candidate_uuid: "fc7521eed4d2442b8ef186e049d4066a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6bda747ed164edc92da287bd74bfe09"
I20260709 12:14:38.527666 25303 raft_consensus.cc:3060] T b32bf4896acc4050b931c386949bd737 P f6bda747ed164edc92da287bd74bfe09 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:38.533370 25053 catalog_manager.cc:5697] T 4d593b40df004d61b9fa278d58fceb1f P f6bda747ed164edc92da287bd74bfe09 reported cstate change: term changed from 0 to 1, leader changed from <none> to f6bda747ed164edc92da287bd74bfe09 (127.12.174.131). New cstate: current_term: 1 leader_uuid: "f6bda747ed164edc92da287bd74bfe09" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc7521eed4d2442b8ef186e049d4066a" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e36ce9c75f594ca7a7f3b05364492a6d" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 33439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6bda747ed164edc92da287bd74bfe09" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 38155 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:38.534780 25230 raft_consensus.cc:2468] T b32bf4896acc4050b931c386949bd737 P e36ce9c75f594ca7a7f3b05364492a6d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc7521eed4d2442b8ef186e049d4066a in term 1.
I20260709 12:14:38.535960 25121 leader_election.cc:304] T b32bf4896acc4050b931c386949bd737 P fc7521eed4d2442b8ef186e049d4066a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e36ce9c75f594ca7a7f3b05364492a6d, fc7521eed4d2442b8ef186e049d4066a; no voters: 
I20260709 12:14:38.536739 25379 raft_consensus.cc:2804] T b32bf4896acc4050b931c386949bd737 P fc7521eed4d2442b8ef186e049d4066a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:38.537063 25303 raft_consensus.cc:2468] T b32bf4896acc4050b931c386949bd737 P f6bda747ed164edc92da287bd74bfe09 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc7521eed4d2442b8ef186e049d4066a in term 1.
I20260709 12:14:38.538215 25379 raft_consensus.cc:697] T b32bf4896acc4050b931c386949bd737 P fc7521eed4d2442b8ef186e049d4066a [term 1 LEADER]: Becoming Leader. State: Replica: fc7521eed4d2442b8ef186e049d4066a, State: Running, Role: LEADER
I20260709 12:14:38.539316 25379 consensus_queue.cc:237] T b32bf4896acc4050b931c386949bd737 P fc7521eed4d2442b8ef186e049d4066a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc7521eed4d2442b8ef186e049d4066a" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34155 } } peers { permanent_uuid: "e36ce9c75f594ca7a7f3b05364492a6d" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 33439 } } peers { permanent_uuid: "f6bda747ed164edc92da287bd74bfe09" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 38155 } }
I20260709 12:14:38.549922 25053 catalog_manager.cc:5697] T b32bf4896acc4050b931c386949bd737 P fc7521eed4d2442b8ef186e049d4066a reported cstate change: term changed from 0 to 1, leader changed from <none> to fc7521eed4d2442b8ef186e049d4066a (127.12.174.129). New cstate: current_term: 1 leader_uuid: "fc7521eed4d2442b8ef186e049d4066a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc7521eed4d2442b8ef186e049d4066a" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e36ce9c75f594ca7a7f3b05364492a6d" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 33439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6bda747ed164edc92da287bd74bfe09" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 38155 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:38.602506 25230 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0f3f10dc1540463da3ee13fb25421fb4"
dest_uuid: "e36ce9c75f594ca7a7f3b05364492a6d"
mode: GRACEFUL
new_leader_uuid: "fc7521eed4d2442b8ef186e049d4066a"
 from {username='slave'} at 127.0.0.1:55958
I20260709 12:14:38.603089 25230 raft_consensus.cc:606] T 0f3f10dc1540463da3ee13fb25421fb4 P e36ce9c75f594ca7a7f3b05364492a6d [term 1 LEADER]: Received request to transfer leadership to TS fc7521eed4d2442b8ef186e049d4066a
I20260709 12:14:38.618539 25303 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aba6f0e01aed4f529d4095e920aa6db3"
dest_uuid: "f6bda747ed164edc92da287bd74bfe09"
mode: GRACEFUL
new_leader_uuid: "e36ce9c75f594ca7a7f3b05364492a6d"
 from {username='slave'} at 127.0.0.1:43578
I20260709 12:14:38.619154 25303 raft_consensus.cc:606] T aba6f0e01aed4f529d4095e920aa6db3 P f6bda747ed164edc92da287bd74bfe09 [term 2 LEADER]: Received request to transfer leadership to TS e36ce9c75f594ca7a7f3b05364492a6d
I20260709 12:14:38.625696 25303 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4d593b40df004d61b9fa278d58fceb1f"
dest_uuid: "f6bda747ed164edc92da287bd74bfe09"
mode: GRACEFUL
new_leader_uuid: "fc7521eed4d2442b8ef186e049d4066a"
 from {username='slave'} at 127.0.0.1:43578
I20260709 12:14:38.626473 25303 raft_consensus.cc:606] T 4d593b40df004d61b9fa278d58fceb1f P f6bda747ed164edc92da287bd74bfe09 [term 1 LEADER]: Received request to transfer leadership to TS fc7521eed4d2442b8ef186e049d4066a
I20260709 12:14:38.756685 25387 raft_consensus.cc:993] T aba6f0e01aed4f529d4095e920aa6db3 P f6bda747ed164edc92da287bd74bfe09: : Instructing follower e36ce9c75f594ca7a7f3b05364492a6d to start an election
I20260709 12:14:38.757262 25372 raft_consensus.cc:1081] T aba6f0e01aed4f529d4095e920aa6db3 P f6bda747ed164edc92da287bd74bfe09 [term 2 LEADER]: Signalling peer e36ce9c75f594ca7a7f3b05364492a6d to start an election
I20260709 12:14:38.759249 25230 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aba6f0e01aed4f529d4095e920aa6db3"
dest_uuid: "e36ce9c75f594ca7a7f3b05364492a6d"
 from {username='slave'} at 127.0.0.1:55942
I20260709 12:14:38.759917 25230 raft_consensus.cc:493] T aba6f0e01aed4f529d4095e920aa6db3 P e36ce9c75f594ca7a7f3b05364492a6d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:38.760337 25230 raft_consensus.cc:3060] T aba6f0e01aed4f529d4095e920aa6db3 P e36ce9c75f594ca7a7f3b05364492a6d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:38.766834 25230 raft_consensus.cc:515] T aba6f0e01aed4f529d4095e920aa6db3 P e36ce9c75f594ca7a7f3b05364492a6d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc7521eed4d2442b8ef186e049d4066a" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34155 } } peers { permanent_uuid: "e36ce9c75f594ca7a7f3b05364492a6d" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 33439 } } peers { permanent_uuid: "f6bda747ed164edc92da287bd74bfe09" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 38155 } }
I20260709 12:14:38.768800 25230 leader_election.cc:290] T aba6f0e01aed4f529d4095e920aa6db3 P e36ce9c75f594ca7a7f3b05364492a6d [CANDIDATE]: Term 3 election: Requested vote from peers fc7521eed4d2442b8ef186e049d4066a (127.12.174.129:34155), f6bda747ed164edc92da287bd74bfe09 (127.12.174.131:38155)
I20260709 12:14:38.769726 25155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba6f0e01aed4f529d4095e920aa6db3" candidate_uuid: "e36ce9c75f594ca7a7f3b05364492a6d" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "fc7521eed4d2442b8ef186e049d4066a"
I20260709 12:14:38.770071 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aba6f0e01aed4f529d4095e920aa6db3" candidate_uuid: "e36ce9c75f594ca7a7f3b05364492a6d" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "f6bda747ed164edc92da287bd74bfe09"
I20260709 12:14:38.770541 25155 raft_consensus.cc:3060] T aba6f0e01aed4f529d4095e920aa6db3 P fc7521eed4d2442b8ef186e049d4066a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:38.770639 25303 raft_consensus.cc:3055] T aba6f0e01aed4f529d4095e920aa6db3 P f6bda747ed164edc92da287bd74bfe09 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:38.771059 25303 raft_consensus.cc:740] T aba6f0e01aed4f529d4095e920aa6db3 P f6bda747ed164edc92da287bd74bfe09 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f6bda747ed164edc92da287bd74bfe09, State: Running, Role: LEADER
I20260709 12:14:38.772002 25303 consensus_queue.cc:260] T aba6f0e01aed4f529d4095e920aa6db3 P f6bda747ed164edc92da287bd74bfe09 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc7521eed4d2442b8ef186e049d4066a" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34155 } } peers { permanent_uuid: "e36ce9c75f594ca7a7f3b05364492a6d" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 33439 } } peers { permanent_uuid: "f6bda747ed164edc92da287bd74bfe09" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 38155 } }
I20260709 12:14:38.773459 25303 raft_consensus.cc:3060] T aba6f0e01aed4f529d4095e920aa6db3 P f6bda747ed164edc92da287bd74bfe09 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:38.779860 25155 raft_consensus.cc:2468] T aba6f0e01aed4f529d4095e920aa6db3 P fc7521eed4d2442b8ef186e049d4066a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e36ce9c75f594ca7a7f3b05364492a6d in term 3.
I20260709 12:14:38.781335 25193 leader_election.cc:304] T aba6f0e01aed4f529d4095e920aa6db3 P e36ce9c75f594ca7a7f3b05364492a6d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e36ce9c75f594ca7a7f3b05364492a6d, fc7521eed4d2442b8ef186e049d4066a; no voters: 
I20260709 12:14:38.782586 25351 raft_consensus.cc:2804] T aba6f0e01aed4f529d4095e920aa6db3 P e36ce9c75f594ca7a7f3b05364492a6d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:38.783092 25303 raft_consensus.cc:2468] T aba6f0e01aed4f529d4095e920aa6db3 P f6bda747ed164edc92da287bd74bfe09 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e36ce9c75f594ca7a7f3b05364492a6d in term 3.
I20260709 12:14:38.784667 25351 raft_consensus.cc:697] T aba6f0e01aed4f529d4095e920aa6db3 P e36ce9c75f594ca7a7f3b05364492a6d [term 3 LEADER]: Becoming Leader. State: Replica: e36ce9c75f594ca7a7f3b05364492a6d, State: Running, Role: LEADER
I20260709 12:14:38.785697 25351 consensus_queue.cc:237] T aba6f0e01aed4f529d4095e920aa6db3 P e36ce9c75f594ca7a7f3b05364492a6d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc7521eed4d2442b8ef186e049d4066a" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34155 } } peers { permanent_uuid: "e36ce9c75f594ca7a7f3b05364492a6d" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 33439 } } peers { permanent_uuid: "f6bda747ed164edc92da287bd74bfe09" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 38155 } }
I20260709 12:14:38.793350 25052 catalog_manager.cc:5697] T aba6f0e01aed4f529d4095e920aa6db3 P e36ce9c75f594ca7a7f3b05364492a6d reported cstate change: term changed from 2 to 3, leader changed from f6bda747ed164edc92da287bd74bfe09 (127.12.174.131) to e36ce9c75f594ca7a7f3b05364492a6d (127.12.174.130). New cstate: current_term: 3 leader_uuid: "e36ce9c75f594ca7a7f3b05364492a6d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc7521eed4d2442b8ef186e049d4066a" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e36ce9c75f594ca7a7f3b05364492a6d" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 33439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6bda747ed164edc92da287bd74bfe09" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 38155 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:39.029045 25379 consensus_queue.cc:1048] T b32bf4896acc4050b931c386949bd737 P fc7521eed4d2442b8ef186e049d4066a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e36ce9c75f594ca7a7f3b05364492a6d" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 33439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:39.043751 25410 consensus_queue.cc:1048] T b32bf4896acc4050b931c386949bd737 P fc7521eed4d2442b8ef186e049d4066a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6bda747ed164edc92da287bd74bfe09" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 38155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:39.045343 25372 consensus_queue.cc:1048] T 4d593b40df004d61b9fa278d58fceb1f P f6bda747ed164edc92da287bd74bfe09 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e36ce9c75f594ca7a7f3b05364492a6d" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 33439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:39.061679 25387 consensus_queue.cc:1048] T 4d593b40df004d61b9fa278d58fceb1f P f6bda747ed164edc92da287bd74bfe09 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc7521eed4d2442b8ef186e049d4066a" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:39.070791 25387 raft_consensus.cc:993] T 4d593b40df004d61b9fa278d58fceb1f P f6bda747ed164edc92da287bd74bfe09: : Instructing follower fc7521eed4d2442b8ef186e049d4066a to start an election
I20260709 12:14:39.071277 25372 raft_consensus.cc:1081] T 4d593b40df004d61b9fa278d58fceb1f P f6bda747ed164edc92da287bd74bfe09 [term 1 LEADER]: Signalling peer fc7521eed4d2442b8ef186e049d4066a to start an election
I20260709 12:14:39.073272 25155 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4d593b40df004d61b9fa278d58fceb1f"
dest_uuid: "fc7521eed4d2442b8ef186e049d4066a"
 from {username='slave'} at 127.0.0.1:42366
I20260709 12:14:39.073994 25155 raft_consensus.cc:493] T 4d593b40df004d61b9fa278d58fceb1f P fc7521eed4d2442b8ef186e049d4066a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:39.074409 25155 raft_consensus.cc:3060] T 4d593b40df004d61b9fa278d58fceb1f P fc7521eed4d2442b8ef186e049d4066a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:39.082638 25155 raft_consensus.cc:515] T 4d593b40df004d61b9fa278d58fceb1f P fc7521eed4d2442b8ef186e049d4066a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc7521eed4d2442b8ef186e049d4066a" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34155 } } peers { permanent_uuid: "e36ce9c75f594ca7a7f3b05364492a6d" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 33439 } } peers { permanent_uuid: "f6bda747ed164edc92da287bd74bfe09" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 38155 } }
I20260709 12:14:39.085767 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d593b40df004d61b9fa278d58fceb1f" candidate_uuid: "fc7521eed4d2442b8ef186e049d4066a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e36ce9c75f594ca7a7f3b05364492a6d"
I20260709 12:14:39.086498 25229 raft_consensus.cc:3060] T 4d593b40df004d61b9fa278d58fceb1f P e36ce9c75f594ca7a7f3b05364492a6d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:39.086647 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d593b40df004d61b9fa278d58fceb1f" candidate_uuid: "fc7521eed4d2442b8ef186e049d4066a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f6bda747ed164edc92da287bd74bfe09"
I20260709 12:14:39.087435 25303 raft_consensus.cc:3055] T 4d593b40df004d61b9fa278d58fceb1f P f6bda747ed164edc92da287bd74bfe09 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:39.087980 25303 raft_consensus.cc:740] T 4d593b40df004d61b9fa278d58fceb1f P f6bda747ed164edc92da287bd74bfe09 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f6bda747ed164edc92da287bd74bfe09, State: Running, Role: LEADER
I20260709 12:14:39.089143 25303 consensus_queue.cc:260] T 4d593b40df004d61b9fa278d58fceb1f P f6bda747ed164edc92da287bd74bfe09 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc7521eed4d2442b8ef186e049d4066a" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34155 } } peers { permanent_uuid: "e36ce9c75f594ca7a7f3b05364492a6d" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 33439 } } peers { permanent_uuid: "f6bda747ed164edc92da287bd74bfe09" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 38155 } }
I20260709 12:14:39.090577 25303 raft_consensus.cc:3060] T 4d593b40df004d61b9fa278d58fceb1f P f6bda747ed164edc92da287bd74bfe09 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:39.091065 25155 leader_election.cc:290] T 4d593b40df004d61b9fa278d58fceb1f P fc7521eed4d2442b8ef186e049d4066a [CANDIDATE]: Term 2 election: Requested vote from peers e36ce9c75f594ca7a7f3b05364492a6d (127.12.174.130:33439), f6bda747ed164edc92da287bd74bfe09 (127.12.174.131:38155)
I20260709 12:14:39.096422 25229 raft_consensus.cc:2468] T 4d593b40df004d61b9fa278d58fceb1f P e36ce9c75f594ca7a7f3b05364492a6d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc7521eed4d2442b8ef186e049d4066a in term 2.
I20260709 12:14:39.097810 25121 leader_election.cc:304] T 4d593b40df004d61b9fa278d58fceb1f P fc7521eed4d2442b8ef186e049d4066a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e36ce9c75f594ca7a7f3b05364492a6d, fc7521eed4d2442b8ef186e049d4066a; no voters: 
I20260709 12:14:39.098778 25410 raft_consensus.cc:2804] T 4d593b40df004d61b9fa278d58fceb1f P fc7521eed4d2442b8ef186e049d4066a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:39.099439 25410 raft_consensus.cc:697] T 4d593b40df004d61b9fa278d58fceb1f P fc7521eed4d2442b8ef186e049d4066a [term 2 LEADER]: Becoming Leader. State: Replica: fc7521eed4d2442b8ef186e049d4066a, State: Running, Role: LEADER
I20260709 12:14:39.100426 25410 consensus_queue.cc:237] T 4d593b40df004d61b9fa278d58fceb1f P fc7521eed4d2442b8ef186e049d4066a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc7521eed4d2442b8ef186e049d4066a" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34155 } } peers { permanent_uuid: "e36ce9c75f594ca7a7f3b05364492a6d" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 33439 } } peers { permanent_uuid: "f6bda747ed164edc92da287bd74bfe09" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 38155 } }
I20260709 12:14:39.101650 25303 raft_consensus.cc:2468] T 4d593b40df004d61b9fa278d58fceb1f P f6bda747ed164edc92da287bd74bfe09 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc7521eed4d2442b8ef186e049d4066a in term 2.
I20260709 12:14:39.108090 25053 catalog_manager.cc:5697] T 4d593b40df004d61b9fa278d58fceb1f P fc7521eed4d2442b8ef186e049d4066a reported cstate change: term changed from 1 to 2, leader changed from f6bda747ed164edc92da287bd74bfe09 (127.12.174.131) to fc7521eed4d2442b8ef186e049d4066a (127.12.174.129). New cstate: current_term: 2 leader_uuid: "fc7521eed4d2442b8ef186e049d4066a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc7521eed4d2442b8ef186e049d4066a" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e36ce9c75f594ca7a7f3b05364492a6d" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 33439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6bda747ed164edc92da287bd74bfe09" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 38155 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:39.127866 25407 raft_consensus.cc:993] T 0f3f10dc1540463da3ee13fb25421fb4 P e36ce9c75f594ca7a7f3b05364492a6d: : Instructing follower fc7521eed4d2442b8ef186e049d4066a to start an election
I20260709 12:14:39.128347 25351 raft_consensus.cc:1081] T 0f3f10dc1540463da3ee13fb25421fb4 P e36ce9c75f594ca7a7f3b05364492a6d [term 1 LEADER]: Signalling peer fc7521eed4d2442b8ef186e049d4066a to start an election
I20260709 12:14:39.130071 25155 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0f3f10dc1540463da3ee13fb25421fb4"
dest_uuid: "fc7521eed4d2442b8ef186e049d4066a"
 from {username='slave'} at 127.0.0.1:42352
I20260709 12:14:39.130591 25155 raft_consensus.cc:493] T 0f3f10dc1540463da3ee13fb25421fb4 P fc7521eed4d2442b8ef186e049d4066a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:39.130889 25155 raft_consensus.cc:3060] T 0f3f10dc1540463da3ee13fb25421fb4 P fc7521eed4d2442b8ef186e049d4066a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:39.137194 25155 raft_consensus.cc:515] T 0f3f10dc1540463da3ee13fb25421fb4 P fc7521eed4d2442b8ef186e049d4066a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36ce9c75f594ca7a7f3b05364492a6d" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 33439 } } peers { permanent_uuid: "fc7521eed4d2442b8ef186e049d4066a" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34155 } } peers { permanent_uuid: "f6bda747ed164edc92da287bd74bfe09" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 38155 } }
I20260709 12:14:39.139139 25155 leader_election.cc:290] T 0f3f10dc1540463da3ee13fb25421fb4 P fc7521eed4d2442b8ef186e049d4066a [CANDIDATE]: Term 2 election: Requested vote from peers e36ce9c75f594ca7a7f3b05364492a6d (127.12.174.130:33439), f6bda747ed164edc92da287bd74bfe09 (127.12.174.131:38155)
I20260709 12:14:39.140054 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f10dc1540463da3ee13fb25421fb4" candidate_uuid: "fc7521eed4d2442b8ef186e049d4066a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e36ce9c75f594ca7a7f3b05364492a6d"
I20260709 12:14:39.140345 25303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3f10dc1540463da3ee13fb25421fb4" candidate_uuid: "fc7521eed4d2442b8ef186e049d4066a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f6bda747ed164edc92da287bd74bfe09"
I20260709 12:14:39.140735 25229 raft_consensus.cc:3055] T 0f3f10dc1540463da3ee13fb25421fb4 P e36ce9c75f594ca7a7f3b05364492a6d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:39.140941 25303 raft_consensus.cc:3060] T 0f3f10dc1540463da3ee13fb25421fb4 P f6bda747ed164edc92da287bd74bfe09 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:39.141126 25229 raft_consensus.cc:740] T 0f3f10dc1540463da3ee13fb25421fb4 P e36ce9c75f594ca7a7f3b05364492a6d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e36ce9c75f594ca7a7f3b05364492a6d, State: Running, Role: LEADER
I20260709 12:14:39.142042 25229 consensus_queue.cc:260] T 0f3f10dc1540463da3ee13fb25421fb4 P e36ce9c75f594ca7a7f3b05364492a6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36ce9c75f594ca7a7f3b05364492a6d" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 33439 } } peers { permanent_uuid: "fc7521eed4d2442b8ef186e049d4066a" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34155 } } peers { permanent_uuid: "f6bda747ed164edc92da287bd74bfe09" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 38155 } }
I20260709 12:14:39.143146 25229 raft_consensus.cc:3060] T 0f3f10dc1540463da3ee13fb25421fb4 P e36ce9c75f594ca7a7f3b05364492a6d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:39.148547 25303 raft_consensus.cc:2468] T 0f3f10dc1540463da3ee13fb25421fb4 P f6bda747ed164edc92da287bd74bfe09 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc7521eed4d2442b8ef186e049d4066a in term 2.
I20260709 12:14:39.149698 25229 raft_consensus.cc:2468] T 0f3f10dc1540463da3ee13fb25421fb4 P e36ce9c75f594ca7a7f3b05364492a6d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc7521eed4d2442b8ef186e049d4066a in term 2.
I20260709 12:14:39.149986 25118 leader_election.cc:304] T 0f3f10dc1540463da3ee13fb25421fb4 P fc7521eed4d2442b8ef186e049d4066a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f6bda747ed164edc92da287bd74bfe09, fc7521eed4d2442b8ef186e049d4066a; no voters: 
I20260709 12:14:39.151098 25410 raft_consensus.cc:2804] T 0f3f10dc1540463da3ee13fb25421fb4 P fc7521eed4d2442b8ef186e049d4066a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:39.151535 25410 raft_consensus.cc:697] T 0f3f10dc1540463da3ee13fb25421fb4 P fc7521eed4d2442b8ef186e049d4066a [term 2 LEADER]: Becoming Leader. State: Replica: fc7521eed4d2442b8ef186e049d4066a, State: Running, Role: LEADER
I20260709 12:14:39.152233 25410 consensus_queue.cc:237] T 0f3f10dc1540463da3ee13fb25421fb4 P fc7521eed4d2442b8ef186e049d4066a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36ce9c75f594ca7a7f3b05364492a6d" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 33439 } } peers { permanent_uuid: "fc7521eed4d2442b8ef186e049d4066a" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34155 } } peers { permanent_uuid: "f6bda747ed164edc92da287bd74bfe09" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 38155 } }
I20260709 12:14:39.160104 25053 catalog_manager.cc:5697] T 0f3f10dc1540463da3ee13fb25421fb4 P fc7521eed4d2442b8ef186e049d4066a reported cstate change: term changed from 1 to 2, leader changed from e36ce9c75f594ca7a7f3b05364492a6d (127.12.174.130) to fc7521eed4d2442b8ef186e049d4066a (127.12.174.129). New cstate: current_term: 2 leader_uuid: "fc7521eed4d2442b8ef186e049d4066a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e36ce9c75f594ca7a7f3b05364492a6d" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 33439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc7521eed4d2442b8ef186e049d4066a" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6bda747ed164edc92da287bd74bfe09" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 38155 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:39.322129 25155 raft_consensus.cc:1275] T aba6f0e01aed4f529d4095e920aa6db3 P fc7521eed4d2442b8ef186e049d4066a [term 3 FOLLOWER]: Refusing update from remote peer e36ce9c75f594ca7a7f3b05364492a6d: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:14:39.323629 25351 consensus_queue.cc:1048] T aba6f0e01aed4f529d4095e920aa6db3 P e36ce9c75f594ca7a7f3b05364492a6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc7521eed4d2442b8ef186e049d4066a" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:39.333521 25303 raft_consensus.cc:1275] T aba6f0e01aed4f529d4095e920aa6db3 P f6bda747ed164edc92da287bd74bfe09 [term 3 FOLLOWER]: Refusing update from remote peer e36ce9c75f594ca7a7f3b05364492a6d: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:14:39.335347 25418 consensus_queue.cc:1048] T aba6f0e01aed4f529d4095e920aa6db3 P e36ce9c75f594ca7a7f3b05364492a6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6bda747ed164edc92da287bd74bfe09" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 38155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:14:39.379449 12986 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 12:14:39.381194 12986 auto_leader_rebalancer.cc:440] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 12:14:39.381647 12986 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 12:14:39.394516 25155 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b32bf4896acc4050b931c386949bd737"
dest_uuid: "fc7521eed4d2442b8ef186e049d4066a"
mode: GRACEFUL
new_leader_uuid: "f6bda747ed164edc92da287bd74bfe09"
 from {username='slave'} at 127.0.0.1:42376
I20260709 12:14:39.395123 25155 raft_consensus.cc:606] T b32bf4896acc4050b931c386949bd737 P fc7521eed4d2442b8ef186e049d4066a [term 1 LEADER]: Received request to transfer leadership to TS f6bda747ed164edc92da287bd74bfe09
I20260709 12:14:39.396467 12986 auto_leader_rebalancer.cc:440] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 12:14:39.486111 25303 raft_consensus.cc:1275] T 4d593b40df004d61b9fa278d58fceb1f P f6bda747ed164edc92da287bd74bfe09 [term 2 FOLLOWER]: Refusing update from remote peer fc7521eed4d2442b8ef186e049d4066a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:39.487641 25410 consensus_queue.cc:1048] T 4d593b40df004d61b9fa278d58fceb1f P fc7521eed4d2442b8ef186e049d4066a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6bda747ed164edc92da287bd74bfe09" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 38155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:39.497921 25229 raft_consensus.cc:1275] T 4d593b40df004d61b9fa278d58fceb1f P e36ce9c75f594ca7a7f3b05364492a6d [term 2 FOLLOWER]: Refusing update from remote peer fc7521eed4d2442b8ef186e049d4066a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:39.499866 25402 consensus_queue.cc:1048] T 4d593b40df004d61b9fa278d58fceb1f P fc7521eed4d2442b8ef186e049d4066a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e36ce9c75f594ca7a7f3b05364492a6d" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 33439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:14:39.630462 25229 raft_consensus.cc:1275] T 0f3f10dc1540463da3ee13fb25421fb4 P e36ce9c75f594ca7a7f3b05364492a6d [term 2 FOLLOWER]: Refusing update from remote peer fc7521eed4d2442b8ef186e049d4066a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:39.632134 25379 consensus_queue.cc:1048] T 0f3f10dc1540463da3ee13fb25421fb4 P fc7521eed4d2442b8ef186e049d4066a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e36ce9c75f594ca7a7f3b05364492a6d" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 33439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:39.675599 25402 raft_consensus.cc:993] T b32bf4896acc4050b931c386949bd737 P fc7521eed4d2442b8ef186e049d4066a: : Instructing follower f6bda747ed164edc92da287bd74bfe09 to start an election
I20260709 12:14:39.679920 25379 raft_consensus.cc:1081] T b32bf4896acc4050b931c386949bd737 P fc7521eed4d2442b8ef186e049d4066a [term 1 LEADER]: Signalling peer f6bda747ed164edc92da287bd74bfe09 to start an election
I20260709 12:14:39.683840 25303 raft_consensus.cc:1275] T 0f3f10dc1540463da3ee13fb25421fb4 P f6bda747ed164edc92da287bd74bfe09 [term 2 FOLLOWER]: Refusing update from remote peer fc7521eed4d2442b8ef186e049d4066a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:39.687884 25379 consensus_queue.cc:1048] T 0f3f10dc1540463da3ee13fb25421fb4 P fc7521eed4d2442b8ef186e049d4066a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6bda747ed164edc92da287bd74bfe09" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 38155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:14:39.688519 25303 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b32bf4896acc4050b931c386949bd737"
dest_uuid: "f6bda747ed164edc92da287bd74bfe09"
 from {username='slave'} at 127.0.0.1:43572
I20260709 12:14:39.689594 25303 raft_consensus.cc:493] T b32bf4896acc4050b931c386949bd737 P f6bda747ed164edc92da287bd74bfe09 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:39.690097 25303 raft_consensus.cc:3060] T b32bf4896acc4050b931c386949bd737 P f6bda747ed164edc92da287bd74bfe09 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:39.704867 25303 raft_consensus.cc:515] T b32bf4896acc4050b931c386949bd737 P f6bda747ed164edc92da287bd74bfe09 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc7521eed4d2442b8ef186e049d4066a" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34155 } } peers { permanent_uuid: "e36ce9c75f594ca7a7f3b05364492a6d" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 33439 } } peers { permanent_uuid: "f6bda747ed164edc92da287bd74bfe09" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 38155 } }
I20260709 12:14:39.707172 25303 leader_election.cc:290] T b32bf4896acc4050b931c386949bd737 P f6bda747ed164edc92da287bd74bfe09 [CANDIDATE]: Term 2 election: Requested vote from peers fc7521eed4d2442b8ef186e049d4066a (127.12.174.129:34155), e36ce9c75f594ca7a7f3b05364492a6d (127.12.174.130:33439)
I20260709 12:14:39.708937 25155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32bf4896acc4050b931c386949bd737" candidate_uuid: "f6bda747ed164edc92da287bd74bfe09" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fc7521eed4d2442b8ef186e049d4066a"
I20260709 12:14:39.709158 25229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b32bf4896acc4050b931c386949bd737" candidate_uuid: "f6bda747ed164edc92da287bd74bfe09" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e36ce9c75f594ca7a7f3b05364492a6d"
I20260709 12:14:39.709831 25155 raft_consensus.cc:3055] T b32bf4896acc4050b931c386949bd737 P fc7521eed4d2442b8ef186e049d4066a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:39.710147 25229 raft_consensus.cc:3060] T b32bf4896acc4050b931c386949bd737 P e36ce9c75f594ca7a7f3b05364492a6d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:39.710199 25155 raft_consensus.cc:740] T b32bf4896acc4050b931c386949bd737 P fc7521eed4d2442b8ef186e049d4066a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fc7521eed4d2442b8ef186e049d4066a, State: Running, Role: LEADER
I20260709 12:14:39.711934 25155 consensus_queue.cc:260] T b32bf4896acc4050b931c386949bd737 P fc7521eed4d2442b8ef186e049d4066a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc7521eed4d2442b8ef186e049d4066a" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34155 } } peers { permanent_uuid: "e36ce9c75f594ca7a7f3b05364492a6d" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 33439 } } peers { permanent_uuid: "f6bda747ed164edc92da287bd74bfe09" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 38155 } }
I20260709 12:14:39.714613 25155 raft_consensus.cc:3060] T b32bf4896acc4050b931c386949bd737 P fc7521eed4d2442b8ef186e049d4066a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:39.719931 25229 raft_consensus.cc:2468] T b32bf4896acc4050b931c386949bd737 P e36ce9c75f594ca7a7f3b05364492a6d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6bda747ed164edc92da287bd74bfe09 in term 2.
I20260709 12:14:39.721912 25270 leader_election.cc:304] T b32bf4896acc4050b931c386949bd737 P f6bda747ed164edc92da287bd74bfe09 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e36ce9c75f594ca7a7f3b05364492a6d, f6bda747ed164edc92da287bd74bfe09; no voters: 
I20260709 12:14:39.723222 25372 raft_consensus.cc:2804] T b32bf4896acc4050b931c386949bd737 P f6bda747ed164edc92da287bd74bfe09 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:39.724361 25372 raft_consensus.cc:697] T b32bf4896acc4050b931c386949bd737 P f6bda747ed164edc92da287bd74bfe09 [term 2 LEADER]: Becoming Leader. State: Replica: f6bda747ed164edc92da287bd74bfe09, State: Running, Role: LEADER
I20260709 12:14:39.725281 25155 raft_consensus.cc:2468] T b32bf4896acc4050b931c386949bd737 P fc7521eed4d2442b8ef186e049d4066a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6bda747ed164edc92da287bd74bfe09 in term 2.
I20260709 12:14:39.725919 25372 consensus_queue.cc:237] T b32bf4896acc4050b931c386949bd737 P f6bda747ed164edc92da287bd74bfe09 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc7521eed4d2442b8ef186e049d4066a" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34155 } } peers { permanent_uuid: "e36ce9c75f594ca7a7f3b05364492a6d" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 33439 } } peers { permanent_uuid: "f6bda747ed164edc92da287bd74bfe09" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 38155 } }
I20260709 12:14:39.733642 25051 catalog_manager.cc:5697] T b32bf4896acc4050b931c386949bd737 P f6bda747ed164edc92da287bd74bfe09 reported cstate change: term changed from 1 to 2, leader changed from fc7521eed4d2442b8ef186e049d4066a (127.12.174.129) to f6bda747ed164edc92da287bd74bfe09 (127.12.174.131). New cstate: current_term: 2 leader_uuid: "f6bda747ed164edc92da287bd74bfe09" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc7521eed4d2442b8ef186e049d4066a" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e36ce9c75f594ca7a7f3b05364492a6d" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 33439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6bda747ed164edc92da287bd74bfe09" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 38155 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:39.770541 12986 tablet_server.cc:179] TabletServer@127.12.174.129:0 shutting down...
I20260709 12:14:39.799206 12986 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:14:39.800051 12986 tablet_replica.cc:333] T b32bf4896acc4050b931c386949bd737 P fc7521eed4d2442b8ef186e049d4066a: stopping tablet replica
I20260709 12:14:39.800844 12986 raft_consensus.cc:2243] T b32bf4896acc4050b931c386949bd737 P fc7521eed4d2442b8ef186e049d4066a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:39.801293 12986 raft_consensus.cc:2272] T b32bf4896acc4050b931c386949bd737 P fc7521eed4d2442b8ef186e049d4066a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:39.804986 12986 tablet_replica.cc:333] T 4d593b40df004d61b9fa278d58fceb1f P fc7521eed4d2442b8ef186e049d4066a: stopping tablet replica
I20260709 12:14:39.805707 12986 raft_consensus.cc:2243] T 4d593b40df004d61b9fa278d58fceb1f P fc7521eed4d2442b8ef186e049d4066a [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:39.807298 12986 raft_consensus.cc:2272] T 4d593b40df004d61b9fa278d58fceb1f P fc7521eed4d2442b8ef186e049d4066a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:39.811337 12986 tablet_replica.cc:333] T aba6f0e01aed4f529d4095e920aa6db3 P fc7521eed4d2442b8ef186e049d4066a: stopping tablet replica
I20260709 12:14:39.811988 12986 raft_consensus.cc:2243] T aba6f0e01aed4f529d4095e920aa6db3 P fc7521eed4d2442b8ef186e049d4066a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:39.812670 12986 raft_consensus.cc:2272] T aba6f0e01aed4f529d4095e920aa6db3 P fc7521eed4d2442b8ef186e049d4066a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:39.816196 12986 tablet_replica.cc:333] T 0f3f10dc1540463da3ee13fb25421fb4 P fc7521eed4d2442b8ef186e049d4066a: stopping tablet replica
I20260709 12:14:39.816798 12986 raft_consensus.cc:2243] T 0f3f10dc1540463da3ee13fb25421fb4 P fc7521eed4d2442b8ef186e049d4066a [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:39.817922 12986 raft_consensus.cc:2272] T 0f3f10dc1540463da3ee13fb25421fb4 P fc7521eed4d2442b8ef186e049d4066a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:39.850560 12986 tablet_server.cc:196] TabletServer@127.12.174.129:0 shutdown complete.
W20260709 12:14:39.873150 25193 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.174.129:34155: connect: Connection refused (error 111) [suppressed 5 similar messages]
W20260709 12:14:39.878144 25193 consensus_peers.cc:597] T aba6f0e01aed4f529d4095e920aa6db3 P e36ce9c75f594ca7a7f3b05364492a6d -> Peer fc7521eed4d2442b8ef186e049d4066a (127.12.174.129:34155): Couldn't send request to peer fc7521eed4d2442b8ef186e049d4066a. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:34155: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:14:39.878537 12986 tablet_server.cc:179] TabletServer@127.12.174.130:0 shutting down...
I20260709 12:14:39.901291 12986 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:14:39.902128 12986 tablet_replica.cc:333] T b32bf4896acc4050b931c386949bd737 P e36ce9c75f594ca7a7f3b05364492a6d: stopping tablet replica
I20260709 12:14:39.903007 12986 raft_consensus.cc:2243] T b32bf4896acc4050b931c386949bd737 P e36ce9c75f594ca7a7f3b05364492a6d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:39.903606 12986 raft_consensus.cc:2272] T b32bf4896acc4050b931c386949bd737 P e36ce9c75f594ca7a7f3b05364492a6d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:39.907052 12986 tablet_replica.cc:333] T 4d593b40df004d61b9fa278d58fceb1f P e36ce9c75f594ca7a7f3b05364492a6d: stopping tablet replica
I20260709 12:14:39.907786 12986 raft_consensus.cc:2243] T 4d593b40df004d61b9fa278d58fceb1f P e36ce9c75f594ca7a7f3b05364492a6d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:39.908412 12986 raft_consensus.cc:2272] T 4d593b40df004d61b9fa278d58fceb1f P e36ce9c75f594ca7a7f3b05364492a6d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:39.912091 12986 tablet_replica.cc:333] T aba6f0e01aed4f529d4095e920aa6db3 P e36ce9c75f594ca7a7f3b05364492a6d: stopping tablet replica
I20260709 12:14:39.912699 12986 raft_consensus.cc:2243] T aba6f0e01aed4f529d4095e920aa6db3 P e36ce9c75f594ca7a7f3b05364492a6d [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:14:39.914040 12986 raft_consensus.cc:2272] T aba6f0e01aed4f529d4095e920aa6db3 P e36ce9c75f594ca7a7f3b05364492a6d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:39.917446 12986 tablet_replica.cc:333] T 0f3f10dc1540463da3ee13fb25421fb4 P e36ce9c75f594ca7a7f3b05364492a6d: stopping tablet replica
I20260709 12:14:39.918109 12986 raft_consensus.cc:2243] T 0f3f10dc1540463da3ee13fb25421fb4 P e36ce9c75f594ca7a7f3b05364492a6d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:39.918658 12986 raft_consensus.cc:2272] T 0f3f10dc1540463da3ee13fb25421fb4 P e36ce9c75f594ca7a7f3b05364492a6d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:39.947516 12986 tablet_server.cc:196] TabletServer@127.12.174.130:0 shutdown complete.
I20260709 12:14:39.969957 12986 tablet_server.cc:179] TabletServer@127.12.174.131:0 shutting down...
I20260709 12:14:39.992486 12986 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:14:39.993322 12986 tablet_replica.cc:333] T b32bf4896acc4050b931c386949bd737 P f6bda747ed164edc92da287bd74bfe09: stopping tablet replica
I20260709 12:14:39.994139 12986 raft_consensus.cc:2243] T b32bf4896acc4050b931c386949bd737 P f6bda747ed164edc92da287bd74bfe09 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:14:39.994887 12986 pending_rounds.cc:70] T b32bf4896acc4050b931c386949bd737 P f6bda747ed164edc92da287bd74bfe09: Trying to abort 1 pending ops.
I20260709 12:14:39.995083 12986 pending_rounds.cc:77] T b32bf4896acc4050b931c386949bd737 P f6bda747ed164edc92da287bd74bfe09: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305622649767579648 op_type: NO_OP noop_request { }
I20260709 12:14:39.995374 12986 raft_consensus.cc:2889] T b32bf4896acc4050b931c386949bd737 P f6bda747ed164edc92da287bd74bfe09 [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:14:39.995688 12986 raft_consensus.cc:2272] T b32bf4896acc4050b931c386949bd737 P f6bda747ed164edc92da287bd74bfe09 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:39.998886 12986 tablet_replica.cc:333] T 4d593b40df004d61b9fa278d58fceb1f P f6bda747ed164edc92da287bd74bfe09: stopping tablet replica
I20260709 12:14:39.999521 12986 raft_consensus.cc:2243] T 4d593b40df004d61b9fa278d58fceb1f P f6bda747ed164edc92da287bd74bfe09 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:40.000190 12986 raft_consensus.cc:2272] T 4d593b40df004d61b9fa278d58fceb1f P f6bda747ed164edc92da287bd74bfe09 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:40.003508 12986 tablet_replica.cc:333] T 0f3f10dc1540463da3ee13fb25421fb4 P f6bda747ed164edc92da287bd74bfe09: stopping tablet replica
I20260709 12:14:40.004136 12986 raft_consensus.cc:2243] T 0f3f10dc1540463da3ee13fb25421fb4 P f6bda747ed164edc92da287bd74bfe09 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:40.004623 12986 raft_consensus.cc:2272] T 0f3f10dc1540463da3ee13fb25421fb4 P f6bda747ed164edc92da287bd74bfe09 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:40.007643 12986 tablet_replica.cc:333] T aba6f0e01aed4f529d4095e920aa6db3 P f6bda747ed164edc92da287bd74bfe09: stopping tablet replica
I20260709 12:14:40.008242 12986 raft_consensus.cc:2243] T aba6f0e01aed4f529d4095e920aa6db3 P f6bda747ed164edc92da287bd74bfe09 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:14:40.008841 12986 raft_consensus.cc:2272] T aba6f0e01aed4f529d4095e920aa6db3 P f6bda747ed164edc92da287bd74bfe09 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:40.036250 12986 tablet_server.cc:196] TabletServer@127.12.174.131:0 shutdown complete.
I20260709 12:14:40.057598 12986 master.cc:562] Master@127.12.174.190:35103 shutting down...
I20260709 12:14:40.078161 12986 raft_consensus.cc:2243] T 00000000000000000000000000000000 P c5dfceea27184016b735edef976d4e39 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:14:40.078827 12986 raft_consensus.cc:2272] T 00000000000000000000000000000000 P c5dfceea27184016b735edef976d4e39 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:14:40.079208 12986 tablet_replica.cc:333] T 00000000000000000000000000000000 P c5dfceea27184016b735edef976d4e39: stopping tablet replica
I20260709 12:14:40.100467 12986 master.cc:584] Master@127.12.174.190:35103 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (5210 ms)
[----------] 6 tests from LeaderRebalancerTest (393739 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 12:14:40.144327 12986 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.12.174.190:38643
I20260709 12:14:40.145601 12986 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:14:40.151690 25432 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:40.152765 25433 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:40.153254 25435 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:14:40.153613 12986 server_base.cc:1061] running on GCE node
I20260709 12:14:40.154606 12986 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:14:40.154814 12986 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:14:40.154973 12986 hybrid_clock.cc:648] HybridClock initialized: now 1783599280154955 us; error 0 us; skew 500 ppm
I20260709 12:14:40.155530 12986 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:14:40.158239 12986 webserver.cc:533] Webserver started at http://127.12.174.190:35043/ using document root <none> and password file <none>
I20260709 12:14:40.158785 12986 fs_manager.cc:362] Metadata directory not provided
I20260709 12:14:40.158959 12986 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:14:40.159242 12986 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:14:40.160478 12986 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598886212958-12986-0/minicluster-data/master-0-root/instance:
uuid: "289dddc755224fb2a6616ef0c1fb377c"
format_stamp: "Formatted at 2026-07-09 12:14:40 on dist-test-slave-9q7n"
I20260709 12:14:40.165609 12986 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.001s	sys 0.006s
I20260709 12:14:40.169879 25440 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:40.170816 12986 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 12:14:40.171134 12986 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598886212958-12986-0/minicluster-data/master-0-root
uuid: "289dddc755224fb2a6616ef0c1fb377c"
format_stamp: "Formatted at 2026-07-09 12:14:40 on dist-test-slave-9q7n"
I20260709 12:14:40.171444 12986 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598886212958-12986-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598886212958-12986-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598886212958-12986-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:14:40.191392 12986 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:14:40.192879 12986 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:14:40.238046 12986 rpc_server.cc:307] RPC server started. Bound to: 127.12.174.190:38643
I20260709 12:14:40.238180 25491 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.174.190:38643 every 8 connection(s)
I20260709 12:14:40.242450 25492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:40.258734 25492 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 289dddc755224fb2a6616ef0c1fb377c: Bootstrap starting.
I20260709 12:14:40.264566 25492 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 289dddc755224fb2a6616ef0c1fb377c: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:40.269523 25492 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 289dddc755224fb2a6616ef0c1fb377c: No bootstrap required, opened a new log
I20260709 12:14:40.272163 25492 raft_consensus.cc:359] T 00000000000000000000000000000000 P 289dddc755224fb2a6616ef0c1fb377c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "289dddc755224fb2a6616ef0c1fb377c" member_type: VOTER }
I20260709 12:14:40.272598 25492 raft_consensus.cc:385] T 00000000000000000000000000000000 P 289dddc755224fb2a6616ef0c1fb377c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:40.272812 25492 raft_consensus.cc:740] T 00000000000000000000000000000000 P 289dddc755224fb2a6616ef0c1fb377c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 289dddc755224fb2a6616ef0c1fb377c, State: Initialized, Role: FOLLOWER
I20260709 12:14:40.273447 25492 consensus_queue.cc:260] T 00000000000000000000000000000000 P 289dddc755224fb2a6616ef0c1fb377c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "289dddc755224fb2a6616ef0c1fb377c" member_type: VOTER }
I20260709 12:14:40.274004 25492 raft_consensus.cc:399] T 00000000000000000000000000000000 P 289dddc755224fb2a6616ef0c1fb377c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:14:40.274245 25492 raft_consensus.cc:493] T 00000000000000000000000000000000 P 289dddc755224fb2a6616ef0c1fb377c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:14:40.274514 25492 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 289dddc755224fb2a6616ef0c1fb377c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:40.280839 25492 raft_consensus.cc:515] T 00000000000000000000000000000000 P 289dddc755224fb2a6616ef0c1fb377c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "289dddc755224fb2a6616ef0c1fb377c" member_type: VOTER }
I20260709 12:14:40.281430 25492 leader_election.cc:304] T 00000000000000000000000000000000 P 289dddc755224fb2a6616ef0c1fb377c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 289dddc755224fb2a6616ef0c1fb377c; no voters: 
I20260709 12:14:40.282694 25492 leader_election.cc:290] T 00000000000000000000000000000000 P 289dddc755224fb2a6616ef0c1fb377c [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:14:40.283079 25495 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 289dddc755224fb2a6616ef0c1fb377c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:40.284543 25495 raft_consensus.cc:697] T 00000000000000000000000000000000 P 289dddc755224fb2a6616ef0c1fb377c [term 1 LEADER]: Becoming Leader. State: Replica: 289dddc755224fb2a6616ef0c1fb377c, State: Running, Role: LEADER
I20260709 12:14:40.285349 25495 consensus_queue.cc:237] T 00000000000000000000000000000000 P 289dddc755224fb2a6616ef0c1fb377c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "289dddc755224fb2a6616ef0c1fb377c" member_type: VOTER }
I20260709 12:14:40.285920 25492 sys_catalog.cc:565] T 00000000000000000000000000000000 P 289dddc755224fb2a6616ef0c1fb377c [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:14:40.288772 25497 sys_catalog.cc:455] T 00000000000000000000000000000000 P 289dddc755224fb2a6616ef0c1fb377c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 289dddc755224fb2a6616ef0c1fb377c. Latest consensus state: current_term: 1 leader_uuid: "289dddc755224fb2a6616ef0c1fb377c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "289dddc755224fb2a6616ef0c1fb377c" member_type: VOTER } }
I20260709 12:14:40.288764 25496 sys_catalog.cc:455] T 00000000000000000000000000000000 P 289dddc755224fb2a6616ef0c1fb377c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "289dddc755224fb2a6616ef0c1fb377c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "289dddc755224fb2a6616ef0c1fb377c" member_type: VOTER } }
I20260709 12:14:40.289774 25496 sys_catalog.cc:458] T 00000000000000000000000000000000 P 289dddc755224fb2a6616ef0c1fb377c [sys.catalog]: This master's current role is: LEADER
I20260709 12:14:40.293282 25497 sys_catalog.cc:458] T 00000000000000000000000000000000 P 289dddc755224fb2a6616ef0c1fb377c [sys.catalog]: This master's current role is: LEADER
I20260709 12:14:40.296603 25501 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:14:40.304852 25501 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:14:40.306092 12986 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:14:40.314932 25501 catalog_manager.cc:1383] Generated new cluster ID: d8ce4d544aea4b44b449a80b8b978eb4
I20260709 12:14:40.315302 25501 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:14:40.341866 25501 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:14:40.343480 25501 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:14:40.358197 25501 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 289dddc755224fb2a6616ef0c1fb377c: Generated new TSK 0
I20260709 12:14:40.358929 25501 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:14:40.374536 12986 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:14:40.381307 25513 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:40.382135 25514 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:40.384630 25516 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:14:40.385003 12986 server_base.cc:1061] running on GCE node
I20260709 12:14:40.386058 12986 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:14:40.386255 12986 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:14:40.386435 12986 hybrid_clock.cc:648] HybridClock initialized: now 1783599280386405 us; error 0 us; skew 500 ppm
I20260709 12:14:40.386973 12986 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:14:40.389422 12986 webserver.cc:533] Webserver started at http://127.12.174.129:44503/ using document root <none> and password file <none>
I20260709 12:14:40.389969 12986 fs_manager.cc:362] Metadata directory not provided
I20260709 12:14:40.390156 12986 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:14:40.390430 12986 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:14:40.391701 12986 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598886212958-12986-0/minicluster-data/ts-0-root/instance:
uuid: "f2868245e89644679e2b7dac75591a58"
format_stamp: "Formatted at 2026-07-09 12:14:40 on dist-test-slave-9q7n"
I20260709 12:14:40.396940 12986 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:14:40.400909 25521 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:40.401800 12986 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:14:40.402132 12986 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598886212958-12986-0/minicluster-data/ts-0-root
uuid: "f2868245e89644679e2b7dac75591a58"
format_stamp: "Formatted at 2026-07-09 12:14:40 on dist-test-slave-9q7n"
I20260709 12:14:40.402429 12986 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598886212958-12986-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598886212958-12986-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598886212958-12986-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:14:40.420320 12986 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:14:40.421794 12986 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:14:40.423525 12986 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:14:40.426291 12986 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:14:40.426530 12986 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:40.426803 12986 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:14:40.426965 12986 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:40.474920 12986 rpc_server.cc:307] RPC server started. Bound to: 127.12.174.129:40387
I20260709 12:14:40.475063 25583 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.174.129:40387 every 8 connection(s)
I20260709 12:14:40.480993 12986 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:14:40.489151 25588 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:40.490198 25589 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:14:40.494752 12986 server_base.cc:1061] running on GCE node
W20260709 12:14:40.495024 25591 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:14:40.496845 12986 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:14:40.497161 12986 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:14:40.497360 12986 hybrid_clock.cc:648] HybridClock initialized: now 1783599280497341 us; error 0 us; skew 500 ppm
I20260709 12:14:40.498191 12986 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:14:40.499222 25584 heartbeater.cc:344] Connected to a master server at 127.12.174.190:38643
I20260709 12:14:40.499706 25584 heartbeater.cc:461] Registering TS with master...
I20260709 12:14:40.500931 25584 heartbeater.cc:507] Master 127.12.174.190:38643 requested a full tablet report, sending...
I20260709 12:14:40.501214 12986 webserver.cc:533] Webserver started at http://127.12.174.130:45337/ using document root <none> and password file <none>
I20260709 12:14:40.501942 12986 fs_manager.cc:362] Metadata directory not provided
I20260709 12:14:40.502197 12986 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:14:40.502527 12986 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:14:40.503822 25457 ts_manager.cc:194] Registered new tserver with Master: f2868245e89644679e2b7dac75591a58 (127.12.174.129:40387)
I20260709 12:14:40.504375 12986 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598886212958-12986-0/minicluster-data/ts-1-root/instance:
uuid: "6e4eb6facf924880a0e38eeff91ba974"
format_stamp: "Formatted at 2026-07-09 12:14:40 on dist-test-slave-9q7n"
I20260709 12:14:40.506840 25457 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36420
I20260709 12:14:40.510628 12986 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.001s
I20260709 12:14:40.514739 25596 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:40.515570 12986 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.004s	sys 0.000s
I20260709 12:14:40.515859 12986 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598886212958-12986-0/minicluster-data/ts-1-root
uuid: "6e4eb6facf924880a0e38eeff91ba974"
format_stamp: "Formatted at 2026-07-09 12:14:40 on dist-test-slave-9q7n"
I20260709 12:14:40.516121 12986 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598886212958-12986-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598886212958-12986-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598886212958-12986-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:14:40.539759 12986 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:14:40.541056 12986 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:14:40.542692 12986 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:14:40.545156 12986 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:14:40.545349 12986 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:40.545616 12986 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:14:40.545797 12986 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260709 12:14:40.590540 12986 rpc_server.cc:307] RPC server started. Bound to: 127.12.174.130:41805
I20260709 12:14:40.590680 25658 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.174.130:41805 every 8 connection(s)
I20260709 12:14:40.595806 12986 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:14:40.604894 25662 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:40.608289 25663 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:14:40.608633 25665 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:14:40.608868 12986 server_base.cc:1061] running on GCE node
I20260709 12:14:40.609510 25659 heartbeater.cc:344] Connected to a master server at 127.12.174.190:38643
I20260709 12:14:40.610049 25659 heartbeater.cc:461] Registering TS with master...
I20260709 12:14:40.610343 12986 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:14:40.610661 12986 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:14:40.610873 12986 hybrid_clock.cc:648] HybridClock initialized: now 1783599280610852 us; error 0 us; skew 500 ppm
I20260709 12:14:40.611126 25659 heartbeater.cc:507] Master 127.12.174.190:38643 requested a full tablet report, sending...
I20260709 12:14:40.611791 12986 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:14:40.614234 25457 ts_manager.cc:194] Registered new tserver with Master: 6e4eb6facf924880a0e38eeff91ba974 (127.12.174.130:41805)
I20260709 12:14:40.615139 12986 webserver.cc:533] Webserver started at http://127.12.174.131:40029/ using document root <none> and password file <none>
I20260709 12:14:40.615754 12986 fs_manager.cc:362] Metadata directory not provided
I20260709 12:14:40.615844 25457 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36426
I20260709 12:14:40.615931 12986 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:14:40.616534 12986 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:14:40.618294 12986 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598886212958-12986-0/minicluster-data/ts-2-root/instance:
uuid: "7ffdf999adba487a9887fe7e2cc0f874"
format_stamp: "Formatted at 2026-07-09 12:14:40 on dist-test-slave-9q7n"
I20260709 12:14:40.624075 12986 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:14:40.628232 25670 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:40.629483 12986 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 12:14:40.630017 12986 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598886212958-12986-0/minicluster-data/ts-2-root
uuid: "7ffdf999adba487a9887fe7e2cc0f874"
format_stamp: "Formatted at 2026-07-09 12:14:40 on dist-test-slave-9q7n"
I20260709 12:14:40.630379 12986 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598886212958-12986-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598886212958-12986-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598886212958-12986-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:14:40.640738 12986 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:14:40.642174 12986 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:14:40.643803 12986 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:14:40.646366 12986 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:14:40.646596 12986 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:40.646837 12986 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:14:40.646994 12986 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:14:40.696605 12986 rpc_server.cc:307] RPC server started. Bound to: 127.12.174.131:36809
I20260709 12:14:40.696740 25732 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.174.131:36809 every 8 connection(s)
I20260709 12:14:40.712798 25733 heartbeater.cc:344] Connected to a master server at 127.12.174.190:38643
I20260709 12:14:40.713310 25733 heartbeater.cc:461] Registering TS with master...
I20260709 12:14:40.714190 25733 heartbeater.cc:507] Master 127.12.174.190:38643 requested a full tablet report, sending...
I20260709 12:14:40.716290 25457 ts_manager.cc:194] Registered new tserver with Master: 7ffdf999adba487a9887fe7e2cc0f874 (127.12.174.131:36809)
I20260709 12:14:40.716815 12986 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016262445s
I20260709 12:14:40.718322 25457 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36432
I20260709 12:14:40.746762 25457 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36446:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:14:40.749810 25457 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:14:40.835491 25698 tablet_service.cc:1511] Processing CreateTablet for tablet f9d5a17200ac45a7b5a2130ba1fd816b (DEFAULT_TABLE table=test-workload [id=a397e40a5a6f45c8821b69cfb20ca95f]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:14:40.837214 25696 tablet_service.cc:1511] Processing CreateTablet for tablet 243ba61cc23a42669b893d2e6268a359 (DEFAULT_TABLE table=test-workload [id=a397e40a5a6f45c8821b69cfb20ca95f]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:14:40.838631 25697 tablet_service.cc:1511] Processing CreateTablet for tablet 741c39eaebc94dfc9bd1562b10cf0698 (DEFAULT_TABLE table=test-workload [id=a397e40a5a6f45c8821b69cfb20ca95f]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:14:40.842908 25549 tablet_service.cc:1511] Processing CreateTablet for tablet f9d5a17200ac45a7b5a2130ba1fd816b (DEFAULT_TABLE table=test-workload [id=a397e40a5a6f45c8821b69cfb20ca95f]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:14:40.843628 25547 tablet_service.cc:1511] Processing CreateTablet for tablet 243ba61cc23a42669b893d2e6268a359 (DEFAULT_TABLE table=test-workload [id=a397e40a5a6f45c8821b69cfb20ca95f]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:14:40.845238 25547 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 243ba61cc23a42669b893d2e6268a359. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:40.845011 25548 tablet_service.cc:1511] Processing CreateTablet for tablet 741c39eaebc94dfc9bd1562b10cf0698 (DEFAULT_TABLE table=test-workload [id=a397e40a5a6f45c8821b69cfb20ca95f]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:14:40.846565 25548 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 741c39eaebc94dfc9bd1562b10cf0698. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:40.847057 25695 tablet_service.cc:1511] Processing CreateTablet for tablet 448860827aca47b984ef19865addaeff (DEFAULT_TABLE table=test-workload [id=a397e40a5a6f45c8821b69cfb20ca95f]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:14:40.837214 25698 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9d5a17200ac45a7b5a2130ba1fd816b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:40.849885 25697 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 741c39eaebc94dfc9bd1562b10cf0698. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:40.850018 25549 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9d5a17200ac45a7b5a2130ba1fd816b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:40.851816 25694 tablet_service.cc:1511] Processing CreateTablet for tablet 5fa898e4a0cf49c79c9803b61ac3e756 (DEFAULT_TABLE table=test-workload [id=a397e40a5a6f45c8821b69cfb20ca95f]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:14:40.852275 25695 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 448860827aca47b984ef19865addaeff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:40.858084 25693 tablet_service.cc:1511] Processing CreateTablet for tablet 12dd6a165033473e9c39fd87d4763add (DEFAULT_TABLE table=test-workload [id=a397e40a5a6f45c8821b69cfb20ca95f]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:14:40.861515 25546 tablet_service.cc:1511] Processing CreateTablet for tablet 448860827aca47b984ef19865addaeff (DEFAULT_TABLE table=test-workload [id=a397e40a5a6f45c8821b69cfb20ca95f]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:14:40.863332 25546 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 448860827aca47b984ef19865addaeff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:40.863950 25692 tablet_service.cc:1511] Processing CreateTablet for tablet 1513bb8a7eb64808b506fd1c49256752 (DEFAULT_TABLE table=test-workload [id=a397e40a5a6f45c8821b69cfb20ca95f]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:14:40.867136 25692 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1513bb8a7eb64808b506fd1c49256752. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:40.869807 25694 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fa898e4a0cf49c79c9803b61ac3e756. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:40.881673 25542 tablet_service.cc:1511] Processing CreateTablet for tablet 6a3136f9b7e64004b7005f11e9a050f9 (DEFAULT_TABLE table=test-workload [id=a397e40a5a6f45c8821b69cfb20ca95f]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:14:40.883257 25542 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a3136f9b7e64004b7005f11e9a050f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:40.884124 25693 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12dd6a165033473e9c39fd87d4763add. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:40.872447 25545 tablet_service.cc:1511] Processing CreateTablet for tablet 5fa898e4a0cf49c79c9803b61ac3e756 (DEFAULT_TABLE table=test-workload [id=a397e40a5a6f45c8821b69cfb20ca95f]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:14:40.874635 25691 tablet_service.cc:1511] Processing CreateTablet for tablet 6a3136f9b7e64004b7005f11e9a050f9 (DEFAULT_TABLE table=test-workload [id=a397e40a5a6f45c8821b69cfb20ca95f]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:14:40.887542 25691 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a3136f9b7e64004b7005f11e9a050f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:40.876559 25544 tablet_service.cc:1511] Processing CreateTablet for tablet 12dd6a165033473e9c39fd87d4763add (DEFAULT_TABLE table=test-workload [id=a397e40a5a6f45c8821b69cfb20ca95f]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:14:40.879146 25543 tablet_service.cc:1511] Processing CreateTablet for tablet 1513bb8a7eb64808b506fd1c49256752 (DEFAULT_TABLE table=test-workload [id=a397e40a5a6f45c8821b69cfb20ca95f]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:14:40.879707 25690 tablet_service.cc:1511] Processing CreateTablet for tablet 9204b1c1003646bfb3b61de1e4a235d6 (DEFAULT_TABLE table=test-workload [id=a397e40a5a6f45c8821b69cfb20ca95f]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:14:40.894161 25696 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 243ba61cc23a42669b893d2e6268a359. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:40.902557 25690 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9204b1c1003646bfb3b61de1e4a235d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:40.912488 25624 tablet_service.cc:1511] Processing CreateTablet for tablet f9d5a17200ac45a7b5a2130ba1fd816b (DEFAULT_TABLE table=test-workload [id=a397e40a5a6f45c8821b69cfb20ca95f]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:14:40.916234 25622 tablet_service.cc:1511] Processing CreateTablet for tablet 243ba61cc23a42669b893d2e6268a359 (DEFAULT_TABLE table=test-workload [id=a397e40a5a6f45c8821b69cfb20ca95f]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:14:40.919219 25621 tablet_service.cc:1511] Processing CreateTablet for tablet 448860827aca47b984ef19865addaeff (DEFAULT_TABLE table=test-workload [id=a397e40a5a6f45c8821b69cfb20ca95f]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:14:40.924589 25620 tablet_service.cc:1511] Processing CreateTablet for tablet 5fa898e4a0cf49c79c9803b61ac3e756 (DEFAULT_TABLE table=test-workload [id=a397e40a5a6f45c8821b69cfb20ca95f]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:14:40.928900 25619 tablet_service.cc:1511] Processing CreateTablet for tablet 12dd6a165033473e9c39fd87d4763add (DEFAULT_TABLE table=test-workload [id=a397e40a5a6f45c8821b69cfb20ca95f]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:14:40.927349 25545 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fa898e4a0cf49c79c9803b61ac3e756. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:40.933197 25618 tablet_service.cc:1511] Processing CreateTablet for tablet 1513bb8a7eb64808b506fd1c49256752 (DEFAULT_TABLE table=test-workload [id=a397e40a5a6f45c8821b69cfb20ca95f]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:14:40.935197 25617 tablet_service.cc:1511] Processing CreateTablet for tablet 6a3136f9b7e64004b7005f11e9a050f9 (DEFAULT_TABLE table=test-workload [id=a397e40a5a6f45c8821b69cfb20ca95f]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:14:40.930946 25623 tablet_service.cc:1511] Processing CreateTablet for tablet 741c39eaebc94dfc9bd1562b10cf0698 (DEFAULT_TABLE table=test-workload [id=a397e40a5a6f45c8821b69cfb20ca95f]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:14:40.924681 25616 tablet_service.cc:1511] Processing CreateTablet for tablet 9204b1c1003646bfb3b61de1e4a235d6 (DEFAULT_TABLE table=test-workload [id=a397e40a5a6f45c8821b69cfb20ca95f]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:14:40.942291 25544 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12dd6a165033473e9c39fd87d4763add. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:40.950001 25622 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 243ba61cc23a42669b893d2e6268a359. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:40.952656 25624 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9d5a17200ac45a7b5a2130ba1fd816b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:40.954308 25621 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 448860827aca47b984ef19865addaeff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:40.958396 25620 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fa898e4a0cf49c79c9803b61ac3e756. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:40.962971 25541 tablet_service.cc:1511] Processing CreateTablet for tablet 9204b1c1003646bfb3b61de1e4a235d6 (DEFAULT_TABLE table=test-workload [id=a397e40a5a6f45c8821b69cfb20ca95f]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:14:40.965461 25616 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9204b1c1003646bfb3b61de1e4a235d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:40.970443 25618 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1513bb8a7eb64808b506fd1c49256752. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:40.974167 25617 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a3136f9b7e64004b7005f11e9a050f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:40.978430 25623 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 741c39eaebc94dfc9bd1562b10cf0698. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:40.986332 25619 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12dd6a165033473e9c39fd87d4763add. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:41.009400 25543 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1513bb8a7eb64808b506fd1c49256752. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:41.011513 25541 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9204b1c1003646bfb3b61de1e4a235d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:41.117076 25750 tablet_bootstrap.cc:492] T 741c39eaebc94dfc9bd1562b10cf0698 P 6e4eb6facf924880a0e38eeff91ba974: Bootstrap starting.
I20260709 12:14:41.122807 25749 tablet_bootstrap.cc:492] T 5fa898e4a0cf49c79c9803b61ac3e756 P 7ffdf999adba487a9887fe7e2cc0f874: Bootstrap starting.
I20260709 12:14:41.126868 25748 tablet_bootstrap.cc:492] T f9d5a17200ac45a7b5a2130ba1fd816b P f2868245e89644679e2b7dac75591a58: Bootstrap starting.
I20260709 12:14:41.134479 25748 tablet_bootstrap.cc:654] T f9d5a17200ac45a7b5a2130ba1fd816b P f2868245e89644679e2b7dac75591a58: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:41.142099 25750 tablet_bootstrap.cc:654] T 741c39eaebc94dfc9bd1562b10cf0698 P 6e4eb6facf924880a0e38eeff91ba974: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:41.144886 25749 tablet_bootstrap.cc:654] T 5fa898e4a0cf49c79c9803b61ac3e756 P 7ffdf999adba487a9887fe7e2cc0f874: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:41.151638 25748 tablet_bootstrap.cc:492] T f9d5a17200ac45a7b5a2130ba1fd816b P f2868245e89644679e2b7dac75591a58: No bootstrap required, opened a new log
I20260709 12:14:41.151721 25749 tablet_bootstrap.cc:492] T 5fa898e4a0cf49c79c9803b61ac3e756 P 7ffdf999adba487a9887fe7e2cc0f874: No bootstrap required, opened a new log
I20260709 12:14:41.152287 25748 ts_tablet_manager.cc:1403] T f9d5a17200ac45a7b5a2130ba1fd816b P f2868245e89644679e2b7dac75591a58: Time spent bootstrapping tablet: real 0.026s	user 0.004s	sys 0.015s
I20260709 12:14:41.152307 25749 ts_tablet_manager.cc:1403] T 5fa898e4a0cf49c79c9803b61ac3e756 P 7ffdf999adba487a9887fe7e2cc0f874: Time spent bootstrapping tablet: real 0.030s	user 0.009s	sys 0.006s
I20260709 12:14:41.155478 25750 tablet_bootstrap.cc:492] T 741c39eaebc94dfc9bd1562b10cf0698 P 6e4eb6facf924880a0e38eeff91ba974: No bootstrap required, opened a new log
I20260709 12:14:41.156164 25750 ts_tablet_manager.cc:1403] T 741c39eaebc94dfc9bd1562b10cf0698 P 6e4eb6facf924880a0e38eeff91ba974: Time spent bootstrapping tablet: real 0.040s	user 0.002s	sys 0.014s
I20260709 12:14:41.156214 25749 raft_consensus.cc:359] T 5fa898e4a0cf49c79c9803b61ac3e756 P 7ffdf999adba487a9887fe7e2cc0f874 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:41.156970 25749 raft_consensus.cc:385] T 5fa898e4a0cf49c79c9803b61ac3e756 P 7ffdf999adba487a9887fe7e2cc0f874 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:41.157236 25749 raft_consensus.cc:740] T 5fa898e4a0cf49c79c9803b61ac3e756 P 7ffdf999adba487a9887fe7e2cc0f874 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ffdf999adba487a9887fe7e2cc0f874, State: Initialized, Role: FOLLOWER
I20260709 12:14:41.158051 25749 consensus_queue.cc:260] T 5fa898e4a0cf49c79c9803b61ac3e756 P 7ffdf999adba487a9887fe7e2cc0f874 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:41.159145 25748 raft_consensus.cc:359] T f9d5a17200ac45a7b5a2130ba1fd816b P f2868245e89644679e2b7dac75591a58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } } peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } }
I20260709 12:14:41.160192 25748 raft_consensus.cc:385] T f9d5a17200ac45a7b5a2130ba1fd816b P f2868245e89644679e2b7dac75591a58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:41.160657 25748 raft_consensus.cc:740] T f9d5a17200ac45a7b5a2130ba1fd816b P f2868245e89644679e2b7dac75591a58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f2868245e89644679e2b7dac75591a58, State: Initialized, Role: FOLLOWER
I20260709 12:14:41.159868 25750 raft_consensus.cc:359] T 741c39eaebc94dfc9bd1562b10cf0698 P 6e4eb6facf924880a0e38eeff91ba974 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:41.162032 25750 raft_consensus.cc:385] T 741c39eaebc94dfc9bd1562b10cf0698 P 6e4eb6facf924880a0e38eeff91ba974 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:41.162499 25750 raft_consensus.cc:740] T 741c39eaebc94dfc9bd1562b10cf0698 P 6e4eb6facf924880a0e38eeff91ba974 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e4eb6facf924880a0e38eeff91ba974, State: Initialized, Role: FOLLOWER
I20260709 12:14:41.164001 25750 consensus_queue.cc:260] T 741c39eaebc94dfc9bd1562b10cf0698 P 6e4eb6facf924880a0e38eeff91ba974 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:41.165046 25748 consensus_queue.cc:260] T f9d5a17200ac45a7b5a2130ba1fd816b P f2868245e89644679e2b7dac75591a58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } } peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } }
I20260709 12:14:41.168902 25733 heartbeater.cc:499] Master 127.12.174.190:38643 was elected leader, sending a full tablet report...
I20260709 12:14:41.169301 25749 ts_tablet_manager.cc:1434] T 5fa898e4a0cf49c79c9803b61ac3e756 P 7ffdf999adba487a9887fe7e2cc0f874: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.008s
I20260709 12:14:41.170652 25749 tablet_bootstrap.cc:492] T f9d5a17200ac45a7b5a2130ba1fd816b P 7ffdf999adba487a9887fe7e2cc0f874: Bootstrap starting.
I20260709 12:14:41.175838 25750 ts_tablet_manager.cc:1434] T 741c39eaebc94dfc9bd1562b10cf0698 P 6e4eb6facf924880a0e38eeff91ba974: Time spent starting tablet: real 0.019s	user 0.009s	sys 0.006s
I20260709 12:14:41.176324 25748 ts_tablet_manager.cc:1434] T f9d5a17200ac45a7b5a2130ba1fd816b P f2868245e89644679e2b7dac75591a58: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.003s
I20260709 12:14:41.181696 25749 tablet_bootstrap.cc:654] T f9d5a17200ac45a7b5a2130ba1fd816b P 7ffdf999adba487a9887fe7e2cc0f874: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:41.232084 25748 tablet_bootstrap.cc:492] T 5fa898e4a0cf49c79c9803b61ac3e756 P f2868245e89644679e2b7dac75591a58: Bootstrap starting.
I20260709 12:14:41.238925 25749 tablet_bootstrap.cc:492] T f9d5a17200ac45a7b5a2130ba1fd816b P 7ffdf999adba487a9887fe7e2cc0f874: No bootstrap required, opened a new log
I20260709 12:14:41.240402 25749 ts_tablet_manager.cc:1403] T f9d5a17200ac45a7b5a2130ba1fd816b P 7ffdf999adba487a9887fe7e2cc0f874: Time spent bootstrapping tablet: real 0.070s	user 0.016s	sys 0.000s
I20260709 12:14:41.240475 25748 tablet_bootstrap.cc:654] T 5fa898e4a0cf49c79c9803b61ac3e756 P f2868245e89644679e2b7dac75591a58: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:41.330843 25659 heartbeater.cc:499] Master 127.12.174.190:38643 was elected leader, sending a full tablet report...
W20260709 12:14:41.492100 25505 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 12:14:41.509061 25692 consensus_meta.cc:287] T 1513bb8a7eb64808b506fd1c49256752 P 7ffdf999adba487a9887fe7e2cc0f874: Time spent flushing consensus metadata: real 0.532s	user 0.016s	sys 0.006s
W20260709 12:14:41.562544 25696 consensus_meta.cc:287] T 243ba61cc23a42669b893d2e6268a359 P 7ffdf999adba487a9887fe7e2cc0f874: Time spent flushing consensus metadata: real 0.522s	user 0.014s	sys 0.005s
W20260709 12:14:41.564760 25546 consensus_meta.cc:287] T 448860827aca47b984ef19865addaeff P f2868245e89644679e2b7dac75591a58: Time spent flushing consensus metadata: real 0.542s	user 0.009s	sys 0.007s
W20260709 12:14:41.585599 25620 consensus_meta.cc:287] T 5fa898e4a0cf49c79c9803b61ac3e756 P 6e4eb6facf924880a0e38eeff91ba974: Time spent flushing consensus metadata: real 0.528s	user 0.010s	sys 0.005s
W20260709 12:14:41.601539 25697 consensus_meta.cc:287] T 741c39eaebc94dfc9bd1562b10cf0698 P 7ffdf999adba487a9887fe7e2cc0f874: Time spent flushing consensus metadata: real 0.554s	user 0.011s	sys 0.004s
I20260709 12:14:41.620580 25748 tablet_bootstrap.cc:492] T 5fa898e4a0cf49c79c9803b61ac3e756 P f2868245e89644679e2b7dac75591a58: No bootstrap required, opened a new log
I20260709 12:14:41.621199 25748 ts_tablet_manager.cc:1403] T 5fa898e4a0cf49c79c9803b61ac3e756 P f2868245e89644679e2b7dac75591a58: Time spent bootstrapping tablet: real 0.389s	user 0.013s	sys 0.002s
I20260709 12:14:41.243682 25749 raft_consensus.cc:359] T f9d5a17200ac45a7b5a2130ba1fd816b P 7ffdf999adba487a9887fe7e2cc0f874 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } } peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } }
I20260709 12:14:41.624434 25749 raft_consensus.cc:385] T f9d5a17200ac45a7b5a2130ba1fd816b P 7ffdf999adba487a9887fe7e2cc0f874 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:41.624734 25749 raft_consensus.cc:740] T f9d5a17200ac45a7b5a2130ba1fd816b P 7ffdf999adba487a9887fe7e2cc0f874 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ffdf999adba487a9887fe7e2cc0f874, State: Initialized, Role: FOLLOWER
I20260709 12:14:41.625613 25584 heartbeater.cc:499] Master 127.12.174.190:38643 was elected leader, sending a full tablet report...
I20260709 12:14:41.625829 25749 consensus_queue.cc:260] T f9d5a17200ac45a7b5a2130ba1fd816b P 7ffdf999adba487a9887fe7e2cc0f874 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } } peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } }
I20260709 12:14:41.625584 25748 raft_consensus.cc:359] T 5fa898e4a0cf49c79c9803b61ac3e756 P f2868245e89644679e2b7dac75591a58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:41.628471 25748 raft_consensus.cc:385] T 5fa898e4a0cf49c79c9803b61ac3e756 P f2868245e89644679e2b7dac75591a58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:41.628540 25749 ts_tablet_manager.cc:1434] T f9d5a17200ac45a7b5a2130ba1fd816b P 7ffdf999adba487a9887fe7e2cc0f874: Time spent starting tablet: real 0.388s	user 0.011s	sys 0.000s
I20260709 12:14:41.628811 25748 raft_consensus.cc:740] T 5fa898e4a0cf49c79c9803b61ac3e756 P f2868245e89644679e2b7dac75591a58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f2868245e89644679e2b7dac75591a58, State: Initialized, Role: FOLLOWER
I20260709 12:14:41.629875 25748 consensus_queue.cc:260] T 5fa898e4a0cf49c79c9803b61ac3e756 P f2868245e89644679e2b7dac75591a58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:41.631011 25749 tablet_bootstrap.cc:492] T 448860827aca47b984ef19865addaeff P 7ffdf999adba487a9887fe7e2cc0f874: Bootstrap starting.
I20260709 12:14:41.632457 25748 ts_tablet_manager.cc:1434] T 5fa898e4a0cf49c79c9803b61ac3e756 P f2868245e89644679e2b7dac75591a58: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.001s
I20260709 12:14:41.633723 25748 tablet_bootstrap.cc:492] T 741c39eaebc94dfc9bd1562b10cf0698 P f2868245e89644679e2b7dac75591a58: Bootstrap starting.
I20260709 12:14:41.639367 25749 tablet_bootstrap.cc:654] T 448860827aca47b984ef19865addaeff P 7ffdf999adba487a9887fe7e2cc0f874: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:41.642923 25748 tablet_bootstrap.cc:654] T 741c39eaebc94dfc9bd1562b10cf0698 P f2868245e89644679e2b7dac75591a58: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:41.653712 25750 tablet_bootstrap.cc:492] T 6a3136f9b7e64004b7005f11e9a050f9 P 6e4eb6facf924880a0e38eeff91ba974: Bootstrap starting.
I20260709 12:14:41.661267 25749 tablet_bootstrap.cc:492] T 448860827aca47b984ef19865addaeff P 7ffdf999adba487a9887fe7e2cc0f874: No bootstrap required, opened a new log
I20260709 12:14:41.662027 25749 ts_tablet_manager.cc:1403] T 448860827aca47b984ef19865addaeff P 7ffdf999adba487a9887fe7e2cc0f874: Time spent bootstrapping tablet: real 0.031s	user 0.017s	sys 0.002s
I20260709 12:14:41.663429 25748 tablet_bootstrap.cc:492] T 741c39eaebc94dfc9bd1562b10cf0698 P f2868245e89644679e2b7dac75591a58: No bootstrap required, opened a new log
I20260709 12:14:41.664038 25748 ts_tablet_manager.cc:1403] T 741c39eaebc94dfc9bd1562b10cf0698 P f2868245e89644679e2b7dac75591a58: Time spent bootstrapping tablet: real 0.031s	user 0.015s	sys 0.003s
I20260709 12:14:41.665388 25749 raft_consensus.cc:359] T 448860827aca47b984ef19865addaeff P 7ffdf999adba487a9887fe7e2cc0f874 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:41.666249 25749 raft_consensus.cc:385] T 448860827aca47b984ef19865addaeff P 7ffdf999adba487a9887fe7e2cc0f874 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:41.666533 25749 raft_consensus.cc:740] T 448860827aca47b984ef19865addaeff P 7ffdf999adba487a9887fe7e2cc0f874 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ffdf999adba487a9887fe7e2cc0f874, State: Initialized, Role: FOLLOWER
I20260709 12:14:41.667269 25748 raft_consensus.cc:359] T 741c39eaebc94dfc9bd1562b10cf0698 P f2868245e89644679e2b7dac75591a58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:41.668059 25748 raft_consensus.cc:385] T 741c39eaebc94dfc9bd1562b10cf0698 P f2868245e89644679e2b7dac75591a58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:41.668370 25748 raft_consensus.cc:740] T 741c39eaebc94dfc9bd1562b10cf0698 P f2868245e89644679e2b7dac75591a58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f2868245e89644679e2b7dac75591a58, State: Initialized, Role: FOLLOWER
I20260709 12:14:41.669258 25748 consensus_queue.cc:260] T 741c39eaebc94dfc9bd1562b10cf0698 P f2868245e89644679e2b7dac75591a58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:41.672209 25748 ts_tablet_manager.cc:1434] T 741c39eaebc94dfc9bd1562b10cf0698 P f2868245e89644679e2b7dac75591a58: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:14:41.673098 25750 tablet_bootstrap.cc:654] T 6a3136f9b7e64004b7005f11e9a050f9 P 6e4eb6facf924880a0e38eeff91ba974: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:41.667603 25749 consensus_queue.cc:260] T 448860827aca47b984ef19865addaeff P 7ffdf999adba487a9887fe7e2cc0f874 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:41.675318 25749 ts_tablet_manager.cc:1434] T 448860827aca47b984ef19865addaeff P 7ffdf999adba487a9887fe7e2cc0f874: Time spent starting tablet: real 0.013s	user 0.003s	sys 0.003s
I20260709 12:14:41.675537 25748 tablet_bootstrap.cc:492] T 243ba61cc23a42669b893d2e6268a359 P f2868245e89644679e2b7dac75591a58: Bootstrap starting.
I20260709 12:14:41.676724 25749 tablet_bootstrap.cc:492] T 12dd6a165033473e9c39fd87d4763add P 7ffdf999adba487a9887fe7e2cc0f874: Bootstrap starting.
I20260709 12:14:41.685449 25749 tablet_bootstrap.cc:654] T 12dd6a165033473e9c39fd87d4763add P 7ffdf999adba487a9887fe7e2cc0f874: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:41.690460 25748 tablet_bootstrap.cc:654] T 243ba61cc23a42669b893d2e6268a359 P f2868245e89644679e2b7dac75591a58: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:41.698217 25749 tablet_bootstrap.cc:492] T 12dd6a165033473e9c39fd87d4763add P 7ffdf999adba487a9887fe7e2cc0f874: No bootstrap required, opened a new log
I20260709 12:14:41.698983 25749 ts_tablet_manager.cc:1403] T 12dd6a165033473e9c39fd87d4763add P 7ffdf999adba487a9887fe7e2cc0f874: Time spent bootstrapping tablet: real 0.023s	user 0.017s	sys 0.005s
I20260709 12:14:41.702569 25748 tablet_bootstrap.cc:492] T 243ba61cc23a42669b893d2e6268a359 P f2868245e89644679e2b7dac75591a58: No bootstrap required, opened a new log
I20260709 12:14:41.703392 25748 ts_tablet_manager.cc:1403] T 243ba61cc23a42669b893d2e6268a359 P f2868245e89644679e2b7dac75591a58: Time spent bootstrapping tablet: real 0.030s	user 0.007s	sys 0.013s
I20260709 12:14:41.702765 25749 raft_consensus.cc:359] T 12dd6a165033473e9c39fd87d4763add P 7ffdf999adba487a9887fe7e2cc0f874 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:41.703991 25749 raft_consensus.cc:385] T 12dd6a165033473e9c39fd87d4763add P 7ffdf999adba487a9887fe7e2cc0f874 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:41.704401 25749 raft_consensus.cc:740] T 12dd6a165033473e9c39fd87d4763add P 7ffdf999adba487a9887fe7e2cc0f874 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ffdf999adba487a9887fe7e2cc0f874, State: Initialized, Role: FOLLOWER
I20260709 12:14:41.705545 25749 consensus_queue.cc:260] T 12dd6a165033473e9c39fd87d4763add P 7ffdf999adba487a9887fe7e2cc0f874 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:41.706878 25748 raft_consensus.cc:359] T 243ba61cc23a42669b893d2e6268a359 P f2868245e89644679e2b7dac75591a58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:41.707736 25748 raft_consensus.cc:385] T 243ba61cc23a42669b893d2e6268a359 P f2868245e89644679e2b7dac75591a58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:41.708050 25748 raft_consensus.cc:740] T 243ba61cc23a42669b893d2e6268a359 P f2868245e89644679e2b7dac75591a58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f2868245e89644679e2b7dac75591a58, State: Initialized, Role: FOLLOWER
I20260709 12:14:41.708874 25749 ts_tablet_manager.cc:1434] T 12dd6a165033473e9c39fd87d4763add P 7ffdf999adba487a9887fe7e2cc0f874: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:14:41.708953 25748 consensus_queue.cc:260] T 243ba61cc23a42669b893d2e6268a359 P f2868245e89644679e2b7dac75591a58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:41.711323 25749 tablet_bootstrap.cc:492] T 1513bb8a7eb64808b506fd1c49256752 P 7ffdf999adba487a9887fe7e2cc0f874: Bootstrap starting.
I20260709 12:14:41.711920 25748 ts_tablet_manager.cc:1434] T 243ba61cc23a42669b893d2e6268a359 P f2868245e89644679e2b7dac75591a58: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:14:41.712349 25750 tablet_bootstrap.cc:492] T 6a3136f9b7e64004b7005f11e9a050f9 P 6e4eb6facf924880a0e38eeff91ba974: No bootstrap required, opened a new log
I20260709 12:14:41.712911 25750 ts_tablet_manager.cc:1403] T 6a3136f9b7e64004b7005f11e9a050f9 P 6e4eb6facf924880a0e38eeff91ba974: Time spent bootstrapping tablet: real 0.059s	user 0.019s	sys 0.019s
I20260709 12:14:41.713063 25748 tablet_bootstrap.cc:492] T 12dd6a165033473e9c39fd87d4763add P f2868245e89644679e2b7dac75591a58: Bootstrap starting.
I20260709 12:14:41.716289 25750 raft_consensus.cc:359] T 6a3136f9b7e64004b7005f11e9a050f9 P 6e4eb6facf924880a0e38eeff91ba974 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:41.717063 25750 raft_consensus.cc:385] T 6a3136f9b7e64004b7005f11e9a050f9 P 6e4eb6facf924880a0e38eeff91ba974 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:41.717367 25750 raft_consensus.cc:740] T 6a3136f9b7e64004b7005f11e9a050f9 P 6e4eb6facf924880a0e38eeff91ba974 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e4eb6facf924880a0e38eeff91ba974, State: Initialized, Role: FOLLOWER
I20260709 12:14:41.718312 25750 consensus_queue.cc:260] T 6a3136f9b7e64004b7005f11e9a050f9 P 6e4eb6facf924880a0e38eeff91ba974 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:41.720111 25749 tablet_bootstrap.cc:654] T 1513bb8a7eb64808b506fd1c49256752 P 7ffdf999adba487a9887fe7e2cc0f874: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:41.720790 25748 tablet_bootstrap.cc:654] T 12dd6a165033473e9c39fd87d4763add P f2868245e89644679e2b7dac75591a58: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:41.739828 25750 ts_tablet_manager.cc:1434] T 6a3136f9b7e64004b7005f11e9a050f9 P 6e4eb6facf924880a0e38eeff91ba974: Time spent starting tablet: real 0.027s	user 0.021s	sys 0.006s
I20260709 12:14:41.741154 25750 tablet_bootstrap.cc:492] T 12dd6a165033473e9c39fd87d4763add P 6e4eb6facf924880a0e38eeff91ba974: Bootstrap starting.
I20260709 12:14:41.741525 25748 tablet_bootstrap.cc:492] T 12dd6a165033473e9c39fd87d4763add P f2868245e89644679e2b7dac75591a58: No bootstrap required, opened a new log
I20260709 12:14:41.742216 25748 ts_tablet_manager.cc:1403] T 12dd6a165033473e9c39fd87d4763add P f2868245e89644679e2b7dac75591a58: Time spent bootstrapping tablet: real 0.029s	user 0.021s	sys 0.007s
I20260709 12:14:41.743100 25749 tablet_bootstrap.cc:492] T 1513bb8a7eb64808b506fd1c49256752 P 7ffdf999adba487a9887fe7e2cc0f874: No bootstrap required, opened a new log
I20260709 12:14:41.743723 25749 ts_tablet_manager.cc:1403] T 1513bb8a7eb64808b506fd1c49256752 P 7ffdf999adba487a9887fe7e2cc0f874: Time spent bootstrapping tablet: real 0.033s	user 0.015s	sys 0.012s
I20260709 12:14:41.745661 25748 raft_consensus.cc:359] T 12dd6a165033473e9c39fd87d4763add P f2868245e89644679e2b7dac75591a58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:41.746541 25748 raft_consensus.cc:385] T 12dd6a165033473e9c39fd87d4763add P f2868245e89644679e2b7dac75591a58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:41.746850 25748 raft_consensus.cc:740] T 12dd6a165033473e9c39fd87d4763add P f2868245e89644679e2b7dac75591a58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f2868245e89644679e2b7dac75591a58, State: Initialized, Role: FOLLOWER
I20260709 12:14:41.747720 25748 consensus_queue.cc:260] T 12dd6a165033473e9c39fd87d4763add P f2868245e89644679e2b7dac75591a58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:41.746865 25749 raft_consensus.cc:359] T 1513bb8a7eb64808b506fd1c49256752 P 7ffdf999adba487a9887fe7e2cc0f874 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:41.748405 25750 tablet_bootstrap.cc:654] T 12dd6a165033473e9c39fd87d4763add P 6e4eb6facf924880a0e38eeff91ba974: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:41.750310 25748 ts_tablet_manager.cc:1434] T 12dd6a165033473e9c39fd87d4763add P f2868245e89644679e2b7dac75591a58: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 12:14:41.748680 25749 raft_consensus.cc:385] T 1513bb8a7eb64808b506fd1c49256752 P 7ffdf999adba487a9887fe7e2cc0f874 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:41.751161 25749 raft_consensus.cc:740] T 1513bb8a7eb64808b506fd1c49256752 P 7ffdf999adba487a9887fe7e2cc0f874 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ffdf999adba487a9887fe7e2cc0f874, State: Initialized, Role: FOLLOWER
I20260709 12:14:41.751621 25748 tablet_bootstrap.cc:492] T 1513bb8a7eb64808b506fd1c49256752 P f2868245e89644679e2b7dac75591a58: Bootstrap starting.
I20260709 12:14:41.752298 25749 consensus_queue.cc:260] T 1513bb8a7eb64808b506fd1c49256752 P 7ffdf999adba487a9887fe7e2cc0f874 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:41.755265 25749 ts_tablet_manager.cc:1434] T 1513bb8a7eb64808b506fd1c49256752 P 7ffdf999adba487a9887fe7e2cc0f874: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.003s
I20260709 12:14:41.756493 25749 tablet_bootstrap.cc:492] T 243ba61cc23a42669b893d2e6268a359 P 7ffdf999adba487a9887fe7e2cc0f874: Bootstrap starting.
I20260709 12:14:41.760303 25748 tablet_bootstrap.cc:654] T 1513bb8a7eb64808b506fd1c49256752 P f2868245e89644679e2b7dac75591a58: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:41.763759 25749 tablet_bootstrap.cc:654] T 243ba61cc23a42669b893d2e6268a359 P 7ffdf999adba487a9887fe7e2cc0f874: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:41.770161 25756 raft_consensus.cc:493] T 741c39eaebc94dfc9bd1562b10cf0698 P f2868245e89644679e2b7dac75591a58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:41.770884 25756 raft_consensus.cc:515] T 741c39eaebc94dfc9bd1562b10cf0698 P f2868245e89644679e2b7dac75591a58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:41.774318 25748 tablet_bootstrap.cc:492] T 1513bb8a7eb64808b506fd1c49256752 P f2868245e89644679e2b7dac75591a58: No bootstrap required, opened a new log
I20260709 12:14:41.774500 25749 tablet_bootstrap.cc:492] T 243ba61cc23a42669b893d2e6268a359 P 7ffdf999adba487a9887fe7e2cc0f874: No bootstrap required, opened a new log
I20260709 12:14:41.775235 25748 ts_tablet_manager.cc:1403] T 1513bb8a7eb64808b506fd1c49256752 P f2868245e89644679e2b7dac75591a58: Time spent bootstrapping tablet: real 0.024s	user 0.018s	sys 0.003s
I20260709 12:14:41.775559 25749 ts_tablet_manager.cc:1403] T 243ba61cc23a42669b893d2e6268a359 P 7ffdf999adba487a9887fe7e2cc0f874: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.008s
I20260709 12:14:41.779534 25749 raft_consensus.cc:359] T 243ba61cc23a42669b893d2e6268a359 P 7ffdf999adba487a9887fe7e2cc0f874 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:41.781886 25749 raft_consensus.cc:385] T 243ba61cc23a42669b893d2e6268a359 P 7ffdf999adba487a9887fe7e2cc0f874 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:41.782279 25749 raft_consensus.cc:740] T 243ba61cc23a42669b893d2e6268a359 P 7ffdf999adba487a9887fe7e2cc0f874 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ffdf999adba487a9887fe7e2cc0f874, State: Initialized, Role: FOLLOWER
I20260709 12:14:41.782474 25756 leader_election.cc:290] T 741c39eaebc94dfc9bd1562b10cf0698 P f2868245e89644679e2b7dac75591a58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6e4eb6facf924880a0e38eeff91ba974 (127.12.174.130:41805), 7ffdf999adba487a9887fe7e2cc0f874 (127.12.174.131:36809)
I20260709 12:14:41.783854 25749 consensus_queue.cc:260] T 243ba61cc23a42669b893d2e6268a359 P 7ffdf999adba487a9887fe7e2cc0f874 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:41.785660 25748 raft_consensus.cc:359] T 1513bb8a7eb64808b506fd1c49256752 P f2868245e89644679e2b7dac75591a58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:41.786825 25748 raft_consensus.cc:385] T 1513bb8a7eb64808b506fd1c49256752 P f2868245e89644679e2b7dac75591a58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:41.787097 25749 ts_tablet_manager.cc:1434] T 243ba61cc23a42669b893d2e6268a359 P 7ffdf999adba487a9887fe7e2cc0f874: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 12:14:41.788707 25749 tablet_bootstrap.cc:492] T 741c39eaebc94dfc9bd1562b10cf0698 P 7ffdf999adba487a9887fe7e2cc0f874: Bootstrap starting.
I20260709 12:14:41.787195 25748 raft_consensus.cc:740] T 1513bb8a7eb64808b506fd1c49256752 P f2868245e89644679e2b7dac75591a58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f2868245e89644679e2b7dac75591a58, State: Initialized, Role: FOLLOWER
I20260709 12:14:41.793155 25748 consensus_queue.cc:260] T 1513bb8a7eb64808b506fd1c49256752 P f2868245e89644679e2b7dac75591a58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:41.796744 25749 tablet_bootstrap.cc:654] T 741c39eaebc94dfc9bd1562b10cf0698 P 7ffdf999adba487a9887fe7e2cc0f874: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:41.797932 25748 ts_tablet_manager.cc:1434] T 1513bb8a7eb64808b506fd1c49256752 P f2868245e89644679e2b7dac75591a58: Time spent starting tablet: real 0.022s	user 0.011s	sys 0.000s
I20260709 12:14:41.806416 25748 tablet_bootstrap.cc:492] T 448860827aca47b984ef19865addaeff P f2868245e89644679e2b7dac75591a58: Bootstrap starting.
I20260709 12:14:41.807368 25756 raft_consensus.cc:493] T 5fa898e4a0cf49c79c9803b61ac3e756 P f2868245e89644679e2b7dac75591a58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:41.808101 25756 raft_consensus.cc:515] T 5fa898e4a0cf49c79c9803b61ac3e756 P f2868245e89644679e2b7dac75591a58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:41.807726 25764 raft_consensus.cc:493] T 6a3136f9b7e64004b7005f11e9a050f9 P 6e4eb6facf924880a0e38eeff91ba974 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:41.809551 25764 raft_consensus.cc:515] T 6a3136f9b7e64004b7005f11e9a050f9 P 6e4eb6facf924880a0e38eeff91ba974 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:41.810716 25756 leader_election.cc:290] T 5fa898e4a0cf49c79c9803b61ac3e756 P f2868245e89644679e2b7dac75591a58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6e4eb6facf924880a0e38eeff91ba974 (127.12.174.130:41805), 7ffdf999adba487a9887fe7e2cc0f874 (127.12.174.131:36809)
I20260709 12:14:41.825704 25754 raft_consensus.cc:493] T 448860827aca47b984ef19865addaeff P 7ffdf999adba487a9887fe7e2cc0f874 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:41.826448 25754 raft_consensus.cc:515] T 448860827aca47b984ef19865addaeff P 7ffdf999adba487a9887fe7e2cc0f874 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:41.831202 25754 leader_election.cc:290] T 448860827aca47b984ef19865addaeff P 7ffdf999adba487a9887fe7e2cc0f874 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f2868245e89644679e2b7dac75591a58 (127.12.174.129:40387), 6e4eb6facf924880a0e38eeff91ba974 (127.12.174.130:41805)
I20260709 12:14:41.833781 25634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "741c39eaebc94dfc9bd1562b10cf0698" candidate_uuid: "f2868245e89644679e2b7dac75591a58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e4eb6facf924880a0e38eeff91ba974" is_pre_election: true
I20260709 12:14:41.834153 25633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fa898e4a0cf49c79c9803b61ac3e756" candidate_uuid: "f2868245e89644679e2b7dac75591a58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e4eb6facf924880a0e38eeff91ba974" is_pre_election: true
I20260709 12:14:41.834714 25634 raft_consensus.cc:2468] T 741c39eaebc94dfc9bd1562b10cf0698 P 6e4eb6facf924880a0e38eeff91ba974 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f2868245e89644679e2b7dac75591a58 in term 0.
W20260709 12:14:41.836504 25522 leader_election.cc:343] T 5fa898e4a0cf49c79c9803b61ac3e756 P f2868245e89644679e2b7dac75591a58 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6e4eb6facf924880a0e38eeff91ba974 (127.12.174.130:41805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:41.837311 25522 leader_election.cc:304] T 741c39eaebc94dfc9bd1562b10cf0698 P f2868245e89644679e2b7dac75591a58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e4eb6facf924880a0e38eeff91ba974, f2868245e89644679e2b7dac75591a58; no voters: 
I20260709 12:14:41.838260 25756 raft_consensus.cc:2804] T 741c39eaebc94dfc9bd1562b10cf0698 P f2868245e89644679e2b7dac75591a58 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:41.838694 25756 raft_consensus.cc:493] T 741c39eaebc94dfc9bd1562b10cf0698 P f2868245e89644679e2b7dac75591a58 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:41.839046 25756 raft_consensus.cc:3060] T 741c39eaebc94dfc9bd1562b10cf0698 P f2868245e89644679e2b7dac75591a58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:41.850816 25764 leader_election.cc:290] T 6a3136f9b7e64004b7005f11e9a050f9 P 6e4eb6facf924880a0e38eeff91ba974 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f2868245e89644679e2b7dac75591a58 (127.12.174.129:40387), 7ffdf999adba487a9887fe7e2cc0f874 (127.12.174.131:36809)
I20260709 12:14:41.866637 25754 raft_consensus.cc:493] T f9d5a17200ac45a7b5a2130ba1fd816b P 7ffdf999adba487a9887fe7e2cc0f874 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:41.867303 25754 raft_consensus.cc:515] T f9d5a17200ac45a7b5a2130ba1fd816b P 7ffdf999adba487a9887fe7e2cc0f874 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } } peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } }
I20260709 12:14:41.869757 25754 leader_election.cc:290] T f9d5a17200ac45a7b5a2130ba1fd816b P 7ffdf999adba487a9887fe7e2cc0f874 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f2868245e89644679e2b7dac75591a58 (127.12.174.129:40387), 6e4eb6facf924880a0e38eeff91ba974 (127.12.174.130:41805)
I20260709 12:14:41.879364 25754 raft_consensus.cc:493] T 1513bb8a7eb64808b506fd1c49256752 P 7ffdf999adba487a9887fe7e2cc0f874 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:41.879907 25754 raft_consensus.cc:515] T 1513bb8a7eb64808b506fd1c49256752 P 7ffdf999adba487a9887fe7e2cc0f874 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:41.881103 25748 tablet_bootstrap.cc:654] T 448860827aca47b984ef19865addaeff P f2868245e89644679e2b7dac75591a58: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:41.882172 25754 leader_election.cc:290] T 1513bb8a7eb64808b506fd1c49256752 P 7ffdf999adba487a9887fe7e2cc0f874 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f2868245e89644679e2b7dac75591a58 (127.12.174.129:40387), 6e4eb6facf924880a0e38eeff91ba974 (127.12.174.130:41805)
I20260709 12:14:41.883597 25750 tablet_bootstrap.cc:492] T 12dd6a165033473e9c39fd87d4763add P 6e4eb6facf924880a0e38eeff91ba974: No bootstrap required, opened a new log
I20260709 12:14:41.884428 25750 ts_tablet_manager.cc:1403] T 12dd6a165033473e9c39fd87d4763add P 6e4eb6facf924880a0e38eeff91ba974: Time spent bootstrapping tablet: real 0.144s	user 0.061s	sys 0.057s
I20260709 12:14:41.861363 25756 raft_consensus.cc:515] T 741c39eaebc94dfc9bd1562b10cf0698 P f2868245e89644679e2b7dac75591a58 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:41.887420 25756 leader_election.cc:290] T 741c39eaebc94dfc9bd1562b10cf0698 P f2868245e89644679e2b7dac75591a58 [CANDIDATE]: Term 1 election: Requested vote from peers 6e4eb6facf924880a0e38eeff91ba974 (127.12.174.130:41805), 7ffdf999adba487a9887fe7e2cc0f874 (127.12.174.131:36809)
I20260709 12:14:41.887984 25756 raft_consensus.cc:493] T 12dd6a165033473e9c39fd87d4763add P f2868245e89644679e2b7dac75591a58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:41.888211 25634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "741c39eaebc94dfc9bd1562b10cf0698" candidate_uuid: "f2868245e89644679e2b7dac75591a58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e4eb6facf924880a0e38eeff91ba974"
I20260709 12:14:41.888439 25756 raft_consensus.cc:515] T 12dd6a165033473e9c39fd87d4763add P f2868245e89644679e2b7dac75591a58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:41.888918 25634 raft_consensus.cc:3060] T 741c39eaebc94dfc9bd1562b10cf0698 P 6e4eb6facf924880a0e38eeff91ba974 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:41.888644 25750 raft_consensus.cc:359] T 12dd6a165033473e9c39fd87d4763add P 6e4eb6facf924880a0e38eeff91ba974 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:41.889411 25750 raft_consensus.cc:385] T 12dd6a165033473e9c39fd87d4763add P 6e4eb6facf924880a0e38eeff91ba974 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:41.889712 25750 raft_consensus.cc:740] T 12dd6a165033473e9c39fd87d4763add P 6e4eb6facf924880a0e38eeff91ba974 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e4eb6facf924880a0e38eeff91ba974, State: Initialized, Role: FOLLOWER
I20260709 12:14:41.890729 25756 leader_election.cc:290] T 12dd6a165033473e9c39fd87d4763add P f2868245e89644679e2b7dac75591a58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6e4eb6facf924880a0e38eeff91ba974 (127.12.174.130:41805), 7ffdf999adba487a9887fe7e2cc0f874 (127.12.174.131:36809)
I20260709 12:14:41.890551 25750 consensus_queue.cc:260] T 12dd6a165033473e9c39fd87d4763add P 6e4eb6facf924880a0e38eeff91ba974 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:41.892953 25750 ts_tablet_manager.cc:1434] T 12dd6a165033473e9c39fd87d4763add P 6e4eb6facf924880a0e38eeff91ba974: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.002s
I20260709 12:14:41.894116 25750 tablet_bootstrap.cc:492] T 5fa898e4a0cf49c79c9803b61ac3e756 P 6e4eb6facf924880a0e38eeff91ba974: Bootstrap starting.
I20260709 12:14:41.895381 25559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3136f9b7e64004b7005f11e9a050f9" candidate_uuid: "6e4eb6facf924880a0e38eeff91ba974" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f2868245e89644679e2b7dac75591a58" is_pre_election: true
I20260709 12:14:41.896314 25749 tablet_bootstrap.cc:492] T 741c39eaebc94dfc9bd1562b10cf0698 P 7ffdf999adba487a9887fe7e2cc0f874: No bootstrap required, opened a new log
I20260709 12:14:41.896855 25633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12dd6a165033473e9c39fd87d4763add" candidate_uuid: "f2868245e89644679e2b7dac75591a58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e4eb6facf924880a0e38eeff91ba974" is_pre_election: true
I20260709 12:14:41.897548 25633 raft_consensus.cc:2468] T 12dd6a165033473e9c39fd87d4763add P 6e4eb6facf924880a0e38eeff91ba974 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f2868245e89644679e2b7dac75591a58 in term 0.
W20260709 12:14:41.899004 25597 leader_election.cc:343] T 6a3136f9b7e64004b7005f11e9a050f9 P 6e4eb6facf924880a0e38eeff91ba974 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f2868245e89644679e2b7dac75591a58 (127.12.174.129:40387): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:41.901217 25750 tablet_bootstrap.cc:654] T 5fa898e4a0cf49c79c9803b61ac3e756 P 6e4eb6facf924880a0e38eeff91ba974: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:41.902606 25522 leader_election.cc:304] T 12dd6a165033473e9c39fd87d4763add P f2868245e89644679e2b7dac75591a58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e4eb6facf924880a0e38eeff91ba974, f2868245e89644679e2b7dac75591a58; no voters: 
I20260709 12:14:41.903833 25782 raft_consensus.cc:2804] T 12dd6a165033473e9c39fd87d4763add P f2868245e89644679e2b7dac75591a58 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:41.904273 25782 raft_consensus.cc:493] T 12dd6a165033473e9c39fd87d4763add P f2868245e89644679e2b7dac75591a58 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:41.904608 25782 raft_consensus.cc:3060] T 12dd6a165033473e9c39fd87d4763add P f2868245e89644679e2b7dac75591a58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:41.911160 25708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "741c39eaebc94dfc9bd1562b10cf0698" candidate_uuid: "f2868245e89644679e2b7dac75591a58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffdf999adba487a9887fe7e2cc0f874" is_pre_election: true
I20260709 12:14:41.911726 25707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fa898e4a0cf49c79c9803b61ac3e756" candidate_uuid: "f2868245e89644679e2b7dac75591a58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffdf999adba487a9887fe7e2cc0f874" is_pre_election: true
I20260709 12:14:41.912518 25707 raft_consensus.cc:2468] T 5fa898e4a0cf49c79c9803b61ac3e756 P 7ffdf999adba487a9887fe7e2cc0f874 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f2868245e89644679e2b7dac75591a58 in term 0.
I20260709 12:14:41.913959 25750 tablet_bootstrap.cc:492] T 5fa898e4a0cf49c79c9803b61ac3e756 P 6e4eb6facf924880a0e38eeff91ba974: No bootstrap required, opened a new log
I20260709 12:14:41.914613 25750 ts_tablet_manager.cc:1403] T 5fa898e4a0cf49c79c9803b61ac3e756 P 6e4eb6facf924880a0e38eeff91ba974: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.004s
I20260709 12:14:41.915525 25708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12dd6a165033473e9c39fd87d4763add" candidate_uuid: "f2868245e89644679e2b7dac75591a58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffdf999adba487a9887fe7e2cc0f874" is_pre_election: true
I20260709 12:14:41.916301 25708 raft_consensus.cc:2468] T 12dd6a165033473e9c39fd87d4763add P 7ffdf999adba487a9887fe7e2cc0f874 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f2868245e89644679e2b7dac75591a58 in term 0.
I20260709 12:14:41.914712 25707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "741c39eaebc94dfc9bd1562b10cf0698" candidate_uuid: "f2868245e89644679e2b7dac75591a58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffdf999adba487a9887fe7e2cc0f874"
I20260709 12:14:41.917227 25706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3136f9b7e64004b7005f11e9a050f9" candidate_uuid: "6e4eb6facf924880a0e38eeff91ba974" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffdf999adba487a9887fe7e2cc0f874" is_pre_election: true
I20260709 12:14:41.917215 25633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "448860827aca47b984ef19865addaeff" candidate_uuid: "7ffdf999adba487a9887fe7e2cc0f874" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e4eb6facf924880a0e38eeff91ba974" is_pre_election: true
W20260709 12:14:41.919061 25600 leader_election.cc:343] T 6a3136f9b7e64004b7005f11e9a050f9 P 6e4eb6facf924880a0e38eeff91ba974 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ffdf999adba487a9887fe7e2cc0f874 (127.12.174.131:36809): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:41.919605 25600 leader_election.cc:304] T 6a3136f9b7e64004b7005f11e9a050f9 P 6e4eb6facf924880a0e38eeff91ba974 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e4eb6facf924880a0e38eeff91ba974; no voters: 7ffdf999adba487a9887fe7e2cc0f874, f2868245e89644679e2b7dac75591a58
I20260709 12:14:41.920218 25782 raft_consensus.cc:515] T 12dd6a165033473e9c39fd87d4763add P f2868245e89644679e2b7dac75591a58 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:41.920603 25764 raft_consensus.cc:2749] T 6a3136f9b7e64004b7005f11e9a050f9 P 6e4eb6facf924880a0e38eeff91ba974 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:14:41.914606 25525 leader_election.cc:343] T 741c39eaebc94dfc9bd1562b10cf0698 P f2868245e89644679e2b7dac75591a58 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ffdf999adba487a9887fe7e2cc0f874 (127.12.174.131:36809): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:14:41.922868 25671 leader_election.cc:343] T 448860827aca47b984ef19865addaeff P 7ffdf999adba487a9887fe7e2cc0f874 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6e4eb6facf924880a0e38eeff91ba974 (127.12.174.130:41805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:41.896884 25749 ts_tablet_manager.cc:1403] T 741c39eaebc94dfc9bd1562b10cf0698 P 7ffdf999adba487a9887fe7e2cc0f874: Time spent bootstrapping tablet: real 0.108s	user 0.021s	sys 0.020s
I20260709 12:14:41.923065 25633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9d5a17200ac45a7b5a2130ba1fd816b" candidate_uuid: "7ffdf999adba487a9887fe7e2cc0f874" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e4eb6facf924880a0e38eeff91ba974" is_pre_election: true
I20260709 12:14:41.923233 25525 leader_election.cc:304] T 5fa898e4a0cf49c79c9803b61ac3e756 P f2868245e89644679e2b7dac75591a58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffdf999adba487a9887fe7e2cc0f874, f2868245e89644679e2b7dac75591a58; no voters: 6e4eb6facf924880a0e38eeff91ba974
I20260709 12:14:41.923590 25632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1513bb8a7eb64808b506fd1c49256752" candidate_uuid: "7ffdf999adba487a9887fe7e2cc0f874" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e4eb6facf924880a0e38eeff91ba974" is_pre_election: true
I20260709 12:14:41.924299 25756 raft_consensus.cc:2804] T 5fa898e4a0cf49c79c9803b61ac3e756 P f2868245e89644679e2b7dac75591a58 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:41.924700 25756 raft_consensus.cc:493] T 5fa898e4a0cf49c79c9803b61ac3e756 P f2868245e89644679e2b7dac75591a58 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:41.925093 25756 raft_consensus.cc:3060] T 5fa898e4a0cf49c79c9803b61ac3e756 P f2868245e89644679e2b7dac75591a58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:41.926954 25750 raft_consensus.cc:359] T 5fa898e4a0cf49c79c9803b61ac3e756 P 6e4eb6facf924880a0e38eeff91ba974 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:41.922022 25634 raft_consensus.cc:2468] T 741c39eaebc94dfc9bd1562b10cf0698 P 6e4eb6facf924880a0e38eeff91ba974 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f2868245e89644679e2b7dac75591a58 in term 1.
I20260709 12:14:41.927810 25750 raft_consensus.cc:385] T 5fa898e4a0cf49c79c9803b61ac3e756 P 6e4eb6facf924880a0e38eeff91ba974 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:41.928197 25750 raft_consensus.cc:740] T 5fa898e4a0cf49c79c9803b61ac3e756 P 6e4eb6facf924880a0e38eeff91ba974 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e4eb6facf924880a0e38eeff91ba974, State: Initialized, Role: FOLLOWER
W20260709 12:14:41.928203 25525 leader_election.cc:343] T 741c39eaebc94dfc9bd1562b10cf0698 P f2868245e89644679e2b7dac75591a58 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7ffdf999adba487a9887fe7e2cc0f874 (127.12.174.131:36809): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:41.929522 25522 leader_election.cc:304] T 741c39eaebc94dfc9bd1562b10cf0698 P f2868245e89644679e2b7dac75591a58 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e4eb6facf924880a0e38eeff91ba974, f2868245e89644679e2b7dac75591a58; no voters: 7ffdf999adba487a9887fe7e2cc0f874
I20260709 12:14:41.929370 25750 consensus_queue.cc:260] T 5fa898e4a0cf49c79c9803b61ac3e756 P 6e4eb6facf924880a0e38eeff91ba974 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:41.932359 25750 ts_tablet_manager.cc:1434] T 5fa898e4a0cf49c79c9803b61ac3e756 P 6e4eb6facf924880a0e38eeff91ba974: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 12:14:41.933068 25785 raft_consensus.cc:493] T f9d5a17200ac45a7b5a2130ba1fd816b P f2868245e89644679e2b7dac75591a58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:41.933591 25750 tablet_bootstrap.cc:492] T 9204b1c1003646bfb3b61de1e4a235d6 P 6e4eb6facf924880a0e38eeff91ba974: Bootstrap starting.
I20260709 12:14:41.927232 25749 raft_consensus.cc:359] T 741c39eaebc94dfc9bd1562b10cf0698 P 7ffdf999adba487a9887fe7e2cc0f874 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:41.933672 25785 raft_consensus.cc:515] T f9d5a17200ac45a7b5a2130ba1fd816b P f2868245e89644679e2b7dac75591a58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } } peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } }
I20260709 12:14:41.935315 25559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "448860827aca47b984ef19865addaeff" candidate_uuid: "7ffdf999adba487a9887fe7e2cc0f874" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f2868245e89644679e2b7dac75591a58" is_pre_election: true
I20260709 12:14:41.944101 25749 raft_consensus.cc:385] T 741c39eaebc94dfc9bd1562b10cf0698 P 7ffdf999adba487a9887fe7e2cc0f874 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:41.936753 25558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9d5a17200ac45a7b5a2130ba1fd816b" candidate_uuid: "7ffdf999adba487a9887fe7e2cc0f874" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f2868245e89644679e2b7dac75591a58" is_pre_election: true
I20260709 12:14:41.944495 25749 raft_consensus.cc:740] T 741c39eaebc94dfc9bd1562b10cf0698 P 7ffdf999adba487a9887fe7e2cc0f874 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ffdf999adba487a9887fe7e2cc0f874, State: Initialized, Role: FOLLOWER
I20260709 12:14:41.945664 25558 raft_consensus.cc:2468] T f9d5a17200ac45a7b5a2130ba1fd816b P f2868245e89644679e2b7dac75591a58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffdf999adba487a9887fe7e2cc0f874 in term 0.
I20260709 12:14:41.947118 25749 consensus_queue.cc:260] T 741c39eaebc94dfc9bd1562b10cf0698 P 7ffdf999adba487a9887fe7e2cc0f874 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:41.950687 25750 tablet_bootstrap.cc:654] T 9204b1c1003646bfb3b61de1e4a235d6 P 6e4eb6facf924880a0e38eeff91ba974: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:41.950579 25756 raft_consensus.cc:515] T 5fa898e4a0cf49c79c9803b61ac3e756 P f2868245e89644679e2b7dac75591a58 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:41.939236 25782 leader_election.cc:290] T 12dd6a165033473e9c39fd87d4763add P f2868245e89644679e2b7dac75591a58 [CANDIDATE]: Term 1 election: Requested vote from peers 6e4eb6facf924880a0e38eeff91ba974 (127.12.174.130:41805), 7ffdf999adba487a9887fe7e2cc0f874 (127.12.174.131:36809)
I20260709 12:14:41.952132 25632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9d5a17200ac45a7b5a2130ba1fd816b" candidate_uuid: "f2868245e89644679e2b7dac75591a58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e4eb6facf924880a0e38eeff91ba974" is_pre_election: true
I20260709 12:14:41.952696 25782 raft_consensus.cc:493] T 243ba61cc23a42669b893d2e6268a359 P f2868245e89644679e2b7dac75591a58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:41.953194 25782 raft_consensus.cc:515] T 243ba61cc23a42669b893d2e6268a359 P f2868245e89644679e2b7dac75591a58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:41.953860 25632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fa898e4a0cf49c79c9803b61ac3e756" candidate_uuid: "f2868245e89644679e2b7dac75591a58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e4eb6facf924880a0e38eeff91ba974"
W20260709 12:14:41.954250 25522 leader_election.cc:343] T f9d5a17200ac45a7b5a2130ba1fd816b P f2868245e89644679e2b7dac75591a58 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6e4eb6facf924880a0e38eeff91ba974 (127.12.174.130:41805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:41.954540 25632 raft_consensus.cc:3060] T 5fa898e4a0cf49c79c9803b61ac3e756 P 6e4eb6facf924880a0e38eeff91ba974 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:41.955324 25782 leader_election.cc:290] T 243ba61cc23a42669b893d2e6268a359 P f2868245e89644679e2b7dac75591a58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6e4eb6facf924880a0e38eeff91ba974 (127.12.174.130:41805), 7ffdf999adba487a9887fe7e2cc0f874 (127.12.174.131:36809)
I20260709 12:14:41.955996 25633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ba61cc23a42669b893d2e6268a359" candidate_uuid: "f2868245e89644679e2b7dac75591a58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e4eb6facf924880a0e38eeff91ba974" is_pre_election: true
I20260709 12:14:41.956411 25785 leader_election.cc:290] T f9d5a17200ac45a7b5a2130ba1fd816b P f2868245e89644679e2b7dac75591a58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ffdf999adba487a9887fe7e2cc0f874 (127.12.174.131:36809), 6e4eb6facf924880a0e38eeff91ba974 (127.12.174.130:41805)
W20260709 12:14:41.957558 25522 leader_election.cc:343] T 243ba61cc23a42669b893d2e6268a359 P f2868245e89644679e2b7dac75591a58 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6e4eb6facf924880a0e38eeff91ba974 (127.12.174.130:41805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:41.954602 25707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9d5a17200ac45a7b5a2130ba1fd816b" candidate_uuid: "f2868245e89644679e2b7dac75591a58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffdf999adba487a9887fe7e2cc0f874" is_pre_election: true
I20260709 12:14:41.958449 25707 raft_consensus.cc:2468] T f9d5a17200ac45a7b5a2130ba1fd816b P 7ffdf999adba487a9887fe7e2cc0f874 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f2868245e89644679e2b7dac75591a58 in term 0.
I20260709 12:14:41.958945 25756 leader_election.cc:290] T 5fa898e4a0cf49c79c9803b61ac3e756 P f2868245e89644679e2b7dac75591a58 [CANDIDATE]: Term 1 election: Requested vote from peers 6e4eb6facf924880a0e38eeff91ba974 (127.12.174.130:41805), 7ffdf999adba487a9887fe7e2cc0f874 (127.12.174.131:36809)
I20260709 12:14:41.960208 25525 leader_election.cc:304] T f9d5a17200ac45a7b5a2130ba1fd816b P f2868245e89644679e2b7dac75591a58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffdf999adba487a9887fe7e2cc0f874, f2868245e89644679e2b7dac75591a58; no voters: 6e4eb6facf924880a0e38eeff91ba974
W20260709 12:14:41.935269 25671 leader_election.cc:343] T f9d5a17200ac45a7b5a2130ba1fd816b P 7ffdf999adba487a9887fe7e2cc0f874 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6e4eb6facf924880a0e38eeff91ba974 (127.12.174.130:41805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:41.960758 25708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fa898e4a0cf49c79c9803b61ac3e756" candidate_uuid: "f2868245e89644679e2b7dac75591a58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffdf999adba487a9887fe7e2cc0f874"
I20260709 12:14:41.960728 25707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ba61cc23a42669b893d2e6268a359" candidate_uuid: "f2868245e89644679e2b7dac75591a58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffdf999adba487a9887fe7e2cc0f874" is_pre_election: true
I20260709 12:14:41.961468 25708 raft_consensus.cc:3060] T 5fa898e4a0cf49c79c9803b61ac3e756 P 7ffdf999adba487a9887fe7e2cc0f874 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:41.961570 25756 raft_consensus.cc:2804] T f9d5a17200ac45a7b5a2130ba1fd816b P f2868245e89644679e2b7dac75591a58 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:41.962208 25756 raft_consensus.cc:493] T f9d5a17200ac45a7b5a2130ba1fd816b P f2868245e89644679e2b7dac75591a58 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:41.938196 25557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1513bb8a7eb64808b506fd1c49256752" candidate_uuid: "7ffdf999adba487a9887fe7e2cc0f874" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f2868245e89644679e2b7dac75591a58" is_pre_election: true
W20260709 12:14:41.962132 25671 leader_election.cc:343] T 1513bb8a7eb64808b506fd1c49256752 P 7ffdf999adba487a9887fe7e2cc0f874 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6e4eb6facf924880a0e38eeff91ba974 (127.12.174.130:41805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:41.963035 25557 raft_consensus.cc:2468] T 1513bb8a7eb64808b506fd1c49256752 P f2868245e89644679e2b7dac75591a58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffdf999adba487a9887fe7e2cc0f874 in term 0.
W20260709 12:14:41.963445 25671 leader_election.cc:343] T 448860827aca47b984ef19865addaeff P 7ffdf999adba487a9887fe7e2cc0f874 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f2868245e89644679e2b7dac75591a58 (127.12.174.129:40387): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:41.963910 25671 leader_election.cc:304] T 448860827aca47b984ef19865addaeff P 7ffdf999adba487a9887fe7e2cc0f874 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffdf999adba487a9887fe7e2cc0f874; no voters: 6e4eb6facf924880a0e38eeff91ba974, f2868245e89644679e2b7dac75591a58
I20260709 12:14:41.964229 25632 raft_consensus.cc:2468] T 5fa898e4a0cf49c79c9803b61ac3e756 P 6e4eb6facf924880a0e38eeff91ba974 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f2868245e89644679e2b7dac75591a58 in term 1.
I20260709 12:14:41.939698 25786 raft_consensus.cc:2804] T 741c39eaebc94dfc9bd1562b10cf0698 P f2868245e89644679e2b7dac75591a58 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:41.961521 25707 raft_consensus.cc:2468] T 243ba61cc23a42669b893d2e6268a359 P 7ffdf999adba487a9887fe7e2cc0f874 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f2868245e89644679e2b7dac75591a58 in term 0.
I20260709 12:14:41.940416 25706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12dd6a165033473e9c39fd87d4763add" candidate_uuid: "f2868245e89644679e2b7dac75591a58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffdf999adba487a9887fe7e2cc0f874"
I20260709 12:14:41.965523 25786 raft_consensus.cc:697] T 741c39eaebc94dfc9bd1562b10cf0698 P f2868245e89644679e2b7dac75591a58 [term 1 LEADER]: Becoming Leader. State: Replica: f2868245e89644679e2b7dac75591a58, State: Running, Role: LEADER
I20260709 12:14:41.965699 25522 leader_election.cc:304] T 5fa898e4a0cf49c79c9803b61ac3e756 P f2868245e89644679e2b7dac75591a58 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e4eb6facf924880a0e38eeff91ba974, f2868245e89644679e2b7dac75591a58; no voters: 
I20260709 12:14:41.966019 25706 raft_consensus.cc:3060] T 12dd6a165033473e9c39fd87d4763add P 7ffdf999adba487a9887fe7e2cc0f874 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:41.966996 25748 tablet_bootstrap.cc:492] T 448860827aca47b984ef19865addaeff P f2868245e89644679e2b7dac75591a58: No bootstrap required, opened a new log
I20260709 12:14:41.966682 25786 consensus_queue.cc:237] T 741c39eaebc94dfc9bd1562b10cf0698 P f2868245e89644679e2b7dac75591a58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:41.967576 25748 ts_tablet_manager.cc:1403] T 448860827aca47b984ef19865addaeff P f2868245e89644679e2b7dac75591a58: Time spent bootstrapping tablet: real 0.162s	user 0.007s	sys 0.016s
I20260709 12:14:41.964323 25756 raft_consensus.cc:3060] T f9d5a17200ac45a7b5a2130ba1fd816b P f2868245e89644679e2b7dac75591a58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:41.971091 25748 raft_consensus.cc:359] T 448860827aca47b984ef19865addaeff P f2868245e89644679e2b7dac75591a58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:41.971841 25748 raft_consensus.cc:385] T 448860827aca47b984ef19865addaeff P f2868245e89644679e2b7dac75591a58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:41.972132 25748 raft_consensus.cc:740] T 448860827aca47b984ef19865addaeff P f2868245e89644679e2b7dac75591a58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f2868245e89644679e2b7dac75591a58, State: Initialized, Role: FOLLOWER
I20260709 12:14:41.973042 25525 leader_election.cc:304] T 243ba61cc23a42669b893d2e6268a359 P f2868245e89644679e2b7dac75591a58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffdf999adba487a9887fe7e2cc0f874, f2868245e89644679e2b7dac75591a58; no voters: 6e4eb6facf924880a0e38eeff91ba974
I20260709 12:14:41.943395 25634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12dd6a165033473e9c39fd87d4763add" candidate_uuid: "f2868245e89644679e2b7dac75591a58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e4eb6facf924880a0e38eeff91ba974"
I20260709 12:14:41.974082 25634 raft_consensus.cc:3060] T 12dd6a165033473e9c39fd87d4763add P 6e4eb6facf924880a0e38eeff91ba974 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:41.975487 25754 raft_consensus.cc:2749] T 448860827aca47b984ef19865addaeff P 7ffdf999adba487a9887fe7e2cc0f874 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:41.976009 25671 leader_election.cc:304] T f9d5a17200ac45a7b5a2130ba1fd816b P 7ffdf999adba487a9887fe7e2cc0f874 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffdf999adba487a9887fe7e2cc0f874, f2868245e89644679e2b7dac75591a58; no voters: 6e4eb6facf924880a0e38eeff91ba974
I20260709 12:14:41.976982 25754 raft_consensus.cc:2804] T f9d5a17200ac45a7b5a2130ba1fd816b P 7ffdf999adba487a9887fe7e2cc0f874 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:41.977334 25754 raft_consensus.cc:493] T f9d5a17200ac45a7b5a2130ba1fd816b P 7ffdf999adba487a9887fe7e2cc0f874 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:41.977456 25671 leader_election.cc:304] T 1513bb8a7eb64808b506fd1c49256752 P 7ffdf999adba487a9887fe7e2cc0f874 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffdf999adba487a9887fe7e2cc0f874, f2868245e89644679e2b7dac75591a58; no voters: 6e4eb6facf924880a0e38eeff91ba974
I20260709 12:14:41.977828 25754 raft_consensus.cc:3060] T f9d5a17200ac45a7b5a2130ba1fd816b P 7ffdf999adba487a9887fe7e2cc0f874 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:41.979555 25756 raft_consensus.cc:515] T f9d5a17200ac45a7b5a2130ba1fd816b P f2868245e89644679e2b7dac75591a58 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } } peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } }
I20260709 12:14:41.982524 25756 leader_election.cc:290] T f9d5a17200ac45a7b5a2130ba1fd816b P f2868245e89644679e2b7dac75591a58 [CANDIDATE]: Term 1 election: Requested vote from peers 7ffdf999adba487a9887fe7e2cc0f874 (127.12.174.131:36809), 6e4eb6facf924880a0e38eeff91ba974 (127.12.174.130:41805)
I20260709 12:14:41.983496 25785 raft_consensus.cc:2804] T 5fa898e4a0cf49c79c9803b61ac3e756 P f2868245e89644679e2b7dac75591a58 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:41.983878 25632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9d5a17200ac45a7b5a2130ba1fd816b" candidate_uuid: "f2868245e89644679e2b7dac75591a58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e4eb6facf924880a0e38eeff91ba974"
I20260709 12:14:41.984160 25749 ts_tablet_manager.cc:1434] T 741c39eaebc94dfc9bd1562b10cf0698 P 7ffdf999adba487a9887fe7e2cc0f874: Time spent starting tablet: real 0.060s	user 0.004s	sys 0.004s
I20260709 12:14:41.983800 25707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9d5a17200ac45a7b5a2130ba1fd816b" candidate_uuid: "f2868245e89644679e2b7dac75591a58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffdf999adba487a9887fe7e2cc0f874"
I20260709 12:14:41.984846 25756 raft_consensus.cc:2804] T 243ba61cc23a42669b893d2e6268a359 P f2868245e89644679e2b7dac75591a58 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:41.985297 25756 raft_consensus.cc:493] T 243ba61cc23a42669b893d2e6268a359 P f2868245e89644679e2b7dac75591a58 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:14:41.985637 25522 leader_election.cc:343] T f9d5a17200ac45a7b5a2130ba1fd816b P f2868245e89644679e2b7dac75591a58 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6e4eb6facf924880a0e38eeff91ba974 (127.12.174.130:41805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:41.985684 25756 raft_consensus.cc:3060] T 243ba61cc23a42669b893d2e6268a359 P f2868245e89644679e2b7dac75591a58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:41.985396 25749 tablet_bootstrap.cc:492] T 6a3136f9b7e64004b7005f11e9a050f9 P 7ffdf999adba487a9887fe7e2cc0f874: Bootstrap starting.
I20260709 12:14:41.996011 25748 consensus_queue.cc:260] T 448860827aca47b984ef19865addaeff P f2868245e89644679e2b7dac75591a58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:41.996766 25785 raft_consensus.cc:697] T 5fa898e4a0cf49c79c9803b61ac3e756 P f2868245e89644679e2b7dac75591a58 [term 1 LEADER]: Becoming Leader. State: Replica: f2868245e89644679e2b7dac75591a58, State: Running, Role: LEADER
I20260709 12:14:41.998075 25785 consensus_queue.cc:237] T 5fa898e4a0cf49c79c9803b61ac3e756 P f2868245e89644679e2b7dac75591a58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:41.998713 25748 ts_tablet_manager.cc:1434] T 448860827aca47b984ef19865addaeff P f2868245e89644679e2b7dac75591a58: Time spent starting tablet: real 0.031s	user 0.007s	sys 0.000s
I20260709 12:14:41.999917 25748 tablet_bootstrap.cc:492] T 6a3136f9b7e64004b7005f11e9a050f9 P f2868245e89644679e2b7dac75591a58: Bootstrap starting.
I20260709 12:14:42.005019 25634 raft_consensus.cc:2468] T 12dd6a165033473e9c39fd87d4763add P 6e4eb6facf924880a0e38eeff91ba974 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f2868245e89644679e2b7dac75591a58 in term 1.
I20260709 12:14:42.005700 25756 raft_consensus.cc:515] T 243ba61cc23a42669b893d2e6268a359 P f2868245e89644679e2b7dac75591a58 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:42.024119 25756 leader_election.cc:290] T 243ba61cc23a42669b893d2e6268a359 P f2868245e89644679e2b7dac75591a58 [CANDIDATE]: Term 1 election: Requested vote from peers 6e4eb6facf924880a0e38eeff91ba974 (127.12.174.130:41805), 7ffdf999adba487a9887fe7e2cc0f874 (127.12.174.131:36809)
I20260709 12:14:42.013893 25706 raft_consensus.cc:2468] T 12dd6a165033473e9c39fd87d4763add P 7ffdf999adba487a9887fe7e2cc0f874 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f2868245e89644679e2b7dac75591a58 in term 1.
I20260709 12:14:42.024528 25632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ba61cc23a42669b893d2e6268a359" candidate_uuid: "f2868245e89644679e2b7dac75591a58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e4eb6facf924880a0e38eeff91ba974"
I20260709 12:14:42.017145 25708 raft_consensus.cc:2468] T 5fa898e4a0cf49c79c9803b61ac3e756 P 7ffdf999adba487a9887fe7e2cc0f874 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f2868245e89644679e2b7dac75591a58 in term 1.
I20260709 12:14:42.021274 25789 raft_consensus.cc:2804] T 1513bb8a7eb64808b506fd1c49256752 P 7ffdf999adba487a9887fe7e2cc0f874 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:42.026103 25789 raft_consensus.cc:493] T 1513bb8a7eb64808b506fd1c49256752 P 7ffdf999adba487a9887fe7e2cc0f874 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:42.011261 25754 raft_consensus.cc:515] T f9d5a17200ac45a7b5a2130ba1fd816b P 7ffdf999adba487a9887fe7e2cc0f874 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } } peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } }
W20260709 12:14:42.026574 25522 leader_election.cc:343] T 243ba61cc23a42669b893d2e6268a359 P f2868245e89644679e2b7dac75591a58 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6e4eb6facf924880a0e38eeff91ba974 (127.12.174.130:41805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:42.027288 25455 catalog_manager.cc:5697] T 741c39eaebc94dfc9bd1562b10cf0698 P f2868245e89644679e2b7dac75591a58 reported cstate change: term changed from 0 to 1, leader changed from <none> to f2868245e89644679e2b7dac75591a58 (127.12.174.129). New cstate: current_term: 1 leader_uuid: "f2868245e89644679e2b7dac75591a58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:42.028805 25754 leader_election.cc:290] T f9d5a17200ac45a7b5a2130ba1fd816b P 7ffdf999adba487a9887fe7e2cc0f874 [CANDIDATE]: Term 1 election: Requested vote from peers f2868245e89644679e2b7dac75591a58 (127.12.174.129:40387), 6e4eb6facf924880a0e38eeff91ba974 (127.12.174.130:41805)
I20260709 12:14:42.027307 25707 raft_consensus.cc:2393] T f9d5a17200ac45a7b5a2130ba1fd816b P 7ffdf999adba487a9887fe7e2cc0f874 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f2868245e89644679e2b7dac75591a58 in current term 1: Already voted for candidate 7ffdf999adba487a9887fe7e2cc0f874 in this term.
I20260709 12:14:42.026571 25789 raft_consensus.cc:3060] T 1513bb8a7eb64808b506fd1c49256752 P 7ffdf999adba487a9887fe7e2cc0f874 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:42.010851 25749 tablet_bootstrap.cc:654] T 6a3136f9b7e64004b7005f11e9a050f9 P 7ffdf999adba487a9887fe7e2cc0f874: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:42.030445 25522 leader_election.cc:304] T 12dd6a165033473e9c39fd87d4763add P f2868245e89644679e2b7dac75591a58 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e4eb6facf924880a0e38eeff91ba974, f2868245e89644679e2b7dac75591a58; no voters: 
W20260709 12:14:42.037999 25671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:40387, user_credentials={real_user=slave}} blocked reactor thread for 57891.2us
I20260709 12:14:42.041311 25525 leader_election.cc:304] T f9d5a17200ac45a7b5a2130ba1fd816b P f2868245e89644679e2b7dac75591a58 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f2868245e89644679e2b7dac75591a58; no voters: 6e4eb6facf924880a0e38eeff91ba974, 7ffdf999adba487a9887fe7e2cc0f874
I20260709 12:14:42.041311 25634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9d5a17200ac45a7b5a2130ba1fd816b" candidate_uuid: "7ffdf999adba487a9887fe7e2cc0f874" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e4eb6facf924880a0e38eeff91ba974"
I20260709 12:14:42.030344 25708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ba61cc23a42669b893d2e6268a359" candidate_uuid: "f2868245e89644679e2b7dac75591a58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffdf999adba487a9887fe7e2cc0f874"
I20260709 12:14:42.042870 25708 raft_consensus.cc:3060] T 243ba61cc23a42669b893d2e6268a359 P 7ffdf999adba487a9887fe7e2cc0f874 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:14:42.043473 25671 leader_election.cc:343] T f9d5a17200ac45a7b5a2130ba1fd816b P 7ffdf999adba487a9887fe7e2cc0f874 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6e4eb6facf924880a0e38eeff91ba974 (127.12.174.130:41805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:42.043790 25756 raft_consensus.cc:2749] T f9d5a17200ac45a7b5a2130ba1fd816b P f2868245e89644679e2b7dac75591a58 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:14:42.045828 25557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9d5a17200ac45a7b5a2130ba1fd816b" candidate_uuid: "7ffdf999adba487a9887fe7e2cc0f874" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f2868245e89644679e2b7dac75591a58"
I20260709 12:14:42.046679 25557 raft_consensus.cc:2393] T f9d5a17200ac45a7b5a2130ba1fd816b P f2868245e89644679e2b7dac75591a58 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ffdf999adba487a9887fe7e2cc0f874 in current term 1: Already voted for candidate f2868245e89644679e2b7dac75591a58 in this term.
I20260709 12:14:42.037964 25786 raft_consensus.cc:2804] T 12dd6a165033473e9c39fd87d4763add P f2868245e89644679e2b7dac75591a58 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:42.048460 25786 raft_consensus.cc:697] T 12dd6a165033473e9c39fd87d4763add P f2868245e89644679e2b7dac75591a58 [term 1 LEADER]: Becoming Leader. State: Replica: f2868245e89644679e2b7dac75591a58, State: Running, Role: LEADER
I20260709 12:14:42.047482 25789 raft_consensus.cc:515] T 1513bb8a7eb64808b506fd1c49256752 P 7ffdf999adba487a9887fe7e2cc0f874 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:42.049631 25671 leader_election.cc:304] T f9d5a17200ac45a7b5a2130ba1fd816b P 7ffdf999adba487a9887fe7e2cc0f874 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffdf999adba487a9887fe7e2cc0f874; no voters: 6e4eb6facf924880a0e38eeff91ba974, f2868245e89644679e2b7dac75591a58
I20260709 12:14:42.053428 25754 raft_consensus.cc:2749] T f9d5a17200ac45a7b5a2130ba1fd816b P 7ffdf999adba487a9887fe7e2cc0f874 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:14:42.053982 25750 tablet_bootstrap.cc:492] T 9204b1c1003646bfb3b61de1e4a235d6 P 6e4eb6facf924880a0e38eeff91ba974: No bootstrap required, opened a new log
I20260709 12:14:42.054615 25750 ts_tablet_manager.cc:1403] T 9204b1c1003646bfb3b61de1e4a235d6 P 6e4eb6facf924880a0e38eeff91ba974: Time spent bootstrapping tablet: real 0.121s	user 0.031s	sys 0.029s
I20260709 12:14:42.050338 25786 consensus_queue.cc:237] T 12dd6a165033473e9c39fd87d4763add P f2868245e89644679e2b7dac75591a58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:42.056089 25557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1513bb8a7eb64808b506fd1c49256752" candidate_uuid: "7ffdf999adba487a9887fe7e2cc0f874" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f2868245e89644679e2b7dac75591a58"
I20260709 12:14:42.056963 25557 raft_consensus.cc:3060] T 1513bb8a7eb64808b506fd1c49256752 P f2868245e89644679e2b7dac75591a58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:42.057066 25789 leader_election.cc:290] T 1513bb8a7eb64808b506fd1c49256752 P 7ffdf999adba487a9887fe7e2cc0f874 [CANDIDATE]: Term 1 election: Requested vote from peers f2868245e89644679e2b7dac75591a58 (127.12.174.129:40387), 6e4eb6facf924880a0e38eeff91ba974 (127.12.174.130:41805)
I20260709 12:14:42.058723 25634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1513bb8a7eb64808b506fd1c49256752" candidate_uuid: "7ffdf999adba487a9887fe7e2cc0f874" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e4eb6facf924880a0e38eeff91ba974"
I20260709 12:14:42.059151 25750 raft_consensus.cc:359] T 9204b1c1003646bfb3b61de1e4a235d6 P 6e4eb6facf924880a0e38eeff91ba974 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:42.059919 25750 raft_consensus.cc:385] T 9204b1c1003646bfb3b61de1e4a235d6 P 6e4eb6facf924880a0e38eeff91ba974 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:42.060200 25750 raft_consensus.cc:740] T 9204b1c1003646bfb3b61de1e4a235d6 P 6e4eb6facf924880a0e38eeff91ba974 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e4eb6facf924880a0e38eeff91ba974, State: Initialized, Role: FOLLOWER
I20260709 12:14:42.061043 25750 consensus_queue.cc:260] T 9204b1c1003646bfb3b61de1e4a235d6 P 6e4eb6facf924880a0e38eeff91ba974 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
W20260709 12:14:42.063165 25671 leader_election.cc:343] T 1513bb8a7eb64808b506fd1c49256752 P 7ffdf999adba487a9887fe7e2cc0f874 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6e4eb6facf924880a0e38eeff91ba974 (127.12.174.130:41805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:42.064052 25750 ts_tablet_manager.cc:1434] T 9204b1c1003646bfb3b61de1e4a235d6 P 6e4eb6facf924880a0e38eeff91ba974: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.003s
I20260709 12:14:42.065308 25750 tablet_bootstrap.cc:492] T 1513bb8a7eb64808b506fd1c49256752 P 6e4eb6facf924880a0e38eeff91ba974: Bootstrap starting.
I20260709 12:14:42.066468 25748 tablet_bootstrap.cc:654] T 6a3136f9b7e64004b7005f11e9a050f9 P f2868245e89644679e2b7dac75591a58: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:42.072908 25750 tablet_bootstrap.cc:654] T 1513bb8a7eb64808b506fd1c49256752 P 6e4eb6facf924880a0e38eeff91ba974: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:42.076586 25749 tablet_bootstrap.cc:492] T 6a3136f9b7e64004b7005f11e9a050f9 P 7ffdf999adba487a9887fe7e2cc0f874: No bootstrap required, opened a new log
I20260709 12:14:42.076870 25557 raft_consensus.cc:2468] T 1513bb8a7eb64808b506fd1c49256752 P f2868245e89644679e2b7dac75591a58 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffdf999adba487a9887fe7e2cc0f874 in term 1.
I20260709 12:14:42.077513 25749 ts_tablet_manager.cc:1403] T 6a3136f9b7e64004b7005f11e9a050f9 P 7ffdf999adba487a9887fe7e2cc0f874: Time spent bootstrapping tablet: real 0.092s	user 0.014s	sys 0.027s
I20260709 12:14:42.078773 25671 leader_election.cc:304] T 1513bb8a7eb64808b506fd1c49256752 P 7ffdf999adba487a9887fe7e2cc0f874 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffdf999adba487a9887fe7e2cc0f874, f2868245e89644679e2b7dac75591a58; no voters: 6e4eb6facf924880a0e38eeff91ba974
I20260709 12:14:42.080235 25789 raft_consensus.cc:2804] T 1513bb8a7eb64808b506fd1c49256752 P 7ffdf999adba487a9887fe7e2cc0f874 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:42.076579 25708 raft_consensus.cc:2468] T 243ba61cc23a42669b893d2e6268a359 P 7ffdf999adba487a9887fe7e2cc0f874 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f2868245e89644679e2b7dac75591a58 in term 1.
I20260709 12:14:42.081130 25749 raft_consensus.cc:359] T 6a3136f9b7e64004b7005f11e9a050f9 P 7ffdf999adba487a9887fe7e2cc0f874 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:42.081967 25749 raft_consensus.cc:385] T 6a3136f9b7e64004b7005f11e9a050f9 P 7ffdf999adba487a9887fe7e2cc0f874 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:42.082504 25749 raft_consensus.cc:740] T 6a3136f9b7e64004b7005f11e9a050f9 P 7ffdf999adba487a9887fe7e2cc0f874 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ffdf999adba487a9887fe7e2cc0f874, State: Initialized, Role: FOLLOWER
I20260709 12:14:42.081933 25525 leader_election.cc:304] T 243ba61cc23a42669b893d2e6268a359 P f2868245e89644679e2b7dac75591a58 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffdf999adba487a9887fe7e2cc0f874, f2868245e89644679e2b7dac75591a58; no voters: 6e4eb6facf924880a0e38eeff91ba974
I20260709 12:14:42.084177 25785 raft_consensus.cc:2804] T 243ba61cc23a42669b893d2e6268a359 P f2868245e89644679e2b7dac75591a58 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:42.084717 25785 raft_consensus.cc:697] T 243ba61cc23a42669b893d2e6268a359 P f2868245e89644679e2b7dac75591a58 [term 1 LEADER]: Becoming Leader. State: Replica: f2868245e89644679e2b7dac75591a58, State: Running, Role: LEADER
I20260709 12:14:42.081816 25789 raft_consensus.cc:697] T 1513bb8a7eb64808b506fd1c49256752 P 7ffdf999adba487a9887fe7e2cc0f874 [term 1 LEADER]: Becoming Leader. State: Replica: 7ffdf999adba487a9887fe7e2cc0f874, State: Running, Role: LEADER
I20260709 12:14:42.085693 25785 consensus_queue.cc:237] T 243ba61cc23a42669b893d2e6268a359 P f2868245e89644679e2b7dac75591a58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:42.086232 25789 consensus_queue.cc:237] T 1513bb8a7eb64808b506fd1c49256752 P 7ffdf999adba487a9887fe7e2cc0f874 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:42.091328 25749 consensus_queue.cc:260] T 6a3136f9b7e64004b7005f11e9a050f9 P 7ffdf999adba487a9887fe7e2cc0f874 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:42.094422 25749 ts_tablet_manager.cc:1434] T 6a3136f9b7e64004b7005f11e9a050f9 P 7ffdf999adba487a9887fe7e2cc0f874: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 12:14:42.095732 25749 tablet_bootstrap.cc:492] T 9204b1c1003646bfb3b61de1e4a235d6 P 7ffdf999adba487a9887fe7e2cc0f874: Bootstrap starting.
I20260709 12:14:42.105913 25748 tablet_bootstrap.cc:492] T 6a3136f9b7e64004b7005f11e9a050f9 P f2868245e89644679e2b7dac75591a58: No bootstrap required, opened a new log
I20260709 12:14:42.106657 25748 ts_tablet_manager.cc:1403] T 6a3136f9b7e64004b7005f11e9a050f9 P f2868245e89644679e2b7dac75591a58: Time spent bootstrapping tablet: real 0.107s	user 0.028s	sys 0.007s
I20260709 12:14:42.109419 25749 tablet_bootstrap.cc:654] T 9204b1c1003646bfb3b61de1e4a235d6 P 7ffdf999adba487a9887fe7e2cc0f874: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:42.109930 25750 tablet_bootstrap.cc:492] T 1513bb8a7eb64808b506fd1c49256752 P 6e4eb6facf924880a0e38eeff91ba974: No bootstrap required, opened a new log
I20260709 12:14:42.108700 25456 catalog_manager.cc:5697] T 1513bb8a7eb64808b506fd1c49256752 P 7ffdf999adba487a9887fe7e2cc0f874 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7ffdf999adba487a9887fe7e2cc0f874 (127.12.174.131). New cstate: current_term: 1 leader_uuid: "7ffdf999adba487a9887fe7e2cc0f874" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:42.110069 25748 raft_consensus.cc:359] T 6a3136f9b7e64004b7005f11e9a050f9 P f2868245e89644679e2b7dac75591a58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:42.110713 25750 ts_tablet_manager.cc:1403] T 1513bb8a7eb64808b506fd1c49256752 P 6e4eb6facf924880a0e38eeff91ba974: Time spent bootstrapping tablet: real 0.046s	user 0.010s	sys 0.004s
I20260709 12:14:42.110971 25748 raft_consensus.cc:385] T 6a3136f9b7e64004b7005f11e9a050f9 P f2868245e89644679e2b7dac75591a58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:42.111307 25748 raft_consensus.cc:740] T 6a3136f9b7e64004b7005f11e9a050f9 P f2868245e89644679e2b7dac75591a58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f2868245e89644679e2b7dac75591a58, State: Initialized, Role: FOLLOWER
I20260709 12:14:42.112279 25748 consensus_queue.cc:260] T 6a3136f9b7e64004b7005f11e9a050f9 P f2868245e89644679e2b7dac75591a58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:42.115134 25748 ts_tablet_manager.cc:1434] T 6a3136f9b7e64004b7005f11e9a050f9 P f2868245e89644679e2b7dac75591a58: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:14:42.115483 25750 raft_consensus.cc:359] T 1513bb8a7eb64808b506fd1c49256752 P 6e4eb6facf924880a0e38eeff91ba974 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:42.116369 25750 raft_consensus.cc:385] T 1513bb8a7eb64808b506fd1c49256752 P 6e4eb6facf924880a0e38eeff91ba974 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:42.116376 25748 tablet_bootstrap.cc:492] T 9204b1c1003646bfb3b61de1e4a235d6 P f2868245e89644679e2b7dac75591a58: Bootstrap starting.
I20260709 12:14:42.116923 25750 raft_consensus.cc:740] T 1513bb8a7eb64808b506fd1c49256752 P 6e4eb6facf924880a0e38eeff91ba974 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e4eb6facf924880a0e38eeff91ba974, State: Initialized, Role: FOLLOWER
I20260709 12:14:42.117915 25750 consensus_queue.cc:260] T 1513bb8a7eb64808b506fd1c49256752 P 6e4eb6facf924880a0e38eeff91ba974 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:42.120563 25750 ts_tablet_manager.cc:1434] T 1513bb8a7eb64808b506fd1c49256752 P 6e4eb6facf924880a0e38eeff91ba974: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:14:42.121999 25750 tablet_bootstrap.cc:492] T 448860827aca47b984ef19865addaeff P 6e4eb6facf924880a0e38eeff91ba974: Bootstrap starting.
I20260709 12:14:42.125424 25748 tablet_bootstrap.cc:654] T 9204b1c1003646bfb3b61de1e4a235d6 P f2868245e89644679e2b7dac75591a58: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:42.129348 25750 tablet_bootstrap.cc:654] T 448860827aca47b984ef19865addaeff P 6e4eb6facf924880a0e38eeff91ba974: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:42.139122 25748 tablet_bootstrap.cc:492] T 9204b1c1003646bfb3b61de1e4a235d6 P f2868245e89644679e2b7dac75591a58: No bootstrap required, opened a new log
I20260709 12:14:42.139879 25748 ts_tablet_manager.cc:1403] T 9204b1c1003646bfb3b61de1e4a235d6 P f2868245e89644679e2b7dac75591a58: Time spent bootstrapping tablet: real 0.024s	user 0.013s	sys 0.007s
I20260709 12:14:42.143683 25789 raft_consensus.cc:493] T 741c39eaebc94dfc9bd1562b10cf0698 P 7ffdf999adba487a9887fe7e2cc0f874 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:42.143711 25748 raft_consensus.cc:359] T 9204b1c1003646bfb3b61de1e4a235d6 P f2868245e89644679e2b7dac75591a58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:42.144464 25789 raft_consensus.cc:515] T 741c39eaebc94dfc9bd1562b10cf0698 P 7ffdf999adba487a9887fe7e2cc0f874 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:42.144860 25748 raft_consensus.cc:385] T 9204b1c1003646bfb3b61de1e4a235d6 P f2868245e89644679e2b7dac75591a58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:42.145421 25748 raft_consensus.cc:740] T 9204b1c1003646bfb3b61de1e4a235d6 P f2868245e89644679e2b7dac75591a58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f2868245e89644679e2b7dac75591a58, State: Initialized, Role: FOLLOWER
I20260709 12:14:42.146606 25748 consensus_queue.cc:260] T 9204b1c1003646bfb3b61de1e4a235d6 P f2868245e89644679e2b7dac75591a58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:42.147930 25557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "741c39eaebc94dfc9bd1562b10cf0698" candidate_uuid: "7ffdf999adba487a9887fe7e2cc0f874" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f2868245e89644679e2b7dac75591a58" is_pre_election: true
I20260709 12:14:42.148290 25789 leader_election.cc:290] T 741c39eaebc94dfc9bd1562b10cf0698 P 7ffdf999adba487a9887fe7e2cc0f874 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f2868245e89644679e2b7dac75591a58 (127.12.174.129:40387), 6e4eb6facf924880a0e38eeff91ba974 (127.12.174.130:41805)
I20260709 12:14:42.149581 25748 ts_tablet_manager.cc:1434] T 9204b1c1003646bfb3b61de1e4a235d6 P f2868245e89644679e2b7dac75591a58: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 12:14:42.150275 25634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "741c39eaebc94dfc9bd1562b10cf0698" candidate_uuid: "7ffdf999adba487a9887fe7e2cc0f874" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e4eb6facf924880a0e38eeff91ba974" is_pre_election: true
I20260709 12:14:42.151297 25634 raft_consensus.cc:2393] T 741c39eaebc94dfc9bd1562b10cf0698 P 6e4eb6facf924880a0e38eeff91ba974 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ffdf999adba487a9887fe7e2cc0f874 in current term 1: Already voted for candidate f2868245e89644679e2b7dac75591a58 in this term.
I20260709 12:14:42.153244 25671 leader_election.cc:304] T 741c39eaebc94dfc9bd1562b10cf0698 P 7ffdf999adba487a9887fe7e2cc0f874 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffdf999adba487a9887fe7e2cc0f874; no voters: 6e4eb6facf924880a0e38eeff91ba974, f2868245e89644679e2b7dac75591a58
I20260709 12:14:42.154866 25789 raft_consensus.cc:3060] T 741c39eaebc94dfc9bd1562b10cf0698 P 7ffdf999adba487a9887fe7e2cc0f874 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:42.154183 25455 catalog_manager.cc:5697] T 5fa898e4a0cf49c79c9803b61ac3e756 P f2868245e89644679e2b7dac75591a58 reported cstate change: term changed from 0 to 1, leader changed from <none> to f2868245e89644679e2b7dac75591a58 (127.12.174.129). New cstate: current_term: 1 leader_uuid: "f2868245e89644679e2b7dac75591a58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:42.156755 25455 catalog_manager.cc:5697] T 243ba61cc23a42669b893d2e6268a359 P f2868245e89644679e2b7dac75591a58 reported cstate change: term changed from 0 to 1, leader changed from <none> to f2868245e89644679e2b7dac75591a58 (127.12.174.129). New cstate: current_term: 1 leader_uuid: "f2868245e89644679e2b7dac75591a58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:42.159071 25455 catalog_manager.cc:5697] T 12dd6a165033473e9c39fd87d4763add P f2868245e89644679e2b7dac75591a58 reported cstate change: term changed from 0 to 1, leader changed from <none> to f2868245e89644679e2b7dac75591a58 (127.12.174.129). New cstate: current_term: 1 leader_uuid: "f2868245e89644679e2b7dac75591a58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:42.165392 25789 raft_consensus.cc:2749] T 741c39eaebc94dfc9bd1562b10cf0698 P 7ffdf999adba487a9887fe7e2cc0f874 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:42.169902 25749 tablet_bootstrap.cc:492] T 9204b1c1003646bfb3b61de1e4a235d6 P 7ffdf999adba487a9887fe7e2cc0f874: No bootstrap required, opened a new log
I20260709 12:14:42.170667 25749 ts_tablet_manager.cc:1403] T 9204b1c1003646bfb3b61de1e4a235d6 P 7ffdf999adba487a9887fe7e2cc0f874: Time spent bootstrapping tablet: real 0.075s	user 0.037s	sys 0.030s
I20260709 12:14:42.173781 25750 tablet_bootstrap.cc:492] T 448860827aca47b984ef19865addaeff P 6e4eb6facf924880a0e38eeff91ba974: No bootstrap required, opened a new log
I20260709 12:14:42.174466 25750 ts_tablet_manager.cc:1403] T 448860827aca47b984ef19865addaeff P 6e4eb6facf924880a0e38eeff91ba974: Time spent bootstrapping tablet: real 0.053s	user 0.021s	sys 0.018s
I20260709 12:14:42.174093 25749 raft_consensus.cc:359] T 9204b1c1003646bfb3b61de1e4a235d6 P 7ffdf999adba487a9887fe7e2cc0f874 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:42.175056 25749 raft_consensus.cc:385] T 9204b1c1003646bfb3b61de1e4a235d6 P 7ffdf999adba487a9887fe7e2cc0f874 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:42.175530 25749 raft_consensus.cc:740] T 9204b1c1003646bfb3b61de1e4a235d6 P 7ffdf999adba487a9887fe7e2cc0f874 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ffdf999adba487a9887fe7e2cc0f874, State: Initialized, Role: FOLLOWER
I20260709 12:14:42.176401 25749 consensus_queue.cc:260] T 9204b1c1003646bfb3b61de1e4a235d6 P 7ffdf999adba487a9887fe7e2cc0f874 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:42.178228 25750 raft_consensus.cc:359] T 448860827aca47b984ef19865addaeff P 6e4eb6facf924880a0e38eeff91ba974 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:42.179069 25750 raft_consensus.cc:385] T 448860827aca47b984ef19865addaeff P 6e4eb6facf924880a0e38eeff91ba974 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:42.179250 25749 ts_tablet_manager.cc:1434] T 9204b1c1003646bfb3b61de1e4a235d6 P 7ffdf999adba487a9887fe7e2cc0f874: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:14:42.179388 25750 raft_consensus.cc:740] T 448860827aca47b984ef19865addaeff P 6e4eb6facf924880a0e38eeff91ba974 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e4eb6facf924880a0e38eeff91ba974, State: Initialized, Role: FOLLOWER
I20260709 12:14:42.180784 25750 consensus_queue.cc:260] T 448860827aca47b984ef19865addaeff P 6e4eb6facf924880a0e38eeff91ba974 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:42.185249 25764 raft_consensus.cc:493] T 448860827aca47b984ef19865addaeff P 6e4eb6facf924880a0e38eeff91ba974 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:42.185806 25764 raft_consensus.cc:515] T 448860827aca47b984ef19865addaeff P 6e4eb6facf924880a0e38eeff91ba974 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:42.189430 25557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "448860827aca47b984ef19865addaeff" candidate_uuid: "6e4eb6facf924880a0e38eeff91ba974" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f2868245e89644679e2b7dac75591a58" is_pre_election: true
I20260709 12:14:42.190253 25557 raft_consensus.cc:2468] T 448860827aca47b984ef19865addaeff P f2868245e89644679e2b7dac75591a58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e4eb6facf924880a0e38eeff91ba974 in term 0.
I20260709 12:14:42.190455 25764 leader_election.cc:290] T 448860827aca47b984ef19865addaeff P 6e4eb6facf924880a0e38eeff91ba974 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f2868245e89644679e2b7dac75591a58 (127.12.174.129:40387), 7ffdf999adba487a9887fe7e2cc0f874 (127.12.174.131:36809)
I20260709 12:14:42.191852 25708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "448860827aca47b984ef19865addaeff" candidate_uuid: "6e4eb6facf924880a0e38eeff91ba974" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffdf999adba487a9887fe7e2cc0f874" is_pre_election: true
I20260709 12:14:42.192529 25708 raft_consensus.cc:2468] T 448860827aca47b984ef19865addaeff P 7ffdf999adba487a9887fe7e2cc0f874 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e4eb6facf924880a0e38eeff91ba974 in term 0.
I20260709 12:14:42.193471 25597 leader_election.cc:304] T 448860827aca47b984ef19865addaeff P 6e4eb6facf924880a0e38eeff91ba974 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e4eb6facf924880a0e38eeff91ba974, f2868245e89644679e2b7dac75591a58; no voters: 
I20260709 12:14:42.194092 25750 ts_tablet_manager.cc:1434] T 448860827aca47b984ef19865addaeff P 6e4eb6facf924880a0e38eeff91ba974: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.002s
I20260709 12:14:42.194387 25764 raft_consensus.cc:2804] T 448860827aca47b984ef19865addaeff P 6e4eb6facf924880a0e38eeff91ba974 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:42.194810 25764 raft_consensus.cc:493] T 448860827aca47b984ef19865addaeff P 6e4eb6facf924880a0e38eeff91ba974 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:42.195179 25764 raft_consensus.cc:3060] T 448860827aca47b984ef19865addaeff P 6e4eb6facf924880a0e38eeff91ba974 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:42.195449 25750 tablet_bootstrap.cc:492] T 243ba61cc23a42669b893d2e6268a359 P 6e4eb6facf924880a0e38eeff91ba974: Bootstrap starting.
I20260709 12:14:42.203635 25750 tablet_bootstrap.cc:654] T 243ba61cc23a42669b893d2e6268a359 P 6e4eb6facf924880a0e38eeff91ba974: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:42.204900 25764 raft_consensus.cc:515] T 448860827aca47b984ef19865addaeff P 6e4eb6facf924880a0e38eeff91ba974 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:42.207423 25764 leader_election.cc:290] T 448860827aca47b984ef19865addaeff P 6e4eb6facf924880a0e38eeff91ba974 [CANDIDATE]: Term 1 election: Requested vote from peers f2868245e89644679e2b7dac75591a58 (127.12.174.129:40387), 7ffdf999adba487a9887fe7e2cc0f874 (127.12.174.131:36809)
I20260709 12:14:42.208537 25557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "448860827aca47b984ef19865addaeff" candidate_uuid: "6e4eb6facf924880a0e38eeff91ba974" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f2868245e89644679e2b7dac75591a58"
I20260709 12:14:42.208712 25708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "448860827aca47b984ef19865addaeff" candidate_uuid: "6e4eb6facf924880a0e38eeff91ba974" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffdf999adba487a9887fe7e2cc0f874"
I20260709 12:14:42.209407 25557 raft_consensus.cc:3060] T 448860827aca47b984ef19865addaeff P f2868245e89644679e2b7dac75591a58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:42.208689 25764 raft_consensus.cc:493] T 1513bb8a7eb64808b506fd1c49256752 P 6e4eb6facf924880a0e38eeff91ba974 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:42.210150 25750 tablet_bootstrap.cc:492] T 243ba61cc23a42669b893d2e6268a359 P 6e4eb6facf924880a0e38eeff91ba974: No bootstrap required, opened a new log
I20260709 12:14:42.210139 25764 raft_consensus.cc:515] T 1513bb8a7eb64808b506fd1c49256752 P 6e4eb6facf924880a0e38eeff91ba974 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:42.211725 25750 ts_tablet_manager.cc:1403] T 243ba61cc23a42669b893d2e6268a359 P 6e4eb6facf924880a0e38eeff91ba974: Time spent bootstrapping tablet: real 0.017s	user 0.013s	sys 0.001s
I20260709 12:14:42.214515 25558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1513bb8a7eb64808b506fd1c49256752" candidate_uuid: "6e4eb6facf924880a0e38eeff91ba974" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f2868245e89644679e2b7dac75591a58" is_pre_election: true
I20260709 12:14:42.214815 25789 raft_consensus.cc:493] T 6a3136f9b7e64004b7005f11e9a050f9 P 7ffdf999adba487a9887fe7e2cc0f874 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:42.215420 25558 raft_consensus.cc:2393] T 1513bb8a7eb64808b506fd1c49256752 P f2868245e89644679e2b7dac75591a58 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e4eb6facf924880a0e38eeff91ba974 in current term 1: Already voted for candidate 7ffdf999adba487a9887fe7e2cc0f874 in this term.
I20260709 12:14:42.215489 25789 raft_consensus.cc:515] T 6a3136f9b7e64004b7005f11e9a050f9 P 7ffdf999adba487a9887fe7e2cc0f874 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:42.216223 25708 raft_consensus.cc:3060] T 448860827aca47b984ef19865addaeff P 7ffdf999adba487a9887fe7e2cc0f874 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:42.216476 25764 leader_election.cc:290] T 1513bb8a7eb64808b506fd1c49256752 P 6e4eb6facf924880a0e38eeff91ba974 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f2868245e89644679e2b7dac75591a58 (127.12.174.129:40387), 7ffdf999adba487a9887fe7e2cc0f874 (127.12.174.131:36809)
I20260709 12:14:42.215201 25750 raft_consensus.cc:359] T 243ba61cc23a42669b893d2e6268a359 P 6e4eb6facf924880a0e38eeff91ba974 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:42.218005 25750 raft_consensus.cc:385] T 243ba61cc23a42669b893d2e6268a359 P 6e4eb6facf924880a0e38eeff91ba974 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:42.218154 25789 leader_election.cc:290] T 6a3136f9b7e64004b7005f11e9a050f9 P 7ffdf999adba487a9887fe7e2cc0f874 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f2868245e89644679e2b7dac75591a58 (127.12.174.129:40387), 6e4eb6facf924880a0e38eeff91ba974 (127.12.174.130:41805)
I20260709 12:14:42.218482 25750 raft_consensus.cc:740] T 243ba61cc23a42669b893d2e6268a359 P 6e4eb6facf924880a0e38eeff91ba974 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e4eb6facf924880a0e38eeff91ba974, State: Initialized, Role: FOLLOWER
I20260709 12:14:42.219590 25558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3136f9b7e64004b7005f11e9a050f9" candidate_uuid: "7ffdf999adba487a9887fe7e2cc0f874" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f2868245e89644679e2b7dac75591a58" is_pre_election: true
I20260709 12:14:42.219870 25634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3136f9b7e64004b7005f11e9a050f9" candidate_uuid: "7ffdf999adba487a9887fe7e2cc0f874" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e4eb6facf924880a0e38eeff91ba974" is_pre_election: true
I20260709 12:14:42.219551 25750 consensus_queue.cc:260] T 243ba61cc23a42669b893d2e6268a359 P 6e4eb6facf924880a0e38eeff91ba974 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:42.220410 25558 raft_consensus.cc:2468] T 6a3136f9b7e64004b7005f11e9a050f9 P f2868245e89644679e2b7dac75591a58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffdf999adba487a9887fe7e2cc0f874 in term 0.
I20260709 12:14:42.221834 25671 leader_election.cc:304] T 6a3136f9b7e64004b7005f11e9a050f9 P 7ffdf999adba487a9887fe7e2cc0f874 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffdf999adba487a9887fe7e2cc0f874, f2868245e89644679e2b7dac75591a58; no voters: 
I20260709 12:14:42.221763 25707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1513bb8a7eb64808b506fd1c49256752" candidate_uuid: "6e4eb6facf924880a0e38eeff91ba974" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffdf999adba487a9887fe7e2cc0f874" is_pre_election: true
I20260709 12:14:42.222347 25750 ts_tablet_manager.cc:1434] T 243ba61cc23a42669b893d2e6268a359 P 6e4eb6facf924880a0e38eeff91ba974: Time spent starting tablet: real 0.010s	user 0.001s	sys 0.007s
I20260709 12:14:42.222998 25789 raft_consensus.cc:2804] T 6a3136f9b7e64004b7005f11e9a050f9 P 7ffdf999adba487a9887fe7e2cc0f874 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:42.223430 25789 raft_consensus.cc:493] T 6a3136f9b7e64004b7005f11e9a050f9 P 7ffdf999adba487a9887fe7e2cc0f874 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:42.220590 25634 raft_consensus.cc:2468] T 6a3136f9b7e64004b7005f11e9a050f9 P 6e4eb6facf924880a0e38eeff91ba974 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffdf999adba487a9887fe7e2cc0f874 in term 0.
I20260709 12:14:42.223858 25789 raft_consensus.cc:3060] T 6a3136f9b7e64004b7005f11e9a050f9 P 7ffdf999adba487a9887fe7e2cc0f874 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:42.224211 25750 tablet_bootstrap.cc:492] T f9d5a17200ac45a7b5a2130ba1fd816b P 6e4eb6facf924880a0e38eeff91ba974: Bootstrap starting.
I20260709 12:14:42.224959 25600 leader_election.cc:304] T 1513bb8a7eb64808b506fd1c49256752 P 6e4eb6facf924880a0e38eeff91ba974 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e4eb6facf924880a0e38eeff91ba974; no voters: 7ffdf999adba487a9887fe7e2cc0f874, f2868245e89644679e2b7dac75591a58
I20260709 12:14:42.225373 25708 raft_consensus.cc:2468] T 448860827aca47b984ef19865addaeff P 7ffdf999adba487a9887fe7e2cc0f874 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e4eb6facf924880a0e38eeff91ba974 in term 1.
I20260709 12:14:42.226920 25764 raft_consensus.cc:3060] T 1513bb8a7eb64808b506fd1c49256752 P 6e4eb6facf924880a0e38eeff91ba974 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:42.232348 25750 tablet_bootstrap.cc:654] T f9d5a17200ac45a7b5a2130ba1fd816b P 6e4eb6facf924880a0e38eeff91ba974: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:42.235415 25600 leader_election.cc:304] T 448860827aca47b984ef19865addaeff P 6e4eb6facf924880a0e38eeff91ba974 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e4eb6facf924880a0e38eeff91ba974, 7ffdf999adba487a9887fe7e2cc0f874; no voters: 
I20260709 12:14:42.235773 25789 raft_consensus.cc:515] T 6a3136f9b7e64004b7005f11e9a050f9 P 7ffdf999adba487a9887fe7e2cc0f874 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:42.237495 25764 raft_consensus.cc:2749] T 1513bb8a7eb64808b506fd1c49256752 P 6e4eb6facf924880a0e38eeff91ba974 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:42.238852 25789 leader_election.cc:290] T 6a3136f9b7e64004b7005f11e9a050f9 P 7ffdf999adba487a9887fe7e2cc0f874 [CANDIDATE]: Term 1 election: Requested vote from peers f2868245e89644679e2b7dac75591a58 (127.12.174.129:40387), 6e4eb6facf924880a0e38eeff91ba974 (127.12.174.130:41805)
I20260709 12:14:42.239847 25558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3136f9b7e64004b7005f11e9a050f9" candidate_uuid: "7ffdf999adba487a9887fe7e2cc0f874" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f2868245e89644679e2b7dac75591a58"
I20260709 12:14:42.240527 25558 raft_consensus.cc:3060] T 6a3136f9b7e64004b7005f11e9a050f9 P f2868245e89644679e2b7dac75591a58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:42.241218 25557 raft_consensus.cc:2468] T 448860827aca47b984ef19865addaeff P f2868245e89644679e2b7dac75591a58 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e4eb6facf924880a0e38eeff91ba974 in term 1.
I20260709 12:14:42.243299 25764 raft_consensus.cc:2804] T 448860827aca47b984ef19865addaeff P 6e4eb6facf924880a0e38eeff91ba974 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:42.243902 25764 raft_consensus.cc:697] T 448860827aca47b984ef19865addaeff P 6e4eb6facf924880a0e38eeff91ba974 [term 1 LEADER]: Becoming Leader. State: Replica: 6e4eb6facf924880a0e38eeff91ba974, State: Running, Role: LEADER
W20260709 12:14:42.244107 25729 debug-util.cc:398] Leaking SignalData structure 0x7b080023b100 after lost signal to thread 12989
I20260709 12:14:42.244884 25764 consensus_queue.cc:237] T 448860827aca47b984ef19865addaeff P 6e4eb6facf924880a0e38eeff91ba974 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
W20260709 12:14:42.245785 25729 debug-util.cc:398] Leaking SignalData structure 0x7b0800161be0 after lost signal to thread 25491
I20260709 12:14:42.252008 25558 raft_consensus.cc:2468] T 6a3136f9b7e64004b7005f11e9a050f9 P f2868245e89644679e2b7dac75591a58 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffdf999adba487a9887fe7e2cc0f874 in term 1.
I20260709 12:14:42.254138 25671 leader_election.cc:304] T 6a3136f9b7e64004b7005f11e9a050f9 P 7ffdf999adba487a9887fe7e2cc0f874 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffdf999adba487a9887fe7e2cc0f874, f2868245e89644679e2b7dac75591a58; no voters: 
I20260709 12:14:42.255568 25789 raft_consensus.cc:2804] T 6a3136f9b7e64004b7005f11e9a050f9 P 7ffdf999adba487a9887fe7e2cc0f874 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:42.256477 25789 raft_consensus.cc:697] T 6a3136f9b7e64004b7005f11e9a050f9 P 7ffdf999adba487a9887fe7e2cc0f874 [term 1 LEADER]: Becoming Leader. State: Replica: 7ffdf999adba487a9887fe7e2cc0f874, State: Running, Role: LEADER
I20260709 12:14:42.259343 25634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3136f9b7e64004b7005f11e9a050f9" candidate_uuid: "7ffdf999adba487a9887fe7e2cc0f874" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e4eb6facf924880a0e38eeff91ba974"
I20260709 12:14:42.260275 25634 raft_consensus.cc:3060] T 6a3136f9b7e64004b7005f11e9a050f9 P 6e4eb6facf924880a0e38eeff91ba974 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:42.260720 25789 consensus_queue.cc:237] T 6a3136f9b7e64004b7005f11e9a050f9 P 7ffdf999adba487a9887fe7e2cc0f874 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:42.264369 25754 raft_consensus.cc:493] T 9204b1c1003646bfb3b61de1e4a235d6 P 7ffdf999adba487a9887fe7e2cc0f874 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:42.265154 25754 raft_consensus.cc:515] T 9204b1c1003646bfb3b61de1e4a235d6 P 7ffdf999adba487a9887fe7e2cc0f874 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:42.269593 25558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9204b1c1003646bfb3b61de1e4a235d6" candidate_uuid: "7ffdf999adba487a9887fe7e2cc0f874" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f2868245e89644679e2b7dac75591a58" is_pre_election: true
I20260709 12:14:42.270618 25558 raft_consensus.cc:2468] T 9204b1c1003646bfb3b61de1e4a235d6 P f2868245e89644679e2b7dac75591a58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffdf999adba487a9887fe7e2cc0f874 in term 0.
I20260709 12:14:42.272409 25671 leader_election.cc:304] T 9204b1c1003646bfb3b61de1e4a235d6 P 7ffdf999adba487a9887fe7e2cc0f874 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffdf999adba487a9887fe7e2cc0f874, f2868245e89644679e2b7dac75591a58; no voters: 
I20260709 12:14:42.273967 25754 leader_election.cc:290] T 9204b1c1003646bfb3b61de1e4a235d6 P 7ffdf999adba487a9887fe7e2cc0f874 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f2868245e89644679e2b7dac75591a58 (127.12.174.129:40387), 6e4eb6facf924880a0e38eeff91ba974 (127.12.174.130:41805)
I20260709 12:14:42.275166 25754 raft_consensus.cc:2804] T 9204b1c1003646bfb3b61de1e4a235d6 P 7ffdf999adba487a9887fe7e2cc0f874 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:42.275511 25754 raft_consensus.cc:493] T 9204b1c1003646bfb3b61de1e4a235d6 P 7ffdf999adba487a9887fe7e2cc0f874 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:42.275985 25754 raft_consensus.cc:3060] T 9204b1c1003646bfb3b61de1e4a235d6 P 7ffdf999adba487a9887fe7e2cc0f874 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:42.280402 25457 catalog_manager.cc:5697] T 6a3136f9b7e64004b7005f11e9a050f9 P 7ffdf999adba487a9887fe7e2cc0f874 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7ffdf999adba487a9887fe7e2cc0f874 (127.12.174.131). New cstate: current_term: 1 leader_uuid: "7ffdf999adba487a9887fe7e2cc0f874" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:42.286237 25754 raft_consensus.cc:515] T 9204b1c1003646bfb3b61de1e4a235d6 P 7ffdf999adba487a9887fe7e2cc0f874 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:42.290297 25558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9204b1c1003646bfb3b61de1e4a235d6" candidate_uuid: "7ffdf999adba487a9887fe7e2cc0f874" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f2868245e89644679e2b7dac75591a58"
I20260709 12:14:42.291085 25558 raft_consensus.cc:3060] T 9204b1c1003646bfb3b61de1e4a235d6 P f2868245e89644679e2b7dac75591a58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:42.298635 25455 catalog_manager.cc:5697] T 448860827aca47b984ef19865addaeff P 6e4eb6facf924880a0e38eeff91ba974 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6e4eb6facf924880a0e38eeff91ba974 (127.12.174.130). New cstate: current_term: 1 leader_uuid: "6e4eb6facf924880a0e38eeff91ba974" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:42.301548 25558 raft_consensus.cc:2468] T 9204b1c1003646bfb3b61de1e4a235d6 P f2868245e89644679e2b7dac75591a58 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffdf999adba487a9887fe7e2cc0f874 in term 1.
I20260709 12:14:42.304670 25671 leader_election.cc:304] T 9204b1c1003646bfb3b61de1e4a235d6 P 7ffdf999adba487a9887fe7e2cc0f874 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffdf999adba487a9887fe7e2cc0f874, f2868245e89644679e2b7dac75591a58; no voters: 
I20260709 12:14:42.305935 25789 raft_consensus.cc:2804] T 9204b1c1003646bfb3b61de1e4a235d6 P 7ffdf999adba487a9887fe7e2cc0f874 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:42.310382 25789 raft_consensus.cc:697] T 9204b1c1003646bfb3b61de1e4a235d6 P 7ffdf999adba487a9887fe7e2cc0f874 [term 1 LEADER]: Becoming Leader. State: Replica: 7ffdf999adba487a9887fe7e2cc0f874, State: Running, Role: LEADER
I20260709 12:14:42.311569 25789 consensus_queue.cc:237] T 9204b1c1003646bfb3b61de1e4a235d6 P 7ffdf999adba487a9887fe7e2cc0f874 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:42.312176 25632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9204b1c1003646bfb3b61de1e4a235d6" candidate_uuid: "7ffdf999adba487a9887fe7e2cc0f874" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e4eb6facf924880a0e38eeff91ba974" is_pre_election: true
I20260709 12:14:42.313180 25632 raft_consensus.cc:2468] T 9204b1c1003646bfb3b61de1e4a235d6 P 6e4eb6facf924880a0e38eeff91ba974 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffdf999adba487a9887fe7e2cc0f874 in term 0.
I20260709 12:14:42.303090 25754 leader_election.cc:290] T 9204b1c1003646bfb3b61de1e4a235d6 P 7ffdf999adba487a9887fe7e2cc0f874 [CANDIDATE]: Term 1 election: Requested vote from peers f2868245e89644679e2b7dac75591a58 (127.12.174.129:40387), 6e4eb6facf924880a0e38eeff91ba974 (127.12.174.130:41805)
I20260709 12:14:42.315788 25632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9204b1c1003646bfb3b61de1e4a235d6" candidate_uuid: "7ffdf999adba487a9887fe7e2cc0f874" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e4eb6facf924880a0e38eeff91ba974"
I20260709 12:14:42.316833 25632 raft_consensus.cc:3060] T 9204b1c1003646bfb3b61de1e4a235d6 P 6e4eb6facf924880a0e38eeff91ba974 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:42.332324 25632 raft_consensus.cc:2468] T 9204b1c1003646bfb3b61de1e4a235d6 P 6e4eb6facf924880a0e38eeff91ba974 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffdf999adba487a9887fe7e2cc0f874 in term 1.
I20260709 12:14:42.333570 25634 raft_consensus.cc:2468] T 6a3136f9b7e64004b7005f11e9a050f9 P 6e4eb6facf924880a0e38eeff91ba974 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffdf999adba487a9887fe7e2cc0f874 in term 1.
I20260709 12:14:42.338888 25750 tablet_bootstrap.cc:492] T f9d5a17200ac45a7b5a2130ba1fd816b P 6e4eb6facf924880a0e38eeff91ba974: No bootstrap required, opened a new log
I20260709 12:14:42.339618 25750 ts_tablet_manager.cc:1403] T f9d5a17200ac45a7b5a2130ba1fd816b P 6e4eb6facf924880a0e38eeff91ba974: Time spent bootstrapping tablet: real 0.116s	user 0.048s	sys 0.024s
I20260709 12:14:42.343075 25750 raft_consensus.cc:359] T f9d5a17200ac45a7b5a2130ba1fd816b P 6e4eb6facf924880a0e38eeff91ba974 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } } peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } }
I20260709 12:14:42.343866 25750 raft_consensus.cc:385] T f9d5a17200ac45a7b5a2130ba1fd816b P 6e4eb6facf924880a0e38eeff91ba974 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:42.344154 25750 raft_consensus.cc:740] T f9d5a17200ac45a7b5a2130ba1fd816b P 6e4eb6facf924880a0e38eeff91ba974 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e4eb6facf924880a0e38eeff91ba974, State: Initialized, Role: FOLLOWER
I20260709 12:14:42.344923 25750 consensus_queue.cc:260] T f9d5a17200ac45a7b5a2130ba1fd816b P 6e4eb6facf924880a0e38eeff91ba974 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } } peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } }
I20260709 12:14:42.347473 25750 ts_tablet_manager.cc:1434] T f9d5a17200ac45a7b5a2130ba1fd816b P 6e4eb6facf924880a0e38eeff91ba974: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:14:42.347946 25456 catalog_manager.cc:5697] T 9204b1c1003646bfb3b61de1e4a235d6 P 7ffdf999adba487a9887fe7e2cc0f874 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7ffdf999adba487a9887fe7e2cc0f874 (127.12.174.131). New cstate: current_term: 1 leader_uuid: "7ffdf999adba487a9887fe7e2cc0f874" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:42.423470 25785 consensus_queue.cc:1048] T 741c39eaebc94dfc9bd1562b10cf0698 P f2868245e89644679e2b7dac75591a58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:42.431900 25764 raft_consensus.cc:493] T 243ba61cc23a42669b893d2e6268a359 P 6e4eb6facf924880a0e38eeff91ba974 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:42.432502 25764 raft_consensus.cc:515] T 243ba61cc23a42669b893d2e6268a359 P 6e4eb6facf924880a0e38eeff91ba974 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:42.434939 25764 leader_election.cc:290] T 243ba61cc23a42669b893d2e6268a359 P 6e4eb6facf924880a0e38eeff91ba974 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f2868245e89644679e2b7dac75591a58 (127.12.174.129:40387), 7ffdf999adba487a9887fe7e2cc0f874 (127.12.174.131:36809)
I20260709 12:14:42.436805 25558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ba61cc23a42669b893d2e6268a359" candidate_uuid: "6e4eb6facf924880a0e38eeff91ba974" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f2868245e89644679e2b7dac75591a58" is_pre_election: true
I20260709 12:14:42.437876 25708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ba61cc23a42669b893d2e6268a359" candidate_uuid: "6e4eb6facf924880a0e38eeff91ba974" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffdf999adba487a9887fe7e2cc0f874" is_pre_election: true
I20260709 12:14:42.438987 25708 raft_consensus.cc:2393] T 243ba61cc23a42669b893d2e6268a359 P 7ffdf999adba487a9887fe7e2cc0f874 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e4eb6facf924880a0e38eeff91ba974 in current term 1: Already voted for candidate f2868245e89644679e2b7dac75591a58 in this term.
I20260709 12:14:42.440688 25600 leader_election.cc:304] T 243ba61cc23a42669b893d2e6268a359 P 6e4eb6facf924880a0e38eeff91ba974 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e4eb6facf924880a0e38eeff91ba974; no voters: 7ffdf999adba487a9887fe7e2cc0f874, f2868245e89644679e2b7dac75591a58
I20260709 12:14:42.441712 25764 raft_consensus.cc:3060] T 243ba61cc23a42669b893d2e6268a359 P 6e4eb6facf924880a0e38eeff91ba974 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:42.452627 25786 consensus_queue.cc:1048] T 741c39eaebc94dfc9bd1562b10cf0698 P f2868245e89644679e2b7dac75591a58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:42.453115 25764 raft_consensus.cc:2749] T 243ba61cc23a42669b893d2e6268a359 P 6e4eb6facf924880a0e38eeff91ba974 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:42.480504 25789 consensus_queue.cc:1048] T 1513bb8a7eb64808b506fd1c49256752 P 7ffdf999adba487a9887fe7e2cc0f874 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:42.480641 25786 consensus_queue.cc:1048] T 5fa898e4a0cf49c79c9803b61ac3e756 P f2868245e89644679e2b7dac75591a58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:14:42.494449 25505 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:14:42.496692 25789 consensus_queue.cc:1048] T 1513bb8a7eb64808b506fd1c49256752 P 7ffdf999adba487a9887fe7e2cc0f874 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:42.506237 25756 consensus_queue.cc:1048] T 5fa898e4a0cf49c79c9803b61ac3e756 P f2868245e89644679e2b7dac75591a58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:42.507607 25786 consensus_queue.cc:1048] T 243ba61cc23a42669b893d2e6268a359 P f2868245e89644679e2b7dac75591a58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:42.519218 25756 consensus_queue.cc:1048] T 12dd6a165033473e9c39fd87d4763add P f2868245e89644679e2b7dac75591a58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:42.538867 25756 consensus_queue.cc:1048] T 243ba61cc23a42669b893d2e6268a359 P f2868245e89644679e2b7dac75591a58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:42.550954 25764 raft_consensus.cc:493] T f9d5a17200ac45a7b5a2130ba1fd816b P 6e4eb6facf924880a0e38eeff91ba974 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:42.551586 25764 raft_consensus.cc:515] T f9d5a17200ac45a7b5a2130ba1fd816b P 6e4eb6facf924880a0e38eeff91ba974 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } } peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } }
I20260709 12:14:42.555001 25706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9d5a17200ac45a7b5a2130ba1fd816b" candidate_uuid: "6e4eb6facf924880a0e38eeff91ba974" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffdf999adba487a9887fe7e2cc0f874" is_pre_election: true
I20260709 12:14:42.555900 25706 raft_consensus.cc:2393] T f9d5a17200ac45a7b5a2130ba1fd816b P 7ffdf999adba487a9887fe7e2cc0f874 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e4eb6facf924880a0e38eeff91ba974 in current term 1: Already voted for candidate 7ffdf999adba487a9887fe7e2cc0f874 in this term.
I20260709 12:14:42.555871 25764 leader_election.cc:290] T f9d5a17200ac45a7b5a2130ba1fd816b P 6e4eb6facf924880a0e38eeff91ba974 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ffdf999adba487a9887fe7e2cc0f874 (127.12.174.131:36809), f2868245e89644679e2b7dac75591a58 (127.12.174.129:40387)
I20260709 12:14:42.558665 25558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9d5a17200ac45a7b5a2130ba1fd816b" candidate_uuid: "6e4eb6facf924880a0e38eeff91ba974" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f2868245e89644679e2b7dac75591a58" is_pre_election: true
I20260709 12:14:42.559638 25558 raft_consensus.cc:2393] T f9d5a17200ac45a7b5a2130ba1fd816b P f2868245e89644679e2b7dac75591a58 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e4eb6facf924880a0e38eeff91ba974 in current term 1: Already voted for candidate f2868245e89644679e2b7dac75591a58 in this term.
I20260709 12:14:42.560245 25756 consensus_queue.cc:1048] T 12dd6a165033473e9c39fd87d4763add P f2868245e89644679e2b7dac75591a58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:42.561434 25597 leader_election.cc:304] T f9d5a17200ac45a7b5a2130ba1fd816b P 6e4eb6facf924880a0e38eeff91ba974 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e4eb6facf924880a0e38eeff91ba974; no voters: 7ffdf999adba487a9887fe7e2cc0f874, f2868245e89644679e2b7dac75591a58
I20260709 12:14:42.563905 25809 raft_consensus.cc:3060] T f9d5a17200ac45a7b5a2130ba1fd816b P 6e4eb6facf924880a0e38eeff91ba974 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:42.607584 25809 raft_consensus.cc:2749] T f9d5a17200ac45a7b5a2130ba1fd816b P 6e4eb6facf924880a0e38eeff91ba974 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:42.674768 25809 consensus_queue.cc:1048] T 448860827aca47b984ef19865addaeff P 6e4eb6facf924880a0e38eeff91ba974 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:42.687539 25829 consensus_queue.cc:1048] T 448860827aca47b984ef19865addaeff P 6e4eb6facf924880a0e38eeff91ba974 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:42.699957 25789 consensus_queue.cc:1048] T 6a3136f9b7e64004b7005f11e9a050f9 P 7ffdf999adba487a9887fe7e2cc0f874 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:42.718024 25812 consensus_queue.cc:1048] T 6a3136f9b7e64004b7005f11e9a050f9 P 7ffdf999adba487a9887fe7e2cc0f874 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:42.765534 25812 consensus_queue.cc:1048] T 9204b1c1003646bfb3b61de1e4a235d6 P 7ffdf999adba487a9887fe7e2cc0f874 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:42.780368 25789 consensus_queue.cc:1048] T 9204b1c1003646bfb3b61de1e4a235d6 P 7ffdf999adba487a9887fe7e2cc0f874 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:14:43.496269 25505 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:14:43.614732 25789 raft_consensus.cc:493] T f9d5a17200ac45a7b5a2130ba1fd816b P 7ffdf999adba487a9887fe7e2cc0f874 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:43.615442 25789 raft_consensus.cc:515] T f9d5a17200ac45a7b5a2130ba1fd816b P 7ffdf999adba487a9887fe7e2cc0f874 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } } peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } }
I20260709 12:14:43.617499 25789 leader_election.cc:290] T f9d5a17200ac45a7b5a2130ba1fd816b P 7ffdf999adba487a9887fe7e2cc0f874 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f2868245e89644679e2b7dac75591a58 (127.12.174.129:40387), 6e4eb6facf924880a0e38eeff91ba974 (127.12.174.130:41805)
I20260709 12:14:43.618778 25632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9d5a17200ac45a7b5a2130ba1fd816b" candidate_uuid: "7ffdf999adba487a9887fe7e2cc0f874" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e4eb6facf924880a0e38eeff91ba974" is_pre_election: true
I20260709 12:14:43.618808 25558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9d5a17200ac45a7b5a2130ba1fd816b" candidate_uuid: "7ffdf999adba487a9887fe7e2cc0f874" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f2868245e89644679e2b7dac75591a58" is_pre_election: true
I20260709 12:14:43.619771 25632 raft_consensus.cc:2468] T f9d5a17200ac45a7b5a2130ba1fd816b P 6e4eb6facf924880a0e38eeff91ba974 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffdf999adba487a9887fe7e2cc0f874 in term 1.
I20260709 12:14:43.619817 25558 raft_consensus.cc:2468] T f9d5a17200ac45a7b5a2130ba1fd816b P f2868245e89644679e2b7dac75591a58 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffdf999adba487a9887fe7e2cc0f874 in term 1.
I20260709 12:14:43.621223 25671 leader_election.cc:304] T f9d5a17200ac45a7b5a2130ba1fd816b P 7ffdf999adba487a9887fe7e2cc0f874 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e4eb6facf924880a0e38eeff91ba974, 7ffdf999adba487a9887fe7e2cc0f874; no voters: 
I20260709 12:14:43.622007 25789 raft_consensus.cc:2804] T f9d5a17200ac45a7b5a2130ba1fd816b P 7ffdf999adba487a9887fe7e2cc0f874 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:43.622411 25789 raft_consensus.cc:493] T f9d5a17200ac45a7b5a2130ba1fd816b P 7ffdf999adba487a9887fe7e2cc0f874 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:43.622741 25789 raft_consensus.cc:3060] T f9d5a17200ac45a7b5a2130ba1fd816b P 7ffdf999adba487a9887fe7e2cc0f874 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:43.629176 25789 raft_consensus.cc:515] T f9d5a17200ac45a7b5a2130ba1fd816b P 7ffdf999adba487a9887fe7e2cc0f874 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } } peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } }
I20260709 12:14:43.631214 25789 leader_election.cc:290] T f9d5a17200ac45a7b5a2130ba1fd816b P 7ffdf999adba487a9887fe7e2cc0f874 [CANDIDATE]: Term 2 election: Requested vote from peers f2868245e89644679e2b7dac75591a58 (127.12.174.129:40387), 6e4eb6facf924880a0e38eeff91ba974 (127.12.174.130:41805)
I20260709 12:14:43.632419 25632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9d5a17200ac45a7b5a2130ba1fd816b" candidate_uuid: "7ffdf999adba487a9887fe7e2cc0f874" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e4eb6facf924880a0e38eeff91ba974"
I20260709 12:14:43.632285 25558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9d5a17200ac45a7b5a2130ba1fd816b" candidate_uuid: "7ffdf999adba487a9887fe7e2cc0f874" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f2868245e89644679e2b7dac75591a58"
I20260709 12:14:43.633252 25558 raft_consensus.cc:3060] T f9d5a17200ac45a7b5a2130ba1fd816b P f2868245e89644679e2b7dac75591a58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:43.634393 25632 raft_consensus.cc:3060] T f9d5a17200ac45a7b5a2130ba1fd816b P 6e4eb6facf924880a0e38eeff91ba974 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:43.640022 25558 raft_consensus.cc:2468] T f9d5a17200ac45a7b5a2130ba1fd816b P f2868245e89644679e2b7dac75591a58 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffdf999adba487a9887fe7e2cc0f874 in term 2.
I20260709 12:14:43.641714 25671 leader_election.cc:304] T f9d5a17200ac45a7b5a2130ba1fd816b P 7ffdf999adba487a9887fe7e2cc0f874 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffdf999adba487a9887fe7e2cc0f874, f2868245e89644679e2b7dac75591a58; no voters: 
I20260709 12:14:43.642676 25789 raft_consensus.cc:2804] T f9d5a17200ac45a7b5a2130ba1fd816b P 7ffdf999adba487a9887fe7e2cc0f874 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:43.643224 25789 raft_consensus.cc:697] T f9d5a17200ac45a7b5a2130ba1fd816b P 7ffdf999adba487a9887fe7e2cc0f874 [term 2 LEADER]: Becoming Leader. State: Replica: 7ffdf999adba487a9887fe7e2cc0f874, State: Running, Role: LEADER
I20260709 12:14:43.644023 25789 consensus_queue.cc:237] T f9d5a17200ac45a7b5a2130ba1fd816b P 7ffdf999adba487a9887fe7e2cc0f874 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } } peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } }
I20260709 12:14:43.645969 25632 raft_consensus.cc:2468] T f9d5a17200ac45a7b5a2130ba1fd816b P 6e4eb6facf924880a0e38eeff91ba974 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffdf999adba487a9887fe7e2cc0f874 in term 2.
I20260709 12:14:43.653136 25455 catalog_manager.cc:5697] T f9d5a17200ac45a7b5a2130ba1fd816b P 7ffdf999adba487a9887fe7e2cc0f874 reported cstate change: term changed from 0 to 2, leader changed from <none> to 7ffdf999adba487a9887fe7e2cc0f874 (127.12.174.131). New cstate: current_term: 2 leader_uuid: "7ffdf999adba487a9887fe7e2cc0f874" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:43.963575 25706 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f9d5a17200ac45a7b5a2130ba1fd816b"
dest_uuid: "7ffdf999adba487a9887fe7e2cc0f874"
mode: GRACEFUL
new_leader_uuid: "f2868245e89644679e2b7dac75591a58"
 from {username='slave'} at 127.0.0.1:44260
I20260709 12:14:43.964368 25706 raft_consensus.cc:606] T f9d5a17200ac45a7b5a2130ba1fd816b P 7ffdf999adba487a9887fe7e2cc0f874 [term 2 LEADER]: Received request to transfer leadership to TS f2868245e89644679e2b7dac75591a58
I20260709 12:14:43.987140 25632 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "448860827aca47b984ef19865addaeff"
dest_uuid: "6e4eb6facf924880a0e38eeff91ba974"
mode: GRACEFUL
new_leader_uuid: "f2868245e89644679e2b7dac75591a58"
 from {username='slave'} at 127.0.0.1:46492
I20260709 12:14:43.987890 25632 raft_consensus.cc:606] T 448860827aca47b984ef19865addaeff P 6e4eb6facf924880a0e38eeff91ba974 [term 1 LEADER]: Received request to transfer leadership to TS f2868245e89644679e2b7dac75591a58
I20260709 12:14:44.004246 25558 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5fa898e4a0cf49c79c9803b61ac3e756"
dest_uuid: "f2868245e89644679e2b7dac75591a58"
mode: GRACEFUL
new_leader_uuid: "6e4eb6facf924880a0e38eeff91ba974"
 from {username='slave'} at 127.0.0.1:38814
I20260709 12:14:44.004868 25558 raft_consensus.cc:606] T 5fa898e4a0cf49c79c9803b61ac3e756 P f2868245e89644679e2b7dac75591a58 [term 1 LEADER]: Received request to transfer leadership to TS 6e4eb6facf924880a0e38eeff91ba974
I20260709 12:14:44.011257 25558 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "12dd6a165033473e9c39fd87d4763add"
dest_uuid: "f2868245e89644679e2b7dac75591a58"
mode: GRACEFUL
new_leader_uuid: "6e4eb6facf924880a0e38eeff91ba974"
 from {username='slave'} at 127.0.0.1:38814
I20260709 12:14:44.011843 25558 raft_consensus.cc:606] T 12dd6a165033473e9c39fd87d4763add P f2868245e89644679e2b7dac75591a58 [term 1 LEADER]: Received request to transfer leadership to TS 6e4eb6facf924880a0e38eeff91ba974
I20260709 12:14:44.017217 25706 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1513bb8a7eb64808b506fd1c49256752"
dest_uuid: "7ffdf999adba487a9887fe7e2cc0f874"
mode: GRACEFUL
new_leader_uuid: "6e4eb6facf924880a0e38eeff91ba974"
 from {username='slave'} at 127.0.0.1:44260
I20260709 12:14:44.017829 25706 raft_consensus.cc:606] T 1513bb8a7eb64808b506fd1c49256752 P 7ffdf999adba487a9887fe7e2cc0f874 [term 1 LEADER]: Received request to transfer leadership to TS 6e4eb6facf924880a0e38eeff91ba974
I20260709 12:14:44.022141 25785 raft_consensus.cc:993] T 5fa898e4a0cf49c79c9803b61ac3e756 P f2868245e89644679e2b7dac75591a58: : Instructing follower 6e4eb6facf924880a0e38eeff91ba974 to start an election
I20260709 12:14:44.022680 25785 raft_consensus.cc:1081] T 5fa898e4a0cf49c79c9803b61ac3e756 P f2868245e89644679e2b7dac75591a58 [term 1 LEADER]: Signalling peer 6e4eb6facf924880a0e38eeff91ba974 to start an election
I20260709 12:14:44.024453 25706 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6a3136f9b7e64004b7005f11e9a050f9"
dest_uuid: "7ffdf999adba487a9887fe7e2cc0f874"
mode: GRACEFUL
new_leader_uuid: "6e4eb6facf924880a0e38eeff91ba974"
 from {username='slave'} at 127.0.0.1:44260
I20260709 12:14:44.024890 25632 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5fa898e4a0cf49c79c9803b61ac3e756"
dest_uuid: "6e4eb6facf924880a0e38eeff91ba974"
 from {username='slave'} at 127.0.0.1:33044
I20260709 12:14:44.025085 25706 raft_consensus.cc:606] T 6a3136f9b7e64004b7005f11e9a050f9 P 7ffdf999adba487a9887fe7e2cc0f874 [term 1 LEADER]: Received request to transfer leadership to TS 6e4eb6facf924880a0e38eeff91ba974
I20260709 12:14:44.025643 25632 raft_consensus.cc:493] T 5fa898e4a0cf49c79c9803b61ac3e756 P 6e4eb6facf924880a0e38eeff91ba974 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:44.026038 25632 raft_consensus.cc:3060] T 5fa898e4a0cf49c79c9803b61ac3e756 P 6e4eb6facf924880a0e38eeff91ba974 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:44.033238 25632 raft_consensus.cc:515] T 5fa898e4a0cf49c79c9803b61ac3e756 P 6e4eb6facf924880a0e38eeff91ba974 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:44.035377 25632 leader_election.cc:290] T 5fa898e4a0cf49c79c9803b61ac3e756 P 6e4eb6facf924880a0e38eeff91ba974 [CANDIDATE]: Term 2 election: Requested vote from peers f2868245e89644679e2b7dac75591a58 (127.12.174.129:40387), 7ffdf999adba487a9887fe7e2cc0f874 (127.12.174.131:36809)
I20260709 12:14:44.036803 25706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fa898e4a0cf49c79c9803b61ac3e756" candidate_uuid: "6e4eb6facf924880a0e38eeff91ba974" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7ffdf999adba487a9887fe7e2cc0f874"
I20260709 12:14:44.037446 25706 raft_consensus.cc:3060] T 5fa898e4a0cf49c79c9803b61ac3e756 P 7ffdf999adba487a9887fe7e2cc0f874 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:44.038602 25558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fa898e4a0cf49c79c9803b61ac3e756" candidate_uuid: "6e4eb6facf924880a0e38eeff91ba974" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f2868245e89644679e2b7dac75591a58"
I20260709 12:14:44.039348 25558 raft_consensus.cc:3055] T 5fa898e4a0cf49c79c9803b61ac3e756 P f2868245e89644679e2b7dac75591a58 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:44.039695 25558 raft_consensus.cc:740] T 5fa898e4a0cf49c79c9803b61ac3e756 P f2868245e89644679e2b7dac75591a58 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f2868245e89644679e2b7dac75591a58, State: Running, Role: LEADER
I20260709 12:14:44.040578 25558 consensus_queue.cc:260] T 5fa898e4a0cf49c79c9803b61ac3e756 P f2868245e89644679e2b7dac75591a58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:44.042075 25558 raft_consensus.cc:3060] T 5fa898e4a0cf49c79c9803b61ac3e756 P f2868245e89644679e2b7dac75591a58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:44.044966 25706 raft_consensus.cc:2468] T 5fa898e4a0cf49c79c9803b61ac3e756 P 7ffdf999adba487a9887fe7e2cc0f874 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e4eb6facf924880a0e38eeff91ba974 in term 2.
I20260709 12:14:44.046320 25600 leader_election.cc:304] T 5fa898e4a0cf49c79c9803b61ac3e756 P 6e4eb6facf924880a0e38eeff91ba974 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e4eb6facf924880a0e38eeff91ba974, 7ffdf999adba487a9887fe7e2cc0f874; no voters: 
I20260709 12:14:44.047039 25840 raft_consensus.cc:2804] T 5fa898e4a0cf49c79c9803b61ac3e756 P 6e4eb6facf924880a0e38eeff91ba974 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:44.048405 25840 raft_consensus.cc:697] T 5fa898e4a0cf49c79c9803b61ac3e756 P 6e4eb6facf924880a0e38eeff91ba974 [term 2 LEADER]: Becoming Leader. State: Replica: 6e4eb6facf924880a0e38eeff91ba974, State: Running, Role: LEADER
I20260709 12:14:44.049252 25840 consensus_queue.cc:237] T 5fa898e4a0cf49c79c9803b61ac3e756 P 6e4eb6facf924880a0e38eeff91ba974 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:44.050871 25558 raft_consensus.cc:2468] T 5fa898e4a0cf49c79c9803b61ac3e756 P f2868245e89644679e2b7dac75591a58 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e4eb6facf924880a0e38eeff91ba974 in term 2.
I20260709 12:14:44.059165 25455 catalog_manager.cc:5697] T 5fa898e4a0cf49c79c9803b61ac3e756 P 6e4eb6facf924880a0e38eeff91ba974 reported cstate change: term changed from 1 to 2, leader changed from f2868245e89644679e2b7dac75591a58 (127.12.174.129) to 6e4eb6facf924880a0e38eeff91ba974 (127.12.174.130). New cstate: current_term: 2 leader_uuid: "6e4eb6facf924880a0e38eeff91ba974" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:44.119621 25632 raft_consensus.cc:1275] T f9d5a17200ac45a7b5a2130ba1fd816b P 6e4eb6facf924880a0e38eeff91ba974 [term 2 FOLLOWER]: Refusing update from remote peer 7ffdf999adba487a9887fe7e2cc0f874: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:14:44.121199 25789 consensus_queue.cc:1048] T f9d5a17200ac45a7b5a2130ba1fd816b P 7ffdf999adba487a9887fe7e2cc0f874 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:44.139443 25558 raft_consensus.cc:1275] T f9d5a17200ac45a7b5a2130ba1fd816b P f2868245e89644679e2b7dac75591a58 [term 2 FOLLOWER]: Refusing update from remote peer 7ffdf999adba487a9887fe7e2cc0f874: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:14:44.141224 25789 consensus_queue.cc:1048] T f9d5a17200ac45a7b5a2130ba1fd816b P 7ffdf999adba487a9887fe7e2cc0f874 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:44.150172 25754 raft_consensus.cc:993] T f9d5a17200ac45a7b5a2130ba1fd816b P 7ffdf999adba487a9887fe7e2cc0f874: : Instructing follower f2868245e89644679e2b7dac75591a58 to start an election
I20260709 12:14:44.150766 25789 raft_consensus.cc:1081] T f9d5a17200ac45a7b5a2130ba1fd816b P 7ffdf999adba487a9887fe7e2cc0f874 [term 2 LEADER]: Signalling peer f2868245e89644679e2b7dac75591a58 to start an election
I20260709 12:14:44.152570 25558 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f9d5a17200ac45a7b5a2130ba1fd816b"
dest_uuid: "f2868245e89644679e2b7dac75591a58"
 from {username='slave'} at 127.0.0.1:36712
I20260709 12:14:44.153223 25558 raft_consensus.cc:493] T f9d5a17200ac45a7b5a2130ba1fd816b P f2868245e89644679e2b7dac75591a58 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:44.153637 25558 raft_consensus.cc:3060] T f9d5a17200ac45a7b5a2130ba1fd816b P f2868245e89644679e2b7dac75591a58 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:44.161994 25558 raft_consensus.cc:515] T f9d5a17200ac45a7b5a2130ba1fd816b P f2868245e89644679e2b7dac75591a58 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } } peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } }
I20260709 12:14:44.164216 25558 leader_election.cc:290] T f9d5a17200ac45a7b5a2130ba1fd816b P f2868245e89644679e2b7dac75591a58 [CANDIDATE]: Term 3 election: Requested vote from peers 7ffdf999adba487a9887fe7e2cc0f874 (127.12.174.131:36809), 6e4eb6facf924880a0e38eeff91ba974 (127.12.174.130:41805)
I20260709 12:14:44.165498 25632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9d5a17200ac45a7b5a2130ba1fd816b" candidate_uuid: "f2868245e89644679e2b7dac75591a58" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "6e4eb6facf924880a0e38eeff91ba974"
I20260709 12:14:44.165717 25706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9d5a17200ac45a7b5a2130ba1fd816b" candidate_uuid: "f2868245e89644679e2b7dac75591a58" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "7ffdf999adba487a9887fe7e2cc0f874"
I20260709 12:14:44.166316 25632 raft_consensus.cc:3060] T f9d5a17200ac45a7b5a2130ba1fd816b P 6e4eb6facf924880a0e38eeff91ba974 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:44.166456 25706 raft_consensus.cc:3055] T f9d5a17200ac45a7b5a2130ba1fd816b P 7ffdf999adba487a9887fe7e2cc0f874 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:44.166985 25706 raft_consensus.cc:740] T f9d5a17200ac45a7b5a2130ba1fd816b P 7ffdf999adba487a9887fe7e2cc0f874 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7ffdf999adba487a9887fe7e2cc0f874, State: Running, Role: LEADER
I20260709 12:14:44.168015 25706 consensus_queue.cc:260] T f9d5a17200ac45a7b5a2130ba1fd816b P 7ffdf999adba487a9887fe7e2cc0f874 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } } peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } }
I20260709 12:14:44.168991 25754 raft_consensus.cc:993] T 1513bb8a7eb64808b506fd1c49256752 P 7ffdf999adba487a9887fe7e2cc0f874: : Instructing follower 6e4eb6facf924880a0e38eeff91ba974 to start an election
I20260709 12:14:44.169562 25706 raft_consensus.cc:3060] T f9d5a17200ac45a7b5a2130ba1fd816b P 7ffdf999adba487a9887fe7e2cc0f874 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:44.169543 25754 raft_consensus.cc:1081] T 1513bb8a7eb64808b506fd1c49256752 P 7ffdf999adba487a9887fe7e2cc0f874 [term 1 LEADER]: Signalling peer 6e4eb6facf924880a0e38eeff91ba974 to start an election
I20260709 12:14:44.175736 25634 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1513bb8a7eb64808b506fd1c49256752"
dest_uuid: "6e4eb6facf924880a0e38eeff91ba974"
 from {username='slave'} at 127.0.0.1:33048
I20260709 12:14:44.176451 25634 raft_consensus.cc:493] T 1513bb8a7eb64808b506fd1c49256752 P 6e4eb6facf924880a0e38eeff91ba974 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:44.177037 25634 raft_consensus.cc:3060] T 1513bb8a7eb64808b506fd1c49256752 P 6e4eb6facf924880a0e38eeff91ba974 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:44.179956 25706 raft_consensus.cc:2468] T f9d5a17200ac45a7b5a2130ba1fd816b P 7ffdf999adba487a9887fe7e2cc0f874 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f2868245e89644679e2b7dac75591a58 in term 3.
I20260709 12:14:44.181562 25525 leader_election.cc:304] T f9d5a17200ac45a7b5a2130ba1fd816b P f2868245e89644679e2b7dac75591a58 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffdf999adba487a9887fe7e2cc0f874, f2868245e89644679e2b7dac75591a58; no voters: 
I20260709 12:14:44.182595 25785 raft_consensus.cc:2804] T f9d5a17200ac45a7b5a2130ba1fd816b P f2868245e89644679e2b7dac75591a58 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:44.183106 25785 raft_consensus.cc:697] T f9d5a17200ac45a7b5a2130ba1fd816b P f2868245e89644679e2b7dac75591a58 [term 3 LEADER]: Becoming Leader. State: Replica: f2868245e89644679e2b7dac75591a58, State: Running, Role: LEADER
I20260709 12:14:44.184031 25785 consensus_queue.cc:237] T f9d5a17200ac45a7b5a2130ba1fd816b P f2868245e89644679e2b7dac75591a58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } } peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } }
I20260709 12:14:44.186172 25634 raft_consensus.cc:515] T 1513bb8a7eb64808b506fd1c49256752 P 6e4eb6facf924880a0e38eeff91ba974 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:44.176445 25632 raft_consensus.cc:2468] T f9d5a17200ac45a7b5a2130ba1fd816b P 6e4eb6facf924880a0e38eeff91ba974 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f2868245e89644679e2b7dac75591a58 in term 3.
I20260709 12:14:44.192250 25558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1513bb8a7eb64808b506fd1c49256752" candidate_uuid: "6e4eb6facf924880a0e38eeff91ba974" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f2868245e89644679e2b7dac75591a58"
I20260709 12:14:44.193045 25558 raft_consensus.cc:3060] T 1513bb8a7eb64808b506fd1c49256752 P f2868245e89644679e2b7dac75591a58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:44.192363 25634 leader_election.cc:290] T 1513bb8a7eb64808b506fd1c49256752 P 6e4eb6facf924880a0e38eeff91ba974 [CANDIDATE]: Term 2 election: Requested vote from peers f2868245e89644679e2b7dac75591a58 (127.12.174.129:40387), 7ffdf999adba487a9887fe7e2cc0f874 (127.12.174.131:36809)
I20260709 12:14:44.193156 25706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1513bb8a7eb64808b506fd1c49256752" candidate_uuid: "6e4eb6facf924880a0e38eeff91ba974" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7ffdf999adba487a9887fe7e2cc0f874"
I20260709 12:14:44.192891 25455 catalog_manager.cc:5697] T f9d5a17200ac45a7b5a2130ba1fd816b P f2868245e89644679e2b7dac75591a58 reported cstate change: term changed from 2 to 3, leader changed from 7ffdf999adba487a9887fe7e2cc0f874 (127.12.174.131) to f2868245e89644679e2b7dac75591a58 (127.12.174.129). New cstate: current_term: 3 leader_uuid: "f2868245e89644679e2b7dac75591a58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:44.194840 25706 raft_consensus.cc:3055] T 1513bb8a7eb64808b506fd1c49256752 P 7ffdf999adba487a9887fe7e2cc0f874 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:44.195405 25706 raft_consensus.cc:740] T 1513bb8a7eb64808b506fd1c49256752 P 7ffdf999adba487a9887fe7e2cc0f874 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7ffdf999adba487a9887fe7e2cc0f874, State: Running, Role: LEADER
I20260709 12:14:44.196471 25706 consensus_queue.cc:260] T 1513bb8a7eb64808b506fd1c49256752 P 7ffdf999adba487a9887fe7e2cc0f874 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:44.197953 25706 raft_consensus.cc:3060] T 1513bb8a7eb64808b506fd1c49256752 P 7ffdf999adba487a9887fe7e2cc0f874 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:44.207067 25840 raft_consensus.cc:993] T 448860827aca47b984ef19865addaeff P 6e4eb6facf924880a0e38eeff91ba974: : Instructing follower f2868245e89644679e2b7dac75591a58 to start an election
I20260709 12:14:44.207690 25840 raft_consensus.cc:1081] T 448860827aca47b984ef19865addaeff P 6e4eb6facf924880a0e38eeff91ba974 [term 1 LEADER]: Signalling peer f2868245e89644679e2b7dac75591a58 to start an election
I20260709 12:14:44.209553 25558 raft_consensus.cc:2468] T 1513bb8a7eb64808b506fd1c49256752 P f2868245e89644679e2b7dac75591a58 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e4eb6facf924880a0e38eeff91ba974 in term 2.
I20260709 12:14:44.209928 25557 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "448860827aca47b984ef19865addaeff"
dest_uuid: "f2868245e89644679e2b7dac75591a58"
 from {username='slave'} at 127.0.0.1:36704
I20260709 12:14:44.210601 25557 raft_consensus.cc:493] T 448860827aca47b984ef19865addaeff P f2868245e89644679e2b7dac75591a58 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:44.207163 25706 raft_consensus.cc:2468] T 1513bb8a7eb64808b506fd1c49256752 P 7ffdf999adba487a9887fe7e2cc0f874 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e4eb6facf924880a0e38eeff91ba974 in term 2.
I20260709 12:14:44.210994 25557 raft_consensus.cc:3060] T 448860827aca47b984ef19865addaeff P f2868245e89644679e2b7dac75591a58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:44.211015 25597 leader_election.cc:304] T 1513bb8a7eb64808b506fd1c49256752 P 6e4eb6facf924880a0e38eeff91ba974 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e4eb6facf924880a0e38eeff91ba974, f2868245e89644679e2b7dac75591a58; no voters: 
I20260709 12:14:44.212345 25846 raft_consensus.cc:2804] T 1513bb8a7eb64808b506fd1c49256752 P 6e4eb6facf924880a0e38eeff91ba974 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:44.212853 25846 raft_consensus.cc:697] T 1513bb8a7eb64808b506fd1c49256752 P 6e4eb6facf924880a0e38eeff91ba974 [term 2 LEADER]: Becoming Leader. State: Replica: 6e4eb6facf924880a0e38eeff91ba974, State: Running, Role: LEADER
I20260709 12:14:44.213802 25846 consensus_queue.cc:237] T 1513bb8a7eb64808b506fd1c49256752 P 6e4eb6facf924880a0e38eeff91ba974 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:44.221930 25557 raft_consensus.cc:515] T 448860827aca47b984ef19865addaeff P f2868245e89644679e2b7dac75591a58 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:44.225041 25557 leader_election.cc:290] T 448860827aca47b984ef19865addaeff P f2868245e89644679e2b7dac75591a58 [CANDIDATE]: Term 2 election: Requested vote from peers 6e4eb6facf924880a0e38eeff91ba974 (127.12.174.130:41805), 7ffdf999adba487a9887fe7e2cc0f874 (127.12.174.131:36809)
I20260709 12:14:44.225065 25455 catalog_manager.cc:5697] T 1513bb8a7eb64808b506fd1c49256752 P 6e4eb6facf924880a0e38eeff91ba974 reported cstate change: term changed from 1 to 2, leader changed from 7ffdf999adba487a9887fe7e2cc0f874 (127.12.174.131) to 6e4eb6facf924880a0e38eeff91ba974 (127.12.174.130). New cstate: current_term: 2 leader_uuid: "6e4eb6facf924880a0e38eeff91ba974" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:44.226182 25634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "448860827aca47b984ef19865addaeff" candidate_uuid: "f2868245e89644679e2b7dac75591a58" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6e4eb6facf924880a0e38eeff91ba974"
I20260709 12:14:44.226970 25634 raft_consensus.cc:3055] T 448860827aca47b984ef19865addaeff P 6e4eb6facf924880a0e38eeff91ba974 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:44.227304 25634 raft_consensus.cc:740] T 448860827aca47b984ef19865addaeff P 6e4eb6facf924880a0e38eeff91ba974 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6e4eb6facf924880a0e38eeff91ba974, State: Running, Role: LEADER
I20260709 12:14:44.227981 25706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "448860827aca47b984ef19865addaeff" candidate_uuid: "f2868245e89644679e2b7dac75591a58" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7ffdf999adba487a9887fe7e2cc0f874"
I20260709 12:14:44.228659 25706 raft_consensus.cc:3060] T 448860827aca47b984ef19865addaeff P 7ffdf999adba487a9887fe7e2cc0f874 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:44.228228 25634 consensus_queue.cc:260] T 448860827aca47b984ef19865addaeff P 6e4eb6facf924880a0e38eeff91ba974 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:44.229807 25634 raft_consensus.cc:3060] T 448860827aca47b984ef19865addaeff P 6e4eb6facf924880a0e38eeff91ba974 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:44.238037 25706 raft_consensus.cc:2468] T 448860827aca47b984ef19865addaeff P 7ffdf999adba487a9887fe7e2cc0f874 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f2868245e89644679e2b7dac75591a58 in term 2.
I20260709 12:14:44.238919 25634 raft_consensus.cc:2468] T 448860827aca47b984ef19865addaeff P 6e4eb6facf924880a0e38eeff91ba974 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f2868245e89644679e2b7dac75591a58 in term 2.
I20260709 12:14:44.239538 25525 leader_election.cc:304] T 448860827aca47b984ef19865addaeff P f2868245e89644679e2b7dac75591a58 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffdf999adba487a9887fe7e2cc0f874, f2868245e89644679e2b7dac75591a58; no voters: 
I20260709 12:14:44.240427 25785 raft_consensus.cc:2804] T 448860827aca47b984ef19865addaeff P f2868245e89644679e2b7dac75591a58 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:44.240940 25785 raft_consensus.cc:697] T 448860827aca47b984ef19865addaeff P f2868245e89644679e2b7dac75591a58 [term 2 LEADER]: Becoming Leader. State: Replica: f2868245e89644679e2b7dac75591a58, State: Running, Role: LEADER
I20260709 12:14:44.241704 25785 consensus_queue.cc:237] T 448860827aca47b984ef19865addaeff P f2868245e89644679e2b7dac75591a58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:44.249816 25455 catalog_manager.cc:5697] T 448860827aca47b984ef19865addaeff P f2868245e89644679e2b7dac75591a58 reported cstate change: term changed from 1 to 2, leader changed from 6e4eb6facf924880a0e38eeff91ba974 (127.12.174.130) to f2868245e89644679e2b7dac75591a58 (127.12.174.129). New cstate: current_term: 2 leader_uuid: "f2868245e89644679e2b7dac75591a58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:44.307677 25754 raft_consensus.cc:993] T 6a3136f9b7e64004b7005f11e9a050f9 P 7ffdf999adba487a9887fe7e2cc0f874: : Instructing follower 6e4eb6facf924880a0e38eeff91ba974 to start an election
I20260709 12:14:44.308218 25789 raft_consensus.cc:1081] T 6a3136f9b7e64004b7005f11e9a050f9 P 7ffdf999adba487a9887fe7e2cc0f874 [term 1 LEADER]: Signalling peer 6e4eb6facf924880a0e38eeff91ba974 to start an election
I20260709 12:14:44.310182 25634 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6a3136f9b7e64004b7005f11e9a050f9"
dest_uuid: "6e4eb6facf924880a0e38eeff91ba974"
 from {username='slave'} at 127.0.0.1:33048
I20260709 12:14:44.310890 25634 raft_consensus.cc:493] T 6a3136f9b7e64004b7005f11e9a050f9 P 6e4eb6facf924880a0e38eeff91ba974 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:44.311302 25634 raft_consensus.cc:3060] T 6a3136f9b7e64004b7005f11e9a050f9 P 6e4eb6facf924880a0e38eeff91ba974 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:44.320612 25634 raft_consensus.cc:515] T 6a3136f9b7e64004b7005f11e9a050f9 P 6e4eb6facf924880a0e38eeff91ba974 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:44.323108 25634 leader_election.cc:290] T 6a3136f9b7e64004b7005f11e9a050f9 P 6e4eb6facf924880a0e38eeff91ba974 [CANDIDATE]: Term 2 election: Requested vote from peers f2868245e89644679e2b7dac75591a58 (127.12.174.129:40387), 7ffdf999adba487a9887fe7e2cc0f874 (127.12.174.131:36809)
I20260709 12:14:44.324064 25557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3136f9b7e64004b7005f11e9a050f9" candidate_uuid: "6e4eb6facf924880a0e38eeff91ba974" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f2868245e89644679e2b7dac75591a58"
I20260709 12:14:44.324590 25706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3136f9b7e64004b7005f11e9a050f9" candidate_uuid: "6e4eb6facf924880a0e38eeff91ba974" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7ffdf999adba487a9887fe7e2cc0f874"
I20260709 12:14:44.324874 25557 raft_consensus.cc:3060] T 6a3136f9b7e64004b7005f11e9a050f9 P f2868245e89644679e2b7dac75591a58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:44.325399 25706 raft_consensus.cc:3055] T 6a3136f9b7e64004b7005f11e9a050f9 P 7ffdf999adba487a9887fe7e2cc0f874 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:44.325807 25706 raft_consensus.cc:740] T 6a3136f9b7e64004b7005f11e9a050f9 P 7ffdf999adba487a9887fe7e2cc0f874 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7ffdf999adba487a9887fe7e2cc0f874, State: Running, Role: LEADER
I20260709 12:14:44.326768 25706 consensus_queue.cc:260] T 6a3136f9b7e64004b7005f11e9a050f9 P 7ffdf999adba487a9887fe7e2cc0f874 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:44.328384 25706 raft_consensus.cc:3060] T 6a3136f9b7e64004b7005f11e9a050f9 P 7ffdf999adba487a9887fe7e2cc0f874 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:44.332190 25557 raft_consensus.cc:2468] T 6a3136f9b7e64004b7005f11e9a050f9 P f2868245e89644679e2b7dac75591a58 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e4eb6facf924880a0e38eeff91ba974 in term 2.
I20260709 12:14:44.333600 25597 leader_election.cc:304] T 6a3136f9b7e64004b7005f11e9a050f9 P 6e4eb6facf924880a0e38eeff91ba974 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e4eb6facf924880a0e38eeff91ba974, f2868245e89644679e2b7dac75591a58; no voters: 
I20260709 12:14:44.334432 25846 raft_consensus.cc:2804] T 6a3136f9b7e64004b7005f11e9a050f9 P 6e4eb6facf924880a0e38eeff91ba974 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:44.334864 25846 raft_consensus.cc:697] T 6a3136f9b7e64004b7005f11e9a050f9 P 6e4eb6facf924880a0e38eeff91ba974 [term 2 LEADER]: Becoming Leader. State: Replica: 6e4eb6facf924880a0e38eeff91ba974, State: Running, Role: LEADER
I20260709 12:14:44.335749 25846 consensus_queue.cc:237] T 6a3136f9b7e64004b7005f11e9a050f9 P 6e4eb6facf924880a0e38eeff91ba974 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:44.338320 25706 raft_consensus.cc:2468] T 6a3136f9b7e64004b7005f11e9a050f9 P 7ffdf999adba487a9887fe7e2cc0f874 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e4eb6facf924880a0e38eeff91ba974 in term 2.
I20260709 12:14:44.345185 25455 catalog_manager.cc:5697] T 6a3136f9b7e64004b7005f11e9a050f9 P 6e4eb6facf924880a0e38eeff91ba974 reported cstate change: term changed from 1 to 2, leader changed from 7ffdf999adba487a9887fe7e2cc0f874 (127.12.174.131) to 6e4eb6facf924880a0e38eeff91ba974 (127.12.174.130). New cstate: current_term: 2 leader_uuid: "6e4eb6facf924880a0e38eeff91ba974" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:44.471108 25706 raft_consensus.cc:1275] T 5fa898e4a0cf49c79c9803b61ac3e756 P 7ffdf999adba487a9887fe7e2cc0f874 [term 2 FOLLOWER]: Refusing update from remote peer 6e4eb6facf924880a0e38eeff91ba974: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:44.472548 25846 consensus_queue.cc:1048] T 5fa898e4a0cf49c79c9803b61ac3e756 P 6e4eb6facf924880a0e38eeff91ba974 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:44.482677 25557 raft_consensus.cc:1275] T 5fa898e4a0cf49c79c9803b61ac3e756 P f2868245e89644679e2b7dac75591a58 [term 2 FOLLOWER]: Refusing update from remote peer 6e4eb6facf924880a0e38eeff91ba974: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:44.484572 25846 consensus_queue.cc:1048] T 5fa898e4a0cf49c79c9803b61ac3e756 P 6e4eb6facf924880a0e38eeff91ba974 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:44.527506 25785 raft_consensus.cc:993] T 12dd6a165033473e9c39fd87d4763add P f2868245e89644679e2b7dac75591a58: : Instructing follower 6e4eb6facf924880a0e38eeff91ba974 to start an election
I20260709 12:14:44.528045 25843 raft_consensus.cc:1081] T 12dd6a165033473e9c39fd87d4763add P f2868245e89644679e2b7dac75591a58 [term 1 LEADER]: Signalling peer 6e4eb6facf924880a0e38eeff91ba974 to start an election
I20260709 12:14:44.530054 25634 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "12dd6a165033473e9c39fd87d4763add"
dest_uuid: "6e4eb6facf924880a0e38eeff91ba974"
 from {username='slave'} at 127.0.0.1:33044
I20260709 12:14:44.530619 25634 raft_consensus.cc:493] T 12dd6a165033473e9c39fd87d4763add P 6e4eb6facf924880a0e38eeff91ba974 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:44.530948 25634 raft_consensus.cc:3060] T 12dd6a165033473e9c39fd87d4763add P 6e4eb6facf924880a0e38eeff91ba974 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:44.537461 25634 raft_consensus.cc:515] T 12dd6a165033473e9c39fd87d4763add P 6e4eb6facf924880a0e38eeff91ba974 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:44.539362 25634 leader_election.cc:290] T 12dd6a165033473e9c39fd87d4763add P 6e4eb6facf924880a0e38eeff91ba974 [CANDIDATE]: Term 2 election: Requested vote from peers f2868245e89644679e2b7dac75591a58 (127.12.174.129:40387), 7ffdf999adba487a9887fe7e2cc0f874 (127.12.174.131:36809)
I20260709 12:14:44.540498 25557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12dd6a165033473e9c39fd87d4763add" candidate_uuid: "6e4eb6facf924880a0e38eeff91ba974" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f2868245e89644679e2b7dac75591a58"
I20260709 12:14:44.540561 25706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12dd6a165033473e9c39fd87d4763add" candidate_uuid: "6e4eb6facf924880a0e38eeff91ba974" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7ffdf999adba487a9887fe7e2cc0f874"
I20260709 12:14:44.541478 25557 raft_consensus.cc:3055] T 12dd6a165033473e9c39fd87d4763add P f2868245e89644679e2b7dac75591a58 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:44.541538 25706 raft_consensus.cc:3060] T 12dd6a165033473e9c39fd87d4763add P 7ffdf999adba487a9887fe7e2cc0f874 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:44.541988 25557 raft_consensus.cc:740] T 12dd6a165033473e9c39fd87d4763add P f2868245e89644679e2b7dac75591a58 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f2868245e89644679e2b7dac75591a58, State: Running, Role: LEADER
I20260709 12:14:44.543097 25557 consensus_queue.cc:260] T 12dd6a165033473e9c39fd87d4763add P f2868245e89644679e2b7dac75591a58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:44.544565 25557 raft_consensus.cc:3060] T 12dd6a165033473e9c39fd87d4763add P f2868245e89644679e2b7dac75591a58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:44.548380 25706 raft_consensus.cc:2468] T 12dd6a165033473e9c39fd87d4763add P 7ffdf999adba487a9887fe7e2cc0f874 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e4eb6facf924880a0e38eeff91ba974 in term 2.
I20260709 12:14:44.549639 25600 leader_election.cc:304] T 12dd6a165033473e9c39fd87d4763add P 6e4eb6facf924880a0e38eeff91ba974 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e4eb6facf924880a0e38eeff91ba974, 7ffdf999adba487a9887fe7e2cc0f874; no voters: 
I20260709 12:14:44.550436 25846 raft_consensus.cc:2804] T 12dd6a165033473e9c39fd87d4763add P 6e4eb6facf924880a0e38eeff91ba974 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:44.550873 25846 raft_consensus.cc:697] T 12dd6a165033473e9c39fd87d4763add P 6e4eb6facf924880a0e38eeff91ba974 [term 2 LEADER]: Becoming Leader. State: Replica: 6e4eb6facf924880a0e38eeff91ba974, State: Running, Role: LEADER
I20260709 12:14:44.551668 25846 consensus_queue.cc:237] T 12dd6a165033473e9c39fd87d4763add P 6e4eb6facf924880a0e38eeff91ba974 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:44.554198 25557 raft_consensus.cc:2468] T 12dd6a165033473e9c39fd87d4763add P f2868245e89644679e2b7dac75591a58 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e4eb6facf924880a0e38eeff91ba974 in term 2.
I20260709 12:14:44.559988 25456 catalog_manager.cc:5697] T 12dd6a165033473e9c39fd87d4763add P 6e4eb6facf924880a0e38eeff91ba974 reported cstate change: term changed from 1 to 2, leader changed from f2868245e89644679e2b7dac75591a58 (127.12.174.129) to 6e4eb6facf924880a0e38eeff91ba974 (127.12.174.130). New cstate: current_term: 2 leader_uuid: "6e4eb6facf924880a0e38eeff91ba974" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:44.610037 25634 raft_consensus.cc:1275] T f9d5a17200ac45a7b5a2130ba1fd816b P 6e4eb6facf924880a0e38eeff91ba974 [term 3 FOLLOWER]: Refusing update from remote peer f2868245e89644679e2b7dac75591a58: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:14:44.611740 25843 consensus_queue.cc:1048] T f9d5a17200ac45a7b5a2130ba1fd816b P f2868245e89644679e2b7dac75591a58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:44.631381 25706 raft_consensus.cc:1275] T f9d5a17200ac45a7b5a2130ba1fd816b P 7ffdf999adba487a9887fe7e2cc0f874 [term 3 FOLLOWER]: Refusing update from remote peer f2868245e89644679e2b7dac75591a58: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:14:44.631724 25708 raft_consensus.cc:1275] T 1513bb8a7eb64808b506fd1c49256752 P 7ffdf999adba487a9887fe7e2cc0f874 [term 2 FOLLOWER]: Refusing update from remote peer 6e4eb6facf924880a0e38eeff91ba974: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:44.633713 25846 consensus_queue.cc:1048] T 1513bb8a7eb64808b506fd1c49256752 P 6e4eb6facf924880a0e38eeff91ba974 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:14:44.637919 25860 consensus_queue.cc:1048] T f9d5a17200ac45a7b5a2130ba1fd816b P f2868245e89644679e2b7dac75591a58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:14:44.646389 25707 raft_consensus.cc:1275] T 448860827aca47b984ef19865addaeff P 7ffdf999adba487a9887fe7e2cc0f874 [term 2 FOLLOWER]: Refusing update from remote peer f2868245e89644679e2b7dac75591a58: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:44.649336 25785 consensus_queue.cc:1048] T 448860827aca47b984ef19865addaeff P f2868245e89644679e2b7dac75591a58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:14:44.659487 25557 raft_consensus.cc:1275] T 1513bb8a7eb64808b506fd1c49256752 P f2868245e89644679e2b7dac75591a58 [term 2 FOLLOWER]: Refusing update from remote peer 6e4eb6facf924880a0e38eeff91ba974: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:44.661491 25840 consensus_queue.cc:1048] T 1513bb8a7eb64808b506fd1c49256752 P 6e4eb6facf924880a0e38eeff91ba974 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:14:44.677397 25634 raft_consensus.cc:1275] T 448860827aca47b984ef19865addaeff P 6e4eb6facf924880a0e38eeff91ba974 [term 2 FOLLOWER]: Refusing update from remote peer f2868245e89644679e2b7dac75591a58: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:44.679761 25860 consensus_queue.cc:1048] T 448860827aca47b984ef19865addaeff P f2868245e89644679e2b7dac75591a58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:44.791268 25708 raft_consensus.cc:1275] T 6a3136f9b7e64004b7005f11e9a050f9 P 7ffdf999adba487a9887fe7e2cc0f874 [term 2 FOLLOWER]: Refusing update from remote peer 6e4eb6facf924880a0e38eeff91ba974: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:44.792680 25840 consensus_queue.cc:1048] T 6a3136f9b7e64004b7005f11e9a050f9 P 6e4eb6facf924880a0e38eeff91ba974 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:44.805024 25557 raft_consensus.cc:1275] T 6a3136f9b7e64004b7005f11e9a050f9 P f2868245e89644679e2b7dac75591a58 [term 2 FOLLOWER]: Refusing update from remote peer 6e4eb6facf924880a0e38eeff91ba974: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:44.806748 25857 consensus_queue.cc:1048] T 6a3136f9b7e64004b7005f11e9a050f9 P 6e4eb6facf924880a0e38eeff91ba974 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:45.048923 25557 raft_consensus.cc:1275] T 12dd6a165033473e9c39fd87d4763add P f2868245e89644679e2b7dac75591a58 [term 2 FOLLOWER]: Refusing update from remote peer 6e4eb6facf924880a0e38eeff91ba974: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:45.050622 25857 consensus_queue.cc:1048] T 12dd6a165033473e9c39fd87d4763add P 6e4eb6facf924880a0e38eeff91ba974 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:45.061110 25708 raft_consensus.cc:1275] T 12dd6a165033473e9c39fd87d4763add P 7ffdf999adba487a9887fe7e2cc0f874 [term 2 FOLLOWER]: Refusing update from remote peer 6e4eb6facf924880a0e38eeff91ba974: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:45.062871 25846 consensus_queue.cc:1048] T 12dd6a165033473e9c39fd87d4763add P 6e4eb6facf924880a0e38eeff91ba974 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:47.063118 25456 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48258:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:14:47.065447 25456 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:14:47.127570 25541 tablet_service.cc:1511] Processing CreateTablet for tablet 7abbe96052d8434cb1e2afd960768847 (DEFAULT_TABLE table=soft_deleted_table [id=30d1a5ef5f7247308db6c9b5a7db7ffa]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:14:47.128974 25541 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7abbe96052d8434cb1e2afd960768847. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:47.130844 25690 tablet_service.cc:1511] Processing CreateTablet for tablet 7abbe96052d8434cb1e2afd960768847 (DEFAULT_TABLE table=soft_deleted_table [id=30d1a5ef5f7247308db6c9b5a7db7ffa]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:14:47.132237 25690 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7abbe96052d8434cb1e2afd960768847. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:47.134847 25691 tablet_service.cc:1511] Processing CreateTablet for tablet fb492c949c97458a940dfcbd02a034cf (DEFAULT_TABLE table=soft_deleted_table [id=30d1a5ef5f7247308db6c9b5a7db7ffa]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:14:47.136274 25691 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb492c949c97458a940dfcbd02a034cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:47.137728 25697 tablet_service.cc:1511] Processing CreateTablet for tablet 927ba57ba7864989a49c8265b14a9c0a (DEFAULT_TABLE table=soft_deleted_table [id=30d1a5ef5f7247308db6c9b5a7db7ffa]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:14:47.139165 25697 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 927ba57ba7864989a49c8265b14a9c0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:47.140218 25542 tablet_service.cc:1511] Processing CreateTablet for tablet fb492c949c97458a940dfcbd02a034cf (DEFAULT_TABLE table=soft_deleted_table [id=30d1a5ef5f7247308db6c9b5a7db7ffa]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:14:47.141034 25624 tablet_service.cc:1511] Processing CreateTablet for tablet 7abbe96052d8434cb1e2afd960768847 (DEFAULT_TABLE table=soft_deleted_table [id=30d1a5ef5f7247308db6c9b5a7db7ffa]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:14:47.141616 25542 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb492c949c97458a940dfcbd02a034cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:47.141414 25622 tablet_service.cc:1511] Processing CreateTablet for tablet fb492c949c97458a940dfcbd02a034cf (DEFAULT_TABLE table=soft_deleted_table [id=30d1a5ef5f7247308db6c9b5a7db7ffa]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:14:47.142391 25624 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7abbe96052d8434cb1e2afd960768847. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:47.143123 25622 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb492c949c97458a940dfcbd02a034cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:47.144436 25546 tablet_service.cc:1511] Processing CreateTablet for tablet 927ba57ba7864989a49c8265b14a9c0a (DEFAULT_TABLE table=soft_deleted_table [id=30d1a5ef5f7247308db6c9b5a7db7ffa]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:14:47.146808 25623 tablet_service.cc:1511] Processing CreateTablet for tablet 927ba57ba7864989a49c8265b14a9c0a (DEFAULT_TABLE table=soft_deleted_table [id=30d1a5ef5f7247308db6c9b5a7db7ffa]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:14:47.148187 25623 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 927ba57ba7864989a49c8265b14a9c0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:47.154042 25546 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 927ba57ba7864989a49c8265b14a9c0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:47.179262 25543 tablet_service.cc:1511] Processing CreateTablet for tablet 556f2a498099427e9a90c94542674f0f (DEFAULT_TABLE table=soft_deleted_table [id=30d1a5ef5f7247308db6c9b5a7db7ffa]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:14:47.182083 25543 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 556f2a498099427e9a90c94542674f0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:47.186611 25621 tablet_service.cc:1511] Processing CreateTablet for tablet 556f2a498099427e9a90c94542674f0f (DEFAULT_TABLE table=soft_deleted_table [id=30d1a5ef5f7247308db6c9b5a7db7ffa]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:14:47.188124 25621 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 556f2a498099427e9a90c94542674f0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:47.199851 25880 tablet_bootstrap.cc:492] T 7abbe96052d8434cb1e2afd960768847 P f2868245e89644679e2b7dac75591a58: Bootstrap starting.
I20260709 12:14:47.200795 25690 tablet_service.cc:1511] Processing CreateTablet for tablet 556f2a498099427e9a90c94542674f0f (DEFAULT_TABLE table=soft_deleted_table [id=30d1a5ef5f7247308db6c9b5a7db7ffa]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:14:47.202263 25690 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 556f2a498099427e9a90c94542674f0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:47.214392 25541 tablet_service.cc:1511] Processing CreateTablet for tablet 2b233b12bfbc42c18b5b121f4122ba3c (DEFAULT_TABLE table=soft_deleted_table [id=30d1a5ef5f7247308db6c9b5a7db7ffa]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:14:47.200045 25879 tablet_bootstrap.cc:492] T fb492c949c97458a940dfcbd02a034cf P 7ffdf999adba487a9887fe7e2cc0f874: Bootstrap starting.
I20260709 12:14:47.216624 25696 tablet_service.cc:1511] Processing CreateTablet for tablet 2b233b12bfbc42c18b5b121f4122ba3c (DEFAULT_TABLE table=soft_deleted_table [id=30d1a5ef5f7247308db6c9b5a7db7ffa]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:14:47.232750 25696 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b233b12bfbc42c18b5b121f4122ba3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:47.232239 25542 tablet_service.cc:1511] Processing CreateTablet for tablet 73781eedcc0f4dbd9bdd82d8ca269bd3 (DEFAULT_TABLE table=soft_deleted_table [id=30d1a5ef5f7247308db6c9b5a7db7ffa]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:14:47.232576 25618 tablet_service.cc:1511] Processing CreateTablet for tablet 2b233b12bfbc42c18b5b121f4122ba3c (DEFAULT_TABLE table=soft_deleted_table [id=30d1a5ef5f7247308db6c9b5a7db7ffa]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:14:47.239166 25618 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b233b12bfbc42c18b5b121f4122ba3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:47.232251 25541 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b233b12bfbc42c18b5b121f4122ba3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:47.248137 25616 tablet_service.cc:1511] Processing CreateTablet for tablet 73781eedcc0f4dbd9bdd82d8ca269bd3 (DEFAULT_TABLE table=soft_deleted_table [id=30d1a5ef5f7247308db6c9b5a7db7ffa]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:14:47.257828 25616 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73781eedcc0f4dbd9bdd82d8ca269bd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:47.257480 25879 tablet_bootstrap.cc:654] T fb492c949c97458a940dfcbd02a034cf P 7ffdf999adba487a9887fe7e2cc0f874: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:47.266032 25697 tablet_service.cc:1511] Processing CreateTablet for tablet 73781eedcc0f4dbd9bdd82d8ca269bd3 (DEFAULT_TABLE table=soft_deleted_table [id=30d1a5ef5f7247308db6c9b5a7db7ffa]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:14:47.268543 25624 tablet_service.cc:1511] Processing CreateTablet for tablet 5a26b0bedc3c4a8c99946f8e5565d353 (DEFAULT_TABLE table=soft_deleted_table [id=30d1a5ef5f7247308db6c9b5a7db7ffa]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:14:47.273686 25544 tablet_service.cc:1511] Processing CreateTablet for tablet 843ddab732fd4de99b4267d7abfd735e (DEFAULT_TABLE table=soft_deleted_table [id=30d1a5ef5f7247308db6c9b5a7db7ffa]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:14:47.273969 25691 tablet_service.cc:1511] Processing CreateTablet for tablet 5a26b0bedc3c4a8c99946f8e5565d353 (DEFAULT_TABLE table=soft_deleted_table [id=30d1a5ef5f7247308db6c9b5a7db7ffa]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:14:47.271356 25624 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a26b0bedc3c4a8c99946f8e5565d353. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:47.272730 25697 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73781eedcc0f4dbd9bdd82d8ca269bd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:47.276569 25620 tablet_service.cc:1511] Processing CreateTablet for tablet 843ddab732fd4de99b4267d7abfd735e (DEFAULT_TABLE table=soft_deleted_table [id=30d1a5ef5f7247308db6c9b5a7db7ffa]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:14:47.271950 25542 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73781eedcc0f4dbd9bdd82d8ca269bd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:47.282734 25692 tablet_service.cc:1511] Processing CreateTablet for tablet 843ddab732fd4de99b4267d7abfd735e (DEFAULT_TABLE table=soft_deleted_table [id=30d1a5ef5f7247308db6c9b5a7db7ffa]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:14:47.279330 25620 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 843ddab732fd4de99b4267d7abfd735e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:47.283628 25691 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a26b0bedc3c4a8c99946f8e5565d353. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:47.297137 25692 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 843ddab732fd4de99b4267d7abfd735e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:47.298237 25544 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 843ddab732fd4de99b4267d7abfd735e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:47.298803 25619 tablet_service.cc:1511] Processing CreateTablet for tablet d835765d07404362a68c773ddc446da5 (DEFAULT_TABLE table=soft_deleted_table [id=30d1a5ef5f7247308db6c9b5a7db7ffa]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:14:47.300191 25619 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d835765d07404362a68c773ddc446da5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:47.300498 25880 tablet_bootstrap.cc:654] T 7abbe96052d8434cb1e2afd960768847 P f2868245e89644679e2b7dac75591a58: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:47.281421 25881 tablet_bootstrap.cc:492] T fb492c949c97458a940dfcbd02a034cf P 6e4eb6facf924880a0e38eeff91ba974: Bootstrap starting.
I20260709 12:14:47.319701 25881 tablet_bootstrap.cc:654] T fb492c949c97458a940dfcbd02a034cf P 6e4eb6facf924880a0e38eeff91ba974: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:47.321161 25879 tablet_bootstrap.cc:492] T fb492c949c97458a940dfcbd02a034cf P 7ffdf999adba487a9887fe7e2cc0f874: No bootstrap required, opened a new log
I20260709 12:14:47.321830 25879 ts_tablet_manager.cc:1403] T fb492c949c97458a940dfcbd02a034cf P 7ffdf999adba487a9887fe7e2cc0f874: Time spent bootstrapping tablet: real 0.122s	user 0.008s	sys 0.010s
I20260709 12:14:47.331116 25697 tablet_service.cc:1511] Processing CreateTablet for tablet d835765d07404362a68c773ddc446da5 (DEFAULT_TABLE table=soft_deleted_table [id=30d1a5ef5f7247308db6c9b5a7db7ffa]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:14:47.332581 25697 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d835765d07404362a68c773ddc446da5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:47.303850 25543 tablet_service.cc:1511] Processing CreateTablet for tablet 5a26b0bedc3c4a8c99946f8e5565d353 (DEFAULT_TABLE table=soft_deleted_table [id=30d1a5ef5f7247308db6c9b5a7db7ffa]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:14:47.325207 25879 raft_consensus.cc:359] T fb492c949c97458a940dfcbd02a034cf P 7ffdf999adba487a9887fe7e2cc0f874 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:47.347216 25879 raft_consensus.cc:385] T fb492c949c97458a940dfcbd02a034cf P 7ffdf999adba487a9887fe7e2cc0f874 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:47.353040 25879 raft_consensus.cc:740] T fb492c949c97458a940dfcbd02a034cf P 7ffdf999adba487a9887fe7e2cc0f874 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ffdf999adba487a9887fe7e2cc0f874, State: Initialized, Role: FOLLOWER
I20260709 12:14:47.354161 25879 consensus_queue.cc:260] T fb492c949c97458a940dfcbd02a034cf P 7ffdf999adba487a9887fe7e2cc0f874 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:47.356104 25546 tablet_service.cc:1511] Processing CreateTablet for tablet d835765d07404362a68c773ddc446da5 (DEFAULT_TABLE table=soft_deleted_table [id=30d1a5ef5f7247308db6c9b5a7db7ffa]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:14:47.364326 25543 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a26b0bedc3c4a8c99946f8e5565d353. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:47.356777 25879 ts_tablet_manager.cc:1434] T fb492c949c97458a940dfcbd02a034cf P 7ffdf999adba487a9887fe7e2cc0f874: Time spent starting tablet: real 0.035s	user 0.002s	sys 0.004s
I20260709 12:14:47.366940 25879 tablet_bootstrap.cc:492] T 7abbe96052d8434cb1e2afd960768847 P 7ffdf999adba487a9887fe7e2cc0f874: Bootstrap starting.
I20260709 12:14:47.373840 25879 tablet_bootstrap.cc:654] T 7abbe96052d8434cb1e2afd960768847 P 7ffdf999adba487a9887fe7e2cc0f874: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:47.378582 25880 tablet_bootstrap.cc:492] T 7abbe96052d8434cb1e2afd960768847 P f2868245e89644679e2b7dac75591a58: No bootstrap required, opened a new log
I20260709 12:14:47.379215 25880 ts_tablet_manager.cc:1403] T 7abbe96052d8434cb1e2afd960768847 P f2868245e89644679e2b7dac75591a58: Time spent bootstrapping tablet: real 0.180s	user 0.009s	sys 0.009s
I20260709 12:14:47.381356 25546 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d835765d07404362a68c773ddc446da5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:14:47.395233 25880 raft_consensus.cc:359] T 7abbe96052d8434cb1e2afd960768847 P f2868245e89644679e2b7dac75591a58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:47.396185 25880 raft_consensus.cc:385] T 7abbe96052d8434cb1e2afd960768847 P f2868245e89644679e2b7dac75591a58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:47.396473 25880 raft_consensus.cc:740] T 7abbe96052d8434cb1e2afd960768847 P f2868245e89644679e2b7dac75591a58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f2868245e89644679e2b7dac75591a58, State: Initialized, Role: FOLLOWER
I20260709 12:14:47.397254 25880 consensus_queue.cc:260] T 7abbe96052d8434cb1e2afd960768847 P f2868245e89644679e2b7dac75591a58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:47.405329 25880 ts_tablet_manager.cc:1434] T 7abbe96052d8434cb1e2afd960768847 P f2868245e89644679e2b7dac75591a58: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.001s
I20260709 12:14:47.413160 25880 tablet_bootstrap.cc:492] T fb492c949c97458a940dfcbd02a034cf P f2868245e89644679e2b7dac75591a58: Bootstrap starting.
I20260709 12:14:47.430296 25880 tablet_bootstrap.cc:654] T fb492c949c97458a940dfcbd02a034cf P f2868245e89644679e2b7dac75591a58: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:47.437656 25881 tablet_bootstrap.cc:492] T fb492c949c97458a940dfcbd02a034cf P 6e4eb6facf924880a0e38eeff91ba974: No bootstrap required, opened a new log
I20260709 12:14:47.438143 25881 ts_tablet_manager.cc:1403] T fb492c949c97458a940dfcbd02a034cf P 6e4eb6facf924880a0e38eeff91ba974: Time spent bootstrapping tablet: real 0.157s	user 0.018s	sys 0.027s
I20260709 12:14:47.440496 25881 raft_consensus.cc:359] T fb492c949c97458a940dfcbd02a034cf P 6e4eb6facf924880a0e38eeff91ba974 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:47.441018 25881 raft_consensus.cc:385] T fb492c949c97458a940dfcbd02a034cf P 6e4eb6facf924880a0e38eeff91ba974 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:47.441226 25881 raft_consensus.cc:740] T fb492c949c97458a940dfcbd02a034cf P 6e4eb6facf924880a0e38eeff91ba974 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e4eb6facf924880a0e38eeff91ba974, State: Initialized, Role: FOLLOWER
I20260709 12:14:47.441953 25881 consensus_queue.cc:260] T fb492c949c97458a940dfcbd02a034cf P 6e4eb6facf924880a0e38eeff91ba974 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:47.444275 25881 ts_tablet_manager.cc:1434] T fb492c949c97458a940dfcbd02a034cf P 6e4eb6facf924880a0e38eeff91ba974: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:14:47.445933 25881 tablet_bootstrap.cc:492] T 7abbe96052d8434cb1e2afd960768847 P 6e4eb6facf924880a0e38eeff91ba974: Bootstrap starting.
I20260709 12:14:47.464520 25881 tablet_bootstrap.cc:654] T 7abbe96052d8434cb1e2afd960768847 P 6e4eb6facf924880a0e38eeff91ba974: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:47.465780 25879 tablet_bootstrap.cc:492] T 7abbe96052d8434cb1e2afd960768847 P 7ffdf999adba487a9887fe7e2cc0f874: No bootstrap required, opened a new log
I20260709 12:14:47.466457 25879 ts_tablet_manager.cc:1403] T 7abbe96052d8434cb1e2afd960768847 P 7ffdf999adba487a9887fe7e2cc0f874: Time spent bootstrapping tablet: real 0.100s	user 0.014s	sys 0.016s
I20260709 12:14:47.468392 25880 tablet_bootstrap.cc:492] T fb492c949c97458a940dfcbd02a034cf P f2868245e89644679e2b7dac75591a58: No bootstrap required, opened a new log
I20260709 12:14:47.469036 25880 ts_tablet_manager.cc:1403] T fb492c949c97458a940dfcbd02a034cf P f2868245e89644679e2b7dac75591a58: Time spent bootstrapping tablet: real 0.056s	user 0.010s	sys 0.003s
I20260709 12:14:47.472448 25880 raft_consensus.cc:359] T fb492c949c97458a940dfcbd02a034cf P f2868245e89644679e2b7dac75591a58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:47.473344 25880 raft_consensus.cc:385] T fb492c949c97458a940dfcbd02a034cf P f2868245e89644679e2b7dac75591a58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:47.473690 25880 raft_consensus.cc:740] T fb492c949c97458a940dfcbd02a034cf P f2868245e89644679e2b7dac75591a58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f2868245e89644679e2b7dac75591a58, State: Initialized, Role: FOLLOWER
I20260709 12:14:47.474505 25880 consensus_queue.cc:260] T fb492c949c97458a940dfcbd02a034cf P f2868245e89644679e2b7dac75591a58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:47.479655 25880 ts_tablet_manager.cc:1434] T fb492c949c97458a940dfcbd02a034cf P f2868245e89644679e2b7dac75591a58: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:14:47.480907 25880 tablet_bootstrap.cc:492] T 556f2a498099427e9a90c94542674f0f P f2868245e89644679e2b7dac75591a58: Bootstrap starting.
I20260709 12:14:47.482100 25879 raft_consensus.cc:359] T 7abbe96052d8434cb1e2afd960768847 P 7ffdf999adba487a9887fe7e2cc0f874 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:47.486610 25879 raft_consensus.cc:385] T 7abbe96052d8434cb1e2afd960768847 P 7ffdf999adba487a9887fe7e2cc0f874 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:47.486951 25879 raft_consensus.cc:740] T 7abbe96052d8434cb1e2afd960768847 P 7ffdf999adba487a9887fe7e2cc0f874 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ffdf999adba487a9887fe7e2cc0f874, State: Initialized, Role: FOLLOWER
I20260709 12:14:47.492236 25880 tablet_bootstrap.cc:654] T 556f2a498099427e9a90c94542674f0f P f2868245e89644679e2b7dac75591a58: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:47.493207 25879 consensus_queue.cc:260] T 7abbe96052d8434cb1e2afd960768847 P 7ffdf999adba487a9887fe7e2cc0f874 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:47.504776 25880 tablet_bootstrap.cc:492] T 556f2a498099427e9a90c94542674f0f P f2868245e89644679e2b7dac75591a58: No bootstrap required, opened a new log
I20260709 12:14:47.505594 25880 ts_tablet_manager.cc:1403] T 556f2a498099427e9a90c94542674f0f P f2868245e89644679e2b7dac75591a58: Time spent bootstrapping tablet: real 0.025s	user 0.013s	sys 0.007s
I20260709 12:14:47.505908 25879 ts_tablet_manager.cc:1434] T 7abbe96052d8434cb1e2afd960768847 P 7ffdf999adba487a9887fe7e2cc0f874: Time spent starting tablet: real 0.039s	user 0.008s	sys 0.001s
I20260709 12:14:47.509348 25881 tablet_bootstrap.cc:492] T 7abbe96052d8434cb1e2afd960768847 P 6e4eb6facf924880a0e38eeff91ba974: No bootstrap required, opened a new log
I20260709 12:14:47.509061 25880 raft_consensus.cc:359] T 556f2a498099427e9a90c94542674f0f P f2868245e89644679e2b7dac75591a58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:47.509965 25881 ts_tablet_manager.cc:1403] T 7abbe96052d8434cb1e2afd960768847 P 6e4eb6facf924880a0e38eeff91ba974: Time spent bootstrapping tablet: real 0.064s	user 0.018s	sys 0.041s
I20260709 12:14:47.510255 25880 raft_consensus.cc:385] T 556f2a498099427e9a90c94542674f0f P f2868245e89644679e2b7dac75591a58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:47.510663 25880 raft_consensus.cc:740] T 556f2a498099427e9a90c94542674f0f P f2868245e89644679e2b7dac75591a58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f2868245e89644679e2b7dac75591a58, State: Initialized, Role: FOLLOWER
I20260709 12:14:47.511631 25880 consensus_queue.cc:260] T 556f2a498099427e9a90c94542674f0f P f2868245e89644679e2b7dac75591a58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:47.513266 25881 raft_consensus.cc:359] T 7abbe96052d8434cb1e2afd960768847 P 6e4eb6facf924880a0e38eeff91ba974 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:47.514117 25881 raft_consensus.cc:385] T 7abbe96052d8434cb1e2afd960768847 P 6e4eb6facf924880a0e38eeff91ba974 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:47.514422 25881 raft_consensus.cc:740] T 7abbe96052d8434cb1e2afd960768847 P 6e4eb6facf924880a0e38eeff91ba974 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e4eb6facf924880a0e38eeff91ba974, State: Initialized, Role: FOLLOWER
I20260709 12:14:47.515288 25881 consensus_queue.cc:260] T 7abbe96052d8434cb1e2afd960768847 P 6e4eb6facf924880a0e38eeff91ba974 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:47.517705 25881 ts_tablet_manager.cc:1434] T 7abbe96052d8434cb1e2afd960768847 P 6e4eb6facf924880a0e38eeff91ba974: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.001s
I20260709 12:14:47.518934 25879 tablet_bootstrap.cc:492] T 927ba57ba7864989a49c8265b14a9c0a P 7ffdf999adba487a9887fe7e2cc0f874: Bootstrap starting.
I20260709 12:14:47.519464 25880 ts_tablet_manager.cc:1434] T 556f2a498099427e9a90c94542674f0f P f2868245e89644679e2b7dac75591a58: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.001s
I20260709 12:14:47.520654 25880 tablet_bootstrap.cc:492] T 927ba57ba7864989a49c8265b14a9c0a P f2868245e89644679e2b7dac75591a58: Bootstrap starting.
I20260709 12:14:47.525420 25881 tablet_bootstrap.cc:492] T 2b233b12bfbc42c18b5b121f4122ba3c P 6e4eb6facf924880a0e38eeff91ba974: Bootstrap starting.
I20260709 12:14:47.527643 25880 tablet_bootstrap.cc:654] T 927ba57ba7864989a49c8265b14a9c0a P f2868245e89644679e2b7dac75591a58: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:47.527791 25879 tablet_bootstrap.cc:654] T 927ba57ba7864989a49c8265b14a9c0a P 7ffdf999adba487a9887fe7e2cc0f874: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:47.537055 25882 raft_consensus.cc:493] T 7abbe96052d8434cb1e2afd960768847 P f2868245e89644679e2b7dac75591a58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:47.537763 25882 raft_consensus.cc:515] T 7abbe96052d8434cb1e2afd960768847 P f2868245e89644679e2b7dac75591a58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:47.539157 25881 tablet_bootstrap.cc:654] T 2b233b12bfbc42c18b5b121f4122ba3c P 6e4eb6facf924880a0e38eeff91ba974: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:47.540091 25882 leader_election.cc:290] T 7abbe96052d8434cb1e2afd960768847 P f2868245e89644679e2b7dac75591a58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6e4eb6facf924880a0e38eeff91ba974 (127.12.174.130:41805), 7ffdf999adba487a9887fe7e2cc0f874 (127.12.174.131:36809)
I20260709 12:14:47.540072 25879 tablet_bootstrap.cc:492] T 927ba57ba7864989a49c8265b14a9c0a P 7ffdf999adba487a9887fe7e2cc0f874: No bootstrap required, opened a new log
I20260709 12:14:47.541767 25706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abbe96052d8434cb1e2afd960768847" candidate_uuid: "f2868245e89644679e2b7dac75591a58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffdf999adba487a9887fe7e2cc0f874" is_pre_election: true
I20260709 12:14:47.542207 25634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abbe96052d8434cb1e2afd960768847" candidate_uuid: "f2868245e89644679e2b7dac75591a58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e4eb6facf924880a0e38eeff91ba974" is_pre_election: true
I20260709 12:14:47.542484 25706 raft_consensus.cc:2468] T 7abbe96052d8434cb1e2afd960768847 P 7ffdf999adba487a9887fe7e2cc0f874 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f2868245e89644679e2b7dac75591a58 in term 0.
I20260709 12:14:47.542932 25634 raft_consensus.cc:2468] T 7abbe96052d8434cb1e2afd960768847 P 6e4eb6facf924880a0e38eeff91ba974 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f2868245e89644679e2b7dac75591a58 in term 0.
I20260709 12:14:47.544229 25525 leader_election.cc:304] T 7abbe96052d8434cb1e2afd960768847 P f2868245e89644679e2b7dac75591a58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffdf999adba487a9887fe7e2cc0f874, f2868245e89644679e2b7dac75591a58; no voters: 
I20260709 12:14:47.545271 25882 raft_consensus.cc:2804] T 7abbe96052d8434cb1e2afd960768847 P f2868245e89644679e2b7dac75591a58 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:47.545691 25882 raft_consensus.cc:493] T 7abbe96052d8434cb1e2afd960768847 P f2868245e89644679e2b7dac75591a58 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:47.546069 25882 raft_consensus.cc:3060] T 7abbe96052d8434cb1e2afd960768847 P f2868245e89644679e2b7dac75591a58 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:14:47.545377 25505 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:14:47.548051 25789 raft_consensus.cc:493] T fb492c949c97458a940dfcbd02a034cf P 7ffdf999adba487a9887fe7e2cc0f874 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:47.548575 25789 raft_consensus.cc:515] T fb492c949c97458a940dfcbd02a034cf P 7ffdf999adba487a9887fe7e2cc0f874 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:47.541141 25879 ts_tablet_manager.cc:1403] T 927ba57ba7864989a49c8265b14a9c0a P 7ffdf999adba487a9887fe7e2cc0f874: Time spent bootstrapping tablet: real 0.022s	user 0.009s	sys 0.009s
I20260709 12:14:47.550760 25789 leader_election.cc:290] T fb492c949c97458a940dfcbd02a034cf P 7ffdf999adba487a9887fe7e2cc0f874 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f2868245e89644679e2b7dac75591a58 (127.12.174.129:40387), 6e4eb6facf924880a0e38eeff91ba974 (127.12.174.130:41805)
I20260709 12:14:47.552057 25880 tablet_bootstrap.cc:492] T 927ba57ba7864989a49c8265b14a9c0a P f2868245e89644679e2b7dac75591a58: No bootstrap required, opened a new log
I20260709 12:14:47.552381 25558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb492c949c97458a940dfcbd02a034cf" candidate_uuid: "7ffdf999adba487a9887fe7e2cc0f874" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f2868245e89644679e2b7dac75591a58" is_pre_election: true
I20260709 12:14:47.552613 25880 ts_tablet_manager.cc:1403] T 927ba57ba7864989a49c8265b14a9c0a P f2868245e89644679e2b7dac75591a58: Time spent bootstrapping tablet: real 0.032s	user 0.009s	sys 0.008s
I20260709 12:14:47.552704 25634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb492c949c97458a940dfcbd02a034cf" candidate_uuid: "7ffdf999adba487a9887fe7e2cc0f874" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e4eb6facf924880a0e38eeff91ba974" is_pre_election: true
I20260709 12:14:47.553155 25558 raft_consensus.cc:2468] T fb492c949c97458a940dfcbd02a034cf P f2868245e89644679e2b7dac75591a58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffdf999adba487a9887fe7e2cc0f874 in term 0.
I20260709 12:14:47.553519 25634 raft_consensus.cc:2468] T fb492c949c97458a940dfcbd02a034cf P 6e4eb6facf924880a0e38eeff91ba974 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffdf999adba487a9887fe7e2cc0f874 in term 0.
I20260709 12:14:47.554867 25671 leader_election.cc:304] T fb492c949c97458a940dfcbd02a034cf P 7ffdf999adba487a9887fe7e2cc0f874 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e4eb6facf924880a0e38eeff91ba974, 7ffdf999adba487a9887fe7e2cc0f874; no voters: 
I20260709 12:14:47.556360 25789 raft_consensus.cc:2804] T fb492c949c97458a940dfcbd02a034cf P 7ffdf999adba487a9887fe7e2cc0f874 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:47.556941 25789 raft_consensus.cc:493] T fb492c949c97458a940dfcbd02a034cf P 7ffdf999adba487a9887fe7e2cc0f874 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:47.556358 25880 raft_consensus.cc:359] T 927ba57ba7864989a49c8265b14a9c0a P f2868245e89644679e2b7dac75591a58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:47.557420 25789 raft_consensus.cc:3060] T fb492c949c97458a940dfcbd02a034cf P 7ffdf999adba487a9887fe7e2cc0f874 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:47.557591 25880 raft_consensus.cc:385] T 927ba57ba7864989a49c8265b14a9c0a P f2868245e89644679e2b7dac75591a58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:47.558085 25880 raft_consensus.cc:740] T 927ba57ba7864989a49c8265b14a9c0a P f2868245e89644679e2b7dac75591a58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f2868245e89644679e2b7dac75591a58, State: Initialized, Role: FOLLOWER
I20260709 12:14:47.558485 25879 raft_consensus.cc:359] T 927ba57ba7864989a49c8265b14a9c0a P 7ffdf999adba487a9887fe7e2cc0f874 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:47.559280 25879 raft_consensus.cc:385] T 927ba57ba7864989a49c8265b14a9c0a P 7ffdf999adba487a9887fe7e2cc0f874 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:47.558900 25880 consensus_queue.cc:260] T 927ba57ba7864989a49c8265b14a9c0a P f2868245e89644679e2b7dac75591a58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:47.559650 25879 raft_consensus.cc:740] T 927ba57ba7864989a49c8265b14a9c0a P 7ffdf999adba487a9887fe7e2cc0f874 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ffdf999adba487a9887fe7e2cc0f874, State: Initialized, Role: FOLLOWER
I20260709 12:14:47.564046 25879 consensus_queue.cc:260] T 927ba57ba7864989a49c8265b14a9c0a P 7ffdf999adba487a9887fe7e2cc0f874 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:47.564633 25880 ts_tablet_manager.cc:1434] T 927ba57ba7864989a49c8265b14a9c0a P f2868245e89644679e2b7dac75591a58: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:14:47.565810 25880 tablet_bootstrap.cc:492] T 73781eedcc0f4dbd9bdd82d8ca269bd3 P f2868245e89644679e2b7dac75591a58: Bootstrap starting.
I20260709 12:14:47.567263 25882 raft_consensus.cc:515] T 7abbe96052d8434cb1e2afd960768847 P f2868245e89644679e2b7dac75591a58 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:47.570524 25634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abbe96052d8434cb1e2afd960768847" candidate_uuid: "f2868245e89644679e2b7dac75591a58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e4eb6facf924880a0e38eeff91ba974"
I20260709 12:14:47.571134 25634 raft_consensus.cc:3060] T 7abbe96052d8434cb1e2afd960768847 P 6e4eb6facf924880a0e38eeff91ba974 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:47.571162 25881 tablet_bootstrap.cc:492] T 2b233b12bfbc42c18b5b121f4122ba3c P 6e4eb6facf924880a0e38eeff91ba974: No bootstrap required, opened a new log
I20260709 12:14:47.571986 25881 ts_tablet_manager.cc:1403] T 2b233b12bfbc42c18b5b121f4122ba3c P 6e4eb6facf924880a0e38eeff91ba974: Time spent bootstrapping tablet: real 0.047s	user 0.014s	sys 0.005s
I20260709 12:14:47.567606 25789 raft_consensus.cc:515] T fb492c949c97458a940dfcbd02a034cf P 7ffdf999adba487a9887fe7e2cc0f874 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:47.575672 25880 tablet_bootstrap.cc:654] T 73781eedcc0f4dbd9bdd82d8ca269bd3 P f2868245e89644679e2b7dac75591a58: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:47.576886 25881 raft_consensus.cc:359] T 2b233b12bfbc42c18b5b121f4122ba3c P 6e4eb6facf924880a0e38eeff91ba974 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:47.581934 25881 raft_consensus.cc:385] T 2b233b12bfbc42c18b5b121f4122ba3c P 6e4eb6facf924880a0e38eeff91ba974 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:47.582443 25881 raft_consensus.cc:740] T 2b233b12bfbc42c18b5b121f4122ba3c P 6e4eb6facf924880a0e38eeff91ba974 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e4eb6facf924880a0e38eeff91ba974, State: Initialized, Role: FOLLOWER
I20260709 12:14:47.580092 25558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb492c949c97458a940dfcbd02a034cf" candidate_uuid: "7ffdf999adba487a9887fe7e2cc0f874" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f2868245e89644679e2b7dac75591a58"
I20260709 12:14:47.583469 25558 raft_consensus.cc:3060] T fb492c949c97458a940dfcbd02a034cf P f2868245e89644679e2b7dac75591a58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:47.583345 25881 consensus_queue.cc:260] T 2b233b12bfbc42c18b5b121f4122ba3c P 6e4eb6facf924880a0e38eeff91ba974 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:47.584039 25634 raft_consensus.cc:2468] T 7abbe96052d8434cb1e2afd960768847 P 6e4eb6facf924880a0e38eeff91ba974 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f2868245e89644679e2b7dac75591a58 in term 1.
I20260709 12:14:47.580884 25632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb492c949c97458a940dfcbd02a034cf" candidate_uuid: "7ffdf999adba487a9887fe7e2cc0f874" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e4eb6facf924880a0e38eeff91ba974"
I20260709 12:14:47.585539 25522 leader_election.cc:304] T 7abbe96052d8434cb1e2afd960768847 P f2868245e89644679e2b7dac75591a58 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e4eb6facf924880a0e38eeff91ba974, f2868245e89644679e2b7dac75591a58; no voters: 
I20260709 12:14:47.586098 25632 raft_consensus.cc:3060] T fb492c949c97458a940dfcbd02a034cf P 6e4eb6facf924880a0e38eeff91ba974 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:47.586621 25881 ts_tablet_manager.cc:1434] T 2b233b12bfbc42c18b5b121f4122ba3c P 6e4eb6facf924880a0e38eeff91ba974: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 12:14:47.586556 25860 raft_consensus.cc:2804] T 7abbe96052d8434cb1e2afd960768847 P f2868245e89644679e2b7dac75591a58 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:47.588244 25881 tablet_bootstrap.cc:492] T 556f2a498099427e9a90c94542674f0f P 6e4eb6facf924880a0e38eeff91ba974: Bootstrap starting.
I20260709 12:14:47.581439 25789 leader_election.cc:290] T fb492c949c97458a940dfcbd02a034cf P 7ffdf999adba487a9887fe7e2cc0f874 [CANDIDATE]: Term 1 election: Requested vote from peers f2868245e89644679e2b7dac75591a58 (127.12.174.129:40387), 6e4eb6facf924880a0e38eeff91ba974 (127.12.174.130:41805)
I20260709 12:14:47.607108 25632 raft_consensus.cc:2468] T fb492c949c97458a940dfcbd02a034cf P 6e4eb6facf924880a0e38eeff91ba974 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffdf999adba487a9887fe7e2cc0f874 in term 1.
I20260709 12:14:47.608721 25880 tablet_bootstrap.cc:492] T 73781eedcc0f4dbd9bdd82d8ca269bd3 P f2868245e89644679e2b7dac75591a58: No bootstrap required, opened a new log
I20260709 12:14:47.609331 25880 ts_tablet_manager.cc:1403] T 73781eedcc0f4dbd9bdd82d8ca269bd3 P f2868245e89644679e2b7dac75591a58: Time spent bootstrapping tablet: real 0.044s	user 0.019s	sys 0.015s
I20260709 12:14:47.612169 25881 tablet_bootstrap.cc:654] T 556f2a498099427e9a90c94542674f0f P 6e4eb6facf924880a0e38eeff91ba974: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:47.620602 25896 raft_consensus.cc:493] T 2b233b12bfbc42c18b5b121f4122ba3c P 6e4eb6facf924880a0e38eeff91ba974 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:47.612653 25880 raft_consensus.cc:359] T 73781eedcc0f4dbd9bdd82d8ca269bd3 P f2868245e89644679e2b7dac75591a58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:47.613197 25860 raft_consensus.cc:697] T 7abbe96052d8434cb1e2afd960768847 P f2868245e89644679e2b7dac75591a58 [term 1 LEADER]: Becoming Leader. State: Replica: f2868245e89644679e2b7dac75591a58, State: Running, Role: LEADER
I20260709 12:14:47.613814 25558 raft_consensus.cc:2468] T fb492c949c97458a940dfcbd02a034cf P f2868245e89644679e2b7dac75591a58 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffdf999adba487a9887fe7e2cc0f874 in term 1.
I20260709 12:14:47.622112 25880 raft_consensus.cc:385] T 73781eedcc0f4dbd9bdd82d8ca269bd3 P f2868245e89644679e2b7dac75591a58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:47.622485 25880 raft_consensus.cc:740] T 73781eedcc0f4dbd9bdd82d8ca269bd3 P f2868245e89644679e2b7dac75591a58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f2868245e89644679e2b7dac75591a58, State: Initialized, Role: FOLLOWER
I20260709 12:14:47.622741 25860 consensus_queue.cc:237] T 7abbe96052d8434cb1e2afd960768847 P f2868245e89644679e2b7dac75591a58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:47.623296 25880 consensus_queue.cc:260] T 73781eedcc0f4dbd9bdd82d8ca269bd3 P f2868245e89644679e2b7dac75591a58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:47.614753 25879 ts_tablet_manager.cc:1434] T 927ba57ba7864989a49c8265b14a9c0a P 7ffdf999adba487a9887fe7e2cc0f874: Time spent starting tablet: real 0.065s	user 0.007s	sys 0.001s
I20260709 12:14:47.616950 25671 leader_election.cc:304] T fb492c949c97458a940dfcbd02a034cf P 7ffdf999adba487a9887fe7e2cc0f874 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e4eb6facf924880a0e38eeff91ba974, 7ffdf999adba487a9887fe7e2cc0f874; no voters: 
I20260709 12:14:47.617924 25706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7abbe96052d8434cb1e2afd960768847" candidate_uuid: "f2868245e89644679e2b7dac75591a58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffdf999adba487a9887fe7e2cc0f874"
I20260709 12:14:47.630609 25706 raft_consensus.cc:3060] T 7abbe96052d8434cb1e2afd960768847 P 7ffdf999adba487a9887fe7e2cc0f874 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:47.630740 25789 raft_consensus.cc:2804] T fb492c949c97458a940dfcbd02a034cf P 7ffdf999adba487a9887fe7e2cc0f874 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:47.631117 25879 tablet_bootstrap.cc:492] T 556f2a498099427e9a90c94542674f0f P 7ffdf999adba487a9887fe7e2cc0f874: Bootstrap starting.
I20260709 12:14:47.631299 25789 raft_consensus.cc:697] T fb492c949c97458a940dfcbd02a034cf P 7ffdf999adba487a9887fe7e2cc0f874 [term 1 LEADER]: Becoming Leader. State: Replica: 7ffdf999adba487a9887fe7e2cc0f874, State: Running, Role: LEADER
I20260709 12:14:47.632205 25789 consensus_queue.cc:237] T fb492c949c97458a940dfcbd02a034cf P 7ffdf999adba487a9887fe7e2cc0f874 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:47.618069 25882 leader_election.cc:290] T 7abbe96052d8434cb1e2afd960768847 P f2868245e89644679e2b7dac75591a58 [CANDIDATE]: Term 1 election: Requested vote from peers 6e4eb6facf924880a0e38eeff91ba974 (127.12.174.130:41805), 7ffdf999adba487a9887fe7e2cc0f874 (127.12.174.131:36809)
I20260709 12:14:47.639460 25706 raft_consensus.cc:2468] T 7abbe96052d8434cb1e2afd960768847 P 7ffdf999adba487a9887fe7e2cc0f874 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f2868245e89644679e2b7dac75591a58 in term 1.
I20260709 12:14:47.621263 25896 raft_consensus.cc:515] T 2b233b12bfbc42c18b5b121f4122ba3c P 6e4eb6facf924880a0e38eeff91ba974 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:47.644517 25880 ts_tablet_manager.cc:1434] T 73781eedcc0f4dbd9bdd82d8ca269bd3 P f2868245e89644679e2b7dac75591a58: Time spent starting tablet: real 0.035s	user 0.004s	sys 0.012s
I20260709 12:14:47.645864 25880 tablet_bootstrap.cc:492] T 843ddab732fd4de99b4267d7abfd735e P f2868245e89644679e2b7dac75591a58: Bootstrap starting.
I20260709 12:14:47.646020 25558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b233b12bfbc42c18b5b121f4122ba3c" candidate_uuid: "6e4eb6facf924880a0e38eeff91ba974" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f2868245e89644679e2b7dac75591a58" is_pre_election: true
W20260709 12:14:47.647814 25597 leader_election.cc:343] T 2b233b12bfbc42c18b5b121f4122ba3c P 6e4eb6facf924880a0e38eeff91ba974 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f2868245e89644679e2b7dac75591a58 (127.12.174.129:40387): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:47.649520 25879 tablet_bootstrap.cc:654] T 556f2a498099427e9a90c94542674f0f P 7ffdf999adba487a9887fe7e2cc0f874: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:47.652586 25455 catalog_manager.cc:5697] T 7abbe96052d8434cb1e2afd960768847 P f2868245e89644679e2b7dac75591a58 reported cstate change: term changed from 0 to 1, leader changed from <none> to f2868245e89644679e2b7dac75591a58 (127.12.174.129). New cstate: current_term: 1 leader_uuid: "f2868245e89644679e2b7dac75591a58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:47.655052 25881 tablet_bootstrap.cc:492] T 556f2a498099427e9a90c94542674f0f P 6e4eb6facf924880a0e38eeff91ba974: No bootstrap required, opened a new log
I20260709 12:14:47.655684 25881 ts_tablet_manager.cc:1403] T 556f2a498099427e9a90c94542674f0f P 6e4eb6facf924880a0e38eeff91ba974: Time spent bootstrapping tablet: real 0.068s	user 0.010s	sys 0.004s
I20260709 12:14:47.658352 25880 tablet_bootstrap.cc:654] T 843ddab732fd4de99b4267d7abfd735e P f2868245e89644679e2b7dac75591a58: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:47.659421 25881 raft_consensus.cc:359] T 556f2a498099427e9a90c94542674f0f P 6e4eb6facf924880a0e38eeff91ba974 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:47.660255 25881 raft_consensus.cc:385] T 556f2a498099427e9a90c94542674f0f P 6e4eb6facf924880a0e38eeff91ba974 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:47.660559 25881 raft_consensus.cc:740] T 556f2a498099427e9a90c94542674f0f P 6e4eb6facf924880a0e38eeff91ba974 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e4eb6facf924880a0e38eeff91ba974, State: Initialized, Role: FOLLOWER
I20260709 12:14:47.661405 25881 consensus_queue.cc:260] T 556f2a498099427e9a90c94542674f0f P 6e4eb6facf924880a0e38eeff91ba974 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:47.662716 25896 leader_election.cc:290] T 2b233b12bfbc42c18b5b121f4122ba3c P 6e4eb6facf924880a0e38eeff91ba974 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f2868245e89644679e2b7dac75591a58 (127.12.174.129:40387), 7ffdf999adba487a9887fe7e2cc0f874 (127.12.174.131:36809)
I20260709 12:14:47.664709 25879 tablet_bootstrap.cc:492] T 556f2a498099427e9a90c94542674f0f P 7ffdf999adba487a9887fe7e2cc0f874: No bootstrap required, opened a new log
I20260709 12:14:47.665285 25879 ts_tablet_manager.cc:1403] T 556f2a498099427e9a90c94542674f0f P 7ffdf999adba487a9887fe7e2cc0f874: Time spent bootstrapping tablet: real 0.034s	user 0.015s	sys 0.005s
I20260709 12:14:47.669142 25706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b233b12bfbc42c18b5b121f4122ba3c" candidate_uuid: "6e4eb6facf924880a0e38eeff91ba974" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffdf999adba487a9887fe7e2cc0f874" is_pre_election: true
W20260709 12:14:47.671638 25600 leader_election.cc:343] T 2b233b12bfbc42c18b5b121f4122ba3c P 6e4eb6facf924880a0e38eeff91ba974 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ffdf999adba487a9887fe7e2cc0f874 (127.12.174.131:36809): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:47.672253 25600 leader_election.cc:304] T 2b233b12bfbc42c18b5b121f4122ba3c P 6e4eb6facf924880a0e38eeff91ba974 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e4eb6facf924880a0e38eeff91ba974; no voters: 7ffdf999adba487a9887fe7e2cc0f874, f2868245e89644679e2b7dac75591a58
I20260709 12:14:47.673009 25880 tablet_bootstrap.cc:492] T 843ddab732fd4de99b4267d7abfd735e P f2868245e89644679e2b7dac75591a58: No bootstrap required, opened a new log
I20260709 12:14:47.673794 25880 ts_tablet_manager.cc:1403] T 843ddab732fd4de99b4267d7abfd735e P f2868245e89644679e2b7dac75591a58: Time spent bootstrapping tablet: real 0.028s	user 0.007s	sys 0.006s
I20260709 12:14:47.676801 25896 raft_consensus.cc:2749] T 2b233b12bfbc42c18b5b121f4122ba3c P 6e4eb6facf924880a0e38eeff91ba974 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:47.669044 25879 raft_consensus.cc:359] T 556f2a498099427e9a90c94542674f0f P 7ffdf999adba487a9887fe7e2cc0f874 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:47.678027 25879 raft_consensus.cc:385] T 556f2a498099427e9a90c94542674f0f P 7ffdf999adba487a9887fe7e2cc0f874 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:47.678339 25879 raft_consensus.cc:740] T 556f2a498099427e9a90c94542674f0f P 7ffdf999adba487a9887fe7e2cc0f874 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ffdf999adba487a9887fe7e2cc0f874, State: Initialized, Role: FOLLOWER
I20260709 12:14:47.679129 25879 consensus_queue.cc:260] T 556f2a498099427e9a90c94542674f0f P 7ffdf999adba487a9887fe7e2cc0f874 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:47.680927 25879 ts_tablet_manager.cc:1434] T 556f2a498099427e9a90c94542674f0f P 7ffdf999adba487a9887fe7e2cc0f874: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 12:14:47.681173 25881 ts_tablet_manager.cc:1434] T 556f2a498099427e9a90c94542674f0f P 6e4eb6facf924880a0e38eeff91ba974: Time spent starting tablet: real 0.025s	user 0.010s	sys 0.000s
I20260709 12:14:47.682102 25879 tablet_bootstrap.cc:492] T 73781eedcc0f4dbd9bdd82d8ca269bd3 P 7ffdf999adba487a9887fe7e2cc0f874: Bootstrap starting.
I20260709 12:14:47.682380 25881 tablet_bootstrap.cc:492] T 927ba57ba7864989a49c8265b14a9c0a P 6e4eb6facf924880a0e38eeff91ba974: Bootstrap starting.
I20260709 12:14:47.677045 25880 raft_consensus.cc:359] T 843ddab732fd4de99b4267d7abfd735e P f2868245e89644679e2b7dac75591a58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:47.689966 25880 raft_consensus.cc:385] T 843ddab732fd4de99b4267d7abfd735e P f2868245e89644679e2b7dac75591a58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:47.690335 25880 raft_consensus.cc:740] T 843ddab732fd4de99b4267d7abfd735e P f2868245e89644679e2b7dac75591a58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f2868245e89644679e2b7dac75591a58, State: Initialized, Role: FOLLOWER
I20260709 12:14:47.691169 25880 consensus_queue.cc:260] T 843ddab732fd4de99b4267d7abfd735e P f2868245e89644679e2b7dac75591a58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:47.693779 25880 ts_tablet_manager.cc:1434] T 843ddab732fd4de99b4267d7abfd735e P f2868245e89644679e2b7dac75591a58: Time spent starting tablet: real 0.020s	user 0.002s	sys 0.002s
I20260709 12:14:47.694885 25880 tablet_bootstrap.cc:492] T 2b233b12bfbc42c18b5b121f4122ba3c P f2868245e89644679e2b7dac75591a58: Bootstrap starting.
I20260709 12:14:47.699735 25881 tablet_bootstrap.cc:654] T 927ba57ba7864989a49c8265b14a9c0a P 6e4eb6facf924880a0e38eeff91ba974: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:47.701972 25880 tablet_bootstrap.cc:654] T 2b233b12bfbc42c18b5b121f4122ba3c P f2868245e89644679e2b7dac75591a58: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:47.705260 25879 tablet_bootstrap.cc:654] T 73781eedcc0f4dbd9bdd82d8ca269bd3 P 7ffdf999adba487a9887fe7e2cc0f874: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:47.714201 25456 catalog_manager.cc:5697] T fb492c949c97458a940dfcbd02a034cf P 7ffdf999adba487a9887fe7e2cc0f874 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7ffdf999adba487a9887fe7e2cc0f874 (127.12.174.131). New cstate: current_term: 1 leader_uuid: "7ffdf999adba487a9887fe7e2cc0f874" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:47.716441 25881 tablet_bootstrap.cc:492] T 927ba57ba7864989a49c8265b14a9c0a P 6e4eb6facf924880a0e38eeff91ba974: No bootstrap required, opened a new log
I20260709 12:14:47.717180 25881 ts_tablet_manager.cc:1403] T 927ba57ba7864989a49c8265b14a9c0a P 6e4eb6facf924880a0e38eeff91ba974: Time spent bootstrapping tablet: real 0.035s	user 0.008s	sys 0.003s
I20260709 12:14:47.720811 25881 raft_consensus.cc:359] T 927ba57ba7864989a49c8265b14a9c0a P 6e4eb6facf924880a0e38eeff91ba974 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:47.721638 25881 raft_consensus.cc:385] T 927ba57ba7864989a49c8265b14a9c0a P 6e4eb6facf924880a0e38eeff91ba974 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:47.721992 25881 raft_consensus.cc:740] T 927ba57ba7864989a49c8265b14a9c0a P 6e4eb6facf924880a0e38eeff91ba974 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e4eb6facf924880a0e38eeff91ba974, State: Initialized, Role: FOLLOWER
I20260709 12:14:47.723345 25895 raft_consensus.cc:493] T 556f2a498099427e9a90c94542674f0f P f2868245e89644679e2b7dac75591a58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:47.724052 25895 raft_consensus.cc:515] T 556f2a498099427e9a90c94542674f0f P f2868245e89644679e2b7dac75591a58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:47.729084 25634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556f2a498099427e9a90c94542674f0f" candidate_uuid: "f2868245e89644679e2b7dac75591a58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e4eb6facf924880a0e38eeff91ba974" is_pre_election: true
I20260709 12:14:47.729977 25634 raft_consensus.cc:2468] T 556f2a498099427e9a90c94542674f0f P 6e4eb6facf924880a0e38eeff91ba974 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f2868245e89644679e2b7dac75591a58 in term 0.
I20260709 12:14:47.730161 25881 consensus_queue.cc:260] T 927ba57ba7864989a49c8265b14a9c0a P 6e4eb6facf924880a0e38eeff91ba974 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:47.733098 25881 ts_tablet_manager.cc:1434] T 927ba57ba7864989a49c8265b14a9c0a P 6e4eb6facf924880a0e38eeff91ba974: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 12:14:47.733286 25522 leader_election.cc:304] T 556f2a498099427e9a90c94542674f0f P f2868245e89644679e2b7dac75591a58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e4eb6facf924880a0e38eeff91ba974, f2868245e89644679e2b7dac75591a58; no voters: 
I20260709 12:14:47.734438 25881 tablet_bootstrap.cc:492] T 843ddab732fd4de99b4267d7abfd735e P 6e4eb6facf924880a0e38eeff91ba974: Bootstrap starting.
I20260709 12:14:47.734642 25860 raft_consensus.cc:2804] T 556f2a498099427e9a90c94542674f0f P f2868245e89644679e2b7dac75591a58 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:47.735168 25860 raft_consensus.cc:493] T 556f2a498099427e9a90c94542674f0f P f2868245e89644679e2b7dac75591a58 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:47.735551 25860 raft_consensus.cc:3060] T 556f2a498099427e9a90c94542674f0f P f2868245e89644679e2b7dac75591a58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:47.746780 25895 leader_election.cc:290] T 556f2a498099427e9a90c94542674f0f P f2868245e89644679e2b7dac75591a58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6e4eb6facf924880a0e38eeff91ba974 (127.12.174.130:41805), 7ffdf999adba487a9887fe7e2cc0f874 (127.12.174.131:36809)
I20260709 12:14:47.752462 25881 tablet_bootstrap.cc:654] T 843ddab732fd4de99b4267d7abfd735e P 6e4eb6facf924880a0e38eeff91ba974: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:47.747849 25880 tablet_bootstrap.cc:492] T 2b233b12bfbc42c18b5b121f4122ba3c P f2868245e89644679e2b7dac75591a58: No bootstrap required, opened a new log
I20260709 12:14:47.748564 25706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556f2a498099427e9a90c94542674f0f" candidate_uuid: "f2868245e89644679e2b7dac75591a58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffdf999adba487a9887fe7e2cc0f874" is_pre_election: true
I20260709 12:14:47.749342 25789 raft_consensus.cc:493] T 927ba57ba7864989a49c8265b14a9c0a P 7ffdf999adba487a9887fe7e2cc0f874 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:47.755874 25880 ts_tablet_manager.cc:1403] T 2b233b12bfbc42c18b5b121f4122ba3c P f2868245e89644679e2b7dac75591a58: Time spent bootstrapping tablet: real 0.061s	user 0.015s	sys 0.027s
I20260709 12:14:47.756153 25789 raft_consensus.cc:515] T 927ba57ba7864989a49c8265b14a9c0a P 7ffdf999adba487a9887fe7e2cc0f874 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:47.757439 25879 tablet_bootstrap.cc:492] T 73781eedcc0f4dbd9bdd82d8ca269bd3 P 7ffdf999adba487a9887fe7e2cc0f874: No bootstrap required, opened a new log
I20260709 12:14:47.758028 25879 ts_tablet_manager.cc:1403] T 73781eedcc0f4dbd9bdd82d8ca269bd3 P 7ffdf999adba487a9887fe7e2cc0f874: Time spent bootstrapping tablet: real 0.076s	user 0.023s	sys 0.020s
I20260709 12:14:47.758915 25789 leader_election.cc:290] T 927ba57ba7864989a49c8265b14a9c0a P 7ffdf999adba487a9887fe7e2cc0f874 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f2868245e89644679e2b7dac75591a58 (127.12.174.129:40387), 6e4eb6facf924880a0e38eeff91ba974 (127.12.174.130:41805)
I20260709 12:14:47.759317 25880 raft_consensus.cc:359] T 2b233b12bfbc42c18b5b121f4122ba3c P f2868245e89644679e2b7dac75591a58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:47.760123 25880 raft_consensus.cc:385] T 2b233b12bfbc42c18b5b121f4122ba3c P f2868245e89644679e2b7dac75591a58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:47.760413 25880 raft_consensus.cc:740] T 2b233b12bfbc42c18b5b121f4122ba3c P f2868245e89644679e2b7dac75591a58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f2868245e89644679e2b7dac75591a58, State: Initialized, Role: FOLLOWER
I20260709 12:14:47.761035 25634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927ba57ba7864989a49c8265b14a9c0a" candidate_uuid: "7ffdf999adba487a9887fe7e2cc0f874" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e4eb6facf924880a0e38eeff91ba974" is_pre_election: true
I20260709 12:14:47.761168 25880 consensus_queue.cc:260] T 2b233b12bfbc42c18b5b121f4122ba3c P f2868245e89644679e2b7dac75591a58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:47.755893 25706 raft_consensus.cc:2468] T 556f2a498099427e9a90c94542674f0f P 7ffdf999adba487a9887fe7e2cc0f874 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f2868245e89644679e2b7dac75591a58 in term 0.
I20260709 12:14:47.761340 25879 raft_consensus.cc:359] T 73781eedcc0f4dbd9bdd82d8ca269bd3 P 7ffdf999adba487a9887fe7e2cc0f874 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:47.762887 25879 raft_consensus.cc:385] T 73781eedcc0f4dbd9bdd82d8ca269bd3 P 7ffdf999adba487a9887fe7e2cc0f874 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:47.763181 25879 raft_consensus.cc:740] T 73781eedcc0f4dbd9bdd82d8ca269bd3 P 7ffdf999adba487a9887fe7e2cc0f874 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ffdf999adba487a9887fe7e2cc0f874, State: Initialized, Role: FOLLOWER
I20260709 12:14:47.764063 25880 ts_tablet_manager.cc:1434] T 2b233b12bfbc42c18b5b121f4122ba3c P f2868245e89644679e2b7dac75591a58: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:14:47.764802 25558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927ba57ba7864989a49c8265b14a9c0a" candidate_uuid: "7ffdf999adba487a9887fe7e2cc0f874" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f2868245e89644679e2b7dac75591a58" is_pre_election: true
I20260709 12:14:47.765221 25880 tablet_bootstrap.cc:492] T 5a26b0bedc3c4a8c99946f8e5565d353 P f2868245e89644679e2b7dac75591a58: Bootstrap starting.
I20260709 12:14:47.765472 25558 raft_consensus.cc:2468] T 927ba57ba7864989a49c8265b14a9c0a P f2868245e89644679e2b7dac75591a58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffdf999adba487a9887fe7e2cc0f874 in term 0.
I20260709 12:14:47.767082 25671 leader_election.cc:304] T 927ba57ba7864989a49c8265b14a9c0a P 7ffdf999adba487a9887fe7e2cc0f874 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffdf999adba487a9887fe7e2cc0f874, f2868245e89644679e2b7dac75591a58; no voters: 
I20260709 12:14:47.764025 25879 consensus_queue.cc:260] T 73781eedcc0f4dbd9bdd82d8ca269bd3 P 7ffdf999adba487a9887fe7e2cc0f874 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:47.769717 25893 raft_consensus.cc:2804] T 927ba57ba7864989a49c8265b14a9c0a P 7ffdf999adba487a9887fe7e2cc0f874 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:47.770138 25893 raft_consensus.cc:493] T 927ba57ba7864989a49c8265b14a9c0a P 7ffdf999adba487a9887fe7e2cc0f874 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:47.770470 25893 raft_consensus.cc:3060] T 927ba57ba7864989a49c8265b14a9c0a P 7ffdf999adba487a9887fe7e2cc0f874 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:47.771097 25879 ts_tablet_manager.cc:1434] T 73781eedcc0f4dbd9bdd82d8ca269bd3 P 7ffdf999adba487a9887fe7e2cc0f874: Time spent starting tablet: real 0.013s	user 0.003s	sys 0.003s
I20260709 12:14:47.772138 25880 tablet_bootstrap.cc:654] T 5a26b0bedc3c4a8c99946f8e5565d353 P f2868245e89644679e2b7dac75591a58: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:47.772280 25879 tablet_bootstrap.cc:492] T 2b233b12bfbc42c18b5b121f4122ba3c P 7ffdf999adba487a9887fe7e2cc0f874: Bootstrap starting.
I20260709 12:14:47.763091 25634 raft_consensus.cc:2468] T 927ba57ba7864989a49c8265b14a9c0a P 6e4eb6facf924880a0e38eeff91ba974 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffdf999adba487a9887fe7e2cc0f874 in term 0.
I20260709 12:14:47.776782 25860 raft_consensus.cc:515] T 556f2a498099427e9a90c94542674f0f P f2868245e89644679e2b7dac75591a58 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:47.783777 25893 raft_consensus.cc:515] T 927ba57ba7864989a49c8265b14a9c0a P 7ffdf999adba487a9887fe7e2cc0f874 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:47.784904 25634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556f2a498099427e9a90c94542674f0f" candidate_uuid: "f2868245e89644679e2b7dac75591a58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e4eb6facf924880a0e38eeff91ba974"
I20260709 12:14:47.785861 25634 raft_consensus.cc:3060] T 556f2a498099427e9a90c94542674f0f P 6e4eb6facf924880a0e38eeff91ba974 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:47.788676 25860 leader_election.cc:290] T 556f2a498099427e9a90c94542674f0f P f2868245e89644679e2b7dac75591a58 [CANDIDATE]: Term 1 election: Requested vote from peers 6e4eb6facf924880a0e38eeff91ba974 (127.12.174.130:41805), 7ffdf999adba487a9887fe7e2cc0f874 (127.12.174.131:36809)
I20260709 12:14:47.790800 25706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556f2a498099427e9a90c94542674f0f" candidate_uuid: "f2868245e89644679e2b7dac75591a58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffdf999adba487a9887fe7e2cc0f874"
I20260709 12:14:47.791174 25881 tablet_bootstrap.cc:492] T 843ddab732fd4de99b4267d7abfd735e P 6e4eb6facf924880a0e38eeff91ba974: No bootstrap required, opened a new log
I20260709 12:14:47.791534 25706 raft_consensus.cc:3060] T 556f2a498099427e9a90c94542674f0f P 7ffdf999adba487a9887fe7e2cc0f874 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:47.791741 25881 ts_tablet_manager.cc:1403] T 843ddab732fd4de99b4267d7abfd735e P 6e4eb6facf924880a0e38eeff91ba974: Time spent bootstrapping tablet: real 0.058s	user 0.021s	sys 0.001s
I20260709 12:14:47.792842 25893 leader_election.cc:290] T 927ba57ba7864989a49c8265b14a9c0a P 7ffdf999adba487a9887fe7e2cc0f874 [CANDIDATE]: Term 1 election: Requested vote from peers f2868245e89644679e2b7dac75591a58 (127.12.174.129:40387), 6e4eb6facf924880a0e38eeff91ba974 (127.12.174.130:41805)
I20260709 12:14:47.794091 25632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927ba57ba7864989a49c8265b14a9c0a" candidate_uuid: "7ffdf999adba487a9887fe7e2cc0f874" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e4eb6facf924880a0e38eeff91ba974"
I20260709 12:14:47.794803 25632 raft_consensus.cc:3060] T 927ba57ba7864989a49c8265b14a9c0a P 6e4eb6facf924880a0e38eeff91ba974 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:47.797226 25558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927ba57ba7864989a49c8265b14a9c0a" candidate_uuid: "7ffdf999adba487a9887fe7e2cc0f874" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f2868245e89644679e2b7dac75591a58"
I20260709 12:14:47.797962 25558 raft_consensus.cc:3060] T 927ba57ba7864989a49c8265b14a9c0a P f2868245e89644679e2b7dac75591a58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:47.803826 25632 raft_consensus.cc:2468] T 927ba57ba7864989a49c8265b14a9c0a P 6e4eb6facf924880a0e38eeff91ba974 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffdf999adba487a9887fe7e2cc0f874 in term 1.
I20260709 12:14:47.804394 25706 raft_consensus.cc:2468] T 556f2a498099427e9a90c94542674f0f P 7ffdf999adba487a9887fe7e2cc0f874 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f2868245e89644679e2b7dac75591a58 in term 1.
I20260709 12:14:47.805388 25671 leader_election.cc:304] T 927ba57ba7864989a49c8265b14a9c0a P 7ffdf999adba487a9887fe7e2cc0f874 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e4eb6facf924880a0e38eeff91ba974, 7ffdf999adba487a9887fe7e2cc0f874; no voters: 
I20260709 12:14:47.805637 25525 leader_election.cc:304] T 556f2a498099427e9a90c94542674f0f P f2868245e89644679e2b7dac75591a58 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffdf999adba487a9887fe7e2cc0f874, f2868245e89644679e2b7dac75591a58; no voters: 
I20260709 12:14:47.806578 25893 raft_consensus.cc:2804] T 927ba57ba7864989a49c8265b14a9c0a P 7ffdf999adba487a9887fe7e2cc0f874 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:47.807103 25893 raft_consensus.cc:697] T 927ba57ba7864989a49c8265b14a9c0a P 7ffdf999adba487a9887fe7e2cc0f874 [term 1 LEADER]: Becoming Leader. State: Replica: 7ffdf999adba487a9887fe7e2cc0f874, State: Running, Role: LEADER
I20260709 12:14:47.807999 25893 consensus_queue.cc:237] T 927ba57ba7864989a49c8265b14a9c0a P 7ffdf999adba487a9887fe7e2cc0f874 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:47.809489 25881 raft_consensus.cc:359] T 843ddab732fd4de99b4267d7abfd735e P 6e4eb6facf924880a0e38eeff91ba974 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:47.810107 25860 raft_consensus.cc:2804] T 556f2a498099427e9a90c94542674f0f P f2868245e89644679e2b7dac75591a58 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:47.810803 25860 raft_consensus.cc:697] T 556f2a498099427e9a90c94542674f0f P f2868245e89644679e2b7dac75591a58 [term 1 LEADER]: Becoming Leader. State: Replica: f2868245e89644679e2b7dac75591a58, State: Running, Role: LEADER
I20260709 12:14:47.811426 25879 tablet_bootstrap.cc:654] T 2b233b12bfbc42c18b5b121f4122ba3c P 7ffdf999adba487a9887fe7e2cc0f874: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:47.811786 25860 consensus_queue.cc:237] T 556f2a498099427e9a90c94542674f0f P f2868245e89644679e2b7dac75591a58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:47.810387 25881 raft_consensus.cc:385] T 843ddab732fd4de99b4267d7abfd735e P 6e4eb6facf924880a0e38eeff91ba974 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:47.815783 25881 raft_consensus.cc:740] T 843ddab732fd4de99b4267d7abfd735e P 6e4eb6facf924880a0e38eeff91ba974 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e4eb6facf924880a0e38eeff91ba974, State: Initialized, Role: FOLLOWER
I20260709 12:14:47.816778 25881 consensus_queue.cc:260] T 843ddab732fd4de99b4267d7abfd735e P 6e4eb6facf924880a0e38eeff91ba974 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:47.818862 25895 raft_consensus.cc:493] T 73781eedcc0f4dbd9bdd82d8ca269bd3 P f2868245e89644679e2b7dac75591a58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:47.819566 25895 raft_consensus.cc:515] T 73781eedcc0f4dbd9bdd82d8ca269bd3 P f2868245e89644679e2b7dac75591a58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:47.821442 25879 tablet_bootstrap.cc:492] T 2b233b12bfbc42c18b5b121f4122ba3c P 7ffdf999adba487a9887fe7e2cc0f874: No bootstrap required, opened a new log
I20260709 12:14:47.822244 25879 ts_tablet_manager.cc:1403] T 2b233b12bfbc42c18b5b121f4122ba3c P 7ffdf999adba487a9887fe7e2cc0f874: Time spent bootstrapping tablet: real 0.050s	user 0.014s	sys 0.001s
I20260709 12:14:47.823513 25632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73781eedcc0f4dbd9bdd82d8ca269bd3" candidate_uuid: "f2868245e89644679e2b7dac75591a58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e4eb6facf924880a0e38eeff91ba974" is_pre_election: true
W20260709 12:14:47.825841 25522 leader_election.cc:343] T 73781eedcc0f4dbd9bdd82d8ca269bd3 P f2868245e89644679e2b7dac75591a58 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6e4eb6facf924880a0e38eeff91ba974 (127.12.174.130:41805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:47.828058 25879 raft_consensus.cc:359] T 2b233b12bfbc42c18b5b121f4122ba3c P 7ffdf999adba487a9887fe7e2cc0f874 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:47.828603 25706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73781eedcc0f4dbd9bdd82d8ca269bd3" candidate_uuid: "f2868245e89644679e2b7dac75591a58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffdf999adba487a9887fe7e2cc0f874" is_pre_election: true
I20260709 12:14:47.828998 25879 raft_consensus.cc:385] T 2b233b12bfbc42c18b5b121f4122ba3c P 7ffdf999adba487a9887fe7e2cc0f874 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:47.829473 25882 raft_consensus.cc:493] T 843ddab732fd4de99b4267d7abfd735e P f2868245e89644679e2b7dac75591a58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:47.828521 25895 leader_election.cc:290] T 73781eedcc0f4dbd9bdd82d8ca269bd3 P f2868245e89644679e2b7dac75591a58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6e4eb6facf924880a0e38eeff91ba974 (127.12.174.130:41805), 7ffdf999adba487a9887fe7e2cc0f874 (127.12.174.131:36809)
I20260709 12:14:47.829607 25706 raft_consensus.cc:2468] T 73781eedcc0f4dbd9bdd82d8ca269bd3 P 7ffdf999adba487a9887fe7e2cc0f874 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f2868245e89644679e2b7dac75591a58 in term 0.
I20260709 12:14:47.830482 25882 raft_consensus.cc:515] T 843ddab732fd4de99b4267d7abfd735e P f2868245e89644679e2b7dac75591a58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:47.829334 25879 raft_consensus.cc:740] T 2b233b12bfbc42c18b5b121f4122ba3c P 7ffdf999adba487a9887fe7e2cc0f874 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ffdf999adba487a9887fe7e2cc0f874, State: Initialized, Role: FOLLOWER
I20260709 12:14:47.831851 25525 leader_election.cc:304] T 73781eedcc0f4dbd9bdd82d8ca269bd3 P f2868245e89644679e2b7dac75591a58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffdf999adba487a9887fe7e2cc0f874, f2868245e89644679e2b7dac75591a58; no voters: 6e4eb6facf924880a0e38eeff91ba974
I20260709 12:14:47.832475 25879 consensus_queue.cc:260] T 2b233b12bfbc42c18b5b121f4122ba3c P 7ffdf999adba487a9887fe7e2cc0f874 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:47.832827 25882 leader_election.cc:290] T 843ddab732fd4de99b4267d7abfd735e P f2868245e89644679e2b7dac75591a58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6e4eb6facf924880a0e38eeff91ba974 (127.12.174.130:41805), 7ffdf999adba487a9887fe7e2cc0f874 (127.12.174.131:36809)
I20260709 12:14:47.833909 25632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843ddab732fd4de99b4267d7abfd735e" candidate_uuid: "f2868245e89644679e2b7dac75591a58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e4eb6facf924880a0e38eeff91ba974" is_pre_election: true
I20260709 12:14:47.834340 25706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843ddab732fd4de99b4267d7abfd735e" candidate_uuid: "f2868245e89644679e2b7dac75591a58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffdf999adba487a9887fe7e2cc0f874" is_pre_election: true
I20260709 12:14:47.833963 25882 raft_consensus.cc:2804] T 73781eedcc0f4dbd9bdd82d8ca269bd3 P f2868245e89644679e2b7dac75591a58 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:47.835253 25882 raft_consensus.cc:493] T 73781eedcc0f4dbd9bdd82d8ca269bd3 P f2868245e89644679e2b7dac75591a58 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:47.835592 25882 raft_consensus.cc:3060] T 73781eedcc0f4dbd9bdd82d8ca269bd3 P f2868245e89644679e2b7dac75591a58 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:14:47.836128 25525 leader_election.cc:343] T 843ddab732fd4de99b4267d7abfd735e P f2868245e89644679e2b7dac75591a58 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ffdf999adba487a9887fe7e2cc0f874 (127.12.174.131:36809): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:47.837251 25879 ts_tablet_manager.cc:1434] T 2b233b12bfbc42c18b5b121f4122ba3c P 7ffdf999adba487a9887fe7e2cc0f874: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.004s
I20260709 12:14:47.838045 25881 ts_tablet_manager.cc:1434] T 843ddab732fd4de99b4267d7abfd735e P 6e4eb6facf924880a0e38eeff91ba974: Time spent starting tablet: real 0.046s	user 0.012s	sys 0.006s
I20260709 12:14:47.838543 25879 tablet_bootstrap.cc:492] T 5a26b0bedc3c4a8c99946f8e5565d353 P 7ffdf999adba487a9887fe7e2cc0f874: Bootstrap starting.
I20260709 12:14:47.839681 25881 tablet_bootstrap.cc:492] T 73781eedcc0f4dbd9bdd82d8ca269bd3 P 6e4eb6facf924880a0e38eeff91ba974: Bootstrap starting.
I20260709 12:14:47.843535 25632 raft_consensus.cc:2468] T 843ddab732fd4de99b4267d7abfd735e P 6e4eb6facf924880a0e38eeff91ba974 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f2868245e89644679e2b7dac75591a58 in term 0.
I20260709 12:14:47.845184 25522 leader_election.cc:304] T 843ddab732fd4de99b4267d7abfd735e P f2868245e89644679e2b7dac75591a58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e4eb6facf924880a0e38eeff91ba974, f2868245e89644679e2b7dac75591a58; no voters: 7ffdf999adba487a9887fe7e2cc0f874
I20260709 12:14:47.846175 25895 raft_consensus.cc:2804] T 843ddab732fd4de99b4267d7abfd735e P f2868245e89644679e2b7dac75591a58 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:47.846592 25895 raft_consensus.cc:493] T 843ddab732fd4de99b4267d7abfd735e P f2868245e89644679e2b7dac75591a58 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:47.846953 25895 raft_consensus.cc:3060] T 843ddab732fd4de99b4267d7abfd735e P f2868245e89644679e2b7dac75591a58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:47.854915 25879 tablet_bootstrap.cc:654] T 5a26b0bedc3c4a8c99946f8e5565d353 P 7ffdf999adba487a9887fe7e2cc0f874: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:47.868767 25634 raft_consensus.cc:2468] T 556f2a498099427e9a90c94542674f0f P 6e4eb6facf924880a0e38eeff91ba974 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f2868245e89644679e2b7dac75591a58 in term 1.
I20260709 12:14:47.870898 25881 tablet_bootstrap.cc:654] T 73781eedcc0f4dbd9bdd82d8ca269bd3 P 6e4eb6facf924880a0e38eeff91ba974: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:47.871428 25895 raft_consensus.cc:515] T 843ddab732fd4de99b4267d7abfd735e P f2868245e89644679e2b7dac75591a58 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:47.876030 25634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843ddab732fd4de99b4267d7abfd735e" candidate_uuid: "f2868245e89644679e2b7dac75591a58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e4eb6facf924880a0e38eeff91ba974"
I20260709 12:14:47.872578 25558 raft_consensus.cc:2468] T 927ba57ba7864989a49c8265b14a9c0a P f2868245e89644679e2b7dac75591a58 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffdf999adba487a9887fe7e2cc0f874 in term 1.
I20260709 12:14:47.878937 25880 tablet_bootstrap.cc:492] T 5a26b0bedc3c4a8c99946f8e5565d353 P f2868245e89644679e2b7dac75591a58: No bootstrap required, opened a new log
I20260709 12:14:47.879520 25880 ts_tablet_manager.cc:1403] T 5a26b0bedc3c4a8c99946f8e5565d353 P f2868245e89644679e2b7dac75591a58: Time spent bootstrapping tablet: real 0.115s	user 0.031s	sys 0.035s
I20260709 12:14:47.880350 25706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843ddab732fd4de99b4267d7abfd735e" candidate_uuid: "f2868245e89644679e2b7dac75591a58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffdf999adba487a9887fe7e2cc0f874"
I20260709 12:14:47.881873 25882 raft_consensus.cc:515] T 73781eedcc0f4dbd9bdd82d8ca269bd3 P f2868245e89644679e2b7dac75591a58 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
W20260709 12:14:47.882189 25525 leader_election.cc:343] T 843ddab732fd4de99b4267d7abfd735e P f2868245e89644679e2b7dac75591a58 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7ffdf999adba487a9887fe7e2cc0f874 (127.12.174.131:36809): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:47.879688 25895 leader_election.cc:290] T 843ddab732fd4de99b4267d7abfd735e P f2868245e89644679e2b7dac75591a58 [CANDIDATE]: Term 1 election: Requested vote from peers 6e4eb6facf924880a0e38eeff91ba974 (127.12.174.130:41805), 7ffdf999adba487a9887fe7e2cc0f874 (127.12.174.131:36809)
I20260709 12:14:47.886390 25882 leader_election.cc:290] T 73781eedcc0f4dbd9bdd82d8ca269bd3 P f2868245e89644679e2b7dac75591a58 [CANDIDATE]: Term 1 election: Requested vote from peers 6e4eb6facf924880a0e38eeff91ba974 (127.12.174.130:41805), 7ffdf999adba487a9887fe7e2cc0f874 (127.12.174.131:36809)
I20260709 12:14:47.887939 25881 tablet_bootstrap.cc:492] T 73781eedcc0f4dbd9bdd82d8ca269bd3 P 6e4eb6facf924880a0e38eeff91ba974: No bootstrap required, opened a new log
I20260709 12:14:47.888548 25881 ts_tablet_manager.cc:1403] T 73781eedcc0f4dbd9bdd82d8ca269bd3 P 6e4eb6facf924880a0e38eeff91ba974: Time spent bootstrapping tablet: real 0.049s	user 0.012s	sys 0.000s
I20260709 12:14:47.888481 25706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73781eedcc0f4dbd9bdd82d8ca269bd3" candidate_uuid: "f2868245e89644679e2b7dac75591a58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffdf999adba487a9887fe7e2cc0f874"
I20260709 12:14:47.889572 25706 raft_consensus.cc:3060] T 73781eedcc0f4dbd9bdd82d8ca269bd3 P 7ffdf999adba487a9887fe7e2cc0f874 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:47.891242 25632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73781eedcc0f4dbd9bdd82d8ca269bd3" candidate_uuid: "f2868245e89644679e2b7dac75591a58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e4eb6facf924880a0e38eeff91ba974"
I20260709 12:14:47.890760 25456 catalog_manager.cc:5697] T 556f2a498099427e9a90c94542674f0f P f2868245e89644679e2b7dac75591a58 reported cstate change: term changed from 0 to 1, leader changed from <none> to f2868245e89644679e2b7dac75591a58 (127.12.174.129). New cstate: current_term: 1 leader_uuid: "f2868245e89644679e2b7dac75591a58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } health_report { overall_health: UNKNOWN } } }
W20260709 12:14:47.898123 25522 leader_election.cc:343] T 73781eedcc0f4dbd9bdd82d8ca269bd3 P f2868245e89644679e2b7dac75591a58 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6e4eb6facf924880a0e38eeff91ba974 (127.12.174.130:41805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:47.876914 25634 raft_consensus.cc:3060] T 843ddab732fd4de99b4267d7abfd735e P 6e4eb6facf924880a0e38eeff91ba974 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:47.904913 25880 raft_consensus.cc:359] T 5a26b0bedc3c4a8c99946f8e5565d353 P f2868245e89644679e2b7dac75591a58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:47.905267 25881 raft_consensus.cc:359] T 73781eedcc0f4dbd9bdd82d8ca269bd3 P 6e4eb6facf924880a0e38eeff91ba974 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:47.905809 25880 raft_consensus.cc:385] T 5a26b0bedc3c4a8c99946f8e5565d353 P f2868245e89644679e2b7dac75591a58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:47.906076 25881 raft_consensus.cc:385] T 73781eedcc0f4dbd9bdd82d8ca269bd3 P 6e4eb6facf924880a0e38eeff91ba974 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:47.906175 25880 raft_consensus.cc:740] T 5a26b0bedc3c4a8c99946f8e5565d353 P f2868245e89644679e2b7dac75591a58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f2868245e89644679e2b7dac75591a58, State: Initialized, Role: FOLLOWER
I20260709 12:14:47.906529 25881 raft_consensus.cc:740] T 73781eedcc0f4dbd9bdd82d8ca269bd3 P 6e4eb6facf924880a0e38eeff91ba974 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e4eb6facf924880a0e38eeff91ba974, State: Initialized, Role: FOLLOWER
I20260709 12:14:47.907075 25880 consensus_queue.cc:260] T 5a26b0bedc3c4a8c99946f8e5565d353 P f2868245e89644679e2b7dac75591a58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:47.907347 25881 consensus_queue.cc:260] T 73781eedcc0f4dbd9bdd82d8ca269bd3 P 6e4eb6facf924880a0e38eeff91ba974 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:47.910105 25881 ts_tablet_manager.cc:1434] T 73781eedcc0f4dbd9bdd82d8ca269bd3 P 6e4eb6facf924880a0e38eeff91ba974: Time spent starting tablet: real 0.021s	user 0.009s	sys 0.001s
I20260709 12:14:47.911350 25881 tablet_bootstrap.cc:492] T 5a26b0bedc3c4a8c99946f8e5565d353 P 6e4eb6facf924880a0e38eeff91ba974: Bootstrap starting.
I20260709 12:14:47.918367 25881 tablet_bootstrap.cc:654] T 5a26b0bedc3c4a8c99946f8e5565d353 P 6e4eb6facf924880a0e38eeff91ba974: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:47.921154 25706 raft_consensus.cc:2468] T 73781eedcc0f4dbd9bdd82d8ca269bd3 P 7ffdf999adba487a9887fe7e2cc0f874 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f2868245e89644679e2b7dac75591a58 in term 1.
I20260709 12:14:47.922720 25525 leader_election.cc:304] T 73781eedcc0f4dbd9bdd82d8ca269bd3 P f2868245e89644679e2b7dac75591a58 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffdf999adba487a9887fe7e2cc0f874, f2868245e89644679e2b7dac75591a58; no voters: 6e4eb6facf924880a0e38eeff91ba974
I20260709 12:14:47.924175 25860 raft_consensus.cc:2804] T 73781eedcc0f4dbd9bdd82d8ca269bd3 P f2868245e89644679e2b7dac75591a58 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:47.924811 25860 raft_consensus.cc:697] T 73781eedcc0f4dbd9bdd82d8ca269bd3 P f2868245e89644679e2b7dac75591a58 [term 1 LEADER]: Becoming Leader. State: Replica: f2868245e89644679e2b7dac75591a58, State: Running, Role: LEADER
I20260709 12:14:47.925765 25860 consensus_queue.cc:237] T 73781eedcc0f4dbd9bdd82d8ca269bd3 P f2868245e89644679e2b7dac75591a58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:47.931989 25881 tablet_bootstrap.cc:492] T 5a26b0bedc3c4a8c99946f8e5565d353 P 6e4eb6facf924880a0e38eeff91ba974: No bootstrap required, opened a new log
I20260709 12:14:47.932637 25881 ts_tablet_manager.cc:1403] T 5a26b0bedc3c4a8c99946f8e5565d353 P 6e4eb6facf924880a0e38eeff91ba974: Time spent bootstrapping tablet: real 0.022s	user 0.006s	sys 0.005s
I20260709 12:14:47.939433 25880 ts_tablet_manager.cc:1434] T 5a26b0bedc3c4a8c99946f8e5565d353 P f2868245e89644679e2b7dac75591a58: Time spent starting tablet: real 0.060s	user 0.008s	sys 0.001s
I20260709 12:14:47.940963 25881 raft_consensus.cc:359] T 5a26b0bedc3c4a8c99946f8e5565d353 P 6e4eb6facf924880a0e38eeff91ba974 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:47.944242 25881 raft_consensus.cc:385] T 5a26b0bedc3c4a8c99946f8e5565d353 P 6e4eb6facf924880a0e38eeff91ba974 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:47.944532 25881 raft_consensus.cc:740] T 5a26b0bedc3c4a8c99946f8e5565d353 P 6e4eb6facf924880a0e38eeff91ba974 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e4eb6facf924880a0e38eeff91ba974, State: Initialized, Role: FOLLOWER
I20260709 12:14:47.945338 25881 consensus_queue.cc:260] T 5a26b0bedc3c4a8c99946f8e5565d353 P 6e4eb6facf924880a0e38eeff91ba974 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:47.947057 25881 ts_tablet_manager.cc:1434] T 5a26b0bedc3c4a8c99946f8e5565d353 P 6e4eb6facf924880a0e38eeff91ba974: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.003s
I20260709 12:14:47.945969 25456 catalog_manager.cc:5697] T 927ba57ba7864989a49c8265b14a9c0a P 7ffdf999adba487a9887fe7e2cc0f874 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7ffdf999adba487a9887fe7e2cc0f874 (127.12.174.131). New cstate: current_term: 1 leader_uuid: "7ffdf999adba487a9887fe7e2cc0f874" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:47.948594 25881 tablet_bootstrap.cc:492] T d835765d07404362a68c773ddc446da5 P 6e4eb6facf924880a0e38eeff91ba974: Bootstrap starting.
I20260709 12:14:47.955593 25881 tablet_bootstrap.cc:654] T d835765d07404362a68c773ddc446da5 P 6e4eb6facf924880a0e38eeff91ba974: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:47.955807 25879 tablet_bootstrap.cc:492] T 5a26b0bedc3c4a8c99946f8e5565d353 P 7ffdf999adba487a9887fe7e2cc0f874: No bootstrap required, opened a new log
I20260709 12:14:47.956409 25879 ts_tablet_manager.cc:1403] T 5a26b0bedc3c4a8c99946f8e5565d353 P 7ffdf999adba487a9887fe7e2cc0f874: Time spent bootstrapping tablet: real 0.118s	user 0.015s	sys 0.019s
I20260709 12:14:47.958911 25634 raft_consensus.cc:2468] T 843ddab732fd4de99b4267d7abfd735e P 6e4eb6facf924880a0e38eeff91ba974 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f2868245e89644679e2b7dac75591a58 in term 1.
I20260709 12:14:47.960057 25879 raft_consensus.cc:359] T 5a26b0bedc3c4a8c99946f8e5565d353 P 7ffdf999adba487a9887fe7e2cc0f874 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:47.960484 25522 leader_election.cc:304] T 843ddab732fd4de99b4267d7abfd735e P f2868245e89644679e2b7dac75591a58 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e4eb6facf924880a0e38eeff91ba974, f2868245e89644679e2b7dac75591a58; no voters: 7ffdf999adba487a9887fe7e2cc0f874
I20260709 12:14:47.960969 25879 raft_consensus.cc:385] T 5a26b0bedc3c4a8c99946f8e5565d353 P 7ffdf999adba487a9887fe7e2cc0f874 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:47.961436 25879 raft_consensus.cc:740] T 5a26b0bedc3c4a8c99946f8e5565d353 P 7ffdf999adba487a9887fe7e2cc0f874 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ffdf999adba487a9887fe7e2cc0f874, State: Initialized, Role: FOLLOWER
I20260709 12:14:47.962077 25882 raft_consensus.cc:2804] T 843ddab732fd4de99b4267d7abfd735e P f2868245e89644679e2b7dac75591a58 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:47.962687 25882 raft_consensus.cc:697] T 843ddab732fd4de99b4267d7abfd735e P f2868245e89644679e2b7dac75591a58 [term 1 LEADER]: Becoming Leader. State: Replica: f2868245e89644679e2b7dac75591a58, State: Running, Role: LEADER
I20260709 12:14:47.962903 25880 tablet_bootstrap.cc:492] T d835765d07404362a68c773ddc446da5 P f2868245e89644679e2b7dac75591a58: Bootstrap starting.
I20260709 12:14:47.962381 25879 consensus_queue.cc:260] T 5a26b0bedc3c4a8c99946f8e5565d353 P 7ffdf999adba487a9887fe7e2cc0f874 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:47.963727 25882 consensus_queue.cc:237] T 843ddab732fd4de99b4267d7abfd735e P f2868245e89644679e2b7dac75591a58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:47.974671 25879 ts_tablet_manager.cc:1434] T 5a26b0bedc3c4a8c99946f8e5565d353 P 7ffdf999adba487a9887fe7e2cc0f874: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.004s
I20260709 12:14:47.976083 25879 tablet_bootstrap.cc:492] T 843ddab732fd4de99b4267d7abfd735e P 7ffdf999adba487a9887fe7e2cc0f874: Bootstrap starting.
I20260709 12:14:47.992484 25879 tablet_bootstrap.cc:654] T 843ddab732fd4de99b4267d7abfd735e P 7ffdf999adba487a9887fe7e2cc0f874: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:47.992941 25880 tablet_bootstrap.cc:654] T d835765d07404362a68c773ddc446da5 P f2868245e89644679e2b7dac75591a58: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:47.997149 25456 catalog_manager.cc:5697] T 73781eedcc0f4dbd9bdd82d8ca269bd3 P f2868245e89644679e2b7dac75591a58 reported cstate change: term changed from 0 to 1, leader changed from <none> to f2868245e89644679e2b7dac75591a58 (127.12.174.129). New cstate: current_term: 1 leader_uuid: "f2868245e89644679e2b7dac75591a58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:47.998229 25881 tablet_bootstrap.cc:492] T d835765d07404362a68c773ddc446da5 P 6e4eb6facf924880a0e38eeff91ba974: No bootstrap required, opened a new log
I20260709 12:14:47.998919 25881 ts_tablet_manager.cc:1403] T d835765d07404362a68c773ddc446da5 P 6e4eb6facf924880a0e38eeff91ba974: Time spent bootstrapping tablet: real 0.051s	user 0.033s	sys 0.008s
I20260709 12:14:48.002898 25893 raft_consensus.cc:493] T 2b233b12bfbc42c18b5b121f4122ba3c P 7ffdf999adba487a9887fe7e2cc0f874 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:48.003530 25893 raft_consensus.cc:515] T 2b233b12bfbc42c18b5b121f4122ba3c P 7ffdf999adba487a9887fe7e2cc0f874 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:48.004540 25879 tablet_bootstrap.cc:492] T 843ddab732fd4de99b4267d7abfd735e P 7ffdf999adba487a9887fe7e2cc0f874: No bootstrap required, opened a new log
I20260709 12:14:48.005177 25879 ts_tablet_manager.cc:1403] T 843ddab732fd4de99b4267d7abfd735e P 7ffdf999adba487a9887fe7e2cc0f874: Time spent bootstrapping tablet: real 0.029s	user 0.011s	sys 0.001s
I20260709 12:14:48.005942 25893 leader_election.cc:290] T 2b233b12bfbc42c18b5b121f4122ba3c P 7ffdf999adba487a9887fe7e2cc0f874 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f2868245e89644679e2b7dac75591a58 (127.12.174.129:40387), 6e4eb6facf924880a0e38eeff91ba974 (127.12.174.130:41805)
I20260709 12:14:48.002178 25881 raft_consensus.cc:359] T d835765d07404362a68c773ddc446da5 P 6e4eb6facf924880a0e38eeff91ba974 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:48.006654 25881 raft_consensus.cc:385] T d835765d07404362a68c773ddc446da5 P 6e4eb6facf924880a0e38eeff91ba974 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:48.006953 25881 raft_consensus.cc:740] T d835765d07404362a68c773ddc446da5 P 6e4eb6facf924880a0e38eeff91ba974 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e4eb6facf924880a0e38eeff91ba974, State: Initialized, Role: FOLLOWER
I20260709 12:14:48.007073 25634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b233b12bfbc42c18b5b121f4122ba3c" candidate_uuid: "7ffdf999adba487a9887fe7e2cc0f874" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e4eb6facf924880a0e38eeff91ba974" is_pre_election: true
I20260709 12:14:48.007814 25558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b233b12bfbc42c18b5b121f4122ba3c" candidate_uuid: "7ffdf999adba487a9887fe7e2cc0f874" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f2868245e89644679e2b7dac75591a58" is_pre_election: true
I20260709 12:14:48.008615 25558 raft_consensus.cc:2468] T 2b233b12bfbc42c18b5b121f4122ba3c P f2868245e89644679e2b7dac75591a58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffdf999adba487a9887fe7e2cc0f874 in term 0.
I20260709 12:14:48.010281 25671 leader_election.cc:304] T 2b233b12bfbc42c18b5b121f4122ba3c P 7ffdf999adba487a9887fe7e2cc0f874 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffdf999adba487a9887fe7e2cc0f874, f2868245e89644679e2b7dac75591a58; no voters: 
I20260709 12:14:48.011106 25893 raft_consensus.cc:2804] T 2b233b12bfbc42c18b5b121f4122ba3c P 7ffdf999adba487a9887fe7e2cc0f874 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:48.011488 25893 raft_consensus.cc:493] T 2b233b12bfbc42c18b5b121f4122ba3c P 7ffdf999adba487a9887fe7e2cc0f874 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:48.007840 25634 raft_consensus.cc:2468] T 2b233b12bfbc42c18b5b121f4122ba3c P 6e4eb6facf924880a0e38eeff91ba974 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffdf999adba487a9887fe7e2cc0f874 in term 0.
I20260709 12:14:48.011802 25893 raft_consensus.cc:3060] T 2b233b12bfbc42c18b5b121f4122ba3c P 7ffdf999adba487a9887fe7e2cc0f874 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:48.017558 25879 raft_consensus.cc:359] T 843ddab732fd4de99b4267d7abfd735e P 7ffdf999adba487a9887fe7e2cc0f874 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:48.018481 25879 raft_consensus.cc:385] T 843ddab732fd4de99b4267d7abfd735e P 7ffdf999adba487a9887fe7e2cc0f874 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:48.018791 25879 raft_consensus.cc:740] T 843ddab732fd4de99b4267d7abfd735e P 7ffdf999adba487a9887fe7e2cc0f874 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ffdf999adba487a9887fe7e2cc0f874, State: Initialized, Role: FOLLOWER
I20260709 12:14:48.019753 25879 consensus_queue.cc:260] T 843ddab732fd4de99b4267d7abfd735e P 7ffdf999adba487a9887fe7e2cc0f874 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:48.022351 25879 ts_tablet_manager.cc:1434] T 843ddab732fd4de99b4267d7abfd735e P 7ffdf999adba487a9887fe7e2cc0f874: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 12:14:48.023828 25879 tablet_bootstrap.cc:492] T d835765d07404362a68c773ddc446da5 P 7ffdf999adba487a9887fe7e2cc0f874: Bootstrap starting.
I20260709 12:14:48.024747 25456 catalog_manager.cc:5697] T 843ddab732fd4de99b4267d7abfd735e P f2868245e89644679e2b7dac75591a58 reported cstate change: term changed from 0 to 1, leader changed from <none> to f2868245e89644679e2b7dac75591a58 (127.12.174.129). New cstate: current_term: 1 leader_uuid: "f2868245e89644679e2b7dac75591a58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:48.028173 25893 raft_consensus.cc:515] T 2b233b12bfbc42c18b5b121f4122ba3c P 7ffdf999adba487a9887fe7e2cc0f874 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:48.032583 25880 tablet_bootstrap.cc:492] T d835765d07404362a68c773ddc446da5 P f2868245e89644679e2b7dac75591a58: No bootstrap required, opened a new log
I20260709 12:14:48.032640 25879 tablet_bootstrap.cc:654] T d835765d07404362a68c773ddc446da5 P 7ffdf999adba487a9887fe7e2cc0f874: Neither blocks nor log segments found. Creating new log.
I20260709 12:14:48.033506 25880 ts_tablet_manager.cc:1403] T d835765d07404362a68c773ddc446da5 P f2868245e89644679e2b7dac75591a58: Time spent bootstrapping tablet: real 0.071s	user 0.014s	sys 0.005s
I20260709 12:14:48.030807 25881 consensus_queue.cc:260] T d835765d07404362a68c773ddc446da5 P 6e4eb6facf924880a0e38eeff91ba974 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:48.034940 25896 raft_consensus.cc:493] T d835765d07404362a68c773ddc446da5 P 6e4eb6facf924880a0e38eeff91ba974 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:48.035501 25896 raft_consensus.cc:515] T d835765d07404362a68c773ddc446da5 P 6e4eb6facf924880a0e38eeff91ba974 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:48.036405 25881 ts_tablet_manager.cc:1434] T d835765d07404362a68c773ddc446da5 P 6e4eb6facf924880a0e38eeff91ba974: Time spent starting tablet: real 0.037s	user 0.005s	sys 0.003s
I20260709 12:14:48.037340 25893 leader_election.cc:290] T 2b233b12bfbc42c18b5b121f4122ba3c P 7ffdf999adba487a9887fe7e2cc0f874 [CANDIDATE]: Term 1 election: Requested vote from peers f2868245e89644679e2b7dac75591a58 (127.12.174.129:40387), 6e4eb6facf924880a0e38eeff91ba974 (127.12.174.130:41805)
I20260709 12:14:48.039729 25634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b233b12bfbc42c18b5b121f4122ba3c" candidate_uuid: "7ffdf999adba487a9887fe7e2cc0f874" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e4eb6facf924880a0e38eeff91ba974"
I20260709 12:14:48.040434 25634 raft_consensus.cc:3060] T 2b233b12bfbc42c18b5b121f4122ba3c P 6e4eb6facf924880a0e38eeff91ba974 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:48.043476 25706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d835765d07404362a68c773ddc446da5" candidate_uuid: "6e4eb6facf924880a0e38eeff91ba974" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffdf999adba487a9887fe7e2cc0f874" is_pre_election: true
I20260709 12:14:48.035699 25558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b233b12bfbc42c18b5b121f4122ba3c" candidate_uuid: "7ffdf999adba487a9887fe7e2cc0f874" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f2868245e89644679e2b7dac75591a58"
I20260709 12:14:48.045238 25558 raft_consensus.cc:3060] T 2b233b12bfbc42c18b5b121f4122ba3c P f2868245e89644679e2b7dac75591a58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:48.039780 25896 leader_election.cc:290] T d835765d07404362a68c773ddc446da5 P 6e4eb6facf924880a0e38eeff91ba974 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f2868245e89644679e2b7dac75591a58 (127.12.174.129:40387), 7ffdf999adba487a9887fe7e2cc0f874 (127.12.174.131:36809)
I20260709 12:14:48.046406 25893 consensus_queue.cc:1048] T fb492c949c97458a940dfcbd02a034cf P 7ffdf999adba487a9887fe7e2cc0f874 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:14:48.050534 25600 leader_election.cc:343] T d835765d07404362a68c773ddc446da5 P 6e4eb6facf924880a0e38eeff91ba974 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ffdf999adba487a9887fe7e2cc0f874 (127.12.174.131:36809): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:48.049458 25880 raft_consensus.cc:359] T d835765d07404362a68c773ddc446da5 P f2868245e89644679e2b7dac75591a58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:48.058651 25559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d835765d07404362a68c773ddc446da5" candidate_uuid: "6e4eb6facf924880a0e38eeff91ba974" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f2868245e89644679e2b7dac75591a58" is_pre_election: true
I20260709 12:14:48.051133 25634 raft_consensus.cc:2468] T 2b233b12bfbc42c18b5b121f4122ba3c P 6e4eb6facf924880a0e38eeff91ba974 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffdf999adba487a9887fe7e2cc0f874 in term 1.
I20260709 12:14:48.071149 25671 leader_election.cc:304] T 2b233b12bfbc42c18b5b121f4122ba3c P 7ffdf999adba487a9887fe7e2cc0f874 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e4eb6facf924880a0e38eeff91ba974, 7ffdf999adba487a9887fe7e2cc0f874; no voters: 
I20260709 12:14:48.066504 25558 raft_consensus.cc:2468] T 2b233b12bfbc42c18b5b121f4122ba3c P f2868245e89644679e2b7dac75591a58 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffdf999adba487a9887fe7e2cc0f874 in term 1.
I20260709 12:14:48.072636 25893 raft_consensus.cc:2804] T 2b233b12bfbc42c18b5b121f4122ba3c P 7ffdf999adba487a9887fe7e2cc0f874 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:48.073184 25893 raft_consensus.cc:697] T 2b233b12bfbc42c18b5b121f4122ba3c P 7ffdf999adba487a9887fe7e2cc0f874 [term 1 LEADER]: Becoming Leader. State: Replica: 7ffdf999adba487a9887fe7e2cc0f874, State: Running, Role: LEADER
I20260709 12:14:48.074121 25893 consensus_queue.cc:237] T 2b233b12bfbc42c18b5b121f4122ba3c P 7ffdf999adba487a9887fe7e2cc0f874 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:48.051451 25880 raft_consensus.cc:385] T d835765d07404362a68c773ddc446da5 P f2868245e89644679e2b7dac75591a58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:48.078331 25880 raft_consensus.cc:740] T d835765d07404362a68c773ddc446da5 P f2868245e89644679e2b7dac75591a58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f2868245e89644679e2b7dac75591a58, State: Initialized, Role: FOLLOWER
I20260709 12:14:48.079057 25880 consensus_queue.cc:260] T d835765d07404362a68c773ddc446da5 P f2868245e89644679e2b7dac75591a58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:48.080065 25559 raft_consensus.cc:2468] T d835765d07404362a68c773ddc446da5 P f2868245e89644679e2b7dac75591a58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e4eb6facf924880a0e38eeff91ba974 in term 0.
I20260709 12:14:48.087844 25880 ts_tablet_manager.cc:1434] T d835765d07404362a68c773ddc446da5 P f2868245e89644679e2b7dac75591a58: Time spent starting tablet: real 0.054s	user 0.006s	sys 0.000s
I20260709 12:14:48.085251 25597 leader_election.cc:304] T d835765d07404362a68c773ddc446da5 P 6e4eb6facf924880a0e38eeff91ba974 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e4eb6facf924880a0e38eeff91ba974, f2868245e89644679e2b7dac75591a58; no voters: 7ffdf999adba487a9887fe7e2cc0f874
I20260709 12:14:48.090670 25896 raft_consensus.cc:2804] T d835765d07404362a68c773ddc446da5 P 6e4eb6facf924880a0e38eeff91ba974 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:48.091064 25896 raft_consensus.cc:493] T d835765d07404362a68c773ddc446da5 P 6e4eb6facf924880a0e38eeff91ba974 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:48.091404 25896 raft_consensus.cc:3060] T d835765d07404362a68c773ddc446da5 P 6e4eb6facf924880a0e38eeff91ba974 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:48.104929 25860 raft_consensus.cc:493] T 5a26b0bedc3c4a8c99946f8e5565d353 P f2868245e89644679e2b7dac75591a58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:48.105640 25860 raft_consensus.cc:515] T 5a26b0bedc3c4a8c99946f8e5565d353 P f2868245e89644679e2b7dac75591a58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:48.108084 25860 leader_election.cc:290] T 5a26b0bedc3c4a8c99946f8e5565d353 P f2868245e89644679e2b7dac75591a58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6e4eb6facf924880a0e38eeff91ba974 (127.12.174.130:41805), 7ffdf999adba487a9887fe7e2cc0f874 (127.12.174.131:36809)
I20260709 12:14:48.110144 25706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a26b0bedc3c4a8c99946f8e5565d353" candidate_uuid: "f2868245e89644679e2b7dac75591a58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffdf999adba487a9887fe7e2cc0f874" is_pre_election: true
I20260709 12:14:48.110918 25706 raft_consensus.cc:2468] T 5a26b0bedc3c4a8c99946f8e5565d353 P 7ffdf999adba487a9887fe7e2cc0f874 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f2868245e89644679e2b7dac75591a58 in term 0.
I20260709 12:14:48.112385 25525 leader_election.cc:304] T 5a26b0bedc3c4a8c99946f8e5565d353 P f2868245e89644679e2b7dac75591a58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffdf999adba487a9887fe7e2cc0f874, f2868245e89644679e2b7dac75591a58; no voters: 
I20260709 12:14:48.114562 25882 raft_consensus.cc:2804] T 5a26b0bedc3c4a8c99946f8e5565d353 P f2868245e89644679e2b7dac75591a58 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:14:48.114944 25882 raft_consensus.cc:493] T 5a26b0bedc3c4a8c99946f8e5565d353 P f2868245e89644679e2b7dac75591a58 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:14:48.115268 25882 raft_consensus.cc:3060] T 5a26b0bedc3c4a8c99946f8e5565d353 P f2868245e89644679e2b7dac75591a58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:48.119513 25632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a26b0bedc3c4a8c99946f8e5565d353" candidate_uuid: "f2868245e89644679e2b7dac75591a58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e4eb6facf924880a0e38eeff91ba974" is_pre_election: true
I20260709 12:14:48.120507 25632 raft_consensus.cc:2468] T 5a26b0bedc3c4a8c99946f8e5565d353 P 6e4eb6facf924880a0e38eeff91ba974 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f2868245e89644679e2b7dac75591a58 in term 0.
I20260709 12:14:48.126466 25926 raft_consensus.cc:493] T 73781eedcc0f4dbd9bdd82d8ca269bd3 P 6e4eb6facf924880a0e38eeff91ba974 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:48.129168 25882 raft_consensus.cc:515] T 5a26b0bedc3c4a8c99946f8e5565d353 P f2868245e89644679e2b7dac75591a58 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:48.133654 25926 raft_consensus.cc:515] T 73781eedcc0f4dbd9bdd82d8ca269bd3 P 6e4eb6facf924880a0e38eeff91ba974 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:48.136560 25632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a26b0bedc3c4a8c99946f8e5565d353" candidate_uuid: "f2868245e89644679e2b7dac75591a58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e4eb6facf924880a0e38eeff91ba974"
I20260709 12:14:48.139138 25632 raft_consensus.cc:3060] T 5a26b0bedc3c4a8c99946f8e5565d353 P 6e4eb6facf924880a0e38eeff91ba974 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:48.144341 25882 leader_election.cc:290] T 5a26b0bedc3c4a8c99946f8e5565d353 P f2868245e89644679e2b7dac75591a58 [CANDIDATE]: Term 1 election: Requested vote from peers 6e4eb6facf924880a0e38eeff91ba974 (127.12.174.130:41805), 7ffdf999adba487a9887fe7e2cc0f874 (127.12.174.131:36809)
I20260709 12:14:48.130632 25896 raft_consensus.cc:515] T d835765d07404362a68c773ddc446da5 P 6e4eb6facf924880a0e38eeff91ba974 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:48.146996 25896 leader_election.cc:290] T d835765d07404362a68c773ddc446da5 P 6e4eb6facf924880a0e38eeff91ba974 [CANDIDATE]: Term 1 election: Requested vote from peers f2868245e89644679e2b7dac75591a58 (127.12.174.129:40387), 7ffdf999adba487a9887fe7e2cc0f874 (127.12.174.131:36809)
I20260709 12:14:48.149940 25559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d835765d07404362a68c773ddc446da5" candidate_uuid: "6e4eb6facf924880a0e38eeff91ba974" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f2868245e89644679e2b7dac75591a58"
I20260709 12:14:48.167784 25559 raft_consensus.cc:3060] T d835765d07404362a68c773ddc446da5 P f2868245e89644679e2b7dac75591a58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:48.151361 25860 consensus_queue.cc:1048] T 7abbe96052d8434cb1e2afd960768847 P f2868245e89644679e2b7dac75591a58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:48.153414 25706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d835765d07404362a68c773ddc446da5" candidate_uuid: "6e4eb6facf924880a0e38eeff91ba974" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffdf999adba487a9887fe7e2cc0f874"
W20260709 12:14:48.171176 25600 leader_election.cc:343] T d835765d07404362a68c773ddc446da5 P 6e4eb6facf924880a0e38eeff91ba974 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7ffdf999adba487a9887fe7e2cc0f874 (127.12.174.131:36809): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:14:48.168710 25456 catalog_manager.cc:5697] T 2b233b12bfbc42c18b5b121f4122ba3c P 7ffdf999adba487a9887fe7e2cc0f874 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7ffdf999adba487a9887fe7e2cc0f874 (127.12.174.131). New cstate: current_term: 1 leader_uuid: "7ffdf999adba487a9887fe7e2cc0f874" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:48.159236 25632 raft_consensus.cc:2468] T 5a26b0bedc3c4a8c99946f8e5565d353 P 6e4eb6facf924880a0e38eeff91ba974 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f2868245e89644679e2b7dac75591a58 in term 1.
I20260709 12:14:48.161337 25708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a26b0bedc3c4a8c99946f8e5565d353" candidate_uuid: "f2868245e89644679e2b7dac75591a58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffdf999adba487a9887fe7e2cc0f874"
I20260709 12:14:48.165704 25558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73781eedcc0f4dbd9bdd82d8ca269bd3" candidate_uuid: "6e4eb6facf924880a0e38eeff91ba974" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f2868245e89644679e2b7dac75591a58" is_pre_election: true
I20260709 12:14:48.176524 25708 raft_consensus.cc:3060] T 5a26b0bedc3c4a8c99946f8e5565d353 P 7ffdf999adba487a9887fe7e2cc0f874 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:48.181352 25706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73781eedcc0f4dbd9bdd82d8ca269bd3" candidate_uuid: "6e4eb6facf924880a0e38eeff91ba974" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ffdf999adba487a9887fe7e2cc0f874" is_pre_election: true
I20260709 12:14:48.182548 25706 raft_consensus.cc:2393] T 73781eedcc0f4dbd9bdd82d8ca269bd3 P 7ffdf999adba487a9887fe7e2cc0f874 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e4eb6facf924880a0e38eeff91ba974 in current term 1: Already voted for candidate f2868245e89644679e2b7dac75591a58 in this term.
I20260709 12:14:48.186795 25522 leader_election.cc:304] T 5a26b0bedc3c4a8c99946f8e5565d353 P f2868245e89644679e2b7dac75591a58 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e4eb6facf924880a0e38eeff91ba974, f2868245e89644679e2b7dac75591a58; no voters: 
I20260709 12:14:48.188647 25860 raft_consensus.cc:2804] T 5a26b0bedc3c4a8c99946f8e5565d353 P f2868245e89644679e2b7dac75591a58 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:48.189054 25860 raft_consensus.cc:697] T 5a26b0bedc3c4a8c99946f8e5565d353 P f2868245e89644679e2b7dac75591a58 [term 1 LEADER]: Becoming Leader. State: Replica: f2868245e89644679e2b7dac75591a58, State: Running, Role: LEADER
I20260709 12:14:48.189918 25860 consensus_queue.cc:237] T 5a26b0bedc3c4a8c99946f8e5565d353 P f2868245e89644679e2b7dac75591a58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:48.197715 25559 raft_consensus.cc:2468] T d835765d07404362a68c773ddc446da5 P f2868245e89644679e2b7dac75591a58 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e4eb6facf924880a0e38eeff91ba974 in term 1.
I20260709 12:14:48.207827 25597 leader_election.cc:304] T d835765d07404362a68c773ddc446da5 P 6e4eb6facf924880a0e38eeff91ba974 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e4eb6facf924880a0e38eeff91ba974, f2868245e89644679e2b7dac75591a58; no voters: 7ffdf999adba487a9887fe7e2cc0f874
I20260709 12:14:48.209918 25879 tablet_bootstrap.cc:492] T d835765d07404362a68c773ddc446da5 P 7ffdf999adba487a9887fe7e2cc0f874: No bootstrap required, opened a new log
I20260709 12:14:48.210577 25879 ts_tablet_manager.cc:1403] T d835765d07404362a68c773ddc446da5 P 7ffdf999adba487a9887fe7e2cc0f874: Time spent bootstrapping tablet: real 0.187s	user 0.038s	sys 0.036s
I20260709 12:14:48.183683 25926 leader_election.cc:290] T 73781eedcc0f4dbd9bdd82d8ca269bd3 P 6e4eb6facf924880a0e38eeff91ba974 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f2868245e89644679e2b7dac75591a58 (127.12.174.129:40387), 7ffdf999adba487a9887fe7e2cc0f874 (127.12.174.131:36809)
I20260709 12:14:48.214233 25600 leader_election.cc:304] T 73781eedcc0f4dbd9bdd82d8ca269bd3 P 6e4eb6facf924880a0e38eeff91ba974 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e4eb6facf924880a0e38eeff91ba974; no voters: 7ffdf999adba487a9887fe7e2cc0f874, f2868245e89644679e2b7dac75591a58
I20260709 12:14:48.221414 25879 raft_consensus.cc:359] T d835765d07404362a68c773ddc446da5 P 7ffdf999adba487a9887fe7e2cc0f874 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:48.223150 25879 raft_consensus.cc:385] T d835765d07404362a68c773ddc446da5 P 7ffdf999adba487a9887fe7e2cc0f874 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:14:48.223466 25879 raft_consensus.cc:740] T d835765d07404362a68c773ddc446da5 P 7ffdf999adba487a9887fe7e2cc0f874 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ffdf999adba487a9887fe7e2cc0f874, State: Initialized, Role: FOLLOWER
I20260709 12:14:48.213649 25896 raft_consensus.cc:2804] T d835765d07404362a68c773ddc446da5 P 6e4eb6facf924880a0e38eeff91ba974 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:14:48.229805 25879 consensus_queue.cc:260] T d835765d07404362a68c773ddc446da5 P 7ffdf999adba487a9887fe7e2cc0f874 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:48.238552 25896 raft_consensus.cc:697] T d835765d07404362a68c773ddc446da5 P 6e4eb6facf924880a0e38eeff91ba974 [term 1 LEADER]: Becoming Leader. State: Replica: 6e4eb6facf924880a0e38eeff91ba974, State: Running, Role: LEADER
I20260709 12:14:48.239813 25896 consensus_queue.cc:237] T d835765d07404362a68c773ddc446da5 P 6e4eb6facf924880a0e38eeff91ba974 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:48.242326 25879 ts_tablet_manager.cc:1434] T d835765d07404362a68c773ddc446da5 P 7ffdf999adba487a9887fe7e2cc0f874: Time spent starting tablet: real 0.031s	user 0.008s	sys 0.000s
I20260709 12:14:48.251221 25928 consensus_queue.cc:1048] T fb492c949c97458a940dfcbd02a034cf P 7ffdf999adba487a9887fe7e2cc0f874 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:48.234162 25926 raft_consensus.cc:3060] T 73781eedcc0f4dbd9bdd82d8ca269bd3 P 6e4eb6facf924880a0e38eeff91ba974 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:48.268741 25895 consensus_queue.cc:1048] T 556f2a498099427e9a90c94542674f0f P f2868245e89644679e2b7dac75591a58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:48.282549 25895 consensus_queue.cc:1048] T 556f2a498099427e9a90c94542674f0f P f2868245e89644679e2b7dac75591a58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:48.297796 25708 raft_consensus.cc:2468] T 5a26b0bedc3c4a8c99946f8e5565d353 P 7ffdf999adba487a9887fe7e2cc0f874 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f2868245e89644679e2b7dac75591a58 in term 1.
I20260709 12:14:48.300082 25895 consensus_queue.cc:1048] T 7abbe96052d8434cb1e2afd960768847 P f2868245e89644679e2b7dac75591a58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:48.306140 25456 catalog_manager.cc:5697] T 5a26b0bedc3c4a8c99946f8e5565d353 P f2868245e89644679e2b7dac75591a58 reported cstate change: term changed from 0 to 1, leader changed from <none> to f2868245e89644679e2b7dac75591a58 (127.12.174.129). New cstate: current_term: 1 leader_uuid: "f2868245e89644679e2b7dac75591a58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:48.323263 25925 raft_consensus.cc:493] T 843ddab732fd4de99b4267d7abfd735e P 7ffdf999adba487a9887fe7e2cc0f874 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:48.324225 25925 raft_consensus.cc:515] T 843ddab732fd4de99b4267d7abfd735e P 7ffdf999adba487a9887fe7e2cc0f874 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:48.323755 25454 catalog_manager.cc:5697] T d835765d07404362a68c773ddc446da5 P 6e4eb6facf924880a0e38eeff91ba974 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6e4eb6facf924880a0e38eeff91ba974 (127.12.174.130). New cstate: current_term: 1 leader_uuid: "6e4eb6facf924880a0e38eeff91ba974" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:48.329192 25559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843ddab732fd4de99b4267d7abfd735e" candidate_uuid: "7ffdf999adba487a9887fe7e2cc0f874" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f2868245e89644679e2b7dac75591a58" is_pre_election: true
I20260709 12:14:48.330691 25925 leader_election.cc:290] T 843ddab732fd4de99b4267d7abfd735e P 7ffdf999adba487a9887fe7e2cc0f874 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f2868245e89644679e2b7dac75591a58 (127.12.174.129:40387), 6e4eb6facf924880a0e38eeff91ba974 (127.12.174.130:41805)
I20260709 12:14:48.335047 25634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843ddab732fd4de99b4267d7abfd735e" candidate_uuid: "7ffdf999adba487a9887fe7e2cc0f874" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e4eb6facf924880a0e38eeff91ba974" is_pre_election: true
I20260709 12:14:48.336633 25634 raft_consensus.cc:2393] T 843ddab732fd4de99b4267d7abfd735e P 6e4eb6facf924880a0e38eeff91ba974 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ffdf999adba487a9887fe7e2cc0f874 in current term 1: Already voted for candidate f2868245e89644679e2b7dac75591a58 in this term.
I20260709 12:14:48.340273 25671 leader_election.cc:304] T 843ddab732fd4de99b4267d7abfd735e P 7ffdf999adba487a9887fe7e2cc0f874 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ffdf999adba487a9887fe7e2cc0f874; no voters: 6e4eb6facf924880a0e38eeff91ba974, f2868245e89644679e2b7dac75591a58
I20260709 12:14:48.341895 25925 raft_consensus.cc:3060] T 843ddab732fd4de99b4267d7abfd735e P 7ffdf999adba487a9887fe7e2cc0f874 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:48.337322 25926 raft_consensus.cc:2749] T 73781eedcc0f4dbd9bdd82d8ca269bd3 P 6e4eb6facf924880a0e38eeff91ba974 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:48.354229 25925 raft_consensus.cc:2749] T 843ddab732fd4de99b4267d7abfd735e P 7ffdf999adba487a9887fe7e2cc0f874 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:14:48.360684 25897 consensus_queue.cc:1048] T 73781eedcc0f4dbd9bdd82d8ca269bd3 P f2868245e89644679e2b7dac75591a58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:48.361006 25928 consensus_queue.cc:1048] T 927ba57ba7864989a49c8265b14a9c0a P 7ffdf999adba487a9887fe7e2cc0f874 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:48.382020 25925 consensus_queue.cc:1048] T 927ba57ba7864989a49c8265b14a9c0a P 7ffdf999adba487a9887fe7e2cc0f874 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:48.413008 25895 consensus_queue.cc:1048] T 843ddab732fd4de99b4267d7abfd735e P f2868245e89644679e2b7dac75591a58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:48.413260 25860 consensus_queue.cc:1048] T 73781eedcc0f4dbd9bdd82d8ca269bd3 P f2868245e89644679e2b7dac75591a58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:48.446171 25897 consensus_queue.cc:1048] T 843ddab732fd4de99b4267d7abfd735e P f2868245e89644679e2b7dac75591a58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:48.511988 25789 consensus_queue.cc:1048] T 2b233b12bfbc42c18b5b121f4122ba3c P 7ffdf999adba487a9887fe7e2cc0f874 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:48.527743 25789 consensus_queue.cc:1048] T 2b233b12bfbc42c18b5b121f4122ba3c P 7ffdf999adba487a9887fe7e2cc0f874 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:48.579034 25708 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fb492c949c97458a940dfcbd02a034cf"
dest_uuid: "7ffdf999adba487a9887fe7e2cc0f874"
mode: GRACEFUL
new_leader_uuid: "f2868245e89644679e2b7dac75591a58"
 from {username='slave'} at 127.0.0.1:44260
I20260709 12:14:48.579629 25708 raft_consensus.cc:606] T fb492c949c97458a940dfcbd02a034cf P 7ffdf999adba487a9887fe7e2cc0f874 [term 1 LEADER]: Received request to transfer leadership to TS f2868245e89644679e2b7dac75591a58
I20260709 12:14:48.585263 25708 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "927ba57ba7864989a49c8265b14a9c0a"
dest_uuid: "7ffdf999adba487a9887fe7e2cc0f874"
mode: GRACEFUL
new_leader_uuid: "f2868245e89644679e2b7dac75591a58"
 from {username='slave'} at 127.0.0.1:44260
I20260709 12:14:48.585908 25708 raft_consensus.cc:606] T 927ba57ba7864989a49c8265b14a9c0a P 7ffdf999adba487a9887fe7e2cc0f874 [term 1 LEADER]: Received request to transfer leadership to TS f2868245e89644679e2b7dac75591a58
I20260709 12:14:48.594177 25708 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2b233b12bfbc42c18b5b121f4122ba3c"
dest_uuid: "7ffdf999adba487a9887fe7e2cc0f874"
mode: GRACEFUL
new_leader_uuid: "6e4eb6facf924880a0e38eeff91ba974"
 from {username='slave'} at 127.0.0.1:44260
I20260709 12:14:48.594782 25708 raft_consensus.cc:606] T 2b233b12bfbc42c18b5b121f4122ba3c P 7ffdf999adba487a9887fe7e2cc0f874 [term 1 LEADER]: Received request to transfer leadership to TS 6e4eb6facf924880a0e38eeff91ba974
I20260709 12:14:48.600474 25559 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "73781eedcc0f4dbd9bdd82d8ca269bd3"
dest_uuid: "f2868245e89644679e2b7dac75591a58"
mode: GRACEFUL
new_leader_uuid: "6e4eb6facf924880a0e38eeff91ba974"
 from {username='slave'} at 127.0.0.1:38814
I20260709 12:14:48.601058 25559 raft_consensus.cc:606] T 73781eedcc0f4dbd9bdd82d8ca269bd3 P f2868245e89644679e2b7dac75591a58 [term 1 LEADER]: Received request to transfer leadership to TS 6e4eb6facf924880a0e38eeff91ba974
I20260709 12:14:48.607198 25559 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5a26b0bedc3c4a8c99946f8e5565d353"
dest_uuid: "f2868245e89644679e2b7dac75591a58"
mode: GRACEFUL
new_leader_uuid: "6e4eb6facf924880a0e38eeff91ba974"
 from {username='slave'} at 127.0.0.1:38814
I20260709 12:14:48.607779 25559 raft_consensus.cc:606] T 5a26b0bedc3c4a8c99946f8e5565d353 P f2868245e89644679e2b7dac75591a58 [term 1 LEADER]: Received request to transfer leadership to TS 6e4eb6facf924880a0e38eeff91ba974
I20260709 12:14:48.613699 25559 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "843ddab732fd4de99b4267d7abfd735e"
dest_uuid: "f2868245e89644679e2b7dac75591a58"
mode: GRACEFUL
new_leader_uuid: "6e4eb6facf924880a0e38eeff91ba974"
 from {username='slave'} at 127.0.0.1:38814
I20260709 12:14:48.614571 25559 raft_consensus.cc:606] T 843ddab732fd4de99b4267d7abfd735e P f2868245e89644679e2b7dac75591a58 [term 1 LEADER]: Received request to transfer leadership to TS 6e4eb6facf924880a0e38eeff91ba974
I20260709 12:14:48.621186 25633 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d835765d07404362a68c773ddc446da5"
dest_uuid: "6e4eb6facf924880a0e38eeff91ba974"
mode: GRACEFUL
new_leader_uuid: "7ffdf999adba487a9887fe7e2cc0f874"
 from {username='slave'} at 127.0.0.1:46492
I20260709 12:14:48.621948 25633 raft_consensus.cc:606] T d835765d07404362a68c773ddc446da5 P 6e4eb6facf924880a0e38eeff91ba974 [term 1 LEADER]: Received request to transfer leadership to TS 7ffdf999adba487a9887fe7e2cc0f874
I20260709 12:14:48.623850 25897 consensus_queue.cc:1048] T 5a26b0bedc3c4a8c99946f8e5565d353 P f2868245e89644679e2b7dac75591a58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:48.631377 25882 raft_consensus.cc:993] T 5a26b0bedc3c4a8c99946f8e5565d353 P f2868245e89644679e2b7dac75591a58: : Instructing follower 6e4eb6facf924880a0e38eeff91ba974 to start an election
I20260709 12:14:48.631981 25882 raft_consensus.cc:1081] T 5a26b0bedc3c4a8c99946f8e5565d353 P f2868245e89644679e2b7dac75591a58 [term 1 LEADER]: Signalling peer 6e4eb6facf924880a0e38eeff91ba974 to start an election
I20260709 12:14:48.637279 25634 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5a26b0bedc3c4a8c99946f8e5565d353"
dest_uuid: "6e4eb6facf924880a0e38eeff91ba974"
 from {username='slave'} at 127.0.0.1:33044
I20260709 12:14:48.638012 25634 raft_consensus.cc:493] T 5a26b0bedc3c4a8c99946f8e5565d353 P 6e4eb6facf924880a0e38eeff91ba974 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:48.638361 25634 raft_consensus.cc:3060] T 5a26b0bedc3c4a8c99946f8e5565d353 P 6e4eb6facf924880a0e38eeff91ba974 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:48.644169 25882 consensus_queue.cc:1048] T 5a26b0bedc3c4a8c99946f8e5565d353 P f2868245e89644679e2b7dac75591a58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:48.647413 25634 raft_consensus.cc:515] T 5a26b0bedc3c4a8c99946f8e5565d353 P 6e4eb6facf924880a0e38eeff91ba974 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:48.649423 25633 raft_consensus.cc:1240] T 5a26b0bedc3c4a8c99946f8e5565d353 P 6e4eb6facf924880a0e38eeff91ba974 [term 2 FOLLOWER]: Rejecting Update request from peer f2868245e89644679e2b7dac75591a58 for earlier term 1. Current term is 2. Ops: []
I20260709 12:14:48.651901 25706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a26b0bedc3c4a8c99946f8e5565d353" candidate_uuid: "6e4eb6facf924880a0e38eeff91ba974" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7ffdf999adba487a9887fe7e2cc0f874"
I20260709 12:14:48.652441 25634 leader_election.cc:290] T 5a26b0bedc3c4a8c99946f8e5565d353 P 6e4eb6facf924880a0e38eeff91ba974 [CANDIDATE]: Term 2 election: Requested vote from peers f2868245e89644679e2b7dac75591a58 (127.12.174.129:40387), 7ffdf999adba487a9887fe7e2cc0f874 (127.12.174.131:36809)
I20260709 12:14:48.653992 25882 consensus_queue.cc:1059] T 5a26b0bedc3c4a8c99946f8e5565d353 P f2868245e89644679e2b7dac75591a58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:48.655068 25897 raft_consensus.cc:3055] T 5a26b0bedc3c4a8c99946f8e5565d353 P f2868245e89644679e2b7dac75591a58 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:48.655442 25897 raft_consensus.cc:740] T 5a26b0bedc3c4a8c99946f8e5565d353 P f2868245e89644679e2b7dac75591a58 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f2868245e89644679e2b7dac75591a58, State: Running, Role: LEADER
I20260709 12:14:48.656374 25897 consensus_queue.cc:260] T 5a26b0bedc3c4a8c99946f8e5565d353 P f2868245e89644679e2b7dac75591a58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:48.656810 25706 raft_consensus.cc:3060] T d835765d07404362a68c773ddc446da5 P 7ffdf999adba487a9887fe7e2cc0f874 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:14:48.657608 25897 raft_consensus.cc:3060] T 5a26b0bedc3c4a8c99946f8e5565d353 P f2868245e89644679e2b7dac75591a58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:48.655476 25559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a26b0bedc3c4a8c99946f8e5565d353" candidate_uuid: "6e4eb6facf924880a0e38eeff91ba974" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f2868245e89644679e2b7dac75591a58"
I20260709 12:14:48.667773 25789 raft_consensus.cc:493] T d835765d07404362a68c773ddc446da5 P 7ffdf999adba487a9887fe7e2cc0f874 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:14:48.668521 25789 raft_consensus.cc:515] T d835765d07404362a68c773ddc446da5 P 7ffdf999adba487a9887fe7e2cc0f874 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:48.668926 25927 consensus_queue.cc:1048] T d835765d07404362a68c773ddc446da5 P 6e4eb6facf924880a0e38eeff91ba974 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:14:48.674081 25558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d835765d07404362a68c773ddc446da5" candidate_uuid: "7ffdf999adba487a9887fe7e2cc0f874" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f2868245e89644679e2b7dac75591a58" is_pre_election: true
I20260709 12:14:48.674770 25558 raft_consensus.cc:2468] T d835765d07404362a68c773ddc446da5 P f2868245e89644679e2b7dac75591a58 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ffdf999adba487a9887fe7e2cc0f874 in term 1.
I20260709 12:14:48.676604 25671 leader_election.cc:304] T d835765d07404362a68c773ddc446da5 P 7ffdf999adba487a9887fe7e2cc0f874 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffdf999adba487a9887fe7e2cc0f874, f2868245e89644679e2b7dac75591a58; no voters: 
I20260709 12:14:48.682181 25789 leader_election.cc:290] T d835765d07404362a68c773ddc446da5 P 7ffdf999adba487a9887fe7e2cc0f874 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f2868245e89644679e2b7dac75591a58 (127.12.174.129:40387), 6e4eb6facf924880a0e38eeff91ba974 (127.12.174.130:41805)
I20260709 12:14:48.682375 25634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d835765d07404362a68c773ddc446da5" candidate_uuid: "7ffdf999adba487a9887fe7e2cc0f874" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e4eb6facf924880a0e38eeff91ba974" is_pre_election: true
I20260709 12:14:48.683563 25893 raft_consensus.cc:2804] T d835765d07404362a68c773ddc446da5 P 7ffdf999adba487a9887fe7e2cc0f874 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:14:48.685587 25893 raft_consensus.cc:493] T d835765d07404362a68c773ddc446da5 P 7ffdf999adba487a9887fe7e2cc0f874 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6e4eb6facf924880a0e38eeff91ba974)
I20260709 12:14:48.686066 25893 raft_consensus.cc:3060] T d835765d07404362a68c773ddc446da5 P 7ffdf999adba487a9887fe7e2cc0f874 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:48.688572 25559 raft_consensus.cc:2468] T 5a26b0bedc3c4a8c99946f8e5565d353 P f2868245e89644679e2b7dac75591a58 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e4eb6facf924880a0e38eeff91ba974 in term 2.
I20260709 12:14:48.691201 25597 leader_election.cc:304] T 5a26b0bedc3c4a8c99946f8e5565d353 P 6e4eb6facf924880a0e38eeff91ba974 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e4eb6facf924880a0e38eeff91ba974, f2868245e89644679e2b7dac75591a58; no voters: 7ffdf999adba487a9887fe7e2cc0f874
I20260709 12:14:48.692097 25927 raft_consensus.cc:2804] T 5a26b0bedc3c4a8c99946f8e5565d353 P 6e4eb6facf924880a0e38eeff91ba974 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:48.692579 25927 raft_consensus.cc:697] T 5a26b0bedc3c4a8c99946f8e5565d353 P 6e4eb6facf924880a0e38eeff91ba974 [term 2 LEADER]: Becoming Leader. State: Replica: 6e4eb6facf924880a0e38eeff91ba974, State: Running, Role: LEADER
I20260709 12:14:48.693421 25927 consensus_queue.cc:237] T 5a26b0bedc3c4a8c99946f8e5565d353 P 6e4eb6facf924880a0e38eeff91ba974 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:48.697171 25893 raft_consensus.cc:515] T d835765d07404362a68c773ddc446da5 P 7ffdf999adba487a9887fe7e2cc0f874 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:48.700131 25926 raft_consensus.cc:993] T d835765d07404362a68c773ddc446da5 P 6e4eb6facf924880a0e38eeff91ba974: : Instructing follower 7ffdf999adba487a9887fe7e2cc0f874 to start an election
I20260709 12:14:48.700665 25926 raft_consensus.cc:1081] T d835765d07404362a68c773ddc446da5 P 6e4eb6facf924880a0e38eeff91ba974 [term 1 LEADER]: Signalling peer 7ffdf999adba487a9887fe7e2cc0f874 to start an election
I20260709 12:14:48.702263 25893 leader_election.cc:290] T d835765d07404362a68c773ddc446da5 P 7ffdf999adba487a9887fe7e2cc0f874 [CANDIDATE]: Term 2 election: Requested vote from peers f2868245e89644679e2b7dac75591a58 (127.12.174.129:40387), 6e4eb6facf924880a0e38eeff91ba974 (127.12.174.130:41805)
I20260709 12:14:48.704478 25706 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d835765d07404362a68c773ddc446da5"
dest_uuid: "7ffdf999adba487a9887fe7e2cc0f874"
 from {username='slave'} at 127.0.0.1:57670
I20260709 12:14:48.703366 25634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d835765d07404362a68c773ddc446da5" candidate_uuid: "7ffdf999adba487a9887fe7e2cc0f874" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6e4eb6facf924880a0e38eeff91ba974"
I20260709 12:14:48.708101 25457 catalog_manager.cc:5697] T 5a26b0bedc3c4a8c99946f8e5565d353 P 6e4eb6facf924880a0e38eeff91ba974 reported cstate change: term changed from 1 to 2, leader changed from f2868245e89644679e2b7dac75591a58 (127.12.174.129) to 6e4eb6facf924880a0e38eeff91ba974 (127.12.174.130). New cstate: current_term: 2 leader_uuid: "6e4eb6facf924880a0e38eeff91ba974" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:48.705183 25706 raft_consensus.cc:493] T d835765d07404362a68c773ddc446da5 P 7ffdf999adba487a9887fe7e2cc0f874 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:48.709837 25706 raft_consensus.cc:3060] T d835765d07404362a68c773ddc446da5 P 7ffdf999adba487a9887fe7e2cc0f874 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:48.703253 25559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d835765d07404362a68c773ddc446da5" candidate_uuid: "7ffdf999adba487a9887fe7e2cc0f874" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f2868245e89644679e2b7dac75591a58"
I20260709 12:14:48.712510 25559 raft_consensus.cc:3060] T d835765d07404362a68c773ddc446da5 P f2868245e89644679e2b7dac75591a58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:48.711712 25927 consensus_queue.cc:1048] T d835765d07404362a68c773ddc446da5 P 6e4eb6facf924880a0e38eeff91ba974 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:48.724309 25706 raft_consensus.cc:515] T d835765d07404362a68c773ddc446da5 P 7ffdf999adba487a9887fe7e2cc0f874 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:48.725600 25708 raft_consensus.cc:1240] T d835765d07404362a68c773ddc446da5 P 7ffdf999adba487a9887fe7e2cc0f874 [term 3 FOLLOWER]: Rejecting Update request from peer 6e4eb6facf924880a0e38eeff91ba974 for earlier term 1. Current term is 3. Ops: []
I20260709 12:14:48.728120 25927 consensus_queue.cc:1059] T d835765d07404362a68c773ddc446da5 P 6e4eb6facf924880a0e38eeff91ba974 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:48.729043 25927 raft_consensus.cc:3055] T d835765d07404362a68c773ddc446da5 P 6e4eb6facf924880a0e38eeff91ba974 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:48.729202 25557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d835765d07404362a68c773ddc446da5" candidate_uuid: "7ffdf999adba487a9887fe7e2cc0f874" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f2868245e89644679e2b7dac75591a58"
I20260709 12:14:48.730470 25927 raft_consensus.cc:740] T d835765d07404362a68c773ddc446da5 P 6e4eb6facf924880a0e38eeff91ba974 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6e4eb6facf924880a0e38eeff91ba974, State: Running, Role: LEADER
I20260709 12:14:48.731371 25706 leader_election.cc:290] T d835765d07404362a68c773ddc446da5 P 7ffdf999adba487a9887fe7e2cc0f874 [CANDIDATE]: Term 3 election: Requested vote from peers f2868245e89644679e2b7dac75591a58 (127.12.174.129:40387), 6e4eb6facf924880a0e38eeff91ba974 (127.12.174.130:41805)
I20260709 12:14:48.731611 25927 consensus_queue.cc:260] T d835765d07404362a68c773ddc446da5 P 6e4eb6facf924880a0e38eeff91ba974 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:48.733570 25927 raft_consensus.cc:3060] T d835765d07404362a68c773ddc446da5 P 6e4eb6facf924880a0e38eeff91ba974 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:14:48.733775 25634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d835765d07404362a68c773ddc446da5" candidate_uuid: "7ffdf999adba487a9887fe7e2cc0f874" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6e4eb6facf924880a0e38eeff91ba974"
I20260709 12:14:48.735947 25559 raft_consensus.cc:2468] T d835765d07404362a68c773ddc446da5 P f2868245e89644679e2b7dac75591a58 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffdf999adba487a9887fe7e2cc0f874 in term 2.
I20260709 12:14:48.736814 25558 raft_consensus.cc:1240] T d835765d07404362a68c773ddc446da5 P f2868245e89644679e2b7dac75591a58 [term 2 FOLLOWER]: Rejecting Update request from peer 6e4eb6facf924880a0e38eeff91ba974 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 12:14:48.737308 25671 leader_election.cc:304] T d835765d07404362a68c773ddc446da5 P 7ffdf999adba487a9887fe7e2cc0f874 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ffdf999adba487a9887fe7e2cc0f874, f2868245e89644679e2b7dac75591a58; no voters: 6e4eb6facf924880a0e38eeff91ba974
I20260709 12:14:48.738255 25893 raft_consensus.cc:2764] T d835765d07404362a68c773ddc446da5 P 7ffdf999adba487a9887fe7e2cc0f874 [term 3 FOLLOWER]: Leader election decision vote started in defunct term 2: won
I20260709 12:14:48.750481 25634 raft_consensus.cc:2468] T d835765d07404362a68c773ddc446da5 P 6e4eb6facf924880a0e38eeff91ba974 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffdf999adba487a9887fe7e2cc0f874 in term 3.
I20260709 12:14:48.752211 25671 leader_election.cc:304] T d835765d07404362a68c773ddc446da5 P 7ffdf999adba487a9887fe7e2cc0f874 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e4eb6facf924880a0e38eeff91ba974, 7ffdf999adba487a9887fe7e2cc0f874; no voters: f2868245e89644679e2b7dac75591a58
I20260709 12:14:48.753198 25893 raft_consensus.cc:2804] T d835765d07404362a68c773ddc446da5 P 7ffdf999adba487a9887fe7e2cc0f874 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:48.753816 25893 raft_consensus.cc:697] T d835765d07404362a68c773ddc446da5 P 7ffdf999adba487a9887fe7e2cc0f874 [term 3 LEADER]: Becoming Leader. State: Replica: 7ffdf999adba487a9887fe7e2cc0f874, State: Running, Role: LEADER
I20260709 12:14:48.754992 25893 consensus_queue.cc:237] T d835765d07404362a68c773ddc446da5 P 7ffdf999adba487a9887fe7e2cc0f874 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:48.764087 25456 catalog_manager.cc:5697] T d835765d07404362a68c773ddc446da5 P 7ffdf999adba487a9887fe7e2cc0f874 reported cstate change: term changed from 1 to 3, leader changed from 6e4eb6facf924880a0e38eeff91ba974 (127.12.174.130) to 7ffdf999adba487a9887fe7e2cc0f874 (127.12.174.131). New cstate: current_term: 3 leader_uuid: "7ffdf999adba487a9887fe7e2cc0f874" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:48.796047 25789 raft_consensus.cc:993] T fb492c949c97458a940dfcbd02a034cf P 7ffdf999adba487a9887fe7e2cc0f874: : Instructing follower f2868245e89644679e2b7dac75591a58 to start an election
I20260709 12:14:48.796558 25893 raft_consensus.cc:1081] T fb492c949c97458a940dfcbd02a034cf P 7ffdf999adba487a9887fe7e2cc0f874 [term 1 LEADER]: Signalling peer f2868245e89644679e2b7dac75591a58 to start an election
I20260709 12:14:48.798332 25558 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fb492c949c97458a940dfcbd02a034cf"
dest_uuid: "f2868245e89644679e2b7dac75591a58"
 from {username='slave'} at 127.0.0.1:36712
I20260709 12:14:48.798971 25558 raft_consensus.cc:493] T fb492c949c97458a940dfcbd02a034cf P f2868245e89644679e2b7dac75591a58 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:48.799332 25558 raft_consensus.cc:3060] T fb492c949c97458a940dfcbd02a034cf P f2868245e89644679e2b7dac75591a58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:48.807475 25558 raft_consensus.cc:515] T fb492c949c97458a940dfcbd02a034cf P f2868245e89644679e2b7dac75591a58 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:48.809186 25558 leader_election.cc:290] T fb492c949c97458a940dfcbd02a034cf P f2868245e89644679e2b7dac75591a58 [CANDIDATE]: Term 2 election: Requested vote from peers 6e4eb6facf924880a0e38eeff91ba974 (127.12.174.130:41805), 7ffdf999adba487a9887fe7e2cc0f874 (127.12.174.131:36809)
I20260709 12:14:48.810395 25706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb492c949c97458a940dfcbd02a034cf" candidate_uuid: "f2868245e89644679e2b7dac75591a58" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7ffdf999adba487a9887fe7e2cc0f874"
I20260709 12:14:48.810513 25634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb492c949c97458a940dfcbd02a034cf" candidate_uuid: "f2868245e89644679e2b7dac75591a58" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6e4eb6facf924880a0e38eeff91ba974"
I20260709 12:14:48.811012 25706 raft_consensus.cc:3055] T fb492c949c97458a940dfcbd02a034cf P 7ffdf999adba487a9887fe7e2cc0f874 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:48.811172 25634 raft_consensus.cc:3060] T fb492c949c97458a940dfcbd02a034cf P 6e4eb6facf924880a0e38eeff91ba974 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:48.811303 25706 raft_consensus.cc:740] T fb492c949c97458a940dfcbd02a034cf P 7ffdf999adba487a9887fe7e2cc0f874 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7ffdf999adba487a9887fe7e2cc0f874, State: Running, Role: LEADER
I20260709 12:14:48.812201 25706 consensus_queue.cc:260] T fb492c949c97458a940dfcbd02a034cf P 7ffdf999adba487a9887fe7e2cc0f874 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:48.813198 25706 raft_consensus.cc:3060] T fb492c949c97458a940dfcbd02a034cf P 7ffdf999adba487a9887fe7e2cc0f874 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:48.818826 25706 raft_consensus.cc:2468] T fb492c949c97458a940dfcbd02a034cf P 7ffdf999adba487a9887fe7e2cc0f874 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f2868245e89644679e2b7dac75591a58 in term 2.
I20260709 12:14:48.819478 25634 raft_consensus.cc:2468] T fb492c949c97458a940dfcbd02a034cf P 6e4eb6facf924880a0e38eeff91ba974 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f2868245e89644679e2b7dac75591a58 in term 2.
I20260709 12:14:48.819965 25525 leader_election.cc:304] T fb492c949c97458a940dfcbd02a034cf P f2868245e89644679e2b7dac75591a58 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffdf999adba487a9887fe7e2cc0f874, f2868245e89644679e2b7dac75591a58; no voters: 
I20260709 12:14:48.820840 25897 raft_consensus.cc:2804] T fb492c949c97458a940dfcbd02a034cf P f2868245e89644679e2b7dac75591a58 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:48.821336 25897 raft_consensus.cc:697] T fb492c949c97458a940dfcbd02a034cf P f2868245e89644679e2b7dac75591a58 [term 2 LEADER]: Becoming Leader. State: Replica: f2868245e89644679e2b7dac75591a58, State: Running, Role: LEADER
I20260709 12:14:48.822844 25897 consensus_queue.cc:237] T fb492c949c97458a940dfcbd02a034cf P f2868245e89644679e2b7dac75591a58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:48.827847 25789 raft_consensus.cc:993] T 927ba57ba7864989a49c8265b14a9c0a P 7ffdf999adba487a9887fe7e2cc0f874: : Instructing follower f2868245e89644679e2b7dac75591a58 to start an election
I20260709 12:14:48.828301 25893 raft_consensus.cc:1081] T 927ba57ba7864989a49c8265b14a9c0a P 7ffdf999adba487a9887fe7e2cc0f874 [term 1 LEADER]: Signalling peer f2868245e89644679e2b7dac75591a58 to start an election
I20260709 12:14:48.830963 25558 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "927ba57ba7864989a49c8265b14a9c0a"
dest_uuid: "f2868245e89644679e2b7dac75591a58"
 from {username='slave'} at 127.0.0.1:36712
I20260709 12:14:48.831532 25558 raft_consensus.cc:493] T 927ba57ba7864989a49c8265b14a9c0a P f2868245e89644679e2b7dac75591a58 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:48.831876 25558 raft_consensus.cc:3060] T 927ba57ba7864989a49c8265b14a9c0a P f2868245e89644679e2b7dac75591a58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:48.832942 25456 catalog_manager.cc:5697] T fb492c949c97458a940dfcbd02a034cf P f2868245e89644679e2b7dac75591a58 reported cstate change: term changed from 1 to 2, leader changed from 7ffdf999adba487a9887fe7e2cc0f874 (127.12.174.131) to f2868245e89644679e2b7dac75591a58 (127.12.174.129). New cstate: current_term: 2 leader_uuid: "f2868245e89644679e2b7dac75591a58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:48.839599 25558 raft_consensus.cc:515] T 927ba57ba7864989a49c8265b14a9c0a P f2868245e89644679e2b7dac75591a58 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:48.842504 25558 leader_election.cc:290] T 927ba57ba7864989a49c8265b14a9c0a P f2868245e89644679e2b7dac75591a58 [CANDIDATE]: Term 2 election: Requested vote from peers 6e4eb6facf924880a0e38eeff91ba974 (127.12.174.130:41805), 7ffdf999adba487a9887fe7e2cc0f874 (127.12.174.131:36809)
I20260709 12:14:48.843663 25706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927ba57ba7864989a49c8265b14a9c0a" candidate_uuid: "f2868245e89644679e2b7dac75591a58" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7ffdf999adba487a9887fe7e2cc0f874"
I20260709 12:14:48.844376 25706 raft_consensus.cc:3055] T 927ba57ba7864989a49c8265b14a9c0a P 7ffdf999adba487a9887fe7e2cc0f874 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:48.844635 25706 raft_consensus.cc:740] T 927ba57ba7864989a49c8265b14a9c0a P 7ffdf999adba487a9887fe7e2cc0f874 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7ffdf999adba487a9887fe7e2cc0f874, State: Running, Role: LEADER
I20260709 12:14:48.845419 25706 consensus_queue.cc:260] T 927ba57ba7864989a49c8265b14a9c0a P 7ffdf999adba487a9887fe7e2cc0f874 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:48.846134 25634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "927ba57ba7864989a49c8265b14a9c0a" candidate_uuid: "f2868245e89644679e2b7dac75591a58" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6e4eb6facf924880a0e38eeff91ba974"
I20260709 12:14:48.846768 25706 raft_consensus.cc:3060] T 927ba57ba7864989a49c8265b14a9c0a P 7ffdf999adba487a9887fe7e2cc0f874 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:48.846773 25634 raft_consensus.cc:3060] T 927ba57ba7864989a49c8265b14a9c0a P 6e4eb6facf924880a0e38eeff91ba974 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:48.854425 25706 raft_consensus.cc:2468] T 927ba57ba7864989a49c8265b14a9c0a P 7ffdf999adba487a9887fe7e2cc0f874 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f2868245e89644679e2b7dac75591a58 in term 2.
I20260709 12:14:48.855693 25525 leader_election.cc:304] T 927ba57ba7864989a49c8265b14a9c0a P f2868245e89644679e2b7dac75591a58 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffdf999adba487a9887fe7e2cc0f874, f2868245e89644679e2b7dac75591a58; no voters: 
I20260709 12:14:48.856475 25897 raft_consensus.cc:2804] T 927ba57ba7864989a49c8265b14a9c0a P f2868245e89644679e2b7dac75591a58 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:48.856983 25897 raft_consensus.cc:697] T 927ba57ba7864989a49c8265b14a9c0a P f2868245e89644679e2b7dac75591a58 [term 2 LEADER]: Becoming Leader. State: Replica: f2868245e89644679e2b7dac75591a58, State: Running, Role: LEADER
I20260709 12:14:48.858136 25634 raft_consensus.cc:2468] T 927ba57ba7864989a49c8265b14a9c0a P 6e4eb6facf924880a0e38eeff91ba974 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f2868245e89644679e2b7dac75591a58 in term 2.
I20260709 12:14:48.858332 25897 consensus_queue.cc:237] T 927ba57ba7864989a49c8265b14a9c0a P f2868245e89644679e2b7dac75591a58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:48.867057 25456 catalog_manager.cc:5697] T 927ba57ba7864989a49c8265b14a9c0a P f2868245e89644679e2b7dac75591a58 reported cstate change: term changed from 1 to 2, leader changed from 7ffdf999adba487a9887fe7e2cc0f874 (127.12.174.131) to f2868245e89644679e2b7dac75591a58 (127.12.174.129). New cstate: current_term: 2 leader_uuid: "f2868245e89644679e2b7dac75591a58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:48.887032 25882 raft_consensus.cc:993] T 73781eedcc0f4dbd9bdd82d8ca269bd3 P f2868245e89644679e2b7dac75591a58: : Instructing follower 6e4eb6facf924880a0e38eeff91ba974 to start an election
I20260709 12:14:48.887593 25882 raft_consensus.cc:1081] T 73781eedcc0f4dbd9bdd82d8ca269bd3 P f2868245e89644679e2b7dac75591a58 [term 1 LEADER]: Signalling peer 6e4eb6facf924880a0e38eeff91ba974 to start an election
I20260709 12:14:48.889213 25634 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "73781eedcc0f4dbd9bdd82d8ca269bd3"
dest_uuid: "6e4eb6facf924880a0e38eeff91ba974"
 from {username='slave'} at 127.0.0.1:33044
I20260709 12:14:48.889830 25634 raft_consensus.cc:493] T 73781eedcc0f4dbd9bdd82d8ca269bd3 P 6e4eb6facf924880a0e38eeff91ba974 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:48.890183 25634 raft_consensus.cc:3060] T 73781eedcc0f4dbd9bdd82d8ca269bd3 P 6e4eb6facf924880a0e38eeff91ba974 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:48.898495 25634 raft_consensus.cc:515] T 73781eedcc0f4dbd9bdd82d8ca269bd3 P 6e4eb6facf924880a0e38eeff91ba974 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:48.900964 25634 leader_election.cc:290] T 73781eedcc0f4dbd9bdd82d8ca269bd3 P 6e4eb6facf924880a0e38eeff91ba974 [CANDIDATE]: Term 2 election: Requested vote from peers f2868245e89644679e2b7dac75591a58 (127.12.174.129:40387), 7ffdf999adba487a9887fe7e2cc0f874 (127.12.174.131:36809)
I20260709 12:14:48.901232 25558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73781eedcc0f4dbd9bdd82d8ca269bd3" candidate_uuid: "6e4eb6facf924880a0e38eeff91ba974" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f2868245e89644679e2b7dac75591a58"
I20260709 12:14:48.901496 25706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73781eedcc0f4dbd9bdd82d8ca269bd3" candidate_uuid: "6e4eb6facf924880a0e38eeff91ba974" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7ffdf999adba487a9887fe7e2cc0f874"
I20260709 12:14:48.902232 25706 raft_consensus.cc:3060] T 73781eedcc0f4dbd9bdd82d8ca269bd3 P 7ffdf999adba487a9887fe7e2cc0f874 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:48.902233 25558 raft_consensus.cc:3055] T 73781eedcc0f4dbd9bdd82d8ca269bd3 P f2868245e89644679e2b7dac75591a58 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:48.902822 25558 raft_consensus.cc:740] T 73781eedcc0f4dbd9bdd82d8ca269bd3 P f2868245e89644679e2b7dac75591a58 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f2868245e89644679e2b7dac75591a58, State: Running, Role: LEADER
I20260709 12:14:48.903779 25558 consensus_queue.cc:260] T 73781eedcc0f4dbd9bdd82d8ca269bd3 P f2868245e89644679e2b7dac75591a58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:48.905951 25558 raft_consensus.cc:3060] T 73781eedcc0f4dbd9bdd82d8ca269bd3 P f2868245e89644679e2b7dac75591a58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:48.910113 25706 raft_consensus.cc:2468] T 73781eedcc0f4dbd9bdd82d8ca269bd3 P 7ffdf999adba487a9887fe7e2cc0f874 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e4eb6facf924880a0e38eeff91ba974 in term 2.
I20260709 12:14:48.911270 25600 leader_election.cc:304] T 73781eedcc0f4dbd9bdd82d8ca269bd3 P 6e4eb6facf924880a0e38eeff91ba974 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e4eb6facf924880a0e38eeff91ba974, 7ffdf999adba487a9887fe7e2cc0f874; no voters: 
I20260709 12:14:48.911996 25927 raft_consensus.cc:2804] T 73781eedcc0f4dbd9bdd82d8ca269bd3 P 6e4eb6facf924880a0e38eeff91ba974 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:48.912412 25927 raft_consensus.cc:697] T 73781eedcc0f4dbd9bdd82d8ca269bd3 P 6e4eb6facf924880a0e38eeff91ba974 [term 2 LEADER]: Becoming Leader. State: Replica: 6e4eb6facf924880a0e38eeff91ba974, State: Running, Role: LEADER
I20260709 12:14:48.913659 25927 consensus_queue.cc:237] T 73781eedcc0f4dbd9bdd82d8ca269bd3 P 6e4eb6facf924880a0e38eeff91ba974 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:48.913955 25558 raft_consensus.cc:2468] T 73781eedcc0f4dbd9bdd82d8ca269bd3 P f2868245e89644679e2b7dac75591a58 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e4eb6facf924880a0e38eeff91ba974 in term 2.
I20260709 12:14:48.921948 25456 catalog_manager.cc:5697] T 73781eedcc0f4dbd9bdd82d8ca269bd3 P 6e4eb6facf924880a0e38eeff91ba974 reported cstate change: term changed from 1 to 2, leader changed from f2868245e89644679e2b7dac75591a58 (127.12.174.129) to 6e4eb6facf924880a0e38eeff91ba974 (127.12.174.130). New cstate: current_term: 2 leader_uuid: "6e4eb6facf924880a0e38eeff91ba974" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:48.991863 25882 raft_consensus.cc:993] T 843ddab732fd4de99b4267d7abfd735e P f2868245e89644679e2b7dac75591a58: : Instructing follower 6e4eb6facf924880a0e38eeff91ba974 to start an election
I20260709 12:14:48.992393 25895 raft_consensus.cc:1081] T 843ddab732fd4de99b4267d7abfd735e P f2868245e89644679e2b7dac75591a58 [term 1 LEADER]: Signalling peer 6e4eb6facf924880a0e38eeff91ba974 to start an election
I20260709 12:14:48.994318 25634 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "843ddab732fd4de99b4267d7abfd735e"
dest_uuid: "6e4eb6facf924880a0e38eeff91ba974"
 from {username='slave'} at 127.0.0.1:33044
I20260709 12:14:48.994925 25634 raft_consensus.cc:493] T 843ddab732fd4de99b4267d7abfd735e P 6e4eb6facf924880a0e38eeff91ba974 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:48.995306 25634 raft_consensus.cc:3060] T 843ddab732fd4de99b4267d7abfd735e P 6e4eb6facf924880a0e38eeff91ba974 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:49.001569 25634 raft_consensus.cc:515] T 843ddab732fd4de99b4267d7abfd735e P 6e4eb6facf924880a0e38eeff91ba974 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:49.005075 25634 leader_election.cc:290] T 843ddab732fd4de99b4267d7abfd735e P 6e4eb6facf924880a0e38eeff91ba974 [CANDIDATE]: Term 2 election: Requested vote from peers f2868245e89644679e2b7dac75591a58 (127.12.174.129:40387), 7ffdf999adba487a9887fe7e2cc0f874 (127.12.174.131:36809)
I20260709 12:14:49.006552 25558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843ddab732fd4de99b4267d7abfd735e" candidate_uuid: "6e4eb6facf924880a0e38eeff91ba974" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f2868245e89644679e2b7dac75591a58"
I20260709 12:14:49.007357 25558 raft_consensus.cc:3055] T 843ddab732fd4de99b4267d7abfd735e P f2868245e89644679e2b7dac75591a58 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:49.007364 25706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843ddab732fd4de99b4267d7abfd735e" candidate_uuid: "6e4eb6facf924880a0e38eeff91ba974" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7ffdf999adba487a9887fe7e2cc0f874"
I20260709 12:14:49.007952 25893 raft_consensus.cc:993] T 2b233b12bfbc42c18b5b121f4122ba3c P 7ffdf999adba487a9887fe7e2cc0f874: : Instructing follower 6e4eb6facf924880a0e38eeff91ba974 to start an election
I20260709 12:14:49.008271 25706 raft_consensus.cc:3060] T 843ddab732fd4de99b4267d7abfd735e P 7ffdf999adba487a9887fe7e2cc0f874 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:49.008462 25789 raft_consensus.cc:1081] T 2b233b12bfbc42c18b5b121f4122ba3c P 7ffdf999adba487a9887fe7e2cc0f874 [term 1 LEADER]: Signalling peer 6e4eb6facf924880a0e38eeff91ba974 to start an election
I20260709 12:14:49.008001 25558 raft_consensus.cc:740] T 843ddab732fd4de99b4267d7abfd735e P f2868245e89644679e2b7dac75591a58 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f2868245e89644679e2b7dac75591a58, State: Running, Role: LEADER
I20260709 12:14:49.010535 25633 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2b233b12bfbc42c18b5b121f4122ba3c"
dest_uuid: "6e4eb6facf924880a0e38eeff91ba974"
 from {username='slave'} at 127.0.0.1:33048
I20260709 12:14:49.010536 25558 consensus_queue.cc:260] T 843ddab732fd4de99b4267d7abfd735e P f2868245e89644679e2b7dac75591a58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:49.011099 25633 raft_consensus.cc:493] T 2b233b12bfbc42c18b5b121f4122ba3c P 6e4eb6facf924880a0e38eeff91ba974 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:49.011524 25633 raft_consensus.cc:3060] T 2b233b12bfbc42c18b5b121f4122ba3c P 6e4eb6facf924880a0e38eeff91ba974 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:49.012072 25558 raft_consensus.cc:3060] T 843ddab732fd4de99b4267d7abfd735e P f2868245e89644679e2b7dac75591a58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:49.018584 25633 raft_consensus.cc:515] T 2b233b12bfbc42c18b5b121f4122ba3c P 6e4eb6facf924880a0e38eeff91ba974 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:49.020604 25558 raft_consensus.cc:2468] T 843ddab732fd4de99b4267d7abfd735e P f2868245e89644679e2b7dac75591a58 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e4eb6facf924880a0e38eeff91ba974 in term 2.
I20260709 12:14:49.022294 25597 leader_election.cc:304] T 843ddab732fd4de99b4267d7abfd735e P 6e4eb6facf924880a0e38eeff91ba974 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e4eb6facf924880a0e38eeff91ba974, f2868245e89644679e2b7dac75591a58; no voters: 
I20260709 12:14:49.023272 25927 raft_consensus.cc:2804] T 843ddab732fd4de99b4267d7abfd735e P 6e4eb6facf924880a0e38eeff91ba974 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:49.024200 25927 raft_consensus.cc:697] T 843ddab732fd4de99b4267d7abfd735e P 6e4eb6facf924880a0e38eeff91ba974 [term 2 LEADER]: Becoming Leader. State: Replica: 6e4eb6facf924880a0e38eeff91ba974, State: Running, Role: LEADER
I20260709 12:14:49.023401 25708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b233b12bfbc42c18b5b121f4122ba3c" candidate_uuid: "6e4eb6facf924880a0e38eeff91ba974" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7ffdf999adba487a9887fe7e2cc0f874"
I20260709 12:14:49.025296 25708 raft_consensus.cc:3055] T 2b233b12bfbc42c18b5b121f4122ba3c P 7ffdf999adba487a9887fe7e2cc0f874 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:49.025103 25927 consensus_queue.cc:237] T 843ddab732fd4de99b4267d7abfd735e P 6e4eb6facf924880a0e38eeff91ba974 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:49.025766 25708 raft_consensus.cc:740] T 2b233b12bfbc42c18b5b121f4122ba3c P 7ffdf999adba487a9887fe7e2cc0f874 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7ffdf999adba487a9887fe7e2cc0f874, State: Running, Role: LEADER
I20260709 12:14:49.026736 25708 consensus_queue.cc:260] T 2b233b12bfbc42c18b5b121f4122ba3c P 7ffdf999adba487a9887fe7e2cc0f874 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:49.027954 25708 raft_consensus.cc:3060] T 2b233b12bfbc42c18b5b121f4122ba3c P 7ffdf999adba487a9887fe7e2cc0f874 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:49.028067 25558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b233b12bfbc42c18b5b121f4122ba3c" candidate_uuid: "6e4eb6facf924880a0e38eeff91ba974" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f2868245e89644679e2b7dac75591a58"
I20260709 12:14:49.033900 25633 leader_election.cc:290] T 2b233b12bfbc42c18b5b121f4122ba3c P 6e4eb6facf924880a0e38eeff91ba974 [CANDIDATE]: Term 2 election: Requested vote from peers f2868245e89644679e2b7dac75591a58 (127.12.174.129:40387), 7ffdf999adba487a9887fe7e2cc0f874 (127.12.174.131:36809)
I20260709 12:14:49.035336 25706 raft_consensus.cc:2468] T 843ddab732fd4de99b4267d7abfd735e P 7ffdf999adba487a9887fe7e2cc0f874 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e4eb6facf924880a0e38eeff91ba974 in term 2.
I20260709 12:14:49.036896 25558 raft_consensus.cc:3060] T 2b233b12bfbc42c18b5b121f4122ba3c P f2868245e89644679e2b7dac75591a58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:49.042248 25708 raft_consensus.cc:2468] T 2b233b12bfbc42c18b5b121f4122ba3c P 7ffdf999adba487a9887fe7e2cc0f874 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e4eb6facf924880a0e38eeff91ba974 in term 2.
I20260709 12:14:49.043995 25600 leader_election.cc:304] T 2b233b12bfbc42c18b5b121f4122ba3c P 6e4eb6facf924880a0e38eeff91ba974 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e4eb6facf924880a0e38eeff91ba974, 7ffdf999adba487a9887fe7e2cc0f874; no voters: 
I20260709 12:14:49.045619 25456 catalog_manager.cc:5697] T 843ddab732fd4de99b4267d7abfd735e P 6e4eb6facf924880a0e38eeff91ba974 reported cstate change: term changed from 1 to 2, leader changed from f2868245e89644679e2b7dac75591a58 (127.12.174.129) to 6e4eb6facf924880a0e38eeff91ba974 (127.12.174.130). New cstate: current_term: 2 leader_uuid: "6e4eb6facf924880a0e38eeff91ba974" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:49.047576 25558 raft_consensus.cc:2468] T 2b233b12bfbc42c18b5b121f4122ba3c P f2868245e89644679e2b7dac75591a58 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e4eb6facf924880a0e38eeff91ba974 in term 2.
I20260709 12:14:49.048763 25927 raft_consensus.cc:2804] T 2b233b12bfbc42c18b5b121f4122ba3c P 6e4eb6facf924880a0e38eeff91ba974 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:49.049403 25927 raft_consensus.cc:697] T 2b233b12bfbc42c18b5b121f4122ba3c P 6e4eb6facf924880a0e38eeff91ba974 [term 2 LEADER]: Becoming Leader. State: Replica: 6e4eb6facf924880a0e38eeff91ba974, State: Running, Role: LEADER
I20260709 12:14:49.050326 25927 consensus_queue.cc:237] T 2b233b12bfbc42c18b5b121f4122ba3c P 6e4eb6facf924880a0e38eeff91ba974 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:49.061635 25456 catalog_manager.cc:5697] T 2b233b12bfbc42c18b5b121f4122ba3c P 6e4eb6facf924880a0e38eeff91ba974 reported cstate change: term changed from 1 to 2, leader changed from 7ffdf999adba487a9887fe7e2cc0f874 (127.12.174.131) to 6e4eb6facf924880a0e38eeff91ba974 (127.12.174.130). New cstate: current_term: 2 leader_uuid: "6e4eb6facf924880a0e38eeff91ba974" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } health_report { overall_health: UNKNOWN } } }
I20260709 12:14:49.125005 25559 raft_consensus.cc:1275] T 5a26b0bedc3c4a8c99946f8e5565d353 P f2868245e89644679e2b7dac75591a58 [term 2 FOLLOWER]: Refusing update from remote peer 6e4eb6facf924880a0e38eeff91ba974: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:49.125787 25708 raft_consensus.cc:3060] T 5a26b0bedc3c4a8c99946f8e5565d353 P 7ffdf999adba487a9887fe7e2cc0f874 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:49.126688 25926 consensus_queue.cc:1048] T 5a26b0bedc3c4a8c99946f8e5565d353 P 6e4eb6facf924880a0e38eeff91ba974 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:49.134589 25708 raft_consensus.cc:1275] T 5a26b0bedc3c4a8c99946f8e5565d353 P 7ffdf999adba487a9887fe7e2cc0f874 [term 2 FOLLOWER]: Refusing update from remote peer 6e4eb6facf924880a0e38eeff91ba974: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:49.136806 25926 consensus_queue.cc:1048] T 5a26b0bedc3c4a8c99946f8e5565d353 P 6e4eb6facf924880a0e38eeff91ba974 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 12:14:49.179075 25559 raft_consensus.cc:3060] T d835765d07404362a68c773ddc446da5 P f2868245e89644679e2b7dac75591a58 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:49.186017 25559 raft_consensus.cc:1275] T d835765d07404362a68c773ddc446da5 P f2868245e89644679e2b7dac75591a58 [term 3 FOLLOWER]: Refusing update from remote peer 7ffdf999adba487a9887fe7e2cc0f874: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:14:49.187765 25789 consensus_queue.cc:1048] T d835765d07404362a68c773ddc446da5 P 7ffdf999adba487a9887fe7e2cc0f874 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:14:49.199491 25633 raft_consensus.cc:1275] T d835765d07404362a68c773ddc446da5 P 6e4eb6facf924880a0e38eeff91ba974 [term 3 FOLLOWER]: Refusing update from remote peer 7ffdf999adba487a9887fe7e2cc0f874: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:14:49.201211 25928 consensus_queue.cc:1048] T d835765d07404362a68c773ddc446da5 P 7ffdf999adba487a9887fe7e2cc0f874 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:49.266491 25633 raft_consensus.cc:1275] T 927ba57ba7864989a49c8265b14a9c0a P 6e4eb6facf924880a0e38eeff91ba974 [term 2 FOLLOWER]: Refusing update from remote peer f2868245e89644679e2b7dac75591a58: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:49.267799 25895 consensus_queue.cc:1048] T 927ba57ba7864989a49c8265b14a9c0a P f2868245e89644679e2b7dac75591a58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:49.276214 25708 raft_consensus.cc:1275] T 927ba57ba7864989a49c8265b14a9c0a P 7ffdf999adba487a9887fe7e2cc0f874 [term 2 FOLLOWER]: Refusing update from remote peer f2868245e89644679e2b7dac75591a58: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:49.278041 25897 consensus_queue.cc:1048] T 927ba57ba7864989a49c8265b14a9c0a P f2868245e89644679e2b7dac75591a58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:49.311982 25708 raft_consensus.cc:1275] T fb492c949c97458a940dfcbd02a034cf P 7ffdf999adba487a9887fe7e2cc0f874 [term 2 FOLLOWER]: Refusing update from remote peer f2868245e89644679e2b7dac75591a58: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:49.313491 25882 consensus_queue.cc:1048] T fb492c949c97458a940dfcbd02a034cf P f2868245e89644679e2b7dac75591a58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:49.324393 25633 raft_consensus.cc:1275] T fb492c949c97458a940dfcbd02a034cf P 6e4eb6facf924880a0e38eeff91ba974 [term 2 FOLLOWER]: Refusing update from remote peer f2868245e89644679e2b7dac75591a58: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:49.326694 25882 consensus_queue.cc:1048] T fb492c949c97458a940dfcbd02a034cf P f2868245e89644679e2b7dac75591a58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:49.413717 25708 raft_consensus.cc:1275] T 73781eedcc0f4dbd9bdd82d8ca269bd3 P 7ffdf999adba487a9887fe7e2cc0f874 [term 2 FOLLOWER]: Refusing update from remote peer 6e4eb6facf924880a0e38eeff91ba974: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:49.415268 25846 consensus_queue.cc:1048] T 73781eedcc0f4dbd9bdd82d8ca269bd3 P 6e4eb6facf924880a0e38eeff91ba974 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:49.424177 25559 raft_consensus.cc:1275] T 73781eedcc0f4dbd9bdd82d8ca269bd3 P f2868245e89644679e2b7dac75591a58 [term 2 FOLLOWER]: Refusing update from remote peer 6e4eb6facf924880a0e38eeff91ba974: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:49.426528 25926 consensus_queue.cc:1048] T 73781eedcc0f4dbd9bdd82d8ca269bd3 P 6e4eb6facf924880a0e38eeff91ba974 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:49.473100 25708 raft_consensus.cc:1275] T 843ddab732fd4de99b4267d7abfd735e P 7ffdf999adba487a9887fe7e2cc0f874 [term 2 FOLLOWER]: Refusing update from remote peer 6e4eb6facf924880a0e38eeff91ba974: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:49.474500 25926 consensus_queue.cc:1048] T 843ddab732fd4de99b4267d7abfd735e P 6e4eb6facf924880a0e38eeff91ba974 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:49.484329 25559 raft_consensus.cc:1275] T 843ddab732fd4de99b4267d7abfd735e P f2868245e89644679e2b7dac75591a58 [term 2 FOLLOWER]: Refusing update from remote peer 6e4eb6facf924880a0e38eeff91ba974: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:49.486233 25926 consensus_queue.cc:1048] T 843ddab732fd4de99b4267d7abfd735e P 6e4eb6facf924880a0e38eeff91ba974 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:49.566606 25559 raft_consensus.cc:1275] T 2b233b12bfbc42c18b5b121f4122ba3c P f2868245e89644679e2b7dac75591a58 [term 2 FOLLOWER]: Refusing update from remote peer 6e4eb6facf924880a0e38eeff91ba974: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:49.568096 25926 consensus_queue.cc:1048] T 2b233b12bfbc42c18b5b121f4122ba3c P 6e4eb6facf924880a0e38eeff91ba974 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:49.574697 25708 raft_consensus.cc:1275] T 2b233b12bfbc42c18b5b121f4122ba3c P 7ffdf999adba487a9887fe7e2cc0f874 [term 2 FOLLOWER]: Refusing update from remote peer 6e4eb6facf924880a0e38eeff91ba974: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:49.576681 25846 consensus_queue.cc:1048] T 2b233b12bfbc42c18b5b121f4122ba3c P 6e4eb6facf924880a0e38eeff91ba974 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:51.626735 25454 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48258:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 12:14:51.655613 25454 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48258:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 12:14:51.698195 12986 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
W20260709 12:14:51.921309 25597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:40387, user_credentials={real_user=slave}} blocked reactor thread for 60670.2us
I20260709 12:14:51.957587 26012 tablet.cc:1724] T d835765d07404362a68c773ddc446da5 P 7ffdf999adba487a9887fe7e2cc0f874: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:51.981113 26010 tablet.cc:1724] T 7abbe96052d8434cb1e2afd960768847 P 7ffdf999adba487a9887fe7e2cc0f874: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:52.062593 26028 tablet.cc:1724] T 2b233b12bfbc42c18b5b121f4122ba3c P 6e4eb6facf924880a0e38eeff91ba974: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:52.063071 26027 tablet.cc:1724] T 5a26b0bedc3c4a8c99946f8e5565d353 P 6e4eb6facf924880a0e38eeff91ba974: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:14:52.064589 25597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.129:40387, user_credentials={real_user=slave}} blocked reactor thread for 77484.8us
I20260709 12:14:52.078804 26018 tablet.cc:1724] T d835765d07404362a68c773ddc446da5 P 6e4eb6facf924880a0e38eeff91ba974: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:52.115255 26035 tablet.cc:1724] T 843ddab732fd4de99b4267d7abfd735e P 6e4eb6facf924880a0e38eeff91ba974: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:52.116683 26030 tablet.cc:1724] T 927ba57ba7864989a49c8265b14a9c0a P 7ffdf999adba487a9887fe7e2cc0f874: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:52.144388 25559 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "556f2a498099427e9a90c94542674f0f"
dest_uuid: "f2868245e89644679e2b7dac75591a58"
mode: GRACEFUL
new_leader_uuid: "7ffdf999adba487a9887fe7e2cc0f874"
 from {username='slave'} at 127.0.0.1:38828
I20260709 12:14:52.145381 25559 raft_consensus.cc:606] T 556f2a498099427e9a90c94542674f0f P f2868245e89644679e2b7dac75591a58 [term 1 LEADER]: Received request to transfer leadership to TS 7ffdf999adba487a9887fe7e2cc0f874
I20260709 12:14:52.124130 26031 tablet.cc:1724] T 556f2a498099427e9a90c94542674f0f P 7ffdf999adba487a9887fe7e2cc0f874: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:52.121647 26029 tablet.cc:1724] T fb492c949c97458a940dfcbd02a034cf P f2868245e89644679e2b7dac75591a58: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:52.146112 26025 tablet.cc:1724] T 7abbe96052d8434cb1e2afd960768847 P f2868245e89644679e2b7dac75591a58: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:52.157853 26033 tablet.cc:1724] T 927ba57ba7864989a49c8265b14a9c0a P f2868245e89644679e2b7dac75591a58: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:14:52.178153 25585 tablet_mm_ops.cc:220] Minor delta compaction is disabled (check --enable_minor_delta_compaction and disable_compaction in extra_config for tablet:7abbe96052d8434cb1e2afd960768847)
W20260709 12:14:52.188944 25660 tablet_mm_ops.cc:304] Major delta compaction is disabled (check --enable_major_delta_compaction and disable_compaction in extra_config for tablet:2b233b12bfbc42c18b5b121f4122ba3c)
I20260709 12:14:52.196614 26028 tablet.cc:1724] T 7abbe96052d8434cb1e2afd960768847 P 6e4eb6facf924880a0e38eeff91ba974: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:52.201052 26034 tablet.cc:1724] T 556f2a498099427e9a90c94542674f0f P f2868245e89644679e2b7dac75591a58: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:52.206233 26030 tablet.cc:1724] T 5a26b0bedc3c4a8c99946f8e5565d353 P 7ffdf999adba487a9887fe7e2cc0f874: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:52.232220 26035 tablet.cc:1724] T 73781eedcc0f4dbd9bdd82d8ca269bd3 P 6e4eb6facf924880a0e38eeff91ba974: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:52.236176 26018 tablet.cc:1724] T 927ba57ba7864989a49c8265b14a9c0a P 6e4eb6facf924880a0e38eeff91ba974: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:14:52.233949 25600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:36809, user_credentials={real_user=slave}} blocked reactor thread for 74421.2us
I20260709 12:14:52.234344 26031 tablet.cc:1724] T 843ddab732fd4de99b4267d7abfd735e P 7ffdf999adba487a9887fe7e2cc0f874: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:52.201107 26033 tablet.cc:1724] T d835765d07404362a68c773ddc446da5 P f2868245e89644679e2b7dac75591a58: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:52.244474 26025 tablet.cc:1724] T 5a26b0bedc3c4a8c99946f8e5565d353 P f2868245e89644679e2b7dac75591a58: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:52.246985 26012 tablet.cc:1724] T fb492c949c97458a940dfcbd02a034cf P 7ffdf999adba487a9887fe7e2cc0f874: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:52.237125 26029 tablet.cc:1724] T 2b233b12bfbc42c18b5b121f4122ba3c P f2868245e89644679e2b7dac75591a58: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:52.259461 26027 tablet.cc:1724] T fb492c949c97458a940dfcbd02a034cf P 6e4eb6facf924880a0e38eeff91ba974: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:52.274940 26035 tablet.cc:1724] T 556f2a498099427e9a90c94542674f0f P 6e4eb6facf924880a0e38eeff91ba974: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:52.261224 25454 catalog_manager.cc:5789] TS 6e4eb6facf924880a0e38eeff91ba974 (127.12.174.130:41805) does not have the latest schema for tablet 73781eedcc0f4dbd9bdd82d8ca269bd3 (table soft_deleted_table [id=30d1a5ef5f7247308db6c9b5a7db7ffa]). Expected version 1 got 0
I20260709 12:14:52.278398 25454 catalog_manager.cc:5789] TS 6e4eb6facf924880a0e38eeff91ba974 (127.12.174.130:41805) does not have the latest schema for tablet 843ddab732fd4de99b4267d7abfd735e (table soft_deleted_table [id=30d1a5ef5f7247308db6c9b5a7db7ffa]). Expected version 1 got 0
W20260709 12:14:52.282788 25734 tablet_mm_ops.cc:139] Rowset compaction is disabled (check --enable_rowset_compaction and disable_compaction in extra_config for tablet:556f2a498099427e9a90c94542674f0f)
I20260709 12:14:52.289657 26031 tablet.cc:1724] T 2b233b12bfbc42c18b5b121f4122ba3c P 7ffdf999adba487a9887fe7e2cc0f874: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:52.290369 26033 tablet.cc:1724] T 73781eedcc0f4dbd9bdd82d8ca269bd3 P f2868245e89644679e2b7dac75591a58: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:52.292837 26010 tablet.cc:1724] T 73781eedcc0f4dbd9bdd82d8ca269bd3 P 7ffdf999adba487a9887fe7e2cc0f874: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:52.296713 26034 tablet.cc:1724] T 843ddab732fd4de99b4267d7abfd735e P f2868245e89644679e2b7dac75591a58: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:14:52.299687 25633 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "73781eedcc0f4dbd9bdd82d8ca269bd3"
dest_uuid: "6e4eb6facf924880a0e38eeff91ba974"
mode: GRACEFUL
new_leader_uuid: "7ffdf999adba487a9887fe7e2cc0f874"
 from {username='slave'} at 127.0.0.1:44558
I20260709 12:14:52.306174 25633 raft_consensus.cc:606] T 73781eedcc0f4dbd9bdd82d8ca269bd3 P 6e4eb6facf924880a0e38eeff91ba974 [term 2 LEADER]: Received request to transfer leadership to TS 7ffdf999adba487a9887fe7e2cc0f874
I20260709 12:14:52.308655 12986 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 12:14:52.315670 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:52.329818 25633 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "12dd6a165033473e9c39fd87d4763add"
dest_uuid: "6e4eb6facf924880a0e38eeff91ba974"
mode: GRACEFUL
new_leader_uuid: "7ffdf999adba487a9887fe7e2cc0f874"
 from {username='slave'} at 127.0.0.1:44558
I20260709 12:14:52.330493 25633 raft_consensus.cc:606] T 12dd6a165033473e9c39fd87d4763add P 6e4eb6facf924880a0e38eeff91ba974 [term 2 LEADER]: Received request to transfer leadership to TS 7ffdf999adba487a9887fe7e2cc0f874
I20260709 12:14:52.333995 25559 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "243ba61cc23a42669b893d2e6268a359"
dest_uuid: "f2868245e89644679e2b7dac75591a58"
mode: GRACEFUL
new_leader_uuid: "7ffdf999adba487a9887fe7e2cc0f874"
 from {username='slave'} at 127.0.0.1:38828
I20260709 12:14:52.334766 25559 raft_consensus.cc:606] T 243ba61cc23a42669b893d2e6268a359 P f2868245e89644679e2b7dac75591a58 [term 1 LEADER]: Received request to transfer leadership to TS 7ffdf999adba487a9887fe7e2cc0f874
I20260709 12:14:52.336854 12986 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:14:52.337666 12986 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:52.367607 25456 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 289dddc755224fb2a6616ef0c1fb377c: soft_deleted_table [id=30d1a5ef5f7247308db6c9b5a7db7ffa] alter complete (version 1)
I20260709 12:14:52.647150 25979 raft_consensus.cc:993] T 556f2a498099427e9a90c94542674f0f P f2868245e89644679e2b7dac75591a58: : Instructing follower 7ffdf999adba487a9887fe7e2cc0f874 to start an election
I20260709 12:14:52.647740 26024 raft_consensus.cc:1081] T 556f2a498099427e9a90c94542674f0f P f2868245e89644679e2b7dac75591a58 [term 1 LEADER]: Signalling peer 7ffdf999adba487a9887fe7e2cc0f874 to start an election
I20260709 12:14:52.649291 25704 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "556f2a498099427e9a90c94542674f0f"
dest_uuid: "7ffdf999adba487a9887fe7e2cc0f874"
 from {username='slave'} at 127.0.0.1:57664
I20260709 12:14:52.650415 25704 raft_consensus.cc:493] T 556f2a498099427e9a90c94542674f0f P 7ffdf999adba487a9887fe7e2cc0f874 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:52.650904 25704 raft_consensus.cc:3060] T 556f2a498099427e9a90c94542674f0f P 7ffdf999adba487a9887fe7e2cc0f874 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:52.652634 25993 raft_consensus.cc:993] T 12dd6a165033473e9c39fd87d4763add P 6e4eb6facf924880a0e38eeff91ba974: : Instructing follower 7ffdf999adba487a9887fe7e2cc0f874 to start an election
I20260709 12:14:52.653196 25993 raft_consensus.cc:1081] T 12dd6a165033473e9c39fd87d4763add P 6e4eb6facf924880a0e38eeff91ba974 [term 2 LEADER]: Signalling peer 7ffdf999adba487a9887fe7e2cc0f874 to start an election
I20260709 12:14:52.656358 25705 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "12dd6a165033473e9c39fd87d4763add"
dest_uuid: "7ffdf999adba487a9887fe7e2cc0f874"
 from {username='slave'} at 127.0.0.1:57670
I20260709 12:14:52.656993 25705 raft_consensus.cc:493] T 12dd6a165033473e9c39fd87d4763add P 7ffdf999adba487a9887fe7e2cc0f874 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:52.657357 25705 raft_consensus.cc:3060] T 12dd6a165033473e9c39fd87d4763add P 7ffdf999adba487a9887fe7e2cc0f874 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:52.662107 25704 raft_consensus.cc:515] T 556f2a498099427e9a90c94542674f0f P 7ffdf999adba487a9887fe7e2cc0f874 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:52.664669 25704 leader_election.cc:290] T 556f2a498099427e9a90c94542674f0f P 7ffdf999adba487a9887fe7e2cc0f874 [CANDIDATE]: Term 2 election: Requested vote from peers f2868245e89644679e2b7dac75591a58 (127.12.174.129:40387), 6e4eb6facf924880a0e38eeff91ba974 (127.12.174.130:41805)
I20260709 12:14:52.665431 25705 raft_consensus.cc:515] T 12dd6a165033473e9c39fd87d4763add P 7ffdf999adba487a9887fe7e2cc0f874 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:52.666265 25633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556f2a498099427e9a90c94542674f0f" candidate_uuid: "7ffdf999adba487a9887fe7e2cc0f874" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "6e4eb6facf924880a0e38eeff91ba974"
I20260709 12:14:52.666534 25559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556f2a498099427e9a90c94542674f0f" candidate_uuid: "7ffdf999adba487a9887fe7e2cc0f874" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "f2868245e89644679e2b7dac75591a58"
I20260709 12:14:52.667232 25559 raft_consensus.cc:3055] T 556f2a498099427e9a90c94542674f0f P f2868245e89644679e2b7dac75591a58 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:52.667580 25559 raft_consensus.cc:740] T 556f2a498099427e9a90c94542674f0f P f2868245e89644679e2b7dac75591a58 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f2868245e89644679e2b7dac75591a58, State: Running, Role: LEADER
I20260709 12:14:52.668514 25559 consensus_queue.cc:260] T 556f2a498099427e9a90c94542674f0f P f2868245e89644679e2b7dac75591a58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:52.669333 25556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12dd6a165033473e9c39fd87d4763add" candidate_uuid: "7ffdf999adba487a9887fe7e2cc0f874" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f2868245e89644679e2b7dac75591a58"
I20260709 12:14:52.669961 25630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12dd6a165033473e9c39fd87d4763add" candidate_uuid: "7ffdf999adba487a9887fe7e2cc0f874" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6e4eb6facf924880a0e38eeff91ba974"
I20260709 12:14:52.670112 25559 raft_consensus.cc:3060] T 556f2a498099427e9a90c94542674f0f P f2868245e89644679e2b7dac75591a58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:52.670045 25556 raft_consensus.cc:3060] T 12dd6a165033473e9c39fd87d4763add P f2868245e89644679e2b7dac75591a58 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:52.670645 25630 raft_consensus.cc:3055] T 12dd6a165033473e9c39fd87d4763add P 6e4eb6facf924880a0e38eeff91ba974 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:52.671002 25630 raft_consensus.cc:740] T 12dd6a165033473e9c39fd87d4763add P 6e4eb6facf924880a0e38eeff91ba974 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6e4eb6facf924880a0e38eeff91ba974, State: Running, Role: LEADER
I20260709 12:14:52.671857 25630 consensus_queue.cc:260] T 12dd6a165033473e9c39fd87d4763add P 6e4eb6facf924880a0e38eeff91ba974 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:52.673242 25630 raft_consensus.cc:3060] T 12dd6a165033473e9c39fd87d4763add P 6e4eb6facf924880a0e38eeff91ba974 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:52.673580 25633 raft_consensus.cc:3060] T 556f2a498099427e9a90c94542674f0f P 6e4eb6facf924880a0e38eeff91ba974 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:52.679880 25559 raft_consensus.cc:2468] T 556f2a498099427e9a90c94542674f0f P f2868245e89644679e2b7dac75591a58 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffdf999adba487a9887fe7e2cc0f874 in term 2.
I20260709 12:14:52.681224 25556 raft_consensus.cc:2468] T 12dd6a165033473e9c39fd87d4763add P f2868245e89644679e2b7dac75591a58 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffdf999adba487a9887fe7e2cc0f874 in term 3.
I20260709 12:14:52.681526 25671 leader_election.cc:304] T 556f2a498099427e9a90c94542674f0f P 7ffdf999adba487a9887fe7e2cc0f874 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffdf999adba487a9887fe7e2cc0f874, f2868245e89644679e2b7dac75591a58; no voters: 
I20260709 12:14:52.682587 25705 leader_election.cc:290] T 12dd6a165033473e9c39fd87d4763add P 7ffdf999adba487a9887fe7e2cc0f874 [CANDIDATE]: Term 3 election: Requested vote from peers f2868245e89644679e2b7dac75591a58 (127.12.174.129:40387), 6e4eb6facf924880a0e38eeff91ba974 (127.12.174.130:41805)
I20260709 12:14:52.682732 25671 leader_election.cc:304] T 12dd6a165033473e9c39fd87d4763add P 7ffdf999adba487a9887fe7e2cc0f874 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffdf999adba487a9887fe7e2cc0f874, f2868245e89644679e2b7dac75591a58; no voters: 
I20260709 12:14:52.684015 25962 raft_consensus.cc:2804] T 556f2a498099427e9a90c94542674f0f P 7ffdf999adba487a9887fe7e2cc0f874 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:52.684602 25633 raft_consensus.cc:2468] T 556f2a498099427e9a90c94542674f0f P 6e4eb6facf924880a0e38eeff91ba974 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffdf999adba487a9887fe7e2cc0f874 in term 2.
I20260709 12:14:52.686313 25962 raft_consensus.cc:697] T 556f2a498099427e9a90c94542674f0f P 7ffdf999adba487a9887fe7e2cc0f874 [term 2 LEADER]: Becoming Leader. State: Replica: 7ffdf999adba487a9887fe7e2cc0f874, State: Running, Role: LEADER
I20260709 12:14:52.686847 26044 raft_consensus.cc:2804] T 12dd6a165033473e9c39fd87d4763add P 7ffdf999adba487a9887fe7e2cc0f874 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:52.687744 25630 raft_consensus.cc:2468] T 12dd6a165033473e9c39fd87d4763add P 6e4eb6facf924880a0e38eeff91ba974 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffdf999adba487a9887fe7e2cc0f874 in term 3.
I20260709 12:14:52.687356 25962 consensus_queue.cc:237] T 556f2a498099427e9a90c94542674f0f P 7ffdf999adba487a9887fe7e2cc0f874 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:52.693847 26044 raft_consensus.cc:697] T 12dd6a165033473e9c39fd87d4763add P 7ffdf999adba487a9887fe7e2cc0f874 [term 3 LEADER]: Becoming Leader. State: Replica: 7ffdf999adba487a9887fe7e2cc0f874, State: Running, Role: LEADER
I20260709 12:14:52.694947 26044 consensus_queue.cc:237] T 12dd6a165033473e9c39fd87d4763add P 7ffdf999adba487a9887fe7e2cc0f874 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:52.704300 25454 catalog_manager.cc:5697] T 556f2a498099427e9a90c94542674f0f P 7ffdf999adba487a9887fe7e2cc0f874 reported cstate change: term changed from 1 to 2, leader changed from f2868245e89644679e2b7dac75591a58 (127.12.174.129) to 7ffdf999adba487a9887fe7e2cc0f874 (127.12.174.131). New cstate: current_term: 2 leader_uuid: "7ffdf999adba487a9887fe7e2cc0f874" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:52.705456 25454 catalog_manager.cc:5697] T 12dd6a165033473e9c39fd87d4763add P 7ffdf999adba487a9887fe7e2cc0f874 reported cstate change: term changed from 2 to 3, leader changed from 6e4eb6facf924880a0e38eeff91ba974 (127.12.174.130) to 7ffdf999adba487a9887fe7e2cc0f874 (127.12.174.131). New cstate: current_term: 3 leader_uuid: "7ffdf999adba487a9887fe7e2cc0f874" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:52.827618 25979 raft_consensus.cc:993] T 243ba61cc23a42669b893d2e6268a359 P f2868245e89644679e2b7dac75591a58: : Instructing follower 7ffdf999adba487a9887fe7e2cc0f874 to start an election
I20260709 12:14:52.828131 26024 raft_consensus.cc:1081] T 243ba61cc23a42669b893d2e6268a359 P f2868245e89644679e2b7dac75591a58 [term 1 LEADER]: Signalling peer 7ffdf999adba487a9887fe7e2cc0f874 to start an election
I20260709 12:14:52.829519 25705 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "243ba61cc23a42669b893d2e6268a359"
dest_uuid: "7ffdf999adba487a9887fe7e2cc0f874"
 from {username='slave'} at 127.0.0.1:57664
I20260709 12:14:52.830027 25705 raft_consensus.cc:493] T 243ba61cc23a42669b893d2e6268a359 P 7ffdf999adba487a9887fe7e2cc0f874 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:52.830302 25705 raft_consensus.cc:3060] T 243ba61cc23a42669b893d2e6268a359 P 7ffdf999adba487a9887fe7e2cc0f874 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:52.836277 25705 raft_consensus.cc:515] T 243ba61cc23a42669b893d2e6268a359 P 7ffdf999adba487a9887fe7e2cc0f874 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:52.838107 25705 leader_election.cc:290] T 243ba61cc23a42669b893d2e6268a359 P 7ffdf999adba487a9887fe7e2cc0f874 [CANDIDATE]: Term 2 election: Requested vote from peers f2868245e89644679e2b7dac75591a58 (127.12.174.129:40387), 6e4eb6facf924880a0e38eeff91ba974 (127.12.174.130:41805)
I20260709 12:14:52.838840 25556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ba61cc23a42669b893d2e6268a359" candidate_uuid: "7ffdf999adba487a9887fe7e2cc0f874" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f2868245e89644679e2b7dac75591a58"
I20260709 12:14:52.839454 25630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "243ba61cc23a42669b893d2e6268a359" candidate_uuid: "7ffdf999adba487a9887fe7e2cc0f874" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6e4eb6facf924880a0e38eeff91ba974"
I20260709 12:14:52.839705 25556 raft_consensus.cc:3055] T 243ba61cc23a42669b893d2e6268a359 P f2868245e89644679e2b7dac75591a58 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:14:52.840042 25630 raft_consensus.cc:3060] T 243ba61cc23a42669b893d2e6268a359 P 6e4eb6facf924880a0e38eeff91ba974 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:52.840101 25556 raft_consensus.cc:740] T 243ba61cc23a42669b893d2e6268a359 P f2868245e89644679e2b7dac75591a58 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f2868245e89644679e2b7dac75591a58, State: Running, Role: LEADER
I20260709 12:14:52.840962 25556 consensus_queue.cc:260] T 243ba61cc23a42669b893d2e6268a359 P f2868245e89644679e2b7dac75591a58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:52.842198 25556 raft_consensus.cc:3060] T 243ba61cc23a42669b893d2e6268a359 P f2868245e89644679e2b7dac75591a58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:14:52.846959 26036 raft_consensus.cc:993] T 73781eedcc0f4dbd9bdd82d8ca269bd3 P 6e4eb6facf924880a0e38eeff91ba974: : Instructing follower 7ffdf999adba487a9887fe7e2cc0f874 to start an election
I20260709 12:14:52.846980 25630 raft_consensus.cc:2468] T 243ba61cc23a42669b893d2e6268a359 P 6e4eb6facf924880a0e38eeff91ba974 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffdf999adba487a9887fe7e2cc0f874 in term 2.
I20260709 12:14:52.847709 26036 raft_consensus.cc:1081] T 73781eedcc0f4dbd9bdd82d8ca269bd3 P 6e4eb6facf924880a0e38eeff91ba974 [term 2 LEADER]: Signalling peer 7ffdf999adba487a9887fe7e2cc0f874 to start an election
I20260709 12:14:52.848657 25671 leader_election.cc:304] T 243ba61cc23a42669b893d2e6268a359 P 7ffdf999adba487a9887fe7e2cc0f874 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e4eb6facf924880a0e38eeff91ba974, 7ffdf999adba487a9887fe7e2cc0f874; no voters: 
I20260709 12:14:52.849346 25556 raft_consensus.cc:2468] T 243ba61cc23a42669b893d2e6268a359 P f2868245e89644679e2b7dac75591a58 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffdf999adba487a9887fe7e2cc0f874 in term 2.
I20260709 12:14:52.850061 26044 raft_consensus.cc:2804] T 243ba61cc23a42669b893d2e6268a359 P 7ffdf999adba487a9887fe7e2cc0f874 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:14:52.850592 26044 raft_consensus.cc:697] T 243ba61cc23a42669b893d2e6268a359 P 7ffdf999adba487a9887fe7e2cc0f874 [term 2 LEADER]: Becoming Leader. State: Replica: 7ffdf999adba487a9887fe7e2cc0f874, State: Running, Role: LEADER
I20260709 12:14:52.851070 25705 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "73781eedcc0f4dbd9bdd82d8ca269bd3"
dest_uuid: "7ffdf999adba487a9887fe7e2cc0f874"
 from {username='slave'} at 127.0.0.1:57670
I20260709 12:14:52.851557 26044 consensus_queue.cc:237] T 243ba61cc23a42669b893d2e6268a359 P 7ffdf999adba487a9887fe7e2cc0f874 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:52.852308 25705 raft_consensus.cc:493] T 73781eedcc0f4dbd9bdd82d8ca269bd3 P 7ffdf999adba487a9887fe7e2cc0f874 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:14:52.852775 25705 raft_consensus.cc:3060] T 73781eedcc0f4dbd9bdd82d8ca269bd3 P 7ffdf999adba487a9887fe7e2cc0f874 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:52.859635 25454 catalog_manager.cc:5697] T 243ba61cc23a42669b893d2e6268a359 P 7ffdf999adba487a9887fe7e2cc0f874 reported cstate change: term changed from 1 to 2, leader changed from f2868245e89644679e2b7dac75591a58 (127.12.174.129) to 7ffdf999adba487a9887fe7e2cc0f874 (127.12.174.131). New cstate: current_term: 2 leader_uuid: "7ffdf999adba487a9887fe7e2cc0f874" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:52.860437 25705 raft_consensus.cc:515] T 73781eedcc0f4dbd9bdd82d8ca269bd3 P 7ffdf999adba487a9887fe7e2cc0f874 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:52.862344 25705 leader_election.cc:290] T 73781eedcc0f4dbd9bdd82d8ca269bd3 P 7ffdf999adba487a9887fe7e2cc0f874 [CANDIDATE]: Term 3 election: Requested vote from peers f2868245e89644679e2b7dac75591a58 (127.12.174.129:40387), 6e4eb6facf924880a0e38eeff91ba974 (127.12.174.130:41805)
I20260709 12:14:52.863078 25556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73781eedcc0f4dbd9bdd82d8ca269bd3" candidate_uuid: "7ffdf999adba487a9887fe7e2cc0f874" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "f2868245e89644679e2b7dac75591a58"
I20260709 12:14:52.863484 25633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73781eedcc0f4dbd9bdd82d8ca269bd3" candidate_uuid: "7ffdf999adba487a9887fe7e2cc0f874" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "6e4eb6facf924880a0e38eeff91ba974"
I20260709 12:14:52.863759 25556 raft_consensus.cc:3060] T 73781eedcc0f4dbd9bdd82d8ca269bd3 P f2868245e89644679e2b7dac75591a58 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:52.864147 25633 raft_consensus.cc:3055] T 73781eedcc0f4dbd9bdd82d8ca269bd3 P 6e4eb6facf924880a0e38eeff91ba974 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:14:52.864495 25633 raft_consensus.cc:740] T 73781eedcc0f4dbd9bdd82d8ca269bd3 P 6e4eb6facf924880a0e38eeff91ba974 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6e4eb6facf924880a0e38eeff91ba974, State: Running, Role: LEADER
I20260709 12:14:52.865396 25633 consensus_queue.cc:260] T 73781eedcc0f4dbd9bdd82d8ca269bd3 P 6e4eb6facf924880a0e38eeff91ba974 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:52.866999 25633 raft_consensus.cc:3060] T 73781eedcc0f4dbd9bdd82d8ca269bd3 P 6e4eb6facf924880a0e38eeff91ba974 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:14:52.872664 25556 raft_consensus.cc:2468] T 73781eedcc0f4dbd9bdd82d8ca269bd3 P f2868245e89644679e2b7dac75591a58 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffdf999adba487a9887fe7e2cc0f874 in term 3.
I20260709 12:14:52.873636 25633 raft_consensus.cc:2468] T 73781eedcc0f4dbd9bdd82d8ca269bd3 P 6e4eb6facf924880a0e38eeff91ba974 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ffdf999adba487a9887fe7e2cc0f874 in term 3.
I20260709 12:14:52.873970 25671 leader_election.cc:304] T 73781eedcc0f4dbd9bdd82d8ca269bd3 P 7ffdf999adba487a9887fe7e2cc0f874 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ffdf999adba487a9887fe7e2cc0f874, f2868245e89644679e2b7dac75591a58; no voters: 
I20260709 12:14:52.874886 26044 raft_consensus.cc:2804] T 73781eedcc0f4dbd9bdd82d8ca269bd3 P 7ffdf999adba487a9887fe7e2cc0f874 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:14:52.875435 26044 raft_consensus.cc:697] T 73781eedcc0f4dbd9bdd82d8ca269bd3 P 7ffdf999adba487a9887fe7e2cc0f874 [term 3 LEADER]: Becoming Leader. State: Replica: 7ffdf999adba487a9887fe7e2cc0f874, State: Running, Role: LEADER
I20260709 12:14:52.876324 26044 consensus_queue.cc:237] T 73781eedcc0f4dbd9bdd82d8ca269bd3 P 7ffdf999adba487a9887fe7e2cc0f874 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } }
I20260709 12:14:52.883714 25454 catalog_manager.cc:5697] T 73781eedcc0f4dbd9bdd82d8ca269bd3 P 7ffdf999adba487a9887fe7e2cc0f874 reported cstate change: term changed from 2 to 3, leader changed from 6e4eb6facf924880a0e38eeff91ba974 (127.12.174.130) to 7ffdf999adba487a9887fe7e2cc0f874 (127.12.174.131). New cstate: current_term: 3 leader_uuid: "7ffdf999adba487a9887fe7e2cc0f874" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ffdf999adba487a9887fe7e2cc0f874" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 36809 } health_report { overall_health: HEALTHY } } }
I20260709 12:14:53.243230 25633 raft_consensus.cc:1275] T 12dd6a165033473e9c39fd87d4763add P 6e4eb6facf924880a0e38eeff91ba974 [term 3 FOLLOWER]: Refusing update from remote peer 7ffdf999adba487a9887fe7e2cc0f874: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:53.244452 26045 consensus_queue.cc:1048] T 12dd6a165033473e9c39fd87d4763add P 7ffdf999adba487a9887fe7e2cc0f874 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:53.250454 25630 raft_consensus.cc:1275] T 556f2a498099427e9a90c94542674f0f P 6e4eb6facf924880a0e38eeff91ba974 [term 2 FOLLOWER]: Refusing update from remote peer 7ffdf999adba487a9887fe7e2cc0f874: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:14:53.251863 26044 consensus_queue.cc:1048] T 556f2a498099427e9a90c94542674f0f P 7ffdf999adba487a9887fe7e2cc0f874 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:53.259269 25556 raft_consensus.cc:1275] T 12dd6a165033473e9c39fd87d4763add P f2868245e89644679e2b7dac75591a58 [term 3 FOLLOWER]: Refusing update from remote peer 7ffdf999adba487a9887fe7e2cc0f874: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:14:53.263748 26044 consensus_queue.cc:1048] T 12dd6a165033473e9c39fd87d4763add P 7ffdf999adba487a9887fe7e2cc0f874 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:53.265269 25556 raft_consensus.cc:1275] T 556f2a498099427e9a90c94542674f0f P f2868245e89644679e2b7dac75591a58 [term 2 FOLLOWER]: Refusing update from remote peer 7ffdf999adba487a9887fe7e2cc0f874: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:14:53.274307 26049 consensus_queue.cc:1048] T 556f2a498099427e9a90c94542674f0f P 7ffdf999adba487a9887fe7e2cc0f874 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:14:53.335570 25559 raft_consensus.cc:1275] T 73781eedcc0f4dbd9bdd82d8ca269bd3 P f2868245e89644679e2b7dac75591a58 [term 3 FOLLOWER]: Refusing update from remote peer 7ffdf999adba487a9887fe7e2cc0f874: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:14:53.337035 26049 consensus_queue.cc:1048] T 73781eedcc0f4dbd9bdd82d8ca269bd3 P 7ffdf999adba487a9887fe7e2cc0f874 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:14:53.339023 12986 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:14:53.346872 25632 raft_consensus.cc:1275] T 73781eedcc0f4dbd9bdd82d8ca269bd3 P 6e4eb6facf924880a0e38eeff91ba974 [term 3 FOLLOWER]: Refusing update from remote peer 7ffdf999adba487a9887fe7e2cc0f874: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:14:53.349640 26044 consensus_queue.cc:1048] T 73781eedcc0f4dbd9bdd82d8ca269bd3 P 7ffdf999adba487a9887fe7e2cc0f874 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:14:53.351909 12986 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:14:53.352861 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:53.363171 12986 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:14:53.363878 12986 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:53.386197 25559 raft_consensus.cc:1275] T 243ba61cc23a42669b893d2e6268a359 P f2868245e89644679e2b7dac75591a58 [term 2 FOLLOWER]: Refusing update from remote peer 7ffdf999adba487a9887fe7e2cc0f874: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:53.387633 26045 consensus_queue.cc:1048] T 243ba61cc23a42669b893d2e6268a359 P 7ffdf999adba487a9887fe7e2cc0f874 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f2868245e89644679e2b7dac75591a58" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 40387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:53.397897 25632 raft_consensus.cc:1275] T 243ba61cc23a42669b893d2e6268a359 P 6e4eb6facf924880a0e38eeff91ba974 [term 2 FOLLOWER]: Refusing update from remote peer 7ffdf999adba487a9887fe7e2cc0f874: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:14:53.399792 26044 consensus_queue.cc:1048] T 243ba61cc23a42669b893d2e6268a359 P 7ffdf999adba487a9887fe7e2cc0f874 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e4eb6facf924880a0e38eeff91ba974" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:14:54.364886 12986 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:14:54.371312 12986 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:14:54.371723 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:54.376971 12986 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:14:54.377468 12986 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:55.378692 12986 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:14:55.384454 12986 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:14:55.385003 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:55.390398 12986 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:14:55.390962 12986 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:56.392189 12986 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:14:56.399657 12986 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:14:56.400296 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:56.406836 12986 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:14:56.407299 12986 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:57.408710 12986 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:14:57.416700 12986 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:14:57.417183 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:57.422327 12986 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:14:57.422784 12986 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:58.423889 12986 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:14:58.429924 12986 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:14:58.430449 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:58.437323 12986 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:14:58.437873 12986 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:14:59.439160 12986 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:14:59.444470 12986 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:14:59.444986 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:14:59.449965 12986 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:14:59.450459 12986 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:00.451809 12986 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:15:00.459776 12986 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:15:00.460546 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:00.467877 12986 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:00.468556 12986 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:01.469919 12986 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:15:01.478259 12986 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:15:01.478787 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:01.484004 12986 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:01.484517 12986 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:02.547787 12986 tablet_server.cc:179] TabletServer@127.12.174.129:0 shutting down...
W20260709 12:15:02.555776 25671 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:15:02.561151 25671 consensus_peers.cc:597] T 243ba61cc23a42669b893d2e6268a359 P 7ffdf999adba487a9887fe7e2cc0f874 -> Peer f2868245e89644679e2b7dac75591a58 (127.12.174.129:40387): Couldn't send request to peer f2868245e89644679e2b7dac75591a58. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:02.562073 25671 consensus_peers.cc:597] T 9204b1c1003646bfb3b61de1e4a235d6 P 7ffdf999adba487a9887fe7e2cc0f874 -> Peer f2868245e89644679e2b7dac75591a58 (127.12.174.129:40387): Couldn't send request to peer f2868245e89644679e2b7dac75591a58. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:02.588135 25597 consensus_peers.cc:597] T 5a26b0bedc3c4a8c99946f8e5565d353 P 6e4eb6facf924880a0e38eeff91ba974 -> Peer f2868245e89644679e2b7dac75591a58 (127.12.174.129:40387): Couldn't send request to peer f2868245e89644679e2b7dac75591a58. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:02.594578 12986 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:15:02.595428 12986 tablet_replica.cc:333] T d835765d07404362a68c773ddc446da5 P f2868245e89644679e2b7dac75591a58: stopping tablet replica
I20260709 12:15:02.596446 12986 raft_consensus.cc:2243] T d835765d07404362a68c773ddc446da5 P f2868245e89644679e2b7dac75591a58 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:02.597283 12986 raft_consensus.cc:2272] T d835765d07404362a68c773ddc446da5 P f2868245e89644679e2b7dac75591a58 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:02.600320 12986 tablet_replica.cc:333] T 2b233b12bfbc42c18b5b121f4122ba3c P f2868245e89644679e2b7dac75591a58: stopping tablet replica
I20260709 12:15:02.601099 12986 raft_consensus.cc:2243] T 2b233b12bfbc42c18b5b121f4122ba3c P f2868245e89644679e2b7dac75591a58 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:02.601799 12986 raft_consensus.cc:2272] T 2b233b12bfbc42c18b5b121f4122ba3c P f2868245e89644679e2b7dac75591a58 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:02.604579 12986 tablet_replica.cc:333] T 843ddab732fd4de99b4267d7abfd735e P f2868245e89644679e2b7dac75591a58: stopping tablet replica
I20260709 12:15:02.605286 12986 raft_consensus.cc:2243] T 843ddab732fd4de99b4267d7abfd735e P f2868245e89644679e2b7dac75591a58 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:02.605962 12986 raft_consensus.cc:2272] T 843ddab732fd4de99b4267d7abfd735e P f2868245e89644679e2b7dac75591a58 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:02.608572 12986 tablet_replica.cc:333] T 73781eedcc0f4dbd9bdd82d8ca269bd3 P f2868245e89644679e2b7dac75591a58: stopping tablet replica
I20260709 12:15:02.609249 12986 raft_consensus.cc:2243] T 73781eedcc0f4dbd9bdd82d8ca269bd3 P f2868245e89644679e2b7dac75591a58 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:02.609939 12986 raft_consensus.cc:2272] T 73781eedcc0f4dbd9bdd82d8ca269bd3 P f2868245e89644679e2b7dac75591a58 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:02.613713 12986 tablet_replica.cc:333] T 556f2a498099427e9a90c94542674f0f P f2868245e89644679e2b7dac75591a58: stopping tablet replica
I20260709 12:15:02.614753 12986 raft_consensus.cc:2243] T 556f2a498099427e9a90c94542674f0f P f2868245e89644679e2b7dac75591a58 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:02.615638 12986 raft_consensus.cc:2272] T 556f2a498099427e9a90c94542674f0f P f2868245e89644679e2b7dac75591a58 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:02.616266 25597 consensus_peers.cc:597] T 1513bb8a7eb64808b506fd1c49256752 P 6e4eb6facf924880a0e38eeff91ba974 -> Peer f2868245e89644679e2b7dac75591a58 (127.12.174.129:40387): Couldn't send request to peer f2868245e89644679e2b7dac75591a58. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:02.618623 12986 tablet_replica.cc:333] T 243ba61cc23a42669b893d2e6268a359 P f2868245e89644679e2b7dac75591a58: stopping tablet replica
I20260709 12:15:02.619601 12986 raft_consensus.cc:2243] T 243ba61cc23a42669b893d2e6268a359 P f2868245e89644679e2b7dac75591a58 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:02.620185 12986 raft_consensus.cc:2272] T 243ba61cc23a42669b893d2e6268a359 P f2868245e89644679e2b7dac75591a58 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:02.623009 12986 tablet_replica.cc:333] T 7abbe96052d8434cb1e2afd960768847 P f2868245e89644679e2b7dac75591a58: stopping tablet replica
I20260709 12:15:02.623910 12986 raft_consensus.cc:2243] T 7abbe96052d8434cb1e2afd960768847 P f2868245e89644679e2b7dac75591a58 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:02.625098 12986 raft_consensus.cc:2272] T 7abbe96052d8434cb1e2afd960768847 P f2868245e89644679e2b7dac75591a58 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:02.626816 25597 consensus_peers.cc:597] T 2b233b12bfbc42c18b5b121f4122ba3c P 6e4eb6facf924880a0e38eeff91ba974 -> Peer f2868245e89644679e2b7dac75591a58 (127.12.174.129:40387): Couldn't send request to peer f2868245e89644679e2b7dac75591a58. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:02.628185 12986 tablet_replica.cc:333] T 9204b1c1003646bfb3b61de1e4a235d6 P f2868245e89644679e2b7dac75591a58: stopping tablet replica
I20260709 12:15:02.628912 12986 raft_consensus.cc:2243] T 9204b1c1003646bfb3b61de1e4a235d6 P f2868245e89644679e2b7dac75591a58 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:02.629474 12986 raft_consensus.cc:2272] T 9204b1c1003646bfb3b61de1e4a235d6 P f2868245e89644679e2b7dac75591a58 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:02.632228 12986 tablet_replica.cc:333] T 741c39eaebc94dfc9bd1562b10cf0698 P f2868245e89644679e2b7dac75591a58: stopping tablet replica
I20260709 12:15:02.632848 12986 raft_consensus.cc:2243] T 741c39eaebc94dfc9bd1562b10cf0698 P f2868245e89644679e2b7dac75591a58 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:02.633920 12986 raft_consensus.cc:2272] T 741c39eaebc94dfc9bd1562b10cf0698 P f2868245e89644679e2b7dac75591a58 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:02.637099 12986 tablet_replica.cc:333] T 6a3136f9b7e64004b7005f11e9a050f9 P f2868245e89644679e2b7dac75591a58: stopping tablet replica
I20260709 12:15:02.637722 12986 raft_consensus.cc:2243] T 6a3136f9b7e64004b7005f11e9a050f9 P f2868245e89644679e2b7dac75591a58 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:02.638280 12986 raft_consensus.cc:2272] T 6a3136f9b7e64004b7005f11e9a050f9 P f2868245e89644679e2b7dac75591a58 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:02.641544 12986 tablet_replica.cc:333] T 448860827aca47b984ef19865addaeff P f2868245e89644679e2b7dac75591a58: stopping tablet replica
I20260709 12:15:02.642271 12986 raft_consensus.cc:2243] T 448860827aca47b984ef19865addaeff P f2868245e89644679e2b7dac75591a58 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:15:02.643354 12986 raft_consensus.cc:2272] T 448860827aca47b984ef19865addaeff P f2868245e89644679e2b7dac75591a58 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:02.645941 12986 tablet_replica.cc:333] T 12dd6a165033473e9c39fd87d4763add P f2868245e89644679e2b7dac75591a58: stopping tablet replica
I20260709 12:15:02.646620 12986 raft_consensus.cc:2243] T 12dd6a165033473e9c39fd87d4763add P f2868245e89644679e2b7dac75591a58 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:02.647173 12986 raft_consensus.cc:2272] T 12dd6a165033473e9c39fd87d4763add P f2868245e89644679e2b7dac75591a58 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:02.649945 12986 tablet_replica.cc:333] T 5a26b0bedc3c4a8c99946f8e5565d353 P f2868245e89644679e2b7dac75591a58: stopping tablet replica
I20260709 12:15:02.650612 12986 raft_consensus.cc:2243] T 5a26b0bedc3c4a8c99946f8e5565d353 P f2868245e89644679e2b7dac75591a58 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:02.651218 12986 raft_consensus.cc:2272] T 5a26b0bedc3c4a8c99946f8e5565d353 P f2868245e89644679e2b7dac75591a58 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:02.653775 12986 tablet_replica.cc:333] T 927ba57ba7864989a49c8265b14a9c0a P f2868245e89644679e2b7dac75591a58: stopping tablet replica
I20260709 12:15:02.654347 12986 raft_consensus.cc:2243] T 927ba57ba7864989a49c8265b14a9c0a P f2868245e89644679e2b7dac75591a58 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:15:02.655303 12986 raft_consensus.cc:2272] T 927ba57ba7864989a49c8265b14a9c0a P f2868245e89644679e2b7dac75591a58 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:02.658177 12986 tablet_replica.cc:333] T 1513bb8a7eb64808b506fd1c49256752 P f2868245e89644679e2b7dac75591a58: stopping tablet replica
I20260709 12:15:02.658787 12986 raft_consensus.cc:2243] T 1513bb8a7eb64808b506fd1c49256752 P f2868245e89644679e2b7dac75591a58 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:02.659382 12986 raft_consensus.cc:2272] T 1513bb8a7eb64808b506fd1c49256752 P f2868245e89644679e2b7dac75591a58 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:02.662734 12986 tablet_replica.cc:333] T fb492c949c97458a940dfcbd02a034cf P f2868245e89644679e2b7dac75591a58: stopping tablet replica
I20260709 12:15:02.663313 12986 raft_consensus.cc:2243] T fb492c949c97458a940dfcbd02a034cf P f2868245e89644679e2b7dac75591a58 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:15:02.664597 12986 raft_consensus.cc:2272] T fb492c949c97458a940dfcbd02a034cf P f2868245e89644679e2b7dac75591a58 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:02.667169 12986 tablet_replica.cc:333] T 5fa898e4a0cf49c79c9803b61ac3e756 P f2868245e89644679e2b7dac75591a58: stopping tablet replica
I20260709 12:15:02.667757 12986 raft_consensus.cc:2243] T 5fa898e4a0cf49c79c9803b61ac3e756 P f2868245e89644679e2b7dac75591a58 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:02.668290 12986 raft_consensus.cc:2272] T 5fa898e4a0cf49c79c9803b61ac3e756 P f2868245e89644679e2b7dac75591a58 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:02.670837 12986 tablet_replica.cc:333] T f9d5a17200ac45a7b5a2130ba1fd816b P f2868245e89644679e2b7dac75591a58: stopping tablet replica
I20260709 12:15:02.671664 12986 raft_consensus.cc:2243] T f9d5a17200ac45a7b5a2130ba1fd816b P f2868245e89644679e2b7dac75591a58 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:15:02.672907 12986 raft_consensus.cc:2272] T f9d5a17200ac45a7b5a2130ba1fd816b P f2868245e89644679e2b7dac75591a58 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:02.725484 12986 tablet_server.cc:196] TabletServer@127.12.174.129:0 shutdown complete.
W20260709 12:15:02.755227 25671 consensus_peers.cc:597] T 73781eedcc0f4dbd9bdd82d8ca269bd3 P 7ffdf999adba487a9887fe7e2cc0f874 -> Peer f2868245e89644679e2b7dac75591a58 (127.12.174.129:40387): Couldn't send request to peer f2868245e89644679e2b7dac75591a58. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:40387: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:02.785852 12986 tablet_server.cc:179] TabletServer@127.12.174.130:0 shutting down...
W20260709 12:15:02.797647 25671 consensus_peers.cc:597] T 9204b1c1003646bfb3b61de1e4a235d6 P 7ffdf999adba487a9887fe7e2cc0f874 -> Peer 6e4eb6facf924880a0e38eeff91ba974 (127.12.174.130:41805): Couldn't send request to peer 6e4eb6facf924880a0e38eeff91ba974. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:02.815376 12986 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:15:02.816305 12986 tablet_replica.cc:333] T d835765d07404362a68c773ddc446da5 P 6e4eb6facf924880a0e38eeff91ba974: stopping tablet replica
I20260709 12:15:02.817269 12986 raft_consensus.cc:2243] T d835765d07404362a68c773ddc446da5 P 6e4eb6facf924880a0e38eeff91ba974 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:02.818041 12986 raft_consensus.cc:2272] T d835765d07404362a68c773ddc446da5 P 6e4eb6facf924880a0e38eeff91ba974 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:02.820796 12986 tablet_replica.cc:333] T 73781eedcc0f4dbd9bdd82d8ca269bd3 P 6e4eb6facf924880a0e38eeff91ba974: stopping tablet replica
I20260709 12:15:02.821559 12986 raft_consensus.cc:2243] T 73781eedcc0f4dbd9bdd82d8ca269bd3 P 6e4eb6facf924880a0e38eeff91ba974 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:02.822211 12986 raft_consensus.cc:2272] T 73781eedcc0f4dbd9bdd82d8ca269bd3 P 6e4eb6facf924880a0e38eeff91ba974 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:02.824826 12986 tablet_replica.cc:333] T 843ddab732fd4de99b4267d7abfd735e P 6e4eb6facf924880a0e38eeff91ba974: stopping tablet replica
I20260709 12:15:02.825503 12986 raft_consensus.cc:2243] T 843ddab732fd4de99b4267d7abfd735e P 6e4eb6facf924880a0e38eeff91ba974 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:15:02.826540 12986 raft_consensus.cc:2272] T 843ddab732fd4de99b4267d7abfd735e P 6e4eb6facf924880a0e38eeff91ba974 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:02.829072 12986 tablet_replica.cc:333] T 556f2a498099427e9a90c94542674f0f P 6e4eb6facf924880a0e38eeff91ba974: stopping tablet replica
I20260709 12:15:02.829701 12986 raft_consensus.cc:2243] T 556f2a498099427e9a90c94542674f0f P 6e4eb6facf924880a0e38eeff91ba974 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:02.830345 12986 raft_consensus.cc:2272] T 556f2a498099427e9a90c94542674f0f P 6e4eb6facf924880a0e38eeff91ba974 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:02.832929 12986 tablet_replica.cc:333] T 2b233b12bfbc42c18b5b121f4122ba3c P 6e4eb6facf924880a0e38eeff91ba974: stopping tablet replica
I20260709 12:15:02.833678 12986 raft_consensus.cc:2243] T 2b233b12bfbc42c18b5b121f4122ba3c P 6e4eb6facf924880a0e38eeff91ba974 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:15:02.834695 12986 raft_consensus.cc:2272] T 2b233b12bfbc42c18b5b121f4122ba3c P 6e4eb6facf924880a0e38eeff91ba974 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:02.837337 12986 tablet_replica.cc:333] T 243ba61cc23a42669b893d2e6268a359 P 6e4eb6facf924880a0e38eeff91ba974: stopping tablet replica
I20260709 12:15:02.838156 12986 raft_consensus.cc:2243] T 243ba61cc23a42669b893d2e6268a359 P 6e4eb6facf924880a0e38eeff91ba974 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:02.838678 12986 raft_consensus.cc:2272] T 243ba61cc23a42669b893d2e6268a359 P 6e4eb6facf924880a0e38eeff91ba974 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:02.842023 12986 tablet_replica.cc:333] T 7abbe96052d8434cb1e2afd960768847 P 6e4eb6facf924880a0e38eeff91ba974: stopping tablet replica
I20260709 12:15:02.842921 12986 raft_consensus.cc:2243] T 7abbe96052d8434cb1e2afd960768847 P 6e4eb6facf924880a0e38eeff91ba974 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:02.843600 12986 raft_consensus.cc:2272] T 7abbe96052d8434cb1e2afd960768847 P 6e4eb6facf924880a0e38eeff91ba974 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:02.844784 25671 consensus_peers.cc:597] T 556f2a498099427e9a90c94542674f0f P 7ffdf999adba487a9887fe7e2cc0f874 -> Peer f2868245e89644679e2b7dac75591a58 (127.12.174.129:40387): Couldn't send request to peer f2868245e89644679e2b7dac75591a58. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:40387: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:02.846684 12986 tablet_replica.cc:333] T 12dd6a165033473e9c39fd87d4763add P 6e4eb6facf924880a0e38eeff91ba974: stopping tablet replica
I20260709 12:15:02.847487 12986 raft_consensus.cc:2243] T 12dd6a165033473e9c39fd87d4763add P 6e4eb6facf924880a0e38eeff91ba974 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:02.848063 12986 raft_consensus.cc:2272] T 12dd6a165033473e9c39fd87d4763add P 6e4eb6facf924880a0e38eeff91ba974 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:02.850714 12986 tablet_replica.cc:333] T 448860827aca47b984ef19865addaeff P 6e4eb6facf924880a0e38eeff91ba974: stopping tablet replica
I20260709 12:15:02.851315 12986 raft_consensus.cc:2243] T 448860827aca47b984ef19865addaeff P 6e4eb6facf924880a0e38eeff91ba974 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:02.851788 12986 raft_consensus.cc:2272] T 448860827aca47b984ef19865addaeff P 6e4eb6facf924880a0e38eeff91ba974 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:02.854499 12986 tablet_replica.cc:333] T 5a26b0bedc3c4a8c99946f8e5565d353 P 6e4eb6facf924880a0e38eeff91ba974: stopping tablet replica
I20260709 12:15:02.855182 12986 raft_consensus.cc:2243] T 5a26b0bedc3c4a8c99946f8e5565d353 P 6e4eb6facf924880a0e38eeff91ba974 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:15:02.856223 12986 raft_consensus.cc:2272] T 5a26b0bedc3c4a8c99946f8e5565d353 P 6e4eb6facf924880a0e38eeff91ba974 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:02.859189 12986 tablet_replica.cc:333] T 927ba57ba7864989a49c8265b14a9c0a P 6e4eb6facf924880a0e38eeff91ba974: stopping tablet replica
I20260709 12:15:02.859851 12986 raft_consensus.cc:2243] T 927ba57ba7864989a49c8265b14a9c0a P 6e4eb6facf924880a0e38eeff91ba974 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:02.860502 12986 raft_consensus.cc:2272] T 927ba57ba7864989a49c8265b14a9c0a P 6e4eb6facf924880a0e38eeff91ba974 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:02.863495 12986 tablet_replica.cc:333] T 1513bb8a7eb64808b506fd1c49256752 P 6e4eb6facf924880a0e38eeff91ba974: stopping tablet replica
I20260709 12:15:02.864210 12986 raft_consensus.cc:2243] T 1513bb8a7eb64808b506fd1c49256752 P 6e4eb6facf924880a0e38eeff91ba974 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:15:02.865339 12986 raft_consensus.cc:2272] T 1513bb8a7eb64808b506fd1c49256752 P 6e4eb6facf924880a0e38eeff91ba974 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:02.868245 12986 tablet_replica.cc:333] T 9204b1c1003646bfb3b61de1e4a235d6 P 6e4eb6facf924880a0e38eeff91ba974: stopping tablet replica
I20260709 12:15:02.868855 12986 raft_consensus.cc:2243] T 9204b1c1003646bfb3b61de1e4a235d6 P 6e4eb6facf924880a0e38eeff91ba974 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:02.869431 12986 raft_consensus.cc:2272] T 9204b1c1003646bfb3b61de1e4a235d6 P 6e4eb6facf924880a0e38eeff91ba974 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:02.872395 12986 tablet_replica.cc:333] T fb492c949c97458a940dfcbd02a034cf P 6e4eb6facf924880a0e38eeff91ba974: stopping tablet replica
I20260709 12:15:02.873019 12986 raft_consensus.cc:2243] T fb492c949c97458a940dfcbd02a034cf P 6e4eb6facf924880a0e38eeff91ba974 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:02.873764 12986 raft_consensus.cc:2272] T fb492c949c97458a940dfcbd02a034cf P 6e4eb6facf924880a0e38eeff91ba974 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:02.876410 12986 tablet_replica.cc:333] T f9d5a17200ac45a7b5a2130ba1fd816b P 6e4eb6facf924880a0e38eeff91ba974: stopping tablet replica
I20260709 12:15:02.877034 12986 raft_consensus.cc:2243] T f9d5a17200ac45a7b5a2130ba1fd816b P 6e4eb6facf924880a0e38eeff91ba974 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:02.877574 12986 raft_consensus.cc:2272] T f9d5a17200ac45a7b5a2130ba1fd816b P 6e4eb6facf924880a0e38eeff91ba974 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:02.880066 12986 tablet_replica.cc:333] T 5fa898e4a0cf49c79c9803b61ac3e756 P 6e4eb6facf924880a0e38eeff91ba974: stopping tablet replica
I20260709 12:15:02.880575 12986 raft_consensus.cc:2243] T 5fa898e4a0cf49c79c9803b61ac3e756 P 6e4eb6facf924880a0e38eeff91ba974 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:15:02.881598 12986 raft_consensus.cc:2272] T 5fa898e4a0cf49c79c9803b61ac3e756 P 6e4eb6facf924880a0e38eeff91ba974 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:02.884302 12986 tablet_replica.cc:333] T 6a3136f9b7e64004b7005f11e9a050f9 P 6e4eb6facf924880a0e38eeff91ba974: stopping tablet replica
I20260709 12:15:02.884861 12986 raft_consensus.cc:2243] T 6a3136f9b7e64004b7005f11e9a050f9 P 6e4eb6facf924880a0e38eeff91ba974 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:15:02.885918 12986 raft_consensus.cc:2272] T 6a3136f9b7e64004b7005f11e9a050f9 P 6e4eb6facf924880a0e38eeff91ba974 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:02.888525 12986 tablet_replica.cc:333] T 741c39eaebc94dfc9bd1562b10cf0698 P 6e4eb6facf924880a0e38eeff91ba974: stopping tablet replica
I20260709 12:15:02.889055 12986 raft_consensus.cc:2243] T 741c39eaebc94dfc9bd1562b10cf0698 P 6e4eb6facf924880a0e38eeff91ba974 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:02.889583 12986 raft_consensus.cc:2272] T 741c39eaebc94dfc9bd1562b10cf0698 P 6e4eb6facf924880a0e38eeff91ba974 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:02.939942 12986 tablet_server.cc:196] TabletServer@127.12.174.130:0 shutdown complete.
W20260709 12:15:02.972048 25671 consensus_peers.cc:597] T 12dd6a165033473e9c39fd87d4763add P 7ffdf999adba487a9887fe7e2cc0f874 -> Peer f2868245e89644679e2b7dac75591a58 (127.12.174.129:40387): Couldn't send request to peer f2868245e89644679e2b7dac75591a58. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:40387: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:02.991109 12986 tablet_server.cc:179] TabletServer@127.12.174.131:0 shutting down...
W20260709 12:15:02.991930 25671 consensus_peers.cc:597] T 243ba61cc23a42669b893d2e6268a359 P 7ffdf999adba487a9887fe7e2cc0f874 -> Peer 6e4eb6facf924880a0e38eeff91ba974 (127.12.174.130:41805): Couldn't send request to peer 6e4eb6facf924880a0e38eeff91ba974. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.130:41805: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:03.006419 25671 consensus_peers.cc:597] T d835765d07404362a68c773ddc446da5 P 7ffdf999adba487a9887fe7e2cc0f874 -> Peer f2868245e89644679e2b7dac75591a58 (127.12.174.129:40387): Couldn't send request to peer f2868245e89644679e2b7dac75591a58. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:40387: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:03.042714 12986 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:15:03.043504 12986 tablet_replica.cc:333] T d835765d07404362a68c773ddc446da5 P 7ffdf999adba487a9887fe7e2cc0f874: stopping tablet replica
I20260709 12:15:03.044317 12986 raft_consensus.cc:2243] T d835765d07404362a68c773ddc446da5 P 7ffdf999adba487a9887fe7e2cc0f874 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:15:03.045426 12986 raft_consensus.cc:2272] T d835765d07404362a68c773ddc446da5 P 7ffdf999adba487a9887fe7e2cc0f874 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:03.048053 12986 tablet_replica.cc:333] T 843ddab732fd4de99b4267d7abfd735e P 7ffdf999adba487a9887fe7e2cc0f874: stopping tablet replica
I20260709 12:15:03.048806 12986 raft_consensus.cc:2243] T 843ddab732fd4de99b4267d7abfd735e P 7ffdf999adba487a9887fe7e2cc0f874 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:03.049374 12986 raft_consensus.cc:2272] T 843ddab732fd4de99b4267d7abfd735e P 7ffdf999adba487a9887fe7e2cc0f874 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:03.051883 12986 tablet_replica.cc:333] T 2b233b12bfbc42c18b5b121f4122ba3c P 7ffdf999adba487a9887fe7e2cc0f874: stopping tablet replica
I20260709 12:15:03.052579 12986 raft_consensus.cc:2243] T 2b233b12bfbc42c18b5b121f4122ba3c P 7ffdf999adba487a9887fe7e2cc0f874 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:03.053159 12986 raft_consensus.cc:2272] T 2b233b12bfbc42c18b5b121f4122ba3c P 7ffdf999adba487a9887fe7e2cc0f874 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:03.055557 12986 tablet_replica.cc:333] T 73781eedcc0f4dbd9bdd82d8ca269bd3 P 7ffdf999adba487a9887fe7e2cc0f874: stopping tablet replica
I20260709 12:15:03.056196 12986 raft_consensus.cc:2243] T 73781eedcc0f4dbd9bdd82d8ca269bd3 P 7ffdf999adba487a9887fe7e2cc0f874 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:15:03.057179 12986 raft_consensus.cc:2272] T 73781eedcc0f4dbd9bdd82d8ca269bd3 P 7ffdf999adba487a9887fe7e2cc0f874 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:03.059603 12986 tablet_replica.cc:333] T 556f2a498099427e9a90c94542674f0f P 7ffdf999adba487a9887fe7e2cc0f874: stopping tablet replica
I20260709 12:15:03.060266 12986 raft_consensus.cc:2243] T 556f2a498099427e9a90c94542674f0f P 7ffdf999adba487a9887fe7e2cc0f874 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:15:03.061250 12986 raft_consensus.cc:2272] T 556f2a498099427e9a90c94542674f0f P 7ffdf999adba487a9887fe7e2cc0f874 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:03.063628 12986 tablet_replica.cc:333] T 243ba61cc23a42669b893d2e6268a359 P 7ffdf999adba487a9887fe7e2cc0f874: stopping tablet replica
I20260709 12:15:03.064255 12986 raft_consensus.cc:2243] T 243ba61cc23a42669b893d2e6268a359 P 7ffdf999adba487a9887fe7e2cc0f874 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:15:03.065188 12986 raft_consensus.cc:2272] T 243ba61cc23a42669b893d2e6268a359 P 7ffdf999adba487a9887fe7e2cc0f874 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:03.067836 12986 tablet_replica.cc:333] T 7abbe96052d8434cb1e2afd960768847 P 7ffdf999adba487a9887fe7e2cc0f874: stopping tablet replica
I20260709 12:15:03.068466 12986 raft_consensus.cc:2243] T 7abbe96052d8434cb1e2afd960768847 P 7ffdf999adba487a9887fe7e2cc0f874 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:03.069057 12986 raft_consensus.cc:2272] T 7abbe96052d8434cb1e2afd960768847 P 7ffdf999adba487a9887fe7e2cc0f874 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:03.071552 12986 tablet_replica.cc:333] T 9204b1c1003646bfb3b61de1e4a235d6 P 7ffdf999adba487a9887fe7e2cc0f874: stopping tablet replica
I20260709 12:15:03.072139 12986 raft_consensus.cc:2243] T 9204b1c1003646bfb3b61de1e4a235d6 P 7ffdf999adba487a9887fe7e2cc0f874 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:03.073084 12986 raft_consensus.cc:2272] T 9204b1c1003646bfb3b61de1e4a235d6 P 7ffdf999adba487a9887fe7e2cc0f874 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:03.075762 12986 tablet_replica.cc:333] T 6a3136f9b7e64004b7005f11e9a050f9 P 7ffdf999adba487a9887fe7e2cc0f874: stopping tablet replica
I20260709 12:15:03.076391 12986 raft_consensus.cc:2243] T 6a3136f9b7e64004b7005f11e9a050f9 P 7ffdf999adba487a9887fe7e2cc0f874 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:03.076896 12986 raft_consensus.cc:2272] T 6a3136f9b7e64004b7005f11e9a050f9 P 7ffdf999adba487a9887fe7e2cc0f874 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:03.079373 12986 tablet_replica.cc:333] T 741c39eaebc94dfc9bd1562b10cf0698 P 7ffdf999adba487a9887fe7e2cc0f874: stopping tablet replica
I20260709 12:15:03.079989 12986 raft_consensus.cc:2243] T 741c39eaebc94dfc9bd1562b10cf0698 P 7ffdf999adba487a9887fe7e2cc0f874 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:03.080480 12986 raft_consensus.cc:2272] T 741c39eaebc94dfc9bd1562b10cf0698 P 7ffdf999adba487a9887fe7e2cc0f874 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:03.083010 12986 tablet_replica.cc:333] T 5a26b0bedc3c4a8c99946f8e5565d353 P 7ffdf999adba487a9887fe7e2cc0f874: stopping tablet replica
I20260709 12:15:03.083623 12986 raft_consensus.cc:2243] T 5a26b0bedc3c4a8c99946f8e5565d353 P 7ffdf999adba487a9887fe7e2cc0f874 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:03.084156 12986 raft_consensus.cc:2272] T 5a26b0bedc3c4a8c99946f8e5565d353 P 7ffdf999adba487a9887fe7e2cc0f874 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:03.086544 12986 tablet_replica.cc:333] T 927ba57ba7864989a49c8265b14a9c0a P 7ffdf999adba487a9887fe7e2cc0f874: stopping tablet replica
I20260709 12:15:03.087200 12986 raft_consensus.cc:2243] T 927ba57ba7864989a49c8265b14a9c0a P 7ffdf999adba487a9887fe7e2cc0f874 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:03.087735 12986 raft_consensus.cc:2272] T 927ba57ba7864989a49c8265b14a9c0a P 7ffdf999adba487a9887fe7e2cc0f874 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:03.090240 12986 tablet_replica.cc:333] T 1513bb8a7eb64808b506fd1c49256752 P 7ffdf999adba487a9887fe7e2cc0f874: stopping tablet replica
I20260709 12:15:03.090849 12986 raft_consensus.cc:2243] T 1513bb8a7eb64808b506fd1c49256752 P 7ffdf999adba487a9887fe7e2cc0f874 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:03.091312 12986 raft_consensus.cc:2272] T 1513bb8a7eb64808b506fd1c49256752 P 7ffdf999adba487a9887fe7e2cc0f874 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:03.093892 12986 tablet_replica.cc:333] T 448860827aca47b984ef19865addaeff P 7ffdf999adba487a9887fe7e2cc0f874: stopping tablet replica
I20260709 12:15:03.094494 12986 raft_consensus.cc:2243] T 448860827aca47b984ef19865addaeff P 7ffdf999adba487a9887fe7e2cc0f874 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:03.095016 12986 raft_consensus.cc:2272] T 448860827aca47b984ef19865addaeff P 7ffdf999adba487a9887fe7e2cc0f874 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:03.097509 12986 tablet_replica.cc:333] T 12dd6a165033473e9c39fd87d4763add P 7ffdf999adba487a9887fe7e2cc0f874: stopping tablet replica
I20260709 12:15:03.098165 12986 raft_consensus.cc:2243] T 12dd6a165033473e9c39fd87d4763add P 7ffdf999adba487a9887fe7e2cc0f874 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:15:03.099089 12986 raft_consensus.cc:2272] T 12dd6a165033473e9c39fd87d4763add P 7ffdf999adba487a9887fe7e2cc0f874 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:03.101588 12986 tablet_replica.cc:333] T fb492c949c97458a940dfcbd02a034cf P 7ffdf999adba487a9887fe7e2cc0f874: stopping tablet replica
I20260709 12:15:03.102178 12986 raft_consensus.cc:2243] T fb492c949c97458a940dfcbd02a034cf P 7ffdf999adba487a9887fe7e2cc0f874 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:03.102705 12986 raft_consensus.cc:2272] T fb492c949c97458a940dfcbd02a034cf P 7ffdf999adba487a9887fe7e2cc0f874 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:03.105104 12986 tablet_replica.cc:333] T 5fa898e4a0cf49c79c9803b61ac3e756 P 7ffdf999adba487a9887fe7e2cc0f874: stopping tablet replica
I20260709 12:15:03.105676 12986 raft_consensus.cc:2243] T 5fa898e4a0cf49c79c9803b61ac3e756 P 7ffdf999adba487a9887fe7e2cc0f874 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:03.106194 12986 raft_consensus.cc:2272] T 5fa898e4a0cf49c79c9803b61ac3e756 P 7ffdf999adba487a9887fe7e2cc0f874 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:03.108620 12986 tablet_replica.cc:333] T f9d5a17200ac45a7b5a2130ba1fd816b P 7ffdf999adba487a9887fe7e2cc0f874: stopping tablet replica
I20260709 12:15:03.109146 12986 raft_consensus.cc:2243] T f9d5a17200ac45a7b5a2130ba1fd816b P 7ffdf999adba487a9887fe7e2cc0f874 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:03.109673 12986 raft_consensus.cc:2272] T f9d5a17200ac45a7b5a2130ba1fd816b P 7ffdf999adba487a9887fe7e2cc0f874 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:03.188377 12986 tablet_server.cc:196] TabletServer@127.12.174.131:0 shutdown complete.
I20260709 12:15:03.232097 12986 master.cc:562] Master@127.12.174.190:38643 shutting down...
I20260709 12:15:03.255467 12986 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 289dddc755224fb2a6616ef0c1fb377c [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:03.256208 12986 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 289dddc755224fb2a6616ef0c1fb377c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:03.256559 12986 tablet_replica.cc:333] T 00000000000000000000000000000000 P 289dddc755224fb2a6616ef0c1fb377c: stopping tablet replica
I20260709 12:15:03.278311 12986 master.cc:584] Master@127.12.174.190:38643 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (23192 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 12:15:03.336400 12986 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.12.174.190:44777
I20260709 12:15:03.337630 12986 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:15:03.343875 26083 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:03.343943 26084 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:03.344957 26086 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:15:03.346454 12986 server_base.cc:1061] running on GCE node
I20260709 12:15:03.347558 12986 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:15:03.347752 12986 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:15:03.347913 12986 hybrid_clock.cc:648] HybridClock initialized: now 1783599303347892 us; error 0 us; skew 500 ppm
I20260709 12:15:03.348479 12986 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:15:03.351016 12986 webserver.cc:533] Webserver started at http://127.12.174.190:42785/ using document root <none> and password file <none>
I20260709 12:15:03.351567 12986 fs_manager.cc:362] Metadata directory not provided
I20260709 12:15:03.351755 12986 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:15:03.352013 12986 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:15:03.353258 12986 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598886212958-12986-0/minicluster-data/master-0-root/instance:
uuid: "7afd9fe5d8ed452893c9113fd5ea3eb7"
format_stamp: "Formatted at 2026-07-09 12:15:03 on dist-test-slave-9q7n"
I20260709 12:15:03.358026 12986 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.004s
I20260709 12:15:03.361697 26091 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:03.362562 12986 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:15:03.362866 12986 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598886212958-12986-0/minicluster-data/master-0-root
uuid: "7afd9fe5d8ed452893c9113fd5ea3eb7"
format_stamp: "Formatted at 2026-07-09 12:15:03 on dist-test-slave-9q7n"
I20260709 12:15:03.363143 12986 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598886212958-12986-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598886212958-12986-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598886212958-12986-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:15:03.395869 12986 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:15:03.397230 12986 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:15:03.439838 12986 rpc_server.cc:307] RPC server started. Bound to: 127.12.174.190:44777
I20260709 12:15:03.439958 26142 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.174.190:44777 every 8 connection(s)
I20260709 12:15:03.444350 26143 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:03.458406 26143 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7afd9fe5d8ed452893c9113fd5ea3eb7: Bootstrap starting.
I20260709 12:15:03.463928 26143 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7afd9fe5d8ed452893c9113fd5ea3eb7: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:03.468888 26143 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7afd9fe5d8ed452893c9113fd5ea3eb7: No bootstrap required, opened a new log
I20260709 12:15:03.471627 26143 raft_consensus.cc:359] T 00000000000000000000000000000000 P 7afd9fe5d8ed452893c9113fd5ea3eb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7afd9fe5d8ed452893c9113fd5ea3eb7" member_type: VOTER }
I20260709 12:15:03.472101 26143 raft_consensus.cc:385] T 00000000000000000000000000000000 P 7afd9fe5d8ed452893c9113fd5ea3eb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:03.472287 26143 raft_consensus.cc:740] T 00000000000000000000000000000000 P 7afd9fe5d8ed452893c9113fd5ea3eb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7afd9fe5d8ed452893c9113fd5ea3eb7, State: Initialized, Role: FOLLOWER
I20260709 12:15:03.472860 26143 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7afd9fe5d8ed452893c9113fd5ea3eb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7afd9fe5d8ed452893c9113fd5ea3eb7" member_type: VOTER }
I20260709 12:15:03.473358 26143 raft_consensus.cc:399] T 00000000000000000000000000000000 P 7afd9fe5d8ed452893c9113fd5ea3eb7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:15:03.473557 26143 raft_consensus.cc:493] T 00000000000000000000000000000000 P 7afd9fe5d8ed452893c9113fd5ea3eb7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:15:03.473817 26143 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 7afd9fe5d8ed452893c9113fd5ea3eb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:03.479666 26143 raft_consensus.cc:515] T 00000000000000000000000000000000 P 7afd9fe5d8ed452893c9113fd5ea3eb7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7afd9fe5d8ed452893c9113fd5ea3eb7" member_type: VOTER }
I20260709 12:15:03.480223 26143 leader_election.cc:304] T 00000000000000000000000000000000 P 7afd9fe5d8ed452893c9113fd5ea3eb7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7afd9fe5d8ed452893c9113fd5ea3eb7; no voters: 
I20260709 12:15:03.481431 26143 leader_election.cc:290] T 00000000000000000000000000000000 P 7afd9fe5d8ed452893c9113fd5ea3eb7 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:15:03.481945 26146 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 7afd9fe5d8ed452893c9113fd5ea3eb7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:03.483392 26146 raft_consensus.cc:697] T 00000000000000000000000000000000 P 7afd9fe5d8ed452893c9113fd5ea3eb7 [term 1 LEADER]: Becoming Leader. State: Replica: 7afd9fe5d8ed452893c9113fd5ea3eb7, State: Running, Role: LEADER
I20260709 12:15:03.484165 26146 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7afd9fe5d8ed452893c9113fd5ea3eb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7afd9fe5d8ed452893c9113fd5ea3eb7" member_type: VOTER }
I20260709 12:15:03.484561 26143 sys_catalog.cc:565] T 00000000000000000000000000000000 P 7afd9fe5d8ed452893c9113fd5ea3eb7 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:15:03.488900 26147 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7afd9fe5d8ed452893c9113fd5ea3eb7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7afd9fe5d8ed452893c9113fd5ea3eb7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7afd9fe5d8ed452893c9113fd5ea3eb7" member_type: VOTER } }
I20260709 12:15:03.489001 26148 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7afd9fe5d8ed452893c9113fd5ea3eb7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7afd9fe5d8ed452893c9113fd5ea3eb7. Latest consensus state: current_term: 1 leader_uuid: "7afd9fe5d8ed452893c9113fd5ea3eb7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7afd9fe5d8ed452893c9113fd5ea3eb7" member_type: VOTER } }
I20260709 12:15:03.489948 26147 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7afd9fe5d8ed452893c9113fd5ea3eb7 [sys.catalog]: This master's current role is: LEADER
I20260709 12:15:03.490097 26148 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7afd9fe5d8ed452893c9113fd5ea3eb7 [sys.catalog]: This master's current role is: LEADER
I20260709 12:15:03.493481 26153 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:15:03.499034 26153 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:15:03.502632 12986 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:15:03.508909 26153 catalog_manager.cc:1383] Generated new cluster ID: 8879ce42c533478f9690720ad88bf3f8
I20260709 12:15:03.509197 26153 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:15:03.545588 26153 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:15:03.547039 26153 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:15:03.558494 26153 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 7afd9fe5d8ed452893c9113fd5ea3eb7: Generated new TSK 0
I20260709 12:15:03.559109 26153 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:15:03.570108 12986 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:15:03.576318 26164 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:03.577327 26165 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:03.579279 26167 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:15:03.579501 12986 server_base.cc:1061] running on GCE node
I20260709 12:15:03.580574 12986 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:15:03.580780 12986 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:15:03.580928 12986 hybrid_clock.cc:648] HybridClock initialized: now 1783599303580913 us; error 0 us; skew 500 ppm
I20260709 12:15:03.581429 12986 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:15:03.583719 12986 webserver.cc:533] Webserver started at http://127.12.174.129:32813/ using document root <none> and password file <none>
I20260709 12:15:03.584162 12986 fs_manager.cc:362] Metadata directory not provided
I20260709 12:15:03.584317 12986 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:15:03.584533 12986 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:15:03.585961 12986 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598886212958-12986-0/minicluster-data/ts-0-root/instance:
uuid: "b6ea3e3c1dd142c2a529707d9999b96d"
format_stamp: "Formatted at 2026-07-09 12:15:03 on dist-test-slave-9q7n"
I20260709 12:15:03.590485 12986 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 12:15:03.593914 26172 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:03.594645 12986 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:15:03.594905 12986 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598886212958-12986-0/minicluster-data/ts-0-root
uuid: "b6ea3e3c1dd142c2a529707d9999b96d"
format_stamp: "Formatted at 2026-07-09 12:15:03 on dist-test-slave-9q7n"
I20260709 12:15:03.595147 12986 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598886212958-12986-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598886212958-12986-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598886212958-12986-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:15:03.612695 12986 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:15:03.614061 12986 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:15:03.615556 12986 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:15:03.617906 12986 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:15:03.618089 12986 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:03.618323 12986 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:15:03.618476 12986 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:03.662727 12986 rpc_server.cc:307] RPC server started. Bound to: 127.12.174.129:34845
I20260709 12:15:03.662849 26234 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.174.129:34845 every 8 connection(s)
I20260709 12:15:03.668123 12986 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:15:03.676337 26239 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:03.677898 26240 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:03.681402 26242 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:15:03.681541 12986 server_base.cc:1061] running on GCE node
I20260709 12:15:03.682991 12986 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:15:03.683211 12986 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:15:03.683377 12986 hybrid_clock.cc:648] HybridClock initialized: now 1783599303683358 us; error 0 us; skew 500 ppm
I20260709 12:15:03.683938 12986 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:15:03.686303 12986 webserver.cc:533] Webserver started at http://127.12.174.130:36191/ using document root <none> and password file <none>
I20260709 12:15:03.686784 12986 fs_manager.cc:362] Metadata directory not provided
I20260709 12:15:03.686964 12986 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:15:03.687209 12986 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:15:03.688450 12986 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598886212958-12986-0/minicluster-data/ts-1-root/instance:
uuid: "47ec5c2bfdd24b1eb2a906f63214876e"
format_stamp: "Formatted at 2026-07-09 12:15:03 on dist-test-slave-9q7n"
I20260709 12:15:03.693540 12986 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:15:03.694731 26235 heartbeater.cc:344] Connected to a master server at 127.12.174.190:44777
I20260709 12:15:03.695158 26235 heartbeater.cc:461] Registering TS with master...
I20260709 12:15:03.695909 26235 heartbeater.cc:507] Master 127.12.174.190:44777 requested a full tablet report, sending...
I20260709 12:15:03.697713 26247 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:03.698535 26108 ts_manager.cc:194] Registered new tserver with Master: b6ea3e3c1dd142c2a529707d9999b96d (127.12.174.129:34845)
I20260709 12:15:03.698717 12986 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:15:03.699136 12986 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598886212958-12986-0/minicluster-data/ts-1-root
uuid: "47ec5c2bfdd24b1eb2a906f63214876e"
format_stamp: "Formatted at 2026-07-09 12:15:03 on dist-test-slave-9q7n"
I20260709 12:15:03.699512 12986 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598886212958-12986-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598886212958-12986-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598886212958-12986-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:15:03.701174 26108 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54450
I20260709 12:15:03.715378 12986 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:15:03.716830 12986 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:15:03.718422 12986 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:15:03.720662 12986 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:15:03.720847 12986 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:03.721096 12986 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:15:03.721253 12986 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:03.766637 12986 rpc_server.cc:307] RPC server started. Bound to: 127.12.174.130:43337
I20260709 12:15:03.766861 26309 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.174.130:43337 every 8 connection(s)
I20260709 12:15:03.771538 12986 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:15:03.779208 26313 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:03.780359 26314 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:03.783188 26316 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:15:03.784407 26310 heartbeater.cc:344] Connected to a master server at 127.12.174.190:44777
I20260709 12:15:03.784863 26310 heartbeater.cc:461] Registering TS with master...
I20260709 12:15:03.785184 12986 server_base.cc:1061] running on GCE node
I20260709 12:15:03.785928 26310 heartbeater.cc:507] Master 127.12.174.190:44777 requested a full tablet report, sending...
I20260709 12:15:03.786363 12986 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:15:03.786665 12986 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:15:03.786883 12986 hybrid_clock.cc:648] HybridClock initialized: now 1783599303786863 us; error 0 us; skew 500 ppm
I20260709 12:15:03.787510 12986 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:15:03.788333 26108 ts_manager.cc:194] Registered new tserver with Master: 47ec5c2bfdd24b1eb2a906f63214876e (127.12.174.130:43337)
I20260709 12:15:03.790247 12986 webserver.cc:533] Webserver started at http://127.12.174.131:38351/ using document root <none> and password file <none>
I20260709 12:15:03.790388 26108 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54464
I20260709 12:15:03.790961 12986 fs_manager.cc:362] Metadata directory not provided
I20260709 12:15:03.791252 12986 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:15:03.791538 12986 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:15:03.793131 12986 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598886212958-12986-0/minicluster-data/ts-2-root/instance:
uuid: "29ab82db4b2a4da39ed4796200c235bd"
format_stamp: "Formatted at 2026-07-09 12:15:03 on dist-test-slave-9q7n"
I20260709 12:15:03.797686 12986 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.002s
I20260709 12:15:03.801299 26321 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:03.802145 12986 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:15:03.802439 12986 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598886212958-12986-0/minicluster-data/ts-2-root
uuid: "29ab82db4b2a4da39ed4796200c235bd"
format_stamp: "Formatted at 2026-07-09 12:15:03 on dist-test-slave-9q7n"
I20260709 12:15:03.802706 12986 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598886212958-12986-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598886212958-12986-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskjh2E6P/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598886212958-12986-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:15:03.825429 12986 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:15:03.826751 12986 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:15:03.828274 12986 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:15:03.830585 12986 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:15:03.830772 12986 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:03.831017 12986 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:15:03.831182 12986 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:03.875027 12986 rpc_server.cc:307] RPC server started. Bound to: 127.12.174.131:43279
I20260709 12:15:03.875151 26383 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.174.131:43279 every 8 connection(s)
I20260709 12:15:03.889547 26384 heartbeater.cc:344] Connected to a master server at 127.12.174.190:44777
I20260709 12:15:03.890036 26384 heartbeater.cc:461] Registering TS with master...
I20260709 12:15:03.890833 26384 heartbeater.cc:507] Master 127.12.174.190:44777 requested a full tablet report, sending...
I20260709 12:15:03.892872 26108 ts_manager.cc:194] Registered new tserver with Master: 29ab82db4b2a4da39ed4796200c235bd (127.12.174.131:43279)
I20260709 12:15:03.893031 12986 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014856444s
I20260709 12:15:03.894922 26108 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54478
I20260709 12:15:03.920580 26108 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:54480:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:15:03.923481 26108 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:15:03.992782 26200 tablet_service.cc:1511] Processing CreateTablet for tablet f7cde2085f2b4fa182c0126b08cc9dd5 (DEFAULT_TABLE table=test-workload [id=69f5e7119a74423d898ce9464209a58d]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:15:03.996639 26200 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7cde2085f2b4fa182c0126b08cc9dd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:03.998096 26199 tablet_service.cc:1511] Processing CreateTablet for tablet 0ced3f63513a4e0ba988e57453fcf32e (DEFAULT_TABLE table=test-workload [id=69f5e7119a74423d898ce9464209a58d]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:15:03.999826 26199 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ced3f63513a4e0ba988e57453fcf32e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:04.004029 26198 tablet_service.cc:1511] Processing CreateTablet for tablet 2be4e2f97d1941a4a3fe4f0dc03bdc57 (DEFAULT_TABLE table=test-workload [id=69f5e7119a74423d898ce9464209a58d]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:15:04.005653 26198 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2be4e2f97d1941a4a3fe4f0dc03bdc57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:04.015934 26275 tablet_service.cc:1511] Processing CreateTablet for tablet f7cde2085f2b4fa182c0126b08cc9dd5 (DEFAULT_TABLE table=test-workload [id=69f5e7119a74423d898ce9464209a58d]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:15:04.017554 26275 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7cde2085f2b4fa182c0126b08cc9dd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:04.018853 26197 tablet_service.cc:1511] Processing CreateTablet for tablet 51f64f6460364936b54245159e7025b6 (DEFAULT_TABLE table=test-workload [id=69f5e7119a74423d898ce9464209a58d]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:15:04.020334 26197 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51f64f6460364936b54245159e7025b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:04.028095 26274 tablet_service.cc:1511] Processing CreateTablet for tablet 0ced3f63513a4e0ba988e57453fcf32e (DEFAULT_TABLE table=test-workload [id=69f5e7119a74423d898ce9464209a58d]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:15:04.029842 26274 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ced3f63513a4e0ba988e57453fcf32e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:04.040423 26273 tablet_service.cc:1511] Processing CreateTablet for tablet 2be4e2f97d1941a4a3fe4f0dc03bdc57 (DEFAULT_TABLE table=test-workload [id=69f5e7119a74423d898ce9464209a58d]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:15:04.044751 26349 tablet_service.cc:1511] Processing CreateTablet for tablet f7cde2085f2b4fa182c0126b08cc9dd5 (DEFAULT_TABLE table=test-workload [id=69f5e7119a74423d898ce9464209a58d]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:15:04.046303 26349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7cde2085f2b4fa182c0126b08cc9dd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:04.046020 26196 tablet_service.cc:1511] Processing CreateTablet for tablet 61c63f2d508d492dab277021e7a3de0f (DEFAULT_TABLE table=test-workload [id=69f5e7119a74423d898ce9464209a58d]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:15:04.047530 26196 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61c63f2d508d492dab277021e7a3de0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:04.051126 26348 tablet_service.cc:1511] Processing CreateTablet for tablet 0ced3f63513a4e0ba988e57453fcf32e (DEFAULT_TABLE table=test-workload [id=69f5e7119a74423d898ce9464209a58d]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:15:04.052526 26348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ced3f63513a4e0ba988e57453fcf32e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:04.054950 26347 tablet_service.cc:1511] Processing CreateTablet for tablet 2be4e2f97d1941a4a3fe4f0dc03bdc57 (DEFAULT_TABLE table=test-workload [id=69f5e7119a74423d898ce9464209a58d]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:15:04.057283 26346 tablet_service.cc:1511] Processing CreateTablet for tablet 51f64f6460364936b54245159e7025b6 (DEFAULT_TABLE table=test-workload [id=69f5e7119a74423d898ce9464209a58d]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:15:04.059192 26195 tablet_service.cc:1511] Processing CreateTablet for tablet 29fd96c2a5d34cbfbc04b6878fc1a9ae (DEFAULT_TABLE table=test-workload [id=69f5e7119a74423d898ce9464209a58d]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:15:04.060634 26195 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29fd96c2a5d34cbfbc04b6878fc1a9ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:04.060860 26345 tablet_service.cc:1511] Processing CreateTablet for tablet 61c63f2d508d492dab277021e7a3de0f (DEFAULT_TABLE table=test-workload [id=69f5e7119a74423d898ce9464209a58d]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:15:04.063143 26344 tablet_service.cc:1511] Processing CreateTablet for tablet 5640177c765d4c7eace47afab24512cc (DEFAULT_TABLE table=test-workload [id=69f5e7119a74423d898ce9464209a58d]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:15:04.065174 26273 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2be4e2f97d1941a4a3fe4f0dc03bdc57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:04.067363 26343 tablet_service.cc:1511] Processing CreateTablet for tablet 29fd96c2a5d34cbfbc04b6878fc1a9ae (DEFAULT_TABLE table=test-workload [id=69f5e7119a74423d898ce9464209a58d]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:15:04.070197 26342 tablet_service.cc:1511] Processing CreateTablet for tablet 8e274509d4a64b129aa342b697004bf1 (DEFAULT_TABLE table=test-workload [id=69f5e7119a74423d898ce9464209a58d]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:15:04.069216 26198 tablet_service.cc:1511] Processing CreateTablet for tablet 04079c0c50104d67a18aaeb329e1e434 (DEFAULT_TABLE table=test-workload [id=69f5e7119a74423d898ce9464209a58d]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:15:04.071904 26198 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04079c0c50104d67a18aaeb329e1e434. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:04.072535 26197 tablet_service.cc:1511] Processing CreateTablet for tablet 5640177c765d4c7eace47afab24512cc (DEFAULT_TABLE table=test-workload [id=69f5e7119a74423d898ce9464209a58d]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:15:04.073813 26197 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5640177c765d4c7eace47afab24512cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:04.076896 26200 tablet_service.cc:1511] Processing CreateTablet for tablet 8e274509d4a64b129aa342b697004bf1 (DEFAULT_TABLE table=test-workload [id=69f5e7119a74423d898ce9464209a58d]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:15:04.078213 26200 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e274509d4a64b129aa342b697004bf1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:04.079288 26341 tablet_service.cc:1511] Processing CreateTablet for tablet 04079c0c50104d67a18aaeb329e1e434 (DEFAULT_TABLE table=test-workload [id=69f5e7119a74423d898ce9464209a58d]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:15:04.085968 26343 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29fd96c2a5d34cbfbc04b6878fc1a9ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:04.088116 26341 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04079c0c50104d67a18aaeb329e1e434. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:04.089725 26345 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61c63f2d508d492dab277021e7a3de0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:04.091290 26344 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5640177c765d4c7eace47afab24512cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:04.092482 26347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2be4e2f97d1941a4a3fe4f0dc03bdc57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:04.094089 26342 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e274509d4a64b129aa342b697004bf1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:04.095445 26346 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51f64f6460364936b54245159e7025b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:04.130945 26272 tablet_service.cc:1511] Processing CreateTablet for tablet 51f64f6460364936b54245159e7025b6 (DEFAULT_TABLE table=test-workload [id=69f5e7119a74423d898ce9464209a58d]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:15:04.132913 26272 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51f64f6460364936b54245159e7025b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:04.135185 26271 tablet_service.cc:1511] Processing CreateTablet for tablet 61c63f2d508d492dab277021e7a3de0f (DEFAULT_TABLE table=test-workload [id=69f5e7119a74423d898ce9464209a58d]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:15:04.136965 26271 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61c63f2d508d492dab277021e7a3de0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:04.147823 26270 tablet_service.cc:1511] Processing CreateTablet for tablet 5640177c765d4c7eace47afab24512cc (DEFAULT_TABLE table=test-workload [id=69f5e7119a74423d898ce9464209a58d]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:15:04.151744 26269 tablet_service.cc:1511] Processing CreateTablet for tablet 29fd96c2a5d34cbfbc04b6878fc1a9ae (DEFAULT_TABLE table=test-workload [id=69f5e7119a74423d898ce9464209a58d]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:15:04.155485 26268 tablet_service.cc:1511] Processing CreateTablet for tablet 8e274509d4a64b129aa342b697004bf1 (DEFAULT_TABLE table=test-workload [id=69f5e7119a74423d898ce9464209a58d]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:15:04.159206 26267 tablet_service.cc:1511] Processing CreateTablet for tablet 04079c0c50104d67a18aaeb329e1e434 (DEFAULT_TABLE table=test-workload [id=69f5e7119a74423d898ce9464209a58d]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:15:04.161237 26270 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5640177c765d4c7eace47afab24512cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:04.166369 26268 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e274509d4a64b129aa342b697004bf1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:04.170310 26267 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04079c0c50104d67a18aaeb329e1e434. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:04.171051 26269 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29fd96c2a5d34cbfbc04b6878fc1a9ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:04.175259 26399 tablet_bootstrap.cc:492] T 0ced3f63513a4e0ba988e57453fcf32e P b6ea3e3c1dd142c2a529707d9999b96d: Bootstrap starting.
I20260709 12:15:04.205719 26399 tablet_bootstrap.cc:654] T 0ced3f63513a4e0ba988e57453fcf32e P b6ea3e3c1dd142c2a529707d9999b96d: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:04.264451 26400 tablet_bootstrap.cc:492] T f7cde2085f2b4fa182c0126b08cc9dd5 P 29ab82db4b2a4da39ed4796200c235bd: Bootstrap starting.
I20260709 12:15:04.267287 26401 tablet_bootstrap.cc:492] T f7cde2085f2b4fa182c0126b08cc9dd5 P 47ec5c2bfdd24b1eb2a906f63214876e: Bootstrap starting.
I20260709 12:15:04.273195 26399 tablet_bootstrap.cc:492] T 0ced3f63513a4e0ba988e57453fcf32e P b6ea3e3c1dd142c2a529707d9999b96d: No bootstrap required, opened a new log
I20260709 12:15:04.273936 26399 ts_tablet_manager.cc:1403] T 0ced3f63513a4e0ba988e57453fcf32e P b6ea3e3c1dd142c2a529707d9999b96d: Time spent bootstrapping tablet: real 0.099s	user 0.022s	sys 0.020s
I20260709 12:15:04.277318 26399 raft_consensus.cc:359] T 0ced3f63513a4e0ba988e57453fcf32e P b6ea3e3c1dd142c2a529707d9999b96d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:04.278159 26399 raft_consensus.cc:385] T 0ced3f63513a4e0ba988e57453fcf32e P b6ea3e3c1dd142c2a529707d9999b96d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:04.278504 26399 raft_consensus.cc:740] T 0ced3f63513a4e0ba988e57453fcf32e P b6ea3e3c1dd142c2a529707d9999b96d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6ea3e3c1dd142c2a529707d9999b96d, State: Initialized, Role: FOLLOWER
I20260709 12:15:04.279491 26399 consensus_queue.cc:260] T 0ced3f63513a4e0ba988e57453fcf32e P b6ea3e3c1dd142c2a529707d9999b96d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:04.282081 26235 heartbeater.cc:499] Master 127.12.174.190:44777 was elected leader, sending a full tablet report...
I20260709 12:15:04.282531 26399 ts_tablet_manager.cc:1434] T 0ced3f63513a4e0ba988e57453fcf32e P b6ea3e3c1dd142c2a529707d9999b96d: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.002s
I20260709 12:15:04.284332 26399 tablet_bootstrap.cc:492] T 51f64f6460364936b54245159e7025b6 P b6ea3e3c1dd142c2a529707d9999b96d: Bootstrap starting.
I20260709 12:15:04.289942 26400 tablet_bootstrap.cc:654] T f7cde2085f2b4fa182c0126b08cc9dd5 P 29ab82db4b2a4da39ed4796200c235bd: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:04.291047 26401 tablet_bootstrap.cc:654] T f7cde2085f2b4fa182c0126b08cc9dd5 P 47ec5c2bfdd24b1eb2a906f63214876e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:04.291395 26399 tablet_bootstrap.cc:654] T 51f64f6460364936b54245159e7025b6 P b6ea3e3c1dd142c2a529707d9999b96d: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:04.332497 26399 tablet_bootstrap.cc:492] T 51f64f6460364936b54245159e7025b6 P b6ea3e3c1dd142c2a529707d9999b96d: No bootstrap required, opened a new log
I20260709 12:15:04.332739 26401 tablet_bootstrap.cc:492] T f7cde2085f2b4fa182c0126b08cc9dd5 P 47ec5c2bfdd24b1eb2a906f63214876e: No bootstrap required, opened a new log
I20260709 12:15:04.332767 26400 tablet_bootstrap.cc:492] T f7cde2085f2b4fa182c0126b08cc9dd5 P 29ab82db4b2a4da39ed4796200c235bd: No bootstrap required, opened a new log
I20260709 12:15:04.333029 26399 ts_tablet_manager.cc:1403] T 51f64f6460364936b54245159e7025b6 P b6ea3e3c1dd142c2a529707d9999b96d: Time spent bootstrapping tablet: real 0.050s	user 0.026s	sys 0.018s
I20260709 12:15:04.333563 26400 ts_tablet_manager.cc:1403] T f7cde2085f2b4fa182c0126b08cc9dd5 P 29ab82db4b2a4da39ed4796200c235bd: Time spent bootstrapping tablet: real 0.070s	user 0.014s	sys 0.037s
I20260709 12:15:04.333559 26401 ts_tablet_manager.cc:1403] T f7cde2085f2b4fa182c0126b08cc9dd5 P 47ec5c2bfdd24b1eb2a906f63214876e: Time spent bootstrapping tablet: real 0.067s	user 0.016s	sys 0.030s
I20260709 12:15:04.335987 26399 raft_consensus.cc:359] T 51f64f6460364936b54245159e7025b6 P b6ea3e3c1dd142c2a529707d9999b96d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:04.336687 26399 raft_consensus.cc:385] T 51f64f6460364936b54245159e7025b6 P b6ea3e3c1dd142c2a529707d9999b96d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:04.336928 26399 raft_consensus.cc:740] T 51f64f6460364936b54245159e7025b6 P b6ea3e3c1dd142c2a529707d9999b96d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6ea3e3c1dd142c2a529707d9999b96d, State: Initialized, Role: FOLLOWER
I20260709 12:15:04.337047 26400 raft_consensus.cc:359] T f7cde2085f2b4fa182c0126b08cc9dd5 P 29ab82db4b2a4da39ed4796200c235bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:04.337324 26401 raft_consensus.cc:359] T f7cde2085f2b4fa182c0126b08cc9dd5 P 47ec5c2bfdd24b1eb2a906f63214876e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:04.337983 26400 raft_consensus.cc:385] T f7cde2085f2b4fa182c0126b08cc9dd5 P 29ab82db4b2a4da39ed4796200c235bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:04.337671 26399 consensus_queue.cc:260] T 51f64f6460364936b54245159e7025b6 P b6ea3e3c1dd142c2a529707d9999b96d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:04.338140 26401 raft_consensus.cc:385] T f7cde2085f2b4fa182c0126b08cc9dd5 P 47ec5c2bfdd24b1eb2a906f63214876e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:04.338392 26400 raft_consensus.cc:740] T f7cde2085f2b4fa182c0126b08cc9dd5 P 29ab82db4b2a4da39ed4796200c235bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29ab82db4b2a4da39ed4796200c235bd, State: Initialized, Role: FOLLOWER
I20260709 12:15:04.338594 26401 raft_consensus.cc:740] T f7cde2085f2b4fa182c0126b08cc9dd5 P 47ec5c2bfdd24b1eb2a906f63214876e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47ec5c2bfdd24b1eb2a906f63214876e, State: Initialized, Role: FOLLOWER
I20260709 12:15:04.339491 26400 consensus_queue.cc:260] T f7cde2085f2b4fa182c0126b08cc9dd5 P 29ab82db4b2a4da39ed4796200c235bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:04.339572 26401 consensus_queue.cc:260] T f7cde2085f2b4fa182c0126b08cc9dd5 P 47ec5c2bfdd24b1eb2a906f63214876e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:04.340168 26399 ts_tablet_manager.cc:1434] T 51f64f6460364936b54245159e7025b6 P b6ea3e3c1dd142c2a529707d9999b96d: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 12:15:04.341387 26399 tablet_bootstrap.cc:492] T 2be4e2f97d1941a4a3fe4f0dc03bdc57 P b6ea3e3c1dd142c2a529707d9999b96d: Bootstrap starting.
I20260709 12:15:04.348608 26399 tablet_bootstrap.cc:654] T 2be4e2f97d1941a4a3fe4f0dc03bdc57 P b6ea3e3c1dd142c2a529707d9999b96d: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:04.355924 26384 heartbeater.cc:499] Master 127.12.174.190:44777 was elected leader, sending a full tablet report...
I20260709 12:15:04.356554 26400 ts_tablet_manager.cc:1434] T f7cde2085f2b4fa182c0126b08cc9dd5 P 29ab82db4b2a4da39ed4796200c235bd: Time spent starting tablet: real 0.023s	user 0.014s	sys 0.007s
I20260709 12:15:04.357100 26403 raft_consensus.cc:493] T 51f64f6460364936b54245159e7025b6 P b6ea3e3c1dd142c2a529707d9999b96d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:04.357826 26400 tablet_bootstrap.cc:492] T 0ced3f63513a4e0ba988e57453fcf32e P 29ab82db4b2a4da39ed4796200c235bd: Bootstrap starting.
I20260709 12:15:04.357909 26403 raft_consensus.cc:515] T 51f64f6460364936b54245159e7025b6 P b6ea3e3c1dd142c2a529707d9999b96d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:04.365998 26400 tablet_bootstrap.cc:654] T 0ced3f63513a4e0ba988e57453fcf32e P 29ab82db4b2a4da39ed4796200c235bd: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:04.366963 26403 leader_election.cc:290] T 51f64f6460364936b54245159e7025b6 P b6ea3e3c1dd142c2a529707d9999b96d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 47ec5c2bfdd24b1eb2a906f63214876e (127.12.174.130:43337), 29ab82db4b2a4da39ed4796200c235bd (127.12.174.131:43279)
W20260709 12:15:04.379457 26385 tablet.cc:2406] T f7cde2085f2b4fa182c0126b08cc9dd5 P 29ab82db4b2a4da39ed4796200c235bd: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:15:04.390136 26310 heartbeater.cc:499] Master 127.12.174.190:44777 was elected leader, sending a full tablet report...
I20260709 12:15:04.390398 26399 tablet_bootstrap.cc:492] T 2be4e2f97d1941a4a3fe4f0dc03bdc57 P b6ea3e3c1dd142c2a529707d9999b96d: No bootstrap required, opened a new log
I20260709 12:15:04.391011 26399 ts_tablet_manager.cc:1403] T 2be4e2f97d1941a4a3fe4f0dc03bdc57 P b6ea3e3c1dd142c2a529707d9999b96d: Time spent bootstrapping tablet: real 0.050s	user 0.028s	sys 0.018s
I20260709 12:15:04.393317 26401 ts_tablet_manager.cc:1434] T f7cde2085f2b4fa182c0126b08cc9dd5 P 47ec5c2bfdd24b1eb2a906f63214876e: Time spent starting tablet: real 0.059s	user 0.011s	sys 0.011s
I20260709 12:15:04.394809 26401 tablet_bootstrap.cc:492] T 0ced3f63513a4e0ba988e57453fcf32e P 47ec5c2bfdd24b1eb2a906f63214876e: Bootstrap starting.
I20260709 12:15:04.394690 26399 raft_consensus.cc:359] T 2be4e2f97d1941a4a3fe4f0dc03bdc57 P b6ea3e3c1dd142c2a529707d9999b96d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:04.395645 26399 raft_consensus.cc:385] T 2be4e2f97d1941a4a3fe4f0dc03bdc57 P b6ea3e3c1dd142c2a529707d9999b96d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:04.395964 26399 raft_consensus.cc:740] T 2be4e2f97d1941a4a3fe4f0dc03bdc57 P b6ea3e3c1dd142c2a529707d9999b96d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6ea3e3c1dd142c2a529707d9999b96d, State: Initialized, Role: FOLLOWER
I20260709 12:15:04.397073 26399 consensus_queue.cc:260] T 2be4e2f97d1941a4a3fe4f0dc03bdc57 P b6ea3e3c1dd142c2a529707d9999b96d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:04.399976 26399 ts_tablet_manager.cc:1434] T 2be4e2f97d1941a4a3fe4f0dc03bdc57 P b6ea3e3c1dd142c2a529707d9999b96d: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:15:04.401352 26399 tablet_bootstrap.cc:492] T f7cde2085f2b4fa182c0126b08cc9dd5 P b6ea3e3c1dd142c2a529707d9999b96d: Bootstrap starting.
I20260709 12:15:04.409847 26399 tablet_bootstrap.cc:654] T f7cde2085f2b4fa182c0126b08cc9dd5 P b6ea3e3c1dd142c2a529707d9999b96d: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:04.416694 26401 tablet_bootstrap.cc:654] T 0ced3f63513a4e0ba988e57453fcf32e P 47ec5c2bfdd24b1eb2a906f63214876e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:04.435256 26399 tablet_bootstrap.cc:492] T f7cde2085f2b4fa182c0126b08cc9dd5 P b6ea3e3c1dd142c2a529707d9999b96d: No bootstrap required, opened a new log
I20260709 12:15:04.435216 26400 tablet_bootstrap.cc:492] T 0ced3f63513a4e0ba988e57453fcf32e P 29ab82db4b2a4da39ed4796200c235bd: No bootstrap required, opened a new log
I20260709 12:15:04.436215 26399 ts_tablet_manager.cc:1403] T f7cde2085f2b4fa182c0126b08cc9dd5 P b6ea3e3c1dd142c2a529707d9999b96d: Time spent bootstrapping tablet: real 0.035s	user 0.016s	sys 0.010s
I20260709 12:15:04.436566 26400 ts_tablet_manager.cc:1403] T 0ced3f63513a4e0ba988e57453fcf32e P 29ab82db4b2a4da39ed4796200c235bd: Time spent bootstrapping tablet: real 0.079s	user 0.046s	sys 0.030s
I20260709 12:15:04.439337 26401 tablet_bootstrap.cc:492] T 0ced3f63513a4e0ba988e57453fcf32e P 47ec5c2bfdd24b1eb2a906f63214876e: No bootstrap required, opened a new log
I20260709 12:15:04.440119 26401 ts_tablet_manager.cc:1403] T 0ced3f63513a4e0ba988e57453fcf32e P 47ec5c2bfdd24b1eb2a906f63214876e: Time spent bootstrapping tablet: real 0.046s	user 0.015s	sys 0.007s
I20260709 12:15:04.440130 26399 raft_consensus.cc:359] T f7cde2085f2b4fa182c0126b08cc9dd5 P b6ea3e3c1dd142c2a529707d9999b96d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:04.443377 26399 raft_consensus.cc:385] T f7cde2085f2b4fa182c0126b08cc9dd5 P b6ea3e3c1dd142c2a529707d9999b96d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:04.443760 26399 raft_consensus.cc:740] T f7cde2085f2b4fa182c0126b08cc9dd5 P b6ea3e3c1dd142c2a529707d9999b96d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6ea3e3c1dd142c2a529707d9999b96d, State: Initialized, Role: FOLLOWER
I20260709 12:15:04.444840 26399 consensus_queue.cc:260] T f7cde2085f2b4fa182c0126b08cc9dd5 P b6ea3e3c1dd142c2a529707d9999b96d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:04.441807 26400 raft_consensus.cc:359] T 0ced3f63513a4e0ba988e57453fcf32e P 29ab82db4b2a4da39ed4796200c235bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:04.446681 26400 raft_consensus.cc:385] T 0ced3f63513a4e0ba988e57453fcf32e P 29ab82db4b2a4da39ed4796200c235bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:04.447024 26400 raft_consensus.cc:740] T 0ced3f63513a4e0ba988e57453fcf32e P 29ab82db4b2a4da39ed4796200c235bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29ab82db4b2a4da39ed4796200c235bd, State: Initialized, Role: FOLLOWER
I20260709 12:15:04.447922 26400 consensus_queue.cc:260] T 0ced3f63513a4e0ba988e57453fcf32e P 29ab82db4b2a4da39ed4796200c235bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:04.449384 26359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f64f6460364936b54245159e7025b6" candidate_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29ab82db4b2a4da39ed4796200c235bd" is_pre_election: true
I20260709 12:15:04.450518 26400 ts_tablet_manager.cc:1434] T 0ced3f63513a4e0ba988e57453fcf32e P 29ab82db4b2a4da39ed4796200c235bd: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.003s
I20260709 12:15:04.450673 26399 ts_tablet_manager.cc:1434] T f7cde2085f2b4fa182c0126b08cc9dd5 P b6ea3e3c1dd142c2a529707d9999b96d: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 12:15:04.451767 26400 tablet_bootstrap.cc:492] T 29fd96c2a5d34cbfbc04b6878fc1a9ae P 29ab82db4b2a4da39ed4796200c235bd: Bootstrap starting.
I20260709 12:15:04.451939 26399 tablet_bootstrap.cc:492] T 5640177c765d4c7eace47afab24512cc P b6ea3e3c1dd142c2a529707d9999b96d: Bootstrap starting.
I20260709 12:15:04.459048 26400 tablet_bootstrap.cc:654] T 29fd96c2a5d34cbfbc04b6878fc1a9ae P 29ab82db4b2a4da39ed4796200c235bd: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:04.449385 26285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f64f6460364936b54245159e7025b6" candidate_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" is_pre_election: true
W20260709 12:15:04.460940 26173 leader_election.cc:343] T 51f64f6460364936b54245159e7025b6 P b6ea3e3c1dd142c2a529707d9999b96d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 47ec5c2bfdd24b1eb2a906f63214876e (127.12.174.130:43337): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:15:04.462204 26174 leader_election.cc:343] T 51f64f6460364936b54245159e7025b6 P b6ea3e3c1dd142c2a529707d9999b96d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 29ab82db4b2a4da39ed4796200c235bd (127.12.174.131:43279): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:04.462769 26174 leader_election.cc:304] T 51f64f6460364936b54245159e7025b6 P b6ea3e3c1dd142c2a529707d9999b96d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6ea3e3c1dd142c2a529707d9999b96d; no voters: 29ab82db4b2a4da39ed4796200c235bd, 47ec5c2bfdd24b1eb2a906f63214876e
I20260709 12:15:04.463762 26403 raft_consensus.cc:2749] T 51f64f6460364936b54245159e7025b6 P b6ea3e3c1dd142c2a529707d9999b96d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:04.465088 26400 tablet_bootstrap.cc:492] T 29fd96c2a5d34cbfbc04b6878fc1a9ae P 29ab82db4b2a4da39ed4796200c235bd: No bootstrap required, opened a new log
I20260709 12:15:04.465812 26400 ts_tablet_manager.cc:1403] T 29fd96c2a5d34cbfbc04b6878fc1a9ae P 29ab82db4b2a4da39ed4796200c235bd: Time spent bootstrapping tablet: real 0.014s	user 0.007s	sys 0.006s
I20260709 12:15:04.465704 26401 raft_consensus.cc:359] T 0ced3f63513a4e0ba988e57453fcf32e P 47ec5c2bfdd24b1eb2a906f63214876e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:04.466670 26399 tablet_bootstrap.cc:654] T 5640177c765d4c7eace47afab24512cc P b6ea3e3c1dd142c2a529707d9999b96d: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:04.466982 26401 raft_consensus.cc:385] T 0ced3f63513a4e0ba988e57453fcf32e P 47ec5c2bfdd24b1eb2a906f63214876e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:04.467386 26401 raft_consensus.cc:740] T 0ced3f63513a4e0ba988e57453fcf32e P 47ec5c2bfdd24b1eb2a906f63214876e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47ec5c2bfdd24b1eb2a906f63214876e, State: Initialized, Role: FOLLOWER
I20260709 12:15:04.468340 26401 consensus_queue.cc:260] T 0ced3f63513a4e0ba988e57453fcf32e P 47ec5c2bfdd24b1eb2a906f63214876e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:04.468993 26400 raft_consensus.cc:359] T 29fd96c2a5d34cbfbc04b6878fc1a9ae P 29ab82db4b2a4da39ed4796200c235bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:04.469717 26400 raft_consensus.cc:385] T 29fd96c2a5d34cbfbc04b6878fc1a9ae P 29ab82db4b2a4da39ed4796200c235bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:04.470039 26400 raft_consensus.cc:740] T 29fd96c2a5d34cbfbc04b6878fc1a9ae P 29ab82db4b2a4da39ed4796200c235bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29ab82db4b2a4da39ed4796200c235bd, State: Initialized, Role: FOLLOWER
I20260709 12:15:04.470944 26400 consensus_queue.cc:260] T 29fd96c2a5d34cbfbc04b6878fc1a9ae P 29ab82db4b2a4da39ed4796200c235bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:04.473413 26400 ts_tablet_manager.cc:1434] T 29fd96c2a5d34cbfbc04b6878fc1a9ae P 29ab82db4b2a4da39ed4796200c235bd: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.001s
I20260709 12:15:04.474932 26400 tablet_bootstrap.cc:492] T 2be4e2f97d1941a4a3fe4f0dc03bdc57 P 29ab82db4b2a4da39ed4796200c235bd: Bootstrap starting.
I20260709 12:15:04.481129 26399 tablet_bootstrap.cc:492] T 5640177c765d4c7eace47afab24512cc P b6ea3e3c1dd142c2a529707d9999b96d: No bootstrap required, opened a new log
I20260709 12:15:04.481542 26400 tablet_bootstrap.cc:654] T 2be4e2f97d1941a4a3fe4f0dc03bdc57 P 29ab82db4b2a4da39ed4796200c235bd: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:04.471640 26401 ts_tablet_manager.cc:1434] T 0ced3f63513a4e0ba988e57453fcf32e P 47ec5c2bfdd24b1eb2a906f63214876e: Time spent starting tablet: real 0.028s	user 0.005s	sys 0.002s
I20260709 12:15:04.481911 26399 ts_tablet_manager.cc:1403] T 5640177c765d4c7eace47afab24512cc P b6ea3e3c1dd142c2a529707d9999b96d: Time spent bootstrapping tablet: real 0.030s	user 0.019s	sys 0.004s
I20260709 12:15:04.485706 26399 raft_consensus.cc:359] T 5640177c765d4c7eace47afab24512cc P b6ea3e3c1dd142c2a529707d9999b96d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:04.486675 26399 raft_consensus.cc:385] T 5640177c765d4c7eace47afab24512cc P b6ea3e3c1dd142c2a529707d9999b96d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:04.487002 26399 raft_consensus.cc:740] T 5640177c765d4c7eace47afab24512cc P b6ea3e3c1dd142c2a529707d9999b96d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6ea3e3c1dd142c2a529707d9999b96d, State: Initialized, Role: FOLLOWER
I20260709 12:15:04.487959 26401 tablet_bootstrap.cc:492] T 2be4e2f97d1941a4a3fe4f0dc03bdc57 P 47ec5c2bfdd24b1eb2a906f63214876e: Bootstrap starting.
I20260709 12:15:04.487830 26399 consensus_queue.cc:260] T 5640177c765d4c7eace47afab24512cc P b6ea3e3c1dd142c2a529707d9999b96d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:04.491746 26408 raft_consensus.cc:493] T 0ced3f63513a4e0ba988e57453fcf32e P 47ec5c2bfdd24b1eb2a906f63214876e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:04.492492 26408 raft_consensus.cc:515] T 0ced3f63513a4e0ba988e57453fcf32e P 47ec5c2bfdd24b1eb2a906f63214876e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
W20260709 12:15:04.497567 26156 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:15:04.499352 26399 ts_tablet_manager.cc:1434] T 5640177c765d4c7eace47afab24512cc P b6ea3e3c1dd142c2a529707d9999b96d: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 12:15:04.504360 26401 tablet_bootstrap.cc:654] T 2be4e2f97d1941a4a3fe4f0dc03bdc57 P 47ec5c2bfdd24b1eb2a906f63214876e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:04.506333 26408 leader_election.cc:290] T 0ced3f63513a4e0ba988e57453fcf32e P 47ec5c2bfdd24b1eb2a906f63214876e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6ea3e3c1dd142c2a529707d9999b96d (127.12.174.129:34845), 29ab82db4b2a4da39ed4796200c235bd (127.12.174.131:43279)
I20260709 12:15:04.509354 26399 tablet_bootstrap.cc:492] T 29fd96c2a5d34cbfbc04b6878fc1a9ae P b6ea3e3c1dd142c2a529707d9999b96d: Bootstrap starting.
I20260709 12:15:04.516026 26401 tablet_bootstrap.cc:492] T 2be4e2f97d1941a4a3fe4f0dc03bdc57 P 47ec5c2bfdd24b1eb2a906f63214876e: No bootstrap required, opened a new log
I20260709 12:15:04.517027 26401 ts_tablet_manager.cc:1403] T 2be4e2f97d1941a4a3fe4f0dc03bdc57 P 47ec5c2bfdd24b1eb2a906f63214876e: Time spent bootstrapping tablet: real 0.029s	user 0.006s	sys 0.011s
I20260709 12:15:04.517949 26399 tablet_bootstrap.cc:654] T 29fd96c2a5d34cbfbc04b6878fc1a9ae P b6ea3e3c1dd142c2a529707d9999b96d: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:04.521241 26401 raft_consensus.cc:359] T 2be4e2f97d1941a4a3fe4f0dc03bdc57 P 47ec5c2bfdd24b1eb2a906f63214876e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:04.522559 26401 raft_consensus.cc:385] T 2be4e2f97d1941a4a3fe4f0dc03bdc57 P 47ec5c2bfdd24b1eb2a906f63214876e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:04.522996 26401 raft_consensus.cc:740] T 2be4e2f97d1941a4a3fe4f0dc03bdc57 P 47ec5c2bfdd24b1eb2a906f63214876e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47ec5c2bfdd24b1eb2a906f63214876e, State: Initialized, Role: FOLLOWER
I20260709 12:15:04.524044 26401 consensus_queue.cc:260] T 2be4e2f97d1941a4a3fe4f0dc03bdc57 P 47ec5c2bfdd24b1eb2a906f63214876e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:04.529803 26403 raft_consensus.cc:493] T 0ced3f63513a4e0ba988e57453fcf32e P b6ea3e3c1dd142c2a529707d9999b96d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:04.530660 26403 raft_consensus.cc:515] T 0ced3f63513a4e0ba988e57453fcf32e P b6ea3e3c1dd142c2a529707d9999b96d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:04.535411 26359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ced3f63513a4e0ba988e57453fcf32e" candidate_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29ab82db4b2a4da39ed4796200c235bd" is_pre_election: true
I20260709 12:15:04.536309 26359 raft_consensus.cc:2468] T 0ced3f63513a4e0ba988e57453fcf32e P 29ab82db4b2a4da39ed4796200c235bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6ea3e3c1dd142c2a529707d9999b96d in term 0.
I20260709 12:15:04.536546 26401 ts_tablet_manager.cc:1434] T 2be4e2f97d1941a4a3fe4f0dc03bdc57 P 47ec5c2bfdd24b1eb2a906f63214876e: Time spent starting tablet: real 0.019s	user 0.009s	sys 0.000s
I20260709 12:15:04.537312 26403 leader_election.cc:290] T 0ced3f63513a4e0ba988e57453fcf32e P b6ea3e3c1dd142c2a529707d9999b96d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 47ec5c2bfdd24b1eb2a906f63214876e (127.12.174.130:43337), 29ab82db4b2a4da39ed4796200c235bd (127.12.174.131:43279)
I20260709 12:15:04.538829 26174 leader_election.cc:304] T 0ced3f63513a4e0ba988e57453fcf32e P b6ea3e3c1dd142c2a529707d9999b96d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29ab82db4b2a4da39ed4796200c235bd, b6ea3e3c1dd142c2a529707d9999b96d; no voters: 
I20260709 12:15:04.540009 26403 raft_consensus.cc:2804] T 0ced3f63513a4e0ba988e57453fcf32e P b6ea3e3c1dd142c2a529707d9999b96d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:04.540441 26403 raft_consensus.cc:493] T 0ced3f63513a4e0ba988e57453fcf32e P b6ea3e3c1dd142c2a529707d9999b96d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:04.540796 26403 raft_consensus.cc:3060] T 0ced3f63513a4e0ba988e57453fcf32e P b6ea3e3c1dd142c2a529707d9999b96d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:04.546823 26401 tablet_bootstrap.cc:492] T 04079c0c50104d67a18aaeb329e1e434 P 47ec5c2bfdd24b1eb2a906f63214876e: Bootstrap starting.
I20260709 12:15:04.551491 26285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ced3f63513a4e0ba988e57453fcf32e" candidate_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" is_pre_election: true
I20260709 12:15:04.552577 26285 raft_consensus.cc:2468] T 0ced3f63513a4e0ba988e57453fcf32e P 47ec5c2bfdd24b1eb2a906f63214876e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6ea3e3c1dd142c2a529707d9999b96d in term 0.
I20260709 12:15:04.555497 26399 tablet_bootstrap.cc:492] T 29fd96c2a5d34cbfbc04b6878fc1a9ae P b6ea3e3c1dd142c2a529707d9999b96d: No bootstrap required, opened a new log
I20260709 12:15:04.556200 26399 ts_tablet_manager.cc:1403] T 29fd96c2a5d34cbfbc04b6878fc1a9ae P b6ea3e3c1dd142c2a529707d9999b96d: Time spent bootstrapping tablet: real 0.047s	user 0.024s	sys 0.019s
I20260709 12:15:04.557636 26401 tablet_bootstrap.cc:654] T 04079c0c50104d67a18aaeb329e1e434 P 47ec5c2bfdd24b1eb2a906f63214876e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:04.559875 26399 raft_consensus.cc:359] T 29fd96c2a5d34cbfbc04b6878fc1a9ae P b6ea3e3c1dd142c2a529707d9999b96d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:04.560775 26399 raft_consensus.cc:385] T 29fd96c2a5d34cbfbc04b6878fc1a9ae P b6ea3e3c1dd142c2a529707d9999b96d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:04.561086 26399 raft_consensus.cc:740] T 29fd96c2a5d34cbfbc04b6878fc1a9ae P b6ea3e3c1dd142c2a529707d9999b96d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6ea3e3c1dd142c2a529707d9999b96d, State: Initialized, Role: FOLLOWER
I20260709 12:15:04.562014 26399 consensus_queue.cc:260] T 29fd96c2a5d34cbfbc04b6878fc1a9ae P b6ea3e3c1dd142c2a529707d9999b96d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:04.572495 26399 ts_tablet_manager.cc:1434] T 29fd96c2a5d34cbfbc04b6878fc1a9ae P b6ea3e3c1dd142c2a529707d9999b96d: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.008s
I20260709 12:15:04.578626 26210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ced3f63513a4e0ba988e57453fcf32e" candidate_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" is_pre_election: true
I20260709 12:15:04.585196 26400 tablet_bootstrap.cc:492] T 2be4e2f97d1941a4a3fe4f0dc03bdc57 P 29ab82db4b2a4da39ed4796200c235bd: No bootstrap required, opened a new log
I20260709 12:15:04.586083 26400 ts_tablet_manager.cc:1403] T 2be4e2f97d1941a4a3fe4f0dc03bdc57 P 29ab82db4b2a4da39ed4796200c235bd: Time spent bootstrapping tablet: real 0.111s	user 0.053s	sys 0.050s
I20260709 12:15:04.586722 26359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ced3f63513a4e0ba988e57453fcf32e" candidate_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29ab82db4b2a4da39ed4796200c235bd" is_pre_election: true
I20260709 12:15:04.587528 26359 raft_consensus.cc:2468] T 0ced3f63513a4e0ba988e57453fcf32e P 29ab82db4b2a4da39ed4796200c235bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47ec5c2bfdd24b1eb2a906f63214876e in term 0.
I20260709 12:15:04.587775 26399 tablet_bootstrap.cc:492] T 61c63f2d508d492dab277021e7a3de0f P b6ea3e3c1dd142c2a529707d9999b96d: Bootstrap starting.
I20260709 12:15:04.589218 26249 leader_election.cc:304] T 0ced3f63513a4e0ba988e57453fcf32e P 47ec5c2bfdd24b1eb2a906f63214876e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29ab82db4b2a4da39ed4796200c235bd, 47ec5c2bfdd24b1eb2a906f63214876e; no voters: 
I20260709 12:15:04.590345 26408 raft_consensus.cc:2804] T 0ced3f63513a4e0ba988e57453fcf32e P 47ec5c2bfdd24b1eb2a906f63214876e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:04.590178 26400 raft_consensus.cc:359] T 2be4e2f97d1941a4a3fe4f0dc03bdc57 P 29ab82db4b2a4da39ed4796200c235bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:04.590958 26408 raft_consensus.cc:493] T 0ced3f63513a4e0ba988e57453fcf32e P 47ec5c2bfdd24b1eb2a906f63214876e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:04.591272 26400 raft_consensus.cc:385] T 2be4e2f97d1941a4a3fe4f0dc03bdc57 P 29ab82db4b2a4da39ed4796200c235bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:04.591392 26408 raft_consensus.cc:3060] T 0ced3f63513a4e0ba988e57453fcf32e P 47ec5c2bfdd24b1eb2a906f63214876e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:04.591706 26400 raft_consensus.cc:740] T 2be4e2f97d1941a4a3fe4f0dc03bdc57 P 29ab82db4b2a4da39ed4796200c235bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29ab82db4b2a4da39ed4796200c235bd, State: Initialized, Role: FOLLOWER
I20260709 12:15:04.592968 26400 consensus_queue.cc:260] T 2be4e2f97d1941a4a3fe4f0dc03bdc57 P 29ab82db4b2a4da39ed4796200c235bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:04.596848 26399 tablet_bootstrap.cc:654] T 61c63f2d508d492dab277021e7a3de0f P b6ea3e3c1dd142c2a529707d9999b96d: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:04.605170 26403 raft_consensus.cc:515] T 0ced3f63513a4e0ba988e57453fcf32e P b6ea3e3c1dd142c2a529707d9999b96d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:04.605913 26400 ts_tablet_manager.cc:1434] T 2be4e2f97d1941a4a3fe4f0dc03bdc57 P 29ab82db4b2a4da39ed4796200c235bd: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.004s
I20260709 12:15:04.606984 26210 raft_consensus.cc:2393] T 0ced3f63513a4e0ba988e57453fcf32e P b6ea3e3c1dd142c2a529707d9999b96d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47ec5c2bfdd24b1eb2a906f63214876e in current term 1: Already voted for candidate b6ea3e3c1dd142c2a529707d9999b96d in this term.
I20260709 12:15:04.616264 26408 raft_consensus.cc:515] T 0ced3f63513a4e0ba988e57453fcf32e P 47ec5c2bfdd24b1eb2a906f63214876e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:04.617347 26400 tablet_bootstrap.cc:492] T 8e274509d4a64b129aa342b697004bf1 P 29ab82db4b2a4da39ed4796200c235bd: Bootstrap starting.
I20260709 12:15:04.620632 26210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ced3f63513a4e0ba988e57453fcf32e" candidate_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6ea3e3c1dd142c2a529707d9999b96d"
I20260709 12:15:04.621914 26210 raft_consensus.cc:2393] T 0ced3f63513a4e0ba988e57453fcf32e P b6ea3e3c1dd142c2a529707d9999b96d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 47ec5c2bfdd24b1eb2a906f63214876e in current term 1: Already voted for candidate b6ea3e3c1dd142c2a529707d9999b96d in this term.
I20260709 12:15:04.626653 26285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ced3f63513a4e0ba988e57453fcf32e" candidate_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47ec5c2bfdd24b1eb2a906f63214876e"
I20260709 12:15:04.627015 26400 tablet_bootstrap.cc:654] T 8e274509d4a64b129aa342b697004bf1 P 29ab82db4b2a4da39ed4796200c235bd: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:04.627765 26285 raft_consensus.cc:2393] T 0ced3f63513a4e0ba988e57453fcf32e P 47ec5c2bfdd24b1eb2a906f63214876e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b6ea3e3c1dd142c2a529707d9999b96d in current term 1: Already voted for candidate 47ec5c2bfdd24b1eb2a906f63214876e in this term.
I20260709 12:15:04.631799 26359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ced3f63513a4e0ba988e57453fcf32e" candidate_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29ab82db4b2a4da39ed4796200c235bd"
I20260709 12:15:04.632496 26359 raft_consensus.cc:3060] T 0ced3f63513a4e0ba988e57453fcf32e P 29ab82db4b2a4da39ed4796200c235bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:04.640626 26400 tablet_bootstrap.cc:492] T 8e274509d4a64b129aa342b697004bf1 P 29ab82db4b2a4da39ed4796200c235bd: No bootstrap required, opened a new log
I20260709 12:15:04.641501 26400 ts_tablet_manager.cc:1403] T 8e274509d4a64b129aa342b697004bf1 P 29ab82db4b2a4da39ed4796200c235bd: Time spent bootstrapping tablet: real 0.024s	user 0.017s	sys 0.004s
I20260709 12:15:04.641904 26403 leader_election.cc:290] T 0ced3f63513a4e0ba988e57453fcf32e P b6ea3e3c1dd142c2a529707d9999b96d [CANDIDATE]: Term 1 election: Requested vote from peers 47ec5c2bfdd24b1eb2a906f63214876e (127.12.174.130:43337), 29ab82db4b2a4da39ed4796200c235bd (127.12.174.131:43279)
I20260709 12:15:04.644275 26408 leader_election.cc:290] T 0ced3f63513a4e0ba988e57453fcf32e P 47ec5c2bfdd24b1eb2a906f63214876e [CANDIDATE]: Term 1 election: Requested vote from peers b6ea3e3c1dd142c2a529707d9999b96d (127.12.174.129:34845), 29ab82db4b2a4da39ed4796200c235bd (127.12.174.131:43279)
I20260709 12:15:04.645251 26400 raft_consensus.cc:359] T 8e274509d4a64b129aa342b697004bf1 P 29ab82db4b2a4da39ed4796200c235bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:04.645960 26358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ced3f63513a4e0ba988e57453fcf32e" candidate_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29ab82db4b2a4da39ed4796200c235bd"
I20260709 12:15:04.646941 26359 raft_consensus.cc:2468] T 0ced3f63513a4e0ba988e57453fcf32e P 29ab82db4b2a4da39ed4796200c235bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6ea3e3c1dd142c2a529707d9999b96d in term 1.
I20260709 12:15:04.647166 26401 tablet_bootstrap.cc:492] T 04079c0c50104d67a18aaeb329e1e434 P 47ec5c2bfdd24b1eb2a906f63214876e: No bootstrap required, opened a new log
I20260709 12:15:04.648651 26174 leader_election.cc:304] T 0ced3f63513a4e0ba988e57453fcf32e P b6ea3e3c1dd142c2a529707d9999b96d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29ab82db4b2a4da39ed4796200c235bd, b6ea3e3c1dd142c2a529707d9999b96d; no voters: 47ec5c2bfdd24b1eb2a906f63214876e
I20260709 12:15:04.648855 26401 ts_tablet_manager.cc:1403] T 04079c0c50104d67a18aaeb329e1e434 P 47ec5c2bfdd24b1eb2a906f63214876e: Time spent bootstrapping tablet: real 0.102s	user 0.036s	sys 0.056s
I20260709 12:15:04.649066 26400 raft_consensus.cc:385] T 8e274509d4a64b129aa342b697004bf1 P 29ab82db4b2a4da39ed4796200c235bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:04.649006 26249 leader_election.cc:304] T 0ced3f63513a4e0ba988e57453fcf32e P 47ec5c2bfdd24b1eb2a906f63214876e [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47ec5c2bfdd24b1eb2a906f63214876e; no voters: 29ab82db4b2a4da39ed4796200c235bd, b6ea3e3c1dd142c2a529707d9999b96d
I20260709 12:15:04.649971 26400 raft_consensus.cc:740] T 8e274509d4a64b129aa342b697004bf1 P 29ab82db4b2a4da39ed4796200c235bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29ab82db4b2a4da39ed4796200c235bd, State: Initialized, Role: FOLLOWER
I20260709 12:15:04.650051 26403 raft_consensus.cc:2804] T 0ced3f63513a4e0ba988e57453fcf32e P b6ea3e3c1dd142c2a529707d9999b96d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:04.650918 26408 raft_consensus.cc:2749] T 0ced3f63513a4e0ba988e57453fcf32e P 47ec5c2bfdd24b1eb2a906f63214876e [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:15:04.651053 26400 consensus_queue.cc:260] T 8e274509d4a64b129aa342b697004bf1 P 29ab82db4b2a4da39ed4796200c235bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:04.651633 26403 raft_consensus.cc:697] T 0ced3f63513a4e0ba988e57453fcf32e P b6ea3e3c1dd142c2a529707d9999b96d [term 1 LEADER]: Becoming Leader. State: Replica: b6ea3e3c1dd142c2a529707d9999b96d, State: Running, Role: LEADER
I20260709 12:15:04.652733 26403 consensus_queue.cc:237] T 0ced3f63513a4e0ba988e57453fcf32e P b6ea3e3c1dd142c2a529707d9999b96d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:04.652981 26401 raft_consensus.cc:359] T 04079c0c50104d67a18aaeb329e1e434 P 47ec5c2bfdd24b1eb2a906f63214876e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:04.653868 26401 raft_consensus.cc:385] T 04079c0c50104d67a18aaeb329e1e434 P 47ec5c2bfdd24b1eb2a906f63214876e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:04.653901 26400 ts_tablet_manager.cc:1434] T 8e274509d4a64b129aa342b697004bf1 P 29ab82db4b2a4da39ed4796200c235bd: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 12:15:04.654300 26401 raft_consensus.cc:740] T 04079c0c50104d67a18aaeb329e1e434 P 47ec5c2bfdd24b1eb2a906f63214876e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47ec5c2bfdd24b1eb2a906f63214876e, State: Initialized, Role: FOLLOWER
I20260709 12:15:04.655440 26400 tablet_bootstrap.cc:492] T 51f64f6460364936b54245159e7025b6 P 29ab82db4b2a4da39ed4796200c235bd: Bootstrap starting.
I20260709 12:15:04.655213 26401 consensus_queue.cc:260] T 04079c0c50104d67a18aaeb329e1e434 P 47ec5c2bfdd24b1eb2a906f63214876e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:04.657698 26401 ts_tablet_manager.cc:1434] T 04079c0c50104d67a18aaeb329e1e434 P 47ec5c2bfdd24b1eb2a906f63214876e: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:15:04.658669 26399 tablet_bootstrap.cc:492] T 61c63f2d508d492dab277021e7a3de0f P b6ea3e3c1dd142c2a529707d9999b96d: No bootstrap required, opened a new log
I20260709 12:15:04.658910 26401 tablet_bootstrap.cc:492] T 29fd96c2a5d34cbfbc04b6878fc1a9ae P 47ec5c2bfdd24b1eb2a906f63214876e: Bootstrap starting.
I20260709 12:15:04.659360 26399 ts_tablet_manager.cc:1403] T 61c63f2d508d492dab277021e7a3de0f P b6ea3e3c1dd142c2a529707d9999b96d: Time spent bootstrapping tablet: real 0.072s	user 0.035s	sys 0.024s
I20260709 12:15:04.663153 26399 raft_consensus.cc:359] T 61c63f2d508d492dab277021e7a3de0f P b6ea3e3c1dd142c2a529707d9999b96d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:04.664072 26399 raft_consensus.cc:385] T 61c63f2d508d492dab277021e7a3de0f P b6ea3e3c1dd142c2a529707d9999b96d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:04.664402 26399 raft_consensus.cc:740] T 61c63f2d508d492dab277021e7a3de0f P b6ea3e3c1dd142c2a529707d9999b96d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6ea3e3c1dd142c2a529707d9999b96d, State: Initialized, Role: FOLLOWER
I20260709 12:15:04.666466 26401 tablet_bootstrap.cc:654] T 29fd96c2a5d34cbfbc04b6878fc1a9ae P 47ec5c2bfdd24b1eb2a906f63214876e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:04.667536 26400 tablet_bootstrap.cc:654] T 51f64f6460364936b54245159e7025b6 P 29ab82db4b2a4da39ed4796200c235bd: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:04.671304 26424 raft_consensus.cc:493] T f7cde2085f2b4fa182c0126b08cc9dd5 P b6ea3e3c1dd142c2a529707d9999b96d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:04.672720 26424 raft_consensus.cc:515] T f7cde2085f2b4fa182c0126b08cc9dd5 P b6ea3e3c1dd142c2a529707d9999b96d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:04.676532 26285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7cde2085f2b4fa182c0126b08cc9dd5" candidate_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" is_pre_election: true
I20260709 12:15:04.681070 26400 tablet_bootstrap.cc:492] T 51f64f6460364936b54245159e7025b6 P 29ab82db4b2a4da39ed4796200c235bd: No bootstrap required, opened a new log
I20260709 12:15:04.681811 26359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7cde2085f2b4fa182c0126b08cc9dd5" candidate_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29ab82db4b2a4da39ed4796200c235bd" is_pre_election: true
I20260709 12:15:04.682814 26359 raft_consensus.cc:2468] T f7cde2085f2b4fa182c0126b08cc9dd5 P 29ab82db4b2a4da39ed4796200c235bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6ea3e3c1dd142c2a529707d9999b96d in term 0.
I20260709 12:15:04.677410 26285 raft_consensus.cc:2468] T f7cde2085f2b4fa182c0126b08cc9dd5 P 47ec5c2bfdd24b1eb2a906f63214876e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6ea3e3c1dd142c2a529707d9999b96d in term 0.
I20260709 12:15:04.681879 26400 ts_tablet_manager.cc:1403] T 51f64f6460364936b54245159e7025b6 P 29ab82db4b2a4da39ed4796200c235bd: Time spent bootstrapping tablet: real 0.027s	user 0.013s	sys 0.005s
I20260709 12:15:04.684502 26174 leader_election.cc:304] T f7cde2085f2b4fa182c0126b08cc9dd5 P b6ea3e3c1dd142c2a529707d9999b96d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29ab82db4b2a4da39ed4796200c235bd, b6ea3e3c1dd142c2a529707d9999b96d; no voters: 
I20260709 12:15:04.685496 26401 tablet_bootstrap.cc:492] T 29fd96c2a5d34cbfbc04b6878fc1a9ae P 47ec5c2bfdd24b1eb2a906f63214876e: No bootstrap required, opened a new log
I20260709 12:15:04.682394 26407 raft_consensus.cc:493] T 29fd96c2a5d34cbfbc04b6878fc1a9ae P 29ab82db4b2a4da39ed4796200c235bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:04.686262 26407 raft_consensus.cc:515] T 29fd96c2a5d34cbfbc04b6878fc1a9ae P 29ab82db4b2a4da39ed4796200c235bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:04.687115 26400 raft_consensus.cc:359] T 51f64f6460364936b54245159e7025b6 P 29ab82db4b2a4da39ed4796200c235bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:04.687827 26400 raft_consensus.cc:385] T 51f64f6460364936b54245159e7025b6 P 29ab82db4b2a4da39ed4796200c235bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:04.688026 26400 raft_consensus.cc:740] T 51f64f6460364936b54245159e7025b6 P 29ab82db4b2a4da39ed4796200c235bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29ab82db4b2a4da39ed4796200c235bd, State: Initialized, Role: FOLLOWER
I20260709 12:15:04.688881 26424 leader_election.cc:290] T f7cde2085f2b4fa182c0126b08cc9dd5 P b6ea3e3c1dd142c2a529707d9999b96d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 47ec5c2bfdd24b1eb2a906f63214876e (127.12.174.130:43337), 29ab82db4b2a4da39ed4796200c235bd (127.12.174.131:43279)
I20260709 12:15:04.688777 26400 consensus_queue.cc:260] T 51f64f6460364936b54245159e7025b6 P 29ab82db4b2a4da39ed4796200c235bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:04.689561 26424 raft_consensus.cc:2804] T f7cde2085f2b4fa182c0126b08cc9dd5 P b6ea3e3c1dd142c2a529707d9999b96d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:04.689519 26407 leader_election.cc:290] T 29fd96c2a5d34cbfbc04b6878fc1a9ae P 29ab82db4b2a4da39ed4796200c235bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6ea3e3c1dd142c2a529707d9999b96d (127.12.174.129:34845), 47ec5c2bfdd24b1eb2a906f63214876e (127.12.174.130:43337)
I20260709 12:15:04.690073 26424 raft_consensus.cc:493] T f7cde2085f2b4fa182c0126b08cc9dd5 P b6ea3e3c1dd142c2a529707d9999b96d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:04.690542 26424 raft_consensus.cc:3060] T f7cde2085f2b4fa182c0126b08cc9dd5 P b6ea3e3c1dd142c2a529707d9999b96d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:04.690860 26407 raft_consensus.cc:493] T 8e274509d4a64b129aa342b697004bf1 P 29ab82db4b2a4da39ed4796200c235bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:04.691468 26407 raft_consensus.cc:515] T 8e274509d4a64b129aa342b697004bf1 P 29ab82db4b2a4da39ed4796200c235bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:04.694450 26407 leader_election.cc:290] T 8e274509d4a64b129aa342b697004bf1 P 29ab82db4b2a4da39ed4796200c235bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6ea3e3c1dd142c2a529707d9999b96d (127.12.174.129:34845), 47ec5c2bfdd24b1eb2a906f63214876e (127.12.174.130:43337)
I20260709 12:15:04.695865 26401 ts_tablet_manager.cc:1403] T 29fd96c2a5d34cbfbc04b6878fc1a9ae P 47ec5c2bfdd24b1eb2a906f63214876e: Time spent bootstrapping tablet: real 0.037s	user 0.015s	sys 0.012s
I20260709 12:15:04.700457 26401 raft_consensus.cc:359] T 29fd96c2a5d34cbfbc04b6878fc1a9ae P 47ec5c2bfdd24b1eb2a906f63214876e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:04.701406 26401 raft_consensus.cc:385] T 29fd96c2a5d34cbfbc04b6878fc1a9ae P 47ec5c2bfdd24b1eb2a906f63214876e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:04.701845 26401 raft_consensus.cc:740] T 29fd96c2a5d34cbfbc04b6878fc1a9ae P 47ec5c2bfdd24b1eb2a906f63214876e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47ec5c2bfdd24b1eb2a906f63214876e, State: Initialized, Role: FOLLOWER
I20260709 12:15:04.702754 26401 consensus_queue.cc:260] T 29fd96c2a5d34cbfbc04b6878fc1a9ae P 47ec5c2bfdd24b1eb2a906f63214876e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:04.705628 26401 ts_tablet_manager.cc:1434] T 29fd96c2a5d34cbfbc04b6878fc1a9ae P 47ec5c2bfdd24b1eb2a906f63214876e: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 12:15:04.706941 26401 tablet_bootstrap.cc:492] T 8e274509d4a64b129aa342b697004bf1 P 47ec5c2bfdd24b1eb2a906f63214876e: Bootstrap starting.
I20260709 12:15:04.670615 26399 consensus_queue.cc:260] T 61c63f2d508d492dab277021e7a3de0f P b6ea3e3c1dd142c2a529707d9999b96d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:04.710462 26399 ts_tablet_manager.cc:1434] T 61c63f2d508d492dab277021e7a3de0f P b6ea3e3c1dd142c2a529707d9999b96d: Time spent starting tablet: real 0.051s	user 0.006s	sys 0.003s
I20260709 12:15:04.711833 26399 tablet_bootstrap.cc:492] T 04079c0c50104d67a18aaeb329e1e434 P b6ea3e3c1dd142c2a529707d9999b96d: Bootstrap starting.
I20260709 12:15:04.714818 26401 tablet_bootstrap.cc:654] T 8e274509d4a64b129aa342b697004bf1 P 47ec5c2bfdd24b1eb2a906f63214876e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:04.716619 26424 raft_consensus.cc:515] T f7cde2085f2b4fa182c0126b08cc9dd5 P b6ea3e3c1dd142c2a529707d9999b96d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:04.720738 26359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7cde2085f2b4fa182c0126b08cc9dd5" candidate_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29ab82db4b2a4da39ed4796200c235bd"
I20260709 12:15:04.720219 26108 catalog_manager.cc:5697] T 0ced3f63513a4e0ba988e57453fcf32e P b6ea3e3c1dd142c2a529707d9999b96d reported cstate change: term changed from 0 to 1, leader changed from <none> to b6ea3e3c1dd142c2a529707d9999b96d (127.12.174.129). New cstate: current_term: 1 leader_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:04.721529 26359 raft_consensus.cc:3060] T f7cde2085f2b4fa182c0126b08cc9dd5 P 29ab82db4b2a4da39ed4796200c235bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:04.722994 26408 raft_consensus.cc:493] T 2be4e2f97d1941a4a3fe4f0dc03bdc57 P 47ec5c2bfdd24b1eb2a906f63214876e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:04.724005 26400 ts_tablet_manager.cc:1434] T 51f64f6460364936b54245159e7025b6 P 29ab82db4b2a4da39ed4796200c235bd: Time spent starting tablet: real 0.040s	user 0.003s	sys 0.009s
I20260709 12:15:04.725283 26400 tablet_bootstrap.cc:492] T 61c63f2d508d492dab277021e7a3de0f P 29ab82db4b2a4da39ed4796200c235bd: Bootstrap starting.
I20260709 12:15:04.725621 26285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7cde2085f2b4fa182c0126b08cc9dd5" candidate_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47ec5c2bfdd24b1eb2a906f63214876e"
I20260709 12:15:04.726366 26285 raft_consensus.cc:3060] T f7cde2085f2b4fa182c0126b08cc9dd5 P 47ec5c2bfdd24b1eb2a906f63214876e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:04.728276 26401 tablet_bootstrap.cc:492] T 8e274509d4a64b129aa342b697004bf1 P 47ec5c2bfdd24b1eb2a906f63214876e: No bootstrap required, opened a new log
I20260709 12:15:04.728987 26401 ts_tablet_manager.cc:1403] T 8e274509d4a64b129aa342b697004bf1 P 47ec5c2bfdd24b1eb2a906f63214876e: Time spent bootstrapping tablet: real 0.022s	user 0.016s	sys 0.004s
I20260709 12:15:04.723618 26408 raft_consensus.cc:515] T 2be4e2f97d1941a4a3fe4f0dc03bdc57 P 47ec5c2bfdd24b1eb2a906f63214876e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:04.732686 26408 leader_election.cc:290] T 2be4e2f97d1941a4a3fe4f0dc03bdc57 P 47ec5c2bfdd24b1eb2a906f63214876e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6ea3e3c1dd142c2a529707d9999b96d (127.12.174.129:34845), 29ab82db4b2a4da39ed4796200c235bd (127.12.174.131:43279)
I20260709 12:15:04.732856 26401 raft_consensus.cc:359] T 8e274509d4a64b129aa342b697004bf1 P 47ec5c2bfdd24b1eb2a906f63214876e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:04.734113 26401 raft_consensus.cc:385] T 8e274509d4a64b129aa342b697004bf1 P 47ec5c2bfdd24b1eb2a906f63214876e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:04.734597 26401 raft_consensus.cc:740] T 8e274509d4a64b129aa342b697004bf1 P 47ec5c2bfdd24b1eb2a906f63214876e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47ec5c2bfdd24b1eb2a906f63214876e, State: Initialized, Role: FOLLOWER
I20260709 12:15:04.734009 26358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2be4e2f97d1941a4a3fe4f0dc03bdc57" candidate_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29ab82db4b2a4da39ed4796200c235bd" is_pre_election: true
I20260709 12:15:04.735766 26284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29fd96c2a5d34cbfbc04b6878fc1a9ae" candidate_uuid: "29ab82db4b2a4da39ed4796200c235bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" is_pre_election: true
I20260709 12:15:04.736549 26284 raft_consensus.cc:2468] T 29fd96c2a5d34cbfbc04b6878fc1a9ae P 47ec5c2bfdd24b1eb2a906f63214876e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29ab82db4b2a4da39ed4796200c235bd in term 0.
I20260709 12:15:04.735773 26358 raft_consensus.cc:2468] T 2be4e2f97d1941a4a3fe4f0dc03bdc57 P 29ab82db4b2a4da39ed4796200c235bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47ec5c2bfdd24b1eb2a906f63214876e in term 0.
I20260709 12:15:04.736829 26283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e274509d4a64b129aa342b697004bf1" candidate_uuid: "29ab82db4b2a4da39ed4796200c235bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" is_pre_election: true
I20260709 12:15:04.737246 26359 raft_consensus.cc:2468] T f7cde2085f2b4fa182c0126b08cc9dd5 P 29ab82db4b2a4da39ed4796200c235bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6ea3e3c1dd142c2a529707d9999b96d in term 1.
I20260709 12:15:04.737845 26424 leader_election.cc:290] T f7cde2085f2b4fa182c0126b08cc9dd5 P b6ea3e3c1dd142c2a529707d9999b96d [CANDIDATE]: Term 1 election: Requested vote from peers 47ec5c2bfdd24b1eb2a906f63214876e (127.12.174.130:43337), 29ab82db4b2a4da39ed4796200c235bd (127.12.174.131:43279)
I20260709 12:15:04.735754 26401 consensus_queue.cc:260] T 8e274509d4a64b129aa342b697004bf1 P 47ec5c2bfdd24b1eb2a906f63214876e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:04.738837 26283 raft_consensus.cc:2468] T 8e274509d4a64b129aa342b697004bf1 P 47ec5c2bfdd24b1eb2a906f63214876e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29ab82db4b2a4da39ed4796200c235bd in term 0.
I20260709 12:15:04.739184 26322 leader_election.cc:304] T 29fd96c2a5d34cbfbc04b6878fc1a9ae P 29ab82db4b2a4da39ed4796200c235bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29ab82db4b2a4da39ed4796200c235bd, 47ec5c2bfdd24b1eb2a906f63214876e; no voters: 
I20260709 12:15:04.739368 26174 leader_election.cc:304] T f7cde2085f2b4fa182c0126b08cc9dd5 P b6ea3e3c1dd142c2a529707d9999b96d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29ab82db4b2a4da39ed4796200c235bd, b6ea3e3c1dd142c2a529707d9999b96d; no voters: 
I20260709 12:15:04.740315 26432 raft_consensus.cc:2804] T 29fd96c2a5d34cbfbc04b6878fc1a9ae P 29ab82db4b2a4da39ed4796200c235bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:04.738417 26249 leader_election.cc:304] T 2be4e2f97d1941a4a3fe4f0dc03bdc57 P 47ec5c2bfdd24b1eb2a906f63214876e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29ab82db4b2a4da39ed4796200c235bd, 47ec5c2bfdd24b1eb2a906f63214876e; no voters: 
I20260709 12:15:04.740379 26424 raft_consensus.cc:2804] T f7cde2085f2b4fa182c0126b08cc9dd5 P b6ea3e3c1dd142c2a529707d9999b96d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:04.740949 26432 raft_consensus.cc:493] T 29fd96c2a5d34cbfbc04b6878fc1a9ae P 29ab82db4b2a4da39ed4796200c235bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:04.741411 26432 raft_consensus.cc:3060] T 29fd96c2a5d34cbfbc04b6878fc1a9ae P 29ab82db4b2a4da39ed4796200c235bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:04.741585 26424 raft_consensus.cc:697] T f7cde2085f2b4fa182c0126b08cc9dd5 P b6ea3e3c1dd142c2a529707d9999b96d [term 1 LEADER]: Becoming Leader. State: Replica: b6ea3e3c1dd142c2a529707d9999b96d, State: Running, Role: LEADER
I20260709 12:15:04.742233 26401 ts_tablet_manager.cc:1434] T 8e274509d4a64b129aa342b697004bf1 P 47ec5c2bfdd24b1eb2a906f63214876e: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.000s
I20260709 12:15:04.735193 26399 tablet_bootstrap.cc:654] T 04079c0c50104d67a18aaeb329e1e434 P b6ea3e3c1dd142c2a529707d9999b96d: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:04.742331 26408 raft_consensus.cc:2804] T 2be4e2f97d1941a4a3fe4f0dc03bdc57 P 47ec5c2bfdd24b1eb2a906f63214876e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:04.747094 26408 raft_consensus.cc:493] T 2be4e2f97d1941a4a3fe4f0dc03bdc57 P 47ec5c2bfdd24b1eb2a906f63214876e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:04.747498 26408 raft_consensus.cc:3060] T 2be4e2f97d1941a4a3fe4f0dc03bdc57 P 47ec5c2bfdd24b1eb2a906f63214876e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:04.748633 26399 tablet_bootstrap.cc:492] T 04079c0c50104d67a18aaeb329e1e434 P b6ea3e3c1dd142c2a529707d9999b96d: No bootstrap required, opened a new log
I20260709 12:15:04.749338 26399 ts_tablet_manager.cc:1403] T 04079c0c50104d67a18aaeb329e1e434 P b6ea3e3c1dd142c2a529707d9999b96d: Time spent bootstrapping tablet: real 0.038s	user 0.009s	sys 0.004s
I20260709 12:15:04.742762 26424 consensus_queue.cc:237] T f7cde2085f2b4fa182c0126b08cc9dd5 P b6ea3e3c1dd142c2a529707d9999b96d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:04.743810 26401 tablet_bootstrap.cc:492] T 61c63f2d508d492dab277021e7a3de0f P 47ec5c2bfdd24b1eb2a906f63214876e: Bootstrap starting.
I20260709 12:15:04.750908 26400 tablet_bootstrap.cc:654] T 61c63f2d508d492dab277021e7a3de0f P 29ab82db4b2a4da39ed4796200c235bd: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:04.745106 26209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29fd96c2a5d34cbfbc04b6878fc1a9ae" candidate_uuid: "29ab82db4b2a4da39ed4796200c235bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" is_pre_election: true
I20260709 12:15:04.754123 26209 raft_consensus.cc:2468] T 29fd96c2a5d34cbfbc04b6878fc1a9ae P b6ea3e3c1dd142c2a529707d9999b96d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29ab82db4b2a4da39ed4796200c235bd in term 0.
I20260709 12:15:04.744004 26210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2be4e2f97d1941a4a3fe4f0dc03bdc57" candidate_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" is_pre_election: true
I20260709 12:15:04.752789 26399 raft_consensus.cc:359] T 04079c0c50104d67a18aaeb329e1e434 P b6ea3e3c1dd142c2a529707d9999b96d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:04.745457 26208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e274509d4a64b129aa342b697004bf1" candidate_uuid: "29ab82db4b2a4da39ed4796200c235bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" is_pre_election: true
I20260709 12:15:04.742882 26403 raft_consensus.cc:493] T 61c63f2d508d492dab277021e7a3de0f P b6ea3e3c1dd142c2a529707d9999b96d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:04.756356 26210 raft_consensus.cc:2468] T 2be4e2f97d1941a4a3fe4f0dc03bdc57 P b6ea3e3c1dd142c2a529707d9999b96d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47ec5c2bfdd24b1eb2a906f63214876e in term 0.
I20260709 12:15:04.756572 26403 raft_consensus.cc:515] T 61c63f2d508d492dab277021e7a3de0f P b6ea3e3c1dd142c2a529707d9999b96d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:04.758999 26403 leader_election.cc:290] T 61c63f2d508d492dab277021e7a3de0f P b6ea3e3c1dd142c2a529707d9999b96d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 47ec5c2bfdd24b1eb2a906f63214876e (127.12.174.130:43337), 29ab82db4b2a4da39ed4796200c235bd (127.12.174.131:43279)
I20260709 12:15:04.760426 26401 tablet_bootstrap.cc:654] T 61c63f2d508d492dab277021e7a3de0f P 47ec5c2bfdd24b1eb2a906f63214876e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:04.761047 26359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61c63f2d508d492dab277021e7a3de0f" candidate_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29ab82db4b2a4da39ed4796200c235bd" is_pre_election: true
W20260709 12:15:04.762743 26174 leader_election.cc:343] T 61c63f2d508d492dab277021e7a3de0f P b6ea3e3c1dd142c2a529707d9999b96d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 29ab82db4b2a4da39ed4796200c235bd (127.12.174.131:43279): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:04.740453 26322 leader_election.cc:304] T 8e274509d4a64b129aa342b697004bf1 P 29ab82db4b2a4da39ed4796200c235bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29ab82db4b2a4da39ed4796200c235bd, 47ec5c2bfdd24b1eb2a906f63214876e; no voters: 
I20260709 12:15:04.765260 26283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61c63f2d508d492dab277021e7a3de0f" candidate_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" is_pre_election: true
I20260709 12:15:04.765551 26407 raft_consensus.cc:2804] T 8e274509d4a64b129aa342b697004bf1 P 29ab82db4b2a4da39ed4796200c235bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:04.766757 26407 raft_consensus.cc:493] T 8e274509d4a64b129aa342b697004bf1 P 29ab82db4b2a4da39ed4796200c235bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:04.767768 26399 raft_consensus.cc:385] T 04079c0c50104d67a18aaeb329e1e434 P b6ea3e3c1dd142c2a529707d9999b96d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:04.768110 26399 raft_consensus.cc:740] T 04079c0c50104d67a18aaeb329e1e434 P b6ea3e3c1dd142c2a529707d9999b96d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6ea3e3c1dd142c2a529707d9999b96d, State: Initialized, Role: FOLLOWER
W20260709 12:15:04.769941 26325 leader_election.cc:343] T 8e274509d4a64b129aa342b697004bf1 P 29ab82db4b2a4da39ed4796200c235bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6ea3e3c1dd142c2a529707d9999b96d (127.12.174.129:34845): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:04.770951 26408 raft_consensus.cc:515] T 2be4e2f97d1941a4a3fe4f0dc03bdc57 P 47ec5c2bfdd24b1eb2a906f63214876e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:04.767181 26407 raft_consensus.cc:3060] T 8e274509d4a64b129aa342b697004bf1 P 29ab82db4b2a4da39ed4796200c235bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:04.772957 26432 raft_consensus.cc:515] T 29fd96c2a5d34cbfbc04b6878fc1a9ae P 29ab82db4b2a4da39ed4796200c235bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:04.769214 26399 consensus_queue.cc:260] T 04079c0c50104d67a18aaeb329e1e434 P b6ea3e3c1dd142c2a529707d9999b96d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:04.773401 26408 leader_election.cc:290] T 2be4e2f97d1941a4a3fe4f0dc03bdc57 P 47ec5c2bfdd24b1eb2a906f63214876e [CANDIDATE]: Term 1 election: Requested vote from peers b6ea3e3c1dd142c2a529707d9999b96d (127.12.174.129:34845), 29ab82db4b2a4da39ed4796200c235bd (127.12.174.131:43279)
I20260709 12:15:04.790971 26399 ts_tablet_manager.cc:1434] T 04079c0c50104d67a18aaeb329e1e434 P b6ea3e3c1dd142c2a529707d9999b96d: Time spent starting tablet: real 0.041s	user 0.004s	sys 0.003s
I20260709 12:15:04.792006 26399 tablet_bootstrap.cc:492] T 8e274509d4a64b129aa342b697004bf1 P b6ea3e3c1dd142c2a529707d9999b96d: Bootstrap starting.
I20260709 12:15:04.793946 26359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2be4e2f97d1941a4a3fe4f0dc03bdc57" candidate_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29ab82db4b2a4da39ed4796200c235bd"
I20260709 12:15:04.794706 26359 raft_consensus.cc:3060] T 2be4e2f97d1941a4a3fe4f0dc03bdc57 P 29ab82db4b2a4da39ed4796200c235bd [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:15:04.786685 26173 leader_election.cc:343] T 61c63f2d508d492dab277021e7a3de0f P b6ea3e3c1dd142c2a529707d9999b96d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 47ec5c2bfdd24b1eb2a906f63214876e (127.12.174.130:43337): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:04.797065 26173 leader_election.cc:304] T 61c63f2d508d492dab277021e7a3de0f P b6ea3e3c1dd142c2a529707d9999b96d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6ea3e3c1dd142c2a529707d9999b96d; no voters: 29ab82db4b2a4da39ed4796200c235bd, 47ec5c2bfdd24b1eb2a906f63214876e
I20260709 12:15:04.799403 26403 raft_consensus.cc:2749] T 61c63f2d508d492dab277021e7a3de0f P b6ea3e3c1dd142c2a529707d9999b96d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:04.800838 26210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2be4e2f97d1941a4a3fe4f0dc03bdc57" candidate_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6ea3e3c1dd142c2a529707d9999b96d"
I20260709 12:15:04.801748 26210 raft_consensus.cc:3060] T 2be4e2f97d1941a4a3fe4f0dc03bdc57 P b6ea3e3c1dd142c2a529707d9999b96d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:04.801859 26403 raft_consensus.cc:493] T 5640177c765d4c7eace47afab24512cc P b6ea3e3c1dd142c2a529707d9999b96d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:04.802294 26407 raft_consensus.cc:515] T 8e274509d4a64b129aa342b697004bf1 P 29ab82db4b2a4da39ed4796200c235bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:04.802639 26403 raft_consensus.cc:515] T 5640177c765d4c7eace47afab24512cc P b6ea3e3c1dd142c2a529707d9999b96d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:04.804809 26407 leader_election.cc:290] T 8e274509d4a64b129aa342b697004bf1 P 29ab82db4b2a4da39ed4796200c235bd [CANDIDATE]: Term 1 election: Requested vote from peers b6ea3e3c1dd142c2a529707d9999b96d (127.12.174.129:34845), 47ec5c2bfdd24b1eb2a906f63214876e (127.12.174.130:43337)
I20260709 12:15:04.787644 26285 raft_consensus.cc:2468] T f7cde2085f2b4fa182c0126b08cc9dd5 P 47ec5c2bfdd24b1eb2a906f63214876e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6ea3e3c1dd142c2a529707d9999b96d in term 1.
I20260709 12:15:04.810293 26399 tablet_bootstrap.cc:654] T 8e274509d4a64b129aa342b697004bf1 P b6ea3e3c1dd142c2a529707d9999b96d: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:04.810262 26284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5640177c765d4c7eace47afab24512cc" candidate_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" is_pre_election: true
I20260709 12:15:04.808502 26208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e274509d4a64b129aa342b697004bf1" candidate_uuid: "29ab82db4b2a4da39ed4796200c235bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6ea3e3c1dd142c2a529707d9999b96d"
I20260709 12:15:04.807232 26283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e274509d4a64b129aa342b697004bf1" candidate_uuid: "29ab82db4b2a4da39ed4796200c235bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47ec5c2bfdd24b1eb2a906f63214876e"
W20260709 12:15:04.822587 26325 leader_election.cc:343] T 8e274509d4a64b129aa342b697004bf1 P 29ab82db4b2a4da39ed4796200c235bd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b6ea3e3c1dd142c2a529707d9999b96d (127.12.174.129:34845): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:04.816231 26431 raft_consensus.cc:493] T 51f64f6460364936b54245159e7025b6 P 29ab82db4b2a4da39ed4796200c235bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:04.810119 26358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5640177c765d4c7eace47afab24512cc" candidate_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29ab82db4b2a4da39ed4796200c235bd" is_pre_election: true
I20260709 12:15:04.811153 26403 leader_election.cc:290] T 5640177c765d4c7eace47afab24512cc P b6ea3e3c1dd142c2a529707d9999b96d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 47ec5c2bfdd24b1eb2a906f63214876e (127.12.174.130:43337), 29ab82db4b2a4da39ed4796200c235bd (127.12.174.131:43279)
I20260709 12:15:04.824363 26431 raft_consensus.cc:515] T 51f64f6460364936b54245159e7025b6 P 29ab82db4b2a4da39ed4796200c235bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
W20260709 12:15:04.823518 26173 leader_election.cc:343] T 5640177c765d4c7eace47afab24512cc P b6ea3e3c1dd142c2a529707d9999b96d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 47ec5c2bfdd24b1eb2a906f63214876e (127.12.174.130:43337): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:15:04.825917 26174 leader_election.cc:343] T 5640177c765d4c7eace47afab24512cc P b6ea3e3c1dd142c2a529707d9999b96d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 29ab82db4b2a4da39ed4796200c235bd (127.12.174.131:43279): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:04.826445 26174 leader_election.cc:304] T 5640177c765d4c7eace47afab24512cc P b6ea3e3c1dd142c2a529707d9999b96d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6ea3e3c1dd142c2a529707d9999b96d; no voters: 29ab82db4b2a4da39ed4796200c235bd, 47ec5c2bfdd24b1eb2a906f63214876e
I20260709 12:15:04.828926 26403 raft_consensus.cc:2749] T 5640177c765d4c7eace47afab24512cc P b6ea3e3c1dd142c2a529707d9999b96d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:04.829468 26400 tablet_bootstrap.cc:492] T 61c63f2d508d492dab277021e7a3de0f P 29ab82db4b2a4da39ed4796200c235bd: No bootstrap required, opened a new log
I20260709 12:15:04.824546 26283 raft_consensus.cc:3060] T 8e274509d4a64b129aa342b697004bf1 P 47ec5c2bfdd24b1eb2a906f63214876e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:04.837100 26284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29fd96c2a5d34cbfbc04b6878fc1a9ae" candidate_uuid: "29ab82db4b2a4da39ed4796200c235bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47ec5c2bfdd24b1eb2a906f63214876e"
I20260709 12:15:04.837939 26284 raft_consensus.cc:3060] T 29fd96c2a5d34cbfbc04b6878fc1a9ae P 47ec5c2bfdd24b1eb2a906f63214876e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:04.838285 26208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29fd96c2a5d34cbfbc04b6878fc1a9ae" candidate_uuid: "29ab82db4b2a4da39ed4796200c235bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6ea3e3c1dd142c2a529707d9999b96d"
I20260709 12:15:04.839076 26208 raft_consensus.cc:3060] T 29fd96c2a5d34cbfbc04b6878fc1a9ae P b6ea3e3c1dd142c2a529707d9999b96d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:04.839778 26401 tablet_bootstrap.cc:492] T 61c63f2d508d492dab277021e7a3de0f P 47ec5c2bfdd24b1eb2a906f63214876e: No bootstrap required, opened a new log
I20260709 12:15:04.840471 26401 ts_tablet_manager.cc:1403] T 61c63f2d508d492dab277021e7a3de0f P 47ec5c2bfdd24b1eb2a906f63214876e: Time spent bootstrapping tablet: real 0.097s	user 0.023s	sys 0.015s
I20260709 12:15:04.835109 26400 ts_tablet_manager.cc:1403] T 61c63f2d508d492dab277021e7a3de0f P 29ab82db4b2a4da39ed4796200c235bd: Time spent bootstrapping tablet: real 0.110s	user 0.015s	sys 0.007s
I20260709 12:15:04.844308 26401 raft_consensus.cc:359] T 61c63f2d508d492dab277021e7a3de0f P 47ec5c2bfdd24b1eb2a906f63214876e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:04.845198 26401 raft_consensus.cc:385] T 61c63f2d508d492dab277021e7a3de0f P 47ec5c2bfdd24b1eb2a906f63214876e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:04.847512 26209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f64f6460364936b54245159e7025b6" candidate_uuid: "29ab82db4b2a4da39ed4796200c235bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" is_pre_election: true
I20260709 12:15:04.830353 26432 leader_election.cc:290] T 29fd96c2a5d34cbfbc04b6878fc1a9ae P 29ab82db4b2a4da39ed4796200c235bd [CANDIDATE]: Term 1 election: Requested vote from peers b6ea3e3c1dd142c2a529707d9999b96d (127.12.174.129:34845), 47ec5c2bfdd24b1eb2a906f63214876e (127.12.174.130:43337)
I20260709 12:15:04.848402 26209 raft_consensus.cc:2468] T 51f64f6460364936b54245159e7025b6 P b6ea3e3c1dd142c2a529707d9999b96d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29ab82db4b2a4da39ed4796200c235bd in term 0.
I20260709 12:15:04.848889 26208 raft_consensus.cc:2468] T 29fd96c2a5d34cbfbc04b6878fc1a9ae P b6ea3e3c1dd142c2a529707d9999b96d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29ab82db4b2a4da39ed4796200c235bd in term 1.
I20260709 12:15:04.849992 26325 leader_election.cc:304] T 51f64f6460364936b54245159e7025b6 P 29ab82db4b2a4da39ed4796200c235bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29ab82db4b2a4da39ed4796200c235bd, b6ea3e3c1dd142c2a529707d9999b96d; no voters: 
I20260709 12:15:04.850251 26285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f64f6460364936b54245159e7025b6" candidate_uuid: "29ab82db4b2a4da39ed4796200c235bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" is_pre_election: true
I20260709 12:15:04.851588 26325 leader_election.cc:304] T 29fd96c2a5d34cbfbc04b6878fc1a9ae P 29ab82db4b2a4da39ed4796200c235bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29ab82db4b2a4da39ed4796200c235bd, b6ea3e3c1dd142c2a529707d9999b96d; no voters: 
W20260709 12:15:04.851729 26322 leader_election.cc:343] T 51f64f6460364936b54245159e7025b6 P 29ab82db4b2a4da39ed4796200c235bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 47ec5c2bfdd24b1eb2a906f63214876e (127.12.174.130:43337): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:04.852008 26359 raft_consensus.cc:2468] T 2be4e2f97d1941a4a3fe4f0dc03bdc57 P 29ab82db4b2a4da39ed4796200c235bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47ec5c2bfdd24b1eb2a906f63214876e in term 1.
I20260709 12:15:04.852581 26407 raft_consensus.cc:2804] T 51f64f6460364936b54245159e7025b6 P 29ab82db4b2a4da39ed4796200c235bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:04.849606 26431 leader_election.cc:290] T 51f64f6460364936b54245159e7025b6 P 29ab82db4b2a4da39ed4796200c235bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6ea3e3c1dd142c2a529707d9999b96d (127.12.174.129:34845), 47ec5c2bfdd24b1eb2a906f63214876e (127.12.174.130:43337)
I20260709 12:15:04.853018 26407 raft_consensus.cc:493] T 51f64f6460364936b54245159e7025b6 P 29ab82db4b2a4da39ed4796200c235bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:04.847437 26210 raft_consensus.cc:2468] T 2be4e2f97d1941a4a3fe4f0dc03bdc57 P b6ea3e3c1dd142c2a529707d9999b96d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47ec5c2bfdd24b1eb2a906f63214876e in term 1.
I20260709 12:15:04.854128 26407 raft_consensus.cc:3060] T 51f64f6460364936b54245159e7025b6 P 29ab82db4b2a4da39ed4796200c235bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:04.853667 26249 leader_election.cc:304] T 2be4e2f97d1941a4a3fe4f0dc03bdc57 P 47ec5c2bfdd24b1eb2a906f63214876e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29ab82db4b2a4da39ed4796200c235bd, 47ec5c2bfdd24b1eb2a906f63214876e; no voters: 
I20260709 12:15:04.857467 26283 raft_consensus.cc:2468] T 8e274509d4a64b129aa342b697004bf1 P 47ec5c2bfdd24b1eb2a906f63214876e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29ab82db4b2a4da39ed4796200c235bd in term 1.
I20260709 12:15:04.857692 26408 raft_consensus.cc:2804] T 2be4e2f97d1941a4a3fe4f0dc03bdc57 P 47ec5c2bfdd24b1eb2a906f63214876e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:04.858877 26322 leader_election.cc:304] T 8e274509d4a64b129aa342b697004bf1 P 29ab82db4b2a4da39ed4796200c235bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29ab82db4b2a4da39ed4796200c235bd, 47ec5c2bfdd24b1eb2a906f63214876e; no voters: b6ea3e3c1dd142c2a529707d9999b96d
I20260709 12:15:04.860271 26431 raft_consensus.cc:2804] T 8e274509d4a64b129aa342b697004bf1 P 29ab82db4b2a4da39ed4796200c235bd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:04.852845 26432 raft_consensus.cc:2804] T 29fd96c2a5d34cbfbc04b6878fc1a9ae P 29ab82db4b2a4da39ed4796200c235bd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:04.863677 26407 raft_consensus.cc:515] T 51f64f6460364936b54245159e7025b6 P 29ab82db4b2a4da39ed4796200c235bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:04.845543 26401 raft_consensus.cc:740] T 61c63f2d508d492dab277021e7a3de0f P 47ec5c2bfdd24b1eb2a906f63214876e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47ec5c2bfdd24b1eb2a906f63214876e, State: Initialized, Role: FOLLOWER
I20260709 12:15:04.845322 26400 raft_consensus.cc:359] T 61c63f2d508d492dab277021e7a3de0f P 29ab82db4b2a4da39ed4796200c235bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:04.872161 26284 raft_consensus.cc:2468] T 29fd96c2a5d34cbfbc04b6878fc1a9ae P 47ec5c2bfdd24b1eb2a906f63214876e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29ab82db4b2a4da39ed4796200c235bd in term 1.
I20260709 12:15:04.869674 26400 raft_consensus.cc:385] T 61c63f2d508d492dab277021e7a3de0f P 29ab82db4b2a4da39ed4796200c235bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:04.873380 26400 raft_consensus.cc:740] T 61c63f2d508d492dab277021e7a3de0f P 29ab82db4b2a4da39ed4796200c235bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29ab82db4b2a4da39ed4796200c235bd, State: Initialized, Role: FOLLOWER
I20260709 12:15:04.874454 26400 consensus_queue.cc:260] T 61c63f2d508d492dab277021e7a3de0f P 29ab82db4b2a4da39ed4796200c235bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:04.867475 26408 raft_consensus.cc:697] T 2be4e2f97d1941a4a3fe4f0dc03bdc57 P 47ec5c2bfdd24b1eb2a906f63214876e [term 1 LEADER]: Becoming Leader. State: Replica: 47ec5c2bfdd24b1eb2a906f63214876e, State: Running, Role: LEADER
I20260709 12:15:04.878880 26408 consensus_queue.cc:237] T 2be4e2f97d1941a4a3fe4f0dc03bdc57 P 47ec5c2bfdd24b1eb2a906f63214876e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:04.880662 26399 tablet_bootstrap.cc:492] T 8e274509d4a64b129aa342b697004bf1 P b6ea3e3c1dd142c2a529707d9999b96d: No bootstrap required, opened a new log
I20260709 12:15:04.881609 26399 ts_tablet_manager.cc:1403] T 8e274509d4a64b129aa342b697004bf1 P b6ea3e3c1dd142c2a529707d9999b96d: Time spent bootstrapping tablet: real 0.090s	user 0.015s	sys 0.014s
I20260709 12:15:04.883091 26431 raft_consensus.cc:697] T 8e274509d4a64b129aa342b697004bf1 P 29ab82db4b2a4da39ed4796200c235bd [term 1 LEADER]: Becoming Leader. State: Replica: 29ab82db4b2a4da39ed4796200c235bd, State: Running, Role: LEADER
I20260709 12:15:04.885128 26401 consensus_queue.cc:260] T 61c63f2d508d492dab277021e7a3de0f P 47ec5c2bfdd24b1eb2a906f63214876e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:04.890024 26210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f64f6460364936b54245159e7025b6" candidate_uuid: "29ab82db4b2a4da39ed4796200c235bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6ea3e3c1dd142c2a529707d9999b96d"
I20260709 12:15:04.890874 26210 raft_consensus.cc:3060] T 51f64f6460364936b54245159e7025b6 P b6ea3e3c1dd142c2a529707d9999b96d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:04.892913 26399 raft_consensus.cc:359] T 8e274509d4a64b129aa342b697004bf1 P b6ea3e3c1dd142c2a529707d9999b96d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:04.893846 26399 raft_consensus.cc:385] T 8e274509d4a64b129aa342b697004bf1 P b6ea3e3c1dd142c2a529707d9999b96d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:04.894682 26399 raft_consensus.cc:740] T 8e274509d4a64b129aa342b697004bf1 P b6ea3e3c1dd142c2a529707d9999b96d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6ea3e3c1dd142c2a529707d9999b96d, State: Initialized, Role: FOLLOWER
I20260709 12:15:04.894866 26432 raft_consensus.cc:697] T 29fd96c2a5d34cbfbc04b6878fc1a9ae P 29ab82db4b2a4da39ed4796200c235bd [term 1 LEADER]: Becoming Leader. State: Replica: 29ab82db4b2a4da39ed4796200c235bd, State: Running, Role: LEADER
I20260709 12:15:04.893798 26284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f64f6460364936b54245159e7025b6" candidate_uuid: "29ab82db4b2a4da39ed4796200c235bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47ec5c2bfdd24b1eb2a906f63214876e"
I20260709 12:15:04.896390 26432 consensus_queue.cc:237] T 29fd96c2a5d34cbfbc04b6878fc1a9ae P 29ab82db4b2a4da39ed4796200c235bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
W20260709 12:15:04.897501 26322 leader_election.cc:343] T 51f64f6460364936b54245159e7025b6 P 29ab82db4b2a4da39ed4796200c235bd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 47ec5c2bfdd24b1eb2a906f63214876e (127.12.174.130:43337): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:04.896178 26399 consensus_queue.cc:260] T 8e274509d4a64b129aa342b697004bf1 P b6ea3e3c1dd142c2a529707d9999b96d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:04.894358 26407 leader_election.cc:290] T 51f64f6460364936b54245159e7025b6 P 29ab82db4b2a4da39ed4796200c235bd [CANDIDATE]: Term 1 election: Requested vote from peers b6ea3e3c1dd142c2a529707d9999b96d (127.12.174.129:34845), 47ec5c2bfdd24b1eb2a906f63214876e (127.12.174.130:43337)
I20260709 12:15:04.905712 26401 ts_tablet_manager.cc:1434] T 61c63f2d508d492dab277021e7a3de0f P 47ec5c2bfdd24b1eb2a906f63214876e: Time spent starting tablet: real 0.065s	user 0.010s	sys 0.000s
I20260709 12:15:04.906937 26399 ts_tablet_manager.cc:1434] T 8e274509d4a64b129aa342b697004bf1 P b6ea3e3c1dd142c2a529707d9999b96d: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.000s
I20260709 12:15:04.885951 26431 consensus_queue.cc:237] T 8e274509d4a64b129aa342b697004bf1 P 29ab82db4b2a4da39ed4796200c235bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:04.910774 26400 ts_tablet_manager.cc:1434] T 61c63f2d508d492dab277021e7a3de0f P 29ab82db4b2a4da39ed4796200c235bd: Time spent starting tablet: real 0.069s	user 0.017s	sys 0.002s
I20260709 12:15:04.908699 26401 tablet_bootstrap.cc:492] T 5640177c765d4c7eace47afab24512cc P 47ec5c2bfdd24b1eb2a906f63214876e: Bootstrap starting.
I20260709 12:15:04.914929 26400 tablet_bootstrap.cc:492] T 04079c0c50104d67a18aaeb329e1e434 P 29ab82db4b2a4da39ed4796200c235bd: Bootstrap starting.
I20260709 12:15:04.926859 26400 tablet_bootstrap.cc:654] T 04079c0c50104d67a18aaeb329e1e434 P 29ab82db4b2a4da39ed4796200c235bd: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:04.941591 26210 raft_consensus.cc:2468] T 51f64f6460364936b54245159e7025b6 P b6ea3e3c1dd142c2a529707d9999b96d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29ab82db4b2a4da39ed4796200c235bd in term 1.
I20260709 12:15:04.943802 26325 leader_election.cc:304] T 51f64f6460364936b54245159e7025b6 P 29ab82db4b2a4da39ed4796200c235bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29ab82db4b2a4da39ed4796200c235bd, b6ea3e3c1dd142c2a529707d9999b96d; no voters: 47ec5c2bfdd24b1eb2a906f63214876e
I20260709 12:15:04.944679 26431 raft_consensus.cc:2804] T 51f64f6460364936b54245159e7025b6 P 29ab82db4b2a4da39ed4796200c235bd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:04.945297 26431 raft_consensus.cc:697] T 51f64f6460364936b54245159e7025b6 P 29ab82db4b2a4da39ed4796200c235bd [term 1 LEADER]: Becoming Leader. State: Replica: 29ab82db4b2a4da39ed4796200c235bd, State: Running, Role: LEADER
I20260709 12:15:04.946343 26431 consensus_queue.cc:237] T 51f64f6460364936b54245159e7025b6 P 29ab82db4b2a4da39ed4796200c235bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:04.952931 26401 tablet_bootstrap.cc:654] T 5640177c765d4c7eace47afab24512cc P 47ec5c2bfdd24b1eb2a906f63214876e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:04.955030 26108 catalog_manager.cc:5697] T 2be4e2f97d1941a4a3fe4f0dc03bdc57 P 47ec5c2bfdd24b1eb2a906f63214876e reported cstate change: term changed from 0 to 1, leader changed from <none> to 47ec5c2bfdd24b1eb2a906f63214876e (127.12.174.130). New cstate: current_term: 1 leader_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:04.958132 26400 tablet_bootstrap.cc:492] T 04079c0c50104d67a18aaeb329e1e434 P 29ab82db4b2a4da39ed4796200c235bd: No bootstrap required, opened a new log
I20260709 12:15:04.958909 26400 ts_tablet_manager.cc:1403] T 04079c0c50104d67a18aaeb329e1e434 P 29ab82db4b2a4da39ed4796200c235bd: Time spent bootstrapping tablet: real 0.044s	user 0.018s	sys 0.007s
I20260709 12:15:04.960130 26106 catalog_manager.cc:5697] T 8e274509d4a64b129aa342b697004bf1 P 29ab82db4b2a4da39ed4796200c235bd reported cstate change: term changed from 0 to 1, leader changed from <none> to 29ab82db4b2a4da39ed4796200c235bd (127.12.174.131). New cstate: current_term: 1 leader_uuid: "29ab82db4b2a4da39ed4796200c235bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:04.962239 26400 raft_consensus.cc:359] T 04079c0c50104d67a18aaeb329e1e434 P 29ab82db4b2a4da39ed4796200c235bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:04.963234 26400 raft_consensus.cc:385] T 04079c0c50104d67a18aaeb329e1e434 P 29ab82db4b2a4da39ed4796200c235bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:04.963505 26400 raft_consensus.cc:740] T 04079c0c50104d67a18aaeb329e1e434 P 29ab82db4b2a4da39ed4796200c235bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29ab82db4b2a4da39ed4796200c235bd, State: Initialized, Role: FOLLOWER
I20260709 12:15:04.962313 26106 catalog_manager.cc:5697] T 29fd96c2a5d34cbfbc04b6878fc1a9ae P 29ab82db4b2a4da39ed4796200c235bd reported cstate change: term changed from 0 to 1, leader changed from <none> to 29ab82db4b2a4da39ed4796200c235bd (127.12.174.131). New cstate: current_term: 1 leader_uuid: "29ab82db4b2a4da39ed4796200c235bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:04.964494 26400 consensus_queue.cc:260] T 04079c0c50104d67a18aaeb329e1e434 P 29ab82db4b2a4da39ed4796200c235bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:04.967288 26400 ts_tablet_manager.cc:1434] T 04079c0c50104d67a18aaeb329e1e434 P 29ab82db4b2a4da39ed4796200c235bd: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:15:04.968369 26401 tablet_bootstrap.cc:492] T 5640177c765d4c7eace47afab24512cc P 47ec5c2bfdd24b1eb2a906f63214876e: No bootstrap required, opened a new log
I20260709 12:15:04.968366 26400 tablet_bootstrap.cc:492] T 5640177c765d4c7eace47afab24512cc P 29ab82db4b2a4da39ed4796200c235bd: Bootstrap starting.
I20260709 12:15:04.968981 26401 ts_tablet_manager.cc:1403] T 5640177c765d4c7eace47afab24512cc P 47ec5c2bfdd24b1eb2a906f63214876e: Time spent bootstrapping tablet: real 0.061s	user 0.024s	sys 0.004s
I20260709 12:15:04.972111 26401 raft_consensus.cc:359] T 5640177c765d4c7eace47afab24512cc P 47ec5c2bfdd24b1eb2a906f63214876e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:04.972875 26401 raft_consensus.cc:385] T 5640177c765d4c7eace47afab24512cc P 47ec5c2bfdd24b1eb2a906f63214876e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:04.973323 26401 raft_consensus.cc:740] T 5640177c765d4c7eace47afab24512cc P 47ec5c2bfdd24b1eb2a906f63214876e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47ec5c2bfdd24b1eb2a906f63214876e, State: Initialized, Role: FOLLOWER
I20260709 12:15:04.974097 26401 consensus_queue.cc:260] T 5640177c765d4c7eace47afab24512cc P 47ec5c2bfdd24b1eb2a906f63214876e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:04.975867 26400 tablet_bootstrap.cc:654] T 5640177c765d4c7eace47afab24512cc P 29ab82db4b2a4da39ed4796200c235bd: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:04.976727 26401 ts_tablet_manager.cc:1434] T 5640177c765d4c7eace47afab24512cc P 47ec5c2bfdd24b1eb2a906f63214876e: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:15:04.977900 26401 tablet_bootstrap.cc:492] T 51f64f6460364936b54245159e7025b6 P 47ec5c2bfdd24b1eb2a906f63214876e: Bootstrap starting.
I20260709 12:15:04.981232 26400 tablet_bootstrap.cc:492] T 5640177c765d4c7eace47afab24512cc P 29ab82db4b2a4da39ed4796200c235bd: No bootstrap required, opened a new log
I20260709 12:15:04.981901 26400 ts_tablet_manager.cc:1403] T 5640177c765d4c7eace47afab24512cc P 29ab82db4b2a4da39ed4796200c235bd: Time spent bootstrapping tablet: real 0.014s	user 0.013s	sys 0.000s
I20260709 12:15:04.984318 26401 tablet_bootstrap.cc:654] T 51f64f6460364936b54245159e7025b6 P 47ec5c2bfdd24b1eb2a906f63214876e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:04.985150 26400 raft_consensus.cc:359] T 5640177c765d4c7eace47afab24512cc P 29ab82db4b2a4da39ed4796200c235bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:04.984354 26107 catalog_manager.cc:5697] T f7cde2085f2b4fa182c0126b08cc9dd5 P b6ea3e3c1dd142c2a529707d9999b96d reported cstate change: term changed from 0 to 1, leader changed from <none> to b6ea3e3c1dd142c2a529707d9999b96d (127.12.174.129). New cstate: current_term: 1 leader_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:04.986817 26400 raft_consensus.cc:385] T 5640177c765d4c7eace47afab24512cc P 29ab82db4b2a4da39ed4796200c235bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:04.987176 26400 raft_consensus.cc:740] T 5640177c765d4c7eace47afab24512cc P 29ab82db4b2a4da39ed4796200c235bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29ab82db4b2a4da39ed4796200c235bd, State: Initialized, Role: FOLLOWER
I20260709 12:15:04.988111 26400 consensus_queue.cc:260] T 5640177c765d4c7eace47afab24512cc P 29ab82db4b2a4da39ed4796200c235bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:04.991313 26400 ts_tablet_manager.cc:1434] T 5640177c765d4c7eace47afab24512cc P 29ab82db4b2a4da39ed4796200c235bd: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:15:04.992286 26401 tablet_bootstrap.cc:492] T 51f64f6460364936b54245159e7025b6 P 47ec5c2bfdd24b1eb2a906f63214876e: No bootstrap required, opened a new log
I20260709 12:15:04.992944 26401 ts_tablet_manager.cc:1403] T 51f64f6460364936b54245159e7025b6 P 47ec5c2bfdd24b1eb2a906f63214876e: Time spent bootstrapping tablet: real 0.015s	user 0.013s	sys 0.000s
I20260709 12:15:04.994577 26403 raft_consensus.cc:493] T 04079c0c50104d67a18aaeb329e1e434 P b6ea3e3c1dd142c2a529707d9999b96d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:04.995210 26403 raft_consensus.cc:515] T 04079c0c50104d67a18aaeb329e1e434 P b6ea3e3c1dd142c2a529707d9999b96d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:04.995884 26401 raft_consensus.cc:359] T 51f64f6460364936b54245159e7025b6 P 47ec5c2bfdd24b1eb2a906f63214876e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:04.996699 26401 raft_consensus.cc:385] T 51f64f6460364936b54245159e7025b6 P 47ec5c2bfdd24b1eb2a906f63214876e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:04.996977 26401 raft_consensus.cc:740] T 51f64f6460364936b54245159e7025b6 P 47ec5c2bfdd24b1eb2a906f63214876e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47ec5c2bfdd24b1eb2a906f63214876e, State: Initialized, Role: FOLLOWER
I20260709 12:15:04.997817 26401 consensus_queue.cc:260] T 51f64f6460364936b54245159e7025b6 P 47ec5c2bfdd24b1eb2a906f63214876e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:04.999460 26359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04079c0c50104d67a18aaeb329e1e434" candidate_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29ab82db4b2a4da39ed4796200c235bd" is_pre_election: true
I20260709 12:15:04.999768 26403 leader_election.cc:290] T 04079c0c50104d67a18aaeb329e1e434 P b6ea3e3c1dd142c2a529707d9999b96d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 47ec5c2bfdd24b1eb2a906f63214876e (127.12.174.130:43337), 29ab82db4b2a4da39ed4796200c235bd (127.12.174.131:43279)
I20260709 12:15:05.000288 26359 raft_consensus.cc:2468] T 04079c0c50104d67a18aaeb329e1e434 P 29ab82db4b2a4da39ed4796200c235bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6ea3e3c1dd142c2a529707d9999b96d in term 0.
I20260709 12:15:05.000576 26401 ts_tablet_manager.cc:1434] T 51f64f6460364936b54245159e7025b6 P 47ec5c2bfdd24b1eb2a906f63214876e: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:15:05.001430 26284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04079c0c50104d67a18aaeb329e1e434" candidate_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" is_pre_election: true
I20260709 12:15:05.002020 26284 raft_consensus.cc:2468] T 04079c0c50104d67a18aaeb329e1e434 P 47ec5c2bfdd24b1eb2a906f63214876e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6ea3e3c1dd142c2a529707d9999b96d in term 0.
I20260709 12:15:05.003334 26174 leader_election.cc:304] T 04079c0c50104d67a18aaeb329e1e434 P b6ea3e3c1dd142c2a529707d9999b96d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29ab82db4b2a4da39ed4796200c235bd, b6ea3e3c1dd142c2a529707d9999b96d; no voters: 
I20260709 12:15:05.004908 26403 raft_consensus.cc:2804] T 04079c0c50104d67a18aaeb329e1e434 P b6ea3e3c1dd142c2a529707d9999b96d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:05.004679 26106 catalog_manager.cc:5697] T 51f64f6460364936b54245159e7025b6 P 29ab82db4b2a4da39ed4796200c235bd reported cstate change: term changed from 0 to 1, leader changed from <none> to 29ab82db4b2a4da39ed4796200c235bd (127.12.174.131). New cstate: current_term: 1 leader_uuid: "29ab82db4b2a4da39ed4796200c235bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:05.005421 26403 raft_consensus.cc:493] T 04079c0c50104d67a18aaeb329e1e434 P b6ea3e3c1dd142c2a529707d9999b96d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:05.005903 26403 raft_consensus.cc:3060] T 04079c0c50104d67a18aaeb329e1e434 P b6ea3e3c1dd142c2a529707d9999b96d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:05.010664 26431 raft_consensus.cc:493] T 61c63f2d508d492dab277021e7a3de0f P 29ab82db4b2a4da39ed4796200c235bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:05.011358 26431 raft_consensus.cc:515] T 61c63f2d508d492dab277021e7a3de0f P 29ab82db4b2a4da39ed4796200c235bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:05.013785 26431 leader_election.cc:290] T 61c63f2d508d492dab277021e7a3de0f P 29ab82db4b2a4da39ed4796200c235bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6ea3e3c1dd142c2a529707d9999b96d (127.12.174.129:34845), 47ec5c2bfdd24b1eb2a906f63214876e (127.12.174.130:43337)
I20260709 12:15:05.015024 26284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61c63f2d508d492dab277021e7a3de0f" candidate_uuid: "29ab82db4b2a4da39ed4796200c235bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" is_pre_election: true
I20260709 12:15:05.015424 26403 raft_consensus.cc:515] T 04079c0c50104d67a18aaeb329e1e434 P b6ea3e3c1dd142c2a529707d9999b96d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:05.015878 26284 raft_consensus.cc:2468] T 61c63f2d508d492dab277021e7a3de0f P 47ec5c2bfdd24b1eb2a906f63214876e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29ab82db4b2a4da39ed4796200c235bd in term 0.
I20260709 12:15:05.016322 26210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61c63f2d508d492dab277021e7a3de0f" candidate_uuid: "29ab82db4b2a4da39ed4796200c235bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" is_pre_election: true
I20260709 12:15:05.017102 26210 raft_consensus.cc:2468] T 61c63f2d508d492dab277021e7a3de0f P b6ea3e3c1dd142c2a529707d9999b96d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29ab82db4b2a4da39ed4796200c235bd in term 0.
I20260709 12:15:05.017406 26322 leader_election.cc:304] T 61c63f2d508d492dab277021e7a3de0f P 29ab82db4b2a4da39ed4796200c235bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29ab82db4b2a4da39ed4796200c235bd, 47ec5c2bfdd24b1eb2a906f63214876e; no voters: 
I20260709 12:15:05.018441 26431 raft_consensus.cc:2804] T 61c63f2d508d492dab277021e7a3de0f P 29ab82db4b2a4da39ed4796200c235bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:05.018832 26431 raft_consensus.cc:493] T 61c63f2d508d492dab277021e7a3de0f P 29ab82db4b2a4da39ed4796200c235bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:05.018929 26403 leader_election.cc:290] T 04079c0c50104d67a18aaeb329e1e434 P b6ea3e3c1dd142c2a529707d9999b96d [CANDIDATE]: Term 1 election: Requested vote from peers 47ec5c2bfdd24b1eb2a906f63214876e (127.12.174.130:43337), 29ab82db4b2a4da39ed4796200c235bd (127.12.174.131:43279)
I20260709 12:15:05.019259 26431 raft_consensus.cc:3060] T 61c63f2d508d492dab277021e7a3de0f P 29ab82db4b2a4da39ed4796200c235bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:05.019596 26359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04079c0c50104d67a18aaeb329e1e434" candidate_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29ab82db4b2a4da39ed4796200c235bd"
I20260709 12:15:05.019081 26284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04079c0c50104d67a18aaeb329e1e434" candidate_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47ec5c2bfdd24b1eb2a906f63214876e"
I20260709 12:15:05.020313 26359 raft_consensus.cc:3060] T 04079c0c50104d67a18aaeb329e1e434 P 29ab82db4b2a4da39ed4796200c235bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:05.021773 26284 raft_consensus.cc:3060] T 04079c0c50104d67a18aaeb329e1e434 P 47ec5c2bfdd24b1eb2a906f63214876e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:05.027338 26431 raft_consensus.cc:515] T 61c63f2d508d492dab277021e7a3de0f P 29ab82db4b2a4da39ed4796200c235bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:05.030849 26210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61c63f2d508d492dab277021e7a3de0f" candidate_uuid: "29ab82db4b2a4da39ed4796200c235bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6ea3e3c1dd142c2a529707d9999b96d"
I20260709 12:15:05.031106 26285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61c63f2d508d492dab277021e7a3de0f" candidate_uuid: "29ab82db4b2a4da39ed4796200c235bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47ec5c2bfdd24b1eb2a906f63214876e"
I20260709 12:15:05.031599 26210 raft_consensus.cc:3060] T 61c63f2d508d492dab277021e7a3de0f P b6ea3e3c1dd142c2a529707d9999b96d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:05.031817 26285 raft_consensus.cc:3060] T 61c63f2d508d492dab277021e7a3de0f P 47ec5c2bfdd24b1eb2a906f63214876e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:05.033910 26431 leader_election.cc:290] T 61c63f2d508d492dab277021e7a3de0f P 29ab82db4b2a4da39ed4796200c235bd [CANDIDATE]: Term 1 election: Requested vote from peers b6ea3e3c1dd142c2a529707d9999b96d (127.12.174.129:34845), 47ec5c2bfdd24b1eb2a906f63214876e (127.12.174.130:43337)
I20260709 12:15:05.034899 26284 raft_consensus.cc:2468] T 04079c0c50104d67a18aaeb329e1e434 P 47ec5c2bfdd24b1eb2a906f63214876e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6ea3e3c1dd142c2a529707d9999b96d in term 1.
I20260709 12:15:05.036331 26173 leader_election.cc:304] T 04079c0c50104d67a18aaeb329e1e434 P b6ea3e3c1dd142c2a529707d9999b96d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47ec5c2bfdd24b1eb2a906f63214876e, b6ea3e3c1dd142c2a529707d9999b96d; no voters: 
I20260709 12:15:05.037360 26403 raft_consensus.cc:2804] T 04079c0c50104d67a18aaeb329e1e434 P b6ea3e3c1dd142c2a529707d9999b96d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:05.038800 26403 raft_consensus.cc:697] T 04079c0c50104d67a18aaeb329e1e434 P b6ea3e3c1dd142c2a529707d9999b96d [term 1 LEADER]: Becoming Leader. State: Replica: b6ea3e3c1dd142c2a529707d9999b96d, State: Running, Role: LEADER
I20260709 12:15:05.039623 26359 raft_consensus.cc:2468] T 04079c0c50104d67a18aaeb329e1e434 P 29ab82db4b2a4da39ed4796200c235bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6ea3e3c1dd142c2a529707d9999b96d in term 1.
I20260709 12:15:05.040455 26210 raft_consensus.cc:2468] T 61c63f2d508d492dab277021e7a3de0f P b6ea3e3c1dd142c2a529707d9999b96d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29ab82db4b2a4da39ed4796200c235bd in term 1.
I20260709 12:15:05.039786 26403 consensus_queue.cc:237] T 04079c0c50104d67a18aaeb329e1e434 P b6ea3e3c1dd142c2a529707d9999b96d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:05.040455 26285 raft_consensus.cc:2468] T 61c63f2d508d492dab277021e7a3de0f P 47ec5c2bfdd24b1eb2a906f63214876e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29ab82db4b2a4da39ed4796200c235bd in term 1.
I20260709 12:15:05.041927 26325 leader_election.cc:304] T 61c63f2d508d492dab277021e7a3de0f P 29ab82db4b2a4da39ed4796200c235bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29ab82db4b2a4da39ed4796200c235bd, b6ea3e3c1dd142c2a529707d9999b96d; no voters: 
I20260709 12:15:05.042809 26431 raft_consensus.cc:2804] T 61c63f2d508d492dab277021e7a3de0f P 29ab82db4b2a4da39ed4796200c235bd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:05.043268 26431 raft_consensus.cc:697] T 61c63f2d508d492dab277021e7a3de0f P 29ab82db4b2a4da39ed4796200c235bd [term 1 LEADER]: Becoming Leader. State: Replica: 29ab82db4b2a4da39ed4796200c235bd, State: Running, Role: LEADER
I20260709 12:15:05.044051 26431 consensus_queue.cc:237] T 61c63f2d508d492dab277021e7a3de0f P 29ab82db4b2a4da39ed4796200c235bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:05.048216 26408 raft_consensus.cc:493] T 5640177c765d4c7eace47afab24512cc P 47ec5c2bfdd24b1eb2a906f63214876e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:05.048902 26408 raft_consensus.cc:515] T 5640177c765d4c7eace47afab24512cc P 47ec5c2bfdd24b1eb2a906f63214876e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:05.051352 26408 leader_election.cc:290] T 5640177c765d4c7eace47afab24512cc P 47ec5c2bfdd24b1eb2a906f63214876e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6ea3e3c1dd142c2a529707d9999b96d (127.12.174.129:34845), 29ab82db4b2a4da39ed4796200c235bd (127.12.174.131:43279)
I20260709 12:15:05.052290 26210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5640177c765d4c7eace47afab24512cc" candidate_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" is_pre_election: true
I20260709 12:15:05.052261 26106 catalog_manager.cc:5697] T 04079c0c50104d67a18aaeb329e1e434 P b6ea3e3c1dd142c2a529707d9999b96d reported cstate change: term changed from 0 to 1, leader changed from <none> to b6ea3e3c1dd142c2a529707d9999b96d (127.12.174.129). New cstate: current_term: 1 leader_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:05.053335 26210 raft_consensus.cc:2468] T 5640177c765d4c7eace47afab24512cc P b6ea3e3c1dd142c2a529707d9999b96d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47ec5c2bfdd24b1eb2a906f63214876e in term 0.
I20260709 12:15:05.055279 26251 leader_election.cc:304] T 5640177c765d4c7eace47afab24512cc P 47ec5c2bfdd24b1eb2a906f63214876e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47ec5c2bfdd24b1eb2a906f63214876e, b6ea3e3c1dd142c2a529707d9999b96d; no voters: 
I20260709 12:15:05.054821 26107 catalog_manager.cc:5697] T 61c63f2d508d492dab277021e7a3de0f P 29ab82db4b2a4da39ed4796200c235bd reported cstate change: term changed from 0 to 1, leader changed from <none> to 29ab82db4b2a4da39ed4796200c235bd (127.12.174.131). New cstate: current_term: 1 leader_uuid: "29ab82db4b2a4da39ed4796200c235bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:05.054845 26359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5640177c765d4c7eace47afab24512cc" candidate_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29ab82db4b2a4da39ed4796200c235bd" is_pre_election: true
I20260709 12:15:05.056388 26408 raft_consensus.cc:2804] T 5640177c765d4c7eace47afab24512cc P 47ec5c2bfdd24b1eb2a906f63214876e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:05.056491 26359 raft_consensus.cc:2468] T 5640177c765d4c7eace47afab24512cc P 29ab82db4b2a4da39ed4796200c235bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47ec5c2bfdd24b1eb2a906f63214876e in term 0.
I20260709 12:15:05.057054 26408 raft_consensus.cc:493] T 5640177c765d4c7eace47afab24512cc P 47ec5c2bfdd24b1eb2a906f63214876e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:05.057519 26408 raft_consensus.cc:3060] T 5640177c765d4c7eace47afab24512cc P 47ec5c2bfdd24b1eb2a906f63214876e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:05.066115 26408 raft_consensus.cc:515] T 5640177c765d4c7eace47afab24512cc P 47ec5c2bfdd24b1eb2a906f63214876e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:05.067925 26408 leader_election.cc:290] T 5640177c765d4c7eace47afab24512cc P 47ec5c2bfdd24b1eb2a906f63214876e [CANDIDATE]: Term 1 election: Requested vote from peers b6ea3e3c1dd142c2a529707d9999b96d (127.12.174.129:34845), 29ab82db4b2a4da39ed4796200c235bd (127.12.174.131:43279)
I20260709 12:15:05.068801 26210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5640177c765d4c7eace47afab24512cc" candidate_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6ea3e3c1dd142c2a529707d9999b96d"
I20260709 12:15:05.068928 26359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5640177c765d4c7eace47afab24512cc" candidate_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29ab82db4b2a4da39ed4796200c235bd"
I20260709 12:15:05.069448 26210 raft_consensus.cc:3060] T 5640177c765d4c7eace47afab24512cc P b6ea3e3c1dd142c2a529707d9999b96d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:05.069492 26359 raft_consensus.cc:3060] T 5640177c765d4c7eace47afab24512cc P 29ab82db4b2a4da39ed4796200c235bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:05.076308 26210 raft_consensus.cc:2468] T 5640177c765d4c7eace47afab24512cc P b6ea3e3c1dd142c2a529707d9999b96d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47ec5c2bfdd24b1eb2a906f63214876e in term 1.
I20260709 12:15:05.076749 26359 raft_consensus.cc:2468] T 5640177c765d4c7eace47afab24512cc P 29ab82db4b2a4da39ed4796200c235bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47ec5c2bfdd24b1eb2a906f63214876e in term 1.
I20260709 12:15:05.077566 26251 leader_election.cc:304] T 5640177c765d4c7eace47afab24512cc P 47ec5c2bfdd24b1eb2a906f63214876e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47ec5c2bfdd24b1eb2a906f63214876e, b6ea3e3c1dd142c2a529707d9999b96d; no voters: 
I20260709 12:15:05.078847 26408 raft_consensus.cc:2804] T 5640177c765d4c7eace47afab24512cc P 47ec5c2bfdd24b1eb2a906f63214876e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:05.079298 26408 raft_consensus.cc:697] T 5640177c765d4c7eace47afab24512cc P 47ec5c2bfdd24b1eb2a906f63214876e [term 1 LEADER]: Becoming Leader. State: Replica: 47ec5c2bfdd24b1eb2a906f63214876e, State: Running, Role: LEADER
I20260709 12:15:05.080138 26408 consensus_queue.cc:237] T 5640177c765d4c7eace47afab24512cc P 47ec5c2bfdd24b1eb2a906f63214876e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:05.086686 26403 raft_consensus.cc:493] T 8e274509d4a64b129aa342b697004bf1 P b6ea3e3c1dd142c2a529707d9999b96d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:05.087311 26403 raft_consensus.cc:515] T 8e274509d4a64b129aa342b697004bf1 P b6ea3e3c1dd142c2a529707d9999b96d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:05.088122 26107 catalog_manager.cc:5697] T 5640177c765d4c7eace47afab24512cc P 47ec5c2bfdd24b1eb2a906f63214876e reported cstate change: term changed from 0 to 1, leader changed from <none> to 47ec5c2bfdd24b1eb2a906f63214876e (127.12.174.130). New cstate: current_term: 1 leader_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:05.089622 26403 leader_election.cc:290] T 8e274509d4a64b129aa342b697004bf1 P b6ea3e3c1dd142c2a529707d9999b96d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 47ec5c2bfdd24b1eb2a906f63214876e (127.12.174.130:43337), 29ab82db4b2a4da39ed4796200c235bd (127.12.174.131:43279)
I20260709 12:15:05.090147 26285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e274509d4a64b129aa342b697004bf1" candidate_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" is_pre_election: true
I20260709 12:15:05.090341 26359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e274509d4a64b129aa342b697004bf1" candidate_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29ab82db4b2a4da39ed4796200c235bd" is_pre_election: true
I20260709 12:15:05.091037 26285 raft_consensus.cc:2393] T 8e274509d4a64b129aa342b697004bf1 P 47ec5c2bfdd24b1eb2a906f63214876e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6ea3e3c1dd142c2a529707d9999b96d in current term 1: Already voted for candidate 29ab82db4b2a4da39ed4796200c235bd in this term.
I20260709 12:15:05.092181 26173 leader_election.cc:304] T 8e274509d4a64b129aa342b697004bf1 P b6ea3e3c1dd142c2a529707d9999b96d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6ea3e3c1dd142c2a529707d9999b96d; no voters: 29ab82db4b2a4da39ed4796200c235bd, 47ec5c2bfdd24b1eb2a906f63214876e
I20260709 12:15:05.093076 26403 raft_consensus.cc:3060] T 8e274509d4a64b129aa342b697004bf1 P b6ea3e3c1dd142c2a529707d9999b96d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:05.101540 26403 raft_consensus.cc:2749] T 8e274509d4a64b129aa342b697004bf1 P b6ea3e3c1dd142c2a529707d9999b96d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:05.141512 26408 raft_consensus.cc:493] T 51f64f6460364936b54245159e7025b6 P 47ec5c2bfdd24b1eb2a906f63214876e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:05.142220 26408 raft_consensus.cc:515] T 51f64f6460364936b54245159e7025b6 P 47ec5c2bfdd24b1eb2a906f63214876e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:05.144583 26408 leader_election.cc:290] T 51f64f6460364936b54245159e7025b6 P 47ec5c2bfdd24b1eb2a906f63214876e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6ea3e3c1dd142c2a529707d9999b96d (127.12.174.129:34845), 29ab82db4b2a4da39ed4796200c235bd (127.12.174.131:43279)
I20260709 12:15:05.145540 26210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f64f6460364936b54245159e7025b6" candidate_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" is_pre_election: true
I20260709 12:15:05.145937 26359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f64f6460364936b54245159e7025b6" candidate_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29ab82db4b2a4da39ed4796200c235bd" is_pre_election: true
I20260709 12:15:05.146488 26210 raft_consensus.cc:2393] T 51f64f6460364936b54245159e7025b6 P b6ea3e3c1dd142c2a529707d9999b96d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47ec5c2bfdd24b1eb2a906f63214876e in current term 1: Already voted for candidate 29ab82db4b2a4da39ed4796200c235bd in this term.
I20260709 12:15:05.147545 26251 leader_election.cc:304] T 51f64f6460364936b54245159e7025b6 P 47ec5c2bfdd24b1eb2a906f63214876e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47ec5c2bfdd24b1eb2a906f63214876e; no voters: 29ab82db4b2a4da39ed4796200c235bd, b6ea3e3c1dd142c2a529707d9999b96d
I20260709 12:15:05.148276 26408 raft_consensus.cc:3060] T 51f64f6460364936b54245159e7025b6 P 47ec5c2bfdd24b1eb2a906f63214876e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:05.155576 26408 raft_consensus.cc:2749] T 51f64f6460364936b54245159e7025b6 P 47ec5c2bfdd24b1eb2a906f63214876e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:05.167440 26285 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2be4e2f97d1941a4a3fe4f0dc03bdc57"
dest_uuid: "47ec5c2bfdd24b1eb2a906f63214876e"
mode: GRACEFUL
new_leader_uuid: "b6ea3e3c1dd142c2a529707d9999b96d"
 from {username='slave'} at 127.0.0.1:52708
I20260709 12:15:05.168218 26285 raft_consensus.cc:606] T 2be4e2f97d1941a4a3fe4f0dc03bdc57 P 47ec5c2bfdd24b1eb2a906f63214876e [term 1 LEADER]: Received request to transfer leadership to TS b6ea3e3c1dd142c2a529707d9999b96d
I20260709 12:15:05.184151 26359 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "51f64f6460364936b54245159e7025b6"
dest_uuid: "29ab82db4b2a4da39ed4796200c235bd"
mode: GRACEFUL
new_leader_uuid: "b6ea3e3c1dd142c2a529707d9999b96d"
 from {username='slave'} at 127.0.0.1:42050
I20260709 12:15:05.184790 26359 raft_consensus.cc:606] T 51f64f6460364936b54245159e7025b6 P 29ab82db4b2a4da39ed4796200c235bd [term 1 LEADER]: Received request to transfer leadership to TS b6ea3e3c1dd142c2a529707d9999b96d
I20260709 12:15:05.187348 26403 consensus_queue.cc:1048] T 0ced3f63513a4e0ba988e57453fcf32e P b6ea3e3c1dd142c2a529707d9999b96d [LEADER]: Connected to new peer: Peer: permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:05.191193 26359 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "61c63f2d508d492dab277021e7a3de0f"
dest_uuid: "29ab82db4b2a4da39ed4796200c235bd"
mode: GRACEFUL
new_leader_uuid: "47ec5c2bfdd24b1eb2a906f63214876e"
 from {username='slave'} at 127.0.0.1:42050
I20260709 12:15:05.191767 26359 raft_consensus.cc:606] T 61c63f2d508d492dab277021e7a3de0f P 29ab82db4b2a4da39ed4796200c235bd [term 1 LEADER]: Received request to transfer leadership to TS 47ec5c2bfdd24b1eb2a906f63214876e
I20260709 12:15:05.205224 26359 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "29fd96c2a5d34cbfbc04b6878fc1a9ae"
dest_uuid: "29ab82db4b2a4da39ed4796200c235bd"
mode: GRACEFUL
new_leader_uuid: "47ec5c2bfdd24b1eb2a906f63214876e"
 from {username='slave'} at 127.0.0.1:42050
I20260709 12:15:05.205996 26359 raft_consensus.cc:606] T 29fd96c2a5d34cbfbc04b6878fc1a9ae P 29ab82db4b2a4da39ed4796200c235bd [term 1 LEADER]: Received request to transfer leadership to TS 47ec5c2bfdd24b1eb2a906f63214876e
I20260709 12:15:05.206014 26403 consensus_queue.cc:1048] T 0ced3f63513a4e0ba988e57453fcf32e P b6ea3e3c1dd142c2a529707d9999b96d [LEADER]: Connected to new peer: Peer: permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:05.213464 26358 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8e274509d4a64b129aa342b697004bf1"
dest_uuid: "29ab82db4b2a4da39ed4796200c235bd"
mode: GRACEFUL
new_leader_uuid: "47ec5c2bfdd24b1eb2a906f63214876e"
 from {username='slave'} at 127.0.0.1:42050
I20260709 12:15:05.214259 26358 raft_consensus.cc:606] T 8e274509d4a64b129aa342b697004bf1 P 29ab82db4b2a4da39ed4796200c235bd [term 1 LEADER]: Received request to transfer leadership to TS 47ec5c2bfdd24b1eb2a906f63214876e
I20260709 12:15:05.229352 26210 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "04079c0c50104d67a18aaeb329e1e434"
dest_uuid: "b6ea3e3c1dd142c2a529707d9999b96d"
mode: GRACEFUL
new_leader_uuid: "29ab82db4b2a4da39ed4796200c235bd"
 from {username='slave'} at 127.0.0.1:48158
I20260709 12:15:05.230034 26210 raft_consensus.cc:606] T 04079c0c50104d67a18aaeb329e1e434 P b6ea3e3c1dd142c2a529707d9999b96d [term 1 LEADER]: Received request to transfer leadership to TS 29ab82db4b2a4da39ed4796200c235bd
I20260709 12:15:05.295069 26403 consensus_queue.cc:1048] T f7cde2085f2b4fa182c0126b08cc9dd5 P b6ea3e3c1dd142c2a529707d9999b96d [LEADER]: Connected to new peer: Peer: permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:05.306613 26430 consensus_queue.cc:1048] T f7cde2085f2b4fa182c0126b08cc9dd5 P b6ea3e3c1dd142c2a529707d9999b96d [LEADER]: Connected to new peer: Peer: permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:05.359935 26431 consensus_queue.cc:1048] T 29fd96c2a5d34cbfbc04b6878fc1a9ae P 29ab82db4b2a4da39ed4796200c235bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:05.368278 26432 consensus_queue.cc:1048] T 8e274509d4a64b129aa342b697004bf1 P 29ab82db4b2a4da39ed4796200c235bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:05.371872 26407 consensus_queue.cc:1048] T 29fd96c2a5d34cbfbc04b6878fc1a9ae P 29ab82db4b2a4da39ed4796200c235bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:05.385562 26431 raft_consensus.cc:993] T 29fd96c2a5d34cbfbc04b6878fc1a9ae P 29ab82db4b2a4da39ed4796200c235bd: : Instructing follower 47ec5c2bfdd24b1eb2a906f63214876e to start an election
I20260709 12:15:05.386193 26431 raft_consensus.cc:1081] T 29fd96c2a5d34cbfbc04b6878fc1a9ae P 29ab82db4b2a4da39ed4796200c235bd [term 1 LEADER]: Signalling peer 47ec5c2bfdd24b1eb2a906f63214876e to start an election
I20260709 12:15:05.388428 26407 consensus_queue.cc:1048] T 8e274509d4a64b129aa342b697004bf1 P 29ab82db4b2a4da39ed4796200c235bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:05.389065 26285 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "29fd96c2a5d34cbfbc04b6878fc1a9ae"
dest_uuid: "47ec5c2bfdd24b1eb2a906f63214876e"
 from {username='slave'} at 127.0.0.1:52698
I20260709 12:15:05.389918 26285 raft_consensus.cc:493] T 29fd96c2a5d34cbfbc04b6878fc1a9ae P 47ec5c2bfdd24b1eb2a906f63214876e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:05.390309 26285 raft_consensus.cc:3060] T 29fd96c2a5d34cbfbc04b6878fc1a9ae P 47ec5c2bfdd24b1eb2a906f63214876e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:05.397840 26431 raft_consensus.cc:993] T 8e274509d4a64b129aa342b697004bf1 P 29ab82db4b2a4da39ed4796200c235bd: : Instructing follower 47ec5c2bfdd24b1eb2a906f63214876e to start an election
I20260709 12:15:05.398561 26407 raft_consensus.cc:1081] T 8e274509d4a64b129aa342b697004bf1 P 29ab82db4b2a4da39ed4796200c235bd [term 1 LEADER]: Signalling peer 47ec5c2bfdd24b1eb2a906f63214876e to start an election
I20260709 12:15:05.400326 26284 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8e274509d4a64b129aa342b697004bf1"
dest_uuid: "47ec5c2bfdd24b1eb2a906f63214876e"
 from {username='slave'} at 127.0.0.1:52698
I20260709 12:15:05.400950 26284 raft_consensus.cc:493] T 8e274509d4a64b129aa342b697004bf1 P 47ec5c2bfdd24b1eb2a906f63214876e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:05.401366 26284 raft_consensus.cc:3060] T 8e274509d4a64b129aa342b697004bf1 P 47ec5c2bfdd24b1eb2a906f63214876e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:05.401211 26285 raft_consensus.cc:515] T 29fd96c2a5d34cbfbc04b6878fc1a9ae P 47ec5c2bfdd24b1eb2a906f63214876e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:05.403728 26285 leader_election.cc:290] T 29fd96c2a5d34cbfbc04b6878fc1a9ae P 47ec5c2bfdd24b1eb2a906f63214876e [CANDIDATE]: Term 2 election: Requested vote from peers b6ea3e3c1dd142c2a529707d9999b96d (127.12.174.129:34845), 29ab82db4b2a4da39ed4796200c235bd (127.12.174.131:43279)
I20260709 12:15:05.404999 26210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29fd96c2a5d34cbfbc04b6878fc1a9ae" candidate_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b6ea3e3c1dd142c2a529707d9999b96d"
I20260709 12:15:05.405484 26358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29fd96c2a5d34cbfbc04b6878fc1a9ae" candidate_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "29ab82db4b2a4da39ed4796200c235bd"
I20260709 12:15:05.405771 26210 raft_consensus.cc:3060] T 29fd96c2a5d34cbfbc04b6878fc1a9ae P b6ea3e3c1dd142c2a529707d9999b96d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:05.406142 26358 raft_consensus.cc:3055] T 29fd96c2a5d34cbfbc04b6878fc1a9ae P 29ab82db4b2a4da39ed4796200c235bd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:05.406500 26358 raft_consensus.cc:740] T 29fd96c2a5d34cbfbc04b6878fc1a9ae P 29ab82db4b2a4da39ed4796200c235bd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 29ab82db4b2a4da39ed4796200c235bd, State: Running, Role: LEADER
I20260709 12:15:05.411531 26284 raft_consensus.cc:515] T 8e274509d4a64b129aa342b697004bf1 P 47ec5c2bfdd24b1eb2a906f63214876e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:05.412323 26358 consensus_queue.cc:260] T 29fd96c2a5d34cbfbc04b6878fc1a9ae P 29ab82db4b2a4da39ed4796200c235bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:05.413017 26408 consensus_queue.cc:1048] T 2be4e2f97d1941a4a3fe4f0dc03bdc57 P 47ec5c2bfdd24b1eb2a906f63214876e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:05.413863 26358 raft_consensus.cc:3060] T 29fd96c2a5d34cbfbc04b6878fc1a9ae P 29ab82db4b2a4da39ed4796200c235bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:05.414433 26210 raft_consensus.cc:2468] T 29fd96c2a5d34cbfbc04b6878fc1a9ae P b6ea3e3c1dd142c2a529707d9999b96d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47ec5c2bfdd24b1eb2a906f63214876e in term 2.
I20260709 12:15:05.414860 26284 leader_election.cc:290] T 8e274509d4a64b129aa342b697004bf1 P 47ec5c2bfdd24b1eb2a906f63214876e [CANDIDATE]: Term 2 election: Requested vote from peers b6ea3e3c1dd142c2a529707d9999b96d (127.12.174.129:34845), 29ab82db4b2a4da39ed4796200c235bd (127.12.174.131:43279)
I20260709 12:15:05.415759 26251 leader_election.cc:304] T 29fd96c2a5d34cbfbc04b6878fc1a9ae P 47ec5c2bfdd24b1eb2a906f63214876e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47ec5c2bfdd24b1eb2a906f63214876e, b6ea3e3c1dd142c2a529707d9999b96d; no voters: 
I20260709 12:15:05.417936 26408 raft_consensus.cc:2804] T 29fd96c2a5d34cbfbc04b6878fc1a9ae P 47ec5c2bfdd24b1eb2a906f63214876e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:05.419471 26359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e274509d4a64b129aa342b697004bf1" candidate_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "29ab82db4b2a4da39ed4796200c235bd"
I20260709 12:15:05.414644 26208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e274509d4a64b129aa342b697004bf1" candidate_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b6ea3e3c1dd142c2a529707d9999b96d"
I20260709 12:15:05.420197 26359 raft_consensus.cc:3055] T 8e274509d4a64b129aa342b697004bf1 P 29ab82db4b2a4da39ed4796200c235bd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:05.420418 26208 raft_consensus.cc:3060] T 8e274509d4a64b129aa342b697004bf1 P b6ea3e3c1dd142c2a529707d9999b96d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:05.418895 26408 raft_consensus.cc:697] T 29fd96c2a5d34cbfbc04b6878fc1a9ae P 47ec5c2bfdd24b1eb2a906f63214876e [term 2 LEADER]: Becoming Leader. State: Replica: 47ec5c2bfdd24b1eb2a906f63214876e, State: Running, Role: LEADER
I20260709 12:15:05.422004 26408 consensus_queue.cc:237] T 29fd96c2a5d34cbfbc04b6878fc1a9ae P 47ec5c2bfdd24b1eb2a906f63214876e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:05.423641 26358 raft_consensus.cc:2468] T 29fd96c2a5d34cbfbc04b6878fc1a9ae P 29ab82db4b2a4da39ed4796200c235bd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47ec5c2bfdd24b1eb2a906f63214876e in term 2.
I20260709 12:15:05.423808 26359 raft_consensus.cc:740] T 8e274509d4a64b129aa342b697004bf1 P 29ab82db4b2a4da39ed4796200c235bd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 29ab82db4b2a4da39ed4796200c235bd, State: Running, Role: LEADER
I20260709 12:15:05.424772 26359 consensus_queue.cc:260] T 8e274509d4a64b129aa342b697004bf1 P 29ab82db4b2a4da39ed4796200c235bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:05.426249 26359 raft_consensus.cc:3060] T 8e274509d4a64b129aa342b697004bf1 P 29ab82db4b2a4da39ed4796200c235bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:05.428665 26430 consensus_queue.cc:1048] T 04079c0c50104d67a18aaeb329e1e434 P b6ea3e3c1dd142c2a529707d9999b96d [LEADER]: Connected to new peer: Peer: permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:05.435253 26208 raft_consensus.cc:2468] T 8e274509d4a64b129aa342b697004bf1 P b6ea3e3c1dd142c2a529707d9999b96d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47ec5c2bfdd24b1eb2a906f63214876e in term 2.
I20260709 12:15:05.434885 26359 raft_consensus.cc:2468] T 8e274509d4a64b129aa342b697004bf1 P 29ab82db4b2a4da39ed4796200c235bd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47ec5c2bfdd24b1eb2a906f63214876e in term 2.
I20260709 12:15:05.444901 26249 leader_election.cc:304] T 8e274509d4a64b129aa342b697004bf1 P 47ec5c2bfdd24b1eb2a906f63214876e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29ab82db4b2a4da39ed4796200c235bd, 47ec5c2bfdd24b1eb2a906f63214876e; no voters: 
I20260709 12:15:05.446446 26408 consensus_queue.cc:1048] T 2be4e2f97d1941a4a3fe4f0dc03bdc57 P 47ec5c2bfdd24b1eb2a906f63214876e [LEADER]: Connected to new peer: Peer: permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:05.447629 26106 catalog_manager.cc:5697] T 29fd96c2a5d34cbfbc04b6878fc1a9ae P 47ec5c2bfdd24b1eb2a906f63214876e reported cstate change: term changed from 1 to 2, leader changed from 29ab82db4b2a4da39ed4796200c235bd (127.12.174.131) to 47ec5c2bfdd24b1eb2a906f63214876e (127.12.174.130). New cstate: current_term: 2 leader_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:05.449508 26443 raft_consensus.cc:2804] T 8e274509d4a64b129aa342b697004bf1 P 47ec5c2bfdd24b1eb2a906f63214876e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:05.451037 26403 consensus_queue.cc:1048] T 04079c0c50104d67a18aaeb329e1e434 P b6ea3e3c1dd142c2a529707d9999b96d [LEADER]: Connected to new peer: Peer: permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:05.462195 26408 raft_consensus.cc:993] T 2be4e2f97d1941a4a3fe4f0dc03bdc57 P 47ec5c2bfdd24b1eb2a906f63214876e: : Instructing follower b6ea3e3c1dd142c2a529707d9999b96d to start an election
I20260709 12:15:05.462818 26408 raft_consensus.cc:1081] T 2be4e2f97d1941a4a3fe4f0dc03bdc57 P 47ec5c2bfdd24b1eb2a906f63214876e [term 1 LEADER]: Signalling peer b6ea3e3c1dd142c2a529707d9999b96d to start an election
I20260709 12:15:05.466229 26210 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2be4e2f97d1941a4a3fe4f0dc03bdc57"
dest_uuid: "b6ea3e3c1dd142c2a529707d9999b96d"
 from {username='slave'} at 127.0.0.1:48130
I20260709 12:15:05.466933 26210 raft_consensus.cc:493] T 2be4e2f97d1941a4a3fe4f0dc03bdc57 P b6ea3e3c1dd142c2a529707d9999b96d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:05.467880 26210 raft_consensus.cc:3060] T 2be4e2f97d1941a4a3fe4f0dc03bdc57 P b6ea3e3c1dd142c2a529707d9999b96d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:05.473547 26407 consensus_queue.cc:1048] T 51f64f6460364936b54245159e7025b6 P 29ab82db4b2a4da39ed4796200c235bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:05.480756 26476 consensus_queue.cc:1048] T 5640177c765d4c7eace47afab24512cc P 47ec5c2bfdd24b1eb2a906f63214876e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:05.485268 26443 raft_consensus.cc:697] T 8e274509d4a64b129aa342b697004bf1 P 47ec5c2bfdd24b1eb2a906f63214876e [term 2 LEADER]: Becoming Leader. State: Replica: 47ec5c2bfdd24b1eb2a906f63214876e, State: Running, Role: LEADER
I20260709 12:15:05.486531 26443 consensus_queue.cc:237] T 8e274509d4a64b129aa342b697004bf1 P 47ec5c2bfdd24b1eb2a906f63214876e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:05.487430 26407 consensus_queue.cc:1048] T 51f64f6460364936b54245159e7025b6 P 29ab82db4b2a4da39ed4796200c235bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:05.491919 26210 raft_consensus.cc:515] T 2be4e2f97d1941a4a3fe4f0dc03bdc57 P b6ea3e3c1dd142c2a529707d9999b96d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:05.499377 26108 catalog_manager.cc:5697] T 8e274509d4a64b129aa342b697004bf1 P 47ec5c2bfdd24b1eb2a906f63214876e reported cstate change: term changed from 1 to 2, leader changed from 29ab82db4b2a4da39ed4796200c235bd (127.12.174.131) to 47ec5c2bfdd24b1eb2a906f63214876e (127.12.174.130). New cstate: current_term: 2 leader_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:05.500324 26210 leader_election.cc:290] T 2be4e2f97d1941a4a3fe4f0dc03bdc57 P b6ea3e3c1dd142c2a529707d9999b96d [CANDIDATE]: Term 2 election: Requested vote from peers 47ec5c2bfdd24b1eb2a906f63214876e (127.12.174.130:43337), 29ab82db4b2a4da39ed4796200c235bd (127.12.174.131:43279)
I20260709 12:15:05.502995 26359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2be4e2f97d1941a4a3fe4f0dc03bdc57" candidate_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "29ab82db4b2a4da39ed4796200c235bd"
I20260709 12:15:05.503259 26403 raft_consensus.cc:993] T 04079c0c50104d67a18aaeb329e1e434 P b6ea3e3c1dd142c2a529707d9999b96d: : Instructing follower 29ab82db4b2a4da39ed4796200c235bd to start an election
I20260709 12:15:05.503674 26359 raft_consensus.cc:3060] T 2be4e2f97d1941a4a3fe4f0dc03bdc57 P 29ab82db4b2a4da39ed4796200c235bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:05.504397 26284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2be4e2f97d1941a4a3fe4f0dc03bdc57" candidate_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "47ec5c2bfdd24b1eb2a906f63214876e"
I20260709 12:15:05.505136 26284 raft_consensus.cc:3055] T 2be4e2f97d1941a4a3fe4f0dc03bdc57 P 47ec5c2bfdd24b1eb2a906f63214876e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:05.505462 26284 raft_consensus.cc:740] T 2be4e2f97d1941a4a3fe4f0dc03bdc57 P 47ec5c2bfdd24b1eb2a906f63214876e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 47ec5c2bfdd24b1eb2a906f63214876e, State: Running, Role: LEADER
I20260709 12:15:05.506609 26284 consensus_queue.cc:260] T 2be4e2f97d1941a4a3fe4f0dc03bdc57 P 47ec5c2bfdd24b1eb2a906f63214876e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:05.508004 26284 raft_consensus.cc:3060] T 2be4e2f97d1941a4a3fe4f0dc03bdc57 P 47ec5c2bfdd24b1eb2a906f63214876e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:05.503821 26403 raft_consensus.cc:1081] T 04079c0c50104d67a18aaeb329e1e434 P b6ea3e3c1dd142c2a529707d9999b96d [term 1 LEADER]: Signalling peer 29ab82db4b2a4da39ed4796200c235bd to start an election
I20260709 12:15:05.513371 26359 raft_consensus.cc:2468] T 2be4e2f97d1941a4a3fe4f0dc03bdc57 P 29ab82db4b2a4da39ed4796200c235bd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6ea3e3c1dd142c2a529707d9999b96d in term 2.
I20260709 12:15:05.513974 26358 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "04079c0c50104d67a18aaeb329e1e434"
dest_uuid: "29ab82db4b2a4da39ed4796200c235bd"
 from {username='slave'} at 127.0.0.1:42038
I20260709 12:15:05.514643 26358 raft_consensus.cc:493] T 04079c0c50104d67a18aaeb329e1e434 P 29ab82db4b2a4da39ed4796200c235bd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:05.514719 26174 leader_election.cc:304] T 2be4e2f97d1941a4a3fe4f0dc03bdc57 P b6ea3e3c1dd142c2a529707d9999b96d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29ab82db4b2a4da39ed4796200c235bd, b6ea3e3c1dd142c2a529707d9999b96d; no voters: 
I20260709 12:15:05.515066 26358 raft_consensus.cc:3060] T 04079c0c50104d67a18aaeb329e1e434 P 29ab82db4b2a4da39ed4796200c235bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:05.515734 26403 raft_consensus.cc:2804] T 2be4e2f97d1941a4a3fe4f0dc03bdc57 P b6ea3e3c1dd142c2a529707d9999b96d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:05.516227 26403 raft_consensus.cc:697] T 2be4e2f97d1941a4a3fe4f0dc03bdc57 P b6ea3e3c1dd142c2a529707d9999b96d [term 2 LEADER]: Becoming Leader. State: Replica: b6ea3e3c1dd142c2a529707d9999b96d, State: Running, Role: LEADER
I20260709 12:15:05.517109 26403 consensus_queue.cc:237] T 2be4e2f97d1941a4a3fe4f0dc03bdc57 P b6ea3e3c1dd142c2a529707d9999b96d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:05.520015 26407 consensus_queue.cc:1048] T 61c63f2d508d492dab277021e7a3de0f P 29ab82db4b2a4da39ed4796200c235bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:05.524411 26284 raft_consensus.cc:2468] T 2be4e2f97d1941a4a3fe4f0dc03bdc57 P 47ec5c2bfdd24b1eb2a906f63214876e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6ea3e3c1dd142c2a529707d9999b96d in term 2.
I20260709 12:15:05.528195 26444 raft_consensus.cc:993] T 61c63f2d508d492dab277021e7a3de0f P 29ab82db4b2a4da39ed4796200c235bd: : Instructing follower 47ec5c2bfdd24b1eb2a906f63214876e to start an election
I20260709 12:15:05.528755 26446 raft_consensus.cc:1081] T 61c63f2d508d492dab277021e7a3de0f P 29ab82db4b2a4da39ed4796200c235bd [term 1 LEADER]: Signalling peer 47ec5c2bfdd24b1eb2a906f63214876e to start an election
I20260709 12:15:05.528638 26358 raft_consensus.cc:515] T 04079c0c50104d67a18aaeb329e1e434 P 29ab82db4b2a4da39ed4796200c235bd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:05.532691 26210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04079c0c50104d67a18aaeb329e1e434" candidate_uuid: "29ab82db4b2a4da39ed4796200c235bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b6ea3e3c1dd142c2a529707d9999b96d"
I20260709 12:15:05.533360 26210 raft_consensus.cc:3055] T 04079c0c50104d67a18aaeb329e1e434 P b6ea3e3c1dd142c2a529707d9999b96d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:05.533787 26210 raft_consensus.cc:740] T 04079c0c50104d67a18aaeb329e1e434 P b6ea3e3c1dd142c2a529707d9999b96d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b6ea3e3c1dd142c2a529707d9999b96d, State: Running, Role: LEADER
I20260709 12:15:05.534713 26210 consensus_queue.cc:260] T 04079c0c50104d67a18aaeb329e1e434 P b6ea3e3c1dd142c2a529707d9999b96d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:05.535935 26210 raft_consensus.cc:3060] T 04079c0c50104d67a18aaeb329e1e434 P b6ea3e3c1dd142c2a529707d9999b96d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:05.536356 26407 consensus_queue.cc:1048] T 61c63f2d508d492dab277021e7a3de0f P 29ab82db4b2a4da39ed4796200c235bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:05.542606 26285 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "61c63f2d508d492dab277021e7a3de0f"
dest_uuid: "47ec5c2bfdd24b1eb2a906f63214876e"
 from {username='slave'} at 127.0.0.1:52698
I20260709 12:15:05.543289 26285 raft_consensus.cc:493] T 61c63f2d508d492dab277021e7a3de0f P 47ec5c2bfdd24b1eb2a906f63214876e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:05.543695 26285 raft_consensus.cc:3060] T 61c63f2d508d492dab277021e7a3de0f P 47ec5c2bfdd24b1eb2a906f63214876e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:05.545291 26210 raft_consensus.cc:2468] T 04079c0c50104d67a18aaeb329e1e434 P b6ea3e3c1dd142c2a529707d9999b96d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29ab82db4b2a4da39ed4796200c235bd in term 2.
I20260709 12:15:05.546896 26325 leader_election.cc:304] T 04079c0c50104d67a18aaeb329e1e434 P 29ab82db4b2a4da39ed4796200c235bd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29ab82db4b2a4da39ed4796200c235bd, b6ea3e3c1dd142c2a529707d9999b96d; no voters: 
I20260709 12:15:05.547407 26358 leader_election.cc:290] T 04079c0c50104d67a18aaeb329e1e434 P 29ab82db4b2a4da39ed4796200c235bd [CANDIDATE]: Term 2 election: Requested vote from peers b6ea3e3c1dd142c2a529707d9999b96d (127.12.174.129:34845), 47ec5c2bfdd24b1eb2a906f63214876e (127.12.174.130:43337)
I20260709 12:15:05.547645 26283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04079c0c50104d67a18aaeb329e1e434" candidate_uuid: "29ab82db4b2a4da39ed4796200c235bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "47ec5c2bfdd24b1eb2a906f63214876e"
I20260709 12:15:05.548321 26283 raft_consensus.cc:3060] T 04079c0c50104d67a18aaeb329e1e434 P 47ec5c2bfdd24b1eb2a906f63214876e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:05.549535 26444 raft_consensus.cc:993] T 51f64f6460364936b54245159e7025b6 P 29ab82db4b2a4da39ed4796200c235bd: : Instructing follower b6ea3e3c1dd142c2a529707d9999b96d to start an election
I20260709 12:15:05.550024 26444 raft_consensus.cc:1081] T 51f64f6460364936b54245159e7025b6 P 29ab82db4b2a4da39ed4796200c235bd [term 1 LEADER]: Signalling peer b6ea3e3c1dd142c2a529707d9999b96d to start an election
I20260709 12:15:05.548194 26431 raft_consensus.cc:2804] T 04079c0c50104d67a18aaeb329e1e434 P 29ab82db4b2a4da39ed4796200c235bd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:05.551124 26431 raft_consensus.cc:697] T 04079c0c50104d67a18aaeb329e1e434 P 29ab82db4b2a4da39ed4796200c235bd [term 2 LEADER]: Becoming Leader. State: Replica: 29ab82db4b2a4da39ed4796200c235bd, State: Running, Role: LEADER
I20260709 12:15:05.552078 26210 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "51f64f6460364936b54245159e7025b6"
dest_uuid: "b6ea3e3c1dd142c2a529707d9999b96d"
 from {username='slave'} at 127.0.0.1:48146
I20260709 12:15:05.551963 26431 consensus_queue.cc:237] T 04079c0c50104d67a18aaeb329e1e434 P 29ab82db4b2a4da39ed4796200c235bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:05.552690 26210 raft_consensus.cc:493] T 51f64f6460364936b54245159e7025b6 P b6ea3e3c1dd142c2a529707d9999b96d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:05.553113 26210 raft_consensus.cc:3060] T 51f64f6460364936b54245159e7025b6 P b6ea3e3c1dd142c2a529707d9999b96d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:05.570475 26479 consensus_queue.cc:1048] T 5640177c765d4c7eace47afab24512cc P 47ec5c2bfdd24b1eb2a906f63214876e [LEADER]: Connected to new peer: Peer: permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:05.561687 26210 raft_consensus.cc:515] T 51f64f6460364936b54245159e7025b6 P b6ea3e3c1dd142c2a529707d9999b96d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:05.562304 26106 catalog_manager.cc:5697] T 04079c0c50104d67a18aaeb329e1e434 P 29ab82db4b2a4da39ed4796200c235bd reported cstate change: term changed from 1 to 2, leader changed from b6ea3e3c1dd142c2a529707d9999b96d (127.12.174.129) to 29ab82db4b2a4da39ed4796200c235bd (127.12.174.131). New cstate: current_term: 2 leader_uuid: "29ab82db4b2a4da39ed4796200c235bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:05.580524 26210 leader_election.cc:290] T 51f64f6460364936b54245159e7025b6 P b6ea3e3c1dd142c2a529707d9999b96d [CANDIDATE]: Term 2 election: Requested vote from peers 47ec5c2bfdd24b1eb2a906f63214876e (127.12.174.130:43337), 29ab82db4b2a4da39ed4796200c235bd (127.12.174.131:43279)
I20260709 12:15:05.581238 26284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f64f6460364936b54245159e7025b6" candidate_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "47ec5c2bfdd24b1eb2a906f63214876e"
I20260709 12:15:05.581897 26359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f64f6460364936b54245159e7025b6" candidate_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "29ab82db4b2a4da39ed4796200c235bd"
I20260709 12:15:05.582636 26359 raft_consensus.cc:3055] T 51f64f6460364936b54245159e7025b6 P 29ab82db4b2a4da39ed4796200c235bd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:05.582960 26359 raft_consensus.cc:740] T 51f64f6460364936b54245159e7025b6 P 29ab82db4b2a4da39ed4796200c235bd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 29ab82db4b2a4da39ed4796200c235bd, State: Running, Role: LEADER
I20260709 12:15:05.583940 26359 consensus_queue.cc:260] T 51f64f6460364936b54245159e7025b6 P 29ab82db4b2a4da39ed4796200c235bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:05.581962 26284 raft_consensus.cc:3060] T 51f64f6460364936b54245159e7025b6 P 47ec5c2bfdd24b1eb2a906f63214876e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:05.586513 26283 raft_consensus.cc:2468] T 04079c0c50104d67a18aaeb329e1e434 P 47ec5c2bfdd24b1eb2a906f63214876e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29ab82db4b2a4da39ed4796200c235bd in term 2.
I20260709 12:15:05.591617 26285 raft_consensus.cc:515] T 61c63f2d508d492dab277021e7a3de0f P 47ec5c2bfdd24b1eb2a906f63214876e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:05.585508 26359 raft_consensus.cc:3060] T 51f64f6460364936b54245159e7025b6 P 29ab82db4b2a4da39ed4796200c235bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:05.595635 26210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61c63f2d508d492dab277021e7a3de0f" candidate_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b6ea3e3c1dd142c2a529707d9999b96d"
I20260709 12:15:05.598054 26285 leader_election.cc:290] T 61c63f2d508d492dab277021e7a3de0f P 47ec5c2bfdd24b1eb2a906f63214876e [CANDIDATE]: Term 2 election: Requested vote from peers b6ea3e3c1dd142c2a529707d9999b96d (127.12.174.129:34845), 29ab82db4b2a4da39ed4796200c235bd (127.12.174.131:43279)
I20260709 12:15:05.598424 26357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61c63f2d508d492dab277021e7a3de0f" candidate_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "29ab82db4b2a4da39ed4796200c235bd"
I20260709 12:15:05.599216 26357 raft_consensus.cc:3055] T 61c63f2d508d492dab277021e7a3de0f P 29ab82db4b2a4da39ed4796200c235bd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:05.599555 26357 raft_consensus.cc:740] T 61c63f2d508d492dab277021e7a3de0f P 29ab82db4b2a4da39ed4796200c235bd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 29ab82db4b2a4da39ed4796200c235bd, State: Running, Role: LEADER
I20260709 12:15:05.600411 26357 consensus_queue.cc:260] T 61c63f2d508d492dab277021e7a3de0f P 29ab82db4b2a4da39ed4796200c235bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:05.601855 26357 raft_consensus.cc:3060] T 61c63f2d508d492dab277021e7a3de0f P 29ab82db4b2a4da39ed4796200c235bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:05.607072 26284 raft_consensus.cc:2468] T 51f64f6460364936b54245159e7025b6 P 47ec5c2bfdd24b1eb2a906f63214876e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6ea3e3c1dd142c2a529707d9999b96d in term 2.
I20260709 12:15:05.608578 26173 leader_election.cc:304] T 51f64f6460364936b54245159e7025b6 P b6ea3e3c1dd142c2a529707d9999b96d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47ec5c2bfdd24b1eb2a906f63214876e, b6ea3e3c1dd142c2a529707d9999b96d; no voters: 
I20260709 12:15:05.609520 26403 raft_consensus.cc:2804] T 51f64f6460364936b54245159e7025b6 P b6ea3e3c1dd142c2a529707d9999b96d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:05.610071 26403 raft_consensus.cc:697] T 51f64f6460364936b54245159e7025b6 P b6ea3e3c1dd142c2a529707d9999b96d [term 2 LEADER]: Becoming Leader. State: Replica: b6ea3e3c1dd142c2a529707d9999b96d, State: Running, Role: LEADER
I20260709 12:15:05.610960 26403 consensus_queue.cc:237] T 51f64f6460364936b54245159e7025b6 P b6ea3e3c1dd142c2a529707d9999b96d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:05.610693 26107 catalog_manager.cc:5697] T 2be4e2f97d1941a4a3fe4f0dc03bdc57 P b6ea3e3c1dd142c2a529707d9999b96d reported cstate change: term changed from 1 to 2, leader changed from 47ec5c2bfdd24b1eb2a906f63214876e (127.12.174.130) to b6ea3e3c1dd142c2a529707d9999b96d (127.12.174.129). New cstate: current_term: 2 leader_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:05.615023 26357 raft_consensus.cc:2468] T 61c63f2d508d492dab277021e7a3de0f P 29ab82db4b2a4da39ed4796200c235bd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47ec5c2bfdd24b1eb2a906f63214876e in term 2.
I20260709 12:15:05.616369 26249 leader_election.cc:304] T 61c63f2d508d492dab277021e7a3de0f P 47ec5c2bfdd24b1eb2a906f63214876e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29ab82db4b2a4da39ed4796200c235bd, 47ec5c2bfdd24b1eb2a906f63214876e; no voters: b6ea3e3c1dd142c2a529707d9999b96d
I20260709 12:15:05.617005 26359 raft_consensus.cc:2468] T 51f64f6460364936b54245159e7025b6 P 29ab82db4b2a4da39ed4796200c235bd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6ea3e3c1dd142c2a529707d9999b96d in term 2.
I20260709 12:15:05.617655 26476 raft_consensus.cc:2804] T 61c63f2d508d492dab277021e7a3de0f P 47ec5c2bfdd24b1eb2a906f63214876e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:05.618202 26476 raft_consensus.cc:697] T 61c63f2d508d492dab277021e7a3de0f P 47ec5c2bfdd24b1eb2a906f63214876e [term 2 LEADER]: Becoming Leader. State: Replica: 47ec5c2bfdd24b1eb2a906f63214876e, State: Running, Role: LEADER
I20260709 12:15:05.619020 26476 consensus_queue.cc:237] T 61c63f2d508d492dab277021e7a3de0f P 47ec5c2bfdd24b1eb2a906f63214876e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:05.627117 26107 catalog_manager.cc:5697] T 61c63f2d508d492dab277021e7a3de0f P 47ec5c2bfdd24b1eb2a906f63214876e reported cstate change: term changed from 1 to 2, leader changed from 29ab82db4b2a4da39ed4796200c235bd (127.12.174.131) to 47ec5c2bfdd24b1eb2a906f63214876e (127.12.174.130). New cstate: current_term: 2 leader_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:05.635692 26106 catalog_manager.cc:5697] T 51f64f6460364936b54245159e7025b6 P b6ea3e3c1dd142c2a529707d9999b96d reported cstate change: term changed from 1 to 2, leader changed from 29ab82db4b2a4da39ed4796200c235bd (127.12.174.131) to b6ea3e3c1dd142c2a529707d9999b96d (127.12.174.129). New cstate: current_term: 2 leader_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:05.801905 26209 raft_consensus.cc:1275] T 29fd96c2a5d34cbfbc04b6878fc1a9ae P b6ea3e3c1dd142c2a529707d9999b96d [term 2 FOLLOWER]: Refusing update from remote peer 47ec5c2bfdd24b1eb2a906f63214876e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:05.803324 26476 consensus_queue.cc:1048] T 29fd96c2a5d34cbfbc04b6878fc1a9ae P 47ec5c2bfdd24b1eb2a906f63214876e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:05.814082 26357 raft_consensus.cc:1275] T 29fd96c2a5d34cbfbc04b6878fc1a9ae P 29ab82db4b2a4da39ed4796200c235bd [term 2 FOLLOWER]: Refusing update from remote peer 47ec5c2bfdd24b1eb2a906f63214876e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:05.815959 26478 consensus_queue.cc:1048] T 29fd96c2a5d34cbfbc04b6878fc1a9ae P 47ec5c2bfdd24b1eb2a906f63214876e [LEADER]: Connected to new peer: Peer: permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:05.886586 26209 raft_consensus.cc:1275] T 8e274509d4a64b129aa342b697004bf1 P b6ea3e3c1dd142c2a529707d9999b96d [term 2 FOLLOWER]: Refusing update from remote peer 47ec5c2bfdd24b1eb2a906f63214876e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:05.887969 26443 consensus_queue.cc:1048] T 8e274509d4a64b129aa342b697004bf1 P 47ec5c2bfdd24b1eb2a906f63214876e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:05.897275 26357 raft_consensus.cc:1275] T 8e274509d4a64b129aa342b697004bf1 P 29ab82db4b2a4da39ed4796200c235bd [term 2 FOLLOWER]: Refusing update from remote peer 47ec5c2bfdd24b1eb2a906f63214876e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:05.899744 26476 consensus_queue.cc:1048] T 8e274509d4a64b129aa342b697004bf1 P 47ec5c2bfdd24b1eb2a906f63214876e [LEADER]: Connected to new peer: Peer: permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:05.982170 26357 raft_consensus.cc:1275] T 2be4e2f97d1941a4a3fe4f0dc03bdc57 P 29ab82db4b2a4da39ed4796200c235bd [term 2 FOLLOWER]: Refusing update from remote peer b6ea3e3c1dd142c2a529707d9999b96d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:05.983656 26403 consensus_queue.cc:1048] T 2be4e2f97d1941a4a3fe4f0dc03bdc57 P b6ea3e3c1dd142c2a529707d9999b96d [LEADER]: Connected to new peer: Peer: permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:05.992936 26284 raft_consensus.cc:1275] T 2be4e2f97d1941a4a3fe4f0dc03bdc57 P 47ec5c2bfdd24b1eb2a906f63214876e [term 2 FOLLOWER]: Refusing update from remote peer b6ea3e3c1dd142c2a529707d9999b96d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:05.993019 26209 raft_consensus.cc:1275] T 04079c0c50104d67a18aaeb329e1e434 P b6ea3e3c1dd142c2a529707d9999b96d [term 2 FOLLOWER]: Refusing update from remote peer 29ab82db4b2a4da39ed4796200c235bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:05.995384 26431 consensus_queue.cc:1048] T 04079c0c50104d67a18aaeb329e1e434 P 29ab82db4b2a4da39ed4796200c235bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:05.997843 26430 consensus_queue.cc:1048] T 2be4e2f97d1941a4a3fe4f0dc03bdc57 P b6ea3e3c1dd142c2a529707d9999b96d [LEADER]: Connected to new peer: Peer: permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:06.011040 26284 raft_consensus.cc:1275] T 04079c0c50104d67a18aaeb329e1e434 P 47ec5c2bfdd24b1eb2a906f63214876e [term 2 FOLLOWER]: Refusing update from remote peer 29ab82db4b2a4da39ed4796200c235bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:06.013083 26431 consensus_queue.cc:1048] T 04079c0c50104d67a18aaeb329e1e434 P 29ab82db4b2a4da39ed4796200c235bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:06.055112 26210 raft_consensus.cc:3060] T 61c63f2d508d492dab277021e7a3de0f P b6ea3e3c1dd142c2a529707d9999b96d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:06.062067 26210 raft_consensus.cc:1275] T 61c63f2d508d492dab277021e7a3de0f P b6ea3e3c1dd142c2a529707d9999b96d [term 2 FOLLOWER]: Refusing update from remote peer 47ec5c2bfdd24b1eb2a906f63214876e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:06.063475 26478 consensus_queue.cc:1048] T 61c63f2d508d492dab277021e7a3de0f P 47ec5c2bfdd24b1eb2a906f63214876e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:06.072389 26357 raft_consensus.cc:1275] T 61c63f2d508d492dab277021e7a3de0f P 29ab82db4b2a4da39ed4796200c235bd [term 2 FOLLOWER]: Refusing update from remote peer 47ec5c2bfdd24b1eb2a906f63214876e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:06.074453 26443 consensus_queue.cc:1048] T 61c63f2d508d492dab277021e7a3de0f P 47ec5c2bfdd24b1eb2a906f63214876e [LEADER]: Connected to new peer: Peer: permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:06.081461 26359 raft_consensus.cc:1275] T 51f64f6460364936b54245159e7025b6 P 29ab82db4b2a4da39ed4796200c235bd [term 2 FOLLOWER]: Refusing update from remote peer b6ea3e3c1dd142c2a529707d9999b96d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:06.083333 26430 consensus_queue.cc:1048] T 51f64f6460364936b54245159e7025b6 P b6ea3e3c1dd142c2a529707d9999b96d [LEADER]: Connected to new peer: Peer: permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:06.091766 26285 raft_consensus.cc:1275] T 51f64f6460364936b54245159e7025b6 P 47ec5c2bfdd24b1eb2a906f63214876e [term 2 FOLLOWER]: Refusing update from remote peer b6ea3e3c1dd142c2a529707d9999b96d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:06.093292 26403 consensus_queue.cc:1048] T 51f64f6460364936b54245159e7025b6 P b6ea3e3c1dd142c2a529707d9999b96d [LEADER]: Connected to new peer: Peer: permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:08.261209 26108 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:54496:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:15:08.263613 26108 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:15:08.326161 26199 tablet_service.cc:1511] Processing CreateTablet for tablet e904f17eeb0846d3a6cefab2b07e3b4a (DEFAULT_TABLE table=soft_deleted_table [id=2c3874a85a02421f84a5445eba658efb]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:15:08.327673 26199 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e904f17eeb0846d3a6cefab2b07e3b4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:08.327636 26271 tablet_service.cc:1511] Processing CreateTablet for tablet e904f17eeb0846d3a6cefab2b07e3b4a (DEFAULT_TABLE table=soft_deleted_table [id=2c3874a85a02421f84a5445eba658efb]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:15:08.329375 26271 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e904f17eeb0846d3a6cefab2b07e3b4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:08.332517 26344 tablet_service.cc:1511] Processing CreateTablet for tablet e904f17eeb0846d3a6cefab2b07e3b4a (DEFAULT_TABLE table=soft_deleted_table [id=2c3874a85a02421f84a5445eba658efb]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:15:08.334044 26200 tablet_service.cc:1511] Processing CreateTablet for tablet f31c0326c2bb48958872433822c1aa7c (DEFAULT_TABLE table=soft_deleted_table [id=2c3874a85a02421f84a5445eba658efb]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:15:08.335736 26200 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f31c0326c2bb48958872433822c1aa7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:08.336221 26270 tablet_service.cc:1511] Processing CreateTablet for tablet f31c0326c2bb48958872433822c1aa7c (DEFAULT_TABLE table=soft_deleted_table [id=2c3874a85a02421f84a5445eba658efb]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:15:08.337869 26270 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f31c0326c2bb48958872433822c1aa7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:08.338243 26341 tablet_service.cc:1511] Processing CreateTablet for tablet f31c0326c2bb48958872433822c1aa7c (DEFAULT_TABLE table=soft_deleted_table [id=2c3874a85a02421f84a5445eba658efb]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:15:08.334120 26344 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e904f17eeb0846d3a6cefab2b07e3b4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:08.343115 26198 tablet_service.cc:1511] Processing CreateTablet for tablet ed22621a01e740fdb61fe0db7e9c77c6 (DEFAULT_TABLE table=soft_deleted_table [id=2c3874a85a02421f84a5445eba658efb]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:15:08.344645 26198 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed22621a01e740fdb61fe0db7e9c77c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:08.346797 26272 tablet_service.cc:1511] Processing CreateTablet for tablet ed22621a01e740fdb61fe0db7e9c77c6 (DEFAULT_TABLE table=soft_deleted_table [id=2c3874a85a02421f84a5445eba658efb]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:15:08.348395 26272 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed22621a01e740fdb61fe0db7e9c77c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:08.349299 26268 tablet_service.cc:1511] Processing CreateTablet for tablet d80bd7c3354c472eaaaf49cdd958e470 (DEFAULT_TABLE table=soft_deleted_table [id=2c3874a85a02421f84a5445eba658efb]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:15:08.350787 26268 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d80bd7c3354c472eaaaf49cdd958e470. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:08.353407 26349 tablet_service.cc:1511] Processing CreateTablet for tablet ed22621a01e740fdb61fe0db7e9c77c6 (DEFAULT_TABLE table=soft_deleted_table [id=2c3874a85a02421f84a5445eba658efb]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:15:08.355192 26349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed22621a01e740fdb61fe0db7e9c77c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:08.362950 26196 tablet_service.cc:1511] Processing CreateTablet for tablet d80bd7c3354c472eaaaf49cdd958e470 (DEFAULT_TABLE table=soft_deleted_table [id=2c3874a85a02421f84a5445eba658efb]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:15:08.367348 26341 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f31c0326c2bb48958872433822c1aa7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:08.370946 26346 tablet_service.cc:1511] Processing CreateTablet for tablet d80bd7c3354c472eaaaf49cdd958e470 (DEFAULT_TABLE table=soft_deleted_table [id=2c3874a85a02421f84a5445eba658efb]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:15:08.372517 26346 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d80bd7c3354c472eaaaf49cdd958e470. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:08.373143 26196 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d80bd7c3354c472eaaaf49cdd958e470. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:08.374257 26197 tablet_service.cc:1511] Processing CreateTablet for tablet ef313d7b9e734aae93e2ed571944bbaa (DEFAULT_TABLE table=soft_deleted_table [id=2c3874a85a02421f84a5445eba658efb]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:15:08.375730 26197 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef313d7b9e734aae93e2ed571944bbaa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:08.398437 26270 tablet_service.cc:1511] Processing CreateTablet for tablet ef313d7b9e734aae93e2ed571944bbaa (DEFAULT_TABLE table=soft_deleted_table [id=2c3874a85a02421f84a5445eba658efb]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:15:08.400257 26270 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef313d7b9e734aae93e2ed571944bbaa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:08.419167 26347 tablet_service.cc:1511] Processing CreateTablet for tablet ef313d7b9e734aae93e2ed571944bbaa (DEFAULT_TABLE table=soft_deleted_table [id=2c3874a85a02421f84a5445eba658efb]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:15:08.423358 26347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef313d7b9e734aae93e2ed571944bbaa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:08.434015 26497 tablet_bootstrap.cc:492] T e904f17eeb0846d3a6cefab2b07e3b4a P 47ec5c2bfdd24b1eb2a906f63214876e: Bootstrap starting.
I20260709 12:15:08.449494 26497 tablet_bootstrap.cc:654] T e904f17eeb0846d3a6cefab2b07e3b4a P 47ec5c2bfdd24b1eb2a906f63214876e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:08.450959 26271 tablet_service.cc:1511] Processing CreateTablet for tablet e18e3ddc9621480a960d88fb92a478c8 (DEFAULT_TABLE table=soft_deleted_table [id=2c3874a85a02421f84a5445eba658efb]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:15:08.453197 26271 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e18e3ddc9621480a960d88fb92a478c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:08.453986 26199 tablet_service.cc:1511] Processing CreateTablet for tablet e18e3ddc9621480a960d88fb92a478c8 (DEFAULT_TABLE table=soft_deleted_table [id=2c3874a85a02421f84a5445eba658efb]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:15:08.455483 26199 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e18e3ddc9621480a960d88fb92a478c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:08.462522 26498 tablet_bootstrap.cc:492] T e904f17eeb0846d3a6cefab2b07e3b4a P 29ab82db4b2a4da39ed4796200c235bd: Bootstrap starting.
I20260709 12:15:08.469892 26498 tablet_bootstrap.cc:654] T e904f17eeb0846d3a6cefab2b07e3b4a P 29ab82db4b2a4da39ed4796200c235bd: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:08.471984 26344 tablet_service.cc:1511] Processing CreateTablet for tablet e18e3ddc9621480a960d88fb92a478c8 (DEFAULT_TABLE table=soft_deleted_table [id=2c3874a85a02421f84a5445eba658efb]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:15:08.473272 26197 tablet_service.cc:1511] Processing CreateTablet for tablet e5a4343a89b74e2394864cfa1b2a45ab (DEFAULT_TABLE table=soft_deleted_table [id=2c3874a85a02421f84a5445eba658efb]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:15:08.474674 26197 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5a4343a89b74e2394864cfa1b2a45ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:08.475718 26270 tablet_service.cc:1511] Processing CreateTablet for tablet e5a4343a89b74e2394864cfa1b2a45ab (DEFAULT_TABLE table=soft_deleted_table [id=2c3874a85a02421f84a5445eba658efb]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:15:08.477135 26270 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5a4343a89b74e2394864cfa1b2a45ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:08.474677 26344 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e18e3ddc9621480a960d88fb92a478c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:08.492026 26341 tablet_service.cc:1511] Processing CreateTablet for tablet e5a4343a89b74e2394864cfa1b2a45ab (DEFAULT_TABLE table=soft_deleted_table [id=2c3874a85a02421f84a5445eba658efb]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:15:08.493692 26341 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5a4343a89b74e2394864cfa1b2a45ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:08.499173 26200 tablet_service.cc:1511] Processing CreateTablet for tablet 3be8e2e412f8465b83495d611f4b7ce2 (DEFAULT_TABLE table=soft_deleted_table [id=2c3874a85a02421f84a5445eba658efb]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:15:08.489413 26499 tablet_bootstrap.cc:492] T f31c0326c2bb48958872433822c1aa7c P b6ea3e3c1dd142c2a529707d9999b96d: Bootstrap starting.
I20260709 12:15:08.503075 26200 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3be8e2e412f8465b83495d611f4b7ce2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:08.510423 26499 tablet_bootstrap.cc:654] T f31c0326c2bb48958872433822c1aa7c P b6ea3e3c1dd142c2a529707d9999b96d: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:08.516141 26497 tablet_bootstrap.cc:492] T e904f17eeb0846d3a6cefab2b07e3b4a P 47ec5c2bfdd24b1eb2a906f63214876e: No bootstrap required, opened a new log
I20260709 12:15:08.516793 26497 ts_tablet_manager.cc:1403] T e904f17eeb0846d3a6cefab2b07e3b4a P 47ec5c2bfdd24b1eb2a906f63214876e: Time spent bootstrapping tablet: real 0.083s	user 0.008s	sys 0.003s
I20260709 12:15:08.519963 26497 raft_consensus.cc:359] T e904f17eeb0846d3a6cefab2b07e3b4a P 47ec5c2bfdd24b1eb2a906f63214876e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:08.520766 26497 raft_consensus.cc:385] T e904f17eeb0846d3a6cefab2b07e3b4a P 47ec5c2bfdd24b1eb2a906f63214876e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:08.521076 26497 raft_consensus.cc:740] T e904f17eeb0846d3a6cefab2b07e3b4a P 47ec5c2bfdd24b1eb2a906f63214876e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47ec5c2bfdd24b1eb2a906f63214876e, State: Initialized, Role: FOLLOWER
I20260709 12:15:08.521756 26268 tablet_service.cc:1511] Processing CreateTablet for tablet 3be8e2e412f8465b83495d611f4b7ce2 (DEFAULT_TABLE table=soft_deleted_table [id=2c3874a85a02421f84a5445eba658efb]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:15:08.523656 26268 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3be8e2e412f8465b83495d611f4b7ce2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:08.528555 26346 tablet_service.cc:1511] Processing CreateTablet for tablet 3be8e2e412f8465b83495d611f4b7ce2 (DEFAULT_TABLE table=soft_deleted_table [id=2c3874a85a02421f84a5445eba658efb]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:15:08.530185 26346 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3be8e2e412f8465b83495d611f4b7ce2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:08.541342 26499 tablet_bootstrap.cc:492] T f31c0326c2bb48958872433822c1aa7c P b6ea3e3c1dd142c2a529707d9999b96d: No bootstrap required, opened a new log
I20260709 12:15:08.542225 26499 ts_tablet_manager.cc:1403] T f31c0326c2bb48958872433822c1aa7c P b6ea3e3c1dd142c2a529707d9999b96d: Time spent bootstrapping tablet: real 0.053s	user 0.012s	sys 0.003s
I20260709 12:15:08.547276 26499 raft_consensus.cc:359] T f31c0326c2bb48958872433822c1aa7c P b6ea3e3c1dd142c2a529707d9999b96d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:08.548249 26499 raft_consensus.cc:385] T f31c0326c2bb48958872433822c1aa7c P b6ea3e3c1dd142c2a529707d9999b96d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:08.548583 26499 raft_consensus.cc:740] T f31c0326c2bb48958872433822c1aa7c P b6ea3e3c1dd142c2a529707d9999b96d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6ea3e3c1dd142c2a529707d9999b96d, State: Initialized, Role: FOLLOWER
I20260709 12:15:08.549237 26271 tablet_service.cc:1511] Processing CreateTablet for tablet 739b1449642e40fb84a22a155ce21e59 (DEFAULT_TABLE table=soft_deleted_table [id=2c3874a85a02421f84a5445eba658efb]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:15:08.550149 26198 tablet_service.cc:1511] Processing CreateTablet for tablet 739b1449642e40fb84a22a155ce21e59 (DEFAULT_TABLE table=soft_deleted_table [id=2c3874a85a02421f84a5445eba658efb]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:15:08.549448 26499 consensus_queue.cc:260] T f31c0326c2bb48958872433822c1aa7c P b6ea3e3c1dd142c2a529707d9999b96d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:08.525921 26497 consensus_queue.cc:260] T e904f17eeb0846d3a6cefab2b07e3b4a P 47ec5c2bfdd24b1eb2a906f63214876e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:08.561251 26499 ts_tablet_manager.cc:1434] T f31c0326c2bb48958872433822c1aa7c P b6ea3e3c1dd142c2a529707d9999b96d: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 12:15:08.566138 26498 tablet_bootstrap.cc:492] T e904f17eeb0846d3a6cefab2b07e3b4a P 29ab82db4b2a4da39ed4796200c235bd: No bootstrap required, opened a new log
I20260709 12:15:08.566807 26498 ts_tablet_manager.cc:1403] T e904f17eeb0846d3a6cefab2b07e3b4a P 29ab82db4b2a4da39ed4796200c235bd: Time spent bootstrapping tablet: real 0.105s	user 0.016s	sys 0.015s
I20260709 12:15:08.570191 26498 raft_consensus.cc:359] T e904f17eeb0846d3a6cefab2b07e3b4a P 29ab82db4b2a4da39ed4796200c235bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:08.570981 26498 raft_consensus.cc:385] T e904f17eeb0846d3a6cefab2b07e3b4a P 29ab82db4b2a4da39ed4796200c235bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:08.571280 26498 raft_consensus.cc:740] T e904f17eeb0846d3a6cefab2b07e3b4a P 29ab82db4b2a4da39ed4796200c235bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29ab82db4b2a4da39ed4796200c235bd, State: Initialized, Role: FOLLOWER
I20260709 12:15:08.572026 26498 consensus_queue.cc:260] T e904f17eeb0846d3a6cefab2b07e3b4a P 29ab82db4b2a4da39ed4796200c235bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:08.576864 26271 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 739b1449642e40fb84a22a155ce21e59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:08.578706 26430 raft_consensus.cc:493] T f31c0326c2bb48958872433822c1aa7c P b6ea3e3c1dd142c2a529707d9999b96d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:08.579342 26430 raft_consensus.cc:515] T f31c0326c2bb48958872433822c1aa7c P b6ea3e3c1dd142c2a529707d9999b96d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:08.580724 26498 ts_tablet_manager.cc:1434] T e904f17eeb0846d3a6cefab2b07e3b4a P 29ab82db4b2a4da39ed4796200c235bd: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 12:15:08.581491 26198 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 739b1449642e40fb84a22a155ce21e59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:08.582000 26498 tablet_bootstrap.cc:492] T f31c0326c2bb48958872433822c1aa7c P 29ab82db4b2a4da39ed4796200c235bd: Bootstrap starting.
I20260709 12:15:08.585467 26359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31c0326c2bb48958872433822c1aa7c" candidate_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29ab82db4b2a4da39ed4796200c235bd" is_pre_election: true
I20260709 12:15:08.587146 26285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31c0326c2bb48958872433822c1aa7c" candidate_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" is_pre_election: true
W20260709 12:15:08.589074 26173 leader_election.cc:343] T f31c0326c2bb48958872433822c1aa7c P b6ea3e3c1dd142c2a529707d9999b96d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 47ec5c2bfdd24b1eb2a906f63214876e (127.12.174.130:43337): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:08.589272 26498 tablet_bootstrap.cc:654] T f31c0326c2bb48958872433822c1aa7c P 29ab82db4b2a4da39ed4796200c235bd: Neither blocks nor log segments found. Creating new log.
W20260709 12:15:08.590348 26174 leader_election.cc:343] T f31c0326c2bb48958872433822c1aa7c P b6ea3e3c1dd142c2a529707d9999b96d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 29ab82db4b2a4da39ed4796200c235bd (127.12.174.131:43279): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:08.590821 26174 leader_election.cc:304] T f31c0326c2bb48958872433822c1aa7c P b6ea3e3c1dd142c2a529707d9999b96d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6ea3e3c1dd142c2a529707d9999b96d; no voters: 29ab82db4b2a4da39ed4796200c235bd, 47ec5c2bfdd24b1eb2a906f63214876e
I20260709 12:15:08.592075 26430 leader_election.cc:290] T f31c0326c2bb48958872433822c1aa7c P b6ea3e3c1dd142c2a529707d9999b96d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 47ec5c2bfdd24b1eb2a906f63214876e (127.12.174.130:43337), 29ab82db4b2a4da39ed4796200c235bd (127.12.174.131:43279)
I20260709 12:15:08.592653 26430 raft_consensus.cc:2749] T f31c0326c2bb48958872433822c1aa7c P b6ea3e3c1dd142c2a529707d9999b96d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:08.598500 26349 tablet_service.cc:1511] Processing CreateTablet for tablet 739b1449642e40fb84a22a155ce21e59 (DEFAULT_TABLE table=soft_deleted_table [id=2c3874a85a02421f84a5445eba658efb]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:15:08.601627 26498 tablet_bootstrap.cc:492] T f31c0326c2bb48958872433822c1aa7c P 29ab82db4b2a4da39ed4796200c235bd: No bootstrap required, opened a new log
W20260709 12:15:08.603336 26156 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:15:08.605468 26498 ts_tablet_manager.cc:1403] T f31c0326c2bb48958872433822c1aa7c P 29ab82db4b2a4da39ed4796200c235bd: Time spent bootstrapping tablet: real 0.024s	user 0.012s	sys 0.007s
I20260709 12:15:08.604913 26349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 739b1449642e40fb84a22a155ce21e59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:08.603617 26497 ts_tablet_manager.cc:1434] T e904f17eeb0846d3a6cefab2b07e3b4a P 47ec5c2bfdd24b1eb2a906f63214876e: Time spent starting tablet: real 0.086s	user 0.007s	sys 0.005s
I20260709 12:15:08.609117 26497 tablet_bootstrap.cc:492] T f31c0326c2bb48958872433822c1aa7c P 47ec5c2bfdd24b1eb2a906f63214876e: Bootstrap starting.
I20260709 12:15:08.609010 26498 raft_consensus.cc:359] T f31c0326c2bb48958872433822c1aa7c P 29ab82db4b2a4da39ed4796200c235bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:08.609915 26498 raft_consensus.cc:385] T f31c0326c2bb48958872433822c1aa7c P 29ab82db4b2a4da39ed4796200c235bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:08.610252 26498 raft_consensus.cc:740] T f31c0326c2bb48958872433822c1aa7c P 29ab82db4b2a4da39ed4796200c235bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29ab82db4b2a4da39ed4796200c235bd, State: Initialized, Role: FOLLOWER
I20260709 12:15:08.611142 26498 consensus_queue.cc:260] T f31c0326c2bb48958872433822c1aa7c P 29ab82db4b2a4da39ed4796200c235bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:08.613855 26498 ts_tablet_manager.cc:1434] T f31c0326c2bb48958872433822c1aa7c P 29ab82db4b2a4da39ed4796200c235bd: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:15:08.615028 26498 tablet_bootstrap.cc:492] T d80bd7c3354c472eaaaf49cdd958e470 P 29ab82db4b2a4da39ed4796200c235bd: Bootstrap starting.
I20260709 12:15:08.622255 26498 tablet_bootstrap.cc:654] T d80bd7c3354c472eaaaf49cdd958e470 P 29ab82db4b2a4da39ed4796200c235bd: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:08.625068 26497 tablet_bootstrap.cc:654] T f31c0326c2bb48958872433822c1aa7c P 47ec5c2bfdd24b1eb2a906f63214876e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:08.633483 26499 tablet_bootstrap.cc:492] T ef313d7b9e734aae93e2ed571944bbaa P b6ea3e3c1dd142c2a529707d9999b96d: Bootstrap starting.
I20260709 12:15:08.641031 26499 tablet_bootstrap.cc:654] T ef313d7b9e734aae93e2ed571944bbaa P b6ea3e3c1dd142c2a529707d9999b96d: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:08.648449 26497 tablet_bootstrap.cc:492] T f31c0326c2bb48958872433822c1aa7c P 47ec5c2bfdd24b1eb2a906f63214876e: No bootstrap required, opened a new log
I20260709 12:15:08.649072 26497 ts_tablet_manager.cc:1403] T f31c0326c2bb48958872433822c1aa7c P 47ec5c2bfdd24b1eb2a906f63214876e: Time spent bootstrapping tablet: real 0.040s	user 0.012s	sys 0.000s
I20260709 12:15:08.649879 26498 tablet_bootstrap.cc:492] T d80bd7c3354c472eaaaf49cdd958e470 P 29ab82db4b2a4da39ed4796200c235bd: No bootstrap required, opened a new log
I20260709 12:15:08.650549 26498 ts_tablet_manager.cc:1403] T d80bd7c3354c472eaaaf49cdd958e470 P 29ab82db4b2a4da39ed4796200c235bd: Time spent bootstrapping tablet: real 0.036s	user 0.027s	sys 0.008s
I20260709 12:15:08.652452 26497 raft_consensus.cc:359] T f31c0326c2bb48958872433822c1aa7c P 47ec5c2bfdd24b1eb2a906f63214876e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:08.653375 26497 raft_consensus.cc:385] T f31c0326c2bb48958872433822c1aa7c P 47ec5c2bfdd24b1eb2a906f63214876e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:08.653967 26498 raft_consensus.cc:359] T d80bd7c3354c472eaaaf49cdd958e470 P 29ab82db4b2a4da39ed4796200c235bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:08.654803 26498 raft_consensus.cc:385] T d80bd7c3354c472eaaaf49cdd958e470 P 29ab82db4b2a4da39ed4796200c235bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:08.655386 26498 raft_consensus.cc:740] T d80bd7c3354c472eaaaf49cdd958e470 P 29ab82db4b2a4da39ed4796200c235bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29ab82db4b2a4da39ed4796200c235bd, State: Initialized, Role: FOLLOWER
I20260709 12:15:08.656549 26498 consensus_queue.cc:260] T d80bd7c3354c472eaaaf49cdd958e470 P 29ab82db4b2a4da39ed4796200c235bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:08.659211 26498 ts_tablet_manager.cc:1434] T d80bd7c3354c472eaaaf49cdd958e470 P 29ab82db4b2a4da39ed4796200c235bd: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.003s
I20260709 12:15:08.653683 26497 raft_consensus.cc:740] T f31c0326c2bb48958872433822c1aa7c P 47ec5c2bfdd24b1eb2a906f63214876e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47ec5c2bfdd24b1eb2a906f63214876e, State: Initialized, Role: FOLLOWER
I20260709 12:15:08.660573 26498 tablet_bootstrap.cc:492] T ed22621a01e740fdb61fe0db7e9c77c6 P 29ab82db4b2a4da39ed4796200c235bd: Bootstrap starting.
I20260709 12:15:08.660480 26497 consensus_queue.cc:260] T f31c0326c2bb48958872433822c1aa7c P 47ec5c2bfdd24b1eb2a906f63214876e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:08.663898 26497 ts_tablet_manager.cc:1434] T f31c0326c2bb48958872433822c1aa7c P 47ec5c2bfdd24b1eb2a906f63214876e: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.003s
I20260709 12:15:08.665154 26497 tablet_bootstrap.cc:492] T ef313d7b9e734aae93e2ed571944bbaa P 47ec5c2bfdd24b1eb2a906f63214876e: Bootstrap starting.
I20260709 12:15:08.668630 26498 tablet_bootstrap.cc:654] T ed22621a01e740fdb61fe0db7e9c77c6 P 29ab82db4b2a4da39ed4796200c235bd: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:08.672650 26497 tablet_bootstrap.cc:654] T ef313d7b9e734aae93e2ed571944bbaa P 47ec5c2bfdd24b1eb2a906f63214876e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:08.697609 26499 tablet_bootstrap.cc:492] T ef313d7b9e734aae93e2ed571944bbaa P b6ea3e3c1dd142c2a529707d9999b96d: No bootstrap required, opened a new log
I20260709 12:15:08.698328 26499 ts_tablet_manager.cc:1403] T ef313d7b9e734aae93e2ed571944bbaa P b6ea3e3c1dd142c2a529707d9999b96d: Time spent bootstrapping tablet: real 0.065s	user 0.018s	sys 0.019s
I20260709 12:15:08.699208 26498 tablet_bootstrap.cc:492] T ed22621a01e740fdb61fe0db7e9c77c6 P 29ab82db4b2a4da39ed4796200c235bd: No bootstrap required, opened a new log
I20260709 12:15:08.699293 26497 tablet_bootstrap.cc:492] T ef313d7b9e734aae93e2ed571944bbaa P 47ec5c2bfdd24b1eb2a906f63214876e: No bootstrap required, opened a new log
I20260709 12:15:08.699975 26498 ts_tablet_manager.cc:1403] T ed22621a01e740fdb61fe0db7e9c77c6 P 29ab82db4b2a4da39ed4796200c235bd: Time spent bootstrapping tablet: real 0.040s	user 0.034s	sys 0.005s
I20260709 12:15:08.700006 26497 ts_tablet_manager.cc:1403] T ef313d7b9e734aae93e2ed571944bbaa P 47ec5c2bfdd24b1eb2a906f63214876e: Time spent bootstrapping tablet: real 0.035s	user 0.020s	sys 0.012s
I20260709 12:15:08.702246 26499 raft_consensus.cc:359] T ef313d7b9e734aae93e2ed571944bbaa P b6ea3e3c1dd142c2a529707d9999b96d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:08.703181 26499 raft_consensus.cc:385] T ef313d7b9e734aae93e2ed571944bbaa P b6ea3e3c1dd142c2a529707d9999b96d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:08.703070 26497 raft_consensus.cc:359] T ef313d7b9e734aae93e2ed571944bbaa P 47ec5c2bfdd24b1eb2a906f63214876e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:08.703801 26499 raft_consensus.cc:740] T ef313d7b9e734aae93e2ed571944bbaa P b6ea3e3c1dd142c2a529707d9999b96d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6ea3e3c1dd142c2a529707d9999b96d, State: Initialized, Role: FOLLOWER
I20260709 12:15:08.703553 26498 raft_consensus.cc:359] T ed22621a01e740fdb61fe0db7e9c77c6 P 29ab82db4b2a4da39ed4796200c235bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:08.704052 26497 raft_consensus.cc:385] T ef313d7b9e734aae93e2ed571944bbaa P 47ec5c2bfdd24b1eb2a906f63214876e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:08.704316 26498 raft_consensus.cc:385] T ed22621a01e740fdb61fe0db7e9c77c6 P 29ab82db4b2a4da39ed4796200c235bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:08.704473 26497 raft_consensus.cc:740] T ef313d7b9e734aae93e2ed571944bbaa P 47ec5c2bfdd24b1eb2a906f63214876e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47ec5c2bfdd24b1eb2a906f63214876e, State: Initialized, Role: FOLLOWER
I20260709 12:15:08.704708 26498 raft_consensus.cc:740] T ed22621a01e740fdb61fe0db7e9c77c6 P 29ab82db4b2a4da39ed4796200c235bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29ab82db4b2a4da39ed4796200c235bd, State: Initialized, Role: FOLLOWER
I20260709 12:15:08.704711 26499 consensus_queue.cc:260] T ef313d7b9e734aae93e2ed571944bbaa P b6ea3e3c1dd142c2a529707d9999b96d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:08.705436 26497 consensus_queue.cc:260] T ef313d7b9e734aae93e2ed571944bbaa P 47ec5c2bfdd24b1eb2a906f63214876e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:08.705968 26498 consensus_queue.cc:260] T ed22621a01e740fdb61fe0db7e9c77c6 P 29ab82db4b2a4da39ed4796200c235bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:08.708678 26498 ts_tablet_manager.cc:1434] T ed22621a01e740fdb61fe0db7e9c77c6 P 29ab82db4b2a4da39ed4796200c235bd: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:15:08.708851 26497 ts_tablet_manager.cc:1434] T ef313d7b9e734aae93e2ed571944bbaa P 47ec5c2bfdd24b1eb2a906f63214876e: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:15:08.710075 26498 tablet_bootstrap.cc:492] T e18e3ddc9621480a960d88fb92a478c8 P 29ab82db4b2a4da39ed4796200c235bd: Bootstrap starting.
I20260709 12:15:08.711616 26499 ts_tablet_manager.cc:1434] T ef313d7b9e734aae93e2ed571944bbaa P b6ea3e3c1dd142c2a529707d9999b96d: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.000s
I20260709 12:15:08.712878 26499 tablet_bootstrap.cc:492] T e904f17eeb0846d3a6cefab2b07e3b4a P b6ea3e3c1dd142c2a529707d9999b96d: Bootstrap starting.
I20260709 12:15:08.717841 26498 tablet_bootstrap.cc:654] T e18e3ddc9621480a960d88fb92a478c8 P 29ab82db4b2a4da39ed4796200c235bd: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:08.710129 26497 tablet_bootstrap.cc:492] T ed22621a01e740fdb61fe0db7e9c77c6 P 47ec5c2bfdd24b1eb2a906f63214876e: Bootstrap starting.
I20260709 12:15:08.720333 26499 tablet_bootstrap.cc:654] T e904f17eeb0846d3a6cefab2b07e3b4a P b6ea3e3c1dd142c2a529707d9999b96d: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:08.725396 26497 tablet_bootstrap.cc:654] T ed22621a01e740fdb61fe0db7e9c77c6 P 47ec5c2bfdd24b1eb2a906f63214876e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:08.727118 26431 raft_consensus.cc:493] T f31c0326c2bb48958872433822c1aa7c P 29ab82db4b2a4da39ed4796200c235bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:08.727742 26431 raft_consensus.cc:515] T f31c0326c2bb48958872433822c1aa7c P 29ab82db4b2a4da39ed4796200c235bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:08.731191 26210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31c0326c2bb48958872433822c1aa7c" candidate_uuid: "29ab82db4b2a4da39ed4796200c235bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" is_pre_election: true
I20260709 12:15:08.732331 26210 raft_consensus.cc:2468] T f31c0326c2bb48958872433822c1aa7c P b6ea3e3c1dd142c2a529707d9999b96d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29ab82db4b2a4da39ed4796200c235bd in term 0.
I20260709 12:15:08.732632 26285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31c0326c2bb48958872433822c1aa7c" candidate_uuid: "29ab82db4b2a4da39ed4796200c235bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" is_pre_election: true
I20260709 12:15:08.733402 26285 raft_consensus.cc:2468] T f31c0326c2bb48958872433822c1aa7c P 47ec5c2bfdd24b1eb2a906f63214876e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29ab82db4b2a4da39ed4796200c235bd in term 0.
I20260709 12:15:08.734082 26325 leader_election.cc:304] T f31c0326c2bb48958872433822c1aa7c P 29ab82db4b2a4da39ed4796200c235bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29ab82db4b2a4da39ed4796200c235bd, b6ea3e3c1dd142c2a529707d9999b96d; no voters: 
I20260709 12:15:08.735186 26431 leader_election.cc:290] T f31c0326c2bb48958872433822c1aa7c P 29ab82db4b2a4da39ed4796200c235bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6ea3e3c1dd142c2a529707d9999b96d (127.12.174.129:34845), 47ec5c2bfdd24b1eb2a906f63214876e (127.12.174.130:43337)
I20260709 12:15:08.735775 26431 raft_consensus.cc:2804] T f31c0326c2bb48958872433822c1aa7c P 29ab82db4b2a4da39ed4796200c235bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:08.736147 26431 raft_consensus.cc:493] T f31c0326c2bb48958872433822c1aa7c P 29ab82db4b2a4da39ed4796200c235bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:08.736462 26431 raft_consensus.cc:3060] T f31c0326c2bb48958872433822c1aa7c P 29ab82db4b2a4da39ed4796200c235bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:08.764070 26504 raft_consensus.cc:493] T ef313d7b9e734aae93e2ed571944bbaa P b6ea3e3c1dd142c2a529707d9999b96d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:08.764917 26504 raft_consensus.cc:515] T ef313d7b9e734aae93e2ed571944bbaa P b6ea3e3c1dd142c2a529707d9999b96d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:08.769625 26285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef313d7b9e734aae93e2ed571944bbaa" candidate_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" is_pre_election: true
I20260709 12:15:08.770627 26285 raft_consensus.cc:2468] T ef313d7b9e734aae93e2ed571944bbaa P 47ec5c2bfdd24b1eb2a906f63214876e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6ea3e3c1dd142c2a529707d9999b96d in term 0.
I20260709 12:15:08.772514 26173 leader_election.cc:304] T ef313d7b9e734aae93e2ed571944bbaa P b6ea3e3c1dd142c2a529707d9999b96d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47ec5c2bfdd24b1eb2a906f63214876e, b6ea3e3c1dd142c2a529707d9999b96d; no voters: 
I20260709 12:15:08.773666 26430 raft_consensus.cc:2804] T ef313d7b9e734aae93e2ed571944bbaa P b6ea3e3c1dd142c2a529707d9999b96d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:08.774103 26430 raft_consensus.cc:493] T ef313d7b9e734aae93e2ed571944bbaa P b6ea3e3c1dd142c2a529707d9999b96d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:08.774432 26430 raft_consensus.cc:3060] T ef313d7b9e734aae93e2ed571944bbaa P b6ea3e3c1dd142c2a529707d9999b96d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:08.780452 26359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef313d7b9e734aae93e2ed571944bbaa" candidate_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29ab82db4b2a4da39ed4796200c235bd" is_pre_election: true
W20260709 12:15:08.782938 26174 leader_election.cc:343] T ef313d7b9e734aae93e2ed571944bbaa P b6ea3e3c1dd142c2a529707d9999b96d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 29ab82db4b2a4da39ed4796200c235bd (127.12.174.131:43279): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:08.783854 26504 leader_election.cc:290] T ef313d7b9e734aae93e2ed571944bbaa P b6ea3e3c1dd142c2a529707d9999b96d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 47ec5c2bfdd24b1eb2a906f63214876e (127.12.174.130:43337), 29ab82db4b2a4da39ed4796200c235bd (127.12.174.131:43279)
I20260709 12:15:08.798816 26430 raft_consensus.cc:515] T ef313d7b9e734aae93e2ed571944bbaa P b6ea3e3c1dd142c2a529707d9999b96d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:08.805056 26512 raft_consensus.cc:493] T e904f17eeb0846d3a6cefab2b07e3b4a P 29ab82db4b2a4da39ed4796200c235bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:08.805094 26325 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.129:34845, user_credentials={real_user=slave}} blocked reactor thread for 71159.8us
I20260709 12:15:08.809664 26431 raft_consensus.cc:515] T f31c0326c2bb48958872433822c1aa7c P 29ab82db4b2a4da39ed4796200c235bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:08.817935 26359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef313d7b9e734aae93e2ed571944bbaa" candidate_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29ab82db4b2a4da39ed4796200c235bd"
I20260709 12:15:08.812986 26285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef313d7b9e734aae93e2ed571944bbaa" candidate_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47ec5c2bfdd24b1eb2a906f63214876e"
I20260709 12:15:08.814373 26512 raft_consensus.cc:515] T e904f17eeb0846d3a6cefab2b07e3b4a P 29ab82db4b2a4da39ed4796200c235bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:08.818153 26498 tablet_bootstrap.cc:492] T e18e3ddc9621480a960d88fb92a478c8 P 29ab82db4b2a4da39ed4796200c235bd: No bootstrap required, opened a new log
W20260709 12:15:08.820888 26174 leader_election.cc:343] T ef313d7b9e734aae93e2ed571944bbaa P b6ea3e3c1dd142c2a529707d9999b96d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 29ab82db4b2a4da39ed4796200c235bd (127.12.174.131:43279): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:08.820952 26497 tablet_bootstrap.cc:492] T ed22621a01e740fdb61fe0db7e9c77c6 P 47ec5c2bfdd24b1eb2a906f63214876e: No bootstrap required, opened a new log
I20260709 12:15:08.822640 26497 ts_tablet_manager.cc:1403] T ed22621a01e740fdb61fe0db7e9c77c6 P 47ec5c2bfdd24b1eb2a906f63214876e: Time spent bootstrapping tablet: real 0.113s	user 0.022s	sys 0.025s
I20260709 12:15:08.821436 26285 raft_consensus.cc:3060] T ef313d7b9e734aae93e2ed571944bbaa P 47ec5c2bfdd24b1eb2a906f63214876e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:08.824431 26284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e904f17eeb0846d3a6cefab2b07e3b4a" candidate_uuid: "29ab82db4b2a4da39ed4796200c235bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" is_pre_election: true
I20260709 12:15:08.825240 26284 raft_consensus.cc:2468] T e904f17eeb0846d3a6cefab2b07e3b4a P 47ec5c2bfdd24b1eb2a906f63214876e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29ab82db4b2a4da39ed4796200c235bd in term 0.
I20260709 12:15:08.821950 26498 ts_tablet_manager.cc:1403] T e18e3ddc9621480a960d88fb92a478c8 P 29ab82db4b2a4da39ed4796200c235bd: Time spent bootstrapping tablet: real 0.112s	user 0.025s	sys 0.023s
I20260709 12:15:08.826747 26322 leader_election.cc:304] T e904f17eeb0846d3a6cefab2b07e3b4a P 29ab82db4b2a4da39ed4796200c235bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29ab82db4b2a4da39ed4796200c235bd, 47ec5c2bfdd24b1eb2a906f63214876e; no voters: 
I20260709 12:15:08.829557 26498 raft_consensus.cc:359] T e18e3ddc9621480a960d88fb92a478c8 P 29ab82db4b2a4da39ed4796200c235bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:08.830567 26498 raft_consensus.cc:385] T e18e3ddc9621480a960d88fb92a478c8 P 29ab82db4b2a4da39ed4796200c235bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:08.830916 26498 raft_consensus.cc:740] T e18e3ddc9621480a960d88fb92a478c8 P 29ab82db4b2a4da39ed4796200c235bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29ab82db4b2a4da39ed4796200c235bd, State: Initialized, Role: FOLLOWER
I20260709 12:15:08.831779 26512 leader_election.cc:290] T e904f17eeb0846d3a6cefab2b07e3b4a P 29ab82db4b2a4da39ed4796200c235bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6ea3e3c1dd142c2a529707d9999b96d (127.12.174.129:34845), 47ec5c2bfdd24b1eb2a906f63214876e (127.12.174.130:43337)
I20260709 12:15:08.832456 26210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31c0326c2bb48958872433822c1aa7c" candidate_uuid: "29ab82db4b2a4da39ed4796200c235bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6ea3e3c1dd142c2a529707d9999b96d"
I20260709 12:15:08.818089 26430 leader_election.cc:290] T ef313d7b9e734aae93e2ed571944bbaa P b6ea3e3c1dd142c2a529707d9999b96d [CANDIDATE]: Term 1 election: Requested vote from peers 47ec5c2bfdd24b1eb2a906f63214876e (127.12.174.130:43337), 29ab82db4b2a4da39ed4796200c235bd (127.12.174.131:43279)
I20260709 12:15:08.831933 26498 consensus_queue.cc:260] T e18e3ddc9621480a960d88fb92a478c8 P 29ab82db4b2a4da39ed4796200c235bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:08.833087 26497 raft_consensus.cc:359] T ed22621a01e740fdb61fe0db7e9c77c6 P 47ec5c2bfdd24b1eb2a906f63214876e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:08.833288 26210 raft_consensus.cc:3060] T f31c0326c2bb48958872433822c1aa7c P b6ea3e3c1dd142c2a529707d9999b96d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:08.834877 26497 raft_consensus.cc:385] T ed22621a01e740fdb61fe0db7e9c77c6 P 47ec5c2bfdd24b1eb2a906f63214876e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:08.832537 26512 raft_consensus.cc:2804] T e904f17eeb0846d3a6cefab2b07e3b4a P 29ab82db4b2a4da39ed4796200c235bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:08.835494 26497 raft_consensus.cc:740] T ed22621a01e740fdb61fe0db7e9c77c6 P 47ec5c2bfdd24b1eb2a906f63214876e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47ec5c2bfdd24b1eb2a906f63214876e, State: Initialized, Role: FOLLOWER
I20260709 12:15:08.835579 26512 raft_consensus.cc:493] T e904f17eeb0846d3a6cefab2b07e3b4a P 29ab82db4b2a4da39ed4796200c235bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:08.836421 26498 ts_tablet_manager.cc:1434] T e18e3ddc9621480a960d88fb92a478c8 P 29ab82db4b2a4da39ed4796200c235bd: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:15:08.836537 26497 consensus_queue.cc:260] T ed22621a01e740fdb61fe0db7e9c77c6 P 47ec5c2bfdd24b1eb2a906f63214876e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:08.837939 26498 tablet_bootstrap.cc:492] T ef313d7b9e734aae93e2ed571944bbaa P 29ab82db4b2a4da39ed4796200c235bd: Bootstrap starting.
I20260709 12:15:08.836115 26512 raft_consensus.cc:3060] T e904f17eeb0846d3a6cefab2b07e3b4a P 29ab82db4b2a4da39ed4796200c235bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:08.839735 26497 ts_tablet_manager.cc:1434] T ed22621a01e740fdb61fe0db7e9c77c6 P 47ec5c2bfdd24b1eb2a906f63214876e: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 12:15:08.841112 26497 tablet_bootstrap.cc:492] T d80bd7c3354c472eaaaf49cdd958e470 P 47ec5c2bfdd24b1eb2a906f63214876e: Bootstrap starting.
I20260709 12:15:08.849005 26431 leader_election.cc:290] T f31c0326c2bb48958872433822c1aa7c P 29ab82db4b2a4da39ed4796200c235bd [CANDIDATE]: Term 1 election: Requested vote from peers b6ea3e3c1dd142c2a529707d9999b96d (127.12.174.129:34845), 47ec5c2bfdd24b1eb2a906f63214876e (127.12.174.130:43337)
I20260709 12:15:08.860033 26498 tablet_bootstrap.cc:654] T ef313d7b9e734aae93e2ed571944bbaa P 29ab82db4b2a4da39ed4796200c235bd: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:08.866938 26499 tablet_bootstrap.cc:492] T e904f17eeb0846d3a6cefab2b07e3b4a P b6ea3e3c1dd142c2a529707d9999b96d: No bootstrap required, opened a new log
I20260709 12:15:08.867621 26499 ts_tablet_manager.cc:1403] T e904f17eeb0846d3a6cefab2b07e3b4a P b6ea3e3c1dd142c2a529707d9999b96d: Time spent bootstrapping tablet: real 0.155s	user 0.040s	sys 0.083s
I20260709 12:15:08.871160 26499 raft_consensus.cc:359] T e904f17eeb0846d3a6cefab2b07e3b4a P b6ea3e3c1dd142c2a529707d9999b96d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:08.871731 26497 tablet_bootstrap.cc:654] T d80bd7c3354c472eaaaf49cdd958e470 P 47ec5c2bfdd24b1eb2a906f63214876e: Neither blocks nor log segments found. Creating new log.
W20260709 12:15:08.872330 26322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.174.130:43337, user_credentials={real_user=slave}} blocked reactor thread for 45701.9us
I20260709 12:15:08.874331 26284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31c0326c2bb48958872433822c1aa7c" candidate_uuid: "29ab82db4b2a4da39ed4796200c235bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47ec5c2bfdd24b1eb2a906f63214876e"
I20260709 12:15:08.875005 26284 raft_consensus.cc:3060] T f31c0326c2bb48958872433822c1aa7c P 47ec5c2bfdd24b1eb2a906f63214876e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:08.879379 26498 tablet_bootstrap.cc:492] T ef313d7b9e734aae93e2ed571944bbaa P 29ab82db4b2a4da39ed4796200c235bd: No bootstrap required, opened a new log
I20260709 12:15:08.880154 26498 ts_tablet_manager.cc:1403] T ef313d7b9e734aae93e2ed571944bbaa P 29ab82db4b2a4da39ed4796200c235bd: Time spent bootstrapping tablet: real 0.043s	user 0.024s	sys 0.016s
I20260709 12:15:08.881279 26209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e904f17eeb0846d3a6cefab2b07e3b4a" candidate_uuid: "29ab82db4b2a4da39ed4796200c235bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" is_pre_election: true
I20260709 12:15:08.882560 26497 tablet_bootstrap.cc:492] T d80bd7c3354c472eaaaf49cdd958e470 P 47ec5c2bfdd24b1eb2a906f63214876e: No bootstrap required, opened a new log
I20260709 12:15:08.883212 26497 ts_tablet_manager.cc:1403] T d80bd7c3354c472eaaaf49cdd958e470 P 47ec5c2bfdd24b1eb2a906f63214876e: Time spent bootstrapping tablet: real 0.042s	user 0.021s	sys 0.008s
I20260709 12:15:08.883706 26498 raft_consensus.cc:359] T ef313d7b9e734aae93e2ed571944bbaa P 29ab82db4b2a4da39ed4796200c235bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:08.884577 26498 raft_consensus.cc:385] T ef313d7b9e734aae93e2ed571944bbaa P 29ab82db4b2a4da39ed4796200c235bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:08.884266 26515 raft_consensus.cc:493] T d80bd7c3354c472eaaaf49cdd958e470 P 29ab82db4b2a4da39ed4796200c235bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:08.884904 26498 raft_consensus.cc:740] T ef313d7b9e734aae93e2ed571944bbaa P 29ab82db4b2a4da39ed4796200c235bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29ab82db4b2a4da39ed4796200c235bd, State: Initialized, Role: FOLLOWER
I20260709 12:15:08.885795 26498 consensus_queue.cc:260] T ef313d7b9e734aae93e2ed571944bbaa P 29ab82db4b2a4da39ed4796200c235bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:08.886933 26497 raft_consensus.cc:359] T d80bd7c3354c472eaaaf49cdd958e470 P 47ec5c2bfdd24b1eb2a906f63214876e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:08.887725 26497 raft_consensus.cc:385] T d80bd7c3354c472eaaaf49cdd958e470 P 47ec5c2bfdd24b1eb2a906f63214876e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:08.885092 26515 raft_consensus.cc:515] T d80bd7c3354c472eaaaf49cdd958e470 P 29ab82db4b2a4da39ed4796200c235bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:08.888509 26498 ts_tablet_manager.cc:1434] T ef313d7b9e734aae93e2ed571944bbaa P 29ab82db4b2a4da39ed4796200c235bd: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.002s
I20260709 12:15:08.888023 26497 raft_consensus.cc:740] T d80bd7c3354c472eaaaf49cdd958e470 P 47ec5c2bfdd24b1eb2a906f63214876e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47ec5c2bfdd24b1eb2a906f63214876e, State: Initialized, Role: FOLLOWER
I20260709 12:15:08.889823 26498 tablet_bootstrap.cc:492] T e5a4343a89b74e2394864cfa1b2a45ab P 29ab82db4b2a4da39ed4796200c235bd: Bootstrap starting.
I20260709 12:15:08.889693 26497 consensus_queue.cc:260] T d80bd7c3354c472eaaaf49cdd958e470 P 47ec5c2bfdd24b1eb2a906f63214876e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:08.892681 26497 ts_tablet_manager.cc:1434] T d80bd7c3354c472eaaaf49cdd958e470 P 47ec5c2bfdd24b1eb2a906f63214876e: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:15:08.893282 26515 leader_election.cc:290] T d80bd7c3354c472eaaaf49cdd958e470 P 29ab82db4b2a4da39ed4796200c235bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6ea3e3c1dd142c2a529707d9999b96d (127.12.174.129:34845), 47ec5c2bfdd24b1eb2a906f63214876e (127.12.174.130:43337)
I20260709 12:15:08.893945 26497 tablet_bootstrap.cc:492] T e18e3ddc9621480a960d88fb92a478c8 P 47ec5c2bfdd24b1eb2a906f63214876e: Bootstrap starting.
I20260709 12:15:08.887907 26284 raft_consensus.cc:2468] T f31c0326c2bb48958872433822c1aa7c P 47ec5c2bfdd24b1eb2a906f63214876e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29ab82db4b2a4da39ed4796200c235bd in term 1.
I20260709 12:15:08.871987 26499 raft_consensus.cc:385] T e904f17eeb0846d3a6cefab2b07e3b4a P b6ea3e3c1dd142c2a529707d9999b96d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:08.896869 26499 raft_consensus.cc:740] T e904f17eeb0846d3a6cefab2b07e3b4a P b6ea3e3c1dd142c2a529707d9999b96d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6ea3e3c1dd142c2a529707d9999b96d, State: Initialized, Role: FOLLOWER
I20260709 12:15:08.897953 26499 consensus_queue.cc:260] T e904f17eeb0846d3a6cefab2b07e3b4a P b6ea3e3c1dd142c2a529707d9999b96d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:08.899492 26209 raft_consensus.cc:2468] T e904f17eeb0846d3a6cefab2b07e3b4a P b6ea3e3c1dd142c2a529707d9999b96d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29ab82db4b2a4da39ed4796200c235bd in term 0.
I20260709 12:15:08.899627 26208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80bd7c3354c472eaaaf49cdd958e470" candidate_uuid: "29ab82db4b2a4da39ed4796200c235bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" is_pre_election: true
I20260709 12:15:08.898370 26498 tablet_bootstrap.cc:654] T e5a4343a89b74e2394864cfa1b2a45ab P 29ab82db4b2a4da39ed4796200c235bd: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:08.864765 26512 raft_consensus.cc:515] T e904f17eeb0846d3a6cefab2b07e3b4a P 29ab82db4b2a4da39ed4796200c235bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:08.903307 26512 leader_election.cc:290] T e904f17eeb0846d3a6cefab2b07e3b4a P 29ab82db4b2a4da39ed4796200c235bd [CANDIDATE]: Term 1 election: Requested vote from peers b6ea3e3c1dd142c2a529707d9999b96d (127.12.174.129:34845), 47ec5c2bfdd24b1eb2a906f63214876e (127.12.174.130:43337)
I20260709 12:15:08.904057 26497 tablet_bootstrap.cc:654] T e18e3ddc9621480a960d88fb92a478c8 P 47ec5c2bfdd24b1eb2a906f63214876e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:08.904383 26499 ts_tablet_manager.cc:1434] T e904f17eeb0846d3a6cefab2b07e3b4a P b6ea3e3c1dd142c2a529707d9999b96d: Time spent starting tablet: real 0.036s	user 0.009s	sys 0.001s
I20260709 12:15:08.908215 26499 tablet_bootstrap.cc:492] T d80bd7c3354c472eaaaf49cdd958e470 P b6ea3e3c1dd142c2a529707d9999b96d: Bootstrap starting.
I20260709 12:15:08.916272 26499 tablet_bootstrap.cc:654] T d80bd7c3354c472eaaaf49cdd958e470 P b6ea3e3c1dd142c2a529707d9999b96d: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:08.916133 26498 tablet_bootstrap.cc:492] T e5a4343a89b74e2394864cfa1b2a45ab P 29ab82db4b2a4da39ed4796200c235bd: No bootstrap required, opened a new log
I20260709 12:15:08.917225 26498 ts_tablet_manager.cc:1403] T e5a4343a89b74e2394864cfa1b2a45ab P 29ab82db4b2a4da39ed4796200c235bd: Time spent bootstrapping tablet: real 0.028s	user 0.020s	sys 0.001s
I20260709 12:15:08.919196 26209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e904f17eeb0846d3a6cefab2b07e3b4a" candidate_uuid: "29ab82db4b2a4da39ed4796200c235bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6ea3e3c1dd142c2a529707d9999b96d"
W20260709 12:15:08.919770 26325 leader_election.cc:343] T d80bd7c3354c472eaaaf49cdd958e470 P 29ab82db4b2a4da39ed4796200c235bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6ea3e3c1dd142c2a529707d9999b96d (127.12.174.129:34845): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:08.919956 26209 raft_consensus.cc:3060] T e904f17eeb0846d3a6cefab2b07e3b4a P b6ea3e3c1dd142c2a529707d9999b96d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:08.920560 26498 raft_consensus.cc:359] T e5a4343a89b74e2394864cfa1b2a45ab P 29ab82db4b2a4da39ed4796200c235bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:08.916455 26497 tablet_bootstrap.cc:492] T e18e3ddc9621480a960d88fb92a478c8 P 47ec5c2bfdd24b1eb2a906f63214876e: No bootstrap required, opened a new log
I20260709 12:15:08.926160 26497 ts_tablet_manager.cc:1403] T e18e3ddc9621480a960d88fb92a478c8 P 47ec5c2bfdd24b1eb2a906f63214876e: Time spent bootstrapping tablet: real 0.033s	user 0.016s	sys 0.004s
I20260709 12:15:08.929922 26497 raft_consensus.cc:359] T e18e3ddc9621480a960d88fb92a478c8 P 47ec5c2bfdd24b1eb2a906f63214876e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:08.922504 26284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80bd7c3354c472eaaaf49cdd958e470" candidate_uuid: "29ab82db4b2a4da39ed4796200c235bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" is_pre_election: true
I20260709 12:15:08.931313 26497 raft_consensus.cc:385] T e18e3ddc9621480a960d88fb92a478c8 P 47ec5c2bfdd24b1eb2a906f63214876e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:08.922194 26322 leader_election.cc:304] T f31c0326c2bb48958872433822c1aa7c P 29ab82db4b2a4da39ed4796200c235bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29ab82db4b2a4da39ed4796200c235bd, 47ec5c2bfdd24b1eb2a906f63214876e; no voters: 
I20260709 12:15:08.924108 26285 raft_consensus.cc:2468] T ef313d7b9e734aae93e2ed571944bbaa P 47ec5c2bfdd24b1eb2a906f63214876e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6ea3e3c1dd142c2a529707d9999b96d in term 1.
I20260709 12:15:08.924738 26283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e904f17eeb0846d3a6cefab2b07e3b4a" candidate_uuid: "29ab82db4b2a4da39ed4796200c235bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47ec5c2bfdd24b1eb2a906f63214876e"
I20260709 12:15:08.934053 26515 raft_consensus.cc:2804] T f31c0326c2bb48958872433822c1aa7c P 29ab82db4b2a4da39ed4796200c235bd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:08.934415 26283 raft_consensus.cc:3060] T e904f17eeb0846d3a6cefab2b07e3b4a P 47ec5c2bfdd24b1eb2a906f63214876e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:08.934641 26515 raft_consensus.cc:697] T f31c0326c2bb48958872433822c1aa7c P 29ab82db4b2a4da39ed4796200c235bd [term 1 LEADER]: Becoming Leader. State: Replica: 29ab82db4b2a4da39ed4796200c235bd, State: Running, Role: LEADER
I20260709 12:15:08.935756 26515 consensus_queue.cc:237] T f31c0326c2bb48958872433822c1aa7c P 29ab82db4b2a4da39ed4796200c235bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:08.937187 26209 raft_consensus.cc:2468] T e904f17eeb0846d3a6cefab2b07e3b4a P b6ea3e3c1dd142c2a529707d9999b96d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29ab82db4b2a4da39ed4796200c235bd in term 1.
I20260709 12:15:08.919216 26512 raft_consensus.cc:493] T ef313d7b9e734aae93e2ed571944bbaa P 29ab82db4b2a4da39ed4796200c235bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:08.930827 26498 raft_consensus.cc:385] T e5a4343a89b74e2394864cfa1b2a45ab P 29ab82db4b2a4da39ed4796200c235bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:08.937945 26498 raft_consensus.cc:740] T e5a4343a89b74e2394864cfa1b2a45ab P 29ab82db4b2a4da39ed4796200c235bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29ab82db4b2a4da39ed4796200c235bd, State: Initialized, Role: FOLLOWER
I20260709 12:15:08.938030 26512 raft_consensus.cc:515] T ef313d7b9e734aae93e2ed571944bbaa P 29ab82db4b2a4da39ed4796200c235bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:08.938875 26498 consensus_queue.cc:260] T e5a4343a89b74e2394864cfa1b2a45ab P 29ab82db4b2a4da39ed4796200c235bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:08.940452 26512 leader_election.cc:290] T ef313d7b9e734aae93e2ed571944bbaa P 29ab82db4b2a4da39ed4796200c235bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6ea3e3c1dd142c2a529707d9999b96d (127.12.174.129:34845), 47ec5c2bfdd24b1eb2a906f63214876e (127.12.174.130:43337)
I20260709 12:15:08.941684 26498 ts_tablet_manager.cc:1434] T e5a4343a89b74e2394864cfa1b2a45ab P 29ab82db4b2a4da39ed4796200c235bd: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.000s
I20260709 12:15:08.943001 26498 tablet_bootstrap.cc:492] T 3be8e2e412f8465b83495d611f4b7ce2 P 29ab82db4b2a4da39ed4796200c235bd: Bootstrap starting.
I20260709 12:15:08.931734 26497 raft_consensus.cc:740] T e18e3ddc9621480a960d88fb92a478c8 P 47ec5c2bfdd24b1eb2a906f63214876e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47ec5c2bfdd24b1eb2a906f63214876e, State: Initialized, Role: FOLLOWER
I20260709 12:15:08.931581 26284 raft_consensus.cc:2468] T d80bd7c3354c472eaaaf49cdd958e470 P 47ec5c2bfdd24b1eb2a906f63214876e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29ab82db4b2a4da39ed4796200c235bd in term 0.
I20260709 12:15:08.923790 26210 raft_consensus.cc:2468] T f31c0326c2bb48958872433822c1aa7c P b6ea3e3c1dd142c2a529707d9999b96d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29ab82db4b2a4da39ed4796200c235bd in term 1.
I20260709 12:15:08.946724 26497 consensus_queue.cc:260] T e18e3ddc9621480a960d88fb92a478c8 P 47ec5c2bfdd24b1eb2a906f63214876e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:08.949471 26497 ts_tablet_manager.cc:1434] T e18e3ddc9621480a960d88fb92a478c8 P 47ec5c2bfdd24b1eb2a906f63214876e: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 12:15:08.950518 26173 leader_election.cc:304] T ef313d7b9e734aae93e2ed571944bbaa P b6ea3e3c1dd142c2a529707d9999b96d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47ec5c2bfdd24b1eb2a906f63214876e, b6ea3e3c1dd142c2a529707d9999b96d; no voters: 29ab82db4b2a4da39ed4796200c235bd
I20260709 12:15:08.951179 26497 tablet_bootstrap.cc:492] T e5a4343a89b74e2394864cfa1b2a45ab P 47ec5c2bfdd24b1eb2a906f63214876e: Bootstrap starting.
I20260709 12:15:08.952526 26504 raft_consensus.cc:2804] T ef313d7b9e734aae93e2ed571944bbaa P b6ea3e3c1dd142c2a529707d9999b96d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:08.953228 26283 raft_consensus.cc:2468] T e904f17eeb0846d3a6cefab2b07e3b4a P 47ec5c2bfdd24b1eb2a906f63214876e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29ab82db4b2a4da39ed4796200c235bd in term 1.
I20260709 12:15:08.960443 26322 leader_election.cc:304] T d80bd7c3354c472eaaaf49cdd958e470 P 29ab82db4b2a4da39ed4796200c235bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29ab82db4b2a4da39ed4796200c235bd, 47ec5c2bfdd24b1eb2a906f63214876e; no voters: b6ea3e3c1dd142c2a529707d9999b96d
I20260709 12:15:08.961781 26512 raft_consensus.cc:2804] T d80bd7c3354c472eaaaf49cdd958e470 P 29ab82db4b2a4da39ed4796200c235bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:08.962236 26512 raft_consensus.cc:493] T d80bd7c3354c472eaaaf49cdd958e470 P 29ab82db4b2a4da39ed4796200c235bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:08.962854 26512 raft_consensus.cc:3060] T d80bd7c3354c472eaaaf49cdd958e470 P 29ab82db4b2a4da39ed4796200c235bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:08.963271 26283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef313d7b9e734aae93e2ed571944bbaa" candidate_uuid: "29ab82db4b2a4da39ed4796200c235bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" is_pre_election: true
I20260709 12:15:08.964299 26283 raft_consensus.cc:2393] T ef313d7b9e734aae93e2ed571944bbaa P 47ec5c2bfdd24b1eb2a906f63214876e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 29ab82db4b2a4da39ed4796200c235bd in current term 1: Already voted for candidate b6ea3e3c1dd142c2a529707d9999b96d in this term.
I20260709 12:15:08.965356 26210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef313d7b9e734aae93e2ed571944bbaa" candidate_uuid: "29ab82db4b2a4da39ed4796200c235bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" is_pre_election: true
I20260709 12:15:08.965399 26497 tablet_bootstrap.cc:654] T e5a4343a89b74e2394864cfa1b2a45ab P 47ec5c2bfdd24b1eb2a906f63214876e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:08.962033 26322 leader_election.cc:304] T e904f17eeb0846d3a6cefab2b07e3b4a P 29ab82db4b2a4da39ed4796200c235bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29ab82db4b2a4da39ed4796200c235bd, 47ec5c2bfdd24b1eb2a906f63214876e; no voters: 
I20260709 12:15:08.972080 26431 raft_consensus.cc:2804] T e904f17eeb0846d3a6cefab2b07e3b4a P 29ab82db4b2a4da39ed4796200c235bd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:08.973784 26504 raft_consensus.cc:697] T ef313d7b9e734aae93e2ed571944bbaa P b6ea3e3c1dd142c2a529707d9999b96d [term 1 LEADER]: Becoming Leader. State: Replica: b6ea3e3c1dd142c2a529707d9999b96d, State: Running, Role: LEADER
I20260709 12:15:08.975879 26498 tablet_bootstrap.cc:654] T 3be8e2e412f8465b83495d611f4b7ce2 P 29ab82db4b2a4da39ed4796200c235bd: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:08.985414 26499 tablet_bootstrap.cc:492] T d80bd7c3354c472eaaaf49cdd958e470 P b6ea3e3c1dd142c2a529707d9999b96d: No bootstrap required, opened a new log
I20260709 12:15:08.988703 26499 ts_tablet_manager.cc:1403] T d80bd7c3354c472eaaaf49cdd958e470 P b6ea3e3c1dd142c2a529707d9999b96d: Time spent bootstrapping tablet: real 0.081s	user 0.014s	sys 0.018s
I20260709 12:15:08.975903 26504 consensus_queue.cc:237] T ef313d7b9e734aae93e2ed571944bbaa P b6ea3e3c1dd142c2a529707d9999b96d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:08.992923 26105 catalog_manager.cc:5697] T f31c0326c2bb48958872433822c1aa7c P 29ab82db4b2a4da39ed4796200c235bd reported cstate change: term changed from 0 to 1, leader changed from <none> to 29ab82db4b2a4da39ed4796200c235bd (127.12.174.131). New cstate: current_term: 1 leader_uuid: "29ab82db4b2a4da39ed4796200c235bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:08.999929 26499 raft_consensus.cc:359] T d80bd7c3354c472eaaaf49cdd958e470 P b6ea3e3c1dd142c2a529707d9999b96d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:09.005303 26499 raft_consensus.cc:385] T d80bd7c3354c472eaaaf49cdd958e470 P b6ea3e3c1dd142c2a529707d9999b96d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:09.004788 26512 raft_consensus.cc:515] T d80bd7c3354c472eaaaf49cdd958e470 P 29ab82db4b2a4da39ed4796200c235bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:09.008167 26499 raft_consensus.cc:740] T d80bd7c3354c472eaaaf49cdd958e470 P b6ea3e3c1dd142c2a529707d9999b96d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6ea3e3c1dd142c2a529707d9999b96d, State: Initialized, Role: FOLLOWER
I20260709 12:15:09.008319 26497 tablet_bootstrap.cc:492] T e5a4343a89b74e2394864cfa1b2a45ab P 47ec5c2bfdd24b1eb2a906f63214876e: No bootstrap required, opened a new log
I20260709 12:15:09.010260 26497 ts_tablet_manager.cc:1403] T e5a4343a89b74e2394864cfa1b2a45ab P 47ec5c2bfdd24b1eb2a906f63214876e: Time spent bootstrapping tablet: real 0.060s	user 0.013s	sys 0.004s
I20260709 12:15:09.012144 26209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80bd7c3354c472eaaaf49cdd958e470" candidate_uuid: "29ab82db4b2a4da39ed4796200c235bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6ea3e3c1dd142c2a529707d9999b96d"
I20260709 12:15:09.012724 26431 raft_consensus.cc:697] T e904f17eeb0846d3a6cefab2b07e3b4a P 29ab82db4b2a4da39ed4796200c235bd [term 1 LEADER]: Becoming Leader. State: Replica: 29ab82db4b2a4da39ed4796200c235bd, State: Running, Role: LEADER
I20260709 12:15:09.009245 26499 consensus_queue.cc:260] T d80bd7c3354c472eaaaf49cdd958e470 P b6ea3e3c1dd142c2a529707d9999b96d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:09.016719 26209 raft_consensus.cc:3060] T d80bd7c3354c472eaaaf49cdd958e470 P b6ea3e3c1dd142c2a529707d9999b96d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:09.013793 26431 consensus_queue.cc:237] T e904f17eeb0846d3a6cefab2b07e3b4a P 29ab82db4b2a4da39ed4796200c235bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:09.023056 26498 tablet_bootstrap.cc:492] T 3be8e2e412f8465b83495d611f4b7ce2 P 29ab82db4b2a4da39ed4796200c235bd: No bootstrap required, opened a new log
I20260709 12:15:09.023623 26498 ts_tablet_manager.cc:1403] T 3be8e2e412f8465b83495d611f4b7ce2 P 29ab82db4b2a4da39ed4796200c235bd: Time spent bootstrapping tablet: real 0.081s	user 0.018s	sys 0.002s
I20260709 12:15:09.018520 26497 raft_consensus.cc:359] T e5a4343a89b74e2394864cfa1b2a45ab P 47ec5c2bfdd24b1eb2a906f63214876e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:09.026785 26497 raft_consensus.cc:385] T e5a4343a89b74e2394864cfa1b2a45ab P 47ec5c2bfdd24b1eb2a906f63214876e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:09.027107 26497 raft_consensus.cc:740] T e5a4343a89b74e2394864cfa1b2a45ab P 47ec5c2bfdd24b1eb2a906f63214876e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47ec5c2bfdd24b1eb2a906f63214876e, State: Initialized, Role: FOLLOWER
I20260709 12:15:09.027904 26497 consensus_queue.cc:260] T e5a4343a89b74e2394864cfa1b2a45ab P 47ec5c2bfdd24b1eb2a906f63214876e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:09.028180 26325 leader_election.cc:304] T ef313d7b9e734aae93e2ed571944bbaa P 29ab82db4b2a4da39ed4796200c235bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 29ab82db4b2a4da39ed4796200c235bd; no voters: 47ec5c2bfdd24b1eb2a906f63214876e, b6ea3e3c1dd142c2a529707d9999b96d
I20260709 12:15:09.024220 26285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80bd7c3354c472eaaaf49cdd958e470" candidate_uuid: "29ab82db4b2a4da39ed4796200c235bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47ec5c2bfdd24b1eb2a906f63214876e"
I20260709 12:15:09.030143 26285 raft_consensus.cc:3060] T d80bd7c3354c472eaaaf49cdd958e470 P 47ec5c2bfdd24b1eb2a906f63214876e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:09.030920 26497 ts_tablet_manager.cc:1434] T e5a4343a89b74e2394864cfa1b2a45ab P 47ec5c2bfdd24b1eb2a906f63214876e: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.001s
I20260709 12:15:09.032200 26497 tablet_bootstrap.cc:492] T 3be8e2e412f8465b83495d611f4b7ce2 P 47ec5c2bfdd24b1eb2a906f63214876e: Bootstrap starting.
I20260709 12:15:09.018499 26512 leader_election.cc:290] T d80bd7c3354c472eaaaf49cdd958e470 P 29ab82db4b2a4da39ed4796200c235bd [CANDIDATE]: Term 1 election: Requested vote from peers b6ea3e3c1dd142c2a529707d9999b96d (127.12.174.129:34845), 47ec5c2bfdd24b1eb2a906f63214876e (127.12.174.130:43337)
I20260709 12:15:09.039023 26497 tablet_bootstrap.cc:654] T 3be8e2e412f8465b83495d611f4b7ce2 P 47ec5c2bfdd24b1eb2a906f63214876e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:09.039026 26512 raft_consensus.cc:3060] T ef313d7b9e734aae93e2ed571944bbaa P 29ab82db4b2a4da39ed4796200c235bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:09.046787 26499 ts_tablet_manager.cc:1434] T d80bd7c3354c472eaaaf49cdd958e470 P b6ea3e3c1dd142c2a529707d9999b96d: Time spent starting tablet: real 0.057s	user 0.010s	sys 0.021s
I20260709 12:15:09.048388 26499 tablet_bootstrap.cc:492] T ed22621a01e740fdb61fe0db7e9c77c6 P b6ea3e3c1dd142c2a529707d9999b96d: Bootstrap starting.
I20260709 12:15:09.051497 26498 raft_consensus.cc:359] T 3be8e2e412f8465b83495d611f4b7ce2 P 29ab82db4b2a4da39ed4796200c235bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:09.052278 26498 raft_consensus.cc:385] T 3be8e2e412f8465b83495d611f4b7ce2 P 29ab82db4b2a4da39ed4796200c235bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:09.052560 26498 raft_consensus.cc:740] T 3be8e2e412f8465b83495d611f4b7ce2 P 29ab82db4b2a4da39ed4796200c235bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29ab82db4b2a4da39ed4796200c235bd, State: Initialized, Role: FOLLOWER
I20260709 12:15:09.053234 26498 consensus_queue.cc:260] T 3be8e2e412f8465b83495d611f4b7ce2 P 29ab82db4b2a4da39ed4796200c235bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:09.047382 26285 raft_consensus.cc:2468] T d80bd7c3354c472eaaaf49cdd958e470 P 47ec5c2bfdd24b1eb2a906f63214876e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29ab82db4b2a4da39ed4796200c235bd in term 1.
I20260709 12:15:09.056522 26322 leader_election.cc:304] T d80bd7c3354c472eaaaf49cdd958e470 P 29ab82db4b2a4da39ed4796200c235bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29ab82db4b2a4da39ed4796200c235bd, 47ec5c2bfdd24b1eb2a906f63214876e; no voters: 
I20260709 12:15:09.057881 26524 raft_consensus.cc:2804] T d80bd7c3354c472eaaaf49cdd958e470 P 29ab82db4b2a4da39ed4796200c235bd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:09.058475 26524 raft_consensus.cc:697] T d80bd7c3354c472eaaaf49cdd958e470 P 29ab82db4b2a4da39ed4796200c235bd [term 1 LEADER]: Becoming Leader. State: Replica: 29ab82db4b2a4da39ed4796200c235bd, State: Running, Role: LEADER
I20260709 12:15:09.059324 26524 consensus_queue.cc:237] T d80bd7c3354c472eaaaf49cdd958e470 P 29ab82db4b2a4da39ed4796200c235bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:09.064007 26498 ts_tablet_manager.cc:1434] T 3be8e2e412f8465b83495d611f4b7ce2 P 29ab82db4b2a4da39ed4796200c235bd: Time spent starting tablet: real 0.040s	user 0.008s	sys 0.000s
I20260709 12:15:09.065481 26498 tablet_bootstrap.cc:492] T 739b1449642e40fb84a22a155ce21e59 P 29ab82db4b2a4da39ed4796200c235bd: Bootstrap starting.
I20260709 12:15:09.057008 26499 tablet_bootstrap.cc:654] T ed22621a01e740fdb61fe0db7e9c77c6 P b6ea3e3c1dd142c2a529707d9999b96d: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:09.074283 26209 raft_consensus.cc:2468] T d80bd7c3354c472eaaaf49cdd958e470 P b6ea3e3c1dd142c2a529707d9999b96d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29ab82db4b2a4da39ed4796200c235bd in term 1.
I20260709 12:15:09.075345 26512 raft_consensus.cc:2749] T ef313d7b9e734aae93e2ed571944bbaa P 29ab82db4b2a4da39ed4796200c235bd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:09.078857 26498 tablet_bootstrap.cc:654] T 739b1449642e40fb84a22a155ce21e59 P 29ab82db4b2a4da39ed4796200c235bd: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:09.082777 26107 catalog_manager.cc:5697] T ef313d7b9e734aae93e2ed571944bbaa P b6ea3e3c1dd142c2a529707d9999b96d reported cstate change: term changed from 0 to 1, leader changed from <none> to b6ea3e3c1dd142c2a529707d9999b96d (127.12.174.129). New cstate: current_term: 1 leader_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:09.087034 26512 raft_consensus.cc:493] T ed22621a01e740fdb61fe0db7e9c77c6 P 29ab82db4b2a4da39ed4796200c235bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:09.102798 26512 raft_consensus.cc:515] T ed22621a01e740fdb61fe0db7e9c77c6 P 29ab82db4b2a4da39ed4796200c235bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:09.114114 26498 tablet_bootstrap.cc:492] T 739b1449642e40fb84a22a155ce21e59 P 29ab82db4b2a4da39ed4796200c235bd: No bootstrap required, opened a new log
I20260709 12:15:09.114813 26498 ts_tablet_manager.cc:1403] T 739b1449642e40fb84a22a155ce21e59 P 29ab82db4b2a4da39ed4796200c235bd: Time spent bootstrapping tablet: real 0.050s	user 0.011s	sys 0.009s
I20260709 12:15:09.123492 26498 raft_consensus.cc:359] T 739b1449642e40fb84a22a155ce21e59 P 29ab82db4b2a4da39ed4796200c235bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:09.124276 26498 raft_consensus.cc:385] T 739b1449642e40fb84a22a155ce21e59 P 29ab82db4b2a4da39ed4796200c235bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:09.124531 26498 raft_consensus.cc:740] T 739b1449642e40fb84a22a155ce21e59 P 29ab82db4b2a4da39ed4796200c235bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29ab82db4b2a4da39ed4796200c235bd, State: Initialized, Role: FOLLOWER
I20260709 12:15:09.129756 26210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed22621a01e740fdb61fe0db7e9c77c6" candidate_uuid: "29ab82db4b2a4da39ed4796200c235bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" is_pre_election: true
I20260709 12:15:09.130218 26285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed22621a01e740fdb61fe0db7e9c77c6" candidate_uuid: "29ab82db4b2a4da39ed4796200c235bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" is_pre_election: true
I20260709 12:15:09.130910 26285 raft_consensus.cc:2468] T ed22621a01e740fdb61fe0db7e9c77c6 P 47ec5c2bfdd24b1eb2a906f63214876e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29ab82db4b2a4da39ed4796200c235bd in term 0.
W20260709 12:15:09.131780 26325 leader_election.cc:343] T ed22621a01e740fdb61fe0db7e9c77c6 P 29ab82db4b2a4da39ed4796200c235bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6ea3e3c1dd142c2a529707d9999b96d (127.12.174.129:34845): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:09.132414 26322 leader_election.cc:304] T ed22621a01e740fdb61fe0db7e9c77c6 P 29ab82db4b2a4da39ed4796200c235bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29ab82db4b2a4da39ed4796200c235bd, 47ec5c2bfdd24b1eb2a906f63214876e; no voters: b6ea3e3c1dd142c2a529707d9999b96d
I20260709 12:15:09.125247 26498 consensus_queue.cc:260] T 739b1449642e40fb84a22a155ce21e59 P 29ab82db4b2a4da39ed4796200c235bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:09.133234 26524 raft_consensus.cc:2804] T ed22621a01e740fdb61fe0db7e9c77c6 P 29ab82db4b2a4da39ed4796200c235bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:09.133630 26524 raft_consensus.cc:493] T ed22621a01e740fdb61fe0db7e9c77c6 P 29ab82db4b2a4da39ed4796200c235bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:09.134689 26524 raft_consensus.cc:3060] T ed22621a01e740fdb61fe0db7e9c77c6 P 29ab82db4b2a4da39ed4796200c235bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:09.133324 26512 leader_election.cc:290] T ed22621a01e740fdb61fe0db7e9c77c6 P 29ab82db4b2a4da39ed4796200c235bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6ea3e3c1dd142c2a529707d9999b96d (127.12.174.129:34845), 47ec5c2bfdd24b1eb2a906f63214876e (127.12.174.130:43337)
I20260709 12:15:09.135367 26498 ts_tablet_manager.cc:1434] T 739b1449642e40fb84a22a155ce21e59 P 29ab82db4b2a4da39ed4796200c235bd: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.000s
I20260709 12:15:09.139568 26503 raft_consensus.cc:493] T e18e3ddc9621480a960d88fb92a478c8 P 47ec5c2bfdd24b1eb2a906f63214876e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:09.141655 26503 raft_consensus.cc:515] T e18e3ddc9621480a960d88fb92a478c8 P 47ec5c2bfdd24b1eb2a906f63214876e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:09.144224 26503 leader_election.cc:290] T e18e3ddc9621480a960d88fb92a478c8 P 47ec5c2bfdd24b1eb2a906f63214876e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6ea3e3c1dd142c2a529707d9999b96d (127.12.174.129:34845), 29ab82db4b2a4da39ed4796200c235bd (127.12.174.131:43279)
I20260709 12:15:09.145167 26210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e18e3ddc9621480a960d88fb92a478c8" candidate_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" is_pre_election: true
I20260709 12:15:09.144654 26105 catalog_manager.cc:5697] T e904f17eeb0846d3a6cefab2b07e3b4a P 29ab82db4b2a4da39ed4796200c235bd reported cstate change: term changed from 0 to 1, leader changed from <none> to 29ab82db4b2a4da39ed4796200c235bd (127.12.174.131). New cstate: current_term: 1 leader_uuid: "29ab82db4b2a4da39ed4796200c235bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:09.145826 26512 raft_consensus.cc:493] T 3be8e2e412f8465b83495d611f4b7ce2 P 29ab82db4b2a4da39ed4796200c235bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:09.146476 26512 raft_consensus.cc:515] T 3be8e2e412f8465b83495d611f4b7ce2 P 29ab82db4b2a4da39ed4796200c235bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
W20260709 12:15:09.147459 26251 leader_election.cc:343] T e18e3ddc9621480a960d88fb92a478c8 P 47ec5c2bfdd24b1eb2a906f63214876e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6ea3e3c1dd142c2a529707d9999b96d (127.12.174.129:34845): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:09.151615 26497 tablet_bootstrap.cc:492] T 3be8e2e412f8465b83495d611f4b7ce2 P 47ec5c2bfdd24b1eb2a906f63214876e: No bootstrap required, opened a new log
I20260709 12:15:09.151904 26210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be8e2e412f8465b83495d611f4b7ce2" candidate_uuid: "29ab82db4b2a4da39ed4796200c235bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" is_pre_election: true
I20260709 12:15:09.152302 26497 ts_tablet_manager.cc:1403] T 3be8e2e412f8465b83495d611f4b7ce2 P 47ec5c2bfdd24b1eb2a906f63214876e: Time spent bootstrapping tablet: real 0.120s	user 0.012s	sys 0.029s
I20260709 12:15:09.147014 26105 catalog_manager.cc:5697] T d80bd7c3354c472eaaaf49cdd958e470 P 29ab82db4b2a4da39ed4796200c235bd reported cstate change: term changed from 0 to 1, leader changed from <none> to 29ab82db4b2a4da39ed4796200c235bd (127.12.174.131). New cstate: current_term: 1 leader_uuid: "29ab82db4b2a4da39ed4796200c235bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:09.153059 26285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be8e2e412f8465b83495d611f4b7ce2" candidate_uuid: "29ab82db4b2a4da39ed4796200c235bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" is_pre_election: true
W20260709 12:15:09.153708 26325 leader_election.cc:343] T 3be8e2e412f8465b83495d611f4b7ce2 P 29ab82db4b2a4da39ed4796200c235bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6ea3e3c1dd142c2a529707d9999b96d (127.12.174.129:34845): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:15:09.155491 26322 leader_election.cc:343] T 3be8e2e412f8465b83495d611f4b7ce2 P 29ab82db4b2a4da39ed4796200c235bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 47ec5c2bfdd24b1eb2a906f63214876e (127.12.174.130:43337): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:09.156056 26322 leader_election.cc:304] T 3be8e2e412f8465b83495d611f4b7ce2 P 29ab82db4b2a4da39ed4796200c235bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 29ab82db4b2a4da39ed4796200c235bd; no voters: 47ec5c2bfdd24b1eb2a906f63214876e, b6ea3e3c1dd142c2a529707d9999b96d
I20260709 12:15:09.157090 26431 raft_consensus.cc:2749] T 3be8e2e412f8465b83495d611f4b7ce2 P 29ab82db4b2a4da39ed4796200c235bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:09.155802 26497 raft_consensus.cc:359] T 3be8e2e412f8465b83495d611f4b7ce2 P 47ec5c2bfdd24b1eb2a906f63214876e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:09.157631 26497 raft_consensus.cc:385] T 3be8e2e412f8465b83495d611f4b7ce2 P 47ec5c2bfdd24b1eb2a906f63214876e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:09.157881 26499 tablet_bootstrap.cc:492] T ed22621a01e740fdb61fe0db7e9c77c6 P b6ea3e3c1dd142c2a529707d9999b96d: No bootstrap required, opened a new log
I20260709 12:15:09.157949 26497 raft_consensus.cc:740] T 3be8e2e412f8465b83495d611f4b7ce2 P 47ec5c2bfdd24b1eb2a906f63214876e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47ec5c2bfdd24b1eb2a906f63214876e, State: Initialized, Role: FOLLOWER
I20260709 12:15:09.158442 26524 raft_consensus.cc:515] T ed22621a01e740fdb61fe0db7e9c77c6 P 29ab82db4b2a4da39ed4796200c235bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:09.159126 26497 consensus_queue.cc:260] T 3be8e2e412f8465b83495d611f4b7ce2 P 47ec5c2bfdd24b1eb2a906f63214876e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:09.160159 26499 ts_tablet_manager.cc:1403] T ed22621a01e740fdb61fe0db7e9c77c6 P b6ea3e3c1dd142c2a529707d9999b96d: Time spent bootstrapping tablet: real 0.112s	user 0.023s	sys 0.011s
I20260709 12:15:09.153852 26512 leader_election.cc:290] T 3be8e2e412f8465b83495d611f4b7ce2 P 29ab82db4b2a4da39ed4796200c235bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6ea3e3c1dd142c2a529707d9999b96d (127.12.174.129:34845), 47ec5c2bfdd24b1eb2a906f63214876e (127.12.174.130:43337)
I20260709 12:15:09.161863 26210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed22621a01e740fdb61fe0db7e9c77c6" candidate_uuid: "29ab82db4b2a4da39ed4796200c235bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6ea3e3c1dd142c2a529707d9999b96d"
I20260709 12:15:09.164572 26285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed22621a01e740fdb61fe0db7e9c77c6" candidate_uuid: "29ab82db4b2a4da39ed4796200c235bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47ec5c2bfdd24b1eb2a906f63214876e"
I20260709 12:15:09.165315 26285 raft_consensus.cc:3060] T ed22621a01e740fdb61fe0db7e9c77c6 P 47ec5c2bfdd24b1eb2a906f63214876e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:09.166618 26359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e18e3ddc9621480a960d88fb92a478c8" candidate_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29ab82db4b2a4da39ed4796200c235bd" is_pre_election: true
I20260709 12:15:09.167358 26359 raft_consensus.cc:2468] T e18e3ddc9621480a960d88fb92a478c8 P 29ab82db4b2a4da39ed4796200c235bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47ec5c2bfdd24b1eb2a906f63214876e in term 0.
I20260709 12:15:09.167500 26499 raft_consensus.cc:359] T ed22621a01e740fdb61fe0db7e9c77c6 P b6ea3e3c1dd142c2a529707d9999b96d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:09.168365 26499 raft_consensus.cc:385] T ed22621a01e740fdb61fe0db7e9c77c6 P b6ea3e3c1dd142c2a529707d9999b96d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:09.168685 26499 raft_consensus.cc:740] T ed22621a01e740fdb61fe0db7e9c77c6 P b6ea3e3c1dd142c2a529707d9999b96d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6ea3e3c1dd142c2a529707d9999b96d, State: Initialized, Role: FOLLOWER
I20260709 12:15:09.168910 26249 leader_election.cc:304] T e18e3ddc9621480a960d88fb92a478c8 P 47ec5c2bfdd24b1eb2a906f63214876e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29ab82db4b2a4da39ed4796200c235bd, 47ec5c2bfdd24b1eb2a906f63214876e; no voters: b6ea3e3c1dd142c2a529707d9999b96d
I20260709 12:15:09.169481 26499 consensus_queue.cc:260] T ed22621a01e740fdb61fe0db7e9c77c6 P b6ea3e3c1dd142c2a529707d9999b96d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:09.170511 26210 raft_consensus.cc:3060] T ed22621a01e740fdb61fe0db7e9c77c6 P b6ea3e3c1dd142c2a529707d9999b96d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:09.161499 26497 ts_tablet_manager.cc:1434] T 3be8e2e412f8465b83495d611f4b7ce2 P 47ec5c2bfdd24b1eb2a906f63214876e: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:15:09.173410 26497 tablet_bootstrap.cc:492] T 739b1449642e40fb84a22a155ce21e59 P 47ec5c2bfdd24b1eb2a906f63214876e: Bootstrap starting.
I20260709 12:15:09.179545 26497 tablet_bootstrap.cc:654] T 739b1449642e40fb84a22a155ce21e59 P 47ec5c2bfdd24b1eb2a906f63214876e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:09.179656 26210 raft_consensus.cc:2468] T ed22621a01e740fdb61fe0db7e9c77c6 P b6ea3e3c1dd142c2a529707d9999b96d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29ab82db4b2a4da39ed4796200c235bd in term 1.
I20260709 12:15:09.182647 26538 raft_consensus.cc:2804] T e18e3ddc9621480a960d88fb92a478c8 P 47ec5c2bfdd24b1eb2a906f63214876e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:09.183086 26538 raft_consensus.cc:493] T e18e3ddc9621480a960d88fb92a478c8 P 47ec5c2bfdd24b1eb2a906f63214876e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:09.183422 26538 raft_consensus.cc:3060] T e18e3ddc9621480a960d88fb92a478c8 P 47ec5c2bfdd24b1eb2a906f63214876e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:09.185271 26524 leader_election.cc:290] T ed22621a01e740fdb61fe0db7e9c77c6 P 29ab82db4b2a4da39ed4796200c235bd [CANDIDATE]: Term 1 election: Requested vote from peers b6ea3e3c1dd142c2a529707d9999b96d (127.12.174.129:34845), 47ec5c2bfdd24b1eb2a906f63214876e (127.12.174.130:43337)
I20260709 12:15:09.172149 26499 ts_tablet_manager.cc:1434] T ed22621a01e740fdb61fe0db7e9c77c6 P b6ea3e3c1dd142c2a529707d9999b96d: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:15:09.187130 26499 tablet_bootstrap.cc:492] T e5a4343a89b74e2394864cfa1b2a45ab P b6ea3e3c1dd142c2a529707d9999b96d: Bootstrap starting.
I20260709 12:15:09.187963 26285 raft_consensus.cc:2468] T ed22621a01e740fdb61fe0db7e9c77c6 P 47ec5c2bfdd24b1eb2a906f63214876e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29ab82db4b2a4da39ed4796200c235bd in term 1.
I20260709 12:15:09.189196 26322 leader_election.cc:304] T ed22621a01e740fdb61fe0db7e9c77c6 P 29ab82db4b2a4da39ed4796200c235bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29ab82db4b2a4da39ed4796200c235bd, 47ec5c2bfdd24b1eb2a906f63214876e; no voters: 
I20260709 12:15:09.189945 26524 raft_consensus.cc:2804] T ed22621a01e740fdb61fe0db7e9c77c6 P 29ab82db4b2a4da39ed4796200c235bd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:09.191255 26524 raft_consensus.cc:697] T ed22621a01e740fdb61fe0db7e9c77c6 P 29ab82db4b2a4da39ed4796200c235bd [term 1 LEADER]: Becoming Leader. State: Replica: 29ab82db4b2a4da39ed4796200c235bd, State: Running, Role: LEADER
I20260709 12:15:09.192198 26524 consensus_queue.cc:237] T ed22621a01e740fdb61fe0db7e9c77c6 P 29ab82db4b2a4da39ed4796200c235bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:09.193291 26538 raft_consensus.cc:515] T e18e3ddc9621480a960d88fb92a478c8 P 47ec5c2bfdd24b1eb2a906f63214876e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:09.194628 26499 tablet_bootstrap.cc:654] T e5a4343a89b74e2394864cfa1b2a45ab P b6ea3e3c1dd142c2a529707d9999b96d: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:09.198833 26209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e18e3ddc9621480a960d88fb92a478c8" candidate_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6ea3e3c1dd142c2a529707d9999b96d"
W20260709 12:15:09.200606 26251 leader_election.cc:343] T e18e3ddc9621480a960d88fb92a478c8 P 47ec5c2bfdd24b1eb2a906f63214876e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b6ea3e3c1dd142c2a529707d9999b96d (127.12.174.129:34845): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:09.201843 26538 leader_election.cc:290] T e18e3ddc9621480a960d88fb92a478c8 P 47ec5c2bfdd24b1eb2a906f63214876e [CANDIDATE]: Term 1 election: Requested vote from peers b6ea3e3c1dd142c2a529707d9999b96d (127.12.174.129:34845), 29ab82db4b2a4da39ed4796200c235bd (127.12.174.131:43279)
I20260709 12:15:09.203225 26499 tablet_bootstrap.cc:492] T e5a4343a89b74e2394864cfa1b2a45ab P b6ea3e3c1dd142c2a529707d9999b96d: No bootstrap required, opened a new log
I20260709 12:15:09.203830 26499 ts_tablet_manager.cc:1403] T e5a4343a89b74e2394864cfa1b2a45ab P b6ea3e3c1dd142c2a529707d9999b96d: Time spent bootstrapping tablet: real 0.017s	user 0.007s	sys 0.006s
I20260709 12:15:09.205053 26497 tablet_bootstrap.cc:492] T 739b1449642e40fb84a22a155ce21e59 P 47ec5c2bfdd24b1eb2a906f63214876e: No bootstrap required, opened a new log
I20260709 12:15:09.203900 26108 catalog_manager.cc:5697] T ed22621a01e740fdb61fe0db7e9c77c6 P 29ab82db4b2a4da39ed4796200c235bd reported cstate change: term changed from 0 to 1, leader changed from <none> to 29ab82db4b2a4da39ed4796200c235bd (127.12.174.131). New cstate: current_term: 1 leader_uuid: "29ab82db4b2a4da39ed4796200c235bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:09.205477 26359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e18e3ddc9621480a960d88fb92a478c8" candidate_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29ab82db4b2a4da39ed4796200c235bd"
I20260709 12:15:09.205663 26497 ts_tablet_manager.cc:1403] T 739b1449642e40fb84a22a155ce21e59 P 47ec5c2bfdd24b1eb2a906f63214876e: Time spent bootstrapping tablet: real 0.032s	user 0.010s	sys 0.000s
I20260709 12:15:09.206167 26359 raft_consensus.cc:3060] T e18e3ddc9621480a960d88fb92a478c8 P 29ab82db4b2a4da39ed4796200c235bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:09.207312 26499 raft_consensus.cc:359] T e5a4343a89b74e2394864cfa1b2a45ab P b6ea3e3c1dd142c2a529707d9999b96d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:09.208277 26499 raft_consensus.cc:385] T e5a4343a89b74e2394864cfa1b2a45ab P b6ea3e3c1dd142c2a529707d9999b96d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:09.208561 26499 raft_consensus.cc:740] T e5a4343a89b74e2394864cfa1b2a45ab P b6ea3e3c1dd142c2a529707d9999b96d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6ea3e3c1dd142c2a529707d9999b96d, State: Initialized, Role: FOLLOWER
I20260709 12:15:09.208971 26497 raft_consensus.cc:359] T 739b1449642e40fb84a22a155ce21e59 P 47ec5c2bfdd24b1eb2a906f63214876e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:09.209787 26497 raft_consensus.cc:385] T 739b1449642e40fb84a22a155ce21e59 P 47ec5c2bfdd24b1eb2a906f63214876e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:09.209374 26499 consensus_queue.cc:260] T e5a4343a89b74e2394864cfa1b2a45ab P b6ea3e3c1dd142c2a529707d9999b96d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:09.210083 26497 raft_consensus.cc:740] T 739b1449642e40fb84a22a155ce21e59 P 47ec5c2bfdd24b1eb2a906f63214876e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47ec5c2bfdd24b1eb2a906f63214876e, State: Initialized, Role: FOLLOWER
I20260709 12:15:09.214936 26359 raft_consensus.cc:2468] T e18e3ddc9621480a960d88fb92a478c8 P 29ab82db4b2a4da39ed4796200c235bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47ec5c2bfdd24b1eb2a906f63214876e in term 1.
I20260709 12:15:09.219095 26249 leader_election.cc:304] T e18e3ddc9621480a960d88fb92a478c8 P 47ec5c2bfdd24b1eb2a906f63214876e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29ab82db4b2a4da39ed4796200c235bd, 47ec5c2bfdd24b1eb2a906f63214876e; no voters: b6ea3e3c1dd142c2a529707d9999b96d
I20260709 12:15:09.219146 26499 ts_tablet_manager.cc:1434] T e5a4343a89b74e2394864cfa1b2a45ab P b6ea3e3c1dd142c2a529707d9999b96d: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 12:15:09.219897 26538 raft_consensus.cc:2804] T e18e3ddc9621480a960d88fb92a478c8 P 47ec5c2bfdd24b1eb2a906f63214876e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:09.220503 26538 raft_consensus.cc:697] T e18e3ddc9621480a960d88fb92a478c8 P 47ec5c2bfdd24b1eb2a906f63214876e [term 1 LEADER]: Becoming Leader. State: Replica: 47ec5c2bfdd24b1eb2a906f63214876e, State: Running, Role: LEADER
I20260709 12:15:09.220561 26499 tablet_bootstrap.cc:492] T e18e3ddc9621480a960d88fb92a478c8 P b6ea3e3c1dd142c2a529707d9999b96d: Bootstrap starting.
I20260709 12:15:09.221463 26538 consensus_queue.cc:237] T e18e3ddc9621480a960d88fb92a478c8 P 47ec5c2bfdd24b1eb2a906f63214876e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:09.225680 26497 consensus_queue.cc:260] T 739b1449642e40fb84a22a155ce21e59 P 47ec5c2bfdd24b1eb2a906f63214876e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:09.228204 26497 ts_tablet_manager.cc:1434] T 739b1449642e40fb84a22a155ce21e59 P 47ec5c2bfdd24b1eb2a906f63214876e: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.004s
I20260709 12:15:09.229179 26499 tablet_bootstrap.cc:654] T e18e3ddc9621480a960d88fb92a478c8 P b6ea3e3c1dd142c2a529707d9999b96d: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:09.236714 26105 catalog_manager.cc:5697] T e18e3ddc9621480a960d88fb92a478c8 P 47ec5c2bfdd24b1eb2a906f63214876e reported cstate change: term changed from 0 to 1, leader changed from <none> to 47ec5c2bfdd24b1eb2a906f63214876e (127.12.174.130). New cstate: current_term: 1 leader_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:09.238567 26499 tablet_bootstrap.cc:492] T e18e3ddc9621480a960d88fb92a478c8 P b6ea3e3c1dd142c2a529707d9999b96d: No bootstrap required, opened a new log
I20260709 12:15:09.239112 26499 ts_tablet_manager.cc:1403] T e18e3ddc9621480a960d88fb92a478c8 P b6ea3e3c1dd142c2a529707d9999b96d: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.004s
I20260709 12:15:09.242378 26499 raft_consensus.cc:359] T e18e3ddc9621480a960d88fb92a478c8 P b6ea3e3c1dd142c2a529707d9999b96d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:09.243000 26499 raft_consensus.cc:385] T e18e3ddc9621480a960d88fb92a478c8 P b6ea3e3c1dd142c2a529707d9999b96d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:09.243242 26499 raft_consensus.cc:740] T e18e3ddc9621480a960d88fb92a478c8 P b6ea3e3c1dd142c2a529707d9999b96d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6ea3e3c1dd142c2a529707d9999b96d, State: Initialized, Role: FOLLOWER
I20260709 12:15:09.243839 26499 consensus_queue.cc:260] T e18e3ddc9621480a960d88fb92a478c8 P b6ea3e3c1dd142c2a529707d9999b96d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:09.245798 26499 ts_tablet_manager.cc:1434] T e18e3ddc9621480a960d88fb92a478c8 P b6ea3e3c1dd142c2a529707d9999b96d: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:15:09.247203 26499 tablet_bootstrap.cc:492] T 3be8e2e412f8465b83495d611f4b7ce2 P b6ea3e3c1dd142c2a529707d9999b96d: Bootstrap starting.
I20260709 12:15:09.253430 26499 tablet_bootstrap.cc:654] T 3be8e2e412f8465b83495d611f4b7ce2 P b6ea3e3c1dd142c2a529707d9999b96d: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:09.253866 26538 raft_consensus.cc:493] T 3be8e2e412f8465b83495d611f4b7ce2 P 47ec5c2bfdd24b1eb2a906f63214876e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:09.254496 26538 raft_consensus.cc:515] T 3be8e2e412f8465b83495d611f4b7ce2 P 47ec5c2bfdd24b1eb2a906f63214876e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:09.258179 26209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be8e2e412f8465b83495d611f4b7ce2" candidate_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" is_pre_election: true
W20260709 12:15:09.259930 26251 leader_election.cc:343] T 3be8e2e412f8465b83495d611f4b7ce2 P 47ec5c2bfdd24b1eb2a906f63214876e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b6ea3e3c1dd142c2a529707d9999b96d (127.12.174.129:34845): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:09.261062 26538 leader_election.cc:290] T 3be8e2e412f8465b83495d611f4b7ce2 P 47ec5c2bfdd24b1eb2a906f63214876e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6ea3e3c1dd142c2a529707d9999b96d (127.12.174.129:34845), 29ab82db4b2a4da39ed4796200c235bd (127.12.174.131:43279)
I20260709 12:15:09.261798 26499 tablet_bootstrap.cc:492] T 3be8e2e412f8465b83495d611f4b7ce2 P b6ea3e3c1dd142c2a529707d9999b96d: No bootstrap required, opened a new log
I20260709 12:15:09.262491 26499 ts_tablet_manager.cc:1403] T 3be8e2e412f8465b83495d611f4b7ce2 P b6ea3e3c1dd142c2a529707d9999b96d: Time spent bootstrapping tablet: real 0.016s	user 0.009s	sys 0.003s
I20260709 12:15:09.262413 26359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be8e2e412f8465b83495d611f4b7ce2" candidate_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29ab82db4b2a4da39ed4796200c235bd" is_pre_election: true
I20260709 12:15:09.263342 26359 raft_consensus.cc:2468] T 3be8e2e412f8465b83495d611f4b7ce2 P 29ab82db4b2a4da39ed4796200c235bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47ec5c2bfdd24b1eb2a906f63214876e in term 0.
I20260709 12:15:09.264525 26249 leader_election.cc:304] T 3be8e2e412f8465b83495d611f4b7ce2 P 47ec5c2bfdd24b1eb2a906f63214876e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29ab82db4b2a4da39ed4796200c235bd, 47ec5c2bfdd24b1eb2a906f63214876e; no voters: b6ea3e3c1dd142c2a529707d9999b96d
I20260709 12:15:09.265424 26538 raft_consensus.cc:2804] T 3be8e2e412f8465b83495d611f4b7ce2 P 47ec5c2bfdd24b1eb2a906f63214876e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:09.265775 26538 raft_consensus.cc:493] T 3be8e2e412f8465b83495d611f4b7ce2 P 47ec5c2bfdd24b1eb2a906f63214876e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:09.266079 26538 raft_consensus.cc:3060] T 3be8e2e412f8465b83495d611f4b7ce2 P 47ec5c2bfdd24b1eb2a906f63214876e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:09.266003 26499 raft_consensus.cc:359] T 3be8e2e412f8465b83495d611f4b7ce2 P b6ea3e3c1dd142c2a529707d9999b96d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:09.266841 26499 raft_consensus.cc:385] T 3be8e2e412f8465b83495d611f4b7ce2 P b6ea3e3c1dd142c2a529707d9999b96d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:09.267110 26499 raft_consensus.cc:740] T 3be8e2e412f8465b83495d611f4b7ce2 P b6ea3e3c1dd142c2a529707d9999b96d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6ea3e3c1dd142c2a529707d9999b96d, State: Initialized, Role: FOLLOWER
I20260709 12:15:09.267760 26499 consensus_queue.cc:260] T 3be8e2e412f8465b83495d611f4b7ce2 P b6ea3e3c1dd142c2a529707d9999b96d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:09.269611 26499 ts_tablet_manager.cc:1434] T 3be8e2e412f8465b83495d611f4b7ce2 P b6ea3e3c1dd142c2a529707d9999b96d: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.000s
I20260709 12:15:09.270717 26499 tablet_bootstrap.cc:492] T 739b1449642e40fb84a22a155ce21e59 P b6ea3e3c1dd142c2a529707d9999b96d: Bootstrap starting.
I20260709 12:15:09.273650 26524 raft_consensus.cc:493] T e5a4343a89b74e2394864cfa1b2a45ab P 29ab82db4b2a4da39ed4796200c235bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:09.273654 26538 raft_consensus.cc:515] T 3be8e2e412f8465b83495d611f4b7ce2 P 47ec5c2bfdd24b1eb2a906f63214876e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:09.274449 26524 raft_consensus.cc:515] T e5a4343a89b74e2394864cfa1b2a45ab P 29ab82db4b2a4da39ed4796200c235bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:09.276425 26499 tablet_bootstrap.cc:654] T 739b1449642e40fb84a22a155ce21e59 P b6ea3e3c1dd142c2a529707d9999b96d: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:09.276826 26524 leader_election.cc:290] T e5a4343a89b74e2394864cfa1b2a45ab P 29ab82db4b2a4da39ed4796200c235bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6ea3e3c1dd142c2a529707d9999b96d (127.12.174.129:34845), 47ec5c2bfdd24b1eb2a906f63214876e (127.12.174.130:43337)
I20260709 12:15:09.277582 26209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be8e2e412f8465b83495d611f4b7ce2" candidate_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6ea3e3c1dd142c2a529707d9999b96d"
I20260709 12:15:09.278317 26209 raft_consensus.cc:3060] T 3be8e2e412f8465b83495d611f4b7ce2 P b6ea3e3c1dd142c2a529707d9999b96d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:09.283075 26210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a4343a89b74e2394864cfa1b2a45ab" candidate_uuid: "29ab82db4b2a4da39ed4796200c235bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" is_pre_election: true
I20260709 12:15:09.284189 26210 raft_consensus.cc:2468] T e5a4343a89b74e2394864cfa1b2a45ab P b6ea3e3c1dd142c2a529707d9999b96d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29ab82db4b2a4da39ed4796200c235bd in term 0.
I20260709 12:15:09.283075 26285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a4343a89b74e2394864cfa1b2a45ab" candidate_uuid: "29ab82db4b2a4da39ed4796200c235bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" is_pre_election: true
I20260709 12:15:09.285504 26285 raft_consensus.cc:2468] T e5a4343a89b74e2394864cfa1b2a45ab P 47ec5c2bfdd24b1eb2a906f63214876e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29ab82db4b2a4da39ed4796200c235bd in term 0.
I20260709 12:15:09.285518 26325 leader_election.cc:304] T e5a4343a89b74e2394864cfa1b2a45ab P 29ab82db4b2a4da39ed4796200c235bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29ab82db4b2a4da39ed4796200c235bd, b6ea3e3c1dd142c2a529707d9999b96d; no voters: 
I20260709 12:15:09.287068 26524 raft_consensus.cc:2804] T e5a4343a89b74e2394864cfa1b2a45ab P 29ab82db4b2a4da39ed4796200c235bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:09.287567 26524 raft_consensus.cc:493] T e5a4343a89b74e2394864cfa1b2a45ab P 29ab82db4b2a4da39ed4796200c235bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:09.287981 26524 raft_consensus.cc:3060] T e5a4343a89b74e2394864cfa1b2a45ab P 29ab82db4b2a4da39ed4796200c235bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:09.290462 26538 leader_election.cc:290] T 3be8e2e412f8465b83495d611f4b7ce2 P 47ec5c2bfdd24b1eb2a906f63214876e [CANDIDATE]: Term 1 election: Requested vote from peers b6ea3e3c1dd142c2a529707d9999b96d (127.12.174.129:34845), 29ab82db4b2a4da39ed4796200c235bd (127.12.174.131:43279)
I20260709 12:15:09.291824 26359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be8e2e412f8465b83495d611f4b7ce2" candidate_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29ab82db4b2a4da39ed4796200c235bd"
I20260709 12:15:09.292155 26499 tablet_bootstrap.cc:492] T 739b1449642e40fb84a22a155ce21e59 P b6ea3e3c1dd142c2a529707d9999b96d: No bootstrap required, opened a new log
I20260709 12:15:09.292322 26209 raft_consensus.cc:2468] T 3be8e2e412f8465b83495d611f4b7ce2 P b6ea3e3c1dd142c2a529707d9999b96d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47ec5c2bfdd24b1eb2a906f63214876e in term 1.
I20260709 12:15:09.292603 26359 raft_consensus.cc:3060] T 3be8e2e412f8465b83495d611f4b7ce2 P 29ab82db4b2a4da39ed4796200c235bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:09.292814 26499 ts_tablet_manager.cc:1403] T 739b1449642e40fb84a22a155ce21e59 P b6ea3e3c1dd142c2a529707d9999b96d: Time spent bootstrapping tablet: real 0.022s	user 0.013s	sys 0.008s
I20260709 12:15:09.293815 26251 leader_election.cc:304] T 3be8e2e412f8465b83495d611f4b7ce2 P 47ec5c2bfdd24b1eb2a906f63214876e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47ec5c2bfdd24b1eb2a906f63214876e, b6ea3e3c1dd142c2a529707d9999b96d; no voters: 
I20260709 12:15:09.294917 26538 raft_consensus.cc:2804] T 3be8e2e412f8465b83495d611f4b7ce2 P 47ec5c2bfdd24b1eb2a906f63214876e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:09.295627 26538 raft_consensus.cc:697] T 3be8e2e412f8465b83495d611f4b7ce2 P 47ec5c2bfdd24b1eb2a906f63214876e [term 1 LEADER]: Becoming Leader. State: Replica: 47ec5c2bfdd24b1eb2a906f63214876e, State: Running, Role: LEADER
I20260709 12:15:09.296173 26499 raft_consensus.cc:359] T 739b1449642e40fb84a22a155ce21e59 P b6ea3e3c1dd142c2a529707d9999b96d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:09.297050 26499 raft_consensus.cc:385] T 739b1449642e40fb84a22a155ce21e59 P b6ea3e3c1dd142c2a529707d9999b96d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:09.297356 26499 raft_consensus.cc:740] T 739b1449642e40fb84a22a155ce21e59 P b6ea3e3c1dd142c2a529707d9999b96d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6ea3e3c1dd142c2a529707d9999b96d, State: Initialized, Role: FOLLOWER
I20260709 12:15:09.296869 26538 consensus_queue.cc:237] T 3be8e2e412f8465b83495d611f4b7ce2 P 47ec5c2bfdd24b1eb2a906f63214876e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:09.298209 26499 consensus_queue.cc:260] T 739b1449642e40fb84a22a155ce21e59 P b6ea3e3c1dd142c2a529707d9999b96d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:09.301131 26499 ts_tablet_manager.cc:1434] T 739b1449642e40fb84a22a155ce21e59 P b6ea3e3c1dd142c2a529707d9999b96d: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:15:09.302666 26359 raft_consensus.cc:2468] T 3be8e2e412f8465b83495d611f4b7ce2 P 29ab82db4b2a4da39ed4796200c235bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47ec5c2bfdd24b1eb2a906f63214876e in term 1.
I20260709 12:15:09.305549 26524 raft_consensus.cc:515] T e5a4343a89b74e2394864cfa1b2a45ab P 29ab82db4b2a4da39ed4796200c235bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:09.310954 26524 leader_election.cc:290] T e5a4343a89b74e2394864cfa1b2a45ab P 29ab82db4b2a4da39ed4796200c235bd [CANDIDATE]: Term 1 election: Requested vote from peers b6ea3e3c1dd142c2a529707d9999b96d (127.12.174.129:34845), 47ec5c2bfdd24b1eb2a906f63214876e (127.12.174.130:43337)
I20260709 12:15:09.311318 26209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a4343a89b74e2394864cfa1b2a45ab" candidate_uuid: "29ab82db4b2a4da39ed4796200c235bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6ea3e3c1dd142c2a529707d9999b96d"
I20260709 12:15:09.311964 26209 raft_consensus.cc:3060] T e5a4343a89b74e2394864cfa1b2a45ab P b6ea3e3c1dd142c2a529707d9999b96d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:09.313551 26285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a4343a89b74e2394864cfa1b2a45ab" candidate_uuid: "29ab82db4b2a4da39ed4796200c235bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47ec5c2bfdd24b1eb2a906f63214876e"
I20260709 12:15:09.314388 26285 raft_consensus.cc:3060] T e5a4343a89b74e2394864cfa1b2a45ab P 47ec5c2bfdd24b1eb2a906f63214876e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:09.314632 26530 raft_consensus.cc:493] T e18e3ddc9621480a960d88fb92a478c8 P b6ea3e3c1dd142c2a529707d9999b96d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:09.315169 26530 raft_consensus.cc:515] T e18e3ddc9621480a960d88fb92a478c8 P b6ea3e3c1dd142c2a529707d9999b96d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:09.317373 26530 leader_election.cc:290] T e18e3ddc9621480a960d88fb92a478c8 P b6ea3e3c1dd142c2a529707d9999b96d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 47ec5c2bfdd24b1eb2a906f63214876e (127.12.174.130:43337), 29ab82db4b2a4da39ed4796200c235bd (127.12.174.131:43279)
I20260709 12:15:09.318456 26283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e18e3ddc9621480a960d88fb92a478c8" candidate_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" is_pre_election: true
I20260709 12:15:09.313689 26105 catalog_manager.cc:5697] T 3be8e2e412f8465b83495d611f4b7ce2 P 47ec5c2bfdd24b1eb2a906f63214876e reported cstate change: term changed from 0 to 1, leader changed from <none> to 47ec5c2bfdd24b1eb2a906f63214876e (127.12.174.130). New cstate: current_term: 1 leader_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:09.321807 26359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e18e3ddc9621480a960d88fb92a478c8" candidate_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29ab82db4b2a4da39ed4796200c235bd" is_pre_election: true
I20260709 12:15:09.322741 26359 raft_consensus.cc:2393] T e18e3ddc9621480a960d88fb92a478c8 P 29ab82db4b2a4da39ed4796200c235bd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b6ea3e3c1dd142c2a529707d9999b96d in current term 1: Already voted for candidate 47ec5c2bfdd24b1eb2a906f63214876e in this term.
I20260709 12:15:09.322640 26209 raft_consensus.cc:2468] T e5a4343a89b74e2394864cfa1b2a45ab P b6ea3e3c1dd142c2a529707d9999b96d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29ab82db4b2a4da39ed4796200c235bd in term 1.
I20260709 12:15:09.323725 26285 raft_consensus.cc:2468] T e5a4343a89b74e2394864cfa1b2a45ab P 47ec5c2bfdd24b1eb2a906f63214876e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29ab82db4b2a4da39ed4796200c235bd in term 1.
I20260709 12:15:09.325048 26322 leader_election.cc:304] T e5a4343a89b74e2394864cfa1b2a45ab P 29ab82db4b2a4da39ed4796200c235bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29ab82db4b2a4da39ed4796200c235bd, 47ec5c2bfdd24b1eb2a906f63214876e; no voters: 
I20260709 12:15:09.325773 26174 leader_election.cc:304] T e18e3ddc9621480a960d88fb92a478c8 P b6ea3e3c1dd142c2a529707d9999b96d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b6ea3e3c1dd142c2a529707d9999b96d; no voters: 29ab82db4b2a4da39ed4796200c235bd, 47ec5c2bfdd24b1eb2a906f63214876e
I20260709 12:15:09.325970 26524 raft_consensus.cc:2804] T e5a4343a89b74e2394864cfa1b2a45ab P 29ab82db4b2a4da39ed4796200c235bd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:09.326546 26530 raft_consensus.cc:3060] T e18e3ddc9621480a960d88fb92a478c8 P b6ea3e3c1dd142c2a529707d9999b96d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:09.327447 26524 raft_consensus.cc:697] T e5a4343a89b74e2394864cfa1b2a45ab P 29ab82db4b2a4da39ed4796200c235bd [term 1 LEADER]: Becoming Leader. State: Replica: 29ab82db4b2a4da39ed4796200c235bd, State: Running, Role: LEADER
I20260709 12:15:09.328397 26524 consensus_queue.cc:237] T e5a4343a89b74e2394864cfa1b2a45ab P 29ab82db4b2a4da39ed4796200c235bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:09.336052 26530 raft_consensus.cc:2749] T e18e3ddc9621480a960d88fb92a478c8 P b6ea3e3c1dd142c2a529707d9999b96d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:09.338337 26105 catalog_manager.cc:5697] T e5a4343a89b74e2394864cfa1b2a45ab P 29ab82db4b2a4da39ed4796200c235bd reported cstate change: term changed from 0 to 1, leader changed from <none> to 29ab82db4b2a4da39ed4796200c235bd (127.12.174.131). New cstate: current_term: 1 leader_uuid: "29ab82db4b2a4da39ed4796200c235bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:09.355960 26524 raft_consensus.cc:493] T 739b1449642e40fb84a22a155ce21e59 P 29ab82db4b2a4da39ed4796200c235bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:09.356580 26524 raft_consensus.cc:515] T 739b1449642e40fb84a22a155ce21e59 P 29ab82db4b2a4da39ed4796200c235bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:09.358530 26524 leader_election.cc:290] T 739b1449642e40fb84a22a155ce21e59 P 29ab82db4b2a4da39ed4796200c235bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6ea3e3c1dd142c2a529707d9999b96d (127.12.174.129:34845), 47ec5c2bfdd24b1eb2a906f63214876e (127.12.174.130:43337)
I20260709 12:15:09.359549 26209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739b1449642e40fb84a22a155ce21e59" candidate_uuid: "29ab82db4b2a4da39ed4796200c235bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" is_pre_election: true
I20260709 12:15:09.359766 26285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739b1449642e40fb84a22a155ce21e59" candidate_uuid: "29ab82db4b2a4da39ed4796200c235bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" is_pre_election: true
I20260709 12:15:09.360262 26209 raft_consensus.cc:2468] T 739b1449642e40fb84a22a155ce21e59 P b6ea3e3c1dd142c2a529707d9999b96d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29ab82db4b2a4da39ed4796200c235bd in term 0.
I20260709 12:15:09.360421 26285 raft_consensus.cc:2468] T 739b1449642e40fb84a22a155ce21e59 P 47ec5c2bfdd24b1eb2a906f63214876e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29ab82db4b2a4da39ed4796200c235bd in term 0.
I20260709 12:15:09.361338 26325 leader_election.cc:304] T 739b1449642e40fb84a22a155ce21e59 P 29ab82db4b2a4da39ed4796200c235bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29ab82db4b2a4da39ed4796200c235bd, b6ea3e3c1dd142c2a529707d9999b96d; no voters: 
I20260709 12:15:09.362241 26524 raft_consensus.cc:2804] T 739b1449642e40fb84a22a155ce21e59 P 29ab82db4b2a4da39ed4796200c235bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:09.362622 26524 raft_consensus.cc:493] T 739b1449642e40fb84a22a155ce21e59 P 29ab82db4b2a4da39ed4796200c235bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:09.362875 26524 raft_consensus.cc:3060] T 739b1449642e40fb84a22a155ce21e59 P 29ab82db4b2a4da39ed4796200c235bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:09.369266 26524 raft_consensus.cc:515] T 739b1449642e40fb84a22a155ce21e59 P 29ab82db4b2a4da39ed4796200c235bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:09.371212 26524 leader_election.cc:290] T 739b1449642e40fb84a22a155ce21e59 P 29ab82db4b2a4da39ed4796200c235bd [CANDIDATE]: Term 1 election: Requested vote from peers b6ea3e3c1dd142c2a529707d9999b96d (127.12.174.129:34845), 47ec5c2bfdd24b1eb2a906f63214876e (127.12.174.130:43337)
I20260709 12:15:09.372192 26209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739b1449642e40fb84a22a155ce21e59" candidate_uuid: "29ab82db4b2a4da39ed4796200c235bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6ea3e3c1dd142c2a529707d9999b96d"
I20260709 12:15:09.372392 26285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "739b1449642e40fb84a22a155ce21e59" candidate_uuid: "29ab82db4b2a4da39ed4796200c235bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47ec5c2bfdd24b1eb2a906f63214876e"
I20260709 12:15:09.372845 26209 raft_consensus.cc:3060] T 739b1449642e40fb84a22a155ce21e59 P b6ea3e3c1dd142c2a529707d9999b96d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:09.373041 26285 raft_consensus.cc:3060] T 739b1449642e40fb84a22a155ce21e59 P 47ec5c2bfdd24b1eb2a906f63214876e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:09.379323 26209 raft_consensus.cc:2468] T 739b1449642e40fb84a22a155ce21e59 P b6ea3e3c1dd142c2a529707d9999b96d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29ab82db4b2a4da39ed4796200c235bd in term 1.
I20260709 12:15:09.379441 26285 raft_consensus.cc:2468] T 739b1449642e40fb84a22a155ce21e59 P 47ec5c2bfdd24b1eb2a906f63214876e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29ab82db4b2a4da39ed4796200c235bd in term 1.
I20260709 12:15:09.380769 26325 leader_election.cc:304] T 739b1449642e40fb84a22a155ce21e59 P 29ab82db4b2a4da39ed4796200c235bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29ab82db4b2a4da39ed4796200c235bd, b6ea3e3c1dd142c2a529707d9999b96d; no voters: 
I20260709 12:15:09.381507 26524 raft_consensus.cc:2804] T 739b1449642e40fb84a22a155ce21e59 P 29ab82db4b2a4da39ed4796200c235bd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:09.381989 26524 raft_consensus.cc:697] T 739b1449642e40fb84a22a155ce21e59 P 29ab82db4b2a4da39ed4796200c235bd [term 1 LEADER]: Becoming Leader. State: Replica: 29ab82db4b2a4da39ed4796200c235bd, State: Running, Role: LEADER
I20260709 12:15:09.382802 26524 consensus_queue.cc:237] T 739b1449642e40fb84a22a155ce21e59 P 29ab82db4b2a4da39ed4796200c235bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:09.390460 26524 consensus_queue.cc:1048] T f31c0326c2bb48958872433822c1aa7c P 29ab82db4b2a4da39ed4796200c235bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:09.393167 26105 catalog_manager.cc:5697] T 739b1449642e40fb84a22a155ce21e59 P 29ab82db4b2a4da39ed4796200c235bd reported cstate change: term changed from 0 to 1, leader changed from <none> to 29ab82db4b2a4da39ed4796200c235bd (127.12.174.131). New cstate: current_term: 1 leader_uuid: "29ab82db4b2a4da39ed4796200c235bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:09.405426 26524 consensus_queue.cc:1048] T f31c0326c2bb48958872433822c1aa7c P 29ab82db4b2a4da39ed4796200c235bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:09.494920 26524 consensus_queue.cc:1048] T e904f17eeb0846d3a6cefab2b07e3b4a P 29ab82db4b2a4da39ed4796200c235bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:09.502750 26530 consensus_queue.cc:1048] T ef313d7b9e734aae93e2ed571944bbaa P b6ea3e3c1dd142c2a529707d9999b96d [LEADER]: Connected to new peer: Peer: permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:09.510298 26523 consensus_queue.cc:1048] T d80bd7c3354c472eaaaf49cdd958e470 P 29ab82db4b2a4da39ed4796200c235bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:09.512964 26359 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e904f17eeb0846d3a6cefab2b07e3b4a"
dest_uuid: "29ab82db4b2a4da39ed4796200c235bd"
mode: GRACEFUL
new_leader_uuid: "b6ea3e3c1dd142c2a529707d9999b96d"
 from {username='slave'} at 127.0.0.1:42050
I20260709 12:15:09.514219 26359 raft_consensus.cc:606] T e904f17eeb0846d3a6cefab2b07e3b4a P 29ab82db4b2a4da39ed4796200c235bd [term 1 LEADER]: Received request to transfer leadership to TS b6ea3e3c1dd142c2a529707d9999b96d
I20260709 12:15:09.518790 26523 consensus_queue.cc:1048] T e904f17eeb0846d3a6cefab2b07e3b4a P 29ab82db4b2a4da39ed4796200c235bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:09.523429 26515 raft_consensus.cc:993] T e904f17eeb0846d3a6cefab2b07e3b4a P 29ab82db4b2a4da39ed4796200c235bd: : Instructing follower b6ea3e3c1dd142c2a529707d9999b96d to start an election
I20260709 12:15:09.523947 26515 raft_consensus.cc:1081] T e904f17eeb0846d3a6cefab2b07e3b4a P 29ab82db4b2a4da39ed4796200c235bd [term 1 LEADER]: Signalling peer b6ea3e3c1dd142c2a529707d9999b96d to start an election
I20260709 12:15:09.528952 26209 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e904f17eeb0846d3a6cefab2b07e3b4a"
dest_uuid: "b6ea3e3c1dd142c2a529707d9999b96d"
 from {username='slave'} at 127.0.0.1:48146
I20260709 12:15:09.529624 26209 raft_consensus.cc:493] T e904f17eeb0846d3a6cefab2b07e3b4a P b6ea3e3c1dd142c2a529707d9999b96d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:09.530102 26209 raft_consensus.cc:3060] T e904f17eeb0846d3a6cefab2b07e3b4a P b6ea3e3c1dd142c2a529707d9999b96d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:09.531075 26359 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f31c0326c2bb48958872433822c1aa7c"
dest_uuid: "29ab82db4b2a4da39ed4796200c235bd"
mode: GRACEFUL
new_leader_uuid: "b6ea3e3c1dd142c2a529707d9999b96d"
 from {username='slave'} at 127.0.0.1:42050
I20260709 12:15:09.531903 26359 raft_consensus.cc:606] T f31c0326c2bb48958872433822c1aa7c P 29ab82db4b2a4da39ed4796200c235bd [term 1 LEADER]: Received request to transfer leadership to TS b6ea3e3c1dd142c2a529707d9999b96d
I20260709 12:15:09.540894 26359 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ed22621a01e740fdb61fe0db7e9c77c6"
dest_uuid: "29ab82db4b2a4da39ed4796200c235bd"
mode: GRACEFUL
new_leader_uuid: "b6ea3e3c1dd142c2a529707d9999b96d"
 from {username='slave'} at 127.0.0.1:42050
I20260709 12:15:09.541707 26359 raft_consensus.cc:606] T ed22621a01e740fdb61fe0db7e9c77c6 P 29ab82db4b2a4da39ed4796200c235bd [term 1 LEADER]: Received request to transfer leadership to TS b6ea3e3c1dd142c2a529707d9999b96d
I20260709 12:15:09.547982 26515 consensus_queue.cc:1048] T d80bd7c3354c472eaaaf49cdd958e470 P 29ab82db4b2a4da39ed4796200c235bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:09.560577 26504 consensus_queue.cc:1048] T ef313d7b9e734aae93e2ed571944bbaa P b6ea3e3c1dd142c2a529707d9999b96d [LEADER]: Connected to new peer: Peer: permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:09.568202 26357 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d80bd7c3354c472eaaaf49cdd958e470"
dest_uuid: "29ab82db4b2a4da39ed4796200c235bd"
mode: GRACEFUL
new_leader_uuid: "b6ea3e3c1dd142c2a529707d9999b96d"
 from {username='slave'} at 127.0.0.1:42050
I20260709 12:15:09.568078 26209 raft_consensus.cc:515] T e904f17eeb0846d3a6cefab2b07e3b4a P b6ea3e3c1dd142c2a529707d9999b96d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:09.569096 26357 raft_consensus.cc:606] T d80bd7c3354c472eaaaf49cdd958e470 P 29ab82db4b2a4da39ed4796200c235bd [term 1 LEADER]: Received request to transfer leadership to TS b6ea3e3c1dd142c2a529707d9999b96d
I20260709 12:15:09.570706 26209 leader_election.cc:290] T e904f17eeb0846d3a6cefab2b07e3b4a P b6ea3e3c1dd142c2a529707d9999b96d [CANDIDATE]: Term 2 election: Requested vote from peers 47ec5c2bfdd24b1eb2a906f63214876e (127.12.174.130:43337), 29ab82db4b2a4da39ed4796200c235bd (127.12.174.131:43279)
I20260709 12:15:09.573961 26285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e904f17eeb0846d3a6cefab2b07e3b4a" candidate_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "47ec5c2bfdd24b1eb2a906f63214876e"
I20260709 12:15:09.574677 26285 raft_consensus.cc:3060] T e904f17eeb0846d3a6cefab2b07e3b4a P 47ec5c2bfdd24b1eb2a906f63214876e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:09.575587 26357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e904f17eeb0846d3a6cefab2b07e3b4a" candidate_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "29ab82db4b2a4da39ed4796200c235bd"
I20260709 12:15:09.576253 26357 raft_consensus.cc:3055] T e904f17eeb0846d3a6cefab2b07e3b4a P 29ab82db4b2a4da39ed4796200c235bd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:09.576586 26357 raft_consensus.cc:740] T e904f17eeb0846d3a6cefab2b07e3b4a P 29ab82db4b2a4da39ed4796200c235bd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 29ab82db4b2a4da39ed4796200c235bd, State: Running, Role: LEADER
I20260709 12:15:09.578379 26357 consensus_queue.cc:260] T e904f17eeb0846d3a6cefab2b07e3b4a P 29ab82db4b2a4da39ed4796200c235bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:09.580010 26357 raft_consensus.cc:3060] T e904f17eeb0846d3a6cefab2b07e3b4a P 29ab82db4b2a4da39ed4796200c235bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:09.585337 26285 raft_consensus.cc:2468] T e904f17eeb0846d3a6cefab2b07e3b4a P 47ec5c2bfdd24b1eb2a906f63214876e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6ea3e3c1dd142c2a529707d9999b96d in term 2.
I20260709 12:15:09.586687 26173 leader_election.cc:304] T e904f17eeb0846d3a6cefab2b07e3b4a P b6ea3e3c1dd142c2a529707d9999b96d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47ec5c2bfdd24b1eb2a906f63214876e, b6ea3e3c1dd142c2a529707d9999b96d; no voters: 
I20260709 12:15:09.587984 26504 raft_consensus.cc:2804] T e904f17eeb0846d3a6cefab2b07e3b4a P b6ea3e3c1dd142c2a529707d9999b96d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:09.588698 26504 raft_consensus.cc:697] T e904f17eeb0846d3a6cefab2b07e3b4a P b6ea3e3c1dd142c2a529707d9999b96d [term 2 LEADER]: Becoming Leader. State: Replica: b6ea3e3c1dd142c2a529707d9999b96d, State: Running, Role: LEADER
I20260709 12:15:09.589561 26504 consensus_queue.cc:237] T e904f17eeb0846d3a6cefab2b07e3b4a P b6ea3e3c1dd142c2a529707d9999b96d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:09.595397 26357 raft_consensus.cc:2468] T e904f17eeb0846d3a6cefab2b07e3b4a P 29ab82db4b2a4da39ed4796200c235bd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6ea3e3c1dd142c2a529707d9999b96d in term 2.
I20260709 12:15:09.599162 26209 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ef313d7b9e734aae93e2ed571944bbaa"
dest_uuid: "b6ea3e3c1dd142c2a529707d9999b96d"
mode: GRACEFUL
new_leader_uuid: "47ec5c2bfdd24b1eb2a906f63214876e"
 from {username='slave'} at 127.0.0.1:48158
I20260709 12:15:09.599927 26209 raft_consensus.cc:606] T ef313d7b9e734aae93e2ed571944bbaa P b6ea3e3c1dd142c2a529707d9999b96d [term 1 LEADER]: Received request to transfer leadership to TS 47ec5c2bfdd24b1eb2a906f63214876e
I20260709 12:15:09.604231 26107 catalog_manager.cc:5697] T e904f17eeb0846d3a6cefab2b07e3b4a P b6ea3e3c1dd142c2a529707d9999b96d reported cstate change: term changed from 1 to 2, leader changed from 29ab82db4b2a4da39ed4796200c235bd (127.12.174.131) to b6ea3e3c1dd142c2a529707d9999b96d (127.12.174.129). New cstate: current_term: 2 leader_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:09.609331 26359 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e5a4343a89b74e2394864cfa1b2a45ab"
dest_uuid: "29ab82db4b2a4da39ed4796200c235bd"
mode: GRACEFUL
new_leader_uuid: "47ec5c2bfdd24b1eb2a906f63214876e"
 from {username='slave'} at 127.0.0.1:42050
I20260709 12:15:09.610525 26359 raft_consensus.cc:606] T e5a4343a89b74e2394864cfa1b2a45ab P 29ab82db4b2a4da39ed4796200c235bd [term 1 LEADER]: Received request to transfer leadership to TS 47ec5c2bfdd24b1eb2a906f63214876e
I20260709 12:15:09.659586 26503 consensus_queue.cc:1048] T e18e3ddc9621480a960d88fb92a478c8 P 47ec5c2bfdd24b1eb2a906f63214876e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:09.670665 26503 consensus_queue.cc:1048] T e18e3ddc9621480a960d88fb92a478c8 P 47ec5c2bfdd24b1eb2a906f63214876e [LEADER]: Connected to new peer: Peer: permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:09.737869 26515 consensus_queue.cc:1048] T ed22621a01e740fdb61fe0db7e9c77c6 P 29ab82db4b2a4da39ed4796200c235bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:09.745523 26523 raft_consensus.cc:993] T ed22621a01e740fdb61fe0db7e9c77c6 P 29ab82db4b2a4da39ed4796200c235bd: : Instructing follower b6ea3e3c1dd142c2a529707d9999b96d to start an election
I20260709 12:15:09.746076 26524 raft_consensus.cc:1081] T ed22621a01e740fdb61fe0db7e9c77c6 P 29ab82db4b2a4da39ed4796200c235bd [term 1 LEADER]: Signalling peer b6ea3e3c1dd142c2a529707d9999b96d to start an election
I20260709 12:15:09.748036 26208 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ed22621a01e740fdb61fe0db7e9c77c6"
dest_uuid: "b6ea3e3c1dd142c2a529707d9999b96d"
 from {username='slave'} at 127.0.0.1:48146
I20260709 12:15:09.749254 26208 raft_consensus.cc:493] T ed22621a01e740fdb61fe0db7e9c77c6 P b6ea3e3c1dd142c2a529707d9999b96d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:09.749670 26208 raft_consensus.cc:3060] T ed22621a01e740fdb61fe0db7e9c77c6 P b6ea3e3c1dd142c2a529707d9999b96d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:09.751252 26523 consensus_queue.cc:1048] T ed22621a01e740fdb61fe0db7e9c77c6 P 29ab82db4b2a4da39ed4796200c235bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:09.758721 26208 raft_consensus.cc:515] T ed22621a01e740fdb61fe0db7e9c77c6 P b6ea3e3c1dd142c2a529707d9999b96d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:09.762813 26208 leader_election.cc:290] T ed22621a01e740fdb61fe0db7e9c77c6 P b6ea3e3c1dd142c2a529707d9999b96d [CANDIDATE]: Term 2 election: Requested vote from peers 47ec5c2bfdd24b1eb2a906f63214876e (127.12.174.130:43337), 29ab82db4b2a4da39ed4796200c235bd (127.12.174.131:43279)
I20260709 12:15:09.762943 26285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed22621a01e740fdb61fe0db7e9c77c6" candidate_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "47ec5c2bfdd24b1eb2a906f63214876e"
I20260709 12:15:09.763000 26359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed22621a01e740fdb61fe0db7e9c77c6" candidate_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "29ab82db4b2a4da39ed4796200c235bd"
I20260709 12:15:09.763913 26285 raft_consensus.cc:3060] T ed22621a01e740fdb61fe0db7e9c77c6 P 47ec5c2bfdd24b1eb2a906f63214876e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:09.764001 26359 raft_consensus.cc:3055] T ed22621a01e740fdb61fe0db7e9c77c6 P 29ab82db4b2a4da39ed4796200c235bd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:09.764496 26359 raft_consensus.cc:740] T ed22621a01e740fdb61fe0db7e9c77c6 P 29ab82db4b2a4da39ed4796200c235bd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 29ab82db4b2a4da39ed4796200c235bd, State: Running, Role: LEADER
I20260709 12:15:09.765395 26359 consensus_queue.cc:260] T ed22621a01e740fdb61fe0db7e9c77c6 P 29ab82db4b2a4da39ed4796200c235bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:09.766875 26359 raft_consensus.cc:3060] T ed22621a01e740fdb61fe0db7e9c77c6 P 29ab82db4b2a4da39ed4796200c235bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:09.772205 26285 raft_consensus.cc:2468] T ed22621a01e740fdb61fe0db7e9c77c6 P 47ec5c2bfdd24b1eb2a906f63214876e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6ea3e3c1dd142c2a529707d9999b96d in term 2.
I20260709 12:15:09.773567 26173 leader_election.cc:304] T ed22621a01e740fdb61fe0db7e9c77c6 P b6ea3e3c1dd142c2a529707d9999b96d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47ec5c2bfdd24b1eb2a906f63214876e, b6ea3e3c1dd142c2a529707d9999b96d; no voters: 
I20260709 12:15:09.774477 26504 raft_consensus.cc:2804] T ed22621a01e740fdb61fe0db7e9c77c6 P b6ea3e3c1dd142c2a529707d9999b96d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:09.774536 26359 raft_consensus.cc:2468] T ed22621a01e740fdb61fe0db7e9c77c6 P 29ab82db4b2a4da39ed4796200c235bd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6ea3e3c1dd142c2a529707d9999b96d in term 2.
I20260709 12:15:09.775008 26504 raft_consensus.cc:697] T ed22621a01e740fdb61fe0db7e9c77c6 P b6ea3e3c1dd142c2a529707d9999b96d [term 2 LEADER]: Becoming Leader. State: Replica: b6ea3e3c1dd142c2a529707d9999b96d, State: Running, Role: LEADER
I20260709 12:15:09.775910 26504 consensus_queue.cc:237] T ed22621a01e740fdb61fe0db7e9c77c6 P b6ea3e3c1dd142c2a529707d9999b96d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:09.779320 26503 consensus_queue.cc:1048] T 3be8e2e412f8465b83495d611f4b7ce2 P 47ec5c2bfdd24b1eb2a906f63214876e [LEADER]: Connected to new peer: Peer: permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:09.785897 26108 catalog_manager.cc:5697] T ed22621a01e740fdb61fe0db7e9c77c6 P b6ea3e3c1dd142c2a529707d9999b96d reported cstate change: term changed from 1 to 2, leader changed from 29ab82db4b2a4da39ed4796200c235bd (127.12.174.131) to b6ea3e3c1dd142c2a529707d9999b96d (127.12.174.129). New cstate: current_term: 2 leader_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:09.787750 26524 consensus_queue.cc:1048] T 739b1449642e40fb84a22a155ce21e59 P 29ab82db4b2a4da39ed4796200c235bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:09.790621 26563 consensus_queue.cc:1048] T 3be8e2e412f8465b83495d611f4b7ce2 P 47ec5c2bfdd24b1eb2a906f63214876e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:09.813906 26512 consensus_queue.cc:1048] T 739b1449642e40fb84a22a155ce21e59 P 29ab82db4b2a4da39ed4796200c235bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:09.924350 26515 consensus_queue.cc:1048] T e5a4343a89b74e2394864cfa1b2a45ab P 29ab82db4b2a4da39ed4796200c235bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:09.940429 26523 consensus_queue.cc:1048] T e5a4343a89b74e2394864cfa1b2a45ab P 29ab82db4b2a4da39ed4796200c235bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:09.950717 26515 raft_consensus.cc:993] T e5a4343a89b74e2394864cfa1b2a45ab P 29ab82db4b2a4da39ed4796200c235bd: : Instructing follower 47ec5c2bfdd24b1eb2a906f63214876e to start an election
I20260709 12:15:09.951313 26523 raft_consensus.cc:1081] T e5a4343a89b74e2394864cfa1b2a45ab P 29ab82db4b2a4da39ed4796200c235bd [term 1 LEADER]: Signalling peer 47ec5c2bfdd24b1eb2a906f63214876e to start an election
I20260709 12:15:09.953318 26285 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e5a4343a89b74e2394864cfa1b2a45ab"
dest_uuid: "47ec5c2bfdd24b1eb2a906f63214876e"
 from {username='slave'} at 127.0.0.1:52698
I20260709 12:15:09.954005 26285 raft_consensus.cc:493] T e5a4343a89b74e2394864cfa1b2a45ab P 47ec5c2bfdd24b1eb2a906f63214876e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:09.954358 26285 raft_consensus.cc:3060] T e5a4343a89b74e2394864cfa1b2a45ab P 47ec5c2bfdd24b1eb2a906f63214876e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:09.967306 26285 raft_consensus.cc:515] T e5a4343a89b74e2394864cfa1b2a45ab P 47ec5c2bfdd24b1eb2a906f63214876e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:09.970400 26285 leader_election.cc:290] T e5a4343a89b74e2394864cfa1b2a45ab P 47ec5c2bfdd24b1eb2a906f63214876e [CANDIDATE]: Term 2 election: Requested vote from peers b6ea3e3c1dd142c2a529707d9999b96d (127.12.174.129:34845), 29ab82db4b2a4da39ed4796200c235bd (127.12.174.131:43279)
I20260709 12:15:09.971418 26357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a4343a89b74e2394864cfa1b2a45ab" candidate_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "29ab82db4b2a4da39ed4796200c235bd"
I20260709 12:15:09.972487 26357 raft_consensus.cc:3055] T e5a4343a89b74e2394864cfa1b2a45ab P 29ab82db4b2a4da39ed4796200c235bd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:09.972822 26357 raft_consensus.cc:740] T e5a4343a89b74e2394864cfa1b2a45ab P 29ab82db4b2a4da39ed4796200c235bd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 29ab82db4b2a4da39ed4796200c235bd, State: Running, Role: LEADER
I20260709 12:15:09.974081 26515 raft_consensus.cc:993] T f31c0326c2bb48958872433822c1aa7c P 29ab82db4b2a4da39ed4796200c235bd: : Instructing follower b6ea3e3c1dd142c2a529707d9999b96d to start an election
I20260709 12:15:09.971500 26210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a4343a89b74e2394864cfa1b2a45ab" candidate_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b6ea3e3c1dd142c2a529707d9999b96d"
I20260709 12:15:09.974664 26523 raft_consensus.cc:1081] T f31c0326c2bb48958872433822c1aa7c P 29ab82db4b2a4da39ed4796200c235bd [term 1 LEADER]: Signalling peer b6ea3e3c1dd142c2a529707d9999b96d to start an election
I20260709 12:15:09.975080 26210 raft_consensus.cc:3060] T e5a4343a89b74e2394864cfa1b2a45ab P b6ea3e3c1dd142c2a529707d9999b96d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:09.977151 26208 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f31c0326c2bb48958872433822c1aa7c"
dest_uuid: "b6ea3e3c1dd142c2a529707d9999b96d"
 from {username='slave'} at 127.0.0.1:48146
I20260709 12:15:09.976990 26357 consensus_queue.cc:260] T e5a4343a89b74e2394864cfa1b2a45ab P 29ab82db4b2a4da39ed4796200c235bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:09.978049 26208 raft_consensus.cc:493] T f31c0326c2bb48958872433822c1aa7c P b6ea3e3c1dd142c2a529707d9999b96d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:09.978615 26208 raft_consensus.cc:3060] T f31c0326c2bb48958872433822c1aa7c P b6ea3e3c1dd142c2a529707d9999b96d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:09.978648 26357 raft_consensus.cc:3060] T e5a4343a89b74e2394864cfa1b2a45ab P 29ab82db4b2a4da39ed4796200c235bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:09.986517 26210 raft_consensus.cc:2468] T e5a4343a89b74e2394864cfa1b2a45ab P b6ea3e3c1dd142c2a529707d9999b96d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47ec5c2bfdd24b1eb2a906f63214876e in term 2.
I20260709 12:15:09.988426 26251 leader_election.cc:304] T e5a4343a89b74e2394864cfa1b2a45ab P 47ec5c2bfdd24b1eb2a906f63214876e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47ec5c2bfdd24b1eb2a906f63214876e, b6ea3e3c1dd142c2a529707d9999b96d; no voters: 
I20260709 12:15:09.988508 26357 raft_consensus.cc:2468] T e5a4343a89b74e2394864cfa1b2a45ab P 29ab82db4b2a4da39ed4796200c235bd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47ec5c2bfdd24b1eb2a906f63214876e in term 2.
I20260709 12:15:09.989785 26563 raft_consensus.cc:2804] T e5a4343a89b74e2394864cfa1b2a45ab P 47ec5c2bfdd24b1eb2a906f63214876e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:09.990305 26563 raft_consensus.cc:697] T e5a4343a89b74e2394864cfa1b2a45ab P 47ec5c2bfdd24b1eb2a906f63214876e [term 2 LEADER]: Becoming Leader. State: Replica: 47ec5c2bfdd24b1eb2a906f63214876e, State: Running, Role: LEADER
I20260709 12:15:09.990979 26208 raft_consensus.cc:515] T f31c0326c2bb48958872433822c1aa7c P b6ea3e3c1dd142c2a529707d9999b96d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:09.991581 26563 consensus_queue.cc:237] T e5a4343a89b74e2394864cfa1b2a45ab P 47ec5c2bfdd24b1eb2a906f63214876e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:09.994242 26208 leader_election.cc:290] T f31c0326c2bb48958872433822c1aa7c P b6ea3e3c1dd142c2a529707d9999b96d [CANDIDATE]: Term 2 election: Requested vote from peers 47ec5c2bfdd24b1eb2a906f63214876e (127.12.174.130:43337), 29ab82db4b2a4da39ed4796200c235bd (127.12.174.131:43279)
I20260709 12:15:09.994331 26285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31c0326c2bb48958872433822c1aa7c" candidate_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "47ec5c2bfdd24b1eb2a906f63214876e"
I20260709 12:15:09.995009 26285 raft_consensus.cc:3060] T f31c0326c2bb48958872433822c1aa7c P 47ec5c2bfdd24b1eb2a906f63214876e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:09.995471 26357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31c0326c2bb48958872433822c1aa7c" candidate_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "29ab82db4b2a4da39ed4796200c235bd"
I20260709 12:15:09.996136 26357 raft_consensus.cc:3055] T f31c0326c2bb48958872433822c1aa7c P 29ab82db4b2a4da39ed4796200c235bd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:09.996583 26357 raft_consensus.cc:740] T f31c0326c2bb48958872433822c1aa7c P 29ab82db4b2a4da39ed4796200c235bd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 29ab82db4b2a4da39ed4796200c235bd, State: Running, Role: LEADER
I20260709 12:15:09.997694 26357 consensus_queue.cc:260] T f31c0326c2bb48958872433822c1aa7c P 29ab82db4b2a4da39ed4796200c235bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:09.999507 26357 raft_consensus.cc:3060] T f31c0326c2bb48958872433822c1aa7c P 29ab82db4b2a4da39ed4796200c235bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:10.002750 26515 raft_consensus.cc:993] T d80bd7c3354c472eaaaf49cdd958e470 P 29ab82db4b2a4da39ed4796200c235bd: : Instructing follower b6ea3e3c1dd142c2a529707d9999b96d to start an election
I20260709 12:15:10.003562 26523 raft_consensus.cc:1081] T d80bd7c3354c472eaaaf49cdd958e470 P 29ab82db4b2a4da39ed4796200c235bd [term 1 LEADER]: Signalling peer b6ea3e3c1dd142c2a529707d9999b96d to start an election
I20260709 12:15:10.002806 26107 catalog_manager.cc:5697] T e5a4343a89b74e2394864cfa1b2a45ab P 47ec5c2bfdd24b1eb2a906f63214876e reported cstate change: term changed from 1 to 2, leader changed from 29ab82db4b2a4da39ed4796200c235bd (127.12.174.131) to 47ec5c2bfdd24b1eb2a906f63214876e (127.12.174.130). New cstate: current_term: 2 leader_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:10.005578 26208 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d80bd7c3354c472eaaaf49cdd958e470"
dest_uuid: "b6ea3e3c1dd142c2a529707d9999b96d"
 from {username='slave'} at 127.0.0.1:48146
I20260709 12:15:10.006309 26208 raft_consensus.cc:493] T d80bd7c3354c472eaaaf49cdd958e470 P b6ea3e3c1dd142c2a529707d9999b96d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:10.006779 26208 raft_consensus.cc:3060] T d80bd7c3354c472eaaaf49cdd958e470 P b6ea3e3c1dd142c2a529707d9999b96d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:10.008201 26285 raft_consensus.cc:2468] T f31c0326c2bb48958872433822c1aa7c P 47ec5c2bfdd24b1eb2a906f63214876e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6ea3e3c1dd142c2a529707d9999b96d in term 2.
I20260709 12:15:10.009632 26357 raft_consensus.cc:2468] T f31c0326c2bb48958872433822c1aa7c P 29ab82db4b2a4da39ed4796200c235bd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6ea3e3c1dd142c2a529707d9999b96d in term 2.
I20260709 12:15:10.010362 26173 leader_election.cc:304] T f31c0326c2bb48958872433822c1aa7c P b6ea3e3c1dd142c2a529707d9999b96d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47ec5c2bfdd24b1eb2a906f63214876e, b6ea3e3c1dd142c2a529707d9999b96d; no voters: 
I20260709 12:15:10.012022 26504 raft_consensus.cc:2804] T f31c0326c2bb48958872433822c1aa7c P b6ea3e3c1dd142c2a529707d9999b96d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:10.012567 26504 raft_consensus.cc:697] T f31c0326c2bb48958872433822c1aa7c P b6ea3e3c1dd142c2a529707d9999b96d [term 2 LEADER]: Becoming Leader. State: Replica: b6ea3e3c1dd142c2a529707d9999b96d, State: Running, Role: LEADER
I20260709 12:15:10.014137 26504 consensus_queue.cc:237] T f31c0326c2bb48958872433822c1aa7c P b6ea3e3c1dd142c2a529707d9999b96d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:10.017395 26208 raft_consensus.cc:515] T d80bd7c3354c472eaaaf49cdd958e470 P b6ea3e3c1dd142c2a529707d9999b96d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:10.021250 26285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80bd7c3354c472eaaaf49cdd958e470" candidate_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "47ec5c2bfdd24b1eb2a906f63214876e"
I20260709 12:15:10.021391 26357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d80bd7c3354c472eaaaf49cdd958e470" candidate_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "29ab82db4b2a4da39ed4796200c235bd"
I20260709 12:15:10.022181 26285 raft_consensus.cc:3060] T d80bd7c3354c472eaaaf49cdd958e470 P 47ec5c2bfdd24b1eb2a906f63214876e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:10.022321 26357 raft_consensus.cc:3055] T d80bd7c3354c472eaaaf49cdd958e470 P 29ab82db4b2a4da39ed4796200c235bd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:10.022884 26357 raft_consensus.cc:740] T d80bd7c3354c472eaaaf49cdd958e470 P 29ab82db4b2a4da39ed4796200c235bd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 29ab82db4b2a4da39ed4796200c235bd, State: Running, Role: LEADER
I20260709 12:15:10.024039 26357 consensus_queue.cc:260] T d80bd7c3354c472eaaaf49cdd958e470 P 29ab82db4b2a4da39ed4796200c235bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:10.025379 26357 raft_consensus.cc:3060] T d80bd7c3354c472eaaaf49cdd958e470 P 29ab82db4b2a4da39ed4796200c235bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:10.024629 26108 catalog_manager.cc:5697] T f31c0326c2bb48958872433822c1aa7c P b6ea3e3c1dd142c2a529707d9999b96d reported cstate change: term changed from 1 to 2, leader changed from 29ab82db4b2a4da39ed4796200c235bd (127.12.174.131) to b6ea3e3c1dd142c2a529707d9999b96d (127.12.174.129). New cstate: current_term: 2 leader_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:10.027901 26208 leader_election.cc:290] T d80bd7c3354c472eaaaf49cdd958e470 P b6ea3e3c1dd142c2a529707d9999b96d [CANDIDATE]: Term 2 election: Requested vote from peers 47ec5c2bfdd24b1eb2a906f63214876e (127.12.174.130:43337), 29ab82db4b2a4da39ed4796200c235bd (127.12.174.131:43279)
I20260709 12:15:10.031031 26285 raft_consensus.cc:2468] T d80bd7c3354c472eaaaf49cdd958e470 P 47ec5c2bfdd24b1eb2a906f63214876e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6ea3e3c1dd142c2a529707d9999b96d in term 2.
I20260709 12:15:10.032357 26173 leader_election.cc:304] T d80bd7c3354c472eaaaf49cdd958e470 P b6ea3e3c1dd142c2a529707d9999b96d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47ec5c2bfdd24b1eb2a906f63214876e, b6ea3e3c1dd142c2a529707d9999b96d; no voters: 
I20260709 12:15:10.033531 26504 raft_consensus.cc:2804] T d80bd7c3354c472eaaaf49cdd958e470 P b6ea3e3c1dd142c2a529707d9999b96d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:10.034168 26504 raft_consensus.cc:697] T d80bd7c3354c472eaaaf49cdd958e470 P b6ea3e3c1dd142c2a529707d9999b96d [term 2 LEADER]: Becoming Leader. State: Replica: b6ea3e3c1dd142c2a529707d9999b96d, State: Running, Role: LEADER
I20260709 12:15:10.035890 26357 raft_consensus.cc:2468] T d80bd7c3354c472eaaaf49cdd958e470 P 29ab82db4b2a4da39ed4796200c235bd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6ea3e3c1dd142c2a529707d9999b96d in term 2.
I20260709 12:15:10.035573 26504 consensus_queue.cc:237] T d80bd7c3354c472eaaaf49cdd958e470 P b6ea3e3c1dd142c2a529707d9999b96d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:10.049816 26108 catalog_manager.cc:5697] T d80bd7c3354c472eaaaf49cdd958e470 P b6ea3e3c1dd142c2a529707d9999b96d reported cstate change: term changed from 1 to 2, leader changed from 29ab82db4b2a4da39ed4796200c235bd (127.12.174.131) to b6ea3e3c1dd142c2a529707d9999b96d (127.12.174.129). New cstate: current_term: 2 leader_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:10.060084 26285 raft_consensus.cc:1275] T e904f17eeb0846d3a6cefab2b07e3b4a P 47ec5c2bfdd24b1eb2a906f63214876e [term 2 FOLLOWER]: Refusing update from remote peer b6ea3e3c1dd142c2a529707d9999b96d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:10.061635 26559 consensus_queue.cc:1048] T e904f17eeb0846d3a6cefab2b07e3b4a P b6ea3e3c1dd142c2a529707d9999b96d [LEADER]: Connected to new peer: Peer: permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:10.074290 26357 raft_consensus.cc:1275] T e904f17eeb0846d3a6cefab2b07e3b4a P 29ab82db4b2a4da39ed4796200c235bd [term 2 FOLLOWER]: Refusing update from remote peer b6ea3e3c1dd142c2a529707d9999b96d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:10.075927 26559 consensus_queue.cc:1048] T e904f17eeb0846d3a6cefab2b07e3b4a P b6ea3e3c1dd142c2a529707d9999b96d [LEADER]: Connected to new peer: Peer: permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:10.105265 26559 raft_consensus.cc:993] T ef313d7b9e734aae93e2ed571944bbaa P b6ea3e3c1dd142c2a529707d9999b96d: : Instructing follower 47ec5c2bfdd24b1eb2a906f63214876e to start an election
I20260709 12:15:10.105842 26559 raft_consensus.cc:1081] T ef313d7b9e734aae93e2ed571944bbaa P b6ea3e3c1dd142c2a529707d9999b96d [term 1 LEADER]: Signalling peer 47ec5c2bfdd24b1eb2a906f63214876e to start an election
I20260709 12:15:10.107842 26284 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ef313d7b9e734aae93e2ed571944bbaa"
dest_uuid: "47ec5c2bfdd24b1eb2a906f63214876e"
 from {username='slave'} at 127.0.0.1:52684
I20260709 12:15:10.108337 26284 raft_consensus.cc:493] T ef313d7b9e734aae93e2ed571944bbaa P 47ec5c2bfdd24b1eb2a906f63214876e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:10.108705 26284 raft_consensus.cc:3060] T ef313d7b9e734aae93e2ed571944bbaa P 47ec5c2bfdd24b1eb2a906f63214876e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:10.118368 26284 raft_consensus.cc:515] T ef313d7b9e734aae93e2ed571944bbaa P 47ec5c2bfdd24b1eb2a906f63214876e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:10.120501 26284 leader_election.cc:290] T ef313d7b9e734aae93e2ed571944bbaa P 47ec5c2bfdd24b1eb2a906f63214876e [CANDIDATE]: Term 2 election: Requested vote from peers b6ea3e3c1dd142c2a529707d9999b96d (127.12.174.129:34845), 29ab82db4b2a4da39ed4796200c235bd (127.12.174.131:43279)
I20260709 12:15:10.121348 26208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef313d7b9e734aae93e2ed571944bbaa" candidate_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b6ea3e3c1dd142c2a529707d9999b96d"
I20260709 12:15:10.121773 26359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef313d7b9e734aae93e2ed571944bbaa" candidate_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "29ab82db4b2a4da39ed4796200c235bd"
I20260709 12:15:10.122051 26208 raft_consensus.cc:3055] T ef313d7b9e734aae93e2ed571944bbaa P b6ea3e3c1dd142c2a529707d9999b96d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:10.122345 26359 raft_consensus.cc:3060] T ef313d7b9e734aae93e2ed571944bbaa P 29ab82db4b2a4da39ed4796200c235bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:10.122355 26208 raft_consensus.cc:740] T ef313d7b9e734aae93e2ed571944bbaa P b6ea3e3c1dd142c2a529707d9999b96d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b6ea3e3c1dd142c2a529707d9999b96d, State: Running, Role: LEADER
I20260709 12:15:10.123361 26208 consensus_queue.cc:260] T ef313d7b9e734aae93e2ed571944bbaa P b6ea3e3c1dd142c2a529707d9999b96d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:10.124586 26208 raft_consensus.cc:3060] T ef313d7b9e734aae93e2ed571944bbaa P b6ea3e3c1dd142c2a529707d9999b96d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:10.130255 26359 raft_consensus.cc:2468] T ef313d7b9e734aae93e2ed571944bbaa P 29ab82db4b2a4da39ed4796200c235bd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47ec5c2bfdd24b1eb2a906f63214876e in term 2.
I20260709 12:15:10.131773 26249 leader_election.cc:304] T ef313d7b9e734aae93e2ed571944bbaa P 47ec5c2bfdd24b1eb2a906f63214876e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29ab82db4b2a4da39ed4796200c235bd, 47ec5c2bfdd24b1eb2a906f63214876e; no voters: 
I20260709 12:15:10.131825 26208 raft_consensus.cc:2468] T ef313d7b9e734aae93e2ed571944bbaa P b6ea3e3c1dd142c2a529707d9999b96d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47ec5c2bfdd24b1eb2a906f63214876e in term 2.
I20260709 12:15:10.132560 26563 raft_consensus.cc:2804] T ef313d7b9e734aae93e2ed571944bbaa P 47ec5c2bfdd24b1eb2a906f63214876e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:10.132990 26563 raft_consensus.cc:697] T ef313d7b9e734aae93e2ed571944bbaa P 47ec5c2bfdd24b1eb2a906f63214876e [term 2 LEADER]: Becoming Leader. State: Replica: 47ec5c2bfdd24b1eb2a906f63214876e, State: Running, Role: LEADER
I20260709 12:15:10.133984 26563 consensus_queue.cc:237] T ef313d7b9e734aae93e2ed571944bbaa P 47ec5c2bfdd24b1eb2a906f63214876e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:10.142896 26105 catalog_manager.cc:5697] T ef313d7b9e734aae93e2ed571944bbaa P 47ec5c2bfdd24b1eb2a906f63214876e reported cstate change: term changed from 1 to 2, leader changed from b6ea3e3c1dd142c2a529707d9999b96d (127.12.174.129) to 47ec5c2bfdd24b1eb2a906f63214876e (127.12.174.130). New cstate: current_term: 2 leader_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:10.178293 26284 raft_consensus.cc:1275] T ed22621a01e740fdb61fe0db7e9c77c6 P 47ec5c2bfdd24b1eb2a906f63214876e [term 2 FOLLOWER]: Refusing update from remote peer b6ea3e3c1dd142c2a529707d9999b96d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:10.179834 26504 consensus_queue.cc:1048] T ed22621a01e740fdb61fe0db7e9c77c6 P b6ea3e3c1dd142c2a529707d9999b96d [LEADER]: Connected to new peer: Peer: permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:10.190240 26359 raft_consensus.cc:1275] T ed22621a01e740fdb61fe0db7e9c77c6 P 29ab82db4b2a4da39ed4796200c235bd [term 2 FOLLOWER]: Refusing update from remote peer b6ea3e3c1dd142c2a529707d9999b96d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:10.194468 26504 consensus_queue.cc:1048] T ed22621a01e740fdb61fe0db7e9c77c6 P b6ea3e3c1dd142c2a529707d9999b96d [LEADER]: Connected to new peer: Peer: permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:10.389705 26208 raft_consensus.cc:1275] T e5a4343a89b74e2394864cfa1b2a45ab P b6ea3e3c1dd142c2a529707d9999b96d [term 2 FOLLOWER]: Refusing update from remote peer 47ec5c2bfdd24b1eb2a906f63214876e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:10.391209 26563 consensus_queue.cc:1048] T e5a4343a89b74e2394864cfa1b2a45ab P 47ec5c2bfdd24b1eb2a906f63214876e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:10.400807 26357 raft_consensus.cc:1275] T e5a4343a89b74e2394864cfa1b2a45ab P 29ab82db4b2a4da39ed4796200c235bd [term 2 FOLLOWER]: Refusing update from remote peer 47ec5c2bfdd24b1eb2a906f63214876e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:10.403179 26574 consensus_queue.cc:1048] T e5a4343a89b74e2394864cfa1b2a45ab P 47ec5c2bfdd24b1eb2a906f63214876e [LEADER]: Connected to new peer: Peer: permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:10.538543 26284 raft_consensus.cc:1275] T f31c0326c2bb48958872433822c1aa7c P 47ec5c2bfdd24b1eb2a906f63214876e [term 2 FOLLOWER]: Refusing update from remote peer b6ea3e3c1dd142c2a529707d9999b96d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:10.540057 26558 consensus_queue.cc:1048] T f31c0326c2bb48958872433822c1aa7c P b6ea3e3c1dd142c2a529707d9999b96d [LEADER]: Connected to new peer: Peer: permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:10.553799 26357 raft_consensus.cc:1275] T f31c0326c2bb48958872433822c1aa7c P 29ab82db4b2a4da39ed4796200c235bd [term 2 FOLLOWER]: Refusing update from remote peer b6ea3e3c1dd142c2a529707d9999b96d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:10.555647 26208 raft_consensus.cc:1275] T ef313d7b9e734aae93e2ed571944bbaa P b6ea3e3c1dd142c2a529707d9999b96d [term 2 FOLLOWER]: Refusing update from remote peer 47ec5c2bfdd24b1eb2a906f63214876e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:10.556246 26504 consensus_queue.cc:1048] T f31c0326c2bb48958872433822c1aa7c P b6ea3e3c1dd142c2a529707d9999b96d [LEADER]: Connected to new peer: Peer: permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:10.558678 26574 consensus_queue.cc:1048] T ef313d7b9e734aae93e2ed571944bbaa P 47ec5c2bfdd24b1eb2a906f63214876e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:10.575171 26359 raft_consensus.cc:1275] T ef313d7b9e734aae93e2ed571944bbaa P 29ab82db4b2a4da39ed4796200c235bd [term 2 FOLLOWER]: Refusing update from remote peer 47ec5c2bfdd24b1eb2a906f63214876e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:10.578595 26538 consensus_queue.cc:1048] T ef313d7b9e734aae93e2ed571944bbaa P 47ec5c2bfdd24b1eb2a906f63214876e [LEADER]: Connected to new peer: Peer: permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:10.625259 26284 raft_consensus.cc:1275] T d80bd7c3354c472eaaaf49cdd958e470 P 47ec5c2bfdd24b1eb2a906f63214876e [term 2 FOLLOWER]: Refusing update from remote peer b6ea3e3c1dd142c2a529707d9999b96d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:10.626745 26504 consensus_queue.cc:1048] T d80bd7c3354c472eaaaf49cdd958e470 P b6ea3e3c1dd142c2a529707d9999b96d [LEADER]: Connected to new peer: Peer: permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:10.637169 26359 raft_consensus.cc:1275] T d80bd7c3354c472eaaaf49cdd958e470 P 29ab82db4b2a4da39ed4796200c235bd [term 2 FOLLOWER]: Refusing update from remote peer b6ea3e3c1dd142c2a529707d9999b96d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:10.640097 26504 consensus_queue.cc:1048] T d80bd7c3354c472eaaaf49cdd958e470 P b6ea3e3c1dd142c2a529707d9999b96d [LEADER]: Connected to new peer: Peer: permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:15:10.689414 26173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.130:43337, user_credentials={real_user=slave}} blocked reactor thread for 49758.3us
I20260709 12:15:12.621948 26107 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:54496:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 12:15:12.644902 26107 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:54496:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 12:15:12.797593 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:15:12.825451 26595 log.cc:927] Time spent T f31c0326c2bb48958872433822c1aa7c P b6ea3e3c1dd142c2a529707d9999b96d: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 12:15:12.947870 26626 tablet.cc:1724] T f31c0326c2bb48958872433822c1aa7c P b6ea3e3c1dd142c2a529707d9999b96d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:15:12.946359 26614 log.cc:927] Time spent T f31c0326c2bb48958872433822c1aa7c P 47ec5c2bfdd24b1eb2a906f63214876e: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
W20260709 12:15:13.041699 26622 log.cc:927] Time spent T e904f17eeb0846d3a6cefab2b07e3b4a P 29ab82db4b2a4da39ed4796200c235bd: Append to log took a long time: real 0.061s	user 0.002s	sys 0.000s
W20260709 12:15:13.073334 26623 log.cc:927] Time spent T 3be8e2e412f8465b83495d611f4b7ce2 P 47ec5c2bfdd24b1eb2a906f63214876e: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 12:15:13.106508 26626 tablet.cc:1724] T ed22621a01e740fdb61fe0db7e9c77c6 P b6ea3e3c1dd142c2a529707d9999b96d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:15:13.108352 26625 log.cc:927] Time spent T 739b1449642e40fb84a22a155ce21e59 P b6ea3e3c1dd142c2a529707d9999b96d: Append to log took a long time: real 0.128s	user 0.001s	sys 0.003s
I20260709 12:15:13.150233 26644 tablet.cc:1724] T ed22621a01e740fdb61fe0db7e9c77c6 P 47ec5c2bfdd24b1eb2a906f63214876e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:13.172659 26647 tablet.cc:1724] T ef313d7b9e734aae93e2ed571944bbaa P 29ab82db4b2a4da39ed4796200c235bd: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:13.162003 26639 tablet.cc:1724] T ef313d7b9e734aae93e2ed571944bbaa P b6ea3e3c1dd142c2a529707d9999b96d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:15:13.221887 26641 log.cc:927] Time spent T 3be8e2e412f8465b83495d611f4b7ce2 P 29ab82db4b2a4da39ed4796200c235bd: Append to log took a long time: real 0.127s	user 0.003s	sys 0.000s
I20260709 12:15:13.172264 26646 tablet.cc:1724] T ef313d7b9e734aae93e2ed571944bbaa P 47ec5c2bfdd24b1eb2a906f63214876e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:15:13.211972 26174 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.174.131:43279, user_credentials={real_user=slave}} blocked reactor thread for 86879.8us
I20260709 12:15:13.231478 26643 tablet.cc:1724] T f31c0326c2bb48958872433822c1aa7c P 29ab82db4b2a4da39ed4796200c235bd: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:15:13.235141 26640 log.cc:927] Time spent T 739b1449642e40fb84a22a155ce21e59 P 47ec5c2bfdd24b1eb2a906f63214876e: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:15:13.264233 26285 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "29fd96c2a5d34cbfbc04b6878fc1a9ae"
dest_uuid: "47ec5c2bfdd24b1eb2a906f63214876e"
mode: GRACEFUL
new_leader_uuid: "29ab82db4b2a4da39ed4796200c235bd"
 from {username='slave'} at 127.0.0.1:60230
I20260709 12:15:13.265076 26285 raft_consensus.cc:606] T 29fd96c2a5d34cbfbc04b6878fc1a9ae P 47ec5c2bfdd24b1eb2a906f63214876e [term 2 LEADER]: Received request to transfer leadership to TS 29ab82db4b2a4da39ed4796200c235bd
I20260709 12:15:13.268733 26648 tablet.cc:1724] T e18e3ddc9621480a960d88fb92a478c8 P 29ab82db4b2a4da39ed4796200c235bd: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:13.289000 26644 tablet.cc:1724] T e18e3ddc9621480a960d88fb92a478c8 P 47ec5c2bfdd24b1eb2a906f63214876e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:13.281080 26647 tablet.cc:1724] T e904f17eeb0846d3a6cefab2b07e3b4a P 29ab82db4b2a4da39ed4796200c235bd: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:13.286518 26639 tablet.cc:1724] T d80bd7c3354c472eaaaf49cdd958e470 P b6ea3e3c1dd142c2a529707d9999b96d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:15:13.299888 26645 log.cc:927] Time spent T e5a4343a89b74e2394864cfa1b2a45ab P 29ab82db4b2a4da39ed4796200c235bd: Append to log took a long time: real 0.117s	user 0.000s	sys 0.001s
I20260709 12:15:13.306015 26646 tablet.cc:1724] T d80bd7c3354c472eaaaf49cdd958e470 P 47ec5c2bfdd24b1eb2a906f63214876e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:13.309070 26626 tablet.cc:1724] T e5a4343a89b74e2394864cfa1b2a45ab P b6ea3e3c1dd142c2a529707d9999b96d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:13.305843 26650 tablet.cc:1724] T e18e3ddc9621480a960d88fb92a478c8 P b6ea3e3c1dd142c2a529707d9999b96d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:13.311323 26653 tablet.cc:1724] T f31c0326c2bb48958872433822c1aa7c P 47ec5c2bfdd24b1eb2a906f63214876e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:13.316561 26644 tablet.cc:1724] T e5a4343a89b74e2394864cfa1b2a45ab P 47ec5c2bfdd24b1eb2a906f63214876e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:13.319805 26655 tablet.cc:1724] T 3be8e2e412f8465b83495d611f4b7ce2 P 29ab82db4b2a4da39ed4796200c235bd: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:13.324651 26643 tablet.cc:1724] T 739b1449642e40fb84a22a155ce21e59 P 29ab82db4b2a4da39ed4796200c235bd: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:13.335573 26654 tablet.cc:1724] T e904f17eeb0846d3a6cefab2b07e3b4a P b6ea3e3c1dd142c2a529707d9999b96d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:13.367297 26655 tablet.cc:1724] T d80bd7c3354c472eaaaf49cdd958e470 P 29ab82db4b2a4da39ed4796200c235bd: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:13.369877 26654 tablet.cc:1724] T 3be8e2e412f8465b83495d611f4b7ce2 P b6ea3e3c1dd142c2a529707d9999b96d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:13.377194 26626 tablet.cc:1724] T 739b1449642e40fb84a22a155ce21e59 P b6ea3e3c1dd142c2a529707d9999b96d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:13.395327 26646 tablet.cc:1724] T 3be8e2e412f8465b83495d611f4b7ce2 P 47ec5c2bfdd24b1eb2a906f63214876e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:13.407335 26648 tablet.cc:1724] T e5a4343a89b74e2394864cfa1b2a45ab P 29ab82db4b2a4da39ed4796200c235bd: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:13.425405 26643 tablet.cc:1724] T ed22621a01e740fdb61fe0db7e9c77c6 P 29ab82db4b2a4da39ed4796200c235bd: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:13.428766 26657 tablet.cc:1724] T e904f17eeb0846d3a6cefab2b07e3b4a P 47ec5c2bfdd24b1eb2a906f63214876e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:13.440469 26210 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f7cde2085f2b4fa182c0126b08cc9dd5"
dest_uuid: "b6ea3e3c1dd142c2a529707d9999b96d"
mode: GRACEFUL
new_leader_uuid: "29ab82db4b2a4da39ed4796200c235bd"
 from {username='slave'} at 127.0.0.1:60768
I20260709 12:15:13.441387 26210 raft_consensus.cc:606] T f7cde2085f2b4fa182c0126b08cc9dd5 P b6ea3e3c1dd142c2a529707d9999b96d [term 1 LEADER]: Received request to transfer leadership to TS 29ab82db4b2a4da39ed4796200c235bd
I20260709 12:15:13.444392 12986 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:15:13.445331 12986 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:13.459317 26644 tablet.cc:1724] T 739b1449642e40fb84a22a155ce21e59 P 47ec5c2bfdd24b1eb2a906f63214876e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:15:13.475698 26106 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 7afd9fe5d8ed452893c9113fd5ea3eb7: soft_deleted_table [id=2c3874a85a02421f84a5445eba658efb] alter complete (version 1)
I20260709 12:15:13.594677 26583 raft_consensus.cc:993] T 29fd96c2a5d34cbfbc04b6878fc1a9ae P 47ec5c2bfdd24b1eb2a906f63214876e: : Instructing follower 29ab82db4b2a4da39ed4796200c235bd to start an election
I20260709 12:15:13.595361 26607 raft_consensus.cc:1081] T 29fd96c2a5d34cbfbc04b6878fc1a9ae P 47ec5c2bfdd24b1eb2a906f63214876e [term 2 LEADER]: Signalling peer 29ab82db4b2a4da39ed4796200c235bd to start an election
I20260709 12:15:13.597333 26355 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "29fd96c2a5d34cbfbc04b6878fc1a9ae"
dest_uuid: "29ab82db4b2a4da39ed4796200c235bd"
 from {username='slave'} at 127.0.0.1:42042
I20260709 12:15:13.597916 26355 raft_consensus.cc:493] T 29fd96c2a5d34cbfbc04b6878fc1a9ae P 29ab82db4b2a4da39ed4796200c235bd [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:13.598232 26355 raft_consensus.cc:3060] T 29fd96c2a5d34cbfbc04b6878fc1a9ae P 29ab82db4b2a4da39ed4796200c235bd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:13.606549 26355 raft_consensus.cc:515] T 29fd96c2a5d34cbfbc04b6878fc1a9ae P 29ab82db4b2a4da39ed4796200c235bd [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:13.609323 26355 leader_election.cc:290] T 29fd96c2a5d34cbfbc04b6878fc1a9ae P 29ab82db4b2a4da39ed4796200c235bd [CANDIDATE]: Term 3 election: Requested vote from peers b6ea3e3c1dd142c2a529707d9999b96d (127.12.174.129:34845), 47ec5c2bfdd24b1eb2a906f63214876e (127.12.174.130:43337)
I20260709 12:15:13.609680 26210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29fd96c2a5d34cbfbc04b6878fc1a9ae" candidate_uuid: "29ab82db4b2a4da39ed4796200c235bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b6ea3e3c1dd142c2a529707d9999b96d"
I20260709 12:15:13.610061 26285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29fd96c2a5d34cbfbc04b6878fc1a9ae" candidate_uuid: "29ab82db4b2a4da39ed4796200c235bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "47ec5c2bfdd24b1eb2a906f63214876e"
I20260709 12:15:13.610586 26210 raft_consensus.cc:3060] T 29fd96c2a5d34cbfbc04b6878fc1a9ae P b6ea3e3c1dd142c2a529707d9999b96d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:13.610745 26285 raft_consensus.cc:3055] T 29fd96c2a5d34cbfbc04b6878fc1a9ae P 47ec5c2bfdd24b1eb2a906f63214876e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:15:13.611172 26285 raft_consensus.cc:740] T 29fd96c2a5d34cbfbc04b6878fc1a9ae P 47ec5c2bfdd24b1eb2a906f63214876e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 47ec5c2bfdd24b1eb2a906f63214876e, State: Running, Role: LEADER
I20260709 12:15:13.611981 26285 consensus_queue.cc:260] T 29fd96c2a5d34cbfbc04b6878fc1a9ae P 47ec5c2bfdd24b1eb2a906f63214876e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:13.613489 26285 raft_consensus.cc:3060] T 29fd96c2a5d34cbfbc04b6878fc1a9ae P 47ec5c2bfdd24b1eb2a906f63214876e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:13.619874 26210 raft_consensus.cc:2468] T 29fd96c2a5d34cbfbc04b6878fc1a9ae P b6ea3e3c1dd142c2a529707d9999b96d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29ab82db4b2a4da39ed4796200c235bd in term 3.
I20260709 12:15:13.621645 26325 leader_election.cc:304] T 29fd96c2a5d34cbfbc04b6878fc1a9ae P 29ab82db4b2a4da39ed4796200c235bd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29ab82db4b2a4da39ed4796200c235bd, b6ea3e3c1dd142c2a529707d9999b96d; no voters: 
I20260709 12:15:13.622934 26651 raft_consensus.cc:2804] T 29fd96c2a5d34cbfbc04b6878fc1a9ae P 29ab82db4b2a4da39ed4796200c235bd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:13.622792 26285 raft_consensus.cc:2468] T 29fd96c2a5d34cbfbc04b6878fc1a9ae P 47ec5c2bfdd24b1eb2a906f63214876e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29ab82db4b2a4da39ed4796200c235bd in term 3.
I20260709 12:15:13.623586 26651 raft_consensus.cc:697] T 29fd96c2a5d34cbfbc04b6878fc1a9ae P 29ab82db4b2a4da39ed4796200c235bd [term 3 LEADER]: Becoming Leader. State: Replica: 29ab82db4b2a4da39ed4796200c235bd, State: Running, Role: LEADER
I20260709 12:15:13.624621 26651 consensus_queue.cc:237] T 29fd96c2a5d34cbfbc04b6878fc1a9ae P 29ab82db4b2a4da39ed4796200c235bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:13.634735 26106 catalog_manager.cc:5697] T 29fd96c2a5d34cbfbc04b6878fc1a9ae P 29ab82db4b2a4da39ed4796200c235bd reported cstate change: term changed from 2 to 3, leader changed from 47ec5c2bfdd24b1eb2a906f63214876e (127.12.174.130) to 29ab82db4b2a4da39ed4796200c235bd (127.12.174.131). New cstate: current_term: 3 leader_uuid: "29ab82db4b2a4da39ed4796200c235bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:13.696364 26580 raft_consensus.cc:993] T f7cde2085f2b4fa182c0126b08cc9dd5 P b6ea3e3c1dd142c2a529707d9999b96d: : Instructing follower 29ab82db4b2a4da39ed4796200c235bd to start an election
I20260709 12:15:13.697150 26600 raft_consensus.cc:1081] T f7cde2085f2b4fa182c0126b08cc9dd5 P b6ea3e3c1dd142c2a529707d9999b96d [term 1 LEADER]: Signalling peer 29ab82db4b2a4da39ed4796200c235bd to start an election
I20260709 12:15:13.698873 26355 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f7cde2085f2b4fa182c0126b08cc9dd5"
dest_uuid: "29ab82db4b2a4da39ed4796200c235bd"
 from {username='slave'} at 127.0.0.1:42038
I20260709 12:15:13.699507 26355 raft_consensus.cc:493] T f7cde2085f2b4fa182c0126b08cc9dd5 P 29ab82db4b2a4da39ed4796200c235bd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:13.699904 26355 raft_consensus.cc:3060] T f7cde2085f2b4fa182c0126b08cc9dd5 P 29ab82db4b2a4da39ed4796200c235bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:13.708349 26355 raft_consensus.cc:515] T f7cde2085f2b4fa182c0126b08cc9dd5 P 29ab82db4b2a4da39ed4796200c235bd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:13.710398 26355 leader_election.cc:290] T f7cde2085f2b4fa182c0126b08cc9dd5 P 29ab82db4b2a4da39ed4796200c235bd [CANDIDATE]: Term 2 election: Requested vote from peers b6ea3e3c1dd142c2a529707d9999b96d (127.12.174.129:34845), 47ec5c2bfdd24b1eb2a906f63214876e (127.12.174.130:43337)
I20260709 12:15:13.711967 26210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7cde2085f2b4fa182c0126b08cc9dd5" candidate_uuid: "29ab82db4b2a4da39ed4796200c235bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b6ea3e3c1dd142c2a529707d9999b96d"
I20260709 12:15:13.711930 26285 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7cde2085f2b4fa182c0126b08cc9dd5" candidate_uuid: "29ab82db4b2a4da39ed4796200c235bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "47ec5c2bfdd24b1eb2a906f63214876e"
I20260709 12:15:13.712751 26210 raft_consensus.cc:3055] T f7cde2085f2b4fa182c0126b08cc9dd5 P b6ea3e3c1dd142c2a529707d9999b96d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:13.712831 26285 raft_consensus.cc:3060] T f7cde2085f2b4fa182c0126b08cc9dd5 P 47ec5c2bfdd24b1eb2a906f63214876e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:13.713029 26210 raft_consensus.cc:740] T f7cde2085f2b4fa182c0126b08cc9dd5 P b6ea3e3c1dd142c2a529707d9999b96d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b6ea3e3c1dd142c2a529707d9999b96d, State: Running, Role: LEADER
I20260709 12:15:13.713881 26210 consensus_queue.cc:260] T f7cde2085f2b4fa182c0126b08cc9dd5 P b6ea3e3c1dd142c2a529707d9999b96d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:13.715024 26210 raft_consensus.cc:3060] T f7cde2085f2b4fa182c0126b08cc9dd5 P b6ea3e3c1dd142c2a529707d9999b96d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:13.721669 26285 raft_consensus.cc:2468] T f7cde2085f2b4fa182c0126b08cc9dd5 P 47ec5c2bfdd24b1eb2a906f63214876e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29ab82db4b2a4da39ed4796200c235bd in term 2.
I20260709 12:15:13.723315 26210 raft_consensus.cc:2468] T f7cde2085f2b4fa182c0126b08cc9dd5 P b6ea3e3c1dd142c2a529707d9999b96d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29ab82db4b2a4da39ed4796200c235bd in term 2.
I20260709 12:15:13.723853 26322 leader_election.cc:304] T f7cde2085f2b4fa182c0126b08cc9dd5 P 29ab82db4b2a4da39ed4796200c235bd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29ab82db4b2a4da39ed4796200c235bd, 47ec5c2bfdd24b1eb2a906f63214876e; no voters: 
I20260709 12:15:13.725155 26651 raft_consensus.cc:2804] T f7cde2085f2b4fa182c0126b08cc9dd5 P 29ab82db4b2a4da39ed4796200c235bd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:13.725598 26651 raft_consensus.cc:697] T f7cde2085f2b4fa182c0126b08cc9dd5 P 29ab82db4b2a4da39ed4796200c235bd [term 2 LEADER]: Becoming Leader. State: Replica: 29ab82db4b2a4da39ed4796200c235bd, State: Running, Role: LEADER
I20260709 12:15:13.726619 26651 consensus_queue.cc:237] T f7cde2085f2b4fa182c0126b08cc9dd5 P 29ab82db4b2a4da39ed4796200c235bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } }
I20260709 12:15:13.736158 26106 catalog_manager.cc:5697] T f7cde2085f2b4fa182c0126b08cc9dd5 P 29ab82db4b2a4da39ed4796200c235bd reported cstate change: term changed from 1 to 2, leader changed from b6ea3e3c1dd142c2a529707d9999b96d (127.12.174.129) to 29ab82db4b2a4da39ed4796200c235bd (127.12.174.131). New cstate: current_term: 2 leader_uuid: "29ab82db4b2a4da39ed4796200c235bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "29ab82db4b2a4da39ed4796200c235bd" member_type: VOTER last_known_addr { host: "127.12.174.131" port: 43279 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:14.098101 26285 raft_consensus.cc:1275] T 29fd96c2a5d34cbfbc04b6878fc1a9ae P 47ec5c2bfdd24b1eb2a906f63214876e [term 3 FOLLOWER]: Refusing update from remote peer 29ab82db4b2a4da39ed4796200c235bd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:15:14.099418 26651 consensus_queue.cc:1048] T 29fd96c2a5d34cbfbc04b6878fc1a9ae P 29ab82db4b2a4da39ed4796200c235bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:15:14.111130 26208 raft_consensus.cc:1275] T 29fd96c2a5d34cbfbc04b6878fc1a9ae P b6ea3e3c1dd142c2a529707d9999b96d [term 3 FOLLOWER]: Refusing update from remote peer 29ab82db4b2a4da39ed4796200c235bd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:15:14.112921 26651 consensus_queue.cc:1048] T 29fd96c2a5d34cbfbc04b6878fc1a9ae P 29ab82db4b2a4da39ed4796200c235bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:15:14.135924 26208 raft_consensus.cc:1275] T f7cde2085f2b4fa182c0126b08cc9dd5 P b6ea3e3c1dd142c2a529707d9999b96d [term 2 FOLLOWER]: Refusing update from remote peer 29ab82db4b2a4da39ed4796200c235bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:14.137326 26651 consensus_queue.cc:1048] T f7cde2085f2b4fa182c0126b08cc9dd5 P 29ab82db4b2a4da39ed4796200c235bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6ea3e3c1dd142c2a529707d9999b96d" member_type: VOTER last_known_addr { host: "127.12.174.129" port: 34845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:14.148857 26285 raft_consensus.cc:1275] T f7cde2085f2b4fa182c0126b08cc9dd5 P 47ec5c2bfdd24b1eb2a906f63214876e [term 2 FOLLOWER]: Refusing update from remote peer 29ab82db4b2a4da39ed4796200c235bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:14.150573 26666 consensus_queue.cc:1048] T f7cde2085f2b4fa182c0126b08cc9dd5 P 29ab82db4b2a4da39ed4796200c235bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "47ec5c2bfdd24b1eb2a906f63214876e" member_type: VOTER last_known_addr { host: "127.12.174.130" port: 43337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:14.446633 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:14.452929 12986 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:14.453459 12986 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:15.454695 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:15.460917 12986 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:15.461484 12986 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:16.462672 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:16.468477 12986 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:16.469004 12986 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:17.470057 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:17.475826 12986 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:17.476432 12986 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:18.477556 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:18.483184 12986 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:18.483711 12986 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:19.484884 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:19.490792 12986 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:19.491355 12986 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:20.492750 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:20.499117 12986 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:20.499660 12986 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:21.501060 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:21.507992 12986 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:21.508505 12986 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:22.509586 12986 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:22.515472 12986 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:22.516043 12986 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:23.585270 12986 tablet_server.cc:179] TabletServer@127.12.174.129:0 shutting down...
W20260709 12:15:23.622694 26325 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 12 similar messages]
W20260709 12:15:23.632306 26325 consensus_peers.cc:597] T f7cde2085f2b4fa182c0126b08cc9dd5 P 29ab82db4b2a4da39ed4796200c235bd -> Peer b6ea3e3c1dd142c2a529707d9999b96d (127.12.174.129:34845): Couldn't send request to peer b6ea3e3c1dd142c2a529707d9999b96d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:23.637589 12986 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:15:23.638558 12986 tablet_replica.cc:333] T 3be8e2e412f8465b83495d611f4b7ce2 P b6ea3e3c1dd142c2a529707d9999b96d: stopping tablet replica
I20260709 12:15:23.639626 12986 raft_consensus.cc:2243] T 3be8e2e412f8465b83495d611f4b7ce2 P b6ea3e3c1dd142c2a529707d9999b96d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:23.640432 12986 raft_consensus.cc:2272] T 3be8e2e412f8465b83495d611f4b7ce2 P b6ea3e3c1dd142c2a529707d9999b96d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:23.644443 12986 tablet_replica.cc:333] T e5a4343a89b74e2394864cfa1b2a45ab P b6ea3e3c1dd142c2a529707d9999b96d: stopping tablet replica
I20260709 12:15:23.645687 12986 raft_consensus.cc:2243] T e5a4343a89b74e2394864cfa1b2a45ab P b6ea3e3c1dd142c2a529707d9999b96d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:23.646401 12986 raft_consensus.cc:2272] T e5a4343a89b74e2394864cfa1b2a45ab P b6ea3e3c1dd142c2a529707d9999b96d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:23.649257 12986 tablet_replica.cc:333] T ed22621a01e740fdb61fe0db7e9c77c6 P b6ea3e3c1dd142c2a529707d9999b96d: stopping tablet replica
I20260709 12:15:23.650103 12986 raft_consensus.cc:2243] T ed22621a01e740fdb61fe0db7e9c77c6 P b6ea3e3c1dd142c2a529707d9999b96d [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:15:23.651227 12986 raft_consensus.cc:2272] T ed22621a01e740fdb61fe0db7e9c77c6 P b6ea3e3c1dd142c2a529707d9999b96d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:23.654156 12986 tablet_replica.cc:333] T d80bd7c3354c472eaaaf49cdd958e470 P b6ea3e3c1dd142c2a529707d9999b96d: stopping tablet replica
I20260709 12:15:23.654852 12986 raft_consensus.cc:2243] T d80bd7c3354c472eaaaf49cdd958e470 P b6ea3e3c1dd142c2a529707d9999b96d [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:15:23.655944 12986 raft_consensus.cc:2272] T d80bd7c3354c472eaaaf49cdd958e470 P b6ea3e3c1dd142c2a529707d9999b96d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:23.658877 12986 tablet_replica.cc:333] T ef313d7b9e734aae93e2ed571944bbaa P b6ea3e3c1dd142c2a529707d9999b96d: stopping tablet replica
I20260709 12:15:23.659564 12986 raft_consensus.cc:2243] T ef313d7b9e734aae93e2ed571944bbaa P b6ea3e3c1dd142c2a529707d9999b96d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:23.660251 12986 raft_consensus.cc:2272] T ef313d7b9e734aae93e2ed571944bbaa P b6ea3e3c1dd142c2a529707d9999b96d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:23.663280 12986 tablet_replica.cc:333] T f31c0326c2bb48958872433822c1aa7c P b6ea3e3c1dd142c2a529707d9999b96d: stopping tablet replica
I20260709 12:15:23.663996 12986 raft_consensus.cc:2243] T f31c0326c2bb48958872433822c1aa7c P b6ea3e3c1dd142c2a529707d9999b96d [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:15:23.665235 12986 raft_consensus.cc:2272] T f31c0326c2bb48958872433822c1aa7c P b6ea3e3c1dd142c2a529707d9999b96d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:23.668915 12986 tablet_replica.cc:333] T 8e274509d4a64b129aa342b697004bf1 P b6ea3e3c1dd142c2a529707d9999b96d: stopping tablet replica
I20260709 12:15:23.669857 12986 raft_consensus.cc:2243] T 8e274509d4a64b129aa342b697004bf1 P b6ea3e3c1dd142c2a529707d9999b96d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:23.670540 12986 raft_consensus.cc:2272] T 8e274509d4a64b129aa342b697004bf1 P b6ea3e3c1dd142c2a529707d9999b96d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:23.673695 12986 tablet_replica.cc:333] T 739b1449642e40fb84a22a155ce21e59 P b6ea3e3c1dd142c2a529707d9999b96d: stopping tablet replica
I20260709 12:15:23.674655 12986 raft_consensus.cc:2243] T 739b1449642e40fb84a22a155ce21e59 P b6ea3e3c1dd142c2a529707d9999b96d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:23.676119 12986 raft_consensus.cc:2272] T 739b1449642e40fb84a22a155ce21e59 P b6ea3e3c1dd142c2a529707d9999b96d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:23.680591 12986 tablet_replica.cc:333] T 61c63f2d508d492dab277021e7a3de0f P b6ea3e3c1dd142c2a529707d9999b96d: stopping tablet replica
I20260709 12:15:23.681520 12986 raft_consensus.cc:2243] T 61c63f2d508d492dab277021e7a3de0f P b6ea3e3c1dd142c2a529707d9999b96d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:23.682399 12986 raft_consensus.cc:2272] T 61c63f2d508d492dab277021e7a3de0f P b6ea3e3c1dd142c2a529707d9999b96d [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:23.682945 26251 consensus_peers.cc:597] T 8e274509d4a64b129aa342b697004bf1 P 47ec5c2bfdd24b1eb2a906f63214876e -> Peer b6ea3e3c1dd142c2a529707d9999b96d (127.12.174.129:34845): Couldn't send request to peer b6ea3e3c1dd142c2a529707d9999b96d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:23.686534 12986 tablet_replica.cc:333] T 5640177c765d4c7eace47afab24512cc P b6ea3e3c1dd142c2a529707d9999b96d: stopping tablet replica
I20260709 12:15:23.687605 12986 raft_consensus.cc:2243] T 5640177c765d4c7eace47afab24512cc P b6ea3e3c1dd142c2a529707d9999b96d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:23.688320 12986 raft_consensus.cc:2272] T 5640177c765d4c7eace47afab24512cc P b6ea3e3c1dd142c2a529707d9999b96d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:23.689309 26251 consensus_peers.cc:597] T 3be8e2e412f8465b83495d611f4b7ce2 P 47ec5c2bfdd24b1eb2a906f63214876e -> Peer b6ea3e3c1dd142c2a529707d9999b96d (127.12.174.129:34845): Couldn't send request to peer b6ea3e3c1dd142c2a529707d9999b96d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:23.692571 12986 tablet_replica.cc:333] T 04079c0c50104d67a18aaeb329e1e434 P b6ea3e3c1dd142c2a529707d9999b96d: stopping tablet replica
I20260709 12:15:23.693609 12986 raft_consensus.cc:2243] T 04079c0c50104d67a18aaeb329e1e434 P b6ea3e3c1dd142c2a529707d9999b96d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:23.694458 12986 raft_consensus.cc:2272] T 04079c0c50104d67a18aaeb329e1e434 P b6ea3e3c1dd142c2a529707d9999b96d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:23.698088 12986 tablet_replica.cc:333] T 0ced3f63513a4e0ba988e57453fcf32e P b6ea3e3c1dd142c2a529707d9999b96d: stopping tablet replica
I20260709 12:15:23.698726 12986 raft_consensus.cc:2243] T 0ced3f63513a4e0ba988e57453fcf32e P b6ea3e3c1dd142c2a529707d9999b96d [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:23.699857 12986 raft_consensus.cc:2272] T 0ced3f63513a4e0ba988e57453fcf32e P b6ea3e3c1dd142c2a529707d9999b96d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:23.702915 12986 tablet_replica.cc:333] T 51f64f6460364936b54245159e7025b6 P b6ea3e3c1dd142c2a529707d9999b96d: stopping tablet replica
I20260709 12:15:23.703526 12986 raft_consensus.cc:2243] T 51f64f6460364936b54245159e7025b6 P b6ea3e3c1dd142c2a529707d9999b96d [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:15:23.704876 12986 raft_consensus.cc:2272] T 51f64f6460364936b54245159e7025b6 P b6ea3e3c1dd142c2a529707d9999b96d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:23.708559 12986 tablet_replica.cc:333] T e18e3ddc9621480a960d88fb92a478c8 P b6ea3e3c1dd142c2a529707d9999b96d: stopping tablet replica
I20260709 12:15:23.709345 12986 raft_consensus.cc:2243] T e18e3ddc9621480a960d88fb92a478c8 P b6ea3e3c1dd142c2a529707d9999b96d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:23.710304 12986 raft_consensus.cc:2272] T e18e3ddc9621480a960d88fb92a478c8 P b6ea3e3c1dd142c2a529707d9999b96d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:23.713692 26251 consensus_peers.cc:597] T 61c63f2d508d492dab277021e7a3de0f P 47ec5c2bfdd24b1eb2a906f63214876e -> Peer b6ea3e3c1dd142c2a529707d9999b96d (127.12.174.129:34845): Couldn't send request to peer b6ea3e3c1dd142c2a529707d9999b96d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:23.713967 12986 tablet_replica.cc:333] T f7cde2085f2b4fa182c0126b08cc9dd5 P b6ea3e3c1dd142c2a529707d9999b96d: stopping tablet replica
I20260709 12:15:23.714713 12986 raft_consensus.cc:2243] T f7cde2085f2b4fa182c0126b08cc9dd5 P b6ea3e3c1dd142c2a529707d9999b96d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:23.715282 12986 raft_consensus.cc:2272] T f7cde2085f2b4fa182c0126b08cc9dd5 P b6ea3e3c1dd142c2a529707d9999b96d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:23.718202 12986 tablet_replica.cc:333] T e904f17eeb0846d3a6cefab2b07e3b4a P b6ea3e3c1dd142c2a529707d9999b96d: stopping tablet replica
I20260709 12:15:23.718847 12986 raft_consensus.cc:2243] T e904f17eeb0846d3a6cefab2b07e3b4a P b6ea3e3c1dd142c2a529707d9999b96d [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:15:23.719924 12986 raft_consensus.cc:2272] T e904f17eeb0846d3a6cefab2b07e3b4a P b6ea3e3c1dd142c2a529707d9999b96d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:23.722996 12986 tablet_replica.cc:333] T 2be4e2f97d1941a4a3fe4f0dc03bdc57 P b6ea3e3c1dd142c2a529707d9999b96d: stopping tablet replica
I20260709 12:15:23.723611 12986 raft_consensus.cc:2243] T 2be4e2f97d1941a4a3fe4f0dc03bdc57 P b6ea3e3c1dd142c2a529707d9999b96d [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:15:23.724870 12986 raft_consensus.cc:2272] T 2be4e2f97d1941a4a3fe4f0dc03bdc57 P b6ea3e3c1dd142c2a529707d9999b96d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:23.727914 12986 tablet_replica.cc:333] T 29fd96c2a5d34cbfbc04b6878fc1a9ae P b6ea3e3c1dd142c2a529707d9999b96d: stopping tablet replica
I20260709 12:15:23.728497 12986 raft_consensus.cc:2243] T 29fd96c2a5d34cbfbc04b6878fc1a9ae P b6ea3e3c1dd142c2a529707d9999b96d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:23.729259 12986 raft_consensus.cc:2272] T 29fd96c2a5d34cbfbc04b6878fc1a9ae P b6ea3e3c1dd142c2a529707d9999b96d [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:23.779619 26251 consensus_peers.cc:597] T ef313d7b9e734aae93e2ed571944bbaa P 47ec5c2bfdd24b1eb2a906f63214876e -> Peer b6ea3e3c1dd142c2a529707d9999b96d (127.12.174.129:34845): Couldn't send request to peer b6ea3e3c1dd142c2a529707d9999b96d. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:34845: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:23.782336 26325 consensus_peers.cc:597] T 739b1449642e40fb84a22a155ce21e59 P 29ab82db4b2a4da39ed4796200c235bd -> Peer b6ea3e3c1dd142c2a529707d9999b96d (127.12.174.129:34845): Couldn't send request to peer b6ea3e3c1dd142c2a529707d9999b96d. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:34845: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:23.783330 12986 tablet_server.cc:196] TabletServer@127.12.174.129:0 shutdown complete.
I20260709 12:15:23.838881 12986 tablet_server.cc:179] TabletServer@127.12.174.130:0 shutting down...
W20260709 12:15:23.869935 26251 consensus_peers.cc:597] T e5a4343a89b74e2394864cfa1b2a45ab P 47ec5c2bfdd24b1eb2a906f63214876e -> Peer b6ea3e3c1dd142c2a529707d9999b96d (127.12.174.129:34845): Couldn't send request to peer b6ea3e3c1dd142c2a529707d9999b96d. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:34845: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:23.872403 12986 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:15:23.873304 12986 tablet_replica.cc:333] T 3be8e2e412f8465b83495d611f4b7ce2 P 47ec5c2bfdd24b1eb2a906f63214876e: stopping tablet replica
I20260709 12:15:23.874352 12986 raft_consensus.cc:2243] T 3be8e2e412f8465b83495d611f4b7ce2 P 47ec5c2bfdd24b1eb2a906f63214876e [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:23.875494 12986 raft_consensus.cc:2272] T 3be8e2e412f8465b83495d611f4b7ce2 P 47ec5c2bfdd24b1eb2a906f63214876e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:23.878326 12986 tablet_replica.cc:333] T e5a4343a89b74e2394864cfa1b2a45ab P 47ec5c2bfdd24b1eb2a906f63214876e: stopping tablet replica
I20260709 12:15:23.879045 12986 raft_consensus.cc:2243] T e5a4343a89b74e2394864cfa1b2a45ab P 47ec5c2bfdd24b1eb2a906f63214876e [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:15:23.880072 12986 raft_consensus.cc:2272] T e5a4343a89b74e2394864cfa1b2a45ab P 47ec5c2bfdd24b1eb2a906f63214876e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:23.883423 12986 tablet_replica.cc:333] T d80bd7c3354c472eaaaf49cdd958e470 P 47ec5c2bfdd24b1eb2a906f63214876e: stopping tablet replica
I20260709 12:15:23.884243 12986 raft_consensus.cc:2243] T d80bd7c3354c472eaaaf49cdd958e470 P 47ec5c2bfdd24b1eb2a906f63214876e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:23.884979 12986 raft_consensus.cc:2272] T d80bd7c3354c472eaaaf49cdd958e470 P 47ec5c2bfdd24b1eb2a906f63214876e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:23.888342 12986 tablet_replica.cc:333] T ed22621a01e740fdb61fe0db7e9c77c6 P 47ec5c2bfdd24b1eb2a906f63214876e: stopping tablet replica
I20260709 12:15:23.889144 12986 raft_consensus.cc:2243] T ed22621a01e740fdb61fe0db7e9c77c6 P 47ec5c2bfdd24b1eb2a906f63214876e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:23.889853 12986 raft_consensus.cc:2272] T ed22621a01e740fdb61fe0db7e9c77c6 P 47ec5c2bfdd24b1eb2a906f63214876e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:23.892674 12986 tablet_replica.cc:333] T ef313d7b9e734aae93e2ed571944bbaa P 47ec5c2bfdd24b1eb2a906f63214876e: stopping tablet replica
I20260709 12:15:23.893370 12986 raft_consensus.cc:2243] T ef313d7b9e734aae93e2ed571944bbaa P 47ec5c2bfdd24b1eb2a906f63214876e [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:15:23.894595 12986 raft_consensus.cc:2272] T ef313d7b9e734aae93e2ed571944bbaa P 47ec5c2bfdd24b1eb2a906f63214876e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:23.897341 12986 tablet_replica.cc:333] T f31c0326c2bb48958872433822c1aa7c P 47ec5c2bfdd24b1eb2a906f63214876e: stopping tablet replica
I20260709 12:15:23.898030 12986 raft_consensus.cc:2243] T f31c0326c2bb48958872433822c1aa7c P 47ec5c2bfdd24b1eb2a906f63214876e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:23.898622 12986 raft_consensus.cc:2272] T f31c0326c2bb48958872433822c1aa7c P 47ec5c2bfdd24b1eb2a906f63214876e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:23.901712 12986 tablet_replica.cc:333] T 2be4e2f97d1941a4a3fe4f0dc03bdc57 P 47ec5c2bfdd24b1eb2a906f63214876e: stopping tablet replica
I20260709 12:15:23.902458 12986 raft_consensus.cc:2243] T 2be4e2f97d1941a4a3fe4f0dc03bdc57 P 47ec5c2bfdd24b1eb2a906f63214876e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:23.902988 12986 raft_consensus.cc:2272] T 2be4e2f97d1941a4a3fe4f0dc03bdc57 P 47ec5c2bfdd24b1eb2a906f63214876e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:23.905684 12986 tablet_replica.cc:333] T e904f17eeb0846d3a6cefab2b07e3b4a P 47ec5c2bfdd24b1eb2a906f63214876e: stopping tablet replica
I20260709 12:15:23.906352 12986 raft_consensus.cc:2243] T e904f17eeb0846d3a6cefab2b07e3b4a P 47ec5c2bfdd24b1eb2a906f63214876e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:23.906960 12986 raft_consensus.cc:2272] T e904f17eeb0846d3a6cefab2b07e3b4a P 47ec5c2bfdd24b1eb2a906f63214876e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:23.910665 12986 tablet_replica.cc:333] T 04079c0c50104d67a18aaeb329e1e434 P 47ec5c2bfdd24b1eb2a906f63214876e: stopping tablet replica
I20260709 12:15:23.912215 12986 raft_consensus.cc:2243] T 04079c0c50104d67a18aaeb329e1e434 P 47ec5c2bfdd24b1eb2a906f63214876e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:23.912923 12986 raft_consensus.cc:2272] T 04079c0c50104d67a18aaeb329e1e434 P 47ec5c2bfdd24b1eb2a906f63214876e [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:23.913025 26325 consensus_peers.cc:597] T 04079c0c50104d67a18aaeb329e1e434 P 29ab82db4b2a4da39ed4796200c235bd -> Peer b6ea3e3c1dd142c2a529707d9999b96d (127.12.174.129:34845): Couldn't send request to peer b6ea3e3c1dd142c2a529707d9999b96d. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:34845: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:23.915764 12986 tablet_replica.cc:333] T 5640177c765d4c7eace47afab24512cc P 47ec5c2bfdd24b1eb2a906f63214876e: stopping tablet replica
I20260709 12:15:23.916446 12986 raft_consensus.cc:2243] T 5640177c765d4c7eace47afab24512cc P 47ec5c2bfdd24b1eb2a906f63214876e [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:23.917488 12986 raft_consensus.cc:2272] T 5640177c765d4c7eace47afab24512cc P 47ec5c2bfdd24b1eb2a906f63214876e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:23.920135 12986 tablet_replica.cc:333] T 739b1449642e40fb84a22a155ce21e59 P 47ec5c2bfdd24b1eb2a906f63214876e: stopping tablet replica
I20260709 12:15:23.920722 12986 raft_consensus.cc:2243] T 739b1449642e40fb84a22a155ce21e59 P 47ec5c2bfdd24b1eb2a906f63214876e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:23.921234 12986 raft_consensus.cc:2272] T 739b1449642e40fb84a22a155ce21e59 P 47ec5c2bfdd24b1eb2a906f63214876e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:23.923686 12986 tablet_replica.cc:333] T 61c63f2d508d492dab277021e7a3de0f P 47ec5c2bfdd24b1eb2a906f63214876e: stopping tablet replica
I20260709 12:15:23.924338 12986 raft_consensus.cc:2243] T 61c63f2d508d492dab277021e7a3de0f P 47ec5c2bfdd24b1eb2a906f63214876e [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:15:23.925319 12986 raft_consensus.cc:2272] T 61c63f2d508d492dab277021e7a3de0f P 47ec5c2bfdd24b1eb2a906f63214876e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:23.927989 12986 tablet_replica.cc:333] T 8e274509d4a64b129aa342b697004bf1 P 47ec5c2bfdd24b1eb2a906f63214876e: stopping tablet replica
I20260709 12:15:23.928580 12986 raft_consensus.cc:2243] T 8e274509d4a64b129aa342b697004bf1 P 47ec5c2bfdd24b1eb2a906f63214876e [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:15:23.929836 12986 raft_consensus.cc:2272] T 8e274509d4a64b129aa342b697004bf1 P 47ec5c2bfdd24b1eb2a906f63214876e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:23.933228 12986 tablet_replica.cc:333] T 51f64f6460364936b54245159e7025b6 P 47ec5c2bfdd24b1eb2a906f63214876e: stopping tablet replica
I20260709 12:15:23.934247 12986 raft_consensus.cc:2243] T 51f64f6460364936b54245159e7025b6 P 47ec5c2bfdd24b1eb2a906f63214876e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:23.934984 12986 raft_consensus.cc:2272] T 51f64f6460364936b54245159e7025b6 P 47ec5c2bfdd24b1eb2a906f63214876e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:23.937662 12986 tablet_replica.cc:333] T 0ced3f63513a4e0ba988e57453fcf32e P 47ec5c2bfdd24b1eb2a906f63214876e: stopping tablet replica
I20260709 12:15:23.938345 12986 raft_consensus.cc:2243] T 0ced3f63513a4e0ba988e57453fcf32e P 47ec5c2bfdd24b1eb2a906f63214876e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:23.938848 12986 raft_consensus.cc:2272] T 0ced3f63513a4e0ba988e57453fcf32e P 47ec5c2bfdd24b1eb2a906f63214876e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:23.941341 12986 tablet_replica.cc:333] T 29fd96c2a5d34cbfbc04b6878fc1a9ae P 47ec5c2bfdd24b1eb2a906f63214876e: stopping tablet replica
I20260709 12:15:23.941933 12986 raft_consensus.cc:2243] T 29fd96c2a5d34cbfbc04b6878fc1a9ae P 47ec5c2bfdd24b1eb2a906f63214876e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:23.942451 12986 raft_consensus.cc:2272] T 29fd96c2a5d34cbfbc04b6878fc1a9ae P 47ec5c2bfdd24b1eb2a906f63214876e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:23.944839 12986 tablet_replica.cc:333] T e18e3ddc9621480a960d88fb92a478c8 P 47ec5c2bfdd24b1eb2a906f63214876e: stopping tablet replica
I20260709 12:15:23.945420 12986 raft_consensus.cc:2243] T e18e3ddc9621480a960d88fb92a478c8 P 47ec5c2bfdd24b1eb2a906f63214876e [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:23.946528 12986 raft_consensus.cc:2272] T e18e3ddc9621480a960d88fb92a478c8 P 47ec5c2bfdd24b1eb2a906f63214876e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:23.949051 12986 tablet_replica.cc:333] T f7cde2085f2b4fa182c0126b08cc9dd5 P 47ec5c2bfdd24b1eb2a906f63214876e: stopping tablet replica
I20260709 12:15:23.949579 12986 raft_consensus.cc:2243] T f7cde2085f2b4fa182c0126b08cc9dd5 P 47ec5c2bfdd24b1eb2a906f63214876e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:23.950084 12986 raft_consensus.cc:2272] T f7cde2085f2b4fa182c0126b08cc9dd5 P 47ec5c2bfdd24b1eb2a906f63214876e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:23.997656 12986 tablet_server.cc:196] TabletServer@127.12.174.130:0 shutdown complete.
W20260709 12:15:24.006804 26322 consensus_peers.cc:597] T 29fd96c2a5d34cbfbc04b6878fc1a9ae P 29ab82db4b2a4da39ed4796200c235bd -> Peer 47ec5c2bfdd24b1eb2a906f63214876e (127.12.174.130:43337): Couldn't send request to peer 47ec5c2bfdd24b1eb2a906f63214876e. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.130:43337: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:24.037019 26322 consensus_peers.cc:597] T 04079c0c50104d67a18aaeb329e1e434 P 29ab82db4b2a4da39ed4796200c235bd -> Peer 47ec5c2bfdd24b1eb2a906f63214876e (127.12.174.130:43337): Couldn't send request to peer 47ec5c2bfdd24b1eb2a906f63214876e. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.130:43337: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:24.056087 12986 tablet_server.cc:179] TabletServer@127.12.174.131:0 shutting down...
W20260709 12:15:24.065150 26325 consensus_peers.cc:597] T 29fd96c2a5d34cbfbc04b6878fc1a9ae P 29ab82db4b2a4da39ed4796200c235bd -> Peer b6ea3e3c1dd142c2a529707d9999b96d (127.12.174.129:34845): Couldn't send request to peer b6ea3e3c1dd142c2a529707d9999b96d. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.129:34845: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:24.070662 26322 consensus_peers.cc:597] T f7cde2085f2b4fa182c0126b08cc9dd5 P 29ab82db4b2a4da39ed4796200c235bd -> Peer 47ec5c2bfdd24b1eb2a906f63214876e (127.12.174.130:43337): Couldn't send request to peer 47ec5c2bfdd24b1eb2a906f63214876e. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.130:43337: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:24.088415 12986 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:15:24.089285 12986 tablet_replica.cc:333] T 3be8e2e412f8465b83495d611f4b7ce2 P 29ab82db4b2a4da39ed4796200c235bd: stopping tablet replica
I20260709 12:15:24.090190 12986 raft_consensus.cc:2243] T 3be8e2e412f8465b83495d611f4b7ce2 P 29ab82db4b2a4da39ed4796200c235bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:24.090830 12986 raft_consensus.cc:2272] T 3be8e2e412f8465b83495d611f4b7ce2 P 29ab82db4b2a4da39ed4796200c235bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:24.094097 12986 tablet_replica.cc:333] T e5a4343a89b74e2394864cfa1b2a45ab P 29ab82db4b2a4da39ed4796200c235bd: stopping tablet replica
I20260709 12:15:24.094901 12986 raft_consensus.cc:2243] T e5a4343a89b74e2394864cfa1b2a45ab P 29ab82db4b2a4da39ed4796200c235bd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:24.095599 12986 raft_consensus.cc:2272] T e5a4343a89b74e2394864cfa1b2a45ab P 29ab82db4b2a4da39ed4796200c235bd [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:24.097323 26322 consensus_peers.cc:597] T 739b1449642e40fb84a22a155ce21e59 P 29ab82db4b2a4da39ed4796200c235bd -> Peer 47ec5c2bfdd24b1eb2a906f63214876e (127.12.174.130:43337): Couldn't send request to peer 47ec5c2bfdd24b1eb2a906f63214876e. Status: Network error: Client connection negotiation failed: client connection to 127.12.174.130:43337: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:24.098866 12986 tablet_replica.cc:333] T ef313d7b9e734aae93e2ed571944bbaa P 29ab82db4b2a4da39ed4796200c235bd: stopping tablet replica
I20260709 12:15:24.099637 12986 raft_consensus.cc:2243] T ef313d7b9e734aae93e2ed571944bbaa P 29ab82db4b2a4da39ed4796200c235bd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:24.100222 12986 raft_consensus.cc:2272] T ef313d7b9e734aae93e2ed571944bbaa P 29ab82db4b2a4da39ed4796200c235bd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:24.102870 12986 tablet_replica.cc:333] T ed22621a01e740fdb61fe0db7e9c77c6 P 29ab82db4b2a4da39ed4796200c235bd: stopping tablet replica
I20260709 12:15:24.103684 12986 raft_consensus.cc:2243] T ed22621a01e740fdb61fe0db7e9c77c6 P 29ab82db4b2a4da39ed4796200c235bd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:24.104454 12986 raft_consensus.cc:2272] T ed22621a01e740fdb61fe0db7e9c77c6 P 29ab82db4b2a4da39ed4796200c235bd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:24.107550 12986 tablet_replica.cc:333] T d80bd7c3354c472eaaaf49cdd958e470 P 29ab82db4b2a4da39ed4796200c235bd: stopping tablet replica
I20260709 12:15:24.108256 12986 raft_consensus.cc:2243] T d80bd7c3354c472eaaaf49cdd958e470 P 29ab82db4b2a4da39ed4796200c235bd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:24.108808 12986 raft_consensus.cc:2272] T d80bd7c3354c472eaaaf49cdd958e470 P 29ab82db4b2a4da39ed4796200c235bd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:24.111323 12986 tablet_replica.cc:333] T f31c0326c2bb48958872433822c1aa7c P 29ab82db4b2a4da39ed4796200c235bd: stopping tablet replica
I20260709 12:15:24.111955 12986 raft_consensus.cc:2243] T f31c0326c2bb48958872433822c1aa7c P 29ab82db4b2a4da39ed4796200c235bd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:24.112538 12986 raft_consensus.cc:2272] T f31c0326c2bb48958872433822c1aa7c P 29ab82db4b2a4da39ed4796200c235bd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:24.115103 12986 tablet_replica.cc:333] T 2be4e2f97d1941a4a3fe4f0dc03bdc57 P 29ab82db4b2a4da39ed4796200c235bd: stopping tablet replica
I20260709 12:15:24.115700 12986 raft_consensus.cc:2243] T 2be4e2f97d1941a4a3fe4f0dc03bdc57 P 29ab82db4b2a4da39ed4796200c235bd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:24.116248 12986 raft_consensus.cc:2272] T 2be4e2f97d1941a4a3fe4f0dc03bdc57 P 29ab82db4b2a4da39ed4796200c235bd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:24.118777 12986 tablet_replica.cc:333] T e904f17eeb0846d3a6cefab2b07e3b4a P 29ab82db4b2a4da39ed4796200c235bd: stopping tablet replica
I20260709 12:15:24.119379 12986 raft_consensus.cc:2243] T e904f17eeb0846d3a6cefab2b07e3b4a P 29ab82db4b2a4da39ed4796200c235bd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:24.119896 12986 raft_consensus.cc:2272] T e904f17eeb0846d3a6cefab2b07e3b4a P 29ab82db4b2a4da39ed4796200c235bd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:24.122305 12986 tablet_replica.cc:333] T 04079c0c50104d67a18aaeb329e1e434 P 29ab82db4b2a4da39ed4796200c235bd: stopping tablet replica
I20260709 12:15:24.122968 12986 raft_consensus.cc:2243] T 04079c0c50104d67a18aaeb329e1e434 P 29ab82db4b2a4da39ed4796200c235bd [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:15:24.123970 12986 raft_consensus.cc:2272] T 04079c0c50104d67a18aaeb329e1e434 P 29ab82db4b2a4da39ed4796200c235bd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:24.126541 12986 tablet_replica.cc:333] T 5640177c765d4c7eace47afab24512cc P 29ab82db4b2a4da39ed4796200c235bd: stopping tablet replica
I20260709 12:15:24.127178 12986 raft_consensus.cc:2243] T 5640177c765d4c7eace47afab24512cc P 29ab82db4b2a4da39ed4796200c235bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:24.127662 12986 raft_consensus.cc:2272] T 5640177c765d4c7eace47afab24512cc P 29ab82db4b2a4da39ed4796200c235bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:24.130088 12986 tablet_replica.cc:333] T 8e274509d4a64b129aa342b697004bf1 P 29ab82db4b2a4da39ed4796200c235bd: stopping tablet replica
I20260709 12:15:24.130708 12986 raft_consensus.cc:2243] T 8e274509d4a64b129aa342b697004bf1 P 29ab82db4b2a4da39ed4796200c235bd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:24.131285 12986 raft_consensus.cc:2272] T 8e274509d4a64b129aa342b697004bf1 P 29ab82db4b2a4da39ed4796200c235bd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:24.133674 12986 tablet_replica.cc:333] T 29fd96c2a5d34cbfbc04b6878fc1a9ae P 29ab82db4b2a4da39ed4796200c235bd: stopping tablet replica
I20260709 12:15:24.134441 12986 raft_consensus.cc:2243] T 29fd96c2a5d34cbfbc04b6878fc1a9ae P 29ab82db4b2a4da39ed4796200c235bd [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:15:24.135473 12986 raft_consensus.cc:2272] T 29fd96c2a5d34cbfbc04b6878fc1a9ae P 29ab82db4b2a4da39ed4796200c235bd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:24.138041 12986 tablet_replica.cc:333] T 51f64f6460364936b54245159e7025b6 P 29ab82db4b2a4da39ed4796200c235bd: stopping tablet replica
I20260709 12:15:24.138692 12986 raft_consensus.cc:2243] T 51f64f6460364936b54245159e7025b6 P 29ab82db4b2a4da39ed4796200c235bd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:24.139225 12986 raft_consensus.cc:2272] T 51f64f6460364936b54245159e7025b6 P 29ab82db4b2a4da39ed4796200c235bd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:24.141606 12986 tablet_replica.cc:333] T 0ced3f63513a4e0ba988e57453fcf32e P 29ab82db4b2a4da39ed4796200c235bd: stopping tablet replica
I20260709 12:15:24.142297 12986 raft_consensus.cc:2243] T 0ced3f63513a4e0ba988e57453fcf32e P 29ab82db4b2a4da39ed4796200c235bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:24.142838 12986 raft_consensus.cc:2272] T 0ced3f63513a4e0ba988e57453fcf32e P 29ab82db4b2a4da39ed4796200c235bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:24.145295 12986 tablet_replica.cc:333] T 739b1449642e40fb84a22a155ce21e59 P 29ab82db4b2a4da39ed4796200c235bd: stopping tablet replica
I20260709 12:15:24.145905 12986 raft_consensus.cc:2243] T 739b1449642e40fb84a22a155ce21e59 P 29ab82db4b2a4da39ed4796200c235bd [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:24.146924 12986 raft_consensus.cc:2272] T 739b1449642e40fb84a22a155ce21e59 P 29ab82db4b2a4da39ed4796200c235bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:24.149501 12986 tablet_replica.cc:333] T 61c63f2d508d492dab277021e7a3de0f P 29ab82db4b2a4da39ed4796200c235bd: stopping tablet replica
I20260709 12:15:24.150130 12986 raft_consensus.cc:2243] T 61c63f2d508d492dab277021e7a3de0f P 29ab82db4b2a4da39ed4796200c235bd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:24.150672 12986 raft_consensus.cc:2272] T 61c63f2d508d492dab277021e7a3de0f P 29ab82db4b2a4da39ed4796200c235bd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:24.153124 12986 tablet_replica.cc:333] T e18e3ddc9621480a960d88fb92a478c8 P 29ab82db4b2a4da39ed4796200c235bd: stopping tablet replica
I20260709 12:15:24.153695 12986 raft_consensus.cc:2243] T e18e3ddc9621480a960d88fb92a478c8 P 29ab82db4b2a4da39ed4796200c235bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:24.154253 12986 raft_consensus.cc:2272] T e18e3ddc9621480a960d88fb92a478c8 P 29ab82db4b2a4da39ed4796200c235bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:24.156756 12986 tablet_replica.cc:333] T f7cde2085f2b4fa182c0126b08cc9dd5 P 29ab82db4b2a4da39ed4796200c235bd: stopping tablet replica
I20260709 12:15:24.157294 12986 raft_consensus.cc:2243] T f7cde2085f2b4fa182c0126b08cc9dd5 P 29ab82db4b2a4da39ed4796200c235bd [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:15:24.158262 12986 raft_consensus.cc:2272] T f7cde2085f2b4fa182c0126b08cc9dd5 P 29ab82db4b2a4da39ed4796200c235bd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:24.204838 12986 tablet_server.cc:196] TabletServer@127.12.174.131:0 shutdown complete.
I20260709 12:15:24.252843 12986 master.cc:562] Master@127.12.174.190:44777 shutting down...
I20260709 12:15:24.282754 12986 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 7afd9fe5d8ed452893c9113fd5ea3eb7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:24.283557 12986 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 7afd9fe5d8ed452893c9113fd5ea3eb7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:24.283948 12986 tablet_replica.cc:333] T 00000000000000000000000000000000 P 7afd9fe5d8ed452893c9113fd5ea3eb7: stopping tablet replica
I20260709 12:15:24.306883 12986 master.cc:584] Master@127.12.174.190:44777 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (21032 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (44224 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (437964 ms total)
[  PASSED  ] 7 tests.
[  FAILED  ] 1 test, listed below:
[  FAILED  ] LeaderRebalancerTest.AddTserver

 1 FAILED TEST
I20260709 12:15:24.372089 12986 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 2219 messages since previous log ~32 seconds ago
I20260709 12:15:24.372364 12986 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 2229 messages since previous log ~32 seconds ago
I20260709 12:15:24.372542 12986 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 2229 messages since previous log ~32 seconds ago
I20260709 12:15:24.372757 12986 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~55 seconds ago
I20260709 12:15:24.372946 12986 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~55 seconds ago
I20260709 12:15:24.373204 12986 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 4 messages since previous log ~147 seconds ago
I20260709 12:15:24.373508 12986 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 13 messages since previous log ~0 seconds ago
I20260709 12:15:24.373718 12986 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 53 messages since previous log ~19 seconds ago
